2024-03-12T15:41:05.343 INFO:root:teuthology version: 0.0.1.dev262+ge691533 2024-03-12T15:41:05.343 DEBUG:teuthology.run:Teuthology command: teuthology --description fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} --owner scheduled_yuriw@teuthology --name yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi --verbose --archive /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640 -- /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640/orig.config.yaml 2024-03-12T15:41:05.396 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T15:41:05.489 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640 branch: wip-yuri11-testing-2024-03-11-0838-reef description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} email: yweinste@redhat.com first_in_suite: false job_id: '7593640' kernel: kdb: true sha1: distro last_in_suite: false machine_type: smithi meta: - desc: 'setup ceph/pacific ' name: yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi no_nested_subset: false nuke-on-error: true os_type: centos os_version: 8.stream overrides: admin_socket: branch: wip-yuri11-testing-2024-03-11-0838-reef ceph: conf: client: client mount timeout: 600 debug client: 20 debug ms: 1 rados mon op timeout: 900 rados osd op timeout: 900 global: mon pg warn min per osd: 0 mds: debug mds: 20 debug mds balancer: 20 debug ms: 1 mds debug frag: true mds debug scatterstat: true mds op complaint time: 180 mds verify scatter: true osd op complaint time: 180 rados mon op timeout: 900 rados osd op timeout: 900 mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 mon op complaint time: 120 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore osd op complaint time: 180 flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - FS_DEGRADED - FS_INLINE_DATA_DEPRECATED - FS_WITH_FAILED_MDS - MDS_ALL_DOWN - MDS_DAMAGE - MDS_DEGRADED - MDS_FAILED - MDS_INSUFFICIENT_STANDBY - MDS_UP_LESS_THAN_MAX - POOL_APP_NOT_ENABLED - overall HEALTH_ - Replacing daemon - OSD_DOWN - overall HEALTH_ - \(OSD_DOWN\) - \(OSD_ - but it is still running - is not responding sha1: 49e4a6794d5502bd66908faf714fc54896c51712 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 49e4a6794d5502bd66908faf714fc54896c51712 kclient: syntax: v1 selinux: whitelist: - scontext=system_u:system_r:logrotate_t:s0 thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuri11-testing-2024-03-11-0838-reef sha1: 49e4a6794d5502bd66908faf714fc54896c51712 owner: scheduled_yuriw@teuthology priority: 71 repo: https://github.com/ceph/ceph-ci.git roles: - - host.a - client.0 - osd.0 - osd.1 - osd.2 - - host.b - client.1 - osd.3 - osd.4 - osd.5 seed: 9096 sha1: 49e4a6794d5502bd66908faf714fc54896c51712 sleep_before_teardown: 0 subset: 111/120000 suite: fs suite_branch: wip-yuri11-testing-2024-03-11-0838-reef suite_path: /home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa suite_relpath: qa suite_repo: https://github.com/ceph/ceph-ci.git suite_sha1: 49e4a6794d5502bd66908faf714fc54896c51712 targets: smithi006.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/8geieGzvcccyabxwJDW1GF/3Yi6gLib589imOauAjgMjGkbfLx2Z1AxkRt717Ov7EmcixmeHXI3aN5cn6tlo= smithi134.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCKv+ws9DevildNnkJO/shSslHwTUggX9SVna4RVVaWEEsjNJzuneJ8TscB9BBDbeZaqDzt8GUb9V/0andMGjr4= tasks: - pexec: all: - sudo cp /etc/containers/registries.conf /etc/containers/registries.conf.backup - sudo dnf -y module reset container-tools - sudo dnf -y module install container-tools --allowerasing --nobest - sudo cp /etc/containers/registries.conf.backup /etc/containers/registries.conf - install: branch: pacific exclude_packages: - ceph-volume - print: '**** done install task...' - cephadm: cephadm_branch: pacific cephadm_git_url: https://github.com/ceph/ceph conf: osd: osd_class_default_list: '*' osd_class_load_list: '*' image: quay.ceph.io/ceph-ci/ceph:pacific roleless: true - print: '**** done end installing pacific cephadm ...' - cephadm.shell: host.a: - ceph config set mgr mgr/cephadm/use_repo_digest true --force - print: '**** done cephadm.shell ceph config set mgr...' - cephadm.shell: host.a: - ceph orch status - ceph orch ps - ceph orch ls - ceph orch host ls - ceph orch device ls - cephadm.shell: host.a: - ceph fs volume create cephfs --placement=4 - ceph fs dump - cephadm.shell: host.a: - ceph fs set cephfs max_mds 2 - cephadm.shell: host.a: - ceph fs set cephfs allow_standby_replay false - cephadm.shell: host.a: - ceph fs set cephfs inline_data false - cephadm.shell: host.a: - ceph fs dump - ceph --format=json fs dump | jq -e ".filesystems | length == 1" - while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done - fs.pre_upgrade_save: null - ceph-fuse: null - print: '**** done client' - parallel: - upgrade-tasks - workload-tasks - cephadm.shell: host.a: - ceph fs dump - fs.post_upgrade_checks: null teuthology: fragments_dropped: [] meta: {} postmerge: [] variables: fail_fs: true teuthology_branch: main teuthology_sha1: e691533f9cbb33d85b2187bba20d7102f098636d timestamp: 2024-03-12_14:59:27 tube: smithi upgrade-tasks: sequential: - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch ps - cephadm.shell: env: - sha1 host.a: - ceph config set mgr mgr/orchestrator/fail_fs true - cephadm.shell: env: - sha1 host.a: - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 host.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph orch upgrade status - ceph health detail - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 user: yuriw verbose: true worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2226885 workload-tasks: sequential: - workunit: clients: all: - suites/fsstress.sh 2024-03-12T15:41:05.489 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa; will attempt to use it 2024-03-12T15:41:05.490 INFO:teuthology.run:Found tasks at /home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks 2024-03-12T15:41:05.490 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-03-12T15:41:05.492 INFO:teuthology.task.internal:Checking packages... 2024-03-12T15:41:05.546 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '49e4a6794d5502bd66908faf714fc54896c51712' 2024-03-12T15:41:05.546 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-12T15:41:05.546 INFO:teuthology.packaging:ref: None 2024-03-12T15:41:05.546 INFO:teuthology.packaging:tag: None 2024-03-12T15:41:05.547 INFO:teuthology.packaging:branch: wip-yuri11-testing-2024-03-11-0838-reef 2024-03-12T15:41:05.547 INFO:teuthology.packaging:sha1: 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T15:41:05.547 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=wip-yuri11-testing-2024-03-11-0838-reef 2024-03-12T15:41:05.686 INFO:teuthology.task.internal:Found packages for ceph version 18.2.2-797.g49e4a679 2024-03-12T15:41:05.688 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-03-12T15:41:05.693 INFO:teuthology.task.internal:no buildpackages task found 2024-03-12T15:41:05.693 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-03-12T15:41:05.710 INFO:teuthology.task.internal:Saving configuration 2024-03-12T15:41:05.729 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-03-12T15:41:05.737 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-12T15:41:05.760 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-12 15:36:08.609279', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/8geieGzvcccyabxwJDW1GF/3Yi6gLib589imOauAjgMjGkbfLx2Z1AxkRt717Ov7EmcixmeHXI3aN5cn6tlo='} 2024-03-12T15:41:05.782 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-12 15:36:08.611131', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCKv+ws9DevildNnkJO/shSslHwTUggX9SVna4RVVaWEEsjNJzuneJ8TscB9BBDbeZaqDzt8GUb9V/0andMGjr4='} 2024-03-12T15:41:05.783 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-03-12T15:41:05.789 INFO:teuthology.task.internal:roles: ubuntu@smithi006.front.sepia.ceph.com - ['host.a', 'client.0', 'osd.0', 'osd.1', 'osd.2'] 2024-03-12T15:41:05.790 INFO:teuthology.task.internal:roles: ubuntu@smithi134.front.sepia.ceph.com - ['host.b', 'client.1', 'osd.3', 'osd.4', 'osd.5'] 2024-03-12T15:41:05.790 INFO:teuthology.run_tasks:Running task console_log... 2024-03-12T15:41:05.860 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fb673f90160>, signals=[15]) 2024-03-12T15:41:05.861 INFO:teuthology.run_tasks:Running task internal.connect... 2024-03-12T15:41:05.869 INFO:teuthology.task.internal:Opening connections... 2024-03-12T15:41:05.869 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T15:41:05.870 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:41:05.943 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi134.front.sepia.ceph.com 2024-03-12T15:41:05.944 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:41:06.014 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-03-12T15:41:06.022 DEBUG:teuthology.orchestra.run.smithi006:> uname -m 2024-03-12T15:41:06.045 INFO:teuthology.orchestra.run.smithi006.stdout:x86_64 2024-03-12T15:41:06.045 DEBUG:teuthology.orchestra.run.smithi006:> cat /etc/os-release 2024-03-12T15:41:06.107 INFO:teuthology.orchestra.run.smithi006.stdout:NAME="CentOS Stream" 2024-03-12T15:41:06.107 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION="8" 2024-03-12T15:41:06.107 INFO:teuthology.orchestra.run.smithi006.stdout:ID="centos" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:ID_LIKE="rhel fedora" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:VERSION_ID="8" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:PLATFORM_ID="platform:el8" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:ANSI_COLOR="0;31" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:HOME_URL="https://centos.org/" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-12T15:41:06.108 INFO:teuthology.orchestra.run.smithi006.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T15:41:06.109 INFO:teuthology.lock.ops:Updating smithi006.front.sepia.ceph.com on lock server 2024-03-12T15:41:06.133 DEBUG:teuthology.orchestra.run.smithi134:> uname -m 2024-03-12T15:41:06.155 INFO:teuthology.orchestra.run.smithi134.stdout:x86_64 2024-03-12T15:41:06.156 DEBUG:teuthology.orchestra.run.smithi134:> cat /etc/os-release 2024-03-12T15:41:06.216 INFO:teuthology.orchestra.run.smithi134.stdout:NAME="CentOS Stream" 2024-03-12T15:41:06.216 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION="8" 2024-03-12T15:41:06.216 INFO:teuthology.orchestra.run.smithi134.stdout:ID="centos" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:ID_LIKE="rhel fedora" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:VERSION_ID="8" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:PLATFORM_ID="platform:el8" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:PRETTY_NAME="CentOS Stream 8" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:ANSI_COLOR="0;31" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:CPE_NAME="cpe:/o:centos:centos:8" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:HOME_URL="https://centos.org/" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 8" 2024-03-12T15:41:06.217 INFO:teuthology.orchestra.run.smithi134.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-03-12T15:41:06.217 INFO:teuthology.lock.ops:Updating smithi134.front.sepia.ceph.com on lock server 2024-03-12T15:41:06.242 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-03-12T15:41:06.252 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-03-12T15:41:06.266 INFO:teuthology.task.internal:Checking for old test directory... 2024-03-12T15:41:06.266 DEBUG:teuthology.orchestra.run.smithi006:> test '!' -e /home/ubuntu/cephtest 2024-03-12T15:41:06.269 DEBUG:teuthology.orchestra.run.smithi134:> test '!' -e /home/ubuntu/cephtest 2024-03-12T15:41:06.289 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-03-12T15:41:06.300 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-03-12T15:41:06.300 DEBUG:teuthology.orchestra.run.smithi006:> test -z $(ls -A /var/lib/ceph) 2024-03-12T15:41:06.330 DEBUG:teuthology.orchestra.run.smithi134:> test -z $(ls -A /var/lib/ceph) 2024-03-12T15:41:06.358 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-03-12T15:41:06.423 INFO:teuthology.run_tasks:Running task kernel... 2024-03-12T15:41:06.439 INFO:teuthology.task.kernel:normalize config orig: {'kdb': True, 'sha1': 'distro'} 2024-03-12T15:41:06.439 INFO:teuthology.task.kernel:config {'host.a': {'kdb': True, 'sha1': 'distro'}, 'host.b': {'kdb': True, 'sha1': 'distro'}}, timeout 300 2024-03-12T15:41:06.440 DEBUG:teuthology.orchestra.run.smithi006:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-12T15:41:06.440 DEBUG:teuthology.orchestra.run.smithi134:> test -f /run/.containerenv -o -f /.dockerenv 2024-03-12T15:41:06.459 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T15:41:06.460 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-03-12T15:41:06.461 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T15:41:06.461 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-03-12T15:41:06.520 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-489.el8.x86_64 2024-03-12T15:41:06.520 INFO:teuthology.task.kernel:Running kernel on smithi134: 4.18.0-489.el8.x86_64 2024-03-12T15:41:06.521 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum install -y kernel 2024-03-12T15:41:06.523 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-489.el8.x86_64 2024-03-12T15:41:06.523 INFO:teuthology.task.kernel:Running kernel on smithi006: 4.18.0-489.el8.x86_64 2024-03-12T15:41:06.524 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum install -y kernel 2024-03-12T15:41:13.572 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - AppStream 6.1 MB/s | 28 MB 00:04 2024-03-12T15:41:21.205 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - AppStream 2.3 MB/s | 28 MB 00:12 2024-03-12T15:41:47.877 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - BaseOS 485 kB/s | 10 MB 00:21 2024-03-12T15:41:49.860 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras 49 kB/s | 18 kB 00:00 2024-03-12T15:41:50.353 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras common packages 19 kB/s | 7.2 kB 00:00 2024-03-12T15:41:50.469 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - BaseOS 333 kB/s | 10 MB 00:31 2024-03-12T15:41:50.587 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 24 kB/s | 3.5 kB 00:00 2024-03-12T15:41:52.098 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 11 MB/s | 16 MB 00:01 2024-03-12T15:41:52.403 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - Extras 82 kB/s | 18 kB 00:00 2024-03-12T15:41:52.945 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 7.2 kB 00:00 2024-03-12T15:41:53.205 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 22 kB/s | 3.5 kB 00:00 2024-03-12T15:41:54.298 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 16 MB/s | 16 MB 00:00 2024-03-12T15:41:55.855 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 407 kB/s | 24 kB 00:00 2024-03-12T15:41:58.231 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 439 kB/s | 24 kB 00:00 2024-03-12T15:41:58.935 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-03-12T15:41:58.935 INFO:teuthology.orchestra.run.smithi134.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-03-12T15:41:59.055 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:41:59.056 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:41:59.056 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-03-12T15:41:59.057 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:41:59.057 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:41:59.057 INFO:teuthology.orchestra.run.smithi134.stdout: kernel x86_64 4.18.0-544.el8 baseos 10 M 2024-03-12T15:41:59.057 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:41:59.057 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-core x86_64 4.18.0-544.el8 baseos 44 M 2024-03-12T15:41:59.057 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules x86_64 4.18.0-544.el8 baseos 36 M 2024-03-12T15:41:59.058 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:41:59.058 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:41:59.058 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:41:59.058 INFO:teuthology.orchestra.run.smithi134.stdout:Install 3 Packages 2024-03-12T15:41:59.058 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:41:59.058 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 90 M 2024-03-12T15:41:59.058 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 97 M 2024-03-12T15:41:59.058 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:42:01.437 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-348.el8.x86_64 is already installed. 2024-03-12T15:42:01.437 INFO:teuthology.orchestra.run.smithi006.stdout:Package kernel-4.18.0-489.el8.x86_64 is already installed. 2024-03-12T15:42:01.540 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:42:01.540 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:42:01.540 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: kernel x86_64 4.18.0-544.el8 baseos 10 M 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-core x86_64 4.18.0-544.el8 baseos 44 M 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules x86_64 4.18.0-544.el8 baseos 36 M 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout:Install 3 Packages 2024-03-12T15:42:01.541 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:42:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 90 M 2024-03-12T15:42:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 97 M 2024-03-12T15:42:01.542 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:42:29.878 INFO:teuthology.orchestra.run.smithi134.stdout:(1/3): kernel-4.18.0-544.el8.x86_64.rpm 344 kB/s | 10 MB 00:30 2024-03-12T15:42:32.630 INFO:teuthology.orchestra.run.smithi006.stdout:(1/3): kernel-4.18.0-544.el8.x86_64.rpm 343 kB/s | 10 MB 00:30 2024-03-12T15:44:14.379 INFO:teuthology.orchestra.run.smithi006.stdout:(2/3): kernel-core-4.18.0-544.el8.x86_64.rpm 337 kB/s | 44 MB 02:12 2024-03-12T15:44:27.961 INFO:teuthology.orchestra.run.smithi006.stdout:(3/3): kernel-modules-4.18.0-544.el8.x86_64.rpm 255 kB/s | 36 MB 02:26 2024-03-12T15:44:27.961 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:44:27.961 INFO:teuthology.orchestra.run.smithi006.stdout:Total 632 kB/s | 90 MB 02:26 2024-03-12T15:44:28.678 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:44:29.120 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:44:29.120 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:44:30.431 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:44:30.464 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:44:33.455 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:44:33.947 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-12T15:44:37.654 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-12T15:44:38.064 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-12T15:44:41.745 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-12T15:44:42.033 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : kernel-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:45:05.624 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:45:05.647 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:45:06.065 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: kernel-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:45:06.066 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-4.18.0-544.el8.x86_64 1/3 2024-03-12T15:45:06.066 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-core-4.18.0-544.el8.x86_64 2/3 2024-03-12T15:45:06.596 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:45:06.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:45:06.597 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:45:06.597 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-4.18.0-544.el8.x86_64 kernel-core-4.18.0-544.el8.x86_64 2024-03-12T15:45:06.597 INFO:teuthology.orchestra.run.smithi006.stdout: kernel-modules-4.18.0-544.el8.x86_64 2024-03-12T15:45:06.597 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:45:06.597 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:45:06.756 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-03-12T15:45:06.981 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-12T15:45:06.981 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-12T15:45:06.982 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-544.el8.x86_64 2024-03-12T15:45:06.982 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-12T15:45:06.982 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-12T15:45:06.982 INFO:teuthology.task.kernel:Installing distro kernel on host.a... 2024-03-12T15:45:06.982 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi006.front.sepia.ceph.com, path=None, version=distro) 2024-03-12T15:45:06.982 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q kernel | sort -rV | head -n 1 2024-03-12T15:45:07.039 INFO:teuthology.orchestra.run.smithi134.stdout:(2/3): kernel-core-4.18.0-544.el8.x86_64.rpm 238 kB/s | 44 MB 03:07 2024-03-12T15:45:07.201 INFO:teuthology.orchestra.run.smithi006.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-12T15:45:07.202 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-12T15:45:07.202 DEBUG:teuthology.orchestra.run.smithi006:> sudo rpm -qi grub2-tools 2024-03-12T15:45:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:Name : grub2-tools 2024-03-12T15:45:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:Epoch : 1 2024-03-12T15:45:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:Version : 2.02 2024-03-12T15:45:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:Release : 129.el8 2024-03-12T15:45:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:Architecture: x86_64 2024-03-12T15:45:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-03-12T15:45:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:Group : System Environment/Base 2024-03-12T15:45:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:Size : 9265586 2024-03-12T15:45:07.237 INFO:teuthology.orchestra.run.smithi006.stdout:License : GPLv3+ 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:Build Host : kbuilder.bsys.centos.org 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:Relocations : (not relocatable) 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:Packager : CentOS BuildSystem 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:Vendor : CentOS 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:Summary : Support tools for GRUB. 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:Description : 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-12T15:45:07.238 INFO:teuthology.orchestra.run.smithi006.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-12T15:45:07.239 INFO:teuthology.orchestra.run.smithi006.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-12T15:45:07.239 INFO:teuthology.orchestra.run.smithi006.stdout:hardware devices. 2024-03-12T15:45:07.239 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:45:07.239 INFO:teuthology.orchestra.run.smithi006.stdout:This subpackage provides tools for support of all platforms. 2024-03-12T15:45:07.240 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-12T15:45:07.240 INFO:teuthology.task.kernel:Updating grub on smithi006 to boot 4.18.0-544.el8.x86_64 2024-03-12T15:45:07.240 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-12T15:45:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:Generating grub configuration file ... 2024-03-12T15:45:10.332 INFO:teuthology.orchestra.run.smithi006.stderr:done 2024-03-12T15:45:10.333 DEBUG:teuthology.orchestra.run.smithi006:> mktemp 2024-03-12T15:45:10.404 INFO:teuthology.orchestra.run.smithi006.stdout:/tmp/tmp.Him5ElPYhM 2024-03-12T15:45:10.404 DEBUG:teuthology.orchestra.run.smithi006:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Him5ElPYhM 2024-03-12T15:45:10.477 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0666 /tmp/tmp.Him5ElPYhM 2024-03-12T15:45:10.624 DEBUG:teuthology.orchestra.remote:smithi006:/tmp/tmp.Him5ElPYhM is 6KB 2024-03-12T15:45:10.672 DEBUG:teuthology.orchestra.run.smithi006:> rm -fr /tmp/tmp.Him5ElPYhM 2024-03-12T15:45:10.690 DEBUG:teuthology.orchestra.run.smithi006:> sudo /bin/ls /boot/loader/entries || true 2024-03-12T15:45:10.760 INFO:teuthology.orchestra.run.smithi006.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-03-12T15:45:10.760 INFO:teuthology.orchestra.run.smithi006.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-03-12T15:45:10.761 INFO:teuthology.orchestra.run.smithi006.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-03-12T15:45:10.761 INFO:teuthology.orchestra.run.smithi006.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64.conf 2024-03-12T15:45:10.762 DEBUG:teuthology.orchestra.run.smithi006:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64 2024-03-12T15:45:10.925 DEBUG:teuthology.orchestra.run.smithi006:> sudo shutdown -r now 2024-03-12T15:45:36.694 INFO:teuthology.orchestra.run.smithi134.stdout:(3/3): kernel-modules-4.18.0-544.el8.x86_64.rpm 171 kB/s | 36 MB 03:37 2024-03-12T15:45:36.694 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:45:36.694 INFO:teuthology.orchestra.run.smithi134.stdout:Total 425 kB/s | 90 MB 03:37 2024-03-12T15:45:37.378 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:45:37.795 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:45:37.795 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:45:39.033 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:45:39.062 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:45:40.928 INFO:teuthology.task.kernel:Checking client host.a for new kernel version... 2024-03-12T15:45:40.928 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-03-12T15:45:40.929 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:45:41.863 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:45:42.407 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-12T15:45:45.942 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 1/3 2024-03-12T15:45:46.373 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-12T15:45:49.811 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 2/3 2024-03-12T15:45:50.095 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : kernel-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:45:59.326 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.6 2024-03-12T15:46:08.327 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-03-12T15:46:08.328 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:46:11.913 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-core-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:46:11.935 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:46:12.285 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: kernel-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:46:12.286 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-4.18.0-544.el8.x86_64 1/3 2024-03-12T15:46:12.286 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-core-4.18.0-544.el8.x86_64 2/3 2024-03-12T15:46:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : kernel-modules-4.18.0-544.el8.x86_64 3/3 2024-03-12T15:46:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:46:12.782 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:46:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-4.18.0-544.el8.x86_64 kernel-core-4.18.0-544.el8.x86_64 2024-03-12T15:46:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: kernel-modules-4.18.0-544.el8.x86_64 2024-03-12T15:46:12.782 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:46:12.782 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:46:12.951 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-03-12T15:46:13.170 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-12T15:46:13.170 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-12T15:46:13.170 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 4.18.0-489.el8.x86_64 Expected: 4.18.0-544.el8.x86_64 2024-03-12T15:46:13.170 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-03-12T15:46:13.171 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-03-12T15:46:13.171 INFO:teuthology.task.kernel:Installing distro kernel on host.b... 2024-03-12T15:46:13.171 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi134.front.sepia.ceph.com, path=None, version=distro) 2024-03-12T15:46:13.171 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q kernel | sort -rV | head -n 1 2024-03-12T15:46:13.382 INFO:teuthology.orchestra.run.smithi134.stdout:kernel-4.18.0-544.el8.x86_64 2024-03-12T15:46:13.382 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 4.18.0-544.el8.x86_64 2024-03-12T15:46:13.383 DEBUG:teuthology.orchestra.run.smithi134:> sudo rpm -qi grub2-tools 2024-03-12T15:46:13.415 INFO:teuthology.orchestra.run.smithi134.stdout:Name : grub2-tools 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Epoch : 1 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Version : 2.02 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Release : 129.el8 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Architecture: x86_64 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Install Date: Thu 04 May 2023 10:17:48 PM UTC 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Group : System Environment/Base 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Size : 9265586 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:License : GPLv3+ 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Signature : RSA/SHA256, Tue 19 Jul 2022 02:52:06 PM UTC, Key ID 05b555b38483c65d 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Source RPM : grub2-2.02-129.el8.src.rpm 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Build Date : Tue 19 Jul 2022 02:30:39 PM UTC 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Build Host : kbuilder.bsys.centos.org 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Relocations : (not relocatable) 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Packager : CentOS BuildSystem 2024-03-12T15:46:13.416 INFO:teuthology.orchestra.run.smithi134.stdout:Vendor : CentOS 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:URL : http://www.gnu.org/software/grub/ 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:Summary : Support tools for GRUB. 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:Description : 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:customizable bootloader with modular architecture. It supports a rich 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:variety of kernel formats, file systems, computer architectures and 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:hardware devices. 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:46:13.417 INFO:teuthology.orchestra.run.smithi134.stdout:This subpackage provides tools for support of all platforms. 2024-03-12T15:46:13.418 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-03-12T15:46:13.418 INFO:teuthology.task.kernel:Updating grub on smithi134 to boot 4.18.0-544.el8.x86_64 2024-03-12T15:46:13.418 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-03-12T15:46:15.121 INFO:teuthology.orchestra.run.smithi134.stderr:Generating grub configuration file ... 2024-03-12T15:46:16.923 INFO:teuthology.orchestra.run.smithi134.stderr:done 2024-03-12T15:46:16.924 DEBUG:teuthology.orchestra.run.smithi134:> mktemp 2024-03-12T15:46:16.948 INFO:teuthology.orchestra.run.smithi134.stdout:/tmp/tmp.Yi3huhcCVU 2024-03-12T15:46:16.948 DEBUG:teuthology.orchestra.run.smithi134:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.Yi3huhcCVU 2024-03-12T15:46:17.036 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0666 /tmp/tmp.Yi3huhcCVU 2024-03-12T15:46:17.141 DEBUG:teuthology.orchestra.remote:smithi134:/tmp/tmp.Yi3huhcCVU is 6KB 2024-03-12T15:46:17.189 DEBUG:teuthology.orchestra.run.smithi134:> rm -fr /tmp/tmp.Yi3huhcCVU 2024-03-12T15:46:17.206 DEBUG:teuthology.orchestra.run.smithi134:> sudo /bin/ls /boot/loader/entries || true 2024-03-12T15:46:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-0-rescue.conf 2024-03-12T15:46:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-348.el8.x86_64.conf 2024-03-12T15:46:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-489.el8.x86_64.conf 2024-03-12T15:46:17.272 INFO:teuthology.orchestra.run.smithi134.stdout:a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64.conf 2024-03-12T15:46:17.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo grub2-set-default a1b29d6c289747bdb22930598d39874a-4.18.0-544.el8.x86_64 2024-03-12T15:46:17.435 DEBUG:teuthology.orchestra.run.smithi134:> sudo shutdown -r now 2024-03-12T15:46:47.466 INFO:teuthology.task.kernel:Checking client host.b for new kernel version... 2024-03-12T15:46:47.467 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-12T15:46:47.468 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:47:05.890 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-12T15:47:08.332 DEBUG:teuthology.orchestra.remote:timed out 2024-03-12T15:47:14.898 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-12T15:47:14.899 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:47:17.954 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.134 2024-03-12T15:47:20.335 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-03-12T15:47:20.335 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:47:20.674 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-03-12T15:47:20.973 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-03-12T15:47:20.973 INFO:teuthology.task.kernel:Checking kernel version of host.a, want "4.18.0-544.el8.x86_64"... 2024-03-12T15:47:20.973 DEBUG:teuthology.orchestra.run.smithi006:> uname -r 2024-03-12T15:47:20.993 INFO:teuthology.orchestra.run.smithi006.stdout:4.18.0-544.el8.x86_64 2024-03-12T15:47:20.993 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-544.el8.x86_64 vs 4.18.0-544.el8.x86_64 2024-03-12T15:47:20.993 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-12T15:47:20.993 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-12T15:47:21.994 INFO:teuthology.task.kernel:Enabling kdb on host.a... 2024-03-12T15:47:21.994 DEBUG:teuthology.orchestra.run.smithi006:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-12T15:47:22.072 INFO:teuthology.orchestra.run.smithi006.stdout:ttyS1 2024-03-12T15:47:22.085 DEBUG:teuthology.parallel:result is None 2024-03-12T15:47:29.956 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-12T15:47:29.956 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:48:02.491 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-03-12T15:48:03.107 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-12T15:48:03.108 INFO:teuthology.task.kernel:Checking kernel version of host.b, want "4.18.0-544.el8.x86_64"... 2024-03-12T15:48:03.108 DEBUG:teuthology.orchestra.run.smithi134:> uname -r 2024-03-12T15:48:03.125 INFO:teuthology.orchestra.run.smithi134.stdout:4.18.0-544.el8.x86_64 2024-03-12T15:48:03.125 DEBUG:teuthology.task.kernel:current kernel version is 4.18.0-544.el8.x86_64 vs 4.18.0-544.el8.x86_64 2024-03-12T15:48:03.125 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-03-12T15:48:03.125 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-03-12T15:48:04.126 INFO:teuthology.task.kernel:Enabling kdb on host.b... 2024-03-12T15:48:04.126 DEBUG:teuthology.orchestra.run.smithi134:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-03-12T15:48:04.193 INFO:teuthology.orchestra.run.smithi134.stdout:ttyS1 2024-03-12T15:48:04.205 DEBUG:teuthology.parallel:result is None 2024-03-12T15:48:04.206 INFO:teuthology.run_tasks:Running task internal.base... 2024-03-12T15:48:04.214 INFO:teuthology.task.internal:Creating test directory... 2024-03-12T15:48:04.214 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-12T15:48:04.217 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-03-12T15:48:04.237 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-03-12T15:48:04.244 INFO:teuthology.run_tasks:Running task internal.archive... 2024-03-12T15:48:04.250 INFO:teuthology.task.internal:Creating archive directory... 2024-03-12T15:48:04.251 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-12T15:48:04.280 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-03-12T15:48:04.314 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-03-12T15:48:04.321 INFO:teuthology.task.internal:Enabling coredump saving... 2024-03-12T15:48:04.321 DEBUG:teuthology.orchestra.run.smithi006:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-12T15:48:04.352 DEBUG:teuthology.orchestra.run.smithi134:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-03-12T15:48:04.387 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-12T15:48:04.389 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-12T15:48:04.398 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-12T15:48:04.399 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-03-12T15:48:04.401 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-03-12T15:48:04.408 INFO:teuthology.task.internal:Configuring sudo... 2024-03-12T15:48:04.408 DEBUG:teuthology.orchestra.run.smithi006:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-12T15:48:04.442 DEBUG:teuthology.orchestra.run.smithi134:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-03-12T15:48:04.470 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-03-12T15:48:04.482 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-03-12T15:48:04.483 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-12T15:48:04.511 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-03-12T15:48:04.529 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-12T15:48:04.616 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-12T15:48:04.666 DEBUG:teuthology.orchestra.run.smithi006:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-12T15:48:04.752 DEBUG:teuthology.orchestra.run.smithi006:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-12T15:48:04.794 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T15:48:04.794 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-12T15:48:04.861 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-12T15:48:04.906 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-03-12T15:48:04.961 DEBUG:teuthology.orchestra.run.smithi134:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-12T15:48:05.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-03-12T15:48:05.087 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T15:48:05.087 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-03-12T15:48:05.153 DEBUG:teuthology.orchestra.run.smithi006:> sudo service rsyslog restart 2024-03-12T15:48:05.156 DEBUG:teuthology.orchestra.run.smithi134:> sudo service rsyslog restart 2024-03-12T15:48:05.231 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-12T15:48:05.247 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-12T15:48:05.729 INFO:teuthology.run_tasks:Running task internal.timer... 2024-03-12T15:48:05.737 INFO:teuthology.task.internal:Starting timer... 2024-03-12T15:48:05.737 INFO:teuthology.run_tasks:Running task pcp... 2024-03-12T15:48:05.759 INFO:teuthology.run_tasks:Running task selinux... 2024-03-12T15:48:05.797 DEBUG:teuthology.task:Applying overrides for task selinux: {'whitelist': ['scontext=system_u:system_r:logrotate_t:s0']} 2024-03-12T15:48:05.798 DEBUG:teuthology.orchestra.run.smithi006:> sudo service auditd rotate 2024-03-12T15:48:05.868 INFO:teuthology.orchestra.run.smithi006.stdout:Rotating logs: 2024-03-12T15:48:05.870 DEBUG:teuthology.orchestra.run.smithi134:> sudo service auditd rotate 2024-03-12T15:48:05.943 INFO:teuthology.orchestra.run.smithi134.stdout:Rotating logs: 2024-03-12T15:48:05.945 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-03-12T15:48:05.945 DEBUG:teuthology.orchestra.run.smithi006:> /usr/sbin/getenforce 2024-03-12T15:48:05.976 INFO:teuthology.orchestra.run.smithi006.stdout:Permissive 2024-03-12T15:48:05.976 DEBUG:teuthology.orchestra.run.smithi134:> /usr/sbin/getenforce 2024-03-12T15:48:06.004 INFO:teuthology.orchestra.run.smithi134.stdout:Permissive 2024-03-12T15:48:06.004 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi006.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi134.front.sepia.ceph.com': 'permissive'} 2024-03-12T15:48:06.005 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-12T15:48:06.044 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T15:48:06.044 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-12T15:48:06.071 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T15:48:06.072 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-03-12T15:48:06.072 DEBUG:teuthology.orchestra.run.smithi006:> sudo /usr/sbin/setenforce permissive 2024-03-12T15:48:06.111 DEBUG:teuthology.orchestra.run.smithi134:> sudo /usr/sbin/setenforce permissive 2024-03-12T15:48:06.139 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-03-12T15:48:06.148 DEBUG:teuthology.repo_utils:Setting repo remote to https://git.ceph.com/ceph-cm-ansible.git 2024-03-12T15:48:06.154 INFO:teuthology.repo_utils:Fetching git.ceph.com_ceph-cm-ansible_main from origin 2024-03-12T15:48:06.272 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-03-12T15:48:06.290 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-03-12T15:48:06.291 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi006.front.sepia.ceph.com,smithi134.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-03-12T15:55:14.362 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi006.front.sepia.ceph.com'), Remote(name='ubuntu@smithi134.front.sepia.ceph.com')] 2024-03-12T15:55:14.364 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-03-12T15:55:14.365 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi006.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:55:14.442 DEBUG:teuthology.orchestra.run.smithi006:> true 2024-03-12T15:55:14.517 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi006.front.sepia.ceph.com' 2024-03-12T15:55:14.518 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-12T15:55:14.518 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi134.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-03-12T15:55:14.590 DEBUG:teuthology.orchestra.run.smithi134:> true 2024-03-12T15:55:14.665 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi134.front.sepia.ceph.com' 2024-03-12T15:55:14.666 INFO:teuthology.run_tasks:Running task clock... 2024-03-12T15:55:14.678 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-03-12T15:55:14.678 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-12T15:55:14.678 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-12T15:55:14.681 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-03-12T15:55:14.681 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-12T15:55:14.717 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-12T15:55:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-12T15:55:14.738 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-03-12T15:55:14.752 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-03-12T15:55:14.802 INFO:teuthology.orchestra.run.smithi006.stderr:sudo: ntpd: command not found 2024-03-12T15:55:14.814 INFO:teuthology.orchestra.run.smithi006.stdout:506 Cannot talk to daemon 2024-03-12T15:55:14.816 INFO:teuthology.orchestra.run.smithi134.stderr:sudo: ntpd: command not found 2024-03-12T15:55:14.827 INFO:teuthology.orchestra.run.smithi134.stdout:506 Cannot talk to daemon 2024-03-12T15:55:14.829 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-12T15:55:14.841 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-03-12T15:55:14.844 INFO:teuthology.orchestra.run.smithi006.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-12T15:55:14.854 INFO:teuthology.orchestra.run.smithi134.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-03-12T15:55:14.920 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2024-03-12T15:55:14.921 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2024-03-12T15:55:14.925 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-12T15:55:14.925 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-03-12T15:55:14.925 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T15:55:14.926 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T15:55:14.926 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T15:55:14.926 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T15:55:14.926 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-12T15:55:14.926 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-03-12T15:55:14.926 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T15:55:14.926 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T15:55:14.926 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T15:55:14.926 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T15:55:14.927 INFO:teuthology.run_tasks:Running task pexec... 2024-03-12T15:55:14.937 INFO:teuthology.task.pexec:Executing custom commands... 2024-03-12T15:55:14.937 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T15:55:14.938 DEBUG:teuthology.orchestra.run.smithi006:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-03-12T15:55:14.938 INFO:teuthology.task.pexec:Running commands on host ubuntu@smithi134.front.sepia.ceph.com 2024-03-12T15:55:14.938 DEBUG:teuthology.orchestra.run.smithi134:> TESTDIR=/home/ubuntu/cephtest bash -s 2024-03-12T15:55:15.757 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:50 ago on Tue 12 Mar 2024 03:53:25 PM UTC. 2024-03-12T15:55:15.789 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:28 ago on Tue 12 Mar 2024 03:53:47 PM UTC. 2024-03-12T15:55:17.815 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:55:17.816 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:55:17.816 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-03-12T15:55:17.817 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:55:17.817 INFO:teuthology.orchestra.run.smithi134.stdout:Resetting modules: 2024-03-12T15:55:17.817 INFO:teuthology.orchestra.run.smithi134.stdout: container-tools 2024-03-12T15:55:17.817 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:55:17.817 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:55:17.817 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:55:17.817 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:55:18.042 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:55:18.043 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:55:18.043 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-03-12T15:55:18.043 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:55:18.043 INFO:teuthology.orchestra.run.smithi006.stdout:Resetting modules: 2024-03-12T15:55:18.043 INFO:teuthology.orchestra.run.smithi006.stdout: container-tools 2024-03-12T15:55:18.043 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:55:18.043 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:55:18.043 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:55:18.044 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:55:18.060 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:55:18.316 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:55:18.963 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:53 ago on Tue 12 Mar 2024 03:53:25 PM UTC. 2024-03-12T15:55:19.199 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:32 ago on Tue 12 Mar 2024 03:53:47 PM UTC. 2024-03-12T15:55:21.029 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:55:21.064 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout:Installing group/module packages: 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-03-12T15:55:21.065 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout:Installing weak dependencies: 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout:Installing module profiles: 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: container-tools/common 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout:Enabling module streams: 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: container-tools rhel8 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:55:21.066 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:55:21.067 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:55:21.067 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-03-12T15:55:21.067 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:55:21.067 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 27 M 2024-03-12T15:55:21.067 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 91 M 2024-03-12T15:55:21.067 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:55:21.289 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 3.7 MB/s | 689 kB 00:00 2024-03-12T15:55:21.322 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): aardvark-dns-1.10.0-1.module_el8+871+55 4.7 MB/s | 1.0 MB 00:00 2024-03-12T15:55:21.339 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 757 kB/s | 38 kB 00:00 2024-03-12T15:55:21.423 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 2.5 MB/s | 258 kB 00:00 2024-03-12T15:55:21.429 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout:Installing group/module packages: 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: aardvark-dns x86_64 2:1.10.0-1.module_el8+871+552be958 appstream 1.0 M 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: buildah x86_64 2:1.33.6-2.module_el8+976+11360731 appstream 9.6 M 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: cockpit-podman noarch 84.1-1.module_el8+977+8ab54275 appstream 689 k 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: crun x86_64 1.14.3-2.module_el8+968+fbb249c7 appstream 258 k 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: netavark x86_64 2:1.10.3-1.module_el8+951+32019cde appstream 4.1 M 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: python3-podman noarch 4.9.0-1.module_el8+847+7863d4e6 appstream 180 k 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: skopeo x86_64 2:1.14.3-0.1.module_el8+885+7da147f3 appstream 8.8 M 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: toolbox x86_64 0.0.99.5-2.module_el8+971+3d3df00d appstream 2.5 M 2024-03-12T15:55:21.468 INFO:teuthology.orchestra.run.smithi006.stdout: udica noarch 0.2.6-20.module_el8+804+f131391c appstream 53 k 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytoml noarch 0.1.14-5.git7dea353.el8 appstream 25 k 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyxdg noarch 0.25-16.el8 appstream 94 k 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: yajl x86_64 2.1.0-12.el8 appstream 41 k 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout:Installing weak dependencies: 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: criu-libs x86_64 3.15-3.module_el8.7.0+1216+b022c01d appstream 38 k 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout:Installing module profiles: 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: container-tools/common 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout:Enabling module streams: 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: container-tools rhel8 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:55:21.469 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:55:21.470 INFO:teuthology.orchestra.run.smithi006.stdout:Install 13 Packages 2024-03-12T15:55:21.470 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:55:21.470 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 27 M 2024-03-12T15:55:21.470 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 91 M 2024-03-12T15:55:21.470 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:55:21.490 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 2.6 MB/s | 180 kB 00:00 2024-03-12T15:55:21.523 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 744 kB/s | 25 kB 00:00 2024-03-12T15:55:21.565 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 2.2 MB/s | 94 kB 00:00 2024-03-12T15:55:21.832 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): netavark-1.10.3-1.module_el8+951+32019c 8.3 MB/s | 4.1 MB 00:00 2024-03-12T15:55:22.133 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): toolbox-0.0.99.5-2.module_el8+971+3d3df 8.4 MB/s | 2.5 MB 00:00 2024-03-12T15:55:22.174 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 1.2 MB/s | 53 kB 00:00 2024-03-12T15:55:22.217 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 974 kB/s | 41 kB 00:00 2024-03-12T15:55:22.442 INFO:teuthology.orchestra.run.smithi006.stdout:(1/13): cockpit-podman-84.1-1.module_el8+977+8a 891 kB/s | 689 kB 00:00 2024-03-12T15:55:22.492 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): skopeo-1.14.3-0.1.module_el8+885+7da14 9.5 MB/s | 8.8 MB 00:00 2024-03-12T15:55:22.584 INFO:teuthology.orchestra.run.smithi006.stdout:(2/13): criu-libs-3.15-3.module_el8.7.0+1216+b0 268 kB/s | 38 kB 00:00 2024-03-12T15:55:22.667 INFO:teuthology.orchestra.run.smithi006.stdout:(3/13): aardvark-dns-1.10.0-1.module_el8+871+55 1.0 MB/s | 1.0 MB 00:00 2024-03-12T15:55:22.726 INFO:teuthology.orchestra.run.smithi006.stdout:(4/13): crun-1.14.3-2.module_el8+968+fbb249c7.x 1.8 MB/s | 258 kB 00:00 2024-03-12T15:55:22.734 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): buildah-1.33.6-2.module_el8+976+113607 5.9 MB/s | 9.6 MB 00:01 2024-03-12T15:55:22.734 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:55:22.734 INFO:teuthology.orchestra.run.smithi134.stdout:Total 16 MB/s | 27 MB 00:01 2024-03-12T15:55:22.868 INFO:teuthology.orchestra.run.smithi006.stdout:(5/13): python3-podman-4.9.0-1.module_el8+847+7 1.2 MB/s | 180 kB 00:00 2024-03-12T15:55:23.002 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:55:23.010 INFO:teuthology.orchestra.run.smithi006.stdout:(6/13): python3-pytoml-0.1.14-5.git7dea353.el8. 175 kB/s | 25 kB 00:00 2024-03-12T15:55:23.023 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:55:23.023 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:55:23.160 INFO:teuthology.orchestra.run.smithi006.stdout:(7/13): python3-pyxdg-0.25-16.el8.noarch.rpm 626 kB/s | 94 kB 00:00 2024-03-12T15:55:23.294 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:55:23.297 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:55:23.998 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:55:24.923 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-03-12T15:55:25.134 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-03-12T15:55:25.320 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-03-12T15:55:25.511 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-03-12T15:55:25.585 INFO:teuthology.orchestra.run.smithi006.stdout:(8/13): netavark-1.10.3-1.module_el8+951+32019c 1.4 MB/s | 4.1 MB 00:02 2024-03-12T15:55:25.731 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-03-12T15:55:26.019 INFO:teuthology.orchestra.run.smithi006.stdout:(9/13): toolbox-0.0.99.5-2.module_el8+971+3d3df 5.8 MB/s | 2.5 MB 00:00 2024-03-12T15:55:26.136 INFO:teuthology.orchestra.run.smithi006.stdout:(10/13): udica-0.2.6-20.module_el8+804+f131391c 451 kB/s | 53 kB 00:00 2024-03-12T15:55:26.253 INFO:teuthology.orchestra.run.smithi006.stdout:(11/13): yajl-2.1.0-12.el8.x86_64.rpm 351 kB/s | 41 kB 00:00 2024-03-12T15:55:26.330 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-03-12T15:55:27.283 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-03-12T15:55:27.498 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-03-12T15:55:27.726 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-03-12T15:55:28.180 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-03-12T15:55:28.389 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-03-12T15:55:28.621 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-03-12T15:55:28.802 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-03-12T15:55:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-03-12T15:55:29.242 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-03-12T15:55:29.243 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-03-12T15:55:29.319 INFO:teuthology.orchestra.run.smithi006.stdout:(12/13): buildah-1.33.6-2.module_el8+976+113607 1.3 MB/s | 9.6 MB 00:07 2024-03-12T15:55:29.487 INFO:teuthology.orchestra.run.smithi006.stdout:(13/13): skopeo-1.14.3-0.1.module_el8+885+7da14 1.4 MB/s | 8.8 MB 00:06 2024-03-12T15:55:29.487 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:55:29.487 INFO:teuthology.orchestra.run.smithi006.stdout:Total 3.4 MB/s | 27 MB 00:08 2024-03-12T15:55:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-03-12T15:55:29.749 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:55:29.750 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:55:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-03-12T15:55:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-03-12T15:55:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-03-12T15:55:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-03-12T15:55:29.750 INFO:teuthology.orchestra.run.smithi134.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-03-12T15:55:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-03-12T15:55:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-03-12T15:55:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-03-12T15:55:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-03-12T15:55:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-03-12T15:55:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-03-12T15:55:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-03-12T15:55:29.751 INFO:teuthology.orchestra.run.smithi134.stdout: yajl-2.1.0-12.el8.x86_64 2024-03-12T15:55:29.752 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:55:29.752 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:55:29.768 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:55:29.791 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:55:29.791 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:55:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:55:30.077 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:55:30.244 DEBUG:teuthology.parallel:result is None 2024-03-12T15:55:30.781 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:55:32.029 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : yajl-2.1.0-12.el8.x86_64 1/13 2024-03-12T15:55:32.222 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2/13 2024-03-12T15:55:32.434 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyxdg-0.25-16.el8.noarch 3/13 2024-03-12T15:55:32.628 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 4/13 2024-03-12T15:55:32.866 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 5/13 2024-03-12T15:55:33.492 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 6/13 2024-03-12T15:55:34.531 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 7/13 2024-03-12T15:55:34.748 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 8/13 2024-03-12T15:55:34.963 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 9/13 2024-03-12T15:55:35.421 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 10/13 2024-03-12T15:55:35.623 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-03-12T15:55:35.878 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-03-12T15:55:36.066 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-03-12T15:55:36.545 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 13/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x8 1/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cockpit-podman-84.1-1.module_el8+977+8ab54275.noar 3/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_ 4/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 5/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 6/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-podman-4.9.0-1.module_el8+847+7863d4e6.noa 7/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytoml-0.1.14-5.git7dea353.el8.noarch 8/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyxdg-0.25-16.el8.noarch 9/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 10/13 2024-03-12T15:55:36.546 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 11/13 2024-03-12T15:55:36.547 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : udica-0.2.6-20.module_el8+804+f131391c.noarch 12/13 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : yajl-2.1.0-12.el8.x86_64 13/13 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout: aardvark-dns-2:1.10.0-1.module_el8+871+552be958.x86_64 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout: buildah-2:1.33.6-2.module_el8+976+11360731.x86_64 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout: cockpit-podman-84.1-1.module_el8+977+8ab54275.noarch 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout: criu-libs-3.15-3.module_el8.7.0+1216+b022c01d.x86_64 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout: crun-1.14.3-2.module_el8+968+fbb249c7.x86_64 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout: netavark-2:1.10.3-1.module_el8+951+32019cde.x86_64 2024-03-12T15:55:37.106 INFO:teuthology.orchestra.run.smithi006.stdout: python3-podman-4.9.0-1.module_el8+847+7863d4e6.noarch 2024-03-12T15:55:37.107 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytoml-0.1.14-5.git7dea353.el8.noarch 2024-03-12T15:55:37.107 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyxdg-0.25-16.el8.noarch 2024-03-12T15:55:37.107 INFO:teuthology.orchestra.run.smithi006.stdout: skopeo-2:1.14.3-0.1.module_el8+885+7da147f3.x86_64 2024-03-12T15:55:37.107 INFO:teuthology.orchestra.run.smithi006.stdout: toolbox-0.0.99.5-2.module_el8+971+3d3df00d.x86_64 2024-03-12T15:55:37.107 INFO:teuthology.orchestra.run.smithi006.stdout: udica-0.2.6-20.module_el8+804+f131391c.noarch 2024-03-12T15:55:37.107 INFO:teuthology.orchestra.run.smithi006.stdout: yajl-2.1.0-12.el8.x86_64 2024-03-12T15:55:37.107 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:55:37.107 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:55:37.363 DEBUG:teuthology.parallel:result is None 2024-03-12T15:55:37.363 INFO:teuthology.run_tasks:Running task install... 2024-03-12T15:55:37.373 DEBUG:teuthology.task.install:project ceph 2024-03-12T15:55:37.373 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712'}} 2024-03-12T15:55:37.373 DEBUG:teuthology.task.install:config {'branch': 'pacific', 'exclude_packages': ['ceph-volume'], 'flavor': 'default', 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712'} 2024-03-12T15:55:37.373 INFO:teuthology.task.install:Using flavor: default 2024-03-12T15:55:37.383 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-03-12T15:55:37.383 INFO:teuthology.task.install:extra packages: [] 2024-03-12T15:55:37.383 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712', 'tag': None, 'wait_for_package': False} 2024-03-12T15:55:37.383 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-12T15:55:37.384 INFO:teuthology.packaging:ref: None 2024-03-12T15:55:37.384 INFO:teuthology.packaging:tag: None 2024-03-12T15:55:37.384 INFO:teuthology.packaging:branch: pacific 2024-03-12T15:55:37.384 INFO:teuthology.packaging:sha1: 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T15:55:37.384 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-03-12T15:55:37.386 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': 'pacific', 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': ['ceph-volume'], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712', 'tag': None, 'wait_for_package': False} 2024-03-12T15:55:37.386 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-12T15:55:37.386 INFO:teuthology.packaging:ref: None 2024-03-12T15:55:37.386 INFO:teuthology.packaging:tag: None 2024-03-12T15:55:37.387 INFO:teuthology.packaging:branch: pacific 2024-03-12T15:55:37.387 INFO:teuthology.packaging:sha1: 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T15:55:37.387 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-03-12T15:55:37.607 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/8963e9dec9df5145388f0d6f6f32af0a74591caf/centos/8/flavors/default/ 2024-03-12T15:55:37.607 INFO:teuthology.task.install.rpm:Package version is 16.2.15-1.g8963e9de 2024-03-12T15:55:37.621 INFO:teuthology.task.install.rpm:Pulling from https://2.chacra.ceph.com/r/ceph/pacific/8963e9dec9df5145388f0d6f6f32af0a74591caf/centos/8/flavors/default/ 2024-03-12T15:55:37.621 INFO:teuthology.task.install.rpm:Package version is 16.2.15-1.g8963e9de 2024-03-12T15:55:37.729 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/8963e9dec9df5145388f0d6f6f32af0a74591caf/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/8963e9dec9df5145388f0d6f6f32af0a74591caf/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/8963e9dec9df5145388f0d6f6f32af0a74591caf/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-12T15:55:37.730 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T15:55:37.730 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-12T15:55:37.759 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-12T15:55:37.759 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-12T15:55:37.759 INFO:teuthology.packaging:ref: None 2024-03-12T15:55:37.759 INFO:teuthology.packaging:tag: None 2024-03-12T15:55:37.759 INFO:teuthology.packaging:branch: pacific 2024-03-12T15:55:37.759 INFO:teuthology.packaging:sha1: 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T15:55:37.760 DEBUG:teuthology.orchestra.run.smithi006:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-12T15:55:37.788 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://2.chacra.ceph.com/r/ceph/pacific/8963e9dec9df5145388f0d6f6f32af0a74591caf/centos/8/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/8963e9dec9df5145388f0d6f6f32af0a74591caf/centos/8/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://2.chacra.ceph.com/r/ceph/pacific/8963e9dec9df5145388f0d6f6f32af0a74591caf/centos/8/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-03-12T15:55:37.789 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T15:55:37.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-03-12T15:55:37.822 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-03-12T15:55:37.823 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-12T15:55:37.823 INFO:teuthology.packaging:ref: None 2024-03-12T15:55:37.823 INFO:teuthology.packaging:tag: None 2024-03-12T15:55:37.823 INFO:teuthology.packaging:branch: pacific 2024-03-12T15:55:37.823 INFO:teuthology.packaging:sha1: 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T15:55:37.823 DEBUG:teuthology.orchestra.run.smithi134:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;ref/pacific/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-03-12T15:55:37.828 DEBUG:teuthology.orchestra.run.smithi006:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-12T15:55:37.895 DEBUG:teuthology.orchestra.run.smithi134:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-03-12T15:55:37.908 DEBUG:teuthology.orchestra.run.smithi006:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-12T15:55:37.974 DEBUG:teuthology.orchestra.run.smithi134:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-03-12T15:55:37.975 INFO:teuthology.orchestra.run.smithi006.stdout:check_obsoletes = 1 2024-03-12T15:55:37.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum clean all 2024-03-12T15:55:38.042 INFO:teuthology.orchestra.run.smithi134.stdout:check_obsoletes = 1 2024-03-12T15:55:38.043 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum clean all 2024-03-12T15:55:38.258 INFO:teuthology.orchestra.run.smithi006.stdout:76 files removed 2024-03-12T15:55:38.286 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-radosgw 2024-03-12T15:55:38.308 INFO:teuthology.orchestra.run.smithi134.stdout:76 files removed 2024-03-12T15:55:38.336 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-radosgw 2024-03-12T15:55:39.038 INFO:teuthology.orchestra.run.smithi006.stdout:ceph packages for x86_64 237 kB/s | 76 kB 00:00 2024-03-12T15:55:39.216 INFO:teuthology.orchestra.run.smithi134.stdout:ceph packages for x86_64 160 kB/s | 76 kB 00:00 2024-03-12T15:55:39.397 INFO:teuthology.orchestra.run.smithi006.stdout:ceph noarch packages 48 kB/s | 15 kB 00:00 2024-03-12T15:55:39.750 INFO:teuthology.orchestra.run.smithi134.stdout:ceph noarch packages 31 kB/s | 15 kB 00:00 2024-03-12T15:55:39.948 INFO:teuthology.orchestra.run.smithi006.stdout:ceph source packages 2.8 kB/s | 1.4 kB 00:00 2024-03-12T15:55:40.309 INFO:teuthology.orchestra.run.smithi134.stdout:ceph source packages 2.7 kB/s | 1.4 kB 00:00 2024-03-12T15:55:43.282 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - AppStream 8.4 MB/s | 28 MB 00:03 2024-03-12T15:55:50.426 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - AppStream 2.7 MB/s | 28 MB 00:10 2024-03-12T15:56:12.798 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - BaseOS 434 kB/s | 10 MB 00:24 2024-03-12T15:56:14.873 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - Extras 45 kB/s | 18 kB 00:00 2024-03-12T15:56:15.432 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - Extras common packages 16 kB/s | 7.2 kB 00:00 2024-03-12T15:56:16.084 INFO:teuthology.orchestra.run.smithi006.stdout:CentOS Stream 8 - PowerTools 8.9 MB/s | 4.9 MB 00:00 2024-03-12T15:56:17.260 INFO:teuthology.orchestra.run.smithi006.stdout:Copr repo for python3-asyncssh owned by ceph 19 kB/s | 3.5 kB 00:00 2024-03-12T15:56:18.770 INFO:teuthology.orchestra.run.smithi006.stdout:Extra Packages for Enterprise Linux 12 MB/s | 16 MB 00:01 2024-03-12T15:56:22.845 INFO:teuthology.orchestra.run.smithi006.stdout:lab-extras 505 kB/s | 24 kB 00:00 2024-03-12T15:56:23.636 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - BaseOS 373 kB/s | 10 MB 00:28 2024-03-12T15:56:25.440 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras 82 kB/s | 18 kB 00:00 2024-03-12T15:56:25.974 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - Extras common packages 17 kB/s | 7.2 kB 00:00 2024-03-12T15:56:26.645 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:56:26.647 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:56:26.647 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw x86_64 2:16.2.15-1.g8963e9de.el8 ceph 12 M 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrading: 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout: librados2 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 3.7 M 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 4.2 M 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base x86_64 2:16.2.15-1.g8963e9de.el8 ceph 6.1 M 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common x86_64 2:16.2.15-1.g8963e9de.el8 ceph 24 M 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux x86_64 2:16.2.15-1.g8963e9de.el8 ceph 26 k 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-03-12T15:56:26.648 INFO:teuthology.orchestra.run.smithi006.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 825 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 494 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 3.8 M 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse x86_64 2:16.2.15-1.g8963e9de.el8 ceph 45 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common x86_64 2:16.2.15-1.g8963e9de.el8 ceph 99 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs x86_64 2:16.2.15-1.g8963e9de.el8 ceph 215 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados x86_64 2:16.2.15-1.g8963e9de.el8 ceph 389 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd x86_64 2:16.2.15-1.g8963e9de.el8 ceph 369 k 2024-03-12T15:56:26.649 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw x86_64 2:16.2.15-1.g8963e9de.el8 ceph 114 k 2024-03-12T15:56:26.650 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:56:26.650 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:56:26.650 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:56:26.650 INFO:teuthology.orchestra.run.smithi006.stdout:Install 21 Packages 2024-03-12T15:56:26.650 INFO:teuthology.orchestra.run.smithi006.stdout:Upgrade 2 Packages 2024-03-12T15:56:26.650 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:56:26.650 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 58 M 2024-03-12T15:56:26.651 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:56:26.758 INFO:teuthology.orchestra.run.smithi134.stdout:CentOS Stream 8 - PowerTools 7.1 MB/s | 4.9 MB 00:00 2024-03-12T15:56:27.860 INFO:teuthology.orchestra.run.smithi134.stdout:Copr repo for python3-asyncssh owned by ceph 20 kB/s | 3.5 kB 00:00 2024-03-12T15:56:28.271 INFO:teuthology.orchestra.run.smithi006.stdout:(1/23): ceph-base-16.2.15-1.g8963e9de.el8.x86_6 4.9 MB/s | 6.1 MB 00:01 2024-03-12T15:56:28.371 INFO:teuthology.orchestra.run.smithi006.stdout:(2/23): ceph-selinux-16.2.15-1.g8963e9de.el8.x8 256 kB/s | 26 kB 00:00 2024-03-12T15:56:28.546 INFO:teuthology.orchestra.run.smithi006.stdout:(3/23): libcephfs2-16.2.15-1.g8963e9de.el8.x86_ 4.6 MB/s | 825 kB 00:00 2024-03-12T15:56:28.680 INFO:teuthology.orchestra.run.smithi006.stdout:(4/23): libradosstriper1-16.2.15-1.g8963e9de.el 3.6 MB/s | 494 kB 00:00 2024-03-12T15:56:28.889 INFO:teuthology.orchestra.run.smithi006.stdout:(5/23): ceph-radosgw-16.2.15-1.g8963e9de.el8.x8 6.2 MB/s | 12 MB 00:01 2024-03-12T15:56:28.921 INFO:teuthology.orchestra.run.smithi134.stdout:Extra Packages for Enterprise Linux 17 MB/s | 16 MB 00:00 2024-03-12T15:56:28.981 INFO:teuthology.orchestra.run.smithi006.stdout:(6/23): python3-ceph-argparse-16.2.15-1.g8963e9 492 kB/s | 45 kB 00:00 2024-03-12T15:56:29.064 INFO:teuthology.orchestra.run.smithi006.stdout:(7/23): python3-ceph-common-16.2.15-1.g8963e9de 1.2 MB/s | 99 kB 00:00 2024-03-12T15:56:29.173 INFO:teuthology.orchestra.run.smithi006.stdout:(8/23): librgw2-16.2.15-1.g8963e9de.el8.x86_64. 7.7 MB/s | 3.8 MB 00:00 2024-03-12T15:56:29.198 INFO:teuthology.orchestra.run.smithi006.stdout:(9/23): python3-cephfs-16.2.15-1.g8963e9de.el8. 1.6 MB/s | 215 kB 00:00 2024-03-12T15:56:29.257 INFO:teuthology.orchestra.run.smithi006.stdout:(10/23): python3-rados-16.2.15-1.g8963e9de.el8. 4.6 MB/s | 389 kB 00:00 2024-03-12T15:56:29.299 INFO:teuthology.orchestra.run.smithi006.stdout:(11/23): python3-rbd-16.2.15-1.g8963e9de.el8.x8 3.6 MB/s | 369 kB 00:00 2024-03-12T15:56:29.333 INFO:teuthology.orchestra.run.smithi006.stdout:(12/23): python3-rgw-16.2.15-1.g8963e9de.el8.x8 1.5 MB/s | 114 kB 00:00 2024-03-12T15:56:29.692 INFO:teuthology.orchestra.run.smithi006.stdout:(13/23): ceph-common-16.2.15-1.g8963e9de.el8.x8 9.0 MB/s | 24 MB 00:02 2024-03-12T15:56:29.708 INFO:teuthology.orchestra.run.smithi006.stdout:(14/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 692 kB/s | 259 kB 00:00 2024-03-12T15:56:29.742 INFO:teuthology.orchestra.run.smithi006.stdout:(15/23): librdkafka-1.6.1-1.el8.x86_64.rpm 1.5 MB/s | 677 kB 00:00 2024-03-12T15:56:29.876 INFO:teuthology.orchestra.run.smithi006.stdout:(16/23): python3-prettytable-0.7.2-14.el8.noarc 239 kB/s | 44 kB 00:00 2024-03-12T15:56:29.901 INFO:teuthology.orchestra.run.smithi006.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 1.9 MB/s | 306 kB 00:00 2024-03-12T15:56:29.960 INFO:teuthology.orchestra.run.smithi006.stdout:(18/23): liboath-2.6.2-3.el8.x86_64.rpm 1.0 MB/s | 59 kB 00:00 2024-03-12T15:56:30.002 INFO:teuthology.orchestra.run.smithi006.stdout:(19/23): libunwind-1.3.1-3.el8.x86_64.rpm 1.8 MB/s | 75 kB 00:00 2024-03-12T15:56:30.027 INFO:teuthology.orchestra.run.smithi006.stdout:(20/23): leveldb-1.22-1.el8.x86_64.rpm 1.2 MB/s | 181 kB 00:00 2024-03-12T15:56:30.236 INFO:teuthology.orchestra.run.smithi006.stdout:(21/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 89 kB/s | 47 kB 00:00 2024-03-12T15:56:30.386 INFO:teuthology.orchestra.run.smithi006.stdout:(22/23): librbd1-16.2.15-1.g8963e9de.el8.x86_64 12 MB/s | 4.2 MB 00:00 2024-03-12T15:56:30.453 INFO:teuthology.orchestra.run.smithi006.stdout:(23/23): librados2-16.2.15-1.g8963e9de.el8.x86_ 8.3 MB/s | 3.7 MB 00:00 2024-03-12T15:56:30.455 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:56:30.455 INFO:teuthology.orchestra.run.smithi006.stdout:Total 15 MB/s | 58 MB 00:03 2024-03-12T15:56:30.499 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:56:30.551 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:56:30.551 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:56:30.916 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:56:30.919 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:56:31.968 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:56:32.202 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-03-12T15:56:32.334 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-03-12T15:56:32.702 INFO:teuthology.orchestra.run.smithi134.stdout:lab-extras 283 kB/s | 24 kB 00:00 2024-03-12T15:56:32.741 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-03-12T15:56:32.942 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librados2-2:16.2.15-1.g8963e9de.el8.x86_64 3/25 2024-03-12T15:56:33.054 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-2:16.2.15-1.g8963e9de.el8.x86_64 3/25 2024-03-12T15:56:33.270 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rados-2:16.2.15-1.g8963e9de.el8.x86_64 4/25 2024-03-12T15:56:33.434 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 5/25 2024-03-12T15:56:33.872 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 5/25 2024-03-12T15:56:34.060 INFO:teuthology.orchestra.run.smithi006.stdout: Upgrading : librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 6/25 2024-03-12T15:56:34.125 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 6/25 2024-03-12T15:56:34.314 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-03-12T15:56:34.975 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-03-12T15:56:35.117 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librgw2-2:16.2.15-1.g8963e9de.el8.x86_64 9/25 2024-03-12T15:56:35.182 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librgw2-2:16.2.15-1.g8963e9de.el8.x86_64 9/25 2024-03-12T15:56:35.423 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-03-12T15:56:35.574 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-argparse-2:16.2.15-1.g8963e9de.el8.x8 11/25 2024-03-12T15:56:35.797 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cephfs-2:16.2.15-1.g8963e9de.el8.x86_64 12/25 2024-03-12T15:56:35.988 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rgw-2:16.2.15-1.g8963e9de.el8.x86_64 13/25 2024-03-12T15:56:36.196 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rbd-2:16.2.15-1.g8963e9de.el8.x86_64 14/25 2024-03-12T15:56:36.307 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:56:36.310 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:56:36.310 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:56:36.310 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:56:36.310 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:56:36.310 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw x86_64 2:16.2.15-1.g8963e9de.el8 ceph 12 M 2024-03-12T15:56:36.310 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrading: 2024-03-12T15:56:36.310 INFO:teuthology.orchestra.run.smithi134.stdout: librados2 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 3.7 M 2024-03-12T15:56:36.310 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 4.2 M 2024-03-12T15:56:36.310 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base x86_64 2:16.2.15-1.g8963e9de.el8 ceph 6.1 M 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common x86_64 2:16.2.15-1.g8963e9de.el8 ceph 24 M 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux x86_64 2:16.2.15-1.g8963e9de.el8 ceph 26 k 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs x86_64 1:2.7-9.el8 epel 306 k 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: leveldb x86_64 1.22-1.el8 epel 181 k 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 825 k 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: liboath x86_64 2.6.2-3.el8 epel 59 k 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq x86_64 0.9.0-5.el8 baseos 47 k 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 494 k 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka x86_64 1.6.1-1.el8 appstream 677 k 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2 x86_64 2:16.2.15-1.g8963e9de.el8 ceph 3.8 M 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind x86_64 1.3.1-3.el8 epel 75 k 2024-03-12T15:56:36.311 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust x86_64 2.8.1-11.el8 appstream 259 k 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse x86_64 2:16.2.15-1.g8963e9de.el8 ceph 45 k 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common x86_64 2:16.2.15-1.g8963e9de.el8 ceph 99 k 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs x86_64 2:16.2.15-1.g8963e9de.el8 ceph 215 k 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable noarch 0.7.2-14.el8 appstream 44 k 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados x86_64 2:16.2.15-1.g8963e9de.el8 ceph 389 k 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd x86_64 2:16.2.15-1.g8963e9de.el8 ceph 369 k 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw x86_64 2:16.2.15-1.g8963e9de.el8 ceph 114 k 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout:Install 21 Packages 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout:Upgrade 2 Packages 2024-03-12T15:56:36.312 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:56:36.313 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 58 M 2024-03-12T15:56:36.313 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:56:36.359 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libradosstriper1-2:16.2.15-1.g8963e9de.el8.x86_64 15/25 2024-03-12T15:56:36.420 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libradosstriper1-2:16.2.15-1.g8963e9de.el8.x86_64 15/25 2024-03-12T15:56:36.608 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-03-12T15:56:36.785 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-03-12T15:56:36.967 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-03-12T15:56:37.176 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-ceph-common-2:16.2.15-1.g8963e9de.el8.x86_ 19/25 2024-03-12T15:56:37.620 INFO:teuthology.orchestra.run.smithi134.stdout:(1/23): ceph-radosgw-16.2.15-1.g8963e9de.el8.x8 16 MB/s | 12 MB 00:00 2024-03-12T15:56:37.670 INFO:teuthology.orchestra.run.smithi134.stdout:(2/23): ceph-selinux-16.2.15-1.g8963e9de.el8.x8 515 kB/s | 26 kB 00:00 2024-03-12T15:56:37.753 INFO:teuthology.orchestra.run.smithi134.stdout:(3/23): libcephfs2-16.2.15-1.g8963e9de.el8.x86_ 9.7 MB/s | 825 kB 00:00 2024-03-12T15:56:37.812 INFO:teuthology.orchestra.run.smithi134.stdout:(4/23): libradosstriper1-16.2.15-1.g8963e9de.el 8.3 MB/s | 494 kB 00:00 2024-03-12T15:56:38.038 INFO:teuthology.orchestra.run.smithi134.stdout:(5/23): librgw2-16.2.15-1.g8963e9de.el8.x86_64. 17 MB/s | 3.8 MB 00:00 2024-03-12T15:56:38.088 INFO:teuthology.orchestra.run.smithi134.stdout:(6/23): python3-ceph-argparse-16.2.15-1.g8963e9 906 kB/s | 45 kB 00:00 2024-03-12T15:56:38.121 INFO:teuthology.orchestra.run.smithi134.stdout:(7/23): python3-ceph-common-16.2.15-1.g8963e9de 2.9 MB/s | 99 kB 00:00 2024-03-12T15:56:38.171 INFO:teuthology.orchestra.run.smithi134.stdout:(8/23): python3-cephfs-16.2.15-1.g8963e9de.el8. 4.2 MB/s | 215 kB 00:00 2024-03-12T15:56:38.239 INFO:teuthology.orchestra.run.smithi134.stdout:(9/23): python3-rados-16.2.15-1.g8963e9de.el8.x 5.7 MB/s | 389 kB 00:00 2024-03-12T15:56:38.336 INFO:teuthology.orchestra.run.smithi134.stdout:(10/23): python3-rbd-16.2.15-1.g8963e9de.el8.x8 3.7 MB/s | 369 kB 00:00 2024-03-12T15:56:38.398 INFO:teuthology.orchestra.run.smithi134.stdout:(11/23): python3-rgw-16.2.15-1.g8963e9de.el8.x8 1.8 MB/s | 114 kB 00:00 2024-03-12T15:56:38.805 INFO:teuthology.orchestra.run.smithi134.stdout:(12/23): ceph-base-16.2.15-1.g8963e9de.el8.x86_ 3.2 MB/s | 6.1 MB 00:01 2024-03-12T15:56:39.307 INFO:teuthology.orchestra.run.smithi134.stdout:(13/23): librdkafka-1.6.1-1.el8.x86_64.rpm 745 kB/s | 677 kB 00:00 2024-03-12T15:56:39.441 INFO:teuthology.orchestra.run.smithi134.stdout:(14/23): python3-prettytable-0.7.2-14.el8.noarc 329 kB/s | 44 kB 00:00 2024-03-12T15:56:39.466 INFO:teuthology.orchestra.run.smithi134.stdout:(15/23): lttng-ust-2.8.1-11.el8.x86_64.rpm 393 kB/s | 259 kB 00:00 2024-03-12T15:56:39.855 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 20/25 2024-03-12T15:56:39.941 INFO:teuthology.orchestra.run.smithi134.stdout:(16/23): ceph-common-16.2.15-1.g8963e9de.el8.x8 7.9 MB/s | 24 MB 00:03 2024-03-12T15:56:39.966 INFO:teuthology.orchestra.run.smithi134.stdout:(17/23): gperftools-libs-2.7-9.el8.x86_64.rpm 612 kB/s | 306 kB 00:00 2024-03-12T15:56:39.991 INFO:teuthology.orchestra.run.smithi134.stdout:(18/23): librabbitmq-0.9.0-5.el8.x86_64.rpm 85 kB/s | 47 kB 00:00 2024-03-12T15:56:40.058 INFO:teuthology.orchestra.run.smithi134.stdout:(19/23): liboath-2.6.2-3.el8.x86_64.rpm 639 kB/s | 59 kB 00:00 2024-03-12T15:56:40.084 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 20/25 2024-03-12T15:56:40.317 INFO:teuthology.orchestra.run.smithi134.stdout:(20/23): libunwind-1.3.1-3.el8.x86_64.rpm 231 kB/s | 75 kB 00:00 2024-03-12T15:56:40.342 INFO:teuthology.orchestra.run.smithi134.stdout:(21/23): leveldb-1.22-1.el8.x86_64.rpm 451 kB/s | 181 kB 00:00 2024-03-12T15:56:40.767 INFO:teuthology.orchestra.run.smithi134.stdout:(22/23): librbd1-16.2.15-1.g8963e9de.el8.x86_64 9.3 MB/s | 4.2 MB 00:00 2024-03-12T15:56:40.849 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 20/25 2024-03-12T15:56:41.151 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 21/25 2024-03-12T15:56:41.243 INFO:teuthology.orchestra.run.smithi134.stdout:(23/23): librados2-16.2.15-1.g8963e9de.el8.x86_ 3.2 MB/s | 3.7 MB 00:01 2024-03-12T15:56:41.245 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:56:41.245 INFO:teuthology.orchestra.run.smithi134.stdout:Total 12 MB/s | 58 MB 00:04 2024-03-12T15:56:41.265 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 21/25 2024-03-12T15:56:41.287 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:56:41.335 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:56:41.335 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:56:41.400 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-selinux-2:16.2.15-1.g8963e9de.el8.x86_64 22/25 2024-03-12T15:56:41.685 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:56:41.688 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:56:42.690 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:56:42.905 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : liboath-2.6.2-3.el8.x86_64 1/25 2024-03-12T15:56:43.100 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-03-12T15:56:43.468 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: lttng-ust-2.8.1-11.el8.x86_64 2/25 2024-03-12T15:56:43.650 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librados2-2:16.2.15-1.g8963e9de.el8.x86_64 3/25 2024-03-12T15:56:43.734 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-2:16.2.15-1.g8963e9de.el8.x86_64 3/25 2024-03-12T15:56:43.956 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rados-2:16.2.15-1.g8963e9de.el8.x86_64 4/25 2024-03-12T15:56:44.175 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 5/25 2024-03-12T15:56:44.584 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 5/25 2024-03-12T15:56:44.749 INFO:teuthology.orchestra.run.smithi134.stdout: Upgrading : librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 6/25 2024-03-12T15:56:44.814 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 6/25 2024-03-12T15:56:45.038 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librabbitmq-0.9.0-5.el8.x86_64 7/25 2024-03-12T15:56:45.503 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librdkafka-1.6.1-1.el8.x86_64 8/25 2024-03-12T15:56:45.666 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librgw2-2:16.2.15-1.g8963e9de.el8.x86_64 9/25 2024-03-12T15:56:45.745 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librgw2-2:16.2.15-1.g8963e9de.el8.x86_64 9/25 2024-03-12T15:56:45.955 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : leveldb-1.22-1.el8.x86_64 10/25 2024-03-12T15:56:46.104 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-argparse-2:16.2.15-1.g8963e9de.el8.x8 11/25 2024-03-12T15:56:46.278 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cephfs-2:16.2.15-1.g8963e9de.el8.x86_64 12/25 2024-03-12T15:56:46.492 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rgw-2:16.2.15-1.g8963e9de.el8.x86_64 13/25 2024-03-12T15:56:46.699 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rbd-2:16.2.15-1.g8963e9de.el8.x86_64 14/25 2024-03-12T15:56:46.849 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libradosstriper1-2:16.2.15-1.g8963e9de.el8.x86_64 15/25 2024-03-12T15:56:46.940 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libradosstriper1-2:16.2.15-1.g8963e9de.el8.x86_64 15/25 2024-03-12T15:56:47.133 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libunwind-1.3.1-3.el8.x86_64 16/25 2024-03-12T15:56:47.316 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : gperftools-libs-1:2.7-9.el8.x86_64 17/25 2024-03-12T15:56:47.510 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-prettytable-0.7.2-14.el8.noarch 18/25 2024-03-12T15:56:47.683 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-ceph-common-2:16.2.15-1.g8963e9de.el8.x86_ 19/25 2024-03-12T15:56:50.174 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 20/25 2024-03-12T15:56:50.457 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 20/25 2024-03-12T15:56:51.163 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 20/25 2024-03-12T15:56:51.481 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 21/25 2024-03-12T15:56:51.589 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 21/25 2024-03-12T15:56:51.757 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-selinux-2:16.2.15-1.g8963e9de.el8.x86_64 22/25 2024-03-12T15:57:01.422 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-selinux-2:16.2.15-1.g8963e9de.el8.x86_64 22/25 2024-03-12T15:57:01.423 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /sys 2024-03-12T15:57:01.423 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /proc 2024-03-12T15:57:01.423 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2024-03-12T15:57:01.423 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /run 2024-03-12T15:57:01.423 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /mnt 2024-03-12T15:57:01.423 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /var/tmp 2024-03-12T15:57:01.423 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /home 2024-03-12T15:57:01.423 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /tmp 2024-03-12T15:57:01.423 INFO:teuthology.orchestra.run.smithi006.stdout:skipping the directory /dev 2024-03-12T15:57:01.424 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:02.674 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-radosgw-2:16.2.15-1.g8963e9de.el8.x86_64 23/25 2024-03-12T15:57:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-1.g8963e9de.el8.x86_64 23/25 2024-03-12T15:57:02.753 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-03-12T15:57:03.008 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-03-12T15:57:03.008 INFO:teuthology.orchestra.run.smithi006.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-03-12T15:57:03.710 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-03-12T15:57:03.710 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 1/25 2024-03-12T15:57:03.710 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 2/25 2024-03-12T15:57:03.710 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-radosgw-2:16.2.15-1.g8963e9de.el8.x86_64 3/25 2024-03-12T15:57:03.710 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-selinux-2:16.2.15-1.g8963e9de.el8.x86_64 4/25 2024-03-12T15:57:03.710 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 5/25 2024-03-12T15:57:03.710 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libradosstriper1-2:16.2.15-1.g8963e9de.el8.x86_64 6/25 2024-03-12T15:57:03.710 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librgw2-2:16.2.15-1.g8963e9de.el8.x86_64 7/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-argparse-2:16.2.15-1.g8963e9de.el8.x8 8/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-ceph-common-2:16.2.15-1.g8963e9de.el8.x86_ 9/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cephfs-2:16.2.15-1.g8963e9de.el8.x86_64 10/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rados-2:16.2.15-1.g8963e9de.el8.x86_64 11/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rbd-2:16.2.15-1.g8963e9de.el8.x86_64 12/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rgw-2:16.2.15-1.g8963e9de.el8.x86_64 13/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-03-12T15:57:03.711 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-03-12T15:57:03.712 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-2:16.2.15-1.g8963e9de.el8.x86_64 22/25 2024-03-12T15:57:03.712 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-03-12T15:57:03.712 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 24/25 2024-03-12T15:57:04.661 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-03-12T15:57:04.661 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:04.661 INFO:teuthology.orchestra.run.smithi006.stdout:Upgraded: 2024-03-12T15:57:04.661 INFO:teuthology.orchestra.run.smithi006.stdout: librados2-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.661 INFO:teuthology.orchestra.run.smithi006.stdout: librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.661 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:57:04.661 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.661 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-radosgw-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-selinux-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: leveldb-1.22-1.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: liboath-2.6.2-3.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: libradosstriper1-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: librgw2-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: libunwind-1.3.1-3.el8.x86_64 2024-03-12T15:57:04.662 INFO:teuthology.orchestra.run.smithi006.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-03-12T15:57:04.663 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-argparse-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.663 INFO:teuthology.orchestra.run.smithi006.stdout: python3-ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.663 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cephfs-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.663 INFO:teuthology.orchestra.run.smithi006.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-03-12T15:57:04.663 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rados-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.663 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rbd-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.663 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rgw-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:04.663 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:04.663 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:57:05.104 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-test 2024-03-12T15:57:05.896 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:43 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:57:07.604 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:57:07.605 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:07.605 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:57:07.605 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:07.605 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test x86_64 2:16.2.15-1.g8963e9de.el8 ceph 52 M 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite x86_64 2:16.2.15-1.g8963e9de.el8 ceph 174 k 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:57:07.606 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:07.607 INFO:teuthology.orchestra.run.smithi006.stdout:Install 6 Packages 2024-03-12T15:57:07.607 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:07.607 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 53 M 2024-03-12T15:57:07.607 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 197 M 2024-03-12T15:57:07.607 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:57:07.944 INFO:teuthology.orchestra.run.smithi006.stdout:(1/6): jq-1.6-8.el8.x86_64.rpm 1.4 MB/s | 203 kB 00:00 2024-03-12T15:57:07.994 INFO:teuthology.orchestra.run.smithi006.stdout:(2/6): libcephsqlite-16.2.15-1.g8963e9de.el8.x8 888 kB/s | 174 kB 00:00 2024-03-12T15:57:08.019 INFO:teuthology.orchestra.run.smithi006.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 2.4 MB/s | 188 kB 00:00 2024-03-12T15:57:08.062 INFO:teuthology.orchestra.run.smithi006.stdout:(4/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 1.7 MB/s | 71 kB 00:00 2024-03-12T15:57:08.153 INFO:teuthology.orchestra.run.smithi006.stdout:(5/6): socat-1.7.4.1-1.el8.x86_64.rpm 2.0 MB/s | 323 kB 00:00 2024-03-12T15:57:10.295 INFO:teuthology.orchestra.run.smithi006.stdout:(6/6): ceph-test-16.2.15-1.g8963e9de.el8.x86_64 21 MB/s | 52 MB 00:02 2024-03-12T15:57:10.297 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:57:10.297 INFO:teuthology.orchestra.run.smithi006.stdout:Total 20 MB/s | 53 MB 00:02 2024-03-12T15:57:10.341 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:57:10.364 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:57:10.364 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:57:10.582 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-selinux-2:16.2.15-1.g8963e9de.el8.x86_64 22/25 2024-03-12T15:57:10.582 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /sys 2024-03-12T15:57:10.582 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /proc 2024-03-12T15:57:10.582 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2024-03-12T15:57:10.583 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /run 2024-03-12T15:57:10.583 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /mnt 2024-03-12T15:57:10.583 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /var/tmp 2024-03-12T15:57:10.583 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /home 2024-03-12T15:57:10.583 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /tmp 2024-03-12T15:57:10.583 INFO:teuthology.orchestra.run.smithi134.stdout:skipping the directory /dev 2024-03-12T15:57:10.583 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:10.669 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:57:10.672 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:57:11.183 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:57:11.427 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-03-12T15:57:11.649 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-03-12T15:57:11.771 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-03-12T15:57:11.785 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-radosgw-2:16.2.15-1.g8963e9de.el8.x86_64 23/25 2024-03-12T15:57:11.853 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-03-12T15:57:11.862 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-radosgw-2:16.2.15-1.g8963e9de.el8.x86_64 23/25 2024-03-12T15:57:11.862 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-03-12T15:57:12.073 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-03-12T15:57:12.078 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librbd1-1:12.2.7-9.el8.x86_64 24/25 2024-03-12T15:57:12.079 INFO:teuthology.orchestra.run.smithi134.stdout: Cleanup : librados2-1:12.2.7-9.el8.x86_64 25/25 2024-03-12T15:57:12.212 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephsqlite-2:16.2.15-1.g8963e9de.el8.x86_64 5/6 2024-03-12T15:57:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados2-1:12.2.7-9.el8.x86_64 25/25 2024-03-12T15:57:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 1/25 2024-03-12T15:57:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 2/25 2024-03-12T15:57:12.769 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-radosgw-2:16.2.15-1.g8963e9de.el8.x86_64 3/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-selinux-2:16.2.15-1.g8963e9de.el8.x86_64 4/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 5/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libradosstriper1-2:16.2.15-1.g8963e9de.el8.x86_64 6/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librgw2-2:16.2.15-1.g8963e9de.el8.x86_64 7/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-argparse-2:16.2.15-1.g8963e9de.el8.x8 8/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-ceph-common-2:16.2.15-1.g8963e9de.el8.x86_ 9/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cephfs-2:16.2.15-1.g8963e9de.el8.x86_64 10/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rados-2:16.2.15-1.g8963e9de.el8.x86_64 11/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rbd-2:16.2.15-1.g8963e9de.el8.x86_64 12/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rgw-2:16.2.15-1.g8963e9de.el8.x86_64 13/25 2024-03-12T15:57:12.770 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librdkafka-1.6.1-1.el8.x86_64 14/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : lttng-ust-2.8.1-11.el8.x86_64 15/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-prettytable-0.7.2-14.el8.noarch 16/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librabbitmq-0.9.0-5.el8.x86_64 17/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : gperftools-libs-1:2.7-9.el8.x86_64 18/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : leveldb-1.22-1.el8.x86_64 19/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : liboath-2.6.2-3.el8.x86_64 20/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libunwind-1.3.1-3.el8.x86_64 21/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-2:16.2.15-1.g8963e9de.el8.x86_64 22/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados2-1:12.2.7-9.el8.x86_64 23/25 2024-03-12T15:57:12.771 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 24/25 2024-03-12T15:57:13.665 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librbd1-1:12.2.7-9.el8.x86_64 25/25 2024-03-12T15:57:13.665 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:13.665 INFO:teuthology.orchestra.run.smithi134.stdout:Upgraded: 2024-03-12T15:57:13.665 INFO:teuthology.orchestra.run.smithi134.stdout: librados2-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.665 INFO:teuthology.orchestra.run.smithi134.stdout: librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.665 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-radosgw-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-selinux-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: gperftools-libs-1:2.7-9.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: leveldb-1.22-1.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: liboath-2.6.2-3.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: librabbitmq-0.9.0-5.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: libradosstriper1-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: librdkafka-1.6.1-1.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: librgw2-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.666 INFO:teuthology.orchestra.run.smithi134.stdout: libunwind-1.3.1-3.el8.x86_64 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout: lttng-ust-2.8.1-11.el8.x86_64 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-argparse-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-ceph-common-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cephfs-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-prettytable-0.7.2-14.el8.noarch 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rados-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rbd-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rgw-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:13.667 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:57:13.960 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-test 2024-03-12T15:57:14.719 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:42 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:57:16.314 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:57:16.315 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:57:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:57:16.315 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:57:16.315 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:57:16.315 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test x86_64 2:16.2.15-1.g8963e9de.el8 ceph 52 M 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: jq x86_64 1.6-8.el8 appstream 203 k 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite x86_64 2:16.2.15-1.g8963e9de.el8 ceph 174 k 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: oniguruma x86_64 6.8.2-3.el8 appstream 188 k 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: socat x86_64 1.7.4.1-1.el8 appstream 323 k 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: xmlstarlet x86_64 1.6.1-20.el8 appstream 71 k 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-03-12T15:57:16.316 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:16.317 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 53 M 2024-03-12T15:57:16.317 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 197 M 2024-03-12T15:57:16.317 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:57:16.936 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): libcephsqlite-16.2.15-1.g8963e9de.el8.x8 305 kB/s | 174 kB 00:00 2024-03-12T15:57:17.011 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): jq-1.6-8.el8.x86_64.rpm 315 kB/s | 203 kB 00:00 2024-03-12T15:57:17.097 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephsqlite-2:16.2.15-1.g8963e9de.el8.x86_64 5/6 2024-03-12T15:57:17.344 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-test-2:16.2.15-1.g8963e9de.el8.x86_64 6/6 2024-03-12T15:57:17.627 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-test-2:16.2.15-1.g8963e9de.el8.x86_64 6/6 2024-03-12T15:57:17.628 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-test-2:16.2.15-1.g8963e9de.el8.x86_64 1/6 2024-03-12T15:57:17.628 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephsqlite-2:16.2.15-1.g8963e9de.el8.x86_64 2/6 2024-03-12T15:57:17.628 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-03-12T15:57:17.628 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-03-12T15:57:17.628 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-03-12T15:57:17.628 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): oniguruma-6.8.2-3.el8.x86_64.rpm 272 kB/s | 188 kB 00:00 2024-03-12T15:57:17.906 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): socat-1.7.4.1-1.el8.x86_64.rpm 362 kB/s | 323 kB 00:00 2024-03-12T15:57:18.035 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-03-12T15:57:18.035 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:18.035 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:57:18.036 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-test-2:16.2.15-1.g8963e9de.el8.x86_64 jq-1.6-8.el8.x86_64 2024-03-12T15:57:18.036 INFO:teuthology.orchestra.run.smithi006.stdout: libcephsqlite-2:16.2.15-1.g8963e9de.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-03-12T15:57:18.036 INFO:teuthology.orchestra.run.smithi006.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-03-12T15:57:18.036 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:18.036 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:57:18.112 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): xmlstarlet-1.6.1-20.el8.x86_64.rpm 146 kB/s | 71 kB 00:00 2024-03-12T15:57:18.271 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph 2024-03-12T15:57:18.846 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): ceph-test-16.2.15-1.g8963e9de.el8.x86_64 21 MB/s | 52 MB 00:02 2024-03-12T15:57:18.848 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:57:18.848 INFO:teuthology.orchestra.run.smithi134.stdout:Total 21 MB/s | 53 MB 00:02 2024-03-12T15:57:18.890 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:57:18.910 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:57:18.911 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:57:19.058 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:00:57 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:57:19.198 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:57:19.201 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:57:19.696 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:57:19.962 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : xmlstarlet-1.6.1-20.el8.x86_64 1/6 2024-03-12T15:57:20.163 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : socat-1.7.4.1-1.el8.x86_64 2/6 2024-03-12T15:57:20.335 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : oniguruma-6.8.2-3.el8.x86_64 3/6 2024-03-12T15:57:20.409 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: oniguruma-6.8.2-3.el8.x86_64 3/6 2024-03-12T15:57:20.591 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : jq-1.6-8.el8.x86_64 4/6 2024-03-12T15:57:20.764 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:57:20.768 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:20.768 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:57:20.768 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:20.768 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:57:20.768 INFO:teuthology.orchestra.run.smithi006.stdout: ceph x86_64 2:16.2.15-1.g8963e9de.el8 ceph 6.4 k 2024-03-12T15:57:20.768 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds x86_64 2:16.2.15-1.g8963e9de.el8 ceph 2.4 M 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr x86_64 2:16.2.15-1.g8963e9de.el8 ceph 1.6 M 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 245 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon x86_64 2:16.2.15-1.g8963e9de.el8 ceph 5.2 M 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd x86_64 2:16.2.15-1.g8963e9de.el8 ceph 19 M 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-03-12T15:57:20.769 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-03-12T15:57:20.770 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-03-12T15:57:20.771 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-03-12T15:57:20.771 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-03-12T15:57:20.771 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-03-12T15:57:20.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:20.771 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:57:20.771 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:20.771 INFO:teuthology.orchestra.run.smithi006.stdout:Install 32 Packages 2024-03-12T15:57:20.771 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:20.772 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 32 M 2024-03-12T15:57:20.772 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 104 M 2024-03-12T15:57:20.772 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:57:20.802 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephsqlite-2:16.2.15-1.g8963e9de.el8.x86_64 5/6 2024-03-12T15:57:21.307 INFO:teuthology.orchestra.run.smithi006.stdout:(1/32): ceph-16.2.15-1.g8963e9de.el8.x86_64.rpm 55 kB/s | 6.4 kB 00:00 2024-03-12T15:57:21.491 INFO:teuthology.orchestra.run.smithi006.stdout:(2/32): ceph-mgr-16.2.15-1.g8963e9de.el8.x86_64 5.4 MB/s | 1.6 MB 00:00 2024-03-12T15:57:22.058 INFO:teuthology.orchestra.run.smithi006.stdout:(3/32): ceph-mon-16.2.15-1.g8963e9de.el8.x86_64 6.9 MB/s | 5.2 MB 00:00 2024-03-12T15:57:22.108 INFO:teuthology.orchestra.run.smithi006.stdout:(4/32): ceph-mds-16.2.15-1.g8963e9de.el8.x86_64 2.7 MB/s | 2.4 MB 00:00 2024-03-12T15:57:22.134 INFO:teuthology.orchestra.run.smithi006.stdout:(5/32): ceph-mgr-modules-core-16.2.15-1.g8963e9 3.2 MB/s | 245 kB 00:00 2024-03-12T15:57:22.551 INFO:teuthology.orchestra.run.smithi006.stdout:(6/32): ceph-osd-16.2.15-1.g8963e9de.el8.x86_64 18 MB/s | 19 MB 00:01 2024-03-12T15:57:22.576 INFO:teuthology.orchestra.run.smithi006.stdout:(7/32): python3-markupsafe-0.23-19.el8.x86_64.r 88 kB/s | 39 kB 00:00 2024-03-12T15:57:22.602 INFO:teuthology.orchestra.run.smithi006.stdout:(8/32): python3-mako-1.0.6-14.el8.noarch.rpm 319 kB/s | 157 kB 00:00 2024-03-12T15:57:22.777 INFO:teuthology.orchestra.run.smithi006.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 285 kB/s | 57 kB 00:00 2024-03-12T15:57:22.969 INFO:teuthology.orchestra.run.smithi006.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 1.2 MB/s | 457 kB 00:00 2024-03-12T15:57:22.994 INFO:teuthology.orchestra.run.smithi006.stdout:(11/32): python3-pyOpenSSL-19.0.0-1.el8.noarch. 234 kB/s | 103 kB 00:00 2024-03-12T15:57:24.136 INFO:teuthology.orchestra.run.smithi006.stdout:(12/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 183 kB/s | 249 kB 00:01 2024-03-12T15:57:24.203 INFO:teuthology.orchestra.run.smithi006.stdout:(13/32): python3-pycparser-2.14-14.el8.noarch.r 90 kB/s | 109 kB 00:01 2024-03-12T15:57:24.378 INFO:teuthology.orchestra.run.smithi006.stdout:(14/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 180 kB/s | 44 kB 00:00 2024-03-12T15:57:24.478 INFO:teuthology.orchestra.run.smithi006.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 673 kB/s | 185 kB 00:00 2024-03-12T15:57:24.503 INFO:teuthology.orchestra.run.smithi006.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 1.3 MB/s | 173 kB 00:00 2024-03-12T15:57:24.570 INFO:teuthology.orchestra.run.smithi006.stdout:(17/32): python3-jaraco-6.2-6.el8.noarch.rpm 167 kB/s | 11 kB 00:00 2024-03-12T15:57:24.604 INFO:teuthology.orchestra.run.smithi006.stdout:(18/32): python3-cherrypy-18.4.0-1.el8.noarch.r 3.0 MB/s | 384 kB 00:00 2024-03-12T15:57:24.637 INFO:teuthology.orchestra.run.smithi006.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 263 kB/s | 18 kB 00:00 2024-03-12T15:57:24.663 INFO:teuthology.orchestra.run.smithi006.stdout:(20/32): python3-logutils-0.3.5-11.el8.noarch.r 835 kB/s | 49 kB 00:00 2024-03-12T15:57:24.737 INFO:teuthology.orchestra.run.smithi006.stdout:(21/32): python3-more-itertools-7.2.0-3.el8.noa 589 kB/s | 59 kB 00:00 2024-03-12T15:57:24.772 INFO:teuthology.orchestra.run.smithi006.stdout:(22/32): python3-pecan-1.3.2-9.el8.noarch.rpm 2.5 MB/s | 283 kB 00:00 2024-03-12T15:57:24.806 INFO:teuthology.orchestra.run.smithi006.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 230 kB/s | 16 kB 00:00 2024-03-12T15:57:24.831 INFO:teuthology.orchestra.run.smithi006.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 318 kB/s | 19 kB 00:00 2024-03-12T15:57:24.873 INFO:teuthology.orchestra.run.smithi006.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 358 kB/s | 24 kB 00:00 2024-03-12T15:57:24.907 INFO:teuthology.orchestra.run.smithi006.stdout:(26/32): python3-tempora-1.14.1-5.el8.noarch.rp 389 kB/s | 29 kB 00:00 2024-03-12T15:57:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:(27/32): python3-trustme-0.6.0-4.el8.noarch.rpm 365 kB/s | 27 kB 00:00 2024-03-12T15:57:24.982 INFO:teuthology.orchestra.run.smithi006.stdout:(28/32): python3-waitress-1.4.3-1.el8.noarch.rp 3.3 MB/s | 255 kB 00:00 2024-03-12T15:57:25.049 INFO:teuthology.orchestra.run.smithi006.stdout:(29/32): python3-webtest-2.0.33-1.el8.noarch.rp 1.2 MB/s | 85 kB 00:00 2024-03-12T15:57:25.074 INFO:teuthology.orchestra.run.smithi006.stdout:(30/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 2.0 MB/s | 251 kB 00:00 2024-03-12T15:57:25.158 INFO:teuthology.orchestra.run.smithi006.stdout:(31/32): python3-zc-lockfile-2.0-2.el8.noarch.r 212 kB/s | 23 kB 00:00 2024-03-12T15:57:25.233 INFO:teuthology.orchestra.run.smithi006.stdout:(32/32): python3-cryptography-3.2.1-7.el8.x86_6 283 kB/s | 641 kB 00:02 2024-03-12T15:57:25.235 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:57:25.235 INFO:teuthology.orchestra.run.smithi006.stdout:Total 7.1 MB/s | 32 MB 00:04 2024-03-12T15:57:25.320 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:57:25.362 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:57:25.362 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:57:25.387 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephsqlite-2:16.2.15-1.g8963e9de.el8.x86_64 5/6 2024-03-12T15:57:25.667 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-test-2:16.2.15-1.g8963e9de.el8.x86_64 6/6 2024-03-12T15:57:25.709 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:57:25.713 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:57:25.958 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-test-2:16.2.15-1.g8963e9de.el8.x86_64 6/6 2024-03-12T15:57:25.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-test-2:16.2.15-1.g8963e9de.el8.x86_64 1/6 2024-03-12T15:57:25.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephsqlite-2:16.2.15-1.g8963e9de.el8.x86_64 2/6 2024-03-12T15:57:25.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : jq-1.6-8.el8.x86_64 3/6 2024-03-12T15:57:25.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : oniguruma-6.8.2-3.el8.x86_64 4/6 2024-03-12T15:57:25.958 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : socat-1.7.4.1-1.el8.x86_64 5/6 2024-03-12T15:57:26.420 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : xmlstarlet-1.6.1-20.el8.x86_64 6/6 2024-03-12T15:57:26.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:26.420 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:57:26.420 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-test-2:16.2.15-1.g8963e9de.el8.x86_64 jq-1.6-8.el8.x86_64 2024-03-12T15:57:26.420 INFO:teuthology.orchestra.run.smithi134.stdout: libcephsqlite-2:16.2.15-1.g8963e9de.el8.x86_64 oniguruma-6.8.2-3.el8.x86_64 2024-03-12T15:57:26.420 INFO:teuthology.orchestra.run.smithi134.stdout: socat-1.7.4.1-1.el8.x86_64 xmlstarlet-1.6.1-20.el8.x86_64 2024-03-12T15:57:26.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:26.420 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:57:26.640 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph 2024-03-12T15:57:26.887 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:57:27.104 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-03-12T15:57:27.361 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-03-12T15:57:27.400 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:00:55 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:57:27.619 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-03-12T15:57:27.851 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-03-12T15:57:28.082 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-03-12T15:57:28.265 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-03-12T15:57:28.439 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-03-12T15:57:28.642 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-03-12T15:57:28.854 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-03-12T15:57:28.983 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:57:28.986 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:57:28.986 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:57:28.986 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:57:28.986 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: ceph x86_64 2:16.2.15-1.g8963e9de.el8 ceph 6.4 k 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds x86_64 2:16.2.15-1.g8963e9de.el8 ceph 2.4 M 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr x86_64 2:16.2.15-1.g8963e9de.el8 ceph 1.6 M 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 245 k 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon x86_64 2:16.2.15-1.g8963e9de.el8 ceph 5.2 M 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd x86_64 2:16.2.15-1.g8963e9de.el8 ceph 19 M 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt x86_64 3.1.6-2.el8.1 epel 44 k 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4 noarch 4.6.3-2.el8.1 epel 185 k 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi x86_64 1.11.5-6.el8 baseos 249 k 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot noarch 8.5.2-1.el8 epel 173 k 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy noarch 18.4.0-1.el8 epel 384 k 2024-03-12T15:57:28.987 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography x86_64 3.2.1-7.el8 baseos 641 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco noarch 6.2-6.el8 epel 11 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools noarch 2.0-4.el8 epel 18 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils noarch 0.3.5-11.el8 epel 49 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako noarch 1.0.6-14.el8 appstream 157 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe x86_64 0.23-19.el8 appstream 39 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools noarch 7.2.0-3.el8 epel 59 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan noarch 1.3.2-9.el8 epel 283 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend noarch 2.6-1.el8 epel 16 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL noarch 19.0.0-1.el8 appstream 103 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser noarch 2.14-14.el8 baseos 109 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz noarch 2017.2-11.el8 appstream 57 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric noarch 0.8.1-17.el8 epel 19 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch noarch 3.4.0.3-18.el8 epel 24 k 2024-03-12T15:57:28.988 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora noarch 1.14.1-5.el8 epel 29 k 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme noarch 0.6.0-4.el8 epel 27 k 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress noarch 1.4.3-1.el8 epel 255 k 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob noarch 1.8.5-1.el8.1 epel 251 k 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest noarch 2.0.33-1.el8 epel 85 k 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug noarch 0.12.2-4.el8 appstream 457 k 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile noarch 2.0-2.el8 epel 23 k 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout:Install 32 Packages 2024-03-12T15:57:28.989 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:28.990 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 32 M 2024-03-12T15:57:28.990 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 104 M 2024-03-12T15:57:28.990 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:57:29.090 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-03-12T15:57:29.337 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-03-12T15:57:29.594 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-03-12T15:57:29.929 INFO:teuthology.orchestra.run.smithi134.stdout:(1/32): ceph-16.2.15-1.g8963e9de.el8.x86_64.rpm 36 kB/s | 6.4 kB 00:00 2024-03-12T15:57:30.014 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-03-12T15:57:30.063 INFO:teuthology.orchestra.run.smithi134.stdout:(2/32): ceph-mgr-16.2.15-1.g8963e9de.el8.x86_64 5.2 MB/s | 1.6 MB 00:00 2024-03-12T15:57:30.273 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-03-12T15:57:30.452 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-03-12T15:57:30.596 INFO:teuthology.orchestra.run.smithi134.stdout:(3/32): ceph-mds-16.2.15-1.g8963e9de.el8.x86_64 2.9 MB/s | 2.4 MB 00:00 2024-03-12T15:57:30.713 INFO:teuthology.orchestra.run.smithi134.stdout:(4/32): ceph-mgr-modules-core-16.2.15-1.g8963e9 2.1 MB/s | 245 kB 00:00 2024-03-12T15:57:30.732 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-03-12T15:57:30.839 INFO:teuthology.orchestra.run.smithi134.stdout:(5/32): python3-mako-1.0.6-14.el8.noarch.rpm 1.2 MB/s | 157 kB 00:00 2024-03-12T15:57:30.872 INFO:teuthology.orchestra.run.smithi134.stdout:(6/32): python3-markupsafe-0.23-19.el8.x86_64.r 1.1 MB/s | 39 kB 00:00 2024-03-12T15:57:30.914 INFO:teuthology.orchestra.run.smithi134.stdout:(7/32): python3-pyOpenSSL-19.0.0-1.el8.noarch.r 2.4 MB/s | 103 kB 00:00 2024-03-12T15:57:30.938 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-12T15:57:31.098 INFO:teuthology.orchestra.run.smithi134.stdout:(8/32): ceph-osd-16.2.15-1.g8963e9de.el8.x86_64 18 MB/s | 19 MB 00:01 2024-03-12T15:57:31.115 INFO:teuthology.orchestra.run.smithi134.stdout:(9/32): python3-pytz-2017.2-11.el8.noarch.rpm 285 kB/s | 57 kB 00:00 2024-03-12T15:57:31.274 INFO:teuthology.orchestra.run.smithi134.stdout:(10/32): python3-werkzeug-0.12.2-4.el8.noarch.r 2.6 MB/s | 457 kB 00:00 2024-03-12T15:57:31.286 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-03-12T15:57:31.349 INFO:teuthology.orchestra.run.smithi134.stdout:(11/32): ceph-mon-16.2.15-1.g8963e9de.el8.x86_6 3.7 MB/s | 5.2 MB 00:01 2024-03-12T15:57:31.518 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-03-12T15:57:31.798 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-03-12T15:57:32.025 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-03-12T15:57:32.149 INFO:teuthology.orchestra.run.smithi134.stdout:(12/32): python3-pycparser-2.14-14.el8.noarch.r 136 kB/s | 109 kB 00:00 2024-03-12T15:57:32.279 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-03-12T15:57:32.499 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-03-12T15:57:32.716 INFO:teuthology.orchestra.run.smithi134.stdout:(13/32): python3-bcrypt-3.1.6-2.el8.1.x86_64.rp 77 kB/s | 44 kB 00:00 2024-03-12T15:57:32.748 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-03-12T15:57:32.858 INFO:teuthology.orchestra.run.smithi134.stdout:(14/32): python3-cffi-1.11.5-6.el8.x86_64.rpm 143 kB/s | 249 kB 00:01 2024-03-12T15:57:33.070 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-03-12T15:57:33.438 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-03-12T15:57:33.466 INFO:teuthology.orchestra.run.smithi134.stdout:(15/32): python3-beautifulsoup4-4.6.3-2.el8.1.n 247 kB/s | 185 kB 00:00 2024-03-12T15:57:33.646 INFO:teuthology.orchestra.run.smithi134.stdout:(16/32): python3-cheroot-8.5.2-1.el8.noarch.rpm 219 kB/s | 173 kB 00:00 2024-03-12T15:57:33.784 INFO:teuthology.orchestra.run.smithi134.stdout:(17/32): python3-cryptography-3.2.1-7.el8.x86_6 255 kB/s | 641 kB 00:02 2024-03-12T15:57:33.823 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-modules-core-2:16.2.15-1.g8963e9de.el8.no 27/32 2024-03-12T15:57:34.009 INFO:teuthology.orchestra.run.smithi134.stdout:(18/32): python3-jaraco-6.2-6.el8.noarch.rpm 31 kB/s | 11 kB 00:00 2024-03-12T15:57:34.078 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 28/32 2024-03-12T15:57:34.243 INFO:teuthology.orchestra.run.smithi134.stdout:(19/32): python3-jaraco-functools-2.0-4.el8.noa 38 kB/s | 18 kB 00:00 2024-03-12T15:57:34.451 INFO:teuthology.orchestra.run.smithi134.stdout:(20/32): python3-cherrypy-18.4.0-1.el8.noarch.r 391 kB/s | 384 kB 00:00 2024-03-12T15:57:34.543 INFO:teuthology.orchestra.run.smithi134.stdout:(21/32): python3-logutils-0.3.5-11.el8.noarch.r 91 kB/s | 49 kB 00:00 2024-03-12T15:57:34.835 INFO:teuthology.orchestra.run.smithi134.stdout:(22/32): python3-more-itertools-7.2.0-3.el8.noa 99 kB/s | 59 kB 00:00 2024-03-12T15:57:34.910 INFO:teuthology.orchestra.run.smithi134.stdout:(23/32): python3-portend-2.6-1.el8.noarch.rpm 43 kB/s | 16 kB 00:00 2024-03-12T15:57:35.219 INFO:teuthology.orchestra.run.smithi134.stdout:(24/32): python3-simplegeneric-0.8.1-17.el8.noa 49 kB/s | 19 kB 00:00 2024-03-12T15:57:35.344 INFO:teuthology.orchestra.run.smithi134.stdout:(25/32): python3-singledispatch-3.4.0.3-18.el8. 55 kB/s | 24 kB 00:00 2024-03-12T15:57:35.378 INFO:teuthology.orchestra.run.smithi134.stdout:(26/32): python3-pecan-1.3.2-9.el8.noarch.rpm 305 kB/s | 283 kB 00:00 2024-03-12T15:57:35.670 INFO:teuthology.orchestra.run.smithi134.stdout:(27/32): python3-tempora-1.14.1-5.el8.noarch.rp 65 kB/s | 29 kB 00:00 2024-03-12T15:57:35.690 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 28/32 2024-03-12T15:57:35.787 INFO:teuthology.orchestra.run.smithi134.stdout:(28/32): python3-trustme-0.6.0-4.el8.noarch.rpm 62 kB/s | 27 kB 00:00 2024-03-12T15:57:35.893 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-osd-2:16.2.15-1.g8963e9de.el8.x86_64 29/32 2024-03-12T15:57:36.129 INFO:teuthology.orchestra.run.smithi134.stdout:(29/32): python3-waitress-1.4.3-1.el8.noarch.rp 340 kB/s | 255 kB 00:00 2024-03-12T15:57:36.337 INFO:teuthology.orchestra.run.smithi134.stdout:(30/32): python3-webtest-2.0.33-1.el8.noarch.rp 155 kB/s | 85 kB 00:00 2024-03-12T15:57:36.365 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-osd-2:16.2.15-1.g8963e9de.el8.x86_64 29/32 2024-03-12T15:57:36.370 INFO:teuthology.orchestra.run.smithi134.stdout:(31/32): python3-webob-1.8.5-1.el8.1.noarch.rpm 359 kB/s | 251 kB 00:00 2024-03-12T15:57:36.521 INFO:teuthology.orchestra.run.smithi134.stdout:(32/32): python3-zc-lockfile-2.0-2.el8.noarch.r 59 kB/s | 23 kB 00:00 2024-03-12T15:57:36.524 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:57:36.524 INFO:teuthology.orchestra.run.smithi134.stdout:Total 4.2 MB/s | 32 MB 00:07 2024-03-12T15:57:36.605 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:57:36.644 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:57:36.644 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:57:36.951 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:57:36.954 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:57:37.343 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mon-2:16.2.15-1.g8963e9de.el8.x86_64 30/32 2024-03-12T15:57:37.578 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mon-2:16.2.15-1.g8963e9de.el8.x86_64 30/32 2024-03-12T15:57:37.743 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mds-2:16.2.15-1.g8963e9de.el8.x86_64 31/32 2024-03-12T15:57:37.837 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mds-2:16.2.15-1.g8963e9de.el8.x86_64 31/32 2024-03-12T15:57:37.927 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-2:16.2.15-1.g8963e9de.el8.x86_64 32/32 2024-03-12T15:57:38.077 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:57:38.294 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-more-itertools-7.2.0-3.el8.noarch 1/32 2024-03-12T15:57:38.352 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-2:16.2.15-1.g8963e9de.el8.x86_64 32/32 2024-03-12T15:57:38.352 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-2:16.2.15-1.g8963e9de.el8.x86_64 1/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mds-2:16.2.15-1.g8963e9de.el8.x86_64 2/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 3/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mon-2:16.2.15-1.g8963e9de.el8.x86_64 4/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-osd-2:16.2.15-1.g8963e9de.el8.x86_64 5/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-modules-core-2:16.2.15-1.g8963e9de.el8.no 6/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-03-12T15:57:38.353 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-03-12T15:57:38.354 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-03-12T15:57:38.355 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-03-12T15:57:38.355 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-03-12T15:57:38.355 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-03-12T15:57:38.556 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webob-1.8.5-1.el8.1.noarch 2/32 2024-03-12T15:57:38.814 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-zc-lockfile-2.0-2.el8.noarch 3/32 2024-03-12T15:57:39.098 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-waitress-1.4.3-1.el8.noarch 4/32 2024-03-12T15:57:39.237 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-03-12T15:57:39.237 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:39.237 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:57:39.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:39.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mds-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:39.237 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-modules-core-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mon-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-osd-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-6.2-6.el8.noarch 2024-03-12T15:57:39.238 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-mako-1.0.6-14.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-portend-2.6-1.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pycparser-2.14-14.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pytz-2017.2-11.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-03-12T15:57:39.239 INFO:teuthology.orchestra.run.smithi006.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-03-12T15:57:39.240 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-03-12T15:57:39.240 INFO:teuthology.orchestra.run.smithi006.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-03-12T15:57:39.240 INFO:teuthology.orchestra.run.smithi006.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-03-12T15:57:39.240 INFO:teuthology.orchestra.run.smithi006.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-03-12T15:57:39.240 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:39.240 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:57:39.296 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-singledispatch-3.4.0.3-18.el8.noarch 5/32 2024-03-12T15:57:39.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-base 2024-03-12T15:57:39.530 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-simplegeneric-0.8.1-17.el8.noarch 6/32 2024-03-12T15:57:39.711 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-logutils-0.3.5-11.el8.noarch 7/32 2024-03-12T15:57:39.931 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-6.2-6.el8.noarch 8/32 2024-03-12T15:57:40.143 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jaraco-functools-2.0-4.el8.noarch 9/32 2024-03-12T15:57:40.274 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:18 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:57:40.405 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 10/32 2024-03-12T15:57:40.617 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-webtest-2.0.33-1.el8.noarch 11/32 2024-03-12T15:57:40.900 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pycparser-2.14-14.el8.noarch 12/32 2024-03-12T15:57:41.308 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cffi-1.11.5-6.el8.x86_64 13/32 2024-03-12T15:57:41.562 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cryptography-3.2.1-7.el8.x86_64 14/32 2024-03-12T15:57:41.791 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyOpenSSL-19.0.0-1.el8.noarch 15/32 2024-03-12T15:57:41.925 INFO:teuthology.orchestra.run.smithi006.stdout:Package ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:57:41.976 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:57:41.977 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-03-12T15:57:41.978 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:57:42.046 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-trustme-0.6.0-4.el8.noarch 16/32 2024-03-12T15:57:42.087 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install cephadm 2024-03-12T15:57:42.309 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-12T15:57:42.663 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-bcrypt-3.1.6-2.el8.1.x86_64 18/32 2024-03-12T15:57:42.874 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:20 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:57:42.923 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-werkzeug-0.12.2-4.el8.noarch 19/32 2024-03-12T15:57:43.103 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pytz-2017.2-11.el8.noarch 20/32 2024-03-12T15:57:43.313 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-tempora-1.14.1-5.el8.noarch 21/32 2024-03-12T15:57:43.548 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-portend-2.6-1.el8.noarch 22/32 2024-03-12T15:57:43.804 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cherrypy-18.4.0-1.el8.noarch 23/32 2024-03-12T15:57:44.025 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-markupsafe-0.23-19.el8.x86_64 24/32 2024-03-12T15:57:44.386 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-mako-1.0.6-14.el8.noarch 25/32 2024-03-12T15:57:44.577 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:57:44.577 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 85 k 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 85 k 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 352 k 2024-03-12T15:57:44.578 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:57:44.702 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pecan-1.3.2-9.el8.noarch 26/32 2024-03-12T15:57:44.883 INFO:teuthology.orchestra.run.smithi006.stdout:cephadm-16.2.15-1.g8963e9de.el8.noarch.rpm 280 kB/s | 85 kB 00:00 2024-03-12T15:57:44.883 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:57:44.884 INFO:teuthology.orchestra.run.smithi006.stdout:Total 279 kB/s | 85 kB 00:00 2024-03-12T15:57:44.884 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:57:44.891 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:57:44.892 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:57:44.893 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:57:44.897 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:57:44.942 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:57:45.059 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-modules-core-2:16.2.15-1.g8963e9de.el8.no 27/32 2024-03-12T15:57:45.314 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 28/32 2024-03-12T15:57:45.445 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/1 2024-03-12T15:57:45.607 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/1 2024-03-12T15:57:45.846 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/1 2024-03-12T15:57:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/1 2024-03-12T15:57:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:46.224 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:57:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: cephadm-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:57:46.224 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:46.224 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:57:46.447 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-immutable-object-cache 2024-03-12T15:57:46.835 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 28/32 2024-03-12T15:57:47.066 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-osd-2:16.2.15-1.g8963e9de.el8.x86_64 29/32 2024-03-12T15:57:47.238 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:25 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:57:47.511 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-osd-2:16.2.15-1.g8963e9de.el8.x86_64 29/32 2024-03-12T15:57:47.731 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mon-2:16.2.15-1.g8963e9de.el8.x86_64 30/32 2024-03-12T15:57:47.962 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mon-2:16.2.15-1.g8963e9de.el8.x86_64 30/32 2024-03-12T15:57:48.156 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mds-2:16.2.15-1.g8963e9de.el8.x86_64 31/32 2024-03-12T15:57:48.174 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mds-2:16.2.15-1.g8963e9de.el8.x86_64 31/32 2024-03-12T15:57:48.314 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-2:16.2.15-1.g8963e9de.el8.x86_64 32/32 2024-03-12T15:57:48.725 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-2:16.2.15-1.g8963e9de.el8.x86_64 32/32 2024-03-12T15:57:48.725 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-2:16.2.15-1.g8963e9de.el8.x86_64 1/32 2024-03-12T15:57:48.725 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mds-2:16.2.15-1.g8963e9de.el8.x86_64 2/32 2024-03-12T15:57:48.725 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 3/32 2024-03-12T15:57:48.725 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mon-2:16.2.15-1.g8963e9de.el8.x86_64 4/32 2024-03-12T15:57:48.725 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-osd-2:16.2.15-1.g8963e9de.el8.x86_64 5/32 2024-03-12T15:57:48.725 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-modules-core-2:16.2.15-1.g8963e9de.el8.no 6/32 2024-03-12T15:57:48.725 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-mako-1.0.6-14.el8.noarch 7/32 2024-03-12T15:57:48.725 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-markupsafe-0.23-19.el8.x86_64 8/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyOpenSSL-19.0.0-1.el8.noarch 9/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pytz-2017.2-11.el8.noarch 10/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-werkzeug-0.12.2-4.el8.noarch 11/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cffi-1.11.5-6.el8.x86_64 12/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cryptography-3.2.1-7.el8.x86_64 13/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pycparser-2.14-14.el8.noarch 14/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-bcrypt-3.1.6-2.el8.1.x86_64 15/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-beautifulsoup4-4.6.3-2.el8.1.noarch 16/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cheroot-8.5.2-1.el8.noarch 17/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cherrypy-18.4.0-1.el8.noarch 18/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-6.2-6.el8.noarch 19/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jaraco-functools-2.0-4.el8.noarch 20/32 2024-03-12T15:57:48.726 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-logutils-0.3.5-11.el8.noarch 21/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-more-itertools-7.2.0-3.el8.noarch 22/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pecan-1.3.2-9.el8.noarch 23/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-portend-2.6-1.el8.noarch 24/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-simplegeneric-0.8.1-17.el8.noarch 25/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-singledispatch-3.4.0.3-18.el8.noarch 26/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-tempora-1.14.1-5.el8.noarch 27/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-trustme-0.6.0-4.el8.noarch 28/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-waitress-1.4.3-1.el8.noarch 29/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webob-1.8.5-1.el8.1.noarch 30/32 2024-03-12T15:57:48.727 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-webtest-2.0.33-1.el8.noarch 31/32 2024-03-12T15:57:48.948 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:57:48.948 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:48.948 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repo Size 2024-03-12T15:57:48.948 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:48.949 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:57:48.949 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache x86_64 2:16.2.15-1.g8963e9de.el8 ceph 161 k 2024-03-12T15:57:48.949 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:48.949 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:57:48.949 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:48.949 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2024-03-12T15:57:48.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:48.950 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 161 k 2024-03-12T15:57:48.950 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 470 k 2024-03-12T15:57:48.951 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:57:49.280 INFO:teuthology.orchestra.run.smithi006.stdout:ceph-immutable-object-cache-16.2.15-1.g8963e9de 488 kB/s | 161 kB 00:00 2024-03-12T15:57:49.281 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:57:49.281 INFO:teuthology.orchestra.run.smithi006.stdout:Total 486 kB/s | 161 kB 00:00 2024-03-12T15:57:49.281 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:57:49.294 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:57:49.294 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:57:49.345 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:57:49.348 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:57:49.475 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:57:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-zc-lockfile-2.0-2.el8.noarch 32/32 2024-03-12T15:57:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:49.647 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:57:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:49.647 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mds-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-modules-core-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mon-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-osd-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-bcrypt-3.1.6-2.el8.1.x86_64 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-beautifulsoup4-4.6.3-2.el8.1.noarch 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cffi-1.11.5-6.el8.x86_64 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cheroot-8.5.2-1.el8.noarch 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cherrypy-18.4.0-1.el8.noarch 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cryptography-3.2.1-7.el8.x86_64 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-6.2-6.el8.noarch 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jaraco-functools-2.0-4.el8.noarch 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-logutils-0.3.5-11.el8.noarch 2024-03-12T15:57:49.648 INFO:teuthology.orchestra.run.smithi134.stdout: python3-mako-1.0.6-14.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-markupsafe-0.23-19.el8.x86_64 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-more-itertools-7.2.0-3.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pecan-1.3.2-9.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-portend-2.6-1.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyOpenSSL-19.0.0-1.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pycparser-2.14-14.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pytz-2017.2-11.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-simplegeneric-0.8.1-17.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-singledispatch-3.4.0.3-18.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-tempora-1.14.1-5.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-trustme-0.6.0-4.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-waitress-1.4.3-1.el8.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webob-1.8.5-1.el8.1.noarch 2024-03-12T15:57:49.649 INFO:teuthology.orchestra.run.smithi134.stdout: python3-webtest-2.0.33-1.el8.noarch 2024-03-12T15:57:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: python3-werkzeug-0.12.2-4.el8.noarch 2024-03-12T15:57:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: python3-zc-lockfile-2.0-2.el8.noarch 2024-03-12T15:57:49.650 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:49.650 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:57:49.675 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-immutable-object-cache-2:16.2.15-1.g8963e9de.el 1/1 2024-03-12T15:57:49.893 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-base 2024-03-12T15:57:50.115 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.15-1.g8963e9de.el 1/1 2024-03-12T15:57:50.514 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-immutable-object-cache-2:16.2.15-1.g8963e9de.el 1/1 2024-03-12T15:57:50.514 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:50.514 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:57:50.514 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-immutable-object-cache-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:57:50.514 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:50.514 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:57:50.652 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:18 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:57:50.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-mgr 2024-03-12T15:57:51.514 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:29 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:57:52.204 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-base-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:57:52.250 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:57:52.251 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-12T15:57:52.252 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:57:52.366 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install cephadm 2024-03-12T15:57:53.118 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:21 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:57:53.164 INFO:teuthology.orchestra.run.smithi006.stdout:Package ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:57:53.217 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:57:53.218 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-03-12T15:57:53.219 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:57:53.327 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-mgr-dashboard 2024-03-12T15:57:54.119 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:32 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:57:54.715 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:57:54.715 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:57:54.715 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:57:54.715 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:57:54.715 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:57:54.715 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 85 k 2024-03-12T15:57:54.715 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:54.716 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:57:54.716 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:57:54.716 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-12T15:57:54.716 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:54.716 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 85 k 2024-03-12T15:57:54.716 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 352 k 2024-03-12T15:57:54.716 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:57:54.884 INFO:teuthology.orchestra.run.smithi134.stdout:cephadm-16.2.15-1.g8963e9de.el8.noarch.rpm 509 kB/s | 85 kB 00:00 2024-03-12T15:57:54.885 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:57:54.885 INFO:teuthology.orchestra.run.smithi134.stdout:Total 505 kB/s | 85 kB 00:00 2024-03-12T15:57:54.885 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:57:54.892 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:57:54.892 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:57:54.894 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:57:54.897 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:57:54.944 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:57:55.421 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/1 2024-03-12T15:57:55.566 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/1 2024-03-12T15:57:55.801 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/1 2024-03-12T15:57:55.828 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:57:55.829 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:55.829 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:57:55.829 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:55.829 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:57:55.829 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 3.1 M 2024-03-12T15:57:55.829 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:57:55.829 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 24 k 2024-03-12T15:57:55.829 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 15 k 2024-03-12T15:57:55.829 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-03-12T15:57:55.830 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-03-12T15:57:55.830 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-03-12T15:57:55.830 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:55.830 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:57:55.830 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:57:55.830 INFO:teuthology.orchestra.run.smithi006.stdout:Install 6 Packages 2024-03-12T15:57:55.830 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:57:55.831 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 3.4 M 2024-03-12T15:57:55.831 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 22 M 2024-03-12T15:57:55.831 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:57:56.049 INFO:teuthology.orchestra.run.smithi006.stdout:(1/6): ceph-prometheus-alerts-16.2.15-1.g8963e9 100 kB/s | 15 kB 00:00 2024-03-12T15:57:56.169 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/1 2024-03-12T15:57:56.169 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:56.170 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:57:56.170 INFO:teuthology.orchestra.run.smithi134.stdout: cephadm-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:57:56.170 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:57:56.170 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:57:56.249 INFO:teuthology.orchestra.run.smithi006.stdout:(2/6): ceph-grafana-dashboards-16.2.15-1.g8963e 70 kB/s | 24 kB 00:00 2024-03-12T15:57:56.291 INFO:teuthology.orchestra.run.smithi006.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 177 kB/s | 43 kB 00:00 2024-03-12T15:57:56.441 INFO:teuthology.orchestra.run.smithi006.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 175 kB/s | 34 kB 00:00 2024-03-12T15:57:56.592 INFO:teuthology.orchestra.run.smithi006.stdout:(5/6): python3-routes-2.4.1-12.el8.noarch.rpm 654 kB/s | 196 kB 00:00 2024-03-12T15:57:57.384 INFO:teuthology.orchestra.run.smithi006.stdout:(6/6): ceph-mgr-dashboard-16.2.15-1.g8963e9de.e 2.1 MB/s | 3.1 MB 00:01 2024-03-12T15:57:57.386 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:57:57.386 INFO:teuthology.orchestra.run.smithi006.stdout:Total 2.2 MB/s | 3.4 MB 00:01 2024-03-12T15:57:57.399 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:57:57.410 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:57:57.411 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:57:57.578 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:57:57.582 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:57:57.893 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:57:58.115 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-03-12T15:57:58.121 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-immutable-object-cache 2024-03-12T15:57:58.376 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-03-12T15:57:58.585 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-03-12T15:57:58.697 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-prometheus-alerts-2:16.2.15-1.g8963e9de.el8.noa 4/6 2024-03-12T15:57:58.895 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:26 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:58:00.030 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-grafana-dashboards-2:16.2.15-1.g8963e9de.el8.no 5/6 2024-03-12T15:58:00.325 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-dashboard-2:16.2.15-1.g8963e9de.el8.noarch 6/6 2024-03-12T15:58:00.492 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache x86_64 2:16.2.15-1.g8963e9de.el8 ceph 161 k 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:00.494 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 161 k 2024-03-12T15:58:00.495 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 470 k 2024-03-12T15:58:00.495 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:58:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.15-1.g8963e9de.el8.noarch 6/6 2024-03-12T15:58:00.612 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-grafana-dashboards-2:16.2.15-1.g8963e9de.el8.no 1/6 2024-03-12T15:58:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-dashboard-2:16.2.15-1.g8963e9de.el8.noarch 2/6 2024-03-12T15:58:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-prometheus-alerts-2:16.2.15-1.g8963e9de.el8.noa 3/6 2024-03-12T15:58:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-03-12T15:58:00.613 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-03-12T15:58:00.897 INFO:teuthology.orchestra.run.smithi134.stdout:ceph-immutable-object-cache-16.2.15-1.g8963e9de 400 kB/s | 161 kB 00:00 2024-03-12T15:58:00.898 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:00.898 INFO:teuthology.orchestra.run.smithi134.stdout:Total 398 kB/s | 161 kB 00:00 2024-03-12T15:58:00.898 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:58:00.909 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:58:00.910 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:58:00.958 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:58:00.960 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:58:01.066 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:58:01.193 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-03-12T15:58:01.193 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:01.193 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:58:01.193 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-grafana-dashboards-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:01.193 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-dashboard-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:01.194 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-prometheus-alerts-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:01.194 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-03-12T15:58:01.194 INFO:teuthology.orchestra.run.smithi006.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-03-12T15:58:01.194 INFO:teuthology.orchestra.run.smithi006.stdout: python3-routes-2.4.1-12.el8.noarch 2024-03-12T15:58:01.194 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:01.194 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:58:01.287 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-immutable-object-cache-2:16.2.15-1.g8963e9de.el 1/1 2024-03-12T15:58:01.318 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-12T15:58:01.696 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-immutable-object-cache-2:16.2.15-1.g8963e9de.el 1/1 2024-03-12T15:58:02.095 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-immutable-object-cache-2:16.2.15-1.g8963e9de.el 1/1 2024-03-12T15:58:02.096 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:02.096 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:58:02.096 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-immutable-object-cache-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:58:02.096 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:02.096 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:58:02.101 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:40 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:58:02.320 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr 2024-03-12T15:58:03.086 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:31 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:58:03.807 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:58:03.808 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================ 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================ 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 8.6 M 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-03-12T15:58:03.809 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-03-12T15:58:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:03.810 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:58:03.810 INFO:teuthology.orchestra.run.smithi006.stdout:============================================================================================ 2024-03-12T15:58:03.810 INFO:teuthology.orchestra.run.smithi006.stdout:Install 8 Packages 2024-03-12T15:58:03.810 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:03.810 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 37 M 2024-03-12T15:58:03.810 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 210 M 2024-03-12T15:58:03.811 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:58:04.627 INFO:teuthology.orchestra.run.smithi134.stdout:Package ceph-mgr-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:58:04.676 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:58:04.678 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-12T15:58:04.678 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:58:04.788 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-dashboard 2024-03-12T15:58:05.549 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:33 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:58:06.349 INFO:teuthology.orchestra.run.smithi006.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.15-1. 7.5 MB/s | 8.6 MB 00:01 2024-03-12T15:58:06.649 INFO:teuthology.orchestra.run.smithi006.stdout:(2/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 3.4 MB/s | 4.9 MB 00:01 2024-03-12T15:58:06.924 INFO:teuthology.orchestra.run.smithi006.stdout:(3/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 819 kB/s | 225 kB 00:00 2024-03-12T15:58:07.041 INFO:teuthology.orchestra.run.smithi006.stdout:(4/8): openblas-0.3.15-4.el8.x86_64.rpm 2.6 MB/s | 4.7 MB 00:01 2024-03-12T15:58:07.137 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:58:07.138 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:58:07.138 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:07.138 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:58:07.138 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 3.1 M 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 24 k 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 15 k 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt noarch 1.6.1-2.el8 baseos 43 k 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru noarch 0.7-6.el8 epel 34 k 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes noarch 2.4.1-12.el8 epel 196 k 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-03-12T15:58:07.139 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:07.140 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.4 M 2024-03-12T15:58:07.140 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 22 M 2024-03-12T15:58:07.140 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:58:07.458 INFO:teuthology.orchestra.run.smithi006.stdout:(5/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 3.4 MB/s | 3.7 MB 00:01 2024-03-12T15:58:08.092 INFO:teuthology.orchestra.run.smithi006.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 272 kB/s | 172 kB 00:00 2024-03-12T15:58:08.132 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): ceph-grafana-dashboards-16.2.15-1.g8963e 159 kB/s | 24 kB 00:00 2024-03-12T15:58:08.199 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): ceph-prometheus-alerts-16.2.15-1.g8963e9 67 kB/s | 15 kB 00:00 2024-03-12T15:58:08.416 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-jwt-1.6.1-2.el8.noarch.rpm 150 kB/s | 43 kB 00:00 2024-03-12T15:58:08.525 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-repoze-lru-0.7-6.el8.noarch.rpm 103 kB/s | 34 kB 00:00 2024-03-12T15:58:08.775 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): ceph-mgr-dashboard-16.2.15-1.g8963e9de.e 3.9 MB/s | 3.1 MB 00:00 2024-03-12T15:58:09.092 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-routes-2.4.1-12.el8.noarch.rpm 291 kB/s | 196 kB 00:00 2024-03-12T15:58:09.096 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:09.096 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.8 MB/s | 3.4 MB 00:01 2024-03-12T15:58:09.108 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:58:09.119 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:58:09.119 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:58:09.283 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:58:09.286 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:58:09.471 INFO:teuthology.orchestra.run.smithi006.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 266 kB/s | 645 kB 00:02 2024-03-12T15:58:09.570 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:58:09.783 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-repoze-lru-0.7-6.el8.noarch 1/6 2024-03-12T15:58:10.046 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-routes-2.4.1-12.el8.noarch 2/6 2024-03-12T15:58:10.288 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jwt-1.6.1-2.el8.noarch 3/6 2024-03-12T15:58:10.400 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-prometheus-alerts-2:16.2.15-1.g8963e9de.el8.noa 4/6 2024-03-12T15:58:11.414 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-grafana-dashboards-2:16.2.15-1.g8963e9de.el8.no 5/6 2024-03-12T15:58:11.576 INFO:teuthology.orchestra.run.smithi006.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 3.0 MB/s | 14 MB 00:04 2024-03-12T15:58:11.577 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:11.577 INFO:teuthology.orchestra.run.smithi006.stdout:Total 4.8 MB/s | 37 MB 00:07 2024-03-12T15:58:11.709 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-dashboard-2:16.2.15-1.g8963e9de.el8.noarch 6/6 2024-03-12T15:58:11.817 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:58:11.837 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:58:11.837 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:58:11.992 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-dashboard-2:16.2.15-1.g8963e9de.el8.noarch 6/6 2024-03-12T15:58:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-grafana-dashboards-2:16.2.15-1.g8963e9de.el8.no 1/6 2024-03-12T15:58:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-dashboard-2:16.2.15-1.g8963e9de.el8.noarch 2/6 2024-03-12T15:58:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-prometheus-alerts-2:16.2.15-1.g8963e9de.el8.noa 3/6 2024-03-12T15:58:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jwt-1.6.1-2.el8.noarch 4/6 2024-03-12T15:58:11.993 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-repoze-lru-0.7-6.el8.noarch 5/6 2024-03-12T15:58:12.189 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:58:12.192 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:58:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-routes-2.4.1-12.el8.noarch 6/6 2024-03-12T15:58:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:12.401 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:58:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-grafana-dashboards-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:12.401 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-dashboard-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-prometheus-alerts-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jwt-1.6.1-2.el8.noarch 2024-03-12T15:58:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-repoze-lru-0.7-6.el8.noarch 2024-03-12T15:58:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: python3-routes-2.4.1-12.el8.noarch 2024-03-12T15:58:12.402 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:12.402 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:58:12.526 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-diskprediction-local 2024-03-12T15:58:12.795 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:58:12.972 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-03-12T15:58:13.098 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-03-12T15:58:13.230 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-03-12T15:58:13.279 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:01:41 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:58:13.859 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-03-12T15:58:14.055 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-03-12T15:58:14.706 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-03-12T15:58:14.868 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:58:14.869 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================================ 2024-03-12T15:58:14.869 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================================ 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 8.6 M 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran x86_64 8.5.0-21.el8 baseos 645 k 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath x86_64 8.5.0-21.el8 baseos 172 k 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout: openblas x86_64 0.3.15-4.el8 appstream 4.7 M 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads x86_64 0.3.15-4.el8 appstream 4.9 M 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy x86_64 1:1.14.3-10.el8 appstream 3.7 M 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py x86_64 1:1.14.3-10.el8 appstream 225 k 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy x86_64 1.0.0-21.module_el8+762+77bd8591 appstream 14 M 2024-03-12T15:58:14.870 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:58:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:============================================================================================ 2024-03-12T15:58:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:Install 8 Packages 2024-03-12T15:58:14.871 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 37 M 2024-03-12T15:58:14.871 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 210 M 2024-03-12T15:58:14.872 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:58:14.896 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-03-12T15:58:15.603 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-03-12T15:58:15.904 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-03-12T15:58:16.023 INFO:teuthology.orchestra.run.smithi134.stdout:(1/8): ceph-mgr-diskprediction-local-16.2.15-1. 12 MB/s | 8.6 MB 00:00 2024-03-12T15:58:16.163 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-03-12T15:58:16.723 INFO:teuthology.orchestra.run.smithi134.stdout:(2/8): openblas-0.3.15-4.el8.x86_64.rpm 3.3 MB/s | 4.7 MB 00:01 2024-03-12T15:58:16.832 INFO:teuthology.orchestra.run.smithi134.stdout:(3/8): openblas-threads-0.3.15-4.el8.x86_64.rpm 3.1 MB/s | 4.9 MB 00:01 2024-03-12T15:58:16.882 INFO:teuthology.orchestra.run.smithi134.stdout:(4/8): python3-numpy-1.14.3-10.el8.x86_64.rpm 4.3 MB/s | 3.7 MB 00:00 2024-03-12T15:58:16.938 INFO:teuthology.orchestra.run.smithi134.stdout:(5/8): python3-numpy-f2py-1.14.3-10.el8.x86_64. 1.0 MB/s | 225 kB 00:00 2024-03-12T15:58:17.999 INFO:teuthology.orchestra.run.smithi134.stdout:(6/8): libquadmath-8.5.0-21.el8.x86_64.rpm 162 kB/s | 172 kB 00:01 2024-03-12T15:58:18.046 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-03-12T15:58:18.907 INFO:teuthology.orchestra.run.smithi134.stdout:(7/8): libgfortran-8.5.0-21.el8.x86_64.rpm 319 kB/s | 645 kB 00:02 2024-03-12T15:58:19.412 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-03-12T15:58:19.596 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.15-1.g8963e9de. 8/8 2024-03-12T15:58:19.934 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.15-1.g8963e9de. 8/8 2024-03-12T15:58:19.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.15-1.g8963e9de. 1/8 2024-03-12T15:58:19.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-03-12T15:58:19.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-03-12T15:58:19.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-03-12T15:58:19.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-03-12T15:58:19.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-03-12T15:58:19.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-diskprediction-local-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-0.3.15-4.el8.x86_64 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-03-12T15:58:20.361 INFO:teuthology.orchestra.run.smithi006.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-03-12T15:58:20.362 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:20.362 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:58:20.485 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-mgr-rook 2024-03-12T15:58:21.271 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:01:59 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:58:22.977 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:58:22.979 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:22.979 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:58:22.979 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:22.979 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:58:22.979 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 27 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-03-12T15:58:22.980 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-03-12T15:58:22.981 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-03-12T15:58:22.981 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:22.981 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:58:22.981 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:22.981 INFO:teuthology.orchestra.run.smithi006.stdout:Install 13 Packages 2024-03-12T15:58:22.981 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:22.981 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 1.9 M 2024-03-12T15:58:22.982 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 24 M 2024-03-12T15:58:22.982 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:58:24.174 INFO:teuthology.orchestra.run.smithi006.stdout:(1/13): ceph-mgr-rook-16.2.15-1.g8963e9de.el8.n 79 kB/s | 27 kB 00:00 2024-03-12T15:58:24.199 INFO:teuthology.orchestra.run.smithi006.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 71 kB/s | 27 kB 00:00 2024-03-12T15:58:24.224 INFO:teuthology.orchestra.run.smithi006.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 50 kB/s | 20 kB 00:00 2024-03-12T15:58:24.591 INFO:teuthology.orchestra.run.smithi006.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 300 kB/s | 110 kB 00:00 2024-03-12T15:58:24.825 INFO:teuthology.orchestra.run.smithi006.stdout:(5/13): python3-requests-oauthlib-1.0.0-1.el8.n 183 kB/s | 43 kB 00:00 2024-03-12T15:58:24.858 INFO:teuthology.orchestra.run.smithi006.stdout:(6/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 185 kB/s | 126 kB 00:00 2024-03-12T15:58:24.909 INFO:teuthology.orchestra.run.smithi006.stdout:(7/13): python3-oauthlib-2.1.0-1.el8.noarch.rpm 226 kB/s | 155 kB 00:00 2024-03-12T15:58:25.151 INFO:teuthology.orchestra.run.smithi006.stdout:(8/13): python3-certifi-2018.10.15-7.el8.noarch 56 kB/s | 16 kB 00:00 2024-03-12T15:58:25.184 INFO:teuthology.orchestra.run.smithi006.stdout:(9/13): python3-cachetools-3.1.1-4.el8.noarch.r 92 kB/s | 33 kB 00:00 2024-03-12T15:58:25.635 INFO:teuthology.orchestra.run.smithi006.stdout:(10/13): python3-kubernetes-11.0.0-6.el8.noarch 2.4 MB/s | 1.2 MB 00:00 2024-03-12T15:58:25.719 INFO:teuthology.orchestra.run.smithi006.stdout:(11/13): python3-websocket-client-0.56.0-5.el8. 732 kB/s | 61 kB 00:00 2024-03-12T15:58:25.777 INFO:teuthology.orchestra.run.smithi006.stdout:(12/13): python3-rsa-4.9-2.el8.noarch.rpm 108 kB/s | 64 kB 00:00 2024-03-12T15:58:26.235 INFO:teuthology.orchestra.run.smithi006.stdout:(13/13): python3-google-auth-1.1.1-10.el8.noarc 61 kB/s | 81 kB 00:01 2024-03-12T15:58:26.238 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:26.238 INFO:teuthology.orchestra.run.smithi006.stdout:Total 601 kB/s | 1.9 MB 00:03 2024-03-12T15:58:26.299 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:58:26.316 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:58:26.316 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:58:26.411 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:58:26.414 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:58:26.980 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:58:27.242 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-03-12T15:58:27.481 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-03-12T15:58:27.699 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-03-12T15:58:27.927 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-03-12T15:58:28.120 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-03-12T15:58:28.497 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-03-12T15:58:28.809 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-03-12T15:58:29.045 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-03-12T15:58:30.166 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-03-12T15:58:30.407 INFO:teuthology.orchestra.run.smithi134.stdout:(8/8): python3-scipy-1.0.0-21.module_el8+762+77 1.0 MB/s | 14 MB 00:13 2024-03-12T15:58:30.408 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:30.408 INFO:teuthology.orchestra.run.smithi134.stdout:Total 2.4 MB/s | 37 MB 00:15 2024-03-12T15:58:30.477 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-03-12T15:58:30.641 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:58:30.659 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:58:30.659 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:58:30.962 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-03-12T15:58:30.998 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:58:31.001 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:58:31.154 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-03-12T15:58:31.369 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-rook-2:16.2.15-1.g8963e9de.el8.noarch 13/13 2024-03-12T15:58:31.579 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:58:31.669 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.15-1.g8963e9de.el8.noarch 13/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-rook-2:16.2.15-1.g8963e9de.el8.noarch 1/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-03-12T15:58:31.670 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-03-12T15:58:31.774 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libquadmath-8.5.0-21.el8.x86_64 1/8 2024-03-12T15:58:31.910 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libquadmath-8.5.0-21.el8.x86_64 1/8 2024-03-12T15:58:32.099 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libgfortran-8.5.0-21.el8.x86_64 2/8 2024-03-12T15:58:32.170 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-rook-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-03-12T15:58:32.171 INFO:teuthology.orchestra.run.smithi006.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-03-12T15:58:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-03-12T15:58:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: python3-rsa-4.9-2.el8.noarch 2024-03-12T15:58:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-03-12T15:58:32.172 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:32.172 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:58:32.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-mgr-cephadm 2024-03-12T15:58:32.679 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libgfortran-8.5.0-21.el8.x86_64 2/8 2024-03-12T15:58:32.840 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-0.3.15-4.el8.x86_64 3/8 2024-03-12T15:58:33.070 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:11 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:58:33.459 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-0.3.15-4.el8.x86_64 3/8 2024-03-12T15:58:33.673 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-03-12T15:58:34.353 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: openblas-threads-0.3.15-4.el8.x86_64 4/8 2024-03-12T15:58:34.702 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-1:1.14.3-10.el8.x86_64 5/8 2024-03-12T15:58:34.776 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 116 k 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-03-12T15:58:34.777 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-03-12T15:58:34.778 INFO:teuthology.orchestra.run.smithi006.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-03-12T15:58:34.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:34.778 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:58:34.778 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:34.778 INFO:teuthology.orchestra.run.smithi006.stdout:Install 6 Packages 2024-03-12T15:58:34.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:34.778 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 5.9 M 2024-03-12T15:58:34.779 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 24 M 2024-03-12T15:58:34.779 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:58:34.916 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-03-12T15:58:35.287 INFO:teuthology.orchestra.run.smithi006.stdout:(1/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 2.2 MB/s | 578 kB 00:00 2024-03-12T15:58:35.387 INFO:teuthology.orchestra.run.smithi006.stdout:(2/6): ceph-mgr-cephadm-16.2.15-1.g8963e9de.el8 329 kB/s | 116 kB 00:00 2024-03-12T15:58:35.412 INFO:teuthology.orchestra.run.smithi006.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 169 kB/s | 21 kB 00:00 2024-03-12T15:58:35.521 INFO:teuthology.orchestra.run.smithi006.stdout:(4/6): python3-remoto-1.2.1-1.el8.noarch.rpm 475 kB/s | 49 kB 00:00 2024-03-12T15:58:35.838 INFO:teuthology.orchestra.run.smithi006.stdout:(5/6): python3-execnet-1.7.1-1.el8.noarch.rpm 789 kB/s | 355 kB 00:00 2024-03-12T15:58:36.238 INFO:teuthology.orchestra.run.smithi006.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 4.0 MB/s | 4.8 MB 00:01 2024-03-12T15:58:36.241 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:36.241 INFO:teuthology.orchestra.run.smithi006.stdout:Total 4.0 MB/s | 5.9 MB 00:01 2024-03-12T15:58:36.296 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:58:36.307 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:58:36.308 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:58:36.423 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:58:36.426 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:58:36.681 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 6/8 2024-03-12T15:58:36.846 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:58:37.149 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-03-12T15:58:37.540 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-03-12T15:58:38.054 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 7/8 2024-03-12T15:58:38.298 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-diskprediction-local-2:16.2.15-1.g8963e9de. 8/8 2024-03-12T15:58:38.525 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-03-12T15:58:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:16.2.15-1.g8963e9de. 8/8 2024-03-12T15:58:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-diskprediction-local-2:16.2.15-1.g8963e9de. 1/8 2024-03-12T15:58:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-0.3.15-4.el8.x86_64 2/8 2024-03-12T15:58:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : openblas-threads-0.3.15-4.el8.x86_64 3/8 2024-03-12T15:58:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-1:1.14.3-10.el8.x86_64 4/8 2024-03-12T15:58:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-numpy-f2py-1:1.14.3-10.el8.x86_64 5/8 2024-03-12T15:58:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_6 6/8 2024-03-12T15:58:38.604 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libgfortran-8.5.0-21.el8.x86_64 7/8 2024-03-12T15:58:38.914 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-03-12T15:58:39.010 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libquadmath-8.5.0-21.el8.x86_64 8/8 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-diskprediction-local-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: libgfortran-8.5.0-21.el8.x86_64 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: libquadmath-8.5.0-21.el8.x86_64 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-0.3.15-4.el8.x86_64 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: openblas-threads-0.3.15-4.el8.x86_64 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-1:1.14.3-10.el8.x86_64 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-numpy-f2py-1:1.14.3-10.el8.x86_64 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: python3-scipy-1.0.0-21.module_el8+762+77bd8591.x86_64 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:39.011 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:58:39.140 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-rook 2024-03-12T15:58:39.212 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-03-12T15:58:39.427 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-mgr-cephadm-2:16.2.15-1.g8963e9de.el8.noarch 6/6 2024-03-12T15:58:39.759 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.15-1.g8963e9de.el8.noarch 6/6 2024-03-12T15:58:39.760 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-mgr-cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/6 2024-03-12T15:58:39.760 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-03-12T15:58:39.760 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-03-12T15:58:39.760 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-03-12T15:58:39.760 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-03-12T15:58:39.894 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:07 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:58:40.167 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-03-12T15:58:40.167 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:40.167 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:58:40.167 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-mgr-cephadm-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:40.167 INFO:teuthology.orchestra.run.smithi006.stdout: python3-apipkg-1.5-6.el8.noarch 2024-03-12T15:58:40.167 INFO:teuthology.orchestra.run.smithi006.stdout: python3-babel-2.5.1-7.el8.noarch 2024-03-12T15:58:40.167 INFO:teuthology.orchestra.run.smithi006.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-03-12T15:58:40.167 INFO:teuthology.orchestra.run.smithi006.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-03-12T15:58:40.168 INFO:teuthology.orchestra.run.smithi006.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-03-12T15:58:40.168 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:40.168 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:58:40.285 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install ceph-fuse 2024-03-12T15:58:41.079 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:19 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:58:41.498 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:58:41.499 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:41.499 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 27 k 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools noarch 3.1.1-4.el8 epel 33 k 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi noarch 2018.10.15-7.el8 epel 16 k 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth noarch 1:1.1.1-10.el8 epel 81 k 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch noarch 1.21-2.el8 appstream 27 k 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer noarch 1.10-11.el8 appstream 20 k 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes noarch 1:11.0.0-6.el8 epel 1.2 M 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib noarch 2.1.0-1.el8 baseos 155 k 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1 noarch 0.3.7-6.el8 appstream 126 k 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules noarch 0.3.7-6.el8 appstream 110 k 2024-03-12T15:58:41.500 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib noarch 1.0.0-1.el8 baseos 43 k 2024-03-12T15:58:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa noarch 4.9-2.el8 epel 64 k 2024-03-12T15:58:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client noarch 0.56.0-5.el8 epel 61 k 2024-03-12T15:58:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:41.501 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:58:41.501 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:41.501 INFO:teuthology.orchestra.run.smithi134.stdout:Install 13 Packages 2024-03-12T15:58:41.501 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:41.502 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 1.9 M 2024-03-12T15:58:41.502 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 24 M 2024-03-12T15:58:41.502 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:58:41.789 INFO:teuthology.orchestra.run.smithi134.stdout:(1/13): ceph-mgr-rook-16.2.15-1.g8963e9de.el8.n 178 kB/s | 27 kB 00:00 2024-03-12T15:58:41.914 INFO:teuthology.orchestra.run.smithi134.stdout:(2/13): python3-jsonpatch-1.21-2.el8.noarch.rpm 95 kB/s | 27 kB 00:00 2024-03-12T15:58:41.939 INFO:teuthology.orchestra.run.smithi134.stdout:(3/13): python3-jsonpointer-1.10-11.el8.noarch. 66 kB/s | 20 kB 00:00 2024-03-12T15:58:42.189 INFO:teuthology.orchestra.run.smithi134.stdout:(4/13): python3-pyasn1-modules-0.3.7-6.el8.noar 399 kB/s | 110 kB 00:00 2024-03-12T15:58:42.215 INFO:teuthology.orchestra.run.smithi134.stdout:(5/13): python3-pyasn1-0.3.7-6.el8.noarch.rpm 297 kB/s | 126 kB 00:00 2024-03-12T15:58:42.365 INFO:teuthology.orchestra.run.smithi134.stdout:(6/13): python3-cachetools-3.1.1-4.el8.noarch.r 220 kB/s | 33 kB 00:00 2024-03-12T15:58:42.424 INFO:teuthology.orchestra.run.smithi134.stdout:(7/13): python3-certifi-2018.10.15-7.el8.noarch 280 kB/s | 16 kB 00:00 2024-03-12T15:58:42.507 INFO:teuthology.orchestra.run.smithi134.stdout:(8/13): python3-google-auth-1.1.1-10.el8.noarch 976 kB/s | 81 kB 00:00 2024-03-12T15:58:42.566 INFO:teuthology.orchestra.run.smithi134.stdout:(9/13): python3-requests-oauthlib-1.0.0-1.el8.n 113 kB/s | 43 kB 00:00 2024-03-12T15:58:42.716 INFO:teuthology.orchestra.run.smithi134.stdout:(10/13): python3-rsa-4.9-2.el8.noarch.rpm 428 kB/s | 64 kB 00:00 2024-03-12T15:58:42.750 INFO:teuthology.orchestra.run.smithi134.stdout:(11/13): python3-kubernetes-11.0.0-6.el8.noarch 4.8 MB/s | 1.2 MB 00:00 2024-03-12T15:58:42.775 INFO:teuthology.orchestra.run.smithi134.stdout:(12/13): python3-websocket-client-0.56.0-5.el8. 1.0 MB/s | 61 kB 00:00 2024-03-12T15:58:42.799 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:58:42.800 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:42.800 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repository Size 2024-03-12T15:58:42.800 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:42.800 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:58:42.800 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse x86_64 2:16.2.15-1.g8963e9de.el8 ceph 911 k 2024-03-12T15:58:42.800 INFO:teuthology.orchestra.run.smithi006.stdout:Installing dependencies: 2024-03-12T15:58:42.800 INFO:teuthology.orchestra.run.smithi006.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-03-12T15:58:42.801 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:42.801 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:58:42.801 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:42.801 INFO:teuthology.orchestra.run.smithi006.stdout:Install 2 Packages 2024-03-12T15:58:42.801 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:42.801 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 994 k 2024-03-12T15:58:42.801 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 2.8 M 2024-03-12T15:58:42.802 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:58:43.105 INFO:teuthology.orchestra.run.smithi006.stdout:(1/2): ceph-fuse-16.2.15-1.g8963e9de.el8.x86_64 3.4 MB/s | 911 kB 00:00 2024-03-12T15:58:43.117 INFO:teuthology.orchestra.run.smithi134.stdout:(13/13): python3-oauthlib-2.1.0-1.el8.noarch.rp 132 kB/s | 155 kB 00:01 2024-03-12T15:58:43.117 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:43.118 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.2 MB/s | 1.9 MB 00:01 2024-03-12T15:58:43.176 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:58:43.191 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:58:43.192 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:58:43.225 INFO:teuthology.orchestra.run.smithi006.stdout:(2/2): fuse-2.9.7-19.el8.x86_64.rpm 218 kB/s | 83 kB 00:00 2024-03-12T15:58:43.226 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:43.226 INFO:teuthology.orchestra.run.smithi006.stdout:Total 2.3 MB/s | 994 kB 00:00 2024-03-12T15:58:43.236 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:58:43.259 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:58:43.259 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:58:43.279 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:58:43.282 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:58:43.352 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:58:43.355 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:58:43.543 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:58:43.846 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:58:43.846 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-03-12T15:58:44.019 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : ceph-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 2/2 2024-03-12T15:58:44.099 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-0.3.7-6.el8.noarch 1/13 2024-03-12T15:58:44.271 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-pyasn1-modules-0.3.7-6.el8.noarch 2/13 2024-03-12T15:58:44.453 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: ceph-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 2/2 2024-03-12T15:58:44.454 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : ceph-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 1/2 2024-03-12T15:58:44.550 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-rsa-4.9-2.el8.noarch 3/13 2024-03-12T15:58:44.779 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-websocket-client-0.56.0-5.el8.noarch 4/13 2024-03-12T15:58:44.881 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-03-12T15:58:44.881 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:44.881 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:58:44.881 INFO:teuthology.orchestra.run.smithi006.stdout: ceph-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-03-12T15:58:44.881 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:44.882 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:58:45.027 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-certifi-2018.10.15-7.el8.noarch 5/13 2024-03-12T15:58:45.129 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install librados-devel 2024-03-12T15:58:45.259 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-cachetools-3.1.1-4.el8.noarch 6/13 2024-03-12T15:58:45.790 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-google-auth-1:1.1.1-10.el8.noarch 7/13 2024-03-12T15:58:45.928 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:23 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:58:46.078 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-oauthlib-2.1.0-1.el8.noarch 8/13 2024-03-12T15:58:47.082 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-requests-oauthlib-1.0.0-1.el8.noarch 9/13 2024-03-12T15:58:47.337 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-kubernetes-1:11.0.0-6.el8.noarch 10/13 2024-03-12T15:58:47.571 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpointer-1.10-11.el8.noarch 11/13 2024-03-12T15:58:47.640 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:58:47.640 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:47.640 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repo Size 2024-03-12T15:58:47.640 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:47.640 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:58:47.640 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel x86_64 2:16.2.15-1.g8963e9de.el8 ceph 131 k 2024-03-12T15:58:47.640 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:47.641 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:58:47.641 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:47.641 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2024-03-12T15:58:47.641 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:47.641 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 131 k 2024-03-12T15:58:47.641 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 432 k 2024-03-12T15:58:47.641 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:58:47.763 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jsonpatch-1.21-2.el8.noarch 12/13 2024-03-12T15:58:47.938 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-rook-2:16.2.15-1.g8963e9de.el8.noarch 13/13 2024-03-12T15:58:47.987 INFO:teuthology.orchestra.run.smithi006.stdout:librados-devel-16.2.15-1.g8963e9de.el8.x86_64.r 380 kB/s | 131 kB 00:00 2024-03-12T15:58:47.987 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:47.987 INFO:teuthology.orchestra.run.smithi006.stdout:Total 378 kB/s | 131 kB 00:00 2024-03-12T15:58:47.988 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:58:47.993 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:58:47.994 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:58:48.047 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:58:48.051 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:58:48.164 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:58:48.254 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-rook-2:16.2.15-1.g8963e9de.el8.noarch 13/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-rook-2:16.2.15-1.g8963e9de.el8.noarch 1/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpatch-1.21-2.el8.noarch 2/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jsonpointer-1.10-11.el8.noarch 3/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-0.3.7-6.el8.noarch 4/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-pyasn1-modules-0.3.7-6.el8.noarch 5/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-oauthlib-2.1.0-1.el8.noarch 6/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-requests-oauthlib-1.0.0-1.el8.noarch 7/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-cachetools-3.1.1-4.el8.noarch 8/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-certifi-2018.10.15-7.el8.noarch 9/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-google-auth-1:1.1.1-10.el8.noarch 10/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-kubernetes-1:11.0.0-6.el8.noarch 11/13 2024-03-12T15:58:48.255 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-rsa-4.9-2.el8.noarch 12/13 2024-03-12T15:58:48.417 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : librados-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:58:48.703 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: librados-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:58:48.739 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-websocket-client-0.56.0-5.el8.noarch 13/13 2024-03-12T15:58:48.739 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:48.739 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:58:48.739 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-rook-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:48.739 INFO:teuthology.orchestra.run.smithi134.stdout: python3-cachetools-3.1.1-4.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-certifi-2018.10.15-7.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-google-auth-1:1.1.1-10.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpatch-1.21-2.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jsonpointer-1.10-11.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-kubernetes-1:11.0.0-6.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-oauthlib-2.1.0-1.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-0.3.7-6.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-pyasn1-modules-0.3.7-6.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-requests-oauthlib-1.0.0-1.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-rsa-4.9-2.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: python3-websocket-client-0.56.0-5.el8.noarch 2024-03-12T15:58:48.740 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:48.741 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:58:48.866 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-mgr-cephadm 2024-03-12T15:58:49.081 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : librados-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:58:49.081 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:49.081 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:58:49.082 INFO:teuthology.orchestra.run.smithi006.stdout: librados-devel-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:58:49.082 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:49.082 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:58:49.300 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install libcephfs2 2024-03-12T15:58:49.636 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:17 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:58:50.091 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:28 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:58:51.203 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm noarch 2:16.2.15-1.g8963e9de.el8 ceph-noarch 116 k 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: python3-apipkg noarch 1.5-6.el8 epel 21 k 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel noarch 2.5.1-7.el8 appstream 4.8 M 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: python3-execnet noarch 1.7.1-1.el8 epel 355 k 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2 noarch 2.10.1-4.el8 appstream 578 k 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: python3-remoto noarch 1.2.1-1.el8 epel 49 k 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:51.205 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:58:51.206 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:51.206 INFO:teuthology.orchestra.run.smithi134.stdout:Install 6 Packages 2024-03-12T15:58:51.206 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:51.206 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 5.9 M 2024-03-12T15:58:51.206 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 24 M 2024-03-12T15:58:51.206 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:58:51.758 INFO:teuthology.orchestra.run.smithi006.stdout:Package libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:58:51.758 INFO:teuthology.orchestra.run.smithi134.stdout:(1/6): python3-jinja2-2.10.1-4.el8.noarch.rpm 2.9 MB/s | 578 kB 00:00 2024-03-12T15:58:51.783 INFO:teuthology.orchestra.run.smithi134.stdout:(2/6): ceph-mgr-cephadm-16.2.15-1.g8963e9de.el8 535 kB/s | 116 kB 00:00 2024-03-12T15:58:51.810 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:58:51.812 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-03-12T15:58:51.812 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:58:51.892 INFO:teuthology.orchestra.run.smithi134.stdout:(3/6): python3-apipkg-1.5-6.el8.noarch.rpm 159 kB/s | 21 kB 00:00 2024-03-12T15:58:51.902 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install libcephfs-devel 2024-03-12T15:58:51.968 INFO:teuthology.orchestra.run.smithi134.stdout:(4/6): python3-remoto-1.2.1-1.el8.noarch.rpm 650 kB/s | 49 kB 00:00 2024-03-12T15:58:52.001 INFO:teuthology.orchestra.run.smithi134.stdout:(5/6): python3-execnet-1.7.1-1.el8.noarch.rpm 1.6 MB/s | 355 kB 00:00 2024-03-12T15:58:52.697 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:30 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:58:52.727 INFO:teuthology.orchestra.run.smithi134.stdout:(6/6): python3-babel-2.5.1-7.el8.noarch.rpm 4.1 MB/s | 4.8 MB 00:01 2024-03-12T15:58:52.727 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:52.728 INFO:teuthology.orchestra.run.smithi134.stdout:Total 3.9 MB/s | 5.9 MB 00:01 2024-03-12T15:58:52.778 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:58:52.787 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:58:52.788 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:58:52.887 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:58:52.890 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:58:53.171 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:58:53.411 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-apipkg-1.5-6.el8.noarch 1/6 2024-03-12T15:58:53.723 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-execnet-1.7.1-1.el8.noarch 2/6 2024-03-12T15:58:54.400 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:58:54.400 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: Package Arch Version Repo Size 2024-03-12T15:58:54.400 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:54.400 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:58:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel x86_64 2:16.2.15-1.g8963e9de.el8 ceph 25 k 2024-03-12T15:58:54.400 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:54.401 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:58:54.401 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:58:54.401 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2024-03-12T15:58:54.401 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:54.401 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 25 k 2024-03-12T15:58:54.401 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 107 k 2024-03-12T15:58:54.401 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:58:54.664 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-remoto-1.2.1-1.el8.noarch 3/6 2024-03-12T15:58:54.732 INFO:teuthology.orchestra.run.smithi006.stdout:libcephfs-devel-16.2.15-1.g8963e9de.el8.x86_64. 77 kB/s | 25 kB 00:00 2024-03-12T15:58:54.732 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:54.732 INFO:teuthology.orchestra.run.smithi006.stdout:Total 77 kB/s | 25 kB 00:00 2024-03-12T15:58:54.733 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:58:54.736 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:58:54.736 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:58:54.739 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:58:54.742 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:58:54.795 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:58:55.024 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : libcephfs-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:58:55.042 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-babel-2.5.1-7.el8.noarch 4/6 2024-03-12T15:58:55.261 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : python3-jinja2-2.10.1-4.el8.noarch 5/6 2024-03-12T15:58:55.302 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: libcephfs-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:58:55.462 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-mgr-cephadm-2:16.2.15-1.g8963e9de.el8.noarch 6/6 2024-03-12T15:58:55.657 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : libcephfs-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:58:55.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:55.657 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:58:55.657 INFO:teuthology.orchestra.run.smithi006.stdout: libcephfs-devel-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:58:55.657 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:58:55.657 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:58:55.766 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-mgr-cephadm-2:16.2.15-1.g8963e9de.el8.noarch 6/6 2024-03-12T15:58:55.767 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-mgr-cephadm-2:16.2.15-1.g8963e9de.el8.noarch 1/6 2024-03-12T15:58:55.767 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-babel-2.5.1-7.el8.noarch 2/6 2024-03-12T15:58:55.767 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-jinja2-2.10.1-4.el8.noarch 3/6 2024-03-12T15:58:55.767 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-apipkg-1.5-6.el8.noarch 4/6 2024-03-12T15:58:55.767 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-execnet-1.7.1-1.el8.noarch 5/6 2024-03-12T15:58:55.810 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install librados2 2024-03-12T15:58:56.151 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : python3-remoto-1.2.1-1.el8.noarch 6/6 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-mgr-cephadm-2:16.2.15-1.g8963e9de.el8.noarch 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-apipkg-1.5-6.el8.noarch 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-babel-2.5.1-7.el8.noarch 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-execnet-1.7.1-1.el8.noarch 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-jinja2-2.10.1-4.el8.noarch 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout: python3-remoto-1.2.1-1.el8.noarch 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:56.152 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:58:56.273 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install ceph-fuse 2024-03-12T15:58:56.596 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:34 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:58:57.034 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:25 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:58:58.246 INFO:teuthology.orchestra.run.smithi006.stdout:Package librados2-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:58:58.297 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:58:58.298 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-03-12T15:58:58.298 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:58:58.400 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install librbd1 2024-03-12T15:58:58.630 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:58:58.630 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:58.630 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repository Size 2024-03-12T15:58:58.630 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:58.630 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:58:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse x86_64 2:16.2.15-1.g8963e9de.el8 ceph 911 k 2024-03-12T15:58:58.631 INFO:teuthology.orchestra.run.smithi134.stdout:Installing dependencies: 2024-03-12T15:58:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: fuse x86_64 2.9.7-19.el8 baseos 83 k 2024-03-12T15:58:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:58.631 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:58:58.631 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:58:58.631 INFO:teuthology.orchestra.run.smithi134.stdout:Install 2 Packages 2024-03-12T15:58:58.631 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:58:58.632 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 994 k 2024-03-12T15:58:58.632 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 2.8 M 2024-03-12T15:58:58.632 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:58:59.185 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:37 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:58:59.193 INFO:teuthology.orchestra.run.smithi134.stdout:(1/2): fuse-2.9.7-19.el8.x86_64.rpm 227 kB/s | 83 kB 00:00 2024-03-12T15:58:59.369 INFO:teuthology.orchestra.run.smithi134.stdout:(2/2): ceph-fuse-16.2.15-1.g8963e9de.el8.x86_64 1.6 MB/s | 911 kB 00:00 2024-03-12T15:58:59.370 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:58:59.370 INFO:teuthology.orchestra.run.smithi134.stdout:Total 1.3 MB/s | 994 kB 00:00 2024-03-12T15:58:59.380 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:58:59.401 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:58:59.401 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:58:59.488 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:58:59.492 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:58:59.673 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:58:59.994 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : fuse-2.9.7-19.el8.x86_64 1/2 2024-03-12T15:59:00.186 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : ceph-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 2/2 2024-03-12T15:59:00.617 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: ceph-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 2/2 2024-03-12T15:59:00.617 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : ceph-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 1/2 2024-03-12T15:59:00.838 INFO:teuthology.orchestra.run.smithi006.stdout:Package librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:00.890 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:59:00.892 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-03-12T15:59:00.892 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:59:00.994 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install python3-rados 2024-03-12T15:59:01.030 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : fuse-2.9.7-19.el8.x86_64 2/2 2024-03-12T15:59:01.030 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:01.031 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:59:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: ceph-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 fuse-2.9.7-19.el8.x86_64 2024-03-12T15:59:01.031 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:01.031 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:01.343 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados-devel 2024-03-12T15:59:01.792 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:39 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:59:02.114 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:30 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:03.442 INFO:teuthology.orchestra.run.smithi006.stdout:Package python3-rados-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:03.493 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:59:03.494 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-03-12T15:59:03.494 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:59:03.705 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel x86_64 2:16.2.15-1.g8963e9de.el8 ceph 131 k 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-12T15:59:03.706 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:03.707 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 131 k 2024-03-12T15:59:03.707 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 432 k 2024-03-12T15:59:03.707 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:59:03.726 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install python3-rgw 2024-03-12T15:59:04.092 INFO:teuthology.orchestra.run.smithi134.stdout:librados-devel-16.2.15-1.g8963e9de.el8.x86_64.r 340 kB/s | 131 kB 00:00 2024-03-12T15:59:04.093 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:59:04.093 INFO:teuthology.orchestra.run.smithi134.stdout:Total 339 kB/s | 131 kB 00:00 2024-03-12T15:59:04.093 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:59:04.099 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:59:04.099 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:59:04.151 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:59:04.154 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:59:04.262 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:59:04.476 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : librados-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:04.531 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:42 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:59:04.802 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: librados-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:05.190 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : librados-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:05.191 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:05.191 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:59:05.191 INFO:teuthology.orchestra.run.smithi134.stdout: librados-devel-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:59:05.191 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:05.191 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:05.407 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs2 2024-03-12T15:59:06.168 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:34 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:06.187 INFO:teuthology.orchestra.run.smithi006.stdout:Package python3-rgw-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:06.237 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:59:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-03-12T15:59:06.238 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:59:06.348 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install python3-cephfs 2024-03-12T15:59:07.132 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:45 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:59:07.724 INFO:teuthology.orchestra.run.smithi134.stdout:Package libcephfs2-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:07.769 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:07.770 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-12T15:59:07.770 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:07.881 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install libcephfs-devel 2024-03-12T15:59:08.642 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:36 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:08.805 INFO:teuthology.orchestra.run.smithi006.stdout:Package python3-cephfs-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:08.855 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-03-12T15:59:08.856 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:59:08.966 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install python3-rbd 2024-03-12T15:59:09.756 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:47 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:59:10.236 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:10.236 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: Package Arch Version Repo Size 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel x86_64 2:16.2.15-1.g8963e9de.el8 ceph 25 k 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 25 k 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 107 k 2024-03-12T15:59:10.237 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:59:10.410 INFO:teuthology.orchestra.run.smithi134.stdout:libcephfs-devel-16.2.15-1.g8963e9de.el8.x86_64. 147 kB/s | 25 kB 00:00 2024-03-12T15:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:59:10.411 INFO:teuthology.orchestra.run.smithi134.stdout:Total 146 kB/s | 25 kB 00:00 2024-03-12T15:59:10.412 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:59:10.415 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:59:10.417 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:59:10.420 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:59:10.469 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:59:10.669 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : libcephfs-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:10.938 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: libcephfs-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:11.284 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : libcephfs-devel-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:11.284 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:11.284 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:59:11.284 INFO:teuthology.orchestra.run.smithi134.stdout: libcephfs-devel-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:59:11.284 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:11.284 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:11.412 INFO:teuthology.orchestra.run.smithi006.stdout:Package python3-rbd-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:11.440 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librados2 2024-03-12T15:59:11.463 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:59:11.465 INFO:teuthology.orchestra.run.smithi006.stdout:Nothing to do. 2024-03-12T15:59:11.465 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:59:11.576 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install rbd-fuse 2024-03-12T15:59:12.191 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:40 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:12.364 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:50 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:59:13.734 INFO:teuthology.orchestra.run.smithi134.stdout:Package librados2-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:13.783 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:13.784 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-12T15:59:13.784 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:13.899 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install librbd1 2024-03-12T15:59:14.070 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:59:14.070 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:59:14.070 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-03-12T15:59:14.070 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:59:14.070 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:59:14.070 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse x86_64 2:16.2.15-1.g8963e9de.el8 ceph 88 k 2024-03-12T15:59:14.070 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:14.071 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:59:14.071 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:59:14.071 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2024-03-12T15:59:14.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:14.071 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 88 k 2024-03-12T15:59:14.071 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 240 k 2024-03-12T15:59:14.071 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:59:14.653 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:42 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:14.737 INFO:teuthology.orchestra.run.smithi006.stdout:rbd-fuse-16.2.15-1.g8963e9de.el8.x86_64.rpm 133 kB/s | 88 kB 00:00 2024-03-12T15:59:14.738 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:59:14.738 INFO:teuthology.orchestra.run.smithi006.stdout:Total 132 kB/s | 88 kB 00:00 2024-03-12T15:59:14.738 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:59:14.751 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:59:14.751 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:59:14.810 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:59:14.813 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:59:15.018 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:59:15.230 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:15.521 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:15.934 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:59:15.934 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:59:15.935 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:15.935 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:59:16.144 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install rbd-mirror 2024-03-12T15:59:16.203 INFO:teuthology.orchestra.run.smithi134.stdout:Package librbd1-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:16.250 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:16.251 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-12T15:59:16.251 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:16.351 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rados 2024-03-12T15:59:16.940 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:02:54 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:59:17.100 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:45 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:18.632 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rados-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:18.646 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:59:18.646 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:59:18.646 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-03-12T15:59:18.646 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:59:18.646 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:59:18.647 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror x86_64 2:16.2.15-1.g8963e9de.el8 ceph 3.7 M 2024-03-12T15:59:18.647 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:18.647 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:59:18.647 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:59:18.647 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2024-03-12T15:59:18.647 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:18.647 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 3.7 M 2024-03-12T15:59:18.648 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 15 M 2024-03-12T15:59:18.648 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:59:18.679 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:18.680 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-12T15:59:18.680 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:18.790 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rgw 2024-03-12T15:59:19.539 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:47 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:19.658 INFO:teuthology.orchestra.run.smithi006.stdout:rbd-mirror-16.2.15-1.g8963e9de.el8.x86_64.rpm 3.6 MB/s | 3.7 MB 00:01 2024-03-12T15:59:19.659 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:59:19.659 INFO:teuthology.orchestra.run.smithi006.stdout:Total 3.6 MB/s | 3.7 MB 00:01 2024-03-12T15:59:19.660 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:59:19.674 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:59:19.674 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:59:19.745 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:59:19.749 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:59:20.209 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:59:20.539 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-mirror-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:20.970 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-mirror-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:21.100 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rgw-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:21.146 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:21.148 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-12T15:59:21.148 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:21.251 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-cephfs 2024-03-12T15:59:21.382 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-mirror-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:21.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:21.383 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:59:21.383 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-mirror-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:59:21.383 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:21.383 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:59:21.609 DEBUG:teuthology.orchestra.run.smithi006:> sudo yum -y install rbd-nbd 2024-03-12T15:59:22.002 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:50 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:22.399 INFO:teuthology.orchestra.run.smithi006.stdout:Last metadata expiration check: 0:03:00 ago on Tue 12 Mar 2024 03:56:22 PM UTC. 2024-03-12T15:59:23.536 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-cephfs-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:23.585 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:23.586 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-12T15:59:23.586 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:23.692 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install python3-rbd 2024-03-12T15:59:24.100 INFO:teuthology.orchestra.run.smithi006.stdout:Dependencies resolved. 2024-03-12T15:59:24.101 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:59:24.101 INFO:teuthology.orchestra.run.smithi006.stdout: Package Architecture Version Repository Size 2024-03-12T15:59:24.101 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:59:24.101 INFO:teuthology.orchestra.run.smithi006.stdout:Installing: 2024-03-12T15:59:24.101 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd x86_64 2:16.2.15-1.g8963e9de.el8 ceph 175 k 2024-03-12T15:59:24.101 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:24.101 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction Summary 2024-03-12T15:59:24.101 INFO:teuthology.orchestra.run.smithi006.stdout:================================================================================ 2024-03-12T15:59:24.102 INFO:teuthology.orchestra.run.smithi006.stdout:Install 1 Package 2024-03-12T15:59:24.102 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:24.102 INFO:teuthology.orchestra.run.smithi006.stdout:Total download size: 175 k 2024-03-12T15:59:24.102 INFO:teuthology.orchestra.run.smithi006.stdout:Installed size: 523 k 2024-03-12T15:59:24.103 INFO:teuthology.orchestra.run.smithi006.stdout:Downloading Packages: 2024-03-12T15:59:24.296 INFO:teuthology.orchestra.run.smithi006.stdout:rbd-nbd-16.2.15-1.g8963e9de.el8.x86_64.rpm 910 kB/s | 175 kB 00:00 2024-03-12T15:59:24.296 INFO:teuthology.orchestra.run.smithi006.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:59:24.296 INFO:teuthology.orchestra.run.smithi006.stdout:Total 904 kB/s | 175 kB 00:00 2024-03-12T15:59:24.296 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction check 2024-03-12T15:59:24.307 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction check succeeded. 2024-03-12T15:59:24.307 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction test 2024-03-12T15:59:24.361 INFO:teuthology.orchestra.run.smithi006.stdout:Transaction test succeeded. 2024-03-12T15:59:24.364 INFO:teuthology.orchestra.run.smithi006.stdout:Running transaction 2024-03-12T15:59:24.446 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:52 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:24.480 INFO:teuthology.orchestra.run.smithi006.stdout: Preparing : 1/1 2024-03-12T15:59:24.712 INFO:teuthology.orchestra.run.smithi006.stdout: Installing : rbd-nbd-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:25.010 INFO:teuthology.orchestra.run.smithi006.stdout: Running scriptlet: rbd-nbd-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: Verifying : rbd-nbd-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:25.399 INFO:teuthology.orchestra.run.smithi006.stdout:Installed: 2024-03-12T15:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: rbd-nbd-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T15:59:25.400 INFO:teuthology.orchestra.run.smithi006.stdout:Complete! 2024-03-12T15:59:25.599 DEBUG:teuthology.parallel:result is None 2024-03-12T15:59:25.976 INFO:teuthology.orchestra.run.smithi134.stdout:Package python3-rbd-2:16.2.15-1.g8963e9de.el8.x86_64 is already installed. 2024-03-12T15:59:26.023 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:26.024 INFO:teuthology.orchestra.run.smithi134.stdout:Nothing to do. 2024-03-12T15:59:26.025 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:26.133 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-fuse 2024-03-12T15:59:26.891 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:54 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:28.486 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:28.487 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:28.487 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-03-12T15:59:28.487 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:28.487 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:59:28.487 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse x86_64 2:16.2.15-1.g8963e9de.el8 ceph 88 k 2024-03-12T15:59:28.487 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:28.488 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:59:28.488 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:28.488 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-12T15:59:28.488 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:28.488 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 88 k 2024-03-12T15:59:28.488 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 240 k 2024-03-12T15:59:28.488 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:59:29.066 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-fuse-16.2.15-1.g8963e9de.el8.x86_64.rpm 153 kB/s | 88 kB 00:00 2024-03-12T15:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout:Total 152 kB/s | 88 kB 00:00 2024-03-12T15:59:29.067 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:59:29.077 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:59:29.078 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:59:29.128 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:59:29.131 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:59:29.234 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:59:29.464 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:29.755 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:30.124 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:30.124 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:30.124 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:59:30.124 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-fuse-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:59:30.124 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:30.124 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:30.404 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-mirror 2024-03-12T15:59:31.169 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:02:59 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:32.749 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:32.750 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-03-12T15:59:32.750 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:32.750 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:59:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror x86_64 2:16.2.15-1.g8963e9de.el8 ceph 3.7 M 2024-03-12T15:59:32.750 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:32.750 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:59:32.751 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:32.751 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-12T15:59:32.751 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:32.751 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 3.7 M 2024-03-12T15:59:32.751 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 15 M 2024-03-12T15:59:32.751 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:59:33.718 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-mirror-16.2.15-1.g8963e9de.el8.x86_64.rpm 3.8 MB/s | 3.7 MB 00:00 2024-03-12T15:59:33.718 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:59:33.718 INFO:teuthology.orchestra.run.smithi134.stdout:Total 3.8 MB/s | 3.7 MB 00:00 2024-03-12T15:59:33.719 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:59:33.730 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:59:33.730 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:59:33.793 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:59:33.796 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:59:34.230 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:59:34.548 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-mirror-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:34.995 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-mirror-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-mirror-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-mirror-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:35.355 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:35.576 DEBUG:teuthology.orchestra.run.smithi134:> sudo yum -y install rbd-nbd 2024-03-12T15:59:36.346 INFO:teuthology.orchestra.run.smithi134.stdout:Last metadata expiration check: 0:03:04 ago on Tue 12 Mar 2024 03:56:32 PM UTC. 2024-03-12T15:59:37.940 INFO:teuthology.orchestra.run.smithi134.stdout:Dependencies resolved. 2024-03-12T15:59:37.940 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: Package Architecture Version Repository Size 2024-03-12T15:59:37.940 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:37.940 INFO:teuthology.orchestra.run.smithi134.stdout:Installing: 2024-03-12T15:59:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd x86_64 2:16.2.15-1.g8963e9de.el8 ceph 175 k 2024-03-12T15:59:37.940 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:37.940 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction Summary 2024-03-12T15:59:37.941 INFO:teuthology.orchestra.run.smithi134.stdout:================================================================================ 2024-03-12T15:59:37.941 INFO:teuthology.orchestra.run.smithi134.stdout:Install 1 Package 2024-03-12T15:59:37.941 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:37.941 INFO:teuthology.orchestra.run.smithi134.stdout:Total download size: 175 k 2024-03-12T15:59:37.941 INFO:teuthology.orchestra.run.smithi134.stdout:Installed size: 523 k 2024-03-12T15:59:37.941 INFO:teuthology.orchestra.run.smithi134.stdout:Downloading Packages: 2024-03-12T15:59:38.129 INFO:teuthology.orchestra.run.smithi134.stdout:rbd-nbd-16.2.15-1.g8963e9de.el8.x86_64.rpm 936 kB/s | 175 kB 00:00 2024-03-12T15:59:38.129 INFO:teuthology.orchestra.run.smithi134.stdout:-------------------------------------------------------------------------------- 2024-03-12T15:59:38.130 INFO:teuthology.orchestra.run.smithi134.stdout:Total 928 kB/s | 175 kB 00:00 2024-03-12T15:59:38.130 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction check 2024-03-12T15:59:38.140 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction check succeeded. 2024-03-12T15:59:38.140 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction test 2024-03-12T15:59:38.189 INFO:teuthology.orchestra.run.smithi134.stdout:Transaction test succeeded. 2024-03-12T15:59:38.192 INFO:teuthology.orchestra.run.smithi134.stdout:Running transaction 2024-03-12T15:59:38.300 INFO:teuthology.orchestra.run.smithi134.stdout: Preparing : 1/1 2024-03-12T15:59:38.529 INFO:teuthology.orchestra.run.smithi134.stdout: Installing : rbd-nbd-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:38.811 INFO:teuthology.orchestra.run.smithi134.stdout: Running scriptlet: rbd-nbd-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: Verifying : rbd-nbd-2:16.2.15-1.g8963e9de.el8.x86_64 1/1 2024-03-12T15:59:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:39.170 INFO:teuthology.orchestra.run.smithi134.stdout:Installed: 2024-03-12T15:59:39.170 INFO:teuthology.orchestra.run.smithi134.stdout: rbd-nbd-2:16.2.15-1.g8963e9de.el8.x86_64 2024-03-12T15:59:39.171 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T15:59:39.171 INFO:teuthology.orchestra.run.smithi134.stdout:Complete! 2024-03-12T15:59:39.377 DEBUG:teuthology.parallel:result is None 2024-03-12T15:59:39.377 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-12T15:59:39.377 INFO:teuthology.packaging:ref: None 2024-03-12T15:59:39.377 INFO:teuthology.packaging:tag: None 2024-03-12T15:59:39.377 INFO:teuthology.packaging:branch: pacific 2024-03-12T15:59:39.378 INFO:teuthology.packaging:sha1: 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T15:59:39.378 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-03-12T15:59:39.595 DEBUG:teuthology.orchestra.run.smithi006:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-12T15:59:39.623 INFO:teuthology.orchestra.run.smithi006.stdout:16.2.15-1.g8963e9de.el8 2024-03-12T15:59:39.624 INFO:teuthology.packaging:The installed version of ceph is 16.2.15-1.g8963e9de.el8 2024-03-12T15:59:39.624 INFO:teuthology.task.install:The correct ceph version 16.2.15-1.g8963e9de is installed. 2024-03-12T15:59:39.625 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-03-12T15:59:39.626 INFO:teuthology.packaging:ref: None 2024-03-12T15:59:39.626 INFO:teuthology.packaging:tag: None 2024-03-12T15:59:39.626 INFO:teuthology.packaging:branch: pacific 2024-03-12T15:59:39.626 INFO:teuthology.packaging:sha1: 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T15:59:39.626 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F8%2Fx86_64&ref=pacific 2024-03-12T15:59:39.831 DEBUG:teuthology.orchestra.run.smithi134:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-03-12T15:59:39.854 INFO:teuthology.orchestra.run.smithi134.stdout:16.2.15-1.g8963e9de.el8 2024-03-12T15:59:39.854 INFO:teuthology.packaging:The installed version of ceph is 16.2.15-1.g8963e9de.el8 2024-03-12T15:59:39.854 INFO:teuthology.task.install:The correct ceph version 16.2.15-1.g8963e9de is installed. 2024-03-12T15:59:39.856 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-03-12T15:59:39.856 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T15:59:39.856 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-12T15:59:39.891 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T15:59:39.891 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-03-12T15:59:39.922 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-03-12T15:59:39.922 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T15:59:39.923 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/daemon-helper 2024-03-12T15:59:39.962 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-12T15:59:40.034 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T15:59:40.034 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/daemon-helper 2024-03-12T15:59:40.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-03-12T15:59:40.127 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-03-12T15:59:40.127 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T15:59:40.127 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-12T15:59:40.157 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-12T15:59:40.227 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T15:59:40.229 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/adjust-ulimits 2024-03-12T15:59:40.256 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-03-12T15:59:40.322 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-03-12T15:59:40.322 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T15:59:40.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/usr/bin/stdin-killer 2024-03-12T15:59:40.352 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-12T15:59:40.422 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T15:59:40.422 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/usr/bin/stdin-killer 2024-03-12T15:59:40.450 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-03-12T15:59:40.517 INFO:teuthology.run_tasks:Running task print... 2024-03-12T15:59:40.527 INFO:teuthology.task.print:**** done install task... 2024-03-12T15:59:40.527 INFO:teuthology.run_tasks:Running task cephadm... 2024-03-12T15:59:40.605 INFO:tasks.cephadm:Config: {'cephadm_branch': 'pacific', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'conf': {'osd': {'osd_class_default_list': '*', 'osd_class_load_list': '*', 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore', 'osd op complaint time': 180}, 'client': {'client mount timeout': 600, 'debug client': 20, 'debug ms': 1, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'global': {'mon pg warn min per osd': 0}, 'mds': {'debug mds': 20, 'debug mds balancer': 20, 'debug ms': 1, 'mds debug frag': True, 'mds debug scatterstat': True, 'mds op complaint time': 180, 'mds verify scatter': True, 'osd op complaint time': 180, 'rados mon op timeout': 900, 'rados osd op timeout': 900}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20, 'mon op complaint time': 120}}, 'image': 'quay.ceph.io/ceph-ci/ceph:pacific', 'roleless': True, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', 'FS_DEGRADED', 'FS_INLINE_DATA_DEPRECATED', 'FS_WITH_FAILED_MDS', 'MDS_ALL_DOWN', 'MDS_DAMAGE', 'MDS_DEGRADED', 'MDS_FAILED', 'MDS_INSUFFICIENT_STANDBY', 'MDS_UP_LESS_THAN_MAX', 'POOL_APP_NOT_ENABLED', 'overall HEALTH_', 'Replacing daemon', 'OSD_DOWN', 'overall HEALTH_', '\\(OSD_DOWN\\)', '\\(OSD_', 'but it is still running', 'is not responding'], 'sha1': '49e4a6794d5502bd66908faf714fc54896c51712'} 2024-03-12T15:59:40.605 INFO:tasks.cephadm:Cluster image is quay.ceph.io/ceph-ci/ceph:pacific 2024-03-12T15:59:40.605 INFO:tasks.cephadm:Cluster fsid is 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T15:59:40.606 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-03-12T15:59:40.606 INFO:tasks.cephadm:No mon roles; fabricating mons 2024-03-12T15:59:40.606 INFO:tasks.cephadm:Monitor IPs: {'mon.smithi006': '172.21.15.6', 'mon.smithi134': '172.21.15.134'} 2024-03-12T15:59:40.606 INFO:tasks.cephadm:Normalizing hostnames... 2024-03-12T15:59:40.606 DEBUG:teuthology.orchestra.run.smithi006:> sudo hostname $(hostname -s) 2024-03-12T15:59:40.637 DEBUG:teuthology.orchestra.run.smithi134:> sudo hostname $(hostname -s) 2024-03-12T15:59:40.664 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref pacific)... 2024-03-12T15:59:40.665 DEBUG:teuthology.orchestra.run.smithi006:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-12T15:59:40.951 INFO:teuthology.orchestra.run.smithi006.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Mar 12 15:59 /home/ubuntu/cephtest/cephadm 2024-03-12T15:59:40.951 DEBUG:teuthology.orchestra.run.smithi134:> curl --silent https://raw.githubusercontent.com/ceph/ceph/pacific/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-03-12T15:59:41.201 INFO:teuthology.orchestra.run.smithi134.stdout:-rw-rw-r--. 1 ubuntu ubuntu 355729 Mar 12 15:59 /home/ubuntu/cephtest/cephadm 2024-03-12T15:59:41.201 DEBUG:teuthology.orchestra.run.smithi006:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-12T15:59:41.225 DEBUG:teuthology.orchestra.run.smithi134:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-03-12T15:59:41.255 INFO:tasks.cephadm:Pulling image quay.ceph.io/ceph-ci/ceph:pacific on all hosts... 2024-03-12T15:59:41.255 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific pull 2024-03-12T15:59:41.267 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific pull 2024-03-12T15:59:42.593 INFO:teuthology.orchestra.run.smithi134.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-03-12T15:59:42.681 INFO:teuthology.orchestra.run.smithi006.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-03-12T16:00:29.113 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:00:29.113 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)", 2024-03-12T16:00:29.113 INFO:teuthology.orchestra.run.smithi006.stdout: "image_id": "727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0", 2024-03-12T16:00:29.113 INFO:teuthology.orchestra.run.smithi006.stdout: "repo_digests": [ 2024-03-12T16:00:29.113 INFO:teuthology.orchestra.run.smithi006.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a917adc3f5c2fb88f02feae5d8f667631e1c7fa0b341817d32f1d6fd5cd1bec1" 2024-03-12T16:00:29.114 INFO:teuthology.orchestra.run.smithi006.stdout: ] 2024-03-12T16:00:29.114 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:00:29.503 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-12T16:00:29.503 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)", 2024-03-12T16:00:29.503 INFO:teuthology.orchestra.run.smithi134.stdout: "image_id": "727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0", 2024-03-12T16:00:29.503 INFO:teuthology.orchestra.run.smithi134.stdout: "repo_digests": [ 2024-03-12T16:00:29.503 INFO:teuthology.orchestra.run.smithi134.stdout: "quay.ceph.io/ceph-ci/ceph@sha256:a917adc3f5c2fb88f02feae5d8f667631e1c7fa0b341817d32f1d6fd5cd1bec1" 2024-03-12T16:00:29.503 INFO:teuthology.orchestra.run.smithi134.stdout: ] 2024-03-12T16:00:29.504 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-12T16:00:29.523 DEBUG:teuthology.orchestra.run.smithi006:> sudo mkdir -p /etc/ceph 2024-03-12T16:00:29.559 DEBUG:teuthology.orchestra.run.smithi134:> sudo mkdir -p /etc/ceph 2024-03-12T16:00:29.589 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 777 /etc/ceph 2024-03-12T16:00:29.630 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 777 /etc/ceph 2024-03-12T16:00:29.657 INFO:tasks.cephadm:Writing seed config... 2024-03-12T16:00:29.658 INFO:tasks.cephadm: override: [osd] osd_class_default_list = * 2024-03-12T16:00:29.659 INFO:tasks.cephadm: override: [osd] osd_class_load_list = * 2024-03-12T16:00:29.659 INFO:tasks.cephadm: override: [osd] bdev async discard = True 2024-03-12T16:00:29.659 INFO:tasks.cephadm: override: [osd] bdev enable discard = True 2024-03-12T16:00:29.659 INFO:tasks.cephadm: override: [osd] bluestore allocator = bitmap 2024-03-12T16:00:29.659 INFO:tasks.cephadm: override: [osd] bluestore block size = 96636764160 2024-03-12T16:00:29.659 INFO:tasks.cephadm: override: [osd] bluestore fsck on mount = True 2024-03-12T16:00:29.659 INFO:tasks.cephadm: override: [osd] debug bluefs = 1/20 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] debug bluestore = 1/20 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] debug rocksdb = 4/10 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] mon osd backfillfull_ratio = 0.85 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] mon osd full ratio = 0.9 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] mon osd nearfull ratio = 0.8 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] osd failsafe full ratio = 0.95 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] osd objectstore = bluestore 2024-03-12T16:00:29.660 INFO:tasks.cephadm: override: [osd] osd op complaint time = 180 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [client] client mount timeout = 600 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [client] debug client = 20 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [client] debug ms = 1 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [client] rados mon op timeout = 900 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [client] rados osd op timeout = 900 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [global] mon pg warn min per osd = 0 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [mds] debug mds = 20 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [mds] debug mds balancer = 20 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [mds] debug ms = 1 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [mds] mds debug frag = True 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [mds] mds debug scatterstat = True 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [mds] mds op complaint time = 180 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [mds] mds verify scatter = True 2024-03-12T16:00:29.661 INFO:tasks.cephadm: override: [mds] osd op complaint time = 180 2024-03-12T16:00:29.662 INFO:tasks.cephadm: override: [mds] rados mon op timeout = 900 2024-03-12T16:00:29.662 INFO:tasks.cephadm: override: [mds] rados osd op timeout = 900 2024-03-12T16:00:29.662 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-03-12T16:00:29.662 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-03-12T16:00:29.662 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-03-12T16:00:29.662 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-03-12T16:00:29.662 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-03-12T16:00:29.662 INFO:tasks.cephadm: override: [mon] mon op complaint time = 120 2024-03-12T16:00:29.663 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:00:29.663 DEBUG:teuthology.orchestra.run.smithi006:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-03-12T16:00:29.690 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 88d7ee42-e089-11ee-95c8-87774f69a715 mon pg warn min per osd = 0 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true osd_class_default_list = * osd_class_load_list = * bdev async discard = True bdev enable discard = True bluestore allocator = bitmap bluestore block size = 96636764160 bluestore fsck on mount = True debug bluefs = 1/20 debug bluestore = 1/20 debug ms = 1 debug osd = 20 debug rocksdb = 4/10 mon osd backfillfull_ratio = 0.85 mon osd full ratio = 0.9 mon osd nearfull ratio = 0.8 osd failsafe full ratio = 0.95 osd objectstore = bluestore osd op complaint time = 180 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 mon op complaint time = 120 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true [client] client mount timeout = 600 debug client = 20 debug ms = 1 rados mon op timeout = 900 rados osd op timeout = 900 [mds] debug mds = 20 debug mds balancer = 20 debug ms = 1 mds debug frag = True mds debug scatterstat = True mds op complaint time = 180 mds verify scatter = True osd op complaint time = 180 rados mon op timeout = 900 rados osd op timeout = 900 2024-03-12T16:00:29.691 DEBUG:teuthology.orchestra.run.smithi006:mon.smithi006> sudo journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi006.service 2024-03-12T16:00:29.733 INFO:tasks.cephadm:Bootstrapping... 2024-03-12T16:00:29.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific -v bootstrap --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-ip 172.21.15.6 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-03-12T16:00:29.762 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:-- Logs begin at Tue 2024-03-12 15:46:33 UTC. -- 2024-03-12T16:00:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:-------------------------------------------------------------------------------- 2024-03-12T16:00:29.949 INFO:teuthology.orchestra.run.smithi006.stderr:cephadm ['--image', 'quay.ceph.io/ceph-ci/ceph:pacific', '-v', 'bootstrap', '--fsid', '88d7ee42-e089-11ee-95c8-87774f69a715', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-ip', '172.21.15.6', '--skip-admin-label'] 2024-03-12T16:00:29.971 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: 4.9.4-dev 2024-03-12T16:00:29.979 INFO:teuthology.orchestra.run.smithi006.stderr:Verifying podman|docker is present... 2024-03-12T16:00:30.000 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: 4.9.4-dev 2024-03-12T16:00:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:Verifying lvm2 is present... 2024-03-12T16:00:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:Verifying time synchronization is in place... 2024-03-12T16:00:30.021 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-03-12T16:00:30.029 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: inactive 2024-03-12T16:00:30.034 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: enabled 2024-03-12T16:00:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: active 2024-03-12T16:00:30.039 INFO:teuthology.orchestra.run.smithi006.stderr:Unit chronyd.service is enabled and running 2024-03-12T16:00:30.040 INFO:teuthology.orchestra.run.smithi006.stderr:Repeating the final host check... 2024-03-12T16:00:30.060 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: 4.9.4-dev 2024-03-12T16:00:30.075 INFO:teuthology.orchestra.run.smithi006.stderr:podman (/bin/podman) version 4.9.4 is present 2024-03-12T16:00:30.075 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl is present 2024-03-12T16:00:30.075 INFO:teuthology.orchestra.run.smithi006.stderr:lvcreate is present 2024-03-12T16:00:30.080 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-03-12T16:00:30.086 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: inactive 2024-03-12T16:00:30.092 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: enabled 2024-03-12T16:00:30.098 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: active 2024-03-12T16:00:30.098 INFO:teuthology.orchestra.run.smithi006.stderr:Unit chronyd.service is enabled and running 2024-03-12T16:00:30.098 INFO:teuthology.orchestra.run.smithi006.stderr:Host looks OK 2024-03-12T16:00:30.099 INFO:teuthology.orchestra.run.smithi006.stderr:Cluster fsid: 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:30.099 INFO:teuthology.orchestra.run.smithi006.stderr:Acquiring lock 139973769546216 on /run/cephadm/88d7ee42-e089-11ee-95c8-87774f69a715.lock 2024-03-12T16:00:30.099 INFO:teuthology.orchestra.run.smithi006.stderr:Lock 139973769546216 acquired on /run/cephadm/88d7ee42-e089-11ee-95c8-87774f69a715.lock 2024-03-12T16:00:30.099 INFO:teuthology.orchestra.run.smithi006.stderr:Verifying IP 172.21.15.6 port 3300 ... 2024-03-12T16:00:30.100 INFO:teuthology.orchestra.run.smithi006.stderr:Verifying IP 172.21.15.6 port 6789 ... 2024-03-12T16:00:30.100 INFO:teuthology.orchestra.run.smithi006.stderr:Base mon IP(s) is [172.21.15.6:3300, 172.21.15.6:6789], mon addrv is [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-03-12T16:00:30.103 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: default via 172.21.15.254 dev ens1f0 proto dhcp src 172.21.15.6 metric 100 2024-03-12T16:00:30.103 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: 172.21.0.0/20 dev ens1f0 proto kernel scope link src 172.21.15.6 metric 100 2024-03-12T16:00:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-03-12T16:00:30.106 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: fe80::/64 dev ens1f0 proto kernel metric 256 pref medium 2024-03-12T16:00:30.107 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev ens1f0 proto ra metric 1024 expires 1799sec hoplimit 64 pref medium 2024-03-12T16:00:30.109 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-03-12T16:00:30.110 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-03-12T16:00:30.110 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-03-12T16:00:30.110 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: 4: ens1f0: mtu 1500 state UP qlen 1000 2024-03-12T16:00:30.110 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-03-12T16:00:30.110 INFO:teuthology.orchestra.run.smithi006.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-03-12T16:00:30.111 INFO:teuthology.orchestra.run.smithi006.stderr:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2024-03-12T16:00:30.111 INFO:teuthology.orchestra.run.smithi006.stderr:Mon IP `172.21.15.6` is in CIDR network `172.21.0.0/20` 2024-03-12T16:00:30.111 INFO:teuthology.orchestra.run.smithi006.stderr:Inferred mon public CIDR from local network configuration ['172.21.0.0/20', '172.21.0.0/20'] 2024-03-12T16:00:30.111 INFO:teuthology.orchestra.run.smithi006.stderr:Internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-03-12T16:00:30.112 INFO:teuthology.orchestra.run.smithi006.stderr:Pulling container image quay.ceph.io/ceph-ci/ceph:pacific... 2024-03-12T16:00:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: Trying to pull quay.ceph.io/ceph-ci/ceph:pacific... 2024-03-12T16:00:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: Getting image source signatures 2024-03-12T16:00:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: Copying blob sha256:efbf2990d792dd99354c95f0e06c6d4330413e38e584cb30666e2a0d35649b94 2024-03-12T16:00:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: Copying blob sha256:7feca07754707458c3945cf0062cf4dabc512f6d90fe1a9a1370b362b6011124 2024-03-12T16:00:30.307 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: Copying config sha256:727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0 2024-03-12T16:00:30.477 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: Writing manifest to image destination 2024-03-12T16:00:30.616 INFO:teuthology.orchestra.run.smithi006.stderr:/bin/podman: 727f386679cb5962a8bf6fbf5ad40cabb5457725c5b7aee81a1eb45b35ff08b0 2024-03-12T16:00:31.115 INFO:teuthology.orchestra.run.smithi006.stderr:ceph: ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable) 2024-03-12T16:00:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:Ceph version: ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable) 2024-03-12T16:00:33.838 INFO:teuthology.orchestra.run.smithi006.stderr:Extracting ceph user uid/gid from container image... 2024-03-12T16:00:34.536 INFO:teuthology.orchestra.run.smithi006.stderr:stat: 167 167 2024-03-12T16:00:35.037 INFO:teuthology.orchestra.run.smithi006.stderr:Creating initial keys... 2024-03-12T16:00:35.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-authtool: AQAjfPBl1QGoHRAAY00d6+uqg6UfFPyOKMkvxA== 2024-03-12T16:00:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-authtool: AQAkfPBlSeFFJxAAaEdWy0WXfUriahCCzH5mjQ== 2024-03-12T16:00:38.079 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-authtool: AQAlfPBlD9grOBAAha3/30Jwsh3P8Jmq8KMEkA== 2024-03-12T16:00:38.666 INFO:teuthology.orchestra.run.smithi006.stderr:Creating initial monmap... 2024-03-12T16:00:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-12T16:00:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:39.410 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-12T16:00:40.129 INFO:teuthology.orchestra.run.smithi006.stderr:monmaptool for smithi006 [v2:172.21.15.6:3300,v1:172.21.15.6:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-03-12T16:00:40.129 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/monmaptool: set fsid to 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:40.129 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-03-12T16:00:40.130 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:00:40.130 INFO:teuthology.orchestra.run.smithi006.stderr:Creating mon... 2024-03-12T16:00:40.800 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.667+0000 7fd20d7a0880 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-12T16:00:40.800 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.668+0000 7fd20d7a0880 1 imported monmap: 2024-03-12T16:00:40.800 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: epoch 0 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: fsid 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: last_changed 2024-03-12T16:00:39.302317+0000 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: created 2024-03-12T16:00:39.302317+0000 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: min_mon_release 0 (unknown) 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: election_strategy: 1 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 0: [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon.smithi006 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.668+0000 7fd20d7a0880 0 /usr/bin/ceph-mon: set fsid to 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: RocksDB version: 6.8.1 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Compile date Mar 4 2024 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: DB SUMMARY 2024-03-12T16:00:40.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi006/store.db dir, Total Num: 0, files: 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi006/store.db: 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.error_if_exists: 0 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.create_if_missing: 1 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.paranoid_checks: 1 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.env: 0x561776d32080 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.fs: Posix File System 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.info_log: 0x561778631300 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.statistics: (nil) 2024-03-12T16:00:40.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.use_fsync: 0 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_log_file_size: 0 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.allow_fallocate: 1 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.use_direct_reads: 0 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.create_missing_column_families: 0 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.db_log_dir: 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi006/store.db 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-12T16:00:40.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_subcompactions: 1 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_background_flushes: -1 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.advise_random_on_open: 1 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.write_buffer_manager: 0x561778637950 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-12T16:00:40.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.rate_limiter: (nil) 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.unordered_write: 0 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.row_cache: None 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.wal_filter: None 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.preserve_deletes: 0 2024-03-12T16:00:40.805 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.two_write_queues: 0 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.manual_wal_flush: 0 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.atomic_flush: 0 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.log_readahead_size: 0 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_background_jobs: 2 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_background_compactions: -1 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_total_wal_size: 0 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-12T16:00:40.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.max_open_files: -1 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.bytes_per_sync: 0 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Compression algorithms supported: 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: kZSTD supported: 0 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: kXpressCompression supported: 0 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: kLZ4Compression supported: 1 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: kBZip2Compression supported: 0 2024-03-12T16:00:40.807 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: kZlibCompression supported: 1 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: kSnappyCompression supported: 1 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.669+0000 7fd20d7a0880 4 rocksdb: [db_impl/db_impl_open.cc:273] Creating manifest 1 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi006/store.db/MANIFEST-000001 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.merge_operator: 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_filter: None 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_filter_factory: None 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-12T16:00:40.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x561778547d18) 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks: 1 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: pin_top_level_index_and_filter: 1 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: index_type: 0 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: data_block_index_type: 0 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: index_shortening: 1 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: data_block_hash_table_util_ratio: 0.750000 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: hash_index_allow_collision: 1 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: checksum: 1 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: no_block_cache: 0 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: block_cache: 0x56177857cd10 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: block_cache_name: BinnedLRUCache 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: block_cache_options: 2024-03-12T16:00:40.809 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: capacity : 536870912 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: num_shard_bits : 4 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: strict_capacity_limit : 0 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: high_pri_pool_ratio: 0.000 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: block_cache_compressed: (nil) 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: persistent_cache: (nil) 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: block_size: 4096 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: block_size_deviation: 10 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: block_restart_interval: 16 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: index_block_restart_interval: 1 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: metadata_block_size: 4096 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: partition_filters: 0 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: use_delta_encoding: 1 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: filter_policy: rocksdb.BuiltinBloomFilter 2024-03-12T16:00:40.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: whole_key_filtering: 1 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: verify_compression: 0 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: read_amp_bytes_per_bit: 0 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: format_version: 2 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: enable_index_compression: 1 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: block_align: 0 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compression: NoCompression 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.num_levels: 7 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-12T16:00:40.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compression_opts.level: 32767 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compression_opts.enabled: false 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-12T16:00:40.812 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-12T16:00:40.813 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.arena_block_size: 4194304 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-12T16:00:40.814 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.table_properties_collectors: 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.inplace_update_support: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.bloom_locality: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.max_successive_merges: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.force_consistency_checks: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.ttl: 2592000 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-12T16:00:40.815 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi006/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.670+0000 7fd20d7a0880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.671+0000 7fd20d7a0880 4 rocksdb: DB pointer 0x561778645800 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.671+0000 7fd1f6613700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.671+0000 7fd1f6613700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ** DB Stats ** 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.816 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-03-12T16:00:40.817 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Sum 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ** Compaction Stats [default] ** 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:00:40.818 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Flush(GB): cumulative 0.000, interval 0.000 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: AddFile(Total Files): cumulative 0, interval 0 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: AddFile(L0 Files): cumulative 0, interval 0 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: AddFile(Keys): cumulative 0, interval 0 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Cumulative compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: ** File Read Latency Histogram By Level [default] ** 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.672+0000 7fd20d7a0880 4 rocksdb: [db_impl/db_impl.cc:397] Shutdown: canceling all background work 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.673+0000 7fd20d7a0880 4 rocksdb: [db_impl/db_impl.cc:573] Shutdown complete 2024-03-12T16:00:40.819 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph-mon: debug 2024-03-12T16:00:40.673+0000 7fd20d7a0880 0 /usr/bin/ceph-mon: created monfs at /var/lib/ceph/mon/ceph-smithi006 for mon.smithi006 2024-03-12T16:00:41.386 INFO:teuthology.orchestra.run.smithi006.stderr:create mon.smithi006 on 2024-03-12T16:00:41.401 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Removed /etc/systemd/system/multi-user.target.wants/ceph.target. 2024-03-12T16:00:41.501 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-03-12T16:00:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-88d7ee42-e089-11ee-95c8-87774f69a715.target → /etc/systemd/system/ceph-88d7ee42-e089-11ee-95c8-87774f69a715.target. 2024-03-12T16:00:41.602 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-88d7ee42-e089-11ee-95c8-87774f69a715.target → /etc/systemd/system/ceph-88d7ee42-e089-11ee-95c8-87774f69a715.target. 2024-03-12T16:00:41.827 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Failed to reset failed state of unit ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi006.service: Unit ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi006.service not loaded. 2024-03-12T16:00:41.834 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Created symlink /etc/systemd/system/ceph-88d7ee42-e089-11ee-95c8-87774f69a715.target.wants/ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi006.service → /etc/systemd/system/ceph-88d7ee42-e089-11ee-95c8-87774f69a715@.service. 2024-03-12T16:00:41.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:41 smithi006 systemd[1]: Starting Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:00:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: disabled 2024-03-12T16:00:42.635 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: inactive 2024-03-12T16:00:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:firewalld.service is not enabled 2024-03-12T16:00:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:Not possible to enable service . firewalld.service is not available 2024-03-12T16:00:42.636 INFO:teuthology.orchestra.run.smithi006.stderr:Waiting for mon to start... 2024-03-12T16:00:42.637 INFO:teuthology.orchestra.run.smithi006.stderr:Waiting for mon... 2024-03-12T16:00:42.877 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:42 smithi006 bash[39168]: 3e986c31e5a7fa4686b769d5ba1621f76ac1d0c2bcc9de4565b92f22d14de3ae 2024-03-12T16:00:42.878 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:42 smithi006 systemd[1]: Started Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:00:42.878 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: cluster 2024-03-12T16:00:42.612972+0000 mon.smithi006 (mon.0) 0 : [INF] mkfs 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:42.878 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: cluster 2024-03-12T16:00:42.592016+0000 mon.smithi006 (mon.0) 1 : cluster [INF] mon.smithi006 is new leader, mons smithi006 in quorum (ranks 0) 2024-03-12T16:00:43.178 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.174+0000 7f03984e2700 1 Processor -- start 2024-03-12T16:00:43.178 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.174+0000 7f03984e2700 1 -- start start 2024-03-12T16:00:43.178 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.175+0000 7f03984e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f03900fd990 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:43.178 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.175+0000 7f03984e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03900fde80 con 0x7f03900fd570 2024-03-12T16:00:43.178 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.175+0000 7f039627e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f03900fd990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.175+0000 7f039627e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f03900fd990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42358/0 (socket says 172.21.15.6:42358) 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.175+0000 7f039627e700 1 -- 172.21.15.6:0/3635451258 learned_addr learned my addr 172.21.15.6:0/3635451258 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.175+0000 7f039627e700 1 -- 172.21.15.6:0/3635451258 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03900fdfc0 con 0x7f03900fd570 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f039627e700 1 --2- 172.21.15.6:0/3635451258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f03900fd990 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f038c009730 tx=0x7f038c0090f0).ready entity=mon.0 client_cookie=607a5257fb803eff server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f039527c700 1 -- 172.21.15.6:0/3635451258 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038c00b770 con 0x7f03900fd570 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f039527c700 1 -- 172.21.15.6:0/3635451258 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c00b8d0 con 0x7f03900fd570 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f039527c700 1 -- 172.21.15.6:0/3635451258 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038c00bba0 con 0x7f03900fd570 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f03984e2700 1 -- 172.21.15.6:0/3635451258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 msgr2=0x7f03900fd990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f03984e2700 1 --2- 172.21.15.6:0/3635451258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f03900fd990 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7f038c009730 tx=0x7f038c0090f0).stop 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f03984e2700 1 -- 172.21.15.6:0/3635451258 shutdown_connections 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f03984e2700 1 --2- 172.21.15.6:0/3635451258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f03900fd990 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f03984e2700 1 -- 172.21.15.6:0/3635451258 >> 172.21.15.6:0/3635451258 conn(0x7f03900f6e20 msgr2=0x7f03900f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.176+0000 7f03984e2700 1 -- 172.21.15.6:0/3635451258 shutdown_connections 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.177+0000 7f03984e2700 1 -- 172.21.15.6:0/3635451258 wait complete. 2024-03-12T16:00:43.179 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.177+0000 7f03984e2700 1 Processor -- start 2024-03-12T16:00:43.180 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.177+0000 7f03984e2700 1 -- start start 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.177+0000 7f03984e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f039010d7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.177+0000 7f03984e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f039010dce0 con 0x7f03900fd570 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.177+0000 7f039627e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f039010d7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.177+0000 7f039627e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f039010d7f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42368/0 (socket says 172.21.15.6:42368) 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.177+0000 7f039627e700 1 -- 172.21.15.6:0/3943191475 learned_addr learned my addr 172.21.15.6:0/3943191475 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.178+0000 7f039627e700 1 -- 172.21.15.6:0/3943191475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f038c009370 con 0x7f03900fd570 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.178+0000 7f039627e700 1 --2- 172.21.15.6:0/3943191475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f039010d7f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f038c009130 tx=0x7f038c017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.178+0000 7f03837fe700 1 -- 172.21.15.6:0/3943191475 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038c011d90 con 0x7f03900fd570 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.178+0000 7f03837fe700 1 -- 172.21.15.6:0/3943191475 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7f038c01d430 con 0x7f03900fd570 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.178+0000 7f03984e2700 1 -- 172.21.15.6:0/3943191475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f039010dee0 con 0x7f03900fd570 2024-03-12T16:00:43.181 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.178+0000 7f03837fe700 1 -- 172.21.15.6:0/3943191475 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f038c01d700 con 0x7f03900fd570 2024-03-12T16:00:43.182 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.178+0000 7f03984e2700 1 -- 172.21.15.6:0/3943191475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f039010e2f0 con 0x7f03900fd570 2024-03-12T16:00:43.182 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.179+0000 7f03837fe700 1 -- 172.21.15.6:0/3943191475 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f038c01dba0 con 0x7f03900fd570 2024-03-12T16:00:43.182 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.179+0000 7f03837fe700 1 -- 172.21.15.6:0/3943191475 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f038c026c90 con 0x7f03900fd570 2024-03-12T16:00:43.182 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.179+0000 7f03984e2700 1 -- 172.21.15.6:0/3943191475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0390046ce0 con 0x7f03900fd570 2024-03-12T16:00:43.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.181+0000 7f03837fe700 1 -- 172.21.15.6:0/3943191475 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f038c021030 con 0x7f03900fd570 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.251+0000 7f03984e2700 1 -- 172.21.15.6:0/3943191475 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status"} v 0) v1 -- 0x7f0390107440 con 0x7f03900fd570 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.252+0000 7f03837fe700 1 -- 172.21.15.6:0/3943191475 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status"}]=0 v0) v1 ==== 54+0+325 (secure 0 0 0) 0x7f038c026410 con 0x7f03900fd570 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: cluster: 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: id: 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: services: 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon: 1 daemons, quorum smithi006 (age 0.642597s) 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mgr: no daemons active 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-03-12T16:00:43.255 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: data: 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: pgs: 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.252+0000 7f03984e2700 1 -- 172.21.15.6:0/3943191475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 msgr2=0x7f039010d7f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.252+0000 7f03984e2700 1 --2- 172.21.15.6:0/3943191475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f039010d7f0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7f038c009130 tx=0x7f038c017000).stop 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.252+0000 7f03984e2700 1 -- 172.21.15.6:0/3943191475 shutdown_connections 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.252+0000 7f03984e2700 1 --2- 172.21.15.6:0/3943191475 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03900fd570 0x7f039010d7f0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.252+0000 7f03984e2700 1 -- 172.21.15.6:0/3943191475 >> 172.21.15.6:0/3943191475 conn(0x7f03900f6e20 msgr2=0x7f03900f8a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.252+0000 7f03984e2700 1 -- 172.21.15.6:0/3943191475 shutdown_connections 2024-03-12T16:00:43.256 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:43.253+0000 7f03984e2700 1 -- 172.21.15.6:0/3943191475 wait complete. 2024-03-12T16:00:43.874 INFO:teuthology.orchestra.run.smithi006.stderr:mon is available 2024-03-12T16:00:43.874 INFO:teuthology.orchestra.run.smithi006.stderr:Assimilating anything we can from ceph.conf... 2024-03-12T16:00:43.876 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: cluster 2024-03-12T16:00:42.609885+0000 mon.smithi006 (mon.0) 2 : cluster [INF] mon.smithi006 is new leader, mons smithi006 in quorum (ranks 0) 2024-03-12T16:00:43.876 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: cluster 2024-03-12T16:00:42.610048+0000 mon.smithi006 (mon.0) 3 : cluster [DBG] monmap e1: 1 mons at {smithi006=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0]} removed_ranks: {} 2024-03-12T16:00:43.876 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: cluster 2024-03-12T16:00:42.614837+0000 mon.smithi006 (mon.0) 4 : cluster [DBG] fsmap 2024-03-12T16:00:43.876 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: cluster 2024-03-12T16:00:42.617859+0000 mon.smithi006 (mon.0) 5 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-03-12T16:00:43.877 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: cluster 2024-03-12T16:00:42.618310+0000 mon.smithi006 (mon.0) 6 : cluster [DBG] mgrmap e1: no daemons active 2024-03-12T16:00:43.877 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: audit 2024-03-12T16:00:43.252420+0000 mon.smithi006 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.6:0/3943191475' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-03-12T16:00:44.429 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.428+0000 7fb95b158700 1 Processor -- start 2024-03-12T16:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.428+0000 7fb95b158700 1 -- start start 2024-03-12T16:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.428+0000 7fb95b158700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb9540ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.428+0000 7fb95b158700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb954100120 con 0x7fb954071c60 2024-03-12T16:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.428+0000 7fb958ef4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb9540ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.428+0000 7fb958ef4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb9540ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42382/0 (socket says 172.21.15.6:42382) 2024-03-12T16:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.428+0000 7fb958ef4700 1 -- 172.21.15.6:0/1852640497 learned_addr learned my addr 172.21.15.6:0/1852640497 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.428+0000 7fb958ef4700 1 -- 172.21.15.6:0/1852640497 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb954100260 con 0x7fb954071c60 2024-03-12T16:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb958ef4700 1 --2- 172.21.15.6:0/1852640497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb9540ffc30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fb948009730 tx=0x7fb9480090f0).ready entity=mon.0 client_cookie=e41c272f58341cb4 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:44.433 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb9537fe700 1 -- 172.21.15.6:0/1852640497 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb94800b6e0 con 0x7fb954071c60 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb9537fe700 1 -- 172.21.15.6:0/1852640497 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb94800b840 con 0x7fb954071c60 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb9537fe700 1 -- 172.21.15.6:0/1852640497 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb94800bb10 con 0x7fb954071c60 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb95b158700 1 -- 172.21.15.6:0/1852640497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 msgr2=0x7fb9540ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb95b158700 1 --2- 172.21.15.6:0/1852640497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb9540ffc30 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7fb948009730 tx=0x7fb9480090f0).stop 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb95b158700 1 -- 172.21.15.6:0/1852640497 shutdown_connections 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb95b158700 1 --2- 172.21.15.6:0/1852640497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb9540ffc30 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb95b158700 1 -- 172.21.15.6:0/1852640497 >> 172.21.15.6:0/1852640497 conn(0x7fb9540f76f0 msgr2=0x7fb9540f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb95b158700 1 -- 172.21.15.6:0/1852640497 shutdown_connections 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.429+0000 7fb95b158700 1 -- 172.21.15.6:0/1852640497 wait complete. 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.430+0000 7fb95b158700 1 Processor -- start 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.430+0000 7fb95b158700 1 -- start start 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.430+0000 7fb95b158700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb95410b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.430+0000 7fb95b158700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb95410bab0 con 0x7fb954071c60 2024-03-12T16:00:44.434 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb958ef4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb95410b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb958ef4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb95410b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42394/0 (socket says 172.21.15.6:42394) 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb958ef4700 1 -- 172.21.15.6:0/2916313374 learned_addr learned my addr 172.21.15.6:0/2916313374 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb958ef4700 1 -- 172.21.15.6:0/2916313374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb948009370 con 0x7fb954071c60 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb958ef4700 1 --2- 172.21.15.6:0/2916313374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb95410b5c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fb948000c00 tx=0x7fb948017000).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb951ffb700 1 -- 172.21.15.6:0/2916313374 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb948011cc0 con 0x7fb954071c60 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb951ffb700 1 -- 172.21.15.6:0/2916313374 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(0 keys) v1 ==== 4+0+0 (secure 0 0 0) 0x7fb948011e20 con 0x7fb954071c60 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb95b158700 1 -- 172.21.15.6:0/2916313374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb95410bcb0 con 0x7fb954071c60 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb951ffb700 1 -- 172.21.15.6:0/2916313374 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb94801d590 con 0x7fb954071c60 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.431+0000 7fb95b158700 1 -- 172.21.15.6:0/2916313374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb95410c0c0 con 0x7fb954071c60 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.432+0000 7fb951ffb700 1 -- 172.21.15.6:0/2916313374 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fb94801da20 con 0x7fb954071c60 2024-03-12T16:00:44.435 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.432+0000 7fb951ffb700 1 -- 172.21.15.6:0/2916313374 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb948026b10 con 0x7fb954071c60 2024-03-12T16:00:44.436 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.433+0000 7fb95b158700 1 -- 172.21.15.6:0/2916313374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb954046ce0 con 0x7fb954071c60 2024-03-12T16:00:44.436 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.435+0000 7fb951ffb700 1 -- 172.21.15.6:0/2916313374 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fb948021030 con 0x7fb954071c60 2024-03-12T16:00:44.503 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.502+0000 7fb95b158700 1 -- 172.21.15.6:0/2916313374 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fb954100510 con 0x7fb954071c60 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.505+0000 7fb951ffb700 1 -- 172.21.15.6:0/2916313374 <== mon.0 v2:172.21.15.6:3300/0 7 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb94802f880 con 0x7fb954071c60 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.505+0000 7fb951ffb700 1 -- 172.21.15.6:0/2916313374 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v2) v1 ==== 70+0+452 (secure 0 0 0) 0x7fb948036430 con 0x7fb954071c60 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: [global] 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: fsid = 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: log_to_journald = false 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.6:3300,v1:172.21.15.6:6789] 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-03-12T16:00:44.509 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: [mgr] 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: [osd] 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.507+0000 7fb95b158700 1 -- 172.21.15.6:0/2916313374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 msgr2=0x7fb95410b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.507+0000 7fb95b158700 1 --2- 172.21.15.6:0/2916313374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb95410b5c0 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7fb948000c00 tx=0x7fb948017000).stop 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.507+0000 7fb95b158700 1 -- 172.21.15.6:0/2916313374 shutdown_connections 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.507+0000 7fb95b158700 1 --2- 172.21.15.6:0/2916313374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb954071c60 0x7fb95410b5c0 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.507+0000 7fb95b158700 1 -- 172.21.15.6:0/2916313374 >> 172.21.15.6:0/2916313374 conn(0x7fb9540f76f0 msgr2=0x7fb9540f93c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:44.510 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.507+0000 7fb95b158700 1 -- 172.21.15.6:0/2916313374 shutdown_connections 2024-03-12T16:00:44.511 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:44.507+0000 7fb95b158700 1 -- 172.21.15.6:0/2916313374 wait complete. 2024-03-12T16:00:44.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: audit 2024-03-12T16:00:44.502913+0000 mon.smithi006 (mon.0) 8 : audit [INF] from='client.? 172.21.15.6:0/2916313374' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-12T16:00:44.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: audit 2024-03-12T16:00:44.506037+0000 mon.smithi006 (mon.0) 9 : audit [INF] from='client.? 172.21.15.6:0/2916313374' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-03-12T16:00:45.347 INFO:teuthology.orchestra.run.smithi006.stderr:Generating new minimal ceph.conf... 2024-03-12T16:00:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.926+0000 7f6de2f47700 1 Processor -- start 2024-03-12T16:00:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.926+0000 7f6de2f47700 1 -- start start 2024-03-12T16:00:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.926+0000 7f6de2f47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc0ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:45.934 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.926+0000 7f6de2f47700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc100160 con 0x7f6ddc071c20 2024-03-12T16:00:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.926+0000 7f6de0ce3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc0ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.926+0000 7f6de0ce3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc0ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42396/0 (socket says 172.21.15.6:42396) 2024-03-12T16:00:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.926+0000 7f6de0ce3700 1 -- 172.21.15.6:0/4276766000 learned_addr learned my addr 172.21.15.6:0/4276766000 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.927+0000 7f6de0ce3700 1 -- 172.21.15.6:0/4276766000 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ddc1002a0 con 0x7f6ddc071c20 2024-03-12T16:00:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.927+0000 7f6de0ce3700 1 --2- 172.21.15.6:0/4276766000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc0ffc70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f6dd0009730 tx=0x7f6dd00090f0).ready entity=mon.0 client_cookie=d2f49cf42709a368 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:45.935 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.927+0000 7f6ddb7fe700 1 -- 172.21.15.6:0/4276766000 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6dd000b770 con 0x7f6ddc071c20 2024-03-12T16:00:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.927+0000 7f6ddb7fe700 1 -- 172.21.15.6:0/4276766000 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6dd000bd20 con 0x7f6ddc071c20 2024-03-12T16:00:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.927+0000 7f6ddb7fe700 1 -- 172.21.15.6:0/4276766000 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6dd0011cc0 con 0x7f6ddc071c20 2024-03-12T16:00:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.928+0000 7f6de2f47700 1 -- 172.21.15.6:0/4276766000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 msgr2=0x7f6ddc0ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.928+0000 7f6de2f47700 1 --2- 172.21.15.6:0/4276766000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc0ffc70 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f6dd0009730 tx=0x7f6dd00090f0).stop 2024-03-12T16:00:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.928+0000 7f6de2f47700 1 -- 172.21.15.6:0/4276766000 shutdown_connections 2024-03-12T16:00:45.936 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.928+0000 7f6de2f47700 1 --2- 172.21.15.6:0/4276766000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc0ffc70 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.928+0000 7f6de2f47700 1 -- 172.21.15.6:0/4276766000 >> 172.21.15.6:0/4276766000 conn(0x7f6ddc0f76f0 msgr2=0x7f6ddc0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.928+0000 7f6de2f47700 1 -- 172.21.15.6:0/4276766000 shutdown_connections 2024-03-12T16:00:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.928+0000 7f6de2f47700 1 -- 172.21.15.6:0/4276766000 wait complete. 2024-03-12T16:00:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.929+0000 7f6de2f47700 1 Processor -- start 2024-03-12T16:00:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.929+0000 7f6de2f47700 1 -- start start 2024-03-12T16:00:45.937 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.929+0000 7f6de2f47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc109b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.929+0000 7f6de2f47700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ddc10a060 con 0x7f6ddc071c20 2024-03-12T16:00:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.929+0000 7f6de0ce3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc109b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.929+0000 7f6de0ce3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc109b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42410/0 (socket says 172.21.15.6:42410) 2024-03-12T16:00:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.929+0000 7f6de0ce3700 1 -- 172.21.15.6:0/152696679 learned_addr learned my addr 172.21.15.6:0/152696679 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.929+0000 7f6de0ce3700 1 -- 172.21.15.6:0/152696679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6dd0009370 con 0x7f6ddc071c20 2024-03-12T16:00:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.929+0000 7f6de0ce3700 1 --2- 172.21.15.6:0/152696679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc109b70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f6dd0011630 tx=0x7f6dd00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:45.938 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.930+0000 7f6dd9ffb700 1 -- 172.21.15.6:0/152696679 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6dd0011400 con 0x7f6ddc071c20 2024-03-12T16:00:45.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.930+0000 7f6de2f47700 1 -- 172.21.15.6:0/152696679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ddc10a260 con 0x7f6ddc071c20 2024-03-12T16:00:45.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.930+0000 7f6dd9ffb700 1 -- 172.21.15.6:0/152696679 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f6dd0010e70 con 0x7f6ddc071c20 2024-03-12T16:00:45.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.930+0000 7f6dd9ffb700 1 -- 172.21.15.6:0/152696679 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f6dd001ab90 con 0x7f6ddc071c20 2024-03-12T16:00:45.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.930+0000 7f6de2f47700 1 -- 172.21.15.6:0/152696679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ddc10a670 con 0x7f6ddc071c20 2024-03-12T16:00:45.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.930+0000 7f6dd9ffb700 1 -- 172.21.15.6:0/152696679 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7f6dd0023450 con 0x7f6ddc071c20 2024-03-12T16:00:45.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.930+0000 7f6dd9ffb700 1 -- 172.21.15.6:0/152696679 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f6dd00223b0 con 0x7f6ddc071c20 2024-03-12T16:00:45.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.931+0000 7f6de2f47700 1 -- 172.21.15.6:0/152696679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ddc046ce0 con 0x7f6ddc071c20 2024-03-12T16:00:45.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:45.934+0000 7f6dd9ffb700 1 -- 172.21.15.6:0/152696679 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7f6dd0028060 con 0x7f6ddc071c20 2024-03-12T16:00:46.008 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:46.001+0000 7f6de2f47700 1 -- 172.21.15.6:0/152696679 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7f6ddc103b40 con 0x7f6ddc071c20 2024-03-12T16:00:46.009 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:46.002+0000 7f6dd9ffb700 1 -- 172.21.15.6:0/152696679 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v2) v1 ==== 76+0+173 (secure 0 0 0) 0x7f6dd001e070 con 0x7f6ddc071c20 2024-03-12T16:00:46.009 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:46.002+0000 7f6de2f47700 1 -- 172.21.15.6:0/152696679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 msgr2=0x7f6ddc109b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:46.009 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:46.002+0000 7f6de2f47700 1 --2- 172.21.15.6:0/152696679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc109b70 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f6dd0011630 tx=0x7f6dd00090f0).stop 2024-03-12T16:00:46.009 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:46.002+0000 7f6de2f47700 1 -- 172.21.15.6:0/152696679 shutdown_connections 2024-03-12T16:00:46.009 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:46.002+0000 7f6de2f47700 1 --2- 172.21.15.6:0/152696679 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ddc071c20 0x7f6ddc109b70 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:46.002+0000 7f6de2f47700 1 -- 172.21.15.6:0/152696679 >> 172.21.15.6:0/152696679 conn(0x7f6ddc0f76f0 msgr2=0x7f6ddc0fdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:46.003+0000 7f6de2f47700 1 -- 172.21.15.6:0/152696679 shutdown_connections 2024-03-12T16:00:46.010 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:46.003+0000 7f6de2f47700 1 -- 172.21.15.6:0/152696679 wait complete. 2024-03-12T16:00:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: audit 2024-03-12T16:00:46.002296+0000 mon.smithi006 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.6:0/152696679' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:00:46.762 INFO:teuthology.orchestra.run.smithi006.stderr:Restarting the monitor... 2024-03-12T16:00:47.082 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:46 smithi006 systemd[1]: Stopping Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:00:47.082 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:46 smithi006 bash[39508]: Error: no container with name or ID "ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon.smithi006" found: no such container 2024-03-12T16:00:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: debug 2024-03-12T16:00:47.080+0000 7f6a27448700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi006 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-12T16:00:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39183]: debug 2024-03-12T16:00:47.080+0000 7f6a27448700 -1 mon.smithi006@0(leader) e1 *** Got Signal Terminated *** 2024-03-12T16:00:47.906 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:47 smithi006 bash[39548]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006 2024-03-12T16:00:48.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:47 smithi006 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi006.service: Succeeded. 2024-03-12T16:00:48.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:47 smithi006 systemd[1]: Stopped Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:00:48.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:47 smithi006 systemd[1]: Starting Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:00:48.520 INFO:teuthology.orchestra.run.smithi006.stderr:Setting public_network to 172.21.0.0/20 in mon config section 2024-03-12T16:00:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.453+0000 7f394c9e7880 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-12T16:00:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.453+0000 7f394c9e7880 0 ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable), process ceph-mon, pid 7 2024-03-12T16:00:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.453+0000 7f394c9e7880 0 pidfile_write: ignore empty --pid-file 2024-03-12T16:00:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.457+0000 7f394c9e7880 0 load: jerasure load: lrc load: isa 2024-03-12T16:00:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: RocksDB version: 6.8.1 2024-03-12T16:00:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-03-12T16:00:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Compile date Mar 4 2024 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: DB SUMMARY 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: CURRENT file: CURRENT 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: IDENTITY file: IDENTITY 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: MANIFEST file: MANIFEST-000005 size: 131 Bytes 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi006/store.db dir, Total Num: 1, files: 000004.sst 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi006/store.db: 000006.log size: 99974 ; 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.error_if_exists: 0 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.create_if_missing: 0 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.paranoid_checks: 1 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.env: 0x556bda35e080 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.fs: Posix File System 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.info_log: 0x556bdbe84560 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.statistics: (nil) 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.use_fsync: 0 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_log_file_size: 0 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-12T16:00:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.allow_fallocate: 1 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.use_direct_reads: 0 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.create_missing_column_families: 0 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.db_log_dir: 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi006/store.db 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_subcompactions: 1 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_background_flushes: -1 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-12T16:00:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.advise_random_on_open: 1 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.write_buffer_manager: 0x556bdcaf4450 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.rate_limiter: (nil) 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-12T16:00:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.unordered_write: 0 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.row_cache: None 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.wal_filter: None 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.preserve_deletes: 0 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.two_write_queues: 0 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.manual_wal_flush: 0 2024-03-12T16:00:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.atomic_flush: 0 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.log_readahead_size: 0 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_background_jobs: 2 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_background_compactions: -1 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_total_wal_size: 0 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-12T16:00:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_open_files: -1 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.bytes_per_sync: 0 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Compression algorithms supported: 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: kZSTD supported: 0 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: kXpressCompression supported: 0 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: kLZ4Compression supported: 1 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: kBZip2Compression supported: 0 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: kZlibCompression supported: 1 2024-03-12T16:00:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: kSnappyCompression supported: 1 2024-03-12T16:00:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-12T16:00:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi006/store.db/MANIFEST-000005 2024-03-12T16:00:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-03-12T16:00:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-12T16:00:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.merge_operator: 2024-03-12T16:00:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_filter: None 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_filter_factory: None 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x556bdbe29d10) 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cache_index_and_filter_blocks: 1 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: pin_top_level_index_and_filter: 1 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: index_type: 0 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: data_block_index_type: 0 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: index_shortening: 1 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: data_block_hash_table_util_ratio: 0.750000 2024-03-12T16:00:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: hash_index_allow_collision: 1 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: checksum: 1 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: no_block_cache: 0 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: block_cache: 0x556bdbe5ef10 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: block_cache_name: BinnedLRUCache 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: block_cache_options: 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: capacity : 536870912 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: num_shard_bits : 4 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: strict_capacity_limit : 0 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: high_pri_pool_ratio: 0.000 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: block_cache_compressed: (nil) 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: persistent_cache: (nil) 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: block_size: 4096 2024-03-12T16:00:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: block_size_deviation: 10 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: block_restart_interval: 16 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: index_block_restart_interval: 1 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: metadata_block_size: 4096 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: partition_filters: 0 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: use_delta_encoding: 1 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: filter_policy: rocksdb.BuiltinBloomFilter 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: whole_key_filtering: 1 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: verify_compression: 0 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: read_amp_bytes_per_bit: 0 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: format_version: 2 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: enable_index_compression: 1 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: block_align: 0 2024-03-12T16:00:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compression: NoCompression 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.num_levels: 7 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-12T16:00:48.721 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compression_opts.level: 32767 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compression_opts.enabled: false 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-12T16:00:48.722 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-12T16:00:48.723 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.arena_block_size: 4194304 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-12T16:00:48.724 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.table_properties_collectors: 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.inplace_update_support: 0 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.bloom_locality: 0 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.max_successive_merges: 0 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-12T16:00:48.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.force_consistency_checks: 0 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.ttl: 2592000 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.458+0000 7f394c9e7880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.459+0000 7f394c9e7880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi006/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 7, last_sequence is 5, log_number is 4,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.459+0000 7f394c9e7880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 4 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.459+0000 7f394c9e7880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710259248459736, "job": 1, "event": "recovery_started", "log_files": [6]} 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.459+0000 7f394c9e7880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #6 mode 2 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.459+0000 7f394c9e7880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.460+0000 7f394c9e7880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710259248460712, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 7, "file_size": 95353, "table_properties": {"data_size": 93448, "index_size": 382, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 709, "raw_key_size": 12918, "raw_average_key_size": 49, "raw_value_size": 86342, "raw_average_value_size": 332, "num_data_blocks": 12, "num_entries": 260, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1710259248, "oldest_key_time": 3, "file_creation_time": 0}} 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.460+0000 7f394c9e7880 4 rocksdb: [version_set.cc:3826] Creating manifest 8 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.460+0000 7f394c9e7880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710259248461114, "job": 1, "event": "recovery_finished"} 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.461+0000 7f394c9e7880 4 rocksdb: DB pointer 0x556bdbf27800 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.461+0000 7f39337d9700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.461+0000 7f39337d9700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ** DB Stats ** 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ** Compaction Stats [default] ** 2024-03-12T16:00:48.727 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: L0 2/0 94.81 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.7 0.00 0.00 1 0.001 0 0 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Sum 2/0 94.81 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.7 0.00 0.00 1 0.001 0 0 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.7 0.00 0.00 1 0.001 0 0 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ** Compaction Stats [default] ** 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 145.7 0.00 0.00 1 0.001 0 0 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-12T16:00:48.728 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: AddFile(Total Files): cumulative 0, interval 0 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: AddFile(Keys): cumulative 0, interval 0 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Cumulative compaction: 0.00 GB write, 31.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Interval compaction: 0.00 GB write, 31.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ** File Read Latency Histogram By Level [default] ** 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ** Compaction Stats [default] ** 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: L0 2/0 94.81 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.7 0.00 0.00 1 0.001 0 0 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Sum 2/0 94.81 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 145.7 0.00 0.00 1 0.001 0 0 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-12T16:00:48.729 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ** Compaction Stats [default] ** 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 145.7 0.00 0.00 1 0.001 0 0 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: AddFile(Total Files): cumulative 0, interval 0 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: AddFile(Keys): cumulative 0, interval 0 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Cumulative compaction: 0.00 GB write, 31.27 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:00:48.730 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: ** File Read Latency Histogram By Level [default] ** 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.462+0000 7f394c9e7880 0 starting mon.smithi006 rank 0 at public addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] at bind addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi006 fsid 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.463+0000 7f394c9e7880 1 mon.smithi006@-1(???) e1 preinit fsid 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.463+0000 7f394c9e7880 0 mon.smithi006@-1(???).mds e1 new map 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.463+0000 7f394c9e7880 0 mon.smithi006@-1(???).mds e1 print_map 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: e1 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: legacy client fscid: -1 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: No filesystems configured 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: 2024-03-12T16:00:48.731 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.463+0000 7f394c9e7880 0 mon.smithi006@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.463+0000 7f394c9e7880 0 mon.smithi006@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.463+0000 7f394c9e7880 0 mon.smithi006@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.463+0000 7f394c9e7880 0 mon.smithi006@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:46.002296+0000 mon.smithi006 (mon.0) 10 : audit [DBG] from='client.? 172.21.15.6:0/152696679' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:00:48.463+0000 7f394c9e7880 1 mon.smithi006@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 bash[39668]: 0a9d6f3ef42c2da2836e97c23e9a8e6c9280d6c1cc219c2ee1567ee5e90489a3 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 systemd[1]: Started Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:48.479062+0000 mon.smithi006 (mon.0) 1 : cluster [INF] mon.smithi006 is new leader, mons smithi006 in quorum (ranks 0) 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:48.479107+0000 mon.smithi006 (mon.0) 2 : cluster [DBG] monmap e1: 1 mons at {smithi006=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0]} removed_ranks: {} 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:48.479490+0000 mon.smithi006 (mon.0) 3 : cluster [DBG] fsmap 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:48.479520+0000 mon.smithi006 (mon.0) 4 : cluster [DBG] osdmap e1: 0 total, 0 up, 0 in 2024-03-12T16:00:48.732 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:48.479860+0000 mon.smithi006 (mon.0) 5 : cluster [DBG] mgrmap e1: no daemons active 2024-03-12T16:00:49.079 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.076+0000 7fcd3545c700 1 Processor -- start 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.076+0000 7fcd3545c700 1 -- start start 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.076+0000 7fcd3545c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd300722c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.076+0000 7fcd3545c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd30074140 con 0x7fcd30073d20 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.077+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd300722c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.077+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd300722c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42420/0 (socket says 172.21.15.6:42420) 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.077+0000 7fcd2effd700 1 -- 172.21.15.6:0/1385630556 learned_addr learned my addr 172.21.15.6:0/1385630556 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.077+0000 7fcd2effd700 1 -- 172.21.15.6:0/1385630556 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd300727b0 con 0x7fcd30073d20 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.077+0000 7fcd2effd700 1 --2- 172.21.15.6:0/1385630556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd300722c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fcd24009730 tx=0x7fcd240090f0).ready entity=mon.0 client_cookie=725671cbc93a067f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.077+0000 7fcd2dffb700 1 -- 172.21.15.6:0/1385630556 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd2400b6e0 con 0x7fcd30073d20 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.077+0000 7fcd2dffb700 1 -- 172.21.15.6:0/1385630556 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fcd2400bc90 con 0x7fcd30073d20 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.077+0000 7fcd2dffb700 1 -- 172.21.15.6:0/1385630556 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd24011c70 con 0x7fcd30073d20 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.078+0000 7fcd3545c700 1 -- 172.21.15.6:0/1385630556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 msgr2=0x7fcd300722c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.078+0000 7fcd3545c700 1 --2- 172.21.15.6:0/1385630556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd300722c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fcd24009730 tx=0x7fcd240090f0).stop 2024-03-12T16:00:49.080 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.078+0000 7fcd3545c700 1 -- 172.21.15.6:0/1385630556 shutdown_connections 2024-03-12T16:00:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.078+0000 7fcd3545c700 1 --2- 172.21.15.6:0/1385630556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd300722c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.078+0000 7fcd3545c700 1 -- 172.21.15.6:0/1385630556 >> 172.21.15.6:0/1385630556 conn(0x7fcd300f8800 msgr2=0x7fcd300fac20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.078+0000 7fcd3545c700 1 -- 172.21.15.6:0/1385630556 shutdown_connections 2024-03-12T16:00:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.078+0000 7fcd3545c700 1 -- 172.21.15.6:0/1385630556 wait complete. 2024-03-12T16:00:49.081 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.079+0000 7fcd3545c700 1 Processor -- start 2024-03-12T16:00:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.079+0000 7fcd3545c700 1 -- start start 2024-03-12T16:00:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.079+0000 7fcd3545c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd3010dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.079+0000 7fcd3545c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd3010e4e0 con 0x7fcd30073d20 2024-03-12T16:00:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.079+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd3010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.079+0000 7fcd2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd3010dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42422/0 (socket says 172.21.15.6:42422) 2024-03-12T16:00:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.079+0000 7fcd2effd700 1 -- 172.21.15.6:0/3098490483 learned_addr learned my addr 172.21.15.6:0/3098490483 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.079+0000 7fcd2effd700 1 -- 172.21.15.6:0/3098490483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd24009370 con 0x7fcd30073d20 2024-03-12T16:00:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.080+0000 7fcd2effd700 1 --2- 172.21.15.6:0/3098490483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd3010dff0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fcd24009330 tx=0x7fcd240090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.080+0000 7fcd17fff700 1 -- 172.21.15.6:0/3098490483 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd2401a610 con 0x7fcd30073d20 2024-03-12T16:00:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.080+0000 7fcd17fff700 1 -- 172.21.15.6:0/3098490483 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fcd2401abc0 con 0x7fcd30073d20 2024-03-12T16:00:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.080+0000 7fcd17fff700 1 -- 172.21.15.6:0/3098490483 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fcd24022a30 con 0x7fcd30073d20 2024-03-12T16:00:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.080+0000 7fcd3545c700 1 -- 172.21.15.6:0/3098490483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd3010e6e0 con 0x7fcd30073d20 2024-03-12T16:00:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.080+0000 7fcd3545c700 1 -- 172.21.15.6:0/3098490483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd3010eaf0 con 0x7fcd30073d20 2024-03-12T16:00:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.080+0000 7fcd17fff700 1 -- 172.21.15.6:0/3098490483 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fcd24023450 con 0x7fcd30073d20 2024-03-12T16:00:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.080+0000 7fcd17fff700 1 -- 172.21.15.6:0/3098490483 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fcd24019390 con 0x7fcd30073d20 2024-03-12T16:00:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.081+0000 7fcd3545c700 1 -- 172.21.15.6:0/3098490483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd30046ce0 con 0x7fcd30073d20 2024-03-12T16:00:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.083+0000 7fcd17fff700 1 -- 172.21.15.6:0/3098490483 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fcd24028060 con 0x7fcd30073d20 2024-03-12T16:00:49.151 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.150+0000 7fcd3545c700 1 -- 172.21.15.6:0/3098490483 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=public_network}] v 0) v1 -- 0x7fcd30107e10 con 0x7fcd30073d20 2024-03-12T16:00:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.152+0000 7fcd17fff700 1 -- 172.21.15.6:0/3098490483 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=public_network}]=0 v3)=0 v3) v1 ==== 124+0+0 (secure 0 0 0) 0x7fcd2401e070 con 0x7fcd30073d20 2024-03-12T16:00:49.153 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.152+0000 7fcd3545c700 1 -- 172.21.15.6:0/3098490483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 msgr2=0x7fcd3010dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.152+0000 7fcd3545c700 1 --2- 172.21.15.6:0/3098490483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd3010dff0 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 rx=0x7fcd24009330 tx=0x7fcd240090f0).stop 2024-03-12T16:00:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.153+0000 7fcd3545c700 1 -- 172.21.15.6:0/3098490483 shutdown_connections 2024-03-12T16:00:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.153+0000 7fcd3545c700 1 --2- 172.21.15.6:0/3098490483 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd30073d20 0x7fcd3010dff0 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:49.154 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.153+0000 7fcd3545c700 1 -- 172.21.15.6:0/3098490483 >> 172.21.15.6:0/3098490483 conn(0x7fcd300f8800 msgr2=0x7fcd300fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:49.155 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.153+0000 7fcd3545c700 1 -- 172.21.15.6:0/3098490483 shutdown_connections 2024-03-12T16:00:49.155 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:49.153+0000 7fcd3545c700 1 -- 172.21.15.6:0/3098490483 wait complete. 2024-03-12T16:00:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:Wrote config to /etc/ceph/ceph.conf 2024-03-12T16:00:49.741 INFO:teuthology.orchestra.run.smithi006.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-03-12T16:00:49.742 INFO:teuthology.orchestra.run.smithi006.stderr:Creating mgr... 2024-03-12T16:00:49.742 INFO:teuthology.orchestra.run.smithi006.stderr:Verifying port 9283 ... 2024-03-12T16:00:49.892 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Failed to reset failed state of unit ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mgr.smithi006.kskdce.service: Unit ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mgr.smithi006.kskdce.service not loaded. 2024-03-12T16:00:49.898 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: Created symlink /etc/systemd/system/ceph-88d7ee42-e089-11ee-95c8-87774f69a715.target.wants/ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mgr.smithi006.kskdce.service → /etc/systemd/system/ceph-88d7ee42-e089-11ee-95c8-87774f69a715@.service. 2024-03-12T16:00:50.387 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:49.152566+0000 mon.smithi006 (mon.0) 6 : audit [INF] from='client.? 172.21.15.6:0/3098490483' entity='client.admin' 2024-03-12T16:00:50.672 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: disabled 2024-03-12T16:00:50.680 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: inactive 2024-03-12T16:00:50.681 INFO:teuthology.orchestra.run.smithi006.stderr:firewalld.service is not enabled 2024-03-12T16:00:50.681 INFO:teuthology.orchestra.run.smithi006.stderr:Not possible to enable service . firewalld.service is not available 2024-03-12T16:00:50.689 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: disabled 2024-03-12T16:00:50.697 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: inactive 2024-03-12T16:00:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:firewalld.service is not enabled 2024-03-12T16:00:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-03-12T16:00:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:Waiting for mgr to start... 2024-03-12T16:00:50.698 INFO:teuthology.orchestra.run.smithi006.stderr:Waiting for mgr... 2024-03-12T16:00:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.257+0000 7fc08bc0a700 1 Processor -- start 2024-03-12T16:00:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.257+0000 7fc08bc0a700 1 -- start start 2024-03-12T16:00:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.257+0000 7fc08bc0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc0840ffcb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.257+0000 7fc08bc0a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc0841001a0 con 0x7fc084071be0 2024-03-12T16:00:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.258+0000 7fc0899a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc0840ffcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.258+0000 7fc0899a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc0840ffcb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42448/0 (socket says 172.21.15.6:42448) 2024-03-12T16:00:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.258+0000 7fc0899a6700 1 -- 172.21.15.6:0/100565995 learned_addr learned my addr 172.21.15.6:0/100565995 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.258+0000 7fc0899a6700 1 -- 172.21.15.6:0/100565995 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc0841002e0 con 0x7fc084071be0 2024-03-12T16:00:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.258+0000 7fc0899a6700 1 --2- 172.21.15.6:0/100565995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc0840ffcb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc080009730 tx=0x7fc0800090f0).ready entity=mon.0 client_cookie=b854c1ad279e8eec server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc0889a4700 1 -- 172.21.15.6:0/100565995 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc08000b6e0 con 0x7fc084071be0 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc0889a4700 1 -- 172.21.15.6:0/100565995 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fc08000bc90 con 0x7fc084071be0 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc0889a4700 1 -- 172.21.15.6:0/100565995 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc080011c70 con 0x7fc084071be0 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc08bc0a700 1 -- 172.21.15.6:0/100565995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 msgr2=0x7fc0840ffcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc08bc0a700 1 --2- 172.21.15.6:0/100565995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc0840ffcb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc080009730 tx=0x7fc0800090f0).stop 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc08bc0a700 1 -- 172.21.15.6:0/100565995 shutdown_connections 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc08bc0a700 1 --2- 172.21.15.6:0/100565995 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc0840ffcb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc08bc0a700 1 -- 172.21.15.6:0/100565995 >> 172.21.15.6:0/100565995 conn(0x7fc0840f76f0 msgr2=0x7fc0840f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc08bc0a700 1 -- 172.21.15.6:0/100565995 shutdown_connections 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.259+0000 7fc08bc0a700 1 -- 172.21.15.6:0/100565995 wait complete. 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.260+0000 7fc08bc0a700 1 Processor -- start 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.260+0000 7fc08bc0a700 1 -- start start 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.260+0000 7fc08bc0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc08410dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.260+0000 7fc08bc0a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc08410e4a0 con 0x7fc084071be0 2024-03-12T16:00:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.260+0000 7fc0899a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc08410dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:51.264 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.260+0000 7fc0899a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc08410dfb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42450/0 (socket says 172.21.15.6:42450) 2024-03-12T16:00:51.264 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.260+0000 7fc0899a6700 1 -- 172.21.15.6:0/496004123 learned_addr learned my addr 172.21.15.6:0/496004123 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:51.264 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.261+0000 7fc0899a6700 1 -- 172.21.15.6:0/496004123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc080009370 con 0x7fc084071be0 2024-03-12T16:00:51.264 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.261+0000 7fc0899a6700 1 --2- 172.21.15.6:0/496004123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc08410dfb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc080000c00 tx=0x7fc0800090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:51.264 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.261+0000 7fc076ffd700 1 -- 172.21.15.6:0/496004123 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc08001a610 con 0x7fc084071be0 2024-03-12T16:00:51.264 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.261+0000 7fc076ffd700 1 -- 172.21.15.6:0/496004123 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fc08001abc0 con 0x7fc084071be0 2024-03-12T16:00:51.264 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.261+0000 7fc076ffd700 1 -- 172.21.15.6:0/496004123 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc080022a20 con 0x7fc084071be0 2024-03-12T16:00:51.265 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.261+0000 7fc08bc0a700 1 -- 172.21.15.6:0/496004123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc08410e6a0 con 0x7fc084071be0 2024-03-12T16:00:51.265 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.261+0000 7fc08bc0a700 1 -- 172.21.15.6:0/496004123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc08410eab0 con 0x7fc084071be0 2024-03-12T16:00:51.265 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.261+0000 7fc076ffd700 1 -- 172.21.15.6:0/496004123 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fc080023450 con 0x7fc084071be0 2024-03-12T16:00:51.265 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.261+0000 7fc076ffd700 1 -- 172.21.15.6:0/496004123 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fc080019390 con 0x7fc084071be0 2024-03-12T16:00:51.265 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.262+0000 7fc08bc0a700 1 -- 172.21.15.6:0/496004123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc084046ce0 con 0x7fc084071be0 2024-03-12T16:00:51.265 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.264+0000 7fc076ffd700 1 -- 172.21.15.6:0/496004123 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fc080028060 con 0x7fc084071be0 2024-03-12T16:00:51.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.334+0000 7fc08bc0a700 1 -- 172.21.15.6:0/496004123 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fc084108030 con 0x7fc084071be0 2024-03-12T16:00:51.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.335+0000 7fc076ffd700 1 -- 172.21.15.6:0/496004123 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7fc08001e070 con 0x7fc084071be0 2024-03-12T16:00:51.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: { 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "fsid": "88d7ee42-e089-11ee-95c8-87774f69a715", 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "health": { 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "checks": {}, 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "mutes": [] 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "quorum": [ 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 0 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ], 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "quorum_names": [ 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "smithi006" 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ], 2024-03-12T16:00:51.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "quorum_age": 2, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "monmap": { 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_mons": 1 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "osdmap": { 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_osds": 0, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "pgmap": { 2024-03-12T16:00:51.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_pools": 0, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_objects": 0, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "bytes_total": 0 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "fsmap": { 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "by_rank": [], 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "up:standby": 0 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "mgrmap": { 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "available": false, 2024-03-12T16:00:51.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "modules": [ 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "iostat", 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "nfs", 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "restful" 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ], 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "services": {} 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "servicemap": { 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "modified": "2024-03-12T16:00:42.613335+0000", 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "services": {} 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "progress_events": {} 2024-03-12T16:00:51.350 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: } 2024-03-12T16:00:51.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.336+0000 7fc08bc0a700 1 -- 172.21.15.6:0/496004123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 msgr2=0x7fc08410dfb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:51.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.336+0000 7fc08bc0a700 1 --2- 172.21.15.6:0/496004123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc08410dfb0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fc080000c00 tx=0x7fc0800090f0).stop 2024-03-12T16:00:51.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.336+0000 7fc08bc0a700 1 -- 172.21.15.6:0/496004123 shutdown_connections 2024-03-12T16:00:51.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.336+0000 7fc08bc0a700 1 --2- 172.21.15.6:0/496004123 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc084071be0 0x7fc08410dfb0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:51.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.336+0000 7fc08bc0a700 1 -- 172.21.15.6:0/496004123 >> 172.21.15.6:0/496004123 conn(0x7fc0840f76f0 msgr2=0x7fc0840f9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:51.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.336+0000 7fc08bc0a700 1 -- 172.21.15.6:0/496004123 shutdown_connections 2024-03-12T16:00:51.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:51.336+0000 7fc08bc0a700 1 -- 172.21.15.6:0/496004123 wait complete. 2024-03-12T16:00:51.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:51.335326+0000 mon.smithi006 (mon.0) 7 : audit [DBG] from='client.? 172.21.15.6:0/496004123' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-12T16:00:51.958 INFO:teuthology.orchestra.run.smithi006.stderr:mgr not available, waiting (1/15)... 2024-03-12T16:00:54.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:54.636138+0000 mon.smithi006 (mon.0) 8 : audit [DBG] from='client.? 172.21.15.6:0/2889477103' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-12T16:00:55.555 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.558+0000 7faddb394700 1 Processor -- start 2024-03-12T16:00:55.555 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.558+0000 7faddb394700 1 -- start start 2024-03-12T16:00:55.555 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.558+0000 7faddb394700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.559+0000 7faddb394700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd4100160 con 0x7fadd4071c20 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.559+0000 7fadd9130700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.559+0000 7fadd9130700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48848/0 (socket says 172.21.15.6:48848) 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.559+0000 7fadd9130700 1 -- 172.21.15.6:0/1410131858 learned_addr learned my addr 172.21.15.6:0/1410131858 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.559+0000 7fadd9130700 1 -- 172.21.15.6:0/1410131858 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd41002a0 con 0x7fadd4071c20 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.559+0000 7fadd9130700 1 --2- 172.21.15.6:0/1410131858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40ffc70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fadd0009730 tx=0x7fadd00090f0).ready entity=mon.0 client_cookie=8a5d77295300c652 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.559+0000 7fadcbfff700 1 -- 172.21.15.6:0/1410131858 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadd000b770 con 0x7fadd4071c20 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.560+0000 7fadcbfff700 1 -- 172.21.15.6:0/1410131858 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fadd000bd20 con 0x7fadd4071c20 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.560+0000 7fadcbfff700 1 -- 172.21.15.6:0/1410131858 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadd0011cc0 con 0x7fadd4071c20 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.560+0000 7faddb394700 1 -- 172.21.15.6:0/1410131858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 msgr2=0x7fadd40ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.560+0000 7faddb394700 1 --2- 172.21.15.6:0/1410131858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40ffc70 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7fadd0009730 tx=0x7fadd00090f0).stop 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.560+0000 7faddb394700 1 -- 172.21.15.6:0/1410131858 shutdown_connections 2024-03-12T16:00:55.556 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.560+0000 7faddb394700 1 --2- 172.21.15.6:0/1410131858 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40ffc70 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.560+0000 7faddb394700 1 -- 172.21.15.6:0/1410131858 >> 172.21.15.6:0/1410131858 conn(0x7fadd40f76f0 msgr2=0x7fadd40f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.560+0000 7faddb394700 1 -- 172.21.15.6:0/1410131858 shutdown_connections 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.560+0000 7faddb394700 1 -- 172.21.15.6:0/1410131858 wait complete. 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.561+0000 7faddb394700 1 Processor -- start 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.561+0000 7faddb394700 1 -- start start 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.561+0000 7faddb394700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.561+0000 7faddb394700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fadd40fbb70 con 0x7fadd4071c20 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.561+0000 7fadd9130700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.561+0000 7fadd9130700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48862/0 (socket says 172.21.15.6:48862) 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.561+0000 7fadd9130700 1 -- 172.21.15.6:0/2889477103 learned_addr learned my addr 172.21.15.6:0/2889477103 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.561+0000 7fadd9130700 1 -- 172.21.15.6:0/2889477103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadd0009370 con 0x7fadd4071c20 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.561+0000 7fadd9130700 1 --2- 172.21.15.6:0/2889477103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40fd6f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fadd0011630 tx=0x7fadd00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.562+0000 7fadca7fc700 1 -- 172.21.15.6:0/2889477103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadd0011400 con 0x7fadd4071c20 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.562+0000 7fadca7fc700 1 -- 172.21.15.6:0/2889477103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fadd0010e70 con 0x7fadd4071c20 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.562+0000 7faddb394700 1 -- 172.21.15.6:0/2889477103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fadd40fbd10 con 0x7fadd4071c20 2024-03-12T16:00:55.557 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.562+0000 7fadca7fc700 1 -- 172.21.15.6:0/2889477103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fadd001ab90 con 0x7fadd4071c20 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.562+0000 7faddb394700 1 -- 172.21.15.6:0/2889477103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fadd40fc120 con 0x7fadd4071c20 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.562+0000 7fadca7fc700 1 -- 172.21.15.6:0/2889477103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 1) v1 ==== 495+0+0 (secure 0 0 0) 0x7fadd0023450 con 0x7fadd4071c20 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.562+0000 7fadca7fc700 1 -- 172.21.15.6:0/2889477103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fadd00223b0 con 0x7fadd4071c20 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.563+0000 7faddb394700 1 -- 172.21.15.6:0/2889477103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fadd4046ce0 con 0x7fadd4071c20 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.565+0000 7fadca7fc700 1 -- 172.21.15.6:0/2889477103 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+73271 (secure 0 0 0) 0x7fadd0028060 con 0x7fadd4071c20 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.635+0000 7faddb394700 1 -- 172.21.15.6:0/2889477103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7fadd4105ba0 con 0x7fadd4071c20 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.635+0000 7fadca7fc700 1 -- 172.21.15.6:0/2889477103 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7fadd001e070 con 0x7fadd4071c20 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.636+0000 7faddb394700 1 -- 172.21.15.6:0/2889477103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 msgr2=0x7fadd40fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.636+0000 7faddb394700 1 --2- 172.21.15.6:0/2889477103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40fd6f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fadd0011630 tx=0x7fadd00090f0).stop 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.636+0000 7faddb394700 1 -- 172.21.15.6:0/2889477103 shutdown_connections 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.636+0000 7faddb394700 1 --2- 172.21.15.6:0/2889477103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fadd4071c20 0x7fadd40fd6f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.636+0000 7faddb394700 1 -- 172.21.15.6:0/2889477103 >> 172.21.15.6:0/2889477103 conn(0x7fadd40f76f0 msgr2=0x7fadd40f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:00:55.558 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.636+0000 7faddb394700 1 -- 172.21.15.6:0/2889477103 shutdown_connections 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:54.636+0000 7faddb394700 1 -- 172.21.15.6:0/2889477103 wait complete. 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: { 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "fsid": "88d7ee42-e089-11ee-95c8-87774f69a715", 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "health": { 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "checks": {}, 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "mutes": [] 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "quorum": [ 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 0 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ], 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "quorum_names": [ 2024-03-12T16:00:55.559 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "smithi006" 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ], 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "quorum_age": 6, 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "monmap": { 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_mons": 1 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "osdmap": { 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_osds": 0, 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-03-12T16:00:55.560 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "pgmap": { 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_pools": 0, 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_objects": 0, 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "bytes_total": 0 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "fsmap": { 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:00:55.561 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "by_rank": [], 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "up:standby": 0 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "mgrmap": { 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "available": false, 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "modules": [ 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "iostat", 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "nfs", 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "restful" 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ], 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "services": {} 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "servicemap": { 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:00:55.562 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "modified": "2024-03-12T16:00:42.613335+0000", 2024-03-12T16:00:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "services": {} 2024-03-12T16:00:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:00:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "progress_events": {} 2024-03-12T16:00:55.563 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: } 2024-03-12T16:00:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:56.135416+0000 mon.smithi006 (mon.0) 9 : cluster [INF] Activating manager daemon smithi006.kskdce 2024-03-12T16:00:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:56.138008+0000 mon.smithi006 (mon.0) 10 : cluster [DBG] mgrmap e2: smithi006.kskdce(active, starting, since 0.00268527s) 2024-03-12T16:00:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.139070+0000 mon.smithi006 (mon.0) 11 : audit [DBG] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:00:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.139311+0000 mon.smithi006 (mon.0) 12 : audit [DBG] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:00:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.139522+0000 mon.smithi006 (mon.0) 13 : audit [DBG] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:00:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.139804+0000 mon.smithi006 (mon.0) 14 : audit [DBG] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:00:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.140026+0000 mon.smithi006 (mon.0) 15 : audit [DBG] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:00:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:56.153887+0000 mon.smithi006 (mon.0) 16 : cluster [INF] Manager daemon smithi006.kskdce is now available 2024-03-12T16:00:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.162263+0000 mon.smithi006 (mon.0) 17 : audit [INF] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' 2024-03-12T16:00:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.168550+0000 mon.smithi006 (mon.0) 18 : audit [INF] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:00:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.170957+0000 mon.smithi006 (mon.0) 19 : audit [INF] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:00:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.174372+0000 mon.smithi006 (mon.0) 20 : audit [INF] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' 2024-03-12T16:00:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:00:56.176252+0000 mon.smithi006 (mon.0) 21 : audit [INF] from='mgr.14100 172.21.15.6:0/4127061132' entity='mgr.smithi006.kskdce' 2024-03-12T16:00:58.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:00:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:57.141882+0000 mon.smithi006 (mon.0) 22 : cluster [DBG] mgrmap e3: smithi006.kskdce(active, since 1.00656s) 2024-03-12T16:00:59.259 INFO:teuthology.orchestra.run.smithi006.stderr:mgr not available, waiting (2/15)... 2024-03-12T16:01:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:00:59.141634+0000 mon.smithi006 (mon.0) 23 : cluster [DBG] mgrmap e4: smithi006.kskdce(active, since 3s) 2024-03-12T16:01:04.092 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.088+0000 7f7f83844700 1 Processor -- start 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.088+0000 7f7f83844700 1 -- start start 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.088+0000 7f7f83844700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c0fea60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.088+0000 7f7f83844700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c0fef50 con 0x7f7f7c0fe640 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.088+0000 7f7f815e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c0fea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.088+0000 7f7f815e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c0fea60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53328/0 (socket says 172.21.15.6:53328) 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.088+0000 7f7f815e0700 1 -- 172.21.15.6:0/3905182654 learned_addr learned my addr 172.21.15.6:0/3905182654 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.089+0000 7f7f815e0700 1 -- 172.21.15.6:0/3905182654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f7c0ff090 con 0x7f7f7c0fe640 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.089+0000 7f7f815e0700 1 --2- 172.21.15.6:0/3905182654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c0fea60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f7f78009730 tx=0x7f7f780090f0).ready entity=mon.0 client_cookie=333d250a19a18abf server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.089+0000 7f7f73fff700 1 -- 172.21.15.6:0/3905182654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f7800b6e0 con 0x7f7f7c0fe640 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.089+0000 7f7f73fff700 1 -- 172.21.15.6:0/3905182654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f7f7800bc90 con 0x7f7f7c0fe640 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.089+0000 7f7f73fff700 1 -- 172.21.15.6:0/3905182654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f78011c70 con 0x7f7f7c0fe640 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.090+0000 7f7f83844700 1 -- 172.21.15.6:0/3905182654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 msgr2=0x7f7f7c0fea60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:04.093 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.090+0000 7f7f83844700 1 --2- 172.21.15.6:0/3905182654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c0fea60 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f7f78009730 tx=0x7f7f780090f0).stop 2024-03-12T16:01:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.090+0000 7f7f83844700 1 -- 172.21.15.6:0/3905182654 shutdown_connections 2024-03-12T16:01:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.090+0000 7f7f83844700 1 --2- 172.21.15.6:0/3905182654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c0fea60 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.090+0000 7f7f83844700 1 -- 172.21.15.6:0/3905182654 >> 172.21.15.6:0/3905182654 conn(0x7f7f7c0f6e20 msgr2=0x7f7f7c0f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.090+0000 7f7f83844700 1 -- 172.21.15.6:0/3905182654 shutdown_connections 2024-03-12T16:01:04.094 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.090+0000 7f7f83844700 1 -- 172.21.15.6:0/3905182654 wait complete. 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.091+0000 7f7f83844700 1 Processor -- start 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.091+0000 7f7f83844700 1 -- start start 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.091+0000 7f7f83844700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c10bd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.091+0000 7f7f83844700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c10c270 con 0x7f7f7c0fe640 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.091+0000 7f7f815e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c10bd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.091+0000 7f7f815e0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c10bd80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53334/0 (socket says 172.21.15.6:53334) 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.091+0000 7f7f815e0700 1 -- 172.21.15.6:0/2565097105 learned_addr learned my addr 172.21.15.6:0/2565097105 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.092+0000 7f7f815e0700 1 -- 172.21.15.6:0/2565097105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f78009370 con 0x7f7f7c0fe640 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.092+0000 7f7f815e0700 1 --2- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c10bd80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7f78009340 tx=0x7f7f780090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.092+0000 7f7f727fc700 1 -- 172.21.15.6:0/2565097105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f7800bab0 con 0x7f7f7c0fe640 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.092+0000 7f7f727fc700 1 -- 172.21.15.6:0/2565097105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f7f78011c30 con 0x7f7f7c0fe640 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.092+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c10c470 con 0x7f7f7c0fe640 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.092+0000 7f7f727fc700 1 -- 172.21.15.6:0/2565097105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f7f7801ac70 con 0x7f7f7c0fe640 2024-03-12T16:01:04.096 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.092+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c10c880 con 0x7f7f7c0fe640 2024-03-12T16:01:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.093+0000 7f7f727fc700 1 -- 172.21.15.6:0/2565097105 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 38621+0+0 (secure 0 0 0) 0x7f7f78023400 con 0x7f7f7c0fe640 2024-03-12T16:01:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.093+0000 7f7f727fc700 1 --2- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f7f680325e0 0x7f7f68034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.093+0000 7f7f727fc700 1 -- 172.21.15.6:0/2565097105 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f7f78044b20 con 0x7f7f7c0fe640 2024-03-12T16:01:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.093+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c046ce0 con 0x7f7f7c0fe640 2024-03-12T16:01:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.093+0000 7f7f80ddf700 1 --2- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f7f680325e0 0x7f7f68034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:04.097 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.094+0000 7f7f80ddf700 1 --2- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f7f680325e0 0x7f7f68034aa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7f6c009780 tx=0x7f7f6c006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:04.100 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.098+0000 7f7f727fc700 1 -- 172.21.15.6:0/2565097105 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7f7801e080 con 0x7f7f7c0fe640 2024-03-12T16:01:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.335+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "status", "format": "json-pretty"} v 0) v1 -- 0x7f7f7c105800 con 0x7f7f7c0fe640 2024-03-12T16:01:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.335+0000 7f7f727fc700 1 -- 172.21.15.6:0/2565097105 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "status", "format": "json-pretty"}]=0 v0) v1 ==== 79+0+1249 (secure 0 0 0) 0x7f7f78011e60 con 0x7f7f7c0fe640 2024-03-12T16:01:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: { 2024-03-12T16:01:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "fsid": "88d7ee42-e089-11ee-95c8-87774f69a715", 2024-03-12T16:01:04.344 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "health": { 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "checks": {}, 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "mutes": [] 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "quorum": [ 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 0 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ], 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "quorum_names": [ 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "smithi006" 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ], 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "quorum_age": 15, 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "monmap": { 2024-03-12T16:01:04.345 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "min_mon_release_name": "pacific", 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_mons": 1 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "osdmap": { 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_osds": 0, 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:01:04.346 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "pgmap": { 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_pools": 0, 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_objects": 0, 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "bytes_total": 0 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "fsmap": { 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "by_rank": [], 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "up:standby": 0 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "mgrmap": { 2024-03-12T16:01:04.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "available": true, 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "modules": [ 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "iostat", 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "nfs", 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "restful" 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ], 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "services": {} 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "servicemap": { 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 1, 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "modified": "2024-03-12T16:00:42.613335+0000", 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "services": {} 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: }, 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "progress_events": {} 2024-03-12T16:01:04.348 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: } 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f7f680325e0 msgr2=0x7f7f68034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 --2- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f7f680325e0 0x7f7f68034aa0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f7f6c009780 tx=0x7f7f6c006cc0).stop 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 msgr2=0x7f7f7c10bd80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 --2- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c10bd80 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f7f78009340 tx=0x7f7f780090f0).stop 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 shutdown_connections 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 --2- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f7f680325e0 0x7f7f68034aa0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 --2- 172.21.15.6:0/2565097105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe640 0x7f7f7c10bd80 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 >> 172.21.15.6:0/2565097105 conn(0x7f7f7c0f6e20 msgr2=0x7f7f7c100430 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 shutdown_connections 2024-03-12T16:01:04.349 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:04.337+0000 7f7f83844700 1 -- 172.21.15.6:0/2565097105 wait complete. 2024-03-12T16:01:04.652 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:04.336674+0000 mon.smithi006 (mon.0) 24 : audit [DBG] from='client.? 172.21.15.6:0/2565097105' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-03-12T16:01:04.948 INFO:teuthology.orchestra.run.smithi006.stderr:mgr is available 2024-03-12T16:01:05.523 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.515+0000 7fb7ee557700 1 Processor -- start 2024-03-12T16:01:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.515+0000 7fb7ee557700 1 -- start start 2024-03-12T16:01:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.515+0000 7fb7ee557700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.515+0000 7fb7ee557700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e80fc7e0 con 0x7fb7e80fbed0 2024-03-12T16:01:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.515+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.515+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e80fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53342/0 (socket says 172.21.15.6:53342) 2024-03-12T16:01:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.516+0000 7fb7e7fff700 1 -- 172.21.15.6:0/4265086046 learned_addr learned my addr 172.21.15.6:0/4265086046 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:05.524 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.516+0000 7fb7e7fff700 1 -- 172.21.15.6:0/4265086046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7e80fc920 con 0x7fb7e80fbed0 2024-03-12T16:01:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.516+0000 7fb7e7fff700 1 --2- 172.21.15.6:0/4265086046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e80fc2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb7d8009730 tx=0x7fb7d80090f0).ready entity=mon.0 client_cookie=8c93018b5c4b3090 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.516+0000 7fb7e6ffd700 1 -- 172.21.15.6:0/4265086046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7d800b6e0 con 0x7fb7e80fbed0 2024-03-12T16:01:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.516+0000 7fb7e6ffd700 1 -- 172.21.15.6:0/4265086046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb7d800bc90 con 0x7fb7e80fbed0 2024-03-12T16:01:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.516+0000 7fb7e6ffd700 1 -- 172.21.15.6:0/4265086046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7d8011c70 con 0x7fb7e80fbed0 2024-03-12T16:01:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.517+0000 7fb7ee557700 1 -- 172.21.15.6:0/4265086046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 msgr2=0x7fb7e80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.517+0000 7fb7ee557700 1 --2- 172.21.15.6:0/4265086046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e80fc2f0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fb7d8009730 tx=0x7fb7d80090f0).stop 2024-03-12T16:01:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.517+0000 7fb7ee557700 1 -- 172.21.15.6:0/4265086046 shutdown_connections 2024-03-12T16:01:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.517+0000 7fb7ee557700 1 --2- 172.21.15.6:0/4265086046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e80fc2f0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.517+0000 7fb7ee557700 1 -- 172.21.15.6:0/4265086046 >> 172.21.15.6:0/4265086046 conn(0x7fb7e80f76f0 msgr2=0x7fb7e80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.517+0000 7fb7ee557700 1 -- 172.21.15.6:0/4265086046 shutdown_connections 2024-03-12T16:01:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.517+0000 7fb7ee557700 1 -- 172.21.15.6:0/4265086046 wait complete. 2024-03-12T16:01:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.517+0000 7fb7ee557700 1 Processor -- start 2024-03-12T16:01:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.517+0000 7fb7ee557700 1 -- start start 2024-03-12T16:01:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7ee557700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e810be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7ee557700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7e810c2f0 con 0x7fb7e80fbed0 2024-03-12T16:01:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e810be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e810be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53344/0 (socket says 172.21.15.6:53344) 2024-03-12T16:01:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7e7fff700 1 -- 172.21.15.6:0/412687264 learned_addr learned my addr 172.21.15.6:0/412687264 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7e7fff700 1 -- 172.21.15.6:0/412687264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7d8009370 con 0x7fb7e80fbed0 2024-03-12T16:01:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7e7fff700 1 --2- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e810be00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb7d80115c0 tx=0x7fb7d80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7e57fa700 1 -- 172.21.15.6:0/412687264 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7d801a610 con 0x7fb7e80fbed0 2024-03-12T16:01:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7e57fa700 1 -- 172.21.15.6:0/412687264 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb7d801abc0 con 0x7fb7e80fbed0 2024-03-12T16:01:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.518+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7e810c4f0 con 0x7fb7e80fbed0 2024-03-12T16:01:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.519+0000 7fb7e57fa700 1 -- 172.21.15.6:0/412687264 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb7d8022a40 con 0x7fb7e80fbed0 2024-03-12T16:01:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.519+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7e810c900 con 0x7fb7e80fbed0 2024-03-12T16:01:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.520+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7e8046ce0 con 0x7fb7e80fbed0 2024-03-12T16:01:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.520+0000 7fb7e57fa700 1 -- 172.21.15.6:0/412687264 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 38621+0+0 (secure 0 0 0) 0x7fb7d8022cb0 con 0x7fb7e80fbed0 2024-03-12T16:01:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.520+0000 7fb7e57fa700 1 --2- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fb7d00325e0 0x7fb7d0034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.520+0000 7fb7e57fa700 1 -- 172.21.15.6:0/412687264 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fb7d8044670 con 0x7fb7e80fbed0 2024-03-12T16:01:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.520+0000 7fb7e77fe700 1 --2- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fb7d00325e0 0x7fb7d0034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.521+0000 7fb7e77fe700 1 --2- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fb7d00325e0 0x7fb7d0034aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb7dc009780 tx=0x7fb7dc006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.525+0000 7fb7e57fa700 1 -- 172.21.15.6:0/412687264 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb7d802bd20 con 0x7fb7e80fbed0 2024-03-12T16:01:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.697+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config assimilate-conf"} v 0) v1 -- 0x7fb7e8105e40 con 0x7fb7e80fbed0 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.698+0000 7fb7e57fa700 1 -- 172.21.15.6:0/412687264 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config assimilate-conf"}]=0 v3) v1 ==== 70+0+398 (secure 0 0 0) 0x7fb7d801e030 con 0x7fb7e80fbed0 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: [global] 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: fsid = 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: log_to_journald = false 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: [mgr] 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: [osd] 2024-03-12T16:01:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_backfillfull_ratio = 0.85 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_full_ratio = 0.9 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: mon_osd_nearfull_ratio = 0.8 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.699+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fb7d00325e0 msgr2=0x7fb7d0034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.699+0000 7fb7ee557700 1 --2- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fb7d00325e0 0x7fb7d0034aa0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fb7dc009780 tx=0x7fb7dc006cc0).stop 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.699+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 msgr2=0x7fb7e810be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.699+0000 7fb7ee557700 1 --2- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e810be00 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fb7d80115c0 tx=0x7fb7d80090f0).stop 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.699+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 shutdown_connections 2024-03-12T16:01:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.699+0000 7fb7ee557700 1 --2- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fb7d00325e0 0x7fb7d0034aa0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.699+0000 7fb7ee557700 1 --2- 172.21.15.6:0/412687264 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7e80fbed0 0x7fb7e810be00 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.699+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 >> 172.21.15.6:0/412687264 conn(0x7fb7e80f76f0 msgr2=0x7fb7e8071910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.700+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 shutdown_connections 2024-03-12T16:01:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:05.700+0000 7fb7ee557700 1 -- 172.21.15.6:0/412687264 wait complete. 2024-03-12T16:01:06.067 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:05.698846+0000 mon.smithi006 (mon.0) 25 : audit [INF] from='client.? 172.21.15.6:0/412687264' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-03-12T16:01:06.305 INFO:teuthology.orchestra.run.smithi006.stderr:Enabling cephadm module... 2024-03-12T16:01:06.828 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.823+0000 7f30b393f700 1 Processor -- start 2024-03-12T16:01:06.828 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.824+0000 7f30b393f700 1 -- start start 2024-03-12T16:01:06.828 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.824+0000 7f30b393f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:06.828 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.824+0000 7f30b393f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac100120 con 0x7f30ac071c60 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.824+0000 7f30b16db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.824+0000 7f30b16db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53356/0 (socket says 172.21.15.6:53356) 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.824+0000 7f30b16db700 1 -- 172.21.15.6:0/2787230829 learned_addr learned my addr 172.21.15.6:0/2787230829 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.824+0000 7f30b16db700 1 -- 172.21.15.6:0/2787230829 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30ac100260 con 0x7f30ac071c60 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.824+0000 7f30b16db700 1 --2- 172.21.15.6:0/2787230829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0ffc30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f30a8009730 tx=0x7f30a80090f0).ready entity=mon.0 client_cookie=e643b62db5cfaffb server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.825+0000 7f309ffff700 1 -- 172.21.15.6:0/2787230829 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30a800b6e0 con 0x7f30ac071c60 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.825+0000 7f309ffff700 1 -- 172.21.15.6:0/2787230829 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f30a800bc90 con 0x7f30ac071c60 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.825+0000 7f309ffff700 1 -- 172.21.15.6:0/2787230829 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30a8011c70 con 0x7f30ac071c60 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.825+0000 7f30b393f700 1 -- 172.21.15.6:0/2787230829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 msgr2=0x7f30ac0ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.825+0000 7f30b393f700 1 --2- 172.21.15.6:0/2787230829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0ffc30 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f30a8009730 tx=0x7f30a80090f0).stop 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.825+0000 7f30b393f700 1 -- 172.21.15.6:0/2787230829 shutdown_connections 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.825+0000 7f30b393f700 1 --2- 172.21.15.6:0/2787230829 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0ffc30 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.825+0000 7f30b393f700 1 -- 172.21.15.6:0/2787230829 >> 172.21.15.6:0/2787230829 conn(0x7f30ac0f76f0 msgr2=0x7f30ac0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:06.829 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.826+0000 7f30b393f700 1 -- 172.21.15.6:0/2787230829 shutdown_connections 2024-03-12T16:01:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.826+0000 7f30b393f700 1 -- 172.21.15.6:0/2787230829 wait complete. 2024-03-12T16:01:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.826+0000 7f30b393f700 1 Processor -- start 2024-03-12T16:01:06.830 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.826+0000 7f30b393f700 1 -- start start 2024-03-12T16:01:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f30b393f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0fd6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f30b393f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30ac0fbb30 con 0x7f30ac071c60 2024-03-12T16:01:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f30b16db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0fd6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:06.831 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f30b16db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0fd6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53370/0 (socket says 172.21.15.6:53370) 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f30b16db700 1 -- 172.21.15.6:0/2816765395 learned_addr learned my addr 172.21.15.6:0/2816765395 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f30b16db700 1 -- 172.21.15.6:0/2816765395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30a8009370 con 0x7f30ac071c60 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f30b16db700 1 --2- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0fd6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f30a800c010 tx=0x7f30a80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f309e7fc700 1 -- 172.21.15.6:0/2816765395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30a801a610 con 0x7f30ac071c60 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30ac0fbcd0 con 0x7f30ac071c60 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f309e7fc700 1 -- 172.21.15.6:0/2816765395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f30a801abc0 con 0x7f30ac071c60 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f309e7fc700 1 -- 172.21.15.6:0/2816765395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30a8022a20 con 0x7f30ac071c60 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.827+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30ac0fc0e0 con 0x7f30ac071c60 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.828+0000 7f309e7fc700 1 -- 172.21.15.6:0/2816765395 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 4) v1 ==== 38621+0+0 (secure 0 0 0) 0x7f30a8022ce0 con 0x7f30ac071c60 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.828+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30ac046ce0 con 0x7f30ac071c60 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.828+0000 7f309e7fc700 1 --2- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f30980325c0 0x7f3098034a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.829+0000 7f309e7fc700 1 -- 172.21.15.6:0/2816765395 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f30a8044820 con 0x7f30ac071c60 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.829+0000 7f30b0eda700 1 --2- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f30980325c0 0x7f3098034a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:06.832 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.829+0000 7f30b0eda700 1 --2- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f30980325c0 0x7f3098034a80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f30a0009780 tx=0x7f30a0006cc0).ready entity=mgr.14100 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:06.835 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:06.833+0000 7f309e7fc700 1 -- 172.21.15.6:0/2816765395 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f30a80223b0 con 0x7f30ac071c60 2024-03-12T16:01:07.051 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.048+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "cephadm"} v 0) v1 -- 0x7f30ac105d50 con 0x7f30ac071c60 2024-03-12T16:01:07.103 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.101+0000 7f309e7fc700 1 -- 172.21.15.6:0/2816765395 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f30a8019390 con 0x7f30ac071c60 2024-03-12T16:01:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.102+0000 7f309e7fc700 1 -- 172.21.15.6:0/2816765395 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "cephadm"}]=0 v5) v1 ==== 86+0+0 (secure 0 0 0) 0x7f30a8006210 con 0x7f30ac071c60 2024-03-12T16:01:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.104+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f30980325c0 msgr2=0x7f3098034a80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.104+0000 7f30b393f700 1 --2- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f30980325c0 0x7f3098034a80 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f30a0009780 tx=0x7f30a0006cc0).stop 2024-03-12T16:01:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.104+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 msgr2=0x7f30ac0fd6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.104+0000 7f30b393f700 1 --2- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0fd6b0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f30a800c010 tx=0x7f30a80090f0).stop 2024-03-12T16:01:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.104+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 shutdown_connections 2024-03-12T16:01:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.104+0000 7f30b393f700 1 --2- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f30980325c0 0x7f3098034a80 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.104+0000 7f30b393f700 1 --2- 172.21.15.6:0/2816765395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30ac071c60 0x7f30ac0fd6b0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.104+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 >> 172.21.15.6:0/2816765395 conn(0x7f30ac0f76f0 msgr2=0x7f30ac0f9180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.105+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 shutdown_connections 2024-03-12T16:01:07.108 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:07.105+0000 7f30b393f700 1 -- 172.21.15.6:0/2816765395 wait complete. 2024-03-12T16:01:07.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:07.050613+0000 mon.smithi006 (mon.0) 26 : audit [INF] from='client.? 172.21.15.6:0/2816765395' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-03-12T16:01:08.325 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.319+0000 7f918b4b9700 1 Processor -- start 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.319+0000 7f918b4b9700 1 -- start start 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.319+0000 7f918b4b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.319+0000 7f918b4b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9184100160 con 0x7f9184071c20 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.320+0000 7f9189255700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.320+0000 7f9189255700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53394/0 (socket says 172.21.15.6:53394) 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.320+0000 7f9189255700 1 -- 172.21.15.6:0/4207027528 learned_addr learned my addr 172.21.15.6:0/4207027528 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.320+0000 7f9189255700 1 -- 172.21.15.6:0/4207027528 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f91841002a0 con 0x7f9184071c20 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.320+0000 7f9189255700 1 --2- 172.21.15.6:0/4207027528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840ffc70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9180009730 tx=0x7f91800090f0).ready entity=mon.0 client_cookie=e83f42df81857378 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.320+0000 7f917bfff700 1 -- 172.21.15.6:0/4207027528 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f918000b770 con 0x7f9184071c20 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.320+0000 7f917bfff700 1 -- 172.21.15.6:0/4207027528 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f918000bd20 con 0x7f9184071c20 2024-03-12T16:01:08.326 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.320+0000 7f917bfff700 1 -- 172.21.15.6:0/4207027528 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9180011cc0 con 0x7f9184071c20 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.321+0000 7f918b4b9700 1 -- 172.21.15.6:0/4207027528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 msgr2=0x7f91840ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.321+0000 7f918b4b9700 1 --2- 172.21.15.6:0/4207027528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840ffc70 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f9180009730 tx=0x7f91800090f0).stop 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.321+0000 7f918b4b9700 1 -- 172.21.15.6:0/4207027528 shutdown_connections 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.321+0000 7f918b4b9700 1 --2- 172.21.15.6:0/4207027528 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840ffc70 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.321+0000 7f918b4b9700 1 -- 172.21.15.6:0/4207027528 >> 172.21.15.6:0/4207027528 conn(0x7f91840f76f0 msgr2=0x7f91840f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.321+0000 7f918b4b9700 1 -- 172.21.15.6:0/4207027528 shutdown_connections 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.321+0000 7f918b4b9700 1 -- 172.21.15.6:0/4207027528 wait complete. 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.322+0000 7f918b4b9700 1 Processor -- start 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.322+0000 7f918b4b9700 1 -- start start 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.322+0000 7f918b4b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.322+0000 7f918b4b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f91840fbb70 con 0x7f9184071c20 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.322+0000 7f9189255700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.322+0000 7f9189255700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53402/0 (socket says 172.21.15.6:53402) 2024-03-12T16:01:08.327 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.322+0000 7f9189255700 1 -- 172.21.15.6:0/2038107547 learned_addr learned my addr 172.21.15.6:0/2038107547 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.322+0000 7f9189255700 1 -- 172.21.15.6:0/2038107547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9180009370 con 0x7f9184071c20 2024-03-12T16:01:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.322+0000 7f9189255700 1 --2- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840fd6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9180011630 tx=0x7f91800090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.323+0000 7f917a7fc700 1 -- 172.21.15.6:0/2038107547 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9180011400 con 0x7f9184071c20 2024-03-12T16:01:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.323+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f91840fbd10 con 0x7f9184071c20 2024-03-12T16:01:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.323+0000 7f917a7fc700 1 -- 172.21.15.6:0/2038107547 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f9180010e70 con 0x7f9184071c20 2024-03-12T16:01:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.323+0000 7f917a7fc700 1 -- 172.21.15.6:0/2038107547 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f918001ab90 con 0x7f9184071c20 2024-03-12T16:01:08.328 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.323+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f91840fc120 con 0x7f9184071c20 2024-03-12T16:01:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.324+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9184046ce0 con 0x7f9184071c20 2024-03-12T16:01:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.324+0000 7f917a7fc700 1 -- 172.21.15.6:0/2038107547 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f918001a400 con 0x7f9184071c20 2024-03-12T16:01:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.324+0000 7f917a7fc700 1 --2- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f91700325e0 0x7f9170034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.324+0000 7f917a7fc700 1 -- 172.21.15.6:0/2038107547 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7f91800447a0 con 0x7f9184071c20 2024-03-12T16:01:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.324+0000 7f9188a54700 1 -- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f91700325e0 msgr2=0x7f9170034aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/860696411 2024-03-12T16:01:08.329 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.325+0000 7f9188a54700 1 --2- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f91700325e0 0x7f9170034aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:01:08.331 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.329+0000 7f917a7fc700 1 -- 172.21.15.6:0/2038107547 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f918001a6b0 con 0x7f9184071c20 2024-03-12T16:01:08.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:07.103815+0000 mon.smithi006 (mon.0) 27 : audit [INF] from='client.? 172.21.15.6:0/2816765395' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-03-12T16:01:08.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:07.103870+0000 mon.smithi006 (mon.0) 28 : cluster [DBG] mgrmap e5: smithi006.kskdce(active, since 10s) 2024-03-12T16:01:08.528 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.526+0000 7f9188a54700 1 -- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f91700325e0 msgr2=0x7f9170034aa0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/860696411 2024-03-12T16:01:08.529 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.526+0000 7f9188a54700 1 --2- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f91700325e0 0x7f9170034aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-03-12T16:01:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.591+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f9184111de0 con 0x7f9184071c20 2024-03-12T16:01:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.592+0000 7f917a7fc700 1 -- 172.21.15.6:0/2038107547 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v5) v1 ==== 56+0+103 (secure 0 0 0) 0x7f918001e020 con 0x7f9184071c20 2024-03-12T16:01:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: { 2024-03-12T16:01:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 5, 2024-03-12T16:01:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "available": true, 2024-03-12T16:01:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "active_name": "smithi006.kskdce", 2024-03-12T16:01:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_standby": 0 2024-03-12T16:01:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: } 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.593+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f91700325e0 msgr2=0x7f9170034aa0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.593+0000 7f918b4b9700 1 --2- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f91700325e0 0x7f9170034aa0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.593+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 msgr2=0x7f91840fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.593+0000 7f918b4b9700 1 --2- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840fd6f0 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f9180011630 tx=0x7f91800090f0).stop 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.594+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 shutdown_connections 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.594+0000 7f918b4b9700 1 --2- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7f91700325e0 0x7f9170034aa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.594+0000 7f918b4b9700 1 --2- 172.21.15.6:0/2038107547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9184071c20 0x7f91840fd6f0 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.594+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 >> 172.21.15.6:0/2038107547 conn(0x7f91840f76f0 msgr2=0x7f91840f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.594+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 shutdown_connections 2024-03-12T16:01:08.597 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:08.594+0000 7f918b4b9700 1 -- 172.21.15.6:0/2038107547 wait complete. 2024-03-12T16:01:09.193 INFO:teuthology.orchestra.run.smithi006.stderr:Waiting for the mgr to restart... 2024-03-12T16:01:09.193 INFO:teuthology.orchestra.run.smithi006.stderr:Waiting for mgr epoch 5... 2024-03-12T16:01:09.359 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:08.593328+0000 mon.smithi006 (mon.0) 29 : audit [DBG] from='client.? 172.21.15.6:0/2038107547' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-12T16:01:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.687+0000 7fbdf2dfd700 1 Processor -- start 2024-03-12T16:01:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.687+0000 7fbdf2dfd700 1 -- start start 2024-03-12T16:01:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdf2dfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdf2dfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec100160 con 0x7fbdec071c20 2024-03-12T16:01:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdf0b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdf0b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53410/0 (socket says 172.21.15.6:53410) 2024-03-12T16:01:09.691 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdf0b99700 1 -- 172.21.15.6:0/1740868882 learned_addr learned my addr 172.21.15.6:0/1740868882 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdf0b99700 1 -- 172.21.15.6:0/1740868882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbdec1002a0 con 0x7fbdec071c20 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdf0b99700 1 --2- 172.21.15.6:0/1740868882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0ffc70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbde0009730 tx=0x7fbde00090f0).ready entity=mon.0 client_cookie=27785eff01689e7f server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdeb7fe700 1 -- 172.21.15.6:0/1740868882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbde000b770 con 0x7fbdec071c20 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdeb7fe700 1 -- 172.21.15.6:0/1740868882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbde000bd20 con 0x7fbdec071c20 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.688+0000 7fbdeb7fe700 1 -- 172.21.15.6:0/1740868882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbde0011cc0 con 0x7fbdec071c20 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.689+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/1740868882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 msgr2=0x7fbdec0ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.689+0000 7fbdf2dfd700 1 --2- 172.21.15.6:0/1740868882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0ffc70 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7fbde0009730 tx=0x7fbde00090f0).stop 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.689+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/1740868882 shutdown_connections 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.689+0000 7fbdf2dfd700 1 --2- 172.21.15.6:0/1740868882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0ffc70 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.689+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/1740868882 >> 172.21.15.6:0/1740868882 conn(0x7fbdec0f76f0 msgr2=0x7fbdec0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.689+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/1740868882 shutdown_connections 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.689+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/1740868882 wait complete. 2024-03-12T16:01:09.696 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.690+0000 7fbdf2dfd700 1 Processor -- start 2024-03-12T16:01:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.690+0000 7fbdf2dfd700 1 -- start start 2024-03-12T16:01:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.690+0000 7fbdf2dfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.690+0000 7fbdf2dfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbdec0fbb70 con 0x7fbdec071c20 2024-03-12T16:01:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.690+0000 7fbdf0b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.690+0000 7fbdf0b99700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53424/0 (socket says 172.21.15.6:53424) 2024-03-12T16:01:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.690+0000 7fbdf0b99700 1 -- 172.21.15.6:0/4234207772 learned_addr learned my addr 172.21.15.6:0/4234207772 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.690+0000 7fbdf0b99700 1 -- 172.21.15.6:0/4234207772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbde0009370 con 0x7fbdec071c20 2024-03-12T16:01:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.691+0000 7fbdf0b99700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0fd6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbde0011630 tx=0x7fbde00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:09.697 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.691+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbde0011ae0 con 0x7fbdec071c20 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.691+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fbde000be90 con 0x7fbdec071c20 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.691+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/4234207772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbdec0fbd10 con 0x7fbdec071c20 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.691+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbde001aaf0 con 0x7fbdec071c20 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.691+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/4234207772 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbdec0fc120 con 0x7fbdec071c20 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.692+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 5) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fbde0023400 con 0x7fbdec071c20 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.692+0000 7fbde9ffb700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 0x7fbddc034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.692+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 --> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbddc035190 con 0x7fbddc032610 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.692+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(1..1 src has 1..1) v4 ==== 721+0+0 (secure 0 0 0) 0x7fbde0044ba0 con 0x7fbdec071c20 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.692+0000 7fbdebfff700 1 -- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 msgr2=0x7fbddc034ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/860696411 2024-03-12T16:01:09.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.692+0000 7fbdebfff700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 0x7fbddc034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:01:09.895 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.893+0000 7fbdebfff700 1 -- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 msgr2=0x7fbddc034ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/860696411 2024-03-12T16:01:09.895 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:09.893+0000 7fbdebfff700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 0x7fbddc034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-03-12T16:01:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:10.294+0000 7fbdebfff700 1 -- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 msgr2=0x7fbddc034ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/860696411 2024-03-12T16:01:10.296 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:10.294+0000 7fbdebfff700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 0x7fbddc034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-03-12T16:01:11.097 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:11.095+0000 7fbdebfff700 1 -- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 msgr2=0x7fbddc034ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/860696411 2024-03-12T16:01:11.098 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:11.095+0000 7fbdebfff700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 0x7fbddc034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-03-12T16:01:12.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:12.696+0000 7fbdebfff700 1 -- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 msgr2=0x7fbddc034ad0 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/860696411 2024-03-12T16:01:12.698 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:12.696+0000 7fbdebfff700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 0x7fbddc034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 3.200000 2024-03-12T16:01:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:12.727+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 6) v1 ==== 38456+0+0 (secure 0 0 0) 0x7fbde0018d10 con 0x7fbdec071c20 2024-03-12T16:01:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:12.727+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 msgr2=0x7fbddc034ad0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:01:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:12.727+0000 7fbde9ffb700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 0x7fbddc034ad0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:01:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:12.726428+0000 mon.smithi006 (mon.0) 30 : cluster [INF] Active manager daemon smithi006.kskdce restarted 2024-03-12T16:01:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:12.726643+0000 mon.smithi006 (mon.0) 31 : cluster [INF] Activating manager daemon smithi006.kskdce 2024-03-12T16:01:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:12.729732+0000 mon.smithi006 (mon.0) 32 : cluster [DBG] osdmap e2: 0 total, 0 up, 0 in 2024-03-12T16:01:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:12.729833+0000 mon.smithi006 (mon.0) 33 : cluster [DBG] mgrmap e6: smithi006.kskdce(active, starting, since 0.00326697s) 2024-03-12T16:01:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.730809+0000 mon.smithi006 (mon.0) 34 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:01:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.731444+0000 mon.smithi006 (mon.0) 35 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:01:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.732310+0000 mon.smithi006 (mon.0) 36 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:01:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.732468+0000 mon.smithi006 (mon.0) 37 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:01:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.732609+0000 mon.smithi006 (mon.0) 38 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:01:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:12.746156+0000 mon.smithi006 (mon.0) 39 : cluster [INF] Manager daemon smithi006.kskdce is now available 2024-03-12T16:01:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.758804+0000 mon.smithi006 (mon.0) 40 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.728+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 7) v1 ==== 38526+0+0 (secure 0 0 0) 0x7fbde00464a0 con 0x7fbdec071c20 2024-03-12T16:01:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.728+0000 7fbde9ffb700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbddc035fd0 0x7fbddc0383c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.728+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbddc035190 con 0x7fbddc035fd0 2024-03-12T16:01:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.729+0000 7fbdebfff700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbddc035fd0 0x7fbddc0383c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:13.731 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.729+0000 7fbdebfff700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbddc035fd0 0x7fbddc0383c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fbdd8006fd0 tx=0x7fbdd8006e70).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:13.732 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.730+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7fbddc035190 con 0x7fbddc035fd0 2024-03-12T16:01:13.739 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.736+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/4234207772 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7fbdec05a310 con 0x7fbddc035fd0 2024-03-12T16:01:13.739 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbde9ffb700 1 -- 172.21.15.6:0/4234207772 <== mgr.14116 v2:172.21.15.6:6800/344339741 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+51 (secure 0 0 0) 0x7fbdec05a310 con 0x7fbddc035fd0 2024-03-12T16:01:13.739 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: { 2024-03-12T16:01:13.739 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-03-12T16:01:13.740 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "initialized": true 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: } 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbddc035fd0 msgr2=0x7fbddc0383c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbddc035fd0 0x7fbddc0383c0 secure :-1 s=READY pgs=1 cs=0 l=1 rev1=1 rx=0x7fbdd8006fd0 tx=0x7fbdd8006e70).stop 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 msgr2=0x7fbdec0fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0fd6f0 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fbde0011630 tx=0x7fbde00090f0).stop 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/4234207772 shutdown_connections 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbddc035fd0 0x7fbddc0383c0 unknown :-1 s=CLOSED pgs=1 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbdec071c20 0x7fbdec0fd6f0 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 --2- 172.21.15.6:0/4234207772 >> [v2:172.21.15.6:6800/860696411,v1:172.21.15.6:6801/860696411] conn(0x7fbddc032610 0x7fbddc034ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/4234207772 >> 172.21.15.6:0/4234207772 conn(0x7fbdec0f76f0 msgr2=0x7fbdec0f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/4234207772 shutdown_connections 2024-03-12T16:01:13.741 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:13.737+0000 7fbdf2dfd700 1 -- 172.21.15.6:0/4234207772 wait complete. 2024-03-12T16:01:14.082 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:12.756058+0000 mgr.smithi006.kskdce (mgr.14116) 1 : cephadm [INF] Found migration_current of "None". Setting to last migration. 2024-03-12T16:01:14.082 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.848541+0000 mon.smithi006 (mon.0) 41 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:14.083 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.849545+0000 mon.smithi006 (mon.0) 42 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:01:14.083 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.851118+0000 mon.smithi006 (mon.0) 43 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:01:14.083 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.853586+0000 mon.smithi006 (mon.0) 44 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:01:14.083 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.866916+0000 mon.smithi006 (mon.0) 45 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:01:14.083 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:12.870259+0000 mon.smithi006 (mon.0) 46 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:01:14.083 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:13.732375+0000 mon.smithi006 (mon.0) 47 : cluster [DBG] mgrmap e7: smithi006.kskdce(active, since 1.0058s) 2024-03-12T16:01:14.317 INFO:teuthology.orchestra.run.smithi006.stderr:mgr epoch 5 is available 2024-03-12T16:01:14.317 INFO:teuthology.orchestra.run.smithi006.stderr:Setting orchestrator backend to cephadm... 2024-03-12T16:01:14.912 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.885+0000 7fd3f2293700 1 Processor -- start 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.885+0000 7fd3f2293700 1 -- start start 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.885+0000 7fd3f2293700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec0ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.885+0000 7fd3f2293700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec100160 con 0x7fd3ec071c20 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.885+0000 7fd3ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec0ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.885+0000 7fd3ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec0ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38614/0 (socket says 172.21.15.6:38614) 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.885+0000 7fd3ebfff700 1 -- 172.21.15.6:0/3123478900 learned_addr learned my addr 172.21.15.6:0/3123478900 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.885+0000 7fd3ebfff700 1 -- 172.21.15.6:0/3123478900 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3ec1002a0 con 0x7fd3ec071c20 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.885+0000 7fd3ebfff700 1 --2- 172.21.15.6:0/3123478900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec0ffc70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd3dc009730 tx=0x7fd3dc0090f0).ready entity=mon.0 client_cookie=37af4155c718a147 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3eaffd700 1 -- 172.21.15.6:0/3123478900 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3dc00b770 con 0x7fd3ec071c20 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3eaffd700 1 -- 172.21.15.6:0/3123478900 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fd3dc00bd20 con 0x7fd3ec071c20 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3eaffd700 1 -- 172.21.15.6:0/3123478900 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3dc011cc0 con 0x7fd3ec071c20 2024-03-12T16:01:14.913 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3f2293700 1 -- 172.21.15.6:0/3123478900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 msgr2=0x7fd3ec0ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3f2293700 1 --2- 172.21.15.6:0/3123478900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec0ffc70 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fd3dc009730 tx=0x7fd3dc0090f0).stop 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3f2293700 1 -- 172.21.15.6:0/3123478900 shutdown_connections 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3f2293700 1 --2- 172.21.15.6:0/3123478900 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec0ffc70 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3f2293700 1 -- 172.21.15.6:0/3123478900 >> 172.21.15.6:0/3123478900 conn(0x7fd3ec0f76f0 msgr2=0x7fd3ec0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3f2293700 1 -- 172.21.15.6:0/3123478900 shutdown_connections 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.886+0000 7fd3f2293700 1 -- 172.21.15.6:0/3123478900 wait complete. 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.887+0000 7fd3f2293700 1 Processor -- start 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.887+0000 7fd3f2293700 1 -- start start 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.887+0000 7fd3f2293700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec10be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.887+0000 7fd3f2293700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3ec10c300 con 0x7fd3ec071c20 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec10be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec10be10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38616/0 (socket says 172.21.15.6:38616) 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3ebfff700 1 -- 172.21.15.6:0/1104242142 learned_addr learned my addr 172.21.15.6:0/1104242142 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:14.914 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3ebfff700 1 -- 172.21.15.6:0/1104242142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3dc009370 con 0x7fd3ec071c20 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3ebfff700 1 --2- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec10be10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd3dc011630 tx=0x7fd3dc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3e9775700 1 -- 172.21.15.6:0/1104242142 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3dc011ae0 con 0x7fd3ec071c20 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3e9775700 1 -- 172.21.15.6:0/1104242142 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fd3dc00be90 con 0x7fd3ec071c20 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3ec10c500 con 0x7fd3ec071c20 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3e9775700 1 -- 172.21.15.6:0/1104242142 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd3dc01aaf0 con 0x7fd3ec071c20 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.888+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3ec10c910 con 0x7fd3ec071c20 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.889+0000 7fd3e9775700 1 -- 172.21.15.6:0/1104242142 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fd3dc010af0 con 0x7fd3ec071c20 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.889+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3ec046ce0 con 0x7fd3ec071c20 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.889+0000 7fd3e9775700 1 --2- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd3d4032610 0x7fd3d4034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.889+0000 7fd3e9775700 1 -- 172.21.15.6:0/1104242142 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fd3dc044f70 con 0x7fd3ec071c20 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.890+0000 7fd3eb7fe700 1 --2- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd3d4032610 0x7fd3d4034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.890+0000 7fd3eb7fe700 1 --2- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd3d4032610 0x7fd3d4034ad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd3e0009780 tx=0x7fd3e0006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:14.915 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:14.894+0000 7fd3e9775700 1 -- 172.21.15.6:0/1104242142 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd3dc018970 con 0x7fd3ec071c20 2024-03-12T16:01:15.081 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.078+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}) v1 -- 0x7fd3ec10d110 con 0x7fd3d4032610 2024-03-12T16:01:15.088 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.086+0000 7fd3e9775700 1 -- 172.21.15.6:0/1104242142 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fd3ec10d110 con 0x7fd3d4032610 2024-03-12T16:01:15.091 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.088+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd3d4032610 msgr2=0x7fd3d4034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:15.091 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.088+0000 7fd3f2293700 1 --2- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd3d4032610 0x7fd3d4034ad0 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fd3e0009780 tx=0x7fd3e0006cc0).stop 2024-03-12T16:01:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.088+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 msgr2=0x7fd3ec10be10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.088+0000 7fd3f2293700 1 --2- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec10be10 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fd3dc011630 tx=0x7fd3dc0090f0).stop 2024-03-12T16:01:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.088+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 shutdown_connections 2024-03-12T16:01:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.088+0000 7fd3f2293700 1 --2- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd3d4032610 0x7fd3d4034ad0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.088+0000 7fd3f2293700 1 --2- 172.21.15.6:0/1104242142 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3ec071c20 0x7fd3ec10be10 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.088+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 >> 172.21.15.6:0/1104242142 conn(0x7fd3ec0f76f0 msgr2=0x7fd3ec0f91d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.089+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 shutdown_connections 2024-03-12T16:01:15.092 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:15.089+0000 7fd3f2293700 1 -- 172.21.15.6:0/1104242142 wait complete. 2024-03-12T16:01:15.114 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:13.731563+0000 mgr.smithi006.kskdce (mgr.14116) 2 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-12T16:01:15.114 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:13.738509+0000 mgr.smithi006.kskdce (mgr.14116) 3 : audit [DBG] from='client.14120 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-12T16:01:16.040 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:14.851014+0000 mon.smithi006 (mon.0) 48 : cluster [DBG] mgrmap e8: smithi006.kskdce(active, since 2s) 2024-03-12T16:01:16.040 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:15.081053+0000 mgr.smithi006.kskdce (mgr.14116) 4 : audit [DBG] from='client.14126 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:16.040 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:15.087625+0000 mon.smithi006 (mon.0) 49 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:16.040 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:15.127712+0000 mon.smithi006 (mon.0) 50 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:01:16.332 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.326+0000 7f0337183700 1 Processor -- start 2024-03-12T16:01:16.332 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.327+0000 7f0337183700 1 -- start start 2024-03-12T16:01:16.332 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.327+0000 7f0337183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f03300ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.327+0000 7f0337183700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0330100120 con 0x7f0330071c60 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.327+0000 7f0334f1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f03300ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.327+0000 7f0334f1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f03300ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38628/0 (socket says 172.21.15.6:38628) 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.327+0000 7f0334f1f700 1 -- 172.21.15.6:0/3034582360 learned_addr learned my addr 172.21.15.6:0/3034582360 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.327+0000 7f0334f1f700 1 -- 172.21.15.6:0/3034582360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0330100260 con 0x7f0330071c60 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.327+0000 7f0334f1f700 1 --2- 172.21.15.6:0/3034582360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f03300ffc30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0324009730 tx=0x7f03240090f0).ready entity=mon.0 client_cookie=3261ef6f2dd5ba10 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f032f7fe700 1 -- 172.21.15.6:0/3034582360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f032400b6e0 con 0x7f0330071c60 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f032f7fe700 1 -- 172.21.15.6:0/3034582360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f032400bc90 con 0x7f0330071c60 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f032f7fe700 1 -- 172.21.15.6:0/3034582360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0324011c70 con 0x7f0330071c60 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f0337183700 1 -- 172.21.15.6:0/3034582360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 msgr2=0x7f03300ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f0337183700 1 --2- 172.21.15.6:0/3034582360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f03300ffc30 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f0324009730 tx=0x7f03240090f0).stop 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f0337183700 1 -- 172.21.15.6:0/3034582360 shutdown_connections 2024-03-12T16:01:16.333 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f0337183700 1 --2- 172.21.15.6:0/3034582360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f03300ffc30 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f0337183700 1 -- 172.21.15.6:0/3034582360 >> 172.21.15.6:0/3034582360 conn(0x7f03300f76f0 msgr2=0x7f03300f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f0337183700 1 -- 172.21.15.6:0/3034582360 shutdown_connections 2024-03-12T16:01:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.328+0000 7f0337183700 1 -- 172.21.15.6:0/3034582360 wait complete. 2024-03-12T16:01:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.329+0000 7f0337183700 1 Processor -- start 2024-03-12T16:01:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.329+0000 7f0337183700 1 -- start start 2024-03-12T16:01:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.329+0000 7f0337183700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f033010be00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.329+0000 7f0337183700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f033010c2f0 con 0x7f0330071c60 2024-03-12T16:01:16.334 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.329+0000 7f0334f1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f033010be00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.329+0000 7f0334f1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f033010be00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38638/0 (socket says 172.21.15.6:38638) 2024-03-12T16:01:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.329+0000 7f0334f1f700 1 -- 172.21.15.6:0/3410952103 learned_addr learned my addr 172.21.15.6:0/3410952103 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.329+0000 7f0334f1f700 1 -- 172.21.15.6:0/3410952103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0324009370 con 0x7f0330071c60 2024-03-12T16:01:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.330+0000 7f0334f1f700 1 --2- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f033010be00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f032400c010 tx=0x7f03240090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.330+0000 7f032dffb700 1 -- 172.21.15.6:0/3410952103 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f032401a610 con 0x7f0330071c60 2024-03-12T16:01:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.330+0000 7f032dffb700 1 -- 172.21.15.6:0/3410952103 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f032401abc0 con 0x7f0330071c60 2024-03-12T16:01:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.330+0000 7f032dffb700 1 -- 172.21.15.6:0/3410952103 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0324022a20 con 0x7f0330071c60 2024-03-12T16:01:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.330+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f033010c4f0 con 0x7f0330071c60 2024-03-12T16:01:16.335 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.330+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f033010c900 con 0x7f0330071c60 2024-03-12T16:01:16.336 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.331+0000 7f032dffb700 1 -- 172.21.15.6:0/3410952103 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f0324022ce0 con 0x7f0330071c60 2024-03-12T16:01:16.336 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.331+0000 7f032dffb700 1 --2- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0320032610 0x7f0320034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:16.336 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.331+0000 7f032dffb700 1 -- 172.21.15.6:0/3410952103 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f0324044c60 con 0x7f0330071c60 2024-03-12T16:01:16.336 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.331+0000 7f032ffff700 1 --2- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0320032610 0x7f0320034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:16.337 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.331+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0330046ce0 con 0x7f0330071c60 2024-03-12T16:01:16.337 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.332+0000 7f032ffff700 1 --2- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0320032610 0x7f0320034ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f031c009780 tx=0x7f031c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:16.338 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.336+0000 7f032dffb700 1 -- 172.21.15.6:0/3410952103 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f032401a770 con 0x7f0330071c60 2024-03-12T16:01:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.508+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}) v1 -- 0x7f0330105ca0 con 0x7f0320032610 2024-03-12T16:01:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.509+0000 7f032dffb700 1 -- 172.21.15.6:0/3410952103 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+16 (secure 0 0 0) 0x7f0330105ca0 con 0x7f0320032610 2024-03-12T16:01:16.511 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: value unchanged 2024-03-12T16:01:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0320032610 msgr2=0x7f0320034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 --2- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0320032610 0x7f0320034ad0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f031c009780 tx=0x7f031c006cc0).stop 2024-03-12T16:01:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 msgr2=0x7f033010be00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 --2- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f033010be00 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f032400c010 tx=0x7f03240090f0).stop 2024-03-12T16:01:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 shutdown_connections 2024-03-12T16:01:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 --2- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0320032610 0x7f0320034ad0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:16.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 --2- 172.21.15.6:0/3410952103 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0330071c60 0x7f033010be00 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 >> 172.21.15.6:0/3410952103 conn(0x7f03300f76f0 msgr2=0x7f03300f9130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 shutdown_connections 2024-03-12T16:01:16.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:16.511+0000 7f0337183700 1 -- 172.21.15.6:0/3410952103 wait complete. 2024-03-12T16:01:17.047 INFO:teuthology.orchestra.run.smithi006.stderr:Generating ssh key... 2024-03-12T16:01:17.332 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:16.510820+0000 mgr.smithi006.kskdce (mgr.14116) 5 : audit [DBG] from='client.14128 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.605+0000 7f1bda179700 1 Processor -- start 2024-03-12T16:01:17.609 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.605+0000 7f1bda179700 1 -- start start 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.605+0000 7f1bda179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd40ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.605+0000 7f1bda179700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd4100160 con 0x7f1bd4071c20 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.606+0000 7f1bd37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd40ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.606+0000 7f1bd37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd40ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38640/0 (socket says 172.21.15.6:38640) 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.606+0000 7f1bd37fe700 1 -- 172.21.15.6:0/1774283383 learned_addr learned my addr 172.21.15.6:0/1774283383 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.606+0000 7f1bd37fe700 1 -- 172.21.15.6:0/1774283383 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bd41002a0 con 0x7f1bd4071c20 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.606+0000 7f1bd37fe700 1 --2- 172.21.15.6:0/1774283383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd40ffc70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1bbc009730 tx=0x7f1bbc0090f0).ready entity=mon.0 client_cookie=8dcb85cf224ff7d3 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.606+0000 7f1bd27fc700 1 -- 172.21.15.6:0/1774283383 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bbc00b770 con 0x7f1bd4071c20 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.606+0000 7f1bd27fc700 1 -- 172.21.15.6:0/1774283383 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1bbc00bd20 con 0x7f1bd4071c20 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.606+0000 7f1bd27fc700 1 -- 172.21.15.6:0/1774283383 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bbc011cc0 con 0x7f1bd4071c20 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.607+0000 7f1bda179700 1 -- 172.21.15.6:0/1774283383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 msgr2=0x7f1bd40ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.607+0000 7f1bda179700 1 --2- 172.21.15.6:0/1774283383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd40ffc70 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f1bbc009730 tx=0x7f1bbc0090f0).stop 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.607+0000 7f1bda179700 1 -- 172.21.15.6:0/1774283383 shutdown_connections 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.607+0000 7f1bda179700 1 --2- 172.21.15.6:0/1774283383 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd40ffc70 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:17.610 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.607+0000 7f1bda179700 1 -- 172.21.15.6:0/1774283383 >> 172.21.15.6:0/1774283383 conn(0x7f1bd40f76f0 msgr2=0x7f1bd40f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.607+0000 7f1bda179700 1 -- 172.21.15.6:0/1774283383 shutdown_connections 2024-03-12T16:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.607+0000 7f1bda179700 1 -- 172.21.15.6:0/1774283383 wait complete. 2024-03-12T16:01:17.611 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.607+0000 7f1bda179700 1 Processor -- start 2024-03-12T16:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.608+0000 7f1bda179700 1 -- start start 2024-03-12T16:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.608+0000 7f1bda179700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd410be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.608+0000 7f1bda179700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1bd410c320 con 0x7f1bd4071c20 2024-03-12T16:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.608+0000 7f1bd37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd410be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.608+0000 7f1bd37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd410be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38648/0 (socket says 172.21.15.6:38648) 2024-03-12T16:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.608+0000 7f1bd37fe700 1 -- 172.21.15.6:0/1596389116 learned_addr learned my addr 172.21.15.6:0/1596389116 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.608+0000 7f1bd37fe700 1 -- 172.21.15.6:0/1596389116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bbc009370 con 0x7f1bd4071c20 2024-03-12T16:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.608+0000 7f1bd37fe700 1 --2- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd410be30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1bbc011630 tx=0x7f1bbc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:17.612 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.609+0000 7f1bd0ff9700 1 -- 172.21.15.6:0/1596389116 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bbc011ae0 con 0x7f1bd4071c20 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.609+0000 7f1bd0ff9700 1 -- 172.21.15.6:0/1596389116 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f1bbc00be90 con 0x7f1bd4071c20 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.609+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1bd410c520 con 0x7f1bd4071c20 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.609+0000 7f1bd0ff9700 1 -- 172.21.15.6:0/1596389116 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f1bbc01aaf0 con 0x7f1bd4071c20 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.609+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1bd410c930 con 0x7f1bd4071c20 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.609+0000 7f1bd0ff9700 1 -- 172.21.15.6:0/1596389116 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f1bbc023400 con 0x7f1bd4071c20 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.610+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1bd4046ce0 con 0x7f1bd4071c20 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.610+0000 7f1bd0ff9700 1 --2- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f1bc0032660 0x7f1bc0034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.610+0000 7f1bd0ff9700 1 -- 172.21.15.6:0/1596389116 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f1bbc010af0 con 0x7f1bd4071c20 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.610+0000 7f1bd2ffd700 1 --2- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f1bc0032660 0x7f1bc0034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:17.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.610+0000 7f1bd2ffd700 1 --2- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f1bc0032660 0x7f1bc0034b20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1bc4009780 tx=0x7f1bc4006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:17.616 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.614+0000 7f1bd0ff9700 1 -- 172.21.15.6:0/1596389116 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1bbc021310 con 0x7f1bd4071c20 2024-03-12T16:01:17.789 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:17.787+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f1bd410d130 con 0x7f1bc0032660 2024-03-12T16:01:18.041 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.038+0000 7f1bd0ff9700 1 -- 172.21.15.6:0/1596389116 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f1bd410d130 con 0x7f1bc0032660 2024-03-12T16:01:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f1bc0032660 msgr2=0x7f1bc0034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 --2- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f1bc0032660 0x7f1bc0034b20 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f1bc4009780 tx=0x7f1bc4006cc0).stop 2024-03-12T16:01:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 msgr2=0x7f1bd410be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 --2- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd410be30 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f1bbc011630 tx=0x7f1bbc0090f0).stop 2024-03-12T16:01:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 shutdown_connections 2024-03-12T16:01:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 --2- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f1bc0032660 0x7f1bc0034b20 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:18.043 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 --2- 172.21.15.6:0/1596389116 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1bd4071c20 0x7f1bd410be30 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 >> 172.21.15.6:0/1596389116 conn(0x7f1bd40f76f0 msgr2=0x7f1bd40f9120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 shutdown_connections 2024-03-12T16:01:18.044 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:18.040+0000 7f1bda179700 1 -- 172.21.15.6:0/1596389116 wait complete. 2024-03-12T16:01:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.220+0000 7f31036af700 1 Processor -- start 2024-03-12T16:01:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.220+0000 7f31036af700 1 -- start start 2024-03-12T16:01:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.220+0000 7f31036af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc0ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:19.228 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.220+0000 7f31036af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc100180 con 0x7f30fc071c00 2024-03-12T16:01:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.220+0000 7f310144b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc0ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.220+0000 7f310144b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc0ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38664/0 (socket says 172.21.15.6:38664) 2024-03-12T16:01:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.220+0000 7f310144b700 1 -- 172.21.15.6:0/900846181 learned_addr learned my addr 172.21.15.6:0/900846181 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.221+0000 7f310144b700 1 -- 172.21.15.6:0/900846181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30fc1002c0 con 0x7f30fc071c00 2024-03-12T16:01:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.221+0000 7f310144b700 1 --2- 172.21.15.6:0/900846181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc0ffc90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f30f8009730 tx=0x7f30f80090f0).ready entity=mon.0 client_cookie=f54e646f0611a2d8 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.221+0000 7f30f3fff700 1 -- 172.21.15.6:0/900846181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f800b6e0 con 0x7f30fc071c00 2024-03-12T16:01:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.221+0000 7f30f3fff700 1 -- 172.21.15.6:0/900846181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f30f800bc90 con 0x7f30fc071c00 2024-03-12T16:01:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.221+0000 7f30f3fff700 1 -- 172.21.15.6:0/900846181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f8011c70 con 0x7f30fc071c00 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.222+0000 7f31036af700 1 -- 172.21.15.6:0/900846181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 msgr2=0x7f30fc0ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.222+0000 7f31036af700 1 --2- 172.21.15.6:0/900846181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc0ffc90 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f30f8009730 tx=0x7f30f80090f0).stop 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.222+0000 7f31036af700 1 -- 172.21.15.6:0/900846181 shutdown_connections 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.222+0000 7f31036af700 1 --2- 172.21.15.6:0/900846181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc0ffc90 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.222+0000 7f31036af700 1 -- 172.21.15.6:0/900846181 >> 172.21.15.6:0/900846181 conn(0x7f30fc0f76f0 msgr2=0x7f30fc0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.222+0000 7f31036af700 1 -- 172.21.15.6:0/900846181 shutdown_connections 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.222+0000 7f31036af700 1 -- 172.21.15.6:0/900846181 wait complete. 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.222+0000 7f31036af700 1 Processor -- start 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.222+0000 7f31036af700 1 -- start start 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f31036af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc10be50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f31036af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30fc10c340 con 0x7f30fc071c00 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f310144b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc10be50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f310144b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc10be50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38674/0 (socket says 172.21.15.6:38674) 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f310144b700 1 -- 172.21.15.6:0/615505329 learned_addr learned my addr 172.21.15.6:0/615505329 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f310144b700 1 -- 172.21.15.6:0/615505329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f8009370 con 0x7f30fc071c00 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f310144b700 1 --2- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc10be50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f30f8009330 tx=0x7f30f80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f30f27fc700 1 -- 172.21.15.6:0/615505329 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f801a610 con 0x7f30fc071c00 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f30f27fc700 1 -- 172.21.15.6:0/615505329 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f30f801abc0 con 0x7f30fc071c00 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30fc10c540 con 0x7f30fc071c00 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f30f27fc700 1 -- 172.21.15.6:0/615505329 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f30f8022a30 con 0x7f30fc071c00 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.223+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30fc10c950 con 0x7f30fc071c00 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.224+0000 7f30f27fc700 1 -- 172.21.15.6:0/615505329 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f30f8022c60 con 0x7f30fc071c00 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.224+0000 7f30f27fc700 1 --2- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f30e8032630 0x7f30e8034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.224+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30fc046ce0 con 0x7f30fc071c00 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.225+0000 7f30f27fc700 1 -- 172.21.15.6:0/615505329 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f30f8044ba0 con 0x7f30fc071c00 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.225+0000 7f3100c4a700 1 --2- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f30e8032630 0x7f30e8034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:19.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.225+0000 7f3100c4a700 1 --2- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f30e8032630 0x7f30e8034af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f30ec009780 tx=0x7f30ec006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:19.232 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.229+0000 7f30f27fc700 1 -- 172.21.15.6:0/615505329 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f30f8018970 con 0x7f30fc071c00 2024-03-12T16:01:19.406 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.404+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}) v1 -- 0x7f30fc10d210 con 0x7f30e8032630 2024-03-12T16:01:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.404+0000 7f30f27fc700 1 -- 172.21.15.6:0/615505329 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+595 (secure 0 0 0) 0x7f30fc10d210 con 0x7f30e8032630 2024-03-12T16:01:19.407 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyz1mgOQdoSFuhZB5fCw9R9WeOrznF+N6kc083aLiGim1QzJNN/zx5VpKBEo5GA44ULHQsNfYhiyh/gKExJizS+rXhCi23X0Ozh/D5bNv+HfNp47I4XJjC141uSS2zr7+uCnrBMT4USiGiSJPiexi33eKq2i4WENl5PRr2QrNk1q1uALyE9MJL3BRAtndcs7cT6zSL4G0the0nO9B10Hi7HKWBKMgUoBZY2yVhqRO1CQiRE8BYFG26WkwYZv4kJS3t19L7ZPQocNDhxNkHSTp/UgKK/fMvtcuuqpjo9J+dB6m4tOJ2ElSg9rhE8fBcVTr6d4QmTddBsLLOJY9dT7PRWLFuMvWl2wF7GGkXPigjdXD7+6XOr5/9k0EFTkVJdIhcJ8IDfdJXTdt2nhfQA+yf1Wt3m3EvyIctvsLe6WPj0LMVIJiNZfOwPWU3Bg7TyW7nZSkYWVrGYhYpbe71F+NEV2w++2KhYUe5sUvI2K8O6TeYY/F6lYzHpRtPbvv8P4c= ceph-88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:01:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.406+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f30e8032630 msgr2=0x7f30e8034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.406+0000 7f31036af700 1 --2- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f30e8032630 0x7f30e8034af0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f30ec009780 tx=0x7f30ec006cc0).stop 2024-03-12T16:01:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.406+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 msgr2=0x7f30fc10be50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.406+0000 7f31036af700 1 --2- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc10be50 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f30f8009330 tx=0x7f30f80090f0).stop 2024-03-12T16:01:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.406+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 shutdown_connections 2024-03-12T16:01:19.409 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.406+0000 7f31036af700 1 --2- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f30e8032630 0x7f30e8034af0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.406+0000 7f31036af700 1 --2- 172.21.15.6:0/615505329 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30fc071c00 0x7f30fc10be50 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.406+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 >> 172.21.15.6:0/615505329 conn(0x7f30fc0f76f0 msgr2=0x7f30fc0f91b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.406+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 shutdown_connections 2024-03-12T16:01:19.410 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:19.407+0000 7f31036af700 1 -- 172.21.15.6:0/615505329 wait complete. 2024-03-12T16:01:19.428 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:17.789571+0000 mgr.smithi006.kskdce (mgr.14116) 6 : audit [DBG] from='client.14130 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:19.429 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:17.789769+0000 mgr.smithi006.kskdce (mgr.14116) 7 : cephadm [INF] Generating ssh key... 2024-03-12T16:01:19.429 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:18.037691+0000 mon.smithi006 (mon.0) 51 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:19.429 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:18.039424+0000 mon.smithi006 (mon.0) 52 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:20.037 INFO:teuthology.orchestra.run.smithi006.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-03-12T16:01:20.037 INFO:teuthology.orchestra.run.smithi006.stderr:Adding key to root@localhost authorized_keys... 2024-03-12T16:01:20.038 INFO:teuthology.orchestra.run.smithi006.stderr:Adding host smithi006... 2024-03-12T16:01:20.293 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:19.406143+0000 mgr.smithi006.kskdce (mgr.14116) 8 : audit [DBG] from='client.14132 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.569+0000 7f578eed3700 1 Processor -- start 2024-03-12T16:01:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.569+0000 7f578eed3700 1 -- start start 2024-03-12T16:01:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.570+0000 7f578eed3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fe9c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.570+0000 7f578eed3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57880feeb0 con 0x7f57880fe5a0 2024-03-12T16:01:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.570+0000 7f578cc6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fe9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:20.573 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.570+0000 7f578cc6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fe9c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38680/0 (socket says 172.21.15.6:38680) 2024-03-12T16:01:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.570+0000 7f578cc6f700 1 -- 172.21.15.6:0/424893128 learned_addr learned my addr 172.21.15.6:0/424893128 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.570+0000 7f578cc6f700 1 -- 172.21.15.6:0/424893128 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f57880feff0 con 0x7f57880fe5a0 2024-03-12T16:01:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.570+0000 7f578cc6f700 1 --2- 172.21.15.6:0/424893128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fe9c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f577c009730 tx=0x7f577c0090f0).ready entity=mon.0 client_cookie=b8cb1f715bd0f60d server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f57877fe700 1 -- 172.21.15.6:0/424893128 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f577c00b6e0 con 0x7f57880fe5a0 2024-03-12T16:01:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f57877fe700 1 -- 172.21.15.6:0/424893128 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f577c00bc90 con 0x7f57880fe5a0 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f57877fe700 1 -- 172.21.15.6:0/424893128 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f577c011c70 con 0x7f57880fe5a0 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f578eed3700 1 -- 172.21.15.6:0/424893128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 msgr2=0x7f57880fe9c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f578eed3700 1 --2- 172.21.15.6:0/424893128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fe9c0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f577c009730 tx=0x7f577c0090f0).stop 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f578eed3700 1 -- 172.21.15.6:0/424893128 shutdown_connections 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f578eed3700 1 --2- 172.21.15.6:0/424893128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fe9c0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f578eed3700 1 -- 172.21.15.6:0/424893128 >> 172.21.15.6:0/424893128 conn(0x7f57880f6e20 msgr2=0x7f57880f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f578eed3700 1 -- 172.21.15.6:0/424893128 shutdown_connections 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.571+0000 7f578eed3700 1 -- 172.21.15.6:0/424893128 wait complete. 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.572+0000 7f578eed3700 1 Processor -- start 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.572+0000 7f578eed3700 1 -- start start 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.572+0000 7f578eed3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fde70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.572+0000 7f578eed3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f57880fc2f0 con 0x7f57880fe5a0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.572+0000 7f578cc6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fde70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.572+0000 7f578cc6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fde70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38686/0 (socket says 172.21.15.6:38686) 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.572+0000 7f578cc6f700 1 -- 172.21.15.6:0/1222427054 learned_addr learned my addr 172.21.15.6:0/1222427054 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.572+0000 7f578cc6f700 1 -- 172.21.15.6:0/1222427054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f577c009370 con 0x7f57880fe5a0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.573+0000 7f578cc6f700 1 --2- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fde70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f577c002f40 tx=0x7f577c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.573+0000 7f5785ffb700 1 -- 172.21.15.6:0/1222427054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f577c01a610 con 0x7f57880fe5a0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.573+0000 7f5785ffb700 1 -- 172.21.15.6:0/1222427054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7f577c01abc0 con 0x7f57880fe5a0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.573+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f57880fc490 con 0x7f57880fe5a0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.573+0000 7f5785ffb700 1 -- 172.21.15.6:0/1222427054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f577c0229d0 con 0x7f57880fe5a0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.573+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f57880fc8a0 con 0x7f57880fe5a0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.574+0000 7f5785ffb700 1 -- 172.21.15.6:0/1222427054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f577c022c90 con 0x7f57880fe5a0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.574+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5788046ce0 con 0x7f57880fe5a0 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.574+0000 7f5785ffb700 1 --2- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5778032610 0x7f5778034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.574+0000 7f5785ffb700 1 -- 172.21.15.6:0/1222427054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f577c044eb0 con 0x7f57880fe5a0 2024-03-12T16:01:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.574+0000 7f5787fff700 1 --2- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5778032610 0x7f5778034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.575+0000 7f5787fff700 1 --2- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5778032610 0x7f5778034ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f5774009780 tx=0x7f5774006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:20.580 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.579+0000 7f5785ffb700 1 -- 172.21.15.6:0/1222427054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f577c018970 con 0x7f57880fe5a0 2024-03-12T16:01:20.757 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:20.755+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}) v1 -- 0x7f5788105860 con 0x7f5778032610 2024-03-12T16:01:21.384 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: Added host 'smithi006' with addr '172.21.15.6' 2024-03-12T16:01:21.384 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.381+0000 7f5785ffb700 1 -- 172.21.15.6:0/1222427054 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+47 (secure 0 0 0) 0x7f5788105860 con 0x7f5778032610 2024-03-12T16:01:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.383+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5778032610 msgr2=0x7f5778034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.383+0000 7f578eed3700 1 --2- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5778032610 0x7f5778034ad0 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7f5774009780 tx=0x7f5774006cc0).stop 2024-03-12T16:01:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.383+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 msgr2=0x7f57880fde70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.383+0000 7f578eed3700 1 --2- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fde70 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f577c002f40 tx=0x7f577c0090f0).stop 2024-03-12T16:01:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.383+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 shutdown_connections 2024-03-12T16:01:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.383+0000 7f578eed3700 1 --2- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5778032610 0x7f5778034ad0 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.383+0000 7f578eed3700 1 --2- 172.21.15.6:0/1222427054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57880fe5a0 0x7f57880fde70 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.383+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 >> 172.21.15.6:0/1222427054 conn(0x7f57880f6e20 msgr2=0x7f5788100460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.384+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 shutdown_connections 2024-03-12T16:01:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:21.384+0000 7f578eed3700 1 -- 172.21.15.6:0/1222427054 wait complete. 2024-03-12T16:01:21.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:20.757447+0000 mgr.smithi006.kskdce (mgr.14116) 9 : audit [DBG] from='client.14134 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi006", "addr": "172.21.15.6", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:22.035 INFO:teuthology.orchestra.run.smithi006.stderr:Deploying mon service with default placement... 2024-03-12T16:01:22.599 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.582+0000 7fb41e0f9700 1 Processor -- start 2024-03-12T16:01:22.599 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.582+0000 7fb41e0f9700 1 -- start start 2024-03-12T16:01:22.599 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.582+0000 7fb41e0f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fe9a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:22.599 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.582+0000 7fb41e0f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180fee90 con 0x7fb4180fe580 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.582+0000 7fb4177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fe9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.582+0000 7fb4177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fe9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34554/0 (socket says 172.21.15.6:34554) 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.582+0000 7fb4177fe700 1 -- 172.21.15.6:0/2439747033 learned_addr learned my addr 172.21.15.6:0/2439747033 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.582+0000 7fb4177fe700 1 -- 172.21.15.6:0/2439747033 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb4180fefd0 con 0x7fb4180fe580 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb4177fe700 1 --2- 172.21.15.6:0/2439747033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fe9a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb408009730 tx=0x7fb4080090f0).ready entity=mon.0 client_cookie=12146f9d2f05ee94 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb4167fc700 1 -- 172.21.15.6:0/2439747033 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb40800b6e0 con 0x7fb4180fe580 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb4167fc700 1 -- 172.21.15.6:0/2439747033 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb40800bc90 con 0x7fb4180fe580 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb4167fc700 1 -- 172.21.15.6:0/2439747033 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb408011c70 con 0x7fb4180fe580 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb41e0f9700 1 -- 172.21.15.6:0/2439747033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 msgr2=0x7fb4180fe9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb41e0f9700 1 --2- 172.21.15.6:0/2439747033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fe9a0 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fb408009730 tx=0x7fb4080090f0).stop 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb41e0f9700 1 -- 172.21.15.6:0/2439747033 shutdown_connections 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb41e0f9700 1 --2- 172.21.15.6:0/2439747033 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fe9a0 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:22.600 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb41e0f9700 1 -- 172.21.15.6:0/2439747033 >> 172.21.15.6:0/2439747033 conn(0x7fb4180f6e20 msgr2=0x7fb4180f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:22.601 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb41e0f9700 1 -- 172.21.15.6:0/2439747033 shutdown_connections 2024-03-12T16:01:22.601 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.583+0000 7fb41e0f9700 1 -- 172.21.15.6:0/2439747033 wait complete. 2024-03-12T16:01:22.601 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.584+0000 7fb41e0f9700 1 Processor -- start 2024-03-12T16:01:22.601 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.584+0000 7fb41e0f9700 1 -- start start 2024-03-12T16:01:22.602 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.584+0000 7fb41e0f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fde50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:22.602 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.584+0000 7fb41e0f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb4180fc2d0 con 0x7fb4180fe580 2024-03-12T16:01:22.602 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.584+0000 7fb4177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fde50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:22.602 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.584+0000 7fb4177fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fde50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34556/0 (socket says 172.21.15.6:34556) 2024-03-12T16:01:22.602 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.584+0000 7fb4177fe700 1 -- 172.21.15.6:0/881991787 learned_addr learned my addr 172.21.15.6:0/881991787 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:22.602 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.585+0000 7fb4177fe700 1 -- 172.21.15.6:0/881991787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb408009370 con 0x7fb4180fe580 2024-03-12T16:01:22.602 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.585+0000 7fb4177fe700 1 --2- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fde50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb408002f40 tx=0x7fb4080090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.585+0000 7fb414ff9700 1 -- 172.21.15.6:0/881991787 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb40801a610 con 0x7fb4180fe580 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.585+0000 7fb414ff9700 1 -- 172.21.15.6:0/881991787 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fb40801abc0 con 0x7fb4180fe580 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.585+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb4180fc470 con 0x7fb4180fe580 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.585+0000 7fb414ff9700 1 -- 172.21.15.6:0/881991787 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fb4080229d0 con 0x7fb4180fe580 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.585+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb4180fc880 con 0x7fb4180fe580 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.586+0000 7fb414ff9700 1 -- 172.21.15.6:0/881991787 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fb408022c90 con 0x7fb4180fe580 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.586+0000 7fb414ff9700 1 --2- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fb400032610 0x7fb400034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.586+0000 7fb414ff9700 1 -- 172.21.15.6:0/881991787 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fb408044ba0 con 0x7fb4180fe580 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.586+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb418046ce0 con 0x7fb4180fe580 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.586+0000 7fb416ffd700 1 --2- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fb400032610 0x7fb400034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.587+0000 7fb416ffd700 1 --2- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fb400032610 0x7fb400034ad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb40c009780 tx=0x7fb40c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:22.603 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.591+0000 7fb414ff9700 1 -- 172.21.15.6:0/881991787 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb40801e080 con 0x7fb4180fe580 2024-03-12T16:01:22.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:22 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:21.382163+0000 mon.smithi006 (mon.0) 53 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:22.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:22 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:21.382479+0000 mgr.smithi006.kskdce (mgr.14116) 10 : cephadm [INF] Added host smithi006 2024-03-12T16:01:22.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:22 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:21.405674+0000 mon.smithi006 (mon.0) 54 : audit [DBG] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:01:22.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.771+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}) v1 -- 0x7fb418105710 con 0x7fb400032610 2024-03-12T16:01:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.776+0000 7fb414ff9700 1 -- 172.21.15.6:0/881991787 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fb418105710 con 0x7fb400032610 2024-03-12T16:01:22.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: Scheduled mon update... 2024-03-12T16:01:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fb400032610 msgr2=0x7fb400034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 --2- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fb400032610 0x7fb400034ad0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fb40c009780 tx=0x7fb40c006cc0).stop 2024-03-12T16:01:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 msgr2=0x7fb4180fde50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 --2- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fde50 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fb408002f40 tx=0x7fb4080090f0).stop 2024-03-12T16:01:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 shutdown_connections 2024-03-12T16:01:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 --2- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fb400032610 0x7fb400034ad0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:22.781 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 --2- 172.21.15.6:0/881991787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4180fe580 0x7fb4180fde50 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:22.782 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 >> 172.21.15.6:0/881991787 conn(0x7fb4180f6e20 msgr2=0x7fb418100410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:22.782 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 shutdown_connections 2024-03-12T16:01:22.782 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:22.778+0000 7fb41e0f9700 1 -- 172.21.15.6:0/881991787 wait complete. 2024-03-12T16:01:23.496 INFO:teuthology.orchestra.run.smithi006.stderr:Deploying mgr service with default placement... 2024-03-12T16:01:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:22.773983+0000 mgr.smithi006.kskdce (mgr.14116) 11 : audit [DBG] from='client.14136 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:22.775180+0000 mgr.smithi006.kskdce (mgr.14116) 12 : cephadm [INF] Saving service mon spec with placement count:5 2024-03-12T16:01:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:22.777428+0000 mon.smithi006 (mon.0) 55 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:24.211 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.068+0000 7fd67cdda700 1 Processor -- start 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.069+0000 7fd67cdda700 1 -- start start 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.069+0000 7fd67cdda700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd6781020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.069+0000 7fd67cdda700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd6780fdaa0 con 0x7fd678071be0 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.069+0000 7fd67659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd6781020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.069+0000 7fd67659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd6781020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34568/0 (socket says 172.21.15.6:34568) 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.069+0000 7fd67659c700 1 -- 172.21.15.6:0/2080491516 learned_addr learned my addr 172.21.15.6:0/2080491516 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.069+0000 7fd67659c700 1 -- 172.21.15.6:0/2080491516 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd6781025a0 con 0x7fd678071be0 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.069+0000 7fd67659c700 1 --2- 172.21.15.6:0/2080491516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd6781020b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd668009730 tx=0x7fd6680090f0).ready entity=mon.0 client_cookie=e785719435b55066 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67559a700 1 -- 172.21.15.6:0/2080491516 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd66800b6e0 con 0x7fd678071be0 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67559a700 1 -- 172.21.15.6:0/2080491516 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fd66800bc90 con 0x7fd678071be0 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67559a700 1 -- 172.21.15.6:0/2080491516 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd668011c70 con 0x7fd678071be0 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67cdda700 1 -- 172.21.15.6:0/2080491516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 msgr2=0x7fd6781020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:24.212 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67cdda700 1 --2- 172.21.15.6:0/2080491516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd6781020b0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fd668009730 tx=0x7fd6680090f0).stop 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67cdda700 1 -- 172.21.15.6:0/2080491516 shutdown_connections 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67cdda700 1 --2- 172.21.15.6:0/2080491516 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd6781020b0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67cdda700 1 -- 172.21.15.6:0/2080491516 >> 172.21.15.6:0/2080491516 conn(0x7fd6780f76f0 msgr2=0x7fd6780f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67cdda700 1 -- 172.21.15.6:0/2080491516 shutdown_connections 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.070+0000 7fd67cdda700 1 -- 172.21.15.6:0/2080491516 wait complete. 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.071+0000 7fd67cdda700 1 Processor -- start 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.071+0000 7fd67cdda700 1 -- start start 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.071+0000 7fd67cdda700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd67810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.071+0000 7fd67cdda700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd67810e4b0 con 0x7fd678071be0 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.071+0000 7fd67659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd67810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.071+0000 7fd67659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd67810dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34580/0 (socket says 172.21.15.6:34580) 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.072+0000 7fd67659c700 1 -- 172.21.15.6:0/3110294938 learned_addr learned my addr 172.21.15.6:0/3110294938 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.072+0000 7fd67659c700 1 -- 172.21.15.6:0/3110294938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd668009370 con 0x7fd678071be0 2024-03-12T16:01:24.213 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.072+0000 7fd67659c700 1 --2- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd67810dfc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd668000c00 tx=0x7fd6680090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.072+0000 7fd6677fe700 1 -- 172.21.15.6:0/3110294938 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd66801a610 con 0x7fd678071be0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.072+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd67810e6b0 con 0x7fd678071be0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.072+0000 7fd6677fe700 1 -- 172.21.15.6:0/3110294938 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 982+0+0 (secure 0 0 0) 0x7fd66801abc0 con 0x7fd678071be0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.072+0000 7fd6677fe700 1 -- 172.21.15.6:0/3110294938 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fd668022a20 con 0x7fd678071be0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.072+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd67810eac0 con 0x7fd678071be0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.073+0000 7fd6677fe700 1 -- 172.21.15.6:0/3110294938 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fd668022ce0 con 0x7fd678071be0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.073+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd678046ce0 con 0x7fd678071be0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.073+0000 7fd6677fe700 1 --2- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd660032610 0x7fd660034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.073+0000 7fd6677fe700 1 -- 172.21.15.6:0/3110294938 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fd668044b30 con 0x7fd678071be0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.073+0000 7fd675d9b700 1 --2- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd660032610 0x7fd660034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.074+0000 7fd675d9b700 1 --2- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd660032610 0x7fd660034ad0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fd66c009780 tx=0x7fd66c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:24.214 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.078+0000 7fd6677fe700 1 -- 172.21.15.6:0/3110294938 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd66801ad30 con 0x7fd678071be0 2024-03-12T16:01:24.273 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.271+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7fd67810f3a0 con 0x7fd660032610 2024-03-12T16:01:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.275+0000 7fd6677fe700 1 -- 172.21.15.6:0/3110294938 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7fd67810f3a0 con 0x7fd660032610 2024-03-12T16:01:24.277 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-03-12T16:01:24.279 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.277+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd660032610 msgr2=0x7fd660034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.277+0000 7fd67cdda700 1 --2- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd660032610 0x7fd660034ad0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7fd66c009780 tx=0x7fd66c006cc0).stop 2024-03-12T16:01:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.277+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 msgr2=0x7fd67810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.277+0000 7fd67cdda700 1 --2- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd67810dfc0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fd668000c00 tx=0x7fd6680090f0).stop 2024-03-12T16:01:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.277+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 shutdown_connections 2024-03-12T16:01:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.277+0000 7fd67cdda700 1 --2- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fd660032610 0x7fd660034ad0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.277+0000 7fd67cdda700 1 --2- 172.21.15.6:0/3110294938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd678071be0 0x7fd67810dfc0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.277+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 >> 172.21.15.6:0/3110294938 conn(0x7fd6780f76f0 msgr2=0x7fd6780f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.278+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 shutdown_connections 2024-03-12T16:01:24.280 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:24.278+0000 7fd67cdda700 1 -- 172.21.15.6:0/3110294938 wait complete. 2024-03-12T16:01:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:24.273147+0000 mgr.smithi006.kskdce (mgr.14116) 13 : audit [DBG] from='client.14138 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:24.273988+0000 mgr.smithi006.kskdce (mgr.14116) 14 : cephadm [INF] Saving service mgr spec with placement count:2 2024-03-12T16:01:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:24.276169+0000 mon.smithi006 (mon.0) 56 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:24.888913+0000 mon.smithi006 (mon.0) 57 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:25.210717+0000 mon.smithi006 (mon.0) 58 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:25.467 INFO:teuthology.orchestra.run.smithi006.stderr:Deploying crash service with default placement... 2024-03-12T16:01:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.934+0000 7f5a7acbf700 1 Processor -- start 2024-03-12T16:01:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.935+0000 7f5a7acbf700 1 -- start start 2024-03-12T16:01:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.935+0000 7f5a7acbf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a741020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.935+0000 7f5a7acbf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a740fdaa0 con 0x7f5a74071be0 2024-03-12T16:01:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.935+0000 7f5a78a5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a741020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.935+0000 7f5a78a5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a741020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34584/0 (socket says 172.21.15.6:34584) 2024-03-12T16:01:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.935+0000 7f5a78a5b700 1 -- 172.21.15.6:0/2602707245 learned_addr learned my addr 172.21.15.6:0/2602707245 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:25.939 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.935+0000 7f5a78a5b700 1 -- 172.21.15.6:0/2602707245 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a741025a0 con 0x7f5a74071be0 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.935+0000 7f5a78a5b700 1 --2- 172.21.15.6:0/2602707245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a741020b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5a68009730 tx=0x7f5a680090f0).ready entity=mon.0 client_cookie=fc0b12b605ca5f47 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a737fe700 1 -- 172.21.15.6:0/2602707245 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a6800b6e0 con 0x7f5a74071be0 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a737fe700 1 -- 172.21.15.6:0/2602707245 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5a6800bcd0 con 0x7f5a74071be0 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a737fe700 1 -- 172.21.15.6:0/2602707245 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a68011cb0 con 0x7f5a74071be0 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a7acbf700 1 -- 172.21.15.6:0/2602707245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 msgr2=0x7f5a741020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a7acbf700 1 --2- 172.21.15.6:0/2602707245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a741020b0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f5a68009730 tx=0x7f5a680090f0).stop 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a7acbf700 1 -- 172.21.15.6:0/2602707245 shutdown_connections 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a7acbf700 1 --2- 172.21.15.6:0/2602707245 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a741020b0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a7acbf700 1 -- 172.21.15.6:0/2602707245 >> 172.21.15.6:0/2602707245 conn(0x7f5a740f76f0 msgr2=0x7f5a740f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a7acbf700 1 -- 172.21.15.6:0/2602707245 shutdown_connections 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.936+0000 7f5a7acbf700 1 -- 172.21.15.6:0/2602707245 wait complete. 2024-03-12T16:01:25.940 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.937+0000 7f5a7acbf700 1 Processor -- start 2024-03-12T16:01:25.941 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.937+0000 7f5a7acbf700 1 -- start start 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.937+0000 7f5a7acbf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a7410dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.937+0000 7f5a7acbf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5a7410e4c0 con 0x7f5a74071be0 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.938+0000 7f5a78a5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a7410dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.938+0000 7f5a78a5b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a7410dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34592/0 (socket says 172.21.15.6:34592) 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.938+0000 7f5a78a5b700 1 -- 172.21.15.6:0/270397698 learned_addr learned my addr 172.21.15.6:0/270397698 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.938+0000 7f5a78a5b700 1 -- 172.21.15.6:0/270397698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5a68009370 con 0x7f5a74071be0 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.938+0000 7f5a78a5b700 1 --2- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a7410dfd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5a680118b0 tx=0x7f5a680090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.938+0000 7f5a71ffb700 1 -- 172.21.15.6:0/270397698 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a6800bad0 con 0x7f5a74071be0 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.938+0000 7f5a71ffb700 1 -- 172.21.15.6:0/270397698 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5a68011ad0 con 0x7f5a74071be0 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.938+0000 7f5a71ffb700 1 -- 172.21.15.6:0/270397698 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f5a6801aa50 con 0x7f5a74071be0 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.938+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5a7410e6c0 con 0x7f5a74071be0 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.939+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5a7410ead0 con 0x7f5a74071be0 2024-03-12T16:01:25.942 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.939+0000 7f5a71ffb700 1 -- 172.21.15.6:0/270397698 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f5a6801acc0 con 0x7f5a74071be0 2024-03-12T16:01:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.940+0000 7f5a71ffb700 1 --2- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5a64032660 0x7f5a64034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.940+0000 7f5a71ffb700 1 -- 172.21.15.6:0/270397698 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f5a68044990 con 0x7f5a74071be0 2024-03-12T16:01:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.940+0000 7f5a73fff700 1 --2- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5a64032660 0x7f5a64034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.940+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5a7405a310 con 0x7f5a74071be0 2024-03-12T16:01:25.943 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.940+0000 7f5a73fff700 1 --2- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5a64032660 0x7f5a64034b20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f5a60009780 tx=0x7f5a60006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:25.947 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:25.945+0000 7f5a71ffb700 1 -- 172.21.15.6:0/270397698 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5a6801e020 con 0x7f5a74071be0 2024-03-12T16:01:26.142 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.139+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}) v1 -- 0x7f5a74107e90 con 0x7f5a64032660 2024-03-12T16:01:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.143+0000 7f5a71ffb700 1 -- 172.21.15.6:0/270397698 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+26 (secure 0 0 0) 0x7f5a74107e90 con 0x7f5a64032660 2024-03-12T16:01:26.146 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: Scheduled crash update... 2024-03-12T16:01:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5a64032660 msgr2=0x7f5a64034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 --2- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5a64032660 0x7f5a64034b20 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f5a60009780 tx=0x7f5a60006cc0).stop 2024-03-12T16:01:26.148 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 msgr2=0x7f5a7410dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 --2- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a7410dfd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f5a680118b0 tx=0x7f5a680090f0).stop 2024-03-12T16:01:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 shutdown_connections 2024-03-12T16:01:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 --2- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f5a64032660 0x7f5a64034b20 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 --2- 172.21.15.6:0/270397698 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5a74071be0 0x7f5a7410dfd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 >> 172.21.15.6:0/270397698 conn(0x7f5a740f76f0 msgr2=0x7f5a740f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 shutdown_connections 2024-03-12T16:01:26.149 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:26.146+0000 7f5a7acbf700 1 -- 172.21.15.6:0/270397698 wait complete. 2024-03-12T16:01:26.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:26.141889+0000 mgr.smithi006.kskdce (mgr.14116) 15 : audit [DBG] from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "crash", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:26.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:26.142834+0000 mgr.smithi006.kskdce (mgr.14116) 16 : cephadm [INF] Saving service crash spec with placement * 2024-03-12T16:01:26.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:26.145055+0000 mon.smithi006 (mon.0) 59 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:26.793 INFO:teuthology.orchestra.run.smithi006.stderr:Deploying prometheus service with default placement... 2024-03-12T16:01:27.588 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.584+0000 7f906b225700 1 Processor -- start 2024-03-12T16:01:27.588 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.584+0000 7f906b225700 1 -- start start 2024-03-12T16:01:27.588 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f906b225700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f90640ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:27.588 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f906b225700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9064071fc0 con 0x7f9064071ba0 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f9068fc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f90640ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f9068fc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f90640ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34594/0 (socket says 172.21.15.6:34594) 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f9068fc1700 1 -- 172.21.15.6:0/1818384420 learned_addr learned my addr 172.21.15.6:0/1818384420 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f9068fc1700 1 -- 172.21.15.6:0/1818384420 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f90641001e0 con 0x7f9064071ba0 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f9068fc1700 1 --2- 172.21.15.6:0/1818384420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f90640ffcf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9058009730 tx=0x7f90580090f0).ready entity=mon.0 client_cookie=fc348eddcc50bb02 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f90637fe700 1 -- 172.21.15.6:0/1818384420 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f905800b6e0 con 0x7f9064071ba0 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f90637fe700 1 -- 172.21.15.6:0/1818384420 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f905800bcd0 con 0x7f9064071ba0 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.585+0000 7f90637fe700 1 -- 172.21.15.6:0/1818384420 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f9058011cb0 con 0x7f9064071ba0 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.586+0000 7f906b225700 1 -- 172.21.15.6:0/1818384420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 msgr2=0x7f90640ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.586+0000 7f906b225700 1 --2- 172.21.15.6:0/1818384420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f90640ffcf0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f9058009730 tx=0x7f90580090f0).stop 2024-03-12T16:01:27.589 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.586+0000 7f906b225700 1 -- 172.21.15.6:0/1818384420 shutdown_connections 2024-03-12T16:01:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.586+0000 7f906b225700 1 --2- 172.21.15.6:0/1818384420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f90640ffcf0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.586+0000 7f906b225700 1 -- 172.21.15.6:0/1818384420 >> 172.21.15.6:0/1818384420 conn(0x7f90640f76f0 msgr2=0x7f90640f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.586+0000 7f906b225700 1 -- 172.21.15.6:0/1818384420 shutdown_connections 2024-03-12T16:01:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.586+0000 7f906b225700 1 -- 172.21.15.6:0/1818384420 wait complete. 2024-03-12T16:01:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.587+0000 7f906b225700 1 Processor -- start 2024-03-12T16:01:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.587+0000 7f906b225700 1 -- start start 2024-03-12T16:01:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.587+0000 7f906b225700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f906410be60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.587+0000 7f906b225700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f906410c350 con 0x7f9064071ba0 2024-03-12T16:01:27.592 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.587+0000 7f9068fc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f906410be60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.587+0000 7f9068fc1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f906410be60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34610/0 (socket says 172.21.15.6:34610) 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.587+0000 7f9068fc1700 1 -- 172.21.15.6:0/2227623395 learned_addr learned my addr 172.21.15.6:0/2227623395 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.588+0000 7f9068fc1700 1 -- 172.21.15.6:0/2227623395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9058009370 con 0x7f9064071ba0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.588+0000 7f9068fc1700 1 --2- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f906410be60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f90580118b0 tx=0x7f90580090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.588+0000 7f9061ffb700 1 -- 172.21.15.6:0/2227623395 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f905800bad0 con 0x7f9064071ba0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.588+0000 7f9061ffb700 1 -- 172.21.15.6:0/2227623395 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9058011ad0 con 0x7f9064071ba0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.588+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f906410c550 con 0x7f9064071ba0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.588+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f906410c960 con 0x7f9064071ba0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.588+0000 7f9061ffb700 1 -- 172.21.15.6:0/2227623395 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f905801aa50 con 0x7f9064071ba0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.589+0000 7f9061ffb700 1 -- 172.21.15.6:0/2227623395 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f905801ad20 con 0x7f9064071ba0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.589+0000 7f9061ffb700 1 --2- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f9054032660 0x7f9054034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.589+0000 7f9061ffb700 1 -- 172.21.15.6:0/2227623395 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f9058045860 con 0x7f9064071ba0 2024-03-12T16:01:27.593 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.589+0000 7f9063fff700 1 --2- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f9054032660 0x7f9054034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.589+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9048005120 con 0x7f9064071ba0 2024-03-12T16:01:27.594 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.590+0000 7f9063fff700 1 --2- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f9054032660 0x7f9054034b20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9050009780 tx=0x7f9050006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:27.596 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.594+0000 7f9061ffb700 1 -- 172.21.15.6:0/2227623395 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f905801e070 con 0x7f9064071ba0 2024-03-12T16:01:27.792 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.790+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}) v1 -- 0x7f9048000b90 con 0x7f9054032660 2024-03-12T16:01:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.795+0000 7f9061ffb700 1 -- 172.21.15.6:0/2227623395 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+31 (secure 0 0 0) 0x7f9048000b90 con 0x7f9054032660 2024-03-12T16:01:27.797 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: Scheduled prometheus update... 2024-03-12T16:01:27.801 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f9054032660 msgr2=0x7f9054034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 --2- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f9054032660 0x7f9054034b20 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f9050009780 tx=0x7f9050006cc0).stop 2024-03-12T16:01:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 msgr2=0x7f906410be60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 --2- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f906410be60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f90580118b0 tx=0x7f90580090f0).stop 2024-03-12T16:01:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 shutdown_connections 2024-03-12T16:01:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 --2- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f9054032660 0x7f9054034b20 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:27.802 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 --2- 172.21.15.6:0/2227623395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9064071ba0 0x7f906410be60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 >> 172.21.15.6:0/2227623395 conn(0x7f90640f76f0 msgr2=0x7f90640f9170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 shutdown_connections 2024-03-12T16:01:27.803 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:27.797+0000 7f906b225700 1 -- 172.21.15.6:0/2227623395 wait complete. 2024-03-12T16:01:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:Deploying grafana service with default placement... 2024-03-12T16:01:28.706 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:27.511417+0000 mon.smithi006 (mon.0) 60 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:27.792286+0000 mgr.smithi006.kskdce (mgr.14116) 17 : audit [DBG] from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:27.793204+0000 mgr.smithi006.kskdce (mgr.14116) 18 : cephadm [INF] Saving service prometheus spec with placement count:1 2024-03-12T16:01:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:27.796079+0000 mon.smithi006 (mon.0) 61 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.438+0000 7fa03f8e9700 1 Processor -- start 2024-03-12T16:01:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.438+0000 7fa03f8e9700 1 -- start start 2024-03-12T16:01:29.757 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa03f8e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa0380fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa03f8e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa0380fc7e0 con 0x7fa0380fbed0 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa03d685700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa0380fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa03d685700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa0380fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34622/0 (socket says 172.21.15.6:34622) 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa03d685700 1 -- 172.21.15.6:0/2256657541 learned_addr learned my addr 172.21.15.6:0/2256657541 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa03d685700 1 -- 172.21.15.6:0/2256657541 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa0380fc920 con 0x7fa0380fbed0 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa03d685700 1 --2- 172.21.15.6:0/2256657541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa0380fc2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa034009730 tx=0x7fa0340090f0).ready entity=mon.0 client_cookie=4702cc05f5375b2c server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa02bfff700 1 -- 172.21.15.6:0/2256657541 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa03400b6e0 con 0x7fa0380fbed0 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa02bfff700 1 -- 172.21.15.6:0/2256657541 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa03400bcd0 con 0x7fa0380fbed0 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.439+0000 7fa02bfff700 1 -- 172.21.15.6:0/2256657541 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa034011cb0 con 0x7fa0380fbed0 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.440+0000 7fa03f8e9700 1 -- 172.21.15.6:0/2256657541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 msgr2=0x7fa0380fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.440+0000 7fa03f8e9700 1 --2- 172.21.15.6:0/2256657541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa0380fc2f0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7fa034009730 tx=0x7fa0340090f0).stop 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.440+0000 7fa03f8e9700 1 -- 172.21.15.6:0/2256657541 shutdown_connections 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.440+0000 7fa03f8e9700 1 --2- 172.21.15.6:0/2256657541 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa0380fc2f0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:29.758 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.440+0000 7fa03f8e9700 1 -- 172.21.15.6:0/2256657541 >> 172.21.15.6:0/2256657541 conn(0x7fa0380f76f0 msgr2=0x7fa0380f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.440+0000 7fa03f8e9700 1 -- 172.21.15.6:0/2256657541 shutdown_connections 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.440+0000 7fa03f8e9700 1 -- 172.21.15.6:0/2256657541 wait complete. 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.441+0000 7fa03f8e9700 1 Processor -- start 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.441+0000 7fa03f8e9700 1 -- start start 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.441+0000 7fa03f8e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa03810eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.441+0000 7fa03f8e9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa038071c80 con 0x7fa0380fbed0 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.441+0000 7fa03d685700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa03810eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.441+0000 7fa03d685700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa03810eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34638/0 (socket says 172.21.15.6:34638) 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.441+0000 7fa03d685700 1 -- 172.21.15.6:0/84821020 learned_addr learned my addr 172.21.15.6:0/84821020 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.442+0000 7fa03d685700 1 -- 172.21.15.6:0/84821020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa034009370 con 0x7fa0380fbed0 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.442+0000 7fa03d685700 1 --2- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa03810eb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa0340118b0 tx=0x7fa0340090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.442+0000 7fa02a7fc700 1 -- 172.21.15.6:0/84821020 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa03400be40 con 0x7fa0380fbed0 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.442+0000 7fa02a7fc700 1 -- 172.21.15.6:0/84821020 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa03400bad0 con 0x7fa0380fbed0 2024-03-12T16:01:29.759 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.442+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa038071e80 con 0x7fa0380fbed0 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.442+0000 7fa02a7fc700 1 -- 172.21.15.6:0/84821020 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa03401aaa0 con 0x7fa0380fbed0 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.442+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa03810f1e0 con 0x7fa0380fbed0 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.443+0000 7fa02a7fc700 1 -- 172.21.15.6:0/84821020 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fa034023410 con 0x7fa0380fbed0 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.443+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa038046ce0 con 0x7fa0380fbed0 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.443+0000 7fa02a7fc700 1 --2- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa024032610 0x7fa024034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.443+0000 7fa02a7fc700 1 -- 172.21.15.6:0/84821020 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fa034044d90 con 0x7fa0380fbed0 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.443+0000 7fa03ce84700 1 --2- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa024032610 0x7fa024034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.443+0000 7fa03ce84700 1 --2- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa024032610 0x7fa024034ad0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fa02c009780 tx=0x7fa02c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.447+0000 7fa02a7fc700 1 -- 172.21.15.6:0/84821020 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa034021710 con 0x7fa0380fbed0 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.633+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}) v1 -- 0x7fa038059120 con 0x7fa024032610 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.637+0000 7fa02a7fc700 1 -- 172.21.15.6:0/84821020 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+28 (secure 0 0 0) 0x7fa038059120 con 0x7fa024032610 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa024032610 msgr2=0x7fa024034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 --2- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa024032610 0x7fa024034ad0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7fa02c009780 tx=0x7fa02c006cc0).stop 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 msgr2=0x7fa03810eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:29.760 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 --2- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa03810eb30 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa0340118b0 tx=0x7fa0340090f0).stop 2024-03-12T16:01:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 shutdown_connections 2024-03-12T16:01:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 --2- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa024032610 0x7fa024034ad0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 --2- 172.21.15.6:0/84821020 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa0380fbed0 0x7fa03810eb30 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 >> 172.21.15.6:0/84821020 conn(0x7fa0380f76f0 msgr2=0x7fa0380f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 shutdown_connections 2024-03-12T16:01:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:29.639+0000 7fa03f8e9700 1 -- 172.21.15.6:0/84821020 wait complete. 2024-03-12T16:01:29.761 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: Scheduled grafana update... 2024-03-12T16:01:30.510 INFO:teuthology.orchestra.run.smithi006.stderr:Deploying node-exporter service with default placement... 2024-03-12T16:01:30.812 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:29.635649+0000 mgr.smithi006.kskdce (mgr.14116) 19 : audit [DBG] from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:30.812 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:29.636455+0000 mgr.smithi006.kskdce (mgr.14116) 20 : cephadm [INF] Saving service grafana spec with placement count:1 2024-03-12T16:01:30.812 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:29.638665+0000 mon.smithi006 (mon.0) 62 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:31.183 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.178+0000 7fc4c31af700 1 Processor -- start 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.178+0000 7fc4c31af700 1 -- start start 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.178+0000 7fc4c31af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc1020b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.178+0000 7fc4c31af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc0fdaa0 con 0x7fc4bc071be0 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.179+0000 7fc4c0f4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc1020b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.179+0000 7fc4c0f4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc1020b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34646/0 (socket says 172.21.15.6:34646) 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.179+0000 7fc4c0f4b700 1 -- 172.21.15.6:0/4277497802 learned_addr learned my addr 172.21.15.6:0/4277497802 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.179+0000 7fc4c0f4b700 1 -- 172.21.15.6:0/4277497802 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4bc1025a0 con 0x7fc4bc071be0 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.179+0000 7fc4c0f4b700 1 --2- 172.21.15.6:0/4277497802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc1020b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc4b0009730 tx=0x7fc4b00090f0).ready entity=mon.0 client_cookie=91fc905d70e3f4d1 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.179+0000 7fc4bb7fe700 1 -- 172.21.15.6:0/4277497802 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4b000b6e0 con 0x7fc4bc071be0 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.179+0000 7fc4bb7fe700 1 -- 172.21.15.6:0/4277497802 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc4b000bcd0 con 0x7fc4bc071be0 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.179+0000 7fc4bb7fe700 1 -- 172.21.15.6:0/4277497802 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4b0011cb0 con 0x7fc4bc071be0 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.180+0000 7fc4c31af700 1 -- 172.21.15.6:0/4277497802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 msgr2=0x7fc4bc1020b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:31.184 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.180+0000 7fc4c31af700 1 --2- 172.21.15.6:0/4277497802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc1020b0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fc4b0009730 tx=0x7fc4b00090f0).stop 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.180+0000 7fc4c31af700 1 -- 172.21.15.6:0/4277497802 shutdown_connections 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.180+0000 7fc4c31af700 1 --2- 172.21.15.6:0/4277497802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc1020b0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.180+0000 7fc4c31af700 1 -- 172.21.15.6:0/4277497802 >> 172.21.15.6:0/4277497802 conn(0x7fc4bc0f76f0 msgr2=0x7fc4bc0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.180+0000 7fc4c31af700 1 -- 172.21.15.6:0/4277497802 shutdown_connections 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.180+0000 7fc4c31af700 1 -- 172.21.15.6:0/4277497802 wait complete. 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.181+0000 7fc4c31af700 1 Processor -- start 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.181+0000 7fc4c31af700 1 -- start start 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.181+0000 7fc4c31af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc10dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.181+0000 7fc4c31af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4bc10e4c0 con 0x7fc4bc071be0 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.181+0000 7fc4c0f4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc10dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.181+0000 7fc4c0f4b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc10dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34648/0 (socket says 172.21.15.6:34648) 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.181+0000 7fc4c0f4b700 1 -- 172.21.15.6:0/3820526504 learned_addr learned my addr 172.21.15.6:0/3820526504 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.181+0000 7fc4c0f4b700 1 -- 172.21.15.6:0/3820526504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4b0009370 con 0x7fc4bc071be0 2024-03-12T16:01:31.185 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.181+0000 7fc4c0f4b700 1 --2- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc10dfd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc4b00118b0 tx=0x7fc4b00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.182+0000 7fc4b9ffb700 1 -- 172.21.15.6:0/3820526504 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4b000bad0 con 0x7fc4bc071be0 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.182+0000 7fc4b9ffb700 1 -- 172.21.15.6:0/3820526504 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc4b0011ad0 con 0x7fc4bc071be0 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.182+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4bc10e6c0 con 0x7fc4bc071be0 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.182+0000 7fc4b9ffb700 1 -- 172.21.15.6:0/3820526504 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fc4b001aa50 con 0x7fc4bc071be0 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.182+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4bc10ead0 con 0x7fc4bc071be0 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.183+0000 7fc4b9ffb700 1 -- 172.21.15.6:0/3820526504 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fc4b001ad10 con 0x7fc4bc071be0 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.183+0000 7fc4b9ffb700 1 --2- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fc4ac032610 0x7fc4ac034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.183+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4bc046ce0 con 0x7fc4bc071be0 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.183+0000 7fc4b9ffb700 1 -- 172.21.15.6:0/3820526504 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fc4b0044d30 con 0x7fc4bc071be0 2024-03-12T16:01:31.187 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.183+0000 7fc4bbfff700 1 --2- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fc4ac032610 0x7fc4ac034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:31.188 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.183+0000 7fc4bbfff700 1 --2- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fc4ac032610 0x7fc4ac034ad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fc4a8009780 tx=0x7fc4a8006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:31.189 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.187+0000 7fc4b9ffb700 1 -- 172.21.15.6:0/3820526504 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc4b002bb40 con 0x7fc4bc071be0 2024-03-12T16:01:31.371 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.369+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}) v1 -- 0x7fc4bc10f3b0 con 0x7fc4ac032610 2024-03-12T16:01:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.373+0000 7fc4b9ffb700 1 -- 172.21.15.6:0/3820526504 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+34 (secure 0 0 0) 0x7fc4bc10f3b0 con 0x7fc4ac032610 2024-03-12T16:01:31.375 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: Scheduled node-exporter update... 2024-03-12T16:01:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fc4ac032610 msgr2=0x7fc4ac034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 --2- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fc4ac032610 0x7fc4ac034ad0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7fc4a8009780 tx=0x7fc4a8006cc0).stop 2024-03-12T16:01:31.378 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 msgr2=0x7fc4bc10dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 --2- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc10dfd0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fc4b00118b0 tx=0x7fc4b00090f0).stop 2024-03-12T16:01:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 shutdown_connections 2024-03-12T16:01:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 --2- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fc4ac032610 0x7fc4ac034ad0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 --2- 172.21.15.6:0/3820526504 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4bc071be0 0x7fc4bc10dfd0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 >> 172.21.15.6:0/3820526504 conn(0x7fc4bc0f76f0 msgr2=0x7fc4bc0f9100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 shutdown_connections 2024-03-12T16:01:31.379 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:31.375+0000 7fc4c31af700 1 -- 172.21.15.6:0/3820526504 wait complete. 2024-03-12T16:01:32.017 INFO:teuthology.orchestra.run.smithi006.stderr:Deploying alertmanager service with default placement... 2024-03-12T16:01:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.609+0000 7fbec43ae700 1 Processor -- start 2024-03-12T16:01:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.610+0000 7fbec43ae700 1 -- start start 2024-03-12T16:01:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.610+0000 7fbec43ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc0ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.610+0000 7fbec43ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc100120 con 0x7fbebc071c60 2024-03-12T16:01:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.610+0000 7fbec214a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc0ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.610+0000 7fbec214a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc0ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54528/0 (socket says 172.21.15.6:54528) 2024-03-12T16:01:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.610+0000 7fbec214a700 1 -- 172.21.15.6:0/2914003881 learned_addr learned my addr 172.21.15.6:0/2914003881 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:32.613 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.610+0000 7fbec214a700 1 -- 172.21.15.6:0/2914003881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbebc100260 con 0x7fbebc071c60 2024-03-12T16:01:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.611+0000 7fbec214a700 1 --2- 172.21.15.6:0/2914003881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc0ffc30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fbeb8009730 tx=0x7fbeb80090f0).ready entity=mon.0 client_cookie=12b4706a3daf5320 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.611+0000 7fbec1148700 1 -- 172.21.15.6:0/2914003881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbeb800b6e0 con 0x7fbebc071c60 2024-03-12T16:01:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.611+0000 7fbec1148700 1 -- 172.21.15.6:0/2914003881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbeb800bcd0 con 0x7fbebc071c60 2024-03-12T16:01:32.614 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.611+0000 7fbec1148700 1 -- 172.21.15.6:0/2914003881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbeb8011cb0 con 0x7fbebc071c60 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.611+0000 7fbec43ae700 1 -- 172.21.15.6:0/2914003881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 msgr2=0x7fbebc0ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.611+0000 7fbec43ae700 1 --2- 172.21.15.6:0/2914003881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc0ffc30 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fbeb8009730 tx=0x7fbeb80090f0).stop 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.611+0000 7fbec43ae700 1 -- 172.21.15.6:0/2914003881 shutdown_connections 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.611+0000 7fbec43ae700 1 --2- 172.21.15.6:0/2914003881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc0ffc30 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.611+0000 7fbec43ae700 1 -- 172.21.15.6:0/2914003881 >> 172.21.15.6:0/2914003881 conn(0x7fbebc0f76f0 msgr2=0x7fbebc0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.612+0000 7fbec43ae700 1 -- 172.21.15.6:0/2914003881 shutdown_connections 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.612+0000 7fbec43ae700 1 -- 172.21.15.6:0/2914003881 wait complete. 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.612+0000 7fbec43ae700 1 Processor -- start 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.612+0000 7fbec43ae700 1 -- start start 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.612+0000 7fbec43ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc10bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.612+0000 7fbec43ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbebc10c390 con 0x7fbebc071c60 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbec214a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc10bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:32.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbec214a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc10bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54542/0 (socket says 172.21.15.6:54542) 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbec214a700 1 -- 172.21.15.6:0/2295496222 learned_addr learned my addr 172.21.15.6:0/2295496222 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbec214a700 1 -- 172.21.15.6:0/2295496222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbeb8009370 con 0x7fbebc071c60 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbec214a700 1 --2- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc10bea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbeb80118b0 tx=0x7fbeb80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbeaf7fe700 1 -- 172.21.15.6:0/2295496222 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbeb800bad0 con 0x7fbebc071c60 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbeaf7fe700 1 -- 172.21.15.6:0/2295496222 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbeb8011ad0 con 0x7fbebc071c60 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbebc10c590 con 0x7fbebc071c60 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbeaf7fe700 1 -- 172.21.15.6:0/2295496222 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbeb801aa50 con 0x7fbebc071c60 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.613+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbebc10c9a0 con 0x7fbebc071c60 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.614+0000 7fbeaf7fe700 1 -- 172.21.15.6:0/2295496222 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fbeb801ace0 con 0x7fbebc071c60 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.614+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbebc046ce0 con 0x7fbebc071c60 2024-03-12T16:01:32.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.614+0000 7fbeaf7fe700 1 --2- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbea8032660 0x7fbea8034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.614+0000 7fbeaf7fe700 1 -- 172.21.15.6:0/2295496222 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fbeb8044cd0 con 0x7fbebc071c60 2024-03-12T16:01:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.615+0000 7fbec1949700 1 --2- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbea8032660 0x7fbea8034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:32.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.615+0000 7fbec1949700 1 --2- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbea8032660 0x7fbea8034b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fbeb0009780 tx=0x7fbeb0006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:32.621 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.619+0000 7fbeaf7fe700 1 -- 172.21.15.6:0/2295496222 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbeb8023cb0 con 0x7fbebc071c60 2024-03-12T16:01:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:31.371714+0000 mgr.smithi006.kskdce (mgr.14116) 21 : audit [DBG] from='client.14146 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:31.372597+0000 mgr.smithi006.kskdce (mgr.14116) 22 : cephadm [INF] Saving service node-exporter spec with placement * 2024-03-12T16:01:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:31.374865+0000 mon.smithi006 (mon.0) 63 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:32.804 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.802+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}) v1 -- 0x7fbebc10d0d0 con 0x7fbea8032660 2024-03-12T16:01:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.805+0000 7fbeaf7fe700 1 -- 172.21.15.6:0/2295496222 <== mgr.14116 v2:172.21.15.6:6800/344339741 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+33 (secure 0 0 0) 0x7fbebc10d0d0 con 0x7fbea8032660 2024-03-12T16:01:32.808 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: Scheduled alertmanager update... 2024-03-12T16:01:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.807+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbea8032660 msgr2=0x7fbea8034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:32.810 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.807+0000 7fbec43ae700 1 --2- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbea8032660 0x7fbea8034b20 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7fbeb0009780 tx=0x7fbeb0006cc0).stop 2024-03-12T16:01:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.807+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 msgr2=0x7fbebc10bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.807+0000 7fbec43ae700 1 --2- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc10bea0 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7fbeb80118b0 tx=0x7fbeb80090f0).stop 2024-03-12T16:01:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.808+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 shutdown_connections 2024-03-12T16:01:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.808+0000 7fbec43ae700 1 --2- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fbea8032660 0x7fbea8034b20 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.808+0000 7fbec43ae700 1 --2- 172.21.15.6:0/2295496222 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbebc071c60 0x7fbebc10bea0 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.808+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 >> 172.21.15.6:0/2295496222 conn(0x7fbebc0f76f0 msgr2=0x7fbebc0f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.808+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 shutdown_connections 2024-03-12T16:01:32.811 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:32.808+0000 7fbec43ae700 1 -- 172.21.15.6:0/2295496222 wait complete. 2024-03-12T16:01:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.048+0000 7fab2a0d5700 1 Processor -- start 2024-03-12T16:01:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.048+0000 7fab2a0d5700 1 -- start start 2024-03-12T16:01:34.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab2a0d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab240fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab2a0d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab240fc7e0 con 0x7fab240fbed0 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab240fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab240fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54554/0 (socket says 172.21.15.6:54554) 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab237fe700 1 -- 172.21.15.6:0/1765030044 learned_addr learned my addr 172.21.15.6:0/1765030044 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab237fe700 1 -- 172.21.15.6:0/1765030044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab240fc920 con 0x7fab240fbed0 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab237fe700 1 --2- 172.21.15.6:0/1765030044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab240fc2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fab14009730 tx=0x7fab140090f0).ready entity=mon.0 client_cookie=3009a6a853131ac8 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab227fc700 1 -- 172.21.15.6:0/1765030044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab1400b6e0 con 0x7fab240fbed0 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab227fc700 1 -- 172.21.15.6:0/1765030044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fab1400bcd0 con 0x7fab240fbed0 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.049+0000 7fab227fc700 1 -- 172.21.15.6:0/1765030044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab14011cb0 con 0x7fab240fbed0 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.050+0000 7fab2a0d5700 1 -- 172.21.15.6:0/1765030044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 msgr2=0x7fab240fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.050+0000 7fab2a0d5700 1 --2- 172.21.15.6:0/1765030044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab240fc2f0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fab14009730 tx=0x7fab140090f0).stop 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.050+0000 7fab2a0d5700 1 -- 172.21.15.6:0/1765030044 shutdown_connections 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.050+0000 7fab2a0d5700 1 --2- 172.21.15.6:0/1765030044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab240fc2f0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:34.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.050+0000 7fab2a0d5700 1 -- 172.21.15.6:0/1765030044 >> 172.21.15.6:0/1765030044 conn(0x7fab240f76f0 msgr2=0x7fab240f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.050+0000 7fab2a0d5700 1 -- 172.21.15.6:0/1765030044 shutdown_connections 2024-03-12T16:01:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.050+0000 7fab2a0d5700 1 -- 172.21.15.6:0/1765030044 wait complete. 2024-03-12T16:01:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.051+0000 7fab2a0d5700 1 Processor -- start 2024-03-12T16:01:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.051+0000 7fab2a0d5700 1 -- start start 2024-03-12T16:01:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.051+0000 7fab2a0d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab2410bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.051+0000 7fab2a0d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab2410c390 con 0x7fab240fbed0 2024-03-12T16:01:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.051+0000 7fab237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab2410bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.051+0000 7fab237fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab2410bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54564/0 (socket says 172.21.15.6:54564) 2024-03-12T16:01:34.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.051+0000 7fab237fe700 1 -- 172.21.15.6:0/914452260 learned_addr learned my addr 172.21.15.6:0/914452260 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.051+0000 7fab237fe700 1 -- 172.21.15.6:0/914452260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab14009370 con 0x7fab240fbed0 2024-03-12T16:01:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.051+0000 7fab237fe700 1 --2- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab2410bea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fab140118b0 tx=0x7fab140090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.052+0000 7fab20ff9700 1 -- 172.21.15.6:0/914452260 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab1400be40 con 0x7fab240fbed0 2024-03-12T16:01:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.052+0000 7fab20ff9700 1 -- 172.21.15.6:0/914452260 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fab1400bad0 con 0x7fab240fbed0 2024-03-12T16:01:34.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.052+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab2410c590 con 0x7fab240fbed0 2024-03-12T16:01:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.052+0000 7fab20ff9700 1 -- 172.21.15.6:0/914452260 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fab1401aaa0 con 0x7fab240fbed0 2024-03-12T16:01:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.052+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab2410c9a0 con 0x7fab240fbed0 2024-03-12T16:01:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.052+0000 7fab20ff9700 1 -- 172.21.15.6:0/914452260 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fab14023410 con 0x7fab240fbed0 2024-03-12T16:01:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.053+0000 7fab20ff9700 1 --2- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fab0c032610 0x7fab0c034ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.053+0000 7fab20ff9700 1 -- 172.21.15.6:0/914452260 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fab14044a50 con 0x7fab240fbed0 2024-03-12T16:01:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.053+0000 7fab22ffd700 1 --2- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fab0c032610 0x7fab0c034ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.053+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab24046ce0 con 0x7fab240fbed0 2024-03-12T16:01:34.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.053+0000 7fab22ffd700 1 --2- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fab0c032610 0x7fab0c034ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fab18009780 tx=0x7fab18006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:34.059 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.058+0000 7fab20ff9700 1 -- 172.21.15.6:0/914452260 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fab1401e020 con 0x7fab240fbed0 2024-03-12T16:01:34.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:32.733602+0000 mgr.smithi006.kskdce (mgr.14116) 23 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:01:34.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:32.804043+0000 mgr.smithi006.kskdce (mgr.14116) 24 : audit [DBG] from='client.14148 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:34.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:32.804890+0000 mgr.smithi006.kskdce (mgr.14116) 25 : cephadm [INF] Saving service alertmanager spec with placement count:1 2024-03-12T16:01:34.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:32.807037+0000 mon.smithi006 (mon.0) 64 : audit [INF] from='mgr.14116 172.21.15.6:0/591770971' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:34.229 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.227+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/container_init}] v 0) v1 -- 0x7fab240fdc20 con 0x7fab240fbed0 2024-03-12T16:01:34.232 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.230+0000 7fab20ff9700 1 -- 172.21.15.6:0/914452260 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/container_init}]=0 v7)=0 v7) v1 ==== 142+0+0 (secure 0 0 0) 0x7fab14021710 con 0x7fab240fbed0 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fab0c032610 msgr2=0x7fab0c034ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 --2- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fab0c032610 0x7fab0c034ad0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7fab18009780 tx=0x7fab18006cc0).stop 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 msgr2=0x7fab2410bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 --2- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab2410bea0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fab140118b0 tx=0x7fab140090f0).stop 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 shutdown_connections 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 --2- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fab0c032610 0x7fab0c034ad0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 --2- 172.21.15.6:0/914452260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab240fbed0 0x7fab2410bea0 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 >> 172.21.15.6:0/914452260 conn(0x7fab240f76f0 msgr2=0x7fab240718d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 shutdown_connections 2024-03-12T16:01:34.235 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:34.232+0000 7fab2a0d5700 1 -- 172.21.15.6:0/914452260 wait complete. 2024-03-12T16:01:35.672 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:34.231520+0000 mon.smithi006 (mon.0) 65 : audit [INF] from='client.? 172.21.15.6:0/914452260' entity='client.admin' 2024-03-12T16:01:35.672 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:34.734003+0000 mgr.smithi006.kskdce (mgr.14116) 26 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:01:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.582+0000 7f2b6781f700 1 Processor -- start 2024-03-12T16:01:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.582+0000 7f2b6781f700 1 -- start start 2024-03-12T16:01:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b6781f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b600ffc90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:36.617 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b6781f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b60100180 con 0x7f2b60071c00 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b655bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b600ffc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b655bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b600ffc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54578/0 (socket says 172.21.15.6:54578) 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b655bb700 1 -- 172.21.15.6:0/650489295 learned_addr learned my addr 172.21.15.6:0/650489295 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b655bb700 1 -- 172.21.15.6:0/650489295 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b601002c0 con 0x7f2b60071c00 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b655bb700 1 --2- 172.21.15.6:0/650489295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b600ffc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2b50009730 tx=0x7f2b500090f0).ready entity=mon.0 client_cookie=6f0398586e010d33 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b57fff700 1 -- 172.21.15.6:0/650489295 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b5000b6e0 con 0x7f2b60071c00 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b57fff700 1 -- 172.21.15.6:0/650489295 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2b5000bcd0 con 0x7f2b60071c00 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.583+0000 7f2b57fff700 1 -- 172.21.15.6:0/650489295 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b50011cb0 con 0x7f2b60071c00 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.584+0000 7f2b6781f700 1 -- 172.21.15.6:0/650489295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 msgr2=0x7f2b600ffc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.584+0000 7f2b6781f700 1 --2- 172.21.15.6:0/650489295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b600ffc90 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7f2b50009730 tx=0x7f2b500090f0).stop 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.584+0000 7f2b6781f700 1 -- 172.21.15.6:0/650489295 shutdown_connections 2024-03-12T16:01:36.618 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.584+0000 7f2b6781f700 1 --2- 172.21.15.6:0/650489295 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b600ffc90 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.584+0000 7f2b6781f700 1 -- 172.21.15.6:0/650489295 >> 172.21.15.6:0/650489295 conn(0x7f2b600f76f0 msgr2=0x7f2b600f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.584+0000 7f2b6781f700 1 -- 172.21.15.6:0/650489295 shutdown_connections 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.584+0000 7f2b6781f700 1 -- 172.21.15.6:0/650489295 wait complete. 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.585+0000 7f2b6781f700 1 Processor -- start 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.585+0000 7f2b6781f700 1 -- start start 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.585+0000 7f2b6781f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b6010bed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.585+0000 7f2b6781f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b6010c3c0 con 0x7f2b60071c00 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.585+0000 7f2b655bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b6010bed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.585+0000 7f2b655bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b6010bed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54584/0 (socket says 172.21.15.6:54584) 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.585+0000 7f2b655bb700 1 -- 172.21.15.6:0/1668255061 learned_addr learned my addr 172.21.15.6:0/1668255061 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:36.619 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.586+0000 7f2b655bb700 1 -- 172.21.15.6:0/1668255061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b50009370 con 0x7f2b60071c00 2024-03-12T16:01:36.620 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.586+0000 7f2b655bb700 1 --2- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b6010bed0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2b500118b0 tx=0x7f2b500090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:36.620 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.586+0000 7f2b567fc700 1 -- 172.21.15.6:0/1668255061 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b5000be40 con 0x7f2b60071c00 2024-03-12T16:01:36.620 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.586+0000 7f2b567fc700 1 -- 172.21.15.6:0/1668255061 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2b5001aad0 con 0x7f2b60071c00 2024-03-12T16:01:36.620 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.586+0000 7f2b567fc700 1 -- 172.21.15.6:0/1668255061 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2b500239e0 con 0x7f2b60071c00 2024-03-12T16:01:36.620 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.586+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6010c5c0 con 0x7f2b60071c00 2024-03-12T16:01:36.620 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.586+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6010c9d0 con 0x7f2b60071c00 2024-03-12T16:01:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.587+0000 7f2b567fc700 1 -- 172.21.15.6:0/1668255061 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7f2b50023ca0 con 0x7f2b60071c00 2024-03-12T16:01:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.587+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b60046ce0 con 0x7f2b60071c00 2024-03-12T16:01:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.587+0000 7f2b567fc700 1 --2- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f2b4c0325e0 0x7f2b4c034aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.587+0000 7f2b567fc700 1 -- 172.21.15.6:0/1668255061 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f2b50044880 con 0x7f2b60071c00 2024-03-12T16:01:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.587+0000 7f2b64dba700 1 --2- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f2b4c0325e0 0x7f2b4c034aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.588+0000 7f2b64dba700 1 --2- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f2b4c0325e0 0x7f2b4c034aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f2b5c009780 tx=0x7f2b5c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:36.621 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.592+0000 7f2b567fc700 1 -- 172.21.15.6:0/1668255061 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2b50019570 con 0x7f2b60071c00 2024-03-12T16:01:36.768 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.766+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/dashboard/ssl_server_port}] v 0) v1 -- 0x7f2b60100f80 con 0x7f2b60071c00 2024-03-12T16:01:36.770 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.768+0000 7f2b567fc700 1 -- 172.21.15.6:0/1668255061 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/dashboard/ssl_server_port}]=0 v8)=0 v8) v1 ==== 130+0+0 (secure 0 0 0) 0x7f2b5001e020 con 0x7f2b60071c00 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.771+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f2b4c0325e0 msgr2=0x7f2b4c034aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.771+0000 7f2b6781f700 1 --2- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f2b4c0325e0 0x7f2b4c034aa0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f2b5c009780 tx=0x7f2b5c006cc0).stop 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.771+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 msgr2=0x7f2b6010bed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.771+0000 7f2b6781f700 1 --2- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b6010bed0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f2b500118b0 tx=0x7f2b500090f0).stop 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.771+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 shutdown_connections 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.771+0000 7f2b6781f700 1 --2- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f2b4c0325e0 0x7f2b4c034aa0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.771+0000 7f2b6781f700 1 --2- 172.21.15.6:0/1668255061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b60071c00 0x7f2b6010bed0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.771+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 >> 172.21.15.6:0/1668255061 conn(0x7f2b600f76f0 msgr2=0x7f2b600f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.772+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 shutdown_connections 2024-03-12T16:01:36.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:36.772+0000 7f2b6781f700 1 -- 172.21.15.6:0/1668255061 wait complete. 2024-03-12T16:01:37.483 INFO:teuthology.orchestra.run.smithi006.stderr:Enabling the dashboard module... 2024-03-12T16:01:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.118+0000 7fa17376c700 1 Processor -- start 2024-03-12T16:01:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.118+0000 7fa17376c700 1 -- start start 2024-03-12T16:01:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.118+0000 7fa17376c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c0722a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.118+0000 7fa17376c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c074120 con 0x7fa16c073d00 2024-03-12T16:01:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.118+0000 7fa171508700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c0722a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.118+0000 7fa171508700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c0722a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54586/0 (socket says 172.21.15.6:54586) 2024-03-12T16:01:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.118+0000 7fa171508700 1 -- 172.21.15.6:0/2622219181 learned_addr learned my addr 172.21.15.6:0/2622219181 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.119+0000 7fa171508700 1 -- 172.21.15.6:0/2622219181 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa16c072790 con 0x7fa16c073d00 2024-03-12T16:01:38.121 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.119+0000 7fa171508700 1 --2- 172.21.15.6:0/2622219181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c0722a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa168009730 tx=0x7fa1680090f0).ready entity=mon.0 client_cookie=b9fd716cf4505c7a server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:38.122 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.119+0000 7fa163fff700 1 -- 172.21.15.6:0/2622219181 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa16800b6e0 con 0x7fa16c073d00 2024-03-12T16:01:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.119+0000 7fa163fff700 1 -- 172.21.15.6:0/2622219181 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa16800bcd0 con 0x7fa16c073d00 2024-03-12T16:01:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.119+0000 7fa163fff700 1 -- 172.21.15.6:0/2622219181 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa168011cb0 con 0x7fa16c073d00 2024-03-12T16:01:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.120+0000 7fa17376c700 1 -- 172.21.15.6:0/2622219181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 msgr2=0x7fa16c0722a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:38.123 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.120+0000 7fa17376c700 1 --2- 172.21.15.6:0/2622219181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c0722a0 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fa168009730 tx=0x7fa1680090f0).stop 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.120+0000 7fa17376c700 1 -- 172.21.15.6:0/2622219181 shutdown_connections 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.120+0000 7fa17376c700 1 --2- 172.21.15.6:0/2622219181 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c0722a0 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.120+0000 7fa17376c700 1 -- 172.21.15.6:0/2622219181 >> 172.21.15.6:0/2622219181 conn(0x7fa16c0f87e0 msgr2=0x7fa16c0fac00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.120+0000 7fa17376c700 1 -- 172.21.15.6:0/2622219181 shutdown_connections 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.120+0000 7fa17376c700 1 -- 172.21.15.6:0/2622219181 wait complete. 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.120+0000 7fa17376c700 1 Processor -- start 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa17376c700 1 -- start start 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa17376c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa17376c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa16c10e550 con 0x7fa16c073d00 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa171508700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa171508700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c10e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54588/0 (socket says 172.21.15.6:54588) 2024-03-12T16:01:38.124 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa171508700 1 -- 172.21.15.6:0/1271029477 learned_addr learned my addr 172.21.15.6:0/1271029477 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:38.125 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa171508700 1 -- 172.21.15.6:0/1271029477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa168009370 con 0x7fa16c073d00 2024-03-12T16:01:38.125 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa171508700 1 --2- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c10e060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa1680118b0 tx=0x7fa1680090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:38.125 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa1627fc700 1 -- 172.21.15.6:0/1271029477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa16800be40 con 0x7fa16c073d00 2024-03-12T16:01:38.125 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa1627fc700 1 -- 172.21.15.6:0/1271029477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa16801aad0 con 0x7fa16c073d00 2024-03-12T16:01:38.126 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa1627fc700 1 -- 172.21.15.6:0/1271029477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa168023a10 con 0x7fa16c073d00 2024-03-12T16:01:38.126 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.121+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa16c10e750 con 0x7fa16c073d00 2024-03-12T16:01:38.126 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.122+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa16c10eb60 con 0x7fa16c073d00 2024-03-12T16:01:38.126 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.122+0000 7fa1627fc700 1 -- 172.21.15.6:0/1271029477 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 8) v1 ==== 38632+0+0 (secure 0 0 0) 0x7fa168023c40 con 0x7fa16c073d00 2024-03-12T16:01:38.126 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.122+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa16c046ce0 con 0x7fa16c073d00 2024-03-12T16:01:38.126 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.123+0000 7fa1627fc700 1 --2- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa158032660 0x7fa158034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:38.126 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.123+0000 7fa1627fc700 1 -- 172.21.15.6:0/1271029477 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7fa168044790 con 0x7fa16c073d00 2024-03-12T16:01:38.126 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.123+0000 7fa170d07700 1 --2- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa158032660 0x7fa158034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:38.126 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.123+0000 7fa170d07700 1 --2- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa158032660 0x7fa158034b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa15c009780 tx=0x7fa15c006cc0).ready entity=mgr.14116 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:38.129 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.127+0000 7fa1627fc700 1 -- 172.21.15.6:0/1271029477 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa16802bb40 con 0x7fa16c073d00 2024-03-12T16:01:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:36.734317+0000 mgr.smithi006.kskdce (mgr.14116) 27 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:01:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:36.770196+0000 mon.smithi006 (mon.0) 66 : audit [INF] from='client.? 172.21.15.6:0/1668255061' entity='client.admin' 2024-03-12T16:01:38.347 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.345+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr module enable", "module": "dashboard"} v 0) v1 -- 0x7fa16c1031a0 con 0x7fa16c073d00 2024-03-12T16:01:38.774 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.772+0000 7fa1627fc700 1 -- 172.21.15.6:0/1271029477 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7fa16801a730 con 0x7fa16c073d00 2024-03-12T16:01:38.775 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.773+0000 7fa1627fc700 1 -- 172.21.15.6:0/1271029477 <== mon.0 v2:172.21.15.6:3300/0 8 ==== mon_command_ack([{"prefix": "mgr module enable", "module": "dashboard"}]=0 v9) v1 ==== 88+0+0 (secure 0 0 0) 0x7fa1680107a0 con 0x7fa16c073d00 2024-03-12T16:01:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa158032660 msgr2=0x7fa158034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 --2- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa158032660 0x7fa158034b20 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7fa15c009780 tx=0x7fa15c006cc0).stop 2024-03-12T16:01:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 msgr2=0x7fa16c10e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 --2- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c10e060 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fa1680118b0 tx=0x7fa1680090f0).stop 2024-03-12T16:01:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 shutdown_connections 2024-03-12T16:01:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 --2- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7fa158032660 0x7fa158034b20 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 --2- 172.21.15.6:0/1271029477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa16c073d00 0x7fa16c10e060 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 >> 172.21.15.6:0/1271029477 conn(0x7fa16c0f87e0 msgr2=0x7fa16c0fa2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 shutdown_connections 2024-03-12T16:01:38.779 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:38.775+0000 7fa17376c700 1 -- 172.21.15.6:0/1271029477 wait complete. 2024-03-12T16:01:39.024 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:38.347112+0000 mon.smithi006 (mon.0) 67 : audit [INF] from='client.? 172.21.15.6:0/1271029477' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-03-12T16:01:39.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:38.774528+0000 mon.smithi006 (mon.0) 68 : audit [INF] from='client.? 172.21.15.6:0/1271029477' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-03-12T16:01:39.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:38.774616+0000 mon.smithi006 (mon.0) 69 : cluster [DBG] mgrmap e9: smithi006.kskdce(active, since 26s) 2024-03-12T16:01:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.043+0000 7f0d855f1700 1 Processor -- start 2024-03-12T16:01:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.043+0000 7f0d855f1700 1 -- start start 2024-03-12T16:01:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.043+0000 7f0d855f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d800ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.043+0000 7f0d855f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d80100120 con 0x7f0d80071c60 2024-03-12T16:01:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.043+0000 7f0d7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d800ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.043+0000 7f0d7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d800ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54602/0 (socket says 172.21.15.6:54602) 2024-03-12T16:01:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.043+0000 7f0d7effd700 1 -- 172.21.15.6:0/2700973308 learned_addr learned my addr 172.21.15.6:0/2700973308 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.043+0000 7f0d7effd700 1 -- 172.21.15.6:0/2700973308 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d80100260 con 0x7f0d80071c60 2024-03-12T16:01:40.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.043+0000 7f0d7effd700 1 --2- 172.21.15.6:0/2700973308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d800ffc30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0d70009730 tx=0x7f0d700090f0).ready entity=mon.0 client_cookie=3160b530c2ad291d server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d7dffb700 1 -- 172.21.15.6:0/2700973308 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d7000b6e0 con 0x7f0d80071c60 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d7dffb700 1 -- 172.21.15.6:0/2700973308 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0d7000bcd0 con 0x7f0d80071c60 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d7dffb700 1 -- 172.21.15.6:0/2700973308 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d70011cb0 con 0x7f0d80071c60 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d855f1700 1 -- 172.21.15.6:0/2700973308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 msgr2=0x7f0d800ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d855f1700 1 --2- 172.21.15.6:0/2700973308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d800ffc30 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f0d70009730 tx=0x7f0d700090f0).stop 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d855f1700 1 -- 172.21.15.6:0/2700973308 shutdown_connections 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d855f1700 1 --2- 172.21.15.6:0/2700973308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d800ffc30 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d855f1700 1 -- 172.21.15.6:0/2700973308 >> 172.21.15.6:0/2700973308 conn(0x7f0d800f76f0 msgr2=0x7f0d800f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d855f1700 1 -- 172.21.15.6:0/2700973308 shutdown_connections 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.044+0000 7f0d855f1700 1 -- 172.21.15.6:0/2700973308 wait complete. 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.045+0000 7f0d855f1700 1 Processor -- start 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.045+0000 7f0d855f1700 1 -- start start 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d855f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d8010bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:40.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d855f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d8010c390 con 0x7f0d80071c60 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d8010bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d8010bea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54608/0 (socket says 172.21.15.6:54608) 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d7effd700 1 -- 172.21.15.6:0/2930689740 learned_addr learned my addr 172.21.15.6:0/2930689740 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d7effd700 1 -- 172.21.15.6:0/2930689740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d70009370 con 0x7f0d80071c60 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d7effd700 1 --2- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d8010bea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0d700118b0 tx=0x7f0d700090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d67fff700 1 -- 172.21.15.6:0/2930689740 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d7000be40 con 0x7f0d80071c60 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d8010c590 con 0x7f0d80071c60 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d67fff700 1 -- 172.21.15.6:0/2930689740 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0d7001aad0 con 0x7f0d80071c60 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d67fff700 1 -- 172.21.15.6:0/2930689740 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0d70023a80 con 0x7f0d80071c60 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.046+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d8010c9a0 con 0x7f0d80071c60 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.047+0000 7f0d67fff700 1 -- 172.21.15.6:0/2930689740 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f0d70023cc0 con 0x7f0d80071c60 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.047+0000 7f0d67fff700 1 --2- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0d68032660 0x7f0d68034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.047+0000 7f0d67fff700 1 -- 172.21.15.6:0/2930689740 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f0d70044870 con 0x7f0d80071c60 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.047+0000 7f0d7e7fc700 1 -- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0d68032660 msgr2=0x7f0d68034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/344339741 2024-03-12T16:01:40.056 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.047+0000 7f0d7e7fc700 1 --2- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0d68032660 0x7f0d68034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:01:40.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.047+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d80046ce0 con 0x7f0d80071c60 2024-03-12T16:01:40.058 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.056+0000 7f0d67fff700 1 -- 172.21.15.6:0/2930689740 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0d7001e070 con 0x7f0d80071c60 2024-03-12T16:01:40.250 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.248+0000 7f0d7e7fc700 1 -- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0d68032660 msgr2=0x7f0d68034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/344339741 2024-03-12T16:01:40.250 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.248+0000 7f0d7e7fc700 1 --2- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0d68032660 0x7f0d68034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-03-12T16:01:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.316+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr stat"} v 0) v1 -- 0x7f0d80105ca0 con 0x7f0d80071c60 2024-03-12T16:01:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.316+0000 7f0d67fff700 1 -- 172.21.15.6:0/2930689740 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr stat"}]=0 v9) v1 ==== 56+0+103 (secure 0 0 0) 0x7f0d70021320 con 0x7f0d80071c60 2024-03-12T16:01:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: { 2024-03-12T16:01:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "epoch": 9, 2024-03-12T16:01:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "available": true, 2024-03-12T16:01:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "active_name": "smithi006.kskdce", 2024-03-12T16:01:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "num_standby": 0 2024-03-12T16:01:40.319 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: } 2024-03-12T16:01:40.320 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0d68032660 msgr2=0x7f0d68034b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:01:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 --2- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0d68032660 0x7f0d68034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:01:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 msgr2=0x7f0d8010bea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 --2- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d8010bea0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0d700118b0 tx=0x7f0d700090f0).stop 2024-03-12T16:01:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 shutdown_connections 2024-03-12T16:01:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 --2- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f0d68032660 0x7f0d68034b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:01:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 --2- 172.21.15.6:0/2930689740 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d80071c60 0x7f0d8010bea0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 >> 172.21.15.6:0/2930689740 conn(0x7f0d800f76f0 msgr2=0x7f0d800f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 shutdown_connections 2024-03-12T16:01:40.321 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:40.318+0000 7f0d855f1700 1 -- 172.21.15.6:0/2930689740 wait complete. 2024-03-12T16:01:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:Waiting for the mgr to restart... 2024-03-12T16:01:40.957 INFO:teuthology.orchestra.run.smithi006.stderr:Waiting for mgr epoch 9... 2024-03-12T16:01:41.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:40.317753+0000 mon.smithi006 (mon.0) 70 : audit [DBG] from='client.? 172.21.15.6:0/2930689740' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-03-12T16:01:41.636 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.599+0000 7f3dbd96c700 1 Processor -- start 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.599+0000 7f3dbd96c700 1 -- start start 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.599+0000 7f3dbd96c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.599+0000 7f3dbd96c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db80fc7e0 con 0x7f3db80fbed0 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.599+0000 7f3db6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.599+0000 7f3db6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db80fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54616/0 (socket says 172.21.15.6:54616) 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.600+0000 7f3db6ffd700 1 -- 172.21.15.6:0/1241940918 learned_addr learned my addr 172.21.15.6:0/1241940918 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.600+0000 7f3db6ffd700 1 -- 172.21.15.6:0/1241940918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3db80fc920 con 0x7f3db80fbed0 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.600+0000 7f3db6ffd700 1 --2- 172.21.15.6:0/1241940918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db80fc2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3da8009730 tx=0x7f3da80090f0).ready entity=mon.0 client_cookie=49dbd8405936d681 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.600+0000 7f3db5ffb700 1 -- 172.21.15.6:0/1241940918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3da800b6e0 con 0x7f3db80fbed0 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.600+0000 7f3db5ffb700 1 -- 172.21.15.6:0/1241940918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3da800bcd0 con 0x7f3db80fbed0 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.600+0000 7f3db5ffb700 1 -- 172.21.15.6:0/1241940918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3da8011cb0 con 0x7f3db80fbed0 2024-03-12T16:01:41.637 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.601+0000 7f3dbd96c700 1 -- 172.21.15.6:0/1241940918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 msgr2=0x7f3db80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.601+0000 7f3dbd96c700 1 --2- 172.21.15.6:0/1241940918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db80fc2f0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7f3da8009730 tx=0x7f3da80090f0).stop 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.601+0000 7f3dbd96c700 1 -- 172.21.15.6:0/1241940918 shutdown_connections 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.601+0000 7f3dbd96c700 1 --2- 172.21.15.6:0/1241940918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db80fc2f0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.601+0000 7f3dbd96c700 1 -- 172.21.15.6:0/1241940918 >> 172.21.15.6:0/1241940918 conn(0x7f3db80f76f0 msgr2=0x7f3db80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.601+0000 7f3dbd96c700 1 -- 172.21.15.6:0/1241940918 shutdown_connections 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.601+0000 7f3dbd96c700 1 -- 172.21.15.6:0/1241940918 wait complete. 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.601+0000 7f3dbd96c700 1 Processor -- start 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3dbd96c700 1 -- start start 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3dbd96c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db810eb30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3dbd96c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3db8071c80 con 0x7f3db80fbed0 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3db6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db810eb30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3db6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db810eb30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54620/0 (socket says 172.21.15.6:54620) 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3db6ffd700 1 -- 172.21.15.6:0/2539662975 learned_addr learned my addr 172.21.15.6:0/2539662975 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:41.638 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3db6ffd700 1 -- 172.21.15.6:0/2539662975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3da8009370 con 0x7f3db80fbed0 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3db6ffd700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db810eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3da8002f40 tx=0x7f3da80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3da801a590 con 0x7f3db80fbed0 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3db8071e80 con 0x7f3db80fbed0 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3da801ab80 con 0x7f3db80fbed0 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3da8022aa0 con 0x7f3db80fbed0 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.602+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3db810f1e0 con 0x7f3db80fbed0 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.603+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 9) v1 ==== 38645+0+0 (secure 0 0 0) 0x7f3da8019390 con 0x7f3db80fbed0 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.603+0000 7f3d9ffff700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 0x7f3da0034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.603+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 --> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3db805a310 con 0x7f3da0032660 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.603+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(2..2 src has 1..2) v4 ==== 893+0+0 (secure 0 0 0) 0x7f3da8045ad0 con 0x7f3db80fbed0 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.603+0000 7f3db67fc700 1 -- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 msgr2=0x7f3da0034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/344339741 2024-03-12T16:01:41.639 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.603+0000 7f3db67fc700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 0x7f3da0034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:01:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.804+0000 7f3db67fc700 1 -- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 msgr2=0x7f3da0034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/344339741 2024-03-12T16:01:41.806 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:41.804+0000 7f3db67fc700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 0x7f3da0034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-03-12T16:01:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:42.205+0000 7f3db67fc700 1 -- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 msgr2=0x7f3da0034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/344339741 2024-03-12T16:01:42.207 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:42.205+0000 7f3db67fc700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 0x7f3da0034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.800000 2024-03-12T16:01:43.008 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:43.006+0000 7f3db67fc700 1 -- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 msgr2=0x7f3da0034b20 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/344339741 2024-03-12T16:01:43.008 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:43.006+0000 7f3db67fc700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 0x7f3da0034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 1.600000 2024-03-12T16:01:44.399 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:44.396+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mgrmap(e 10) v1 ==== 38469+0+0 (secure 0 0 0) 0x7f3da8019a60 con 0x7f3db80fbed0 2024-03-12T16:01:44.399 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:44.396+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 msgr2=0x7f3da0034b20 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:01:44.399 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:44.396+0000 7f3d9ffff700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 0x7f3da0034b20 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:01:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:44.393248+0000 mon.smithi006 (mon.0) 71 : cluster [INF] Active manager daemon smithi006.kskdce restarted 2024-03-12T16:01:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:44.393559+0000 mon.smithi006 (mon.0) 72 : cluster [INF] Activating manager daemon smithi006.kskdce 2024-03-12T16:01:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:44.399098+0000 mon.smithi006 (mon.0) 73 : cluster [DBG] osdmap e3: 0 total, 0 up, 0 in 2024-03-12T16:01:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:44.399214+0000 mon.smithi006 (mon.0) 74 : cluster [DBG] mgrmap e10: smithi006.kskdce(active, starting, since 0.00578852s) 2024-03-12T16:01:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:44.400084+0000 mon.smithi006 (mon.0) 75 : audit [DBG] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:01:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:44.400805+0000 mon.smithi006 (mon.0) 76 : audit [DBG] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:01:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:44.401484+0000 mon.smithi006 (mon.0) 77 : audit [DBG] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:01:44.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:44.401644+0000 mon.smithi006 (mon.0) 78 : audit [DBG] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:01:44.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:44.401767+0000 mon.smithi006 (mon.0) 79 : audit [DBG] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:01:44.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:44.415937+0000 mon.smithi006 (mon.0) 80 : cluster [INF] Manager daemon smithi006.kskdce is now available 2024-03-12T16:01:45.398 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.395+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mgrmap(e 11) v1 ==== 38539+0+0 (secure 0 0 0) 0x7f3da80151c0 con 0x7f3db80fbed0 2024-03-12T16:01:45.398 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.395+0000 7f3d9ffff700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3da0035fb0 0x7f3da00383a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:45.398 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.395+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 --> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] -- command(tid 0: {"prefix": "get_command_descriptions"}) v1 -- 0x7f3db805a310 con 0x7f3da0035fb0 2024-03-12T16:01:45.398 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.395+0000 7f3db67fc700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3da0035fb0 0x7f3da00383a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:45.398 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.396+0000 7f3db67fc700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3da0035fb0 0x7f3da00383a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f3dac003850 tx=0x7f3dac006e60).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:45.399 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.397+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 <== mgr.14156 v2:172.21.15.6:6800/3591243488 1 ==== command_reply(tid 0: 0 ) v1 ==== 8+0+6438 (secure 0 0 0) 0x7f3db805a310 con 0x7f3da0035fb0 2024-03-12T16:01:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.408+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 --> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] -- command(tid 1: {"prefix": "mgr_status"}) v1 -- 0x7f3db8046ce0 con 0x7f3da0035fb0 2024-03-12T16:01:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3d9ffff700 1 -- 172.21.15.6:0/2539662975 <== mgr.14156 v2:172.21.15.6:6800/3591243488 2 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+52 (secure 0 0 0) 0x7f3db8046ce0 con 0x7f3da0035fb0 2024-03-12T16:01:45.411 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: { 2024-03-12T16:01:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-03-12T16:01:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: "initialized": true 2024-03-12T16:01:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: } 2024-03-12T16:01:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3da0035fb0 msgr2=0x7f3da00383a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3da0035fb0 0x7f3da00383a0 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f3dac003850 tx=0x7f3dac006e60).stop 2024-03-12T16:01:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 msgr2=0x7f3db810eb30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db810eb30 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f3da8002f40 tx=0x7f3da80090f0).stop 2024-03-12T16:01:45.412 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 shutdown_connections 2024-03-12T16:01:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3da0035fb0 0x7f3da00383a0 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3db80fbed0 0x7f3db810eb30 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 --2- 172.21.15.6:0/2539662975 >> [v2:172.21.15.6:6800/344339741,v1:172.21.15.6:6801/344339741] conn(0x7f3da0032660 0x7f3da0034b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:01:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 >> 172.21.15.6:0/2539662975 conn(0x7f3db80f76f0 msgr2=0x7f3db80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 shutdown_connections 2024-03-12T16:01:45.413 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:45.409+0000 7f3dbd96c700 1 -- 172.21.15.6:0/2539662975 wait complete. 2024-03-12T16:01:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:44.515588+0000 mon.smithi006 (mon.0) 81 : audit [DBG] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:01:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:44.518010+0000 mon.smithi006 (mon.0) 82 : audit [DBG] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:01:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:44.543100+0000 mon.smithi006 (mon.0) 83 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:01:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:44.546606+0000 mon.smithi006 (mon.0) 84 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:01:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:45.398595+0000 mon.smithi006 (mon.0) 85 : cluster [DBG] mgrmap e11: smithi006.kskdce(active, since 1.00517s) 2024-03-12T16:01:46.443 INFO:teuthology.orchestra.run.smithi006.stderr:mgr epoch 9 is available 2024-03-12T16:01:46.443 INFO:teuthology.orchestra.run.smithi006.stderr:Generating a dashboard self-signed certificate... 2024-03-12T16:01:46.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:45.398307+0000 mgr.smithi006.kskdce (mgr.14156) 1 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-03-12T16:01:46.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:45.410387+0000 mgr.smithi006.kskdce (mgr.14156) 2 : audit [DBG] from='client.14160 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-03-12T16:01:46.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:45.997808+0000 mon.smithi006 (mon.0) 86 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.996+0000 7fceff23c700 1 Processor -- start 2024-03-12T16:01:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.996+0000 7fceff23c700 1 -- start start 2024-03-12T16:01:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.997+0000 7fceff23c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef80fc2f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.997+0000 7fceff23c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef80fc7e0 con 0x7fcef80fbed0 2024-03-12T16:01:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.997+0000 7fcefcfd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef80fc2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:47.023 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.997+0000 7fcefcfd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef80fc2f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38394/0 (socket says 172.21.15.6:38394) 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.997+0000 7fcefcfd8700 1 -- 172.21.15.6:0/3015032193 learned_addr learned my addr 172.21.15.6:0/3015032193 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.997+0000 7fcefcfd8700 1 -- 172.21.15.6:0/3015032193 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcef80fc920 con 0x7fcef80fbed0 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.997+0000 7fcefcfd8700 1 --2- 172.21.15.6:0/3015032193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef80fc2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fceec009730 tx=0x7fceec0090f0).ready entity=mon.0 client_cookie=8f6c0cb53fbea9fa server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fcef77fe700 1 -- 172.21.15.6:0/3015032193 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceec00b6e0 con 0x7fcef80fbed0 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fcef77fe700 1 -- 172.21.15.6:0/3015032193 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fceec00bcd0 con 0x7fcef80fbed0 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fcef77fe700 1 -- 172.21.15.6:0/3015032193 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceec011cb0 con 0x7fcef80fbed0 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fceff23c700 1 -- 172.21.15.6:0/3015032193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 msgr2=0x7fcef80fc2f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fceff23c700 1 --2- 172.21.15.6:0/3015032193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef80fc2f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fceec009730 tx=0x7fceec0090f0).stop 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fceff23c700 1 -- 172.21.15.6:0/3015032193 shutdown_connections 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fceff23c700 1 --2- 172.21.15.6:0/3015032193 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef80fc2f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fceff23c700 1 -- 172.21.15.6:0/3015032193 >> 172.21.15.6:0/3015032193 conn(0x7fcef80f76f0 msgr2=0x7fcef80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fceff23c700 1 -- 172.21.15.6:0/3015032193 shutdown_connections 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.998+0000 7fceff23c700 1 -- 172.21.15.6:0/3015032193 wait complete. 2024-03-12T16:01:47.024 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.999+0000 7fceff23c700 1 Processor -- start 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.999+0000 7fceff23c700 1 -- start start 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.999+0000 7fceff23c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef810be40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.999+0000 7fceff23c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcef810c330 con 0x7fcef80fbed0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.999+0000 7fcefcfd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef810be40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.999+0000 7fcefcfd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef810be40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38404/0 (socket says 172.21.15.6:38404) 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:46.999+0000 7fcefcfd8700 1 -- 172.21.15.6:0/2819484107 learned_addr learned my addr 172.21.15.6:0/2819484107 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.000+0000 7fcefcfd8700 1 -- 172.21.15.6:0/2819484107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fceec009370 con 0x7fcef80fbed0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.000+0000 7fcefcfd8700 1 --2- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef810be40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fceec002f40 tx=0x7fceec0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.000+0000 7fcef5ffb700 1 -- 172.21.15.6:0/2819484107 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceec01a590 con 0x7fcef80fbed0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.000+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcef810c530 con 0x7fcef80fbed0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.000+0000 7fcef5ffb700 1 -- 172.21.15.6:0/2819484107 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fceec01ab80 con 0x7fcef80fbed0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.000+0000 7fcef5ffb700 1 -- 172.21.15.6:0/2819484107 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fceec022aa0 con 0x7fcef80fbed0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.000+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcef810c940 con 0x7fcef80fbed0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.001+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcef8046ce0 con 0x7fcef80fbed0 2024-03-12T16:01:47.025 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.002+0000 7fcef5ffb700 1 -- 172.21.15.6:0/2819484107 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 38645+0+0 (secure 0 0 0) 0x7fceec022d60 con 0x7fcef80fbed0 2024-03-12T16:01:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.002+0000 7fcef5ffb700 1 --2- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fcee8032660 0x7fcee8034b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.002+0000 7fcef5ffb700 1 -- 172.21.15.6:0/2819484107 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fceec045280 con 0x7fcef80fbed0 2024-03-12T16:01:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.002+0000 7fcef7fff700 1 --2- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fcee8032660 0x7fcee8034b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.002+0000 7fcef7fff700 1 --2- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fcee8032660 0x7fcee8034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fcee4009780 tx=0x7fcee4006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:47.026 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.006+0000 7fcef5ffb700 1 -- 172.21.15.6:0/2819484107 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fceec02b710 con 0x7fcef80fbed0 2024-03-12T16:01:47.201 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.199+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 --> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] -- mgr_command(tid 0: {"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}) v1 -- 0x7fcef810d140 con 0x7fcee8032660 2024-03-12T16:01:47.298 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.295+0000 7fcef5ffb700 1 -- 172.21.15.6:0/2819484107 <== mgr.14156 v2:172.21.15.6:6800/3591243488 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+32 (secure 0 0 0) 0x7fcef810d140 con 0x7fcee8032660 2024-03-12T16:01:47.298 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: Self-signed certificate created 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fcee8032660 msgr2=0x7fcee8034b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 --2- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fcee8032660 0x7fcee8034b20 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7fcee4009780 tx=0x7fcee4006cc0).stop 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 msgr2=0x7fcef810be40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 --2- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef810be40 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fceec002f40 tx=0x7fceec0090f0).stop 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 shutdown_connections 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 --2- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fcee8032660 0x7fcee8034b20 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 --2- 172.21.15.6:0/2819484107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcef80fbed0 0x7fcef810be40 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 >> 172.21.15.6:0/2819484107 conn(0x7fcef80f76f0 msgr2=0x7fcef80f9160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 shutdown_connections 2024-03-12T16:01:47.300 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:47.297+0000 7fceff23c700 1 -- 172.21.15.6:0/2819484107 wait complete. 2024-03-12T16:01:48.308 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:46.999417+0000 mon.smithi006 (mon.0) 87 : cluster [DBG] mgrmap e12: smithi006.kskdce(active, since 2s) 2024-03-12T16:01:48.309 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:47.201174+0000 mgr.smithi006.kskdce (mgr.14156) 3 : audit [DBG] from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:48.309 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:47.291841+0000 mon.smithi006 (mon.0) 88 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:48.309 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:47.296762+0000 mon.smithi006 (mon.0) 89 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:48.750 INFO:teuthology.orchestra.run.smithi006.stderr:Creating initial admin user... 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.344+0000 7fad0d54e700 1 Processor -- start 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.344+0000 7fad0d54e700 1 -- start start 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.344+0000 7fad0d54e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad080fd850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.344+0000 7fad0d54e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad080fdd40 con 0x7fad080fd430 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.344+0000 7fad06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad080fd850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.344+0000 7fad06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad080fd850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38412/0 (socket says 172.21.15.6:38412) 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.344+0000 7fad06ffd700 1 -- 172.21.15.6:0/4244698958 learned_addr learned my addr 172.21.15.6:0/4244698958 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.345+0000 7fad06ffd700 1 -- 172.21.15.6:0/4244698958 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad080fde80 con 0x7fad080fd430 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.345+0000 7fad06ffd700 1 --2- 172.21.15.6:0/4244698958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad080fd850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7facf8009730 tx=0x7facf80090f0).ready entity=mon.0 client_cookie=d7ce1a36d90126c0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:49.351 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.345+0000 7fad05ffb700 1 -- 172.21.15.6:0/4244698958 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facf800b6e0 con 0x7fad080fd430 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.345+0000 7fad05ffb700 1 -- 172.21.15.6:0/4244698958 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7facf800bcd0 con 0x7fad080fd430 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.345+0000 7fad05ffb700 1 -- 172.21.15.6:0/4244698958 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facf8011cb0 con 0x7fad080fd430 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.346+0000 7fad0d54e700 1 -- 172.21.15.6:0/4244698958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 msgr2=0x7fad080fd850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.346+0000 7fad0d54e700 1 --2- 172.21.15.6:0/4244698958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad080fd850 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7facf8009730 tx=0x7facf80090f0).stop 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.346+0000 7fad0d54e700 1 -- 172.21.15.6:0/4244698958 shutdown_connections 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.346+0000 7fad0d54e700 1 --2- 172.21.15.6:0/4244698958 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad080fd850 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.346+0000 7fad0d54e700 1 -- 172.21.15.6:0/4244698958 >> 172.21.15.6:0/4244698958 conn(0x7fad080f6e20 msgr2=0x7fad080f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.346+0000 7fad0d54e700 1 -- 172.21.15.6:0/4244698958 shutdown_connections 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.346+0000 7fad0d54e700 1 -- 172.21.15.6:0/4244698958 wait complete. 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.346+0000 7fad0d54e700 1 Processor -- start 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7fad0d54e700 1 -- start start 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7fad0d54e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad0810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7fad0d54e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad0810e4b0 con 0x7fad080fd430 2024-03-12T16:01:49.352 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7fad06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad0810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7fad06ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad0810dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38422/0 (socket says 172.21.15.6:38422) 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7fad06ffd700 1 -- 172.21.15.6:0/3154338388 learned_addr learned my addr 172.21.15.6:0/3154338388 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7fad06ffd700 1 -- 172.21.15.6:0/3154338388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facf8009370 con 0x7fad080fd430 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7fad06ffd700 1 --2- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad0810dfc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7facf8002f90 tx=0x7facf80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7facfffff700 1 -- 172.21.15.6:0/3154338388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facf801a640 con 0x7fad080fd430 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7facfffff700 1 -- 172.21.15.6:0/3154338388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7facf801ac30 con 0x7fad080fd430 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.347+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad0810e6b0 con 0x7fad080fd430 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.348+0000 7facfffff700 1 -- 172.21.15.6:0/3154338388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facf8022b20 con 0x7fad080fd430 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.348+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad0810eac0 con 0x7fad080fd430 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.348+0000 7facfffff700 1 -- 172.21.15.6:0/3154338388 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 12) v1 ==== 38645+0+0 (secure 0 0 0) 0x7facf8019390 con 0x7fad080fd430 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.348+0000 7facfffff700 1 --2- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7facf4032630 0x7facf4034af0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.349+0000 7facfffff700 1 -- 172.21.15.6:0/3154338388 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7facf8044b30 con 0x7fad080fd430 2024-03-12T16:01:49.353 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.349+0000 7fad067fc700 1 --2- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7facf4032630 0x7facf4034af0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:49.354 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.349+0000 7fad067fc700 1 --2- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7facf4032630 0x7facf4034af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7facf0009780 tx=0x7facf0006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:49.354 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.350+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad0805a310 con 0x7fad080fd430 2024-03-12T16:01:49.356 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.354+0000 7facfffff700 1 -- 172.21.15.6:0/3154338388 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7facf801e020 con 0x7fad080fd430 2024-03-12T16:01:49.545 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.542+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 --> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] -- mgr_command(tid 0: {"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}) v1 -- 0x7fad0805a130 con 0x7facf4032630 2024-03-12T16:01:49.791 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.789+0000 7facfffff700 1 -- 172.21.15.6:0/3154338388 <== mgr.14156 v2:172.21.15.6:6800/3591243488 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+252 (secure 0 0 0) 0x7fad0805a130 con 0x7facf4032630 2024-03-12T16:01:49.791 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$8D17zMwL.cIiq4twBk7F8e00r/47FnJ767GKiUdn3FppfsN2RyLY2", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1710259309, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7facf4032630 msgr2=0x7facf4034af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 --2- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7facf4032630 0x7facf4034af0 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7facf0009780 tx=0x7facf0006cc0).stop 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 msgr2=0x7fad0810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 --2- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad0810dfc0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7facf8002f90 tx=0x7facf80090f0).stop 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 shutdown_connections 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 --2- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7facf4032630 0x7facf4034af0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 --2- 172.21.15.6:0/3154338388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad080fd430 0x7fad0810dfc0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 >> 172.21.15.6:0/3154338388 conn(0x7fad080f6e20 msgr2=0x7fad080fb900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 shutdown_connections 2024-03-12T16:01:49.794 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:49.791+0000 7fad0d54e700 1 -- 172.21.15.6:0/3154338388 wait complete. 2024-03-12T16:01:50.449 INFO:teuthology.orchestra.run.smithi006.stderr:Fetching dashboard port number... 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.046+0000 7fa5bf252700 1 Processor -- start 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.046+0000 7fa5bf252700 1 -- start start 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.046+0000 7fa5bf252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80ffc70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.046+0000 7fa5bf252700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b8100160 con 0x7fa5b8071c20 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.047+0000 7fa5bcfee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80ffc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.047+0000 7fa5bcfee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80ffc70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38436/0 (socket says 172.21.15.6:38436) 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.047+0000 7fa5bcfee700 1 -- 172.21.15.6:0/1484700839 learned_addr learned my addr 172.21.15.6:0/1484700839 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.047+0000 7fa5bcfee700 1 -- 172.21.15.6:0/1484700839 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b81002a0 con 0x7fa5b8071c20 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.047+0000 7fa5bcfee700 1 --2- 172.21.15.6:0/1484700839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80ffc70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa5ac009730 tx=0x7fa5ac0090f0).ready entity=mon.0 client_cookie=328592b474af7ccc server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.047+0000 7fa5b77fe700 1 -- 172.21.15.6:0/1484700839 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5ac00b770 con 0x7fa5b8071c20 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.047+0000 7fa5b77fe700 1 -- 172.21.15.6:0/1484700839 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa5ac00bd60 con 0x7fa5b8071c20 2024-03-12T16:01:51.050 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.047+0000 7fa5b77fe700 1 -- 172.21.15.6:0/1484700839 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5ac011d90 con 0x7fa5b8071c20 2024-03-12T16:01:51.052 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.048+0000 7fa5bf252700 1 -- 172.21.15.6:0/1484700839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 msgr2=0x7fa5b80ffc70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.048+0000 7fa5bf252700 1 --2- 172.21.15.6:0/1484700839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80ffc70 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fa5ac009730 tx=0x7fa5ac0090f0).stop 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.048+0000 7fa5bf252700 1 -- 172.21.15.6:0/1484700839 shutdown_connections 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.048+0000 7fa5bf252700 1 --2- 172.21.15.6:0/1484700839 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80ffc70 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.048+0000 7fa5bf252700 1 -- 172.21.15.6:0/1484700839 >> 172.21.15.6:0/1484700839 conn(0x7fa5b80f76f0 msgr2=0x7fa5b80f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.048+0000 7fa5bf252700 1 -- 172.21.15.6:0/1484700839 shutdown_connections 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.048+0000 7fa5bf252700 1 -- 172.21.15.6:0/1484700839 wait complete. 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.049+0000 7fa5bf252700 1 Processor -- start 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.049+0000 7fa5bf252700 1 -- start start 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.049+0000 7fa5bf252700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80fd6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.049+0000 7fa5bf252700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5b80fbb70 con 0x7fa5b8071c20 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.049+0000 7fa5bcfee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80fd6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.049+0000 7fa5bcfee700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80fd6f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38452/0 (socket says 172.21.15.6:38452) 2024-03-12T16:01:51.053 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.049+0000 7fa5bcfee700 1 -- 172.21.15.6:0/1130851793 learned_addr learned my addr 172.21.15.6:0/1130851793 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.049+0000 7fa5bcfee700 1 -- 172.21.15.6:0/1130851793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5ac009370 con 0x7fa5b8071c20 2024-03-12T16:01:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.049+0000 7fa5bcfee700 1 --2- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80fd6f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa5ac009f00 tx=0x7fa5ac0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.050+0000 7fa5b5ffb700 1 -- 172.21.15.6:0/1130851793 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5ac011bb0 con 0x7fa5b8071c20 2024-03-12T16:01:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.050+0000 7fa5b5ffb700 1 -- 172.21.15.6:0/1130851793 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa5ac00bbc0 con 0x7fa5b8071c20 2024-03-12T16:01:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.050+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5b80fbd10 con 0x7fa5b8071c20 2024-03-12T16:01:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.050+0000 7fa5b5ffb700 1 -- 172.21.15.6:0/1130851793 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa5ac01ab20 con 0x7fa5b8071c20 2024-03-12T16:01:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.050+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5b80fc120 con 0x7fa5b8071c20 2024-03-12T16:01:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.051+0000 7fa5b5ffb700 1 -- 172.21.15.6:0/1130851793 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7fa5ac0108b0 con 0x7fa5b8071c20 2024-03-12T16:01:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.051+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5b8046ce0 con 0x7fa5b8071c20 2024-03-12T16:01:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.051+0000 7fa5b5ffb700 1 --2- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa5a80326d0 0x7fa5a8034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.051+0000 7fa5b5ffb700 1 -- 172.21.15.6:0/1130851793 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fa5ac045100 con 0x7fa5b8071c20 2024-03-12T16:01:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.051+0000 7fa5b7fff700 1 --2- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa5a80326d0 0x7fa5a8034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.051+0000 7fa5b7fff700 1 --2- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa5a80326d0 0x7fa5a8034b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa5a4009780 tx=0x7fa5a4006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:51.057 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.056+0000 7fa5b5ffb700 1 -- 172.21.15.6:0/1130851793 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa5ac018500 con 0x7fa5b8071c20 2024-03-12T16:01:51.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:49.544701+0000 mgr.smithi006.kskdce (mgr.14156) 4 : audit [DBG] from='client.14168 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:01:51.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:49.790410+0000 mon.smithi006 (mon.0) 90 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:51.228 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.225+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"} v 0) v1 -- 0x7fa5b8100f60 con 0x7fa5b8071c20 2024-03-12T16:01:51.228 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.226+0000 7fa5b5ffb700 1 -- 172.21.15.6:0/1130851793 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]=0 v8) v1 ==== 112+0+5 (secure 0 0 0) 0x7fa5ac01e070 con 0x7fa5b8071c20 2024-03-12T16:01:51.228 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 8443 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa5a80326d0 msgr2=0x7fa5a8034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 --2- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa5a80326d0 0x7fa5a8034b90 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7fa5a4009780 tx=0x7fa5a4006cc0).stop 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 msgr2=0x7fa5b80fd6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 --2- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80fd6f0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7fa5ac009f00 tx=0x7fa5ac0090f0).stop 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 shutdown_connections 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 --2- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa5a80326d0 0x7fa5a8034b90 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 --2- 172.21.15.6:0/1130851793 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5b8071c20 0x7fa5b80fd6f0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 >> 172.21.15.6:0/1130851793 conn(0x7fa5b80f76f0 msgr2=0x7fa5b80f9140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 shutdown_connections 2024-03-12T16:01:51.231 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:51.229+0000 7fa5bf252700 1 -- 172.21.15.6:0/1130851793 wait complete. 2024-03-12T16:01:51.877 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:01:50.792119+0000 mon.smithi006 (mon.0) 91 : cluster [DBG] mgrmap e13: smithi006.kskdce(active, since 6s) 2024-03-12T16:01:51.877 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:51.227573+0000 mon.smithi006 (mon.0) 92 : audit [DBG] from='client.? 172.21.15.6:0/1130851793' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-03-12T16:01:51.883 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: disabled 2024-03-12T16:01:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:systemctl: inactive 2024-03-12T16:01:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:firewalld.service is not enabled 2024-03-12T16:01:51.892 INFO:teuthology.orchestra.run.smithi006.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-03-12T16:01:51.895 INFO:teuthology.orchestra.run.smithi006.stderr:Ceph Dashboard is now available at: 2024-03-12T16:01:51.895 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:51.896 INFO:teuthology.orchestra.run.smithi006.stderr: URL: https://smithi006.front.sepia.ceph.com:8443/ 2024-03-12T16:01:51.896 INFO:teuthology.orchestra.run.smithi006.stderr: User: admin 2024-03-12T16:01:51.896 INFO:teuthology.orchestra.run.smithi006.stderr: Password: nuelxu538n 2024-03-12T16:01:51.896 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:51.896 INFO:teuthology.orchestra.run.smithi006.stderr:Enabling autotune for osd_memory_target 2024-03-12T16:01:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.508+0000 7efce0713700 1 Processor -- start 2024-03-12T16:01:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.508+0000 7efce0713700 1 -- start start 2024-03-12T16:01:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.509+0000 7efce0713700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fea20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.509+0000 7efce0713700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80fef10 con 0x7efcd80fe600 2024-03-12T16:01:52.513 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.509+0000 7efcde4af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fea20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.509+0000 7efcde4af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fea20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46558/0 (socket says 172.21.15.6:46558) 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.509+0000 7efcde4af700 1 -- 172.21.15.6:0/2409230440 learned_addr learned my addr 172.21.15.6:0/2409230440 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.509+0000 7efcde4af700 1 -- 172.21.15.6:0/2409230440 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd80ff050 con 0x7efcd80fe600 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.509+0000 7efcde4af700 1 --2- 172.21.15.6:0/2409230440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fea20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7efcd4009730 tx=0x7efcd40090f0).ready entity=mon.0 client_cookie=9fc3567c23bb24e9 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.509+0000 7efcdd4ad700 1 -- 172.21.15.6:0/2409230440 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcd400b6e0 con 0x7efcd80fe600 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.509+0000 7efcdd4ad700 1 -- 172.21.15.6:0/2409230440 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7efcd400bcd0 con 0x7efcd80fe600 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.510+0000 7efcdd4ad700 1 -- 172.21.15.6:0/2409230440 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcd4011cb0 con 0x7efcd80fe600 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.510+0000 7efce0713700 1 -- 172.21.15.6:0/2409230440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 msgr2=0x7efcd80fea20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.510+0000 7efce0713700 1 --2- 172.21.15.6:0/2409230440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fea20 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7efcd4009730 tx=0x7efcd40090f0).stop 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.510+0000 7efce0713700 1 -- 172.21.15.6:0/2409230440 shutdown_connections 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.510+0000 7efce0713700 1 --2- 172.21.15.6:0/2409230440 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fea20 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.510+0000 7efce0713700 1 -- 172.21.15.6:0/2409230440 >> 172.21.15.6:0/2409230440 conn(0x7efcd80f6e20 msgr2=0x7efcd80f9240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:52.514 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.510+0000 7efce0713700 1 -- 172.21.15.6:0/2409230440 shutdown_connections 2024-03-12T16:01:52.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.510+0000 7efce0713700 1 -- 172.21.15.6:0/2409230440 wait complete. 2024-03-12T16:01:52.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.511+0000 7efce0713700 1 Processor -- start 2024-03-12T16:01:52.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.511+0000 7efce0713700 1 -- start start 2024-03-12T16:01:52.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.511+0000 7efce0713700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:52.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.511+0000 7efce0713700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcd80fc350 con 0x7efcd80fe600 2024-03-12T16:01:52.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.511+0000 7efcde4af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:52.515 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.511+0000 7efcde4af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46560/0 (socket says 172.21.15.6:46560) 2024-03-12T16:01:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.511+0000 7efcde4af700 1 -- 172.21.15.6:0/3369497233 learned_addr learned my addr 172.21.15.6:0/3369497233 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.511+0000 7efcde4af700 1 -- 172.21.15.6:0/3369497233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efcd4009370 con 0x7efcd80fe600 2024-03-12T16:01:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.511+0000 7efcde4af700 1 --2- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fded0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efcd4006b00 tx=0x7efcd40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.512+0000 7efccf7fe700 1 -- 172.21.15.6:0/3369497233 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcd401a640 con 0x7efcd80fe600 2024-03-12T16:01:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.512+0000 7efccf7fe700 1 -- 172.21.15.6:0/3369497233 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7efcd401ac30 con 0x7efcd80fe600 2024-03-12T16:01:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.512+0000 7efccf7fe700 1 -- 172.21.15.6:0/3369497233 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7efcd4023cb0 con 0x7efcd80fe600 2024-03-12T16:01:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.512+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcd80fc4f0 con 0x7efcd80fe600 2024-03-12T16:01:52.516 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.512+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcd80fc900 con 0x7efcd80fe600 2024-03-12T16:01:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.513+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcd8046ce0 con 0x7efcd80fe600 2024-03-12T16:01:52.517 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.513+0000 7efccf7fe700 1 -- 172.21.15.6:0/3369497233 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7efcd4023510 con 0x7efcd80fe600 2024-03-12T16:01:52.518 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.513+0000 7efccf7fe700 1 --2- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7efcc4032750 0x7efcc4034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:52.518 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.513+0000 7efccf7fe700 1 -- 172.21.15.6:0/3369497233 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7efcd4045210 con 0x7efcd80fe600 2024-03-12T16:01:52.518 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.513+0000 7efcddcae700 1 --2- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7efcc4032750 0x7efcc4034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:52.518 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.514+0000 7efcddcae700 1 --2- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7efcc4032750 0x7efcc4034c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7efcc8009780 tx=0x7efcc8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:52.519 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.518+0000 7efccf7fe700 1 -- 172.21.15.6:0/3369497233 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7efcd4018500 con 0x7efcd80fe600 2024-03-12T16:01:52.689 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.687+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=osd_memory_target_autotune}] v 0) v1 -- 0x7efcd80fba10 con 0x7efcd80fe600 2024-03-12T16:01:52.689 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.687+0000 7efccf7fe700 1 -- 172.21.15.6:0/3369497233 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=osd_memory_target_autotune}]=0 v8)=0 v8) v1 ==== 127+0+0 (secure 0 0 0) 0x7efcd401e020 con 0x7efcd80fe600 2024-03-12T16:01:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7efcc4032750 msgr2=0x7efcc4034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 --2- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7efcc4032750 0x7efcc4034c10 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7efcc8009780 tx=0x7efcc8006cc0).stop 2024-03-12T16:01:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 msgr2=0x7efcd80fded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 --2- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fded0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7efcd4006b00 tx=0x7efcd40090f0).stop 2024-03-12T16:01:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 shutdown_connections 2024-03-12T16:01:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 --2- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7efcc4032750 0x7efcc4034c10 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 --2- 172.21.15.6:0/3369497233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcd80fe600 0x7efcd80fded0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 >> 172.21.15.6:0/3369497233 conn(0x7efcd80f6e20 msgr2=0x7efcd80f8730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 shutdown_connections 2024-03-12T16:01:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:52.689+0000 7efce0713700 1 -- 172.21.15.6:0/3369497233 wait complete. 2024-03-12T16:01:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.006+0000 7fae53670700 1 Processor -- start 2024-03-12T16:01:54.036 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.006+0000 7fae53670700 1 -- start start 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.007+0000 7fae53670700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c0ffc30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.007+0000 7fae53670700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c100120 con 0x7fae4c071c60 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.007+0000 7fae5140c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c0ffc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.007+0000 7fae5140c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c0ffc30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46564/0 (socket says 172.21.15.6:46564) 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.007+0000 7fae5140c700 1 -- 172.21.15.6:0/3154854125 learned_addr learned my addr 172.21.15.6:0/3154854125 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.007+0000 7fae5140c700 1 -- 172.21.15.6:0/3154854125 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae4c100260 con 0x7fae4c071c60 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.007+0000 7fae5140c700 1 --2- 172.21.15.6:0/3154854125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c0ffc30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fae3c009730 tx=0x7fae3c0090f0).ready entity=mon.0 client_cookie=e69d3e062034be6c server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae43fff700 1 -- 172.21.15.6:0/3154854125 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae3c00b6e0 con 0x7fae4c071c60 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae43fff700 1 -- 172.21.15.6:0/3154854125 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fae3c00bcd0 con 0x7fae4c071c60 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae43fff700 1 -- 172.21.15.6:0/3154854125 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae3c011cb0 con 0x7fae4c071c60 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae53670700 1 -- 172.21.15.6:0/3154854125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 msgr2=0x7fae4c0ffc30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae53670700 1 --2- 172.21.15.6:0/3154854125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c0ffc30 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7fae3c009730 tx=0x7fae3c0090f0).stop 2024-03-12T16:01:54.037 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae53670700 1 -- 172.21.15.6:0/3154854125 shutdown_connections 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae53670700 1 --2- 172.21.15.6:0/3154854125 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c0ffc30 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae53670700 1 -- 172.21.15.6:0/3154854125 >> 172.21.15.6:0/3154854125 conn(0x7fae4c0f76f0 msgr2=0x7fae4c0f9b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae53670700 1 -- 172.21.15.6:0/3154854125 shutdown_connections 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.008+0000 7fae53670700 1 -- 172.21.15.6:0/3154854125 wait complete. 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.009+0000 7fae53670700 1 Processor -- start 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.009+0000 7fae53670700 1 -- start start 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.009+0000 7fae53670700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c10bec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.009+0000 7fae53670700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae4c10c3b0 con 0x7fae4c071c60 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.009+0000 7fae5140c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c10bec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.009+0000 7fae5140c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c10bec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46570/0 (socket says 172.21.15.6:46570) 2024-03-12T16:01:54.038 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.009+0000 7fae5140c700 1 -- 172.21.15.6:0/3289280880 learned_addr learned my addr 172.21.15.6:0/3289280880 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.009+0000 7fae5140c700 1 -- 172.21.15.6:0/3289280880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae3c009370 con 0x7fae4c071c60 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.010+0000 7fae5140c700 1 --2- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c10bec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fae3c0118b0 tx=0x7fae3c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.010+0000 7fae427fc700 1 -- 172.21.15.6:0/3289280880 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae3c00be40 con 0x7fae4c071c60 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.010+0000 7fae427fc700 1 -- 172.21.15.6:0/3289280880 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fae3c01aad0 con 0x7fae4c071c60 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.010+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae4c10c5b0 con 0x7fae4c071c60 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.010+0000 7fae427fc700 1 -- 172.21.15.6:0/3289280880 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fae3c023a80 con 0x7fae4c071c60 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.010+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae4c10c9c0 con 0x7fae4c071c60 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.010+0000 7fae427fc700 1 -- 172.21.15.6:0/3289280880 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7fae3c023c70 con 0x7fae4c071c60 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.011+0000 7fae427fc700 1 --2- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fae38032750 0x7fae38034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.011+0000 7fae427fc700 1 -- 172.21.15.6:0/3289280880 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fae3c044c20 con 0x7fae4c071c60 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.011+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae4c046ce0 con 0x7fae4c071c60 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.011+0000 7fae50c0b700 1 --2- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fae38032750 0x7fae38034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.011+0000 7fae50c0b700 1 --2- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fae38032750 0x7fae38034c10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fae48009780 tx=0x7fae48006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:54.039 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.015+0000 7fae427fc700 1 -- 172.21.15.6:0/3289280880 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fae3c01e080 con 0x7fae4c071c60 2024-03-12T16:01:54.284 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.282+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config-key set, key=mgr/dashboard/cluster/status}] v 0) v1 -- 0x7fae4c105c40 con 0x7fae4c071c60 2024-03-12T16:01:54.285 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.285+0000 7fae427fc700 1 -- 172.21.15.6:0/3289280880 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config-key set, key=mgr/dashboard/cluster/status}]=0 set mgr/dashboard/cluster/status v29)=0 set mgr/dashboard/cluster/status v29) v1 ==== 153+0+0 (secure 0 0 0) 0x7fae3c02bd20 con 0x7fae4c071c60 2024-03-12T16:01:54.288 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.286+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fae38032750 msgr2=0x7fae38034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:54.288 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.286+0000 7fae53670700 1 --2- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fae38032750 0x7fae38034c10 secure :-1 s=READY pgs=10 cs=0 l=1 rev1=1 rx=0x7fae48009780 tx=0x7fae48006cc0).stop 2024-03-12T16:01:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.286+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 msgr2=0x7fae4c10bec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.286+0000 7fae53670700 1 --2- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c10bec0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7fae3c0118b0 tx=0x7fae3c0090f0).stop 2024-03-12T16:01:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.287+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 shutdown_connections 2024-03-12T16:01:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.287+0000 7fae53670700 1 --2- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fae38032750 0x7fae38034c10 unknown :-1 s=CLOSED pgs=10 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.287+0000 7fae53670700 1 --2- 172.21.15.6:0/3289280880 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae4c071c60 0x7fae4c10bec0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.287+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 >> 172.21.15.6:0/3289280880 conn(0x7fae4c0f76f0 msgr2=0x7fae4c0f9150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.287+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 shutdown_connections 2024-03-12T16:01:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: 2024-03-12T16:01:54.287+0000 7fae53670700 1 -- 172.21.15.6:0/3289280880 wait complete. 2024-03-12T16:01:54.289 INFO:teuthology.orchestra.run.smithi006.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-03-12T16:01:54.949 INFO:teuthology.orchestra.run.smithi006.stderr:You can access the Ceph CLI as following in case of multi-cluster or non-default config: 2024-03-12T16:01:54.949 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:54.949 INFO:teuthology.orchestra.run.smithi006.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-03-12T16:01:54.949 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:54.949 INFO:teuthology.orchestra.run.smithi006.stderr:Or, if you are only running a single cluster on this host: 2024-03-12T16:01:54.949 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:54.949 INFO:teuthology.orchestra.run.smithi006.stderr: sudo /home/ubuntu/cephtest/cephadm shell 2024-03-12T16:01:54.949 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:54.949 INFO:teuthology.orchestra.run.smithi006.stderr:Please consider enabling telemetry to help improve Ceph: 2024-03-12T16:01:54.950 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:54.950 INFO:teuthology.orchestra.run.smithi006.stderr: ceph telemetry on 2024-03-12T16:01:54.950 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:54.950 INFO:teuthology.orchestra.run.smithi006.stderr:For more information see: 2024-03-12T16:01:54.950 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:54.950 INFO:teuthology.orchestra.run.smithi006.stderr: https://docs.ceph.com/en/pacific/mgr/telemetry/ 2024-03-12T16:01:54.950 INFO:teuthology.orchestra.run.smithi006.stderr: 2024-03-12T16:01:54.950 INFO:teuthology.orchestra.run.smithi006.stderr:Bootstrap complete. 2024-03-12T16:01:54.996 INFO:tasks.cephadm:Fetching config... 2024-03-12T16:01:54.996 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:01:54.996 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-03-12T16:01:55.056 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-03-12T16:01:55.056 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:01:55.056 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-03-12T16:01:55.114 INFO:tasks.cephadm:Fetching mon keyring... 2024-03-12T16:01:55.115 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:01:55.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/keyring of=/dev/stdout 2024-03-12T16:01:55.184 INFO:tasks.cephadm:Fetching pub ssh key... 2024-03-12T16:01:55.184 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:01:55.184 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-03-12T16:01:55.242 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-03-12T16:01:55.243 DEBUG:teuthology.orchestra.run.smithi006:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyz1mgOQdoSFuhZB5fCw9R9WeOrznF+N6kc083aLiGim1QzJNN/zx5VpKBEo5GA44ULHQsNfYhiyh/gKExJizS+rXhCi23X0Ozh/D5bNv+HfNp47I4XJjC141uSS2zr7+uCnrBMT4USiGiSJPiexi33eKq2i4WENl5PRr2QrNk1q1uALyE9MJL3BRAtndcs7cT6zSL4G0the0nO9B10Hi7HKWBKMgUoBZY2yVhqRO1CQiRE8BYFG26WkwYZv4kJS3t19L7ZPQocNDhxNkHSTp/UgKK/fMvtcuuqpjo9J+dB6m4tOJ2ElSg9rhE8fBcVTr6d4QmTddBsLLOJY9dT7PRWLFuMvWl2wF7GGkXPigjdXD7+6XOr5/9k0EFTkVJdIhcJ8IDfdJXTdt2nhfQA+yf1Wt3m3EvyIctvsLe6WPj0LMVIJiNZfOwPWU3Bg7TyW7nZSkYWVrGYhYpbe71F+NEV2w++2KhYUe5sUvI2K8O6TeYY/F6lYzHpRtPbvv8P4c= ceph-88d7ee42-e089-11ee-95c8-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-12T16:01:55.323 INFO:teuthology.orchestra.run.smithi006.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyz1mgOQdoSFuhZB5fCw9R9WeOrznF+N6kc083aLiGim1QzJNN/zx5VpKBEo5GA44ULHQsNfYhiyh/gKExJizS+rXhCi23X0Ozh/D5bNv+HfNp47I4XJjC141uSS2zr7+uCnrBMT4USiGiSJPiexi33eKq2i4WENl5PRr2QrNk1q1uALyE9MJL3BRAtndcs7cT6zSL4G0the0nO9B10Hi7HKWBKMgUoBZY2yVhqRO1CQiRE8BYFG26WkwYZv4kJS3t19L7ZPQocNDhxNkHSTp/UgKK/fMvtcuuqpjo9J+dB6m4tOJ2ElSg9rhE8fBcVTr6d4QmTddBsLLOJY9dT7PRWLFuMvWl2wF7GGkXPigjdXD7+6XOr5/9k0EFTkVJdIhcJ8IDfdJXTdt2nhfQA+yf1Wt3m3EvyIctvsLe6WPj0LMVIJiNZfOwPWU3Bg7TyW7nZSkYWVrGYhYpbe71F+NEV2w++2KhYUe5sUvI2K8O6TeYY/F6lYzHpRtPbvv8P4c= ceph-88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:01:55.335 DEBUG:teuthology.orchestra.run.smithi134:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyz1mgOQdoSFuhZB5fCw9R9WeOrznF+N6kc083aLiGim1QzJNN/zx5VpKBEo5GA44ULHQsNfYhiyh/gKExJizS+rXhCi23X0Ozh/D5bNv+HfNp47I4XJjC141uSS2zr7+uCnrBMT4USiGiSJPiexi33eKq2i4WENl5PRr2QrNk1q1uALyE9MJL3BRAtndcs7cT6zSL4G0the0nO9B10Hi7HKWBKMgUoBZY2yVhqRO1CQiRE8BYFG26WkwYZv4kJS3t19L7ZPQocNDhxNkHSTp/UgKK/fMvtcuuqpjo9J+dB6m4tOJ2ElSg9rhE8fBcVTr6d4QmTddBsLLOJY9dT7PRWLFuMvWl2wF7GGkXPigjdXD7+6XOr5/9k0EFTkVJdIhcJ8IDfdJXTdt2nhfQA+yf1Wt3m3EvyIctvsLe6WPj0LMVIJiNZfOwPWU3Bg7TyW7nZSkYWVrGYhYpbe71F+NEV2w++2KhYUe5sUvI2K8O6TeYY/F6lYzHpRtPbvv8P4c= ceph-88d7ee42-e089-11ee-95c8-87774f69a715' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-03-12T16:01:55.380 INFO:teuthology.orchestra.run.smithi134.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQCyz1mgOQdoSFuhZB5fCw9R9WeOrznF+N6kc083aLiGim1QzJNN/zx5VpKBEo5GA44ULHQsNfYhiyh/gKExJizS+rXhCi23X0Ozh/D5bNv+HfNp47I4XJjC141uSS2zr7+uCnrBMT4USiGiSJPiexi33eKq2i4WENl5PRr2QrNk1q1uALyE9MJL3BRAtndcs7cT6zSL4G0the0nO9B10Hi7HKWBKMgUoBZY2yVhqRO1CQiRE8BYFG26WkwYZv4kJS3t19L7ZPQocNDhxNkHSTp/UgKK/fMvtcuuqpjo9J+dB6m4tOJ2ElSg9rhE8fBcVTr6d4QmTddBsLLOJY9dT7PRWLFuMvWl2wF7GGkXPigjdXD7+6XOr5/9k0EFTkVJdIhcJ8IDfdJXTdt2nhfQA+yf1Wt3m3EvyIctvsLe6WPj0LMVIJiNZfOwPWU3Bg7TyW7nZSkYWVrGYhYpbe71F+NEV2w++2KhYUe5sUvI2K8O6TeYY/F6lYzHpRtPbvv8P4c= ceph-88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:01:55.392 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-03-12T16:01:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:54.285460+0000 mon.smithi006 (mon.0) 93 : audit [INF] from='client.? 172.21.15.6:0/3289280880' entity='client.admin' 2024-03-12T16:01:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.260+0000 7fbb9c210700 1 -- 172.21.15.6:0/2913400049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 msgr2=0x7fbb940fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:58.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.260+0000 7fbb9c210700 1 --2- 172.21.15.6:0/2913400049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 0x7fbb940fa190 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7fbb90004770 tx=0x7fbb90009cb0).stop 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.260+0000 7fbb9c210700 1 -- 172.21.15.6:0/2913400049 shutdown_connections 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.260+0000 7fbb9c210700 1 --2- 172.21.15.6:0/2913400049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 0x7fbb940fa190 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.260+0000 7fbb9c210700 1 -- 172.21.15.6:0/2913400049 >> 172.21.15.6:0/2913400049 conn(0x7fbb940f1c10 msgr2=0x7fbb940f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.260+0000 7fbb9c210700 1 -- 172.21.15.6:0/2913400049 shutdown_connections 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.260+0000 7fbb9c210700 1 -- 172.21.15.6:0/2913400049 wait complete. 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.261+0000 7fbb9c210700 1 Processor -- start 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.261+0000 7fbb9c210700 1 -- start start 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.261+0000 7fbb9c210700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 0x7fbb941077d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.261+0000 7fbb9c210700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbb94107cc0 con 0x7fbb940611f0 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.261+0000 7fbb99fac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 0x7fbb941077d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.261+0000 7fbb99fac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 0x7fbb941077d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46588/0 (socket says 172.21.15.6:46588) 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.261+0000 7fbb99fac700 1 -- 172.21.15.6:0/373745175 learned_addr learned my addr 172.21.15.6:0/373745175 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.261+0000 7fbb99fac700 1 -- 172.21.15.6:0/373745175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbb90005040 con 0x7fbb940611f0 2024-03-12T16:01:58.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.262+0000 7fbb99fac700 1 --2- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 0x7fbb941077d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fbb90004740 tx=0x7fbb90009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.262+0000 7fbb8affd700 1 -- 172.21.15.6:0/373745175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb90018070 con 0x7fbb940611f0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.262+0000 7fbb8affd700 1 -- 172.21.15.6:0/373745175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbb90013e30 con 0x7fbb940611f0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.262+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbb94107ec0 con 0x7fbb940611f0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.262+0000 7fbb8affd700 1 -- 172.21.15.6:0/373745175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fbb9001d600 con 0x7fbb940611f0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.262+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbb94108350 con 0x7fbb940611f0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.262+0000 7fbb8affd700 1 -- 172.21.15.6:0/373745175 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7fbb9001d760 con 0x7fbb940611f0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.263+0000 7fbb8affd700 1 --2- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fbb80032750 0x7fbb80034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.263+0000 7fbb8affd700 1 -- 172.21.15.6:0/373745175 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fbb90044f90 con 0x7fbb940611f0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.263+0000 7fbb997ab700 1 --2- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fbb80032750 0x7fbb80034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.263+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbb9405a310 con 0x7fbb940611f0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.263+0000 7fbb997ab700 1 --2- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fbb80032750 0x7fbb80034c10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbb84009780 tx=0x7fbb84006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:01:58.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.267+0000 7fbb8affd700 1 -- 172.21.15.6:0/373745175 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbb9001bb60 con 0x7fbb940611f0 2024-03-12T16:01:58.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.442+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/allow_ptrace}] v 0) v1 -- 0x7fbb94046ce0 con 0x7fbb940611f0 2024-03-12T16:01:58.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.447+0000 7fbb8affd700 1 -- 172.21.15.6:0/373745175 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/allow_ptrace}]=0 v9)=0 v9) v1 ==== 125+0+0 (secure 0 0 0) 0x7fbb9001bb60 con 0x7fbb940611f0 2024-03-12T16:01:58.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.449+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fbb80032750 msgr2=0x7fbb80034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:58.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.449+0000 7fbb9c210700 1 --2- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fbb80032750 0x7fbb80034c10 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 rx=0x7fbb84009780 tx=0x7fbb84006cc0).stop 2024-03-12T16:01:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.449+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 msgr2=0x7fbb941077d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:01:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.449+0000 7fbb9c210700 1 --2- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 0x7fbb941077d0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7fbb90004740 tx=0x7fbb90009cb0).stop 2024-03-12T16:01:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.449+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 shutdown_connections 2024-03-12T16:01:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.449+0000 7fbb9c210700 1 --2- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fbb80032750 0x7fbb80034c10 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.449+0000 7fbb9c210700 1 --2- 172.21.15.6:0/373745175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbb940611f0 0x7fbb941077d0 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:01:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.449+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 >> 172.21.15.6:0/373745175 conn(0x7fbb940f1c10 msgr2=0x7fbb940f25e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:01:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.450+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 shutdown_connections 2024-03-12T16:01:58.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:01:58.450+0000 7fbb9c210700 1 -- 172.21.15.6:0/373745175 wait complete. 2024-03-12T16:01:58.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:57.516500+0000 mon.smithi006 (mon.0) 94 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:58.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:58.046674+0000 mon.smithi006 (mon.0) 95 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:01:58.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:58.050208+0000 mon.smithi006 (mon.0) 96 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:01:58.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:01:58.448218+0000 mon.smithi006 (mon.0) 97 : audit [INF] from='client.? 172.21.15.6:0/373745175' entity='client.admin' 2024-03-12T16:01:59.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:01:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:01:58.058903+0000 mgr.smithi006.kskdce (mgr.14156) 5 : cephadm [INF] Deploying daemon alertmanager.smithi006 on smithi006 2024-03-12T16:01:59.730 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-03-12T16:01:59.731 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.183+0000 7f3f97fb9700 1 -- 172.21.15.6:0/1321915505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 msgr2=0x7f3f900f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.183+0000 7f3f97fb9700 1 --2- 172.21.15.6:0/1321915505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 0x7f3f900f79e0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f3f8c004770 tx=0x7f3f8c009cb0).stop 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.183+0000 7f3f97fb9700 1 -- 172.21.15.6:0/1321915505 shutdown_connections 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.183+0000 7f3f97fb9700 1 --2- 172.21.15.6:0/1321915505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 0x7f3f900f79e0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.183+0000 7f3f97fb9700 1 -- 172.21.15.6:0/1321915505 >> 172.21.15.6:0/1321915505 conn(0x7f3f900f2d40 msgr2=0x7f3f900f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.183+0000 7f3f97fb9700 1 -- 172.21.15.6:0/1321915505 shutdown_connections 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.183+0000 7f3f97fb9700 1 -- 172.21.15.6:0/1321915505 wait complete. 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f97fb9700 1 Processor -- start 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f97fb9700 1 -- start start 2024-03-12T16:02:02.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f97fb9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 0x7f3f90107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f97fb9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f90107d30 con 0x7f3f900f75c0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f95d55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 0x7f3f90107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f95d55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 0x7f3f90107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46608/0 (socket says 172.21.15.6:46608) 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f95d55700 1 -- 172.21.15.6:0/3824448917 learned_addr learned my addr 172.21.15.6:0/3824448917 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f95d55700 1 -- 172.21.15.6:0/3824448917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f8c005040 con 0x7f3f900f75c0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f95d55700 1 --2- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 0x7f3f90107840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3f8c0099b0 tx=0x7f3f8c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.184+0000 7f3f86ffd700 1 -- 172.21.15.6:0/3824448917 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f8c018070 con 0x7f3f900f75c0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.185+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f90107f30 con 0x7f3f900f75c0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.185+0000 7f3f86ffd700 1 -- 172.21.15.6:0/3824448917 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3f8c013730 con 0x7f3f900f75c0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.185+0000 7f3f86ffd700 1 -- 172.21.15.6:0/3824448917 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3f8c01d460 con 0x7f3f900f75c0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.185+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f901083c0 con 0x7f3f900f75c0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.186+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f90046ce0 con 0x7f3f900f75c0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.186+0000 7f3f86ffd700 1 -- 172.21.15.6:0/3824448917 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7f3f8c0125d0 con 0x7f3f900f75c0 2024-03-12T16:02:02.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.186+0000 7f3f86ffd700 1 --2- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3f7c0326d0 0x7f3f7c034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.187+0000 7f3f86ffd700 1 -- 172.21.15.6:0/3824448917 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f3f8c044290 con 0x7f3f900f75c0 2024-03-12T16:02:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.187+0000 7f3f95554700 1 --2- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3f7c0326d0 0x7f3f7c034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.187+0000 7f3f95554700 1 --2- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3f7c0326d0 0x7f3f7c034b90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f3f80009780 tx=0x7f3f80006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:02.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.191+0000 7f3f86ffd700 1 -- 172.21.15.6:0/3824448917 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3f8c025ce0 con 0x7f3f900f75c0 2024-03-12T16:02:02.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.387+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 --> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] -- mgr_command(tid 0: {"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f900f3ea0 con 0x7f3f7c0326d0 2024-03-12T16:02:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.390+0000 7f3f86ffd700 1 -- 172.21.15.6:0/3824448917 <== mgr.14156 v2:172.21.15.6:6800/3591243488 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7f3f900f3ea0 con 0x7f3f7c0326d0 2024-03-12T16:02:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3f7c0326d0 msgr2=0x7f3f7c034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 --2- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3f7c0326d0 0x7f3f7c034b90 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f3f80009780 tx=0x7f3f80006cc0).stop 2024-03-12T16:02:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 msgr2=0x7f3f90107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 --2- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 0x7f3f90107840 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f3f8c0099b0 tx=0x7f3f8c009cb0).stop 2024-03-12T16:02:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 shutdown_connections 2024-03-12T16:02:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 --2- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f3f7c0326d0 0x7f3f7c034b90 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 --2- 172.21.15.6:0/3824448917 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f900f75c0 0x7f3f90107840 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 >> 172.21.15.6:0/3824448917 conn(0x7f3f900f2d40 msgr2=0x7f3f900f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:02.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 shutdown_connections 2024-03-12T16:02:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:02.392+0000 7f3f97fb9700 1 -- 172.21.15.6:0/3824448917 wait complete. 2024-03-12T16:02:03.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:02.388155+0000 mgr.smithi006.kskdce (mgr.14156) 6 : audit [DBG] from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:02:03.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:02.390525+0000 mon.smithi006 (mon.0) 98 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:04.094 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi134 2024-03-12T16:02:04.095 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T16:02:04.095 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.conf 2024-03-12T16:02:04.117 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T16:02:04.117 DEBUG:teuthology.orchestra.run.smithi134:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:02:04.179 INFO:tasks.cephadm:Adding host smithi134 to orchestrator... 2024-03-12T16:02:04.179 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch host add smithi134 2024-03-12T16:02:05.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:04.402967+0000 mgr.smithi006.kskdce (mgr.14156) 7 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:07.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:06.403285+0000 mgr.smithi006.kskdce (mgr.14156) 8 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.453+0000 7fead7b75700 1 -- 172.21.15.6:0/1853361215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 msgr2=0x7fead00f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.453+0000 7fead7b75700 1 --2- 172.21.15.6:0/1853361215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 0x7fead00f79e0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7feac0004770 tx=0x7feac0009cb0).stop 2024-03-12T16:02:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.453+0000 7fead7b75700 1 -- 172.21.15.6:0/1853361215 shutdown_connections 2024-03-12T16:02:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.453+0000 7fead7b75700 1 --2- 172.21.15.6:0/1853361215 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 0x7fead00f79e0 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.453+0000 7fead7b75700 1 -- 172.21.15.6:0/1853361215 >> 172.21.15.6:0/1853361215 conn(0x7fead00f2d40 msgr2=0x7fead00f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.453+0000 7fead7b75700 1 -- 172.21.15.6:0/1853361215 shutdown_connections 2024-03-12T16:02:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.453+0000 7fead7b75700 1 -- 172.21.15.6:0/1853361215 wait complete. 2024-03-12T16:02:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7fead7b75700 1 Processor -- start 2024-03-12T16:02:08.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7fead7b75700 1 -- start start 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7fead7b75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 0x7fead0109a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7fead7b75700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fead0109f30 con 0x7fead00f75c0 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7fead5911700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 0x7fead0109a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7fead5911700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 0x7fead0109a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38938/0 (socket says 172.21.15.6:38938) 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7fead5911700 1 -- 172.21.15.6:0/1438327472 learned_addr learned my addr 172.21.15.6:0/1438327472 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7fead5911700 1 -- 172.21.15.6:0/1438327472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feac0005040 con 0x7fead00f75c0 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7fead5911700 1 --2- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 0x7fead0109a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7feac0009300 tx=0x7feac0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.454+0000 7feac6ffd700 1 -- 172.21.15.6:0/1438327472 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feac0018070 con 0x7fead00f75c0 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.455+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fead010a130 con 0x7fead00f75c0 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.455+0000 7feac6ffd700 1 -- 172.21.15.6:0/1438327472 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7feac0009890 con 0x7fead00f75c0 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.455+0000 7feac6ffd700 1 -- 172.21.15.6:0/1438327472 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7feac001c400 con 0x7fead00f75c0 2024-03-12T16:02:08.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.455+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fead010a5c0 con 0x7fead00f75c0 2024-03-12T16:02:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.455+0000 7feac6ffd700 1 -- 172.21.15.6:0/1438327472 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7feac001d420 con 0x7fead00f75c0 2024-03-12T16:02:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.456+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fead0046ce0 con 0x7fead00f75c0 2024-03-12T16:02:08.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.456+0000 7feac6ffd700 1 --2- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7feabc032700 0x7feabc034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.456+0000 7feac6ffd700 1 -- 172.21.15.6:0/1438327472 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7feac0044690 con 0x7fead00f75c0 2024-03-12T16:02:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.456+0000 7fead5110700 1 --2- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7feabc032700 0x7feabc034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:08.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.456+0000 7fead5110700 1 --2- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7feabc032700 0x7feabc034bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7feacc009780 tx=0x7feacc006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:08.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.462+0000 7feac6ffd700 1 -- 172.21.15.6:0/1438327472 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7feac0025ce0 con 0x7fead00f75c0 2024-03-12T16:02:08.640 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:08.639+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 --> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] -- mgr_command(tid 0: {"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}) v1 -- 0x7fead00f3e60 con 0x7feabc032700 2024-03-12T16:02:09.293 INFO:teuthology.orchestra.run.smithi006.stdout:Added host 'smithi134' with addr '172.21.15.134' 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.290+0000 7feac6ffd700 1 -- 172.21.15.6:0/1438327472 <== mgr.14156 v2:172.21.15.6:6800/3591243488 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+49 (secure 0 0 0) 0x7fead00f3e60 con 0x7feabc032700 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7feabc032700 msgr2=0x7feabc034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 --2- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7feabc032700 0x7feabc034bc0 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7feacc009780 tx=0x7feacc006cc0).stop 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 msgr2=0x7fead0109a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 --2- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 0x7fead0109a40 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7feac0009300 tx=0x7feac0009cb0).stop 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 shutdown_connections 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 --2- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7feabc032700 0x7feabc034bc0 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 --2- 172.21.15.6:0/1438327472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fead00f75c0 0x7fead0109a40 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 >> 172.21.15.6:0/1438327472 conn(0x7fead00f2d40 msgr2=0x7fead00f3750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:09.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 shutdown_connections 2024-03-12T16:02:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:09.293+0000 7fead7b75700 1 -- 172.21.15.6:0/1438327472 wait complete. 2024-03-12T16:02:09.691 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:08.403556+0000 mgr.smithi006.kskdce (mgr.14156) 9 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:09.691 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:08.640544+0000 mgr.smithi006.kskdce (mgr.14156) 10 : audit [DBG] from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:02:09.691 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:09.290518+0000 mon.smithi006 (mon.0) 99 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:10.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch host ls --format=json 2024-03-12T16:02:10.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:10 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:09.290815+0000 mgr.smithi006.kskdce (mgr.14156) 11 : cephadm [INF] Added host smithi134 2024-03-12T16:02:11.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:10.403828+0000 mgr.smithi006.kskdce (mgr.14156) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:11.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:10.565695+0000 mon.smithi006 (mon.0) 100 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:11.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:10.567717+0000 mon.smithi006 (mon.0) 101 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi006", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:02:11.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:10.569592+0000 mon.smithi006 (mon.0) 102 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi006", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-12T16:02:11.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:10.570307+0000 mon.smithi006 (mon.0) 103 : audit [DBG] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:02:11.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:10.571097+0000 mgr.smithi006.kskdce (mgr.14156) 13 : cephadm [INF] Deploying daemon crash.smithi006 on smithi006 2024-03-12T16:02:13.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.202+0000 7f0710266700 1 -- 172.21.15.6:0/1823842620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 msgr2=0x7f07080f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.202+0000 7f0710266700 1 --2- 172.21.15.6:0/1823842620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 0x7f07080f79e0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f0704004770 tx=0x7f0704009cb0).stop 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.202+0000 7f0710266700 1 -- 172.21.15.6:0/1823842620 shutdown_connections 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.202+0000 7f0710266700 1 --2- 172.21.15.6:0/1823842620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 0x7f07080f79e0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.202+0000 7f0710266700 1 -- 172.21.15.6:0/1823842620 >> 172.21.15.6:0/1823842620 conn(0x7f07080f2d40 msgr2=0x7f07080f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.202+0000 7f0710266700 1 -- 172.21.15.6:0/1823842620 shutdown_connections 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.202+0000 7f0710266700 1 -- 172.21.15.6:0/1823842620 wait complete. 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.202+0000 7f0710266700 1 Processor -- start 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.202+0000 7f0710266700 1 -- start start 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f0710266700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 0x7f0708107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f0710266700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0708107d30 con 0x7f07080f75c0 2024-03-12T16:02:13.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f070e002700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 0x7f0708107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f070e002700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 0x7f0708107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49832/0 (socket says 172.21.15.6:49832) 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f070e002700 1 -- 172.21.15.6:0/539700410 learned_addr learned my addr 172.21.15.6:0/539700410 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f070e002700 1 -- 172.21.15.6:0/539700410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0704005040 con 0x7f07080f75c0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f070e002700 1 --2- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 0x7f0708107840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0704009300 tx=0x7f0704009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f06faffd700 1 -- 172.21.15.6:0/539700410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f0704018070 con 0x7f07080f75c0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f06faffd700 1 -- 172.21.15.6:0/539700410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0704009890 con 0x7f07080f75c0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0708107f30 con 0x7f07080f75c0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f06faffd700 1 -- 172.21.15.6:0/539700410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f070401c400 con 0x7f07080f75c0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.203+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07081083c0 con 0x7f07080f75c0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.204+0000 7f06faffd700 1 -- 172.21.15.6:0/539700410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7f070401c670 con 0x7f07080f75c0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.204+0000 7f06faffd700 1 --2- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f06f4032750 0x7f06f4034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.204+0000 7f06faffd700 1 -- 172.21.15.6:0/539700410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f07040446b0 con 0x7f07080f75c0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.204+0000 7f070d801700 1 --2- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f06f4032750 0x7f06f4034c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:13.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.204+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f070805a310 con 0x7f07080f75c0 2024-03-12T16:02:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.205+0000 7f070d801700 1 --2- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f06f4032750 0x7f06f4034c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f06fc009780 tx=0x7f06fc006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:13.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.209+0000 7f06faffd700 1 -- 172.21.15.6:0/539700410 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f070401ca10 con 0x7f07080f75c0 2024-03-12T16:02:13.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.386+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 --> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f07080f3ea0 con 0x7f06f4032750 2024-03-12T16:02:13.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.387+0000 7f06faffd700 1 -- 172.21.15.6:0/539700410 <== mgr.14156 v2:172.21.15.6:6800/3591243488 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+159 (secure 0 0 0) 0x7f07080f3ea0 con 0x7f06f4032750 2024-03-12T16:02:13.388 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:02:13.388 INFO:teuthology.orchestra.run.smithi006.stdout:[{"addr": "172.21.15.6", "hostname": "smithi006", "labels": [], "status": ""}, {"addr": "172.21.15.134", "hostname": "smithi134", "labels": [], "status": ""}] 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f06f4032750 msgr2=0x7f06f4034c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 --2- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f06f4032750 0x7f06f4034c10 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 rx=0x7f06fc009780 tx=0x7f06fc006cc0).stop 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 msgr2=0x7f0708107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 --2- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 0x7f0708107840 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f0704009300 tx=0x7f0704009cb0).stop 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 shutdown_connections 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 --2- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f06f4032750 0x7f06f4034c10 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 --2- 172.21.15.6:0/539700410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07080f75c0 0x7f0708107840 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 >> 172.21.15.6:0/539700410 conn(0x7f07080f2d40 msgr2=0x7f07080f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 shutdown_connections 2024-03-12T16:02:13.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:13.389+0000 7f0710266700 1 -- 172.21.15.6:0/539700410 wait complete. 2024-03-12T16:02:13.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:12.404092+0000 mgr.smithi006.kskdce (mgr.14156) 14 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:14.206 INFO:tasks.cephadm:Setting crush tunables to default 2024-03-12T16:02:14.207 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd crush tunables default 2024-03-12T16:02:14.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:13.387324+0000 mgr.smithi006.kskdce (mgr.14156) 15 : audit [DBG] from='client.14182 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-12T16:02:14.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:14.361710+0000 mon.smithi006 (mon.0) 104 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:14.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:14.480545+0000 mon.smithi006 (mon.0) 105 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:14.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:14.483098+0000 mon.smithi006 (mon.0) 106 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:14.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:14.484477+0000 mon.smithi006 (mon.0) 107 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-12T16:02:14.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:14.487872+0000 mon.smithi006 (mon.0) 108 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:14.917 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:14.543552+0000 mon.smithi006 (mon.0) 109 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:15.852 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:14.404306+0000 mgr.smithi006.kskdce (mgr.14156) 16 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:15.852 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:14.484807+0000 mgr.smithi006.kskdce (mgr.14156) 17 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-03-12T16:02:15.852 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:14.494210+0000 mgr.smithi006.kskdce (mgr.14156) 18 : cephadm [INF] Deploying daemon grafana.smithi006 on smithi006 2024-03-12T16:02:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.112+0000 7f2635d62700 1 -- 172.21.15.6:0/926445959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 msgr2=0x7f26300f6900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.112+0000 7f2635d62700 1 --2- 172.21.15.6:0/926445959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 0x7f26300f6900 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f2620004770 tx=0x7f2620009cb0).stop 2024-03-12T16:02:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.112+0000 7f2635d62700 1 -- 172.21.15.6:0/926445959 shutdown_connections 2024-03-12T16:02:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.112+0000 7f2635d62700 1 --2- 172.21.15.6:0/926445959 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 0x7f26300f6900 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.112+0000 7f2635d62700 1 -- 172.21.15.6:0/926445959 >> 172.21.15.6:0/926445959 conn(0x7f26300f1c40 msgr2=0x7f26300f4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.112+0000 7f2635d62700 1 -- 172.21.15.6:0/926445959 shutdown_connections 2024-03-12T16:02:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.112+0000 7f2635d62700 1 -- 172.21.15.6:0/926445959 wait complete. 2024-03-12T16:02:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.112+0000 7f2635d62700 1 Processor -- start 2024-03-12T16:02:16.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f2635d62700 1 -- start start 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f2635d62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 0x7f2630107810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f2635d62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2630107d00 con 0x7f26300f64e0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f262f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 0x7f2630107810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f262f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 0x7f2630107810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49856/0 (socket says 172.21.15.6:49856) 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f262f7fe700 1 -- 172.21.15.6:0/2270414826 learned_addr learned my addr 172.21.15.6:0/2270414826 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f262f7fe700 1 -- 172.21.15.6:0/2270414826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2620005040 con 0x7f26300f64e0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f262f7fe700 1 --2- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 0x7f2630107810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2620009300 tx=0x7f2620009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f262cff9700 1 -- 172.21.15.6:0/2270414826 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f2620018070 con 0x7f26300f64e0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2630107f00 con 0x7f26300f64e0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f262cff9700 1 -- 172.21.15.6:0/2270414826 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2620009890 con 0x7f26300f64e0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f262cff9700 1 -- 172.21.15.6:0/2270414826 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f262001c400 con 0x7f26300f64e0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.113+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2630108390 con 0x7f26300f64e0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.114+0000 7f262cff9700 1 -- 172.21.15.6:0/2270414826 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7f262001c6c0 con 0x7f26300f64e0 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.114+0000 7f262cff9700 1 --2- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f2618032700 0x7f2618034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:16.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.114+0000 7f262cff9700 1 -- 172.21.15.6:0/2270414826 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(3..3 src has 1..3) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f26200445a0 con 0x7f26300f64e0 2024-03-12T16:02:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.114+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2630046ce0 con 0x7f26300f64e0 2024-03-12T16:02:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.114+0000 7f262effd700 1 --2- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f2618032700 0x7f2618034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.115+0000 7f262effd700 1 --2- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f2618032700 0x7f2618034bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f2624009780 tx=0x7f2624006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:16.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.119+0000 7f262cff9700 1 -- 172.21.15.6:0/2270414826 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f262001ca60 con 0x7f26300f64e0 2024-03-12T16:02:16.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.296+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) v1 -- 0x7f26301091a0 con 0x7f26300f64e0 2024-03-12T16:02:16.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.571+0000 7f262cff9700 1 -- 172.21.15.6:0/2270414826 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v4) v1 ==== 124+0+0 (secure 0 0 0) 0x7f262001b370 con 0x7f26300f64e0 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.573+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f2618032700 msgr2=0x7f2618034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.573+0000 7f2635d62700 1 --2- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f2618032700 0x7f2618034bc0 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 rx=0x7f2624009780 tx=0x7f2624006cc0).stop 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.573+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 msgr2=0x7f2630107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.573+0000 7f2635d62700 1 --2- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 0x7f2630107810 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f2620009300 tx=0x7f2620009cb0).stop 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.573+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 shutdown_connections 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.573+0000 7f2635d62700 1 --2- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f2618032700 0x7f2618034bc0 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.573+0000 7f2635d62700 1 --2- 172.21.15.6:0/2270414826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26300f64e0 0x7f2630107810 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.573+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 >> 172.21.15.6:0/2270414826 conn(0x7f26300f1c40 msgr2=0x7f2630060e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.574+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 shutdown_connections 2024-03-12T16:02:16.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:02:16.574+0000 7f2635d62700 1 -- 172.21.15.6:0/2270414826 wait complete. 2024-03-12T16:02:16.576 INFO:teuthology.orchestra.run.smithi006.stderr:adjusted tunables profile to default 2024-03-12T16:02:16.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:16.296918+0000 mon.smithi006 (mon.0) 110 : audit [INF] from='client.? 172.21.15.6:0/2270414826' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-03-12T16:02:17.315 INFO:tasks.cephadm:Adding mon.smithi006 on smithi006 2024-03-12T16:02:17.315 INFO:tasks.cephadm:Adding mon.smithi134 on smithi134 2024-03-12T16:02:17.316 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch apply mon '2;smithi006:172.21.15.6=smithi006;smithi134:172.21.15.134=smithi134' 2024-03-12T16:02:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:16.404668+0000 mgr.smithi006.kskdce (mgr.14156) 19 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:16.572260+0000 mon.smithi006 (mon.0) 111 : audit [INF] from='client.? 172.21.15.6:0/2270414826' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-03-12T16:02:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:16.572305+0000 mon.smithi006 (mon.0) 112 : cluster [DBG] osdmap e4: 0 total, 0 up, 0 in 2024-03-12T16:02:19.188 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.184+0000 7f355995a700 1 -- 172.21.15.134:0/3283641506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 msgr2=0x7f35540f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.184+0000 7f355995a700 1 --2- 172.21.15.134:0/3283641506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 0x7f35540f68e0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7f3548004770 tx=0x7f3548009cb0).stop 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.184+0000 7f355995a700 1 -- 172.21.15.134:0/3283641506 shutdown_connections 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.184+0000 7f355995a700 1 --2- 172.21.15.134:0/3283641506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 0x7f35540f68e0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.184+0000 7f355995a700 1 -- 172.21.15.134:0/3283641506 >> 172.21.15.134:0/3283641506 conn(0x7f35540f1c40 msgr2=0x7f35540f4060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.184+0000 7f355995a700 1 -- 172.21.15.134:0/3283641506 shutdown_connections 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.184+0000 7f355995a700 1 -- 172.21.15.134:0/3283641506 wait complete. 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.184+0000 7f355995a700 1 Processor -- start 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.185+0000 7f355995a700 1 -- start start 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.185+0000 7f355995a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 0x7f355410a580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.185+0000 7f355995a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f35540612a0 con 0x7f35540f64c0 2024-03-12T16:02:19.189 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.185+0000 7f3552ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 0x7f355410a580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.185+0000 7f3552ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 0x7f355410a580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:55294/0 (socket says 172.21.15.134:55294) 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.185+0000 7f3552ffd700 1 -- 172.21.15.134:0/2025324635 learned_addr learned my addr 172.21.15.134:0/2025324635 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.185+0000 7f3552ffd700 1 -- 172.21.15.134:0/2025324635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3548005040 con 0x7f35540f64c0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.185+0000 7f3552ffd700 1 --2- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 0x7f355410a580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3548009300 tx=0x7f3548009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.185+0000 7f353bfff700 1 -- 172.21.15.134:0/2025324635 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f3548018070 con 0x7f35540f64c0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.186+0000 7f353bfff700 1 -- 172.21.15.134:0/2025324635 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3548009890 con 0x7f35540f64c0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.186+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f35540614a0 con 0x7f35540f64c0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.186+0000 7f353bfff700 1 -- 172.21.15.134:0/2025324635 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f354801c400 con 0x7f35540f64c0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.186+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355410ac30 con 0x7f35540f64c0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.186+0000 7f353bfff700 1 -- 172.21.15.134:0/2025324635 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7f354801d420 con 0x7f35540f64c0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.186+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f355405a310 con 0x7f35540f64c0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.186+0000 7f353bfff700 1 --2- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f353c032700 0x7f353c034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.187+0000 7f353bfff700 1 -- 172.21.15.134:0/2025324635 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f35480446a0 con 0x7f35540f64c0 2024-03-12T16:02:19.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.187+0000 7f35527fc700 1 --2- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f353c032700 0x7f353c034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:19.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.187+0000 7f35527fc700 1 --2- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f353c032700 0x7f353c034bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3544009780 tx=0x7f3544006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:19.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.191+0000 7f353bfff700 1 -- 172.21.15.134:0/2025324635 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3548025b40 con 0x7f35540f64c0 2024-03-12T16:02:19.364 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.362+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 --> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] -- mgr_command(tid 0: {"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi006:172.21.15.6=smithi006;smithi134:172.21.15.134=smithi134", "target": ["mon-mgr", ""]}) v1 -- 0x7f35540f2ec0 con 0x7f353c032700 2024-03-12T16:02:19.370 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.369+0000 7f353bfff700 1 -- 172.21.15.134:0/2025324635 <== mgr.14156 v2:172.21.15.6:6800/3591243488 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+24 (secure 0 0 0) 0x7f35540f2ec0 con 0x7f353c032700 2024-03-12T16:02:19.370 INFO:teuthology.orchestra.run.smithi134.stdout:Scheduled mon update... 2024-03-12T16:02:19.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.369+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f353c032700 msgr2=0x7f353c034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:19.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.369+0000 7f355995a700 1 --2- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f353c032700 0x7f353c034bc0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f3544009780 tx=0x7f3544006cc0).stop 2024-03-12T16:02:19.371 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.369+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 msgr2=0x7f355410a580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:19.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.369+0000 7f355995a700 1 --2- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 0x7f355410a580 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f3548009300 tx=0x7f3548009cb0).stop 2024-03-12T16:02:19.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.369+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 shutdown_connections 2024-03-12T16:02:19.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.369+0000 7f355995a700 1 --2- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f353c032700 0x7f353c034bc0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:19.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.369+0000 7f355995a700 1 --2- 172.21.15.134:0/2025324635 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540f64c0 0x7f355410a580 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:19.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.369+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 >> 172.21.15.134:0/2025324635 conn(0x7f35540f1c40 msgr2=0x7f35540f2700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:19.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.370+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 shutdown_connections 2024-03-12T16:02:19.372 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:19.370+0000 7f355995a700 1 -- 172.21.15.134:0/2025324635 wait complete. 2024-03-12T16:02:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:18.404882+0000 mgr.smithi006.kskdce (mgr.14156) 20 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:19.368858+0000 mon.smithi006 (mon.0) 113 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:20.009 DEBUG:teuthology.orchestra.run.smithi134:mon.smithi134> sudo journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi134.service 2024-03-12T16:02:20.011 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:20.011 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:20.039 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:-- Logs begin at Tue 2024-03-12 15:47:40 UTC. -- 2024-03-12T16:02:20.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:19.364536+0000 mgr.smithi006.kskdce (mgr.14156) 21 : audit [DBG] from='client.14186 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "2;smithi006:172.21.15.6=smithi006;smithi134:172.21.15.134=smithi134", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:02:20.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:19.366472+0000 mgr.smithi006.kskdce (mgr.14156) 22 : cephadm [INF] Saving service mon spec with placement smithi006:172.21.15.6=smithi006;smithi134:172.21.15.134=smithi134;count:2 2024-03-12T16:02:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.894+0000 7f88fce86700 1 -- 172.21.15.134:0/2804568184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 msgr2=0x7f88f80f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.894+0000 7f88fce86700 1 --2- 172.21.15.134:0/2804568184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 0x7f88f80f68d0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f88ec004770 tx=0x7f88ec009cb0).stop 2024-03-12T16:02:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.894+0000 7f88fce86700 1 -- 172.21.15.134:0/2804568184 shutdown_connections 2024-03-12T16:02:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.894+0000 7f88fce86700 1 --2- 172.21.15.134:0/2804568184 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 0x7f88f80f68d0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.894+0000 7f88fce86700 1 -- 172.21.15.134:0/2804568184 >> 172.21.15.134:0/2804568184 conn(0x7f88f80f1c10 msgr2=0x7f88f80f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.894+0000 7f88fce86700 1 -- 172.21.15.134:0/2804568184 shutdown_connections 2024-03-12T16:02:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.894+0000 7f88fce86700 1 -- 172.21.15.134:0/2804568184 wait complete. 2024-03-12T16:02:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.895+0000 7f88fce86700 1 Processor -- start 2024-03-12T16:02:21.897 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.895+0000 7f88fce86700 1 -- start start 2024-03-12T16:02:21.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.895+0000 7f88fce86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 0x7f88f8106720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:21.898 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.895+0000 7f88fce86700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f88f8106c10 con 0x7f88f80f64b0 2024-03-12T16:02:21.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88f659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 0x7f88f8106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:21.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88f659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 0x7f88f8106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:51276/0 (socket says 172.21.15.134:51276) 2024-03-12T16:02:21.899 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88f659c700 1 -- 172.21.15.134:0/561795453 learned_addr learned my addr 172.21.15.134:0/561795453 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88f659c700 1 -- 172.21.15.134:0/561795453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f88ec005040 con 0x7f88f80f64b0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88f659c700 1 --2- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 0x7f88f8106720 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f88ec009300 tx=0x7f88ec009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88e77fe700 1 -- 172.21.15.134:0/561795453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88ec018070 con 0x7f88f80f64b0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f88f8106e10 con 0x7f88f80f64b0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88e77fe700 1 -- 172.21.15.134:0/561795453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f88ec009890 con 0x7f88f80f64b0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88e77fe700 1 -- 172.21.15.134:0/561795453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f88ec01c400 con 0x7f88f80f64b0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.896+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f88f81072a0 con 0x7f88f80f64b0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.897+0000 7f88e77fe700 1 -- 172.21.15.134:0/561795453 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7f88ec01c6e0 con 0x7f88f80f64b0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.897+0000 7f88e77fe700 1 --2- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f88e0032700 0x7f88e0034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.897+0000 7f88e77fe700 1 -- 172.21.15.134:0/561795453 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f88ec044940 con 0x7f88f80f64b0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.897+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f88f8046ce0 con 0x7f88f80f64b0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.898+0000 7f88f5d9b700 1 --2- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f88e0032700 0x7f88e0034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:21.900 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.898+0000 7f88f5d9b700 1 --2- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f88e0032700 0x7f88e0034bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f88e8009780 tx=0x7f88e8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:21.904 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:21.903+0000 7f88e77fe700 1 -- 172.21.15.134:0/561795453 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f88ec01bab0 con 0x7f88f80f64b0 2024-03-12T16:02:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:20.405096+0000 mgr.smithi006.kskdce (mgr.14156) 23 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:22.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.123+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f88f80fc090 con 0x7f88f80f64b0 2024-03-12T16:02:22.125 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.124+0000 7f88e77fe700 1 -- 172.21.15.134:0/561795453 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7f88ec01d420 con 0x7f88f80f64b0 2024-03-12T16:02:22.126 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:22.126 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.125+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f88e0032700 msgr2=0x7f88e0034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.125+0000 7f88fce86700 1 --2- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f88e0032700 0x7f88e0034bc0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 rx=0x7f88e8009780 tx=0x7f88e8006cc0).stop 2024-03-12T16:02:22.127 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.125+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 msgr2=0x7f88f8106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.125+0000 7f88fce86700 1 --2- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 0x7f88f8106720 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7f88ec009300 tx=0x7f88ec009cb0).stop 2024-03-12T16:02:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.125+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 shutdown_connections 2024-03-12T16:02:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.125+0000 7f88fce86700 1 --2- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f88e0032700 0x7f88e0034bc0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.125+0000 7f88fce86700 1 --2- 172.21.15.134:0/561795453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f88f80f64b0 0x7f88f8106720 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.125+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 >> 172.21.15.134:0/561795453 conn(0x7f88f80f1c10 msgr2=0x7f88f80f2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.126+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 shutdown_connections 2024-03-12T16:02:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:22.126+0000 7f88fce86700 1 -- 172.21.15.134:0/561795453 wait complete. 2024-03-12T16:02:22.128 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:22.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:22 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:22.125137+0000 mon.smithi006 (mon.0) 114 : audit [DBG] from='client.? 172.21.15.134:0/561795453' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:23.789 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:23.789 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:22.405296+0000 mgr.smithi006.kskdce (mgr.14156) 24 : cluster [DBG] pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.570+0000 7f4503b33700 1 -- 172.21.15.134:0/1259288956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 msgr2=0x7f44fc0f68d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.570+0000 7f4503b33700 1 --2- 172.21.15.134:0/1259288956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 0x7f44fc0f68d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f44f8004770 tx=0x7f44f8009cb0).stop 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.570+0000 7f4503b33700 1 -- 172.21.15.134:0/1259288956 shutdown_connections 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.570+0000 7f4503b33700 1 --2- 172.21.15.134:0/1259288956 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 0x7f44fc0f68d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.570+0000 7f4503b33700 1 -- 172.21.15.134:0/1259288956 >> 172.21.15.134:0/1259288956 conn(0x7f44fc0f1c10 msgr2=0x7f44fc0f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.570+0000 7f4503b33700 1 -- 172.21.15.134:0/1259288956 shutdown_connections 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.570+0000 7f4503b33700 1 -- 172.21.15.134:0/1259288956 wait complete. 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.571+0000 7f4503b33700 1 Processor -- start 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.571+0000 7f4503b33700 1 -- start start 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.571+0000 7f4503b33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 0x7f44fc106720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:25.588 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.571+0000 7f4503b33700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44fc106c10 con 0x7f44fc0f64b0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.571+0000 7f45018cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 0x7f44fc106720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.571+0000 7f45018cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 0x7f44fc106720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:51294/0 (socket says 172.21.15.134:51294) 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.571+0000 7f45018cf700 1 -- 172.21.15.134:0/1099850577 learned_addr learned my addr 172.21.15.134:0/1099850577 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.572+0000 7f45018cf700 1 -- 172.21.15.134:0/1099850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44f8005040 con 0x7f44fc0f64b0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.572+0000 7f45018cf700 1 --2- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 0x7f44fc106720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f44f80099b0 tx=0x7f44f8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.572+0000 7f44f2ffd700 1 -- 172.21.15.134:0/1099850577 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44f8018070 con 0x7f44fc0f64b0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.572+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44fc106e10 con 0x7f44fc0f64b0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.572+0000 7f44f2ffd700 1 -- 172.21.15.134:0/1099850577 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f44f8013730 con 0x7f44fc0f64b0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.572+0000 7f44f2ffd700 1 -- 172.21.15.134:0/1099850577 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f44f801d460 con 0x7f44fc0f64b0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.572+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44fc1072a0 con 0x7f44fc0f64b0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.573+0000 7f44f2ffd700 1 -- 172.21.15.134:0/1099850577 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7f44f80125d0 con 0x7f44fc0f64b0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.573+0000 7f44f2ffd700 1 --2- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f44e80326d0 0x7f44e8034b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.573+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44fc046ce0 con 0x7f44fc0f64b0 2024-03-12T16:02:25.589 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.573+0000 7f44f2ffd700 1 -- 172.21.15.134:0/1099850577 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f44f8043ff0 con 0x7f44fc0f64b0 2024-03-12T16:02:25.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.573+0000 7f45010ce700 1 --2- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f44e80326d0 0x7f44e8034b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:25.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.573+0000 7f45010ce700 1 --2- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f44e80326d0 0x7f44e8034b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f44ec009780 tx=0x7f44ec006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:25.590 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.578+0000 7f44f2ffd700 1 -- 172.21.15.134:0/1099850577 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f44f8025ce0 con 0x7f44fc0f64b0 2024-03-12T16:02:25.802 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.802+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f44fc0fbfa0 con 0x7f44fc0f64b0 2024-03-12T16:02:25.803 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.802+0000 7f44f2ffd700 1 -- 172.21.15.134:0/1099850577 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7f44f8025b00 con 0x7f44fc0f64b0 2024-03-12T16:02:25.803 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:25.804 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f44e80326d0 msgr2=0x7f44e8034b90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 --2- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f44e80326d0 0x7f44e8034b90 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 rx=0x7f44ec009780 tx=0x7f44ec006cc0).stop 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 msgr2=0x7f44fc106720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 --2- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 0x7f44fc106720 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f44f80099b0 tx=0x7f44f8009cb0).stop 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 shutdown_connections 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 --2- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f44e80326d0 0x7f44e8034b90 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 --2- 172.21.15.134:0/1099850577 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44fc0f64b0 0x7f44fc106720 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 >> 172.21.15.134:0/1099850577 conn(0x7f44fc0f1c10 msgr2=0x7f44fc0f2660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 shutdown_connections 2024-03-12T16:02:25.805 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:25.804+0000 7f4503b33700 1 -- 172.21.15.134:0/1099850577 wait complete. 2024-03-12T16:02:25.806 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:25.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:24.405524+0000 mgr.smithi006.kskdce (mgr.14156) 25 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:26.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:25.802709+0000 mon.smithi006 (mon.0) 115 : audit [DBG] from='client.? 172.21.15.134:0/1099850577' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:27.394 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:27.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:27.939 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:26.405896+0000 mgr.smithi006.kskdce (mgr.14156) 26 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.188+0000 7f8d85e2c700 1 -- 172.21.15.134:0/457903254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 msgr2=0x7f8d800f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.188+0000 7f8d85e2c700 1 --2- 172.21.15.134:0/457903254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 0x7f8d800f79e0 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7f8d70004770 tx=0x7f8d70009cb0).stop 2024-03-12T16:02:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.188+0000 7f8d85e2c700 1 -- 172.21.15.134:0/457903254 shutdown_connections 2024-03-12T16:02:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.188+0000 7f8d85e2c700 1 --2- 172.21.15.134:0/457903254 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 0x7f8d800f79e0 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.188+0000 7f8d85e2c700 1 -- 172.21.15.134:0/457903254 >> 172.21.15.134:0/457903254 conn(0x7f8d800f2d40 msgr2=0x7f8d800f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.188+0000 7f8d85e2c700 1 -- 172.21.15.134:0/457903254 shutdown_connections 2024-03-12T16:02:29.190 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.188+0000 7f8d85e2c700 1 -- 172.21.15.134:0/457903254 wait complete. 2024-03-12T16:02:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.188+0000 7f8d85e2c700 1 Processor -- start 2024-03-12T16:02:29.191 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.188+0000 7f8d85e2c700 1 -- start start 2024-03-12T16:02:29.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d85e2c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 0x7f8d80107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:29.192 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d85e2c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8d80107d30 con 0x7f8d800f75c0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d7f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 0x7f8d80107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d7f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 0x7f8d80107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:51320/0 (socket says 172.21.15.134:51320) 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d7f7fe700 1 -- 172.21.15.134:0/465512006 learned_addr learned my addr 172.21.15.134:0/465512006 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d7f7fe700 1 -- 172.21.15.134:0/465512006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8d70005040 con 0x7f8d800f75c0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d7f7fe700 1 --2- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 0x7f8d80107840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8d70009300 tx=0x7f8d70009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d7cff9700 1 -- 172.21.15.134:0/465512006 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d70018070 con 0x7f8d800f75c0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8d80107f30 con 0x7f8d800f75c0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d7cff9700 1 -- 172.21.15.134:0/465512006 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8d70009890 con 0x7f8d800f75c0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d7cff9700 1 -- 172.21.15.134:0/465512006 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8d7001c400 con 0x7f8d800f75c0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.189+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8d801083c0 con 0x7f8d800f75c0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.190+0000 7f8d7cff9700 1 -- 172.21.15.134:0/465512006 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7f8d7001d420 con 0x7f8d800f75c0 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.190+0000 7f8d7cff9700 1 --2- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f8d68032700 0x7f8d68034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:29.193 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.190+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8d80046ce0 con 0x7f8d800f75c0 2024-03-12T16:02:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.190+0000 7f8d7cff9700 1 -- 172.21.15.134:0/465512006 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7f8d70044680 con 0x7f8d800f75c0 2024-03-12T16:02:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.190+0000 7f8d7effd700 1 --2- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f8d68032700 0x7f8d68034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:29.194 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.191+0000 7f8d7effd700 1 --2- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f8d68032700 0x7f8d68034bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8d74009780 tx=0x7f8d74006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:29.197 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.195+0000 7f8d7cff9700 1 -- 172.21.15.134:0/465512006 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8d7001b370 con 0x7f8d800f75c0 2024-03-12T16:02:29.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.417+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f8d80109240 con 0x7f8d800f75c0 2024-03-12T16:02:29.420 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.418+0000 7f8d7cff9700 1 -- 172.21.15.134:0/465512006 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7f8d7001b370 con 0x7f8d800f75c0 2024-03-12T16:02:29.420 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:29.420 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:29.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.419+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f8d68032700 msgr2=0x7f8d68034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:29.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.419+0000 7f8d85e2c700 1 --2- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f8d68032700 0x7f8d68034bc0 secure :-1 s=READY pgs=19 cs=0 l=1 rev1=1 rx=0x7f8d74009780 tx=0x7f8d74006cc0).stop 2024-03-12T16:02:29.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.419+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 msgr2=0x7f8d80107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:29.421 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.419+0000 7f8d85e2c700 1 --2- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 0x7f8d80107840 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7f8d70009300 tx=0x7f8d70009cb0).stop 2024-03-12T16:02:29.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.420+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 shutdown_connections 2024-03-12T16:02:29.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.420+0000 7f8d85e2c700 1 --2- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7f8d68032700 0x7f8d68034bc0 unknown :-1 s=CLOSED pgs=19 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:29.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.420+0000 7f8d85e2c700 1 --2- 172.21.15.134:0/465512006 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8d800f75c0 0x7f8d80107840 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:29.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.420+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 >> 172.21.15.134:0/465512006 conn(0x7f8d800f2d40 msgr2=0x7f8d800f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:29.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.420+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 shutdown_connections 2024-03-12T16:02:29.422 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:29.420+0000 7f8d85e2c700 1 -- 172.21.15.134:0/465512006 wait complete. 2024-03-12T16:02:29.422 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:29.885 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:28.406253+0000 mgr.smithi006.kskdce (mgr.14156) 27 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:29.885 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:29.419193+0000 mon.smithi006 (mon.0) 116 : audit [DBG] from='client.? 172.21.15.134:0/465512006' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:31.071 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:31.071 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:31.324 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:29.995413+0000 mon.smithi006 (mon.0) 117 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:31.324 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:29.998542+0000 mgr.smithi006.kskdce (mgr.14156) 28 : cephadm [INF] Deploying daemon node-exporter.smithi006 on smithi006 2024-03-12T16:02:31.324 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:30.406496+0000 mgr.smithi006.kskdce (mgr.14156) 29 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:32.870 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.867+0000 7ffac960e700 1 -- 172.21.15.134:0/2532876553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 msgr2=0x7ffac40f68e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.867+0000 7ffac960e700 1 --2- 172.21.15.134:0/2532876553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 0x7ffac40f68e0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7ffab4004770 tx=0x7ffab4009cb0).stop 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.867+0000 7ffac960e700 1 -- 172.21.15.134:0/2532876553 shutdown_connections 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.867+0000 7ffac960e700 1 --2- 172.21.15.134:0/2532876553 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 0x7ffac40f68e0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.868+0000 7ffac960e700 1 -- 172.21.15.134:0/2532876553 >> 172.21.15.134:0/2532876553 conn(0x7ffac40f1c00 msgr2=0x7ffac40f4040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.868+0000 7ffac960e700 1 -- 172.21.15.134:0/2532876553 shutdown_connections 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.868+0000 7ffac960e700 1 -- 172.21.15.134:0/2532876553 wait complete. 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.868+0000 7ffac960e700 1 Processor -- start 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.868+0000 7ffac960e700 1 -- start start 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.868+0000 7ffac960e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 0x7ffac4107810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.868+0000 7ffac960e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffac4107d00 con 0x7ffac40f64c0 2024-03-12T16:02:32.871 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffac2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 0x7ffac4107810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:32.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffac2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 0x7ffac4107810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:42914/0 (socket says 172.21.15.134:42914) 2024-03-12T16:02:32.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffac2ffd700 1 -- 172.21.15.134:0/1284520810 learned_addr learned my addr 172.21.15.134:0/1284520810 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:32.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffac2ffd700 1 -- 172.21.15.134:0/1284520810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffab4005040 con 0x7ffac40f64c0 2024-03-12T16:02:32.872 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffac2ffd700 1 --2- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 0x7ffac4107810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ffab4009300 tx=0x7ffab4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:32.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffaabfff700 1 -- 172.21.15.134:0/1284520810 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffab4018070 con 0x7ffac40f64c0 2024-03-12T16:02:32.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffac4107f00 con 0x7ffac40f64c0 2024-03-12T16:02:32.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffaabfff700 1 -- 172.21.15.134:0/1284520810 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ffab4009890 con 0x7ffac40f64c0 2024-03-12T16:02:32.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffaabfff700 1 -- 172.21.15.134:0/1284520810 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ffab401c400 con 0x7ffac40f64c0 2024-03-12T16:02:32.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.869+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffac4108390 con 0x7ffac40f64c0 2024-03-12T16:02:32.873 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.870+0000 7ffaabfff700 1 -- 172.21.15.134:0/1284520810 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 13) v1 ==== 38687+0+0 (secure 0 0 0) 0x7ffab401d420 con 0x7ffac40f64c0 2024-03-12T16:02:32.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.870+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffac4046ce0 con 0x7ffac40f64c0 2024-03-12T16:02:32.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.871+0000 7ffaabfff700 1 --2- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7ffaac032700 0x7ffaac034bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:32.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.871+0000 7ffaabfff700 1 -- 172.21.15.134:0/1284520810 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7ffab40445c0 con 0x7ffac40f64c0 2024-03-12T16:02:32.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.871+0000 7ffac27fc700 1 --2- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7ffaac032700 0x7ffaac034bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:32.874 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.871+0000 7ffac27fc700 1 --2- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7ffaac032700 0x7ffaac034bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ffab8009780 tx=0x7ffab8006cc0).ready entity=mgr.14156 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:32.877 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:32.875+0000 7ffaabfff700 1 -- 172.21.15.134:0/1284520810 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ffab4025b80 con 0x7ffac40f64c0 2024-03-12T16:02:33.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.098+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ffac4109240 con 0x7ffac40f64c0 2024-03-12T16:02:33.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.099+0000 7ffaabfff700 1 -- 172.21.15.134:0/1284520810 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7ffab4025b80 con 0x7ffac40f64c0 2024-03-12T16:02:33.100 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:33.100 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:33.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7ffaac032700 msgr2=0x7ffaac034bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:33.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 --2- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7ffaac032700 0x7ffaac034bc0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7ffab8009780 tx=0x7ffab8006cc0).stop 2024-03-12T16:02:33.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 msgr2=0x7ffac4107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:33.102 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 --2- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 0x7ffac4107810 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7ffab4009300 tx=0x7ffab4009cb0).stop 2024-03-12T16:02:33.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 shutdown_connections 2024-03-12T16:02:33.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 --2- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7ffaac032700 0x7ffaac034bc0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:33.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 --2- 172.21.15.134:0/1284520810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffac40f64c0 0x7ffac4107810 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:33.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 >> 172.21.15.134:0/1284520810 conn(0x7ffac40f1c00 msgr2=0x7ffac4060e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:33.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 shutdown_connections 2024-03-12T16:02:33.103 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:33.100+0000 7ffac960e700 1 -- 172.21.15.134:0/1284520810 wait complete. 2024-03-12T16:02:33.103 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:32.406851+0000 mgr.smithi006.kskdce (mgr.14156) 30 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:02:33.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:33.099864+0000 mon.smithi006 (mon.0) 118 : audit [DBG] from='client.? 172.21.15.134:0/1284520810' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:33.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:33.237057+0000 mon.smithi006 (mon.0) 119 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:33.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:33.239340+0000 mon.smithi006 (mon.0) 120 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-03-12T16:02:34.668 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:34.668 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:35.659 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:34.239589+0000 mon.smithi006 (mon.0) 121 : audit [INF] from='mgr.14156 172.21.15.6:0/3692553344' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-03-12T16:02:35.660 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:34.239652+0000 mon.smithi006 (mon.0) 122 : cluster [DBG] mgrmap e14: smithi006.kskdce(active, since 49s) 2024-03-12T16:02:36.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.505+0000 7fa63365a700 1 -- 172.21.15.134:0/3398903786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 msgr2=0x7fa62c0f79e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:36.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.505+0000 7fa63365a700 1 --2- 172.21.15.134:0/3398903786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 0x7fa62c0f79e0 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa61c004770 tx=0x7fa61c009cb0).stop 2024-03-12T16:02:36.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.505+0000 7fa63365a700 1 -- 172.21.15.134:0/3398903786 shutdown_connections 2024-03-12T16:02:36.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.505+0000 7fa63365a700 1 --2- 172.21.15.134:0/3398903786 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 0x7fa62c0f79e0 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:36.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.505+0000 7fa63365a700 1 -- 172.21.15.134:0/3398903786 >> 172.21.15.134:0/3398903786 conn(0x7fa62c0f2d40 msgr2=0x7fa62c0f5160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:36.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.505+0000 7fa63365a700 1 -- 172.21.15.134:0/3398903786 shutdown_connections 2024-03-12T16:02:36.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.505+0000 7fa63365a700 1 -- 172.21.15.134:0/3398903786 wait complete. 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.506+0000 7fa63365a700 1 Processor -- start 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.506+0000 7fa63365a700 1 -- start start 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.506+0000 7fa63365a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 0x7fa62c107840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.506+0000 7fa63365a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa62c107d30 con 0x7fa62c0f75c0 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.506+0000 7fa6313f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 0x7fa62c107840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.506+0000 7fa6313f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 0x7fa62c107840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:42942/0 (socket says 172.21.15.134:42942) 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.506+0000 7fa6313f6700 1 -- 172.21.15.134:0/3366421456 learned_addr learned my addr 172.21.15.134:0/3366421456 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.507+0000 7fa6313f6700 1 -- 172.21.15.134:0/3366421456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa61c005040 con 0x7fa62c0f75c0 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.507+0000 7fa6313f6700 1 --2- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 0x7fa62c107840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa61c009300 tx=0x7fa61c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.507+0000 7fa6227fc700 1 -- 172.21.15.134:0/3366421456 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa61c018070 con 0x7fa62c0f75c0 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.507+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa62c107f30 con 0x7fa62c0f75c0 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.507+0000 7fa6227fc700 1 -- 172.21.15.134:0/3366421456 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa61c009890 con 0x7fa62c0f75c0 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.507+0000 7fa6227fc700 1 -- 172.21.15.134:0/3366421456 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fa61c01c400 con 0x7fa62c0f75c0 2024-03-12T16:02:36.510 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.507+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa62c1083c0 con 0x7fa62c0f75c0 2024-03-12T16:02:36.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.508+0000 7fa6227fc700 1 -- 172.21.15.134:0/3366421456 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 14) v1 ==== 38701+0+0 (secure 0 0 0) 0x7fa61c01d420 con 0x7fa62c0f75c0 2024-03-12T16:02:36.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.508+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62c046ce0 con 0x7fa62c0f75c0 2024-03-12T16:02:36.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.508+0000 7fa6227fc700 1 --2- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa618032750 0x7fa618034c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:36.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.508+0000 7fa6227fc700 1 -- 172.21.15.134:0/3366421456 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(4..4 src has 1..4) v4 ==== 1065+0+0 (secure 0 0 0) 0x7fa61c044600 con 0x7fa62c0f75c0 2024-03-12T16:02:36.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.508+0000 7fa630bf5700 1 -- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa618032750 msgr2=0x7fa618034c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3591243488 2024-03-12T16:02:36.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.508+0000 7fa630bf5700 1 --2- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa618032750 0x7fa618034c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:02:36.514 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.513+0000 7fa6227fc700 1 -- 172.21.15.134:0/3366421456 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa61c025ce0 con 0x7fa62c0f75c0 2024-03-12T16:02:36.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.709+0000 7fa630bf5700 1 -- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa618032750 msgr2=0x7fa618034c10 unknown :-1 s=STATE_CONNECTING_RE l=1).process reconnect failed to v2:172.21.15.6:6800/3591243488 2024-03-12T16:02:36.711 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.709+0000 7fa630bf5700 1 --2- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa618032750 0x7fa618034c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._fault waiting 0.400000 2024-03-12T16:02:36.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.737+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fa62c109210 con 0x7fa62c0f75c0 2024-03-12T16:02:36.740 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.738+0000 7fa6227fc700 1 -- 172.21.15.134:0/3366421456 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7fa61c01b370 con 0x7fa62c0f75c0 2024-03-12T16:02:36.740 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:36.740 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa618032750 msgr2=0x7fa618034c10 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 --2- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa618032750 0x7fa618034c10 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 msgr2=0x7fa62c107840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 --2- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 0x7fa62c107840 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fa61c009300 tx=0x7fa61c009cb0).stop 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 shutdown_connections 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 --2- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:6800/3591243488,v1:172.21.15.6:6801/3591243488] conn(0x7fa618032750 0x7fa618034c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 --2- 172.21.15.134:0/3366421456 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa62c0f75c0 0x7fa62c107840 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 >> 172.21.15.134:0/3366421456 conn(0x7fa62c0f2d40 msgr2=0x7fa62c0f3790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 shutdown_connections 2024-03-12T16:02:36.742 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:36.740+0000 7fa63365a700 1 -- 172.21.15.134:0/3366421456 wait complete. 2024-03-12T16:02:36.743 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:37.107 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:36.739278+0000 mon.smithi006 (mon.0) 123 : audit [DBG] from='client.? 172.21.15.134:0/3366421456' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:38.340 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:38.340 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:40.161 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.152+0000 7face74f1700 1 -- 172.21.15.134:0/3869562007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 msgr2=0x7face00f68f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:40.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.152+0000 7face74f1700 1 --2- 172.21.15.134:0/3869562007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 0x7face00f68f0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7facdc004770 tx=0x7facdc009cb0).stop 2024-03-12T16:02:40.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.152+0000 7face74f1700 1 -- 172.21.15.134:0/3869562007 shutdown_connections 2024-03-12T16:02:40.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.152+0000 7face74f1700 1 --2- 172.21.15.134:0/3869562007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 0x7face00f68f0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:40.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.152+0000 7face74f1700 1 -- 172.21.15.134:0/3869562007 >> 172.21.15.134:0/3869562007 conn(0x7face00f1c30 msgr2=0x7face00f4050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:40.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.152+0000 7face74f1700 1 -- 172.21.15.134:0/3869562007 shutdown_connections 2024-03-12T16:02:40.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.152+0000 7face74f1700 1 -- 172.21.15.134:0/3869562007 wait complete. 2024-03-12T16:02:40.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face74f1700 1 Processor -- start 2024-03-12T16:02:40.164 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face74f1700 1 -- start start 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face74f1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 0x7face0107810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face74f1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7face0107d00 con 0x7face00f64d0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face528d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 0x7face0107810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face528d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 0x7face0107810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:53348/0 (socket says 172.21.15.134:53348) 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face528d700 1 -- 172.21.15.134:0/65440564 learned_addr learned my addr 172.21.15.134:0/65440564 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face528d700 1 -- 172.21.15.134:0/65440564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7facdc005040 con 0x7face00f64d0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face528d700 1 --2- 172.21.15.134:0/65440564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 0x7face0107810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7facdc009300 tx=0x7facdc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7facd67fc700 1 -- 172.21.15.134:0/65440564 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facdc018070 con 0x7face00f64d0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7face74f1700 1 -- 172.21.15.134:0/65440564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7face0107f00 con 0x7face00f64d0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7facd67fc700 1 -- 172.21.15.134:0/65440564 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7facdc009890 con 0x7face00f64d0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.153+0000 7facd67fc700 1 -- 172.21.15.134:0/65440564 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7facdc01c400 con 0x7face00f64d0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.154+0000 7face74f1700 1 -- 172.21.15.134:0/65440564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7face0108390 con 0x7face00f64d0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.154+0000 7facd67fc700 1 -- 172.21.15.134:0/65440564 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 15) v1 ==== 38483+0+0 (secure 0 0 0) 0x7facdc01c6c0 con 0x7face00f64d0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.154+0000 7facd67fc700 1 -- 172.21.15.134:0/65440564 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7facdc0443a0 con 0x7face00f64d0 2024-03-12T16:02:40.165 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.155+0000 7face74f1700 1 -- 172.21.15.134:0/65440564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7face005a310 con 0x7face00f64d0 2024-03-12T16:02:40.166 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.159+0000 7facd67fc700 1 -- 172.21.15.134:0/65440564 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7facdc01ca60 con 0x7face00f64d0 2024-03-12T16:02:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:39.916458+0000 mon.smithi006 (mon.0) 124 : cluster [INF] Active manager daemon smithi006.kskdce restarted 2024-03-12T16:02:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:39.916680+0000 mon.smithi006 (mon.0) 125 : cluster [INF] Activating manager daemon smithi006.kskdce 2024-03-12T16:02:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:39.921841+0000 mon.smithi006 (mon.0) 126 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-03-12T16:02:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:39.921954+0000 mon.smithi006 (mon.0) 127 : cluster [DBG] mgrmap e15: smithi006.kskdce(active, starting, since 0.00536602s) 2024-03-12T16:02:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:39.923124+0000 mon.smithi006 (mon.0) 128 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:02:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:39.923825+0000 mon.smithi006 (mon.0) 129 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:02:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:39.924499+0000 mon.smithi006 (mon.0) 130 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:02:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:39.924738+0000 mon.smithi006 (mon.0) 131 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:02:40.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:39.924974+0000 mon.smithi006 (mon.0) 132 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:02:40.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:39.927043+0000 mon.smithi006 (mon.0) 133 : cluster [INF] Manager daemon smithi006.kskdce is now available 2024-03-12T16:02:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.395+0000 7face74f1700 1 -- 172.21.15.134:0/65440564 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7face0046ce0 con 0x7face00f64d0 2024-03-12T16:02:40.397 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.396+0000 7facd67fc700 1 -- 172.21.15.134:0/65440564 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7facdc01b370 con 0x7face00f64d0 2024-03-12T16:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:40.397 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:40.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.397+0000 7face74f1700 1 -- 172.21.15.134:0/65440564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 msgr2=0x7face0107810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:40.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.397+0000 7face74f1700 1 --2- 172.21.15.134:0/65440564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 0x7face0107810 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7facdc009300 tx=0x7facdc009cb0).stop 2024-03-12T16:02:40.399 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.397+0000 7face74f1700 1 -- 172.21.15.134:0/65440564 shutdown_connections 2024-03-12T16:02:40.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.397+0000 7face74f1700 1 --2- 172.21.15.134:0/65440564 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7face00f64d0 0x7face0107810 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:40.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.397+0000 7face74f1700 1 -- 172.21.15.134:0/65440564 >> 172.21.15.134:0/65440564 conn(0x7face00f1c30 msgr2=0x7face0060e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:40.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.397+0000 7face74f1700 1 -- 172.21.15.134:0/65440564 shutdown_connections 2024-03-12T16:02:40.400 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:40.398+0000 7face74f1700 1 -- 172.21.15.134:0/65440564 wait complete. 2024-03-12T16:02:40.400 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:40.028071+0000 mon.smithi006 (mon.0) 134 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:02:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:40.029562+0000 mon.smithi006 (mon.0) 135 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:02:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:40.060665+0000 mon.smithi006 (mon.0) 136 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:40.070401+0000 mon.smithi006 (mon.0) 137 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:02:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:40.075703+0000 mon.smithi006 (mon.0) 138 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:02:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:40.396951+0000 mon.smithi006 (mon.0) 139 : audit [DBG] from='client.? 172.21.15.134:0/65440564' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:41.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:40.512054+0000 mon.smithi006 (mon.0) 140 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:41.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:40.921562+0000 mon.smithi006 (mon.0) 141 : cluster [DBG] mgrmap e16: smithi006.kskdce(active, since 1.00497s) 2024-03-12T16:02:42.060 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:42.060 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:42.623 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:41.221349+0000 mon.smithi006 (mon.0) 142 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:43.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:42.222913+0000 mon.smithi006 (mon.0) 143 : cluster [DBG] mgrmap e17: smithi006.kskdce(active, since 2s) 2024-03-12T16:02:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.432+0000 7fac6d05d700 1 -- 172.21.15.134:0/3232233397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 msgr2=0x7fac680fa190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:44.517 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.432+0000 7fac6d05d700 1 --2- 172.21.15.134:0/3232233397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 0x7fac680fa190 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fac58004770 tx=0x7fac58009cb0).stop 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.432+0000 7fac6d05d700 1 -- 172.21.15.134:0/3232233397 shutdown_connections 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.432+0000 7fac6d05d700 1 --2- 172.21.15.134:0/3232233397 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 0x7fac680fa190 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.432+0000 7fac6d05d700 1 -- 172.21.15.134:0/3232233397 >> 172.21.15.134:0/3232233397 conn(0x7fac680f1c10 msgr2=0x7fac680f4030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.432+0000 7fac6d05d700 1 -- 172.21.15.134:0/3232233397 shutdown_connections 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.432+0000 7fac6d05d700 1 -- 172.21.15.134:0/3232233397 wait complete. 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.433+0000 7fac6d05d700 1 Processor -- start 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.433+0000 7fac6d05d700 1 -- start start 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.433+0000 7fac6d05d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 0x7fac680f7c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.433+0000 7fac6d05d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fac680f6090 con 0x7fac680611f0 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.433+0000 7fac66d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 0x7fac680f7c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.433+0000 7fac66d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 0x7fac680f7c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:53376/0 (socket says 172.21.15.134:53376) 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.433+0000 7fac66d9d700 1 -- 172.21.15.134:0/1752561001 learned_addr learned my addr 172.21.15.134:0/1752561001 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:44.518 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.434+0000 7fac66d9d700 1 -- 172.21.15.134:0/1752561001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fac58005040 con 0x7fac680611f0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.434+0000 7fac66d9d700 1 --2- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 0x7fac680f7c10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fac58004740 tx=0x7fac58009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.434+0000 7fac4ffff700 1 -- 172.21.15.134:0/1752561001 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac58018070 con 0x7fac680611f0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.434+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fac680f6230 con 0x7fac680611f0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.434+0000 7fac4ffff700 1 -- 172.21.15.134:0/1752561001 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fac58013e30 con 0x7fac680611f0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.434+0000 7fac4ffff700 1 -- 172.21.15.134:0/1752561001 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7fac5801d600 con 0x7fac680611f0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.434+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fac680f66c0 con 0x7fac680611f0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.435+0000 7fac4ffff700 1 -- 172.21.15.134:0/1752561001 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 38743+0+0 (secure 0 0 0) 0x7fac5801d830 con 0x7fac680611f0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.435+0000 7fac4ffff700 1 --2- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fac500327f0 0x7fac50034cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.435+0000 7fac4ffff700 1 -- 172.21.15.134:0/1752561001 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fac58045790 con 0x7fac680611f0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.435+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fac6805a310 con 0x7fac680611f0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.435+0000 7fac6659c700 1 --2- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fac500327f0 0x7fac50034cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.436+0000 7fac6659c700 1 --2- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fac500327f0 0x7fac50034cb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fac5c009780 tx=0x7fac5c006cc0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:44.519 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.440+0000 7fac4ffff700 1 -- 172.21.15.134:0/1752561001 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fac5801bb20 con 0x7fac680611f0 2024-03-12T16:02:44.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.676+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fac680f6d20 con 0x7fac680611f0 2024-03-12T16:02:44.679 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.677+0000 7fac4ffff700 1 -- 172.21.15.134:0/1752561001 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7fac5801bb20 con 0x7fac680611f0 2024-03-12T16:02:44.679 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:44.679 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fac500327f0 msgr2=0x7fac50034cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 --2- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fac500327f0 0x7fac50034cb0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fac5c009780 tx=0x7fac5c006cc0).stop 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 msgr2=0x7fac680f7c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 --2- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 0x7fac680f7c10 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fac58004740 tx=0x7fac58009cb0).stop 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 shutdown_connections 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 --2- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fac500327f0 0x7fac50034cb0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 --2- 172.21.15.134:0/1752561001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fac680611f0 0x7fac680f7c10 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 >> 172.21.15.134:0/1752561001 conn(0x7fac680f1c10 msgr2=0x7fac680f25d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 shutdown_connections 2024-03-12T16:02:44.682 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:44.680+0000 7fac6d05d700 1 -- 172.21.15.134:0/1752561001 wait complete. 2024-03-12T16:02:44.683 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:45.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:43.941065+0000 mon.smithi006 (mon.0) 144 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:45.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:44.235380+0000 mon.smithi006 (mon.0) 145 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd/host:smithi006", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:02:45.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:44.678319+0000 mon.smithi006 (mon.0) 146 : audit [DBG] from='client.? 172.21.15.134:0/1752561001' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:46.505 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:46.506 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.165285+0000 mon.smithi006 (mon.0) 147 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.477792+0000 mon.smithi006 (mon.0) 148 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.478550+0000 mon.smithi006 (mon.0) 149 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd/host:smithi134", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:02:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.479571+0000 mon.smithi006 (mon.0) 150 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:02:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.480392+0000 mon.smithi006 (mon.0) 151 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:02:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.526764+0000 mon.smithi006 (mon.0) 152 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.530166+0000 mon.smithi006 (mon.0) 153 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.535772+0000 mon.smithi006 (mon.0) 154 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.537694+0000 mon.smithi006 (mon.0) 155 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:02:47.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.540617+0000 mon.smithi006 (mon.0) 156 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]': finished 2024-03-12T16:02:47.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:46.541440+0000 mon.smithi006 (mon.0) 157 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:02:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:46.481826+0000 mgr.smithi006.kskdce (mgr.14196) 1 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:02:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:46.482123+0000 mgr.smithi006.kskdce (mgr.14196) 2 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:02:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:46.507697+0000 mgr.smithi006.kskdce (mgr.14196) 3 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:02:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:46.510281+0000 mgr.smithi006.kskdce (mgr.14196) 4 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:02:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:46.542152+0000 mgr.smithi006.kskdce (mgr.14196) 5 : cephadm [INF] Deploying daemon crash.smithi134 on smithi134 2024-03-12T16:02:49.082 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.076+0000 7ff23cb00700 1 -- 172.21.15.134:0/2419220547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 msgr2=0x7ff2380f8a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:49.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.076+0000 7ff23cb00700 1 --2- 172.21.15.134:0/2419220547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 0x7ff2380f8a70 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7ff22c004770 tx=0x7ff22c009cb0).stop 2024-03-12T16:02:49.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.076+0000 7ff23cb00700 1 -- 172.21.15.134:0/2419220547 shutdown_connections 2024-03-12T16:02:49.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.076+0000 7ff23cb00700 1 --2- 172.21.15.134:0/2419220547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 0x7ff2380f8a70 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:49.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.076+0000 7ff23cb00700 1 -- 172.21.15.134:0/2419220547 >> 172.21.15.134:0/2419220547 conn(0x7ff23806c440 msgr2=0x7ff23806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:49.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.076+0000 7ff23cb00700 1 -- 172.21.15.134:0/2419220547 shutdown_connections 2024-03-12T16:02:49.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.076+0000 7ff23cb00700 1 -- 172.21.15.134:0/2419220547 wait complete. 2024-03-12T16:02:49.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.077+0000 7ff23cb00700 1 Processor -- start 2024-03-12T16:02:49.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.077+0000 7ff23cb00700 1 -- start start 2024-03-12T16:02:49.083 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.077+0000 7ff23cb00700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 0x7ff2380f6640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.077+0000 7ff23cb00700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff2380f6b30 con 0x7ff2380f8690 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff23659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 0x7ff2380f6640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff23659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 0x7ff2380f6640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:53386/0 (socket says 172.21.15.134:53386) 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff23659c700 1 -- 172.21.15.134:0/3312922372 learned_addr learned my addr 172.21.15.134:0/3312922372 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff23659c700 1 -- 172.21.15.134:0/3312922372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff22c005040 con 0x7ff2380f8690 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff23659c700 1 --2- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 0x7ff2380f6640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff22c004740 tx=0x7ff22c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff2277fe700 1 -- 172.21.15.134:0/3312922372 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff22c018070 con 0x7ff2380f8690 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff2380f6d30 con 0x7ff2380f8690 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff2277fe700 1 -- 172.21.15.134:0/3312922372 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff22c009860 con 0x7ff2380f8690 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff2277fe700 1 -- 172.21.15.134:0/3312922372 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7ff22c01c5b0 con 0x7ff2380f8690 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.078+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff2380f7140 con 0x7ff2380f8690 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.079+0000 7ff2277fe700 1 -- 172.21.15.134:0/3312922372 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 38743+0+0 (secure 0 0 0) 0x7ff22c01d470 con 0x7ff2380f8690 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.079+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff23805f1f0 con 0x7ff2380f8690 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.079+0000 7ff2277fe700 1 --2- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff2200327d0 0x7ff220034c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:49.084 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.079+0000 7ff2277fe700 1 -- 172.21.15.134:0/3312922372 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7ff22c0440c0 con 0x7ff2380f8690 2024-03-12T16:02:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.080+0000 7ff235d9b700 1 --2- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff2200327d0 0x7ff220034c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:49.085 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.080+0000 7ff235d9b700 1 --2- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff2200327d0 0x7ff220034c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff228009780 tx=0x7ff228006cc0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:49.086 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.084+0000 7ff2277fe700 1 -- 172.21.15.134:0/3312922372 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff22c0242f0 con 0x7ff2380f8690 2024-03-12T16:02:49.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.315+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7ff23805a350 con 0x7ff2380f8690 2024-03-12T16:02:49.317 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.316+0000 7ff2277fe700 1 -- 172.21.15.134:0/3312922372 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7ff22c0242f0 con 0x7ff2380f8690 2024-03-12T16:02:49.318 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:49.318 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff2200327d0 msgr2=0x7ff220034c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 --2- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff2200327d0 0x7ff220034c90 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7ff228009780 tx=0x7ff228006cc0).stop 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 msgr2=0x7ff2380f6640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 --2- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 0x7ff2380f6640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7ff22c004740 tx=0x7ff22c009cb0).stop 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 shutdown_connections 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 --2- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff2200327d0 0x7ff220034c90 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 --2- 172.21.15.134:0/3312922372 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff2380f8690 0x7ff2380f6640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 >> 172.21.15.134:0/3312922372 conn(0x7ff23806c440 msgr2=0x7ff2380f96a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 shutdown_connections 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:49.318+0000 7ff23cb00700 1 -- 172.21.15.134:0/3312922372 wait complete. 2024-03-12T16:02:49.320 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:49.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:49.316886+0000 mon.smithi006 (mon.0) 158 : audit [DBG] from='client.? 172.21.15.134:0/3312922372' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:50.984 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:50.984 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:50.656271+0000 mon.smithi006 (mon.0) 159 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:50.658455+0000 mon.smithi006 (mon.0) 160 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:02:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:50.660774+0000 mon.smithi006 (mon.0) 161 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-03-12T16:02:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:50.661628+0000 mon.smithi006 (mon.0) 162 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:02:51.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:50.662535+0000 mon.smithi006 (mon.0) 163 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:02:51.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:50.663232+0000 mgr.smithi006.kskdce (mgr.14196) 6 : cephadm [INF] Deploying daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:02:53.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.464+0000 7f4959811700 1 -- 172.21.15.134:0/2544258420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 msgr2=0x7f49540fda00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:53.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.464+0000 7f4959811700 1 --2- 172.21.15.134:0/2544258420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 0x7f49540fda00 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f4944004770 tx=0x7f4944009cb0).stop 2024-03-12T16:02:53.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.464+0000 7f4959811700 1 -- 172.21.15.134:0/2544258420 shutdown_connections 2024-03-12T16:02:53.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.464+0000 7f4959811700 1 --2- 172.21.15.134:0/2544258420 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 0x7f49540fda00 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:53.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.464+0000 7f4959811700 1 -- 172.21.15.134:0/2544258420 >> 172.21.15.134:0/2544258420 conn(0x7f49540f3220 msgr2=0x7f49540f5640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:53.497 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.464+0000 7f4959811700 1 -- 172.21.15.134:0/2544258420 shutdown_connections 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.464+0000 7f4959811700 1 -- 172.21.15.134:0/2544258420 wait complete. 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.464+0000 7f4959811700 1 Processor -- start 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.464+0000 7f4959811700 1 -- start start 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f4959811700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 0x7f495410fab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f4959811700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f495410ffa0 con 0x7f49540fd620 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f4952ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 0x7f495410fab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f4952ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 0x7f495410fab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:49012/0 (socket says 172.21.15.134:49012) 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f4952ffd700 1 -- 172.21.15.134:0/1985800044 learned_addr learned my addr 172.21.15.134:0/1985800044 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f4952ffd700 1 -- 172.21.15.134:0/1985800044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4944005040 con 0x7f49540fd620 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f4952ffd700 1 --2- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 0x7f495410fab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4944004740 tx=0x7f4944009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f493bfff700 1 -- 172.21.15.134:0/1985800044 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f4944018070 con 0x7f49540fd620 2024-03-12T16:02:53.498 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49541101a0 con 0x7f49540fd620 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f493bfff700 1 -- 172.21.15.134:0/1985800044 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4944009860 con 0x7f49540fd620 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.465+0000 7f493bfff700 1 -- 172.21.15.134:0/1985800044 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f494401c5b0 con 0x7f49540fd620 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.466+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4954110630 con 0x7f49540fd620 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.466+0000 7f493bfff700 1 -- 172.21.15.134:0/1985800044 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 38743+0+0 (secure 0 0 0) 0x7f494401d470 con 0x7f49540fd620 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.466+0000 7f493bfff700 1 --2- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f493c0327d0 0x7f493c034c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.466+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f495405f150 con 0x7f49540fd620 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.466+0000 7f493bfff700 1 -- 172.21.15.134:0/1985800044 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f4944044000 con 0x7f49540fd620 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.467+0000 7f49527fc700 1 --2- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f493c0327d0 0x7f493c034c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.467+0000 7f49527fc700 1 --2- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f493c0327d0 0x7f493c034c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4948009780 tx=0x7f4948006cc0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:53.499 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.471+0000 7f493bfff700 1 -- 172.21.15.134:0/1985800044 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f49440263f0 con 0x7f49540fd620 2024-03-12T16:02:53.704 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.703+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f4954046ce0 con 0x7f49540fd620 2024-03-12T16:02:53.705 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.703+0000 7f493bfff700 1 -- 172.21.15.134:0/1985800044 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7f49440242f0 con 0x7f49540fd620 2024-03-12T16:02:53.705 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:53.705 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:53.707 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f493c0327d0 msgr2=0x7f493c034c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 --2- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f493c0327d0 0x7f493c034c90 secure :-1 s=READY pgs=7 cs=0 l=1 rev1=1 rx=0x7f4948009780 tx=0x7f4948006cc0).stop 2024-03-12T16:02:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 msgr2=0x7f495410fab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 --2- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 0x7f495410fab0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f4944004740 tx=0x7f4944009cb0).stop 2024-03-12T16:02:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 shutdown_connections 2024-03-12T16:02:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 --2- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f493c0327d0 0x7f493c034c90 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 --2- 172.21.15.134:0/1985800044 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49540fd620 0x7f495410fab0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 >> 172.21.15.134:0/1985800044 conn(0x7f49540f3220 msgr2=0x7f495406af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 shutdown_connections 2024-03-12T16:02:53.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:53.706+0000 7f4959811700 1 -- 172.21.15.134:0/1985800044 wait complete. 2024-03-12T16:02:53.709 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:53.704875+0000 mon.smithi006 (mon.0) 164 : audit [DBG] from='client.? 172.21.15.134:0/1985800044' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:55.622 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:02:55.622 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:02:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:54.238382+0000 mon.smithi006 (mon.0) 165 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:54.240481+0000 mon.smithi006 (mon.0) 166 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:02:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:54.241301+0000 mon.smithi006 (mon.0) 167 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:02:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:02:54.242029+0000 mgr.smithi006.kskdce (mgr.14196) 7 : cephadm [INF] Deploying daemon mon.smithi134 on smithi134 2024-03-12T16:02:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:55.064193+0000 mon.smithi006 (mon.0) 168 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:02:58.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:58 smithi134 systemd[1]: Starting Ceph mon.smithi134 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:02:58.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.704+0000 7f870b6ca700 1 -- 172.21.15.134:0/2160162660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 msgr2=0x7f87040f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:58.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.704+0000 7f870b6ca700 1 --2- 172.21.15.134:0/2160162660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 0x7f87040f6850 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f8700004770 tx=0x7f8700009cb0).stop 2024-03-12T16:02:58.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.704+0000 7f870b6ca700 1 -- 172.21.15.134:0/2160162660 shutdown_connections 2024-03-12T16:02:58.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.704+0000 7f870b6ca700 1 --2- 172.21.15.134:0/2160162660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 0x7f87040f6850 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:58.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.704+0000 7f870b6ca700 1 -- 172.21.15.134:0/2160162660 >> 172.21.15.134:0/2160162660 conn(0x7f870406c450 msgr2=0x7f870406c860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:58.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.704+0000 7f870b6ca700 1 -- 172.21.15.134:0/2160162660 shutdown_connections 2024-03-12T16:02:58.706 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.704+0000 7f870b6ca700 1 -- 172.21.15.134:0/2160162660 wait complete. 2024-03-12T16:02:58.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.705+0000 7f870b6ca700 1 Processor -- start 2024-03-12T16:02:58.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.705+0000 7f870b6ca700 1 -- start start 2024-03-12T16:02:58.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.705+0000 7f870b6ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 0x7f8704113fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:58.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.705+0000 7f870b6ca700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8704114490 con 0x7f87040f6470 2024-03-12T16:02:58.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.705+0000 7f8709466700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 0x7f8704113fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:58.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.705+0000 7f8709466700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 0x7f8704113fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.134:49062/0 (socket says 172.21.15.134:49062) 2024-03-12T16:02:58.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.705+0000 7f8709466700 1 -- 172.21.15.134:0/4294435416 learned_addr learned my addr 172.21.15.134:0/4294435416 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:02:58.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.705+0000 7f8709466700 1 -- 172.21.15.134:0/4294435416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8700005040 con 0x7f87040f6470 2024-03-12T16:02:58.708 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.706+0000 7f8709466700 1 --2- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 0x7f8704113fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8700009330 tx=0x7f8700009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:58.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.706+0000 7f86fa7fc700 1 -- 172.21.15.134:0/4294435416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f8700018070 con 0x7f87040f6470 2024-03-12T16:02:58.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.706+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8704114690 con 0x7f87040f6470 2024-03-12T16:02:58.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.706+0000 7f86fa7fc700 1 -- 172.21.15.134:0/4294435416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8700013410 con 0x7f87040f6470 2024-03-12T16:02:58.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.706+0000 7f86fa7fc700 1 -- 172.21.15.134:0/4294435416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 229+0+0 (secure 0 0 0) 0x7f870001c5a0 con 0x7f87040f6470 2024-03-12T16:02:58.709 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.706+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8704114aa0 con 0x7f87040f6470 2024-03-12T16:02:58.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.707+0000 7f86fa7fc700 1 -- 172.21.15.134:0/4294435416 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 17) v1 ==== 38743+0+0 (secure 0 0 0) 0x7f870001c700 con 0x7f87040f6470 2024-03-12T16:02:58.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.707+0000 7f86fa7fc700 1 --2- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86f0032830 0x7f86f0034cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:02:58.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.707+0000 7f86fa7fc700 1 -- 172.21.15.134:0/4294435416 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f8700044fc0 con 0x7f87040f6470 2024-03-12T16:02:58.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.707+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f870405f080 con 0x7f87040f6470 2024-03-12T16:02:58.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.707+0000 7f8708c65700 1 --2- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86f0032830 0x7f86f0034cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:02:58.710 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.708+0000 7f8708c65700 1 --2- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86f0032830 0x7f86f0034cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f86f4009780 tx=0x7f86f4006cc0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:02:58.714 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.712+0000 7f86fa7fc700 1 -- 172.21.15.134:0/4294435416 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f870001ca50 con 0x7f87040f6470 2024-03-12T16:02:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.951+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7f870405a310 con 0x7f87040f6470 2024-03-12T16:02:58.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.952+0000 7f86fa7fc700 1 -- 172.21.15.134:0/4294435416 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 1 v1) v1 ==== 95+0+727 (secure 0 0 0) 0x7f870001be90 con 0x7f87040f6470 2024-03-12T16:02:58.954 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:02:58.954 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":1,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:00:39.302317Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86f0032830 msgr2=0x7f86f0034cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 --2- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86f0032830 0x7f86f0034cf0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 rx=0x7f86f4009780 tx=0x7f86f4006cc0).stop 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 msgr2=0x7f8704113fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 --2- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 0x7f8704113fa0 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f8700009330 tx=0x7f8700009cb0).stop 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 shutdown_connections 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 --2- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86f0032830 0x7f86f0034cf0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 --2- 172.21.15.134:0/4294435416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87040f6470 0x7f8704113fa0 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 >> 172.21.15.134:0/4294435416 conn(0x7f870406c450 msgr2=0x7f87041052a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 shutdown_connections 2024-03-12T16:02:58.956 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:02:58.954+0000 7f870b6ca700 1 -- 172.21.15.134:0/4294435416 wait complete. 2024-03-12T16:02:58.957 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 1 2024-03-12T16:02:59.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.126+0000 7fdf0e935880 0 set uid:gid to 167:167 (ceph:ceph) 2024-03-12T16:02:59.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.126+0000 7fdf0e935880 0 ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable), process ceph-mon, pid 7 2024-03-12T16:02:59.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.126+0000 7fdf0e935880 0 pidfile_write: ignore empty --pid-file 2024-03-12T16:02:59.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.130+0000 7fdf0e935880 0 load: jerasure load: lrc load: isa 2024-03-12T16:02:59.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: RocksDB version: 6.8.1 2024-03-12T16:02:59.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-03-12T16:02:59.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Compile date Mar 4 2024 2024-03-12T16:02:59.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: DB SUMMARY 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: CURRENT file: CURRENT 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: IDENTITY file: IDENTITY 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: MANIFEST file: MANIFEST-000001 size: 13 Bytes 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 0, files: 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000003.log size: 511 ; 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.error_if_exists: 0 2024-03-12T16:02:59.414 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.create_if_missing: 0 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.paranoid_checks: 1 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.env: 0x55a361869080 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.fs: Posix File System 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.info_log: 0x55a363ada560 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_file_opening_threads: 16 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.statistics: (nil) 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.use_fsync: 0 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_log_file_size: 0 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.log_file_time_to_roll: 0 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.keep_log_file_num: 1000 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.recycle_log_file_num: 0 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.allow_fallocate: 1 2024-03-12T16:02:59.415 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.allow_mmap_reads: 0 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.allow_mmap_writes: 0 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.use_direct_reads: 0 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.create_missing_column_families: 0 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.db_log_dir: 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-smithi134/store.db 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.table_cache_numshardbits: 6 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_subcompactions: 1 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_background_flushes: -1 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.WAL_ttl_seconds: 0 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.WAL_size_limit_MB: 0 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-12T16:02:59.416 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.is_fd_close_on_exec: 1 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.advise_random_on_open: 1 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.db_write_buffer_size: 0 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.write_buffer_manager: 0x55a36474a450 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.use_adaptive_mutex: 0 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.rate_limiter: (nil) 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.wal_recovery_mode: 2 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.enable_thread_tracking: 0 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.enable_pipelined_write: 0 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.unordered_write: 0 2024-03-12T16:02:59.417 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.row_cache: None 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.wal_filter: None 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.allow_ingest_behind: 0 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.preserve_deletes: 0 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.two_write_queues: 0 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.manual_wal_flush: 0 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.atomic_flush: 0 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.persist_stats_to_disk: 0 2024-03-12T16:02:59.418 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.write_dbid_to_manifest: 0 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.log_readahead_size: 0 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.sst_file_checksum_func: Unknown 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_background_jobs: 2 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_background_compactions: -1 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.delayed_write_rate : 16777216 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_total_wal_size: 0 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.stats_dump_period_sec: 600 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.stats_persist_period_sec: 600 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.max_open_files: -1 2024-03-12T16:02:59.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.bytes_per_sync: 0 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.wal_bytes_per_sync: 0 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.strict_bytes_per_sync: 0 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Options.compaction_readahead_size: 0 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Compression algorithms supported: 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: kZSTD supported: 0 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: kXpressCompression supported: 0 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: kLZ4HCCompression supported: 1 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: kLZ4Compression supported: 1 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: kBZip2Compression supported: 0 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: kZlibCompression supported: 1 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: kSnappyCompression supported: 1 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.131+0000 7fdf0e935880 4 rocksdb: Fast CRC32 supported: Supported on x86 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: [version_set.cc:4413] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000001 2024-03-12T16:02:59.420 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: [column_family.cc:552] --------------- Options for column family [default]: 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.merge_operator: 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_filter: None 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_filter_factory: None 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.memtable_factory: SkipListFactory 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.table_factory: BlockBasedTable 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55a363a7fd10) 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cache_index_and_filter_blocks: 1 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: pin_top_level_index_and_filter: 1 2024-03-12T16:02:59.421 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: index_type: 0 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: data_block_index_type: 0 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: index_shortening: 1 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: data_block_hash_table_util_ratio: 0.750000 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: hash_index_allow_collision: 1 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: checksum: 1 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: no_block_cache: 0 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: block_cache: 0x55a363ab4f10 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: block_cache_name: BinnedLRUCache 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: block_cache_options: 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: capacity : 536870912 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: num_shard_bits : 4 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: strict_capacity_limit : 0 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: high_pri_pool_ratio: 0.000 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: block_cache_compressed: (nil) 2024-03-12T16:02:59.422 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: persistent_cache: (nil) 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: block_size: 4096 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: block_size_deviation: 10 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: block_restart_interval: 16 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: index_block_restart_interval: 1 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: metadata_block_size: 4096 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: partition_filters: 0 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: use_delta_encoding: 1 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: filter_policy: rocksdb.BuiltinBloomFilter 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: whole_key_filtering: 1 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: verify_compression: 0 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: read_amp_bytes_per_bit: 0 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: format_version: 2 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: enable_index_compression: 1 2024-03-12T16:02:59.423 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: block_align: 0 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.write_buffer_size: 33554432 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_write_buffer_number: 2 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compression: NoCompression 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.bottommost_compression: Disabled 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.prefix_extractor: nullptr 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.num_levels: 7 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-12T16:02:59.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compression_opts.window_bits: -14 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compression_opts.level: 32767 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compression_opts.strategy: 0 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compression_opts.enabled: false 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.target_file_size_base: 67108864 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.target_file_size_multiplier: 1 2024-03-12T16:02:59.425 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.arena_block_size: 4194304 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-12T16:02:59.426 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.disable_auto_compactions: 0 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.table_properties_collectors: 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.inplace_update_support: 0 2024-03-12T16:02:59.427 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.inplace_update_num_locks: 10000 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.memtable_huge_page_size: 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.bloom_locality: 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.max_successive_merges: 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.optimize_filters_for_hits: 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.paranoid_file_checks: 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.force_consistency_checks: 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.report_bg_io_stats: 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.ttl: 2592000 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: Options.periodic_compaction_seconds: 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: [version_set.cc:4568] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000001 succeeded,manifest_file_number is 1, next_file_number is 3, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: [version_set.cc:4577] Column family [default] (ID 0), log number is 0 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.428 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710259379133860, "job": 1, "event": "recovery_started", "log_files": [3]} 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 4 rocksdb: [db_impl/db_impl_open.cc:760] Recovering log #3 mode 2 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.132+0000 7fdf0e935880 3 rocksdb: [le/block_based/filter_policy.cc:584] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.133+0000 7fdf0e935880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710259379134312, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 4, "file_size": 1437, "table_properties": {"data_size": 523, "index_size": 40, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 0, "index_value_is_delta_encoded": 0, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 401, "raw_average_value_size": 80, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1710259379, "oldest_key_time": 3, "file_creation_time": 0}} 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.133+0000 7fdf0e935880 4 rocksdb: [version_set.cc:3826] Creating manifest 5 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.133+0000 7fdf0e935880 4 rocksdb: EVENT_LOG_v1 {"time_micros": 1710259379134695, "job": 1, "event": "recovery_finished"} 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.134+0000 7fdf0e935880 4 rocksdb: DB pointer 0x55a363b7d800 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.134+0000 7fdef5727700 4 rocksdb: [db_impl/db_impl.cc:850] ------- DUMPING STATS ------- 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.134+0000 7fdef5727700 4 rocksdb: [db_impl/db_impl.cc:851] 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ** DB Stats ** 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-12T16:02:59.429 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ** Compaction Stats [default] ** 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ** Compaction Stats [default] ** 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:02:59.430 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: AddFile(Total Files): cumulative 0, interval 0 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: AddFile(Keys): cumulative 0, interval 0 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Cumulative compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Interval compaction: 0.00 GB write, 0.62 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ** File Read Latency Histogram By Level [default] ** 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ** Compaction Stats [default] ** 2024-03-12T16:02:59.431 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: L0 1/0 1.40 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Sum 1/0 1.40 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ** Compaction Stats [default] ** 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 3.2 0.00 0.00 1 0.000 0 0 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Flush(GB): cumulative 0.000, interval 0.000 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: AddFile(Total Files): cumulative 0, interval 0 2024-03-12T16:02:59.432 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: AddFile(L0 Files): cumulative 0, interval 0 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: AddFile(Keys): cumulative 0, interval 0 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Cumulative compaction: 0.00 GB write, 0.61 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: ** File Read Latency Histogram By Level [default] ** 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.134+0000 7fdf0e935880 0 mon.smithi134 does not exist in monmap, will attempt to join an existing cluster 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.134+0000 7fdf0e935880 0 using public_addr v2:172.21.15.134:0/0 -> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.135+0000 7fdf0e935880 0 starting mon.smithi134 rank -1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.137+0000 7fdf0e935880 1 mon.smithi134@-1(???) e0 preinit fsid 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 0 mon.smithi134@-1(synchronizing).mds e1 new map 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 0 mon.smithi134@-1(synchronizing).mds e1 print_map 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: e1 2024-03-12T16:02:59.433 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: legacy client fscid: -1 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: No filesystems configured 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 1 mon.smithi134@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 1 mon.smithi134@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 1 mon.smithi134@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 1 mon.smithi134@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 1 mon.smithi134@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 1 mon.smithi134@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 1 mon.smithi134@-1(synchronizing).osd e5 e5: 0 total, 0 up, 0 in 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 0 mon.smithi134@-1(synchronizing).osd e5 crush map has features 3314932999778484224, adjusting msgr requires 2024-03-12T16:02:59.434 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 0 mon.smithi134@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-12T16:02:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 0 mon.smithi134@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-12T16:02:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.163+0000 7fdef7f2c700 0 mon.smithi134@-1(synchronizing).osd e5 crush map has features 288514050185494528, adjusting msgr requires 2024-03-12T16:02:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:02:58.953080+0000 mon.smithi006 (mon.0) 169 : audit [DBG] from='client.? 172.21.15.134:0/4294435416' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:59.435 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:02:59.164+0000 7fdef7f2c700 1 mon.smithi134@-1(synchronizing).paxosservice(auth 1..6) refresh upgraded, format 0 -> 3 2024-03-12T16:02:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:02:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:58.953080+0000 mon.smithi006 (mon.0) 169 : audit [DBG] from='client.? 172.21.15.134:0/4294435416' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:02:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 bash[42635]: 6f04fa39fa4e52740c29882e1836ad350a373b2ce27db2c02f69bc97c1fc4a6f 2024-03-12T16:02:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:02:59 smithi134 systemd[1]: Started Ceph mon.smithi134 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:03:00.803 INFO:tasks.cephadm:Waiting for 2 mons in monmap... 2024-03-12T16:03:00.804 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mon dump -f json 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:02:59.171696+0000 mon.smithi006 (mon.0) 171 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:02:59.171934+0000 mon.smithi006 (mon.0) 172 : cluster [INF] mon.smithi006 calling monitor election 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:02:59.185504+0000 mon.smithi006 (mon.0) 173 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:02:59.670957+0000 mon.smithi006 (mon.0) 174 : audit [DBG] from='mgr.? 172.21.15.134:0/2818102865' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:02:59.926295+0000 mgr.smithi006.kskdce (mgr.14196) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:00.168832+0000 mon.smithi006 (mon.0) 175 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:01.168645+0000 mon.smithi006 (mon.0) 176 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:01.169713+0000 mon.smithi134 (mon.1) 1 : cluster [INF] mon.smithi134 calling monitor election 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:01.926714+0000 mgr.smithi006.kskdce (mgr.14196) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:04.604 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:02.168978+0000 mon.smithi006 (mon.0) 177 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:03.168935+0000 mon.smithi006 (mon.0) 178 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:04.169397+0000 mon.smithi006 (mon.0) 179 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:04.199619+0000 mon.smithi006 (mon.0) 180 : cluster [INF] mon.smithi006 is new leader, mons smithi006,smithi134 in quorum (ranks 0,1) 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:04.202766+0000 mon.smithi006 (mon.0) 181 : cluster [DBG] monmap e2: 2 mons at {smithi006=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:04.203253+0000 mon.smithi006 (mon.0) 182 : cluster [DBG] fsmap 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:04.203297+0000 mon.smithi006 (mon.0) 183 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:04.203561+0000 mon.smithi006 (mon.0) 184 : cluster [DBG] mgrmap e17: smithi006.kskdce(active, since 24s) 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:04.203731+0000 mon.smithi006 (mon.0) 185 : cluster [INF] overall HEALTH_OK 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:04.203989+0000 mon.smithi006 (mon.0) 186 : cluster [DBG] Standby manager daemon smithi134.gcntfu started 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:04.206503+0000 mon.smithi006 (mon.0) 187 : audit [DBG] from='mgr.? 172.21.15.134:0/2818102865' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:04.208428+0000 mon.smithi006 (mon.0) 188 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:04.208787+0000 mon.smithi006 (mon.0) 189 : audit [DBG] from='mgr.? 172.21.15.134:0/2818102865' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:03:04.605 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:04.209349+0000 mon.smithi006 (mon.0) 190 : audit [DBG] from='mgr.? 172.21.15.134:0/2818102865' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:03:04.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:59.171696+0000 mon.smithi006 (mon.0) 171 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:03:04.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:59.171934+0000 mon.smithi006 (mon.0) 172 : cluster [INF] mon.smithi006 calling monitor election 2024-03-12T16:03:04.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:59.185504+0000 mon.smithi006 (mon.0) 173 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:02:59.670957+0000 mon.smithi006 (mon.0) 174 : audit [DBG] from='mgr.? 172.21.15.134:0/2818102865' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:02:59.926295+0000 mgr.smithi006.kskdce (mgr.14196) 8 : cluster [DBG] pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:00.168832+0000 mon.smithi006 (mon.0) 175 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:01.168645+0000 mon.smithi006 (mon.0) 176 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:01.169713+0000 mon.smithi134 (mon.1) 1 : cluster [INF] mon.smithi134 calling monitor election 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:01.926714+0000 mgr.smithi006.kskdce (mgr.14196) 9 : cluster [DBG] pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:02.168978+0000 mon.smithi006 (mon.0) 177 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:03.168935+0000 mon.smithi006 (mon.0) 178 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:04.169397+0000 mon.smithi006 (mon.0) 179 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:04.199619+0000 mon.smithi006 (mon.0) 180 : cluster [INF] mon.smithi006 is new leader, mons smithi006,smithi134 in quorum (ranks 0,1) 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:04.202766+0000 mon.smithi006 (mon.0) 181 : cluster [DBG] monmap e2: 2 mons at {smithi006=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:04.203253+0000 mon.smithi006 (mon.0) 182 : cluster [DBG] fsmap 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:04.203297+0000 mon.smithi006 (mon.0) 183 : cluster [DBG] osdmap e5: 0 total, 0 up, 0 in 2024-03-12T16:03:04.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:04.203561+0000 mon.smithi006 (mon.0) 184 : cluster [DBG] mgrmap e17: smithi006.kskdce(active, since 24s) 2024-03-12T16:03:04.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:04.203731+0000 mon.smithi006 (mon.0) 185 : cluster [INF] overall HEALTH_OK 2024-03-12T16:03:04.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:04.203989+0000 mon.smithi006 (mon.0) 186 : cluster [DBG] Standby manager daemon smithi134.gcntfu started 2024-03-12T16:03:04.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:04.206503+0000 mon.smithi006 (mon.0) 187 : audit [DBG] from='mgr.? 172.21.15.134:0/2818102865' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:03:04.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:04.208428+0000 mon.smithi006 (mon.0) 188 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:04.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:04.208787+0000 mon.smithi006 (mon.0) 189 : audit [DBG] from='mgr.? 172.21.15.134:0/2818102865' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:03:04.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:04.209349+0000 mon.smithi006 (mon.0) 190 : audit [DBG] from='mgr.? 172.21.15.134:0/2818102865' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:03:05.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:03.927039+0000 mgr.smithi006.kskdce (mgr.14196) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:05.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:03:04.210463+0000 mgr.smithi006.kskdce (mgr.14196) 11 : cephadm [INF] Deploying daemon node-exporter.smithi134 on smithi134 2024-03-12T16:03:05.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:04.264349+0000 mon.smithi006 (mon.0) 191 : cluster [DBG] mgrmap e18: smithi006.kskdce(active, since 24s), standbys: smithi134.gcntfu 2024-03-12T16:03:05.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:04.264511+0000 mon.smithi006 (mon.0) 192 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi134.gcntfu", "id": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:03:05.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:05.071673+0000 mon.smithi006 (mon.0) 193 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:05.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:05.169510+0000 mon.smithi006 (mon.0) 194 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:05.706 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:03.927039+0000 mgr.smithi006.kskdce (mgr.14196) 10 : cluster [DBG] pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:05.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:03:04.210463+0000 mgr.smithi006.kskdce (mgr.14196) 11 : cephadm [INF] Deploying daemon node-exporter.smithi134 on smithi134 2024-03-12T16:03:05.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:04.264349+0000 mon.smithi006 (mon.0) 191 : cluster [DBG] mgrmap e18: smithi006.kskdce(active, since 24s), standbys: smithi134.gcntfu 2024-03-12T16:03:05.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:04.264511+0000 mon.smithi006 (mon.0) 192 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi134.gcntfu", "id": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:03:05.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:05.071673+0000 mon.smithi006 (mon.0) 193 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:05.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:05.169510+0000 mon.smithi006 (mon.0) 194 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:03:05.765 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.760+0000 7fd2feb6a700 1 -- 172.21.15.134:0/3330387867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8003400 msgr2=0x7fd2e8005890 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.761+0000 7fd2feb6a700 1 --2- 172.21.15.134:0/3330387867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8003400 0x7fd2e8005890 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7fd2f80f6590 tx=0x7fd2ec00b040).stop 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.761+0000 7fd2feb6a700 1 -- 172.21.15.134:0/3330387867 shutdown_connections 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.761+0000 7fd2feb6a700 1 --2- 172.21.15.134:0/3330387867 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8003400 0x7fd2e8005890 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.761+0000 7fd2feb6a700 1 -- 172.21.15.134:0/3330387867 >> 172.21.15.134:0/3330387867 conn(0x7fd2f806c440 msgr2=0x7fd2f806c850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.761+0000 7fd2feb6a700 1 -- 172.21.15.134:0/3330387867 shutdown_connections 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.761+0000 7fd2feb6a700 1 -- 172.21.15.134:0/3330387867 wait complete. 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.762+0000 7fd2feb6a700 1 Processor -- start 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.762+0000 7fd2feb6a700 1 -- start start 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.762+0000 7fd2feb6a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8003400 0x7fd2f810d820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.762+0000 7fd2feb6a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 0x7fd2f81077b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.762+0000 7fd2feb6a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f810e2e0 con 0x7fd2e8003400 2024-03-12T16:03:05.766 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.762+0000 7fd2feb6a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2f810e420 con 0x7fd2f810dd10 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 0x7fd2f81077b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f7fff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 0x7fd2f81077b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:60388/0 (socket says 172.21.15.134:60388) 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f7fff700 1 -- 172.21.15.134:0/2077273654 learned_addr learned my addr 172.21.15.134:0/2077273654 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2fc906700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8003400 0x7fd2f810d820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f7fff700 1 -- 172.21.15.134:0/2077273654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 msgr2=0x7fd2f81077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f7fff700 1 -- 172.21.15.134:0/2077273654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 msgr2=0x7fd2f81077b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f7fff700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 0x7fd2f81077b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f7fff700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 0x7fd2f81077b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2fc906700 1 -- 172.21.15.134:0/2077273654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 msgr2=0x7fd2f81077b0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2fc906700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 0x7fd2f81077b0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2fc906700 1 -- 172.21.15.134:0/2077273654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd2ec005040 con 0x7fd2e8003400 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2fc906700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8003400 0x7fd2f810d820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd2ec019040 tx=0x7fd2ec002040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f5ffb700 1 -- 172.21.15.134:0/2077273654 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ec020440 con 0x7fd2e8003400 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f5ffb700 1 -- 172.21.15.134:0/2077273654 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fd2ec020a30 con 0x7fd2e8003400 2024-03-12T16:03:05.767 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2f5ffb700 1 -- 172.21.15.134:0/2077273654 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd2ec01f840 con 0x7fd2e8003400 2024-03-12T16:03:05.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.763+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2f8107d00 con 0x7fd2e8003400 2024-03-12T16:03:05.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.764+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2f8108210 con 0x7fd2e8003400 2024-03-12T16:03:05.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.765+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2f805f1f0 con 0x7fd2e8003400 2024-03-12T16:03:05.768 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.765+0000 7fd2f5ffb700 1 -- 172.21.15.134:0/2077273654 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fd2ec0205a0 con 0x7fd2e8003400 2024-03-12T16:03:05.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.765+0000 7fd2f5ffb700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd2dc0612d0 0x7fd2dc063790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:05.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.766+0000 7fd2f5ffb700 1 -- 172.21.15.134:0/2077273654 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7fd2ec07cdd0 con 0x7fd2e8003400 2024-03-12T16:03:05.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.766+0000 7fd2f7fff700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd2dc0612d0 0x7fd2dc063790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:05.769 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.766+0000 7fd2f7fff700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd2dc0612d0 0x7fd2dc063790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd2e4006fd0 tx=0x7fd2e4008040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:03:05.772 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.770+0000 7fd2f5ffb700 1 -- 172.21.15.134:0/2077273654 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd2ec051df0 con 0x7fd2e8003400 2024-03-12T16:03:06.000 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.998+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mon dump", "format": "json"} v 0) v1 -- 0x7fd2f8046ce0 con 0x7fd2e8003400 2024-03-12T16:03:06.001 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:05.999+0000 7fd2f5ffb700 1 -- 172.21.15.134:0/2077273654 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mon dump", "format": "json"}]=0 dumped monmap epoch 2 v2) v1 ==== 95+0+1005 (secure 0 0 0) 0x7fd2ec01b020 con 0x7fd2e8003400 2024-03-12T16:03:06.001 INFO:teuthology.orchestra.run.smithi134.stdout: 2024-03-12T16:03:06.001 INFO:teuthology.orchestra.run.smithi134.stdout:{"epoch":2,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","modified":"2024-03-12T16:02:59.169045Z","created":"2024-03-12T16:00:39.302317Z","min_mon_release":16,"min_mon_release_name":"pacific","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","removed_ranks: ":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging"],"optional":[]},"mons":[{"rank":0,"name":"smithi006","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:3300","nonce":0},{"type":"v1","addr":"172.21.15.6:6789","nonce":0}]},"addr":"172.21.15.6:6789/0","public_addr":"172.21.15.6:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"smithi134","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:3300","nonce":0},{"type":"v1","addr":"172.21.15.134:6789","nonce":0}]},"addr":"172.21.15.134:6789/0","public_addr":"172.21.15.134:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd2dc0612d0 msgr2=0x7fd2dc063790 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd2dc0612d0 0x7fd2dc063790 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fd2e4006fd0 tx=0x7fd2e4008040).stop 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8003400 msgr2=0x7fd2f810d820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8003400 0x7fd2f810d820 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7fd2ec019040 tx=0x7fd2ec002040).stop 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 shutdown_connections 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd2dc0612d0 0x7fd2dc063790 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2e8003400 0x7fd2f810d820 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 --2- 172.21.15.134:0/2077273654 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2f810dd10 0x7fd2f81077b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 >> 172.21.15.134:0/2077273654 conn(0x7fd2f806c440 msgr2=0x7fd2f80fa630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 shutdown_connections 2024-03-12T16:03:06.003 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:03:06.001+0000 7fd2feb6a700 1 -- 172.21.15.134:0/2077273654 wait complete. 2024-03-12T16:03:06.004 INFO:teuthology.orchestra.run.smithi134.stderr:dumped monmap epoch 2 2024-03-12T16:03:06.382 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:06.000324+0000 mon.smithi006 (mon.0) 195 : audit [DBG] from='client.? 172.21.15.134:0/2077273654' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:03:06.684 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-03-12T16:03:06.684 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph config generate-minimal-conf 2024-03-12T16:03:06.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:06.000324+0000 mon.smithi006 (mon.0) 195 : audit [DBG] from='client.? 172.21.15.134:0/2077273654' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-03-12T16:03:07.423 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:05.927274+0000 mgr.smithi006.kskdce (mgr.14196) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:07.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:05.927274+0000 mgr.smithi006.kskdce (mgr.14196) 12 : cluster [DBG] pgmap v6: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.573+0000 7ff0058e6700 1 -- 172.21.15.6:0/572136705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0000fd5f0 msgr2=0x7ff0000fd9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.573+0000 7ff0058e6700 1 --2- 172.21.15.6:0/572136705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0000fd5f0 0x7ff0000fd9d0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7feff0004770 tx=0x7feff0009cb0).stop 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.573+0000 7ff0058e6700 1 -- 172.21.15.6:0/572136705 shutdown_connections 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.573+0000 7ff0058e6700 1 --2- 172.21.15.6:0/572136705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff0000fd5f0 0x7ff0000fd9d0 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.573+0000 7ff0058e6700 1 -- 172.21.15.6:0/572136705 >> 172.21.15.6:0/572136705 conn(0x7ff0000f1890 msgr2=0x7ff0000f3cb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.573+0000 7ff0058e6700 1 -- 172.21.15.6:0/572136705 shutdown_connections 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.573+0000 7ff0058e6700 1 -- 172.21.15.6:0/572136705 wait complete. 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.573+0000 7ff0058e6700 1 Processor -- start 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.573+0000 7ff0058e6700 1 -- start start 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7ff0058e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0000fd5f0 0x7ff00010da00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:08.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7ff0058e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00010def0 0x7ff000107990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7ff0058e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00010e4c0 con 0x7ff00010def0 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7ff0058e6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff00010e600 con 0x7ff0000fd5f0 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7feffe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00010def0 0x7ff000107990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7feffe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00010def0 0x7ff000107990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50808/0 (socket says 172.21.15.6:50808) 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7feffe7fc700 1 -- 172.21.15.6:0/3313788617 learned_addr learned my addr 172.21.15.6:0/3313788617 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7feffe7fc700 1 -- 172.21.15.6:0/3313788617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0000fd5f0 msgr2=0x7ff00010da00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7feffeffd700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0000fd5f0 0x7ff00010da00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7feffe7fc700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0000fd5f0 0x7ff00010da00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7feffe7fc700 1 -- 172.21.15.6:0/3313788617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feff0005040 con 0x7ff00010def0 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7feffe7fc700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00010def0 0x7ff000107990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7feff400b550 tx=0x7feff40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7fefe7fff700 1 -- 172.21.15.6:0/3313788617 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff400f6f0 con 0x7ff00010def0 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7fefe7fff700 1 -- 172.21.15.6:0/3313788617 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7feff400fce0 con 0x7ff00010def0 2024-03-12T16:03:08.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff000107f40 con 0x7ff00010def0 2024-03-12T16:03:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7fefe7fff700 1 -- 172.21.15.6:0/3313788617 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feff4011ce0 con 0x7ff00010def0 2024-03-12T16:03:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.574+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff000108500 con 0x7ff00010def0 2024-03-12T16:03:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.575+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff00005f060 con 0x7ff00010def0 2024-03-12T16:03:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.576+0000 7fefe7fff700 1 -- 172.21.15.6:0/3313788617 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7feff400f850 con 0x7ff00010def0 2024-03-12T16:03:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.576+0000 7fefe7fff700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fefe8061280 0x7fefe8063740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.576+0000 7fefe7fff700 1 -- 172.21.15.6:0/3313788617 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7feff407b710 con 0x7ff00010def0 2024-03-12T16:03:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.576+0000 7feffeffd700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fefe8061280 0x7fefe8063740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.577+0000 7feffeffd700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fefe8061280 0x7fefe8063740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7feff0009ee0 tx=0x7feff000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:03:08.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.580+0000 7fefe7fff700 1 -- 172.21.15.6:0/3313788617 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7feff4050660 con 0x7ff00010def0 2024-03-12T16:03:08.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.751+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "config generate-minimal-conf"} v 0) v1 -- 0x7ff000101630 con 0x7ff00010def0 2024-03-12T16:03:08.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.751+0000 7fefe7fff700 1 -- 172.21.15.6:0/3313788617 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "config generate-minimal-conf"}]=0 v10) v1 ==== 76+0+223 (secure 0 0 0) 0x7feff4050250 con 0x7ff00010def0 2024-03-12T16:03:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:# minimal ceph.conf for 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:03:08.754 INFO:teuthology.orchestra.run.smithi006.stdout:[global] 2024-03-12T16:03:08.754 INFO:teuthology.orchestra.run.smithi006.stdout: fsid = 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:03:08.754 INFO:teuthology.orchestra.run.smithi006.stdout: mon_host = [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] 2024-03-12T16:03:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fefe8061280 msgr2=0x7fefe8063740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fefe8061280 0x7fefe8063740 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7feff0009ee0 tx=0x7feff000b040).stop 2024-03-12T16:03:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00010def0 msgr2=0x7ff000107990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00010def0 0x7ff000107990 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7feff400b550 tx=0x7feff40090f0).stop 2024-03-12T16:03:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 shutdown_connections 2024-03-12T16:03:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fefe8061280 0x7fefe8063740 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:08.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff0000fd5f0 0x7ff00010da00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 --2- 172.21.15.6:0/3313788617 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff00010def0 0x7ff000107990 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 >> 172.21.15.6:0/3313788617 conn(0x7ff0000f1890 msgr2=0x7ff0000f1ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:03:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 shutdown_connections 2024-03-12T16:03:08.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:08.753+0000 7ff0058e6700 1 -- 172.21.15.6:0/3313788617 wait complete. 2024-03-12T16:03:09.323 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-03-12T16:03:09.323 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:03:09.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.conf 2024-03-12T16:03:09.393 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:07.927693+0000 mgr.smithi006.kskdce (mgr.14196) 13 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:09.393 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:08.753160+0000 mon.smithi006 (mon.0) 196 : audit [DBG] from='client.? 172.21.15.6:0/3313788617' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:09.397 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:03:09.397 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:03:09.465 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T16:03:09.465 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.conf 2024-03-12T16:03:09.503 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T16:03:09.503 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:03:09.571 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:07.927693+0000 mgr.smithi006.kskdce (mgr.14196) 13 : cluster [DBG] pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:09.571 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:08.753160+0000 mon.smithi006 (mon.0) 196 : audit [DBG] from='client.? 172.21.15.6:0/3313788617' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:09.574 INFO:tasks.cephadm:Deploying OSDs... 2024-03-12T16:03:09.575 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:03:09.575 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/scratch_devs of=/dev/stdout 2024-03-12T16:03:09.594 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-12T16:03:09.594 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_1 2024-03-12T16:03:09.653 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-12T16:03:09.653 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T16:03:09.653 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 164439 Links: 1 2024-03-12T16:03:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:03:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T16:03:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-03-12 16:02:30.502002981 +0000 2024-03-12T16:03:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-03-12 15:54:39.358690451 +0000 2024-03-12T16:03:09.654 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-03-12 15:54:39.358690451 +0000 2024-03-12T16:03:09.654 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-03-12T16:03:09.654 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-12T16:03:09.721 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-03-12T16:03:09.721 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-03-12T16:03:09.721 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000204498 s, 2.5 MB/s 2024-03-12T16:03:09.722 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-12T16:03:09.782 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_2 2024-03-12T16:03:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-12T16:03:09.841 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T16:03:09.841 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 167465 Links: 1 2024-03-12T16:03:09.841 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:03:09.841 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T16:03:09.841 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-03-12 16:02:30.502002981 +0000 2024-03-12T16:03:09.841 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-03-12 15:54:39.716686642 +0000 2024-03-12T16:03:09.841 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-03-12 15:54:39.716686642 +0000 2024-03-12T16:03:09.842 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-03-12T16:03:09.842 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-12T16:03:09.908 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-03-12T16:03:09.908 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-03-12T16:03:09.908 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000213227 s, 2.4 MB/s 2024-03-12T16:03:09.909 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-12T16:03:09.970 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_3 2024-03-12T16:03:10.030 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-12T16:03:10.030 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T16:03:10.030 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 167578 Links: 1 2024-03-12T16:03:10.030 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:03:10.030 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T16:03:10.030 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-03-12 16:02:30.503002970 +0000 2024-03-12T16:03:10.030 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-03-12 15:54:40.075682822 +0000 2024-03-12T16:03:10.030 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-03-12 15:54:40.075682822 +0000 2024-03-12T16:03:10.030 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-03-12T16:03:10.031 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-12T16:03:10.097 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-03-12T16:03:10.097 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-03-12T16:03:10.097 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000198594 s, 2.6 MB/s 2024-03-12T16:03:10.098 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-12T16:03:10.158 DEBUG:teuthology.orchestra.run.smithi006:> stat /dev/vg_nvme/lv_4 2024-03-12T16:03:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-12T16:03:10.216 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T16:03:10.216 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 6h/6d Inode: 166818 Links: 1 2024-03-12T16:03:10.216 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:03:10.216 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T16:03:10.216 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 2024-03-12 16:02:30.503002970 +0000 2024-03-12T16:03:10.216 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-03-12 15:54:40.421679141 +0000 2024-03-12T16:03:10.217 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-03-12 15:54:40.421679141 +0000 2024-03-12T16:03:10.217 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-03-12T16:03:10.217 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-12T16:03:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records in 2024-03-12T16:03:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:1+0 records out 2024-03-12T16:03:10.283 INFO:teuthology.orchestra.run.smithi006.stderr:512 bytes copied, 0.000227327 s, 2.3 MB/s 2024-03-12T16:03:10.284 DEBUG:teuthology.orchestra.run.smithi006:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-12T16:03:10.343 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T16:03:10.344 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/scratch_devs of=/dev/stdout 2024-03-12T16:03:10.366 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-03-12T16:03:10.366 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_1 2024-03-12T16:03:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-03-12T16:03:10.428 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T16:03:10.428 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 168309 Links: 1 2024-03-12T16:03:10.428 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:03:10.428 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T16:03:10.428 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-03-12 16:03:04.650171973 +0000 2024-03-12T16:03:10.429 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-12 15:54:15.687537111 +0000 2024-03-12T16:03:10.429 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-12 15:54:15.687537111 +0000 2024-03-12T16:03:10.429 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-03-12T16:03:10.429 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-03-12T16:03:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-03-12T16:03:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-03-12T16:03:10.498 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000283867 s, 1.8 MB/s 2024-03-12T16:03:10.499 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-03-12T16:03:10.560 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_2 2024-03-12T16:03:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-03-12T16:03:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T16:03:10.620 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 164583 Links: 1 2024-03-12T16:03:10.620 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:03:10.620 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T16:03:10.620 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-03-12 16:03:04.650171973 +0000 2024-03-12T16:03:10.620 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-12 15:54:16.017529390 +0000 2024-03-12T16:03:10.620 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-12 15:54:16.017529390 +0000 2024-03-12T16:03:10.620 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-03-12T16:03:10.620 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-03-12T16:03:10.688 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-03-12T16:03:10.688 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-03-12T16:03:10.689 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.0002074 s, 2.5 MB/s 2024-03-12T16:03:10.689 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-03-12T16:03:10.749 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_3 2024-03-12T16:03:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-03-12T16:03:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T16:03:10.808 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 167172 Links: 1 2024-03-12T16:03:10.808 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:03:10.808 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T16:03:10.808 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-03-12 16:03:04.650171973 +0000 2024-03-12T16:03:10.808 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-12 15:54:16.353521528 +0000 2024-03-12T16:03:10.808 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-12 15:54:16.353521528 +0000 2024-03-12T16:03:10.808 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-03-12T16:03:10.809 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-03-12T16:03:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-03-12T16:03:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-03-12T16:03:10.875 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000188942 s, 2.7 MB/s 2024-03-12T16:03:10.876 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-03-12T16:03:10.936 DEBUG:teuthology.orchestra.run.smithi134:> stat /dev/vg_nvme/lv_4 2024-03-12T16:03:10.994 INFO:teuthology.orchestra.run.smithi134.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-03-12T16:03:10.995 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-03-12T16:03:10.995 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 6h/6d Inode: 164756 Links: 1 2024-03-12T16:03:10.995 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:03:10.995 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:device_t:s0 2024-03-12T16:03:10.995 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 2024-03-12 16:03:04.651171949 +0000 2024-03-12T16:03:10.995 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-12 15:54:16.689513666 +0000 2024-03-12T16:03:10.995 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-12 15:54:16.689513666 +0000 2024-03-12T16:03:10.995 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-03-12T16:03:10.995 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-03-12T16:03:11.060 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records in 2024-03-12T16:03:11.060 INFO:teuthology.orchestra.run.smithi134.stderr:1+0 records out 2024-03-12T16:03:11.060 INFO:teuthology.orchestra.run.smithi134.stderr:512 bytes copied, 0.000219359 s, 2.3 MB/s 2024-03-12T16:03:11.061 DEBUG:teuthology.orchestra.run.smithi134:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-03-12T16:03:11.120 INFO:tasks.cephadm:Deploying osd.0 on smithi006 with /dev/vg_nvme/lv_4... 2024-03-12T16:03:11.121 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-12T16:03:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:09.928203+0000 mgr.smithi006.kskdce (mgr.14196) 14 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:11.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:09.928203+0000 mgr.smithi006.kskdce (mgr.14196) 14 : cluster [DBG] pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-12T16:03:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-12T16:03:13.298 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2024-03-12T16:03:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2024-03-12T16:03:13.298 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0107506 s, 975 MB/s 2024-03-12T16:03:13.298 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2024-03-12T16:03:13.667 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:11.928468+0000 mgr.smithi006.kskdce (mgr.14196) 15 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:13.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:11.928468+0000 mgr.smithi006.kskdce (mgr.14196) 15 : cluster [DBG] pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:14.248 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi006:vg_nvme/lv_4 2024-03-12T16:03:15.605 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:13.929032+0000 mgr.smithi006.kskdce (mgr.14196) 16 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:13.929032+0000 mgr.smithi006.kskdce (mgr.14196) 16 : cluster [DBG] pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:16.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.068+0000 7f237fa61700 1 -- 172.21.15.6:0/4118102346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 msgr2=0x7f23780f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:16.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.068+0000 7f237fa61700 1 --2- 172.21.15.6:0/4118102346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 0x7f23780f6b10 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f23740047f0 tx=0x7f2374009cb0).stop 2024-03-12T16:03:16.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.068+0000 7f237fa61700 1 -- 172.21.15.6:0/4118102346 shutdown_connections 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.068+0000 7f237fa61700 1 --2- 172.21.15.6:0/4118102346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23780f7000 0x7f23780f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.068+0000 7f237fa61700 1 --2- 172.21.15.6:0/4118102346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 0x7f23780f6b10 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.068+0000 7f237fa61700 1 -- 172.21.15.6:0/4118102346 >> 172.21.15.6:0/4118102346 conn(0x7f23780f1ef0 msgr2=0x7f23780f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.068+0000 7f237fa61700 1 -- 172.21.15.6:0/4118102346 shutdown_connections 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237fa61700 1 -- 172.21.15.6:0/4118102346 wait complete. 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237fa61700 1 Processor -- start 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237fa61700 1 -- start start 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237fa61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 0x7f2378107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237fa61700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23780f7000 0x7f23781084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237fa61700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2378108a80 con 0x7f23780f66f0 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237fa61700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2378108bc0 con 0x7f23780f7000 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237d7fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 0x7f2378107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237d7fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 0x7f2378107fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58406/0 (socket says 172.21.15.6:58406) 2024-03-12T16:03:16.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.069+0000 7f237d7fd700 1 -- 172.21.15.6:0/1963204517 learned_addr learned my addr 172.21.15.6:0/1963204517 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f237cffc700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23780f7000 0x7f23781084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f237d7fd700 1 -- 172.21.15.6:0/1963204517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23780f7000 msgr2=0x7f23781084d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f237d7fd700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23780f7000 0x7f23781084d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f237d7fd700 1 -- 172.21.15.6:0/1963204517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2374005040 con 0x7f23780f66f0 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f237d7fd700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 0x7f2378107fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f2374005010 tx=0x7f2374009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f236e7fc700 1 -- 172.21.15.6:0/1963204517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f237400e030 con 0x7f23780f66f0 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f236e7fc700 1 -- 172.21.15.6:0/1963204517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2374007e90 con 0x7f23780f66f0 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f237810d600 con 0x7f23780f66f0 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f236e7fc700 1 -- 172.21.15.6:0/1963204517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2374018070 con 0x7f23780f66f0 2024-03-12T16:03:16.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.070+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f237810db40 con 0x7f23780f66f0 2024-03-12T16:03:16.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.071+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f23780feef0 con 0x7f23780f66f0 2024-03-12T16:03:16.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.072+0000 7f236e7fc700 1 -- 172.21.15.6:0/1963204517 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f237401d420 con 0x7f23780f66f0 2024-03-12T16:03:16.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.072+0000 7f236e7fc700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f23640611d0 0x7f2364063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:16.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.072+0000 7f236e7fc700 1 -- 172.21.15.6:0/1963204517 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(5..5 src has 1..5) v4 ==== 1237+0+0 (secure 0 0 0) 0x7f237407d1c0 con 0x7f23780f66f0 2024-03-12T16:03:16.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.072+0000 7f237cffc700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f23640611d0 0x7f2364063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:16.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.073+0000 7f237cffc700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f23640611d0 0x7f2364063690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f23680041d0 tx=0x7f2368009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:03:16.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.076+0000 7f236e7fc700 1 -- 172.21.15.6:0/1963204517 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f23740520d0 con 0x7f23780f66f0 2024-03-12T16:03:16.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:16.257+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f237810e1d0 con 0x7f23640611d0 2024-03-12T16:03:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:16.261996+0000 mon.smithi006 (mon.0) 197 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:03:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:16.263907+0000 mon.smithi006 (mon.0) 198 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:03:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:16.264470+0000 mon.smithi006 (mon.0) 199 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:16.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:16.261996+0000 mon.smithi006 (mon.0) 197 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:03:16.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:16.263907+0000 mon.smithi006 (mon.0) 198 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:03:16.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:16.264470+0000 mon.smithi006 (mon.0) 199 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:17.648 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:15.929354+0000 mgr.smithi006.kskdce (mgr.14196) 17 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:17.648 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:16.259409+0000 mgr.smithi006.kskdce (mgr.14196) 18 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:03:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:15.929354+0000 mgr.smithi006.kskdce (mgr.14196) 17 : cluster [DBG] pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:16.259409+0000 mgr.smithi006.kskdce (mgr.14196) 18 : audit [DBG] from='client.14226 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:03:18.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:17.929628+0000 mgr.smithi006.kskdce (mgr.14196) 19 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:18.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:17.929628+0000 mgr.smithi006.kskdce (mgr.14196) 19 : cluster [DBG] pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:19.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:18.681546+0000 mon.smithi006 (mon.0) 200 : audit [INF] from='client.? 172.21.15.6:0/1167550433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81b3ff11-3d87-4f3b-a302-c8c55f378ce1"}]: dispatch 2024-03-12T16:03:19.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:18.685503+0000 mon.smithi006 (mon.0) 201 : audit [INF] from='client.? 172.21.15.6:0/1167550433' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81b3ff11-3d87-4f3b-a302-c8c55f378ce1"}]': finished 2024-03-12T16:03:19.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:18.685541+0000 mon.smithi006 (mon.0) 202 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-03-12T16:03:19.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:18.685649+0000 mon.smithi006 (mon.0) 203 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:19.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:19.282585+0000 mon.smithi006 (mon.0) 204 : audit [DBG] from='client.? 172.21.15.6:0/1932716334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:03:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:18.681546+0000 mon.smithi006 (mon.0) 200 : audit [INF] from='client.? 172.21.15.6:0/1167550433' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "81b3ff11-3d87-4f3b-a302-c8c55f378ce1"}]: dispatch 2024-03-12T16:03:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:18.685503+0000 mon.smithi006 (mon.0) 201 : audit [INF] from='client.? 172.21.15.6:0/1167550433' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "81b3ff11-3d87-4f3b-a302-c8c55f378ce1"}]': finished 2024-03-12T16:03:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:18.685541+0000 mon.smithi006 (mon.0) 202 : cluster [DBG] osdmap e6: 1 total, 0 up, 1 in 2024-03-12T16:03:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:18.685649+0000 mon.smithi006 (mon.0) 203 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:19.282585+0000 mon.smithi006 (mon.0) 204 : audit [DBG] from='client.? 172.21.15.6:0/1932716334' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:03:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:19.871798+0000 mon.smithi006 (mon.0) 205 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:03:19.885896+0000 mgr.smithi006.kskdce (mgr.14196) 20 : cephadm [INF] Deploying daemon prometheus.smithi134 on smithi134 2024-03-12T16:03:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:19.929932+0000 mgr.smithi006.kskdce (mgr.14196) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:20.078336+0000 mon.smithi006 (mon.0) 206 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:19.871798+0000 mon.smithi006 (mon.0) 205 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:03:19.885896+0000 mgr.smithi006.kskdce (mgr.14196) 20 : cephadm [INF] Deploying daemon prometheus.smithi134 on smithi134 2024-03-12T16:03:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:19.929932+0000 mgr.smithi006.kskdce (mgr.14196) 21 : cluster [DBG] pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:20.078336+0000 mon.smithi006 (mon.0) 206 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:23.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:22 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:21.930198+0000 mgr.smithi006.kskdce (mgr.14196) 22 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:23.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:22 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:21.930198+0000 mgr.smithi006.kskdce (mgr.14196) 22 : cluster [DBG] pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:25.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:23.930550+0000 mgr.smithi006.kskdce (mgr.14196) 23 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:25.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:23.930550+0000 mgr.smithi006.kskdce (mgr.14196) 23 : cluster [DBG] pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:27.433 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:25.930905+0000 mgr.smithi006.kskdce (mgr.14196) 24 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:27.433 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:26.081822+0000 mon.smithi006 (mon.0) 207 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-12T16:03:27.434 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:26.082530+0000 mon.smithi006 (mon.0) 208 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:27.434 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:03:26.083153+0000 mgr.smithi006.kskdce (mgr.14196) 25 : cephadm [INF] Deploying daemon osd.0 on smithi006 2024-03-12T16:03:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:25.930905+0000 mgr.smithi006.kskdce (mgr.14196) 24 : cluster [DBG] pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:26.081822+0000 mon.smithi006 (mon.0) 207 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-12T16:03:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:26.082530+0000 mon.smithi006 (mon.0) 208 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:03:26.083153+0000 mgr.smithi006.kskdce (mgr.14196) 25 : cephadm [INF] Deploying daemon osd.0 on smithi006 2024-03-12T16:03:29.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:27.931165+0000 mgr.smithi006.kskdce (mgr.14196) 26 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:29.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:27.931165+0000 mgr.smithi006.kskdce (mgr.14196) 26 : cluster [DBG] pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:31.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:29.931387+0000 mgr.smithi006.kskdce (mgr.14196) 27 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:31.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:29.931387+0000 mgr.smithi006.kskdce (mgr.14196) 27 : cluster [DBG] pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:31.132616+0000 mon.smithi006 (mon.0) 209 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:31.132616+0000 mon.smithi006 (mon.0) 209 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:33.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:31.931727+0000 mgr.smithi006.kskdce (mgr.14196) 28 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:33.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:31.931727+0000 mgr.smithi006.kskdce (mgr.14196) 28 : cluster [DBG] pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:33.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.736+0000 7f236e7fc700 1 -- 172.21.15.6:0/1963204517 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f237810e1d0 con 0x7f23640611d0 2024-03-12T16:03:33.737 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 0 on host 'smithi006' 2024-03-12T16:03:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f23640611d0 msgr2=0x7f2364063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f23640611d0 0x7f2364063690 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f23680041d0 tx=0x7f2368009040).stop 2024-03-12T16:03:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 msgr2=0x7f2378107fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 0x7f2378107fe0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f2374005010 tx=0x7f2374009cb0).stop 2024-03-12T16:03:33.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 shutdown_connections 2024-03-12T16:03:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f23640611d0 0x7f2364063690 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23780f66f0 0x7f2378107fe0 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 --2- 172.21.15.6:0/1963204517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23780f7000 0x7f23781084d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 >> 172.21.15.6:0/1963204517 conn(0x7f23780f1ef0 msgr2=0x7f2378061340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:03:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 shutdown_connections 2024-03-12T16:03:33.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:33.738+0000 7f237fa61700 1 -- 172.21.15.6:0/1963204517 wait complete. 2024-03-12T16:03:34.362 DEBUG:teuthology.orchestra.run.smithi006:osd.0> sudo journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.0.service 2024-03-12T16:03:34.365 INFO:tasks.cephadm:Deploying osd.1 on smithi006 with /dev/vg_nvme/lv_3... 2024-03-12T16:03:34.365 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-12T16:03:34.395 INFO:journalctl@ceph.osd.0.smithi006.stdout:-- Logs begin at Tue 2024-03-12 15:46:33 UTC. -- 2024-03-12T16:03:35.001 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:33.736205+0000 mon.smithi006 (mon.0) 210 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:35.001 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:33.932073+0000 mgr.smithi006.kskdce (mgr.14196) 29 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:35.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:33.736205+0000 mon.smithi006 (mon.0) 210 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:35.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:33.932073+0000 mgr.smithi006.kskdce (mgr.14196) 29 : cluster [DBG] pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:35.457 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:03:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[52104]: debug 2024-03-12T16:03:34.999+0000 7fc1af129380 -1 osd.0 0 log_to_monitors {default=true} 2024-03-12T16:03:36.041 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:35.003009+0000 mon.smithi006 (mon.0) 211 : audit [INF] from='osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-12T16:03:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:35.003009+0000 mon.smithi006 (mon.0) 211 : audit [INF] from='osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-12T16:03:36.629 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-12T16:03:36.629 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-12T16:03:36.629 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2024-03-12T16:03:36.629 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2024-03-12T16:03:36.629 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.013357 s, 785 MB/s 2024-03-12T16:03:36.629 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2024-03-12T16:03:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:35.744790+0000 mon.smithi006 (mon.0) 212 : audit [INF] from='osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-12T16:03:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:35.744844+0000 mon.smithi006 (mon.0) 213 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-03-12T16:03:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:35.744966+0000 mon.smithi006 (mon.0) 214 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:35.745357+0000 mon.smithi006 (mon.0) 215 : audit [INF] from='osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:03:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:35.932406+0000 mgr.smithi006.kskdce (mgr.14196) 30 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:36.958 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:03:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[52104]: debug 2024-03-12T16:03:36.754+0000 7fc1a5697700 -1 osd.0 0 waiting for initial osdmap 2024-03-12T16:03:36.958 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:03:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[52104]: debug 2024-03-12T16:03:36.757+0000 7fc19fe0f700 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:03:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:35.744790+0000 mon.smithi006 (mon.0) 212 : audit [INF] from='osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-12T16:03:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:35.744844+0000 mon.smithi006 (mon.0) 213 : cluster [DBG] osdmap e7: 1 total, 0 up, 1 in 2024-03-12T16:03:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:35.744966+0000 mon.smithi006 (mon.0) 214 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:35.745357+0000 mon.smithi006 (mon.0) 215 : audit [INF] from='osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:03:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:35.932406+0000 mgr.smithi006.kskdce (mgr.14196) 30 : cluster [DBG] pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:37.329 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi006:vg_nvme/lv_3 2024-03-12T16:03:38.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:36.751506+0000 mon.smithi006 (mon.0) 216 : audit [INF] from='osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-03-12T16:03:38.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:36.751555+0000 mon.smithi006 (mon.0) 217 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-03-12T16:03:38.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:36.751870+0000 mon.smithi006 (mon.0) 218 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:38.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:36.754779+0000 mon.smithi006 (mon.0) 219 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:36.751506+0000 mon.smithi006 (mon.0) 216 : audit [INF] from='osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340]' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-03-12T16:03:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:36.751555+0000 mon.smithi006 (mon.0) 217 : cluster [DBG] osdmap e8: 1 total, 0 up, 1 in 2024-03-12T16:03:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:36.751870+0000 mon.smithi006 (mon.0) 218 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:36.754779+0000 mon.smithi006 (mon.0) 219 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:38.858 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:35.977526+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:03:38.858 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:35.977634+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:03:38.858 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:37.755182+0000 mon.smithi006 (mon.0) 220 : cluster [INF] osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] boot 2024-03-12T16:03:38.858 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:37.755229+0000 mon.smithi006 (mon.0) 221 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-03-12T16:03:38.858 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:37.755820+0000 mon.smithi006 (mon.0) 222 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:38.858 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:37.932775+0000 mgr.smithi006.kskdce (mgr.14196) 31 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:39.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.061+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3615545739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f8aa0 msgr2=0x7f4eac0f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:39.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.061+0000 7f4eb3e3c700 1 --2- 172.21.15.6:0/3615545739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f8aa0 0x7f4eac0f8f00 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f4ea80047f0 tx=0x7f4ea8009cb0).stop 2024-03-12T16:03:39.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.061+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3615545739 shutdown_connections 2024-03-12T16:03:39.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.061+0000 7f4eb3e3c700 1 --2- 172.21.15.6:0/3615545739 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f8aa0 0x7f4eac0f8f00 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:39.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.061+0000 7f4eb3e3c700 1 --2- 172.21.15.6:0/3615545739 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac0f7800 0x7f4eac0f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:03:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.061+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3615545739 >> 172.21.15.6:0/3615545739 conn(0x7f4eac0f2f80 msgr2=0x7f4eac0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:03:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.061+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3615545739 shutdown_connections 2024-03-12T16:03:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.061+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3615545739 wait complete. 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb3e3c700 1 Processor -- start 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb3e3c700 1 -- start start 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb3e3c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f7800 0x7f4eac06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb3e3c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac0f8aa0 0x7f4eac06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb3e3c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac06b520 con 0x7f4eac0f7800 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb3e3c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4eac06b660 con 0x7f4eac0f8aa0 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb1bd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f7800 0x7f4eac06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb1bd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f7800 0x7f4eac06c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:53682/0 (socket says 172.21.15.6:53682) 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb1bd8700 1 -- 172.21.15.6:0/3685760488 learned_addr learned my addr 172.21.15.6:0/3685760488 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb13d7700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac0f8aa0 0x7f4eac06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb1bd8700 1 -- 172.21.15.6:0/3685760488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac0f8aa0 msgr2=0x7f4eac06b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb1bd8700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac0f8aa0 0x7f4eac06b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb1bd8700 1 -- 172.21.15.6:0/3685760488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ea8005040 con 0x7f4eac0f7800 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb13d7700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac0f8aa0 0x7f4eac06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.062+0000 7f4eb1bd8700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f7800 0x7f4eac06c9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f4ea000b480 tx=0x7f4ea00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.063+0000 7f4e9effd700 1 -- 172.21.15.6:0/3685760488 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ea0002500 con 0x7f4eac0f7800 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.063+0000 7f4e9effd700 1 -- 172.21.15.6:0/3685760488 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4ea0002af0 con 0x7f4eac0f7800 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.063+0000 7f4e9effd700 1 -- 172.21.15.6:0/3685760488 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4ea0012c30 con 0x7f4eac0f7800 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.063+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4eac06b940 con 0x7f4eac0f7800 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.063+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4eac06be80 con 0x7f4eac0f7800 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.064+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4eac100060 con 0x7f4eac0f7800 2024-03-12T16:03:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.064+0000 7f4e9effd700 1 -- 172.21.15.6:0/3685760488 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f4ea0002660 con 0x7f4eac0f7800 2024-03-12T16:03:39.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.064+0000 7f4e9effd700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e98061180 0x7f4e98063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:03:39.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.065+0000 7f4e9effd700 1 -- 172.21.15.6:0/3685760488 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(10..10 src has 1..10) v4 ==== 1849+0+0 (secure 0 0 0) 0x7f4ea007bb70 con 0x7f4eac0f7800 2024-03-12T16:03:39.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.065+0000 7f4eb13d7700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e98061180 0x7f4e98063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:03:39.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.065+0000 7f4eb13d7700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e98061180 0x7f4e98063640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4ea8007cf0 tx=0x7f4ea800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:03:39.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.069+0000 7f4e9effd700 1 -- 172.21.15.6:0/3685760488 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4ea0050860 con 0x7f4eac0f7800 2024-03-12T16:03:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:35.977526+0000 osd.0 (osd.0) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:03:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:35.977634+0000 osd.0 (osd.0) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:03:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:37.755182+0000 mon.smithi006 (mon.0) 220 : cluster [INF] osd.0 [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] boot 2024-03-12T16:03:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:37.755229+0000 mon.smithi006 (mon.0) 221 : cluster [DBG] osdmap e9: 1 total, 1 up, 1 in 2024-03-12T16:03:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:37.755820+0000 mon.smithi006 (mon.0) 222 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:03:39.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:37.932775+0000 mgr.smithi006.kskdce (mgr.14196) 31 : cluster [DBG] pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-03-12T16:03:39.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:39.248+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f4eac059120 con 0x7f4e98061180 2024-03-12T16:03:40.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:38.764473+0000 mon.smithi006 (mon.0) 223 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-03-12T16:03:40.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:39.250051+0000 mgr.smithi006.kskdce (mgr.14196) 32 : audit [DBG] from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:03:40.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:39.252023+0000 mon.smithi006 (mon.0) 224 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:03:40.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:39.253888+0000 mon.smithi006 (mon.0) 225 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:03:40.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:39.254417+0000 mon.smithi006 (mon.0) 226 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:38.764473+0000 mon.smithi006 (mon.0) 223 : cluster [DBG] osdmap e10: 1 total, 1 up, 1 in 2024-03-12T16:03:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:39.250051+0000 mgr.smithi006.kskdce (mgr.14196) 32 : audit [DBG] from='client.14244 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:03:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:39.252023+0000 mon.smithi006 (mon.0) 224 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:03:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:39.253888+0000 mon.smithi006 (mon.0) 225 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:03:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:39.254417+0000 mon.smithi006 (mon.0) 226 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:41.014 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:39.933192+0000 mgr.smithi006.kskdce (mgr.14196) 33 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:41.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:39.933192+0000 mgr.smithi006.kskdce (mgr.14196) 33 : cluster [DBG] pgmap v28: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:42.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:41.816647+0000 mon.smithi006 (mon.0) 227 : audit [INF] from='client.? 172.21.15.6:0/2002317461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e638e6a3-7dc0-47f6-8901-1bdb1c208583"}]: dispatch 2024-03-12T16:03:42.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:41.822993+0000 mon.smithi006 (mon.0) 228 : audit [INF] from='client.? 172.21.15.6:0/2002317461' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e638e6a3-7dc0-47f6-8901-1bdb1c208583"}]': finished 2024-03-12T16:03:42.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:41.823039+0000 mon.smithi006 (mon.0) 229 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-03-12T16:03:42.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:41.823133+0000 mon.smithi006 (mon.0) 230 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:03:42.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:41.816647+0000 mon.smithi006 (mon.0) 227 : audit [INF] from='client.? 172.21.15.6:0/2002317461' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "e638e6a3-7dc0-47f6-8901-1bdb1c208583"}]: dispatch 2024-03-12T16:03:42.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:41.822993+0000 mon.smithi006 (mon.0) 228 : audit [INF] from='client.? 172.21.15.6:0/2002317461' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "e638e6a3-7dc0-47f6-8901-1bdb1c208583"}]': finished 2024-03-12T16:03:42.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:41.823039+0000 mon.smithi006 (mon.0) 229 : cluster [DBG] osdmap e11: 2 total, 1 up, 2 in 2024-03-12T16:03:42.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:41.823133+0000 mon.smithi006 (mon.0) 230 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:03:43.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:41.933655+0000 mgr.smithi006.kskdce (mgr.14196) 34 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:43.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:42.433651+0000 mon.smithi006 (mon.0) 231 : audit [DBG] from='client.? 172.21.15.6:0/2845945749' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:03:43.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:41.933655+0000 mgr.smithi006.kskdce (mgr.14196) 34 : cluster [DBG] pgmap v30: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:43.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:42.433651+0000 mon.smithi006 (mon.0) 231 : audit [DBG] from='client.? 172.21.15.6:0/2845945749' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:03:45.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:43.934057+0000 mgr.smithi006.kskdce (mgr.14196) 35 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:43.934057+0000 mgr.smithi006.kskdce (mgr.14196) 35 : cluster [DBG] pgmap v31: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:47.130 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:45.934362+0000 mgr.smithi006.kskdce (mgr.14196) 36 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:47.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:45.934362+0000 mgr.smithi006.kskdce (mgr.14196) 36 : cluster [DBG] pgmap v32: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:49.296 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:47.934782+0000 mgr.smithi006.kskdce (mgr.14196) 37 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:49.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:47.934782+0000 mgr.smithi006.kskdce (mgr.14196) 37 : cluster [DBG] pgmap v33: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:50.118 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:49.317172+0000 mon.smithi006 (mon.0) 232 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-12T16:03:50.119 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:49.317870+0000 mon.smithi006 (mon.0) 233 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:50.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:49.317172+0000 mon.smithi006 (mon.0) 232 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-12T16:03:50.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:49.317870+0000 mon.smithi006 (mon.0) 233 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:03:51.135 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:03:49.318424+0000 mgr.smithi006.kskdce (mgr.14196) 38 : cephadm [INF] Deploying daemon osd.1 on smithi006 2024-03-12T16:03:51.135 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:49.935076+0000 mgr.smithi006.kskdce (mgr.14196) 39 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:51.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:03:49.318424+0000 mgr.smithi006.kskdce (mgr.14196) 38 : cephadm [INF] Deploying daemon osd.1 on smithi006 2024-03-12T16:03:51.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:49.935076+0000 mgr.smithi006.kskdce (mgr.14196) 39 : cluster [DBG] pgmap v34: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:53.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:51.935424+0000 mgr.smithi006.kskdce (mgr.14196) 40 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:53.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:51.935424+0000 mgr.smithi006.kskdce (mgr.14196) 40 : cluster [DBG] pgmap v35: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:55.210 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:53.935723+0000 mgr.smithi006.kskdce (mgr.14196) 41 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:55.210 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:54.551521+0000 mon.smithi006 (mon.0) 234 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:55.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:53.935723+0000 mgr.smithi006.kskdce (mgr.14196) 41 : cluster [DBG] pgmap v36: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:55.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:54.551521+0000 mon.smithi006 (mon.0) 234 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:57.310 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:55.935995+0000 mgr.smithi006.kskdce (mgr.14196) 42 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:57.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.338+0000 7f4e9effd700 1 -- 172.21.15.6:0/3685760488 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f4eac059120 con 0x7f4e98061180 2024-03-12T16:03:57.339 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 1 on host 'smithi006' 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e98061180 msgr2=0x7f4e98063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e98061180 0x7f4e98063640 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f4ea8007cf0 tx=0x7f4ea800b040).stop 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f7800 msgr2=0x7f4eac06c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f7800 0x7f4eac06c9d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f4ea000b480 tx=0x7f4ea00090f0).stop 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 shutdown_connections 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e98061180 0x7f4e98063640 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4eac0f7800 0x7f4eac06c9d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 --2- 172.21.15.6:0/3685760488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4eac0f8aa0 0x7f4eac06b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 >> 172.21.15.6:0/3685760488 conn(0x7f4eac0f2f80 msgr2=0x7f4eac0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:03:57.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 shutdown_connections 2024-03-12T16:03:57.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:03:57.340+0000 7f4eb3e3c700 1 -- 172.21.15.6:0/3685760488 wait complete. 2024-03-12T16:03:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:55.935995+0000 mgr.smithi006.kskdce (mgr.14196) 42 : cluster [DBG] pgmap v37: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:58.007 DEBUG:teuthology.orchestra.run.smithi006:osd.1> sudo journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.1.service 2024-03-12T16:03:58.010 INFO:tasks.cephadm:Deploying osd.2 on smithi006 with /dev/vg_nvme/lv_2... 2024-03-12T16:03:58.010 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-12T16:03:58.042 INFO:journalctl@ceph.osd.1.smithi006.stdout:-- Logs begin at Tue 2024-03-12 15:46:33 UTC. -- 2024-03-12T16:03:58.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:57.337490+0000 mon.smithi006 (mon.0) 235 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:58.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:57.936388+0000 mgr.smithi006.kskdce (mgr.14196) 43 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:57.337490+0000 mon.smithi006 (mon.0) 235 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:03:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:57.936388+0000 mgr.smithi006.kskdce (mgr.14196) 43 : cluster [DBG] pgmap v38: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:03:58.707 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:03:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[56039]: debug 2024-03-12T16:03:58.455+0000 7f7cdf8b4380 -1 osd.1 0 log_to_monitors {default=true} 2024-03-12T16:03:59.656 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:03:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:58.459013+0000 mon.smithi006 (mon.0) 236 : audit [INF] from='osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-12T16:03:59.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:03:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:58.459013+0000 mon.smithi006 (mon.0) 236 : audit [INF] from='osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-12T16:04:00.277 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-12T16:04:00.278 INFO:teuthology.orchestra.run.smithi006.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-12T16:04:00.278 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 10+0 records in 2024-03-12T16:04:00.278 INFO:teuthology.orchestra.run.smithi006.stderr:10+0 records out 2024-03-12T16:04:00.278 INFO:teuthology.orchestra.run.smithi006.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0109149 s, 961 MB/s 2024-03-12T16:04:00.278 INFO:teuthology.orchestra.run.smithi006.stderr: stderr: 2024-03-12T16:04:00.278 INFO:teuthology.orchestra.run.smithi006.stderr:--> Zapping successful for: 2024-03-12T16:04:00.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:59.346282+0000 mon.smithi006 (mon.0) 237 : audit [INF] from='osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-12T16:04:00.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:59.346338+0000 mon.smithi006 (mon.0) 238 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-03-12T16:04:00.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:59.346487+0000 mon.smithi006 (mon.0) 239 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:00.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:03:59.346865+0000 mon.smithi006 (mon.0) 240 : audit [INF] from='osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:04:00.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:59.936659+0000 mgr.smithi006.kskdce (mgr.14196) 44 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:04:00.673 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:59.346282+0000 mon.smithi006 (mon.0) 237 : audit [INF] from='osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-12T16:04:00.673 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:59.346338+0000 mon.smithi006 (mon.0) 238 : cluster [DBG] osdmap e12: 2 total, 1 up, 2 in 2024-03-12T16:04:00.673 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:59.346487+0000 mon.smithi006 (mon.0) 239 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:00.673 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:03:59.346865+0000 mon.smithi006 (mon.0) 240 : audit [INF] from='osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:04:00.673 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:59.936659+0000 mgr.smithi006.kskdce (mgr.14196) 44 : cluster [DBG] pgmap v40: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:04:00.674 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:04:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[56039]: debug 2024-03-12T16:04:00.350+0000 7f7cd5e22700 -1 osd.1 0 waiting for initial osdmap 2024-03-12T16:04:00.674 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:04:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[56039]: debug 2024-03-12T16:04:00.355+0000 7f7cd159c700 -1 osd.1 13 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:04:00.985 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi006:vg_nvme/lv_2 2024-03-12T16:04:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:00.347856+0000 mon.smithi006 (mon.0) 241 : audit [INF] from='osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-03-12T16:04:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:00.347923+0000 mon.smithi006 (mon.0) 242 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-03-12T16:04:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:00.348612+0000 mon.smithi006 (mon.0) 243 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:00.352352+0000 mon.smithi006 (mon.0) 244 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:01.324596+0000 mon.smithi006 (mon.0) 245 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:01.326069+0000 mon.smithi006 (mon.0) 246 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:04:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:00.347856+0000 mon.smithi006 (mon.0) 241 : audit [INF] from='osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-03-12T16:04:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:00.347923+0000 mon.smithi006 (mon.0) 242 : cluster [DBG] osdmap e13: 2 total, 1 up, 2 in 2024-03-12T16:04:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:00.348612+0000 mon.smithi006 (mon.0) 243 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:00.352352+0000 mon.smithi006 (mon.0) 244 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:01.324596+0000 mon.smithi006 (mon.0) 245 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:01.326069+0000 mon.smithi006 (mon.0) 246 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:04:02.369 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:59.443294+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:04:02.369 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:03:59.443370+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:04:02.651 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:01.351227+0000 mon.smithi006 (mon.0) 247 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:02.651 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:01.357553+0000 mon.smithi006 (mon.0) 248 : cluster [INF] osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] boot 2024-03-12T16:04:02.651 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:01.357579+0000 mon.smithi006 (mon.0) 249 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-03-12T16:04:02.651 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:01.358244+0000 mon.smithi006 (mon.0) 250 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:02.651 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:01.936918+0000 mgr.smithi006.kskdce (mgr.14196) 45 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:04:02.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:59.443294+0000 osd.1 (osd.1) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:04:02.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:03:59.443370+0000 osd.1 (osd.1) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:04:02.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:01.351227+0000 mon.smithi006 (mon.0) 247 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:02.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:01.357553+0000 mon.smithi006 (mon.0) 248 : cluster [INF] osd.1 [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] boot 2024-03-12T16:04:02.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:01.357579+0000 mon.smithi006 (mon.0) 249 : cluster [DBG] osdmap e14: 2 total, 2 up, 2 in 2024-03-12T16:04:02.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:01.358244+0000 mon.smithi006 (mon.0) 250 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:04:02.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:01.936918+0000 mgr.smithi006.kskdce (mgr.14196) 45 : cluster [DBG] pgmap v43: 0 pgs: ; 0 B data, 290 MiB used, 89 GiB / 89 GiB avail 2024-03-12T16:04:02.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.892+0000 7f98ef26a700 1 -- 172.21.15.6:0/1002816119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80f66f0 msgr2=0x7f98e80f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:04:02.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.892+0000 7f98ef26a700 1 --2- 172.21.15.6:0/1002816119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80f66f0 0x7f98e80f6b10 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7f98d80047f0 tx=0x7f98d8009cb0).stop 2024-03-12T16:04:02.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.892+0000 7f98ef26a700 1 -- 172.21.15.6:0/1002816119 shutdown_connections 2024-03-12T16:04:02.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.892+0000 7f98ef26a700 1 --2- 172.21.15.6:0/1002816119 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98e80f7990 0x7f98e80f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:04:02.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.892+0000 7f98ef26a700 1 --2- 172.21.15.6:0/1002816119 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80f66f0 0x7f98e80f6b10 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.892+0000 7f98ef26a700 1 -- 172.21.15.6:0/1002816119 >> 172.21.15.6:0/1002816119 conn(0x7f98e80f1e50 msgr2=0x7f98e80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.892+0000 7f98ef26a700 1 -- 172.21.15.6:0/1002816119 shutdown_connections 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.892+0000 7f98ef26a700 1 -- 172.21.15.6:0/1002816119 wait complete. 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ef26a700 1 Processor -- start 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ef26a700 1 -- start start 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ef26a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98e80f66f0 0x7f98e8106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ef26a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80f7990 0x7f98e8107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ef26a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e81078f0 con 0x7f98e80f7990 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ef26a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f98e8107a30 con 0x7f98e80f66f0 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ec805700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80f7990 0x7f98e8107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ec805700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80f7990 0x7f98e8107340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55464/0 (socket says 172.21.15.6:55464) 2024-03-12T16:04:02.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ec805700 1 -- 172.21.15.6:0/307765687 learned_addr learned my addr 172.21.15.6:0/307765687 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.893+0000 7f98ed006700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98e80f66f0 0x7f98e8106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.894+0000 7f98ed006700 1 -- 172.21.15.6:0/307765687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80f7990 msgr2=0x7f98e8107340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.894+0000 7f98ed006700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80f7990 0x7f98e8107340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.894+0000 7f98ed006700 1 -- 172.21.15.6:0/307765687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f98d8005040 con 0x7f98e80f66f0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.894+0000 7f98ed006700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98e80f66f0 0x7f98e8106e50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f98d8000c00 tx=0x7f98d8009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.894+0000 7f98de777700 1 -- 172.21.15.6:0/307765687 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d800e030 con 0x7f98e80f66f0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.894+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f98e810c470 con 0x7f98e80f66f0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.894+0000 7f98de777700 1 -- 172.21.15.6:0/307765687 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f98d8007e90 con 0x7f98e80f66f0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.894+0000 7f98de777700 1 -- 172.21.15.6:0/307765687 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f98d8018070 con 0x7f98e80f66f0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.894+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f98e810c9b0 con 0x7f98e80f66f0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.895+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f98e80feeb0 con 0x7f98e80f66f0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.895+0000 7f98de777700 1 -- 172.21.15.6:0/307765687 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f98d801d420 con 0x7f98e80f66f0 2024-03-12T16:04:02.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.896+0000 7f98de777700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f98d4061180 0x7f98d4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:04:02.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.896+0000 7f98de777700 1 -- 172.21.15.6:0/307765687 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(15..15 src has 1..15) v4 ==== 2281+0+0 (secure 0 0 0) 0x7f98d807cf50 con 0x7f98e80f66f0 2024-03-12T16:04:02.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.896+0000 7f98ec805700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f98d4061180 0x7f98d4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:04:02.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.896+0000 7f98ec805700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f98d4061180 0x7f98d4063640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f98e4009fd0 tx=0x7f98e400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:04:02.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:02.900+0000 7f98de777700 1 -- 172.21.15.6:0/307765687 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f98d8051a30 con 0x7f98e80f66f0 2024-03-12T16:04:03.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:03.087+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f98e8059120 con 0x7f98d4061180 2024-03-12T16:04:03.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:02.370025+0000 mon.smithi006 (mon.0) 251 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-03-12T16:04:03.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:03.089630+0000 mgr.smithi006.kskdce (mgr.14196) 46 : audit [DBG] from='client.24117 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:04:03.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:03.091606+0000 mon.smithi006 (mon.0) 252 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:04:03.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:03.093415+0000 mon.smithi006 (mon.0) 253 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:04:03.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:03.093930+0000 mon.smithi006 (mon.0) 254 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:03.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:02.370025+0000 mon.smithi006 (mon.0) 251 : cluster [DBG] osdmap e15: 2 total, 2 up, 2 in 2024-03-12T16:04:03.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:03.089630+0000 mgr.smithi006.kskdce (mgr.14196) 46 : audit [DBG] from='client.24117 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi006:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:04:03.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:03.091606+0000 mon.smithi006 (mon.0) 252 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:04:03.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:03.093415+0000 mon.smithi006 (mon.0) 253 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:04:03.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:03.093930+0000 mon.smithi006 (mon.0) 254 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:05.169 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:03.937192+0000 mgr.smithi006.kskdce (mgr.14196) 47 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:05.169 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:03.978957+0000 mon.smithi006 (mon.0) 255 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:05.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:03.937192+0000 mgr.smithi006.kskdce (mgr.14196) 47 : cluster [DBG] pgmap v45: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:05.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:03.978957+0000 mon.smithi006 (mon.0) 255 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:06.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:05.088576+0000 mon.smithi006 (mon.0) 256 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:06.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:05.088576+0000 mon.smithi006 (mon.0) 256 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:07.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:05.937480+0000 mgr.smithi006.kskdce (mgr.14196) 48 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:07.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:06.739803+0000 mon.smithi006 (mon.0) 257 : audit [INF] from='client.? 172.21.15.6:0/2728927857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45eed951-90a9-4fe0-a184-11b5e1ebe46d"}]: dispatch 2024-03-12T16:04:07.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:06.745802+0000 mon.smithi006 (mon.0) 258 : audit [INF] from='client.? 172.21.15.6:0/2728927857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45eed951-90a9-4fe0-a184-11b5e1ebe46d"}]': finished 2024-03-12T16:04:07.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:06.745842+0000 mon.smithi006 (mon.0) 259 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-03-12T16:04:07.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:06.745945+0000 mon.smithi006 (mon.0) 260 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:07.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:05.937480+0000 mgr.smithi006.kskdce (mgr.14196) 48 : cluster [DBG] pgmap v46: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:07.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:06.739803+0000 mon.smithi006 (mon.0) 257 : audit [INF] from='client.? 172.21.15.6:0/2728927857' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "45eed951-90a9-4fe0-a184-11b5e1ebe46d"}]: dispatch 2024-03-12T16:04:07.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:06.745802+0000 mon.smithi006 (mon.0) 258 : audit [INF] from='client.? 172.21.15.6:0/2728927857' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "45eed951-90a9-4fe0-a184-11b5e1ebe46d"}]': finished 2024-03-12T16:04:07.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:06.745842+0000 mon.smithi006 (mon.0) 259 : cluster [DBG] osdmap e16: 3 total, 2 up, 3 in 2024-03-12T16:04:07.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:06.745945+0000 mon.smithi006 (mon.0) 260 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:08.348 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:07.461367+0000 mon.smithi006 (mon.0) 261 : audit [DBG] from='client.? 172.21.15.6:0/3847767101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:04:08.349 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:07.590517+0000 mon.smithi006 (mon.0) 262 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:08.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:07.461367+0000 mon.smithi006 (mon.0) 261 : audit [DBG] from='client.? 172.21.15.6:0/3847767101' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:04:08.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:07.590517+0000 mon.smithi006 (mon.0) 262 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:07.937765+0000 mgr.smithi006.kskdce (mgr.14196) 49 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:09.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:07.937765+0000 mgr.smithi006.kskdce (mgr.14196) 49 : cluster [DBG] pgmap v48: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:09.938186+0000 mgr.smithi006.kskdce (mgr.14196) 50 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:09.938186+0000 mgr.smithi006.kskdce (mgr.14196) 50 : cluster [DBG] pgmap v49: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:13.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:11.938464+0000 mgr.smithi006.kskdce (mgr.14196) 51 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:11.938464+0000 mgr.smithi006.kskdce (mgr.14196) 51 : cluster [DBG] pgmap v50: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:15.399 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:13.938852+0000 mgr.smithi006.kskdce (mgr.14196) 52 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:15.399 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:14.258237+0000 mgr.smithi006.kskdce (mgr.14196) 53 : cephadm [INF] Detected new or changed devices on smithi006 2024-03-12T16:04:15.399 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.262876+0000 mon.smithi006 (mon.0) 263 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.646587+0000 mon.smithi006 (mon.0) 264 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.647354+0000 mon.smithi006 (mon.0) 265 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.651566+0000 mon.smithi006 (mon.0) 266 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.652282+0000 mon.smithi006 (mon.0) 267 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.652885+0000 mon.smithi006 (mon.0) 268 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.673201+0000 mon.smithi006 (mon.0) 269 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.684696+0000 mon.smithi006 (mon.0) 270 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.690150+0000 mon.smithi006 (mon.0) 271 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.693639+0000 mon.smithi006 (mon.0) 272 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.694182+0000 mon.smithi006 (mon.0) 273 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:04:15.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:14.694697+0000 mon.smithi006 (mon.0) 274 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:13.938852+0000 mgr.smithi006.kskdce (mgr.14196) 52 : cluster [DBG] pgmap v51: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:14.258237+0000 mgr.smithi006.kskdce (mgr.14196) 53 : cephadm [INF] Detected new or changed devices on smithi006 2024-03-12T16:04:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.262876+0000 mon.smithi006 (mon.0) 263 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.646587+0000 mon.smithi006 (mon.0) 264 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.647354+0000 mon.smithi006 (mon.0) 265 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.651566+0000 mon.smithi006 (mon.0) 266 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.652282+0000 mon.smithi006 (mon.0) 267 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.652885+0000 mon.smithi006 (mon.0) 268 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:04:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.673201+0000 mon.smithi006 (mon.0) 269 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.684696+0000 mon.smithi006 (mon.0) 270 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.690150+0000 mon.smithi006 (mon.0) 271 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.693639+0000 mon.smithi006 (mon.0) 272 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:04:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.694182+0000 mon.smithi006 (mon.0) 273 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:04:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:14.694697+0000 mon.smithi006 (mon.0) 274 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:16.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:14.647875+0000 mgr.smithi006.kskdce (mgr.14196) 54 : cephadm [INF] Adjusting osd_memory_target on smithi006 to 6963M 2024-03-12T16:04:16.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:14.653731+0000 mgr.smithi006.kskdce (mgr.14196) 55 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:04:16.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:14.653937+0000 mgr.smithi006.kskdce (mgr.14196) 56 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:04:16.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:14.693393+0000 mgr.smithi006.kskdce (mgr.14196) 57 : cephadm [INF] Reconfiguring mon.smithi006 (unknown last config time)... 2024-03-12T16:04:16.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:14.695178+0000 mgr.smithi006.kskdce (mgr.14196) 58 : cephadm [INF] Reconfiguring daemon mon.smithi006 on smithi006 2024-03-12T16:04:16.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:15.420201+0000 mon.smithi006 (mon.0) 275 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-12T16:04:16.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:15.420888+0000 mon.smithi006 (mon.0) 276 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:14.647875+0000 mgr.smithi006.kskdce (mgr.14196) 54 : cephadm [INF] Adjusting osd_memory_target on smithi006 to 6963M 2024-03-12T16:04:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:14.653731+0000 mgr.smithi006.kskdce (mgr.14196) 55 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:04:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:14.653937+0000 mgr.smithi006.kskdce (mgr.14196) 56 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:04:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:14.693393+0000 mgr.smithi006.kskdce (mgr.14196) 57 : cephadm [INF] Reconfiguring mon.smithi006 (unknown last config time)... 2024-03-12T16:04:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:14.695178+0000 mgr.smithi006.kskdce (mgr.14196) 58 : cephadm [INF] Reconfiguring daemon mon.smithi006 on smithi006 2024-03-12T16:04:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:15.420201+0000 mon.smithi006 (mon.0) 275 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-12T16:04:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:15.420888+0000 mon.smithi006 (mon.0) 276 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:17.541 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:15.421446+0000 mgr.smithi006.kskdce (mgr.14196) 59 : cephadm [INF] Deploying daemon osd.2 on smithi006 2024-03-12T16:04:17.542 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:15.939149+0000 mgr.smithi006.kskdce (mgr.14196) 60 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:17.542 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:16.949798+0000 mon.smithi006 (mon.0) 277 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:17.542 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:16.950675+0000 mon.smithi006 (mon.0) 278 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi006.kskdce", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:04:17.542 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:16.951454+0000 mon.smithi006 (mon.0) 279 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:04:17.542 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:16.952026+0000 mon.smithi006 (mon.0) 280 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:15.421446+0000 mgr.smithi006.kskdce (mgr.14196) 59 : cephadm [INF] Deploying daemon osd.2 on smithi006 2024-03-12T16:04:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:15.939149+0000 mgr.smithi006.kskdce (mgr.14196) 60 : cluster [DBG] pgmap v52: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:16.949798+0000 mon.smithi006 (mon.0) 277 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:16.950675+0000 mon.smithi006 (mon.0) 278 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi006.kskdce", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:04:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:16.951454+0000 mon.smithi006 (mon.0) 279 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:04:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:16.952026+0000 mon.smithi006 (mon.0) 280 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:18.322 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:16.950387+0000 mgr.smithi006.kskdce (mgr.14196) 61 : cephadm [INF] Reconfiguring mgr.smithi006.kskdce (unknown last config time)... 2024-03-12T16:04:18.322 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:16.952567+0000 mgr.smithi006.kskdce (mgr.14196) 62 : cephadm [INF] Reconfiguring daemon mgr.smithi006.kskdce on smithi006 2024-03-12T16:04:18.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:16.950387+0000 mgr.smithi006.kskdce (mgr.14196) 61 : cephadm [INF] Reconfiguring mgr.smithi006.kskdce (unknown last config time)... 2024-03-12T16:04:18.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:16.952567+0000 mgr.smithi006.kskdce (mgr.14196) 62 : cephadm [INF] Reconfiguring daemon mgr.smithi006.kskdce on smithi006 2024-03-12T16:04:19.680 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:17.939576+0000 mgr.smithi006.kskdce (mgr.14196) 63 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:19.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:17.939576+0000 mgr.smithi006.kskdce (mgr.14196) 63 : cluster [DBG] pgmap v53: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:21.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:19.939804+0000 mgr.smithi006.kskdce (mgr.14196) 64 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:21.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:19.939804+0000 mgr.smithi006.kskdce (mgr.14196) 64 : cluster [DBG] pgmap v54: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:23.415 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:21.940058+0000 mgr.smithi006.kskdce (mgr.14196) 65 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:23.415 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:22.256543+0000 mon.smithi006 (mon.0) 281 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:23.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:21.940058+0000 mgr.smithi006.kskdce (mgr.14196) 65 : cluster [DBG] pgmap v55: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:23.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:22.256543+0000 mon.smithi006 (mon.0) 281 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:24.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:23.478828+0000 mon.smithi006 (mon.0) 282 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:24.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:23.479656+0000 mgr.smithi006.kskdce (mgr.14196) 66 : cephadm [INF] Reconfiguring alertmanager.smithi006 (dependencies changed)... 2024-03-12T16:04:24.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:23.485367+0000 mgr.smithi006.kskdce (mgr.14196) 67 : cephadm [INF] Reconfiguring daemon alertmanager.smithi006 on smithi006 2024-03-12T16:04:24.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:23.940297+0000 mgr.smithi006.kskdce (mgr.14196) 68 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:24.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:23.478828+0000 mon.smithi006 (mon.0) 282 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:24.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:23.479656+0000 mgr.smithi006.kskdce (mgr.14196) 66 : cephadm [INF] Reconfiguring alertmanager.smithi006 (dependencies changed)... 2024-03-12T16:04:24.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:23.485367+0000 mgr.smithi006.kskdce (mgr.14196) 67 : cephadm [INF] Reconfiguring daemon alertmanager.smithi006 on smithi006 2024-03-12T16:04:24.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:23.940297+0000 mgr.smithi006.kskdce (mgr.14196) 68 : cluster [DBG] pgmap v56: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:27.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:25.940612+0000 mgr.smithi006.kskdce (mgr.14196) 69 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:27.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:26.144688+0000 mon.smithi006 (mon.0) 283 : audit [INF] from='osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-12T16:04:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:25.940612+0000 mgr.smithi006.kskdce (mgr.14196) 69 : cluster [DBG] pgmap v57: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:26.144688+0000 mon.smithi006 (mon.0) 283 : audit [INF] from='osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-12T16:04:28.322 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:27.000257+0000 mon.smithi006 (mon.0) 284 : audit [INF] from='osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-12T16:04:28.322 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:27.000302+0000 mon.smithi006 (mon.0) 285 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-03-12T16:04:28.322 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:27.000429+0000 mon.smithi006 (mon.0) 286 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:28.322 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:27.000839+0000 mon.smithi006 (mon.0) 287 : audit [INF] from='osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:04:28.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:27.000257+0000 mon.smithi006 (mon.0) 284 : audit [INF] from='osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-12T16:04:28.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:27.000302+0000 mon.smithi006 (mon.0) 285 : cluster [DBG] osdmap e17: 3 total, 2 up, 3 in 2024-03-12T16:04:28.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:27.000429+0000 mon.smithi006 (mon.0) 286 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:28.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:27.000839+0000 mon.smithi006 (mon.0) 287 : audit [INF] from='osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:04:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:27.940837+0000 mgr.smithi006.kskdce (mgr.14196) 70 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:28.001436+0000 mon.smithi006 (mon.0) 288 : audit [INF] from='osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-03-12T16:04:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:28.001491+0000 mon.smithi006 (mon.0) 289 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-03-12T16:04:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:28.001874+0000 mon.smithi006 (mon.0) 290 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:28.005326+0000 mon.smithi006 (mon.0) 291 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:29.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:27.940837+0000 mgr.smithi006.kskdce (mgr.14196) 70 : cluster [DBG] pgmap v59: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:29.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:28.001436+0000 mon.smithi006 (mon.0) 288 : audit [INF] from='osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558]' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]': finished 2024-03-12T16:04:29.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:28.001491+0000 mon.smithi006 (mon.0) 289 : cluster [DBG] osdmap e18: 3 total, 2 up, 3 in 2024-03-12T16:04:29.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:28.001874+0000 mon.smithi006 (mon.0) 290 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:29.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:28.005326+0000 mon.smithi006 (mon.0) 291 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:30.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:27.106075+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:04:30.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:27.106202+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:04:30.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:29.007124+0000 mon.smithi006 (mon.0) 292 : cluster [INF] osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] boot 2024-03-12T16:04:30.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:29.007149+0000 mon.smithi006 (mon.0) 293 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:29.007533+0000 mon.smithi006 (mon.0) 294 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:29.008129+0000 mon.smithi006 (mon.0) 295 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:29.904280+0000 mon.smithi006 (mon.0) 296 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:29.904835+0000 mgr.smithi006.kskdce (mgr.14196) 71 : cephadm [INF] Reconfiguring crash.smithi006 (monmap changed)... 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:29.905076+0000 mon.smithi006 (mon.0) 297 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi006", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:29.905715+0000 mon.smithi006 (mon.0) 298 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:29.906180+0000 mgr.smithi006.kskdce (mgr.14196) 72 : cephadm [INF] Reconfiguring daemon crash.smithi006 on smithi006 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:29.941273+0000 mgr.smithi006.kskdce (mgr.14196) 73 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:30.007983+0000 mon.smithi006 (mon.0) 299 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:30.008035+0000 mon.smithi006 (mon.0) 300 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-03-12T16:04:30.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:30.008861+0000 mon.smithi006 (mon.0) 301 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-03-12T16:04:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:27.106075+0000 osd.2 (osd.2) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:04:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:27.106202+0000 osd.2 (osd.2) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:04:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:29.007124+0000 mon.smithi006 (mon.0) 292 : cluster [INF] osd.2 [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] boot 2024-03-12T16:04:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:29.007149+0000 mon.smithi006 (mon.0) 293 : cluster [DBG] osdmap e19: 3 total, 3 up, 3 in 2024-03-12T16:04:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:29.007533+0000 mon.smithi006 (mon.0) 294 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:04:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:29.008129+0000 mon.smithi006 (mon.0) 295 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-03-12T16:04:30.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:29.904280+0000 mon.smithi006 (mon.0) 296 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:30.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:29.904835+0000 mgr.smithi006.kskdce (mgr.14196) 71 : cephadm [INF] Reconfiguring crash.smithi006 (monmap changed)... 2024-03-12T16:04:30.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:29.905076+0000 mon.smithi006 (mon.0) 297 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi006", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:04:30.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:29.905715+0000 mon.smithi006 (mon.0) 298 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:30.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:29.906180+0000 mgr.smithi006.kskdce (mgr.14196) 72 : cephadm [INF] Reconfiguring daemon crash.smithi006 on smithi006 2024-03-12T16:04:30.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:29.941273+0000 mgr.smithi006.kskdce (mgr.14196) 73 : cluster [DBG] pgmap v62: 0 pgs: ; 0 B data, 581 MiB used, 178 GiB / 179 GiB avail 2024-03-12T16:04:30.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:30.007983+0000 mon.smithi006 (mon.0) 299 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "osd pool create", "format": "json", "pool": "device_health_metrics", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-03-12T16:04:30.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:30.008035+0000 mon.smithi006 (mon.0) 300 : cluster [DBG] osdmap e20: 3 total, 3 up, 3 in 2024-03-12T16:04:30.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:30.008861+0000 mon.smithi006 (mon.0) 301 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]: dispatch 2024-03-12T16:04:31.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.421+0000 7f98de777700 1 -- 172.21.15.6:0/307765687 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f98e8059120 con 0x7f98d4061180 2024-03-12T16:04:31.423 INFO:teuthology.orchestra.run.smithi006.stdout:Created osd(s) 2 on host 'smithi006' 2024-03-12T16:04:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f98d4061180 msgr2=0x7f98d4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:04:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f98d4061180 0x7f98d4063640 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f98e4009fd0 tx=0x7f98e400b040).stop 2024-03-12T16:04:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98e80f66f0 msgr2=0x7f98e8106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:04:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98e80f66f0 0x7f98e8106e50 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 rx=0x7f98d8000c00 tx=0x7f98d8009cb0).stop 2024-03-12T16:04:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 shutdown_connections 2024-03-12T16:04:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f98d4061180 0x7f98d4063640 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:04:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f98e80f66f0 0x7f98e8106e50 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:04:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 --2- 172.21.15.6:0/307765687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f98e80f7990 0x7f98e8107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:04:31.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 >> 172.21.15.6:0/307765687 conn(0x7f98e80f1e50 msgr2=0x7f98e80fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:04:31.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 shutdown_connections 2024-03-12T16:04:31.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:04:31.424+0000 7f98ef26a700 1 -- 172.21.15.6:0/307765687 wait complete. 2024-03-12T16:04:32.379 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:31.013908+0000 mon.smithi006 (mon.0) 302 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-03-12T16:04:32.379 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:31.013979+0000 mon.smithi006 (mon.0) 303 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-03-12T16:04:32.379 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:31.421330+0000 mon.smithi006 (mon.0) 304 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:31.013908+0000 mon.smithi006 (mon.0) 302 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": "device_health_metrics", "app": "mgr_devicehealth"}]': finished 2024-03-12T16:04:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:31.013979+0000 mon.smithi006 (mon.0) 303 : cluster [DBG] osdmap e21: 3 total, 3 up, 3 in 2024-03-12T16:04:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:31.421330+0000 mon.smithi006 (mon.0) 304 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:33.156 DEBUG:teuthology.orchestra.run.smithi006:osd.2> sudo journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.2.service 2024-03-12T16:04:33.159 INFO:tasks.cephadm:Deploying osd.3 on smithi134 with /dev/vg_nvme/lv_4... 2024-03-12T16:04:33.159 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-03-12T16:04:33.192 INFO:journalctl@ceph.osd.2.smithi006.stdout:-- Logs begin at Tue 2024-03-12 15:46:33 UTC. -- 2024-03-12T16:04:33.383 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:31.941746+0000 mgr.smithi006.kskdce (mgr.14196) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:33.384 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:32.016566+0000 mon.smithi006 (mon.0) 305 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-03-12T16:04:33.384 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:32.696116+0000 mon.smithi006 (mon.0) 306 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:33.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:31.941746+0000 mgr.smithi006.kskdce (mgr.14196) 74 : cluster [DBG] pgmap v65: 1 pgs: 1 unknown; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:33.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:32.016566+0000 mon.smithi006 (mon.0) 305 : cluster [DBG] osdmap e22: 3 total, 3 up, 3 in 2024-03-12T16:04:33.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:32.696116+0000 mon.smithi006 (mon.0) 306 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:34.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:32.696742+0000 mgr.smithi006.kskdce (mgr.14196) 75 : cephadm [INF] Reconfiguring grafana.smithi006 (dependencies changed)... 2024-03-12T16:04:34.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:32.729612+0000 mgr.smithi006.kskdce (mgr.14196) 76 : cephadm [INF] Reconfiguring daemon grafana.smithi006 on smithi006 2024-03-12T16:04:34.294 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:32.696742+0000 mgr.smithi006.kskdce (mgr.14196) 75 : cephadm [INF] Reconfiguring grafana.smithi006 (dependencies changed)... 2024-03-12T16:04:34.295 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:32.729612+0000 mgr.smithi006.kskdce (mgr.14196) 76 : cephadm [INF] Reconfiguring daemon grafana.smithi006 on smithi006 2024-03-12T16:04:35.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:33.942093+0000 mgr.smithi006.kskdce (mgr.14196) 77 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:35.400 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-03-12T16:04:35.400 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-03-12T16:04:35.400 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-03-12T16:04:35.400 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-03-12T16:04:35.400 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0108559 s, 966 MB/s 2024-03-12T16:04:35.400 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-03-12T16:04:35.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:33.942093+0000 mgr.smithi006.kskdce (mgr.14196) 77 : cluster [DBG] pgmap v67: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:36.005 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_4 2024-03-12T16:04:37.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:35.942404+0000 mgr.smithi006.kskdce (mgr.14196) 78 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:35.942404+0000 mgr.smithi006.kskdce (mgr.14196) 78 : cluster [DBG] pgmap v68: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:37.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/1824168671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f58061220 msgr2=0x7f1f580fa430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:04:37.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 --2- 172.21.15.134:0/1824168671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f58061220 0x7f1f580fa430 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f1f400047f0 tx=0x7f1f40009cb0).stop 2024-03-12T16:04:37.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/1824168671 shutdown_connections 2024-03-12T16:04:37.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 --2- 172.21.15.134:0/1824168671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f580fa9b0 0x7f1f580fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:04:37.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 --2- 172.21.15.134:0/1824168671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f58061220 0x7f1f580fa430 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:04:37.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/1824168671 >> 172.21.15.134:0/1824168671 conn(0x7f1f580f1e50 msgr2=0x7f1f580f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:04:37.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/1824168671 shutdown_connections 2024-03-12T16:04:37.950 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/1824168671 wait complete. 2024-03-12T16:04:37.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 Processor -- start 2024-03-12T16:04:37.951 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.948+0000 7f1f5e8c1700 1 -- start start 2024-03-12T16:04:37.952 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f5e8c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f58061220 0x7f1f58107f90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f5e8c1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f580fa9b0 0x7f1f58108480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f5e8c1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58108a30 con 0x7f1f58061220 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f5e8c1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f58108b70 con 0x7f1f580fa9b0 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f577fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f580fa9b0 0x7f1f58108480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f577fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f580fa9b0 0x7f1f58108480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:47296/0 (socket says 172.21.15.134:47296) 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f577fe700 1 -- 172.21.15.134:0/3888161009 learned_addr learned my addr 172.21.15.134:0/3888161009 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f57fff700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f58061220 0x7f1f58107f90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f577fe700 1 -- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f58061220 msgr2=0x7f1f58107f90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f577fe700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f58061220 0x7f1f58107f90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f577fe700 1 -- 172.21.15.134:0/3888161009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f40005040 con 0x7f1f580fa9b0 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f577fe700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f580fa9b0 0x7f1f58108480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f1f4800c790 tx=0x7f1f48007f50).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:04:37.953 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f557fa700 1 -- 172.21.15.134:0/3888161009 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f4800e680 con 0x7f1f580fa9b0 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f5810d610 con 0x7f1f580fa9b0 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f557fa700 1 -- 172.21.15.134:0/3888161009 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1f4800ec70 con 0x7f1f580fa9b0 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f557fa700 1 -- 172.21.15.134:0/3888161009 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f48012cc0 con 0x7f1f580fa9b0 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.949+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f5810db50 con 0x7f1f580fa9b0 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.950+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f58100000 con 0x7f1f580fa9b0 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.951+0000 7f1f557fa700 1 -- 172.21.15.134:0/3888161009 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f1f48012490 con 0x7f1f580fa9b0 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.951+0000 7f1f557fa700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1f44061180 0x7f1f44063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.951+0000 7f1f557fa700 1 -- 172.21.15.134:0/3888161009 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(22..22 src has 1..22) v4 ==== 3129+0+0 (secure 0 0 0) 0x7f1f4807b890 con 0x7f1f580fa9b0 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.951+0000 7f1f57fff700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1f44061180 0x7f1f44063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:04:37.954 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.951+0000 7f1f57fff700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1f44061180 0x7f1f44063640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1f400047c0 tx=0x7f1f4000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:04:37.957 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:37.955+0000 7f1f557fa700 1 -- 172.21.15.134:0/3888161009 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1f48047f60 con 0x7f1f580fa9b0 2024-03-12T16:04:38.133 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:04:38.131+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f58059120 con 0x7f1f44061180 2024-03-12T16:04:38.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:37.071463+0000 mon.smithi006 (mon.0) 307 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:38.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:37.072164+0000 mgr.smithi006.kskdce (mgr.14196) 79 : cephadm [INF] Reconfiguring crash.smithi134 (monmap changed)... 2024-03-12T16:04:38.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:37.072427+0000 mon.smithi006 (mon.0) 308 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:04:38.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:37.073152+0000 mon.smithi006 (mon.0) 309 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:38.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:37.073669+0000 mgr.smithi006.kskdce (mgr.14196) 80 : cephadm [INF] Reconfiguring daemon crash.smithi134 on smithi134 2024-03-12T16:04:38.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:37.071463+0000 mon.smithi006 (mon.0) 307 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:38.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:37.072164+0000 mgr.smithi006.kskdce (mgr.14196) 79 : cephadm [INF] Reconfiguring crash.smithi134 (monmap changed)... 2024-03-12T16:04:38.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:37.072427+0000 mon.smithi006 (mon.0) 308 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:04:38.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:37.073152+0000 mon.smithi006 (mon.0) 309 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:38.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:37.073669+0000 mgr.smithi006.kskdce (mgr.14196) 80 : cephadm [INF] Reconfiguring daemon crash.smithi134 on smithi134 2024-03-12T16:04:39.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:37.942815+0000 mgr.smithi006.kskdce (mgr.14196) 81 : cluster [DBG] pgmap v69: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:39.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:38.133863+0000 mgr.smithi006.kskdce (mgr.14196) 82 : audit [DBG] from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:04:39.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:38.136451+0000 mon.smithi006 (mon.0) 310 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:04:39.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:38.138833+0000 mon.smithi006 (mon.0) 311 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:04:39.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:38.139675+0000 mon.smithi006 (mon.0) 312 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:39.449 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:38.938986+0000 mon.smithi006 (mon.0) 313 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:39.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:38.939976+0000 mon.smithi006 (mon.0) 314 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:04:39.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:38.940909+0000 mon.smithi006 (mon.0) 315 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:04:39.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:38.941681+0000 mon.smithi006 (mon.0) 316 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:37.942815+0000 mgr.smithi006.kskdce (mgr.14196) 81 : cluster [DBG] pgmap v69: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:38.133863+0000 mgr.smithi006.kskdce (mgr.14196) 82 : audit [DBG] from='client.24127 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:04:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:38.136451+0000 mon.smithi006 (mon.0) 310 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:04:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:38.138833+0000 mon.smithi006 (mon.0) 311 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:04:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:38.139675+0000 mon.smithi006 (mon.0) 312 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:38.938986+0000 mon.smithi006 (mon.0) 313 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:38.939976+0000 mon.smithi006 (mon.0) 314 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:04:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:38.940909+0000 mon.smithi006 (mon.0) 315 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:04:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:38.941681+0000 mon.smithi006 (mon.0) 316 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:40.368 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:38.939641+0000 mgr.smithi006.kskdce (mgr.14196) 83 : cephadm [INF] Reconfiguring mgr.smithi134.gcntfu (monmap changed)... 2024-03-12T16:04:40.369 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:38.942426+0000 mgr.smithi006.kskdce (mgr.14196) 84 : cephadm [INF] Reconfiguring daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:04:40.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:38.939641+0000 mgr.smithi006.kskdce (mgr.14196) 83 : cephadm [INF] Reconfiguring mgr.smithi134.gcntfu (monmap changed)... 2024-03-12T16:04:40.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:38.942426+0000 mgr.smithi006.kskdce (mgr.14196) 84 : cephadm [INF] Reconfiguring daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:04:41.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:39.943335+0000 mgr.smithi006.kskdce (mgr.14196) 85 : cluster [DBG] pgmap v70: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:41.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:40.424344+0000 mon.smithi006 (mon.0) 317 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:41.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:40.425318+0000 mon.smithi006 (mon.0) 318 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:04:41.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:40.426106+0000 mon.smithi006 (mon.0) 319 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:04:41.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:40.426848+0000 mon.smithi006 (mon.0) 320 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:39.943335+0000 mgr.smithi006.kskdce (mgr.14196) 85 : cluster [DBG] pgmap v70: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:40.424344+0000 mon.smithi006 (mon.0) 317 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:40.425318+0000 mon.smithi006 (mon.0) 318 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:04:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:40.426106+0000 mon.smithi006 (mon.0) 319 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:04:41.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:40.426848+0000 mon.smithi006 (mon.0) 320 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:42.371 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:40.425010+0000 mgr.smithi006.kskdce (mgr.14196) 86 : cephadm [INF] Reconfiguring mon.smithi134 (monmap changed)... 2024-03-12T16:04:42.371 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:40.427516+0000 mgr.smithi006.kskdce (mgr.14196) 87 : cephadm [INF] Reconfiguring daemon mon.smithi134 on smithi134 2024-03-12T16:04:42.431 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:40.425010+0000 mgr.smithi006.kskdce (mgr.14196) 86 : cephadm [INF] Reconfiguring mon.smithi134 (monmap changed)... 2024-03-12T16:04:42.431 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:40.427516+0000 mgr.smithi006.kskdce (mgr.14196) 87 : cephadm [INF] Reconfiguring daemon mon.smithi134 on smithi134 2024-03-12T16:04:43.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:41.943732+0000 mgr.smithi006.kskdce (mgr.14196) 88 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.413024+0000 mon.smithi006 (mon.0) 321 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.416523+0000 mon.smithi006 (mon.0) 322 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.418105+0000 mon.smithi006 (mon.0) 323 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi006.front.sepia.ceph.com:9093"}]: dispatch 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.422554+0000 mon.smithi006 (mon.0) 324 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.429832+0000 mon.smithi006 (mon.0) 325 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.432691+0000 mon.smithi006 (mon.0) 326 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi006.front.sepia.ceph.com:3000"}]: dispatch 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.439449+0000 mon.smithi006 (mon.0) 327 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.445201+0000 mon.smithi006 (mon.0) 328 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.448065+0000 mon.smithi006 (mon.0) 329 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.454736+0000 mon.smithi006 (mon.0) 330 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:43.358 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.458824+0000 mon.smithi006 (mon.0) 331 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:04:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:41.943732+0000 mgr.smithi006.kskdce (mgr.14196) 88 : cluster [DBG] pgmap v71: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.413024+0000 mon.smithi006 (mon.0) 321 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.416523+0000 mon.smithi006 (mon.0) 322 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:04:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.418105+0000 mon.smithi006 (mon.0) 323 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi006.front.sepia.ceph.com:9093"}]: dispatch 2024-03-12T16:04:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.422554+0000 mon.smithi006 (mon.0) 324 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:43.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.429832+0000 mon.smithi006 (mon.0) 325 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:04:43.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.432691+0000 mon.smithi006 (mon.0) 326 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi006.front.sepia.ceph.com:3000"}]: dispatch 2024-03-12T16:04:43.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.439449+0000 mon.smithi006 (mon.0) 327 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:43.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.445201+0000 mon.smithi006 (mon.0) 328 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:04:43.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.448065+0000 mon.smithi006 (mon.0) 329 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-03-12T16:04:43.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.454736+0000 mon.smithi006 (mon.0) 330 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:43.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.458824+0000 mon.smithi006 (mon.0) 331 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:04:44.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.416935+0000 mgr.smithi006.kskdce (mgr.14196) 89 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:04:44.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.418401+0000 mgr.smithi006.kskdce (mgr.14196) 90 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi006.front.sepia.ceph.com:9093"}]: dispatch 2024-03-12T16:04:44.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.430269+0000 mgr.smithi006.kskdce (mgr.14196) 91 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:04:44.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.433018+0000 mgr.smithi006.kskdce (mgr.14196) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi006.front.sepia.ceph.com:3000"}]: dispatch 2024-03-12T16:04:44.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.445637+0000 mgr.smithi006.kskdce (mgr.14196) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:04:44.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:42.448396+0000 mgr.smithi006.kskdce (mgr.14196) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-03-12T16:04:44.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:43.449927+0000 mon.smithi134 (mon.1) 2 : audit [INF] from='client.? 172.21.15.134:0/3657462226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47d2f20b-d7b8-4d67-905c-af29938d36d0"}]: dispatch 2024-03-12T16:04:44.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:43.450575+0000 mon.smithi006 (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47d2f20b-d7b8-4d67-905c-af29938d36d0"}]: dispatch 2024-03-12T16:04:44.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:43.461873+0000 mon.smithi006 (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47d2f20b-d7b8-4d67-905c-af29938d36d0"}]': finished 2024-03-12T16:04:44.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:43.461959+0000 mon.smithi006 (mon.0) 334 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-03-12T16:04:44.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:43.462090+0000 mon.smithi006 (mon.0) 335 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:04:44.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.416935+0000 mgr.smithi006.kskdce (mgr.14196) 89 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:04:44.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.418401+0000 mgr.smithi006.kskdce (mgr.14196) 90 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi006.front.sepia.ceph.com:9093"}]: dispatch 2024-03-12T16:04:44.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.430269+0000 mgr.smithi006.kskdce (mgr.14196) 91 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:04:44.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.433018+0000 mgr.smithi006.kskdce (mgr.14196) 92 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi006.front.sepia.ceph.com:3000"}]: dispatch 2024-03-12T16:04:44.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.445637+0000 mgr.smithi006.kskdce (mgr.14196) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:04:44.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:42.448396+0000 mgr.smithi006.kskdce (mgr.14196) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi134.front.sepia.ceph.com:9095"}]: dispatch 2024-03-12T16:04:44.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:43.449927+0000 mon.smithi134 (mon.1) 2 : audit [INF] from='client.? 172.21.15.134:0/3657462226' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47d2f20b-d7b8-4d67-905c-af29938d36d0"}]: dispatch 2024-03-12T16:04:44.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:43.450575+0000 mon.smithi006 (mon.0) 332 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "47d2f20b-d7b8-4d67-905c-af29938d36d0"}]: dispatch 2024-03-12T16:04:44.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:43.461873+0000 mon.smithi006 (mon.0) 333 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "47d2f20b-d7b8-4d67-905c-af29938d36d0"}]': finished 2024-03-12T16:04:44.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:43.461959+0000 mon.smithi006 (mon.0) 334 : cluster [DBG] osdmap e23: 4 total, 3 up, 4 in 2024-03-12T16:04:44.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:43.462090+0000 mon.smithi006 (mon.0) 335 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:04:45.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:43.944040+0000 mgr.smithi006.kskdce (mgr.14196) 95 : cluster [DBG] pgmap v73: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:45.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:44.113883+0000 mon.smithi134 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.134:0/310383697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:04:45.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:43.944040+0000 mgr.smithi006.kskdce (mgr.14196) 95 : cluster [DBG] pgmap v73: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:44.113883+0000 mon.smithi134 (mon.1) 3 : audit [DBG] from='client.? 172.21.15.134:0/310383697' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:04:46.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:45.440385+0000 mon.smithi006 (mon.0) 336 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:46.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:45.944375+0000 mgr.smithi006.kskdce (mgr.14196) 96 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:46.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:46.208373+0000 mon.smithi006 (mon.0) 337 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:46.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:45.440385+0000 mon.smithi006 (mon.0) 336 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:46.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:45.944375+0000 mgr.smithi006.kskdce (mgr.14196) 96 : cluster [DBG] pgmap v74: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:46.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:46.208373+0000 mon.smithi006 (mon.0) 337 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:49.164 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:47.944808+0000 mgr.smithi006.kskdce (mgr.14196) 97 : cluster [DBG] pgmap v75: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:49.419 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:47.944808+0000 mgr.smithi006.kskdce (mgr.14196) 97 : cluster [DBG] pgmap v75: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:50.420 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:49.418126+0000 mon.smithi006 (mon.0) 338 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:50.420 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:49.418974+0000 mon.smithi006 (mon.0) 339 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:50.420 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:49.419571+0000 mon.smithi006 (mon.0) 340 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:50.420 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:49.420125+0000 mon.smithi006 (mon.0) 341 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:50.420 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:49.420567+0000 mgr.smithi006.kskdce (mgr.14196) 98 : cephadm [INF] Adjusting osd_memory_target on smithi006 to 4642M 2024-03-12T16:04:50.420 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:49.423750+0000 mon.smithi006 (mon.0) 342 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:50.420 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:49.424543+0000 mon.smithi006 (mon.0) 343 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:50.421 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:49.425170+0000 mon.smithi006 (mon.0) 344 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:04:50.421 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:49.428857+0000 mon.smithi006 (mon.0) 345 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:50.421 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:49.432189+0000 mon.smithi006 (mon.0) 346 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:04:50.421 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:49.945140+0000 mgr.smithi006.kskdce (mgr.14196) 99 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:50.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:49.418126+0000 mon.smithi006 (mon.0) 338 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:50.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:49.418974+0000 mon.smithi006 (mon.0) 339 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:50.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:49.419571+0000 mon.smithi006 (mon.0) 340 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:50.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:49.420125+0000 mon.smithi006 (mon.0) 341 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:04:50.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:49.420567+0000 mgr.smithi006.kskdce (mgr.14196) 98 : cephadm [INF] Adjusting osd_memory_target on smithi006 to 4642M 2024-03-12T16:04:50.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:49.423750+0000 mon.smithi006 (mon.0) 342 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:50.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:49.424543+0000 mon.smithi006 (mon.0) 343 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:50.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:49.425170+0000 mon.smithi006 (mon.0) 344 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:04:50.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:49.428857+0000 mon.smithi006 (mon.0) 345 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:50.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:49.432189+0000 mon.smithi006 (mon.0) 346 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:04:50.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:49.945140+0000 mgr.smithi006.kskdce (mgr.14196) 99 : cluster [DBG] pgmap v76: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:51.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:51.348878+0000 mon.smithi006 (mon.0) 347 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-12T16:04:51.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:51.349508+0000 mon.smithi006 (mon.0) 348 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:51.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:51.348878+0000 mon.smithi006 (mon.0) 347 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-12T16:04:51.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:51.349508+0000 mon.smithi006 (mon.0) 348 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:04:51.350043+0000 mgr.smithi006.kskdce (mgr.14196) 100 : cephadm [INF] Deploying daemon osd.3 on smithi134 2024-03-12T16:04:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:51.945440+0000 mgr.smithi006.kskdce (mgr.14196) 101 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:52.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:04:51.350043+0000 mgr.smithi006.kskdce (mgr.14196) 100 : cephadm [INF] Deploying daemon osd.3 on smithi134 2024-03-12T16:04:52.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:51.945440+0000 mgr.smithi006.kskdce (mgr.14196) 101 : cluster [DBG] pgmap v77: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:53.326759+0000 mon.smithi006 (mon.0) 349 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:53.945766+0000 mgr.smithi006.kskdce (mgr.14196) 102 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:54.266853+0000 mon.smithi006 (mon.0) 350 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:53.326759+0000 mon.smithi006 (mon.0) 349 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:53.945766+0000 mgr.smithi006.kskdce (mgr.14196) 102 : cluster [DBG] pgmap v78: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:54.266853+0000 mon.smithi006 (mon.0) 350 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:57.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:55.946188+0000 mgr.smithi006.kskdce (mgr.14196) 103 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:57.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:56.727018+0000 mon.smithi006 (mon.0) 351 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:57.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:56.727684+0000 mon.smithi006 (mon.0) 352 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:57.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:56.728288+0000 mon.smithi006 (mon.0) 353 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:04:57.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:56.731844+0000 mon.smithi006 (mon.0) 354 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:55.946188+0000 mgr.smithi006.kskdce (mgr.14196) 103 : cluster [DBG] pgmap v79: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:56.727018+0000 mon.smithi006 (mon.0) 351 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:56.727684+0000 mon.smithi006 (mon.0) 352 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:04:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:56.728288+0000 mon.smithi006 (mon.0) 353 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:04:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:56.731844+0000 mon.smithi006 (mon.0) 354 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:59.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:57.946626+0000 mgr.smithi006.kskdce (mgr.14196) 104 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:59.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:57.974098+0000 mon.smithi006 (mon.0) 355 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:59.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:04:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:04:58.003007+0000 mon.smithi006 (mon.0) 356 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:04:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:57.946626+0000 mgr.smithi006.kskdce (mgr.14196) 104 : cluster [DBG] pgmap v80: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:04:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:57.974098+0000 mon.smithi006 (mon.0) 355 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:04:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:04:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:04:58.003007+0000 mon.smithi006 (mon.0) 356 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:05:01.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:04:59.946901+0000 mgr.smithi006.kskdce (mgr.14196) 105 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:05:01.312 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:04:59.946901+0000 mgr.smithi006.kskdce (mgr.14196) 105 : cluster [DBG] pgmap v81: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:05:01.862 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.860+0000 7f1f557fa700 1 -- 172.21.15.134:0/3888161009 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1f58059120 con 0x7f1f44061180 2024-03-12T16:05:01.863 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 3 on host 'smithi134' 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1f44061180 msgr2=0x7f1f44063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1f44061180 0x7f1f44063640 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f1f400047c0 tx=0x7f1f4000b040).stop 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f580fa9b0 msgr2=0x7f1f58108480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f580fa9b0 0x7f1f58108480 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7f1f4800c790 tx=0x7f1f48007f50).stop 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 shutdown_connections 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1f44061180 0x7f1f44063640 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f58061220 0x7f1f58107f90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 --2- 172.21.15.134:0/3888161009 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f580fa9b0 0x7f1f58108480 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 >> 172.21.15.134:0/3888161009 conn(0x7f1f580f1e50 msgr2=0x7f1f580f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 shutdown_connections 2024-03-12T16:05:01.864 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:01.862+0000 7f1f5e8c1700 1 -- 172.21.15.134:0/3888161009 wait complete. 2024-03-12T16:05:02.804 DEBUG:teuthology.orchestra.run.smithi134:osd.3> sudo journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.3.service 2024-03-12T16:05:02.807 INFO:tasks.cephadm:Deploying osd.4 on smithi134 with /dev/vg_nvme/lv_3... 2024-03-12T16:05:02.807 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-03-12T16:05:02.837 INFO:journalctl@ceph.osd.3.smithi134.stdout:-- Logs begin at Tue 2024-03-12 15:47:40 UTC. -- 2024-03-12T16:05:03.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:01.731438+0000 mon.smithi006 (mon.0) 357 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:03.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:01.861057+0000 mon.smithi006 (mon.0) 358 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:03.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:01.912694+0000 mon.smithi134 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-12T16:05:03.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:01.913074+0000 mon.smithi006 (mon.0) 359 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-12T16:05:03.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:01.947271+0000 mgr.smithi006.kskdce (mgr.14196) 106 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:05:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:01.731438+0000 mon.smithi006 (mon.0) 357 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:01.861057+0000 mon.smithi006 (mon.0) 358 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:01.912694+0000 mon.smithi134 (mon.1) 4 : audit [INF] from='osd.3 [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-12T16:05:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:01.913074+0000 mon.smithi006 (mon.0) 359 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-12T16:05:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:01.947271+0000 mgr.smithi006.kskdce (mgr.14196) 106 : cluster [DBG] pgmap v82: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:05:04.203 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:05:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[48189]: debug 2024-03-12T16:05:03.874+0000 7f22e5fcb700 -1 osd.3 0 waiting for initial osdmap 2024-03-12T16:05:04.203 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:05:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[48189]: debug 2024-03-12T16:05:03.880+0000 7f22def40700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:05:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:02.868075+0000 mon.smithi006 (mon.0) 360 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-12T16:05:04.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:02.868137+0000 mon.smithi006 (mon.0) 361 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-03-12T16:05:04.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:02.868298+0000 mon.smithi006 (mon.0) 362 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:05:04.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:02.872470+0000 mon.smithi134 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:04.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:02.872920+0000 mon.smithi006 (mon.0) 363 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:04.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:03.299002+0000 mon.smithi006 (mon.0) 364 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:02.868075+0000 mon.smithi006 (mon.0) 360 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-12T16:05:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:02.868137+0000 mon.smithi006 (mon.0) 361 : cluster [DBG] osdmap e24: 4 total, 3 up, 4 in 2024-03-12T16:05:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:02.868298+0000 mon.smithi006 (mon.0) 362 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:05:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:02.872470+0000 mon.smithi134 (mon.1) 5 : audit [INF] from='osd.3 [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:02.872920+0000 mon.smithi006 (mon.0) 363 : audit [INF] from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:03.299002+0000 mon.smithi006 (mon.0) 364 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:03.870125+0000 mon.smithi006 (mon.0) 365 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-12T16:05:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:03.870189+0000 mon.smithi006 (mon.0) 366 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-03-12T16:05:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:03.870692+0000 mon.smithi006 (mon.0) 367 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:05:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:03.875789+0000 mon.smithi006 (mon.0) 368 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:05:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:03.947580+0000 mgr.smithi006.kskdce (mgr.14196) 107 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:05:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:03.870125+0000 mon.smithi006 (mon.0) 365 : audit [INF] from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-12T16:05:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:03.870189+0000 mon.smithi006 (mon.0) 366 : cluster [DBG] osdmap e25: 4 total, 3 up, 4 in 2024-03-12T16:05:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:03.870692+0000 mon.smithi006 (mon.0) 367 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:05:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:03.875789+0000 mon.smithi006 (mon.0) 368 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:05:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:03.947580+0000 mgr.smithi006.kskdce (mgr.14196) 107 : cluster [DBG] pgmap v85: 1 pgs: 1 active+clean; 0 B data, 871 MiB used, 267 GiB / 268 GiB avail 2024-03-12T16:05:06.163 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:02.955567+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:05:06.163 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:02.955634+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:05:06.163 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:04.874467+0000 mon.smithi006 (mon.0) 369 : cluster [INF] osd.3 [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] boot 2024-03-12T16:05:06.163 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:04.874529+0000 mon.smithi006 (mon.0) 370 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-03-12T16:05:06.163 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:04.874728+0000 mon.smithi006 (mon.0) 371 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:05:06.163 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:05.873033+0000 mon.smithi006 (mon.0) 372 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-03-12T16:05:06.183 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-03-12T16:05:06.183 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-03-12T16:05:06.183 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-03-12T16:05:06.183 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-03-12T16:05:06.183 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0109104 s, 961 MB/s 2024-03-12T16:05:06.184 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-03-12T16:05:06.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:02.955567+0000 osd.3 (osd.3) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:05:06.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:02.955634+0000 osd.3 (osd.3) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:05:06.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:04.874467+0000 mon.smithi006 (mon.0) 369 : cluster [INF] osd.3 [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] boot 2024-03-12T16:05:06.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:04.874529+0000 mon.smithi006 (mon.0) 370 : cluster [DBG] osdmap e26: 4 total, 4 up, 4 in 2024-03-12T16:05:06.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:04.874728+0000 mon.smithi006 (mon.0) 371 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:05:06.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:05.873033+0000 mon.smithi006 (mon.0) 372 : cluster [DBG] osdmap e27: 4 total, 4 up, 4 in 2024-03-12T16:05:07.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:05.948146+0000 mgr.smithi006.kskdce (mgr.14196) 108 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:06.874980+0000 mon.smithi006 (mon.0) 373 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-03-12T16:05:07.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:05.948146+0000 mgr.smithi006.kskdce (mgr.14196) 108 : cluster [DBG] pgmap v88: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:07.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:06.874980+0000 mon.smithi006 (mon.0) 373 : cluster [DBG] osdmap e28: 4 total, 4 up, 4 in 2024-03-12T16:05:07.323 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_3 2024-03-12T16:05:09.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:07.948609+0000 mgr.smithi006.kskdce (mgr.14196) 109 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:09.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:05:08.260503+0000 mgr.smithi006.kskdce (mgr.14196) 110 : cephadm [INF] Detected new or changed devices on smithi134 2024-03-12T16:05:09.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:08.265226+0000 mon.smithi006 (mon.0) 374 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:09.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:08.553112+0000 mon.smithi006 (mon.0) 375 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:05:09.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:08.558331+0000 mon.smithi006 (mon.0) 376 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:09.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:08.559501+0000 mon.smithi006 (mon.0) 377 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:09.411 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:08.560386+0000 mon.smithi006 (mon.0) 378 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:05:09.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:08.565311+0000 mon.smithi006 (mon.0) 379 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:09.412 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:08.570075+0000 mon.smithi006 (mon.0) 380 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:05:09.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:07.948609+0000 mgr.smithi006.kskdce (mgr.14196) 109 : cluster [DBG] pgmap v90: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:09.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:05:08.260503+0000 mgr.smithi006.kskdce (mgr.14196) 110 : cephadm [INF] Detected new or changed devices on smithi134 2024-03-12T16:05:09.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:08.265226+0000 mon.smithi006 (mon.0) 374 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:09.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:08.553112+0000 mon.smithi006 (mon.0) 375 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:05:09.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:08.558331+0000 mon.smithi006 (mon.0) 376 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:09.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:08.559501+0000 mon.smithi006 (mon.0) 377 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:09.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:08.560386+0000 mon.smithi006 (mon.0) 378 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:05:09.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:08.565311+0000 mon.smithi006 (mon.0) 379 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:09.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:08.570075+0000 mon.smithi006 (mon.0) 380 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:05:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.659+0000 7f1f14c5a700 1 -- 172.21.15.134:0/3156270444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100616d0 msgr2=0x7f1f100fa510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.659+0000 7f1f14c5a700 1 --2- 172.21.15.134:0/3156270444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100616d0 0x7f1f100fa510 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 rx=0x7f1f000047f0 tx=0x7f1f00009cb0).stop 2024-03-12T16:05:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.659+0000 7f1f14c5a700 1 -- 172.21.15.134:0/3156270444 shutdown_connections 2024-03-12T16:05:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.659+0000 7f1f14c5a700 1 --2- 172.21.15.134:0/3156270444 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f100faa00 0x7f1f100fcdf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:09.661 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.659+0000 7f1f14c5a700 1 --2- 172.21.15.134:0/3156270444 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100616d0 0x7f1f100fa510 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.659+0000 7f1f14c5a700 1 -- 172.21.15.134:0/3156270444 >> 172.21.15.134:0/3156270444 conn(0x7f1f100f1ef0 msgr2=0x7f1f100f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:05:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.659+0000 7f1f14c5a700 1 -- 172.21.15.134:0/3156270444 shutdown_connections 2024-03-12T16:05:09.662 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.659+0000 7f1f14c5a700 1 -- 172.21.15.134:0/3156270444 wait complete. 2024-03-12T16:05:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.660+0000 7f1f14c5a700 1 Processor -- start 2024-03-12T16:05:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.660+0000 7f1f14c5a700 1 -- start start 2024-03-12T16:05:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.660+0000 7f1f14c5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f100616d0 0x7f1f10108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:05:09.663 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.660+0000 7f1f14c5a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100faa00 0x7f1f10108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.660+0000 7f1f14c5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10108ae0 con 0x7f1f100616d0 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.660+0000 7f1f14c5a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f10108c20 con 0x7f1f100faa00 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f0dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100faa00 0x7f1f10108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f0dd9b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100faa00 0x7f1f10108530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:57766/0 (socket says 172.21.15.134:57766) 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f0dd9b700 1 -- 172.21.15.134:0/1039475135 learned_addr learned my addr 172.21.15.134:0/1039475135 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f0e59c700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f100616d0 0x7f1f10108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f0dd9b700 1 -- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f100616d0 msgr2=0x7f1f10108040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f0dd9b700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f100616d0 0x7f1f10108040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f0dd9b700 1 -- 172.21.15.134:0/1039475135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f00005040 con 0x7f1f100faa00 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f0e59c700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f100616d0 0x7f1f10108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f0dd9b700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100faa00 0x7f1f10108530 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f1f040041d0 tx=0x7f1f04009f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1eff7fe700 1 -- 172.21.15.134:0/1039475135 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f04007b40 con 0x7f1f100faa00 2024-03-12T16:05:09.664 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1eff7fe700 1 -- 172.21.15.134:0/1039475135 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f1f0400f040 con 0x7f1f100faa00 2024-03-12T16:05:09.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f1010d6c0 con 0x7f1f100faa00 2024-03-12T16:05:09.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1eff7fe700 1 -- 172.21.15.134:0/1039475135 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f04013730 con 0x7f1f100faa00 2024-03-12T16:05:09.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.661+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f1010dc00 con 0x7f1f100faa00 2024-03-12T16:05:09.665 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.662+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f100ffff0 con 0x7f1f100faa00 2024-03-12T16:05:09.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.663+0000 7f1eff7fe700 1 -- 172.21.15.134:0/1039475135 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f1f04009110 con 0x7f1f100faa00 2024-03-12T16:05:09.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.663+0000 7f1eff7fe700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1ef8061180 0x7f1ef8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:05:09.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.663+0000 7f1eff7fe700 1 -- 172.21.15.134:0/1039475135 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(28..28 src has 1..28) v4 ==== 3671+0+0 (secure 0 0 0) 0x7f1f0407bc70 con 0x7f1f100faa00 2024-03-12T16:05:09.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.663+0000 7f1f0e59c700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1ef8061180 0x7f1ef8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:05:09.666 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.664+0000 7f1f0e59c700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1ef8061180 0x7f1ef8063640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1f00009ee0 tx=0x7f1f0000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:05:09.669 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.668+0000 7f1eff7fe700 1 -- 172.21.15.134:0/1039475135 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f1f040502a0 con 0x7f1f100faa00 2024-03-12T16:05:09.854 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:09.852+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f10059120 con 0x7f1ef8061180 2024-03-12T16:05:10.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:10 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:05:08.553813+0000 mgr.smithi006.kskdce (mgr.14196) 111 : cephadm [INF] Adjusting osd_memory_target on smithi134 to 14946M 2024-03-12T16:05:10.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:10 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:09.856843+0000 mon.smithi006 (mon.0) 381 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:05:10.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:10 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:09.858791+0000 mon.smithi006 (mon.0) 382 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:05:10.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:10 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:09.859312+0000 mon.smithi006 (mon.0) 383 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:10.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:10 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:05:08.553813+0000 mgr.smithi006.kskdce (mgr.14196) 111 : cephadm [INF] Adjusting osd_memory_target on smithi134 to 14946M 2024-03-12T16:05:10.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:10 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:09.856843+0000 mon.smithi006 (mon.0) 381 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:05:10.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:10 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:09.858791+0000 mon.smithi006 (mon.0) 382 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:05:10.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:10 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:09.859312+0000 mon.smithi006 (mon.0) 383 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:11.564 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:09.854585+0000 mgr.smithi006.kskdce (mgr.14196) 112 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:05:11.564 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:09.948951+0000 mgr.smithi006.kskdce (mgr.14196) 113 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:11.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:09.854585+0000 mgr.smithi006.kskdce (mgr.14196) 112 : audit [DBG] from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:05:11.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:09.948951+0000 mgr.smithi006.kskdce (mgr.14196) 113 : cluster [DBG] pgmap v91: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:13.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:11.949255+0000 mgr.smithi006.kskdce (mgr.14196) 114 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:13.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:12.138682+0000 mon.smithi006 (mon.0) 384 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:13.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:13.057259+0000 mon.smithi134 (mon.1) 6 : audit [INF] from='client.? 172.21.15.134:0/4138619609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfe8b5a1-489a-458d-ba30-5d1bada0c33e"}]: dispatch 2024-03-12T16:05:13.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:13.057763+0000 mon.smithi006 (mon.0) 385 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfe8b5a1-489a-458d-ba30-5d1bada0c33e"}]: dispatch 2024-03-12T16:05:13.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:13.062389+0000 mon.smithi006 (mon.0) 386 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfe8b5a1-489a-458d-ba30-5d1bada0c33e"}]': finished 2024-03-12T16:05:13.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:13.062470+0000 mon.smithi006 (mon.0) 387 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-03-12T16:05:13.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:13.062625+0000 mon.smithi006 (mon.0) 388 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:11.949255+0000 mgr.smithi006.kskdce (mgr.14196) 114 : cluster [DBG] pgmap v92: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:12.138682+0000 mon.smithi006 (mon.0) 384 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:13.057259+0000 mon.smithi134 (mon.1) 6 : audit [INF] from='client.? 172.21.15.134:0/4138619609' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfe8b5a1-489a-458d-ba30-5d1bada0c33e"}]: dispatch 2024-03-12T16:05:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:13.057763+0000 mon.smithi006 (mon.0) 385 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "bfe8b5a1-489a-458d-ba30-5d1bada0c33e"}]: dispatch 2024-03-12T16:05:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:13.062389+0000 mon.smithi006 (mon.0) 386 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "bfe8b5a1-489a-458d-ba30-5d1bada0c33e"}]': finished 2024-03-12T16:05:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:13.062470+0000 mon.smithi006 (mon.0) 387 : cluster [DBG] osdmap e29: 5 total, 4 up, 5 in 2024-03-12T16:05:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:13.062625+0000 mon.smithi006 (mon.0) 388 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:14.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:13.760441+0000 mon.smithi134 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.134:0/4134437932' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:05:14.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:13.802256+0000 mon.smithi006 (mon.0) 389 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:14.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:13.803115+0000 mon.smithi006 (mon.0) 390 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:14.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:13.804012+0000 mon.smithi006 (mon.0) 391 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:05:14.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:13.808613+0000 mon.smithi006 (mon.0) 392 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:14.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:13.760441+0000 mon.smithi134 (mon.1) 7 : audit [DBG] from='client.? 172.21.15.134:0/4134437932' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:05:14.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:13.802256+0000 mon.smithi006 (mon.0) 389 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:14.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:13.803115+0000 mon.smithi006 (mon.0) 390 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:14.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:13.804012+0000 mon.smithi006 (mon.0) 391 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:05:14.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:13.808613+0000 mon.smithi006 (mon.0) 392 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:15.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:13.949640+0000 mgr.smithi006.kskdce (mgr.14196) 115 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:15.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:13.949640+0000 mgr.smithi006.kskdce (mgr.14196) 115 : cluster [DBG] pgmap v94: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:17.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:15.950033+0000 mgr.smithi006.kskdce (mgr.14196) 116 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:17.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:15.950033+0000 mgr.smithi006.kskdce (mgr.14196) 116 : cluster [DBG] pgmap v95: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:19.387 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:17.950517+0000 mgr.smithi006.kskdce (mgr.14196) 117 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:19.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:17.950517+0000 mgr.smithi006.kskdce (mgr.14196) 117 : cluster [DBG] pgmap v96: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:21.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:19.950798+0000 mgr.smithi006.kskdce (mgr.14196) 118 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:21.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:20.506117+0000 mon.smithi006 (mon.0) 393 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-12T16:05:21.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:20.507026+0000 mon.smithi006 (mon.0) 394 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:21.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:19.950798+0000 mgr.smithi006.kskdce (mgr.14196) 118 : cluster [DBG] pgmap v97: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:21.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:20.506117+0000 mon.smithi006 (mon.0) 393 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-12T16:05:21.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:20.507026+0000 mon.smithi006 (mon.0) 394 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:22.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:22 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:05:20.507825+0000 mgr.smithi006.kskdce (mgr.14196) 119 : cephadm [INF] Deploying daemon osd.4 on smithi134 2024-03-12T16:05:22.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:22 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:05:20.507825+0000 mgr.smithi006.kskdce (mgr.14196) 119 : cephadm [INF] Deploying daemon osd.4 on smithi134 2024-03-12T16:05:23.375 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:21.951200+0000 mgr.smithi006.kskdce (mgr.14196) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:23.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:21.951200+0000 mgr.smithi006.kskdce (mgr.14196) 120 : cluster [DBG] pgmap v98: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:25.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:23.951687+0000 mgr.smithi006.kskdce (mgr.14196) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:23.951687+0000 mgr.smithi006.kskdce (mgr.14196) 121 : cluster [DBG] pgmap v99: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:26.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:25.730137+0000 mon.smithi006 (mon.0) 395 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:26.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:25.758003+0000 mon.smithi006 (mon.0) 396 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:05:26.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:25.952019+0000 mgr.smithi006.kskdce (mgr.14196) 122 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:27.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:25.730137+0000 mon.smithi006 (mon.0) 395 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:27.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:25.758003+0000 mon.smithi006 (mon.0) 396 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:05:27.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:25.952019+0000 mgr.smithi006.kskdce (mgr.14196) 122 : cluster [DBG] pgmap v100: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:29.045 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:27.952377+0000 mgr.smithi006.kskdce (mgr.14196) 123 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:29.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:27.952377+0000 mgr.smithi006.kskdce (mgr.14196) 123 : cluster [DBG] pgmap v101: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:29.509 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.507+0000 7f1eff7fe700 1 -- 172.21.15.134:0/1039475135 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f1f10059120 con 0x7f1ef8061180 2024-03-12T16:05:29.510 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 4 on host 'smithi134' 2024-03-12T16:05:29.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.509+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1ef8061180 msgr2=0x7f1ef8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:29.511 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.509+0000 7f1f14c5a700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1ef8061180 0x7f1ef8063640 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f1f00009ee0 tx=0x7f1f0000b040).stop 2024-03-12T16:05:29.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.509+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100faa00 msgr2=0x7f1f10108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:29.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.509+0000 7f1f14c5a700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100faa00 0x7f1f10108530 secure :-1 s=READY pgs=13 cs=0 l=1 rev1=1 rx=0x7f1f040041d0 tx=0x7f1f04009f60).stop 2024-03-12T16:05:29.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.510+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 shutdown_connections 2024-03-12T16:05:29.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.510+0000 7f1f14c5a700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f1ef8061180 0x7f1ef8063640 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:29.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.510+0000 7f1f14c5a700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f100616d0 0x7f1f10108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:29.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.510+0000 7f1f14c5a700 1 --2- 172.21.15.134:0/1039475135 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f100faa00 0x7f1f10108530 unknown :-1 s=CLOSED pgs=13 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:29.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.510+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 >> 172.21.15.134:0/1039475135 conn(0x7f1f100f1ef0 msgr2=0x7f1f100f42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:05:29.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.510+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 shutdown_connections 2024-03-12T16:05:29.512 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:29.510+0000 7f1f14c5a700 1 -- 172.21.15.134:0/1039475135 wait complete. 2024-03-12T16:05:30.654 DEBUG:teuthology.orchestra.run.smithi134:osd.4> sudo journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.4.service 2024-03-12T16:05:30.656 INFO:tasks.cephadm:Deploying osd.5 on smithi134 with /dev/vg_nvme/lv_2... 2024-03-12T16:05:30.656 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-03-12T16:05:30.687 INFO:journalctl@ceph.osd.4.smithi134.stdout:-- Logs begin at Tue 2024-03-12 15:47:40 UTC. -- 2024-03-12T16:05:30.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:29.507968+0000 mon.smithi006 (mon.0) 397 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:30.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:29.634330+0000 mon.smithi134 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-12T16:05:30.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:29.634737+0000 mon.smithi006 (mon.0) 398 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-12T16:05:30.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:29.952831+0000 mgr.smithi006.kskdce (mgr.14196) 124 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:29.507968+0000 mon.smithi006 (mon.0) 397 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:29.634330+0000 mon.smithi134 (mon.1) 8 : audit [INF] from='osd.4 [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-12T16:05:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:29.634737+0000 mon.smithi006 (mon.0) 398 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-12T16:05:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:29.952831+0000 mgr.smithi006.kskdce (mgr.14196) 124 : cluster [DBG] pgmap v102: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:30.515093+0000 mon.smithi006 (mon.0) 399 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-12T16:05:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:30.515167+0000 mon.smithi006 (mon.0) 400 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-03-12T16:05:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:30.515472+0000 mon.smithi006 (mon.0) 401 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:30.515820+0000 mon.smithi134 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:30.516144+0000 mon.smithi006 (mon.0) 402 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:31.704 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:05:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[53929]: debug 2024-03-12T16:05:31.516+0000 7f4361c74700 -1 osd.4 0 waiting for initial osdmap 2024-03-12T16:05:31.704 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:05:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[53929]: debug 2024-03-12T16:05:31.524+0000 7f435bbeb700 -1 osd.4 31 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:05:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:30.515093+0000 mon.smithi006 (mon.0) 399 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-12T16:05:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:30.515167+0000 mon.smithi006 (mon.0) 400 : cluster [DBG] osdmap e30: 5 total, 4 up, 5 in 2024-03-12T16:05:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:30.515472+0000 mon.smithi006 (mon.0) 401 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:30.515820+0000 mon.smithi134 (mon.1) 9 : audit [INF] from='osd.4 [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:30.516144+0000 mon.smithi006 (mon.0) 402 : audit [INF] from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:32.575 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:31.514787+0000 mon.smithi006 (mon.0) 403 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-12T16:05:32.575 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:31.514891+0000 mon.smithi006 (mon.0) 404 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-03-12T16:05:32.575 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:31.515369+0000 mon.smithi006 (mon.0) 405 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:32.575 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:31.518989+0000 mon.smithi006 (mon.0) 406 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:32.575 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:31.953186+0000 mgr.smithi006.kskdce (mgr.14196) 125 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:32.575 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:32.205398+0000 mon.smithi006 (mon.0) 407 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:31.514787+0000 mon.smithi006 (mon.0) 403 : audit [INF] from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-12T16:05:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:31.514891+0000 mon.smithi006 (mon.0) 404 : cluster [DBG] osdmap e31: 5 total, 4 up, 5 in 2024-03-12T16:05:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:31.515369+0000 mon.smithi006 (mon.0) 405 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:31.518989+0000 mon.smithi006 (mon.0) 406 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:31.953186+0000 mgr.smithi006.kskdce (mgr.14196) 125 : cluster [DBG] pgmap v105: 1 pgs: 1 active+clean; 0 B data, 1.1 GiB used, 356 GiB / 358 GiB avail 2024-03-12T16:05:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:32.205398+0000 mon.smithi006 (mon.0) 407 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:33.491 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-03-12T16:05:33.491 INFO:teuthology.orchestra.run.smithi134.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-03-12T16:05:33.491 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10+0 records in 2024-03-12T16:05:33.491 INFO:teuthology.orchestra.run.smithi134.stderr:10+0 records out 2024-03-12T16:05:33.491 INFO:teuthology.orchestra.run.smithi134.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0121337 s, 864 MB/s 2024-03-12T16:05:33.491 INFO:teuthology.orchestra.run.smithi134.stderr:--> Zapping successful for: 2024-03-12T16:05:33.855 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:30.634604+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:05:33.856 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:30.634682+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:05:33.856 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:32.516635+0000 mon.smithi006 (mon.0) 408 : cluster [INF] osd.4 [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] boot 2024-03-12T16:05:33.856 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:32.516689+0000 mon.smithi006 (mon.0) 409 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-03-12T16:05:33.856 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:32.516825+0000 mon.smithi006 (mon.0) 410 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:30.634604+0000 osd.4 (osd.4) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:05:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:30.634682+0000 osd.4 (osd.4) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:05:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:32.516635+0000 mon.smithi006 (mon.0) 408 : cluster [INF] osd.4 [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] boot 2024-03-12T16:05:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:32.516689+0000 mon.smithi006 (mon.0) 409 : cluster [DBG] osdmap e32: 5 total, 5 up, 5 in 2024-03-12T16:05:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:32.516825+0000 mon.smithi006 (mon.0) 410 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:05:34.817 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:33.525085+0000 mon.smithi006 (mon.0) 411 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-03-12T16:05:34.817 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:33.953561+0000 mgr.smithi006.kskdce (mgr.14196) 126 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:34.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:33.525085+0000 mon.smithi006 (mon.0) 411 : cluster [DBG] osdmap e33: 5 total, 5 up, 5 in 2024-03-12T16:05:34.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:33.953561+0000 mgr.smithi006.kskdce (mgr.14196) 126 : cluster [DBG] pgmap v108: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:35.559 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph orch daemon add osd smithi134:vg_nvme/lv_2 2024-03-12T16:05:37.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:35.953906+0000 mgr.smithi006.kskdce (mgr.14196) 127 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:37.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:36.989219+0000 mon.smithi006 (mon.0) 412 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:37.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:36.990347+0000 mon.smithi006 (mon.0) 413 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:05:37.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:36.991241+0000 mon.smithi006 (mon.0) 414 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:05:37.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:36.995688+0000 mon.smithi006 (mon.0) 415 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:37.376 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:36.996663+0000 mon.smithi006 (mon.0) 416 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:37.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:36.997408+0000 mon.smithi006 (mon.0) 417 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:05:37.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:37.001884+0000 mon.smithi006 (mon.0) 418 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:35.953906+0000 mgr.smithi006.kskdce (mgr.14196) 127 : cluster [DBG] pgmap v109: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:36.989219+0000 mon.smithi006 (mon.0) 412 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:36.990347+0000 mon.smithi006 (mon.0) 413 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:05:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:36.991241+0000 mon.smithi006 (mon.0) 414 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:05:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:36.995688+0000 mon.smithi006 (mon.0) 415 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:37.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:36.996663+0000 mon.smithi006 (mon.0) 416 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:37.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:36.997408+0000 mon.smithi006 (mon.0) 417 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:05:37.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:37.001884+0000 mon.smithi006 (mon.0) 418 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:37.934 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.931+0000 7f7fcf761700 1 -- 172.21.15.134:0/991482847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 msgr2=0x7f7fc80f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.931+0000 7f7fcf761700 1 --2- 172.21.15.134:0/991482847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 0x7f7fc80f74f0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f7fc40047f0 tx=0x7f7fc4009cb0).stop 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.931+0000 7f7fcf761700 1 -- 172.21.15.134:0/991482847 shutdown_connections 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.931+0000 7f7fcf761700 1 --2- 172.21.15.134:0/991482847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 0x7f7fc80f74f0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.931+0000 7f7fcf761700 1 --2- 172.21.15.134:0/991482847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc80f5e70 0x7f7fc80f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.931+0000 7f7fcf761700 1 -- 172.21.15.134:0/991482847 >> 172.21.15.134:0/991482847 conn(0x7f7fc80f15d0 msgr2=0x7f7fc80f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.931+0000 7f7fcf761700 1 -- 172.21.15.134:0/991482847 shutdown_connections 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.931+0000 7f7fcf761700 1 -- 172.21.15.134:0/991482847 wait complete. 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcf761700 1 Processor -- start 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcf761700 1 -- start start 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcf761700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc80f5e70 0x7f7fc8106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcf761700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 0x7f7fc81073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcf761700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8107a00 con 0x7f7fc80f5e70 2024-03-12T16:05:37.935 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcf761700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7fc8107b40 con 0x7f7fc80f7070 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcccfc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 0x7f7fc81073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcccfc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 0x7f7fc81073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:33998/0 (socket says 172.21.15.134:33998) 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcccfc700 1 -- 172.21.15.134:0/1030382687 learned_addr learned my addr 172.21.15.134:0/1030382687 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcccfc700 1 -- 172.21.15.134:0/1030382687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc80f5e70 msgr2=0x7f7fc8106ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcccfc700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc80f5e70 0x7f7fc8106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcccfc700 1 -- 172.21.15.134:0/1030382687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fc4005040 con 0x7f7fc80f7070 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fcccfc700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 0x7f7fc81073c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7fc4013510 tx=0x7f7fc4009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.932+0000 7f7fbe7fc700 1 -- 172.21.15.134:0/1030382687 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc400e030 con 0x7f7fc80f7070 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.933+0000 7f7fbe7fc700 1 -- 172.21.15.134:0/1030382687 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7fc4007e90 con 0x7f7fc80f7070 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.933+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7fc810c580 con 0x7f7fc80f7070 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.933+0000 7f7fbe7fc700 1 -- 172.21.15.134:0/1030382687 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fc4018070 con 0x7f7fc80f7070 2024-03-12T16:05:37.936 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.933+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7fc810ca00 con 0x7f7fc80f7070 2024-03-12T16:05:37.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.934+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7fc80fe6d0 con 0x7f7fc80f7070 2024-03-12T16:05:37.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.934+0000 7f7fbe7fc700 1 -- 172.21.15.134:0/1030382687 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f7fc401da20 con 0x7f7fc80f7070 2024-03-12T16:05:37.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.934+0000 7f7fbe7fc700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fb4061160 0x7f7fb4063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:05:37.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.934+0000 7f7fbe7fc700 1 -- 172.21.15.134:0/1030382687 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(33..33 src has 1..33) v4 ==== 4103+0+0 (secure 0 0 0) 0x7f7fc407d8c0 con 0x7f7fc80f7070 2024-03-12T16:05:37.937 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.934+0000 7f7fcd4fd700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fb4061160 0x7f7fb4063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:05:37.938 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.935+0000 7f7fcd4fd700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fb4061160 0x7f7fb4063620 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7fb8009700 tx=0x7f7fb8006c30).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:05:37.940 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:37.939+0000 7f7fbe7fc700 1 -- 172.21.15.134:0/1030382687 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7fc4051dc0 con 0x7f7fc80f7070 2024-03-12T16:05:38.145 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:38.143+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}) v1 -- 0x7f7fc80fbb50 con 0x7f7fb4061160 2024-03-12T16:05:38.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:05:36.983807+0000 mgr.smithi006.kskdce (mgr.14196) 128 : cephadm [INF] Detected new or changed devices on smithi134 2024-03-12T16:05:38.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:05:36.991893+0000 mgr.smithi006.kskdce (mgr.14196) 129 : cephadm [INF] Adjusting osd_memory_target on smithi134 to 7473M 2024-03-12T16:05:38.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:37.006664+0000 mon.smithi006 (mon.0) 419 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:05:38.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:05:36.983807+0000 mgr.smithi006.kskdce (mgr.14196) 128 : cephadm [INF] Detected new or changed devices on smithi134 2024-03-12T16:05:38.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:05:36.991893+0000 mgr.smithi006.kskdce (mgr.14196) 129 : cephadm [INF] Adjusting osd_memory_target on smithi134 to 7473M 2024-03-12T16:05:38.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:37.006664+0000 mon.smithi006 (mon.0) 419 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:05:39.333 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:37.954385+0000 mgr.smithi006.kskdce (mgr.14196) 130 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:39.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:38.146041+0000 mgr.smithi006.kskdce (mgr.14196) 131 : audit [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:05:39.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:38.148455+0000 mon.smithi006 (mon.0) 420 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:05:39.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:38.151015+0000 mon.smithi006 (mon.0) 421 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:05:39.334 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:38.151828+0000 mon.smithi006 (mon.0) 422 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:37.954385+0000 mgr.smithi006.kskdce (mgr.14196) 130 : cluster [DBG] pgmap v110: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:38.146041+0000 mgr.smithi006.kskdce (mgr.14196) 131 : audit [DBG] from='client.24163 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi134:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:05:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:38.148455+0000 mon.smithi006 (mon.0) 420 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-03-12T16:05:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:38.151015+0000 mon.smithi006 (mon.0) 421 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-03-12T16:05:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:38.151828+0000 mon.smithi006 (mon.0) 422 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:41.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:39.954880+0000 mgr.smithi006.kskdce (mgr.14196) 132 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:41.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:39.954880+0000 mgr.smithi006.kskdce (mgr.14196) 132 : cluster [DBG] pgmap v111: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:42.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:41.288909+0000 mon.smithi134 (mon.1) 10 : audit [INF] from='client.? 172.21.15.134:0/745695996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02e056ee-a66a-4c23-a819-1e4c1e2d1236"}]: dispatch 2024-03-12T16:05:42.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:41.289500+0000 mon.smithi006 (mon.0) 423 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02e056ee-a66a-4c23-a819-1e4c1e2d1236"}]: dispatch 2024-03-12T16:05:42.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:41.294075+0000 mon.smithi006 (mon.0) 424 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02e056ee-a66a-4c23-a819-1e4c1e2d1236"}]': finished 2024-03-12T16:05:42.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:41.294131+0000 mon.smithi006 (mon.0) 425 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-03-12T16:05:42.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:41.294249+0000 mon.smithi006 (mon.0) 426 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:05:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:41.288909+0000 mon.smithi134 (mon.1) 10 : audit [INF] from='client.? 172.21.15.134:0/745695996' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02e056ee-a66a-4c23-a819-1e4c1e2d1236"}]: dispatch 2024-03-12T16:05:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:41.289500+0000 mon.smithi006 (mon.0) 423 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "02e056ee-a66a-4c23-a819-1e4c1e2d1236"}]: dispatch 2024-03-12T16:05:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:41.294075+0000 mon.smithi006 (mon.0) 424 : audit [INF] from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "02e056ee-a66a-4c23-a819-1e4c1e2d1236"}]': finished 2024-03-12T16:05:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:41.294131+0000 mon.smithi006 (mon.0) 425 : cluster [DBG] osdmap e34: 6 total, 5 up, 6 in 2024-03-12T16:05:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:41.294249+0000 mon.smithi006 (mon.0) 426 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:05:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:41.955224+0000 mgr.smithi006.kskdce (mgr.14196) 133 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:42.020745+0000 mon.smithi134 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.134:0/1867251018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:05:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:42.582624+0000 mon.smithi006 (mon.0) 427 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:42.583559+0000 mon.smithi006 (mon.0) 428 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:42.584427+0000 mon.smithi006 (mon.0) 429 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:05:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:42.589087+0000 mon.smithi006 (mon.0) 430 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:41.955224+0000 mgr.smithi006.kskdce (mgr.14196) 133 : cluster [DBG] pgmap v113: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:42.020745+0000 mon.smithi134 (mon.1) 11 : audit [DBG] from='client.? 172.21.15.134:0/1867251018' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-03-12T16:05:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:42.582624+0000 mon.smithi006 (mon.0) 427 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:42.583559+0000 mon.smithi006 (mon.0) 428 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:42.584427+0000 mon.smithi006 (mon.0) 429 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:05:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:42.589087+0000 mon.smithi006 (mon.0) 430 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:45.322 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:43.955654+0000 mgr.smithi006.kskdce (mgr.14196) 134 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:43.955654+0000 mgr.smithi006.kskdce (mgr.14196) 134 : cluster [DBG] pgmap v114: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:47.377 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:45.956054+0000 mgr.smithi006.kskdce (mgr.14196) 135 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:45.956054+0000 mgr.smithi006.kskdce (mgr.14196) 135 : cluster [DBG] pgmap v115: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:49.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:47.956532+0000 mgr.smithi006.kskdce (mgr.14196) 136 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:49.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:48.826963+0000 mon.smithi006 (mon.0) 431 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-12T16:05:49.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:48.827878+0000 mon.smithi006 (mon.0) 432 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:49.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:47.956532+0000 mgr.smithi006.kskdce (mgr.14196) 136 : cluster [DBG] pgmap v116: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:49.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:48.826963+0000 mon.smithi006 (mon.0) 431 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-12T16:05:49.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:48.827878+0000 mon.smithi006 (mon.0) 432 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:05:50.264 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:05:48.828639+0000 mgr.smithi006.kskdce (mgr.14196) 137 : cephadm [INF] Deploying daemon osd.5 on smithi134 2024-03-12T16:05:50.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:05:48.828639+0000 mgr.smithi006.kskdce (mgr.14196) 137 : cephadm [INF] Deploying daemon osd.5 on smithi134 2024-03-12T16:05:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:49.957006+0000 mgr.smithi006.kskdce (mgr.14196) 138 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:51.312 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:49.957006+0000 mgr.smithi006.kskdce (mgr.14196) 138 : cluster [DBG] pgmap v117: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:53.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:51.957321+0000 mgr.smithi006.kskdce (mgr.14196) 139 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:53.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:51.957321+0000 mgr.smithi006.kskdce (mgr.14196) 139 : cluster [DBG] pgmap v118: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:55.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:53.957738+0000 mgr.smithi006.kskdce (mgr.14196) 140 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:55.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:54.128132+0000 mon.smithi006 (mon.0) 433 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:55.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:54.137667+0000 mon.smithi006 (mon.0) 434 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:05:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:53.957738+0000 mgr.smithi006.kskdce (mgr.14196) 140 : cluster [DBG] pgmap v119: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:54.128132+0000 mon.smithi006 (mon.0) 433 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:54.137667+0000 mon.smithi006 (mon.0) 434 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:05:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:55.958198+0000 mgr.smithi006.kskdce (mgr.14196) 141 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:55.958198+0000 mgr.smithi006.kskdce (mgr.14196) 141 : cluster [DBG] pgmap v120: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:58.098 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.097+0000 7f7fbe7fc700 1 -- 172.21.15.134:0/1030382687 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+37 (secure 0 0 0) 0x7f7fc80fbb50 con 0x7f7fb4061160 2024-03-12T16:05:58.099 INFO:teuthology.orchestra.run.smithi134.stdout:Created osd(s) 5 on host 'smithi134' 2024-03-12T16:05:58.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fb4061160 msgr2=0x7f7fb4063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:58.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fb4061160 0x7f7fb4063620 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f7fb8009700 tx=0x7f7fb8006c30).stop 2024-03-12T16:05:58.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 msgr2=0x7f7fc81073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:05:58.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 0x7f7fc81073c0 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f7fc4013510 tx=0x7f7fc4009cb0).stop 2024-03-12T16:05:58.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 shutdown_connections 2024-03-12T16:05:58.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fb4061160 0x7f7fb4063620 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:58.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7fc80f5e70 0x7f7fc8106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:05:58.100 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 --2- 172.21.15.134:0/1030382687 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7fc80f7070 0x7f7fc81073c0 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:05:58.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 >> 172.21.15.134:0/1030382687 conn(0x7f7fc80f15d0 msgr2=0x7f7fc80fb440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:05:58.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.098+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 shutdown_connections 2024-03-12T16:05:58.101 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:05:58.099+0000 7f7fcf761700 1 -- 172.21.15.134:0/1030382687 wait complete. 2024-03-12T16:05:58.356 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:58.010024+0000 mon.smithi134 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-12T16:05:58.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:58.010674+0000 mon.smithi006 (mon.0) 435 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-12T16:05:58.357 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:58.096698+0000 mon.smithi006 (mon.0) 436 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:58.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:58.010024+0000 mon.smithi134 (mon.1) 12 : audit [INF] from='osd.5 [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-12T16:05:58.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:58.010674+0000 mon.smithi006 (mon.0) 435 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-12T16:05:58.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:58.096698+0000 mon.smithi006 (mon.0) 436 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:05:59.278 DEBUG:teuthology.orchestra.run.smithi134:osd.5> sudo journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.5.service 2024-03-12T16:05:59.280 INFO:tasks.cephadm:Waiting for 6 OSDs to come up... 2024-03-12T16:05:59.280 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd stat -f json 2024-03-12T16:05:59.310 INFO:journalctl@ceph.osd.5.smithi134.stdout:-- Logs begin at Tue 2024-03-12 15:47:40 UTC. -- 2024-03-12T16:05:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:57.958804+0000 mgr.smithi006.kskdce (mgr.14196) 142 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:58.140891+0000 mon.smithi006 (mon.0) 437 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-12T16:05:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:58.140951+0000 mon.smithi006 (mon.0) 438 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-03-12T16:05:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:58.141103+0000 mon.smithi006 (mon.0) 439 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:05:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:58.141447+0000 mon.smithi134 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:05:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:58.141832+0000 mon.smithi006 (mon.0) 440 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:57.958804+0000 mgr.smithi006.kskdce (mgr.14196) 142 : cluster [DBG] pgmap v121: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:05:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:58.140891+0000 mon.smithi006 (mon.0) 437 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-12T16:05:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:58.140951+0000 mon.smithi006 (mon.0) 438 : cluster [DBG] osdmap e35: 6 total, 5 up, 6 in 2024-03-12T16:05:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:58.141103+0000 mon.smithi006 (mon.0) 439 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:05:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:58.141447+0000 mon.smithi134 (mon.1) 13 : audit [INF] from='osd.5 [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:05:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:05:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:58.141832+0000 mon.smithi006 (mon.0) 440 : audit [INF] from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:06:00.448 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:59.142173+0000 mon.smithi006 (mon.0) 441 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-12T16:06:00.448 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:59.142239+0000 mon.smithi006 (mon.0) 442 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-03-12T16:06:00.448 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:59.142644+0000 mon.smithi006 (mon.0) 443 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:06:00.448 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:59.148936+0000 mon.smithi006 (mon.0) 444 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:06:00.448 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:05:59.845414+0000 mon.smithi006 (mon.0) 445 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:00.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:59.142173+0000 mon.smithi006 (mon.0) 441 : audit [INF] from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]': finished 2024-03-12T16:06:00.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:59.142239+0000 mon.smithi006 (mon.0) 442 : cluster [DBG] osdmap e36: 6 total, 5 up, 6 in 2024-03-12T16:06:00.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:59.142644+0000 mon.smithi006 (mon.0) 443 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:06:00.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:59.148936+0000 mon.smithi006 (mon.0) 444 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:06:00.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:05:59.845414+0000 mon.smithi006 (mon.0) 445 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:01.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 -- 172.21.15.6:0/1147860490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 msgr2=0x7fb2940f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 --2- 172.21.15.6:0/1147860490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 0x7fb2940f9110 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7fb2800047f0 tx=0x7fb280009cb0).stop 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 -- 172.21.15.6:0/1147860490 shutdown_connections 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 --2- 172.21.15.6:0/1147860490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 0x7fb2940f9110 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 --2- 172.21.15.6:0/1147860490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940f7a10 0x7fb2940f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 -- 172.21.15.6:0/1147860490 >> 172.21.15.6:0/1147860490 conn(0x7fb2940f3150 msgr2=0x7fb2940f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 -- 172.21.15.6:0/1147860490 shutdown_connections 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 -- 172.21.15.6:0/1147860490 wait complete. 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 Processor -- start 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 -- start start 2024-03-12T16:06:01.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940f7a10 0x7fb294108270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 0x7fb294108760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294108d10 con 0x7fb2940f8cb0 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.284+0000 7fb29ac27700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb294108e50 con 0x7fb2940f7a10 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb293fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 0x7fb294108760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb293fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 0x7fb294108760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38076/0 (socket says 172.21.15.6:38076) 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb293fff700 1 -- 172.21.15.6:0/3871750259 learned_addr learned my addr 172.21.15.6:0/3871750259 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb2989c3700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940f7a10 0x7fb294108270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb293fff700 1 -- 172.21.15.6:0/3871750259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940f7a10 msgr2=0x7fb294108270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb293fff700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940f7a10 0x7fb294108270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb293fff700 1 -- 172.21.15.6:0/3871750259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb280005040 con 0x7fb2940f8cb0 2024-03-12T16:06:01.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb293fff700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 0x7fb294108760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb280013580 tx=0x7fb280009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:01.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb291ffb700 1 -- 172.21.15.6:0/3871750259 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb280018070 con 0x7fb2940f8cb0 2024-03-12T16:06:01.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb291ffb700 1 -- 172.21.15.6:0/3871750259 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb280007e90 con 0x7fb2940f8cb0 2024-03-12T16:06:01.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb29410d890 con 0x7fb2940f8cb0 2024-03-12T16:06:01.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb291ffb700 1 -- 172.21.15.6:0/3871750259 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb2800123c0 con 0x7fb2940f8cb0 2024-03-12T16:06:01.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.285+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb29410de50 con 0x7fb2940f8cb0 2024-03-12T16:06:01.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.286+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb29405fb50 con 0x7fb2940f8cb0 2024-03-12T16:06:01.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.287+0000 7fb291ffb700 1 -- 172.21.15.6:0/3871750259 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fb28001d420 con 0x7fb2940f8cb0 2024-03-12T16:06:01.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.288+0000 7fb291ffb700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb284061180 0x7fb284063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:01.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.288+0000 7fb291ffb700 1 -- 172.21.15.6:0/3871750259 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(37..37 src has 1..37) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fb28007d6f0 con 0x7fb2940f8cb0 2024-03-12T16:06:01.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.288+0000 7fb2989c3700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb284061180 0x7fb284063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:01.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.288+0000 7fb2989c3700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb284061180 0x7fb284063640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb2940f8b10 tx=0x7fb28800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:01.293 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.292+0000 7fb291ffb700 1 -- 172.21.15.6:0/3871750259 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb2800519a0 con 0x7fb2940f8cb0 2024-03-12T16:06:01.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:58.981400+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:06:01.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:58.981488+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:06:01.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:05:59.959258+0000 mgr.smithi006.kskdce (mgr.14196) 143 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:06:01.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:00.151940+0000 mon.smithi006 (mon.0) 446 : cluster [INF] osd.5 [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] boot 2024-03-12T16:06:01.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:00.151986+0000 mon.smithi006 (mon.0) 447 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-03-12T16:06:01.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:00.152886+0000 mon.smithi006 (mon.0) 448 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:06:01.391 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:58.981400+0000 osd.5 (osd.5) 1 : cluster [DBG] purged_snaps scrub starts 2024-03-12T16:06:01.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:58.981488+0000 osd.5 (osd.5) 2 : cluster [DBG] purged_snaps scrub ok 2024-03-12T16:06:01.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:05:59.959258+0000 mgr.smithi006.kskdce (mgr.14196) 143 : cluster [DBG] pgmap v124: 1 pgs: 1 active+clean; 0 B data, 1.4 GiB used, 446 GiB / 447 GiB avail 2024-03-12T16:06:01.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:00.151940+0000 mon.smithi006 (mon.0) 446 : cluster [INF] osd.5 [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] boot 2024-03-12T16:06:01.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:00.151986+0000 mon.smithi006 (mon.0) 447 : cluster [DBG] osdmap e37: 6 total, 6 up, 6 in 2024-03-12T16:06:01.392 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:00.152886+0000 mon.smithi006 (mon.0) 448 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:06:01.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.464+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd stat", "format": "json"} v 0) v1 -- 0x7fb2941021c0 con 0x7fb2940f8cb0 2024-03-12T16:06:01.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.464+0000 7fb291ffb700 1 -- 172.21.15.6:0/3871750259 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd stat", "format": "json"}]=0 v37) v1 ==== 74+0+130 (secure 0 0 0) 0x7fb280051e60 con 0x7fb2940f8cb0 2024-03-12T16:06:01.467 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:06:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb284061180 msgr2=0x7fb284063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:01.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb284061180 0x7fb284063640 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fb2940f8b10 tx=0x7fb28800b040).stop 2024-03-12T16:06:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 msgr2=0x7fb294108760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 0x7fb294108760 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7fb280013580 tx=0x7fb280009cb0).stop 2024-03-12T16:06:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 shutdown_connections 2024-03-12T16:06:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb284061180 0x7fb284063640 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940f7a10 0x7fb294108270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 --2- 172.21.15.6:0/3871750259 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940f8cb0 0x7fb294108760 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 >> 172.21.15.6:0/3871750259 conn(0x7fb2940f3150 msgr2=0x7fb2940fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 shutdown_connections 2024-03-12T16:06:01.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:01.466+0000 7fb29ac27700 1 -- 172.21.15.6:0/3871750259 wait complete. 2024-03-12T16:06:02.093 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":37,"num_osds":6,"num_up_osds":6,"osd_up_since":1710259560,"num_in_osds":6,"osd_in_since":1710259541,"num_remapped_pgs":0} 2024-03-12T16:06:02.093 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd dump --format=json 2024-03-12T16:06:02.378 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:02.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:01.465975+0000 mon.smithi006 (mon.0) 449 : audit [DBG] from='client.? 172.21.15.6:0/3871750259' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-12T16:06:02.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:01.848749+0000 mon.smithi006 (mon.0) 450 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-03-12T16:06:02.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:01.465975+0000 mon.smithi006 (mon.0) 449 : audit [DBG] from='client.? 172.21.15.6:0/3871750259' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-03-12T16:06:02.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:01.848749+0000 mon.smithi006 (mon.0) 450 : cluster [DBG] osdmap e38: 6 total, 6 up, 6 in 2024-03-12T16:06:03.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:01.959682+0000 mgr.smithi006.kskdce (mgr.14196) 144 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:03.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:01.959682+0000 mgr.smithi006.kskdce (mgr.14196) 144 : cluster [DBG] pgmap v127: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.184+0000 7f31cf174700 1 -- 172.21.15.6:0/1595052410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f7b40 msgr2=0x7f31c80f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.184+0000 7f31cf174700 1 --2- 172.21.15.6:0/1595052410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f7b40 0x7f31c80f7fa0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7f31b40047f0 tx=0x7f31b4009cb0).stop 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.184+0000 7f31cf174700 1 -- 172.21.15.6:0/1595052410 shutdown_connections 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.184+0000 7f31cf174700 1 --2- 172.21.15.6:0/1595052410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f7b40 0x7f31c80f7fa0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.184+0000 7f31cf174700 1 --2- 172.21.15.6:0/1595052410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31c80f68a0 0x7f31c80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.184+0000 7f31cf174700 1 -- 172.21.15.6:0/1595052410 >> 172.21.15.6:0/1595052410 conn(0x7f31c80f2020 msgr2=0x7f31c80f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.184+0000 7f31cf174700 1 -- 172.21.15.6:0/1595052410 shutdown_connections 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.184+0000 7f31cf174700 1 -- 172.21.15.6:0/1595052410 wait complete. 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.184+0000 7f31cf174700 1 Processor -- start 2024-03-12T16:06:04.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31cf174700 1 -- start start 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31cf174700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f68a0 0x7f31c810a340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31cf174700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31c80f7b40 0x7f31c810a830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31cf174700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c810ae70 con 0x7f31c80f68a0 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31cf174700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31c810afb0 con 0x7f31c80f7b40 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31ccf10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f68a0 0x7f31c810a340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31ccf10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f68a0 0x7f31c810a340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49806/0 (socket says 172.21.15.6:49806) 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31ccf10700 1 -- 172.21.15.6:0/3955524019 learned_addr learned my addr 172.21.15.6:0/3955524019 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31c7fff700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31c80f7b40 0x7f31c810a830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31ccf10700 1 -- 172.21.15.6:0/3955524019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31c80f7b40 msgr2=0x7f31c810a830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31ccf10700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31c80f7b40 0x7f31c810a830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31ccf10700 1 -- 172.21.15.6:0/3955524019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31b4005040 con 0x7f31c80f68a0 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31c7fff700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31c80f7b40 0x7f31c810a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31ccf10700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f68a0 0x7f31c810a340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f31bc00b480 tx=0x7f31bc0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:04.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.185+0000 7f31c5ffb700 1 -- 172.21.15.6:0/3955524019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31bc002500 con 0x7f31c80f68a0 2024-03-12T16:06:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.186+0000 7f31c5ffb700 1 -- 172.21.15.6:0/3955524019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f31bc002af0 con 0x7f31c80f68a0 2024-03-12T16:06:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.186+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31c810fa50 con 0x7f31c80f68a0 2024-03-12T16:06:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.186+0000 7f31c5ffb700 1 -- 172.21.15.6:0/3955524019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31bc012c40 con 0x7f31c80f68a0 2024-03-12T16:06:04.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.186+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31c810ff90 con 0x7f31c80f68a0 2024-03-12T16:06:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.187+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31c80ff090 con 0x7f31c80f68a0 2024-03-12T16:06:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.187+0000 7f31c5ffb700 1 -- 172.21.15.6:0/3955524019 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f31bc002660 con 0x7f31c80f68a0 2024-03-12T16:06:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.187+0000 7f31c5ffb700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f31b8061180 0x7f31b8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.188+0000 7f31c5ffb700 1 -- 172.21.15.6:0/3955524019 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f31bc07c5f0 con 0x7f31c80f68a0 2024-03-12T16:06:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.188+0000 7f31c7fff700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f31b8061180 0x7f31b8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:04.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.188+0000 7f31c7fff700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f31b8061180 0x7f31b8063640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f31b4013470 tx=0x7f31b400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:04.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.192+0000 7f31c5ffb700 1 -- 172.21.15.6:0/3955524019 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f31bc0508c0 con 0x7f31c80f68a0 2024-03-12T16:06:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.363+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f31c8110600 con 0x7f31c80f68a0 2024-03-12T16:06:04.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.363+0000 7f31c5ffb700 1 -- 172.21.15.6:0/3955524019 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10840 (secure 0 0 0) 0x7f31bc0504b0 con 0x7f31c80f68a0 2024-03-12T16:06:04.366 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:06:04.366 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","created":"2024-03-12T16:00:42.612784+0000","modified":"2024-03-12T16:06:01.845065+0000","last_up_change":"2024-03-12T16:06:00.146006+0000","last_in_change":"2024-03-12T16:05:41.290069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-12T16:04:29.453605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"81b3ff11-3d87-4f3b-a302-c8c55f378ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6803","nonce":782473340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6805","nonce":782473340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6809","nonce":782473340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6807","nonce":782473340}]},"public_addr":"172.21.15.6:6803/782473340","cluster_addr":"172.21.15.6:6805/782473340","heartbeat_back_addr":"172.21.15.6:6809/782473340","heartbeat_front_addr":"172.21.15.6:6807/782473340","state":["exists","up"]},{"osd":1,"uuid":"e638e6a3-7dc0-47f6-8901-1bdb1c208583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6811","nonce":464707515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6813","nonce":464707515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6817","nonce":464707515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6815","nonce":464707515}]},"public_addr":"172.21.15.6:6811/464707515","cluster_addr":"172.21.15.6:6813/464707515","heartbeat_back_addr":"172.21.15.6:6817/464707515","heartbeat_front_addr":"172.21.15.6:6815/464707515","state":["exists","up"]},{"osd":2,"uuid":"45eed951-90a9-4fe0-a184-11b5e1ebe46d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6819","nonce":2037091558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6821","nonce":2037091558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6825","nonce":2037091558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6823","nonce":2037091558}]},"public_addr":"172.21.15.6:6819/2037091558","cluster_addr":"172.21.15.6:6821/2037091558","heartbeat_back_addr":"172.21.15.6:6825/2037091558","heartbeat_front_addr":"172.21.15.6:6823/2037091558","state":["exists","up"]},{"osd":3,"uuid":"47d2f20b-d7b8-4d67-905c-af29938d36d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6801","nonce":641287556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6803","nonce":641287556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6807","nonce":641287556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6805","nonce":641287556}]},"public_addr":"172.21.15.134:6801/641287556","cluster_addr":"172.21.15.134:6803/641287556","heartbeat_back_addr":"172.21.15.134:6807/641287556","heartbeat_front_addr":"172.21.15.134:6805/641287556","state":["exists","up"]},{"osd":4,"uuid":"bfe8b5a1-489a-458d-ba30-5d1bada0c33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6809","nonce":1907759631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6811","nonce":1907759631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6815","nonce":1907759631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6813","nonce":1907759631}]},"public_addr":"172.21.15.134:6809/1907759631","cluster_addr":"172.21.15.134:6811/1907759631","heartbeat_back_addr":"172.21.15.134:6815/1907759631","heartbeat_front_addr":"172.21.15.134:6813/1907759631","state":["exists","up"]},{"osd":5,"uuid":"02e056ee-a66a-4c23-a819-1e4c1e2d1236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6817","nonce":876055595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6819","nonce":876055595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6823","nonce":876055595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6821","nonce":876055595}]},"public_addr":"172.21.15.134:6817/876055595","cluster_addr":"172.21.15.134:6819/876055595","heartbeat_back_addr":"172.21.15.134:6823/876055595","heartbeat_front_addr":"172.21.15.134:6821/876055595","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:35.977637+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:59.443373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:04:27.106208+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:02.955636+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:30.634685+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:58.981490+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4212806006":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/687610333":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/3228405447":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:6801/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/179696865":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/1637754840":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4255668203":"2024-03-13T16:01:12.726451+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T16:06:04.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f31b8061180 msgr2=0x7f31b8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f31b8061180 0x7f31b8063640 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f31b4013470 tx=0x7f31b400b040).stop 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f68a0 msgr2=0x7f31c810a340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f68a0 0x7f31c810a340 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7f31bc00b480 tx=0x7f31bc0090f0).stop 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 shutdown_connections 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f31b8061180 0x7f31b8063640 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31c80f68a0 0x7f31c810a340 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 --2- 172.21.15.6:0/3955524019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31c80f7b40 0x7f31c810a830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 >> 172.21.15.6:0/3955524019 conn(0x7f31c80f2020 msgr2=0x7f31c8061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.365+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 shutdown_connections 2024-03-12T16:06:04.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:04.366+0000 7f31cf174700 1 -- 172.21.15.6:0/3955524019 wait complete. 2024-03-12T16:06:04.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:06:03.362067+0000 mgr.smithi006.kskdce (mgr.14196) 145 : cephadm [INF] Detected new or changed devices on smithi134 2024-03-12T16:06:04.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.367264+0000 mon.smithi006 (mon.0) 451 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:04.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.368209+0000 mon.smithi006 (mon.0) 452 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:06:04.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.368941+0000 mon.smithi006 (mon.0) 453 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:06:04.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.369616+0000 mon.smithi006 (mon.0) 454 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:06:04.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:06:03.370118+0000 mgr.smithi006.kskdce (mgr.14196) 146 : cephadm [INF] Adjusting osd_memory_target on smithi134 to 4982M 2024-03-12T16:06:04.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.373552+0000 mon.smithi006 (mon.0) 455 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:04.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.374379+0000 mon.smithi006 (mon.0) 456 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:06:04.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.375097+0000 mon.smithi006 (mon.0) 457 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:06:04.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.380934+0000 mon.smithi006 (mon.0) 458 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:04.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.385000+0000 mon.smithi006 (mon.0) 459 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:06:04.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.386364+0000 mon.smithi006 (mon.0) 460 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:06:04.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.387007+0000 mon.smithi006 (mon.0) 461 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:06:04.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:03.390875+0000 mon.smithi006 (mon.0) 462 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:04.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:03.960030+0000 mgr.smithi006.kskdce (mgr.14196) 147 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:04.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:06:03.362067+0000 mgr.smithi006.kskdce (mgr.14196) 145 : cephadm [INF] Detected new or changed devices on smithi134 2024-03-12T16:06:04.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.367264+0000 mon.smithi006 (mon.0) 451 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:04.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.368209+0000 mon.smithi006 (mon.0) 452 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:06:04.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.368941+0000 mon.smithi006 (mon.0) 453 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:06:04.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.369616+0000 mon.smithi006 (mon.0) 454 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:06:04.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:06:03.370118+0000 mgr.smithi006.kskdce (mgr.14196) 146 : cephadm [INF] Adjusting osd_memory_target on smithi134 to 4982M 2024-03-12T16:06:04.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.373552+0000 mon.smithi006 (mon.0) 455 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:04.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.374379+0000 mon.smithi006 (mon.0) 456 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:06:04.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.375097+0000 mon.smithi006 (mon.0) 457 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:06:04.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.380934+0000 mon.smithi006 (mon.0) 458 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:04.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.385000+0000 mon.smithi006 (mon.0) 459 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:06:04.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.386364+0000 mon.smithi006 (mon.0) 460 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:06:04.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.387007+0000 mon.smithi006 (mon.0) 461 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:06:04.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:03.390875+0000 mon.smithi006 (mon.0) 462 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:06:04.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:03.960030+0000 mgr.smithi006.kskdce (mgr.14196) 147 : cluster [DBG] pgmap v128: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:05.117 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-03-12T16:04:29.453605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}] 2024-03-12T16:06:05.118 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd pool get device_health_metrics pg_num 2024-03-12T16:06:05.370 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:04.364803+0000 mon.smithi006 (mon.0) 463 : audit [DBG] from='client.? 172.21.15.6:0/3955524019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:06:05.400 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:05.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:04.364803+0000 mon.smithi006 (mon.0) 463 : audit [DBG] from='client.? 172.21.15.6:0/3955524019' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:06:06.675 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:05.960524+0000 mgr.smithi006.kskdce (mgr.14196) 148 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:06.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:05.960524+0000 mgr.smithi006.kskdce (mgr.14196) 148 : cluster [DBG] pgmap v129: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:07.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2697715060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 msgr2=0x7fb9a40f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 --2- 172.21.15.6:0/2697715060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 0x7fb9a40f7fa0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7fb9900047f0 tx=0x7fb990009cb0).stop 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2697715060 shutdown_connections 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 --2- 172.21.15.6:0/2697715060 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 0x7fb9a40f7fa0 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 --2- 172.21.15.6:0/2697715060 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a40f68a0 0x7fb9a40f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2697715060 >> 172.21.15.6:0/2697715060 conn(0x7fb9a40f2020 msgr2=0x7fb9a40f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2697715060 shutdown_connections 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2697715060 wait complete. 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 Processor -- start 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.237+0000 7fb9ab16b700 1 -- start start 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9ab16b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a40f68a0 0x7fb9a4108040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9ab16b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 0x7fb9a4108530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9ab16b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4108ae0 con 0x7fb9a40f7b40 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9ab16b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb9a4108c20 con 0x7fb9a40f68a0 2024-03-12T16:06:07.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 0x7fb9a4108530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 0x7fb9a4108530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49820/0 (socket says 172.21.15.6:49820) 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a3fff700 1 -- 172.21.15.6:0/2844185543 learned_addr learned my addr 172.21.15.6:0/2844185543 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a8f07700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a40f68a0 0x7fb9a4108040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a3fff700 1 -- 172.21.15.6:0/2844185543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a40f68a0 msgr2=0x7fb9a4108040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a3fff700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a40f68a0 0x7fb9a4108040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a3fff700 1 -- 172.21.15.6:0/2844185543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb990005040 con 0x7fb9a40f7b40 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a3fff700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 0x7fb9a4108530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb990013470 tx=0x7fb990009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a1ffb700 1 -- 172.21.15.6:0/2844185543 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb99000e030 con 0x7fb9a40f7b40 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb9a410d660 con 0x7fb9a40f7b40 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a1ffb700 1 -- 172.21.15.6:0/2844185543 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb990007e90 con 0x7fb9a40f7b40 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.238+0000 7fb9a1ffb700 1 -- 172.21.15.6:0/2844185543 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb990018070 con 0x7fb9a40f7b40 2024-03-12T16:06:07.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.239+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb9a410dba0 con 0x7fb9a40f7b40 2024-03-12T16:06:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.240+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb9a40feff0 con 0x7fb9a40f7b40 2024-03-12T16:06:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.240+0000 7fb9a1ffb700 1 -- 172.21.15.6:0/2844185543 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fb99001d420 con 0x7fb9a40f7b40 2024-03-12T16:06:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.240+0000 7fb9a1ffb700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb994061110 0x7fb9940635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.240+0000 7fb9a1ffb700 1 -- 172.21.15.6:0/2844185543 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fb99007d950 con 0x7fb9a40f7b40 2024-03-12T16:06:07.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.240+0000 7fb9a8f07700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb994061110 0x7fb9940635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:07.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.241+0000 7fb9a8f07700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb994061110 0x7fb9940635d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb9a40f79a0 tx=0x7fb99800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:07.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.245+0000 7fb9a1ffb700 1 -- 172.21.15.6:0/2844185543 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb990051c20 con 0x7fb9a40f7b40 2024-03-12T16:06:07.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.415+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7fb9a410e2f0 con 0x7fb9a40f7b40 2024-03-12T16:06:07.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.416+0000 7fb9a1ffb700 1 -- 172.21.15.6:0/2844185543 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v38) v1 ==== 110+0+10 (secure 0 0 0) 0x7fb990051810 con 0x7fb9a40f7b40 2024-03-12T16:06:07.418 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.417+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb994061110 msgr2=0x7fb9940635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.417+0000 7fb9ab16b700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb994061110 0x7fb9940635d0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb9a40f79a0 tx=0x7fb99800b040).stop 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.418+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 msgr2=0x7fb9a4108530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.418+0000 7fb9ab16b700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 0x7fb9a4108530 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7fb990013470 tx=0x7fb990009cb0).stop 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.418+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 shutdown_connections 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.418+0000 7fb9ab16b700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb994061110 0x7fb9940635d0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.418+0000 7fb9ab16b700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9a40f68a0 0x7fb9a4108040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.418+0000 7fb9ab16b700 1 --2- 172.21.15.6:0/2844185543 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9a40f7b40 0x7fb9a4108530 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.418+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 >> 172.21.15.6:0/2844185543 conn(0x7fb9a40f2020 msgr2=0x7fb9a4061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.418+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 shutdown_connections 2024-03-12T16:06:07.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:07.418+0000 7fb9ab16b700 1 -- 172.21.15.6:0/2844185543 wait complete. 2024-03-12T16:06:07.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:07.417545+0000 mon.smithi006 (mon.0) 464 : audit [DBG] from='client.? 172.21.15.6:0/2844185543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-03-12T16:06:07.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:07.417545+0000 mon.smithi006 (mon.0) 464 : audit [DBG] from='client.? 172.21.15.6:0/2844185543' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-03-12T16:06:08.240 INFO:tasks.cephadm:Setting up client nodes... 2024-03-12T16:06:08.240 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-12T16:06:08.734 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:07.960842+0000 mgr.smithi006.kskdce (mgr.14196) 149 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:08.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:07.960842+0000 mgr.smithi006.kskdce (mgr.14196) 149 : cluster [DBG] pgmap v130: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.248+0000 7f4e3f495700 1 -- 172.21.15.6:0/3937443462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f8cb0 msgr2=0x7f4e380f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.248+0000 7f4e3f495700 1 --2- 172.21.15.6:0/3937443462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f8cb0 0x7f4e380f9110 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f4e340047f0 tx=0x7f4e34009cb0).stop 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.248+0000 7f4e3f495700 1 -- 172.21.15.6:0/3937443462 shutdown_connections 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.248+0000 7f4e3f495700 1 --2- 172.21.15.6:0/3937443462 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f8cb0 0x7f4e380f9110 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.248+0000 7f4e3f495700 1 --2- 172.21.15.6:0/3937443462 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380f7a10 0x7f4e380f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.248+0000 7f4e3f495700 1 -- 172.21.15.6:0/3937443462 >> 172.21.15.6:0/3937443462 conn(0x7f4e380f3150 msgr2=0x7f4e380f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.248+0000 7f4e3f495700 1 -- 172.21.15.6:0/3937443462 shutdown_connections 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.248+0000 7f4e3f495700 1 -- 172.21.15.6:0/3937443462 wait complete. 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3f495700 1 Processor -- start 2024-03-12T16:06:10.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3f495700 1 -- start start 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3f495700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f7a10 0x7f4e3806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3f495700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380f8cb0 0x7f4e3806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3f495700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3806cf80 con 0x7f4e380f7a10 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3f495700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e3806b520 con 0x7f4e380f8cb0 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3d231700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f7a10 0x7f4e3806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3d231700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f7a10 0x7f4e3806c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49834/0 (socket says 172.21.15.6:49834) 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3d231700 1 -- 172.21.15.6:0/3985531842 learned_addr learned my addr 172.21.15.6:0/3985531842 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3ca30700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380f8cb0 0x7f4e3806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3d231700 1 -- 172.21.15.6:0/3985531842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380f8cb0 msgr2=0x7f4e3806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3d231700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380f8cb0 0x7f4e3806b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3d231700 1 -- 172.21.15.6:0/3985531842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e34005040 con 0x7f4e380f7a10 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.249+0000 7f4e3d231700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f7a10 0x7f4e3806c9d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f4e28002820 tx=0x7f4e28009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.250+0000 7f4e2e7fc700 1 -- 172.21.15.6:0/3985531842 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e28002d60 con 0x7f4e380f7a10 2024-03-12T16:06:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.250+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e3806b7a0 con 0x7f4e380f7a10 2024-03-12T16:06:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.250+0000 7f4e2e7fc700 1 -- 172.21.15.6:0/3985531842 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4e2800f040 con 0x7f4e380f7a10 2024-03-12T16:06:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.250+0000 7f4e2e7fc700 1 -- 172.21.15.6:0/3985531842 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e2800d820 con 0x7f4e380f7a10 2024-03-12T16:06:10.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.250+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e3806bce0 con 0x7f4e380f7a10 2024-03-12T16:06:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.251+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e3805fb50 con 0x7f4e380f7a10 2024-03-12T16:06:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.251+0000 7f4e2e7fc700 1 -- 172.21.15.6:0/3985531842 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f4e280092f0 con 0x7f4e380f7a10 2024-03-12T16:06:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.251+0000 7f4e2e7fc700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e24061180 0x7f4e24063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.252+0000 7f4e2e7fc700 1 -- 172.21.15.6:0/3985531842 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f4e2807c160 con 0x7f4e380f7a10 2024-03-12T16:06:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.252+0000 7f4e3ca30700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e24061180 0x7f4e24063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:10.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.252+0000 7f4e3ca30700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e24061180 0x7f4e24063640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4e34004f10 tx=0x7f4e3400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:10.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.256+0000 7f4e2e7fc700 1 -- 172.21.15.6:0/3985531842 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4e28050430 con 0x7f4e380f7a10 2024-03-12T16:06:10.497 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.494+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7f4e380008d0 con 0x7f4e380f7a10 2024-03-12T16:06:10.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.498+0000 7f4e2e7fc700 1 -- 172.21.15.6:0/3985531842 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v14) v1 ==== 170+0+59 (secure 0 0 0) 0x7f4e28050020 con 0x7f4e380f7a10 2024-03-12T16:06:10.500 INFO:teuthology.orchestra.run.smithi006.stdout:[client.0] 2024-03-12T16:06:10.500 INFO:teuthology.orchestra.run.smithi006.stdout: key = AQByffBlFB+bHRAA78Cpv9eGqFEBFXllbAHeSQ== 2024-03-12T16:06:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e24061180 msgr2=0x7f4e24063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e24061180 0x7f4e24063640 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f4e34004f10 tx=0x7f4e3400b040).stop 2024-03-12T16:06:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f7a10 msgr2=0x7f4e3806c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f7a10 0x7f4e3806c9d0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f4e28002820 tx=0x7f4e28009f00).stop 2024-03-12T16:06:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 shutdown_connections 2024-03-12T16:06:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e24061180 0x7f4e24063640 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:10.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e380f7a10 0x7f4e3806c9d0 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 --2- 172.21.15.6:0/3985531842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e380f8cb0 0x7f4e3806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 >> 172.21.15.6:0/3985531842 conn(0x7f4e380f3150 msgr2=0x7f4e380fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 shutdown_connections 2024-03-12T16:06:10.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:10.500+0000 7f4e3f495700 1 -- 172.21.15.6:0/3985531842 wait complete. 2024-03-12T16:06:11.104 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:09.961241+0000 mgr.smithi006.kskdce (mgr.14196) 150 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:11.104 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:10.496557+0000 mon.smithi006 (mon.0) 465 : audit [INF] from='client.? 172.21.15.6:0/3985531842' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-12T16:06:11.104 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:10.499794+0000 mon.smithi006 (mon.0) 466 : audit [INF] from='client.? 172.21.15.6:0/3985531842' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-12T16:06:11.123 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:06:11.123 DEBUG:teuthology.orchestra.run.smithi006:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-03-12T16:06:11.124 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-03-12T16:06:11.166 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-03-12T16:06:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:09.961241+0000 mgr.smithi006.kskdce (mgr.14196) 150 : cluster [DBG] pgmap v131: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:10.496557+0000 mon.smithi006 (mon.0) 465 : audit [INF] from='client.? 172.21.15.6:0/3985531842' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-12T16:06:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:10.499794+0000 mon.smithi006 (mon.0) 466 : audit [INF] from='client.? 172.21.15.6:0/3985531842' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-12T16:06:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.230+0000 7efd69431700 1 -- 172.21.15.134:0/3240297187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 msgr2=0x7efd640f7a20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:13.233 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.230+0000 7efd69431700 1 --2- 172.21.15.134:0/3240297187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 0x7efd640f7a20 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7efd4c0047f0 tx=0x7efd4c009cb0).stop 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.230+0000 7efd69431700 1 -- 172.21.15.134:0/3240297187 shutdown_connections 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.230+0000 7efd69431700 1 --2- 172.21.15.134:0/3240297187 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 0x7efd640f7a20 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.230+0000 7efd69431700 1 --2- 172.21.15.134:0/3240297187 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd640f66e0 0x7efd640f6b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.230+0000 7efd69431700 1 -- 172.21.15.134:0/3240297187 >> 172.21.15.134:0/3240297187 conn(0x7efd640f1ee0 msgr2=0x7efd640f4300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.230+0000 7efd69431700 1 -- 172.21.15.134:0/3240297187 shutdown_connections 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.230+0000 7efd69431700 1 -- 172.21.15.134:0/3240297187 wait complete. 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.230+0000 7efd69431700 1 Processor -- start 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd69431700 1 -- start start 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd69431700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd640f66e0 0x7efd64106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd69431700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 0x7efd641073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd69431700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64107a00 con 0x7efd640f66e0 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd69431700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efd64107b40 con 0x7efd640f6ff0 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd627fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 0x7efd641073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:13.234 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd627fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 0x7efd641073c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.134:38824/0 (socket says 172.21.15.134:38824) 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd627fc700 1 -- 172.21.15.134:0/1029899212 learned_addr learned my addr 172.21.15.134:0/1029899212 (peer_addr_for_me v2:172.21.15.134:0/0) 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd62ffd700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd640f66e0 0x7efd64106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd627fc700 1 -- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd640f66e0 msgr2=0x7efd64106ed0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd627fc700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd640f66e0 0x7efd64106ed0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd627fc700 1 -- 172.21.15.134:0/1029899212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efd4c005040 con 0x7efd640f6ff0 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd62ffd700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd640f66e0 0x7efd64106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.231+0000 7efd627fc700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 0x7efd641073c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efd4c013510 tx=0x7efd4c009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.232+0000 7efd5bfff700 1 -- 172.21.15.134:0/1029899212 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4c00e030 con 0x7efd640f6ff0 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.232+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efd6410c580 con 0x7efd640f6ff0 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.232+0000 7efd5bfff700 1 -- 172.21.15.134:0/1029899212 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7efd4c007e90 con 0x7efd640f6ff0 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.232+0000 7efd5bfff700 1 -- 172.21.15.134:0/1029899212 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efd4c018070 con 0x7efd640f6ff0 2024-03-12T16:06:13.235 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.232+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efd6410ca00 con 0x7efd640f6ff0 2024-03-12T16:06:13.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.233+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efd640fef50 con 0x7efd640f6ff0 2024-03-12T16:06:13.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.233+0000 7efd5bfff700 1 -- 172.21.15.134:0/1029899212 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7efd4c01c780 con 0x7efd640f6ff0 2024-03-12T16:06:13.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.233+0000 7efd5bfff700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efd50061110 0x7efd500635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:13.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.233+0000 7efd5bfff700 1 -- 172.21.15.134:0/1029899212 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7efd4c07db30 con 0x7efd640f6ff0 2024-03-12T16:06:13.236 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.233+0000 7efd62ffd700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efd50061110 0x7efd500635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:13.237 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.234+0000 7efd62ffd700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efd50061110 0x7efd500635d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efd5c001370 tx=0x7efd5c0096a0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:13.239 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.237+0000 7efd5bfff700 1 -- 172.21.15.134:0/1029899212 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7efd4c051e00 con 0x7efd640f6ff0 2024-03-12T16:06:13.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:11.961714+0000 mgr.smithi006.kskdce (mgr.14196) 151 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:11.961714+0000 mgr.smithi006.kskdce (mgr.14196) 151 : cluster [DBG] pgmap v132: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:13.459 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.457+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]} v 0) v1 -- 0x7efd64059a80 con 0x7efd640f6ff0 2024-03-12T16:06:13.464 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.463+0000 7efd5bfff700 1 -- 172.21.15.134:0/1029899212 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]=0 v15) v1 ==== 170+0+59 (secure 0 0 0) 0x7efd4c009870 con 0x7efd640f6ff0 2024-03-12T16:06:13.464 INFO:teuthology.orchestra.run.smithi134.stdout:[client.1] 2024-03-12T16:06:13.464 INFO:teuthology.orchestra.run.smithi134.stdout: key = AQB1ffBlqRdqGxAAUaV7fKv3FzuC9qfsLq7I5A== 2024-03-12T16:06:13.466 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.464+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efd50061110 msgr2=0x7efd500635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.464+0000 7efd69431700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efd50061110 0x7efd500635d0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7efd5c001370 tx=0x7efd5c0096a0).stop 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.464+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 msgr2=0x7efd641073c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.464+0000 7efd69431700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 0x7efd641073c0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7efd4c013510 tx=0x7efd4c009cb0).stop 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.465+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 shutdown_connections 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.465+0000 7efd69431700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efd50061110 0x7efd500635d0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.465+0000 7efd69431700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efd640f66e0 0x7efd64106ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.465+0000 7efd69431700 1 --2- 172.21.15.134:0/1029899212 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efd640f6ff0 0x7efd641073c0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.465+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 >> 172.21.15.134:0/1029899212 conn(0x7efd640f1ee0 msgr2=0x7efd640fb470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.465+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 shutdown_connections 2024-03-12T16:06:13.467 INFO:teuthology.orchestra.run.smithi134.stderr:2024-03-12T16:06:13.465+0000 7efd69431700 1 -- 172.21.15.134:0/1029899212 wait complete. 2024-03-12T16:06:14.154 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:13.459115+0000 mon.smithi134 (mon.1) 14 : audit [INF] from='client.? 172.21.15.134:0/1029899212' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-12T16:06:14.154 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:13.459769+0000 mon.smithi006 (mon.0) 467 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-12T16:06:14.154 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:13.463955+0000 mon.smithi006 (mon.0) 468 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-12T16:06:14.173 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T16:06:14.174 DEBUG:teuthology.orchestra.run.smithi134:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-03-12T16:06:14.174 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-03-12T16:06:14.213 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-03-12T16:06:14.213 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-03-12T16:06:14.213 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph mgr dump --format=json 2024-03-12T16:06:14.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:13.459115+0000 mon.smithi134 (mon.1) 14 : audit [INF] from='client.? 172.21.15.134:0/1029899212' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-12T16:06:14.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:13.459769+0000 mon.smithi006 (mon.0) 467 : audit [INF] from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-03-12T16:06:14.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:13.463955+0000 mon.smithi006 (mon.0) 468 : audit [INF] from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-03-12T16:06:14.501 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:15.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:13.962281+0000 mgr.smithi006.kskdce (mgr.14196) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:15.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:13.962281+0000 mgr.smithi006.kskdce (mgr.14196) 152 : cluster [DBG] pgmap v133: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.377+0000 7f14e2d58700 1 -- 172.21.15.6:0/4135835398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f7b40 msgr2=0x7f14dc0f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.377+0000 7f14e2d58700 1 --2- 172.21.15.6:0/4135835398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f7b40 0x7f14dc0f7fa0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f14c80047f0 tx=0x7f14c8009cb0).stop 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.377+0000 7f14e2d58700 1 -- 172.21.15.6:0/4135835398 shutdown_connections 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.377+0000 7f14e2d58700 1 --2- 172.21.15.6:0/4135835398 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f7b40 0x7f14dc0f7fa0 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.377+0000 7f14e2d58700 1 --2- 172.21.15.6:0/4135835398 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14dc0f68a0 0x7f14dc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.377+0000 7f14e2d58700 1 -- 172.21.15.6:0/4135835398 >> 172.21.15.6:0/4135835398 conn(0x7f14dc0f2020 msgr2=0x7f14dc0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.377+0000 7f14e2d58700 1 -- 172.21.15.6:0/4135835398 shutdown_connections 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.377+0000 7f14e2d58700 1 -- 172.21.15.6:0/4135835398 wait complete. 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e2d58700 1 Processor -- start 2024-03-12T16:06:16.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e2d58700 1 -- start start 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e2d58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f68a0 0x7f14dc0fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e2d58700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14dc0f7b40 0x7f14dc0f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e2d58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0fadd0 con 0x7f14dc0f68a0 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e2d58700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14dc0f9370 con 0x7f14dc0f7b40 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e0af4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f68a0 0x7f14dc0fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e0af4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f68a0 0x7f14dc0fa820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38410/0 (socket says 172.21.15.6:38410) 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e0af4700 1 -- 172.21.15.6:0/2972438676 learned_addr learned my addr 172.21.15.6:0/2972438676 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14dbfff700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14dc0f7b40 0x7f14dc0f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e0af4700 1 -- 172.21.15.6:0/2972438676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14dc0f7b40 msgr2=0x7f14dc0f8e80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e0af4700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14dc0f7b40 0x7f14dc0f8e80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:16.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e0af4700 1 -- 172.21.15.6:0/2972438676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14c8005040 con 0x7f14dc0f68a0 2024-03-12T16:06:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e0af4700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f68a0 0x7f14dc0fa820 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f14d0002820 tx=0x7f14d0009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14d9ffb700 1 -- 172.21.15.6:0/2972438676 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d0007b40 con 0x7f14dc0f68a0 2024-03-12T16:06:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14d9ffb700 1 -- 172.21.15.6:0/2972438676 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f14d000f040 con 0x7f14dc0f68a0 2024-03-12T16:06:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14d9ffb700 1 -- 172.21.15.6:0/2972438676 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d00147c0 con 0x7f14dc0f68a0 2024-03-12T16:06:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.378+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14dc0f95f0 con 0x7f14dc0f68a0 2024-03-12T16:06:16.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.379+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14dc0f9b30 con 0x7f14dc0f68a0 2024-03-12T16:06:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.380+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc047540 con 0x7f14dc0f68a0 2024-03-12T16:06:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.380+0000 7f14d9ffb700 1 -- 172.21.15.6:0/2972438676 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f14d0009110 con 0x7f14dc0f68a0 2024-03-12T16:06:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.380+0000 7f14d9ffb700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14cc061180 0x7f14cc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.381+0000 7f14dbfff700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14cc061180 0x7f14cc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.381+0000 7f14d9ffb700 1 -- 172.21.15.6:0/2972438676 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f14d007c0d0 con 0x7f14dc0f68a0 2024-03-12T16:06:16.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.381+0000 7f14dbfff700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14cc061180 0x7f14cc063640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f14c80047c0 tx=0x7f14c800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:16.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.385+0000 7f14d9ffb700 1 -- 172.21.15.6:0/2972438676 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f14d00503a0 con 0x7f14dc0f68a0 2024-03-12T16:06:16.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.603+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) v1 -- 0x7f14dc110810 con 0x7f14dc0f68a0 2024-03-12T16:06:16.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.606+0000 7f14d9ffb700 1 -- 172.21.15.6:0/2972438676 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v18) v1 ==== 74+0+152015 (secure 0 0 0) 0x7f14d004ff90 con 0x7f14dc0f68a0 2024-03-12T16:06:16.611 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:06:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.608+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14cc061180 msgr2=0x7f14cc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.608+0000 7f14e2d58700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14cc061180 0x7f14cc063640 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f14c80047c0 tx=0x7f14c800b040).stop 2024-03-12T16:06:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.608+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f68a0 msgr2=0x7f14dc0fa820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.608+0000 7f14e2d58700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f68a0 0x7f14dc0fa820 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f14d0002820 tx=0x7f14d0009f00).stop 2024-03-12T16:06:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.608+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 shutdown_connections 2024-03-12T16:06:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.608+0000 7f14e2d58700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14cc061180 0x7f14cc063640 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.608+0000 7f14e2d58700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14dc0f68a0 0x7f14dc0fa820 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.608+0000 7f14e2d58700 1 --2- 172.21.15.6:0/2972438676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14dc0f7b40 0x7f14dc0f8e80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.608+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 >> 172.21.15.6:0/2972438676 conn(0x7f14dc0f2020 msgr2=0x7f14dc061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.609+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 shutdown_connections 2024-03-12T16:06:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:16.609+0000 7f14e2d58700 1 -- 172.21.15.6:0/2972438676 wait complete. 2024-03-12T16:06:17.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:15.962656+0000 mgr.smithi006.kskdce (mgr.14196) 153 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:17.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:16.605215+0000 mon.smithi006 (mon.0) 469 : audit [DBG] from='client.? 172.21.15.6:0/2972438676' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-12T16:06:17.343 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"active_gid":14196,"active_name":"smithi006.kskdce","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6800","nonce":139345082},{"type":"v1","addr":"172.21.15.6:6801","nonce":139345082}]},"active_addr":"172.21.15.6:6801/139345082","active_change":"2024-03-12T16:02:39.916580+0000","active_mgr_features":4540138314316775423,"available":true,"standbys":[{"gid":14212,"name":"smithi134.gcntfu","mgr_features":4540138314316775423,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"str","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"str","level":"advanced","flags":0,"default_value":"30","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"str","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"str","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"str","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"None","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.6:8443/","prometheus":"http://172.21.15.6:9283/"},"always_on_modules":{"nautilus":["balancer","crash","devicehealth","orchestrator_cli","progress","rbd_support","status","volumes"],"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":5,"active_clients":[{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":3126632977}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.6:0","nonce":124082729}]}]} 2024-03-12T16:06:17.349 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-03-12T16:06:17.349 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-03-12T16:06:17.349 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd dump --format=json 2024-03-12T16:06:17.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:15.962656+0000 mgr.smithi006.kskdce (mgr.14196) 153 : cluster [DBG] pgmap v134: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:17.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:16.605215+0000 mon.smithi006 (mon.0) 469 : audit [DBG] from='client.? 172.21.15.6:0/2972438676' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-03-12T16:06:17.631 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:19.261 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:17.963061+0000 mgr.smithi006.kskdce (mgr.14196) 154 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:19.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:17.963061+0000 mgr.smithi006.kskdce (mgr.14196) 154 : cluster [DBG] pgmap v135: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:19.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.519+0000 7fd4127af700 1 -- 172.21.15.6:0/2421234583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 msgr2=0x7fd40c0f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:19.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.519+0000 7fd4127af700 1 --2- 172.21.15.6:0/2421234583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 0x7fd40c0f6cc0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fd3fc0047f0 tx=0x7fd3fc009cb0).stop 2024-03-12T16:06:19.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.519+0000 7fd4127af700 1 -- 172.21.15.6:0/2421234583 shutdown_connections 2024-03-12T16:06:19.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.519+0000 7fd4127af700 1 --2- 172.21.15.6:0/2421234583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd40c0f7b40 0x7fd40c0f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:19.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.519+0000 7fd4127af700 1 --2- 172.21.15.6:0/2421234583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 0x7fd40c0f6cc0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:19.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.519+0000 7fd4127af700 1 -- 172.21.15.6:0/2421234583 >> 172.21.15.6:0/2421234583 conn(0x7fd40c0f2020 msgr2=0x7fd40c0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:19.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.519+0000 7fd4127af700 1 -- 172.21.15.6:0/2421234583 shutdown_connections 2024-03-12T16:06:19.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.519+0000 7fd4127af700 1 -- 172.21.15.6:0/2421234583 wait complete. 2024-03-12T16:06:19.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.520+0000 7fd4127af700 1 Processor -- start 2024-03-12T16:06:19.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.520+0000 7fd4127af700 1 -- start start 2024-03-12T16:06:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.520+0000 7fd4127af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 0x7fd40c1080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.520+0000 7fd4127af700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd40c0f7b40 0x7fd40c108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.520+0000 7fd4127af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c108b40 con 0x7fd40c0f68a0 2024-03-12T16:06:19.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.520+0000 7fd4127af700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd40c108c80 con 0x7fd40c0f7b40 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd40bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 0x7fd40c1080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd40bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 0x7fd40c1080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38430/0 (socket says 172.21.15.6:38430) 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd40bfff700 1 -- 172.21.15.6:0/1425585523 learned_addr learned my addr 172.21.15.6:0/1425585523 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd40b7fe700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd40c0f7b40 0x7fd40c108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd40bfff700 1 -- 172.21.15.6:0/1425585523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd40c0f7b40 msgr2=0x7fd40c108590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd40bfff700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd40c0f7b40 0x7fd40c108590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd40bfff700 1 -- 172.21.15.6:0/1425585523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3fc005040 con 0x7fd40c0f68a0 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd40bfff700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 0x7fd40c1080a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fd3fc004f10 tx=0x7fd3fc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd4097fa700 1 -- 172.21.15.6:0/1425585523 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3fc00e070 con 0x7fd40c0f68a0 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd4097fa700 1 -- 172.21.15.6:0/1425585523 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fd3fc007e90 con 0x7fd40c0f68a0 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd40c10d6c0 con 0x7fd40c0f68a0 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd4097fa700 1 -- 172.21.15.6:0/1425585523 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3fc018070 con 0x7fd40c0f68a0 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.521+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd40c10dc00 con 0x7fd40c0f68a0 2024-03-12T16:06:19.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.522+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd40c0feff0 con 0x7fd40c0f68a0 2024-03-12T16:06:19.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.523+0000 7fd4097fa700 1 -- 172.21.15.6:0/1425585523 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fd3fc0123c0 con 0x7fd40c0f68a0 2024-03-12T16:06:19.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.523+0000 7fd4097fa700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd3f4061180 0x7fd3f4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:19.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.523+0000 7fd4097fa700 1 -- 172.21.15.6:0/1425585523 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fd3fc07d240 con 0x7fd40c0f68a0 2024-03-12T16:06:19.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.523+0000 7fd40b7fe700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd3f4061180 0x7fd3f4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:19.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.523+0000 7fd40b7fe700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd3f4061180 0x7fd3f4063640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd400004dc0 tx=0x7fd40000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:19.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.527+0000 7fd4097fa700 1 -- 172.21.15.6:0/1425585523 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd3fc051590 con 0x7fd40c0f68a0 2024-03-12T16:06:19.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.697+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fd40c10e560 con 0x7fd40c0f68a0 2024-03-12T16:06:19.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.698+0000 7fd4097fa700 1 -- 172.21.15.6:0/1425585523 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10840 (secure 0 0 0) 0x7fd3fc051180 con 0x7fd40c0f68a0 2024-03-12T16:06:19.701 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:06:19.701 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","created":"2024-03-12T16:00:42.612784+0000","modified":"2024-03-12T16:06:01.845065+0000","last_up_change":"2024-03-12T16:06:00.146006+0000","last_in_change":"2024-03-12T16:05:41.290069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-12T16:04:29.453605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"81b3ff11-3d87-4f3b-a302-c8c55f378ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6803","nonce":782473340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6805","nonce":782473340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6809","nonce":782473340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6807","nonce":782473340}]},"public_addr":"172.21.15.6:6803/782473340","cluster_addr":"172.21.15.6:6805/782473340","heartbeat_back_addr":"172.21.15.6:6809/782473340","heartbeat_front_addr":"172.21.15.6:6807/782473340","state":["exists","up"]},{"osd":1,"uuid":"e638e6a3-7dc0-47f6-8901-1bdb1c208583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6811","nonce":464707515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6813","nonce":464707515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6817","nonce":464707515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6815","nonce":464707515}]},"public_addr":"172.21.15.6:6811/464707515","cluster_addr":"172.21.15.6:6813/464707515","heartbeat_back_addr":"172.21.15.6:6817/464707515","heartbeat_front_addr":"172.21.15.6:6815/464707515","state":["exists","up"]},{"osd":2,"uuid":"45eed951-90a9-4fe0-a184-11b5e1ebe46d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6819","nonce":2037091558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6821","nonce":2037091558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6825","nonce":2037091558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6823","nonce":2037091558}]},"public_addr":"172.21.15.6:6819/2037091558","cluster_addr":"172.21.15.6:6821/2037091558","heartbeat_back_addr":"172.21.15.6:6825/2037091558","heartbeat_front_addr":"172.21.15.6:6823/2037091558","state":["exists","up"]},{"osd":3,"uuid":"47d2f20b-d7b8-4d67-905c-af29938d36d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6801","nonce":641287556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6803","nonce":641287556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6807","nonce":641287556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6805","nonce":641287556}]},"public_addr":"172.21.15.134:6801/641287556","cluster_addr":"172.21.15.134:6803/641287556","heartbeat_back_addr":"172.21.15.134:6807/641287556","heartbeat_front_addr":"172.21.15.134:6805/641287556","state":["exists","up"]},{"osd":4,"uuid":"bfe8b5a1-489a-458d-ba30-5d1bada0c33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6809","nonce":1907759631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6811","nonce":1907759631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6815","nonce":1907759631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6813","nonce":1907759631}]},"public_addr":"172.21.15.134:6809/1907759631","cluster_addr":"172.21.15.134:6811/1907759631","heartbeat_back_addr":"172.21.15.134:6815/1907759631","heartbeat_front_addr":"172.21.15.134:6813/1907759631","state":["exists","up"]},{"osd":5,"uuid":"02e056ee-a66a-4c23-a819-1e4c1e2d1236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6817","nonce":876055595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6819","nonce":876055595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6823","nonce":876055595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6821","nonce":876055595}]},"public_addr":"172.21.15.134:6817/876055595","cluster_addr":"172.21.15.134:6819/876055595","heartbeat_back_addr":"172.21.15.134:6823/876055595","heartbeat_front_addr":"172.21.15.134:6821/876055595","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:35.977637+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:59.443373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:04:27.106208+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:02.955636+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:30.634685+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:58.981490+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4212806006":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/687610333":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/3228405447":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:6801/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/179696865":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/1637754840":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4255668203":"2024-03-13T16:01:12.726451+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T16:06:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd3f4061180 msgr2=0x7fd3f4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd3f4061180 0x7fd3f4063640 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fd400004dc0 tx=0x7fd40000b040).stop 2024-03-12T16:06:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 msgr2=0x7fd40c1080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 0x7fd40c1080a0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fd3fc004f10 tx=0x7fd3fc009cb0).stop 2024-03-12T16:06:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 shutdown_connections 2024-03-12T16:06:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd3f4061180 0x7fd3f4063640 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:19.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd40c0f68a0 0x7fd40c1080a0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 --2- 172.21.15.6:0/1425585523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd40c0f7b40 0x7fd40c108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 >> 172.21.15.6:0/1425585523 conn(0x7fd40c0f2020 msgr2=0x7fd40c060af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 shutdown_connections 2024-03-12T16:06:19.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:19.700+0000 7fd4127af700 1 -- 172.21.15.6:0/1425585523 wait complete. 2024-03-12T16:06:20.398 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:19.699326+0000 mon.smithi006 (mon.0) 470 : audit [DBG] from='client.? 172.21.15.6:0/1425585523' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:06:20.422 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-03-12T16:06:20.422 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd dump --format=json 2024-03-12T16:06:20.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:19.699326+0000 mon.smithi006 (mon.0) 470 : audit [DBG] from='client.? 172.21.15.6:0/1425585523' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:06:20.703 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:19.963413+0000 mgr.smithi006.kskdce (mgr.14196) 155 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:21.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:19.963413+0000 mgr.smithi006.kskdce (mgr.14196) 155 : cluster [DBG] pgmap v136: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 -- 172.21.15.6:0/2448316154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f79a0 msgr2=0x7ff5700f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 --2- 172.21.15.6:0/2448316154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f79a0 0x7ff5700f7dc0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7ff5600047f0 tx=0x7ff560009cb0).stop 2024-03-12T16:06:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 -- 172.21.15.6:0/2448316154 shutdown_connections 2024-03-12T16:06:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 --2- 172.21.15.6:0/2448316154 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5700f8c40 0x7ff5700f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 --2- 172.21.15.6:0/2448316154 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f79a0 0x7ff5700f7dc0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 -- 172.21.15.6:0/2448316154 >> 172.21.15.6:0/2448316154 conn(0x7ff5700f3100 msgr2=0x7ff5700f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:22.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 -- 172.21.15.6:0/2448316154 shutdown_connections 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 -- 172.21.15.6:0/2448316154 wait complete. 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 Processor -- start 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.512+0000 7ff576a39700 1 -- start start 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff576a39700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5700f79a0 0x7ff57006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff576a39700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f8c40 0x7ff57006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff576a39700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57006cf80 con 0x7ff5700f8c40 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff576a39700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff57006b520 con 0x7ff5700f79a0 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff56f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f8c40 0x7ff57006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff56f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f8c40 0x7ff57006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45024/0 (socket says 172.21.15.6:45024) 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff56f7fe700 1 -- 172.21.15.6:0/2242820670 learned_addr learned my addr 172.21.15.6:0/2242820670 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff56ffff700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5700f79a0 0x7ff57006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:22.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff56f7fe700 1 -- 172.21.15.6:0/2242820670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5700f79a0 msgr2=0x7ff57006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:22.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff56f7fe700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5700f79a0 0x7ff57006c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:22.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff56f7fe700 1 -- 172.21.15.6:0/2242820670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff560005040 con 0x7ff5700f8c40 2024-03-12T16:06:22.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff56ffff700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5700f79a0 0x7ff57006c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:06:22.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.513+0000 7ff56f7fe700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f8c40 0x7ff57006b030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff56400c740 tx=0x7ff564007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:22.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.514+0000 7ff56d7fa700 1 -- 172.21.15.6:0/2242820670 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff56400e680 con 0x7ff5700f8c40 2024-03-12T16:06:22.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.514+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff57006b7a0 con 0x7ff5700f8c40 2024-03-12T16:06:22.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.514+0000 7ff56d7fa700 1 -- 172.21.15.6:0/2242820670 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7ff56400ec70 con 0x7ff5700f8c40 2024-03-12T16:06:22.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.514+0000 7ff56d7fa700 1 -- 172.21.15.6:0/2242820670 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff564013d30 con 0x7ff5700f8c40 2024-03-12T16:06:22.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.514+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff57006bce0 con 0x7ff5700f8c40 2024-03-12T16:06:22.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.515+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff570047540 con 0x7ff5700f8c40 2024-03-12T16:06:22.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.515+0000 7ff56d7fa700 1 -- 172.21.15.6:0/2242820670 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7ff56400e7e0 con 0x7ff5700f8c40 2024-03-12T16:06:22.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.515+0000 7ff56d7fa700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff558061180 0x7ff558063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:22.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.516+0000 7ff56d7fa700 1 -- 172.21.15.6:0/2242820670 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7ff56407c820 con 0x7ff5700f8c40 2024-03-12T16:06:22.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.516+0000 7ff56ffff700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff558061180 0x7ff558063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:22.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.516+0000 7ff56ffff700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff558061180 0x7ff558063640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff560013470 tx=0x7ff560009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:22.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.520+0000 7ff56d7fa700 1 -- 172.21.15.6:0/2242820670 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7ff564050af0 con 0x7ff5700f8c40 2024-03-12T16:06:22.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.691+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7ff5701000f0 con 0x7ff5700f8c40 2024-03-12T16:06:22.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.692+0000 7ff56d7fa700 1 -- 172.21.15.6:0/2242820670 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v38) v1 ==== 74+0+10840 (secure 0 0 0) 0x7ff5640171b0 con 0x7ff5700f8c40 2024-03-12T16:06:22.694 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:06:22.694 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":38,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","created":"2024-03-12T16:00:42.612784+0000","modified":"2024-03-12T16:06:01.845065+0000","last_up_change":"2024-03-12T16:06:00.146006+0000","last_in_change":"2024-03-12T16:05:41.290069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-12T16:04:29.453605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}}],"osds":[{"osd":0,"uuid":"81b3ff11-3d87-4f3b-a302-c8c55f378ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6803","nonce":782473340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6805","nonce":782473340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6809","nonce":782473340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6807","nonce":782473340}]},"public_addr":"172.21.15.6:6803/782473340","cluster_addr":"172.21.15.6:6805/782473340","heartbeat_back_addr":"172.21.15.6:6809/782473340","heartbeat_front_addr":"172.21.15.6:6807/782473340","state":["exists","up"]},{"osd":1,"uuid":"e638e6a3-7dc0-47f6-8901-1bdb1c208583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":27,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6811","nonce":464707515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6813","nonce":464707515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6817","nonce":464707515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6815","nonce":464707515}]},"public_addr":"172.21.15.6:6811/464707515","cluster_addr":"172.21.15.6:6813/464707515","heartbeat_back_addr":"172.21.15.6:6817/464707515","heartbeat_front_addr":"172.21.15.6:6815/464707515","state":["exists","up"]},{"osd":2,"uuid":"45eed951-90a9-4fe0-a184-11b5e1ebe46d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6819","nonce":2037091558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6821","nonce":2037091558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6825","nonce":2037091558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6823","nonce":2037091558}]},"public_addr":"172.21.15.6:6819/2037091558","cluster_addr":"172.21.15.6:6821/2037091558","heartbeat_back_addr":"172.21.15.6:6825/2037091558","heartbeat_front_addr":"172.21.15.6:6823/2037091558","state":["exists","up"]},{"osd":3,"uuid":"47d2f20b-d7b8-4d67-905c-af29938d36d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":31,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6801","nonce":641287556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6803","nonce":641287556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6807","nonce":641287556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6805","nonce":641287556}]},"public_addr":"172.21.15.134:6801/641287556","cluster_addr":"172.21.15.134:6803/641287556","heartbeat_back_addr":"172.21.15.134:6807/641287556","heartbeat_front_addr":"172.21.15.134:6805/641287556","state":["exists","up"]},{"osd":4,"uuid":"bfe8b5a1-489a-458d-ba30-5d1bada0c33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6809","nonce":1907759631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6811","nonce":1907759631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6815","nonce":1907759631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6813","nonce":1907759631}]},"public_addr":"172.21.15.134:6809/1907759631","cluster_addr":"172.21.15.134:6811/1907759631","heartbeat_back_addr":"172.21.15.134:6815/1907759631","heartbeat_front_addr":"172.21.15.134:6813/1907759631","state":["exists","up"]},{"osd":5,"uuid":"02e056ee-a66a-4c23-a819-1e4c1e2d1236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6817","nonce":876055595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6819","nonce":876055595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6823","nonce":876055595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6821","nonce":876055595}]},"public_addr":"172.21.15.134:6817/876055595","cluster_addr":"172.21.15.134:6819/876055595","heartbeat_back_addr":"172.21.15.134:6823/876055595","heartbeat_front_addr":"172.21.15.134:6821/876055595","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:35.977637+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:59.443373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:04:27.106208+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:02.955636+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:30.634685+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:58.981490+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4212806006":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/687610333":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/3228405447":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:6801/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/179696865":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/1637754840":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4255668203":"2024-03-13T16:01:12.726451+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.693+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff558061180 msgr2=0x7ff558063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.693+0000 7ff576a39700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff558061180 0x7ff558063640 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7ff560013470 tx=0x7ff560009cb0).stop 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.693+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f8c40 msgr2=0x7ff57006b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.693+0000 7ff576a39700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f8c40 0x7ff57006b030 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7ff56400c740 tx=0x7ff564007ef0).stop 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.694+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 shutdown_connections 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.694+0000 7ff576a39700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7ff558061180 0x7ff558063640 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.694+0000 7ff576a39700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff5700f79a0 0x7ff57006c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.694+0000 7ff576a39700 1 --2- 172.21.15.6:0/2242820670 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff5700f8c40 0x7ff57006b030 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.694+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 >> 172.21.15.6:0/2242820670 conn(0x7ff5700f3100 msgr2=0x7ff5700fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.694+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 shutdown_connections 2024-03-12T16:06:22.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:22.694+0000 7ff576a39700 1 -- 172.21.15.6:0/2242820670 wait complete. 2024-03-12T16:06:23.416 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:21.963736+0000 mgr.smithi006.kskdce (mgr.14196) 156 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:23.416 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:22.693163+0000 mon.smithi006 (mon.0) 471 : audit [DBG] from='client.? 172.21.15.6:0/2242820670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:06:23.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph tell osd.0 flush_pg_stats 2024-03-12T16:06:23.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph tell osd.1 flush_pg_stats 2024-03-12T16:06:23.440 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph tell osd.2 flush_pg_stats 2024-03-12T16:06:23.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph tell osd.3 flush_pg_stats 2024-03-12T16:06:23.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph tell osd.4 flush_pg_stats 2024-03-12T16:06:23.442 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph tell osd.5 flush_pg_stats 2024-03-12T16:06:23.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:21.963736+0000 mgr.smithi006.kskdce (mgr.14196) 156 : cluster [DBG] pgmap v137: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:23.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:22.693163+0000 mon.smithi006 (mon.0) 471 : audit [DBG] from='client.? 172.21.15.6:0/2242820670' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:06:23.811 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:23.820 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:25.404 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:23.964156+0000 mgr.smithi006.kskdce (mgr.14196) 157 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:25.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:23.964156+0000 mgr.smithi006.kskdce (mgr.14196) 157 : cluster [DBG] pgmap v138: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:25.690 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:25.691 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:27.219 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:25.964509+0000 mgr.smithi006.kskdce (mgr.14196) 158 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:25.964509+0000 mgr.smithi006.kskdce (mgr.14196) 158 : cluster [DBG] pgmap v139: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 -- 172.21.15.6:0/662250360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f79a0 msgr2=0x7f20a40f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 --2- 172.21.15.6:0/662250360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f79a0 0x7f20a40f7dc0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f20980047f0 tx=0x7f2098009cb0).stop 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 -- 172.21.15.6:0/662250360 shutdown_connections 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 --2- 172.21.15.6:0/662250360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a40f8c40 0x7f20a40f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 --2- 172.21.15.6:0/662250360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f79a0 0x7f20a40f7dc0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 -- 172.21.15.6:0/662250360 >> 172.21.15.6:0/662250360 conn(0x7f20a40f3100 msgr2=0x7f20a40f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 -- 172.21.15.6:0/662250360 shutdown_connections 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 -- 172.21.15.6:0/662250360 wait complete. 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 Processor -- start 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.764+0000 7f20aaff9700 1 -- start start 2024-03-12T16:06:27.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20aaff9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a40f79a0 0x7f20a406c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20aaff9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f8c40 0x7f20a406b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20aaff9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a406cf80 con 0x7f20a40f8c40 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20aaff9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20a406b520 con 0x7f20a40f79a0 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f8c40 0x7f20a406b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f8c40 0x7f20a406b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45046/0 (socket says 172.21.15.6:45046) 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a3fff700 1 -- 172.21.15.6:0/3336457551 learned_addr learned my addr 172.21.15.6:0/3336457551 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a8d95700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a40f79a0 0x7f20a406c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a3fff700 1 -- 172.21.15.6:0/3336457551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a40f79a0 msgr2=0x7f20a406c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a3fff700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a40f79a0 0x7f20a406c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a3fff700 1 -- 172.21.15.6:0/3336457551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2098005040 con 0x7f20a40f8c40 2024-03-12T16:06:27.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a3fff700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f8c40 0x7f20a406b030 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f20900041d0 tx=0x7f2090009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a1ffb700 1 -- 172.21.15.6:0/3336457551 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2090007b40 con 0x7f20a40f8c40 2024-03-12T16:06:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a1ffb700 1 -- 172.21.15.6:0/3336457551 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f209000f040 con 0x7f20a40f8c40 2024-03-12T16:06:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20a1ffb700 1 -- 172.21.15.6:0/3336457551 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20900146f0 con 0x7f20a40f8c40 2024-03-12T16:06:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.765+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20a406b7a0 con 0x7f20a40f8c40 2024-03-12T16:06:27.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.766+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20a406bce0 con 0x7f20a40f8c40 2024-03-12T16:06:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.766+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f20a405f5f0 con 0x7f20a40f8c40 2024-03-12T16:06:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.767+0000 7f20a1ffb700 1 -- 172.21.15.6:0/3336457551 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f2090009110 con 0x7f20a40f8c40 2024-03-12T16:06:27.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.767+0000 7f20a1ffb700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f20940611d0 0x7f2094063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.767+0000 7f20a1ffb700 1 -- 172.21.15.6:0/3336457551 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f209007c5d0 con 0x7f20a40f8c40 2024-03-12T16:06:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.767+0000 7f20a8d95700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f20940611d0 0x7f2094063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.767+0000 7f20a1ffb700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] conn(0x7f2094066da0 0x7f20940691e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.767+0000 7f20a1ffb700 1 -- 172.21.15.6:0/3336457551 --> [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f2094069860 con 0x7f2094066da0 2024-03-12T16:06:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.767+0000 7f20a1ffb700 1 -- 172.21.15.6:0/3336457551 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f209007eaf0 con 0x7f20a40f8c40 2024-03-12T16:06:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.768+0000 7f20a9596700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] conn(0x7f2094066da0 0x7f20940691e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.768+0000 7f20a8d95700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f20940611d0 0x7f2094063690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2098004f10 tx=0x7f209800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.768+0000 7f20a9596700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] conn(0x7f2094066da0 0x7f20940691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:27.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.768+0000 7f20a1ffb700 1 -- 172.21.15.6:0/3336457551 <== osd.2 v2:172.21.15.6:6818/2037091558 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f2094069860 con 0x7f2094066da0 2024-03-12T16:06:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 --> [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f20a40593e0 con 0x7f2094066da0 2024-03-12T16:06:27.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20a1ffb700 1 -- 172.21.15.6:0/3336457551 <== osd.2 v2:172.21.15.6:6818/2037091558 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f20a40593e0 con 0x7f2094066da0 2024-03-12T16:06:27.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] conn(0x7f2094066da0 msgr2=0x7f20940691e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:27.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] conn(0x7f2094066da0 0x7f20940691e0 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:27.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f20940611d0 msgr2=0x7f2094063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:27.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f20940611d0 0x7f2094063690 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f2098004f10 tx=0x7f209800b040).stop 2024-03-12T16:06:27.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f8c40 msgr2=0x7f20a406b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:27.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f8c40 0x7f20a406b030 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7f20900041d0 tx=0x7f2090009f60).stop 2024-03-12T16:06:27.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 shutdown_connections 2024-03-12T16:06:27.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6818/2037091558,v1:172.21.15.6:6819/2037091558] conn(0x7f2094066da0 0x7f20940691e0 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:27.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f20940611d0 0x7f2094063690 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:27.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20a40f79a0 0x7f20a406c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:27.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 --2- 172.21.15.6:0/3336457551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20a40f8c40 0x7f20a406b030 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:27.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 >> 172.21.15.6:0/3336457551 conn(0x7f20a40f3100 msgr2=0x7f20a40fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:27.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 shutdown_connections 2024-03-12T16:06:27.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:27.783+0000 7f20aaff9700 1 -- 172.21.15.6:0/3336457551 wait complete. 2024-03-12T16:06:29.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:27.964871+0000 mgr.smithi006.kskdce (mgr.14196) 159 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:29.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:27.964871+0000 mgr.smithi006.kskdce (mgr.14196) 159 : cluster [DBG] pgmap v140: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:30.480 INFO:teuthology.orchestra.run.smithi006.stdout:81604378651 2024-03-12T16:06:30.481 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.2 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.577+0000 7f8edd117700 1 -- 172.21.15.6:0/1502546819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f7b40 msgr2=0x7f8ed80f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.577+0000 7f8edd117700 1 --2- 172.21.15.6:0/1502546819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f7b40 0x7f8ed80f7fa0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f8ecc0047f0 tx=0x7f8ecc009cb0).stop 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.577+0000 7f8edd117700 1 -- 172.21.15.6:0/1502546819 shutdown_connections 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.577+0000 7f8edd117700 1 --2- 172.21.15.6:0/1502546819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f7b40 0x7f8ed80f7fa0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.577+0000 7f8edd117700 1 --2- 172.21.15.6:0/1502546819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed80f68a0 0x7f8ed80f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.577+0000 7f8edd117700 1 -- 172.21.15.6:0/1502546819 >> 172.21.15.6:0/1502546819 conn(0x7f8ed80f2020 msgr2=0x7f8ed80f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.577+0000 7f8edd117700 1 -- 172.21.15.6:0/1502546819 shutdown_connections 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.577+0000 7f8edd117700 1 -- 172.21.15.6:0/1502546819 wait complete. 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.578+0000 7f8edd117700 1 Processor -- start 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.578+0000 7f8edd117700 1 -- start start 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.578+0000 7f8edd117700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f68a0 0x7f8ed8106f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:30.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.578+0000 7f8edd117700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed80f7b40 0x7f8ed8107430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.578+0000 7f8edd117700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed81079e0 con 0x7f8ed80f68a0 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.578+0000 7f8edd117700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8ed8107b20 con 0x7f8ed80f7b40 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.578+0000 7f8ed6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f68a0 0x7f8ed8106f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.578+0000 7f8ed6d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f68a0 0x7f8ed8106f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45050/0 (socket says 172.21.15.6:45050) 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8ed6d9d700 1 -- 172.21.15.6:0/3758064906 learned_addr learned my addr 172.21.15.6:0/3758064906 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8ed659c700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed80f7b40 0x7f8ed8107430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8ed6d9d700 1 -- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed80f7b40 msgr2=0x7f8ed8107430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8ed6d9d700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed80f7b40 0x7f8ed8107430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8ed6d9d700 1 -- 172.21.15.6:0/3758064906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ecc005040 con 0x7f8ed80f68a0 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8ed6d9d700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f68a0 0x7f8ed8106f40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f8ec800c790 tx=0x7f8ec8007f90).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8ebffff700 1 -- 172.21.15.6:0/3758064906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec800e680 con 0x7f8ed80f68a0 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8ed810c5c0 con 0x7f8ed80f68a0 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8ebffff700 1 -- 172.21.15.6:0/3758064906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8ec800ec70 con 0x7f8ed80f68a0 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8ebffff700 1 -- 172.21.15.6:0/3758064906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ec8012d30 con 0x7f8ed80f68a0 2024-03-12T16:06:31.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.579+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8ed810cb00 con 0x7f8ed80f68a0 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.580+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8ed8061c00 con 0x7f8ed80f68a0 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.580+0000 7f8ebffff700 1 -- 172.21.15.6:0/3758064906 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f8ec800e7e0 con 0x7f8ed80f68a0 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.581+0000 7f8ebffff700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8ec0061180 0x7f8ec0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.581+0000 7f8ebffff700 1 -- 172.21.15.6:0/3758064906 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f8ec807be00 con 0x7f8ed80f68a0 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.581+0000 7f8ed659c700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8ec0061180 0x7f8ec0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.581+0000 7f8ebffff700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] conn(0x7f8ec0066d50 0x7f8ec0069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.581+0000 7f8ebffff700 1 -- 172.21.15.6:0/3758064906 --> [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8ec0069810 con 0x7f8ec0066d50 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.581+0000 7f8ebffff700 1 -- 172.21.15.6:0/3758064906 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8ec807e470 con 0x7f8ed80f68a0 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.581+0000 7f8ed659c700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8ec0061180 0x7f8ec0063640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8ecc0047c0 tx=0x7f8ecc00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.581+0000 7f8ed759e700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] conn(0x7f8ec0066d50 0x7f8ec0069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.582+0000 7f8ed759e700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] conn(0x7f8ec0066d50 0x7f8ec0069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.583+0000 7f8ebffff700 1 -- 172.21.15.6:0/3758064906 <== osd.3 v2:172.21.15.134:6800/641287556 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f8ec0069810 con 0x7f8ec0066d50 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.597+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 --> [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8ed8059360 con 0x7f8ec0066d50 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.597+0000 7f8ebffff700 1 -- 172.21.15.6:0/3758064906 <== osd.3 v2:172.21.15.134:6800/641287556 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8ed8059360 con 0x7f8ec0066d50 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] conn(0x7f8ec0066d50 msgr2=0x7f8ec0069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:31.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] conn(0x7f8ec0066d50 0x7f8ec0069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8ec0061180 msgr2=0x7f8ec0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8ec0061180 0x7f8ec0063640 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f8ecc0047c0 tx=0x7f8ecc00b040).stop 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f68a0 msgr2=0x7f8ed8106f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f68a0 0x7f8ed8106f40 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f8ec800c790 tx=0x7f8ec8007f90).stop 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 shutdown_connections 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:6800/641287556,v1:172.21.15.134:6801/641287556] conn(0x7f8ec0066d50 0x7f8ec0069190 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8ec0061180 0x7f8ec0063640 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8ed80f68a0 0x7f8ed8106f40 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 --2- 172.21.15.6:0/3758064906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8ed80f7b40 0x7f8ed8107430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 >> 172.21.15.6:0/3758064906 conn(0x7f8ed80f2020 msgr2=0x7f8ed80fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 shutdown_connections 2024-03-12T16:06:31.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:28.598+0000 7f8edd117700 1 -- 172.21.15.6:0/3758064906 wait complete. 2024-03-12T16:06:31.123 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:31.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:29.965255+0000 mgr.smithi006.kskdce (mgr.14196) 160 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:31.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:29.965255+0000 mgr.smithi006.kskdce (mgr.14196) 160 : cluster [DBG] pgmap v141: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:31.616 INFO:teuthology.orchestra.run.smithi006.stdout:111669149714 2024-03-12T16:06:31.617 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.3 2024-03-12T16:06:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.048+0000 7f70d1e4e700 1 -- 172.21.15.6:0/3586496530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 msgr2=0x7f70cc0f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.048+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/3586496530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 0x7f70cc0f7fa0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f70c00047f0 tx=0x7f70c0009cb0).stop 2024-03-12T16:06:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.048+0000 7f70d1e4e700 1 -- 172.21.15.6:0/3586496530 shutdown_connections 2024-03-12T16:06:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.048+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/3586496530 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 0x7f70cc0f7fa0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:32.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.048+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/3586496530 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc0f68a0 0x7f70cc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.048+0000 7f70d1e4e700 1 -- 172.21.15.6:0/3586496530 >> 172.21.15.6:0/3586496530 conn(0x7f70cc0f2020 msgr2=0x7f70cc0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.048+0000 7f70d1e4e700 1 -- 172.21.15.6:0/3586496530 shutdown_connections 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.048+0000 7f70d1e4e700 1 -- 172.21.15.6:0/3586496530 wait complete. 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.049+0000 7f70d1e4e700 1 Processor -- start 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.049+0000 7f70d1e4e700 1 -- start start 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.049+0000 7f70d1e4e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc0f68a0 0x7f70cc0615c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.049+0000 7f70d1e4e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 0x7f70cc10cf20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.049+0000 7f70d1e4e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc10d410 con 0x7f70cc0f7b40 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.049+0000 7f70d1e4e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f70cc10d550 con 0x7f70cc0f68a0 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.049+0000 7f70caffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 0x7f70cc10cf20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:32.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.049+0000 7f70caffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 0x7f70cc10cf20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45072/0 (socket says 172.21.15.6:45072) 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.049+0000 7f70caffd700 1 -- 172.21.15.6:0/170934043 learned_addr learned my addr 172.21.15.6:0/170934043 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.050+0000 7f70cb7fe700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc0f68a0 0x7f70cc0615c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.050+0000 7f70caffd700 1 -- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc0f68a0 msgr2=0x7f70cc0615c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.050+0000 7f70caffd700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc0f68a0 0x7f70cc0615c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.050+0000 7f70caffd700 1 -- 172.21.15.6:0/170934043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f70c0005040 con 0x7f70cc0f7b40 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.050+0000 7f70cb7fe700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc0f68a0 0x7f70cc0615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.050+0000 7f70caffd700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 0x7f70cc10cf20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f70c0013510 tx=0x7f70c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.052+0000 7f70c8ff9700 1 -- 172.21.15.6:0/170934043 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70c000e030 con 0x7f70cc0f7b40 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.052+0000 7f70c8ff9700 1 -- 172.21.15.6:0/170934043 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f70c0007e90 con 0x7f70cc0f7b40 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.052+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f70cc10d7d0 con 0x7f70cc0f7b40 2024-03-12T16:06:32.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.052+0000 7f70c8ff9700 1 -- 172.21.15.6:0/170934043 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70c0018070 con 0x7f70cc0f7b40 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.052+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f70cc10dcb0 con 0x7f70cc0f7b40 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.053+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f70cc061c00 con 0x7f70cc0f7b40 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.053+0000 7f70c8ff9700 1 -- 172.21.15.6:0/170934043 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f70c001da20 con 0x7f70cc0f7b40 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.053+0000 7f70c8ff9700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f70b4061180 0x7f70b4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.054+0000 7f70c8ff9700 1 -- 172.21.15.6:0/170934043 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f70c007e0b0 con 0x7f70cc0f7b40 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.054+0000 7f70cb7fe700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f70b4061180 0x7f70b4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.054+0000 7f70c8ff9700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] conn(0x7f70b4066d50 0x7f70b4069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.054+0000 7f70c8ff9700 1 -- 172.21.15.6:0/170934043 --> [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f70b4069810 con 0x7f70b4066d50 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.054+0000 7f70c8ff9700 1 -- 172.21.15.6:0/170934043 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f70c007e4b0 con 0x7f70cc0f7b40 2024-03-12T16:06:32.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.054+0000 7f70cb7fe700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f70b4061180 0x7f70b4063640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f70cc0f79a0 tx=0x7f70bc008040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.054+0000 7f70cbfff700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] conn(0x7f70b4066d50 0x7f70b4069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.054+0000 7f70cbfff700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] conn(0x7f70b4066d50 0x7f70b4069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.4 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.055+0000 7f70c8ff9700 1 -- 172.21.15.6:0/170934043 <== osd.4 v2:172.21.15.134:6808/1907759631 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f70b4069810 con 0x7f70b4066d50 2024-03-12T16:06:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.070+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 --> [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f70cc059360 con 0x7f70b4066d50 2024-03-12T16:06:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70c8ff9700 1 -- 172.21.15.6:0/170934043 <== osd.4 v2:172.21.15.134:6808/1907759631 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f70cc059360 con 0x7f70b4066d50 2024-03-12T16:06:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] conn(0x7f70b4066d50 msgr2=0x7f70b4069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] conn(0x7f70b4066d50 0x7f70b4069190 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f70b4061180 msgr2=0x7f70b4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:32.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f70b4061180 0x7f70b4063640 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f70cc0f79a0 tx=0x7f70bc008040).stop 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 msgr2=0x7f70cc10cf20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 0x7f70cc10cf20 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f70c0013510 tx=0x7f70c0009cb0).stop 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 shutdown_connections 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:6808/1907759631,v1:172.21.15.134:6809/1907759631] conn(0x7f70b4066d50 0x7f70b4069190 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f70b4061180 0x7f70b4063640 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f70cc0f68a0 0x7f70cc0615c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 --2- 172.21.15.6:0/170934043 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f70cc0f7b40 0x7f70cc10cf20 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 >> 172.21.15.6:0/170934043 conn(0x7f70cc0f2020 msgr2=0x7f70cc0fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 shutdown_connections 2024-03-12T16:06:32.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.071+0000 7f70d1e4e700 1 -- 172.21.15.6:0/170934043 wait complete. 2024-03-12T16:06:33.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.170+0000 7fbc5043f700 1 -- 172.21.15.6:0/3021849693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 msgr2=0x7fbc480f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:33.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.170+0000 7fbc5043f700 1 --2- 172.21.15.6:0/3021849693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 0x7fbc480f7dc0 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fbc3c0047f0 tx=0x7fbc3c009cb0).stop 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.170+0000 7fbc5043f700 1 -- 172.21.15.6:0/3021849693 shutdown_connections 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.170+0000 7fbc5043f700 1 --2- 172.21.15.6:0/3021849693 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc480f8c40 0x7fbc480f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.170+0000 7fbc5043f700 1 --2- 172.21.15.6:0/3021849693 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 0x7fbc480f7dc0 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.170+0000 7fbc5043f700 1 -- 172.21.15.6:0/3021849693 >> 172.21.15.6:0/3021849693 conn(0x7fbc480f3100 msgr2=0x7fbc480f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.170+0000 7fbc5043f700 1 -- 172.21.15.6:0/3021849693 shutdown_connections 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.170+0000 7fbc5043f700 1 -- 172.21.15.6:0/3021849693 wait complete. 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.171+0000 7fbc5043f700 1 Processor -- start 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.171+0000 7fbc5043f700 1 -- start start 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.171+0000 7fbc5043f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 0x7fbc4806c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.171+0000 7fbc5043f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc480f8c40 0x7fbc4806b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:33.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.171+0000 7fbc5043f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4806cf80 con 0x7fbc480f79a0 2024-03-12T16:06:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.171+0000 7fbc5043f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc4806b520 con 0x7fbc480f8c40 2024-03-12T16:06:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.171+0000 7fbc4e1db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 0x7fbc4806c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.171+0000 7fbc4e1db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 0x7fbc4806c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45090/0 (socket says 172.21.15.6:45090) 2024-03-12T16:06:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.171+0000 7fbc4e1db700 1 -- 172.21.15.6:0/1272531602 learned_addr learned my addr 172.21.15.6:0/1272531602 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc4d9da700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc480f8c40 0x7fbc4806b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc4e1db700 1 -- 172.21.15.6:0/1272531602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc480f8c40 msgr2=0x7fbc4806b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:33.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc4e1db700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc480f8c40 0x7fbc4806b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc4e1db700 1 -- 172.21.15.6:0/1272531602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc3c005040 con 0x7fbc480f79a0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc4e1db700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 0x7fbc4806c9d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fbc3c009eb0 tx=0x7fbc3c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc3b7fe700 1 -- 172.21.15.6:0/1272531602 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc3c00e030 con 0x7fbc480f79a0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc3b7fe700 1 -- 172.21.15.6:0/1272531602 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fbc3c007e90 con 0x7fbc480f79a0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc4806b740 con 0x7fbc480f79a0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc3b7fe700 1 -- 172.21.15.6:0/1272531602 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc3c018070 con 0x7fbc480f79a0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.172+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc4806bc20 con 0x7fbc480f79a0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.173+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7fbc4805f5f0 con 0x7fbc480f79a0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.173+0000 7fbc3b7fe700 1 -- 172.21.15.6:0/1272531602 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fbc3c01d420 con 0x7fbc480f79a0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.174+0000 7fbc3b7fe700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc34061180 0x7fbc34063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.174+0000 7fbc3b7fe700 1 -- 172.21.15.6:0/1272531602 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fbc3c07d760 con 0x7fbc480f79a0 2024-03-12T16:06:33.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.174+0000 7fbc4d9da700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc34061180 0x7fbc34063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.174+0000 7fbc3b7fe700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] conn(0x7fbc34066d50 0x7fbc34069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.174+0000 7fbc3b7fe700 1 -- 172.21.15.6:0/1272531602 --> [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7fbc34069810 con 0x7fbc34066d50 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.174+0000 7fbc3b7fe700 1 -- 172.21.15.6:0/1272531602 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7fbc3c07fdd0 con 0x7fbc480f79a0 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.174+0000 7fbc4e9dc700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] conn(0x7fbc34066d50 0x7fbc34069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.174+0000 7fbc4d9da700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc34061180 0x7fbc34063640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbc44004dc0 tx=0x7fbc4400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.174+0000 7fbc4e9dc700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] conn(0x7fbc34066d50 0x7fbc34069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.175+0000 7fbc3b7fe700 1 -- 172.21.15.6:0/1272531602 <== osd.1 v2:172.21.15.6:6810/464707515 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7fbc34069810 con 0x7fbc34066d50 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.189+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 --> [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7fbc48059360 con 0x7fbc34066d50 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc3b7fe700 1 -- 172.21.15.6:0/1272531602 <== osd.1 v2:172.21.15.6:6810/464707515 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7fbc48059360 con 0x7fbc34066d50 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] conn(0x7fbc34066d50 msgr2=0x7fbc34069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] conn(0x7fbc34066d50 0x7fbc34069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc34061180 msgr2=0x7fbc34063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:33.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc34061180 0x7fbc34063640 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7fbc44004dc0 tx=0x7fbc4400b040).stop 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 msgr2=0x7fbc4806c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 0x7fbc4806c9d0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fbc3c009eb0 tx=0x7fbc3c009cb0).stop 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 shutdown_connections 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6810/464707515,v1:172.21.15.6:6811/464707515] conn(0x7fbc34066d50 0x7fbc34069190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc34061180 0x7fbc34063640 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc480f79a0 0x7fbc4806c9d0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 --2- 172.21.15.6:0/1272531602 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc480f8c40 0x7fbc4806b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 >> 172.21.15.6:0/1272531602 conn(0x7fbc480f3100 msgr2=0x7fbc480fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 shutdown_connections 2024-03-12T16:06:33.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:32.190+0000 7fbc5043f700 1 -- 172.21.15.6:0/1272531602 wait complete. 2024-03-12T16:06:33.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:31.965552+0000 mgr.smithi006.kskdce (mgr.14196) 161 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:33.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:31.965552+0000 mgr.smithi006.kskdce (mgr.14196) 161 : cluster [DBG] pgmap v142: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:35.347 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:33.965926+0000 mgr.smithi006.kskdce (mgr.14196) 162 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:35.367 INFO:teuthology.orchestra.run.smithi006.stdout:60129542177 2024-03-12T16:06:35.368 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.1 2024-03-12T16:06:35.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:33.965926+0000 mgr.smithi006.kskdce (mgr.14196) 162 : cluster [DBG] pgmap v143: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:35.780 INFO:teuthology.orchestra.run.smithi006.stdout:137438953486 2024-03-12T16:06:35.781 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.4 2024-03-12T16:06:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.050+0000 7f83248fa700 1 -- 172.21.15.6:0/547514605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 msgr2=0x7f83200f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.050+0000 7f83248fa700 1 --2- 172.21.15.6:0/547514605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 0x7f83200f90a0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7f83140047f0 tx=0x7f8314009cb0).stop 2024-03-12T16:06:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.051+0000 7f83248fa700 1 -- 172.21.15.6:0/547514605 shutdown_connections 2024-03-12T16:06:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.051+0000 7f83248fa700 1 --2- 172.21.15.6:0/547514605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 0x7f83200f90a0 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.051+0000 7f83248fa700 1 --2- 172.21.15.6:0/547514605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83200f79a0 0x7f83200f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.051+0000 7f83248fa700 1 -- 172.21.15.6:0/547514605 >> 172.21.15.6:0/547514605 conn(0x7f83200f3100 msgr2=0x7f83200f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.051+0000 7f83248fa700 1 -- 172.21.15.6:0/547514605 shutdown_connections 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.051+0000 7f83248fa700 1 -- 172.21.15.6:0/547514605 wait complete. 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.051+0000 7f83248fa700 1 Processor -- start 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.051+0000 7f83248fa700 1 -- start start 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f83248fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83200f79a0 0x7f8320108130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f83248fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 0x7f8320108620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f83248fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8320108c60 con 0x7f83200f8c40 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f83248fa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8320108da0 con 0x7f83200f79a0 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f831dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 0x7f8320108620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f831dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 0x7f8320108620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34618/0 (socket says 172.21.15.6:34618) 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f831dd9b700 1 -- 172.21.15.6:0/4164049907 learned_addr learned my addr 172.21.15.6:0/4164049907 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f831e59c700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83200f79a0 0x7f8320108130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f831dd9b700 1 -- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83200f79a0 msgr2=0x7f8320108130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f831dd9b700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83200f79a0 0x7f8320108130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f831dd9b700 1 -- 172.21.15.6:0/4164049907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8314005040 con 0x7f83200f8c40 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f831dd9b700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 0x7f8320108620 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f8314013510 tx=0x7f8314009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f830f7fe700 1 -- 172.21.15.6:0/4164049907 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f831400e030 con 0x7f83200f8c40 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f830f7fe700 1 -- 172.21.15.6:0/4164049907 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8314007e90 con 0x7f83200f8c40 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f832010d7e0 con 0x7f83200f8c40 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f830f7fe700 1 -- 172.21.15.6:0/4164049907 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8314018070 con 0x7f83200f8c40 2024-03-12T16:06:35.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.052+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f832010dcc0 con 0x7f83200f8c40 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.053+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f832005f5f0 con 0x7f83200f8c40 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.054+0000 7f830f7fe700 1 -- 172.21.15.6:0/4164049907 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f831401da20 con 0x7f83200f8c40 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.054+0000 7f830f7fe700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8308061160 0x7f8308063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.054+0000 7f830f7fe700 1 -- 172.21.15.6:0/4164049907 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f831407db50 con 0x7f83200f8c40 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.054+0000 7f831e59c700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8308061160 0x7f8308063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.054+0000 7f830f7fe700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] conn(0x7f8308066d30 0x7f8308069170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.054+0000 7f830f7fe700 1 -- 172.21.15.6:0/4164049907 --> [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f83080697f0 con 0x7f8308066d30 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.054+0000 7f830f7fe700 1 -- 172.21.15.6:0/4164049907 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8314082220 con 0x7f83200f8c40 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.055+0000 7f831e59c700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8308061160 0x7f8308063620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f83200f8aa0 tx=0x7f8310008040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.055+0000 7f831ed9d700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] conn(0x7f8308066d30 0x7f8308069170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:35.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.055+0000 7f831ed9d700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] conn(0x7f8308066d30 0x7f8308069170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.5 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.056+0000 7f830f7fe700 1 -- 172.21.15.6:0/4164049907 <== osd.5 v2:172.21.15.134:6816/876055595 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f83080697f0 con 0x7f8308066d30 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.071+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 --> [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f8320059360 con 0x7f8308066d30 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.071+0000 7f830f7fe700 1 -- 172.21.15.6:0/4164049907 <== osd.5 v2:172.21.15.134:6816/876055595 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+12 (crc 0 0 0) 0x7f8320059360 con 0x7f8308066d30 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] conn(0x7f8308066d30 msgr2=0x7f8308069170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] conn(0x7f8308066d30 0x7f8308069170 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8308061160 msgr2=0x7f8308063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8308061160 0x7f8308063620 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f83200f8aa0 tx=0x7f8310008040).stop 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 msgr2=0x7f8320108620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 0x7f8320108620 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f8314013510 tx=0x7f8314009cb0).stop 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 shutdown_connections 2024-03-12T16:06:35.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:6816/876055595,v1:172.21.15.134:6817/876055595] conn(0x7f8308066d30 0x7f8308069170 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8308061160 0x7f8308063620 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83200f79a0 0x7f8320108130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 --2- 172.21.15.6:0/4164049907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83200f8c40 0x7f8320108620 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 >> 172.21.15.6:0/4164049907 conn(0x7f83200f3100 msgr2=0x7f83200fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 shutdown_connections 2024-03-12T16:06:35.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:35.072+0000 7f83248fa700 1 -- 172.21.15.6:0/4164049907 wait complete. 2024-03-12T16:06:36.103 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:36.615 INFO:teuthology.orchestra.run.smithi006.stdout:158913789962 2024-03-12T16:06:36.615 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.5 2024-03-12T16:06:36.675 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:37.159 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:35.966226+0000 mgr.smithi006.kskdce (mgr.14196) 163 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:37.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:35.966226+0000 mgr.smithi006.kskdce (mgr.14196) 163 : cluster [DBG] pgmap v144: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:37.832 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:37.832 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:39.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:37.966645+0000 mgr.smithi006.kskdce (mgr.14196) 164 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:39.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:37.966645+0000 mgr.smithi006.kskdce (mgr.14196) 164 : cluster [DBG] pgmap v145: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:39.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.674+0000 7f110d4c8700 1 -- 172.21.15.6:0/829238551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 msgr2=0x7f11080f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.674+0000 7f110d4c8700 1 --2- 172.21.15.6:0/829238551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 0x7f11080f6cc0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f10f80047f0 tx=0x7f10f8009cb0).stop 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.674+0000 7f110d4c8700 1 -- 172.21.15.6:0/829238551 shutdown_connections 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.674+0000 7f110d4c8700 1 --2- 172.21.15.6:0/829238551 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11080f7b40 0x7f11080f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.674+0000 7f110d4c8700 1 --2- 172.21.15.6:0/829238551 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 0x7f11080f6cc0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.674+0000 7f110d4c8700 1 -- 172.21.15.6:0/829238551 >> 172.21.15.6:0/829238551 conn(0x7f11080f2020 msgr2=0x7f11080f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.674+0000 7f110d4c8700 1 -- 172.21.15.6:0/829238551 shutdown_connections 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.674+0000 7f110d4c8700 1 -- 172.21.15.6:0/829238551 wait complete. 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.675+0000 7f110d4c8700 1 Processor -- start 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.675+0000 7f110d4c8700 1 -- start start 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.675+0000 7f110d4c8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 0x7f1108108090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:39.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.675+0000 7f110d4c8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11080f7b40 0x7f1108108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.675+0000 7f110d4c8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1108108b30 con 0x7f11080f68a0 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.675+0000 7f110d4c8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1108108c70 con 0x7f11080f7b40 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.675+0000 7f1106ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 0x7f1108108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.675+0000 7f1106ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 0x7f1108108090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34644/0 (socket says 172.21.15.6:34644) 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f1106ffd700 1 -- 172.21.15.6:0/2133926263 learned_addr learned my addr 172.21.15.6:0/2133926263 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f11067fc700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11080f7b40 0x7f1108108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f1106ffd700 1 -- 172.21.15.6:0/2133926263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11080f7b40 msgr2=0x7f1108108580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f1106ffd700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11080f7b40 0x7f1108108580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f1106ffd700 1 -- 172.21.15.6:0/2133926263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10f8005040 con 0x7f11080f68a0 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f1106ffd700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 0x7f1108108090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f10f8013470 tx=0x7f10f8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f10effff700 1 -- 172.21.15.6:0/2133926263 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10f800e030 con 0x7f11080f68a0 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f110810d6b0 con 0x7f11080f68a0 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f10effff700 1 -- 172.21.15.6:0/2133926263 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f10f8007e90 con 0x7f11080f68a0 2024-03-12T16:06:39.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f10effff700 1 -- 172.21.15.6:0/2133926263 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10f8018070 con 0x7f11080f68a0 2024-03-12T16:06:39.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.676+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f110810dbf0 con 0x7f11080f68a0 2024-03-12T16:06:39.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.677+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f11080feff0 con 0x7f11080f68a0 2024-03-12T16:06:39.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.678+0000 7f10effff700 1 -- 172.21.15.6:0/2133926263 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f10f801d420 con 0x7f11080f68a0 2024-03-12T16:06:39.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.678+0000 7f10effff700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f10f0061180 0x7f10f0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:39.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.678+0000 7f10effff700 1 -- 172.21.15.6:0/2133926263 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f10f807da90 con 0x7f11080f68a0 2024-03-12T16:06:39.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.678+0000 7f11067fc700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f10f0061180 0x7f10f0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:39.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.678+0000 7f11067fc700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f10f0061180 0x7f10f0063640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f10fc004d20 tx=0x7f10fc009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:39.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.682+0000 7f10effff700 1 -- 172.21.15.6:0/2133926263 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f10f8051d60 con 0x7f11080f68a0 2024-03-12T16:06:39.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.853+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) v1 -- 0x7f110810e480 con 0x7f11080f68a0 2024-03-12T16:06:39.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.853+0000 7f10effff700 1 -- 172.21.15.6:0/2133926263 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f10f8051950 con 0x7f11080f68a0 2024-03-12T16:06:39.855 INFO:teuthology.orchestra.run.smithi006.stdout:111669149716 2024-03-12T16:06:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f10f0061180 msgr2=0x7f10f0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f10f0061180 0x7f10f0063640 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f10fc004d20 tx=0x7f10fc009040).stop 2024-03-12T16:06:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 msgr2=0x7f1108108090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 0x7f1108108090 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f10f8013470 tx=0x7f10f8009cb0).stop 2024-03-12T16:06:39.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 shutdown_connections 2024-03-12T16:06:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f10f0061180 0x7f10f0063640 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f11080f68a0 0x7f1108108090 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 --2- 172.21.15.6:0/2133926263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f11080f7b40 0x7f1108108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 >> 172.21.15.6:0/2133926263 conn(0x7f11080f2020 msgr2=0x7f1108061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 shutdown_connections 2024-03-12T16:06:39.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:39.855+0000 7f110d4c8700 1 -- 172.21.15.6:0/2133926263 wait complete. 2024-03-12T16:06:40.173 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:39.854160+0000 mon.smithi006 (mon.0) 472 : audit [DBG] from='client.? 172.21.15.6:0/2133926263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-12T16:06:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.128+0000 7f80490c4700 1 -- 172.21.15.6:0/2851560413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 msgr2=0x7f80440f6cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.128+0000 7f80490c4700 1 --2- 172.21.15.6:0/2851560413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 0x7f80440f6cc0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7f80340047f0 tx=0x7f8034009cb0).stop 2024-03-12T16:06:40.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.128+0000 7f80490c4700 1 -- 172.21.15.6:0/2851560413 shutdown_connections 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.128+0000 7f80490c4700 1 --2- 172.21.15.6:0/2851560413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80440f7b40 0x7f80440f7fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.128+0000 7f80490c4700 1 --2- 172.21.15.6:0/2851560413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 0x7f80440f6cc0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.128+0000 7f80490c4700 1 -- 172.21.15.6:0/2851560413 >> 172.21.15.6:0/2851560413 conn(0x7f80440f2020 msgr2=0x7f80440f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.128+0000 7f80490c4700 1 -- 172.21.15.6:0/2851560413 shutdown_connections 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.128+0000 7f80490c4700 1 -- 172.21.15.6:0/2851560413 wait complete. 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f80490c4700 1 Processor -- start 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f80490c4700 1 -- start start 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f80490c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 0x7f8044108090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f80490c4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80440f7b40 0x7f8044108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f80490c4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8044108b30 con 0x7f80440f68a0 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f80490c4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8044108c70 con 0x7f80440f7b40 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f8042d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 0x7f8044108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f8042d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 0x7f8044108090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34660/0 (socket says 172.21.15.6:34660) 2024-03-12T16:06:40.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f8042d9d700 1 -- 172.21.15.6:0/96620671 learned_addr learned my addr 172.21.15.6:0/96620671 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.129+0000 7f803a59c700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80440f7b40 0x7f8044108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.130+0000 7f8042d9d700 1 -- 172.21.15.6:0/96620671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80440f7b40 msgr2=0x7f8044108580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.130+0000 7f8042d9d700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80440f7b40 0x7f8044108580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.130+0000 7f8042d9d700 1 -- 172.21.15.6:0/96620671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8034005040 con 0x7f80440f68a0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.130+0000 7f8042d9d700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 0x7f8044108090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f8034013470 tx=0x7f8034009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.130+0000 7f8040d99700 1 -- 172.21.15.6:0/96620671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f803400e030 con 0x7f80440f68a0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.130+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f804410d6b0 con 0x7f80440f68a0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.130+0000 7f8040d99700 1 -- 172.21.15.6:0/96620671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8034007e90 con 0x7f80440f68a0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.130+0000 7f8040d99700 1 -- 172.21.15.6:0/96620671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8034018070 con 0x7f80440f68a0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.130+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f804410dbf0 con 0x7f80440f68a0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.131+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_get_version(what=osdmap handle=1) v1 -- 0x7f8044061c00 con 0x7f80440f68a0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.131+0000 7f8040d99700 1 -- 172.21.15.6:0/96620671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f803401c780 con 0x7f80440f68a0 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.131+0000 7f8040d99700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8030061180 0x7f8030063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:40.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.132+0000 7f8040d99700 1 -- 172.21.15.6:0/96620671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f803407db70 con 0x7f80440f68a0 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.132+0000 7f803a59c700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8030061180 0x7f8030063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.132+0000 7f8040d99700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] conn(0x7f8030066d50 0x7f8030069190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.132+0000 7f8040d99700 1 -- 172.21.15.6:0/96620671 --> [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] -- command(tid 1: {"prefix": "get_command_descriptions"}) v1 -- 0x7f8030069810 con 0x7f8030066d50 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.132+0000 7f8040d99700 1 -- 172.21.15.6:0/96620671 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_get_version_reply(handle=1 version=38) v2 ==== 24+0+0 (secure 0 0 0) 0x7f8034082220 con 0x7f80440f68a0 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.132+0000 7f804359e700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] conn(0x7f8030066d50 0x7f8030069190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.132+0000 7f803a59c700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8030061180 0x7f8030063640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f802c004d20 tx=0x7f802c009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.132+0000 7f804359e700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] conn(0x7f8030066d50 0x7f8030069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.133+0000 7f8040d99700 1 -- 172.21.15.6:0/96620671 <== osd.0 v2:172.21.15.6:6802/782473340 1 ==== command_reply(tid 1: 0 ) v1 ==== 8+0+23213 (crc 0 0 0) 0x7f8030069810 con 0x7f8030066d50 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.147+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 --> [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] -- command(tid 2: {"prefix": "flush_pg_stats"}) v1 -- 0x7f80440fc240 con 0x7f8030066d50 2024-03-12T16:06:40.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.147+0000 7f8040d99700 1 -- 172.21.15.6:0/96620671 <== osd.0 v2:172.21.15.6:6802/782473340 2 ==== command_reply(tid 2: 0 ) v1 ==== 8+0+11 (crc 0 0 0) 0x7f80440fc240 con 0x7f8030066d50 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] conn(0x7f8030066d50 msgr2=0x7f8030069190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] conn(0x7f8030066d50 0x7f8030069190 crc :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8030061180 msgr2=0x7f8030063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8030061180 0x7f8030063640 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7f802c004d20 tx=0x7f802c009040).stop 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 msgr2=0x7f8044108090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 0x7f8044108090 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7f8034013470 tx=0x7f8034009cb0).stop 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 shutdown_connections 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8030061180 0x7f8030063640 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80440f68a0 0x7f8044108090 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.6:6802/782473340,v1:172.21.15.6:6803/782473340] conn(0x7f8030066d50 0x7f8030069190 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 --2- 172.21.15.6:0/96620671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80440f7b40 0x7f8044108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 >> 172.21.15.6:0/96620671 conn(0x7f80440f2020 msgr2=0x7f8044061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 shutdown_connections 2024-03-12T16:06:40.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.148+0000 7f80490c4700 1 -- 172.21.15.6:0/96620671 wait complete. 2024-03-12T16:06:40.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:39.854160+0000 mon.smithi006 (mon.0) 472 : audit [DBG] from='client.? 172.21.15.6:0/2133926263' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.970+0000 7f88011e2700 1 -- 172.21.15.6:0/2609234616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 msgr2=0x7f87fc0f6130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.970+0000 7f88011e2700 1 --2- 172.21.15.6:0/2609234616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 0x7f87fc0f6130 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7f87ec0047f0 tx=0x7f87ec009cb0).stop 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.970+0000 7f88011e2700 1 -- 172.21.15.6:0/2609234616 shutdown_connections 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.970+0000 7f88011e2700 1 --2- 172.21.15.6:0/2609234616 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87fc0f66b0 0x7f87fc0fcfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.970+0000 7f88011e2700 1 --2- 172.21.15.6:0/2609234616 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 0x7f87fc0f6130 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.970+0000 7f88011e2700 1 -- 172.21.15.6:0/2609234616 >> 172.21.15.6:0/2609234616 conn(0x7f87fc0f1770 msgr2=0x7f87fc0f3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.970+0000 7f88011e2700 1 -- 172.21.15.6:0/2609234616 shutdown_connections 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.970+0000 7f88011e2700 1 -- 172.21.15.6:0/2609234616 wait complete. 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.971+0000 7f88011e2700 1 Processor -- start 2024-03-12T16:06:41.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.971+0000 7f88011e2700 1 -- start start 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f88011e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 0x7f87fc0f8720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f88011e2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87fc0f66b0 0x7f87fc0f6d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f88011e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0f8cd0 con 0x7f87fc0f5d10 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f88011e2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87fc0f7270 con 0x7f87fc0f66b0 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87fad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 0x7f87fc0f8720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87fad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 0x7f87fc0f8720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34678/0 (socket says 172.21.15.6:34678) 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87fad9d700 1 -- 172.21.15.6:0/796789390 learned_addr learned my addr 172.21.15.6:0/796789390 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87fad9d700 1 -- 172.21.15.6:0/796789390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87fc0f66b0 msgr2=0x7f87fc0f6d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87fad9d700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87fc0f66b0 0x7f87fc0f6d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87fad9d700 1 -- 172.21.15.6:0/796789390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87ec005040 con 0x7f87fc0f5d10 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87fad9d700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 0x7f87fc0f8720 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f87ec013510 tx=0x7f87ec009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:41.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87e3fff700 1 -- 172.21.15.6:0/796789390 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87ec00e030 con 0x7f87fc0f5d10 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87fc0f7490 con 0x7f87fc0f5d10 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87e3fff700 1 -- 172.21.15.6:0/796789390 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f87ec007e90 con 0x7f87fc0f5d10 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f87e3fff700 1 -- 172.21.15.6:0/796789390 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87ec018070 con 0x7f87fc0f5d10 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.972+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87fc0f7970 con 0x7f87fc0f5d10 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.973+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87fc0f7b90 con 0x7f87fc0f5d10 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.974+0000 7f87e3fff700 1 -- 172.21.15.6:0/796789390 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f87ec01da20 con 0x7f87fc0f5d10 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.974+0000 7f87e3fff700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f87e4061180 0x7f87e4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.974+0000 7f87e3fff700 1 -- 172.21.15.6:0/796789390 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f87ec07db60 con 0x7f87fc0f5d10 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.974+0000 7f87fa59c700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f87e4061180 0x7f87e4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.974+0000 7f87fa59c700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f87e4061180 0x7f87e4063640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f87fc0f6b30 tx=0x7f87f0007be0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:41.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:40.978+0000 7f87e3fff700 1 -- 172.21.15.6:0/796789390 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f87ec051e30 con 0x7f87fc0f5d10 2024-03-12T16:06:41.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.152+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) v1 -- 0x7f87fc100110 con 0x7f87fc0f5d10 2024-03-12T16:06:41.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.152+0000 7f87e3fff700 1 -- 172.21.15.6:0/796789390 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7f87ec051a20 con 0x7f87fc0f5d10 2024-03-12T16:06:41.154 INFO:teuthology.orchestra.run.smithi006.stdout:81604378653 2024-03-12T16:06:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f87e4061180 msgr2=0x7f87e4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f87e4061180 0x7f87e4063640 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f87fc0f6b30 tx=0x7f87f0007be0).stop 2024-03-12T16:06:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 msgr2=0x7f87fc0f8720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:41.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 0x7f87fc0f8720 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f87ec013510 tx=0x7f87ec009cb0).stop 2024-03-12T16:06:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 shutdown_connections 2024-03-12T16:06:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f87e4061180 0x7f87e4063640 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87fc0f5d10 0x7f87fc0f8720 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 --2- 172.21.15.6:0/796789390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87fc0f66b0 0x7f87fc0f6d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:06:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 >> 172.21.15.6:0/796789390 conn(0x7f87fc0f1770 msgr2=0x7f87fc0f97c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 shutdown_connections 2024-03-12T16:06:41.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:41.154+0000 7f88011e2700 1 -- 172.21.15.6:0/796789390 wait complete. 2024-03-12T16:06:41.452 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:39.967082+0000 mgr.smithi006.kskdce (mgr.14196) 165 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:41.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:39.967082+0000 mgr.smithi006.kskdce (mgr.14196) 165 : cluster [DBG] pgmap v146: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:41.473 INFO:teuthology.orchestra.run.smithi006.stdout:38654705704 2024-03-12T16:06:41.473 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph osd last-stat-seq osd.0 2024-03-12T16:06:42.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:41.153140+0000 mon.smithi006 (mon.0) 473 : audit [DBG] from='client.? 172.21.15.6:0/796789390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-12T16:06:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:41.153140+0000 mon.smithi006 (mon.0) 473 : audit [DBG] from='client.? 172.21.15.6:0/796789390' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-03-12T16:06:42.500 INFO:tasks.cephadm.ceph_manager.ceph:need seq 81604378651 got 81604378653 for osd.2 2024-03-12T16:06:42.500 DEBUG:teuthology.parallel:result is None 2024-03-12T16:06:43.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:41.967518+0000 mgr.smithi006.kskdce (mgr.14196) 166 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:43.239 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149714 got 111669149716 for osd.3 2024-03-12T16:06:43.240 DEBUG:teuthology.parallel:result is None 2024-03-12T16:06:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:41.967518+0000 mgr.smithi006.kskdce (mgr.14196) 166 : cluster [DBG] pgmap v147: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:44.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.007+0000 7fe1d4140700 1 -- 172.21.15.6:0/3987595382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 msgr2=0x7fe1cc0f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:44.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.007+0000 7fe1d4140700 1 --2- 172.21.15.6:0/3987595382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 0x7fe1cc0f7fa0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7fe1bc0047f0 tx=0x7fe1bc009cb0).stop 2024-03-12T16:06:44.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.007+0000 7fe1d4140700 1 -- 172.21.15.6:0/3987595382 shutdown_connections 2024-03-12T16:06:44.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.007+0000 7fe1d4140700 1 --2- 172.21.15.6:0/3987595382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 0x7fe1cc0f7fa0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:44.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.007+0000 7fe1d4140700 1 --2- 172.21.15.6:0/3987595382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0f68a0 0x7fe1cc0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:44.011 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.007+0000 7fe1d4140700 1 -- 172.21.15.6:0/3987595382 >> 172.21.15.6:0/3987595382 conn(0x7fe1cc0f2020 msgr2=0x7fe1cc0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.007+0000 7fe1d4140700 1 -- 172.21.15.6:0/3987595382 shutdown_connections 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d4140700 1 -- 172.21.15.6:0/3987595382 wait complete. 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d4140700 1 Processor -- start 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d4140700 1 -- start start 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d4140700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0f68a0 0x7fe1cc0fa820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d4140700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 0x7fe1cc0f8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d4140700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0fadd0 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d4140700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe1cc0f9370 con 0x7fe1cc0f68a0 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d16db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 0x7fe1cc0f8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d16db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 0x7fe1cc0f8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49178/0 (socket says 172.21.15.6:49178) 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.008+0000 7fe1d16db700 1 -- 172.21.15.6:0/76310587 learned_addr learned my addr 172.21.15.6:0/76310587 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1d1edc700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0f68a0 0x7fe1cc0fa820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1d16db700 1 -- 172.21.15.6:0/76310587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0f68a0 msgr2=0x7fe1cc0fa820 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:44.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1d16db700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0f68a0 0x7fe1cc0fa820 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:44.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1d16db700 1 -- 172.21.15.6:0/76310587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe1bc005040 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1d16db700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 0x7fe1cc0f8e80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fe1bc013510 tx=0x7fe1bc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:44.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1c2ffd700 1 -- 172.21.15.6:0/76310587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1bc00e030 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe1cc0f9590 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1c2ffd700 1 -- 172.21.15.6:0/76310587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe1bc007e90 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1c2ffd700 1 -- 172.21.15.6:0/76310587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe1bc018070 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.009+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe1cc0f9a70 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.010+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe1cc0f9c90 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.010+0000 7fe1c2ffd700 1 -- 172.21.15.6:0/76310587 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fe1bc01d940 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.011+0000 7fe1c2ffd700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe1b8061180 0x7fe1b8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:44.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.011+0000 7fe1c2ffd700 1 -- 172.21.15.6:0/76310587 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fe1bc07daa0 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.011+0000 7fe1d1edc700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe1b8061180 0x7fe1b8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:44.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.011+0000 7fe1d1edc700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe1b8061180 0x7fe1b8063640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe1cc0f79a0 tx=0x7fe1c8009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:44.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.015+0000 7fe1c2ffd700 1 -- 172.21.15.6:0/76310587 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe1bc051d70 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.188+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) v1 -- 0x7fe1cc1106f0 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.189+0000 7fe1c2ffd700 1 -- 172.21.15.6:0/76310587 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fe1bc051960 con 0x7fe1cc0f7b40 2024-03-12T16:06:44.190 INFO:teuthology.orchestra.run.smithi006.stdout:60129542180 2024-03-12T16:06:44.191 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.190+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe1b8061180 msgr2=0x7fe1b8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.190+0000 7fe1d4140700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe1b8061180 0x7fe1b8063640 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fe1cc0f79a0 tx=0x7fe1c8009040).stop 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.190+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 msgr2=0x7fe1cc0f8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.190+0000 7fe1d4140700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 0x7fe1cc0f8e80 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fe1bc013510 tx=0x7fe1bc009cb0).stop 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.190+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 shutdown_connections 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.190+0000 7fe1d4140700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe1b8061180 0x7fe1b8063640 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.190+0000 7fe1d4140700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1cc0f68a0 0x7fe1cc0fa820 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.190+0000 7fe1d4140700 1 --2- 172.21.15.6:0/76310587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1cc0f7b40 0x7fe1cc0f8e80 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.190+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 >> 172.21.15.6:0/76310587 conn(0x7fe1cc0f2020 msgr2=0x7fe1cc061310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.191+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 shutdown_connections 2024-03-12T16:06:44.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:44.191+0000 7fe1d4140700 1 -- 172.21.15.6:0/76310587 wait complete. 2024-03-12T16:06:44.371 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:45.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:43.967792+0000 mgr.smithi006.kskdce (mgr.14196) 167 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:45.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:44.189478+0000 mon.smithi006 (mon.0) 474 : audit [DBG] from='client.? 172.21.15.6:0/76310587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-12T16:06:45.414 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:45.428 INFO:tasks.cephadm.ceph_manager.ceph:need seq 60129542177 got 60129542180 for osd.1 2024-03-12T16:06:45.428 DEBUG:teuthology.parallel:result is None 2024-03-12T16:06:45.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:43.967792+0000 mgr.smithi006.kskdce (mgr.14196) 167 : cluster [DBG] pgmap v148: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:45.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:44.189478+0000 mon.smithi006 (mon.0) 474 : audit [DBG] from='client.? 172.21.15.6:0/76310587' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-03-12T16:06:47.307 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:45.968068+0000 mgr.smithi006.kskdce (mgr.14196) 168 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:47.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:45.968068+0000 mgr.smithi006.kskdce (mgr.14196) 168 : cluster [DBG] pgmap v149: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.264+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3702438863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 msgr2=0x7fc4e00f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.264+0000 7fc4e6cb8700 1 --2- 172.21.15.6:0/3702438863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 0x7fc4e00f7fa0 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc4cc0047f0 tx=0x7fc4cc009cb0).stop 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.264+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3702438863 shutdown_connections 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.264+0000 7fc4e6cb8700 1 --2- 172.21.15.6:0/3702438863 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 0x7fc4e00f7fa0 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.264+0000 7fc4e6cb8700 1 --2- 172.21.15.6:0/3702438863 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e00f68a0 0x7fc4e00f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.264+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3702438863 >> 172.21.15.6:0/3702438863 conn(0x7fc4e00f2020 msgr2=0x7fc4e00f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.265+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3702438863 shutdown_connections 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.265+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3702438863 wait complete. 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.265+0000 7fc4e6cb8700 1 Processor -- start 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.265+0000 7fc4e6cb8700 1 -- start start 2024-03-12T16:06:48.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.265+0000 7fc4e6cb8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e00f68a0 0x7fc4e00615a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.265+0000 7fc4e6cb8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 0x7fc4e010ce50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.265+0000 7fc4e6cb8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e010d340 con 0x7fc4e00f7b40 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.265+0000 7fc4e6cb8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc4e010d480 con 0x7fc4e00f68a0 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 0x7fc4e010ce50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4dffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 0x7fc4e010ce50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49204/0 (socket says 172.21.15.6:49204) 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4dffff700 1 -- 172.21.15.6:0/3544309348 learned_addr learned my addr 172.21.15.6:0/3544309348 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4e4a54700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e00f68a0 0x7fc4e00615a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4dffff700 1 -- 172.21.15.6:0/3544309348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e00f68a0 msgr2=0x7fc4e00615a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4dffff700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e00f68a0 0x7fc4e00615a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4dffff700 1 -- 172.21.15.6:0/3544309348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc4cc005040 con 0x7fc4e00f7b40 2024-03-12T16:06:48.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4dffff700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 0x7fc4e010ce50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc4cc013470 tx=0x7fc4cc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:48.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4ddffb700 1 -- 172.21.15.6:0/3544309348 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4cc00e030 con 0x7fc4e00f7b40 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4ddffb700 1 -- 172.21.15.6:0/3544309348 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fc4cc007e90 con 0x7fc4e00f7b40 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc4e010d680 con 0x7fc4e00f7b40 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4ddffb700 1 -- 172.21.15.6:0/3544309348 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc4cc018070 con 0x7fc4e00f7b40 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.266+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc4e010db30 con 0x7fc4e00f7b40 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.267+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc4e00feff0 con 0x7fc4e00f7b40 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.268+0000 7fc4ddffb700 1 -- 172.21.15.6:0/3544309348 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fc4cc01d420 con 0x7fc4e00f7b40 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.268+0000 7fc4ddffb700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fc4d0061180 0x7fc4d0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.268+0000 7fc4ddffb700 1 -- 172.21.15.6:0/3544309348 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fc4cc07d850 con 0x7fc4e00f7b40 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.268+0000 7fc4e4a54700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fc4d0061180 0x7fc4d0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:48.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.269+0000 7fc4e4a54700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fc4d0061180 0x7fc4d0063640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fc4e00f79a0 tx=0x7fc4d400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:48.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.272+0000 7fc4ddffb700 1 -- 172.21.15.6:0/3544309348 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fc4cc051ba0 con 0x7fc4e00f7b40 2024-03-12T16:06:48.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.446+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) v1 -- 0x7fc4e0100e60 con 0x7fc4e00f7b40 2024-03-12T16:06:48.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.446+0000 7fc4ddffb700 1 -- 172.21.15.6:0/3544309348 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) v1 ==== 74+0+12 (secure 0 0 0) 0x7fc4cc051790 con 0x7fc4e00f7b40 2024-03-12T16:06:48.448 INFO:teuthology.orchestra.run.smithi006.stdout:38654705705 2024-03-12T16:06:48.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fc4d0061180 msgr2=0x7fc4d0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:48.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fc4d0061180 0x7fc4d0063640 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7fc4e00f79a0 tx=0x7fc4d400b040).stop 2024-03-12T16:06:48.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 msgr2=0x7fc4e010ce50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:48.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 0x7fc4e010ce50 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fc4cc013470 tx=0x7fc4cc009cb0).stop 2024-03-12T16:06:48.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 shutdown_connections 2024-03-12T16:06:48.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fc4d0061180 0x7fc4d0063640 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:48.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4e00f68a0 0x7fc4e00615a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:48.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 --2- 172.21.15.6:0/3544309348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4e00f7b40 0x7fc4e010ce50 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:48.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 >> 172.21.15.6:0/3544309348 conn(0x7fc4e00f2020 msgr2=0x7fc4e00fb590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:48.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 shutdown_connections 2024-03-12T16:06:48.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.448+0000 7fc4e6cb8700 1 -- 172.21.15.6:0/3544309348 wait complete. 2024-03-12T16:06:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.923+0000 7f6280ceb700 1 -- 172.21.15.6:0/647840612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f7b40 msgr2=0x7f627c0f7fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.923+0000 7f6280ceb700 1 --2- 172.21.15.6:0/647840612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f7b40 0x7f627c0f7fa0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f62700047f0 tx=0x7f6270009cb0).stop 2024-03-12T16:06:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.923+0000 7f6280ceb700 1 -- 172.21.15.6:0/647840612 shutdown_connections 2024-03-12T16:06:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.923+0000 7f6280ceb700 1 --2- 172.21.15.6:0/647840612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f7b40 0x7f627c0f7fa0 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.923+0000 7f6280ceb700 1 --2- 172.21.15.6:0/647840612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f627c0f68a0 0x7f627c0f6cc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.923+0000 7f6280ceb700 1 -- 172.21.15.6:0/647840612 >> 172.21.15.6:0/647840612 conn(0x7f627c0f2020 msgr2=0x7f627c0f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.923+0000 7f6280ceb700 1 -- 172.21.15.6:0/647840612 shutdown_connections 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.923+0000 7f6280ceb700 1 -- 172.21.15.6:0/647840612 wait complete. 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.924+0000 7f6280ceb700 1 Processor -- start 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.924+0000 7f6280ceb700 1 -- start start 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.924+0000 7f6280ceb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f68a0 0x7f627c108050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.924+0000 7f6280ceb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f627c0f7b40 0x7f627c108540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.924+0000 7f6280ceb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c108af0 con 0x7f627c0f68a0 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.924+0000 7f6280ceb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f627c108c30 con 0x7f627c0f7b40 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f627a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f68a0 0x7f627c108050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f627a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f68a0 0x7f627c108050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49228/0 (socket says 172.21.15.6:49228) 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f627a59c700 1 -- 172.21.15.6:0/1729227477 learned_addr learned my addr 172.21.15.6:0/1729227477 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f6279d9b700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f627c0f7b40 0x7f627c108540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f627a59c700 1 -- 172.21.15.6:0/1729227477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f627c0f7b40 msgr2=0x7f627c108540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f627a59c700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f627c0f7b40 0x7f627c108540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f627a59c700 1 -- 172.21.15.6:0/1729227477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6270005040 con 0x7f627c0f68a0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f627a59c700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f68a0 0x7f627c108050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f626c002820 tx=0x7f626c009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f626b7fe700 1 -- 172.21.15.6:0/1729227477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626c007b40 con 0x7f627c0f68a0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f626b7fe700 1 -- 172.21.15.6:0/1729227477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f626c00f040 con 0x7f627c0f68a0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f627c10d6d0 con 0x7f627c0f68a0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f626b7fe700 1 -- 172.21.15.6:0/1729227477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f626c0147c0 con 0x7f627c0f68a0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.925+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f627c10dc10 con 0x7f627c0f68a0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.926+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f627c0feff0 con 0x7f627c0f68a0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.927+0000 7f626b7fe700 1 -- 172.21.15.6:0/1729227477 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f626c009110 con 0x7f627c0f68a0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.927+0000 7f626b7fe700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6264061180 0x7f6264063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.927+0000 7f626b7fe700 1 -- 172.21.15.6:0/1729227477 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f626c07c150 con 0x7f627c0f68a0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.927+0000 7f6279d9b700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6264061180 0x7f6264063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.927+0000 7f6279d9b700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6264061180 0x7f6264063640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6270013470 tx=0x7f6270009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:48.931+0000 7f626b7fe700 1 -- 172.21.15.6:0/1729227477 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f626c050420 con 0x7f627c0f68a0 2024-03-12T16:06:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.028+0000 7fccd7c37700 1 -- 172.21.15.6:0/1537150209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f8770 msgr2=0x7fccd00ff190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.028+0000 7fccd7c37700 1 --2- 172.21.15.6:0/1537150209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f8770 0x7fccd00ff190 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7fccc0004820 tx=0x7fccc0009cb0).stop 2024-03-12T16:06:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.028+0000 7fccd7c37700 1 -- 172.21.15.6:0/1537150209 shutdown_connections 2024-03-12T16:06:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.028+0000 7fccd7c37700 1 --2- 172.21.15.6:0/1537150209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f8770 0x7fccd00ff190 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.028+0000 7fccd7c37700 1 --2- 172.21.15.6:0/1537150209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd00f7e60 0x7fccd00f8280 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.028+0000 7fccd7c37700 1 -- 172.21.15.6:0/1537150209 >> 172.21.15.6:0/1537150209 conn(0x7fccd00f1650 msgr2=0x7fccd00f3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.028+0000 7fccd7c37700 1 -- 172.21.15.6:0/1537150209 shutdown_connections 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.028+0000 7fccd7c37700 1 -- 172.21.15.6:0/1537150209 wait complete. 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd7c37700 1 Processor -- start 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd7c37700 1 -- start start 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd7c37700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f7e60 0x7fccd010a240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd7c37700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd00f8770 0x7fccd010a730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd7c37700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd010ace0 con 0x7fccd00f7e60 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd7c37700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fccd010ae20 con 0x7fccd00f8770 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd59d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f7e60 0x7fccd010a240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd59d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f7e60 0x7fccd010a240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49242/0 (socket says 172.21.15.6:49242) 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd59d3700 1 -- 172.21.15.6:0/2958275645 learned_addr learned my addr 172.21.15.6:0/2958275645 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd51d2700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd00f8770 0x7fccd010a730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd59d3700 1 -- 172.21.15.6:0/2958275645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd00f8770 msgr2=0x7fccd010a730 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:49.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd59d3700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd00f8770 0x7fccd010a730 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd59d3700 1 -- 172.21.15.6:0/2958275645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fccc0005040 con 0x7fccd00f7e60 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd51d2700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd00f8770 0x7fccd010a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.029+0000 7fccd59d3700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f7e60 0x7fccd010a240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fcccc0041d0 tx=0x7fcccc009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.030+0000 7fccc6ffd700 1 -- 172.21.15.6:0/2958275645 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcccc002d90 con 0x7fccd00f7e60 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.030+0000 7fccc6ffd700 1 -- 172.21.15.6:0/2958275645 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fcccc00f040 con 0x7fccd00f7e60 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.030+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fccd010b7c0 con 0x7fccd00f7e60 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.030+0000 7fccc6ffd700 1 -- 172.21.15.6:0/2958275645 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcccc00d820 con 0x7fccd00f7e60 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.030+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fccd010bd00 con 0x7fccd00f7e60 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.031+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fccd0046ce0 con 0x7fccd00f7e60 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.032+0000 7fccc6ffd700 1 -- 172.21.15.6:0/2958275645 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fcccc007b40 con 0x7fccd00f7e60 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.032+0000 7fccc6ffd700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fccbc0611d0 0x7fccbc063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.032+0000 7fccc6ffd700 1 -- 172.21.15.6:0/2958275645 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fcccc07c4a0 con 0x7fccd00f7e60 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.032+0000 7fccd51d2700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fccbc0611d0 0x7fccbc063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.033+0000 7fccd51d2700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fccbc0611d0 0x7fccbc063690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fccc00043d0 tx=0x7fccc000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:49.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.036+0000 7fccc6ffd700 1 -- 172.21.15.6:0/2958275645 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fcccc0507f0 con 0x7fccd00f7e60 2024-03-12T16:06:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.110+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 5} v 0) v1 -- 0x7f627c10e5d0 con 0x7f627c0f68a0 2024-03-12T16:06:49.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.110+0000 7f626b7fe700 1 -- 172.21.15.6:0/1729227477 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 5}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7f626c050010 con 0x7f627c0f68a0 2024-03-12T16:06:49.111 INFO:teuthology.orchestra.run.smithi006.stdout:158913789965 2024-03-12T16:06:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6264061180 msgr2=0x7f6264063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6264061180 0x7f6264063640 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7f6270013470 tx=0x7f6270009cb0).stop 2024-03-12T16:06:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f68a0 msgr2=0x7f627c108050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f68a0 0x7f627c108050 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f626c002820 tx=0x7f626c009f00).stop 2024-03-12T16:06:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 shutdown_connections 2024-03-12T16:06:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6264061180 0x7f6264063640 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f627c0f68a0 0x7f627c108050 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 --2- 172.21.15.6:0/1729227477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f627c0f7b40 0x7f627c108540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 >> 172.21.15.6:0/1729227477 conn(0x7f627c0f2020 msgr2=0x7f627c060af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:49.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 shutdown_connections 2024-03-12T16:06:49.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.113+0000 7f6280ceb700 1 -- 172.21.15.6:0/1729227477 wait complete. 2024-03-12T16:06:49.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.223+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 4} v 0) v1 -- 0x7fccd01042e0 con 0x7fccd00f7e60 2024-03-12T16:06:49.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.223+0000 7fccc6ffd700 1 -- 172.21.15.6:0/2958275645 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 4}]=0 v0) v1 ==== 74+0+13 (secure 0 0 0) 0x7fcccc0503e0 con 0x7fccd00f7e60 2024-03-12T16:06:49.225 INFO:teuthology.orchestra.run.smithi006.stdout:137438953490 2024-03-12T16:06:49.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fccbc0611d0 msgr2=0x7fccbc063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:49.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fccbc0611d0 0x7fccbc063690 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7fccc00043d0 tx=0x7fccc000b040).stop 2024-03-12T16:06:49.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f7e60 msgr2=0x7fccd010a240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f7e60 0x7fccd010a240 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fcccc0041d0 tx=0x7fcccc009f60).stop 2024-03-12T16:06:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 shutdown_connections 2024-03-12T16:06:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fccbc0611d0 0x7fccbc063690 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fccd00f7e60 0x7fccd010a240 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 --2- 172.21.15.6:0/2958275645 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fccd00f8770 0x7fccd010a730 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 >> 172.21.15.6:0/2958275645 conn(0x7fccd00f1650 msgr2=0x7fccd00f3ab0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 shutdown_connections 2024-03-12T16:06:49.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:49.225+0000 7fccd7c37700 1 -- 172.21.15.6:0/2958275645 wait complete. 2024-03-12T16:06:49.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:47.968499+0000 mgr.smithi006.kskdce (mgr.14196) 169 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:49.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:48.447177+0000 mon.smithi006 (mon.0) 475 : audit [DBG] from='client.? 172.21.15.6:0/3544309348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-12T16:06:49.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:47.968499+0000 mgr.smithi006.kskdce (mgr.14196) 169 : cluster [DBG] pgmap v150: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:49.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:48.447177+0000 mon.smithi006 (mon.0) 475 : audit [DBG] from='client.? 172.21.15.6:0/3544309348' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-03-12T16:06:49.717 INFO:tasks.cephadm.ceph_manager.ceph:need seq 38654705704 got 38654705705 for osd.0 2024-03-12T16:06:49.717 DEBUG:teuthology.parallel:result is None 2024-03-12T16:06:50.319 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:49.111080+0000 mon.smithi006 (mon.0) 476 : audit [DBG] from='client.? 172.21.15.6:0/1729227477' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-12T16:06:50.319 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:49.223825+0000 mon.smithi006 (mon.0) 477 : audit [DBG] from='client.? 172.21.15.6:0/2958275645' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-12T16:06:50.341 INFO:tasks.cephadm.ceph_manager.ceph:need seq 158913789962 got 158913789965 for osd.5 2024-03-12T16:06:50.341 DEBUG:teuthology.parallel:result is None 2024-03-12T16:06:50.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:49.111080+0000 mon.smithi006 (mon.0) 476 : audit [DBG] from='client.? 172.21.15.6:0/1729227477' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-03-12T16:06:50.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:49.223825+0000 mon.smithi006 (mon.0) 477 : audit [DBG] from='client.? 172.21.15.6:0/2958275645' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-03-12T16:06:50.923 INFO:tasks.cephadm.ceph_manager.ceph:need seq 137438953486 got 137438953490 for osd.4 2024-03-12T16:06:50.923 DEBUG:teuthology.parallel:result is None 2024-03-12T16:06:50.923 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-03-12T16:06:50.924 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph pg dump --format=json 2024-03-12T16:06:51.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:49.968885+0000 mgr.smithi006.kskdce (mgr.14196) 170 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:51.211 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:51.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:49.968885+0000 mgr.smithi006.kskdce (mgr.14196) 170 : cluster [DBG] pgmap v151: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.972+0000 7f2647f48700 1 -- 172.21.15.6:0/2275533875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 msgr2=0x7f26400fa580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.972+0000 7f2647f48700 1 --2- 172.21.15.6:0/2275533875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 0x7f26400fa580 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f263c0047f0 tx=0x7f263c009cb0).stop 2024-03-12T16:06:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.972+0000 7f2647f48700 1 -- 172.21.15.6:0/2275533875 shutdown_connections 2024-03-12T16:06:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.972+0000 7f2647f48700 1 --2- 172.21.15.6:0/2275533875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400fab00 0x7f26400fcf50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:52.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.972+0000 7f2647f48700 1 --2- 172.21.15.6:0/2275533875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 0x7f26400fa580 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.972+0000 7f2647f48700 1 -- 172.21.15.6:0/2275533875 >> 172.21.15.6:0/2275533875 conn(0x7f26400f2020 msgr2=0x7f26400f4440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.972+0000 7f2647f48700 1 -- 172.21.15.6:0/2275533875 shutdown_connections 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.972+0000 7f2647f48700 1 -- 172.21.15.6:0/2275533875 wait complete. 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2647f48700 1 Processor -- start 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2647f48700 1 -- start start 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2647f48700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 0x7f26401080a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2647f48700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400fab00 0x7f2640108590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2647f48700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640108b40 con 0x7f26400617e0 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2647f48700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2640108c80 con 0x7f26400fab00 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2645ce4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 0x7f26401080a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2645ce4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 0x7f26401080a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57662/0 (socket says 172.21.15.6:57662) 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2645ce4700 1 -- 172.21.15.6:0/3116015173 learned_addr learned my addr 172.21.15.6:0/3116015173 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:52.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f26454e3700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400fab00 0x7f2640108590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2645ce4700 1 -- 172.21.15.6:0/3116015173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400fab00 msgr2=0x7f2640108590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2645ce4700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400fab00 0x7f2640108590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2645ce4700 1 -- 172.21.15.6:0/3116015173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f263c005040 con 0x7f26400617e0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.973+0000 7f2645ce4700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 0x7f26401080a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f263c013470 tx=0x7f263c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.974+0000 7f2632ffd700 1 -- 172.21.15.6:0/3116015173 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f263c00e030 con 0x7f26400617e0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.974+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f264010d6c0 con 0x7f26400617e0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.974+0000 7f2632ffd700 1 -- 172.21.15.6:0/3116015173 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f263c007e90 con 0x7f26400617e0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.974+0000 7f2632ffd700 1 -- 172.21.15.6:0/3116015173 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f263c018070 con 0x7f26400617e0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.974+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f264010dc00 con 0x7f26400617e0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.975+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2640100120 con 0x7f26400617e0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.975+0000 7f2632ffd700 1 -- 172.21.15.6:0/3116015173 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f263c01d420 con 0x7f26400617e0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.975+0000 7f2632ffd700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f262c061180 0x7f262c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.976+0000 7f2632ffd700 1 -- 172.21.15.6:0/3116015173 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f263c07da10 con 0x7f26400617e0 2024-03-12T16:06:52.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.976+0000 7f26454e3700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f262c061180 0x7f262c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:52.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.976+0000 7f26454e3700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f262c061180 0x7f262c063640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f26400615b0 tx=0x7f263400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:52.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:52.980+0000 7f2632ffd700 1 -- 172.21.15.6:0/3116015173 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f263c051ce0 con 0x7f26400617e0 2024-03-12T16:06:53.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.146+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f2640059120 con 0x7f262c061180 2024-03-12T16:06:53.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.148+0000 7f2632ffd700 1 -- 172.21.15.6:0/3116015173 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27755 (secure 0 0 0) 0x7f2640059120 con 0x7f262c061180 2024-03-12T16:06:53.149 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:06:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f262c061180 msgr2=0x7f262c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f262c061180 0x7f262c063640 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f26400615b0 tx=0x7f263400b040).stop 2024-03-12T16:06:53.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 msgr2=0x7f26401080a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 0x7f26401080a0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f263c013470 tx=0x7f263c009cb0).stop 2024-03-12T16:06:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 shutdown_connections 2024-03-12T16:06:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f262c061180 0x7f262c063640 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26400617e0 0x7f26401080a0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 --2- 172.21.15.6:0/3116015173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26400fab00 0x7f2640108590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 >> 172.21.15.6:0/3116015173 conn(0x7f26400f2020 msgr2=0x7f26400f4410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 shutdown_connections 2024-03-12T16:06:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:53.149+0000 7f2647f48700 1 -- 172.21.15.6:0/3116015173 wait complete. 2024-03-12T16:06:53.151 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-03-12T16:06:53.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:51.969176+0000 mgr.smithi006.kskdce (mgr.14196) 171 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:53.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:51.969176+0000 mgr.smithi006.kskdce (mgr.14196) 171 : cluster [DBG] pgmap v152: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:53.913 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":152,"stamp":"2024-03-12T16:06:51.969052+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1784568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":1782528,"kb_avail":560686344,"statfs":{"total":575970213888,"available":574142816256,"internally_reserved":0,"allocated":2039808,"data_stored":762216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1825308672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-12T16:06:01.418922+0000","last_change":"2024-03-12T16:05:32.554934+0000","last_active":"2024-03-12T16:06:01.418922+0000","last_peered":"2024-03-12T16:06:01.418922+0000","last_clean":"2024-03-12T16:06:01.418922+0000","last_became_active":"2024-03-12T16:05:32.554543+0000","last_became_peered":"2024-03-12T16:05:32.554543+0000","last_unstale":"2024-03-12T16:06:01.418922+0000","last_undegraded":"2024-03-12T16:06:01.418922+0000","last_fullsized":"2024-03-12T16:06:01.418922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T16:04:30.004375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T16:04:30.004375+0000","last_clean_scrub_stamp":"2024-03-12T16:04:30.004375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953490,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 16:06:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.435},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.42899999999999999}]},{"osd":1,"last update":"Tue Mar 12 16:06:32 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.40699999999999997},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.46200000000000002}]},{"osd":2,"last update":"Tue Mar 12 16:06:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.41399999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.47199999999999998}]},{"osd":3,"last update":"Tue Mar 12 16:06:32 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.39100000000000001},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.35599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45000000000000001}]}]},{"osd":3,"up_from":26,"seq":111669149719,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 16:06:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.51300000000000001},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.44400000000000001}]},{"osd":1,"last update":"Tue Mar 12 16:06:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.54800000000000004},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.504}]},{"osd":2,"last update":"Tue Mar 12 16:06:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.48599999999999999},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.57699999999999996}]},{"osd":4,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.60599999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.45700000000000002}]}]},{"osd":2,"up_from":19,"seq":81604378656,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 16:06:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34000000000000002},"min":{"1min":0.26000000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.29699999999999999},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.28000000000000003,"5min":0.247,"15min":0.247},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.314}]},{"osd":1,"last update":"Tue Mar 12 16:06:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36699999999999999,"15min":0.36499999999999999},"min":{"1min":0.29799999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52400000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.36299999999999999},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.27700000000000002}]},{"osd":3,"last update":"Tue Mar 12 16:06:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.58899999999999997}]},{"osd":4,"last update":"Tue Mar 12 16:06:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.49299999999999999},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.59699999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.65700000000000003}]}]},{"osd":0,"up_from":9,"seq":38654705706,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 16:06:06 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32300000000000001},"min":{"1min":0.27700000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.245},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.27100000000000002}]},{"osd":2,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.34799999999999998,"15min":0.33800000000000002},"min":{"1min":0.23599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.22600000000000001},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.372,"15min":0.36499999999999999},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.28499999999999998}]},{"osd":3,"last update":"Tue Mar 12 16:06:06 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.496}]},{"osd":4,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.47799999999999998},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.51400000000000001}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.52100000000000002}]}]},{"osd":1,"up_from":14,"seq":60129542181,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 16:06:04 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.311},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.27800000000000002},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.31}]},{"osd":2,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.25800000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52200000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.29199999999999998},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.27900000000000003,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.33300000000000002}]},{"osd":3,"last update":"Tue Mar 12 16:06:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.52400000000000002},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.67300000000000004}]},{"osd":4,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.503},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.58199999999999996}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.49099999999999999}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T16:06:53.914 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph pg dump --format=json 2024-03-12T16:06:54.196 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:53.147314+0000 mgr.smithi006.kskdce (mgr.14196) 172 : audit [DBG] from='client.14392 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-12T16:06:54.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:53.147314+0000 mgr.smithi006.kskdce (mgr.14196) 172 : audit [DBG] from='client.14392 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-12T16:06:55.445 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:53.969491+0000 mgr.smithi006.kskdce (mgr.14196) 173 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:55.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:53.969491+0000 mgr.smithi006.kskdce (mgr.14196) 173 : cluster [DBG] pgmap v153: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:55.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.951+0000 7f3094d60700 1 -- 172.21.15.6:0/52252288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f79a0 msgr2=0x7f30900f7dc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:55.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.951+0000 7f3094d60700 1 --2- 172.21.15.6:0/52252288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f79a0 0x7f30900f7dc0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f30800047f0 tx=0x7f3080009cb0).stop 2024-03-12T16:06:55.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.952+0000 7f3094d60700 1 -- 172.21.15.6:0/52252288 shutdown_connections 2024-03-12T16:06:55.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.952+0000 7f3094d60700 1 --2- 172.21.15.6:0/52252288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30900f8c40 0x7f30900f90a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:06:55.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.952+0000 7f3094d60700 1 --2- 172.21.15.6:0/52252288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f79a0 0x7f30900f7dc0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:55.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.952+0000 7f3094d60700 1 -- 172.21.15.6:0/52252288 >> 172.21.15.6:0/52252288 conn(0x7f30900f3100 msgr2=0x7f30900f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:55.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.952+0000 7f3094d60700 1 -- 172.21.15.6:0/52252288 shutdown_connections 2024-03-12T16:06:55.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.952+0000 7f3094d60700 1 -- 172.21.15.6:0/52252288 wait complete. 2024-03-12T16:06:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.952+0000 7f3094d60700 1 Processor -- start 2024-03-12T16:06:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.952+0000 7f3094d60700 1 -- start start 2024-03-12T16:06:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f3094d60700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30900f79a0 0x7f309006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:55.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f3094d60700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f8c40 0x7f309006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f3094d60700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309006b520 con 0x7f30900f8c40 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f3094d60700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f309006b660 con 0x7f30900f79a0 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f308dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f8c40 0x7f309006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f308dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f8c40 0x7f309006b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57678/0 (socket says 172.21.15.6:57678) 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f308dd9b700 1 -- 172.21.15.6:0/711231895 learned_addr learned my addr 172.21.15.6:0/711231895 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f308e59c700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30900f79a0 0x7f309006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f308dd9b700 1 -- 172.21.15.6:0/711231895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30900f79a0 msgr2=0x7f309006c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f308dd9b700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30900f79a0 0x7f309006c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f308dd9b700 1 -- 172.21.15.6:0/711231895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3080005040 con 0x7f30900f8c40 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f308dd9b700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f8c40 0x7f309006b030 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f307800b4b0 tx=0x7f30780090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f30877fe700 1 -- 172.21.15.6:0/711231895 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3078002500 con 0x7f30900f8c40 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f30877fe700 1 -- 172.21.15.6:0/711231895 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f3078002af0 con 0x7f30900f8c40 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f30877fe700 1 -- 172.21.15.6:0/711231895 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3078012c90 con 0x7f30900f8c40 2024-03-12T16:06:55.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.953+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f309006b940 con 0x7f30900f8c40 2024-03-12T16:06:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.954+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f309006be80 con 0x7f30900f8c40 2024-03-12T16:06:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.954+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3090100170 con 0x7f30900f8c40 2024-03-12T16:06:55.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.955+0000 7f30877fe700 1 -- 172.21.15.6:0/711231895 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f3078002660 con 0x7f30900f8c40 2024-03-12T16:06:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.955+0000 7f30877fe700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f307c061180 0x7f307c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.956+0000 7f308e59c700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f307c061180 0x7f307c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.956+0000 7f30877fe700 1 -- 172.21.15.6:0/711231895 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f307807c520 con 0x7f30900f8c40 2024-03-12T16:06:55.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.956+0000 7f308e59c700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f307c061180 0x7f307c063640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3080013470 tx=0x7f3080009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:55.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:55.960+0000 7f30877fe700 1 -- 172.21.15.6:0/711231895 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f3078050870 con 0x7f30900f8c40 2024-03-12T16:06:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.128+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) v1 -- 0x7f3090059120 con 0x7f307c061180 2024-03-12T16:06:56.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.129+0000 7f30877fe700 1 -- 172.21.15.6:0/711231895 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 dumped all) v1 ==== 18+0+27739 (secure 0 0 0) 0x7f3090059120 con 0x7f307c061180 2024-03-12T16:06:56.130 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f307c061180 msgr2=0x7f307c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f307c061180 0x7f307c063640 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f3080013470 tx=0x7f3080009cb0).stop 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f8c40 msgr2=0x7f309006b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f8c40 0x7f309006b030 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7f307800b4b0 tx=0x7f30780090f0).stop 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 shutdown_connections 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f307c061180 0x7f307c063640 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30900f79a0 0x7f309006c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 --2- 172.21.15.6:0/711231895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30900f8c40 0x7f309006b030 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 >> 172.21.15.6:0/711231895 conn(0x7f30900f3100 msgr2=0x7f30900fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 shutdown_connections 2024-03-12T16:06:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:56.131+0000 7f3094d60700 1 -- 172.21.15.6:0/711231895 wait complete. 2024-03-12T16:06:56.133 INFO:teuthology.orchestra.run.smithi006.stderr:dumped all 2024-03-12T16:06:56.917 INFO:teuthology.orchestra.run.smithi006.stdout:{"pg_ready":true,"pg_map":{"version":154,"stamp":"2024-03-12T16:06:55.969654+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":6,"num_per_pool_osds":6,"num_per_pool_omap_osds":3,"kb":562470912,"kb_used":1784568,"kb_used_data":1992,"kb_used_omap":0,"kb_used_meta":1782528,"kb_avail":560686344,"statfs":{"total":575970213888,"available":574142816256,"internally_reserved":0,"allocated":2039808,"data_stored":762216,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":1825308672},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"0.000000"},"pg_stats":[{"pgid":"1.0","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-03-12T16:06:01.418922+0000","last_change":"2024-03-12T16:05:32.554934+0000","last_active":"2024-03-12T16:06:01.418922+0000","last_peered":"2024-03-12T16:06:01.418922+0000","last_clean":"2024-03-12T16:06:01.418922+0000","last_became_active":"2024-03-12T16:05:32.554543+0000","last_became_peered":"2024-03-12T16:05:32.554543+0000","last_unstale":"2024-03-12T16:06:01.418922+0000","last_undegraded":"2024-03-12T16:06:01.418922+0000","last_fullsized":"2024-03-12T16:06:01.418922+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-03-12T16:04:30.004375+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-03-12T16:04:30.004375+0000","last_clean_scrub_stamp":"2024-03-12T16:04:30.004375+0000","log_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1],"acting":[3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":3,"acting":3,"num_store_stats":4}],"osd_stats":[{"osd":5,"up_from":37,"seq":158913789966,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,4],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.67700000000000005}]},{"osd":1,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.63600000000000001}]},{"osd":2,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.54900000000000004}]},{"osd":3,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.42299999999999999}]},{"osd":4,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":4,"up_from":32,"seq":137438953491,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,3,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 16:06:32 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.378,"5min":0.378,"15min":0.378},"max":{"1min":0.66500000000000004,"5min":0.66500000000000004,"15min":0.66500000000000004},"last":0.54400000000000004},{"interface":"front","average":{"1min":0.50700000000000001,"5min":0.50700000000000001,"15min":0.50700000000000001},"min":{"1min":0.39300000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.627}]},{"osd":1,"last update":"Tue Mar 12 16:06:32 2024","interfaces":[{"interface":"back","average":{"1min":0.5,"5min":0.5,"15min":0.5},"min":{"1min":0.35499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":0.70999999999999996,"5min":0.70999999999999996,"15min":0.70999999999999996},"last":0.61499999999999999},{"interface":"front","average":{"1min":0.49299999999999999,"5min":0.49299999999999999,"15min":0.49299999999999999},"min":{"1min":0.373,"5min":0.373,"15min":0.373},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.57299999999999995}]},{"osd":2,"last update":"Tue Mar 12 16:06:32 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.371,"5min":0.371,"15min":0.371},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.60699999999999998},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.36599999999999999,"5min":0.36599999999999999,"15min":0.36599999999999999},"max":{"1min":0.72699999999999998,"5min":0.72699999999999998,"15min":0.72699999999999998},"last":0.66800000000000004}]},{"osd":3,"last update":"Tue Mar 12 16:06:32 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.36699999999999999,"15min":0.36699999999999999},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.56599999999999995,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.41199999999999998},{"interface":"front","average":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"min":{"1min":0.25,"5min":0.25,"15min":0.25},"max":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"last":0.44}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.48499999999999999}]}]},{"osd":3,"up_from":26,"seq":111669149720,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,2,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 16:06:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55500000000000005,"5min":0.55500000000000005,"15min":0.55500000000000005},"min":{"1min":0.372,"5min":0.372,"15min":0.372},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.56599999999999995},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.32500000000000001,"5min":0.32500000000000001,"15min":0.32500000000000001},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.55500000000000005}]},{"osd":1,"last update":"Tue Mar 12 16:06:05 2024","interfaces":[{"interface":"back","average":{"1min":0.55600000000000005,"5min":0.55600000000000005,"15min":0.55600000000000005},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48499999999999999},{"interface":"front","average":{"1min":0.53300000000000003,"5min":0.53300000000000003,"15min":0.53300000000000003},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.53400000000000003}]},{"osd":2,"last update":"Tue Mar 12 16:06:05 2024","interfaces":[{"interface":"back","average":{"1min":0.53100000000000003,"5min":0.53100000000000003,"15min":0.53100000000000003},"min":{"1min":0.35999999999999999,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.747,"5min":0.747,"15min":0.747},"last":0.58599999999999997},{"interface":"front","average":{"1min":0.56200000000000006,"5min":0.56200000000000006,"15min":0.56200000000000006},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.77300000000000002,"5min":0.77300000000000002,"15min":0.77300000000000002},"last":0.51900000000000002}]},{"osd":4,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.39700000000000002,"5min":0.39700000000000002,"15min":0.39700000000000002},"min":{"1min":0.26200000000000001,"5min":0.26200000000000001,"15min":0.26200000000000001},"max":{"1min":0.53600000000000003,"5min":0.53600000000000003,"15min":0.53600000000000003},"last":0.44700000000000001},{"interface":"front","average":{"1min":0.439,"5min":0.439,"15min":0.439},"min":{"1min":0.30299999999999999,"5min":0.30299999999999999,"15min":0.30299999999999999},"max":{"1min":0.56399999999999995,"5min":0.56399999999999995,"15min":0.56399999999999995},"last":0.41299999999999998}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.35299999999999998}]}]},{"osd":2,"up_from":19,"seq":81604378657,"num_pgs":0,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,1,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 16:06:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38700000000000001,"5min":0.34699999999999998,"15min":0.34000000000000002},"min":{"1min":0.26000000000000001,"5min":0.216,"15min":0.216},"max":{"1min":0.63,"5min":0.63,"15min":0.63},"last":0.27000000000000002},{"interface":"front","average":{"1min":0.38100000000000001,"5min":0.35599999999999998,"15min":0.35199999999999998},"min":{"1min":0.28000000000000003,"5min":0.247,"15min":0.247},"max":{"1min":0.64700000000000002,"5min":0.64700000000000002,"15min":0.64700000000000002},"last":0.316}]},{"osd":1,"last update":"Tue Mar 12 16:06:31 2024","interfaces":[{"interface":"back","average":{"1min":0.38200000000000001,"5min":0.36699999999999999,"15min":0.36499999999999999},"min":{"1min":0.29799999999999999,"5min":0.22800000000000001,"15min":0.22800000000000001},"max":{"1min":0.52400000000000002,"5min":0.60799999999999998,"15min":0.60799999999999998},"last":0.33300000000000002},{"interface":"front","average":{"1min":0.38400000000000001,"5min":0.36799999999999999,"15min":0.36599999999999999},"min":{"1min":0.26900000000000002,"5min":0.23999999999999999,"15min":0.23999999999999999},"max":{"1min":0.59199999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"last":0.39700000000000002}]},{"osd":3,"last update":"Tue Mar 12 16:06:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.86099999999999999,"5min":0.86099999999999999,"15min":0.86099999999999999},"last":0.5},{"interface":"front","average":{"1min":0.53800000000000003,"5min":0.53800000000000003,"15min":0.53800000000000003},"min":{"1min":0.39500000000000002,"5min":0.39500000000000002,"15min":0.39500000000000002},"max":{"1min":0.84799999999999998,"5min":0.84799999999999998,"15min":0.84799999999999998},"last":0.54600000000000004}]},{"osd":4,"last update":"Tue Mar 12 16:06:37 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36399999999999999,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.55900000000000005},{"interface":"front","average":{"1min":0.57899999999999996,"5min":0.57899999999999996,"15min":0.57899999999999996},"min":{"1min":0.38100000000000001,"5min":0.38100000000000001,"15min":0.38100000000000001},"max":{"1min":1.0529999999999999,"5min":1.0529999999999999,"15min":1.0529999999999999},"last":0.53900000000000003}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.50800000000000001}]}]},{"osd":0,"up_from":9,"seq":38654705707,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[1,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Tue Mar 12 16:06:06 2024","interfaces":[{"interface":"back","average":{"1min":0.36499999999999999,"5min":0.32900000000000001,"15min":0.32300000000000001},"min":{"1min":0.27700000000000002,"5min":0.20200000000000001,"15min":0.20200000000000001},"max":{"1min":0.504,"5min":0.504,"15min":0.504},"last":0.249},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33900000000000002,"15min":0.33500000000000002},"min":{"1min":0.246,"5min":0.20799999999999999,"15min":0.20799999999999999},"max":{"1min":0.51700000000000002,"5min":0.51700000000000002,"15min":0.51700000000000002},"last":0.28299999999999997}]},{"osd":2,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.40999999999999998,"5min":0.34799999999999998,"15min":0.33800000000000002},"min":{"1min":0.23599999999999999,"5min":0.23499999999999999,"15min":0.23499999999999999},"max":{"1min":0.57999999999999996,"5min":0.57999999999999996,"15min":0.57999999999999996},"last":0.26700000000000002},{"interface":"front","average":{"1min":0.41199999999999998,"5min":0.372,"15min":0.36499999999999999},"min":{"1min":0.27800000000000002,"5min":0.253,"15min":0.253},"max":{"1min":0.55200000000000005,"5min":0.55200000000000005,"15min":0.55200000000000005},"last":0.29699999999999999}]},{"osd":3,"last update":"Tue Mar 12 16:06:06 2024","interfaces":[{"interface":"back","average":{"1min":0.498,"5min":0.498,"15min":0.498},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.71799999999999997,"5min":0.71799999999999997,"15min":0.71799999999999997},"last":0.46000000000000002},{"interface":"front","average":{"1min":0.51300000000000001,"5min":0.51300000000000001,"15min":0.51300000000000001},"min":{"1min":0.34499999999999997,"5min":0.34499999999999997,"15min":0.34499999999999997},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.36899999999999999}]},{"osd":4,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.59699999999999998,"5min":0.59699999999999998,"15min":0.59699999999999998},"min":{"1min":0.39400000000000002,"5min":0.39400000000000002,"15min":0.39400000000000002},"max":{"1min":0.97399999999999998,"5min":0.97399999999999998,"15min":0.97399999999999998},"last":0.433},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41199999999999998,"5min":0.41199999999999998,"15min":0.41199999999999998},"max":{"1min":0.94499999999999995,"5min":0.94499999999999995,"15min":0.94499999999999995},"last":0.39400000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.39100000000000001}]}]},{"osd":1,"up_from":14,"seq":60129542182,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":297428,"kb_used_data":332,"kb_used_omap":0,"kb_used_meta":297088,"kb_avail":93447724,"statfs":{"total":95995035648,"available":95690469376,"internally_reserved":0,"allocated":339968,"data_stored":127036,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":304218112},"hb_peers":[0,2,3,4,5],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Tue Mar 12 16:06:04 2024","interfaces":[{"interface":"back","average":{"1min":0.36699999999999999,"5min":0.31900000000000001,"15min":0.311},"min":{"1min":0.18099999999999999,"5min":0.18099999999999999,"15min":0.18099999999999999},"max":{"1min":0.56299999999999994,"5min":0.56299999999999994,"15min":0.56299999999999994},"last":0.30099999999999999},{"interface":"front","average":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.32800000000000001},"min":{"1min":0.214,"5min":0.214,"15min":0.214},"max":{"1min":0.53700000000000003,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.31900000000000001}]},{"osd":2,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.379,"5min":0.36599999999999999,"15min":0.36399999999999999},"min":{"1min":0.25800000000000001,"5min":0.19400000000000001,"15min":0.19400000000000001},"max":{"1min":0.52200000000000002,"5min":0.53700000000000003,"15min":0.53700000000000003},"last":0.33800000000000002},{"interface":"front","average":{"1min":0.38700000000000001,"5min":0.378,"15min":0.376},"min":{"1min":0.27900000000000003,"5min":0.22700000000000001,"15min":0.22700000000000001},"max":{"1min":0.57399999999999995,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.36599999999999999}]},{"osd":3,"last update":"Tue Mar 12 16:06:08 2024","interfaces":[{"interface":"back","average":{"1min":0.52400000000000002,"5min":0.52400000000000002,"15min":0.52400000000000002},"min":{"1min":0.33800000000000002,"5min":0.33800000000000002,"15min":0.33800000000000002},"max":{"1min":0.70699999999999996,"5min":0.70699999999999996,"15min":0.70699999999999996},"last":0.629},{"interface":"front","average":{"1min":0.52900000000000003,"5min":0.52900000000000003,"15min":0.52900000000000003},"min":{"1min":0.308,"5min":0.308,"15min":0.308},"max":{"1min":0.76200000000000001,"5min":0.76200000000000001,"15min":0.76200000000000001},"last":0.748}]},{"osd":4,"last update":"Tue Mar 12 16:06:33 2024","interfaces":[{"interface":"back","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.746,"5min":0.746,"15min":0.746},"last":0.76400000000000001},{"interface":"front","average":{"1min":0.56799999999999995,"5min":0.56799999999999995,"15min":0.56799999999999995},"min":{"1min":0.42999999999999999,"5min":0.42999999999999999,"15min":0.42999999999999999},"max":{"1min":0.80500000000000005,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.64300000000000002}]},{"osd":5,"last update":"Thu Jan 1 00:00:00 1970","interfaces":[{"interface":"back","average":{"1min":0,"5min":0,"15min":0},"min":{"1min":0,"5min":0,"15min":0},"max":{"1min":0,"5min":0,"15min":0},"last":0.70599999999999996}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-03-12T16:06:56.918 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-03-12T16:06:56.919 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-03-12T16:06:56.919 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-03-12T16:06:56.919 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph health --format=json 2024-03-12T16:06:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:06:57.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:55.969805+0000 mgr.smithi006.kskdce (mgr.14196) 174 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:57.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:56.128699+0000 mgr.smithi006.kskdce (mgr.14196) 175 : audit [DBG] from='client.14396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-12T16:06:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:55.969805+0000 mgr.smithi006.kskdce (mgr.14196) 174 : cluster [DBG] pgmap v154: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:56.128699+0000 mgr.smithi006.kskdce (mgr.14196) 175 : audit [DBG] from='client.14396 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-03-12T16:06:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.891+0000 7f029390f700 1 -- 172.21.15.6:0/1592188422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f65f0 msgr2=0x7f028c0f8d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.891+0000 7f029390f700 1 --2- 172.21.15.6:0/1592188422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f65f0 0x7f028c0f8d70 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7f027c0047f0 tx=0x7f027c009cb0).stop 2024-03-12T16:06:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.891+0000 7f029390f700 1 -- 172.21.15.6:0/1592188422 shutdown_connections 2024-03-12T16:06:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.891+0000 7f029390f700 1 --2- 172.21.15.6:0/1592188422 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f65f0 0x7f028c0f8d70 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.891+0000 7f029390f700 1 --2- 172.21.15.6:0/1592188422 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f028c0f5c50 0x7f028c0f6070 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.891+0000 7f029390f700 1 -- 172.21.15.6:0/1592188422 >> 172.21.15.6:0/1592188422 conn(0x7f028c0f1770 msgr2=0x7f028c0f3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.892+0000 7f029390f700 1 -- 172.21.15.6:0/1592188422 shutdown_connections 2024-03-12T16:06:58.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.892+0000 7f029390f700 1 -- 172.21.15.6:0/1592188422 wait complete. 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.892+0000 7f029390f700 1 Processor -- start 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.892+0000 7f029390f700 1 -- start start 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.892+0000 7f029390f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f5c50 0x7f028c108090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.892+0000 7f029390f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f028c0f65f0 0x7f028c108580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.892+0000 7f029390f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c108b30 con 0x7f028c0f5c50 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.892+0000 7f029390f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f028c108c70 con 0x7f028c0f65f0 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02916ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f5c50 0x7f028c108090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02916ab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f5c50 0x7f028c108090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57692/0 (socket says 172.21.15.6:57692) 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02916ab700 1 -- 172.21.15.6:0/95473496 learned_addr learned my addr 172.21.15.6:0/95473496 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f0290eaa700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f028c0f65f0 0x7f028c108580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02916ab700 1 -- 172.21.15.6:0/95473496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f028c0f65f0 msgr2=0x7f028c108580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02916ab700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f028c0f65f0 0x7f028c108580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02916ab700 1 -- 172.21.15.6:0/95473496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f027c005040 con 0x7f028c0f5c50 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f0290eaa700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f028c0f65f0 0x7f028c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:06:58.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02916ab700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f5c50 0x7f028c108090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f0288002820 tx=0x7f0288009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02827fc700 1 -- 172.21.15.6:0/95473496 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0288002d60 con 0x7f028c0f5c50 2024-03-12T16:06:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02827fc700 1 -- 172.21.15.6:0/95473496 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f028800f040 con 0x7f028c0f5c50 2024-03-12T16:06:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f028c10d710 con 0x7f028c0f5c50 2024-03-12T16:06:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f02827fc700 1 -- 172.21.15.6:0/95473496 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f028800d820 con 0x7f028c0f5c50 2024-03-12T16:06:58.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.893+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f028c10dc50 con 0x7f028c0f5c50 2024-03-12T16:06:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.894+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f028c100100 con 0x7f028c0f5c50 2024-03-12T16:06:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.895+0000 7f02827fc700 1 -- 172.21.15.6:0/95473496 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f02880092f0 con 0x7f028c0f5c50 2024-03-12T16:06:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.896+0000 7f02827fc700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0278061180 0x7f0278063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:06:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.896+0000 7f02827fc700 1 -- 172.21.15.6:0/95473496 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f028807c580 con 0x7f028c0f5c50 2024-03-12T16:06:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.896+0000 7f0290eaa700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0278061180 0x7f0278063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:06:58.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.896+0000 7f0290eaa700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0278061180 0x7f0278063640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f027c013470 tx=0x7f027c00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:06:58.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:58.900+0000 7f02827fc700 1 -- 172.21.15.6:0/95473496 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0288050810 con 0x7f028c0f5c50 2024-03-12T16:06:59.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.112+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) v1 -- 0x7f028c101f70 con 0x7f028c0f5c50 2024-03-12T16:06:59.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.113+0000 7f02827fc700 1 -- 172.21.15.6:0/95473496 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) v1 ==== 72+0+45 (secure 0 0 0) 0x7f0288050400 con 0x7f028c0f5c50 2024-03-12T16:06:59.115 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:06:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0278061180 msgr2=0x7f0278063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0278061180 0x7f0278063640 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f027c013470 tx=0x7f027c00b040).stop 2024-03-12T16:06:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f5c50 msgr2=0x7f028c108090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:06:59.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f5c50 0x7f028c108090 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f0288002820 tx=0x7f0288009f00).stop 2024-03-12T16:06:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 shutdown_connections 2024-03-12T16:06:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0278061180 0x7f0278063640 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f028c0f5c50 0x7f028c108090 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 --2- 172.21.15.6:0/95473496 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f028c0f65f0 0x7f028c108580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:06:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 >> 172.21.15.6:0/95473496 conn(0x7f028c0f1770 msgr2=0x7f028c0fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:06:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 shutdown_connections 2024-03-12T16:06:59.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:06:59.115+0000 7f029390f700 1 -- 172.21.15.6:0/95473496 wait complete. 2024-03-12T16:06:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:06:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:57.970079+0000 mgr.smithi006.kskdce (mgr.14196) 176 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:06:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:57.970079+0000 mgr.smithi006.kskdce (mgr.14196) 176 : cluster [DBG] pgmap v155: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:06:59.807 INFO:teuthology.orchestra.run.smithi006.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-03-12T16:06:59.808 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-03-12T16:06:59.808 INFO:tasks.cephadm:Setup complete, yielding 2024-03-12T16:06:59.808 INFO:teuthology.run_tasks:Running task print... 2024-03-12T16:06:59.819 INFO:teuthology.task.print:**** done end installing pacific cephadm ... 2024-03-12T16:06:59.819 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-12T16:06:59.835 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:06:59.836 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph config set mgr mgr/cephadm/use_repo_digest true --force' 2024-03-12T16:07:00.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:06:59.113686+0000 mon.smithi006 (mon.0) 478 : audit [DBG] from='client.? 172.21.15.6:0/95473496' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-12T16:07:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:06:59.113686+0000 mon.smithi006 (mon.0) 478 : audit [DBG] from='client.? 172.21.15.6:0/95473496' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-03-12T16:07:01.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:06:59.970390+0000 mgr.smithi006.kskdce (mgr.14196) 177 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:01.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:06:59.970390+0000 mgr.smithi006.kskdce (mgr.14196) 177 : cluster [DBG] pgmap v156: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:01.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.803+0000 7f9b64f56700 1 -- 172.21.15.6:0/1046953885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 msgr2=0x7f9b600f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:01.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.803+0000 7f9b64f56700 1 --2- 172.21.15.6:0/1046953885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 0x7f9b600f7e30 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f9b500047f0 tx=0x7f9b50009cb0).stop 2024-03-12T16:07:01.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.803+0000 7f9b64f56700 1 -- 172.21.15.6:0/1046953885 shutdown_connections 2024-03-12T16:07:01.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.803+0000 7f9b64f56700 1 --2- 172.21.15.6:0/1046953885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b600f8cb0 0x7f9b600f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:01.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.803+0000 7f9b64f56700 1 --2- 172.21.15.6:0/1046953885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 0x7f9b600f7e30 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:01.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.803+0000 7f9b64f56700 1 -- 172.21.15.6:0/1046953885 >> 172.21.15.6:0/1046953885 conn(0x7f9b600f3150 msgr2=0x7f9b600f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:01.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.803+0000 7f9b64f56700 1 -- 172.21.15.6:0/1046953885 shutdown_connections 2024-03-12T16:07:01.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.803+0000 7f9b64f56700 1 -- 172.21.15.6:0/1046953885 wait complete. 2024-03-12T16:07:01.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b64f56700 1 Processor -- start 2024-03-12T16:07:01.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b64f56700 1 -- start start 2024-03-12T16:07:01.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b64f56700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 0x7f9b6006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:01.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b64f56700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b600f8cb0 0x7f9b6006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:01.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b64f56700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6006cf80 con 0x7f9b600f7a10 2024-03-12T16:07:01.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b64f56700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9b6006b520 con 0x7f9b600f8cb0 2024-03-12T16:07:01.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 0x7f9b6006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:01.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b5e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 0x7f9b6006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57716/0 (socket says 172.21.15.6:57716) 2024-03-12T16:07:01.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b5e59c700 1 -- 172.21.15.6:0/3074815505 learned_addr learned my addr 172.21.15.6:0/3074815505 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:01.810 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b5dd9b700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b600f8cb0 0x7f9b6006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b5e59c700 1 -- 172.21.15.6:0/3074815505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b600f8cb0 msgr2=0x7f9b6006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b5e59c700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b600f8cb0 0x7f9b6006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.804+0000 7f9b5e59c700 1 -- 172.21.15.6:0/3074815505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9b50005040 con 0x7f9b600f7a10 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.805+0000 7f9b5e59c700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 0x7f9b6006c9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f9b50009eb0 tx=0x7f9b50009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.805+0000 7f9b577fe700 1 -- 172.21.15.6:0/3074815505 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b5000e030 con 0x7f9b600f7a10 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.805+0000 7f9b577fe700 1 -- 172.21.15.6:0/3074815505 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f9b50007e90 con 0x7f9b600f7a10 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.805+0000 7f9b577fe700 1 -- 172.21.15.6:0/3074815505 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9b50018070 con 0x7f9b600f7a10 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.805+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9b6006b740 con 0x7f9b600f7a10 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.805+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9b6006bc20 con 0x7f9b600f7a10 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.806+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9b6006be90 con 0x7f9b600f7a10 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.806+0000 7f9b577fe700 1 -- 172.21.15.6:0/3074815505 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f9b5001d420 con 0x7f9b600f7a10 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.807+0000 7f9b577fe700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9b4c061110 0x7f9b4c0635d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.807+0000 7f9b577fe700 1 -- 172.21.15.6:0/3074815505 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f9b5007d820 con 0x7f9b600f7a10 2024-03-12T16:07:01.811 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.807+0000 7f9b5dd9b700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9b4c061110 0x7f9b4c0635d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:01.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.807+0000 7f9b5dd9b700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9b4c061110 0x7f9b4c0635d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9b48004de0 tx=0x7f9b4800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:01.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.811+0000 7f9b577fe700 1 -- 172.21.15.6:0/3074815505 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f9b50051a90 con 0x7f9b600f7a10 2024-03-12T16:07:01.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.981+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/cephadm/use_repo_digest}] v 0) v1 -- 0x7f9b6005fb50 con 0x7f9b600f7a10 2024-03-12T16:07:01.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.985+0000 7f9b577fe700 1 -- 172.21.15.6:0/3074815505 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/cephadm/use_repo_digest}]=0 v19)=0 v19) v1 ==== 143+0+0 (secure 0 0 0) 0x7f9b6005fb50 con 0x7f9b600f7a10 2024-03-12T16:07:01.988 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9b4c061110 msgr2=0x7f9b4c0635d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9b4c061110 0x7f9b4c0635d0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 rx=0x7f9b48004de0 tx=0x7f9b4800b040).stop 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 msgr2=0x7f9b6006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 0x7f9b6006c9d0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f9b50009eb0 tx=0x7f9b50009cb0).stop 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 shutdown_connections 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9b4c061110 0x7f9b4c0635d0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9b600f7a10 0x7f9b6006c9d0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 --2- 172.21.15.6:0/3074815505 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9b600f8cb0 0x7f9b6006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 >> 172.21.15.6:0/3074815505 conn(0x7f9b600f3150 msgr2=0x7f9b600fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.987+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 shutdown_connections 2024-03-12T16:07:01.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:01.988+0000 7f9b64f56700 1 -- 172.21.15.6:0/3074815505 wait complete. 2024-03-12T16:07:02.751 INFO:teuthology.run_tasks:Running task print... 2024-03-12T16:07:02.760 INFO:teuthology.task.print:**** done cephadm.shell ceph config set mgr... 2024-03-12T16:07:02.760 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-12T16:07:02.769 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:07:02.769 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph orch status' 2024-03-12T16:07:03.256 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:01.970663+0000 mgr.smithi006.kskdce (mgr.14196) 178 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:03.256 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:01.986029+0000 mon.smithi006 (mon.0) 479 : audit [INF] from='client.? 172.21.15.6:0/3074815505' entity='client.admin' 2024-03-12T16:07:03.256 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:02.028133+0000 mon.smithi006 (mon.0) 480 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:07:03.256 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:02.325459+0000 mon.smithi006 (mon.0) 481 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:03.256 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:02.326180+0000 mon.smithi006 (mon.0) 482 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:07:03.256 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:02.332360+0000 mon.smithi006 (mon.0) 483 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:03.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:01.970663+0000 mgr.smithi006.kskdce (mgr.14196) 178 : cluster [DBG] pgmap v157: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:03.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:01.986029+0000 mon.smithi006 (mon.0) 479 : audit [INF] from='client.? 172.21.15.6:0/3074815505' entity='client.admin' 2024-03-12T16:07:03.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:02.028133+0000 mon.smithi006 (mon.0) 480 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:07:03.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:02.325459+0000 mon.smithi006 (mon.0) 481 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:03.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:02.326180+0000 mon.smithi006 (mon.0) 482 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:07:03.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:02.332360+0000 mon.smithi006 (mon.0) 483 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:04.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.712+0000 7f6474c15700 1 -- 172.21.15.6:0/2903822393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f66f0 msgr2=0x7f64700f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.712+0000 7f6474c15700 1 --2- 172.21.15.6:0/2903822393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f66f0 0x7f64700f6b10 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f64600047f0 tx=0x7f6460009cb0).stop 2024-03-12T16:07:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.712+0000 7f6474c15700 1 -- 172.21.15.6:0/2903822393 shutdown_connections 2024-03-12T16:07:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.712+0000 7f6474c15700 1 --2- 172.21.15.6:0/2903822393 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64700f7990 0x7f64700f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.712+0000 7f6474c15700 1 --2- 172.21.15.6:0/2903822393 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f66f0 0x7f64700f6b10 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:04.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.712+0000 7f6474c15700 1 -- 172.21.15.6:0/2903822393 >> 172.21.15.6:0/2903822393 conn(0x7f64700f1e50 msgr2=0x7f64700f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.712+0000 7f6474c15700 1 -- 172.21.15.6:0/2903822393 shutdown_connections 2024-03-12T16:07:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.712+0000 7f6474c15700 1 -- 172.21.15.6:0/2903822393 wait complete. 2024-03-12T16:07:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.713+0000 7f6474c15700 1 Processor -- start 2024-03-12T16:07:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.713+0000 7f6474c15700 1 -- start start 2024-03-12T16:07:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.713+0000 7f6474c15700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64700f66f0 0x7f64700fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:04.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.713+0000 7f6474c15700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f7990 0x7f64700f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.713+0000 7f6474c15700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64700fac20 con 0x7f64700f7990 2024-03-12T16:07:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.713+0000 7f6474c15700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f64700f91c0 con 0x7f64700f66f0 2024-03-12T16:07:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f646dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f7990 0x7f64700f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f646dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f7990 0x7f64700f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46324/0 (socket says 172.21.15.6:46324) 2024-03-12T16:07:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f646dd9b700 1 -- 172.21.15.6:0/1225526278 learned_addr learned my addr 172.21.15.6:0/1225526278 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:04.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f646e59c700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64700f66f0 0x7f64700fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f646dd9b700 1 -- 172.21.15.6:0/1225526278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64700f66f0 msgr2=0x7f64700fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f646dd9b700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64700f66f0 0x7f64700fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f646dd9b700 1 -- 172.21.15.6:0/1225526278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6460005040 con 0x7f64700f7990 2024-03-12T16:07:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f646e59c700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64700f66f0 0x7f64700fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:07:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f646dd9b700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f7990 0x7f64700f8cd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f646400c790 tx=0x7f646400cb50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:04.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f645f7fe700 1 -- 172.21.15.6:0/1225526278 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f64640106f0 con 0x7f64700f7990 2024-03-12T16:07:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f645f7fe700 1 -- 172.21.15.6:0/1225526278 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f6464010ce0 con 0x7f64700f7990 2024-03-12T16:07:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f64700f9440 con 0x7f64700f7990 2024-03-12T16:07:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f645f7fe700 1 -- 172.21.15.6:0/1225526278 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6464012de0 con 0x7f64700f7990 2024-03-12T16:07:04.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.714+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f64700f9980 con 0x7f64700f7990 2024-03-12T16:07:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.715+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64700feed0 con 0x7f64700f7990 2024-03-12T16:07:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.716+0000 7f645f7fe700 1 -- 172.21.15.6:0/1225526278 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f6464010850 con 0x7f64700f7990 2024-03-12T16:07:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.716+0000 7f645f7fe700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6458061180 0x7f6458063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.716+0000 7f645f7fe700 1 -- 172.21.15.6:0/1225526278 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f646407be20 con 0x7f64700f7990 2024-03-12T16:07:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.716+0000 7f646e59c700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6458061180 0x7f6458063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:04.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.717+0000 7f646e59c700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6458061180 0x7f6458063640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f64600043d0 tx=0x7f6460009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:04.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.720+0000 7f645f7fe700 1 -- 172.21.15.6:0/1225526278 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6464048f60 con 0x7f64700f7990 2024-03-12T16:07:04.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.905+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch status", "target": ["mon-mgr", ""]}) v1 -- 0x7f64701104d0 con 0x7f6458061180 2024-03-12T16:07:04.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.906+0000 7f645f7fe700 1 -- 172.21.15.6:0/1225526278 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+43 (secure 0 0 0) 0x7f64701104d0 con 0x7f6458061180 2024-03-12T16:07:04.908 INFO:teuthology.orchestra.run.smithi006.stdout:Backend: cephadm 2024-03-12T16:07:04.909 INFO:teuthology.orchestra.run.smithi006.stdout:Available: Yes 2024-03-12T16:07:04.909 INFO:teuthology.orchestra.run.smithi006.stdout:Paused: No 2024-03-12T16:07:04.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6458061180 msgr2=0x7f6458063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:04.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6458061180 0x7f6458063640 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f64600043d0 tx=0x7f6460009cb0).stop 2024-03-12T16:07:04.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f7990 msgr2=0x7f64700f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:04.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f7990 0x7f64700f8cd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f646400c790 tx=0x7f646400cb50).stop 2024-03-12T16:07:04.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 shutdown_connections 2024-03-12T16:07:04.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6458061180 0x7f6458063640 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:04.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64700f66f0 0x7f64700fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:04.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 --2- 172.21.15.6:0/1225526278 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64700f7990 0x7f64700f8cd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:04.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 >> 172.21.15.6:0/1225526278 conn(0x7f64700f1e50 msgr2=0x7f6470060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:04.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 shutdown_connections 2024-03-12T16:07:04.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:04.908+0000 7f6474c15700 1 -- 172.21.15.6:0/1225526278 wait complete. 2024-03-12T16:07:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:03.971054+0000 mgr.smithi006.kskdce (mgr.14196) 179 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:05.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:03.971054+0000 mgr.smithi006.kskdce (mgr.14196) 179 : cluster [DBG] pgmap v158: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:05.793 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph orch ps' 2024-03-12T16:07:06.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:04.907950+0000 mgr.smithi006.kskdce (mgr.14196) 180 : audit [DBG] from='client.14408 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:06.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:04.907950+0000 mgr.smithi006.kskdce (mgr.14196) 180 : audit [DBG] from='client.14408 -' entity='client.admin' cmd=[{"prefix": "orch status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:07.354 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:05.971351+0000 mgr.smithi006.kskdce (mgr.14196) 181 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:07.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:05.971351+0000 mgr.smithi006.kskdce (mgr.14196) 181 : cluster [DBG] pgmap v159: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.831+0000 7f8a38de6700 1 -- 172.21.15.6:0/37236611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f66f0 msgr2=0x7f8a340f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.831+0000 7f8a38de6700 1 --2- 172.21.15.6:0/37236611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f66f0 0x7f8a340f6b10 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f8a240047f0 tx=0x7f8a24009cb0).stop 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.832+0000 7f8a38de6700 1 -- 172.21.15.6:0/37236611 shutdown_connections 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.832+0000 7f8a38de6700 1 --2- 172.21.15.6:0/37236611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a340f7990 0x7f8a340f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.832+0000 7f8a38de6700 1 --2- 172.21.15.6:0/37236611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f66f0 0x7f8a340f6b10 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.832+0000 7f8a38de6700 1 -- 172.21.15.6:0/37236611 >> 172.21.15.6:0/37236611 conn(0x7f8a340f1e50 msgr2=0x7f8a340f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.832+0000 7f8a38de6700 1 -- 172.21.15.6:0/37236611 shutdown_connections 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.832+0000 7f8a38de6700 1 -- 172.21.15.6:0/37236611 wait complete. 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.832+0000 7f8a38de6700 1 Processor -- start 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.832+0000 7f8a38de6700 1 -- start start 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a38de6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a340f66f0 0x7f8a34106e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:07.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a38de6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f7990 0x7f8a34107380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a38de6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34107930 con 0x7f8a340f7990 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a38de6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8a34107a70 con 0x7f8a340f66f0 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a31d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f7990 0x7f8a34107380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a31d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f7990 0x7f8a34107380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46354/0 (socket says 172.21.15.6:46354) 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a31d9b700 1 -- 172.21.15.6:0/1399425370 learned_addr learned my addr 172.21.15.6:0/1399425370 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a3259c700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a340f66f0 0x7f8a34106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a31d9b700 1 -- 172.21.15.6:0/1399425370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a340f66f0 msgr2=0x7f8a34106e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a31d9b700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a340f66f0 0x7f8a34106e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a31d9b700 1 -- 172.21.15.6:0/1399425370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8a24005040 con 0x7f8a340f7990 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a3259c700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a340f66f0 0x7f8a34106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a31d9b700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f7990 0x7f8a34107380 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f8a1c0041d0 tx=0x7f8a1c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a2b7fe700 1 -- 172.21.15.6:0/1399425370 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a1c002d90 con 0x7f8a340f7990 2024-03-12T16:07:07.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8a3410c510 con 0x7f8a340f7990 2024-03-12T16:07:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a2b7fe700 1 -- 172.21.15.6:0/1399425370 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f8a1c00f040 con 0x7f8a340f7990 2024-03-12T16:07:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a2b7fe700 1 -- 172.21.15.6:0/1399425370 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8a1c00d820 con 0x7f8a340f7990 2024-03-12T16:07:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.833+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8a3410ca50 con 0x7f8a340f7990 2024-03-12T16:07:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.834+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8a340feeb0 con 0x7f8a340f7990 2024-03-12T16:07:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.835+0000 7f8a2b7fe700 1 -- 172.21.15.6:0/1399425370 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f8a1c007b40 con 0x7f8a340f7990 2024-03-12T16:07:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.835+0000 7f8a2b7fe700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8a20061180 0x7f8a20063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:07.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.835+0000 7f8a3259c700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8a20061180 0x7f8a20063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.835+0000 7f8a2b7fe700 1 -- 172.21.15.6:0/1399425370 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f8a1c07c600 con 0x7f8a340f7990 2024-03-12T16:07:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.835+0000 7f8a3259c700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8a20061180 0x7f8a20063640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8a240043d0 tx=0x7f8a24009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:07.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:07.839+0000 7f8a2b7fe700 1 -- 172.21.15.6:0/1399425370 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f8a1c0508d0 con 0x7f8a340f7990 2024-03-12T16:07:08.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.020+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8a34059120 con 0x7f8a20061180 2024-03-12T16:07:08.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.028+0000 7f8a2b7fe700 1 -- 172.21.15.6:0/1399425370 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+2700 (secure 0 0 0) 0x7f8a34059120 con 0x7f8a20061180 2024-03-12T16:07:08.030 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:07:08.030 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (2m) 115s ago 4m 14.5M - 0.23.0 ba2b418f427c 869c486ed5f2 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (4m) 115s ago 4m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (4m) 68s ago 4m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (2m) 115s ago 4m 44.2M - 8.3.5 dad864ee21e9 7deda4319993 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:9283 running (6m) 115s ago 6m 427M - 16.2.15-1-g8963e9de 727f386679cb f09ce35a51f8 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283 running (4m) 68s ago 4m 387M - 16.2.15-1-g8963e9de 727f386679cb d5c56441431d 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (6m) 115s ago 6m 50.1M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (4m) 68s ago 4m 51.2M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (4m) 115s ago 4m 20.3M - 1.3.1 1dbe0e931976 ef9d95e31974 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 68s ago 3m 21.5M - 1.3.1 1dbe0e931976 ee7621f16bde 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (3m) 115s ago 3m 36.7M 4642M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (3m) 115s ago 3m 35.5M 4642M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (2m) 115s ago 2m 33.4M 4642M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (2m) 68s ago 2m 34.5M 4982M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (102s) 68s ago 102s 34.1M 4982M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:07:08.031 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (74s) 68s ago 73s 12.8M 4982M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:07:08.032 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 68s ago 3m 57.4M - 2.33.4 514e6a882f6e 344ddc812ba0 2024-03-12T16:07:08.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8a20061180 msgr2=0x7f8a20063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:08.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8a20061180 0x7f8a20063640 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f8a240043d0 tx=0x7f8a24009cb0).stop 2024-03-12T16:07:08.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f7990 msgr2=0x7f8a34107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f7990 0x7f8a34107380 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7f8a1c0041d0 tx=0x7f8a1c009f60).stop 2024-03-12T16:07:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 shutdown_connections 2024-03-12T16:07:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f8a20061180 0x7f8a20063640 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8a340f66f0 0x7f8a34106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 --2- 172.21.15.6:0/1399425370 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8a340f7990 0x7f8a34107380 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 >> 172.21.15.6:0/1399425370 conn(0x7f8a340f1e50 msgr2=0x7f8a340fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 shutdown_connections 2024-03-12T16:07:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:08.030+0000 7f8a38de6700 1 -- 172.21.15.6:0/1399425370 wait complete. 2024-03-12T16:07:08.743 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph orch ls' 2024-03-12T16:07:09.265 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:07.971663+0000 mgr.smithi006.kskdce (mgr.14196) 182 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:09.266 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:08.022332+0000 mgr.smithi006.kskdce (mgr.14196) 183 : audit [DBG] from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:07.971663+0000 mgr.smithi006.kskdce (mgr.14196) 182 : cluster [DBG] pgmap v160: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:08.022332+0000 mgr.smithi006.kskdce (mgr.14196) 183 : audit [DBG] from='client.14412 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:10.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.871+0000 7f643578b700 1 -- 172.21.15.6:0/1429299912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430061710 msgr2=0x7f64300fa4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.871+0000 7f643578b700 1 --2- 172.21.15.6:0/1429299912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430061710 0x7f64300fa4d0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7f64200047f0 tx=0x7f6420009cb0).stop 2024-03-12T16:07:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.871+0000 7f643578b700 1 -- 172.21.15.6:0/1429299912 shutdown_connections 2024-03-12T16:07:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.871+0000 7f643578b700 1 --2- 172.21.15.6:0/1429299912 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f64300fa9c0 0x7f64300fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.871+0000 7f643578b700 1 --2- 172.21.15.6:0/1429299912 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6430061710 0x7f64300fa4d0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.871+0000 7f643578b700 1 -- 172.21.15.6:0/1429299912 >> 172.21.15.6:0/1429299912 conn(0x7f64300f1ef0 msgr2=0x7f64300f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.871+0000 7f643578b700 1 -- 172.21.15.6:0/1429299912 shutdown_connections 2024-03-12T16:07:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.871+0000 7f643578b700 1 -- 172.21.15.6:0/1429299912 wait complete. 2024-03-12T16:07:10.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f643578b700 1 Processor -- start 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f643578b700 1 -- start start 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f643578b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6430061710 0x7f6430107fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f643578b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64300fa9c0 0x7f64301084d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f643578b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6430108a80 con 0x7f64300fa9c0 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f643578b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6430108bc0 con 0x7f6430061710 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f642e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64300fa9c0 0x7f64301084d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f642e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64300fa9c0 0x7f64301084d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46368/0 (socket says 172.21.15.6:46368) 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f642e7fc700 1 -- 172.21.15.6:0/2546943117 learned_addr learned my addr 172.21.15.6:0/2546943117 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.872+0000 7f642effd700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6430061710 0x7f6430107fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:10.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f642e7fc700 1 -- 172.21.15.6:0/2546943117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6430061710 msgr2=0x7f6430107fe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f642e7fc700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6430061710 0x7f6430107fe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f642e7fc700 1 -- 172.21.15.6:0/2546943117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6420005040 con 0x7f64300fa9c0 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f642effd700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6430061710 0x7f6430107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f642e7fc700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64300fa9c0 0x7f64301084d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f64240041d0 tx=0x7f6424009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f6417fff700 1 -- 172.21.15.6:0/2546943117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6424002d90 con 0x7f64300fa9c0 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f6417fff700 1 -- 172.21.15.6:0/2546943117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f642400f040 con 0x7f64300fa9c0 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f643010d660 con 0x7f64300fa9c0 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f6417fff700 1 -- 172.21.15.6:0/2546943117 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f642400d820 con 0x7f64300fa9c0 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.873+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f643010dba0 con 0x7f64300fa9c0 2024-03-12T16:07:10.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.874+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f64300fffd0 con 0x7f64300fa9c0 2024-03-12T16:07:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.874+0000 7f6417fff700 1 -- 172.21.15.6:0/2546943117 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f6424007b40 con 0x7f64300fa9c0 2024-03-12T16:07:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.875+0000 7f6417fff700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6418061180 0x7f6418063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.875+0000 7f6417fff700 1 -- 172.21.15.6:0/2546943117 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f642407c5d0 con 0x7f64300fa9c0 2024-03-12T16:07:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.875+0000 7f642effd700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6418061180 0x7f6418063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:10.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.875+0000 7f642effd700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6418061180 0x7f6418063640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6420004540 tx=0x7f642000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:10.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:10.879+0000 7f6417fff700 1 -- 172.21.15.6:0/2546943117 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f64240508a0 con 0x7f64300fa9c0 2024-03-12T16:07:11.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.058+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f6430059120 con 0x7f6418061180 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.063+0000 7f6417fff700 1 -- 172.21.15.6:0/2546943117 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+1161 (secure 0 0 0) 0x7f6430059120 con 0x7f6418061180 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager ?:9093,9094 1/1 118s ago 5m count:1 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stdout:crash 2/2 118s ago 5m * 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stdout:grafana ?:3000 1/1 118s ago 5m count:1 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stdout:mgr 2/2 118s ago 5m count:2 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stdout:mon 2/2 118s ago 4m smithi006:172.21.15.6=smithi006;smithi134:172.21.15.134=smithi134;count:2 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter ?:9100 2/2 118s ago 5m * 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stdout:osd 6 118s ago - 2024-03-12T16:07:11.065 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus ?:9095 1/1 71s ago 5m count:1 2024-03-12T16:07:11.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.064+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6418061180 msgr2=0x7f6418063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.064+0000 7f643578b700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6418061180 0x7f6418063640 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7f6420004540 tx=0x7f642000b040).stop 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.064+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64300fa9c0 msgr2=0x7f64301084d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.064+0000 7f643578b700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64300fa9c0 0x7f64301084d0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f64240041d0 tx=0x7f6424009f60).stop 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.065+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 shutdown_connections 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.065+0000 7f643578b700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6418061180 0x7f6418063640 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.065+0000 7f643578b700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6430061710 0x7f6430107fe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.065+0000 7f643578b700 1 --2- 172.21.15.6:0/2546943117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f64300fa9c0 0x7f64301084d0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.065+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 >> 172.21.15.6:0/2546943117 conn(0x7f64300f1ef0 msgr2=0x7f64300f42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.065+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 shutdown_connections 2024-03-12T16:07:11.067 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:11.065+0000 7f643578b700 1 -- 172.21.15.6:0/2546943117 wait complete. 2024-03-12T16:07:11.312 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:09.972223+0000 mgr.smithi006.kskdce (mgr.14196) 184 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:09.972223+0000 mgr.smithi006.kskdce (mgr.14196) 184 : cluster [DBG] pgmap v161: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:11.825 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph orch host ls' 2024-03-12T16:07:12.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:11.061088+0000 mgr.smithi006.kskdce (mgr.14196) 185 : audit [DBG] from='client.14416 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:12.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:12 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:11.061088+0000 mgr.smithi006.kskdce (mgr.14196) 185 : audit [DBG] from='client.14416 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:11.972592+0000 mgr.smithi006.kskdce (mgr.14196) 186 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:13.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:11.972592+0000 mgr.smithi006.kskdce (mgr.14196) 186 : cluster [DBG] pgmap v162: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:13.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.811+0000 7efe8a091700 1 -- 172.21.15.6:0/1931907374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 msgr2=0x7efe840f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:13.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.811+0000 7efe8a091700 1 --2- 172.21.15.6:0/1931907374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 0x7efe840f6b10 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7efe740047f0 tx=0x7efe74009cb0).stop 2024-03-12T16:07:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.812+0000 7efe8a091700 1 -- 172.21.15.6:0/1931907374 shutdown_connections 2024-03-12T16:07:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.812+0000 7efe8a091700 1 --2- 172.21.15.6:0/1931907374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe840f7990 0x7efe840f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.812+0000 7efe8a091700 1 --2- 172.21.15.6:0/1931907374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 0x7efe840f6b10 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.812+0000 7efe8a091700 1 -- 172.21.15.6:0/1931907374 >> 172.21.15.6:0/1931907374 conn(0x7efe840f1e50 msgr2=0x7efe840f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.812+0000 7efe8a091700 1 -- 172.21.15.6:0/1931907374 shutdown_connections 2024-03-12T16:07:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.812+0000 7efe8a091700 1 -- 172.21.15.6:0/1931907374 wait complete. 2024-03-12T16:07:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.813+0000 7efe8a091700 1 Processor -- start 2024-03-12T16:07:13.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.813+0000 7efe8a091700 1 -- start start 2024-03-12T16:07:13.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.813+0000 7efe8a091700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 0x7efe8410a160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.813+0000 7efe8a091700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe840f7990 0x7efe8410a650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.813+0000 7efe8a091700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8410ac00 con 0x7efe840f66f0 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.813+0000 7efe8a091700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe8410ad40 con 0x7efe840f7990 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 0x7efe8410a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 0x7efe8410a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46016/0 (socket says 172.21.15.6:46016) 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe837fe700 1 -- 172.21.15.6:0/9027921 learned_addr learned my addr 172.21.15.6:0/9027921 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe82ffd700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe840f7990 0x7efe8410a650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe837fe700 1 -- 172.21.15.6:0/9027921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe840f7990 msgr2=0x7efe8410a650 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe837fe700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe840f7990 0x7efe8410a650 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe837fe700 1 -- 172.21.15.6:0/9027921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe74005040 con 0x7efe840f66f0 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe82ffd700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe840f7990 0x7efe8410a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe837fe700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 0x7efe8410a160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7efe74004f10 tx=0x7efe74009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe80ff9700 1 -- 172.21.15.6:0/9027921 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe7400e070 con 0x7efe840f66f0 2024-03-12T16:07:13.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe80ff9700 1 -- 172.21.15.6:0/9027921 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7efe74007e90 con 0x7efe840f66f0 2024-03-12T16:07:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe8410f780 con 0x7efe840f66f0 2024-03-12T16:07:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe80ff9700 1 -- 172.21.15.6:0/9027921 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe74018070 con 0x7efe840f66f0 2024-03-12T16:07:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.814+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe8410fcc0 con 0x7efe840f66f0 2024-03-12T16:07:13.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.815+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe840feeb0 con 0x7efe840f66f0 2024-03-12T16:07:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.816+0000 7efe80ff9700 1 -- 172.21.15.6:0/9027921 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7efe740123c0 con 0x7efe840f66f0 2024-03-12T16:07:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.816+0000 7efe80ff9700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efe6c061180 0x7efe6c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.816+0000 7efe80ff9700 1 -- 172.21.15.6:0/9027921 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7efe7407d450 con 0x7efe840f66f0 2024-03-12T16:07:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.816+0000 7efe82ffd700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efe6c061180 0x7efe6c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:13.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.816+0000 7efe82ffd700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efe6c061180 0x7efe6c063640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7efe78009250 tx=0x7efe78009d60).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:13.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.820+0000 7efe80ff9700 1 -- 172.21.15.6:0/9027921 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7efe74051720 con 0x7efe840f66f0 2024-03-12T16:07:13.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.997+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch host ls", "target": ["mon-mgr", ""]}) v1 -- 0x7efe84110300 con 0x7efe6c061180 2024-03-12T16:07:14.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:13.998+0000 7efe80ff9700 1 -- 172.21.15.6:0/9027921 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+148 (secure 0 0 0) 0x7efe84110300 con 0x7efe6c061180 2024-03-12T16:07:14.000 INFO:teuthology.orchestra.run.smithi006.stdout:HOST ADDR LABELS STATUS 2024-03-12T16:07:14.000 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 172.21.15.6 2024-03-12T16:07:14.000 INFO:teuthology.orchestra.run.smithi006.stdout:smithi134 172.21.15.134 2024-03-12T16:07:14.000 INFO:teuthology.orchestra.run.smithi006.stdout:2 hosts in cluster 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efe6c061180 msgr2=0x7efe6c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efe6c061180 0x7efe6c063640 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7efe78009250 tx=0x7efe78009d60).stop 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 msgr2=0x7efe8410a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 0x7efe8410a160 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7efe74004f10 tx=0x7efe74009cb0).stop 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 shutdown_connections 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7efe6c061180 0x7efe6c063640 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe840f66f0 0x7efe8410a160 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 --2- 172.21.15.6:0/9027921 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe840f7990 0x7efe8410a650 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 >> 172.21.15.6:0/9027921 conn(0x7efe840f1e50 msgr2=0x7efe84060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 shutdown_connections 2024-03-12T16:07:14.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:14.000+0000 7efe8a091700 1 -- 172.21.15.6:0/9027921 wait complete. 2024-03-12T16:07:14.619 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph orch device ls' 2024-03-12T16:07:15.361 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:13.972871+0000 mgr.smithi006.kskdce (mgr.14196) 187 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:15.361 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:13.999184+0000 mgr.smithi006.kskdce (mgr.14196) 188 : audit [DBG] from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:15.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:13.972871+0000 mgr.smithi006.kskdce (mgr.14196) 187 : cluster [DBG] pgmap v163: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:15.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:13.999184+0000 mgr.smithi006.kskdce (mgr.14196) 188 : audit [DBG] from='client.14420 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.692+0000 7f5beb6b5700 1 -- 172.21.15.6:0/4068325757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be40fa9b0 msgr2=0x7f5be40fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.692+0000 7f5beb6b5700 1 --2- 172.21.15.6:0/4068325757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be40fa9b0 0x7f5be40fcda0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f5bd80047f0 tx=0x7f5bd8009cb0).stop 2024-03-12T16:07:16.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.692+0000 7f5beb6b5700 1 -- 172.21.15.6:0/4068325757 shutdown_connections 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.692+0000 7f5beb6b5700 1 --2- 172.21.15.6:0/4068325757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be40fa9b0 0x7f5be40fcda0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.692+0000 7f5beb6b5700 1 --2- 172.21.15.6:0/4068325757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5be4061220 0x7f5be40fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.692+0000 7f5beb6b5700 1 -- 172.21.15.6:0/4068325757 >> 172.21.15.6:0/4068325757 conn(0x7f5be40f1e50 msgr2=0x7f5be40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.692+0000 7f5beb6b5700 1 -- 172.21.15.6:0/4068325757 shutdown_connections 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.692+0000 7f5beb6b5700 1 -- 172.21.15.6:0/4068325757 wait complete. 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5beb6b5700 1 Processor -- start 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5beb6b5700 1 -- start start 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5beb6b5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be4061220 0x7f5be40f7cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5beb6b5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5be40fa9b0 0x7f5be40f6330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5beb6b5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40f8280 con 0x7f5be4061220 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5beb6b5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5be40f6820 con 0x7f5be40fa9b0 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5be9451700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be4061220 0x7f5be40f7cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5be9451700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be4061220 0x7f5be40f7cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46034/0 (socket says 172.21.15.6:46034) 2024-03-12T16:07:16.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5be9451700 1 -- 172.21.15.6:0/2984822251 learned_addr learned my addr 172.21.15.6:0/2984822251 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5be8c50700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5be40fa9b0 0x7f5be40f6330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5be9451700 1 -- 172.21.15.6:0/2984822251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5be40fa9b0 msgr2=0x7f5be40f6330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5be9451700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5be40fa9b0 0x7f5be40f6330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5be9451700 1 -- 172.21.15.6:0/2984822251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bd8005040 con 0x7f5be4061220 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.693+0000 7f5be8c50700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5be40fa9b0 0x7f5be40f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.694+0000 7f5be9451700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be4061220 0x7f5be40f7cd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f5be000e8f0 tx=0x7f5be000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.694+0000 7f5bd67fc700 1 -- 172.21.15.6:0/2984822251 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be000ee90 con 0x7f5be4061220 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.694+0000 7f5bd67fc700 1 -- 172.21.15.6:0/2984822251 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f5be000f040 con 0x7f5be4061220 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.694+0000 7f5bd67fc700 1 -- 172.21.15.6:0/2984822251 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5be000c810 con 0x7f5be4061220 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.694+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5be40f6aa0 con 0x7f5be4061220 2024-03-12T16:07:16.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.694+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5be40f7060 con 0x7f5be4061220 2024-03-12T16:07:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.695+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5be40fffb0 con 0x7f5be4061220 2024-03-12T16:07:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.695+0000 7f5bd67fc700 1 -- 172.21.15.6:0/2984822251 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f5be0009360 con 0x7f5be4061220 2024-03-12T16:07:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.696+0000 7f5bd67fc700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f5bd0061180 0x7f5bd0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.696+0000 7f5be8c50700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f5bd0061180 0x7f5bd0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.696+0000 7f5bd67fc700 1 -- 172.21.15.6:0/2984822251 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7f5be007c0e0 con 0x7f5be4061220 2024-03-12T16:07:16.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.696+0000 7f5be8c50700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f5bd0061180 0x7f5bd0063640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5bd8004e60 tx=0x7f5bd800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:16.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.700+0000 7f5bd67fc700 1 -- 172.21.15.6:0/2984822251 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5be0050430 con 0x7f5be4061220 2024-03-12T16:07:16.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.880+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch device ls", "target": ["mon-mgr", ""]}) v1 -- 0x7f5be4059120 con 0x7f5bd0061180 2024-03-12T16:07:16.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.882+0000 7f5bd67fc700 1 -- 172.21.15.6:0/2984822251 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+399 (secure 0 0 0) 0x7f5be4059120 con 0x7f5bd0061180 2024-03-12T16:07:16.884 INFO:teuthology.orchestra.run.smithi006.stdout:HOST PATH TYPE DEVICE ID SIZE AVAILABLE REFRESHED REJECT REASONS 2024-03-12T16:07:16.884 INFO:teuthology.orchestra.run.smithi006.stdout:smithi006 /dev/nvme0n1 ssd INTEL SSDPEDMD400G4_CVFT5330000H400BGN 372G 2m ago Has a FileSystem, LVM detected 2024-03-12T16:07:16.884 INFO:teuthology.orchestra.run.smithi006.stdout:smithi134 /dev/nvme0n1 ssd INTEL SSDPEDMD400G4_CVFT62420002400BGN 372G 73s ago Has a FileSystem, LVM detected 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f5bd0061180 msgr2=0x7f5bd0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f5bd0061180 0x7f5bd0063640 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f5bd8004e60 tx=0x7f5bd800b040).stop 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be4061220 msgr2=0x7f5be40f7cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be4061220 0x7f5be40f7cd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f5be000e8f0 tx=0x7f5be000b040).stop 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 shutdown_connections 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f5bd0061180 0x7f5bd0063640 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5be4061220 0x7f5be40f7cd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 --2- 172.21.15.6:0/2984822251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5be40fa9b0 0x7f5be40f6330 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 >> 172.21.15.6:0/2984822251 conn(0x7f5be40f1e50 msgr2=0x7f5be40f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 shutdown_connections 2024-03-12T16:07:16.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:16.884+0000 7f5beb6b5700 1 -- 172.21.15.6:0/2984822251 wait complete. 2024-03-12T16:07:17.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:15.973215+0000 mgr.smithi006.kskdce (mgr.14196) 189 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:17.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:15.973215+0000 mgr.smithi006.kskdce (mgr.14196) 189 : cluster [DBG] pgmap v164: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:17.644 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-12T16:07:17.657 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:07:17.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph fs volume create cephfs --placement=4' 2024-03-12T16:07:18.410 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:16.883066+0000 mgr.smithi006.kskdce (mgr.14196) 190 : audit [DBG] from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:18.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:16.883066+0000 mgr.smithi006.kskdce (mgr.14196) 190 : audit [DBG] from='client.14424 -' entity='client.admin' cmd=[{"prefix": "orch device ls", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:19.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:17.973733+0000 mgr.smithi006.kskdce (mgr.14196) 191 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:19.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:17.973733+0000 mgr.smithi006.kskdce (mgr.14196) 191 : cluster [DBG] pgmap v165: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.554+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/1676138710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f7990 msgr2=0x7fb5c40f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.554+0000 7fb5cc1e3700 1 --2- 172.21.15.6:0/1676138710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f7990 0x7fb5c40f7df0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fb5b40047f0 tx=0x7fb5b4009cb0).stop 2024-03-12T16:07:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.554+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/1676138710 shutdown_connections 2024-03-12T16:07:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.554+0000 7fb5cc1e3700 1 --2- 172.21.15.6:0/1676138710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f7990 0x7fb5c40f7df0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.554+0000 7fb5cc1e3700 1 --2- 172.21.15.6:0/1676138710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c40f66f0 0x7fb5c40f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:07:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.554+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/1676138710 >> 172.21.15.6:0/1676138710 conn(0x7fb5c40f1e50 msgr2=0x7fb5c40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.555+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/1676138710 shutdown_connections 2024-03-12T16:07:19.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.555+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/1676138710 wait complete. 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.555+0000 7fb5cc1e3700 1 Processor -- start 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.555+0000 7fb5cc1e3700 1 -- start start 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.555+0000 7fb5cc1e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f66f0 0x7fb5c4108010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.555+0000 7fb5cc1e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c40f7990 0x7fb5c4108500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.555+0000 7fb5cc1e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4108b40 con 0x7fb5c40f66f0 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.555+0000 7fb5cc1e3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb5c4108c80 con 0x7fb5c40f7990 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.555+0000 7fb5c9f7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f66f0 0x7fb5c4108010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5c9f7f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f66f0 0x7fb5c4108010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46054/0 (socket says 172.21.15.6:46054) 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5c9f7f700 1 -- 172.21.15.6:0/3750153692 learned_addr learned my addr 172.21.15.6:0/3750153692 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5c977e700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c40f7990 0x7fb5c4108500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5c9f7f700 1 -- 172.21.15.6:0/3750153692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c40f7990 msgr2=0x7fb5c4108500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:19.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5c9f7f700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c40f7990 0x7fb5c4108500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5c9f7f700 1 -- 172.21.15.6:0/3750153692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb5b4005040 con 0x7fb5c40f66f0 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5c977e700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c40f7990 0x7fb5c4108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5c9f7f700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f66f0 0x7fb5c4108010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb5c000b480 tx=0x7fb5c00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5baffd700 1 -- 172.21.15.6:0/3750153692 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c0002500 con 0x7fb5c40f66f0 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5baffd700 1 -- 172.21.15.6:0/3750153692 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fb5c0002af0 con 0x7fb5c40f66f0 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb5c410d720 con 0x7fb5c40f66f0 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5baffd700 1 -- 172.21.15.6:0/3750153692 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb5c0012c40 con 0x7fb5c40f66f0 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.556+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5c410dc60 con 0x7fb5c40f66f0 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.557+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb5c40fef50 con 0x7fb5c40f66f0 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.557+0000 7fb5baffd700 1 -- 172.21.15.6:0/3750153692 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fb5c0002660 con 0x7fb5c40f66f0 2024-03-12T16:07:19.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.558+0000 7fb5baffd700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb5b0061180 0x7fb5b0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:19.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.558+0000 7fb5baffd700 1 -- 172.21.15.6:0/3750153692 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(38..38 src has 1..38) v4 ==== 4535+0+0 (secure 0 0 0) 0x7fb5c007c5d0 con 0x7fb5c40f66f0 2024-03-12T16:07:19.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.558+0000 7fb5c977e700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb5b0061180 0x7fb5b0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:19.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.558+0000 7fb5c977e700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb5b0061180 0x7fb5b0063640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb5b4007cf0 tx=0x7fb5b400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:19.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.562+0000 7fb5baffd700 1 -- 172.21.15.6:0/3750153692 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fb5c00508a0 con 0x7fb5c40f66f0 2024-03-12T16:07:19.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:19.760+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}) v1 -- 0x7fb5c410e300 con 0x7fb5b0061180 2024-03-12T16:07:20.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:19.763510+0000 mon.smithi006 (mon.0) 484 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-03-12T16:07:20.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:19.763510+0000 mon.smithi006 (mon.0) 484 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]: dispatch 2024-03-12T16:07:21.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.284+0000 7fb5baffd700 1 -- 172.21.15.6:0/3750153692 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+0 (secure 0 0 0) 0x7fb5c410e300 con 0x7fb5b0061180 2024-03-12T16:07:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb5b0061180 msgr2=0x7fb5b0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb5b0061180 0x7fb5b0063640 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb5b4007cf0 tx=0x7fb5b400b040).stop 2024-03-12T16:07:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f66f0 msgr2=0x7fb5c4108010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:21.288 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f66f0 0x7fb5c4108010 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fb5c000b480 tx=0x7fb5c00090f0).stop 2024-03-12T16:07:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 shutdown_connections 2024-03-12T16:07:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fb5b0061180 0x7fb5b0063640 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5c40f66f0 0x7fb5c4108010 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 --2- 172.21.15.6:0/3750153692 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5c40f7990 0x7fb5c4108500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 >> 172.21.15.6:0/3750153692 conn(0x7fb5c40f1e50 msgr2=0x7fb5c4060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 shutdown_connections 2024-03-12T16:07:21.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:21.286+0000 7fb5cc1e3700 1 -- 172.21.15.6:0/3750153692 wait complete. 2024-03-12T16:07:21.647 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:07:21.258+0000 7f3935fde700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:19.762968+0000 mgr.smithi006.kskdce (mgr.14196) 192 : audit [DBG] from='client.14428 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:19.974028+0000 mgr.smithi006.kskdce (mgr.14196) 193 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:20.255112+0000 mon.smithi006 (mon.0) 485 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:20.255154+0000 mon.smithi006 (mon.0) 486 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:20.256503+0000 mon.smithi006 (mon.0) 487 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.257442+0000 mon.smithi006 (mon.0) 488 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:21.257626+0000 mon.smithi006 (mon.0) 489 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.259040+0000 mon.smithi006 (mon.0) 490 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:21.259868+0000 mon.smithi006 (mon.0) 491 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-12T16:07:21.928 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:21.259900+0000 mon.smithi006 (mon.0) 492 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:21.271521+0000 mon.smithi006 (mon.0) 493 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.271886+0000 mon.smithi006 (mon.0) 494 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:21.271980+0000 mon.smithi006 (mon.0) 495 : cluster [DBG] fsmap cephfs:0 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:07:21.278603+0000 mgr.smithi006.kskdce (mgr.14196) 194 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.285215+0000 mon.smithi006 (mon.0) 496 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.287766+0000 mon.smithi006 (mon.0) 497 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.289813+0000 mon.smithi006 (mon.0) 498 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.290613+0000 mon.smithi006 (mon.0) 499 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.295688+0000 mon.smithi006 (mon.0) 500 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.303668+0000 mon.smithi006 (mon.0) 501 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.304522+0000 mon.smithi006 (mon.0) 502 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ncuwuc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.307624+0000 mon.smithi006 (mon.0) 503 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ncuwuc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:21.308244+0000 mon.smithi006 (mon.0) 504 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:21.929 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:07:21.308865+0000 mgr.smithi006.kskdce (mgr.14196) 195 : cephadm [INF] Deploying daemon mds.cephfs.smithi006.ncuwuc on smithi006 2024-03-12T16:07:21.948 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-12T16:07:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:19.762968+0000 mgr.smithi006.kskdce (mgr.14196) 192 : audit [DBG] from='client.14428 -' entity='client.admin' cmd=[{"prefix": "fs volume create", "name": "cephfs", "placement": "4", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:07:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:19.974028+0000 mgr.smithi006.kskdce (mgr.14196) 193 : cluster [DBG] pgmap v166: 1 pgs: 1 active+clean; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:20.255112+0000 mon.smithi006 (mon.0) 485 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "osd pool create", "pool": "cephfs.cephfs.meta"}]': finished 2024-03-12T16:07:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:20.255154+0000 mon.smithi006 (mon.0) 486 : cluster [DBG] osdmap e39: 6 total, 6 up, 6 in 2024-03-12T16:07:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:20.256503+0000 mon.smithi006 (mon.0) 487 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]: dispatch 2024-03-12T16:07:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.257442+0000 mon.smithi006 (mon.0) 488 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"bulk": true, "prefix": "osd pool create", "pool": "cephfs.cephfs.data"}]': finished 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:21.257626+0000 mon.smithi006 (mon.0) 489 : cluster [DBG] osdmap e40: 6 total, 6 up, 6 in 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.259040+0000 mon.smithi006 (mon.0) 490 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]: dispatch 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:21.259868+0000 mon.smithi006 (mon.0) 491 : cluster [ERR] Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:21.259900+0000 mon.smithi006 (mon.0) 492 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:21.271521+0000 mon.smithi006 (mon.0) 493 : cluster [DBG] osdmap e41: 6 total, 6 up, 6 in 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.271886+0000 mon.smithi006 (mon.0) 494 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "fs new", "fs_name": "cephfs", "metadata": "cephfs.cephfs.meta", "data": "cephfs.cephfs.data"}]': finished 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:21.271980+0000 mon.smithi006 (mon.0) 495 : cluster [DBG] fsmap cephfs:0 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:07:21.278603+0000 mgr.smithi006.kskdce (mgr.14196) 194 : cephadm [INF] Saving service mds.cephfs spec with placement count:4 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.285215+0000 mon.smithi006 (mon.0) 496 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.287766+0000 mon.smithi006 (mon.0) 497 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.289813+0000 mon.smithi006 (mon.0) 498 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.290613+0000 mon.smithi006 (mon.0) 499 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:07:21.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.295688+0000 mon.smithi006 (mon.0) 500 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:21.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.303668+0000 mon.smithi006 (mon.0) 501 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:21.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.304522+0000 mon.smithi006 (mon.0) 502 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ncuwuc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:07:21.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.307624+0000 mon.smithi006 (mon.0) 503 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ncuwuc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-12T16:07:21.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:21.308244+0000 mon.smithi006 (mon.0) 504 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:21.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:07:21.308865+0000 mgr.smithi006.kskdce (mgr.14196) 195 : cephadm [INF] Deploying daemon mds.cephfs.smithi006.ncuwuc on smithi006 2024-03-12T16:07:23.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:21.974317+0000 mgr.smithi006.kskdce (mgr.14196) 196 : cluster [DBG] pgmap v170: 65 pgs: 5 creating+peering, 1 active+clean, 59 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:23.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:22.273578+0000 mon.smithi006 (mon.0) 505 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-03-12T16:07:23.545 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:21.974317+0000 mgr.smithi006.kskdce (mgr.14196) 196 : cluster [DBG] pgmap v170: 65 pgs: 5 creating+peering, 1 active+clean, 59 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:23.545 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:22.273578+0000 mon.smithi006 (mon.0) 505 : cluster [DBG] osdmap e42: 6 total, 6 up, 6 in 2024-03-12T16:07:24.417 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:23.281203+0000 mon.smithi006 (mon.0) 506 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-03-12T16:07:24.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:23.281203+0000 mon.smithi006 (mon.0) 506 : cluster [DBG] osdmap e43: 6 total, 6 up, 6 in 2024-03-12T16:07:25.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 -- 172.21.15.6:0/2017169747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c061280 msgr2=0x7f398c0fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:25.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 --2- 172.21.15.6:0/2017169747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c061280 0x7f398c0fa3d0 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f39880047f0 tx=0x7f3988009cb0).stop 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 -- 172.21.15.6:0/2017169747 shutdown_connections 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 --2- 172.21.15.6:0/2017169747 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398c0fa950 0x7f398c0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 --2- 172.21.15.6:0/2017169747 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c061280 0x7f398c0fa3d0 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 -- 172.21.15.6:0/2017169747 >> 172.21.15.6:0/2017169747 conn(0x7f398c0f1e50 msgr2=0x7f398c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 -- 172.21.15.6:0/2017169747 shutdown_connections 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 -- 172.21.15.6:0/2017169747 wait complete. 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 Processor -- start 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.911+0000 7f3994315700 1 -- start start 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f3994315700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398c061280 0x7f398c0f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f3994315700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0fa950 0x7f398c0f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f3994315700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0f8220 con 0x7f398c0fa950 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f3994315700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f398c0f67c0 con 0x7f398c061280 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f39918b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0fa950 0x7f398c0f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:25.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f39918b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0fa950 0x7f398c0f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40762/0 (socket says 172.21.15.6:40762) 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f39918b0700 1 -- 172.21.15.6:0/151132883 learned_addr learned my addr 172.21.15.6:0/151132883 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f39920b1700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398c061280 0x7f398c0f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f39918b0700 1 -- 172.21.15.6:0/151132883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398c061280 msgr2=0x7f398c0f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f39918b0700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398c061280 0x7f398c0f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f39918b0700 1 -- 172.21.15.6:0/151132883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3988005040 con 0x7f398c0fa950 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f39920b1700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398c061280 0x7f398c0f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f39918b0700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0fa950 0x7f398c0f62d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f3980002780 tx=0x7f3980009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f397f7fe700 1 -- 172.21.15.6:0/151132883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3980007b40 con 0x7f398c0fa950 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f397f7fe700 1 -- 172.21.15.6:0/151132883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f398000f040 con 0x7f398c0fa950 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f397f7fe700 1 -- 172.21.15.6:0/151132883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f39800146f0 con 0x7f398c0fa950 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f398c0f6a40 con 0x7f398c0fa950 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.912+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f398c0f6f30 con 0x7f398c0fa950 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.913+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f398c0fffe0 con 0x7f398c0fa950 2024-03-12T16:07:25.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.914+0000 7f397f7fe700 1 -- 172.21.15.6:0/151132883 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f3980007ca0 con 0x7f398c0fa950 2024-03-12T16:07:25.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.914+0000 7f397f7fe700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f3978061180 0x7f3978063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:25.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.914+0000 7f397f7fe700 1 -- 172.21.15.6:0/151132883 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f398007c810 con 0x7f398c0fa950 2024-03-12T16:07:25.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.914+0000 7f39920b1700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f3978061180 0x7f3978063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:25.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.915+0000 7f39920b1700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f3978061180 0x7f3978063640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3988013470 tx=0x7f398800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:25.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:24.918+0000 7f397f7fe700 1 -- 172.21.15.6:0/151132883 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f39800507a0 con 0x7f398c0fa950 2024-03-12T16:07:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.153+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f398c0598f0 con 0x7f398c0fa950 2024-03-12T16:07:25.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.153+0000 7f397f7fe700 1 -- 172.21.15.6:0/151132883 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 2 v2) v1 ==== 75+0+1034 (secure 0 0 0) 0x7f3980050390 con 0x7f398c0fa950 2024-03-12T16:07:25.155 INFO:teuthology.orchestra.run.smithi006.stdout:e2 2024-03-12T16:07:25.155 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 2 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:07:21.259775+0000 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:07:25.156 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 1 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:in 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 0 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:07:25.157 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:07:25.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f3978061180 msgr2=0x7f3978063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:25.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f3978061180 0x7f3978063640 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3988013470 tx=0x7f398800b040).stop 2024-03-12T16:07:25.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0fa950 msgr2=0x7f398c0f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:25.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0fa950 0x7f398c0f62d0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f3980002780 tx=0x7f3980009ee0).stop 2024-03-12T16:07:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 shutdown_connections 2024-03-12T16:07:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f3978061180 0x7f3978063640 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f398c061280 0x7f398c0f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 --2- 172.21.15.6:0/151132883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f398c0fa950 0x7f398c0f62d0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 >> 172.21.15.6:0/151132883 conn(0x7f398c0f1e50 msgr2=0x7f398c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.155+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 shutdown_connections 2024-03-12T16:07:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:25.156+0000 7f3994315700 1 -- 172.21.15.6:0/151132883 wait complete. 2024-03-12T16:07:25.159 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 2 2024-03-12T16:07:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:23.974750+0000 mgr.smithi006.kskdce (mgr.14196) 197 : cluster [DBG] pgmap v173: 65 pgs: 5 creating+peering, 28 active+clean, 32 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:25.046712+0000 mon.smithi006 (mon.0) 507 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:25.047861+0000 mon.smithi006 (mon.0) 508 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jqydtn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:07:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:25.050402+0000 mon.smithi006 (mon.0) 509 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jqydtn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-12T16:07:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:25.051029+0000 mon.smithi006 (mon.0) 510 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:25.071530+0000 mon.smithi006 (mon.0) 511 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:25.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:25.155109+0000 mon.smithi006 (mon.0) 512 : audit [DBG] from='client.? 172.21.15.6:0/151132883' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:07:25.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:23.974750+0000 mgr.smithi006.kskdce (mgr.14196) 197 : cluster [DBG] pgmap v173: 65 pgs: 5 creating+peering, 28 active+clean, 32 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:25.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:25.046712+0000 mon.smithi006 (mon.0) 507 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:25.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:25.047861+0000 mon.smithi006 (mon.0) 508 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jqydtn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:07:25.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:25.050402+0000 mon.smithi006 (mon.0) 509 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jqydtn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-12T16:07:25.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:25.051029+0000 mon.smithi006 (mon.0) 510 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:25.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:25.071530+0000 mon.smithi006 (mon.0) 511 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:25.587 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:25.155109+0000 mon.smithi006 (mon.0) 512 : audit [DBG] from='client.? 172.21.15.6:0/151132883' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:07:25.892 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-12T16:07:25.906 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:07:25.906 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph fs set cephfs max_mds 2' 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:07:25.051647+0000 mgr.smithi006.kskdce (mgr.14196) 198 : cephadm [INF] Deploying daemon mds.cephfs.smithi134.jqydtn on smithi134 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:25.286239+0000 mon.smithi006 (mon.0) 513 : cluster [DBG] mds.? [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] up:boot 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:25.286291+0000 mon.smithi006 (mon.0) 514 : cluster [INF] daemon mds.cephfs.smithi006.ncuwuc assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:25.286356+0000 mon.smithi006 (mon.0) 515 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:25.286381+0000 mon.smithi006 (mon.0) 516 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:25.286401+0000 mon.smithi006 (mon.0) 517 : cluster [INF] Cluster is now healthy 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:25.286652+0000 mon.smithi006 (mon.0) 518 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:25.287383+0000 mon.smithi006 (mon.0) 519 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:25.290767+0000 mon.smithi006 (mon.0) 520 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi006.ncuwuc=up:creating} 2024-03-12T16:07:26.678 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:25.302980+0000 mon.smithi006 (mon.0) 521 : cluster [INF] daemon mds.cephfs.smithi006.ncuwuc is now active in filesystem cephfs as rank 0 2024-03-12T16:07:26.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:07:25.051647+0000 mgr.smithi006.kskdce (mgr.14196) 198 : cephadm [INF] Deploying daemon mds.cephfs.smithi134.jqydtn on smithi134 2024-03-12T16:07:26.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:25.286239+0000 mon.smithi006 (mon.0) 513 : cluster [DBG] mds.? [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] up:boot 2024-03-12T16:07:26.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:25.286291+0000 mon.smithi006 (mon.0) 514 : cluster [INF] daemon mds.cephfs.smithi006.ncuwuc assigned to filesystem cephfs as rank 0 (now has 1 ranks) 2024-03-12T16:07:26.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:25.286356+0000 mon.smithi006 (mon.0) 515 : cluster [INF] Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-12T16:07:26.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:25.286381+0000 mon.smithi006 (mon.0) 516 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-12T16:07:26.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:25.286401+0000 mon.smithi006 (mon.0) 517 : cluster [INF] Cluster is now healthy 2024-03-12T16:07:26.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:25.286652+0000 mon.smithi006 (mon.0) 518 : cluster [DBG] fsmap cephfs:0 1 up:standby 2024-03-12T16:07:26.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:25.287383+0000 mon.smithi006 (mon.0) 519 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:07:26.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:25.290767+0000 mon.smithi006 (mon.0) 520 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi006.ncuwuc=up:creating} 2024-03-12T16:07:26.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:25.302980+0000 mon.smithi006 (mon.0) 521 : cluster [INF] daemon mds.cephfs.smithi006.ncuwuc is now active in filesystem cephfs as rank 0 2024-03-12T16:07:27.579 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:25.975141+0000 mgr.smithi006.kskdce (mgr.14196) 199 : cluster [DBG] pgmap v174: 65 pgs: 5 creating+peering, 52 active+clean, 8 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:27.579 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:26.291134+0000 mon.smithi006 (mon.0) 522 : cluster [DBG] mds.? [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] up:active 2024-03-12T16:07:27.579 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:26.291195+0000 mon.smithi006 (mon.0) 523 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi006.ncuwuc=up:active} 2024-03-12T16:07:27.692 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:25.975141+0000 mgr.smithi006.kskdce (mgr.14196) 199 : cluster [DBG] pgmap v174: 65 pgs: 5 creating+peering, 52 active+clean, 8 unknown; 0 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:27.692 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:26.291134+0000 mon.smithi006 (mon.0) 522 : cluster [DBG] mds.? [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] up:active 2024-03-12T16:07:27.692 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:26.291195+0000 mon.smithi006 (mon.0) 523 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi006.ncuwuc=up:active} 2024-03-12T16:07:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.998+0000 7f7c6f15e700 1 -- 172.21.15.6:0/1065018086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 msgr2=0x7f7c680fa470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.998+0000 7f7c6f15e700 1 --2- 172.21.15.6:0/1065018086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 0x7f7c680fa470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f7c5c0047f0 tx=0x7f7c5c009cb0).stop 2024-03-12T16:07:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.998+0000 7f7c6f15e700 1 -- 172.21.15.6:0/1065018086 shutdown_connections 2024-03-12T16:07:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.998+0000 7f7c6f15e700 1 --2- 172.21.15.6:0/1065018086 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c680fa960 0x7f7c680fcdb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.998+0000 7f7c6f15e700 1 --2- 172.21.15.6:0/1065018086 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 0x7f7c680fa470 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.998+0000 7f7c6f15e700 1 -- 172.21.15.6:0/1065018086 >> 172.21.15.6:0/1065018086 conn(0x7f7c680f1e50 msgr2=0x7f7c680f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.998+0000 7f7c6f15e700 1 -- 172.21.15.6:0/1065018086 shutdown_connections 2024-03-12T16:07:28.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.998+0000 7f7c6f15e700 1 -- 172.21.15.6:0/1065018086 wait complete. 2024-03-12T16:07:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.998+0000 7f7c6f15e700 1 Processor -- start 2024-03-12T16:07:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6f15e700 1 -- start start 2024-03-12T16:07:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6f15e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 0x7f7c680f7d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6f15e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c680fa960 0x7f7c680f6370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6f15e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680f82c0 con 0x7f7c680611e0 2024-03-12T16:07:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6f15e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c680f6860 con 0x7f7c680fa960 2024-03-12T16:07:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6cefa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 0x7f7c680f7d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:28.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6cefa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 0x7f7c680f7d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40780/0 (socket says 172.21.15.6:40780) 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6cefa700 1 -- 172.21.15.6:0/3134283275 learned_addr learned my addr 172.21.15.6:0/3134283275 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c67fff700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c680fa960 0x7f7c680f6370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6cefa700 1 -- 172.21.15.6:0/3134283275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c680fa960 msgr2=0x7f7c680f6370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6cefa700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c680fa960 0x7f7c680f6370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6cefa700 1 -- 172.21.15.6:0/3134283275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c5c005040 con 0x7f7c680611e0 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6cefa700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 0x7f7c680f7d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7c5c013580 tx=0x7f7c5c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c65ffb700 1 -- 172.21.15.6:0/3134283275 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c5c018070 con 0x7f7c680611e0 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c65ffb700 1 -- 172.21.15.6:0/3134283275 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7c5c007e90 con 0x7f7c680611e0 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c680f6a80 con 0x7f7c680611e0 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:27.999+0000 7f7c65ffb700 1 -- 172.21.15.6:0/3134283275 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c5c0123c0 con 0x7f7c680611e0 2024-03-12T16:07:28.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.000+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c680f6fe0 con 0x7f7c680611e0 2024-03-12T16:07:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.000+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c68047540 con 0x7f7c680611e0 2024-03-12T16:07:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.001+0000 7f7c65ffb700 1 -- 172.21.15.6:0/3134283275 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f7c5c01d420 con 0x7f7c680611e0 2024-03-12T16:07:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.001+0000 7f7c65ffb700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7c58061180 0x7f7c58063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.001+0000 7f7c65ffb700 1 -- 172.21.15.6:0/3134283275 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f7c5c07d5e0 con 0x7f7c680611e0 2024-03-12T16:07:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.002+0000 7f7c67fff700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7c58061180 0x7f7c58063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:28.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.002+0000 7f7c67fff700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7c58061180 0x7f7c58063640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f7c68060fb0 tx=0x7f7c5400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:28.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.006+0000 7f7c65ffb700 1 -- 172.21.15.6:0/3134283275 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7c5c051570 con 0x7f7c680611e0 2024-03-12T16:07:28.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.246+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"} v 0) v1 -- 0x7f7c68102020 con 0x7f7c680611e0 2024-03-12T16:07:28.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.297+0000 7f7c65ffb700 1 -- 172.21.15.6:0/3134283275 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]=0 v6) v1 ==== 105+0+0 (secure 0 0 0) 0x7f7c5c051160 con 0x7f7c680611e0 2024-03-12T16:07:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7c58061180 msgr2=0x7f7c58063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7c58061180 0x7f7c58063640 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f7c68060fb0 tx=0x7f7c5400b040).stop 2024-03-12T16:07:28.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 msgr2=0x7f7c680f7d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 0x7f7c680f7d10 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f7c5c013580 tx=0x7f7c5c009cb0).stop 2024-03-12T16:07:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 shutdown_connections 2024-03-12T16:07:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7c58061180 0x7f7c58063640 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c680611e0 0x7f7c680f7d10 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 --2- 172.21.15.6:0/3134283275 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c680fa960 0x7f7c680f6370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 >> 172.21.15.6:0/3134283275 conn(0x7f7c680f1e50 msgr2=0x7f7c680f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 shutdown_connections 2024-03-12T16:07:28.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:28.299+0000 7f7c6f15e700 1 -- 172.21.15.6:0/3134283275 wait complete. 2024-03-12T16:07:28.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:27.621635+0000 mon.smithi006 (mon.0) 524 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:27.622716+0000 mon.smithi006 (mon.0) 525 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ufmcfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:27.625759+0000 mon.smithi006 (mon.0) 526 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ufmcfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:27.626485+0000 mon.smithi006 (mon.0) 527 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:07:27.627114+0000 mgr.smithi006.kskdce (mgr.14196) 200 : cephadm [INF] Deploying daemon mds.cephfs.smithi006.ufmcfu on smithi006 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:27.975570+0000 mgr.smithi006.kskdce (mgr.14196) 201 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 182 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:28.247925+0000 mon.smithi006 (mon.0) 528 : audit [INF] from='client.? 172.21.15.6:0/3134283275' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:28.296006+0000 mon.smithi006 (mon.0) 529 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:28.298971+0000 mon.smithi006 (mon.0) 530 : cluster [DBG] mds.? [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] up:boot 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:28.299008+0000 mon.smithi006 (mon.0) 531 : audit [INF] from='client.? 172.21.15.6:0/3134283275' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:28.299077+0000 mon.smithi006 (mon.0) 532 : cluster [INF] daemon mds.cephfs.smithi134.jqydtn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-12T16:07:28.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:28.299159+0000 mon.smithi006 (mon.0) 533 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-03-12T16:07:28.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:28.299182+0000 mon.smithi006 (mon.0) 534 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-12T16:07:28.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:28.299397+0000 mon.smithi006 (mon.0) 535 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi006.ncuwuc=up:active} 1 up:standby 2024-03-12T16:07:28.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:28.299497+0000 mon.smithi006 (mon.0) 536 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:07:28.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:28.302162+0000 mon.smithi006 (mon.0) 537 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:creating} 2024-03-12T16:07:28.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:28.315993+0000 mon.smithi006 (mon.0) 538 : cluster [INF] daemon mds.cephfs.smithi134.jqydtn is now active in filesystem cephfs as rank 1 2024-03-12T16:07:28.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:27.621635+0000 mon.smithi006 (mon.0) 524 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:28.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:27.622716+0000 mon.smithi006 (mon.0) 525 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ufmcfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:07:28.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:27.625759+0000 mon.smithi006 (mon.0) 526 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ufmcfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-12T16:07:28.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:27.626485+0000 mon.smithi006 (mon.0) 527 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:07:27.627114+0000 mgr.smithi006.kskdce (mgr.14196) 200 : cephadm [INF] Deploying daemon mds.cephfs.smithi006.ufmcfu on smithi006 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:27.975570+0000 mgr.smithi006.kskdce (mgr.14196) 201 : cluster [DBG] pgmap v175: 65 pgs: 65 active+clean; 182 B data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:28.247925+0000 mon.smithi006 (mon.0) 528 : audit [INF] from='client.? 172.21.15.6:0/3134283275' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]: dispatch 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:28.296006+0000 mon.smithi006 (mon.0) 529 : cluster [WRN] Health check failed: 1 filesystem is online with fewer MDS than max_mds (MDS_UP_LESS_THAN_MAX) 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:28.298971+0000 mon.smithi006 (mon.0) 530 : cluster [DBG] mds.? [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] up:boot 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:28.299008+0000 mon.smithi006 (mon.0) 531 : audit [INF] from='client.? 172.21.15.6:0/3134283275' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "max_mds", "val": "2"}]': finished 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:28.299077+0000 mon.smithi006 (mon.0) 532 : cluster [INF] daemon mds.cephfs.smithi134.jqydtn assigned to filesystem cephfs as rank 1 (now has 2 ranks) 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:28.299159+0000 mon.smithi006 (mon.0) 533 : cluster [WRN] Health check failed: insufficient standby MDS daemons available (MDS_INSUFFICIENT_STANDBY) 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:28.299182+0000 mon.smithi006 (mon.0) 534 : cluster [INF] Health check cleared: MDS_UP_LESS_THAN_MAX (was: 1 filesystem is online with fewer MDS than max_mds) 2024-03-12T16:07:28.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:28.299397+0000 mon.smithi006 (mon.0) 535 : cluster [DBG] fsmap cephfs:1 {0=cephfs.smithi006.ncuwuc=up:active} 1 up:standby 2024-03-12T16:07:28.959 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:28.299497+0000 mon.smithi006 (mon.0) 536 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:07:28.959 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:28.302162+0000 mon.smithi006 (mon.0) 537 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:creating} 2024-03-12T16:07:28.959 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:28.315993+0000 mon.smithi006 (mon.0) 538 : cluster [INF] daemon mds.cephfs.smithi134.jqydtn is now active in filesystem cephfs as rank 1 2024-03-12T16:07:29.917 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-12T16:07:29.927 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:07:29.928 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph fs set cephfs allow_standby_replay false' 2024-03-12T16:07:30.577 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:29.304018+0000 mon.smithi006 (mon.0) 539 : cluster [DBG] mds.? [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] up:active 2024-03-12T16:07:30.578 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:29.304081+0000 mon.smithi006 (mon.0) 540 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2024-03-12T16:07:30.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:29.304018+0000 mon.smithi006 (mon.0) 539 : cluster [DBG] mds.? [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] up:active 2024-03-12T16:07:30.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:29.304081+0000 mon.smithi006 (mon.0) 540 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2024-03-12T16:07:31.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:29.976052+0000 mgr.smithi006.kskdce (mgr.14196) 202 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s wr, 19 op/s 2024-03-12T16:07:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:29.976052+0000 mgr.smithi006.kskdce (mgr.14196) 202 : cluster [DBG] pgmap v176: 65 pgs: 65 active+clean; 2.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 5.5 KiB/s wr, 19 op/s 2024-03-12T16:07:32.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.183+0000 7f87010bf700 1 -- 172.21.15.6:0/2612512305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0fa950 msgr2=0x7f86fc0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:32.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.183+0000 7f87010bf700 1 --2- 172.21.15.6:0/2612512305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0fa950 0x7f86fc0fcda0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7f86ec0047f0 tx=0x7f86ec009cb0).stop 2024-03-12T16:07:32.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.183+0000 7f87010bf700 1 -- 172.21.15.6:0/2612512305 shutdown_connections 2024-03-12T16:07:32.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.183+0000 7f87010bf700 1 --2- 172.21.15.6:0/2612512305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc0fa950 0x7f86fc0fcda0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:32.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.183+0000 7f87010bf700 1 --2- 172.21.15.6:0/2612512305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc061280 0x7f86fc0fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:07:32.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.183+0000 7f87010bf700 1 -- 172.21.15.6:0/2612512305 >> 172.21.15.6:0/2612512305 conn(0x7f86fc0f1e50 msgr2=0x7f86fc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:32.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.183+0000 7f87010bf700 1 -- 172.21.15.6:0/2612512305 shutdown_connections 2024-03-12T16:07:32.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.183+0000 7f87010bf700 1 -- 172.21.15.6:0/2612512305 wait complete. 2024-03-12T16:07:32.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f87010bf700 1 Processor -- start 2024-03-12T16:07:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f87010bf700 1 -- start start 2024-03-12T16:07:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f87010bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc061280 0x7f86fc107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f87010bf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fa950 0x7f86fc1084e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f87010bf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc108b20 con 0x7f86fc061280 2024-03-12T16:07:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f87010bf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f86fc108c60 con 0x7f86fc0fa950 2024-03-12T16:07:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f86fad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc061280 0x7f86fc107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f86fad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc061280 0x7f86fc107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40822/0 (socket says 172.21.15.6:40822) 2024-03-12T16:07:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f86fad9d700 1 -- 172.21.15.6:0/3583670599 learned_addr learned my addr 172.21.15.6:0/3583670599 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:32.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.184+0000 7f86fa59c700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fa950 0x7f86fc1084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.185+0000 7f86fad9d700 1 -- 172.21.15.6:0/3583670599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fa950 msgr2=0x7f86fc1084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.185+0000 7f86fad9d700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fa950 0x7f86fc1084e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.185+0000 7f86fad9d700 1 -- 172.21.15.6:0/3583670599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f86ec005040 con 0x7f86fc061280 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.185+0000 7f86fad9d700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc061280 0x7f86fc107ff0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f86f000b4b0 tx=0x7f86f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.185+0000 7f86e3fff700 1 -- 172.21.15.6:0/3583670599 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86f0002500 con 0x7f86fc061280 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.185+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f86fc10d700 con 0x7f86fc061280 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.185+0000 7f86e3fff700 1 -- 172.21.15.6:0/3583670599 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f86f0002af0 con 0x7f86fc061280 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.185+0000 7f86e3fff700 1 -- 172.21.15.6:0/3583670599 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f86f0012c80 con 0x7f86fc061280 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.185+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86fc10dc40 con 0x7f86fc061280 2024-03-12T16:07:32.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.186+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f86fc100030 con 0x7f86fc061280 2024-03-12T16:07:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.186+0000 7f86e3fff700 1 -- 172.21.15.6:0/3583670599 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f86f0002660 con 0x7f86fc061280 2024-03-12T16:07:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.187+0000 7f86e3fff700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86e4061180 0x7f86e4063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.187+0000 7f86e3fff700 1 -- 172.21.15.6:0/3583670599 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f86f007c990 con 0x7f86fc061280 2024-03-12T16:07:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.187+0000 7f86fa59c700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86e4061180 0x7f86e4063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:32.190 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.187+0000 7f86fa59c700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86e4061180 0x7f86e4063640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f86ec013470 tx=0x7f86ec00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:32.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.191+0000 7f86e3fff700 1 -- 172.21.15.6:0/3583670599 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f86f0050920 con 0x7f86fc061280 2024-03-12T16:07:32.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:32.414+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"} v 0) v1 -- 0x7f86fc101ea0 con 0x7f86fc061280 2024-03-12T16:07:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:31.306308+0000 mon.smithi006 (mon.0) 541 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-03-12T16:07:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:31.306340+0000 mon.smithi006 (mon.0) 542 : cluster [INF] Cluster is now healthy 2024-03-12T16:07:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:31.313275+0000 mon.smithi006 (mon.0) 543 : cluster [DBG] mds.? [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] up:boot 2024-03-12T16:07:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:31.313348+0000 mon.smithi006 (mon.0) 544 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 1 up:standby 2024-03-12T16:07:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:31.313481+0000 mon.smithi006 (mon.0) 545 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:07:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:31.338904+0000 mon.smithi006 (mon.0) 546 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:31.339995+0000 mon.smithi006 (mon.0) 547 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ufgvbd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:07:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:31.345026+0000 mon.smithi006 (mon.0) 548 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ufgvbd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-12T16:07:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:31.345657+0000 mon.smithi006 (mon.0) 549 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:31.306308+0000 mon.smithi006 (mon.0) 541 : cluster [INF] Health check cleared: MDS_INSUFFICIENT_STANDBY (was: insufficient standby MDS daemons available) 2024-03-12T16:07:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:31.306340+0000 mon.smithi006 (mon.0) 542 : cluster [INF] Cluster is now healthy 2024-03-12T16:07:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:31.313275+0000 mon.smithi006 (mon.0) 543 : cluster [DBG] mds.? [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] up:boot 2024-03-12T16:07:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:31.313348+0000 mon.smithi006 (mon.0) 544 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 1 up:standby 2024-03-12T16:07:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:31.313481+0000 mon.smithi006 (mon.0) 545 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:07:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:31.338904+0000 mon.smithi006 (mon.0) 546 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:31.339995+0000 mon.smithi006 (mon.0) 547 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ufgvbd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:07:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:31.345026+0000 mon.smithi006 (mon.0) 548 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ufgvbd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]': finished 2024-03-12T16:07:32.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:31.345657+0000 mon.smithi006 (mon.0) 549 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:33.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.346+0000 7f86e3fff700 1 -- 172.21.15.6:0/3583670599 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]=0 v10) v1 ==== 122+0+0 (secure 0 0 0) 0x7f86f0050510 con 0x7f86fc061280 2024-03-12T16:07:33.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.348+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86e4061180 msgr2=0x7f86e4063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.348+0000 7f87010bf700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86e4061180 0x7f86e4063640 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f86ec013470 tx=0x7f86ec00b040).stop 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.348+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc061280 msgr2=0x7f86fc107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.348+0000 7f87010bf700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc061280 0x7f86fc107ff0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f86f000b4b0 tx=0x7f86f00090f0).stop 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.348+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 shutdown_connections 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.348+0000 7f87010bf700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f86e4061180 0x7f86e4063640 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.348+0000 7f87010bf700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86fc061280 0x7f86fc107ff0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.348+0000 7f87010bf700 1 --2- 172.21.15.6:0/3583670599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86fc0fa950 0x7f86fc1084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.348+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 >> 172.21.15.6:0/3583670599 conn(0x7f86fc0f1e50 msgr2=0x7f86fc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.349+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 shutdown_connections 2024-03-12T16:07:33.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:33.349+0000 7f87010bf700 1 -- 172.21.15.6:0/3583670599 wait complete. 2024-03-12T16:07:33.566 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:07:31.346281+0000 mgr.smithi006.kskdce (mgr.14196) 203 : cephadm [INF] Deploying daemon mds.cephfs.smithi134.ufgvbd on smithi134 2024-03-12T16:07:33.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:31.976453+0000 mgr.smithi006.kskdce (mgr.14196) 204 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 2.4 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 16 op/s 2024-03-12T16:07:33.567 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:32.416511+0000 mon.smithi006 (mon.0) 550 : audit [INF] from='client.? 172.21.15.6:0/3583670599' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-12T16:07:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:07:31.346281+0000 mgr.smithi006.kskdce (mgr.14196) 203 : cephadm [INF] Deploying daemon mds.cephfs.smithi134.ufgvbd on smithi134 2024-03-12T16:07:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:31.976453+0000 mgr.smithi006.kskdce (mgr.14196) 204 : cluster [DBG] pgmap v177: 65 pgs: 65 active+clean; 2.4 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 16 op/s 2024-03-12T16:07:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:32.416511+0000 mon.smithi006 (mon.0) 550 : audit [INF] from='client.? 172.21.15.6:0/3583670599' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]: dispatch 2024-03-12T16:07:34.016 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-12T16:07:34.026 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:07:34.026 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph fs set cephfs inline_data false' 2024-03-12T16:07:34.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:33.347536+0000 mon.smithi006 (mon.0) 551 : audit [INF] from='client.? 172.21.15.6:0/3583670599' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-12T16:07:34.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:33.347598+0000 mon.smithi006 (mon.0) 552 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 1 up:standby 2024-03-12T16:07:34.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:33.924578+0000 mon.smithi006 (mon.0) 553 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:34.602 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:33.925938+0000 mon.smithi006 (mon.0) 554 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:07:34.602 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:33.976875+0000 mgr.smithi006.kskdce (mgr.14196) 205 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s wr, 12 op/s 2024-03-12T16:07:34.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:33.347536+0000 mon.smithi006 (mon.0) 551 : audit [INF] from='client.? 172.21.15.6:0/3583670599' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "allow_standby_replay", "val": "false"}]': finished 2024-03-12T16:07:34.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:33.347598+0000 mon.smithi006 (mon.0) 552 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 1 up:standby 2024-03-12T16:07:34.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:33.924578+0000 mon.smithi006 (mon.0) 553 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:34.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:33.925938+0000 mon.smithi006 (mon.0) 554 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:07:34.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:33.976875+0000 mgr.smithi006.kskdce (mgr.14196) 205 : cluster [DBG] pgmap v178: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 3.5 KiB/s wr, 12 op/s 2024-03-12T16:07:35.618 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:34.353003+0000 mon.smithi006 (mon.0) 555 : cluster [DBG] mds.? [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] up:boot 2024-03-12T16:07:35.618 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:34.353053+0000 mon.smithi006 (mon.0) 556 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:07:35.618 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:34.353129+0000 mon.smithi006 (mon.0) 557 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:07:35.618 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:35.131926+0000 mon.smithi006 (mon.0) 558 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:34.353003+0000 mon.smithi006 (mon.0) 555 : cluster [DBG] mds.? [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] up:boot 2024-03-12T16:07:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:34.353053+0000 mon.smithi006 (mon.0) 556 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:07:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:34.353129+0000 mon.smithi006 (mon.0) 557 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:07:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:35.131926+0000 mon.smithi006 (mon.0) 558 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:36.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:35.977346+0000 mgr.smithi006.kskdce (mgr.14196) 206 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s wr, 9 op/s 2024-03-12T16:07:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.701+0000 7f045806a700 1 -- 172.21.15.6:0/911809605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0450069510 msgr2=0x7f0450069990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.701+0000 7f045806a700 1 --2- 172.21.15.6:0/911809605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0450069510 0x7f0450069990 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f04400047f0 tx=0x7f0440009cb0).stop 2024-03-12T16:07:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.702+0000 7f045806a700 1 -- 172.21.15.6:0/911809605 shutdown_connections 2024-03-12T16:07:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.702+0000 7f045806a700 1 --2- 172.21.15.6:0/911809605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0450069510 0x7f0450069990 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.702+0000 7f045806a700 1 --2- 172.21.15.6:0/911809605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f045006a7b0 0x7f0450069020 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.702+0000 7f045806a700 1 -- 172.21.15.6:0/911809605 >> 172.21.15.6:0/911809605 conn(0x7f0450064df0 msgr2=0x7f0450067210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.702+0000 7f045806a700 1 -- 172.21.15.6:0/911809605 shutdown_connections 2024-03-12T16:07:36.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.702+0000 7f045806a700 1 -- 172.21.15.6:0/911809605 wait complete. 2024-03-12T16:07:36.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.702+0000 7f045806a700 1 Processor -- start 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f045806a700 1 -- start start 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f045806a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0450069510 0x7f0450112a50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f045806a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f045006a7b0 0x7f0450112f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f045806a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f04501134f0 con 0x7f045006a7b0 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f045806a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0450113630 con 0x7f0450069510 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f0455605700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f045006a7b0 0x7f0450112f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f0455605700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f045006a7b0 0x7f0450112f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58176/0 (socket says 172.21.15.6:58176) 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f0455605700 1 -- 172.21.15.6:0/1215697117 learned_addr learned my addr 172.21.15.6:0/1215697117 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f0455e06700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0450069510 0x7f0450112a50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f0455605700 1 -- 172.21.15.6:0/1215697117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0450069510 msgr2=0x7f0450112a50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f0455605700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0450069510 0x7f0450112a50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f0455605700 1 -- 172.21.15.6:0/1215697117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f044c005040 con 0x7f045006a7b0 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.703+0000 7f0455605700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f045006a7b0 0x7f0450112f40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0440013580 tx=0x7f0440009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:36.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.704+0000 7f0446ffd700 1 -- 172.21.15.6:0/1215697117 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0440018070 con 0x7f045006a7b0 2024-03-12T16:07:36.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.704+0000 7f0446ffd700 1 -- 172.21.15.6:0/1215697117 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f0440007e90 con 0x7f045006a7b0 2024-03-12T16:07:36.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.704+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0440005040 con 0x7f045006a7b0 2024-03-12T16:07:36.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.704+0000 7f0446ffd700 1 -- 172.21.15.6:0/1215697117 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f04400123c0 con 0x7f045006a7b0 2024-03-12T16:07:36.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.704+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f04501184a0 con 0x7f045006a7b0 2024-03-12T16:07:36.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:35.977346+0000 mgr.smithi006.kskdce (mgr.14196) 206 : cluster [DBG] pgmap v179: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.6 KiB/s wr, 9 op/s 2024-03-12T16:07:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.705+0000 7f0446ffd700 1 -- 172.21.15.6:0/1215697117 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f044001d420 con 0x7f045006a7b0 2024-03-12T16:07:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.705+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f045010a9a0 con 0x7f045006a7b0 2024-03-12T16:07:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.706+0000 7f0446ffd700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f043c0611c0 0x7f043c063680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.706+0000 7f0446ffd700 1 -- 172.21.15.6:0/1215697117 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f044007d430 con 0x7f045006a7b0 2024-03-12T16:07:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.706+0000 7f0455e06700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f043c0611c0 0x7f043c063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:36.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.706+0000 7f0455e06700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f043c0611c0 0x7f043c063680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f045006a580 tx=0x7f044c00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:36.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.710+0000 7f0446ffd700 1 -- 172.21.15.6:0/1215697117 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f0440051380 con 0x7f045006a7b0 2024-03-12T16:07:36.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:36.927+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"} v 0) v1 -- 0x7f045010c810 con 0x7f045006a7b0 2024-03-12T16:07:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.913+0000 7f0446ffd700 1 -- 172.21.15.6:0/1215697117 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]=0 inline data disabled v12) v1 ==== 133+0+0 (secure 0 0 0) 0x7f0440050f70 con 0x7f045006a7b0 2024-03-12T16:07:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f043c0611c0 msgr2=0x7f043c063680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f043c0611c0 0x7f043c063680 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7f045006a580 tx=0x7f044c00b040).stop 2024-03-12T16:07:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f045006a7b0 msgr2=0x7f0450112f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f045006a7b0 0x7f0450112f40 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f0440013580 tx=0x7f0440009cb0).stop 2024-03-12T16:07:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 shutdown_connections 2024-03-12T16:07:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f043c0611c0 0x7f043c063680 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:37.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0450069510 0x7f0450112a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 --2- 172.21.15.6:0/1215697117 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f045006a7b0 0x7f0450112f40 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 >> 172.21.15.6:0/1215697117 conn(0x7f0450064df0 msgr2=0x7f0450101410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 shutdown_connections 2024-03-12T16:07:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:37.915+0000 7f045806a700 1 -- 172.21.15.6:0/1215697117 wait complete. 2024-03-12T16:07:37.918 INFO:teuthology.orchestra.run.smithi006.stderr:inline data disabled 2024-03-12T16:07:38.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:36.910863+0000 mon.smithi006 (mon.0) 559 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:38.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:36.929001+0000 mon.smithi006 (mon.0) 560 : audit [INF] from='client.? 172.21.15.6:0/1215697117' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-03-12T16:07:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:36.910863+0000 mon.smithi006 (mon.0) 559 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:36.929001+0000 mon.smithi006 (mon.0) 560 : audit [INF] from='client.? 172.21.15.6:0/1215697117' entity='client.admin' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]: dispatch 2024-03-12T16:07:38.942 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:37.914563+0000 mon.smithi006 (mon.0) 561 : audit [INF] from='client.? 172.21.15.6:0/1215697117' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-03-12T16:07:38.942 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:37.914625+0000 mon.smithi006 (mon.0) 562 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:07:38.942 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:37.977782+0000 mgr.smithi006.kskdce (mgr.14196) 207 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-03-12T16:07:38.966 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-12T16:07:38.977 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:07:38.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-12T16:07:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:37.914563+0000 mon.smithi006 (mon.0) 561 : audit [INF] from='client.? 172.21.15.6:0/1215697117' entity='client.admin' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "inline_data", "val": "false"}]': finished 2024-03-12T16:07:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:37.914625+0000 mon.smithi006 (mon.0) 562 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:07:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:37.977782+0000 mgr.smithi006.kskdce (mgr.14196) 207 : cluster [DBG] pgmap v180: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 2.1 KiB/s wr, 7 op/s 2024-03-12T16:07:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.160+0000 7f207d861700 1 -- 172.21.15.6:0/2715596311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 msgr2=0x7f20780f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.160+0000 7f207d861700 1 --2- 172.21.15.6:0/2715596311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 0x7f20780f7e30 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f20680047f0 tx=0x7f2068009cb0).stop 2024-03-12T16:07:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.160+0000 7f207d861700 1 -- 172.21.15.6:0/2715596311 shutdown_connections 2024-03-12T16:07:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.160+0000 7f207d861700 1 --2- 172.21.15.6:0/2715596311 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20780f8cb0 0x7f20780f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.160+0000 7f207d861700 1 --2- 172.21.15.6:0/2715596311 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 0x7f20780f7e30 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:41.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.160+0000 7f207d861700 1 -- 172.21.15.6:0/2715596311 >> 172.21.15.6:0/2715596311 conn(0x7f20780f3150 msgr2=0x7f20780f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.160+0000 7f207d861700 1 -- 172.21.15.6:0/2715596311 shutdown_connections 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.160+0000 7f207d861700 1 -- 172.21.15.6:0/2715596311 wait complete. 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f207d861700 1 Processor -- start 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f207d861700 1 -- start start 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f207d861700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 0x7f2078108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f207d861700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20780f8cb0 0x7f2078108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f207d861700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2078108c30 con 0x7f20780f7a10 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f207d861700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2078108d70 con 0x7f20780f8cb0 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f2076ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 0x7f2078108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f2076ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 0x7f2078108190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:58192/0 (socket says 172.21.15.6:58192) 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f2076ffd700 1 -- 172.21.15.6:0/457714902 learned_addr learned my addr 172.21.15.6:0/457714902 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:41.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f20767fc700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20780f8cb0 0x7f2078108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f2076ffd700 1 -- 172.21.15.6:0/457714902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20780f8cb0 msgr2=0x7f2078108680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f2076ffd700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20780f8cb0 0x7f2078108680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f2076ffd700 1 -- 172.21.15.6:0/457714902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2068005040 con 0x7f20780f7a10 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f20767fc700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20780f8cb0 0x7f2078108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.161+0000 7f2076ffd700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 0x7f2078108190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f2068013470 tx=0x7f2068009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.162+0000 7f205ffff700 1 -- 172.21.15.6:0/457714902 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f206800e030 con 0x7f20780f7a10 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.162+0000 7f205ffff700 1 -- 172.21.15.6:0/457714902 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f2068007e90 con 0x7f20780f7a10 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.162+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f207810d7b0 con 0x7f20780f7a10 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.162+0000 7f205ffff700 1 -- 172.21.15.6:0/457714902 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2068018070 con 0x7f20780f7a10 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.162+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f207810dcf0 con 0x7f20780f7a10 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.163+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f207805fb50 con 0x7f20780f7a10 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.163+0000 7f205ffff700 1 -- 172.21.15.6:0/457714902 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f206801d940 con 0x7f20780f7a10 2024-03-12T16:07:41.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.163+0000 7f205ffff700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2060061180 0x7f2060063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.164+0000 7f205ffff700 1 -- 172.21.15.6:0/457714902 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f206807df00 con 0x7f20780f7a10 2024-03-12T16:07:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.164+0000 7f20767fc700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2060061180 0x7f2060063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.164+0000 7f20767fc700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2060061180 0x7f2060063640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f206c0041d0 tx=0x7f206c009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:41.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.168+0000 7f205ffff700 1 -- 172.21.15.6:0/457714902 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f2068051e90 con 0x7f20780f7a10 2024-03-12T16:07:41.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.399+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20781001d0 con 0x7f20780f7a10 2024-03-12T16:07:41.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.400+0000 7f205ffff700 1 -- 172.21.15.6:0/457714902 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 12 v12) v1 ==== 76+0+1771 (secure 0 0 0) 0x7f2068051a80 con 0x7f20780f7a10 2024-03-12T16:07:41.402 INFO:teuthology.orchestra.run.smithi006.stdout:e12 2024-03-12T16:07:41.402 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:07:41.402 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:07:41.402 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:07:41.402 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:07:41.402 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:07:41.402 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 12 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:07:37.908210+0000 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:07:41.403 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:07:41.404 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:07:41.405 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:07:41.405 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:07:41.405 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:07:41.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2060061180 msgr2=0x7f2060063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:41.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2060061180 0x7f2060063640 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7f206c0041d0 tx=0x7f206c009040).stop 2024-03-12T16:07:41.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 msgr2=0x7f2078108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 0x7f2078108190 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f2068013470 tx=0x7f2068009cb0).stop 2024-03-12T16:07:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 shutdown_connections 2024-03-12T16:07:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2060061180 0x7f2060063640 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20780f7a10 0x7f2078108190 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 --2- 172.21.15.6:0/457714902 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20780f8cb0 0x7f2078108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 >> 172.21.15.6:0/457714902 conn(0x7f20780f3150 msgr2=0x7f20780fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 shutdown_connections 2024-03-12T16:07:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:41.402+0000 7f207d861700 1 -- 172.21.15.6:0/457714902 wait complete. 2024-03-12T16:07:41.406 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-03-12T16:07:41.425 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:39.978197+0000 mgr.smithi006.kskdce (mgr.14196) 208 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 6 op/s 2024-03-12T16:07:41.425 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:40.071990+0000 mon.smithi006 (mon.0) 563 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:41.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:39.978197+0000 mgr.smithi006.kskdce (mgr.14196) 208 : cluster [DBG] pgmap v181: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s wr, 6 op/s 2024-03-12T16:07:41.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:40.071990+0000 mon.smithi006 (mon.0) 563 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:42.081 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph --format=json fs dump | jq -e ".filesystems | length == 1"' 2024-03-12T16:07:42.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:41.401503+0000 mon.smithi006 (mon.0) 564 : audit [DBG] from='client.? 172.21.15.6:0/457714902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:07:42.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:41.433080+0000 mon.smithi006 (mon.0) 565 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:42.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:41.433868+0000 mon.smithi006 (mon.0) 566 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:42.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:41.434513+0000 mon.smithi006 (mon.0) 567 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:07:42.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:41.438430+0000 mon.smithi006 (mon.0) 568 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:42.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:41.443024+0000 mon.smithi006 (mon.0) 569 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:07:42.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:41.401503+0000 mon.smithi006 (mon.0) 564 : audit [DBG] from='client.? 172.21.15.6:0/457714902' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:07:42.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:41.433080+0000 mon.smithi006 (mon.0) 565 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:42.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:41.433868+0000 mon.smithi006 (mon.0) 566 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:42.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:41.434513+0000 mon.smithi006 (mon.0) 567 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:07:42.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:41.438430+0000 mon.smithi006 (mon.0) 568 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:42.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:41.443024+0000 mon.smithi006 (mon.0) 569 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:07:43.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:41.978613+0000 mgr.smithi006.kskdce (mgr.14196) 209 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 3 op/s 2024-03-12T16:07:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:41.978613+0000 mgr.smithi006.kskdce (mgr.14196) 209 : cluster [DBG] pgmap v182: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 3 op/s 2024-03-12T16:07:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.557+0000 7fe86679d700 1 -- 172.21.15.6:0/1286487478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe860061280 msgr2=0x7fe8600fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:44.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.557+0000 7fe86679d700 1 --2- 172.21.15.6:0/1286487478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe860061280 0x7fe8600fa3d0 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fe850004730 tx=0x7fe850009cb0).stop 2024-03-12T16:07:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.557+0000 7fe86679d700 1 -- 172.21.15.6:0/1286487478 shutdown_connections 2024-03-12T16:07:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.557+0000 7fe86679d700 1 --2- 172.21.15.6:0/1286487478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8600fa950 0x7fe8600fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.557+0000 7fe86679d700 1 --2- 172.21.15.6:0/1286487478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe860061280 0x7fe8600fa3d0 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.557+0000 7fe86679d700 1 -- 172.21.15.6:0/1286487478 >> 172.21.15.6:0/1286487478 conn(0x7fe8600f1e50 msgr2=0x7fe8600f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.557+0000 7fe86679d700 1 -- 172.21.15.6:0/1286487478 shutdown_connections 2024-03-12T16:07:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.557+0000 7fe86679d700 1 -- 172.21.15.6:0/1286487478 wait complete. 2024-03-12T16:07:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.557+0000 7fe86679d700 1 Processor -- start 2024-03-12T16:07:44.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.558+0000 7fe86679d700 1 -- start start 2024-03-12T16:07:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.558+0000 7fe86679d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe860061280 0x7fe860107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:44.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.558+0000 7fe86679d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8600fa950 0x7fe8601084e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.558+0000 7fe86679d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860108a90 con 0x7fe8600fa950 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.558+0000 7fe86679d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe860108bd0 con 0x7fe860061280 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.558+0000 7fe85f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8600fa950 0x7fe8601084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.558+0000 7fe85f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8600fa950 0x7fe8601084e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51710/0 (socket says 172.21.15.6:51710) 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.558+0000 7fe85f7fe700 1 -- 172.21.15.6:0/1770608195 learned_addr learned my addr 172.21.15.6:0/1770608195 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.558+0000 7fe85ffff700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe860061280 0x7fe860107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe85f7fe700 1 -- 172.21.15.6:0/1770608195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe860061280 msgr2=0x7fe860107ff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe85f7fe700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe860061280 0x7fe860107ff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe85f7fe700 1 -- 172.21.15.6:0/1770608195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe854005040 con 0x7fe8600fa950 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe85ffff700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe860061280 0x7fe860107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe85f7fe700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8600fa950 0x7fe8601084e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe854009350 tx=0x7fe854009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe85d7fa700 1 -- 172.21.15.6:0/1770608195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe85400e630 con 0x7fe8600fa950 2024-03-12T16:07:44.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe850005040 con 0x7fe8600fa950 2024-03-12T16:07:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe85d7fa700 1 -- 172.21.15.6:0/1770608195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fe85400f040 con 0x7fe8600fa950 2024-03-12T16:07:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe85d7fa700 1 -- 172.21.15.6:0/1770608195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe854014ba0 con 0x7fe8600fa950 2024-03-12T16:07:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.559+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe86010daa0 con 0x7fe8600fa950 2024-03-12T16:07:44.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.560+0000 7fe85d7fa700 1 -- 172.21.15.6:0/1770608195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fe8540133c0 con 0x7fe8600fa950 2024-03-12T16:07:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.560+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe8600fffe0 con 0x7fe8600fa950 2024-03-12T16:07:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.561+0000 7fe85d7fa700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe848061180 0x7fe848063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.561+0000 7fe85d7fa700 1 -- 172.21.15.6:0/1770608195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fe85407c480 con 0x7fe8600fa950 2024-03-12T16:07:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.561+0000 7fe85ffff700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe848061180 0x7fe848063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:44.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.561+0000 7fe85ffff700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe848061180 0x7fe848063640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe8500133e0 tx=0x7fe85000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:44.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.566+0000 7fe85d7fa700 1 -- 172.21.15.6:0/1770608195 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fe854049f60 con 0x7fe8600fa950 2024-03-12T16:07:44.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.785+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fe8600598f0 con 0x7fe8600fa950 2024-03-12T16:07:44.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.785+0000 7fe85d7fa700 1 -- 172.21.15.6:0/1770608195 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4589 (secure 0 0 0) 0x7fe854050500 con 0x7fe8600fa950 2024-03-12T16:07:44.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe848061180 msgr2=0x7fe848063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:44.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe848061180 0x7fe848063640 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe8500133e0 tx=0x7fe85000b040).stop 2024-03-12T16:07:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8600fa950 msgr2=0x7fe8601084e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8600fa950 0x7fe8601084e0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7fe854009350 tx=0x7fe854009cb0).stop 2024-03-12T16:07:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 shutdown_connections 2024-03-12T16:07:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fe848061180 0x7fe848063640 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe860061280 0x7fe860107ff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 --2- 172.21.15.6:0/1770608195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe8600fa950 0x7fe8601084e0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 >> 172.21.15.6:0/1770608195 conn(0x7fe8600f1e50 msgr2=0x7fe8600f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 shutdown_connections 2024-03-12T16:07:44.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:44.787+0000 7fe86679d700 1 -- 172.21.15.6:0/1770608195 wait complete. 2024-03-12T16:07:44.791 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-03-12T16:07:44.799 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:07:45.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:43.979052+0000 mgr.smithi006.kskdce (mgr.14196) 210 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-12T16:07:45.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:44.189399+0000 mon.smithi006 (mon.0) 570 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:45.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:44.787110+0000 mon.smithi006 (mon.0) 571 : audit [DBG] from='client.? 172.21.15.6:0/1770608195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-12T16:07:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:43.979052+0000 mgr.smithi006.kskdce (mgr.14196) 210 : cluster [DBG] pgmap v183: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-12T16:07:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:44.189399+0000 mon.smithi006 (mon.0) 570 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:44.787110+0000 mon.smithi006 (mon.0) 571 : audit [DBG] from='client.? 172.21.15.6:0/1770608195' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-12T16:07:46.068 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'while ! ceph --format=json mds versions | jq -e ". | add == 4"; do sleep 1; done' 2024-03-12T16:07:47.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:45.979546+0000 mgr.smithi006.kskdce (mgr.14196) 211 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-12T16:07:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:45.979546+0000 mgr.smithi006.kskdce (mgr.14196) 211 : cluster [DBG] pgmap v184: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-12T16:07:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.762+0000 7fa584e5e700 1 -- 172.21.15.6:0/2884115714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 msgr2=0x7fa5800f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.762+0000 7fa584e5e700 1 --2- 172.21.15.6:0/2884115714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 0x7fa5800f7e30 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7fa5700047f0 tx=0x7fa570009cb0).stop 2024-03-12T16:07:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.762+0000 7fa584e5e700 1 -- 172.21.15.6:0/2884115714 shutdown_connections 2024-03-12T16:07:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.762+0000 7fa584e5e700 1 --2- 172.21.15.6:0/2884115714 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5800f8cb0 0x7fa5800f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.762+0000 7fa584e5e700 1 --2- 172.21.15.6:0/2884115714 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 0x7fa5800f7e30 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.762+0000 7fa584e5e700 1 -- 172.21.15.6:0/2884115714 >> 172.21.15.6:0/2884115714 conn(0x7fa5800f3150 msgr2=0x7fa5800f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.762+0000 7fa584e5e700 1 -- 172.21.15.6:0/2884115714 shutdown_connections 2024-03-12T16:07:48.764 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.762+0000 7fa584e5e700 1 -- 172.21.15.6:0/2884115714 wait complete. 2024-03-12T16:07:48.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa584e5e700 1 Processor -- start 2024-03-12T16:07:48.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa584e5e700 1 -- start start 2024-03-12T16:07:48.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa584e5e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 0x7fa5801081d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:48.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa584e5e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5800f8cb0 0x7fa5801086c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:48.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa584e5e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580108c70 con 0x7fa5800f7a10 2024-03-12T16:07:48.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa584e5e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa580108db0 con 0x7fa5800f8cb0 2024-03-12T16:07:48.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa57e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 0x7fa5801081d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:48.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa57e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 0x7fa5801081d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51724/0 (socket says 172.21.15.6:51724) 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa57e59c700 1 -- 172.21.15.6:0/1602567822 learned_addr learned my addr 172.21.15.6:0/1602567822 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa57dd9b700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5800f8cb0 0x7fa5801086c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa57e59c700 1 -- 172.21.15.6:0/1602567822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5800f8cb0 msgr2=0x7fa5801086c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa57e59c700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5800f8cb0 0x7fa5801086c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa57e59c700 1 -- 172.21.15.6:0/1602567822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa570005040 con 0x7fa5800f7a10 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.763+0000 7fa57e59c700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 0x7fa5801081d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fa570004f10 tx=0x7fa570009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.764+0000 7fa56f7fe700 1 -- 172.21.15.6:0/1602567822 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa57000e070 con 0x7fa5800f7a10 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.764+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa58010d7f0 con 0x7fa5800f7a10 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.764+0000 7fa56f7fe700 1 -- 172.21.15.6:0/1602567822 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa570007e90 con 0x7fa5800f7a10 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.764+0000 7fa56f7fe700 1 -- 172.21.15.6:0/1602567822 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa570018070 con 0x7fa5800f7a10 2024-03-12T16:07:48.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.764+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa58010dd30 con 0x7fa5800f7a10 2024-03-12T16:07:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.765+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa58005fb50 con 0x7fa5800f7a10 2024-03-12T16:07:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.765+0000 7fa56f7fe700 1 -- 172.21.15.6:0/1602567822 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fa5700123c0 con 0x7fa5800f7a10 2024-03-12T16:07:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.765+0000 7fa56f7fe700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa568061180 0x7fa568063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.766+0000 7fa56f7fe700 1 -- 172.21.15.6:0/1602567822 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fa57007d790 con 0x7fa5800f7a10 2024-03-12T16:07:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.766+0000 7fa57dd9b700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa568061180 0x7fa568063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:48.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.766+0000 7fa57dd9b700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa568061180 0x7fa568063640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa574009170 tx=0x7fa574009da0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:48.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:48.770+0000 7fa56f7fe700 1 -- 172.21.15.6:0/1602567822 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa570051720 con 0x7fa5800f7a10 2024-03-12T16:07:49.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.010+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "mds versions", "format": "json"} v 0) v1 -- 0x7fa5800598f0 con 0x7fa5800f7a10 2024-03-12T16:07:49.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.010+0000 7fa56f7fe700 1 -- 172.21.15.6:0/1602567822 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "mds versions", "format": "json"}]=0 v12) v1 ==== 78+0+99 (secure 0 0 0) 0x7fa570051310 con 0x7fa5800f7a10 2024-03-12T16:07:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa568061180 msgr2=0x7fa568063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa568061180 0x7fa568063640 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fa574009170 tx=0x7fa574009da0).stop 2024-03-12T16:07:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 msgr2=0x7fa5801081d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 0x7fa5801081d0 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7fa570004f10 tx=0x7fa570009cb0).stop 2024-03-12T16:07:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 shutdown_connections 2024-03-12T16:07:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa568061180 0x7fa568063640 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5800f7a10 0x7fa5801081d0 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 --2- 172.21.15.6:0/1602567822 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5800f8cb0 0x7fa5801086c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:49.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 >> 172.21.15.6:0/1602567822 conn(0x7fa5800f3150 msgr2=0x7fa5800fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 shutdown_connections 2024-03-12T16:07:49.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.012+0000 7fa584e5e700 1 -- 172.21.15.6:0/1602567822 wait complete. 2024-03-12T16:07:49.024 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:07:49.382 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:47.980041+0000 mgr.smithi006.kskdce (mgr.14196) 212 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-12T16:07:49.382 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:49.011860+0000 mon.smithi006 (mon.0) 572 : audit [DBG] from='client.? 172.21.15.6:0/1602567822' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-03-12T16:07:49.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:47.980041+0000 mgr.smithi006.kskdce (mgr.14196) 212 : cluster [DBG] pgmap v185: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 0 B/s wr, 0 op/s 2024-03-12T16:07:49.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:49.011860+0000 mon.smithi006 (mon.0) 572 : audit [DBG] from='client.? 172.21.15.6:0/1602567822' entity='client.admin' cmd=[{"prefix": "mds versions", "format": "json"}]: dispatch 2024-03-12T16:07:49.683 INFO:teuthology.run_tasks:Running task fs.pre_upgrade_save... 2024-03-12T16:07:49.696 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T16:07:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.900+0000 7f4e62507700 1 -- 172.21.15.6:0/3575293341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 msgr2=0x7f4e5c0f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.900+0000 7f4e62507700 1 --2- 172.21.15.6:0/3575293341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 0x7f4e5c0f7df0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f4e500047f0 tx=0x7f4e50009cb0).stop 2024-03-12T16:07:49.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.900+0000 7f4e62507700 1 -- 172.21.15.6:0/3575293341 shutdown_connections 2024-03-12T16:07:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.900+0000 7f4e62507700 1 --2- 172.21.15.6:0/3575293341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 0x7f4e5c0f7df0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.900+0000 7f4e62507700 1 --2- 172.21.15.6:0/3575293341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e5c0f66f0 0x7f4e5c0f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.900+0000 7f4e62507700 1 -- 172.21.15.6:0/3575293341 >> 172.21.15.6:0/3575293341 conn(0x7f4e5c0f1df0 msgr2=0x7f4e5c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.900+0000 7f4e62507700 1 -- 172.21.15.6:0/3575293341 shutdown_connections 2024-03-12T16:07:49.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.900+0000 7f4e62507700 1 -- 172.21.15.6:0/3575293341 wait complete. 2024-03-12T16:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.901+0000 7f4e62507700 1 Processor -- start 2024-03-12T16:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.901+0000 7f4e62507700 1 -- start start 2024-03-12T16:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.901+0000 7f4e62507700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e5c0f66f0 0x7f4e5c0fa670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.901+0000 7f4e62507700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 0x7f4e5c0f8cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.901+0000 7f4e62507700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0fac20 con 0x7f4e5c0f7990 2024-03-12T16:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.901+0000 7f4e62507700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e5c0f91c0 con 0x7f4e5c0f66f0 2024-03-12T16:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.901+0000 7f4e5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 0x7f4e5c0f8cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:49.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.901+0000 7f4e5b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 0x7f4e5c0f8cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51736/0 (socket says 172.21.15.6:51736) 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e5b7fe700 1 -- 172.21.15.6:0/718182676 learned_addr learned my addr 172.21.15.6:0/718182676 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e5bfff700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e5c0f66f0 0x7f4e5c0fa670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e5b7fe700 1 -- 172.21.15.6:0/718182676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e5c0f66f0 msgr2=0x7f4e5c0fa670 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e5b7fe700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e5c0f66f0 0x7f4e5c0fa670 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e5b7fe700 1 -- 172.21.15.6:0/718182676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e50005040 con 0x7f4e5c0f7990 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e5b7fe700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 0x7f4e5c0f8cd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f4e50013470 tx=0x7f4e50009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e597fa700 1 -- 172.21.15.6:0/718182676 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e5000e030 con 0x7f4e5c0f7990 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e597fa700 1 -- 172.21.15.6:0/718182676 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f4e50007e90 con 0x7f4e5c0f7990 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e597fa700 1 -- 172.21.15.6:0/718182676 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e50018070 con 0x7f4e5c0f7990 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e5c0f93e0 con 0x7f4e5c0f7990 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.902+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e5c0f9870 con 0x7f4e5c0f7990 2024-03-12T16:07:49.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.903+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e5c0f9ae0 con 0x7f4e5c0f7990 2024-03-12T16:07:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.904+0000 7f4e597fa700 1 -- 172.21.15.6:0/718182676 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f4e5001d420 con 0x7f4e5c0f7990 2024-03-12T16:07:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.904+0000 7f4e597fa700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e44061180 0x7f4e44063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.904+0000 7f4e597fa700 1 -- 172.21.15.6:0/718182676 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f4e5007dd50 con 0x7f4e5c0f7990 2024-03-12T16:07:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.904+0000 7f4e5bfff700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e44061180 0x7f4e44063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:49.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.904+0000 7f4e5bfff700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e44061180 0x7f4e44063640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4e5c0f77f0 tx=0x7f4e4c009d60).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:49.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:49.908+0000 7f4e597fa700 1 -- 172.21.15.6:0/718182676 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f4e50051ce0 con 0x7f4e5c0f7990 2024-03-12T16:07:50.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.080+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f4e5c1105e0 con 0x7f4e5c0f7990 2024-03-12T16:07:50.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.081+0000 7f4e597fa700 1 -- 172.21.15.6:0/718182676 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v43) v1 ==== 74+0+14025 (secure 0 0 0) 0x7f4e500518d0 con 0x7f4e5c0f7990 2024-03-12T16:07:50.083 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:07:50.083 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":43,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","created":"2024-03-12T16:00:42.612784+0000","modified":"2024-03-12T16:07:23.271382+0000","last_up_change":"2024-03-12T16:06:00.146006+0000","last_in_change":"2024-03-12T16:05:41.290069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":14,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"pacific","pools":[{"pool":1,"pool_name":"device_health_metrics","create_time":"2024-03-12T16:04:29.453605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr_devicehealth":{}}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-12T16:07:20.200653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-12T16:07:20.688894+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}}}],"osds":[{"osd":0,"uuid":"81b3ff11-3d87-4f3b-a302-c8c55f378ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6803","nonce":782473340}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6805","nonce":782473340}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6809","nonce":782473340}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":782473340},{"type":"v1","addr":"172.21.15.6:6807","nonce":782473340}]},"public_addr":"172.21.15.6:6803/782473340","cluster_addr":"172.21.15.6:6805/782473340","heartbeat_back_addr":"172.21.15.6:6809/782473340","heartbeat_front_addr":"172.21.15.6:6807/782473340","state":["exists","up"]},{"osd":1,"uuid":"e638e6a3-7dc0-47f6-8901-1bdb1c208583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":14,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6811","nonce":464707515}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6813","nonce":464707515}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6817","nonce":464707515}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":464707515},{"type":"v1","addr":"172.21.15.6:6815","nonce":464707515}]},"public_addr":"172.21.15.6:6811/464707515","cluster_addr":"172.21.15.6:6813/464707515","heartbeat_back_addr":"172.21.15.6:6817/464707515","heartbeat_front_addr":"172.21.15.6:6815/464707515","state":["exists","up"]},{"osd":2,"uuid":"45eed951-90a9-4fe0-a184-11b5e1ebe46d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":19,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6819","nonce":2037091558}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6821","nonce":2037091558}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6825","nonce":2037091558}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":2037091558},{"type":"v1","addr":"172.21.15.6:6823","nonce":2037091558}]},"public_addr":"172.21.15.6:6819/2037091558","cluster_addr":"172.21.15.6:6821/2037091558","heartbeat_back_addr":"172.21.15.6:6825/2037091558","heartbeat_front_addr":"172.21.15.6:6823/2037091558","state":["exists","up"]},{"osd":3,"uuid":"47d2f20b-d7b8-4d67-905c-af29938d36d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6801","nonce":641287556}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6803","nonce":641287556}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6807","nonce":641287556}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":641287556},{"type":"v1","addr":"172.21.15.134:6805","nonce":641287556}]},"public_addr":"172.21.15.134:6801/641287556","cluster_addr":"172.21.15.134:6803/641287556","heartbeat_back_addr":"172.21.15.134:6807/641287556","heartbeat_front_addr":"172.21.15.134:6805/641287556","state":["exists","up"]},{"osd":4,"uuid":"bfe8b5a1-489a-458d-ba30-5d1bada0c33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":32,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6809","nonce":1907759631}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6811","nonce":1907759631}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6815","nonce":1907759631}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":1907759631},{"type":"v1","addr":"172.21.15.134:6813","nonce":1907759631}]},"public_addr":"172.21.15.134:6809/1907759631","cluster_addr":"172.21.15.134:6811/1907759631","heartbeat_back_addr":"172.21.15.134:6815/1907759631","heartbeat_front_addr":"172.21.15.134:6813/1907759631","state":["exists","up"]},{"osd":5,"uuid":"02e056ee-a66a-4c23-a819-1e4c1e2d1236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":37,"up_thru":40,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6817","nonce":876055595}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6819","nonce":876055595}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6823","nonce":876055595}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":876055595},{"type":"v1","addr":"172.21.15.134:6821","nonce":876055595}]},"public_addr":"172.21.15.134:6817/876055595","cluster_addr":"172.21.15.134:6819/876055595","heartbeat_back_addr":"172.21.15.134:6823/876055595","heartbeat_front_addr":"172.21.15.134:6821/876055595","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:35.977637+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:59.443373+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:04:27.106208+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:02.955636+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:30.634685+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138314316775423,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:58.981490+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:0/4212806006":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/687610333":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/3228405447":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:6801/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/179696865":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/1637754840":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4255668203":"2024-03-13T16:01:12.726451+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T16:07:50.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e44061180 msgr2=0x7f4e44063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e44061180 0x7f4e44063640 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f4e5c0f77f0 tx=0x7f4e4c009d60).stop 2024-03-12T16:07:50.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 msgr2=0x7f4e5c0f8cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 0x7f4e5c0f8cd0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f4e50013470 tx=0x7f4e50009cb0).stop 2024-03-12T16:07:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 shutdown_connections 2024-03-12T16:07:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f4e44061180 0x7f4e44063640 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e5c0f66f0 0x7f4e5c0fa670 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 --2- 172.21.15.6:0/718182676 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e5c0f7990 0x7f4e5c0f8cd0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 >> 172.21.15.6:0/718182676 conn(0x7f4e5c0f1df0 msgr2=0x7f4e5c060d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 shutdown_connections 2024-03-12T16:07:50.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.083+0000 7f4e62507700 1 -- 172.21.15.6:0/718182676 wait complete. 2024-03-12T16:07:50.098 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': 'device_health_metrics', 'create_time': '2024-03-12T16:04:29.453605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr_devicehealth': {}}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-12T16:07:20.200653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-12T16:07:20.688894+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}}] 2024-03-12T16:07:50.098 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get device_health_metrics pg_num 2024-03-12T16:07:50.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.220+0000 7f14d9954700 1 -- 172.21.15.6:0/2247965001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f5a90 msgr2=0x7f14d40f5eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.220+0000 7f14d9954700 1 --2- 172.21.15.6:0/2247965001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f5a90 0x7f14d40f5eb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f14bc0047f0 tx=0x7f14bc009cb0).stop 2024-03-12T16:07:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.220+0000 7f14d9954700 1 -- 172.21.15.6:0/2247965001 shutdown_connections 2024-03-12T16:07:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.220+0000 7f14d9954700 1 --2- 172.21.15.6:0/2247965001 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d40f6430 0x7f14d40f8bb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.220+0000 7f14d9954700 1 --2- 172.21.15.6:0/2247965001 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f5a90 0x7f14d40f5eb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.220+0000 7f14d9954700 1 -- 172.21.15.6:0/2247965001 >> 172.21.15.6:0/2247965001 conn(0x7f14d40f1590 msgr2=0x7f14d40f39d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.220+0000 7f14d9954700 1 -- 172.21.15.6:0/2247965001 shutdown_connections 2024-03-12T16:07:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.220+0000 7f14d9954700 1 -- 172.21.15.6:0/2247965001 wait complete. 2024-03-12T16:07:50.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d9954700 1 Processor -- start 2024-03-12T16:07:50.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d9954700 1 -- start start 2024-03-12T16:07:50.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d9954700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d40f5a90 0x7f14d4107fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d9954700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f6430 0x7f14d41084a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d9954700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d4108a50 con 0x7f14d40f6430 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d9954700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14d4108b90 con 0x7f14d40f5a90 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f6430 0x7f14d41084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f6430 0x7f14d41084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51756/0 (socket says 172.21.15.6:51756) 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d27fc700 1 -- 172.21.15.6:0/3333119354 learned_addr learned my addr 172.21.15.6:0/3333119354 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.221+0000 7f14d2ffd700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d40f5a90 0x7f14d4107fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.222+0000 7f14d27fc700 1 -- 172.21.15.6:0/3333119354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d40f5a90 msgr2=0x7f14d4107fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.222+0000 7f14d27fc700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d40f5a90 0x7f14d4107fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.222+0000 7f14d27fc700 1 -- 172.21.15.6:0/3333119354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14bc005040 con 0x7f14d40f6430 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.222+0000 7f14d27fc700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f6430 0x7f14d41084a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f14c4002780 tx=0x7f14c4009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.222+0000 7f14cbfff700 1 -- 172.21.15.6:0/3333119354 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14c4007b40 con 0x7f14d40f6430 2024-03-12T16:07:50.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.222+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14d410d630 con 0x7f14d40f6430 2024-03-12T16:07:50.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.222+0000 7f14cbfff700 1 -- 172.21.15.6:0/3333119354 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f14c400f040 con 0x7f14d40f6430 2024-03-12T16:07:50.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.222+0000 7f14cbfff700 1 -- 172.21.15.6:0/3333119354 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14c40146f0 con 0x7f14d40f6430 2024-03-12T16:07:50.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.222+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14d410db70 con 0x7f14d40f6430 2024-03-12T16:07:50.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.223+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14d40fffe0 con 0x7f14d40f6430 2024-03-12T16:07:50.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.223+0000 7f14cbfff700 1 -- 172.21.15.6:0/3333119354 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f14c4007ca0 con 0x7f14d40f6430 2024-03-12T16:07:50.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.223+0000 7f14cbfff700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14c0061180 0x7f14c0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:50.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.224+0000 7f14cbfff700 1 -- 172.21.15.6:0/3333119354 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f14c407c7b0 con 0x7f14d40f6430 2024-03-12T16:07:50.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.224+0000 7f14d2ffd700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14c0061180 0x7f14c0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:50.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.224+0000 7f14d2ffd700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14c0061180 0x7f14c0063640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f14bc004f10 tx=0x7f14bc00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:50.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.228+0000 7f14cbfff700 1 -- 172.21.15.6:0/3333119354 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f14c4050740 con 0x7f14d40f6430 2024-03-12T16:07:50.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.402+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"} v 0) v1 -- 0x7f14d4101e50 con 0x7f14d40f6430 2024-03-12T16:07:50.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.403+0000 7f14cbfff700 1 -- 172.21.15.6:0/3333119354 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]=0 v43) v1 ==== 110+0+10 (secure 0 0 0) 0x7f14c4050330 con 0x7f14d40f6430 2024-03-12T16:07:50.405 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-03-12T16:07:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14c0061180 msgr2=0x7f14c0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14c0061180 0x7f14c0063640 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f14bc004f10 tx=0x7f14bc00b040).stop 2024-03-12T16:07:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f6430 msgr2=0x7f14d41084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f6430 0x7f14d41084a0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f14c4002780 tx=0x7f14c4009ee0).stop 2024-03-12T16:07:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 shutdown_connections 2024-03-12T16:07:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f14c0061180 0x7f14c0063640 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14d40f5a90 0x7f14d4107fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 --2- 172.21.15.6:0/3333119354 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14d40f6430 0x7f14d41084a0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 >> 172.21.15.6:0/3333119354 conn(0x7f14d40f1590 msgr2=0x7f14d40fc600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:50.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 shutdown_connections 2024-03-12T16:07:50.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.405+0000 7f14d9954700 1 -- 172.21.15.6:0/3333119354 wait complete. 2024-03-12T16:07:50.420 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-12T16:07:50.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.540+0000 7f72b3d43700 1 -- 172.21.15.6:0/813416906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 msgr2=0x7f72ac0fd140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.540+0000 7f72b3d43700 1 --2- 172.21.15.6:0/813416906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 0x7f72ac0fd140 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f72a80047f0 tx=0x7f72a8009cb0).stop 2024-03-12T16:07:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.540+0000 7f72b3d43700 1 -- 172.21.15.6:0/813416906 shutdown_connections 2024-03-12T16:07:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.540+0000 7f72b3d43700 1 --2- 172.21.15.6:0/813416906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 0x7f72ac0fd140 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.540+0000 7f72b3d43700 1 --2- 172.21.15.6:0/813416906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ac0f5570 0x7f72ac0f5990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.540+0000 7f72b3d43700 1 -- 172.21.15.6:0/813416906 >> 172.21.15.6:0/813416906 conn(0x7f72ac0f11d0 msgr2=0x7f72ac0f35f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.540+0000 7f72b3d43700 1 -- 172.21.15.6:0/813416906 shutdown_connections 2024-03-12T16:07:50.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.540+0000 7f72b3d43700 1 -- 172.21.15.6:0/813416906 wait complete. 2024-03-12T16:07:50.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b3d43700 1 Processor -- start 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b3d43700 1 -- start start 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b3d43700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ac0f5570 0x7f72ac107f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b3d43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 0x7f72ac108420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b3d43700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac1089d0 con 0x7f72ac0f5e80 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b3d43700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f72ac108b10 con 0x7f72ac0f5570 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b12de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 0x7f72ac108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b12de700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 0x7f72ac108420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51774/0 (socket says 172.21.15.6:51774) 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b12de700 1 -- 172.21.15.6:0/2153791292 learned_addr learned my addr 172.21.15.6:0/2153791292 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.541+0000 7f72b1adf700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ac0f5570 0x7f72ac107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.542+0000 7f72b12de700 1 -- 172.21.15.6:0/2153791292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ac0f5570 msgr2=0x7f72ac107f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.542+0000 7f72b12de700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ac0f5570 0x7f72ac107f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.542+0000 7f72b12de700 1 -- 172.21.15.6:0/2153791292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72a8005040 con 0x7f72ac0f5e80 2024-03-12T16:07:50.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.542+0000 7f72b12de700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 0x7f72ac108420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f72a8013470 tx=0x7f72a8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.542+0000 7f72a2ffd700 1 -- 172.21.15.6:0/2153791292 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a800e030 con 0x7f72ac0f5e80 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.542+0000 7f72a2ffd700 1 -- 172.21.15.6:0/2153791292 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f72a8007e90 con 0x7f72ac0f5e80 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.542+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f72ac10d550 con 0x7f72ac0f5e80 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.542+0000 7f72a2ffd700 1 -- 172.21.15.6:0/2153791292 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f72a8018070 con 0x7f72ac0f5e80 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.542+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f72ac10da90 con 0x7f72ac0f5e80 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.543+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f72ac0fff80 con 0x7f72ac0f5e80 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.543+0000 7f72a2ffd700 1 -- 172.21.15.6:0/2153791292 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f72a801d420 con 0x7f72ac0f5e80 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.544+0000 7f72a2ffd700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7298061160 0x7f7298063620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.544+0000 7f72a2ffd700 1 -- 172.21.15.6:0/2153791292 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f72a807dcc0 con 0x7f72ac0f5e80 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.544+0000 7f72b1adf700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7298061160 0x7f7298063620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:50.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.544+0000 7f72b1adf700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7298061160 0x7f7298063620 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f72ac05f280 tx=0x7f729c00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:50.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.548+0000 7f72a2ffd700 1 -- 172.21.15.6:0/2153791292 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f72a8051b90 con 0x7f72ac0f5e80 2024-03-12T16:07:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.720+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f72ac101df0 con 0x7f72ac0f5e80 2024-03-12T16:07:50.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.720+0000 7f72a2ffd700 1 -- 172.21.15.6:0/2153791292 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f72a8051780 con 0x7f72ac0f5e80 2024-03-12T16:07:50.722 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-03-12T16:07:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7298061160 msgr2=0x7f7298063620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7298061160 0x7f7298063620 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7f72ac05f280 tx=0x7f729c00b040).stop 2024-03-12T16:07:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 msgr2=0x7f72ac108420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 0x7f72ac108420 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f72a8013470 tx=0x7f72a8009cb0).stop 2024-03-12T16:07:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 shutdown_connections 2024-03-12T16:07:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7298061160 0x7f7298063620 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f72ac0f5570 0x7f72ac107f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 --2- 172.21.15.6:0/2153791292 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f72ac0f5e80 0x7f72ac108420 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 >> 172.21.15.6:0/2153791292 conn(0x7f72ac0f11d0 msgr2=0x7f72ac0f9940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 shutdown_connections 2024-03-12T16:07:50.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.722+0000 7f72b3d43700 1 -- 172.21.15.6:0/2153791292 wait complete. 2024-03-12T16:07:50.736 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-12T16:07:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.857+0000 7f037f017700 1 -- 172.21.15.6:0/491311258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 msgr2=0x7f03780f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.857+0000 7f037f017700 1 --2- 172.21.15.6:0/491311258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 0x7f03780f6af0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f036c0047f0 tx=0x7f036c009cb0).stop 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.857+0000 7f037f017700 1 -- 172.21.15.6:0/491311258 shutdown_connections 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.857+0000 7f037f017700 1 --2- 172.21.15.6:0/491311258 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03780f7970 0x7f03780f7dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.857+0000 7f037f017700 1 --2- 172.21.15.6:0/491311258 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 0x7f03780f6af0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.857+0000 7f037f017700 1 -- 172.21.15.6:0/491311258 >> 172.21.15.6:0/491311258 conn(0x7f03780f1df0 msgr2=0x7f03780f4250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037f017700 1 -- 172.21.15.6:0/491311258 shutdown_connections 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037f017700 1 -- 172.21.15.6:0/491311258 wait complete. 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037f017700 1 Processor -- start 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037f017700 1 -- start start 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037f017700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 0x7f0378061060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037f017700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03780f7970 0x7f037810cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037f017700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037810d230 con 0x7f03780f66d0 2024-03-12T16:07:50.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037f017700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f037810d370 con 0x7f03780f7970 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037cdb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 0x7f0378061060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037cdb3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 0x7f0378061060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51804/0 (socket says 172.21.15.6:51804) 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.858+0000 7f037cdb3700 1 -- 172.21.15.6:0/3481308265 learned_addr learned my addr 172.21.15.6:0/3481308265 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f0377fff700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03780f7970 0x7f037810cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f037cdb3700 1 -- 172.21.15.6:0/3481308265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03780f7970 msgr2=0x7f037810cd40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f037cdb3700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03780f7970 0x7f037810cd40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f037cdb3700 1 -- 172.21.15.6:0/3481308265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f036c005040 con 0x7f03780f66d0 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f037cdb3700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 0x7f0378061060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f036c004f10 tx=0x7f036c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f0375ffb700 1 -- 172.21.15.6:0/3481308265 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c00e070 con 0x7f03780f66d0 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f0375ffb700 1 -- 172.21.15.6:0/3481308265 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f036c007e90 con 0x7f03780f66d0 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f037810d570 con 0x7f03780f66d0 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f0375ffb700 1 -- 172.21.15.6:0/3481308265 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f036c018070 con 0x7f03780f66d0 2024-03-12T16:07:50.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.859+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f037810da20 con 0x7f03780f66d0 2024-03-12T16:07:50.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.860+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03780fee90 con 0x7f03780f66d0 2024-03-12T16:07:50.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.861+0000 7f0375ffb700 1 -- 172.21.15.6:0/3481308265 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f036c0123c0 con 0x7f03780f66d0 2024-03-12T16:07:50.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.861+0000 7f0375ffb700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0368061180 0x7f0368063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:50.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.861+0000 7f0375ffb700 1 -- 172.21.15.6:0/3481308265 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f036c07d790 con 0x7f03780f66d0 2024-03-12T16:07:50.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.861+0000 7f0377fff700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0368061180 0x7f0368063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:50.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.861+0000 7f0377fff700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0368061180 0x7f0368063640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0364009170 tx=0x7f0364009d60).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:50.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:50.865+0000 7f0375ffb700 1 -- 172.21.15.6:0/3481308265 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f036c051720 con 0x7f03780f66d0 2024-03-12T16:07:51.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.038+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f0378100d00 con 0x7f03780f66d0 2024-03-12T16:07:51.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.038+0000 7f0375ffb700 1 -- 172.21.15.6:0/3481308265 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v43) v1 ==== 107+0+11 (secure 0 0 0) 0x7f036c051310 con 0x7f03780f66d0 2024-03-12T16:07:51.040 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-03-12T16:07:51.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0368061180 msgr2=0x7f0368063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0368061180 0x7f0368063640 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7f0364009170 tx=0x7f0364009d60).stop 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 msgr2=0x7f0378061060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 0x7f0378061060 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f036c004f10 tx=0x7f036c009cb0).stop 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 shutdown_connections 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f0368061180 0x7f0368063640 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03780f66d0 0x7f0378061060 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 --2- 172.21.15.6:0/3481308265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03780f7970 0x7f037810cd40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 >> 172.21.15.6:0/3481308265 conn(0x7f03780f1df0 msgr2=0x7f03780fb3c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 shutdown_connections 2024-03-12T16:07:51.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.040+0000 7f037f017700 1 -- 172.21.15.6:0/3481308265 wait complete. 2024-03-12T16:07:51.053 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:49.891720+0000 mon.smithi006 (mon.0) 573 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:51.053 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:49.892502+0000 mon.smithi006 (mon.0) 574 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:51.053 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:49.893161+0000 mon.smithi006 (mon.0) 575 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:07:51.053 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:49.899490+0000 mon.smithi006 (mon.0) 576 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:51.053 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:49.980418+0000 mgr.smithi006.kskdce (mgr.14196) 213 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:51.054 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:50.082392+0000 mon.smithi006 (mon.0) 577 : audit [DBG] from='client.? 172.21.15.6:0/718182676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:07:51.054 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:50.404556+0000 mon.smithi006 (mon.0) 578 : audit [DBG] from='client.? 172.21.15.6:0/3333119354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-03-12T16:07:51.054 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:50.721864+0000 mon.smithi006 (mon.0) 579 : audit [DBG] from='client.? 172.21.15.6:0/2153791292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-12T16:07:51.055 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T16:07:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.172+0000 7f42d8e16700 1 -- 172.21.15.6:0/454438928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 msgr2=0x7f42d40f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:51.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.172+0000 7f42d8e16700 1 --2- 172.21.15.6:0/454438928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 0x7f42d40f6b10 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f42c4009b60 tx=0x7f42c4004d10).stop 2024-03-12T16:07:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.172+0000 7f42d8e16700 1 -- 172.21.15.6:0/454438928 shutdown_connections 2024-03-12T16:07:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.172+0000 7f42d8e16700 1 --2- 172.21.15.6:0/454438928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42d40f7990 0x7f42d40f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.172+0000 7f42d8e16700 1 --2- 172.21.15.6:0/454438928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 0x7f42d40f6b10 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.172+0000 7f42d8e16700 1 -- 172.21.15.6:0/454438928 >> 172.21.15.6:0/454438928 conn(0x7f42d40f1df0 msgr2=0x7f42d40f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.172+0000 7f42d8e16700 1 -- 172.21.15.6:0/454438928 shutdown_connections 2024-03-12T16:07:51.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.172+0000 7f42d8e16700 1 -- 172.21.15.6:0/454438928 wait complete. 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d8e16700 1 Processor -- start 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d8e16700 1 -- start start 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d8e16700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 0x7f42d4106e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d8e16700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42d40f7990 0x7f42d4107340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d8e16700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d41078f0 con 0x7f42d40f66f0 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d8e16700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42d4107a30 con 0x7f42d40f7990 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 0x7f42d4106e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 0x7f42d4106e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51834/0 (socket says 172.21.15.6:51834) 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d259c700 1 -- 172.21.15.6:0/114573172 learned_addr learned my addr 172.21.15.6:0/114573172 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:51.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d1d9b700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42d40f7990 0x7f42d4107340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d259c700 1 -- 172.21.15.6:0/114573172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42d40f7990 msgr2=0x7f42d4107340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d259c700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42d40f7990 0x7f42d4107340 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.173+0000 7f42d259c700 1 -- 172.21.15.6:0/114573172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f42c40097c0 con 0x7f42d40f66f0 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.174+0000 7f42d259c700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 0x7f42d4106e50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f42c400bc10 tx=0x7f42c4004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.174+0000 7f42cb7fe700 1 -- 172.21.15.6:0/114573172 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c400e070 con 0x7f42d40f66f0 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.174+0000 7f42cb7fe700 1 -- 172.21.15.6:0/114573172 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f42c401d8b0 con 0x7f42d40f66f0 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.174+0000 7f42cb7fe700 1 -- 172.21.15.6:0/114573172 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42c4018070 con 0x7f42d40f66f0 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.174+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42d410c470 con 0x7f42d40f66f0 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.174+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42d410ca30 con 0x7f42d40f66f0 2024-03-12T16:07:51.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.175+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42d40feeb0 con 0x7f42d40f66f0 2024-03-12T16:07:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.176+0000 7f42cb7fe700 1 -- 172.21.15.6:0/114573172 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f42c401da20 con 0x7f42d40f66f0 2024-03-12T16:07:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.176+0000 7f42cb7fe700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f42c0061180 0x7f42c0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.176+0000 7f42cb7fe700 1 -- 172.21.15.6:0/114573172 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f42c407e000 con 0x7f42d40f66f0 2024-03-12T16:07:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.176+0000 7f42d1d9b700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f42c0061180 0x7f42c0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:51.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.176+0000 7f42d1d9b700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f42c0061180 0x7f42c0063640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f42bc004b60 tx=0x7f42bc009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:51.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.180+0000 7f42cb7fe700 1 -- 172.21.15.6:0/114573172 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f42c4051fb0 con 0x7f42d40f66f0 2024-03-12T16:07:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:49.891720+0000 mon.smithi006 (mon.0) 573 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:49.892502+0000 mon.smithi006 (mon.0) 574 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:07:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:49.893161+0000 mon.smithi006 (mon.0) 575 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:07:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:49.899490+0000 mon.smithi006 (mon.0) 576 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:07:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:49.980418+0000 mgr.smithi006.kskdce (mgr.14196) 213 : cluster [DBG] pgmap v186: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:51.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:50.082392+0000 mon.smithi006 (mon.0) 577 : audit [DBG] from='client.? 172.21.15.6:0/718182676' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:07:51.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:50.404556+0000 mon.smithi006 (mon.0) 578 : audit [DBG] from='client.? 172.21.15.6:0/3333119354' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "device_health_metrics", "var": "pg_num"}]: dispatch 2024-03-12T16:07:51.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:50.721864+0000 mon.smithi006 (mon.0) 579 : audit [DBG] from='client.? 172.21.15.6:0/2153791292' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-12T16:07:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.396+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7f42d4100d20 con 0x7f42d40f66f0 2024-03-12T16:07:51.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.396+0000 7f42cb7fe700 1 -- 172.21.15.6:0/114573172 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 12 v12) v1 ==== 94+0+4589 (secure 0 0 0) 0x7f42c4051ba0 con 0x7f42d40f66f0 2024-03-12T16:07:51.402 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:07:51.402 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":12,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14444,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1071999293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1071999293},{"type":"v1","addr":"172.21.15.6:6829","nonce":1071999293}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":12,"flags":18,"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:07:37.908210+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14432,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14432":{"gid":14432,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.6:6827/163878097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":163878097},{"type":"v1","addr":"172.21.15.6:6827","nonce":163878097}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi134.jqydtn","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.134:6825/3713757560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3713757560},{"type":"v1","addr":"172.21.15.134:6825","nonce":3713757560}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","standby_count_wanted":1},"id":1}]} 2024-03-12T16:07:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f42c0061180 msgr2=0x7f42c0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f42c0061180 0x7f42c0063640 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f42bc004b60 tx=0x7f42bc009040).stop 2024-03-12T16:07:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 msgr2=0x7f42d4106e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:51.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 0x7f42d4106e50 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f42c400bc10 tx=0x7f42c4004d10).stop 2024-03-12T16:07:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 shutdown_connections 2024-03-12T16:07:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f42c0061180 0x7f42c0063640 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42d40f66f0 0x7f42d4106e50 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 --2- 172.21.15.6:0/114573172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42d40f7990 0x7f42d4107340 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 >> 172.21.15.6:0/114573172 conn(0x7f42d40f1df0 msgr2=0x7f42d40fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 shutdown_connections 2024-03-12T16:07:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:51.398+0000 7f42d8e16700 1 -- 172.21.15.6:0/114573172 wait complete. 2024-03-12T16:07:51.404 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 12 2024-03-12T16:07:51.412 DEBUG:tasks.fs:fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 2, 'flags': 18} 2024-03-12T16:07:51.413 INFO:teuthology.run_tasks:Running task ceph-fuse... 2024-03-12T16:07:51.441 INFO:tasks.ceph_fuse:Running ceph_fuse task... 2024-03-12T16:07:51.441 INFO:tasks.ceph_fuse:config is {'client.0': {}, 'client.1': {}} 2024-03-12T16:07:51.441 INFO:tasks.ceph_fuse:client.0 config is {} 2024-03-12T16:07:51.441 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-12T16:07:51.441 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-12T16:07:51.441 INFO:tasks.ceph_fuse:client.1 config is {} 2024-03-12T16:07:51.441 INFO:tasks.cephfs.mount:cephfs_mntpt = None 2024-03-12T16:07:51.441 INFO:tasks.cephfs.mount:hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-12T16:07:51.441 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:51.442 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-03-12T16:07:51.467 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:51.467 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link delete ceph-brx 2024-03-12T16:07:51.547 INFO:teuthology.orchestra.run.smithi134.stderr:Cannot find device "ceph-brx" 2024-03-12T16:07:51.547 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T16:07:51.548 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:51.548 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-03-12T16:07:51.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:51.567 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link delete ceph-brx 2024-03-12T16:07:51.638 INFO:teuthology.orchestra.run.smithi006.stderr:Cannot find device "ceph-brx" 2024-03-12T16:07:51.638 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T16:07:51.639 INFO:tasks.ceph_fuse:Mounting ceph-fuse clients... 2024-03-12T16:07:51.639 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph fs ls 2024-03-12T16:07:51.955 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:07:52.177 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:51.040015+0000 mon.smithi006 (mon.0) 580 : audit [DBG] from='client.? 172.21.15.6:0/3481308265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-12T16:07:52.178 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:51.398025+0000 mon.smithi006 (mon.0) 581 : audit [DBG] from='client.? 172.21.15.6:0/114573172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-12T16:07:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:51.040015+0000 mon.smithi006 (mon.0) 580 : audit [DBG] from='client.? 172.21.15.6:0/3481308265' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-12T16:07:52.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:51.398025+0000 mon.smithi006 (mon.0) 581 : audit [DBG] from='client.? 172.21.15.6:0/114573172' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-12T16:07:53.069 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:51.980776+0000 mgr.smithi006.kskdce (mgr.14196) 214 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:53.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:51.980776+0000 mgr.smithi006.kskdce (mgr.14196) 214 : cluster [DBG] pgmap v187: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.575+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/4104198430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f5c50 msgr2=0x7f7ff40f6070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.575+0000 7f7ffa1cc700 1 --2- 172.21.15.6:0/4104198430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f5c50 0x7f7ff40f6070 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f7fe40047f0 tx=0x7f7fe4009cb0).stop 2024-03-12T16:07:53.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.575+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/4104198430 shutdown_connections 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.575+0000 7f7ffa1cc700 1 --2- 172.21.15.6:0/4104198430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff40f65f0 0x7f7ff40f8d70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.575+0000 7f7ffa1cc700 1 --2- 172.21.15.6:0/4104198430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f5c50 0x7f7ff40f6070 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.575+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/4104198430 >> 172.21.15.6:0/4104198430 conn(0x7f7ff40f1770 msgr2=0x7f7ff40f3b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.575+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/4104198430 shutdown_connections 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.575+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/4104198430 wait complete. 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.575+0000 7f7ffa1cc700 1 Processor -- start 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ffa1cc700 1 -- start start 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ffa1cc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff40f5c50 0x7f7ff41080f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ffa1cc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f65f0 0x7f7ff41085e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ffa1cc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4108c20 con 0x7f7ff40f65f0 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ffa1cc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7ff4108d60 con 0x7f7ff40f5c50 2024-03-12T16:07:53.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ff2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f65f0 0x7f7ff41085e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ff2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f65f0 0x7f7ff41085e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34248/0 (socket says 172.21.15.6:34248) 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ff2ffd700 1 -- 172.21.15.6:0/3464087667 learned_addr learned my addr 172.21.15.6:0/3464087667 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ff37fe700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff40f5c50 0x7f7ff41080f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ff2ffd700 1 -- 172.21.15.6:0/3464087667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff40f5c50 msgr2=0x7f7ff41080f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ff2ffd700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff40f5c50 0x7f7ff41080f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ff2ffd700 1 -- 172.21.15.6:0/3464087667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7fe4005040 con 0x7f7ff40f65f0 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.576+0000 7f7ff2ffd700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f65f0 0x7f7ff41085e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f7fe800b480 tx=0x7f7fe80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.577+0000 7f7ff0ff9700 1 -- 172.21.15.6:0/3464087667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe8002500 con 0x7f7ff40f65f0 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.577+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7ff410d800 con 0x7f7ff40f65f0 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.577+0000 7f7ff0ff9700 1 -- 172.21.15.6:0/3464087667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7fe8002af0 con 0x7f7ff40f65f0 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.577+0000 7f7ff0ff9700 1 -- 172.21.15.6:0/3464087667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7fe8012c40 con 0x7f7ff40f65f0 2024-03-12T16:07:53.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.577+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7ff410dd40 con 0x7f7ff40f65f0 2024-03-12T16:07:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.578+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7ff41001a0 con 0x7f7ff40f65f0 2024-03-12T16:07:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.578+0000 7f7ff0ff9700 1 -- 172.21.15.6:0/3464087667 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f7fe8002660 con 0x7f7ff40f65f0 2024-03-12T16:07:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.578+0000 7f7ff0ff9700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fdc061180 0x7f7fdc063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.578+0000 7f7ff0ff9700 1 -- 172.21.15.6:0/3464087667 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f7fe807c910 con 0x7f7ff40f65f0 2024-03-12T16:07:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.579+0000 7f7ff37fe700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fdc061180 0x7f7fdc063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.579+0000 7f7ff37fe700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fdc061180 0x7f7fdc063640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7fe4013470 tx=0x7f7fe400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:53.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.583+0000 7f7ff0ff9700 1 -- 172.21.15.6:0/3464087667 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7fe80508a0 con 0x7f7ff40f65f0 2024-03-12T16:07:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.798+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f7ff40598f0 con 0x7f7ff40f65f0 2024-03-12T16:07:53.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.798+0000 7f7ff0ff9700 1 -- 172.21.15.6:0/3464087667 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+83 (secure 0 0 0) 0x7f7fe8050490 con 0x7f7ff40f65f0 2024-03-12T16:07:53.800 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-03-12T16:07:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fdc061180 msgr2=0x7f7fdc063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:53.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fdc061180 0x7f7fdc063640 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f7fe4013470 tx=0x7f7fe400b040).stop 2024-03-12T16:07:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f65f0 msgr2=0x7f7ff41085e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f65f0 0x7f7ff41085e0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f7fe800b480 tx=0x7f7fe80090f0).stop 2024-03-12T16:07:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 shutdown_connections 2024-03-12T16:07:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7fdc061180 0x7f7fdc063640 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7ff40f5c50 0x7f7ff41080f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 --2- 172.21.15.6:0/3464087667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7ff40f65f0 0x7f7ff41085e0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 >> 172.21.15.6:0/3464087667 conn(0x7f7ff40f1770 msgr2=0x7f7ff40fc7c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 shutdown_connections 2024-03-12T16:07:53.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:53.800+0000 7f7ffa1cc700 1 -- 172.21.15.6:0/3464087667 wait complete. 2024-03-12T16:07:54.146 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:53.799973+0000 mon.smithi006 (mon.0) 582 : audit [DBG] from='client.? 172.21.15.6:0/3464087667' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-12T16:07:54.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:53.799973+0000 mon.smithi006 (mon.0) 582 : audit [DBG] from='client.? 172.21.15.6:0/3464087667' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-12T16:07:54.491 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-12T16:07:54.491 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-12T16:07:54.491 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi006.front.sepia.ceph.com 2024-03-12T16:07:54.491 INFO:tasks.cephfs.mount:self.client.name = client.0 2024-03-12T16:07:54.491 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.0 2024-03-12T16:07:54.491 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-12T16:07:54.491 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-12T16:07:54.491 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-12T16:07:54.492 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.0' 2024-03-12T16:07:54.492 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:54.492 DEBUG:teuthology.orchestra.run.smithi006:> ip addr 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 ::1/128 scope host 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e6 brd ff:ff:ff:ff:ff:ff 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f0 2024-03-12T16:07:54.514 INFO:teuthology.orchestra.run.smithi006.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:6b:fe:e7 brd ff:ff:ff:ff:ff:ff 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp7s0f1 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout:4: ens1f0: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e4 brd ff:ff:ff:ff:ff:ff 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f0 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: inet 172.21.15.6/20 brd 172.21.15.255 scope global dynamic noprefixroute ens1f0 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft 41933sec preferred_lft 41933sec 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: inet6 fe80::ec4:7aff:febd:15e4/64 scope link 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: valid_lft forever preferred_lft forever 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout:5: ens1f1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: link/ether 0c:c4:7a:bd:15:e5 brd ff:ff:ff:ff:ff:ff 2024-03-12T16:07:54.515 INFO:teuthology.orchestra.run.smithi006.stdout: altname enp1s0f1 2024-03-12T16:07:54.516 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-12T16:07:54.516 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:54.516 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-03-12T16:07:54.516 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-03-12T16:07:54.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add name ceph-brx type bridge 2024-03-12T16:07:54.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr flush dev ceph-brx 2024-03-12T16:07:54.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set ceph-brx up 2024-03-12T16:07:54.516 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-12T16:07:54.516 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-03-12T16:07:54.686 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:54.686 DEBUG:teuthology.orchestra.run.smithi006:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-12T16:07:54.716 INFO:teuthology.orchestra.run.smithi006.stdout:1 2024-03-12T16:07:54.717 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:54.717 DEBUG:teuthology.orchestra.run.smithi006:> route 2024-03-12T16:07:54.818 INFO:teuthology.orchestra.run.smithi006.stdout:Kernel IP routing table 2024-03-12T16:07:54.818 INFO:teuthology.orchestra.run.smithi006.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-12T16:07:54.818 INFO:teuthology.orchestra.run.smithi006.stdout:default _gateway 0.0.0.0 UG 100 0 0 ens1f0 2024-03-12T16:07:54.818 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 ens1f0 2024-03-12T16:07:54.818 INFO:teuthology.orchestra.run.smithi006.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-12T16:07:54.819 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:54.819 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-03-12T16:07:54.819 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-03-12T16:07:54.819 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -o ens1f0 -i ceph-brx -j ACCEPT 2024-03-12T16:07:54.819 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -A FORWARD -i ens1f0 -o ceph-brx -j ACCEPT 2024-03-12T16:07:54.819 DEBUG:teuthology.orchestra.run.smithi006:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o ens1f0 -j MASQUERADE 2024-03-12T16:07:54.819 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-03-12T16:07:55.057 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:55.057 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list 2024-03-12T16:07:55.076 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:55.077 DEBUG:teuthology.orchestra.run.smithi006:> ip netns list-id 2024-03-12T16:07:55.135 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:55.135 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-03-12T16:07:55.135 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-03-12T16:07:55.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.0 2024-03-12T16:07:55.135 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.0 0 2024-03-12T16:07:55.136 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-03-12T16:07:55.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:53.981362+0000 mgr.smithi006.kskdce (mgr.14196) 215 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:55.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:53.981362+0000 mgr.smithi006.kskdce (mgr.14196) 215 : cluster [DBG] pgmap v188: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:55.233 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.0' with 192.168.0.1/16 2024-03-12T16:07:55.233 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:55.233 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-03-12T16:07:55.233 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-03-12T16:07:55.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.0 type veth peer name brx.0 2024-03-12T16:07:55.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-12T16:07:55.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set veth0 up 2024-03-12T16:07:55.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip link set lo up 2024-03-12T16:07:55.233 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.0 ip route add default via 192.168.255.254 2024-03-12T16:07:55.234 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-03-12T16:07:55.465 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:55.465 DEBUG:teuthology.orchestra.run.smithi006:> (cd / && exec bash -c ' 2024-03-12T16:07:55.465 DEBUG:teuthology.orchestra.run.smithi006:> set -e 2024-03-12T16:07:55.465 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set brx.0 up 2024-03-12T16:07:55.466 DEBUG:teuthology.orchestra.run.smithi006:> sudo ip link set dev brx.0 master ceph-brx 2024-03-12T16:07:55.466 DEBUG:teuthology.orchestra.run.smithi006:> ') 2024-03-12T16:07:55.564 INFO:tasks.cephfs.fuse_mount:Client client.0 config is {} 2024-03-12T16:07:55.564 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T16:07:55.565 DEBUG:teuthology.orchestra.run.smithi006:> mkdir -p -v /home/ubuntu/cephtest/mnt.0 2024-03-12T16:07:55.583 INFO:teuthology.orchestra.run.smithi006.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.0' 2024-03-12T16:07:55.583 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T16:07:55.583 DEBUG:teuthology.orchestra.run.smithi006:> chmod 0000 /home/ubuntu/cephtest/mnt.0 2024-03-12T16:07:55.642 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-03-12T16:07:55.710 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-12T16:07:55.711 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-03-12T16:07:55.779 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-03-12T16:07:55.780 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-03-12T16:07:55.780 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:55.780 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-03-12T16:07:55.840 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-12T16:07:55.840 DEBUG:teuthology.orchestra.run.smithi006:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.0 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.0 --id 0) 2024-03-12T16:07:55.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo modprobe fuse 2024-03-12T16:07:55.910 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-12T16:07:55.910 DEBUG:teuthology.orchestra.run.smithi006:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-03-12T16:07:55.978 INFO:teuthology.orchestra.run.smithi006.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-03-12T16:07:55.979 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-03-12T16:07:55.979 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:55.979 DEBUG:teuthology.orchestra.run.smithi006:> ls /sys/fs/fuse/connections 2024-03-12T16:07:55.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:2024-03-12T16:07:55.992+0000 7fc5a57693c0 -1 init, newargv = 0x560315d986f0 newargc=15 2024-03-12T16:07:55.994 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[78410]: starting ceph client 2024-03-12T16:07:56.002 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[78410]: starting fuse 2024-03-12T16:07:56.014 INFO:teuthology.orchestra.run.smithi006.stdout:149 2024-03-12T16:07:56.014 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [149] 2024-03-12T16:07:56.014 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> import glob 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> import re 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> import os 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> import subprocess 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> def _find_admin_socket(client_name): 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> asok_path = "/var/run/ceph/ceph-client.0.*.asok" 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> files = glob.glob(asok_path) 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> mountpoint = "/home/ubuntu/cephtest/mnt.0" 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> # Given a non-glob path, it better be there 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> if "*" not in asok_path: 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> assert(len(files) == 1) 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> return files[0] 2024-03-12T16:07:56.015 DEBUG:teuthology.orchestra.run.smithi006:> 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> for f in files: 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> contents = proc_f.read() 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> if mountpoint in contents: 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> return f 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> print(_find_admin_socket("client.0")) 2024-03-12T16:07:56.016 DEBUG:teuthology.orchestra.run.smithi006:> ' 2024-03-12T16:07:56.140 INFO:teuthology.orchestra.run.smithi006.stdout:/var/run/ceph/ceph-client.0.78410.asok 2024-03-12T16:07:56.322 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.0.78410.asok 2024-03-12T16:07:56.322 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:56.322 DEBUG:teuthology.orchestra.run.smithi006:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.0.78410.asok status 2024-03-12T16:07:56.479 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:07:56.479 INFO:teuthology.orchestra.run.smithi006.stdout: "metadata": { 2024-03-12T16:07:56.479 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_sha1": "8963e9dec9df5145388f0d6f6f32af0a74591caf", 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph_version": "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)", 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "entity_id": "0", 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "hostname": "smithi006", 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.0", 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "pid": "78410", 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "root": "/" 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_count": 0, 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "dentry_pinned_count": 0, 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "id": 14494, 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "inst": { 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "name": { 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "client", 2024-03-12T16:07:56.480 INFO:teuthology.orchestra.run.smithi006.stdout: "num": 14494 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1262025081 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": { 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "type": "v1", 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "addr": "192.168.0.1:0", 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "nonce": 1262025081 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "inst_str": "client.14494 192.168.0.1:0/1262025081", 2024-03-12T16:07:56.481 INFO:teuthology.orchestra.run.smithi006.stdout: "addr_str": "192.168.0.1:0/1262025081", 2024-03-12T16:07:56.482 INFO:teuthology.orchestra.run.smithi006.stdout: "inode_count": 1, 2024-03-12T16:07:56.482 INFO:teuthology.orchestra.run.smithi006.stdout: "mds_epoch": 12, 2024-03-12T16:07:56.482 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch": 43, 2024-03-12T16:07:56.482 INFO:teuthology.orchestra.run.smithi006.stdout: "osd_epoch_barrier": 0, 2024-03-12T16:07:56.482 INFO:teuthology.orchestra.run.smithi006.stdout: "blocklisted": false, 2024-03-12T16:07:56.482 INFO:teuthology.orchestra.run.smithi006.stdout: "fs_name": "cephfs" 2024-03-12T16:07:56.482 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:07:56.489 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- ceph fs ls 2024-03-12T16:07:56.766 INFO:teuthology.orchestra.run.smithi006.stderr:Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi006/config 2024-03-12T16:07:57.322 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:55.981715+0000 mgr.smithi006.kskdce (mgr.14196) 216 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:55.981715+0000 mgr.smithi006.kskdce (mgr.14196) 216 : cluster [DBG] pgmap v189: 65 pgs: 65 active+clean; 3.6 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:07:58.608 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.591+0000 7f69e3f5f700 1 -- 172.21.15.6:0/2130391171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 msgr2=0x7f69dc0f90a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.591+0000 7f69e3f5f700 1 --2- 172.21.15.6:0/2130391171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 0x7f69dc0f90a0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f69d00047f0 tx=0x7f69d0009cb0).stop 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.591+0000 7f69e3f5f700 1 -- 172.21.15.6:0/2130391171 shutdown_connections 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.591+0000 7f69e3f5f700 1 --2- 172.21.15.6:0/2130391171 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 0x7f69dc0f90a0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.591+0000 7f69e3f5f700 1 --2- 172.21.15.6:0/2130391171 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69dc0f79a0 0x7f69dc0f7dc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.591+0000 7f69e3f5f700 1 -- 172.21.15.6:0/2130391171 >> 172.21.15.6:0/2130391171 conn(0x7f69dc0f3100 msgr2=0x7f69dc0f5520 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.591+0000 7f69e3f5f700 1 -- 172.21.15.6:0/2130391171 shutdown_connections 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.591+0000 7f69e3f5f700 1 -- 172.21.15.6:0/2130391171 wait complete. 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e3f5f700 1 Processor -- start 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e3f5f700 1 -- start start 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e3f5f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69dc0f79a0 0x7f69dc06c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e3f5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 0x7f69dc06b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e3f5f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc06cf80 con 0x7f69dc0f8c40 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e3f5f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69dc06b520 con 0x7f69dc0f79a0 2024-03-12T16:07:58.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e14fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 0x7f69dc06b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e14fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 0x7f69dc06b030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34260/0 (socket says 172.21.15.6:34260) 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e14fa700 1 -- 172.21.15.6:0/1259358752 learned_addr learned my addr 172.21.15.6:0/1259358752 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e1cfb700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69dc0f79a0 0x7f69dc06c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e14fa700 1 -- 172.21.15.6:0/1259358752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69dc0f79a0 msgr2=0x7f69dc06c9d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.592+0000 7f69e14fa700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69dc0f79a0 0x7f69dc06c9d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.593+0000 7f69e14fa700 1 -- 172.21.15.6:0/1259358752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d0005040 con 0x7f69dc0f8c40 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.593+0000 7f69e1cfb700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69dc0f79a0 0x7f69dc06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.593+0000 7f69e14fa700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 0x7f69dc06b030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f69d0013510 tx=0x7f69d0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.593+0000 7f69ceffd700 1 -- 172.21.15.6:0/1259358752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69d000e030 con 0x7f69dc0f8c40 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.593+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69dc06b740 con 0x7f69dc0f8c40 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.593+0000 7f69ceffd700 1 -- 172.21.15.6:0/1259358752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f69d0007e90 con 0x7f69dc0f8c40 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.593+0000 7f69ceffd700 1 -- 172.21.15.6:0/1259358752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69d0018070 con 0x7f69dc0f8c40 2024-03-12T16:07:58.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.593+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69dc06bc20 con 0x7f69dc0f8c40 2024-03-12T16:07:58.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.594+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69dc06be40 con 0x7f69dc0f8c40 2024-03-12T16:07:58.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.594+0000 7f69ceffd700 1 -- 172.21.15.6:0/1259358752 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f69d001d420 con 0x7f69dc0f8c40 2024-03-12T16:07:58.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.595+0000 7f69ceffd700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f69c8061180 0x7f69c8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:07:58.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.595+0000 7f69ceffd700 1 -- 172.21.15.6:0/1259358752 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f69d007ddd0 con 0x7f69dc0f8c40 2024-03-12T16:07:58.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.595+0000 7f69e1cfb700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f69c8061180 0x7f69c8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:07:58.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.595+0000 7f69e1cfb700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f69c8061180 0x7f69c8063640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f69dc0f8aa0 tx=0x7f69d8009d80).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:07:58.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.599+0000 7f69ceffd700 1 -- 172.21.15.6:0/1259358752 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f69d0051d60 con 0x7f69dc0f8c40 2024-03-12T16:07:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.813+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs ls"} v 0) v1 -- 0x7f69dc1000f0 con 0x7f69dc0f8c40 2024-03-12T16:07:58.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.814+0000 7f69ceffd700 1 -- 172.21.15.6:0/1259358752 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs ls"}]=0 v12) v1 ==== 53+0+83 (secure 0 0 0) 0x7f69d0051950 con 0x7f69dc0f8c40 2024-03-12T16:07:58.815 INFO:teuthology.orchestra.run.smithi006.stdout:name: cephfs, metadata pool: cephfs.cephfs.meta, data pools: [cephfs.cephfs.data ] 2024-03-12T16:07:58.816 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.815+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f69c8061180 msgr2=0x7f69c8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.815+0000 7f69e3f5f700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f69c8061180 0x7f69c8063640 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f69dc0f8aa0 tx=0x7f69d8009d80).stop 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.816+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 msgr2=0x7f69dc06b030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.816+0000 7f69e3f5f700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 0x7f69dc06b030 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f69d0013510 tx=0x7f69d0009cb0).stop 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.816+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 shutdown_connections 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.816+0000 7f69e3f5f700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f69c8061180 0x7f69c8063640 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.816+0000 7f69e3f5f700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69dc0f79a0 0x7f69dc06c9d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.816+0000 7f69e3f5f700 1 --2- 172.21.15.6:0/1259358752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69dc0f8c40 0x7f69dc06b030 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.816+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 >> 172.21.15.6:0/1259358752 conn(0x7f69dc0f3100 msgr2=0x7f69dc0fc690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.816+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 shutdown_connections 2024-03-12T16:07:58.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:07:58.816+0000 7f69e3f5f700 1 -- 172.21.15.6:0/1259358752 wait complete. 2024-03-12T16:07:59.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:57.982250+0000 mgr.smithi006.kskdce (mgr.14196) 217 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 4.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-12T16:07:59.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:07:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:07:58.814614+0000 mon.smithi006 (mon.0) 583 : audit [DBG] from='client.? 172.21.15.6:0/1259358752' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-12T16:07:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:57.982250+0000 mgr.smithi006.kskdce (mgr.14196) 217 : cluster [DBG] pgmap v190: 65 pgs: 65 active+clean; 4.0 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-12T16:07:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:07:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:07:58.814614+0000 mon.smithi006 (mon.0) 583 : audit [DBG] from='client.? 172.21.15.6:0/1259358752' entity='client.admin' cmd=[{"prefix": "fs ls"}]: dispatch 2024-03-12T16:07:59.541 INFO:tasks.cephfs.mount:Mounting default Ceph FS; just confirmed its presence on cluster 2024-03-12T16:07:59.542 INFO:tasks.cephfs.mount:Mounting Ceph FS. Following are details of mount; remember "None" represents Python type None - 2024-03-12T16:07:59.542 INFO:tasks.cephfs.mount:self.client_remote.hostname = smithi134.front.sepia.ceph.com 2024-03-12T16:07:59.542 INFO:tasks.cephfs.mount:self.client.name = client.1 2024-03-12T16:07:59.542 INFO:tasks.cephfs.mount:self.hostfs_mntpt = /home/ubuntu/cephtest/mnt.1 2024-03-12T16:07:59.542 INFO:tasks.cephfs.mount:self.cephfs_name = None 2024-03-12T16:07:59.542 INFO:tasks.cephfs.mount:self.cephfs_mntpt = None 2024-03-12T16:07:59.542 INFO:tasks.cephfs.mount:self.client_keyring_path = None 2024-03-12T16:07:59.542 INFO:tasks.cephfs.mount:Setting the 'None' netns for '/home/ubuntu/cephtest/mnt.1' 2024-03-12T16:07:59.542 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:59.542 DEBUG:teuthology.orchestra.run.smithi134:> ip addr 2024-03-12T16:07:59.565 INFO:teuthology.orchestra.run.smithi134.stdout:1: lo: mtu 65536 qdisc noqueue state UNKNOWN group default qlen 1000 2024-03-12T16:07:59.565 INFO:teuthology.orchestra.run.smithi134.stdout: link/loopback 00:00:00:00:00:00 brd 00:00:00:00:00:00 2024-03-12T16:07:59.565 INFO:teuthology.orchestra.run.smithi134.stdout: inet 127.0.0.1/8 scope host lo 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 ::1/128 scope host 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout:2: eno1: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e6 brd ff:ff:ff:ff:ff:ff 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f0 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout:3: eno2: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:d9:38:e7 brd ff:ff:ff:ff:ff:ff 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: altname enp7s0f1 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout:4: enp3s0f0: mtu 1500 qdisc mq state DOWN group default qlen 1000 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e8 brd ff:ff:ff:ff:ff:ff 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout:5: enp3s0f1: mtu 1500 qdisc mq state UP group default qlen 1000 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: link/ether 0c:c4:7a:88:6d:e9 brd ff:ff:ff:ff:ff:ff 2024-03-12T16:07:59.566 INFO:teuthology.orchestra.run.smithi134.stdout: inet 172.21.15.134/20 brd 172.21.15.255 scope global dynamic noprefixroute enp3s0f1 2024-03-12T16:07:59.567 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft 41990sec preferred_lft 41990sec 2024-03-12T16:07:59.567 INFO:teuthology.orchestra.run.smithi134.stdout: inet6 fe80::ec4:7aff:fe88:6de9/64 scope link 2024-03-12T16:07:59.567 INFO:teuthology.orchestra.run.smithi134.stdout: valid_lft forever preferred_lft forever 2024-03-12T16:07:59.567 INFO:tasks.cephfs.mount:Setuping the 'ceph-brx' with 192.168.255.254/16 2024-03-12T16:07:59.567 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:59.567 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-12T16:07:59.567 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-12T16:07:59.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add name ceph-brx type bridge 2024-03-12T16:07:59.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr flush dev ceph-brx 2024-03-12T16:07:59.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set ceph-brx up 2024-03-12T16:07:59.567 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip addr add 192.168.255.254/16 brd 192.168.255.255 dev ceph-brx 2024-03-12T16:07:59.567 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-12T16:07:59.776 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:59.776 DEBUG:teuthology.orchestra.run.smithi134:> echo 1 | sudo tee /proc/sys/net/ipv4/ip_forward 2024-03-12T16:07:59.805 INFO:teuthology.orchestra.run.smithi134.stdout:1 2024-03-12T16:07:59.806 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:59.807 DEBUG:teuthology.orchestra.run.smithi134:> route 2024-03-12T16:07:59.880 INFO:teuthology.orchestra.run.smithi134.stdout:Kernel IP routing table 2024-03-12T16:07:59.881 INFO:teuthology.orchestra.run.smithi134.stdout:Destination Gateway Genmask Flags Metric Ref Use Iface 2024-03-12T16:07:59.881 INFO:teuthology.orchestra.run.smithi134.stdout:default _gateway 0.0.0.0 UG 100 0 0 enp3s0f1 2024-03-12T16:07:59.881 INFO:teuthology.orchestra.run.smithi134.stdout:172.21.0.0 0.0.0.0 255.255.240.0 U 100 0 0 enp3s0f1 2024-03-12T16:07:59.881 INFO:teuthology.orchestra.run.smithi134.stdout:192.168.0.0 0.0.0.0 255.255.0.0 U 0 0 0 ceph-brx 2024-03-12T16:07:59.881 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:07:59.881 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-12T16:07:59.881 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-12T16:07:59.881 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -o enp3s0f1 -i ceph-brx -j ACCEPT 2024-03-12T16:07:59.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -A FORWARD -i enp3s0f1 -o ceph-brx -j ACCEPT 2024-03-12T16:07:59.882 DEBUG:teuthology.orchestra.run.smithi134:> sudo iptables -t nat -A POSTROUTING -s 192.168.255.254/16 -o enp3s0f1 -j MASQUERADE 2024-03-12T16:07:59.882 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-12T16:08:00.225 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:00.226 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list 2024-03-12T16:08:00.244 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:00.244 DEBUG:teuthology.orchestra.run.smithi134:> ip netns list-id 2024-03-12T16:08:00.301 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:00.302 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-12T16:08:00.302 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-12T16:08:00.302 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns add ceph-ns--home-ubuntu-cephtest-mnt.1 2024-03-12T16:08:00.302 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns set ceph-ns--home-ubuntu-cephtest-mnt.1 0 2024-03-12T16:08:00.302 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-12T16:08:00.395 INFO:tasks.cephfs.mount:Setuping the netns 'ceph-ns--home-ubuntu-cephtest-mnt.1' with 192.168.0.1/16 2024-03-12T16:08:00.395 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:00.396 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-12T16:08:00.396 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-12T16:08:00.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link add veth0 netns ceph-ns--home-ubuntu-cephtest-mnt.1 type veth peer name brx.0 2024-03-12T16:08:00.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip addr add 192.168.0.1/16 brd 192.168.255.255 dev veth0 2024-03-12T16:08:00.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set veth0 up 2024-03-12T16:08:00.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip link set lo up 2024-03-12T16:08:00.396 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip netns exec ceph-ns--home-ubuntu-cephtest-mnt.1 ip route add default via 192.168.255.254 2024-03-12T16:08:00.396 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-12T16:08:00.603 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:00.603 DEBUG:teuthology.orchestra.run.smithi134:> (cd / && exec bash -c ' 2024-03-12T16:08:00.603 DEBUG:teuthology.orchestra.run.smithi134:> set -e 2024-03-12T16:08:00.603 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set brx.0 up 2024-03-12T16:08:00.604 DEBUG:teuthology.orchestra.run.smithi134:> sudo ip link set dev brx.0 master ceph-brx 2024-03-12T16:08:00.604 DEBUG:teuthology.orchestra.run.smithi134:> ') 2024-03-12T16:08:00.700 INFO:tasks.cephfs.fuse_mount:Client client.1 config is {} 2024-03-12T16:08:00.700 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T16:08:00.700 DEBUG:teuthology.orchestra.run.smithi134:> mkdir -p -v /home/ubuntu/cephtest/mnt.1 2024-03-12T16:08:00.718 INFO:teuthology.orchestra.run.smithi134.stdout:mkdir: created directory '/home/ubuntu/cephtest/mnt.1' 2024-03-12T16:08:00.718 INFO:teuthology.orchestra.run:Running command with timeout 60 2024-03-12T16:08:00.718 DEBUG:teuthology.orchestra.run.smithi134:> chmod 0000 /home/ubuntu/cephtest/mnt.1 2024-03-12T16:08:00.776 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-03-12T16:08:00.845 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-12T16:08:00.845 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-03-12T16:08:00.912 INFO:teuthology.orchestra.run.smithi134.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-03-12T16:08:00.913 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-03-12T16:08:00.914 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:00.914 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-03-12T16:08:00.972 INFO:tasks.cephfs.fuse_mount:Pre-mount connections: [] 2024-03-12T16:08:00.973 DEBUG:teuthology.orchestra.run.smithi134:> (cd /home/ubuntu/cephtest && exec sudo nsenter --net=/var/run/netns/ceph-ns--home-ubuntu-cephtest-mnt.1 sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-fuse -f --admin-socket '/var/run/ceph/$cluster-$name.$pid.asok' /home/ubuntu/cephtest/mnt.1 --id 1) 2024-03-12T16:08:01.015 DEBUG:teuthology.orchestra.run.smithi134:> sudo modprobe fuse 2024-03-12T16:08:01.041 INFO:teuthology.orchestra.run:Running command with timeout 30 2024-03-12T16:08:01.041 DEBUG:teuthology.orchestra.run.smithi134:> sudo mount -t fusectl /sys/fs/fuse/connections /sys/fs/fuse/connections 2024-03-12T16:08:01.106 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:07:59.982799+0000 mgr.smithi006.kskdce (mgr.14196) 218 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 4.4 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-12T16:08:01.108 INFO:teuthology.orchestra.run.smithi134.stderr:mount: /sys/fs/fuse/connections: /sys/fs/fuse/connections already mounted or mount point busy. 2024-03-12T16:08:01.109 DEBUG:teuthology.orchestra.run:got remote process result: 32 2024-03-12T16:08:01.110 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:01.110 DEBUG:teuthology.orchestra.run.smithi134:> ls /sys/fs/fuse/connections 2024-03-12T16:08:01.149 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi134.stderr:2024-03-12T16:08:01.147+0000 7fb00420c3c0 -1 init, newargv = 0x55f688dcf550 newargc=15 2024-03-12T16:08:01.149 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi134.stderr:ceph-fuse[64831]: starting ceph client 2024-03-12T16:08:01.156 INFO:tasks.cephfs.fuse_mount.ceph-fuse.1.smithi134.stderr:ceph-fuse[64831]: starting fuse 2024-03-12T16:08:01.168 INFO:teuthology.orchestra.run.smithi134.stdout:137 2024-03-12T16:08:01.168 INFO:tasks.cephfs.fuse_mount:Post-mount connections: [137] 2024-03-12T16:08:01.168 DEBUG:teuthology.orchestra.run.smithi134:> sudo adjust-ulimits daemon-helper kill python3 -c ' 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> import glob 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> import re 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> import os 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> import subprocess 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> def _find_admin_socket(client_name): 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> asok_path = "/var/run/ceph/ceph-client.1.*.asok" 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> files = glob.glob(asok_path) 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> mountpoint = "/home/ubuntu/cephtest/mnt.1" 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> # Given a non-glob path, it better be there 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> if "*" not in asok_path: 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> assert(len(files) == 1) 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> return files[0] 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> for f in files: 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> pid = re.match(".*\.(\d+)\.asok$", f).group(1) 2024-03-12T16:08:01.169 DEBUG:teuthology.orchestra.run.smithi134:> if os.path.exists("/proc/{0}".format(pid)): 2024-03-12T16:08:01.170 DEBUG:teuthology.orchestra.run.smithi134:> with open("/proc/{0}/cmdline".format(pid), '"'"'r'"'"') as proc_f: 2024-03-12T16:08:01.170 DEBUG:teuthology.orchestra.run.smithi134:> contents = proc_f.read() 2024-03-12T16:08:01.170 DEBUG:teuthology.orchestra.run.smithi134:> if mountpoint in contents: 2024-03-12T16:08:01.170 DEBUG:teuthology.orchestra.run.smithi134:> return f 2024-03-12T16:08:01.170 DEBUG:teuthology.orchestra.run.smithi134:> raise RuntimeError("Client socket {0} not found".format(client_name)) 2024-03-12T16:08:01.170 DEBUG:teuthology.orchestra.run.smithi134:> 2024-03-12T16:08:01.170 DEBUG:teuthology.orchestra.run.smithi134:> print(_find_admin_socket("client.1")) 2024-03-12T16:08:01.170 DEBUG:teuthology.orchestra.run.smithi134:> ' 2024-03-12T16:08:01.294 INFO:teuthology.orchestra.run.smithi134.stdout:/var/run/ceph/ceph-client.1.64831.asok 2024-03-12T16:08:01.312 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:07:59.982799+0000 mgr.smithi006.kskdce (mgr.14196) 218 : cluster [DBG] pgmap v191: 65 pgs: 65 active+clean; 4.4 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-12T16:08:01.475 INFO:tasks.cephfs.fuse_mount:Found client admin socket at /var/run/ceph/ceph-client.1.64831.asok 2024-03-12T16:08:01.475 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:01.475 DEBUG:teuthology.orchestra.run.smithi134:> sudo ceph --admin-daemon /var/run/ceph/ceph-client.1.64831.asok status 2024-03-12T16:08:01.626 INFO:teuthology.orchestra.run.smithi134.stdout:{ 2024-03-12T16:08:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "metadata": { 2024-03-12T16:08:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_sha1": "8963e9dec9df5145388f0d6f6f32af0a74591caf", 2024-03-12T16:08:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "ceph_version": "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)", 2024-03-12T16:08:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "entity_id": "1", 2024-03-12T16:08:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "hostname": "smithi134", 2024-03-12T16:08:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "mount_point": "/home/ubuntu/cephtest/mnt.1", 2024-03-12T16:08:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "pid": "64831", 2024-03-12T16:08:01.626 INFO:teuthology.orchestra.run.smithi134.stdout: "root": "/" 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_count": 0, 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "dentry_pinned_count": 0, 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "id": 24327, 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "inst": { 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "name": { 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "client", 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "num": 24327 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3416510794 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: } 2024-03-12T16:08:01.627 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": { 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "type": "v1", 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "addr": "192.168.0.1:0", 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "nonce": 3416510794 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: }, 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "inst_str": "client.24327 192.168.0.1:0/3416510794", 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "addr_str": "192.168.0.1:0/3416510794", 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "inode_count": 1, 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "mds_epoch": 12, 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch": 43, 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "osd_epoch_barrier": 0, 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "blocklisted": false, 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout: "fs_name": "cephfs" 2024-03-12T16:08:01.628 INFO:teuthology.orchestra.run.smithi134.stdout:} 2024-03-12T16:08:01.635 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:01.635 DEBUG:teuthology.orchestra.run.smithi006:> stat --file-system '--printf=%T 2024-03-12T16:08:01.635 DEBUG:teuthology.orchestra.run.smithi006:> ' -- /home/ubuntu/cephtest/mnt.0 2024-03-12T16:08:01.660 INFO:teuthology.orchestra.run.smithi006.stdout:fuseblk 2024-03-12T16:08:01.661 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.0 2024-03-12T16:08:01.661 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:01.661 DEBUG:teuthology.orchestra.run.smithi006:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.0 2024-03-12T16:08:01.741 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:01.742 DEBUG:teuthology.orchestra.run.smithi134:> stat --file-system '--printf=%T 2024-03-12T16:08:01.742 DEBUG:teuthology.orchestra.run.smithi134:> ' -- /home/ubuntu/cephtest/mnt.1 2024-03-12T16:08:01.760 INFO:teuthology.orchestra.run.smithi134.stdout:fuseblk 2024-03-12T16:08:01.761 INFO:tasks.cephfs.fuse_mount:ceph-fuse is mounted on /home/ubuntu/cephtest/mnt.1 2024-03-12T16:08:01.761 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:08:01.761 DEBUG:teuthology.orchestra.run.smithi134:> sudo chmod 1777 /home/ubuntu/cephtest/mnt.1 2024-03-12T16:08:03.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:01.983287+0000 mgr.smithi006.kskdce (mgr.14196) 219 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 4.4 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-12T16:08:03.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:01.983287+0000 mgr.smithi006.kskdce (mgr.14196) 219 : cluster [DBG] pgmap v192: 65 pgs: 65 active+clean; 4.4 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 341 B/s wr, 0 op/s 2024-03-12T16:08:04.916 INFO:teuthology.run_tasks:Running task print... 2024-03-12T16:08:04.926 INFO:teuthology.task.print:**** done client 2024-03-12T16:08:04.926 INFO:teuthology.run_tasks:Running task parallel... 2024-03-12T16:08:04.944 INFO:teuthology.task.parallel:starting parallel... 2024-03-12T16:08:04.945 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-12T16:08:04.945 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-12T16:08:04.945 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:08:04.946 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-03-12T16:08:04.946 INFO:teuthology.task.parallel:In parallel, running task sequential... 2024-03-12T16:08:04.946 INFO:teuthology.task.sequential:In sequential, running task workunit... 2024-03-12T16:08:04.950 INFO:tasks.workunit:Pulling workunits from ref 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:08:04.950 INFO:tasks.workunit:Making a separate scratch dir for every client... 2024-03-12T16:08:04.950 INFO:tasks.workunit:timeout=3h 2024-03-12T16:08:04.950 INFO:tasks.workunit:cleanup=True 2024-03-12T16:08:04.950 DEBUG:teuthology.orchestra.run.smithi006:> stat -- /home/ubuntu/cephtest/mnt.0 2024-03-12T16:08:04.975 INFO:teuthology.orchestra.run.smithi006.stdout: File: /home/ubuntu/cephtest/mnt.0 2024-03-12T16:08:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-12T16:08:04.976 INFO:teuthology.orchestra.run.smithi006.stdout:Device: 95h/149d Inode: 1 Links: 2 2024-03-12T16:08:04.976 INFO:teuthology.orchestra.run.smithi006.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:08:04.976 INFO:teuthology.orchestra.run.smithi006.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-12T16:08:04.976 INFO:teuthology.orchestra.run.smithi006.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-12T16:08:04.976 INFO:teuthology.orchestra.run.smithi006.stdout:Modify: 2024-03-12 16:07:25.290412273 +0000 2024-03-12T16:08:04.976 INFO:teuthology.orchestra.run.smithi006.stdout:Change: 2024-03-12 16:08:01.737378297 +0000 2024-03-12T16:08:04.976 INFO:teuthology.orchestra.run.smithi006.stdout: Birth: - 2024-03-12T16:08:04.976 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.0 2024-03-12T16:08:04.976 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/mnt.0 && sudo install -d -m 0755 --owner=ubuntu -- client.0 2024-03-12T16:08:05.055 DEBUG:teuthology.orchestra.run.smithi134:> stat -- /home/ubuntu/cephtest/mnt.1 2024-03-12T16:08:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: File: /home/ubuntu/cephtest/mnt.1 2024-03-12T16:08:05.080 INFO:teuthology.orchestra.run.smithi134.stdout: Size: 0 Blocks: 1 IO Block: 4194304 directory 2024-03-12T16:08:05.081 INFO:teuthology.orchestra.run.smithi134.stdout:Device: 89h/137d Inode: 1 Links: 3 2024-03-12T16:08:05.081 INFO:teuthology.orchestra.run.smithi134.stdout:Access: (1777/drwxrwxrwt) Uid: ( 0/ root) Gid: ( 0/ root) 2024-03-12T16:08:05.081 INFO:teuthology.orchestra.run.smithi134.stdout:Context: system_u:object_r:fusefs_t:s0 2024-03-12T16:08:05.081 INFO:teuthology.orchestra.run.smithi134.stdout:Access: 1970-01-01 00:00:00.000000000 +0000 2024-03-12T16:08:05.081 INFO:teuthology.orchestra.run.smithi134.stdout:Modify: 2024-03-12 16:08:05.048963429 +0000 2024-03-12T16:08:05.081 INFO:teuthology.orchestra.run.smithi134.stdout:Change: 2024-03-12 16:08:05.048963429 +0000 2024-03-12T16:08:05.081 INFO:teuthology.orchestra.run.smithi134.stdout: Birth: - 2024-03-12T16:08:05.081 INFO:tasks.workunit:Did not need to create dir /home/ubuntu/cephtest/mnt.1 2024-03-12T16:08:05.081 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/mnt.1 && sudo install -d -m 0755 --owner=ubuntu -- client.1 2024-03-12T16:08:05.159 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/clone.client.0 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.0 && cd /home/ubuntu/cephtest/clone.client.0 && git checkout 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:08:05.160 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/clone.client.1 && git clone https://github.com/ceph/ceph-ci.git /home/ubuntu/cephtest/clone.client.1 && cd /home/ubuntu/cephtest/clone.client.1 && git checkout 49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:08:05.179 INFO:tasks.workunit.client.0.smithi006.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.0'... 2024-03-12T16:08:05.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:03.983873+0000 mgr.smithi006.kskdce (mgr.14196) 220 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 4.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-12T16:08:05.220 INFO:tasks.workunit.client.1.smithi134.stderr:Cloning into '/home/ubuntu/cephtest/clone.client.1'... 2024-03-12T16:08:05.426 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:03.983873+0000 mgr.smithi006.kskdce (mgr.14196) 220 : cluster [DBG] pgmap v193: 65 pgs: 65 active+clean; 4.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-12T16:08:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.101+0000 7f7bed03c700 1 -- 172.21.15.6:0/608504472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 msgr2=0x7f7be80f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.101+0000 7f7bed03c700 1 --2- 172.21.15.6:0/608504472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 0x7f7be80f7df0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f7bdc0047f0 tx=0x7f7bdc009cb0).stop 2024-03-12T16:08:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.101+0000 7f7bed03c700 1 -- 172.21.15.6:0/608504472 shutdown_connections 2024-03-12T16:08:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.101+0000 7f7bed03c700 1 --2- 172.21.15.6:0/608504472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 0x7f7be80f7df0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.101+0000 7f7bed03c700 1 --2- 172.21.15.6:0/608504472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be80f66f0 0x7f7be80f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.101+0000 7f7bed03c700 1 -- 172.21.15.6:0/608504472 >> 172.21.15.6:0/608504472 conn(0x7f7be80f1e50 msgr2=0x7f7be80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.101+0000 7f7bed03c700 1 -- 172.21.15.6:0/608504472 shutdown_connections 2024-03-12T16:08:07.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.101+0000 7f7bed03c700 1 -- 172.21.15.6:0/608504472 wait complete. 2024-03-12T16:08:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.101+0000 7f7bed03c700 1 Processor -- start 2024-03-12T16:08:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7bed03c700 1 -- start start 2024-03-12T16:08:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7bed03c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be80f66f0 0x7f7be8106e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7bed03c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 0x7f7be8107380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7bed03c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8107930 con 0x7f7be80f7990 2024-03-12T16:08:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7bed03c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7be8107a70 con 0x7f7be80f66f0 2024-03-12T16:08:07.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7be659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 0x7f7be8107380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7be659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 0x7f7be8107380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51412/0 (socket says 172.21.15.6:51412) 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7be659c700 1 -- 172.21.15.6:0/1862025638 learned_addr learned my addr 172.21.15.6:0/1862025638 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7be6d9d700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be80f66f0 0x7f7be8106e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7be659c700 1 -- 172.21.15.6:0/1862025638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be80f66f0 msgr2=0x7f7be8106e90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7be659c700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be80f66f0 0x7f7be8106e90 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.102+0000 7f7be659c700 1 -- 172.21.15.6:0/1862025638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7bdc005040 con 0x7f7be80f7990 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.103+0000 7f7be659c700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 0x7f7be8107380 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f7bdc013510 tx=0x7f7bdc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.103+0000 7f7bcffff700 1 -- 172.21.15.6:0/1862025638 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bdc00e030 con 0x7f7be80f7990 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.103+0000 7f7bcffff700 1 -- 172.21.15.6:0/1862025638 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f7bdc007e90 con 0x7f7be80f7990 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.103+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7be810c460 con 0x7f7be80f7990 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.103+0000 7f7bcffff700 1 -- 172.21.15.6:0/1862025638 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7bdc018070 con 0x7f7be80f7990 2024-03-12T16:08:07.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.103+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7be810c9a0 con 0x7f7be80f7990 2024-03-12T16:08:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.104+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7be80feeb0 con 0x7f7be80f7990 2024-03-12T16:08:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.104+0000 7f7bcffff700 1 -- 172.21.15.6:0/1862025638 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f7bdc01da20 con 0x7f7be80f7990 2024-03-12T16:08:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.105+0000 7f7bcffff700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7bd0061180 0x7f7bd0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.105+0000 7f7bcffff700 1 -- 172.21.15.6:0/1862025638 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f7bdc07dec0 con 0x7f7be80f7990 2024-03-12T16:08:07.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.105+0000 7f7be6d9d700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7bd0061180 0x7f7bd0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:07.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.105+0000 7f7be6d9d700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7bd0061180 0x7f7bd0063640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7be80f77f0 tx=0x7f7bd8009040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:07.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.109+0000 7f7bcffff700 1 -- 172.21.15.6:0/1862025638 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f7bdc051e50 con 0x7f7be80f7990 2024-03-12T16:08:07.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:05.984238+0000 mgr.smithi006.kskdce (mgr.14196) 221 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 5.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:08:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.283+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f7be8100d20 con 0x7f7be80f7990 2024-03-12T16:08:07.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.283+0000 7f7bcffff700 1 -- 172.21.15.6:0/1862025638 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v20)=0 v20) v1 ==== 155+0+0 (secure 0 0 0) 0x7f7bdc051a40 con 0x7f7be80f7990 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7bd0061180 msgr2=0x7f7bd0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7bd0061180 0x7f7bd0063640 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f7be80f77f0 tx=0x7f7bd8009040).stop 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 msgr2=0x7f7be8107380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 0x7f7be8107380 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f7bdc013510 tx=0x7f7bdc009cb0).stop 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 shutdown_connections 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7bd0061180 0x7f7bd0063640 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7be80f66f0 0x7f7be8106e90 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 --2- 172.21.15.6:0/1862025638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7be80f7990 0x7f7be8107380 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 >> 172.21.15.6:0/1862025638 conn(0x7f7be80f1e50 msgr2=0x7f7be80fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:07.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 shutdown_connections 2024-03-12T16:08:07.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:07.285+0000 7f7bed03c700 1 -- 172.21.15.6:0/1862025638 wait complete. 2024-03-12T16:08:07.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:05.984238+0000 mgr.smithi006.kskdce (mgr.14196) 221 : cluster [DBG] pgmap v194: 65 pgs: 65 active+clean; 5.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:08:08.083 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-03-12T16:08:09.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:07.984894+0000 mgr.smithi006.kskdce (mgr.14196) 222 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 5.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-12T16:08:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:07.984894+0000 mgr.smithi006.kskdce (mgr.14196) 222 : cluster [DBG] pgmap v195: 65 pgs: 65 active+clean; 5.3 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 682 B/s wr, 0 op/s 2024-03-12T16:08:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 -- 172.21.15.6:0/3535472970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f66f0 msgr2=0x7fa8d00f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 --2- 172.21.15.6:0/3535472970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f66f0 0x7fa8d00f6b10 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fa8c00047f0 tx=0x7fa8c0009cb0).stop 2024-03-12T16:08:10.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 -- 172.21.15.6:0/3535472970 shutdown_connections 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 --2- 172.21.15.6:0/3535472970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d00f7990 0x7fa8d00f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 --2- 172.21.15.6:0/3535472970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f66f0 0x7fa8d00f6b10 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 -- 172.21.15.6:0/3535472970 >> 172.21.15.6:0/3535472970 conn(0x7fa8d00f1e50 msgr2=0x7fa8d00f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 -- 172.21.15.6:0/3535472970 shutdown_connections 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 -- 172.21.15.6:0/3535472970 wait complete. 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 Processor -- start 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.242+0000 7fa8d6825700 1 -- start start 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8d6825700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d00f66f0 0x7fa8d00610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8d6825700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f7990 0x7fa8d010cd40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8d6825700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d010d230 con 0x7fa8d00f7990 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8d6825700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa8d010d370 con 0x7fa8d00f66f0 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f7990 0x7fa8d010cd40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f7990 0x7fa8d010cd40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51420/0 (socket says 172.21.15.6:51420) 2024-03-12T16:08:10.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cf7fe700 1 -- 172.21.15.6:0/88536634 learned_addr learned my addr 172.21.15.6:0/88536634 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cffff700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d00f66f0 0x7fa8d00610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cf7fe700 1 -- 172.21.15.6:0/88536634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d00f66f0 msgr2=0x7fa8d00610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cf7fe700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d00f66f0 0x7fa8d00610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cf7fe700 1 -- 172.21.15.6:0/88536634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa8c0005040 con 0x7fa8d00f7990 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cf7fe700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f7990 0x7fa8d010cd40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fa8c40041d0 tx=0x7fa8c4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cd7fa700 1 -- 172.21.15.6:0/88536634 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8c4007b40 con 0x7fa8d00f7990 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa8d010d600 con 0x7fa8d00f7990 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cd7fa700 1 -- 172.21.15.6:0/88536634 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7fa8c400f040 con 0x7fa8d00f7990 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8cd7fa700 1 -- 172.21.15.6:0/88536634 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa8c40146f0 con 0x7fa8d00f7990 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.243+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa8d010db40 con 0x7fa8d00f7990 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.244+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa8d00feeb0 con 0x7fa8d00f7990 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.245+0000 7fa8cd7fa700 1 -- 172.21.15.6:0/88536634 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fa8c4009110 con 0x7fa8d00f7990 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.245+0000 7fa8cd7fa700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa8b8061180 0x7fa8b8063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:10.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.245+0000 7fa8cd7fa700 1 -- 172.21.15.6:0/88536634 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fa8c407c850 con 0x7fa8d00f7990 2024-03-12T16:08:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.245+0000 7fa8cffff700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa8b8061180 0x7fa8b8063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.246+0000 7fa8cffff700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa8b8061180 0x7fa8b8063640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa8c0004f10 tx=0x7fa8c000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:10.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.249+0000 7fa8cd7fa700 1 -- 172.21.15.6:0/88536634 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa8c40507e0 con 0x7fa8d00f7990 2024-03-12T16:08:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.424+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7fa8d0059920 con 0x7fa8d00f7990 2024-03-12T16:08:10.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.424+0000 7fa8cd7fa700 1 -- 172.21.15.6:0/88536634 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v20)=0 v20) v1 ==== 163+0+0 (secure 0 0 0) 0x7fa8c40503d0 con 0x7fa8d00f7990 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa8b8061180 msgr2=0x7fa8b8063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa8b8061180 0x7fa8b8063640 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7fa8c0004f10 tx=0x7fa8c000b040).stop 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f7990 msgr2=0x7fa8d010cd40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f7990 0x7fa8d010cd40 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fa8c40041d0 tx=0x7fa8c4009f60).stop 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 shutdown_connections 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa8b8061180 0x7fa8b8063640 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa8d00f66f0 0x7fa8d00610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 --2- 172.21.15.6:0/88536634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa8d00f7990 0x7fa8d010cd40 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 >> 172.21.15.6:0/88536634 conn(0x7fa8d00f1e50 msgr2=0x7fa8d00fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 shutdown_connections 2024-03-12T16:08:10.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:10.426+0000 7fa8d6825700 1 -- 172.21.15.6:0/88536634 wait complete. 2024-03-12T16:08:11.120 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph config set global log_to_journald false --force' 2024-03-12T16:08:11.312 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:09.985370+0000 mgr.smithi006.kskdce (mgr.14196) 223 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-03-12T16:08:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:09.985370+0000 mgr.smithi006.kskdce (mgr.14196) 223 : cluster [DBG] pgmap v196: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 938 B/s wr, 0 op/s 2024-03-12T16:08:13.089 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:11.985804+0000 mgr.smithi006.kskdce (mgr.14196) 224 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-12T16:08:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.359+0000 7f99310c5700 1 -- 172.21.15.6:0/1066645224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f992c0f6710 msgr2=0x7f992c0f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.359+0000 7f99310c5700 1 --2- 172.21.15.6:0/1066645224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f992c0f6710 0x7f992c0f6b30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f991c0047f0 tx=0x7f991c009cb0).stop 2024-03-12T16:08:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.359+0000 7f99310c5700 1 -- 172.21.15.6:0/1066645224 shutdown_connections 2024-03-12T16:08:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.359+0000 7f99310c5700 1 --2- 172.21.15.6:0/1066645224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992c0f79b0 0x7f992c0f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.359+0000 7f99310c5700 1 --2- 172.21.15.6:0/1066645224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f992c0f6710 0x7f992c0f6b30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.359+0000 7f99310c5700 1 -- 172.21.15.6:0/1066645224 >> 172.21.15.6:0/1066645224 conn(0x7f992c0f1e50 msgr2=0x7f992c0f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.359+0000 7f99310c5700 1 -- 172.21.15.6:0/1066645224 shutdown_connections 2024-03-12T16:08:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.359+0000 7f99310c5700 1 -- 172.21.15.6:0/1066645224 wait complete. 2024-03-12T16:08:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.360+0000 7f99310c5700 1 Processor -- start 2024-03-12T16:08:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.360+0000 7f99310c5700 1 -- start start 2024-03-12T16:08:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.360+0000 7f99310c5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992c0f6710 0x7f992c106f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.360+0000 7f99310c5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f992c0f79b0 0x7f992c107470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.360+0000 7f99310c5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c107a20 con 0x7f992c0f79b0 2024-03-12T16:08:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.360+0000 7f99310c5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f992c107b60 con 0x7f992c0f6710 2024-03-12T16:08:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.360+0000 7f992ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992c0f6710 0x7f992c106f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.360+0000 7f992a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f992c0f79b0 0x7f992c107470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.360+0000 7f992ad9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992c0f6710 0x7f992c106f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:54116/0 (socket says 172.21.15.6:54116) 2024-03-12T16:08:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f992ad9d700 1 -- 172.21.15.6:0/639640596 learned_addr learned my addr 172.21.15.6:0/639640596 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:08:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f992ad9d700 1 -- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f992c0f79b0 msgr2=0x7f992c107470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:13.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f992ad9d700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f992c0f79b0 0x7f992c107470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f992ad9d700 1 -- 172.21.15.6:0/639640596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f991c005040 con 0x7f992c0f6710 2024-03-12T16:08:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f992a59c700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f992c0f79b0 0x7f992c107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:08:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f992ad9d700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992c0f6710 0x7f992c106f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f991c013580 tx=0x7f991c009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f9913fff700 1 -- 172.21.15.6:0/639640596 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f991c018070 con 0x7f992c0f6710 2024-03-12T16:08:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f992c060aa0 con 0x7f992c0f6710 2024-03-12T16:08:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f9913fff700 1 -- 172.21.15.6:0/639640596 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(25 keys) v1 ==== 1046+0+0 (secure 0 0 0) 0x7f991c007e90 con 0x7f992c0f6710 2024-03-12T16:08:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f9913fff700 1 -- 172.21.15.6:0/639640596 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f991c0123c0 con 0x7f992c0f6710 2024-03-12T16:08:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.361+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f992c061060 con 0x7f992c0f6710 2024-03-12T16:08:13.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.362+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f992c0feed0 con 0x7f992c0f6710 2024-03-12T16:08:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.363+0000 7f9913fff700 1 -- 172.21.15.6:0/639640596 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f991c012630 con 0x7f992c0f6710 2024-03-12T16:08:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.363+0000 7f9913fff700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9914061180 0x7f9914063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.363+0000 7f9913fff700 1 -- 172.21.15.6:0/639640596 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f991c07d470 con 0x7f992c0f6710 2024-03-12T16:08:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.363+0000 7f992a59c700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9914061180 0x7f9914063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:13.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.364+0000 7f992a59c700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9914061180 0x7f9914063640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f9920007bf0 tx=0x7f992000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:13.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.368+0000 7f9913fff700 1 -- 172.21.15.6:0/639640596 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f991c051400 con 0x7f992c0f6710 2024-03-12T16:08:13.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:11.985804+0000 mgr.smithi006.kskdce (mgr.14196) 224 : cluster [DBG] pgmap v197: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-12T16:08:13.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.542+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7f992c100ef0 con 0x7f992c0f6710 2024-03-12T16:08:13.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.547+0000 7f9913fff700 1 -- 172.21.15.6:0/639640596 <== mon.1 v2:172.21.15.134:3300/0 7 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f991c051400 con 0x7f992c0f6710 2024-03-12T16:08:13.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.548+0000 7f9913fff700 1 -- 172.21.15.6:0/639640596 <== mon.1 v2:172.21.15.134:3300/0 8 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v21)=0 v21) v1 ==== 135+0+0 (secure 0 0 0) 0x7f991c050ff0 con 0x7f992c0f6710 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9914061180 msgr2=0x7f9914063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9914061180 0x7f9914063640 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f9920007bf0 tx=0x7f992000b040).stop 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992c0f6710 msgr2=0x7f992c106f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992c0f6710 0x7f992c106f80 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f991c013580 tx=0x7f991c009cb0).stop 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 shutdown_connections 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f9914061180 0x7f9914063640 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f992c0f6710 0x7f992c106f80 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 --2- 172.21.15.6:0/639640596 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f992c0f79b0 0x7f992c107470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 >> 172.21.15.6:0/639640596 conn(0x7f992c0f1e50 msgr2=0x7f992c0fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 shutdown_connections 2024-03-12T16:08:13.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:13.551+0000 7f99310c5700 1 -- 172.21.15.6:0/639640596 wait complete. 2024-03-12T16:08:14.403 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-03-12T16:08:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:13.547810+0000 mon.smithi006 (mon.0) 584 : audit [INF] from='client.? ' entity='client.admin' 2024-03-12T16:08:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:13.567967+0000 mon.smithi006 (mon.0) 585 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:08:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:13.917318+0000 mon.smithi006 (mon.0) 586 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:08:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:13.918245+0000 mon.smithi006 (mon.0) 587 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:08:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:13.923113+0000 mon.smithi006 (mon.0) 588 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:14.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:13.986220+0000 mgr.smithi006.kskdce (mgr.14196) 225 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2024-03-12T16:08:14.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:13.547810+0000 mon.smithi006 (mon.0) 584 : audit [INF] from='client.? ' entity='client.admin' 2024-03-12T16:08:14.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:13.567967+0000 mon.smithi006 (mon.0) 585 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:08:14.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:13.917318+0000 mon.smithi006 (mon.0) 586 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:08:14.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:13.918245+0000 mon.smithi006 (mon.0) 587 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:08:14.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:13.923113+0000 mon.smithi006 (mon.0) 588 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:14.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:13.986220+0000 mgr.smithi006.kskdce (mgr.14196) 225 : cluster [DBG] pgmap v198: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 853 B/s wr, 1 op/s 2024-03-12T16:08:16.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 -- 172.21.15.6:0/1279764290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f8ab0 msgr2=0x7f57900f8f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 --2- 172.21.15.6:0/1279764290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f8ab0 0x7f57900f8f10 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f5780004730 tx=0x7f5780009cb0).stop 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 -- 172.21.15.6:0/1279764290 shutdown_connections 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 --2- 172.21.15.6:0/1279764290 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f8ab0 0x7f57900f8f10 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 --2- 172.21.15.6:0/1279764290 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57900f7810 0x7f57900f7c30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 -- 172.21.15.6:0/1279764290 >> 172.21.15.6:0/1279764290 conn(0x7f57900f2f50 msgr2=0x7f57900f5390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 -- 172.21.15.6:0/1279764290 shutdown_connections 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 -- 172.21.15.6:0/1279764290 wait complete. 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 Processor -- start 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.648+0000 7f579605f700 1 -- start start 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f579605f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f7810 0x7f579006c9d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f579605f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57900f8ab0 0x7f579006b030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f579605f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579006cf80 con 0x7f57900f7810 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f579605f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f579006b520 con 0x7f57900f8ab0 2024-03-12T16:08:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f7810 0x7f579006c9d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f7810 0x7f579006c9d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59002/0 (socket says 172.21.15.6:59002) 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578f7fe700 1 -- 172.21.15.6:0/1554229423 learned_addr learned my addr 172.21.15.6:0/1554229423 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578effd700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57900f8ab0 0x7f579006b030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578f7fe700 1 -- 172.21.15.6:0/1554229423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57900f8ab0 msgr2=0x7f579006b030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578f7fe700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57900f8ab0 0x7f579006b030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578f7fe700 1 -- 172.21.15.6:0/1554229423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5778005040 con 0x7f57900f7810 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578f7fe700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f7810 0x7f579006c9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f5778009350 tx=0x7f5778009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578cff9700 1 -- 172.21.15.6:0/1554229423 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f577800e630 con 0x7f57900f7810 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5780005040 con 0x7f57900f7810 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578cff9700 1 -- 172.21.15.6:0/1554229423 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f577800f040 con 0x7f57900f7810 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f578cff9700 1 -- 172.21.15.6:0/1554229423 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5778014b80 con 0x7f57900f7810 2024-03-12T16:08:16.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.649+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f579006bbd0 con 0x7f57900f7810 2024-03-12T16:08:16.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.651+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f579006bdf0 con 0x7f57900f7810 2024-03-12T16:08:16.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.651+0000 7f578cff9700 1 -- 172.21.15.6:0/1554229423 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f577800e790 con 0x7f57900f7810 2024-03-12T16:08:16.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.652+0000 7f578cff9700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f577c061180 0x7f577c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:16.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.652+0000 7f578cff9700 1 -- 172.21.15.6:0/1554229423 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f577807c480 con 0x7f57900f7810 2024-03-12T16:08:16.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.652+0000 7f578effd700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f577c061180 0x7f577c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:16.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.652+0000 7f578effd700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f577c061180 0x7f577c063640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5780005010 tx=0x7f578000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:16.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.656+0000 7f578cff9700 1 -- 172.21.15.6:0/1554229423 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f5778049f60 con 0x7f57900f7810 2024-03-12T16:08:16.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:16.852+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712", "daemon_types": "mgr", "target": ["mon-mgr", ""]}) v1 -- 0x7f57900591d0 con 0x7f577c061180 2024-03-12T16:08:17.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:15.986883+0000 mgr.smithi006.kskdce (mgr.14196) 226 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-12T16:08:17.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:15.986883+0000 mgr.smithi006.kskdce (mgr.14196) 226 : cluster [DBG] pgmap v199: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 0 op/s 2024-03-12T16:08:18.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:16.853534+0000 mgr.smithi006.kskdce (mgr.14196) 227 : audit [DBG] from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:18.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:16.853534+0000 mgr.smithi006.kskdce (mgr.14196) 227 : audit [DBG] from='client.14516 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:19.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:17.987285+0000 mgr.smithi006.kskdce (mgr.14196) 228 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-03-12T16:08:19.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:17.987285+0000 mgr.smithi006.kskdce (mgr.14196) 228 : cluster [DBG] pgmap v200: 65 pgs: 65 active+clean; 9.9 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 767 B/s wr, 1 op/s 2024-03-12T16:08:21.312 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:19.987664+0000 mgr.smithi006.kskdce (mgr.14196) 229 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-03-12T16:08:21.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:19.987664+0000 mgr.smithi006.kskdce (mgr.14196) 229 : cluster [DBG] pgmap v201: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1023 B/s wr, 0 op/s 2024-03-12T16:08:23.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:21.988024+0000 mgr.smithi006.kskdce (mgr.14196) 230 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-12T16:08:23.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:21.988024+0000 mgr.smithi006.kskdce (mgr.14196) 230 : cluster [DBG] pgmap v202: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-12T16:08:25.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:23.988399+0000 mgr.smithi006.kskdce (mgr.14196) 231 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-12T16:08:25.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:23.988399+0000 mgr.smithi006.kskdce (mgr.14196) 231 : cluster [DBG] pgmap v203: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 597 B/s wr, 0 op/s 2024-03-12T16:08:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:25.988851+0000 mgr.smithi006.kskdce (mgr.14196) 232 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:08:27.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:25.988851+0000 mgr.smithi006.kskdce (mgr.14196) 232 : cluster [DBG] pgmap v204: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:08:29.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:27.989245+0000 mgr.smithi006.kskdce (mgr.14196) 233 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:08:29.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:27.989245+0000 mgr.smithi006.kskdce (mgr.14196) 233 : cluster [DBG] pgmap v205: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:08:31.312 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:29.989614+0000 mgr.smithi006.kskdce (mgr.14196) 234 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-12T16:08:31.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:29.989614+0000 mgr.smithi006.kskdce (mgr.14196) 234 : cluster [DBG] pgmap v206: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-12T16:08:33.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:31.989968+0000 mgr.smithi006.kskdce (mgr.14196) 235 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:33.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:31.989968+0000 mgr.smithi006.kskdce (mgr.14196) 235 : cluster [DBG] pgmap v207: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:35.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:33.990330+0000 mgr.smithi006.kskdce (mgr.14196) 236 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:35.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:33.990330+0000 mgr.smithi006.kskdce (mgr.14196) 236 : cluster [DBG] pgmap v208: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:37.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:35.990709+0000 mgr.smithi006.kskdce (mgr.14196) 237 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:37.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:35.990709+0000 mgr.smithi006.kskdce (mgr.14196) 237 : cluster [DBG] pgmap v209: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:39.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:37.991153+0000 mgr.smithi006.kskdce (mgr.14196) 238 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:37.991153+0000 mgr.smithi006.kskdce (mgr.14196) 238 : cluster [DBG] pgmap v210: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:41.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:39.991520+0000 mgr.smithi006.kskdce (mgr.14196) 239 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:39.991520+0000 mgr.smithi006.kskdce (mgr.14196) 239 : cluster [DBG] pgmap v211: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:41.991950+0000 mgr.smithi006.kskdce (mgr.14196) 240 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:41.991950+0000 mgr.smithi006.kskdce (mgr.14196) 240 : cluster [DBG] pgmap v212: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:43.992343+0000 mgr.smithi006.kskdce (mgr.14196) 241 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:44.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:43.992343+0000 mgr.smithi006.kskdce (mgr.14196) 241 : cluster [DBG] pgmap v213: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:47.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:45.992763+0000 mgr.smithi006.kskdce (mgr.14196) 242 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:47.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:45.992763+0000 mgr.smithi006.kskdce (mgr.14196) 242 : cluster [DBG] pgmap v214: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:49.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:47.993215+0000 mgr.smithi006.kskdce (mgr.14196) 243 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:49.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.358+0000 7f578cff9700 1 -- 172.21.15.6:0/1554229423 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f57900591d0 con 0x7f577c061180 2024-03-12T16:08:49.360 INFO:teuthology.orchestra.run.smithi006.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:08:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.360+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f577c061180 msgr2=0x7f577c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.360+0000 7f579605f700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f577c061180 0x7f577c063640 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f5780005010 tx=0x7f578000b040).stop 2024-03-12T16:08:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.360+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f7810 msgr2=0x7f579006c9d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.360+0000 7f579605f700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f7810 0x7f579006c9d0 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f5778009350 tx=0x7f5778009cb0).stop 2024-03-12T16:08:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.360+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 shutdown_connections 2024-03-12T16:08:49.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.360+0000 7f579605f700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f577c061180 0x7f577c063640 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.360+0000 7f579605f700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f57900f7810 0x7f579006c9d0 secure :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0x7f5778009350 tx=0x7f5778009cb0).stop 2024-03-12T16:08:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.360+0000 7f579605f700 1 --2- 172.21.15.6:0/1554229423 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f57900f8ab0 0x7f579006b030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.360+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 >> 172.21.15.6:0/1554229423 conn(0x7f57900f2f50 msgr2=0x7f57900fc500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:49.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.362+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 shutdown_connections 2024-03-12T16:08:49.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:49.362+0000 7f579605f700 1 -- 172.21.15.6:0/1554229423 wait complete. 2024-03-12T16:08:49.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:47.993215+0000 mgr.smithi006.kskdce (mgr.14196) 243 : cluster [DBG] pgmap v215: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:50.032 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-03-12T16:08:50.360 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:08:49.354640+0000 mgr.smithi006.kskdce (mgr.14196) 244 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:08:50.360 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:49.359206+0000 mon.smithi006 (mon.0) 589 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:50.360 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:49.400892+0000 mon.smithi006 (mon.0) 590 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:08:50.360 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:49.402811+0000 mon.smithi006 (mon.0) 591 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:08:50.360 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:49.403490+0000 mon.smithi006 (mon.0) 592 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:08:50.360 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:49.413957+0000 mon.smithi006 (mon.0) 593 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:50.360 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:08:49.419944+0000 mgr.smithi006.kskdce (mgr.14196) 245 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:08:50.360 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:49.993675+0000 mgr.smithi006.kskdce (mgr.14196) 246 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:50.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:08:49.354640+0000 mgr.smithi006.kskdce (mgr.14196) 244 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:08:50.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:49.359206+0000 mon.smithi006 (mon.0) 589 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:50.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:49.400892+0000 mon.smithi006 (mon.0) 590 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:08:50.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:49.402811+0000 mon.smithi006 (mon.0) 591 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:08:50.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:49.403490+0000 mon.smithi006 (mon.0) 592 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:08:50.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:49.413957+0000 mon.smithi006 (mon.0) 593 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:50.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:08:49.419944+0000 mgr.smithi006.kskdce (mgr.14196) 245 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:08:50.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:49.993675+0000 mgr.smithi006.kskdce (mgr.14196) 246 : cluster [DBG] pgmap v216: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:53.050 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:51.994128+0000 mgr.smithi006.kskdce (mgr.14196) 247 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.413+0000 7fa771fd6700 1 -- 172.21.15.6:0/2731718094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f7800 msgr2=0x7fa76c0f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.413+0000 7fa771fd6700 1 --2- 172.21.15.6:0/2731718094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f7800 0x7fa76c0f7c20 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7fa75c004730 tx=0x7fa75c009cb0).stop 2024-03-12T16:08:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.413+0000 7fa771fd6700 1 -- 172.21.15.6:0/2731718094 shutdown_connections 2024-03-12T16:08:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.413+0000 7fa771fd6700 1 --2- 172.21.15.6:0/2731718094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa76c0f8aa0 0x7fa76c0f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.413+0000 7fa771fd6700 1 --2- 172.21.15.6:0/2731718094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f7800 0x7fa76c0f7c20 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.413+0000 7fa771fd6700 1 -- 172.21.15.6:0/2731718094 >> 172.21.15.6:0/2731718094 conn(0x7fa76c0f2f80 msgr2=0x7fa76c0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.413+0000 7fa771fd6700 1 -- 172.21.15.6:0/2731718094 shutdown_connections 2024-03-12T16:08:53.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.413+0000 7fa771fd6700 1 -- 172.21.15.6:0/2731718094 wait complete. 2024-03-12T16:08:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.414+0000 7fa771fd6700 1 Processor -- start 2024-03-12T16:08:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.414+0000 7fa771fd6700 1 -- start start 2024-03-12T16:08:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa771fd6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa76c0f7800 0x7fa76c10e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:53.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa771fd6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f8aa0 0x7fa76c10eb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa771fd6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c10f0d0 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa771fd6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa76c10f210 con 0x7fa76c0f7800 2024-03-12T16:08:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa76affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f8aa0 0x7fa76c10eb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa76affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f8aa0 0x7fa76c10eb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40020/0 (socket says 172.21.15.6:40020) 2024-03-12T16:08:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa76affd700 1 -- 172.21.15.6:0/62792703 learned_addr learned my addr 172.21.15.6:0/62792703 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:08:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa76b7fe700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa76c0f7800 0x7fa76c10e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa76affd700 1 -- 172.21.15.6:0/62792703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa76c0f7800 msgr2=0x7fa76c10e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa76affd700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa76c0f7800 0x7fa76c10e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:53.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.415+0000 7fa76affd700 1 -- 172.21.15.6:0/62792703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa760005040 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.416+0000 7fa76affd700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f8aa0 0x7fa76c10eb20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa760009380 tx=0x7fa760009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.416+0000 7fa768ff9700 1 -- 172.21.15.6:0/62792703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa76000e560 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.416+0000 7fa768ff9700 1 -- 172.21.15.6:0/62792703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa76000f040 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.416+0000 7fa768ff9700 1 -- 172.21.15.6:0/62792703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa760014b00 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.417+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa75c005040 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.417+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa76c062bc0 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.418+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa76c06c6f0 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.419+0000 7fa768ff9700 1 -- 172.21.15.6:0/62792703 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fa760014c60 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.420+0000 7fa768ff9700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa754061180 0x7fa754063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.420+0000 7fa76b7fe700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa754061180 0x7fa754063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.421+0000 7fa76b7fe700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa754061180 0x7fa754063640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa75c004700 tx=0x7fa75c016040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:53.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.424+0000 7fa768ff9700 1 -- 172.21.15.6:0/62792703 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fa760014410 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.428+0000 7fa768ff9700 1 -- 172.21.15.6:0/62792703 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fa760081060 con 0x7fa76c0f8aa0 2024-03-12T16:08:53.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:51.994128+0000 mgr.smithi006.kskdce (mgr.14196) 247 : cluster [DBG] pgmap v217: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:53.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.761+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa76c059120 con 0x7fa754061180 2024-03-12T16:08:53.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.763+0000 7fa768ff9700 1 -- 172.21.15.6:0/62792703 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fa76c059120 con 0x7fa754061180 2024-03-12T16:08:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.765+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa754061180 msgr2=0x7fa754063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.765+0000 7fa771fd6700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa754061180 0x7fa754063640 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fa75c004700 tx=0x7fa75c016040).stop 2024-03-12T16:08:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.765+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f8aa0 msgr2=0x7fa76c10eb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:53.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.765+0000 7fa771fd6700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f8aa0 0x7fa76c10eb20 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7fa760009380 tx=0x7fa760009cb0).stop 2024-03-12T16:08:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.766+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 shutdown_connections 2024-03-12T16:08:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.766+0000 7fa771fd6700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fa754061180 0x7fa754063640 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.766+0000 7fa771fd6700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa76c0f7800 0x7fa76c10e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.766+0000 7fa771fd6700 1 --2- 172.21.15.6:0/62792703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa76c0f8aa0 0x7fa76c10eb20 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.766+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 >> 172.21.15.6:0/62792703 conn(0x7fa76c0f2f80 msgr2=0x7fa76c0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.766+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 shutdown_connections 2024-03-12T16:08:53.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.766+0000 7fa771fd6700 1 -- 172.21.15.6:0/62792703 wait complete. 2024-03-12T16:08:53.780 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:08:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.881+0000 7f756643a700 1 -- 172.21.15.6:0/3743773040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600f7990 msgr2=0x7f75600f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.881+0000 7f756643a700 1 --2- 172.21.15.6:0/3743773040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600f7990 0x7f75600f7df0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f75540047f0 tx=0x7f7554009cb0).stop 2024-03-12T16:08:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.882+0000 7f756643a700 1 -- 172.21.15.6:0/3743773040 shutdown_connections 2024-03-12T16:08:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.882+0000 7f756643a700 1 --2- 172.21.15.6:0/3743773040 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600f7990 0x7f75600f7df0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.882+0000 7f756643a700 1 --2- 172.21.15.6:0/3743773040 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75600f66f0 0x7f75600f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.882+0000 7f756643a700 1 -- 172.21.15.6:0/3743773040 >> 172.21.15.6:0/3743773040 conn(0x7f75600f1e50 msgr2=0x7f75600f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.882+0000 7f756643a700 1 -- 172.21.15.6:0/3743773040 shutdown_connections 2024-03-12T16:08:53.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.882+0000 7f756643a700 1 -- 172.21.15.6:0/3743773040 wait complete. 2024-03-12T16:08:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.882+0000 7f756643a700 1 Processor -- start 2024-03-12T16:08:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.883+0000 7f756643a700 1 -- start start 2024-03-12T16:08:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.883+0000 7f756643a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600f66f0 0x7f756010a380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.883+0000 7f756643a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75600f7990 0x7f756010a870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.883+0000 7f756643a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756010ae20 con 0x7f75600f66f0 2024-03-12T16:08:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.883+0000 7f756643a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f756010af60 con 0x7f75600f7990 2024-03-12T16:08:53.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.883+0000 7f755ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600f66f0 0x7f756010a380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.883+0000 7f755ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600f66f0 0x7f756010a380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40044/0 (socket says 172.21.15.6:40044) 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.883+0000 7f755ffff700 1 -- 172.21.15.6:0/149113626 learned_addr learned my addr 172.21.15.6:0/149113626 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.883+0000 7f755f7fe700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75600f7990 0x7f756010a870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.884+0000 7f755f7fe700 1 -- 172.21.15.6:0/149113626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600f66f0 msgr2=0x7f756010a380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.884+0000 7f755f7fe700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600f66f0 0x7f756010a380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.884+0000 7f755f7fe700 1 -- 172.21.15.6:0/149113626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7554005040 con 0x7f75600f7990 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.884+0000 7f755f7fe700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75600f7990 0x7f756010a870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f75540117a0 tx=0x7f7554009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.884+0000 7f755d7fa700 1 -- 172.21.15.6:0/149113626 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755400e070 con 0x7f75600f7990 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.884+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f756010f9a0 con 0x7f75600f7990 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.884+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f756010ff30 con 0x7f75600f7990 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.884+0000 7f755d7fa700 1 -- 172.21.15.6:0/149113626 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f75540094c0 con 0x7f75600f7990 2024-03-12T16:08:53.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.884+0000 7f755d7fa700 1 -- 172.21.15.6:0/149113626 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f755400f410 con 0x7f75600f7990 2024-03-12T16:08:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.885+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f754c005150 con 0x7f75600f7990 2024-03-12T16:08:53.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.886+0000 7f755d7fa700 1 -- 172.21.15.6:0/149113626 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f7554018040 con 0x7f75600f7990 2024-03-12T16:08:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.887+0000 7f755d7fa700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f75480611d0 0x7f7548063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.887+0000 7f755d7fa700 1 -- 172.21.15.6:0/149113626 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f755407d280 con 0x7f75600f7990 2024-03-12T16:08:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.887+0000 7f755ffff700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f75480611d0 0x7f7548063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:53.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.888+0000 7f755ffff700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f75480611d0 0x7f7548063690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f75500041d0 tx=0x7f755000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:53.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:53.896+0000 7f755d7fa700 1 -- 172.21.15.6:0/149113626 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f75540511d0 con 0x7f75600f7990 2024-03-12T16:08:54.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.084+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f754c000bf0 con 0x7f75480611d0 2024-03-12T16:08:54.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.086+0000 7f755d7fa700 1 -- 172.21.15.6:0/149113626 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f754c000bf0 con 0x7f75480611d0 2024-03-12T16:08:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f75480611d0 msgr2=0x7f7548063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f75480611d0 0x7f7548063690 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f75500041d0 tx=0x7f755000b040).stop 2024-03-12T16:08:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75600f7990 msgr2=0x7f756010a870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75600f7990 0x7f756010a870 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f75540117a0 tx=0x7f7554009cb0).stop 2024-03-12T16:08:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 shutdown_connections 2024-03-12T16:08:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f75480611d0 0x7f7548063690 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f75600f66f0 0x7f756010a380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 --2- 172.21.15.6:0/149113626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f75600f7990 0x7f756010a870 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 >> 172.21.15.6:0/149113626 conn(0x7f75600f1e50 msgr2=0x7f75600fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:54.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 shutdown_connections 2024-03-12T16:08:54.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.088+0000 7f756643a700 1 -- 172.21.15.6:0/149113626 wait complete. 2024-03-12T16:08:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.202+0000 7f6be72d4700 1 -- 172.21.15.6:0/1836737317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 msgr2=0x7f6be00f8c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.204 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.202+0000 7f6be72d4700 1 --2- 172.21.15.6:0/1836737317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 0x7f6be00f8c50 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f6bd00047f0 tx=0x7f6bd0009cb0).stop 2024-03-12T16:08:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.202+0000 7f6be72d4700 1 -- 172.21.15.6:0/1836737317 shutdown_connections 2024-03-12T16:08:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.202+0000 7f6be72d4700 1 --2- 172.21.15.6:0/1836737317 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 0x7f6be00f8c50 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.202+0000 7f6be72d4700 1 --2- 172.21.15.6:0/1836737317 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be00f5b30 0x7f6be00f5f50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.202+0000 7f6be72d4700 1 -- 172.21.15.6:0/1836737317 >> 172.21.15.6:0/1836737317 conn(0x7f6be00f1670 msgr2=0x7f6be00f3a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.202+0000 7f6be72d4700 1 -- 172.21.15.6:0/1836737317 shutdown_connections 2024-03-12T16:08:54.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.203+0000 7f6be72d4700 1 -- 172.21.15.6:0/1836737317 wait complete. 2024-03-12T16:08:54.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.203+0000 7f6be72d4700 1 Processor -- start 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.203+0000 7f6be72d4700 1 -- start start 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.203+0000 7f6be72d4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be00f5b30 0x7f6be00f8500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.203+0000 7f6be72d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 0x7f6be00f6b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.203+0000 7f6be72d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00f8ab0 con 0x7f6be00f64d0 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.203+0000 7f6be72d4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be00f7050 con 0x7f6be00f5b30 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.204+0000 7f6be486f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 0x7f6be00f6b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.204+0000 7f6be486f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 0x7f6be00f6b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40064/0 (socket says 172.21.15.6:40064) 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.204+0000 7f6be486f700 1 -- 172.21.15.6:0/1858316495 learned_addr learned my addr 172.21.15.6:0/1858316495 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.204+0000 7f6be486f700 1 -- 172.21.15.6:0/1858316495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be00f5b30 msgr2=0x7f6be00f8500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.204+0000 7f6be486f700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be00f5b30 0x7f6be00f8500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.204+0000 7f6be486f700 1 -- 172.21.15.6:0/1858316495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd0005040 con 0x7f6be00f64d0 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.204+0000 7f6be486f700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 0x7f6be00f6b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f6bd0013560 tx=0x7f6bd0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.204+0000 7f6bd6777700 1 -- 172.21.15.6:0/1858316495 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd0018070 con 0x7f6be00f64d0 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.204+0000 7f6bd6777700 1 -- 172.21.15.6:0/1858316495 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bd0007e90 con 0x7f6be00f64d0 2024-03-12T16:08:54.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.205+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be00f7270 con 0x7f6be00f64d0 2024-03-12T16:08:54.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.205+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be00f77d0 con 0x7f6be00f64d0 2024-03-12T16:08:54.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.205+0000 7f6bd6777700 1 -- 172.21.15.6:0/1858316495 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bd001c5e0 con 0x7f6be00f64d0 2024-03-12T16:08:54.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.206+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be00fffe0 con 0x7f6be00f64d0 2024-03-12T16:08:54.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.207+0000 7f6bd6777700 1 -- 172.21.15.6:0/1858316495 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f6bd001c740 con 0x7f6be00f64d0 2024-03-12T16:08:54.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.207+0000 7f6bd6777700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6bcc0611c0 0x7f6bcc063680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:54.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.207+0000 7f6bd6777700 1 -- 172.21.15.6:0/1858316495 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f6bd007d600 con 0x7f6be00f64d0 2024-03-12T16:08:54.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.208+0000 7f6be5070700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6bcc0611c0 0x7f6bcc063680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:54.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.208+0000 7f6be5070700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6bcc0611c0 0x7f6bcc063680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f6be00608e0 tx=0x7f6bdc00b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:54.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.216+0000 7f6bd6777700 1 -- 172.21.15.6:0/1858316495 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f6bd0051610 con 0x7f6be00f64d0 2024-03-12T16:08:54.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.416+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6be0059120 con 0x7f6bcc0611c0 2024-03-12T16:08:54.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.426+0000 7f6bd6777700 1 -- 172.21.15.6:0/1858316495 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3344 (secure 0 0 0) 0x7f6be0059120 con 0x7f6bcc0611c0 2024-03-12T16:08:54.432 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:08:54.432 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (4m) 64s ago 6m 24.1M - 0.23.0 ba2b418f427c 869c486ed5f2 2024-03-12T16:08:54.432 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (6m) 64s ago 6m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:08:54.433 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (6m) 70s ago 6m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:08:54.433 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (4m) 64s ago 6m 51.7M - 8.3.5 dad864ee21e9 7deda4319993 2024-03-12T16:08:54.433 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (90s) 64s ago 89s 15.0M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:08:54.434 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (84s) 64s ago 83s 11.7M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:08:54.434 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (87s) 70s ago 86s 14.4M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:08:54.434 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (81s) 70s ago 80s 14.4M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:08:54.435 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:9283 running (8m) 64s ago 8m 434M - 16.2.15-1-g8963e9de 727f386679cb f09ce35a51f8 2024-03-12T16:08:54.435 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283 running (6m) 70s ago 6m 388M - 16.2.15-1-g8963e9de 727f386679cb d5c56441431d 2024-03-12T16:08:54.435 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (8m) 64s ago 8m 62.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:08:54.435 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (5m) 70s ago 5m 60.9M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:08:54.435 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (6m) 64s ago 6m 21.6M - 1.3.1 1dbe0e931976 ef9d95e31974 2024-03-12T16:08:54.435 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 70s ago 5m 22.1M - 1.3.1 1dbe0e931976 ee7621f16bde 2024-03-12T16:08:54.436 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (5m) 64s ago 5m 43.5M 4642M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:08:54.436 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (5m) 64s ago 4m 41.3M 4642M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:08:54.437 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (4m) 64s ago 4m 38.8M 4642M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:08:54.437 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (3m) 70s ago 3m 41.3M 4982M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:08:54.437 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (3m) 70s ago 3m 39.6M 4982M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:08:54.437 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (3m) 70s ago 3m 39.2M 4982M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:08:54.437 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 70s ago 4m 61.7M - 2.33.4 514e6a882f6e 344ddc812ba0 2024-03-12T16:08:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6bcc0611c0 msgr2=0x7f6bcc063680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6bcc0611c0 0x7f6bcc063680 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f6be00608e0 tx=0x7f6bdc00b040).stop 2024-03-12T16:08:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 msgr2=0x7f6be00f6b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 0x7f6be00f6b60 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f6bd0013560 tx=0x7f6bd0009cb0).stop 2024-03-12T16:08:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 shutdown_connections 2024-03-12T16:08:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6bcc0611c0 0x7f6bcc063680 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be00f5b30 0x7f6be00f8500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:08:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 --2- 172.21.15.6:0/1858316495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be00f64d0 0x7f6be00f6b60 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 >> 172.21.15.6:0/1858316495 conn(0x7f6be00f1670 msgr2=0x7f6be00fc6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:54.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.428+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 shutdown_connections 2024-03-12T16:08:54.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.429+0000 7f6be72d4700 1 -- 172.21.15.6:0/1858316495 wait complete. 2024-03-12T16:08:54.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:53.151506+0000 mon.smithi006 (mon.0) 594 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:54.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:08:53.151879+0000 mgr.smithi006.kskdce (mgr.14196) 248 : cephadm [INF] Upgrade: Target is version 18.2.2-797-g49e4a679 (unknown) 2024-03-12T16:08:54.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:08:53.151965+0000 mgr.smithi006.kskdce (mgr.14196) 249 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846, digests ['quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846'] 2024-03-12T16:08:54.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:53.153004+0000 mon.smithi006 (mon.0) 595 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:08:54.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:53.159730+0000 mon.smithi006 (mon.0) 596 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:54.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:08:53.160727+0000 mgr.smithi006.kskdce (mgr.14196) 250 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi006.kskdce) 2024-03-12T16:08:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:53.151506+0000 mon.smithi006 (mon.0) 594 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:08:53.151879+0000 mgr.smithi006.kskdce (mgr.14196) 248 : cephadm [INF] Upgrade: Target is version 18.2.2-797-g49e4a679 (unknown) 2024-03-12T16:08:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:08:53.151965+0000 mgr.smithi006.kskdce (mgr.14196) 249 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846, digests ['quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846'] 2024-03-12T16:08:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:53.153004+0000 mon.smithi006 (mon.0) 595 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:08:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:53.159730+0000 mon.smithi006 (mon.0) 596 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:08:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:08:53.160727+0000 mgr.smithi006.kskdce (mgr.14196) 250 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi006.kskdce) 2024-03-12T16:08:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.539+0000 7fbc89c43700 1 -- 172.21.15.6:0/3396919200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f58f0 msgr2=0x7fbc840f5d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.539+0000 7fbc89c43700 1 --2- 172.21.15.6:0/3396919200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f58f0 0x7fbc840f5d70 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7fbc780047f0 tx=0x7fbc78009cb0).stop 2024-03-12T16:08:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.539+0000 7fbc89c43700 1 -- 172.21.15.6:0/3396919200 shutdown_connections 2024-03-12T16:08:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.539+0000 7fbc89c43700 1 --2- 172.21.15.6:0/3396919200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f58f0 0x7fbc840f5d70 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.539+0000 7fbc89c43700 1 --2- 172.21.15.6:0/3396919200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc840f6ba0 0x7fbc840f6fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.539+0000 7fbc89c43700 1 -- 172.21.15.6:0/3396919200 >> 172.21.15.6:0/3396919200 conn(0x7fbc840f1610 msgr2=0x7fbc840f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.539+0000 7fbc89c43700 1 -- 172.21.15.6:0/3396919200 shutdown_connections 2024-03-12T16:08:54.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.539+0000 7fbc89c43700 1 -- 172.21.15.6:0/3396919200 wait complete. 2024-03-12T16:08:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc89c43700 1 Processor -- start 2024-03-12T16:08:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc89c43700 1 -- start start 2024-03-12T16:08:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc89c43700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc840f58f0 0x7fbc8410e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc89c43700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f6ba0 0x7fbc8410ebc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc89c43700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8410f170 con 0x7fbc840f6ba0 2024-03-12T16:08:54.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc89c43700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbc8410f2b0 con 0x7fbc840f58f0 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f6ba0 0x7fbc8410ebc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc837fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc840f58f0 0x7fbc8410e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc82ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f6ba0 0x7fbc8410ebc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40078/0 (socket says 172.21.15.6:40078) 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.540+0000 7fbc82ffd700 1 -- 172.21.15.6:0/2689540054 learned_addr learned my addr 172.21.15.6:0/2689540054 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.541+0000 7fbc82ffd700 1 -- 172.21.15.6:0/2689540054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc840f58f0 msgr2=0x7fbc8410e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.541+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc840f58f0 0x7fbc8410e6d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.541+0000 7fbc82ffd700 1 -- 172.21.15.6:0/2689540054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbc78005040 con 0x7fbc840f6ba0 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.541+0000 7fbc837fe700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc840f58f0 0x7fbc8410e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.541+0000 7fbc82ffd700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f6ba0 0x7fbc8410ebc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fbc78009380 tx=0x7fbc78009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.541+0000 7fbc80ff9700 1 -- 172.21.15.6:0/2689540054 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc78018070 con 0x7fbc840f6ba0 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.541+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbc84113cf0 con 0x7fbc840f6ba0 2024-03-12T16:08:54.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.541+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbc84114250 con 0x7fbc840f6ba0 2024-03-12T16:08:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.542+0000 7fbc80ff9700 1 -- 172.21.15.6:0/2689540054 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbc78007e90 con 0x7fbc840f6ba0 2024-03-12T16:08:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.542+0000 7fbc80ff9700 1 -- 172.21.15.6:0/2689540054 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbc78012ec0 con 0x7fbc840f6ba0 2024-03-12T16:08:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.542+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbc84106600 con 0x7fbc840f6ba0 2024-03-12T16:08:54.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.544+0000 7fbc80ff9700 1 -- 172.21.15.6:0/2689540054 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fbc780263f0 con 0x7fbc840f6ba0 2024-03-12T16:08:54.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.544+0000 7fbc80ff9700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc6c061180 0x7fbc6c063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:54.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.544+0000 7fbc80ff9700 1 -- 172.21.15.6:0/2689540054 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fbc7807d630 con 0x7fbc840f6ba0 2024-03-12T16:08:54.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.544+0000 7fbc837fe700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc6c061180 0x7fbc6c063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:54.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.545+0000 7fbc837fe700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc6c061180 0x7fbc6c063640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fbc74007bf0 tx=0x7fbc7400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:54.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.552+0000 7fbc80ff9700 1 -- 172.21.15.6:0/2689540054 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fbc78051580 con 0x7fbc840f6ba0 2024-03-12T16:08:54.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.797+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbc84059990 con 0x7fbc840f6ba0 2024-03-12T16:08:54.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.797+0000 7fbc80ff9700 1 -- 172.21.15.6:0/2689540054 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fbc78051170 con 0x7fbc840f6ba0 2024-03-12T16:08:54.799 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:08:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:08:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 14 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:08:54.800 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:08:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc6c061180 msgr2=0x7fbc6c063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc6c061180 0x7fbc6c063640 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7fbc74007bf0 tx=0x7fbc7400b040).stop 2024-03-12T16:08:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f6ba0 msgr2=0x7fbc8410ebc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f6ba0 0x7fbc8410ebc0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7fbc78009380 tx=0x7fbc78009cb0).stop 2024-03-12T16:08:54.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 shutdown_connections 2024-03-12T16:08:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fbc6c061180 0x7fbc6c063640 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbc840f58f0 0x7fbc8410e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 --2- 172.21.15.6:0/2689540054 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbc840f6ba0 0x7fbc8410ebc0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 >> 172.21.15.6:0/2689540054 conn(0x7fbc840f1610 msgr2=0x7fbc840fa350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 shutdown_connections 2024-03-12T16:08:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.799+0000 7fbc89c43700 1 -- 172.21.15.6:0/2689540054 wait complete. 2024-03-12T16:08:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.913+0000 7fec34e31700 1 -- 172.21.15.6:0/145996699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec300f7990 msgr2=0x7fec300f7df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.913+0000 7fec34e31700 1 --2- 172.21.15.6:0/145996699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec300f7990 0x7fec300f7df0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fec240047f0 tx=0x7fec24009cb0).stop 2024-03-12T16:08:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.914+0000 7fec34e31700 1 -- 172.21.15.6:0/145996699 shutdown_connections 2024-03-12T16:08:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.914+0000 7fec34e31700 1 --2- 172.21.15.6:0/145996699 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec300f7990 0x7fec300f7df0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.914+0000 7fec34e31700 1 --2- 172.21.15.6:0/145996699 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec300f66f0 0x7fec300f6b10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.914+0000 7fec34e31700 1 -- 172.21.15.6:0/145996699 >> 172.21.15.6:0/145996699 conn(0x7fec300f1e50 msgr2=0x7fec300f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.914+0000 7fec34e31700 1 -- 172.21.15.6:0/145996699 shutdown_connections 2024-03-12T16:08:54.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.914+0000 7fec34e31700 1 -- 172.21.15.6:0/145996699 wait complete. 2024-03-12T16:08:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec34e31700 1 Processor -- start 2024-03-12T16:08:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec34e31700 1 -- start start 2024-03-12T16:08:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec34e31700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec300f66f0 0x7fec300610a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec34e31700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec300f7990 0x7fec3010ac00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec34e31700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3010b0f0 con 0x7fec300f7990 2024-03-12T16:08:54.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec34e31700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fec3010b230 con 0x7fec300f66f0 2024-03-12T16:08:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec2e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec300f66f0 0x7fec300610a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec2e59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec300f66f0 0x7fec300610a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:41784/0 (socket says 172.21.15.6:41784) 2024-03-12T16:08:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec2e59c700 1 -- 172.21.15.6:0/3125987366 learned_addr learned my addr 172.21.15.6:0/3125987366 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:08:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.915+0000 7fec2dd9b700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec300f7990 0x7fec3010ac00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec2dd9b700 1 -- 172.21.15.6:0/3125987366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec300f66f0 msgr2=0x7fec300610a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec2dd9b700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec300f66f0 0x7fec300610a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec2dd9b700 1 -- 172.21.15.6:0/3125987366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fec24005040 con 0x7fec300f7990 2024-03-12T16:08:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec2e59c700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec300f66f0 0x7fec300610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:08:54.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec2dd9b700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec300f7990 0x7fec3010ac00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fec24013560 tx=0x7fec24009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec1f7fe700 1 -- 172.21.15.6:0/3125987366 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec24018070 con 0x7fec300f7990 2024-03-12T16:08:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fec3010b460 con 0x7fec300f7990 2024-03-12T16:08:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec1f7fe700 1 -- 172.21.15.6:0/3125987366 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fec24007e90 con 0x7fec300f7990 2024-03-12T16:08:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec1f7fe700 1 -- 172.21.15.6:0/3125987366 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fec24012620 con 0x7fec300f7990 2024-03-12T16:08:54.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.916+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fec3010b9c0 con 0x7fec300f7990 2024-03-12T16:08:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.918+0000 7fec1f7fe700 1 -- 172.21.15.6:0/3125987366 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fec2401d420 con 0x7fec300f7990 2024-03-12T16:08:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.918+0000 7fec1f7fe700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fec180611d0 0x7fec18063690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:08:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.919+0000 7fec1f7fe700 1 -- 172.21.15.6:0/3125987366 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fec2407d710 con 0x7fec300f7990 2024-03-12T16:08:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.919+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fec300feeb0 con 0x7fec300f7990 2024-03-12T16:08:54.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.920+0000 7fec2e59c700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fec180611d0 0x7fec18063690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:08:54.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.927+0000 7fec1f7fe700 1 -- 172.21.15.6:0/3125987366 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fec240515e0 con 0x7fec300f7990 2024-03-12T16:08:54.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:54.928+0000 7fec2e59c700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fec180611d0 0x7fec18063690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fec200041d0 tx=0x7fec2000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:08:55.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.118+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fec30059120 con 0x7fec180611d0 2024-03-12T16:08:55.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.120+0000 7fec1f7fe700 1 -- 172.21.15.6:0/3125987366 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7fec30059120 con 0x7fec180611d0 2024-03-12T16:08:55.122 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:08:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:08:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:08:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-12T16:08:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [], 2024-03-12T16:08:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "0/2 daemons upgraded", 2024-03-12T16:08:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Pulling quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846 image on host smithi134", 2024-03-12T16:08:55.122 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:08:55.122 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:08:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.122+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fec180611d0 msgr2=0x7fec18063690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.122+0000 7fec34e31700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fec180611d0 0x7fec18063690 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7fec200041d0 tx=0x7fec2000b040).stop 2024-03-12T16:08:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.122+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec300f7990 msgr2=0x7fec3010ac00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:08:55.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.122+0000 7fec34e31700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec300f7990 0x7fec3010ac00 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fec24013560 tx=0x7fec24009cb0).stop 2024-03-12T16:08:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.123+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 shutdown_connections 2024-03-12T16:08:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.123+0000 7fec34e31700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fec180611d0 0x7fec18063690 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.123+0000 7fec34e31700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fec300f66f0 0x7fec300610a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.123+0000 7fec34e31700 1 --2- 172.21.15.6:0/3125987366 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fec300f7990 0x7fec3010ac00 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:08:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.123+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 >> 172.21.15.6:0/3125987366 conn(0x7fec300f1e50 msgr2=0x7fec300fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:08:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.123+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 shutdown_connections 2024-03-12T16:08:55.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:08:55.123+0000 7fec34e31700 1 -- 172.21.15.6:0/3125987366 wait complete. 2024-03-12T16:08:55.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:08:53.509409+0000 mgr.smithi006.kskdce (mgr.14196) 251 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846 on smithi134 2024-03-12T16:08:55.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:53.764230+0000 mgr.smithi006.kskdce (mgr.14196) 252 : audit [DBG] from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:55.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:53.994623+0000 mgr.smithi006.kskdce (mgr.14196) 253 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:55.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:54.087013+0000 mgr.smithi006.kskdce (mgr.14196) 254 : audit [DBG] from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:55.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:54.798752+0000 mon.smithi006 (mon.0) 597 : audit [DBG] from='client.? 172.21.15.6:0/2689540054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:08:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:08:53.509409+0000 mgr.smithi006.kskdce (mgr.14196) 251 : cephadm [INF] Upgrade: Pulling quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846 on smithi134 2024-03-12T16:08:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:53.764230+0000 mgr.smithi006.kskdce (mgr.14196) 252 : audit [DBG] from='client.14520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:53.994623+0000 mgr.smithi006.kskdce (mgr.14196) 253 : cluster [DBG] pgmap v218: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:54.087013+0000 mgr.smithi006.kskdce (mgr.14196) 254 : audit [DBG] from='client.24349 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:54.798752+0000 mon.smithi006 (mon.0) 597 : audit [DBG] from='client.? 172.21.15.6:0/2689540054' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:08:56.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:56 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:54.418933+0000 mgr.smithi006.kskdce (mgr.14196) 255 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:56.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:56 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:08:55.121135+0000 mgr.smithi006.kskdce (mgr.14196) 256 : audit [DBG] from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:54.418933+0000 mgr.smithi006.kskdce (mgr.14196) 255 : audit [DBG] from='client.14528 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:08:55.121135+0000 mgr.smithi006.kskdce (mgr.14196) 256 : audit [DBG] from='client.14536 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:08:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:55.995059+0000 mgr.smithi006.kskdce (mgr.14196) 257 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:55.995059+0000 mgr.smithi006.kskdce (mgr.14196) 257 : cluster [DBG] pgmap v219: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:08:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:57.995531+0000 mgr.smithi006.kskdce (mgr.14196) 258 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:08:59.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:08:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:57.995531+0000 mgr.smithi006.kskdce (mgr.14196) 258 : cluster [DBG] pgmap v220: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:01.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:08:59.995973+0000 mgr.smithi006.kskdce (mgr.14196) 259 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:01.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:08:59.995973+0000 mgr.smithi006.kskdce (mgr.14196) 259 : cluster [DBG] pgmap v221: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:03.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:01.996407+0000 mgr.smithi006.kskdce (mgr.14196) 260 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:03.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:01.996407+0000 mgr.smithi006.kskdce (mgr.14196) 260 : cluster [DBG] pgmap v222: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:05.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:03.996867+0000 mgr.smithi006.kskdce (mgr.14196) 261 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:05.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:03.996867+0000 mgr.smithi006.kskdce (mgr.14196) 261 : cluster [DBG] pgmap v223: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:07.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:05.997301+0000 mgr.smithi006.kskdce (mgr.14196) 262 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:07.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:05.997301+0000 mgr.smithi006.kskdce (mgr.14196) 262 : cluster [DBG] pgmap v224: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:07.997759+0000 mgr.smithi006.kskdce (mgr.14196) 263 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:09.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:07.997759+0000 mgr.smithi006.kskdce (mgr.14196) 263 : cluster [DBG] pgmap v225: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:09.998204+0000 mgr.smithi006.kskdce (mgr.14196) 264 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:09.998204+0000 mgr.smithi006.kskdce (mgr.14196) 264 : cluster [DBG] pgmap v226: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:13.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:11.998591+0000 mgr.smithi006.kskdce (mgr.14196) 265 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:11.998591+0000 mgr.smithi006.kskdce (mgr.14196) 265 : cluster [DBG] pgmap v227: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:15.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:13.999156+0000 mgr.smithi006.kskdce (mgr.14196) 266 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:15.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:13.999156+0000 mgr.smithi006.kskdce (mgr.14196) 266 : cluster [DBG] pgmap v228: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:16.127 INFO:tasks.workunit.client.0.smithi006.stderr:Updating files: 95% (11510/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-03-12T16:09:16.527 INFO:tasks.workunit.client.0.smithi006.stderr:Note: switching to '49e4a6794d5502bd66908faf714fc54896c51712'. 2024-03-12T16:09:16.527 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-03-12T16:09:16.527 INFO:tasks.workunit.client.0.smithi006.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-12T16:09:16.527 INFO:tasks.workunit.client.0.smithi006.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-12T16:09:16.527 INFO:tasks.workunit.client.0.smithi006.stderr:state without impacting any branches by switching back to a branch. 2024-03-12T16:09:16.527 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-03-12T16:09:16.527 INFO:tasks.workunit.client.0.smithi006.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-12T16:09:16.527 INFO:tasks.workunit.client.0.smithi006.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr: git switch -c 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr:Or undo this operation with: 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr: git switch - 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr: 2024-03-12T16:09:16.528 INFO:tasks.workunit.client.0.smithi006.stderr:HEAD is now at 49e4a6794d5 Merge branch 'wip-64743-reef' of https://github.com/joscollin/ceph into wip-yuri11-testing-2024-03-11-0838-reef 2024-03-12T16:09:16.533 DEBUG:teuthology.orchestra.run.smithi006:> cd -- /home/ubuntu/cephtest/clone.client.0/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.0 2024-03-12T16:09:16.621 INFO:tasks.workunit.client.0.smithi006.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-12T16:09:16.623 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-12T16:09:16.623 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-12T16:09:17.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:15.999556+0000 mgr.smithi006.kskdce (mgr.14196) 267 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:17.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:15.999556+0000 mgr.smithi006.kskdce (mgr.14196) 267 : cluster [DBG] pgmap v229: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:19.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:17.999942+0000 mgr.smithi006.kskdce (mgr.14196) 268 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:19.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:17.999942+0000 mgr.smithi006.kskdce (mgr.14196) 268 : cluster [DBG] pgmap v230: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:20.889 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-12T16:09:21.015 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-12T16:09:21.080 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/direct_io' 2024-03-12T16:09:21.082 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-12T16:09:21.082 INFO:tasks.workunit.client.0.smithi006.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-12T16:09:21.171 INFO:tasks.workunit.client.0.smithi006.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.0/qa/workunits/fs' 2024-03-12T16:09:21.175 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:09:21.175 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/home/ubuntu/cephtest/workunits.list.client.0 of=/dev/stdout 2024-03-12T16:09:21.194 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.0... 2024-03-12T16:09:21.195 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-12T16:09:21.196 DEBUG:teuthology.orchestra.run.smithi006:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && cd -- /home/ubuntu/cephtest/mnt.0/client.0/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=49e4a6794d5502bd66908faf714fc54896c51712 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="0" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.0 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.0 CEPH_MNT=/home/ubuntu/cephtest/mnt.0 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.0/qa/workunits/suites/fsstress.sh 2024-03-12T16:09:21.265 INFO:tasks.workunit.client.0.smithi006.stderr:+ mkdir -p fsstress 2024-03-12T16:09:21.267 INFO:tasks.workunit.client.0.smithi006.stderr:+ pushd fsstress 2024-03-12T16:09:21.268 INFO:tasks.workunit.client.0.smithi006.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-12T16:09:21.268 INFO:tasks.workunit.client.0.smithi006.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-12T16:09:21.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:20.000516+0000 mgr.smithi006.kskdce (mgr.14196) 269 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:21.706 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:20.000516+0000 mgr.smithi006.kskdce (mgr.14196) 269 : cluster [DBG] pgmap v231: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:21.734 INFO:tasks.workunit.client.1.smithi134.stderr:Updating files: 91% (11080/12088) Updating files: 92% (11121/12088) Updating files: 93% (11242/12088) Updating files: 94% (11363/12088) Updating files: 95% (11484/12088) Updating files: 96% (11605/12088) Updating files: 97% (11726/12088) Updating files: 98% (11847/12088) Updating files: 99% (11968/12088) Updating files: 100% (12088/12088) Updating files: 100% (12088/12088), done. 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr:Note: switching to '49e4a6794d5502bd66908faf714fc54896c51712'. 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr:You are in 'detached HEAD' state. You can look around, make experimental 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr:changes and commit them, and you can discard any commits you make in this 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr:state without impacting any branches by switching back to a branch. 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr:If you want to create a new branch to retain commits you create, you may 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr:do so (now or later) by using -c with the switch command. Example: 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-03-12T16:09:22.496 INFO:tasks.workunit.client.1.smithi134.stderr: git switch -c 2024-03-12T16:09:22.497 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-03-12T16:09:22.497 INFO:tasks.workunit.client.1.smithi134.stderr:Or undo this operation with: 2024-03-12T16:09:22.497 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-03-12T16:09:22.497 INFO:tasks.workunit.client.1.smithi134.stderr: git switch - 2024-03-12T16:09:22.497 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-03-12T16:09:22.497 INFO:tasks.workunit.client.1.smithi134.stderr:Turn off this advice by setting config variable advice.detachedHead to false 2024-03-12T16:09:22.497 INFO:tasks.workunit.client.1.smithi134.stderr: 2024-03-12T16:09:22.497 INFO:tasks.workunit.client.1.smithi134.stderr:HEAD is now at 49e4a6794d5 Merge branch 'wip-64743-reef' of https://github.com/joscollin/ceph into wip-yuri11-testing-2024-03-11-0838-reef 2024-03-12T16:09:22.500 DEBUG:teuthology.orchestra.run.smithi134:> cd -- /home/ubuntu/cephtest/clone.client.1/qa/workunits && if test -e Makefile ; then make ; fi && find -executable -type f -printf '%P\0' >/home/ubuntu/cephtest/workunits.list.client.1 2024-03-12T16:09:22.578 INFO:tasks.workunit.client.1.smithi134.stdout:for d in direct_io fs ; do ( cd $d ; make all ) ; done 2024-03-12T16:09:22.580 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-12T16:09:22.580 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE direct_io_test.c -o direct_io_test 2024-03-12T16:09:23.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:22.000994+0000 mgr.smithi006.kskdce (mgr.14196) 270 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:23.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:22.000994+0000 mgr.smithi006.kskdce (mgr.14196) 270 : cluster [DBG] pgmap v232: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:23.827 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_sync_io.c -o test_sync_io 2024-03-12T16:09:23.938 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_short_dio_read.c -o test_short_dio_read 2024-03-12T16:09:23.976 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/direct_io' 2024-03-12T16:09:23.977 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Entering directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-12T16:09:23.977 INFO:tasks.workunit.client.1.smithi134.stdout:cc -Wall -Wextra -D_GNU_SOURCE test_o_trunc.c -o test_o_trunc 2024-03-12T16:09:24.013 INFO:tasks.workunit.client.1.smithi134.stdout:make[1]: Leaving directory '/home/ubuntu/cephtest/clone.client.1/qa/workunits/fs' 2024-03-12T16:09:24.017 DEBUG:teuthology.orchestra.run.smithi134:> set -ex 2024-03-12T16:09:24.017 DEBUG:teuthology.orchestra.run.smithi134:> dd if=/home/ubuntu/cephtest/workunits.list.client.1 of=/dev/stdout 2024-03-12T16:09:24.075 INFO:tasks.workunit:Running workunits matching suites/fsstress.sh on client.1... 2024-03-12T16:09:24.077 INFO:tasks.workunit:Running workunit suites/fsstress.sh... 2024-03-12T16:09:24.077 DEBUG:teuthology.orchestra.run.smithi134:workunit test suites/fsstress.sh> mkdir -p -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && cd -- /home/ubuntu/cephtest/mnt.1/client.1/tmp && CEPH_CLI_TEST_DUP_COMMAND=1 CEPH_REF=49e4a6794d5502bd66908faf714fc54896c51712 TESTDIR="/home/ubuntu/cephtest" CEPH_ARGS="--cluster ceph" CEPH_ID="1" PATH=$PATH:/usr/sbin CEPH_BASE=/home/ubuntu/cephtest/clone.client.1 CEPH_ROOT=/home/ubuntu/cephtest/clone.client.1 CEPH_MNT=/home/ubuntu/cephtest/mnt.1 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 3h /home/ubuntu/cephtest/clone.client.1/qa/workunits/suites/fsstress.sh 2024-03-12T16:09:24.143 INFO:tasks.workunit.client.1.smithi134.stderr:+ mkdir -p fsstress 2024-03-12T16:09:24.145 INFO:tasks.workunit.client.1.smithi134.stderr:+ pushd fsstress 2024-03-12T16:09:24.146 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-12T16:09:24.146 INFO:tasks.workunit.client.1.smithi134.stderr:+ wget -q -O ltp-full.tgz http://download.ceph.com/qa/ltp-full-20091231.tgz 2024-03-12T16:09:25.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.236+0000 7f73ad80e700 1 -- 172.21.15.6:0/929308232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a80fa950 msgr2=0x7f73a80fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.236+0000 7f73ad80e700 1 --2- 172.21.15.6:0/929308232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a80fa950 0x7f73a80fcda0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f73980047f0 tx=0x7f7398009cb0).stop 2024-03-12T16:09:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.236+0000 7f73ad80e700 1 -- 172.21.15.6:0/929308232 shutdown_connections 2024-03-12T16:09:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.236+0000 7f73ad80e700 1 --2- 172.21.15.6:0/929308232 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a80fa950 0x7f73a80fcda0 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.236+0000 7f73ad80e700 1 --2- 172.21.15.6:0/929308232 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a8061280 0x7f73a80fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.236+0000 7f73ad80e700 1 -- 172.21.15.6:0/929308232 >> 172.21.15.6:0/929308232 conn(0x7f73a80f1e50 msgr2=0x7f73a80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.236+0000 7f73ad80e700 1 -- 172.21.15.6:0/929308232 shutdown_connections 2024-03-12T16:09:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.236+0000 7f73ad80e700 1 -- 172.21.15.6:0/929308232 wait complete. 2024-03-12T16:09:25.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73ad80e700 1 Processor -- start 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73ad80e700 1 -- start start 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73ad80e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a8061280 0x7f73a8108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73ad80e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a80fa950 0x7f73a8108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73ad80e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a8108b20 con 0x7f73a8061280 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73ad80e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73a8108c60 con 0x7f73a80fa950 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a8061280 0x7f73a8108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73a6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a8061280 0x7f73a8108080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37548/0 (socket says 172.21.15.6:37548) 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73a6ffd700 1 -- 172.21.15.6:0/1127911576 learned_addr learned my addr 172.21.15.6:0/1127911576 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.237+0000 7f73a67fc700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a80fa950 0x7f73a8108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.238+0000 7f73a6ffd700 1 -- 172.21.15.6:0/1127911576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a80fa950 msgr2=0x7f73a8108570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.238+0000 7f73a6ffd700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a80fa950 0x7f73a8108570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.238+0000 7f73a6ffd700 1 -- 172.21.15.6:0/1127911576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7398005040 con 0x7f73a8061280 2024-03-12T16:09:25.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.238+0000 7f73a6ffd700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a8061280 0x7f73a8108080 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f739c00e910 tx=0x7f739c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.238+0000 7f738ffff700 1 -- 172.21.15.6:0/1127911576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f739c007b40 con 0x7f73a8061280 2024-03-12T16:09:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.238+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73a810d700 con 0x7f73a8061280 2024-03-12T16:09:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.238+0000 7f738ffff700 1 -- 172.21.15.6:0/1127911576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f739c00f040 con 0x7f73a8061280 2024-03-12T16:09:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.238+0000 7f738ffff700 1 -- 172.21.15.6:0/1127911576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f739c014920 con 0x7f73a8061280 2024-03-12T16:09:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.238+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73a810dcc0 con 0x7f73a8061280 2024-03-12T16:09:25.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.239+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73a80fffd0 con 0x7f73a8061280 2024-03-12T16:09:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.240+0000 7f738ffff700 1 -- 172.21.15.6:0/1127911576 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f739c007ca0 con 0x7f73a8061280 2024-03-12T16:09:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.240+0000 7f738ffff700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7390061180 0x7f7390063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.240+0000 7f738ffff700 1 -- 172.21.15.6:0/1127911576 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f739c07c3a0 con 0x7f73a8061280 2024-03-12T16:09:25.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.240+0000 7f73a67fc700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7390061180 0x7f7390063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:25.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.241+0000 7f73a67fc700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7390061180 0x7f7390063640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f73980047c0 tx=0x7f7398009cb0).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:25.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.244+0000 7f738ffff700 1 -- 172.21.15.6:0/1127911576 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f739c0503b0 con 0x7f73a8061280 2024-03-12T16:09:25.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.436+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f73a8059120 con 0x7f7390061180 2024-03-12T16:09:25.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.437+0000 7f738ffff700 1 -- 172.21.15.6:0/1127911576 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f73a8059120 con 0x7f7390061180 2024-03-12T16:09:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7390061180 msgr2=0x7f7390063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7390061180 0x7f7390063640 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f73980047c0 tx=0x7f7398009cb0).stop 2024-03-12T16:09:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a8061280 msgr2=0x7f73a8108080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a8061280 0x7f73a8108080 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f739c00e910 tx=0x7f739c00b040).stop 2024-03-12T16:09:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 shutdown_connections 2024-03-12T16:09:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f7390061180 0x7f7390063640 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73a8061280 0x7f73a8108080 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 --2- 172.21.15.6:0/1127911576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73a80fa950 0x7f73a8108570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 >> 172.21.15.6:0/1127911576 conn(0x7f73a80f1e50 msgr2=0x7f73a80f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 shutdown_connections 2024-03-12T16:09:25.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.439+0000 7f73ad80e700 1 -- 172.21.15.6:0/1127911576 wait complete. 2024-03-12T16:09:25.451 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:09:25.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.544+0000 7f2292f33700 1 -- 172.21.15.6:0/2144338072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c0fa9b0 msgr2=0x7f228c0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.544+0000 7f2292f33700 1 --2- 172.21.15.6:0/2144338072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c0fa9b0 0x7f228c0fcda0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f22800047f0 tx=0x7f2280009cb0).stop 2024-03-12T16:09:25.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.544+0000 7f2292f33700 1 -- 172.21.15.6:0/2144338072 shutdown_connections 2024-03-12T16:09:25.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.544+0000 7f2292f33700 1 --2- 172.21.15.6:0/2144338072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c0fa9b0 0x7f228c0fcda0 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.544+0000 7f2292f33700 1 --2- 172.21.15.6:0/2144338072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f228c061220 0x7f228c0fa430 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.544+0000 7f2292f33700 1 -- 172.21.15.6:0/2144338072 >> 172.21.15.6:0/2144338072 conn(0x7f228c0f1e50 msgr2=0x7f228c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:25.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.544+0000 7f2292f33700 1 -- 172.21.15.6:0/2144338072 shutdown_connections 2024-03-12T16:09:25.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.544+0000 7f2292f33700 1 -- 172.21.15.6:0/2144338072 wait complete. 2024-03-12T16:09:25.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2292f33700 1 Processor -- start 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2292f33700 1 -- start start 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2292f33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c061220 0x7f228c107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2292f33700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f228c0fa9b0 0x7f228c108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2292f33700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c108a20 con 0x7f228c061220 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2292f33700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f228c108b60 con 0x7f228c0fa9b0 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2290ccf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c061220 0x7f228c107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2290ccf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c061220 0x7f228c107f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37562/0 (socket says 172.21.15.6:37562) 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2290ccf700 1 -- 172.21.15.6:0/2646952145 learned_addr learned my addr 172.21.15.6:0/2646952145 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f228bfff700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f228c0fa9b0 0x7f228c108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2290ccf700 1 -- 172.21.15.6:0/2646952145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f228c0fa9b0 msgr2=0x7f228c108470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2290ccf700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f228c0fa9b0 0x7f228c108470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.545+0000 7f2290ccf700 1 -- 172.21.15.6:0/2646952145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2280005040 con 0x7f228c061220 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.546+0000 7f2290ccf700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c061220 0x7f228c107f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f227c00dad0 tx=0x7f227c004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.546+0000 7f2289ffb700 1 -- 172.21.15.6:0/2646952145 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227c00b750 con 0x7f228c061220 2024-03-12T16:09:25.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.546+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f228c10d600 con 0x7f228c061220 2024-03-12T16:09:25.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.546+0000 7f2289ffb700 1 -- 172.21.15.6:0/2646952145 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f227c00f040 con 0x7f228c061220 2024-03-12T16:09:25.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.546+0000 7f2289ffb700 1 -- 172.21.15.6:0/2646952145 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f227c013ba0 con 0x7f228c061220 2024-03-12T16:09:25.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.546+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f228c10dbc0 con 0x7f228c061220 2024-03-12T16:09:25.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.547+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f228c0fffb0 con 0x7f228c061220 2024-03-12T16:09:25.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.547+0000 7f2289ffb700 1 -- 172.21.15.6:0/2646952145 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f227c00b8b0 con 0x7f228c061220 2024-03-12T16:09:25.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.548+0000 7f2289ffb700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2274061180 0x7f2274063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:25.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.548+0000 7f2289ffb700 1 -- 172.21.15.6:0/2646952145 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f227c07c210 con 0x7f228c061220 2024-03-12T16:09:25.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.548+0000 7f228bfff700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2274061180 0x7f2274063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:25.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.548+0000 7f228bfff700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2274061180 0x7f2274063640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2280004f10 tx=0x7f228000b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:25.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.552+0000 7f2289ffb700 1 -- 172.21.15.6:0/2646952145 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f227c049f60 con 0x7f228c061220 2024-03-12T16:09:25.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:24.001364+0000 mgr.smithi006.kskdce (mgr.14196) 271 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:25.706 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:24.001364+0000 mgr.smithi006.kskdce (mgr.14196) 271 : cluster [DBG] pgmap v233: 65 pgs: 65 active+clean; 13 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:09:25.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.745+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f228c059120 con 0x7f2274061180 2024-03-12T16:09:25.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.746+0000 7f2289ffb700 1 -- 172.21.15.6:0/2646952145 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+439 (secure 0 0 0) 0x7f228c059120 con 0x7f2274061180 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.748+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2274061180 msgr2=0x7f2274063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.748+0000 7f2292f33700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2274061180 0x7f2274063640 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f2280004f10 tx=0x7f228000b040).stop 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.748+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c061220 msgr2=0x7f228c107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.748+0000 7f2292f33700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c061220 0x7f228c107f80 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7f227c00dad0 tx=0x7f227c004ee0).stop 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.748+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 shutdown_connections 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.748+0000 7f2292f33700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f2274061180 0x7f2274063640 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.748+0000 7f2292f33700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f228c061220 0x7f228c107f80 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.748+0000 7f2292f33700 1 --2- 172.21.15.6:0/2646952145 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f228c0fa9b0 0x7f228c108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.748+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 >> 172.21.15.6:0/2646952145 conn(0x7f228c0f1e50 msgr2=0x7f228c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.749+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 shutdown_connections 2024-03-12T16:09:25.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.749+0000 7f2292f33700 1 -- 172.21.15.6:0/2646952145 wait complete. 2024-03-12T16:09:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.851+0000 7f03ec0f5700 1 -- 172.21.15.6:0/1678953704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 msgr2=0x7f03e40f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.851+0000 7f03ec0f5700 1 --2- 172.21.15.6:0/1678953704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 0x7f03e40f7e30 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f03e00047f0 tx=0x7f03e0009cb0).stop 2024-03-12T16:09:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.851+0000 7f03ec0f5700 1 -- 172.21.15.6:0/1678953704 shutdown_connections 2024-03-12T16:09:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.851+0000 7f03ec0f5700 1 --2- 172.21.15.6:0/1678953704 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e40f8cb0 0x7f03e40f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.851+0000 7f03ec0f5700 1 --2- 172.21.15.6:0/1678953704 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 0x7f03e40f7e30 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.851+0000 7f03ec0f5700 1 -- 172.21.15.6:0/1678953704 >> 172.21.15.6:0/1678953704 conn(0x7f03e40f3150 msgr2=0x7f03e40f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.851+0000 7f03ec0f5700 1 -- 172.21.15.6:0/1678953704 shutdown_connections 2024-03-12T16:09:25.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.851+0000 7f03ec0f5700 1 -- 172.21.15.6:0/1678953704 wait complete. 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03ec0f5700 1 Processor -- start 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03ec0f5700 1 -- start start 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03ec0f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 0x7f03e4108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03ec0f5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e40f8cb0 0x7f03e4108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03ec0f5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4108c30 con 0x7f03e40f7a10 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03ec0f5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e4108d70 con 0x7f03e40f8cb0 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03e9e91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 0x7f03e4108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03e9e91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 0x7f03e4108190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37586/0 (socket says 172.21.15.6:37586) 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03e9e91700 1 -- 172.21.15.6:0/2040654517 learned_addr learned my addr 172.21.15.6:0/2040654517 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03e9690700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e40f8cb0 0x7f03e4108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03e9e91700 1 -- 172.21.15.6:0/2040654517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e40f8cb0 msgr2=0x7f03e4108680 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03e9e91700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e40f8cb0 0x7f03e4108680 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:25.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03e9e91700 1 -- 172.21.15.6:0/2040654517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03e0005040 con 0x7f03e40f7a10 2024-03-12T16:09:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.852+0000 7f03e9e91700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 0x7f03e4108190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f03e0013620 tx=0x7f03e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.853+0000 7f03daffd700 1 -- 172.21.15.6:0/2040654517 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03e000e070 con 0x7f03e40f7a10 2024-03-12T16:09:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.853+0000 7f03daffd700 1 -- 172.21.15.6:0/2040654517 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03e0007e90 con 0x7f03e40f7a10 2024-03-12T16:09:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.853+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e410d7b0 con 0x7f03e40f7a10 2024-03-12T16:09:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.853+0000 7f03daffd700 1 -- 172.21.15.6:0/2040654517 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03e0018070 con 0x7f03e40f7a10 2024-03-12T16:09:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.853+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e410dd70 con 0x7f03e40f7a10 2024-03-12T16:09:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.854+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e405fb50 con 0x7f03e40f7a10 2024-03-12T16:09:25.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.854+0000 7f03daffd700 1 -- 172.21.15.6:0/2040654517 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f03e001d420 con 0x7f03e40f7a10 2024-03-12T16:09:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.854+0000 7f03daffd700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f03d0061180 0x7f03d0063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.854+0000 7f03daffd700 1 -- 172.21.15.6:0/2040654517 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f03e007d3c0 con 0x7f03e40f7a10 2024-03-12T16:09:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.854+0000 7f03e9690700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f03d0061180 0x7f03d0063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:25.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.855+0000 7f03e9690700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f03d0061180 0x7f03d0063640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f03d4004dc0 tx=0x7f03d400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:25.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:25.859+0000 7f03daffd700 1 -- 172.21.15.6:0/2040654517 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f03e00513d0 con 0x7f03e40f7a10 2024-03-12T16:09:26.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.044+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f03e4059120 con 0x7f03d0061180 2024-03-12T16:09:26.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.053+0000 7f03daffd700 1 -- 172.21.15.6:0/2040654517 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3388 (secure 0 0 0) 0x7f03e4059120 con 0x7f03d0061180 2024-03-12T16:09:26.055 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (4m) 96s ago 7m 24.1M - 0.23.0 ba2b418f427c 869c486ed5f2 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (7m) 96s ago 7m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (6m) 101s ago 6m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (4m) 96s ago 6m 51.7M - 8.3.5 dad864ee21e9 7deda4319993 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (2m) 96s ago 2m 15.0M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (116s) 96s ago 114s 11.7M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (118s) 101s ago 118s 14.4M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (112s) 101s ago 112s 14.4M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:9283 running (8m) 96s ago 8m 434M - 16.2.15-1-g8963e9de 727f386679cb f09ce35a51f8 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283 running (6m) 101s ago 6m 388M - 16.2.15-1-g8963e9de 727f386679cb d5c56441431d 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (8m) 96s ago 8m 62.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (6m) 101s ago 6m 60.9M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (6m) 96s ago 6m 21.6M - 1.3.1 1dbe0e931976 ef9d95e31974 2024-03-12T16:09:26.056 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 101s ago 6m 22.1M - 1.3.1 1dbe0e931976 ee7621f16bde 2024-03-12T16:09:26.057 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (5m) 96s ago 5m 43.5M 4642M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:09:26.057 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (5m) 96s ago 5m 41.3M 4642M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:09:26.057 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (5m) 96s ago 5m 38.8M 4642M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:09:26.057 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (4m) 101s ago 4m 41.3M 4982M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:09:26.057 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (4m) 101s ago 4m 39.6M 4982M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:09:26.057 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (3m) 101s ago 3m 39.2M 4982M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:09:26.057 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 101s ago 5m 61.7M - 2.33.4 514e6a882f6e 344ddc812ba0 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f03d0061180 msgr2=0x7f03d0063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f03d0061180 0x7f03d0063640 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f03d4004dc0 tx=0x7f03d400b040).stop 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 msgr2=0x7f03e4108190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 0x7f03e4108190 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f03e0013620 tx=0x7f03e0009cb0).stop 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 shutdown_connections 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f03d0061180 0x7f03d0063640 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e40f7a10 0x7f03e4108190 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 --2- 172.21.15.6:0/2040654517 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e40f8cb0 0x7f03e4108680 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 >> 172.21.15.6:0/2040654517 conn(0x7f03e40f3150 msgr2=0x7f03e40fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 shutdown_connections 2024-03-12T16:09:26.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.055+0000 7f03ec0f5700 1 -- 172.21.15.6:0/2040654517 wait complete. 2024-03-12T16:09:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.164+0000 7fd72204f700 1 -- 172.21.15.6:0/200968374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 msgr2=0x7fd71c0fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.164+0000 7fd72204f700 1 --2- 172.21.15.6:0/200968374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 0x7fd71c0fa3d0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7fd70c009b60 tx=0x7fd70c004d10).stop 2024-03-12T16:09:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.164+0000 7fd72204f700 1 -- 172.21.15.6:0/200968374 shutdown_connections 2024-03-12T16:09:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.164+0000 7fd72204f700 1 --2- 172.21.15.6:0/200968374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0fa950 0x7fd71c0fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.164+0000 7fd72204f700 1 --2- 172.21.15.6:0/200968374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 0x7fd71c0fa3d0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.164+0000 7fd72204f700 1 -- 172.21.15.6:0/200968374 >> 172.21.15.6:0/200968374 conn(0x7fd71c0f1e50 msgr2=0x7fd71c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.164+0000 7fd72204f700 1 -- 172.21.15.6:0/200968374 shutdown_connections 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.164+0000 7fd72204f700 1 -- 172.21.15.6:0/200968374 wait complete. 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.164+0000 7fd72204f700 1 Processor -- start 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd72204f700 1 -- start start 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd72204f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 0x7fd71c107ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd72204f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0fa950 0x7fd71c1084e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd72204f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c108a90 con 0x7fd71c061280 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd72204f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd71c108bd0 con 0x7fd71c0fa950 2024-03-12T16:09:26.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd71b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 0x7fd71c107ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd71b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 0x7fd71c107ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37600/0 (socket says 172.21.15.6:37600) 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd71b7fe700 1 -- 172.21.15.6:0/2500557353 learned_addr learned my addr 172.21.15.6:0/2500557353 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd71affd700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0fa950 0x7fd71c1084e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd71b7fe700 1 -- 172.21.15.6:0/2500557353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0fa950 msgr2=0x7fd71c1084e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd71b7fe700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0fa950 0x7fd71c1084e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.165+0000 7fd71b7fe700 1 -- 172.21.15.6:0/2500557353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd70c0097c0 con 0x7fd71c061280 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.166+0000 7fd71b7fe700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 0x7fd71c107ff0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd70c00c010 tx=0x7fd70c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.166+0000 7fd718ff9700 1 -- 172.21.15.6:0/2500557353 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd70c00e030 con 0x7fd71c061280 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.166+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd71c10d610 con 0x7fd71c061280 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.166+0000 7fd718ff9700 1 -- 172.21.15.6:0/2500557353 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd70c007e90 con 0x7fd71c061280 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.166+0000 7fd718ff9700 1 -- 172.21.15.6:0/2500557353 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd70c018070 con 0x7fd71c061280 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.166+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd71c10db50 con 0x7fd71c061280 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.167+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71c0fffe0 con 0x7fd71c061280 2024-03-12T16:09:26.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.168+0000 7fd718ff9700 1 -- 172.21.15.6:0/2500557353 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7fd70c01db90 con 0x7fd71c061280 2024-03-12T16:09:26.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.168+0000 7fd718ff9700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd708061180 0x7fd708063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:26.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.168+0000 7fd718ff9700 1 -- 172.21.15.6:0/2500557353 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7fd70c07e080 con 0x7fd71c061280 2024-03-12T16:09:26.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.168+0000 7fd71affd700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd708061180 0x7fd708063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:26.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.168+0000 7fd71affd700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd708061180 0x7fd708063640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd71c061050 tx=0x7fd70400b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:26.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.172+0000 7fd718ff9700 1 -- 172.21.15.6:0/2500557353 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7fd70c052010 con 0x7fd71c061280 2024-03-12T16:09:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.426+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd71c0598f0 con 0x7fd71c061280 2024-03-12T16:09:26.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.426+0000 7fd718ff9700 1 -- 172.21.15.6:0/2500557353 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+638 (secure 0 0 0) 0x7fd70c051c00 con 0x7fd71c061280 2024-03-12T16:09:26.428 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:09:26.428 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:09:26.428 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 14 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:09:26.429 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:09:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd708061180 msgr2=0x7fd708063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd708061180 0x7fd708063640 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fd71c061050 tx=0x7fd70400b040).stop 2024-03-12T16:09:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 msgr2=0x7fd71c107ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 0x7fd71c107ff0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7fd70c00c010 tx=0x7fd70c004d10).stop 2024-03-12T16:09:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 shutdown_connections 2024-03-12T16:09:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7fd708061180 0x7fd708063640 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd71c061280 0x7fd71c107ff0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 --2- 172.21.15.6:0/2500557353 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd71c0fa950 0x7fd71c1084e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 >> 172.21.15.6:0/2500557353 conn(0x7fd71c0f1e50 msgr2=0x7fd71c0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 shutdown_connections 2024-03-12T16:09:26.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.428+0000 7fd72204f700 1 -- 172.21.15.6:0/2500557353 wait complete. 2024-03-12T16:09:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.531+0000 7f695fa51700 1 -- 172.21.15.6:0/2779989701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 msgr2=0x7f69580fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.531+0000 7f695fa51700 1 --2- 172.21.15.6:0/2779989701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 0x7f69580fa3d0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f69540047f0 tx=0x7f6954009cb0).stop 2024-03-12T16:09:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.531+0000 7f695fa51700 1 -- 172.21.15.6:0/2779989701 shutdown_connections 2024-03-12T16:09:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.531+0000 7f695fa51700 1 --2- 172.21.15.6:0/2779989701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69580fa950 0x7f69580fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.531+0000 7f695fa51700 1 --2- 172.21.15.6:0/2779989701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 0x7f69580fa3d0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.531+0000 7f695fa51700 1 -- 172.21.15.6:0/2779989701 >> 172.21.15.6:0/2779989701 conn(0x7f69580f1e50 msgr2=0x7f69580f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:26.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.531+0000 7f695fa51700 1 -- 172.21.15.6:0/2779989701 shutdown_connections 2024-03-12T16:09:26.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.531+0000 7f695fa51700 1 -- 172.21.15.6:0/2779989701 wait complete. 2024-03-12T16:09:26.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.531+0000 7f695fa51700 1 Processor -- start 2024-03-12T16:09:26.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695fa51700 1 -- start start 2024-03-12T16:09:26.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695fa51700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 0x7f6958107f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:26.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695fa51700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69580fa950 0x7f6958108440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:26.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695fa51700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69581089f0 con 0x7f6958061280 2024-03-12T16:09:26.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695fa51700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6958108b30 con 0x7f69580fa950 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695d7ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 0x7f6958107f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695d7ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 0x7f6958107f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37622/0 (socket says 172.21.15.6:37622) 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695d7ed700 1 -- 172.21.15.6:0/2602252924 learned_addr learned my addr 172.21.15.6:0/2602252924 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695cfec700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69580fa950 0x7f6958108440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695d7ed700 1 -- 172.21.15.6:0/2602252924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69580fa950 msgr2=0x7f6958108440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695d7ed700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69580fa950 0x7f6958108440 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695d7ed700 1 -- 172.21.15.6:0/2602252924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6954005040 con 0x7f6958061280 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f695d7ed700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 0x7f6958107f50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6954013620 tx=0x7f6954009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.532+0000 7f694e7fc700 1 -- 172.21.15.6:0/2602252924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f695400e070 con 0x7f6958061280 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.533+0000 7f694e7fc700 1 -- 172.21.15.6:0/2602252924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6954007e90 con 0x7f6958061280 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.533+0000 7f694e7fc700 1 -- 172.21.15.6:0/2602252924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6954018070 con 0x7f6958061280 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.533+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f695810d570 con 0x7f6958061280 2024-03-12T16:09:26.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.533+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f695810db30 con 0x7f6958061280 2024-03-12T16:09:26.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.534+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6958100000 con 0x7f6958061280 2024-03-12T16:09:26.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.534+0000 7f694e7fc700 1 -- 172.21.15.6:0/2602252924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 18) v1 ==== 77149+0+0 (secure 0 0 0) 0x7f695401d420 con 0x7f6958061280 2024-03-12T16:09:26.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.534+0000 7f694e7fc700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6944061180 0x7f6944063640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:26.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.534+0000 7f694e7fc700 1 -- 172.21.15.6:0/2602252924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(43..43 src has 1..43) v4 ==== 5365+0+0 (secure 0 0 0) 0x7f695407d620 con 0x7f6958061280 2024-03-12T16:09:26.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.535+0000 7f695cfec700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6944061180 0x7f6944063640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:26.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.535+0000 7f695cfec700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6944061180 0x7f6944063640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6958061050 tx=0x7f694800b040).ready entity=mgr.14196 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:26.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.539+0000 7f694e7fc700 1 -- 172.21.15.6:0/2602252924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+163658 (secure 0 0 0) 0x7f69540515b0 con 0x7f6958061280 2024-03-12T16:09:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.735+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 --> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6958059120 con 0x7f6944061180 2024-03-12T16:09:26.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.737+0000 7f694e7fc700 1 -- 172.21.15.6:0/2602252924 <== mgr.14196 v2:172.21.15.6:6800/139345082 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f6958059120 con 0x7f6944061180 2024-03-12T16:09:26.739 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:09:26.739 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:09:26.739 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:09:26.739 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-12T16:09:26.739 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [], 2024-03-12T16:09:26.739 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "0/2 daemons upgraded", 2024-03-12T16:09:26.739 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mgr daemons", 2024-03-12T16:09:26.739 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:09:26.739 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:09:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6944061180 msgr2=0x7f6944063640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6944061180 0x7f6944063640 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f6958061050 tx=0x7f694800b040).stop 2024-03-12T16:09:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 msgr2=0x7f6958107f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 0x7f6958107f50 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f6954013620 tx=0x7f6954009cb0).stop 2024-03-12T16:09:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 shutdown_connections 2024-03-12T16:09:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:6800/139345082,v1:172.21.15.6:6801/139345082] conn(0x7f6944061180 0x7f6944063640 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6958061280 0x7f6958107f50 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 --2- 172.21.15.6:0/2602252924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69580fa950 0x7f6958108440 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 >> 172.21.15.6:0/2602252924 conn(0x7f69580f1e50 msgr2=0x7f69580f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 shutdown_connections 2024-03-12T16:09:26.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:26.739+0000 7f695fa51700 1 -- 172.21.15.6:0/2602252924 wait complete. 2024-03-12T16:09:26.904 INFO:tasks.workunit.client.0.smithi006.stderr:+ tar xzf ltp-full.tgz 2024-03-12T16:09:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:25.438505+0000 mgr.smithi006.kskdce (mgr.14196) 272 : audit [DBG] from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:25.747901+0000 mgr.smithi006.kskdce (mgr.14196) 273 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:26.001674+0000 mgr.smithi006.kskdce (mgr.14196) 274 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 34 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s wr, 0 op/s 2024-03-12T16:09:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:26.046294+0000 mgr.smithi006.kskdce (mgr.14196) 275 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:26.427791+0000 mon.smithi006 (mon.0) 598 : audit [DBG] from='client.? 172.21.15.6:0/2500557353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:09:27.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:26.631187+0000 mon.smithi006 (mon.0) 599 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:09:27.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:26.632008+0000 mon.smithi006 (mon.0) 600 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:09:27.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:26.633083+0000 mon.smithi006 (mon.0) 601 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:09:27.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:26.633746+0000 mon.smithi006 (mon.0) 602 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:09:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:25.438505+0000 mgr.smithi006.kskdce (mgr.14196) 272 : audit [DBG] from='client.14540 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:25.747901+0000 mgr.smithi006.kskdce (mgr.14196) 273 : audit [DBG] from='client.14544 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:26.001674+0000 mgr.smithi006.kskdce (mgr.14196) 274 : cluster [DBG] pgmap v234: 65 pgs: 65 active+clean; 34 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 1.9 KiB/s wr, 0 op/s 2024-03-12T16:09:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:26.046294+0000 mgr.smithi006.kskdce (mgr.14196) 275 : audit [DBG] from='client.14548 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:26.427791+0000 mon.smithi006 (mon.0) 598 : audit [DBG] from='client.? 172.21.15.6:0/2500557353' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:09:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:26.631187+0000 mon.smithi006 (mon.0) 599 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:09:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:26.632008+0000 mon.smithi006 (mon.0) 600 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:09:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:26.633083+0000 mon.smithi006 (mon.0) 601 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:09:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:26.633746+0000 mon.smithi006 (mon.0) 602 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:09:28.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:26.626907+0000 mgr.smithi006.kskdce (mgr.14196) 276 : cephadm [INF] Upgrade: Updating mgr.smithi134.gcntfu 2024-03-12T16:09:28.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:26.634313+0000 mgr.smithi006.kskdce (mgr.14196) 277 : cephadm [INF] Deploying daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:09:28.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:26.738112+0000 mgr.smithi006.kskdce (mgr.14196) 278 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:26.626907+0000 mgr.smithi006.kskdce (mgr.14196) 276 : cephadm [INF] Upgrade: Updating mgr.smithi134.gcntfu 2024-03-12T16:09:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:26.634313+0000 mgr.smithi006.kskdce (mgr.14196) 277 : cephadm [INF] Deploying daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:09:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:26.738112+0000 mgr.smithi006.kskdce (mgr.14196) 278 : audit [DBG] from='client.14556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:28.002030+0000 mgr.smithi006.kskdce (mgr.14196) 279 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 255 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s wr, 4 op/s 2024-03-12T16:09:29.706 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:28.002030+0000 mgr.smithi006.kskdce (mgr.14196) 279 : cluster [DBG] pgmap v235: 65 pgs: 65 active+clean; 255 KiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 23 KiB/s wr, 4 op/s 2024-03-12T16:09:30.041 INFO:tasks.workunit.client.1.smithi134.stderr:+ tar xzf ltp-full.tgz 2024-03-12T16:09:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:30.002467+0000 mgr.smithi006.kskdce (mgr.14196) 280 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 9.5 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 829 KiB/s wr, 32 op/s 2024-03-12T16:09:31.706 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:30.002467+0000 mgr.smithi006.kskdce (mgr.14196) 280 : cluster [DBG] pgmap v236: 65 pgs: 65 active+clean; 9.5 MiB data, 1.7 GiB used, 535 GiB / 536 GiB avail; 829 KiB/s wr, 32 op/s 2024-03-12T16:09:33.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:32.002860+0000 mgr.smithi006.kskdce (mgr.14196) 281 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 78 op/s 2024-03-12T16:09:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:32.002860+0000 mgr.smithi006.kskdce (mgr.14196) 281 : cluster [DBG] pgmap v237: 65 pgs: 65 active+clean; 19 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 1.6 MiB/s wr, 78 op/s 2024-03-12T16:09:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:34.003307+0000 mgr.smithi006.kskdce (mgr.14196) 282 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 29 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s wr, 162 op/s 2024-03-12T16:09:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:35.098931+0000 mon.smithi006 (mon.0) 603 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:09:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:35.099848+0000 mon.smithi006 (mon.0) 604 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:09:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:34.003307+0000 mgr.smithi006.kskdce (mgr.14196) 282 : cluster [DBG] pgmap v238: 65 pgs: 65 active+clean; 29 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.5 MiB/s wr, 162 op/s 2024-03-12T16:09:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:35.098931+0000 mon.smithi006 (mon.0) 603 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:09:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:35.099848+0000 mon.smithi006 (mon.0) 604 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:09:36.658 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:35.265196+0000 mon.smithi006 (mon.0) 605 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:09:36.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:35.265196+0000 mon.smithi006 (mon.0) 605 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:09:37.537 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:36.003683+0000 mgr.smithi006.kskdce (mgr.14196) 283 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s wr, 220 op/s 2024-03-12T16:09:37.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:36.003683+0000 mgr.smithi006.kskdce (mgr.14196) 283 : cluster [DBG] pgmap v239: 65 pgs: 65 active+clean; 34 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 2.9 MiB/s wr, 220 op/s 2024-03-12T16:09:39.538 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:38.004117+0000 mgr.smithi006.kskdce (mgr.14196) 284 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 41 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 298 op/s 2024-03-12T16:09:39.538 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:39.172395+0000 mon.smithi006 (mon.0) 606 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:09:39.577 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:38.004117+0000 mgr.smithi006.kskdce (mgr.14196) 284 : cluster [DBG] pgmap v240: 65 pgs: 65 active+clean; 41 MiB data, 1.9 GiB used, 535 GiB / 536 GiB avail; 3.6 MiB/s wr, 298 op/s 2024-03-12T16:09:39.578 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:39.172395+0000 mon.smithi006 (mon.0) 606 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:09:40.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:39.514480+0000 mon.smithi006 (mon.0) 607 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:09:40.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:39.515287+0000 mon.smithi006 (mon.0) 608 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:09:40.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:39.520464+0000 mon.smithi006 (mon.0) 609 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:09:40.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:39.526426+0000 mon.smithi006 (mon.0) 610 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:09:40.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:39.532112+0000 mon.smithi006 (mon.0) 611 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr fail", "who": "smithi006.kskdce"}]: dispatch 2024-03-12T16:09:40.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:39.539406+0000 mon.smithi006 (mon.0) 612 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-03-12T16:09:40.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:39.540588+0000 mon.smithi006 (mon.0) 613 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "mgr fail", "who": "smithi006.kskdce"}]': finished 2024-03-12T16:09:40.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:39.540644+0000 mon.smithi006 (mon.0) 614 : cluster [DBG] mgrmap e19: smithi134.gcntfu(active, starting, since 0.00798955s) 2024-03-12T16:09:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:39.514480+0000 mon.smithi006 (mon.0) 607 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:09:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:39.515287+0000 mon.smithi006 (mon.0) 608 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:09:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:39.520464+0000 mon.smithi006 (mon.0) 609 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' 2024-03-12T16:09:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:39.526426+0000 mon.smithi006 (mon.0) 610 : audit [DBG] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:09:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:39.532112+0000 mon.smithi006 (mon.0) 611 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr fail", "who": "smithi006.kskdce"}]: dispatch 2024-03-12T16:09:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:39.539406+0000 mon.smithi006 (mon.0) 612 : cluster [DBG] osdmap e44: 6 total, 6 up, 6 in 2024-03-12T16:09:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:39.540588+0000 mon.smithi006 (mon.0) 613 : audit [INF] from='mgr.14196 172.21.15.6:0/2992054744' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "mgr fail", "who": "smithi006.kskdce"}]': finished 2024-03-12T16:09:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:39.540644+0000 mon.smithi006 (mon.0) 614 : cluster [DBG] mgrmap e19: smithi134.gcntfu(active, starting, since 0.00798955s) 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:43.464290+0000 mon.smithi006 (mon.0) 615 : cluster [INF] Active manager daemon smithi134.gcntfu restarted 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:43.464717+0000 mon.smithi006 (mon.0) 616 : cluster [INF] Activating manager daemon smithi134.gcntfu 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.467310+0000 mon.smithi134 (mon.1) 15 : audit [DBG] from='mgr.? 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:43.471774+0000 mon.smithi006 (mon.0) 617 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:43.472016+0000 mon.smithi006 (mon.0) 618 : cluster [DBG] mgrmap e20: smithi134.gcntfu(active, starting, since 0.0075012s) 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.479275+0000 mon.smithi006 (mon.0) 619 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.479530+0000 mon.smithi006 (mon.0) 620 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.479737+0000 mon.smithi006 (mon.0) 621 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.480517+0000 mon.smithi006 (mon.0) 622 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.480741+0000 mon.smithi006 (mon.0) 623 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:09:43.572 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.480920+0000 mon.smithi006 (mon.0) 624 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.481107+0000 mon.smithi006 (mon.0) 625 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.481287+0000 mon.smithi006 (mon.0) 626 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mgr metadata", "who": "smithi134.gcntfu", "id": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.481478+0000 mon.smithi006 (mon.0) 627 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.481941+0000 mon.smithi006 (mon.0) 628 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.482138+0000 mon.smithi006 (mon.0) 629 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.482335+0000 mon.smithi006 (mon.0) 630 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.482547+0000 mon.smithi006 (mon.0) 631 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.482721+0000 mon.smithi006 (mon.0) 632 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.483798+0000 mon.smithi006 (mon.0) 633 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.484192+0000 mon.smithi006 (mon.0) 634 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.484679+0000 mon.smithi006 (mon.0) 635 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.484897+0000 mon.smithi006 (mon.0) 636 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.486938+0000 mon.smithi006 (mon.0) 637 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:09:43.573 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.487343+0000 mon.smithi006 (mon.0) 638 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:09:43.794 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:43.464290+0000 mon.smithi006 (mon.0) 615 : cluster [INF] Active manager daemon smithi134.gcntfu restarted 2024-03-12T16:09:43.794 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:43.464717+0000 mon.smithi006 (mon.0) 616 : cluster [INF] Activating manager daemon smithi134.gcntfu 2024-03-12T16:09:43.794 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.467310+0000 mon.smithi134 (mon.1) 15 : audit [DBG] from='mgr.? 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:09:43.794 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:43.471774+0000 mon.smithi006 (mon.0) 617 : cluster [DBG] osdmap e45: 6 total, 6 up, 6 in 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:43.472016+0000 mon.smithi006 (mon.0) 618 : cluster [DBG] mgrmap e20: smithi134.gcntfu(active, starting, since 0.0075012s) 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.479275+0000 mon.smithi006 (mon.0) 619 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.479530+0000 mon.smithi006 (mon.0) 620 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.479737+0000 mon.smithi006 (mon.0) 621 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.480517+0000 mon.smithi006 (mon.0) 622 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.480741+0000 mon.smithi006 (mon.0) 623 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.480920+0000 mon.smithi006 (mon.0) 624 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.481107+0000 mon.smithi006 (mon.0) 625 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.481287+0000 mon.smithi006 (mon.0) 626 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mgr metadata", "who": "smithi134.gcntfu", "id": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:09:43.795 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.481478+0000 mon.smithi006 (mon.0) 627 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.481941+0000 mon.smithi006 (mon.0) 628 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.482138+0000 mon.smithi006 (mon.0) 629 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.482335+0000 mon.smithi006 (mon.0) 630 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.482547+0000 mon.smithi006 (mon.0) 631 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.482721+0000 mon.smithi006 (mon.0) 632 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.483798+0000 mon.smithi006 (mon.0) 633 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.484192+0000 mon.smithi006 (mon.0) 634 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.484679+0000 mon.smithi006 (mon.0) 635 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.484897+0000 mon.smithi006 (mon.0) 636 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.486938+0000 mon.smithi006 (mon.0) 637 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:09:43.796 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.487343+0000 mon.smithi006 (mon.0) 638 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:09:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:43.654006+0000 mon.smithi006 (mon.0) 639 : cluster [INF] Manager daemon smithi134.gcntfu is now available 2024-03-12T16:09:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.682025+0000 mon.smithi006 (mon.0) 640 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.688356+0000 mon.smithi006 (mon.0) 641 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:09:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.692423+0000 mon.smithi006 (mon.0) 642 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:09:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.718743+0000 mon.smithi006 (mon.0) 643 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:09:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.736604+0000 mon.smithi006 (mon.0) 644 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.gcntfu/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:09:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.743506+0000 mon.smithi006 (mon.0) 645 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:43.759370+0000 mon.smithi006 (mon.0) 646 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.gcntfu/trash_purge_schedule"}]: dispatch 2024-03-12T16:09:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:44.093490+0000 mon.smithi006 (mon.0) 647 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:44.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:44.098899+0000 mon.smithi006 (mon.0) 648 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:43.654006+0000 mon.smithi006 (mon.0) 639 : cluster [INF] Manager daemon smithi134.gcntfu is now available 2024-03-12T16:09:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.682025+0000 mon.smithi006 (mon.0) 640 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.688356+0000 mon.smithi006 (mon.0) 641 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:09:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.692423+0000 mon.smithi006 (mon.0) 642 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:09:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.718743+0000 mon.smithi006 (mon.0) 643 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:09:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.736604+0000 mon.smithi006 (mon.0) 644 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.gcntfu/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:09:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.743506+0000 mon.smithi006 (mon.0) 645 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:44.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:43.759370+0000 mon.smithi006 (mon.0) 646 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi134.gcntfu/trash_purge_schedule"}]: dispatch 2024-03-12T16:09:44.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:44.093490+0000 mon.smithi006 (mon.0) 647 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:44.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:44.098899+0000 mon.smithi006 (mon.0) 648 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:45.810 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:44.244371+0000 mgr.smithi134.gcntfu (mgr.24383) 1 : cephadm [INF] Deploying cephadm binary to smithi134 2024-03-12T16:09:45.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:44.262751+0000 mgr.smithi134.gcntfu (mgr.24383) 2 : cephadm [INF] Deploying cephadm binary to smithi006 2024-03-12T16:09:45.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:44.529425+0000 mon.smithi006 (mon.0) 649 : cluster [DBG] mgrmap e21: smithi134.gcntfu(active, since 1.06491s) 2024-03-12T16:09:45.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:44.542551+0000 mgr.smithi134.gcntfu (mgr.24383) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:09:45.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:44.623874+0000 mgr.smithi134.gcntfu (mgr.24383) 4 : cephadm [INF] [12/Mar/2024:16:09:44] ENGINE Bus STARTING 2024-03-12T16:09:45.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:44.819488+0000 mgr.smithi134.gcntfu (mgr.24383) 5 : cephadm [INF] [12/Mar/2024:16:09:44] ENGINE Serving on https://172.21.15.134:7150 2024-03-12T16:09:45.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:44.938519+0000 mgr.smithi134.gcntfu (mgr.24383) 6 : cephadm [INF] [12/Mar/2024:16:09:44] ENGINE Serving on http://172.21.15.134:8765 2024-03-12T16:09:45.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:44.939272+0000 mgr.smithi134.gcntfu (mgr.24383) 7 : cephadm [INF] [12/Mar/2024:16:09:44] ENGINE Bus STARTED 2024-03-12T16:09:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:44.244371+0000 mgr.smithi134.gcntfu (mgr.24383) 1 : cephadm [INF] Deploying cephadm binary to smithi134 2024-03-12T16:09:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:44.262751+0000 mgr.smithi134.gcntfu (mgr.24383) 2 : cephadm [INF] Deploying cephadm binary to smithi006 2024-03-12T16:09:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:44.529425+0000 mon.smithi006 (mon.0) 649 : cluster [DBG] mgrmap e21: smithi134.gcntfu(active, since 1.06491s) 2024-03-12T16:09:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:44.542551+0000 mgr.smithi134.gcntfu (mgr.24383) 3 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:09:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:44.623874+0000 mgr.smithi134.gcntfu (mgr.24383) 4 : cephadm [INF] [12/Mar/2024:16:09:44] ENGINE Bus STARTING 2024-03-12T16:09:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:44.819488+0000 mgr.smithi134.gcntfu (mgr.24383) 5 : cephadm [INF] [12/Mar/2024:16:09:44] ENGINE Serving on https://172.21.15.134:7150 2024-03-12T16:09:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:44.938519+0000 mgr.smithi134.gcntfu (mgr.24383) 6 : cephadm [INF] [12/Mar/2024:16:09:44] ENGINE Serving on http://172.21.15.134:8765 2024-03-12T16:09:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:44.939272+0000 mgr.smithi134.gcntfu (mgr.24383) 7 : cephadm [INF] [12/Mar/2024:16:09:44] ENGINE Bus STARTED 2024-03-12T16:09:46.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:45.483746+0000 mgr.smithi134.gcntfu (mgr.24383) 8 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:09:46.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:45.538492+0000 mon.smithi006 (mon.0) 650 : cluster [DBG] mgrmap e22: smithi134.gcntfu(active, since 2s) 2024-03-12T16:09:46.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:45.710121+0000 mon.smithi006 (mon.0) 651 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-12T16:09:46.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:45.483746+0000 mgr.smithi134.gcntfu (mgr.24383) 8 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:09:46.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:45.538492+0000 mon.smithi006 (mon.0) 650 : cluster [DBG] mgrmap e22: smithi134.gcntfu(active, since 2s) 2024-03-12T16:09:46.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:45.710121+0000 mon.smithi006 (mon.0) 651 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-12T16:09:47.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:46.543706+0000 mon.smithi006 (mon.0) 652 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]': finished 2024-03-12T16:09:47.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:46.543780+0000 mon.smithi006 (mon.0) 653 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-03-12T16:09:47.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:46.545334+0000 mon.smithi006 (mon.0) 654 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-12T16:09:47.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:47.221026+0000 mon.smithi006 (mon.0) 655 : cluster [DBG] Standby manager daemon smithi006.kskdce started 2024-03-12T16:09:47.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:47.223865+0000 mon.smithi006 (mon.0) 656 : audit [DBG] from='mgr.? 172.21.15.6:0/1458965855' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi006.kskdce/crt"}]: dispatch 2024-03-12T16:09:47.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:47.224959+0000 mon.smithi006 (mon.0) 657 : audit [DBG] from='mgr.? 172.21.15.6:0/1458965855' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:09:47.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:47.228785+0000 mon.smithi006 (mon.0) 658 : audit [DBG] from='mgr.? 172.21.15.6:0/1458965855' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi006.kskdce/key"}]: dispatch 2024-03-12T16:09:47.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:47.229274+0000 mon.smithi006 (mon.0) 659 : audit [DBG] from='mgr.? 172.21.15.6:0/1458965855' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:09:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:46.543706+0000 mon.smithi006 (mon.0) 652 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd='[{"prefix": "osd pool rename", "format": "json", "srcpool": "device_health_metrics", "destpool": ".mgr", "yes_i_really_mean_it": true}]': finished 2024-03-12T16:09:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:46.543780+0000 mon.smithi006 (mon.0) 653 : cluster [DBG] osdmap e46: 6 total, 6 up, 6 in 2024-03-12T16:09:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:46.545334+0000 mon.smithi006 (mon.0) 654 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-03-12T16:09:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:47.221026+0000 mon.smithi006 (mon.0) 655 : cluster [DBG] Standby manager daemon smithi006.kskdce started 2024-03-12T16:09:47.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:47.223865+0000 mon.smithi006 (mon.0) 656 : audit [DBG] from='mgr.? 172.21.15.6:0/1458965855' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi006.kskdce/crt"}]: dispatch 2024-03-12T16:09:47.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:47.224959+0000 mon.smithi006 (mon.0) 657 : audit [DBG] from='mgr.? 172.21.15.6:0/1458965855' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:09:47.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:47.228785+0000 mon.smithi006 (mon.0) 658 : audit [DBG] from='mgr.? 172.21.15.6:0/1458965855' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi006.kskdce/key"}]: dispatch 2024-03-12T16:09:47.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:47.229274+0000 mon.smithi006 (mon.0) 659 : audit [DBG] from='mgr.? 172.21.15.6:0/1458965855' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:09:48.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:47.484043+0000 mgr.smithi134.gcntfu (mgr.24383) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:09:48.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:47.547372+0000 mon.smithi006 (mon.0) 660 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-12T16:09:48.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:47.547450+0000 mon.smithi006 (mon.0) 661 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-03-12T16:09:48.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:47.557684+0000 mon.smithi006 (mon.0) 662 : cluster [DBG] mgrmap e23: smithi134.gcntfu(active, since 4s), standbys: smithi006.kskdce 2024-03-12T16:09:48.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:47.558901+0000 mon.smithi006 (mon.0) 663 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:09:48.960 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:47.484043+0000 mgr.smithi134.gcntfu (mgr.24383) 9 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:09:48.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:47.547372+0000 mon.smithi006 (mon.0) 660 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-03-12T16:09:48.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:47.547450+0000 mon.smithi006 (mon.0) 661 : cluster [DBG] osdmap e47: 6 total, 6 up, 6 in 2024-03-12T16:09:48.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:47.557684+0000 mon.smithi006 (mon.0) 662 : cluster [DBG] mgrmap e23: smithi134.gcntfu(active, since 4s), standbys: smithi006.kskdce 2024-03-12T16:09:48.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:47.558901+0000 mon.smithi006 (mon.0) 663 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:09:50.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:48.785559+0000 mon.smithi006 (mon.0) 664 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:50.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:48.785559+0000 mon.smithi006 (mon.0) 664 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:49.484345+0000 mgr.smithi134.gcntfu (mgr.24383) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:09:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:49.791924+0000 mon.smithi006 (mon.0) 665 : cluster [DBG] mgrmap e24: smithi134.gcntfu(active, since 6s), standbys: smithi006.kskdce 2024-03-12T16:09:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:50.724724+0000 mon.smithi006 (mon.0) 666 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:50.731127+0000 mon.smithi006 (mon.0) 667 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:51.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:49.484345+0000 mgr.smithi134.gcntfu (mgr.24383) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 79 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:09:51.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:49.791924+0000 mon.smithi006 (mon.0) 665 : cluster [DBG] mgrmap e24: smithi134.gcntfu(active, since 6s), standbys: smithi006.kskdce 2024-03-12T16:09:51.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:50.724724+0000 mon.smithi006 (mon.0) 666 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:51.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:50.731127+0000 mon.smithi006 (mon.0) 667 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:52.454 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:51.450787+0000 mon.smithi006 (mon.0) 668 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:52.455 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:51.484902+0000 mgr.smithi134.gcntfu (mgr.24383) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 3.6 MiB/s wr, 436 op/s 2024-03-12T16:09:52.455 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:51.571025+0000 mon.smithi006 (mon.0) 669 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:52.455 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:51.575256+0000 mon.smithi006 (mon.0) 670 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:52.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:51.450787+0000 mon.smithi006 (mon.0) 668 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:52.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:51.484902+0000 mgr.smithi134.gcntfu (mgr.24383) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 12 KiB/s rd, 3.6 MiB/s wr, 436 op/s 2024-03-12T16:09:52.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:51.571025+0000 mon.smithi006 (mon.0) 669 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:52.494 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:51.575256+0000 mon.smithi006 (mon.0) 670 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:52.645939+0000 mon.smithi006 (mon.0) 671 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-12T16:09:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:53.646755+0000 mon.smithi006 (mon.0) 672 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-12T16:09:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:53.647937+0000 mon.smithi006 (mon.0) 673 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:09:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:53.648127+0000 mon.smithi006 (mon.0) 674 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:09:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:53.651580+0000 mon.smithi006 (mon.0) 675 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:53.654107+0000 mon.smithi006 (mon.0) 676 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:09:54.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:53.654227+0000 mon.smithi006 (mon.0) 677 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:09:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:52.645939+0000 mon.smithi006 (mon.0) 671 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-12T16:09:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:53.646755+0000 mon.smithi006 (mon.0) 672 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-12T16:09:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:53.647937+0000 mon.smithi006 (mon.0) 673 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:09:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:53.648127+0000 mon.smithi006 (mon.0) 674 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:09:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:53.651580+0000 mon.smithi006 (mon.0) 675 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:53.654107+0000 mon.smithi006 (mon.0) 676 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:09:54.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:53.654227+0000 mon.smithi006 (mon.0) 677 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:09:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:53.485286+0000 mgr.smithi134.gcntfu (mgr.24383) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 3.1 MiB/s wr, 378 op/s 2024-03-12T16:09:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:53.652457+0000 mon.smithi134 (mon.1) 16 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-12T16:09:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:54.221524+0000 mon.smithi134 (mon.1) 17 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-12T16:09:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:54.225270+0000 mon.smithi006 (mon.0) 678 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:55.114350+0000 mon.smithi006 (mon.0) 679 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:55.120525+0000 mon.smithi006 (mon.0) 680 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:53.485286+0000 mgr.smithi134.gcntfu (mgr.24383) 12 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 102 MiB data, 2.1 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 3.1 MiB/s wr, 378 op/s 2024-03-12T16:09:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:53.652457+0000 mon.smithi134 (mon.1) 16 : audit [INF] from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-03-12T16:09:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:54.221524+0000 mon.smithi134 (mon.1) 17 : audit [INF] from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-03-12T16:09:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:54.225270+0000 mon.smithi006 (mon.0) 678 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:55.114350+0000 mon.smithi006 (mon.0) 679 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:55.120525+0000 mon.smithi006 (mon.0) 680 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:55.485814+0000 mgr.smithi134.gcntfu (mgr.24383) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 118 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 620 op/s 2024-03-12T16:09:56.614 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:56 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:55.485814+0000 mgr.smithi134.gcntfu (mgr.24383) 13 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 118 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 11 KiB/s rd, 4.9 MiB/s wr, 620 op/s 2024-03-12T16:09:56.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.870+0000 7f4e0cc76700 1 -- 172.21.15.6:0/965566727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 msgr2=0x7f4e080f74f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.870+0000 7f4e0cc76700 1 --2- 172.21.15.6:0/965566727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 0x7f4e080f74f0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7f4dfc0048f0 tx=0x7f4dfc00adc0).stop 2024-03-12T16:09:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.870+0000 7f4e0cc76700 1 -- 172.21.15.6:0/965566727 shutdown_connections 2024-03-12T16:09:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.870+0000 7f4e0cc76700 1 --2- 172.21.15.6:0/965566727 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 0x7f4e080f74f0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.870+0000 7f4e0cc76700 1 --2- 172.21.15.6:0/965566727 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e080f5e70 0x7f4e080f6290 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.870+0000 7f4e0cc76700 1 -- 172.21.15.6:0/965566727 >> 172.21.15.6:0/965566727 conn(0x7f4e080f15d0 msgr2=0x7f4e080f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.870+0000 7f4e0cc76700 1 -- 172.21.15.6:0/965566727 shutdown_connections 2024-03-12T16:09:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.870+0000 7f4e0cc76700 1 -- 172.21.15.6:0/965566727 wait complete. 2024-03-12T16:09:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e0cc76700 1 Processor -- start 2024-03-12T16:09:56.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e0cc76700 1 -- start start 2024-03-12T16:09:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e0cc76700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e080f5e70 0x7f4e081075f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e0cc76700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 0x7f4e08105c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e0cc76700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08107ba0 con 0x7f4e080f7070 2024-03-12T16:09:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e0cc76700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e08106140 con 0x7f4e080f5e70 2024-03-12T16:09:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e05d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 0x7f4e08105c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:56.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e05d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 0x7f4e08105c50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40228/0 (socket says 172.21.15.6:40228) 2024-03-12T16:09:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e0659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e080f5e70 0x7f4e081075f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e05d9b700 1 -- 172.21.15.6:0/2266004979 learned_addr learned my addr 172.21.15.6:0/2266004979 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e05d9b700 1 -- 172.21.15.6:0/2266004979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e080f5e70 msgr2=0x7f4e081075f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e05d9b700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e080f5e70 0x7f4e081075f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.871+0000 7f4e05d9b700 1 -- 172.21.15.6:0/2266004979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4dfc005040 con 0x7f4e080f7070 2024-03-12T16:09:56.874 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.872+0000 7f4e05d9b700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 0x7f4e08105c50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f4dfc014690 tx=0x7f4dfc00adc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.872+0000 7f4df77fe700 1 -- 172.21.15.6:0/2266004979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dfc00f040 con 0x7f4e080f7070 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.872+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e08106360 con 0x7f4e080f7070 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.872+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e08106860 con 0x7f4e080f7070 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.872+0000 7f4df77fe700 1 -- 172.21.15.6:0/2266004979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4dfc00a860 con 0x7f4e080f7070 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.872+0000 7f4df77fe700 1 -- 172.21.15.6:0/2266004979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4dfc01dd00 con 0x7f4e080f7070 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.873+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4de8005150 con 0x7f4e080f7070 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.873+0000 7f4df77fe700 1 -- 172.21.15.6:0/2266004979 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f4dfc0263b0 con 0x7f4e080f7070 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.874+0000 7f4df77fe700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4df0066dc0 0x7f4df0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.874+0000 7f4df77fe700 1 -- 172.21.15.6:0/2266004979 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f4dfc084b00 con 0x7f4e080f7070 2024-03-12T16:09:56.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.874+0000 7f4e0659c700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4df0066dc0 0x7f4df0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:09:56.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.874+0000 7f4e0659c700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4df0066dc0 0x7f4df0069280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4df8004ee0 tx=0x7f4df800b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:56.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:56.879+0000 7f4df77fe700 1 -- 172.21.15.6:0/2266004979 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f4dfc052c70 con 0x7f4e080f7070 2024-03-12T16:09:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.200+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4de8000bf0 con 0x7f4df0066dc0 2024-03-12T16:09:57.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.202+0000 7f4df77fe700 1 -- 172.21.15.6:0/2266004979 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4de8000bf0 con 0x7f4df0066dc0 2024-03-12T16:09:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4df0066dc0 msgr2=0x7f4df0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4df0066dc0 0x7f4df0069280 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f4df8004ee0 tx=0x7f4df800b040).stop 2024-03-12T16:09:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 msgr2=0x7f4e08105c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 0x7f4e08105c50 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f4dfc014690 tx=0x7f4dfc00adc0).stop 2024-03-12T16:09:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 shutdown_connections 2024-03-12T16:09:57.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4df0066dc0 0x7f4df0069280 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e080f5e70 0x7f4e081075f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 --2- 172.21.15.6:0/2266004979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e080f7070 0x7f4e08105c50 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 >> 172.21.15.6:0/2266004979 conn(0x7f4e080f15d0 msgr2=0x7f4e080fab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 shutdown_connections 2024-03-12T16:09:57.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.205+0000 7f4e0cc76700 1 -- 172.21.15.6:0/2266004979 wait complete. 2024-03-12T16:09:57.221 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:09:57.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.345+0000 7fe6072b2700 1 -- 172.21.15.6:0/2331373234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f6710 msgr2=0x7fe6000f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.345+0000 7fe6072b2700 1 --2- 172.21.15.6:0/2331373234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f6710 0x7fe6000f6b30 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fe5fc004930 tx=0x7fe5fc00bec0).stop 2024-03-12T16:09:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.346+0000 7fe6072b2700 1 -- 172.21.15.6:0/2331373234 shutdown_connections 2024-03-12T16:09:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.346+0000 7fe6072b2700 1 --2- 172.21.15.6:0/2331373234 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6000f79b0 0x7fe6000f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.346+0000 7fe6072b2700 1 --2- 172.21.15.6:0/2331373234 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f6710 0x7fe6000f6b30 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.346+0000 7fe6072b2700 1 -- 172.21.15.6:0/2331373234 >> 172.21.15.6:0/2331373234 conn(0x7fe6000f1e70 msgr2=0x7fe6000f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.346+0000 7fe6072b2700 1 -- 172.21.15.6:0/2331373234 shutdown_connections 2024-03-12T16:09:57.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.346+0000 7fe6072b2700 1 -- 172.21.15.6:0/2331373234 wait complete. 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe6072b2700 1 Processor -- start 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe6072b2700 1 -- start start 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe6072b2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6000f6710 0x7fe60006a8e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe6072b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f79b0 0x7fe600067330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe6072b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600067820 con 0x7fe6000f79b0 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe6072b2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe600067960 con 0x7fe6000f6710 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe60484d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f79b0 0x7fe600067330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe60484d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f79b0 0x7fe600067330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40250/0 (socket says 172.21.15.6:40250) 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe60484d700 1 -- 172.21.15.6:0/118051650 learned_addr learned my addr 172.21.15.6:0/118051650 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.347+0000 7fe60504e700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6000f6710 0x7fe60006a8e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:57.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.348+0000 7fe60484d700 1 -- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6000f6710 msgr2=0x7fe60006a8e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.348+0000 7fe60484d700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6000f6710 0x7fe60006a8e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.348+0000 7fe60484d700 1 -- 172.21.15.6:0/118051650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5f0005040 con 0x7fe6000f79b0 2024-03-12T16:09:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.348+0000 7fe60484d700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f79b0 0x7fe600067330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe5f0009380 tx=0x7fe5f0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.348+0000 7fe5f6777700 1 -- 172.21.15.6:0/118051650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f000e560 con 0x7fe6000f79b0 2024-03-12T16:09:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.348+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5fc005040 con 0x7fe6000f79b0 2024-03-12T16:09:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.348+0000 7fe5f6777700 1 -- 172.21.15.6:0/118051650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5f000f040 con 0x7fe6000f79b0 2024-03-12T16:09:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.348+0000 7fe5f6777700 1 -- 172.21.15.6:0/118051650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5f0014b00 con 0x7fe6000f79b0 2024-03-12T16:09:57.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.348+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe60011ca30 con 0x7fe6000f79b0 2024-03-12T16:09:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.349+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe6000fdc10 con 0x7fe6000f79b0 2024-03-12T16:09:57.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.350+0000 7fe5f6777700 1 -- 172.21.15.6:0/118051650 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fe5f000e6c0 con 0x7fe6000f79b0 2024-03-12T16:09:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.351+0000 7fe5f6777700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe5ec066e10 0x7fe5ec0692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.351+0000 7fe5f6777700 1 -- 172.21.15.6:0/118051650 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fe5f0083eb0 con 0x7fe6000f79b0 2024-03-12T16:09:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.351+0000 7fe60504e700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe5ec066e10 0x7fe5ec0692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:09:57.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.352+0000 7fe60504e700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe5ec066e10 0x7fe5ec0692d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe5fc004900 tx=0x7fe5fc017040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:57.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.357+0000 7fe5f6777700 1 -- 172.21.15.6:0/118051650 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fe5f0051e90 con 0x7fe6000f79b0 2024-03-12T16:09:57.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.699+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe600059120 con 0x7fe5ec066e10 2024-03-12T16:09:57.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.701+0000 7fe5f6777700 1 -- 172.21.15.6:0/118051650 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fe600059120 con 0x7fe5ec066e10 2024-03-12T16:09:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe5ec066e10 msgr2=0x7fe5ec0692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe5ec066e10 0x7fe5ec0692d0 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fe5fc004900 tx=0x7fe5fc017040).stop 2024-03-12T16:09:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f79b0 msgr2=0x7fe600067330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f79b0 0x7fe600067330 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7fe5f0009380 tx=0x7fe5f0009cb0).stop 2024-03-12T16:09:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 shutdown_connections 2024-03-12T16:09:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe5ec066e10 0x7fe5ec0692d0 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe6000f6710 0x7fe60006a8e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 --2- 172.21.15.6:0/118051650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe6000f79b0 0x7fe600067330 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 >> 172.21.15.6:0/118051650 conn(0x7fe6000f1e70 msgr2=0x7fe6000f8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 shutdown_connections 2024-03-12T16:09:57.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.703+0000 7fe6072b2700 1 -- 172.21.15.6:0/118051650 wait complete. 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.843+0000 7f46384a6700 1 -- 172.21.15.6:0/187126721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 msgr2=0x7f46300f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.843+0000 7f46384a6700 1 --2- 172.21.15.6:0/187126721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 0x7f46300f8f00 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f46200047f0 tx=0x7f4620009cb0).stop 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.843+0000 7f46384a6700 1 -- 172.21.15.6:0/187126721 shutdown_connections 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.843+0000 7f46384a6700 1 --2- 172.21.15.6:0/187126721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 0x7f46300f8f00 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.843+0000 7f46384a6700 1 --2- 172.21.15.6:0/187126721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46300f7800 0x7f46300f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.843+0000 7f46384a6700 1 -- 172.21.15.6:0/187126721 >> 172.21.15.6:0/187126721 conn(0x7f46300f2f80 msgr2=0x7f46300f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.843+0000 7f46384a6700 1 -- 172.21.15.6:0/187126721 shutdown_connections 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.843+0000 7f46384a6700 1 -- 172.21.15.6:0/187126721 wait complete. 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f46384a6700 1 Processor -- start 2024-03-12T16:09:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f46384a6700 1 -- start start 2024-03-12T16:09:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f46384a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46300f7800 0x7f4630107fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f46384a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 0x7f46301084a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f46384a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630108ae0 con 0x7f46300f8aa0 2024-03-12T16:09:57.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f46384a6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4630108c20 con 0x7f46300f7800 2024-03-12T16:09:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f4635a41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 0x7f46301084a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f4635a41700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 0x7f46301084a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40272/0 (socket says 172.21.15.6:40272) 2024-03-12T16:09:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f4635a41700 1 -- 172.21.15.6:0/3343416799 learned_addr learned my addr 172.21.15.6:0/3343416799 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.844+0000 7f4636242700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46300f7800 0x7f4630107fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.845+0000 7f4635a41700 1 -- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46300f7800 msgr2=0x7f4630107fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:57.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.845+0000 7f4635a41700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46300f7800 0x7f4630107fb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.845+0000 7f4635a41700 1 -- 172.21.15.6:0/3343416799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4620005040 con 0x7f46300f8aa0 2024-03-12T16:09:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.845+0000 7f4635a41700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 0x7f46301084a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f462000b120 tx=0x7f4620009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.845+0000 7f46277fe700 1 -- 172.21.15.6:0/3343416799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f462000e030 con 0x7f46300f8aa0 2024-03-12T16:09:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.845+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f463010d660 con 0x7f46300f8aa0 2024-03-12T16:09:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.845+0000 7f46277fe700 1 -- 172.21.15.6:0/3343416799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4620007e90 con 0x7f46300f8aa0 2024-03-12T16:09:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.845+0000 7f46277fe700 1 -- 172.21.15.6:0/3343416799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4620018070 con 0x7f46300f8aa0 2024-03-12T16:09:57.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.846+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f463010db40 con 0x7f46300f8aa0 2024-03-12T16:09:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.846+0000 7f46277fe700 1 -- 172.21.15.6:0/3343416799 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f462001d420 con 0x7f46300f8aa0 2024-03-12T16:09:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.847+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4630100060 con 0x7f46300f8aa0 2024-03-12T16:09:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.847+0000 7f46277fe700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f461c066da0 0x7f461c069260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.847+0000 7f46277fe700 1 -- 172.21.15.6:0/3343416799 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f4620085310 con 0x7f46300f8aa0 2024-03-12T16:09:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.847+0000 7f4636242700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f461c066da0 0x7f461c069260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:09:57.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.848+0000 7f4636242700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f461c066da0 0x7f461c069260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f462c006fd0 tx=0x7f462c009060).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:57.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:57.854+0000 7f46277fe700 1 -- 172.21.15.6:0/3343416799 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f4620053540 con 0x7f46300f8aa0 2024-03-12T16:09:58.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.173+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f4630059120 con 0x7f461c066da0 2024-03-12T16:09:58.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.187+0000 7f46277fe700 1 -- 172.21.15.6:0/3343416799 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f4630059120 con 0x7f461c066da0 2024-03-12T16:09:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:09:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (5m) 5s ago 7m 24.4M - 0.23.0 ba2b418f427c 869c486ed5f2 2024-03-12T16:09:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (7m) 5s ago 7m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:09:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (7m) 7s ago 7m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:09:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (5m) 5s ago 7m 53.7M - 8.3.5 dad864ee21e9 7deda4319993 2024-03-12T16:09:58.189 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (2m) 5s ago 2m 86.1M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:09:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (2m) 5s ago 2m 12.7M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:09:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (2m) 7s ago 2m 56.5M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:09:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (2m) 7s ago 2m 15.3M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:09:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:9283 running (9m) 5s ago 9m 358M - 16.2.15-1-g8963e9de 727f386679cb f09ce35a51f8 2024-03-12T16:09:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283 running (23s) 7s ago 7m 477M - 18.2.2-797-g49e4a679 72a574b3d6f5 4b7738c64f1d 2024-03-12T16:09:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (9m) 5s ago 9m 47.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:09:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (6m) 7s ago 6m 40.3M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:09:58.190 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (7m) 5s ago 7m 21.5M - 1.3.1 1dbe0e931976 ef9d95e31974 2024-03-12T16:09:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 7s ago 6m 23.0M - 1.3.1 1dbe0e931976 ee7621f16bde 2024-03-12T16:09:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (6m) 5s ago 6m 81.0M 4642M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:09:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (6m) 5s ago 6m 87.9M 4642M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:09:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (5m) 5s ago 5m 74.3M 4642M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:09:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (5m) 7s ago 5m 84.5M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:09:58.191 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (4m) 7s ago 4m 83.7M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:09:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (4m) 7s ago 4m 78.8M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:09:58.192 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 7s ago 5m 66.2M - 2.33.4 514e6a882f6e 344ddc812ba0 2024-03-12T16:09:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f461c066da0 msgr2=0x7f461c069260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f461c066da0 0x7f461c069260 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f462c006fd0 tx=0x7f462c009060).stop 2024-03-12T16:09:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 msgr2=0x7f46301084a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:58.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 0x7f46301084a0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f462000b120 tx=0x7f4620009cb0).stop 2024-03-12T16:09:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 shutdown_connections 2024-03-12T16:09:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f461c066da0 0x7f461c069260 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46300f7800 0x7f4630107fb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 --2- 172.21.15.6:0/3343416799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46300f8aa0 0x7f46301084a0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 >> 172.21.15.6:0/3343416799 conn(0x7f46300f2f80 msgr2=0x7f46300fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 shutdown_connections 2024-03-12T16:09:58.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.190+0000 7f46384a6700 1 -- 172.21.15.6:0/3343416799 wait complete. 2024-03-12T16:09:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.340+0000 7fbf3394f700 1 -- 172.21.15.6:0/3654159977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f97f0 msgr2=0x7fbf2c0f5970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:58.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.340+0000 7fbf3394f700 1 --2- 172.21.15.6:0/3654159977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f97f0 0x7fbf2c0f5970 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7fbf1c004730 tx=0x7fbf1c009cb0).stop 2024-03-12T16:09:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.340+0000 7fbf3394f700 1 -- 172.21.15.6:0/3654159977 shutdown_connections 2024-03-12T16:09:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.340+0000 7fbf3394f700 1 --2- 172.21.15.6:0/3654159977 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f97f0 0x7fbf2c0f5970 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.340+0000 7fbf3394f700 1 --2- 172.21.15.6:0/3654159977 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf2c0f8e50 0x7fbf2c0f9270 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.340+0000 7fbf3394f700 1 -- 172.21.15.6:0/3654159977 >> 172.21.15.6:0/3654159977 conn(0x7fbf2c0f15d0 msgr2=0x7fbf2c0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.340+0000 7fbf3394f700 1 -- 172.21.15.6:0/3654159977 shutdown_connections 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.340+0000 7fbf3394f700 1 -- 172.21.15.6:0/3654159977 wait complete. 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.341+0000 7fbf3394f700 1 Processor -- start 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.341+0000 7fbf3394f700 1 -- start start 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.341+0000 7fbf3394f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f8e50 0x7fbf2c0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.341+0000 7fbf3394f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf2c0f97f0 0x7fbf2c0f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.341+0000 7fbf3394f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c0f8af0 con 0x7fbf2c0f8e50 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.341+0000 7fbf3394f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbf2c10bd10 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.342+0000 7fbf316eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f8e50 0x7fbf2c0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.342+0000 7fbf30eea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf2c0f97f0 0x7fbf2c0f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.342+0000 7fbf316eb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f8e50 0x7fbf2c0f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40288/0 (socket says 172.21.15.6:40288) 2024-03-12T16:09:58.343 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.342+0000 7fbf316eb700 1 -- 172.21.15.6:0/3235107332 learned_addr learned my addr 172.21.15.6:0/3235107332 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.342+0000 7fbf30eea700 1 -- 172.21.15.6:0/3235107332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f8e50 msgr2=0x7fbf2c0f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.342+0000 7fbf30eea700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f8e50 0x7fbf2c0f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.342+0000 7fbf30eea700 1 -- 172.21.15.6:0/3235107332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbf1c005040 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.342+0000 7fbf316eb700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f8e50 0x7fbf2c0f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:09:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.342+0000 7fbf30eea700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf2c0f97f0 0x7fbf2c0f6ba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbf1c004650 tx=0x7fbf1c00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.343+0000 7fbf227fc700 1 -- 172.21.15.6:0/3235107332 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf1c019070 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.343+0000 7fbf227fc700 1 -- 172.21.15.6:0/3235107332 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbf1c013e70 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.343+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbf2c10bf30 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.344 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.343+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbf2c0f7460 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.343+0000 7fbf227fc700 1 -- 172.21.15.6:0/3235107332 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbf1c01ecb0 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.344+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbf10005150 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.345+0000 7fbf227fc700 1 -- 172.21.15.6:0/3235107332 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fbf1c01e420 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.345+0000 7fbf227fc700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fbf18066dc0 0x7fbf18069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:58.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.345+0000 7fbf227fc700 1 -- 172.21.15.6:0/3235107332 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fbf1c0850a0 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.346+0000 7fbf316eb700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fbf18066dc0 0x7fbf18069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:09:58.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.346+0000 7fbf316eb700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fbf18066dc0 0x7fbf18069280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbf280041d0 tx=0x7fbf2800b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:58.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.350+0000 7fbf227fc700 1 -- 172.21.15.6:0/3235107332 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fbf1c0531c0 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:57.202186+0000 mgr.smithi134.gcntfu (mgr.24383) 14 : audit [DBG] from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:57.486184+0000 mgr.smithi134.gcntfu (mgr.24383) 15 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 118 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 4.4 MiB/s wr, 554 op/s 2024-03-12T16:09:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:57.556557+0000 mon.smithi006 (mon.0) 681 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:57.563487+0000 mon.smithi006 (mon.0) 682 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:57.564981+0000 mon.smithi006 (mon.0) 683 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:57.566090+0000 mon.smithi006 (mon.0) 684 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:57.567190+0000 mon.smithi006 (mon.0) 685 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:58.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:57.568304+0000 mgr.smithi134.gcntfu (mgr.24383) 16 : cephadm [INF] Adjusting osd_memory_target on smithi134 to 2251M 2024-03-12T16:09:58.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:57.573953+0000 mon.smithi006 (mon.0) 686 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:58.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:57.700977+0000 mgr.smithi134.gcntfu (mgr.24383) 17 : audit [DBG] from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:58.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.789+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbf10005af0 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.789+0000 7fbf227fc700 1 -- 172.21.15.6:0/3235107332 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+848 (secure 0 0 0) 0x7fbf1c052db0 con 0x7fbf2c0f97f0 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:09:58.791 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:09:58.792 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:09:58.792 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:09:58.792 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:09:58.792 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-03-12T16:09:58.792 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:09:58.792 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:09:58.792 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fbf18066dc0 msgr2=0x7fbf18069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fbf18066dc0 0x7fbf18069280 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fbf280041d0 tx=0x7fbf2800b040).stop 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf2c0f97f0 msgr2=0x7fbf2c0f6ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf2c0f97f0 0x7fbf2c0f6ba0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7fbf1c004650 tx=0x7fbf1c00b040).stop 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 shutdown_connections 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fbf18066dc0 0x7fbf18069280 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbf2c0f8e50 0x7fbf2c0f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 --2- 172.21.15.6:0/3235107332 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbf2c0f97f0 0x7fbf2c0f6ba0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 >> 172.21.15.6:0/3235107332 conn(0x7fbf2c0f15d0 msgr2=0x7fbf2c0fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 shutdown_connections 2024-03-12T16:09:58.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.792+0000 7fbf3394f700 1 -- 172.21.15.6:0/3235107332 wait complete. 2024-03-12T16:09:58.948 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.947+0000 7f300d1da700 1 -- 172.21.15.6:0/1577098979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30080f8e50 msgr2=0x7f30080f9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.947+0000 7f300d1da700 1 --2- 172.21.15.6:0/1577098979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30080f8e50 0x7f30080f9270 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f2ff80047f0 tx=0x7f2ff8009cb0).stop 2024-03-12T16:09:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.947+0000 7f300d1da700 1 -- 172.21.15.6:0/1577098979 shutdown_connections 2024-03-12T16:09:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.947+0000 7f300d1da700 1 --2- 172.21.15.6:0/1577098979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30080f97f0 0x7f30080f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.947+0000 7f300d1da700 1 --2- 172.21.15.6:0/1577098979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30080f8e50 0x7f30080f9270 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.947+0000 7f300d1da700 1 -- 172.21.15.6:0/1577098979 >> 172.21.15.6:0/1577098979 conn(0x7f30080f15d0 msgr2=0x7f30080f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.947+0000 7f300d1da700 1 -- 172.21.15.6:0/1577098979 shutdown_connections 2024-03-12T16:09:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.947+0000 7f300d1da700 1 -- 172.21.15.6:0/1577098979 wait complete. 2024-03-12T16:09:58.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.948+0000 7f300d1da700 1 Processor -- start 2024-03-12T16:09:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.948+0000 7f300d1da700 1 -- start start 2024-03-12T16:09:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f300d1da700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30080f8e50 0x7f300810a300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f300d1da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30080f97f0 0x7f300810a7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f300d1da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300810ada0 con 0x7f30080f97f0 2024-03-12T16:09:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f300d1da700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f300810aee0 con 0x7f30080f8e50 2024-03-12T16:09:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f3006d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30080f8e50 0x7f300810a300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:58.950 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f300659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30080f97f0 0x7f300810a7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:09:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f3006d9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30080f8e50 0x7f300810a300 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:35286/0 (socket says 172.21.15.6:35286) 2024-03-12T16:09:58.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f3006d9d700 1 -- 172.21.15.6:0/940623649 learned_addr learned my addr 172.21.15.6:0/940623649 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:57.202186+0000 mgr.smithi134.gcntfu (mgr.24383) 14 : audit [DBG] from='client.14586 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:57.486184+0000 mgr.smithi134.gcntfu (mgr.24383) 15 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 118 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 4.4 MiB/s wr, 554 op/s 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:57.556557+0000 mon.smithi006 (mon.0) 681 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:57.563487+0000 mon.smithi006 (mon.0) 682 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:57.564981+0000 mon.smithi006 (mon.0) 683 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:57.566090+0000 mon.smithi006 (mon.0) 684 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:57.567190+0000 mon.smithi006 (mon.0) 685 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:57.568304+0000 mgr.smithi134.gcntfu (mgr.24383) 16 : cephadm [INF] Adjusting osd_memory_target on smithi134 to 2251M 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:57.573953+0000 mon.smithi006 (mon.0) 686 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:57.700977+0000 mgr.smithi134.gcntfu (mgr.24383) 17 : audit [DBG] from='client.14590 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f3006d9d700 1 -- 172.21.15.6:0/940623649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30080f97f0 msgr2=0x7f300810a7f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.949+0000 7f3006d9d700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30080f97f0 0x7f300810a7f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.950+0000 7f3006d9d700 1 -- 172.21.15.6:0/940623649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ff8005040 con 0x7f30080f8e50 2024-03-12T16:09:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.950+0000 7f300659c700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30080f97f0 0x7f300810a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:09:58.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.950+0000 7f3006d9d700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30080f8e50 0x7f300810a300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2ff8000c00 tx=0x7f2ff8009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.950+0000 7f2feffff700 1 -- 172.21.15.6:0/940623649 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff8018070 con 0x7f30080f8e50 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.950+0000 7f2feffff700 1 -- 172.21.15.6:0/940623649 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ff8007e90 con 0x7f30080f8e50 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.950+0000 7f2feffff700 1 -- 172.21.15.6:0/940623649 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ff8012620 con 0x7f30080f8e50 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.950+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f300810f880 con 0x7f30080f8e50 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.950+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f300810fe40 con 0x7f30080f8e50 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.951+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30080f7f90 con 0x7f30080f8e50 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.952+0000 7f2feffff700 1 -- 172.21.15.6:0/940623649 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f2ff801d960 con 0x7f30080f8e50 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.952+0000 7f2feffff700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ff0066dc0 0x7f2ff0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.953+0000 7f2feffff700 1 -- 172.21.15.6:0/940623649 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f2ff8085020 con 0x7f30080f8e50 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.953+0000 7f300659c700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ff0066dc0 0x7f2ff0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:09:58.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.954+0000 7f300659c700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ff0066dc0 0x7f2ff0069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2ffc007bf0 tx=0x7f2ffc00b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:09:58.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:58.960+0000 7f2feffff700 1 -- 172.21.15.6:0/940623649 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f2ff8053140 con 0x7f30080f8e50 2024-03-12T16:09:59.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.284+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3008110510 con 0x7f2ff0066dc0 2024-03-12T16:09:59.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.286+0000 7f2feffff700 1 -- 172.21.15.6:0/940623649 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f3008110510 con 0x7f2ff0066dc0 2024-03-12T16:09:59.288 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:09:59.288 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:09:59.288 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:09:59.289 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-12T16:09:59.289 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [], 2024-03-12T16:09:59.289 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "1/2 daemons upgraded", 2024-03-12T16:09:59.289 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2024-03-12T16:09:59.289 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:09:59.289 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:09:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.290+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ff0066dc0 msgr2=0x7f2ff0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.290+0000 7f300d1da700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ff0066dc0 0x7f2ff0069280 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f2ffc007bf0 tx=0x7f2ffc00b040).stop 2024-03-12T16:09:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.290+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30080f8e50 msgr2=0x7f300810a300 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:09:59.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.290+0000 7f300d1da700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30080f8e50 0x7f300810a300 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f2ff8000c00 tx=0x7f2ff8009cb0).stop 2024-03-12T16:09:59.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.291+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 shutdown_connections 2024-03-12T16:09:59.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.291+0000 7f300d1da700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ff0066dc0 0x7f2ff0069280 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:59.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.291+0000 7f300d1da700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30080f8e50 0x7f300810a300 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:59.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.291+0000 7f300d1da700 1 --2- 172.21.15.6:0/940623649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30080f97f0 0x7f300810a7f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:09:59.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.291+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 >> 172.21.15.6:0/940623649 conn(0x7f30080f15d0 msgr2=0x7f30080f3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:09:59.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.291+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 shutdown_connections 2024-03-12T16:09:59.292 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:09:59.291+0000 7f300d1da700 1 -- 172.21.15.6:0/940623649 wait complete. 2024-03-12T16:09:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:58.174508+0000 mgr.smithi134.gcntfu (mgr.24383) 18 : audit [DBG] from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:58.718792+0000 mon.smithi006 (mon.0) 687 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:09:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:58.790008+0000 mon.smithi134 (mon.1) 18 : audit [DBG] from='client.? 172.21.15.6:0/3235107332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:09:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:59.145764+0000 mon.smithi006 (mon.0) 688 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:59.151510+0000 mon.smithi006 (mon.0) 689 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:59.152840+0000 mon.smithi006 (mon.0) 690 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:59.153853+0000 mon.smithi006 (mon.0) 691 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:59.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:59.154624+0000 mon.smithi006 (mon.0) 692 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:59.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:59.160345+0000 mon.smithi006 (mon.0) 693 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:59.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:59.161505+0000 mon.smithi006 (mon.0) 694 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:09:59.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:09:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:59.162512+0000 mon.smithi006 (mon.0) 695 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:58.174508+0000 mgr.smithi134.gcntfu (mgr.24383) 18 : audit [DBG] from='client.14594 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:58.718792+0000 mon.smithi006 (mon.0) 687 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:58.790008+0000 mon.smithi134 (mon.1) 18 : audit [DBG] from='client.? 172.21.15.6:0/3235107332' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:59.145764+0000 mon.smithi006 (mon.0) 688 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:59.151510+0000 mon.smithi006 (mon.0) 689 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:59.152840+0000 mon.smithi006 (mon.0) 690 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:59.153853+0000 mon.smithi006 (mon.0) 691 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:59.154624+0000 mon.smithi006 (mon.0) 692 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:59.160345+0000 mon.smithi006 (mon.0) 693 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:59.161505+0000 mon.smithi006 (mon.0) 694 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:09:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:09:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:59.162512+0000 mon.smithi006 (mon.0) 695 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:10:00.856 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:59.155123+0000 mgr.smithi134.gcntfu (mgr.24383) 19 : cephadm [INF] Adjusting osd_memory_target on smithi006 to 1911M 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:59.163668+0000 mgr.smithi134.gcntfu (mgr.24383) 20 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:59.163847+0000 mgr.smithi134.gcntfu (mgr.24383) 21 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:09:59.285813+0000 mgr.smithi134.gcntfu (mgr.24383) 22 : audit [DBG] from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:59.478336+0000 mgr.smithi134.gcntfu (mgr.24383) 23 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:59.478472+0000 mgr.smithi134.gcntfu (mgr.24383) 24 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:09:59.486573+0000 mgr.smithi134.gcntfu (mgr.24383) 25 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 118 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 8.4 KiB/s rd, 3.7 MiB/s wr, 464 op/s 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:59.792769+0000 mgr.smithi134.gcntfu (mgr.24383) 26 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:09:59.794360+0000 mgr.smithi134.gcntfu (mgr.24383) 27 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:00.000121+0000 mon.smithi006 (mon.0) 696 : cluster [INF] overall HEALTH_OK 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:00.426119+0000 mon.smithi006 (mon.0) 697 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:00.429428+0000 mon.smithi006 (mon.0) 698 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:00.433993+0000 mon.smithi006 (mon.0) 699 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:00.857 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:00.438361+0000 mon.smithi006 (mon.0) 700 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:00.858 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:00.443146+0000 mon.smithi006 (mon.0) 701 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:59.155123+0000 mgr.smithi134.gcntfu (mgr.24383) 19 : cephadm [INF] Adjusting osd_memory_target on smithi006 to 1911M 2024-03-12T16:10:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:59.163668+0000 mgr.smithi134.gcntfu (mgr.24383) 20 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:10:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:59.163847+0000 mgr.smithi134.gcntfu (mgr.24383) 21 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:10:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:09:59.285813+0000 mgr.smithi134.gcntfu (mgr.24383) 22 : audit [DBG] from='client.24431 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:59.478336+0000 mgr.smithi134.gcntfu (mgr.24383) 23 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:10:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:59.478472+0000 mgr.smithi134.gcntfu (mgr.24383) 24 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:10:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:09:59.486573+0000 mgr.smithi134.gcntfu (mgr.24383) 25 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 118 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 8.4 KiB/s rd, 3.7 MiB/s wr, 464 op/s 2024-03-12T16:10:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:59.792769+0000 mgr.smithi134.gcntfu (mgr.24383) 26 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:10:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:09:59.794360+0000 mgr.smithi134.gcntfu (mgr.24383) 27 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:10:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:00.000121+0000 mon.smithi006 (mon.0) 696 : cluster [INF] overall HEALTH_OK 2024-03-12T16:10:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:00.426119+0000 mon.smithi006 (mon.0) 697 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:00.429428+0000 mon.smithi006 (mon.0) 698 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:00.433993+0000 mon.smithi006 (mon.0) 699 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:00.438361+0000 mon.smithi006 (mon.0) 700 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:00.443146+0000 mon.smithi006 (mon.0) 701 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:10:00.107194+0000 mgr.smithi134.gcntfu (mgr.24383) 28 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:10:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:10:00.109556+0000 mgr.smithi134.gcntfu (mgr.24383) 29 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:10:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:00.578778+0000 mon.smithi006 (mon.0) 702 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:00.582502+0000 mon.smithi006 (mon.0) 703 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:00.587370+0000 mon.smithi006 (mon.0) 704 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:00.590744+0000 mon.smithi006 (mon.0) 705 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:10:00.591625+0000 mgr.smithi134.gcntfu (mgr.24383) 30 : cephadm [INF] Reconfiguring alertmanager.smithi006 (dependencies changed)... 2024-03-12T16:10:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:10:00.605514+0000 mgr.smithi134.gcntfu (mgr.24383) 31 : cephadm [INF] Reconfiguring daemon alertmanager.smithi006 on smithi006 2024-03-12T16:10:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:10:00.107194+0000 mgr.smithi134.gcntfu (mgr.24383) 28 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:10:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:10:00.109556+0000 mgr.smithi134.gcntfu (mgr.24383) 29 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:10:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:00.578778+0000 mon.smithi006 (mon.0) 702 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:00.582502+0000 mon.smithi006 (mon.0) 703 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:00.587370+0000 mon.smithi006 (mon.0) 704 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:00.590744+0000 mon.smithi006 (mon.0) 705 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:10:00.591625+0000 mgr.smithi134.gcntfu (mgr.24383) 30 : cephadm [INF] Reconfiguring alertmanager.smithi006 (dependencies changed)... 2024-03-12T16:10:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:10:00.605514+0000 mgr.smithi134.gcntfu (mgr.24383) 31 : cephadm [INF] Reconfiguring daemon alertmanager.smithi006 on smithi006 2024-03-12T16:10:02.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:01.487090+0000 mgr.smithi134.gcntfu (mgr.24383) 32 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 140 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 8.3 KiB/s rd, 5.6 MiB/s wr, 656 op/s 2024-03-12T16:10:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:01.487090+0000 mgr.smithi134.gcntfu (mgr.24383) 32 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 140 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 8.3 KiB/s rd, 5.6 MiB/s wr, 656 op/s 2024-03-12T16:10:04.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:03.487414+0000 mgr.smithi134.gcntfu (mgr.24383) 33 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 140 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3.5 MiB/s wr, 404 op/s 2024-03-12T16:10:04.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:03.487414+0000 mgr.smithi134.gcntfu (mgr.24383) 33 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 140 MiB data, 2.2 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 3.5 MiB/s wr, 404 op/s 2024-03-12T16:10:06.897 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:05.487913+0000 mgr.smithi134.gcntfu (mgr.24383) 34 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 5.7 MiB/s wr, 608 op/s 2024-03-12T16:10:06.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:05.487913+0000 mgr.smithi134.gcntfu (mgr.24383) 34 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 1.5 KiB/s rd, 5.7 MiB/s wr, 608 op/s 2024-03-12T16:10:08.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:07.488277+0000 mgr.smithi134.gcntfu (mgr.24383) 35 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 398 op/s 2024-03-12T16:10:08.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:07.488277+0000 mgr.smithi134.gcntfu (mgr.24383) 35 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 398 op/s 2024-03-12T16:10:10.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:10 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:09.488621+0000 mgr.smithi134.gcntfu (mgr.24383) 36 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 398 op/s 2024-03-12T16:10:10.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:10 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:09.488621+0000 mgr.smithi134.gcntfu (mgr.24383) 36 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 165 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 4.1 MiB/s wr, 398 op/s 2024-03-12T16:10:12.872 INFO:tasks.workunit.client.0.smithi006.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-12T16:10:12.878 INFO:tasks.workunit.client.0.smithi006.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-12T16:10:12.878 INFO:tasks.workunit.client.0.smithi006.stderr:+ make 2024-03-12T16:10:12.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:12 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:11.489161+0000 mgr.smithi134.gcntfu (mgr.24383) 37 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 603 op/s 2024-03-12T16:10:12.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:11.489161+0000 mgr.smithi134.gcntfu (mgr.24383) 37 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 6.5 MiB/s wr, 603 op/s 2024-03-12T16:10:13.415 INFO:tasks.workunit.client.0.smithi006.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-12T16:10:14.270 INFO:tasks.workunit.client.1.smithi134.stderr:+ pushd ltp-full-20091231/testcases/kernel/fs/fsstress 2024-03-12T16:10:14.279 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress ~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-12T16:10:14.279 INFO:tasks.workunit.client.1.smithi134.stderr:+ make 2024-03-12T16:10:14.596 INFO:tasks.workunit.client.1.smithi134.stdout:cc -DNO_XFS -I/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress -D_LARGEFILE64_SOURCE -D_GNU_SOURCE -I../../../../include -I../../../../include -L../../../../lib fsstress.c -o fsstress 2024-03-12T16:10:14.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:13.415358+0000 mon.smithi006 (mon.0) 706 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:14.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:13.423049+0000 mon.smithi006 (mon.0) 707 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:14.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:10:13.449730+0000 mgr.smithi134.gcntfu (mgr.24383) 38 : cephadm [INF] Reconfiguring grafana.smithi006 (dependencies changed)... 2024-03-12T16:10:14.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:10:13.463790+0000 mgr.smithi134.gcntfu (mgr.24383) 39 : cephadm [INF] Reconfiguring daemon grafana.smithi006 on smithi006 2024-03-12T16:10:14.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:13.489414+0000 mgr.smithi134.gcntfu (mgr.24383) 40 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 409 op/s 2024-03-12T16:10:14.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:13.719045+0000 mon.smithi006 (mon.0) 708 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:10:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:13.415358+0000 mon.smithi006 (mon.0) 706 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:13.423049+0000 mon.smithi006 (mon.0) 707 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:10:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:10:13.449730+0000 mgr.smithi134.gcntfu (mgr.24383) 38 : cephadm [INF] Reconfiguring grafana.smithi006 (dependencies changed)... 2024-03-12T16:10:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:10:13.463790+0000 mgr.smithi134.gcntfu (mgr.24383) 39 : cephadm [INF] Reconfiguring daemon grafana.smithi006 on smithi006 2024-03-12T16:10:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:13.489414+0000 mgr.smithi134.gcntfu (mgr.24383) 40 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 192 MiB data, 2.4 GiB used, 534 GiB / 536 GiB avail; 4.6 MiB/s wr, 409 op/s 2024-03-12T16:10:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:13.719045+0000 mon.smithi006 (mon.0) 708 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:10:15.903 INFO:tasks.workunit.client.0.smithi006.stderr:++ readlink -f fsstress 2024-03-12T16:10:15.904 INFO:tasks.workunit.client.0.smithi006.stderr:+ BIN=/home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-12T16:10:15.904 INFO:tasks.workunit.client.0.smithi006.stderr:+ popd 2024-03-12T16:10:15.905 INFO:tasks.workunit.client.0.smithi006.stdout:~/cephtest/mnt.0/client.0/tmp/fsstress ~/cephtest/mnt.0/client.0/tmp 2024-03-12T16:10:15.905 INFO:tasks.workunit.client.0.smithi006.stderr:+ popd 2024-03-12T16:10:15.906 INFO:tasks.workunit.client.0.smithi006.stdout:~/cephtest/mnt.0/client.0/tmp 2024-03-12T16:10:15.906 INFO:tasks.workunit.client.0.smithi006.stderr:++ mktemp -d -p . 2024-03-12T16:10:15.908 INFO:tasks.workunit.client.0.smithi006.stderr:+ T=./tmp.WO8IEPd7Zv 2024-03-12T16:10:15.908 INFO:tasks.workunit.client.0.smithi006.stderr:+ /home/ubuntu/cephtest/mnt.0/client.0/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.WO8IEPd7Zv -l 1 -n 1000 -p 10 -v 2024-03-12T16:10:15.912 INFO:tasks.workunit.client.0.smithi006.stdout:seed = 1711117049 2024-03-12T16:10:15.917 INFO:tasks.workunit.client.0.smithi006.stdout:0/0: link - no file 2024-03-12T16:10:15.917 INFO:tasks.workunit.client.0.smithi006.stdout:0/1: dread - no filename 2024-03-12T16:10:15.917 INFO:tasks.workunit.client.0.smithi006.stdout:0/2: write - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/3: write - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/4: dread - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/5: write - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/6: dread - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/7: fsync - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/8: dwrite - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/9: readlink - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/10: write - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/11: dread - no filename 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/12: rmdir - no directory 2024-03-12T16:10:15.918 INFO:tasks.workunit.client.0.smithi006.stdout:0/13: chown . 140572 1 2024-03-12T16:10:15.919 INFO:tasks.workunit.client.0.smithi006.stdout:0/14: creat f0 x:0 0 0 2024-03-12T16:10:15.921 INFO:tasks.workunit.client.0.smithi006.stdout:1/0: mkdir d0 0 2024-03-12T16:10:15.923 INFO:tasks.workunit.client.0.smithi006.stdout:1/1: rename d0 to d0/d1 22 2024-03-12T16:10:15.923 INFO:tasks.workunit.client.0.smithi006.stdout:2/0: mkdir d0 0 2024-03-12T16:10:15.925 INFO:tasks.workunit.client.0.smithi006.stdout:2/1: chown d0 458449 1 2024-03-12T16:10:15.927 INFO:tasks.workunit.client.0.smithi006.stdout:4/0: rename - no filename 2024-03-12T16:10:15.927 INFO:tasks.workunit.client.0.smithi006.stdout:4/1: read - no filename 2024-03-12T16:10:15.927 INFO:tasks.workunit.client.0.smithi006.stdout:4/2: write - no filename 2024-03-12T16:10:15.927 INFO:tasks.workunit.client.0.smithi006.stdout:4/3: dread - no filename 2024-03-12T16:10:15.927 INFO:tasks.workunit.client.0.smithi006.stdout:4/4: write - no filename 2024-03-12T16:10:15.927 INFO:tasks.workunit.client.0.smithi006.stdout:4/5: dread - no filename 2024-03-12T16:10:15.927 INFO:tasks.workunit.client.0.smithi006.stdout:2/2: rename d0 to d0/d1 22 2024-03-12T16:10:15.927 INFO:tasks.workunit.client.0.smithi006.stdout:2/3: truncate - no filename 2024-03-12T16:10:15.928 INFO:tasks.workunit.client.0.smithi006.stdout:1/2: creat d0/f2 x:0 0 0 2024-03-12T16:10:15.928 INFO:tasks.workunit.client.0.smithi006.stdout:3/0: creat f0 x:0 0 0 2024-03-12T16:10:15.930 INFO:tasks.workunit.client.0.smithi006.stdout:1/3: read - d0/f2 zero size 2024-03-12T16:10:15.932 INFO:tasks.workunit.client.0.smithi006.stdout:0/15: dwrite f0 [0,4194304] 0 2024-03-12T16:10:15.933 INFO:tasks.workunit.client.0.smithi006.stdout:2/4: symlink d0/l2 0 2024-03-12T16:10:15.936 INFO:tasks.workunit.client.0.smithi006.stdout:7/0: dread - no filename 2024-03-12T16:10:15.936 INFO:tasks.workunit.client.0.smithi006.stdout:7/1: dwrite - no filename 2024-03-12T16:10:15.938 INFO:tasks.workunit.client.0.smithi006.stdout:1/4: rename d0/f2 to d0/f3 0 2024-03-12T16:10:15.938 INFO:tasks.workunit.client.0.smithi006.stdout:1/5: chown d0/f3 108498415 1 2024-03-12T16:10:15.940 INFO:tasks.workunit.client.0.smithi006.stdout:0/16: mknod c1 0 2024-03-12T16:10:15.941 INFO:tasks.workunit.client.0.smithi006.stdout:5/0: symlink l0 0 2024-03-12T16:10:15.941 INFO:tasks.workunit.client.0.smithi006.stdout:5/1: dwrite - no filename 2024-03-12T16:10:15.944 INFO:tasks.workunit.client.0.smithi006.stdout:3/1: link f0 f1 0 2024-03-12T16:10:15.949 INFO:tasks.workunit.client.0.smithi006.stdout:6/0: creat f0 x:0 0 0 2024-03-12T16:10:15.950 INFO:tasks.workunit.client.0.smithi006.stdout:6/1: read - f0 zero size 2024-03-12T16:10:15.950 INFO:tasks.workunit.client.0.smithi006.stdout:1/6: creat d0/f4 x:0 0 0 2024-03-12T16:10:15.952 INFO:tasks.workunit.client.0.smithi006.stdout:0/17: mkdir d2 0 2024-03-12T16:10:15.953 INFO:tasks.workunit.client.0.smithi006.stdout:5/2: rename l0 to l1 0 2024-03-12T16:10:15.956 INFO:tasks.workunit.client.0.smithi006.stdout:3/2: write f0 [874686,11047] 0 2024-03-12T16:10:15.958 INFO:tasks.workunit.client.0.smithi006.stdout:7/2: creat f0 x:0 0 0 2024-03-12T16:10:15.959 INFO:tasks.workunit.client.0.smithi006.stdout:9/0: chown . 93674 1 2024-03-12T16:10:15.959 INFO:tasks.workunit.client.0.smithi006.stdout:9/1: fsync - no filename 2024-03-12T16:10:15.959 INFO:tasks.workunit.client.0.smithi006.stdout:9/2: dread - no filename 2024-03-12T16:10:15.959 INFO:tasks.workunit.client.0.smithi006.stdout:9/3: dread - no filename 2024-03-12T16:10:15.960 INFO:tasks.workunit.client.0.smithi006.stdout:9/4: fsync - no filename 2024-03-12T16:10:15.960 INFO:tasks.workunit.client.0.smithi006.stdout:9/5: dread - no filename 2024-03-12T16:10:15.960 INFO:tasks.workunit.client.0.smithi006.stdout:9/6: chown . 4375224 1 2024-03-12T16:10:15.960 INFO:tasks.workunit.client.0.smithi006.stdout:6/2: rename f0 to f1 0 2024-03-12T16:10:15.960 INFO:tasks.workunit.client.0.smithi006.stdout:9/7: chown . 10 1 2024-03-12T16:10:15.960 INFO:tasks.workunit.client.0.smithi006.stdout:9/8: write - no filename 2024-03-12T16:10:15.960 INFO:tasks.workunit.client.0.smithi006.stdout:9/9: dwrite - no filename 2024-03-12T16:10:15.960 INFO:tasks.workunit.client.0.smithi006.stdout:9/10: truncate - no filename 2024-03-12T16:10:15.962 INFO:tasks.workunit.client.0.smithi006.stdout:1/7: creat d0/f5 x:0 0 0 2024-03-12T16:10:15.962 INFO:tasks.workunit.client.0.smithi006.stdout:6/3: dread - f1 zero size 2024-03-12T16:10:15.964 INFO:tasks.workunit.client.0.smithi006.stdout:0/18: dwrite f0 [0,4194304] 0 2024-03-12T16:10:15.964 INFO:tasks.workunit.client.0.smithi006.stdout:2/5: link d0/l2 d0/l3 0 2024-03-12T16:10:15.966 INFO:tasks.workunit.client.0.smithi006.stdout:6/4: chown f1 448 1 2024-03-12T16:10:15.966 INFO:tasks.workunit.client.0.smithi006.stdout:8/0: symlink l0 0 2024-03-12T16:10:15.966 INFO:tasks.workunit.client.0.smithi006.stdout:0/19: rename d2 to d2/d3 22 2024-03-12T16:10:15.968 INFO:tasks.workunit.client.0.smithi006.stdout:6/5: chown f1 22 1 2024-03-12T16:10:15.968 INFO:tasks.workunit.client.0.smithi006.stdout:8/1: chown l0 427915 1 2024-03-12T16:10:15.968 INFO:tasks.workunit.client.0.smithi006.stdout:3/3: mknod c2 0 2024-03-12T16:10:15.969 INFO:tasks.workunit.client.0.smithi006.stdout:0/20: write f0 [2133673,12832] 0 2024-03-12T16:10:15.974 INFO:tasks.workunit.client.0.smithi006.stdout:7/3: dwrite f0 [0,4194304] 0 2024-03-12T16:10:15.974 INFO:tasks.workunit.client.0.smithi006.stdout:2/6: creat d0/f4 x:0 0 0 2024-03-12T16:10:15.978 INFO:tasks.workunit.client.0.smithi006.stdout:6/6: creat f2 x:0 0 0 2024-03-12T16:10:15.979 INFO:tasks.workunit.client.0.smithi006.stdout:0/21: dread f0 [0,4194304] 0 2024-03-12T16:10:15.980 INFO:tasks.workunit.client.0.smithi006.stdout:6/7: write f2 [695001,61251] 0 2024-03-12T16:10:15.980 INFO:tasks.workunit.client.0.smithi006.stdout:6/8: dread - f1 zero size 2024-03-12T16:10:15.981 INFO:tasks.workunit.client.0.smithi006.stdout:9/11: mkdir d0 0 2024-03-12T16:10:15.982 INFO:tasks.workunit.client.0.smithi006.stdout:6/9: chown f1 2239950 1 2024-03-12T16:10:15.982 INFO:tasks.workunit.client.0.smithi006.stdout:6/10: dread - f1 zero size 2024-03-12T16:10:15.985 INFO:tasks.workunit.client.0.smithi006.stdout:0/22: dread f0 [0,4194304] 0 2024-03-12T16:10:15.986 INFO:tasks.workunit.client.0.smithi006.stdout:0/23: write f0 [1131602,112511] 0 2024-03-12T16:10:15.987 INFO:tasks.workunit.client.0.smithi006.stdout:8/2: rename l0 to l1 0 2024-03-12T16:10:15.988 INFO:tasks.workunit.client.0.smithi006.stdout:3/4: rename c2 to c3 0 2024-03-12T16:10:15.990 INFO:tasks.workunit.client.0.smithi006.stdout:5/3: rename l1 to l2 0 2024-03-12T16:10:15.994 INFO:tasks.workunit.client.0.smithi006.stdout:6/11: mkdir d3 0 2024-03-12T16:10:15.996 INFO:tasks.workunit.client.0.smithi006.stdout:6/12: rename d3 to d3/d4 22 2024-03-12T16:10:15.996 INFO:tasks.workunit.client.0.smithi006.stdout:8/3: mkdir d2 0 2024-03-12T16:10:15.996 INFO:tasks.workunit.client.0.smithi006.stdout:8/4: dread - no filename 2024-03-12T16:10:15.997 INFO:tasks.workunit.client.0.smithi006.stdout:5/4: mknod c3 0 2024-03-12T16:10:15.997 INFO:tasks.workunit.client.0.smithi006.stdout:5/5: rmdir - no directory 2024-03-12T16:10:15.997 INFO:tasks.workunit.client.0.smithi006.stdout:5/6: dread - no filename 2024-03-12T16:10:15.999 INFO:tasks.workunit.client.0.smithi006.stdout:9/12: mkdir d0/d1 0 2024-03-12T16:10:16.000 INFO:tasks.workunit.client.0.smithi006.stdout:1/8: getdents d0 0 2024-03-12T16:10:16.001 INFO:tasks.workunit.client.0.smithi006.stdout:0/24: creat d2/f4 x:0 0 0 2024-03-12T16:10:16.002 INFO:tasks.workunit.client.0.smithi006.stdout:5/7: creat f4 x:0 0 0 2024-03-12T16:10:16.028 INFO:tasks.workunit.client.0.smithi006.stdout:1/9: creat d0/f6 x:0 0 0 2024-03-12T16:10:16.028 INFO:tasks.workunit.client.0.smithi006.stdout:0/25: creat d2/f5 x:0 0 0 2024-03-12T16:10:16.029 INFO:tasks.workunit.client.0.smithi006.stdout:1/10: dread - d0/f5 zero size 2024-03-12T16:10:16.030 INFO:tasks.workunit.client.0.smithi006.stdout:7/4: truncate f0 34245 0 2024-03-12T16:10:16.033 INFO:tasks.workunit.client.0.smithi006.stdout:1/11: write d0/f4 [66770,16262] 0 2024-03-12T16:10:16.041 INFO:tasks.workunit.client.0.smithi006.stdout:5/8: dwrite f4 [0,4194304] 0 2024-03-12T16:10:16.042 INFO:tasks.workunit.client.0.smithi006.stdout:0/26: dwrite d2/f5 [0,4194304] 0 2024-03-12T16:10:16.043 INFO:tasks.workunit.client.0.smithi006.stdout:5/9: write f4 [2554090,20050] 0 2024-03-12T16:10:16.048 INFO:tasks.workunit.client.0.smithi006.stdout:0/27: dread d2/f5 [0,4194304] 0 2024-03-12T16:10:16.049 INFO:tasks.workunit.client.0.smithi006.stdout:0/28: read - d2/f4 zero size 2024-03-12T16:10:16.150 INFO:tasks.workunit.client.0.smithi006.stdout:3/5: unlink c3 0 2024-03-12T16:10:16.151 INFO:tasks.workunit.client.0.smithi006.stdout:7/5: dread f0 [0,4194304] 0 2024-03-12T16:10:16.155 INFO:tasks.workunit.client.0.smithi006.stdout:5/10: symlink l5 0 2024-03-12T16:10:16.156 INFO:tasks.workunit.client.0.smithi006.stdout:0/29: mkdir d2/d6 0 2024-03-12T16:10:16.159 INFO:tasks.workunit.client.0.smithi006.stdout:1/12: link d0/f5 d0/f7 0 2024-03-12T16:10:16.165 INFO:tasks.workunit.client.0.smithi006.stdout:3/6: dwrite f1 [0,4194304] 0 2024-03-12T16:10:16.165 INFO:tasks.workunit.client.0.smithi006.stdout:0/30: unlink d2/f5 0 2024-03-12T16:10:16.174 INFO:tasks.workunit.client.0.smithi006.stdout:3/7: symlink l4 0 2024-03-12T16:10:16.175 INFO:tasks.workunit.client.0.smithi006.stdout:5/11: dwrite f4 [0,4194304] 0 2024-03-12T16:10:16.181 INFO:tasks.workunit.client.0.smithi006.stdout:0/31: creat d2/d6/f7 x:0 0 0 2024-03-12T16:10:16.183 INFO:tasks.workunit.client.0.smithi006.stdout:7/6: dwrite f0 [0,4194304] 0 2024-03-12T16:10:16.183 INFO:tasks.workunit.client.0.smithi006.stdout:5/12: creat f6 x:0 0 0 2024-03-12T16:10:16.185 INFO:tasks.workunit.client.0.smithi006.stdout:0/32: dread - d2/d6/f7 zero size 2024-03-12T16:10:16.187 INFO:tasks.workunit.client.0.smithi006.stdout:5/13: dread - f6 zero size 2024-03-12T16:10:16.188 INFO:tasks.workunit.client.0.smithi006.stdout:5/14: fdatasync f6 0 2024-03-12T16:10:16.191 INFO:tasks.workunit.client.0.smithi006.stdout:1/13: dwrite d0/f5 [0,4194304] 0 2024-03-12T16:10:16.192 INFO:tasks.workunit.client.0.smithi006.stdout:5/15: dread - f6 zero size 2024-03-12T16:10:16.192 INFO:tasks.workunit.client.0.smithi006.stdout:7/7: link f0 f1 0 2024-03-12T16:10:16.193 INFO:tasks.workunit.client.0.smithi006.stdout:0/33: symlink d2/d6/l8 0 2024-03-12T16:10:16.193 INFO:tasks.workunit.client.0.smithi006.stdout:3/8: dread f1 [0,4194304] 0 2024-03-12T16:10:16.194 INFO:tasks.workunit.client.0.smithi006.stdout:5/16: write f6 [20720,95982] 0 2024-03-12T16:10:16.196 INFO:tasks.workunit.client.0.smithi006.stdout:7/8: rename f1 to f2 0 2024-03-12T16:10:16.203 INFO:tasks.workunit.client.0.smithi006.stdout:3/9: link f0 f5 0 2024-03-12T16:10:16.205 INFO:tasks.workunit.client.0.smithi006.stdout:0/34: dwrite d2/d6/f7 [0,4194304] 0 2024-03-12T16:10:16.205 INFO:tasks.workunit.client.0.smithi006.stdout:5/17: dread f4 [0,4194304] 0 2024-03-12T16:10:16.209 INFO:tasks.workunit.client.0.smithi006.stdout:3/10: write f0 [1956210,61586] 0 2024-03-12T16:10:16.213 INFO:tasks.workunit.client.0.smithi006.stdout:0/35: mknod d2/c9 0 2024-03-12T16:10:16.214 INFO:tasks.workunit.client.0.smithi006.stdout:3/11: symlink l6 0 2024-03-12T16:10:16.216 INFO:tasks.workunit.client.0.smithi006.stdout:0/36: fsync f0 0 2024-03-12T16:10:16.217 INFO:tasks.workunit.client.0.smithi006.stdout:5/18: dwrite f6 [0,4194304] 0 2024-03-12T16:10:16.219 INFO:tasks.workunit.client.0.smithi006.stdout:0/37: dread - d2/f4 zero size 2024-03-12T16:10:16.221 INFO:tasks.workunit.client.0.smithi006.stdout:5/19: mkdir d7 0 2024-03-12T16:10:16.221 INFO:tasks.workunit.client.0.smithi006.stdout:0/38: write d2/d6/f7 [1346,108981] 0 2024-03-12T16:10:16.229 INFO:tasks.workunit.client.0.smithi006.stdout:3/12: dwrite f0 [0,4194304] 0 2024-03-12T16:10:16.233 INFO:tasks.workunit.client.0.smithi006.stdout:5/20: dread f4 [0,4194304] 0 2024-03-12T16:10:16.234 INFO:tasks.workunit.client.0.smithi006.stdout:3/13: unlink l6 0 2024-03-12T16:10:16.236 INFO:tasks.workunit.client.0.smithi006.stdout:5/21: write f6 [3901877,59703] 0 2024-03-12T16:10:16.238 INFO:tasks.workunit.client.0.smithi006.stdout:0/39: dwrite d2/f4 [0,4194304] 0 2024-03-12T16:10:16.239 INFO:tasks.workunit.client.0.smithi006.stdout:5/22: chown f6 5585410 1 2024-03-12T16:10:16.242 INFO:tasks.workunit.client.0.smithi006.stdout:0/40: symlink d2/la 0 2024-03-12T16:10:16.242 INFO:tasks.workunit.client.0.smithi006.stdout:3/14: dread f1 [0,4194304] 0 2024-03-12T16:10:16.243 INFO:tasks.workunit.client.0.smithi006.stdout:0/41: read d2/d6/f7 [573685,77536] 0 2024-03-12T16:10:16.243 INFO:tasks.workunit.client.0.smithi006.stdout:0/42: chown d2/d6/f7 34317194 1 2024-03-12T16:10:16.244 INFO:tasks.workunit.client.0.smithi006.stdout:5/23: mkdir d7/d8 0 2024-03-12T16:10:16.245 INFO:tasks.workunit.client.0.smithi006.stdout:0/43: readlink d2/d6/l8 0 2024-03-12T16:10:16.245 INFO:tasks.workunit.client.0.smithi006.stdout:0/44: chown d2/d6 12821422 1 2024-03-12T16:10:16.246 INFO:tasks.workunit.client.0.smithi006.stdout:5/24: write f4 [1357642,122117] 0 2024-03-12T16:10:16.248 INFO:tasks.workunit.client.0.smithi006.stdout:0/45: symlink d2/lb 0 2024-03-12T16:10:16.249 INFO:tasks.workunit.client.0.smithi006.stdout:0/46: rename d2/d6 to d2/d6/dc 22 2024-03-12T16:10:16.250 INFO:tasks.workunit.client.0.smithi006.stdout:5/25: mkdir d7/d9 0 2024-03-12T16:10:16.252 INFO:tasks.workunit.client.0.smithi006.stdout:5/26: unlink f6 0 2024-03-12T16:10:16.254 INFO:tasks.workunit.client.0.smithi006.stdout:5/27: symlink d7/d8/la 0 2024-03-12T16:10:16.257 INFO:tasks.workunit.client.0.smithi006.stdout:5/28: rename d7/d8/la to d7/d8/lb 0 2024-03-12T16:10:16.258 INFO:tasks.workunit.client.0.smithi006.stdout:5/29: write f4 [3808963,105748] 0 2024-03-12T16:10:16.261 INFO:tasks.workunit.client.0.smithi006.stdout:5/30: creat d7/d9/fc x:0 0 0 2024-03-12T16:10:16.262 INFO:tasks.workunit.client.0.smithi006.stdout:5/31: unlink c3 0 2024-03-12T16:10:16.264 INFO:tasks.workunit.client.0.smithi006.stdout:5/32: rmdir d7 39 2024-03-12T16:10:16.277 INFO:tasks.workunit.client.0.smithi006.stdout:0/47: fsync d2/f4 0 2024-03-12T16:10:16.277 INFO:tasks.workunit.client.0.smithi006.stdout:0/48: chown d2/c9 1 1 2024-03-12T16:10:16.279 INFO:tasks.workunit.client.0.smithi006.stdout:0/49: creat d2/fd x:0 0 0 2024-03-12T16:10:16.281 INFO:tasks.workunit.client.0.smithi006.stdout:0/50: symlink d2/d6/le 0 2024-03-12T16:10:16.305 INFO:tasks.workunit.client.0.smithi006.stdout:1/14: getdents d0 0 2024-03-12T16:10:16.307 INFO:tasks.workunit.client.0.smithi006.stdout:1/15: creat d0/f8 x:0 0 0 2024-03-12T16:10:16.309 INFO:tasks.workunit.client.0.smithi006.stdout:1/16: symlink d0/l9 0 2024-03-12T16:10:16.309 INFO:tasks.workunit.client.0.smithi006.stdout:1/17: fdatasync d0/f5 0 2024-03-12T16:10:16.310 INFO:tasks.workunit.client.0.smithi006.stdout:1/18: chown d0/f6 140818 1 2024-03-12T16:10:16.312 INFO:tasks.workunit.client.0.smithi006.stdout:1/19: write d0/f5 [5242629,12060] 0 2024-03-12T16:10:16.314 INFO:tasks.workunit.client.0.smithi006.stdout:1/20: write d0/f3 [711897,1288] 0 2024-03-12T16:10:16.315 INFO:tasks.workunit.client.0.smithi006.stdout:1/21: read d0/f4 [77319,119127] 0 2024-03-12T16:10:16.316 INFO:tasks.workunit.client.0.smithi006.stdout:7/9: rename f2 to f3 0 2024-03-12T16:10:16.316 INFO:tasks.workunit.client.0.smithi006.stdout:1/22: chown d0/f8 4343 1 2024-03-12T16:10:16.320 INFO:tasks.workunit.client.0.smithi006.stdout:7/10: dread f3 [0,4194304] 0 2024-03-12T16:10:16.322 INFO:tasks.workunit.client.0.smithi006.stdout:1/23: dread d0/f3 [0,4194304] 0 2024-03-12T16:10:16.325 INFO:tasks.workunit.client.0.smithi006.stdout:1/24: chown d0/f6 0 1 2024-03-12T16:10:16.325 INFO:tasks.workunit.client.0.smithi006.stdout:5/33: mknod d7/cd 0 2024-03-12T16:10:16.328 INFO:tasks.workunit.client.0.smithi006.stdout:1/25: dread d0/f3 [0,4194304] 0 2024-03-12T16:10:16.329 INFO:tasks.workunit.client.0.smithi006.stdout:7/11: dread f0 [0,4194304] 0 2024-03-12T16:10:16.330 INFO:tasks.workunit.client.0.smithi006.stdout:1/26: truncate d0/f3 1057110 0 2024-03-12T16:10:16.331 INFO:tasks.workunit.client.0.smithi006.stdout:7/12: fdatasync f3 0 2024-03-12T16:10:16.332 INFO:tasks.workunit.client.0.smithi006.stdout:1/27: creat d0/fa x:0 0 0 2024-03-12T16:10:16.333 INFO:tasks.workunit.client.0.smithi006.stdout:7/13: symlink l4 0 2024-03-12T16:10:16.333 INFO:tasks.workunit.client.0.smithi006.stdout:7/14: readlink l4 0 2024-03-12T16:10:16.334 INFO:tasks.workunit.client.0.smithi006.stdout:7/15: write f3 [2772776,78975] 0 2024-03-12T16:10:16.335 INFO:tasks.workunit.client.0.smithi006.stdout:7/16: write f3 [1860394,58613] 0 2024-03-12T16:10:16.337 INFO:tasks.workunit.client.0.smithi006.stdout:1/28: link d0/f7 d0/fb 0 2024-03-12T16:10:16.338 INFO:tasks.workunit.client.0.smithi006.stdout:7/17: fdatasync f0 0 2024-03-12T16:10:16.342 INFO:tasks.workunit.client.0.smithi006.stdout:7/18: creat f5 x:0 0 0 2024-03-12T16:10:16.344 INFO:tasks.workunit.client.0.smithi006.stdout:7/19: dread - f5 zero size 2024-03-12T16:10:16.344 INFO:tasks.workunit.client.0.smithi006.stdout:0/51: dwrite d2/d6/f7 [4194304,4194304] 0 2024-03-12T16:10:16.347 INFO:tasks.workunit.client.0.smithi006.stdout:0/52: dread - d2/fd zero size 2024-03-12T16:10:16.350 INFO:tasks.workunit.client.0.smithi006.stdout:7/20: unlink f0 0 2024-03-12T16:10:16.350 INFO:tasks.workunit.client.0.smithi006.stdout:1/29: dwrite d0/f7 [0,4194304] 0 2024-03-12T16:10:16.351 INFO:tasks.workunit.client.0.smithi006.stdout:7/21: creat f6 x:0 0 0 2024-03-12T16:10:16.352 INFO:tasks.workunit.client.0.smithi006.stdout:7/22: stat l4 0 2024-03-12T16:10:16.354 INFO:tasks.workunit.client.0.smithi006.stdout:0/53: dread f0 [0,4194304] 0 2024-03-12T16:10:16.354 INFO:tasks.workunit.client.0.smithi006.stdout:7/23: write f6 [622026,95306] 0 2024-03-12T16:10:16.354 INFO:tasks.workunit.client.0.smithi006.stdout:1/30: creat d0/fc x:0 0 0 2024-03-12T16:10:16.354 INFO:tasks.workunit.client.0.smithi006.stdout:0/54: chown d2/d6 0 1 2024-03-12T16:10:16.357 INFO:tasks.workunit.client.0.smithi006.stdout:1/31: creat d0/fd x:0 0 0 2024-03-12T16:10:16.357 INFO:tasks.workunit.client.0.smithi006.stdout:0/55: creat d2/d6/ff x:0 0 0 2024-03-12T16:10:16.358 INFO:tasks.workunit.client.0.smithi006.stdout:0/56: truncate d2/d6/ff 101540 0 2024-03-12T16:10:16.360 INFO:tasks.workunit.client.0.smithi006.stdout:0/57: mkdir d2/d6/d10 0 2024-03-12T16:10:16.370 INFO:tasks.workunit.client.0.smithi006.stdout:0/58: dwrite d2/d6/f7 [0,4194304] 0 2024-03-12T16:10:16.371 INFO:tasks.workunit.client.0.smithi006.stdout:1/32: fsync d0/f3 0 2024-03-12T16:10:16.372 INFO:tasks.workunit.client.0.smithi006.stdout:1/33: fdatasync d0/f3 0 2024-03-12T16:10:16.377 INFO:tasks.workunit.client.0.smithi006.stdout:1/34: write d0/f4 [290744,52238] 0 2024-03-12T16:10:16.381 INFO:tasks.workunit.client.0.smithi006.stdout:0/59: dwrite d2/d6/ff [0,4194304] 0 2024-03-12T16:10:16.382 INFO:tasks.workunit.client.0.smithi006.stdout:7/24: dwrite f3 [0,4194304] 0 2024-03-12T16:10:16.388 INFO:tasks.workunit.client.0.smithi006.stdout:0/60: mkdir d2/d6/d10/d11 0 2024-03-12T16:10:16.388 INFO:tasks.workunit.client.0.smithi006.stdout:0/61: read - d2/fd zero size 2024-03-12T16:10:16.389 INFO:tasks.workunit.client.0.smithi006.stdout:7/25: getdents . 0 2024-03-12T16:10:16.394 INFO:tasks.workunit.client.0.smithi006.stdout:1/35: truncate d0/f5 2388544 0 2024-03-12T16:10:16.399 INFO:tasks.workunit.client.0.smithi006.stdout:1/36: creat d0/fe x:0 0 0 2024-03-12T16:10:16.399 INFO:tasks.workunit.client.0.smithi006.stdout:0/62: dwrite f0 [0,4194304] 0 2024-03-12T16:10:16.400 INFO:tasks.workunit.client.0.smithi006.stdout:7/26: dwrite f6 [0,4194304] 0 2024-03-12T16:10:16.404 INFO:tasks.workunit.client.0.smithi006.stdout:7/27: symlink l7 0 2024-03-12T16:10:16.406 INFO:tasks.workunit.client.0.smithi006.stdout:7/28: stat f6 0 2024-03-12T16:10:16.406 INFO:tasks.workunit.client.0.smithi006.stdout:7/29: stat f6 0 2024-03-12T16:10:16.409 INFO:tasks.workunit.client.0.smithi006.stdout:0/63: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:16.411 INFO:tasks.workunit.client.0.smithi006.stdout:0/64: chown d2/fd 0 1 2024-03-12T16:10:16.414 INFO:tasks.workunit.client.0.smithi006.stdout:0/65: creat d2/d6/d10/f12 x:0 0 0 2024-03-12T16:10:16.416 INFO:tasks.workunit.client.0.smithi006.stdout:0/66: symlink d2/l13 0 2024-03-12T16:10:16.421 INFO:tasks.workunit.client.0.smithi006.stdout:0/67: mknod d2/c14 0 2024-03-12T16:10:16.422 INFO:tasks.workunit.client.0.smithi006.stdout:7/30: rename l7 to l8 0 2024-03-12T16:10:16.423 INFO:tasks.workunit.client.0.smithi006.stdout:0/68: creat d2/f15 x:0 0 0 2024-03-12T16:10:16.425 INFO:tasks.workunit.client.0.smithi006.stdout:7/31: symlink l9 0 2024-03-12T16:10:16.426 INFO:tasks.workunit.client.0.smithi006.stdout:0/69: unlink d2/d6/ff 0 2024-03-12T16:10:16.427 INFO:tasks.workunit.client.0.smithi006.stdout:0/70: read d2/f4 [876904,30111] 0 2024-03-12T16:10:16.427 INFO:tasks.workunit.client.0.smithi006.stdout:0/71: chown d2/c9 0 1 2024-03-12T16:10:16.428 INFO:tasks.workunit.client.0.smithi006.stdout:0/72: readlink d2/l13 0 2024-03-12T16:10:16.431 INFO:tasks.workunit.client.0.smithi006.stdout:0/73: unlink d2/la 0 2024-03-12T16:10:16.433 INFO:tasks.workunit.client.0.smithi006.stdout:0/74: symlink d2/d6/d10/l16 0 2024-03-12T16:10:16.436 INFO:tasks.workunit.client.0.smithi006.stdout:0/75: symlink d2/d6/l17 0 2024-03-12T16:10:16.439 INFO:tasks.workunit.client.0.smithi006.stdout:7/32: write f6 [4414555,58030] 0 2024-03-12T16:10:16.441 INFO:tasks.workunit.client.0.smithi006.stdout:1/37: dwrite d0/f7 [0,4194304] 0 2024-03-12T16:10:16.442 INFO:tasks.workunit.client.0.smithi006.stdout:7/33: write f6 [2545446,130747] 0 2024-03-12T16:10:16.444 INFO:tasks.workunit.client.0.smithi006.stdout:1/38: rmdir d0 39 2024-03-12T16:10:16.447 INFO:tasks.workunit.client.0.smithi006.stdout:7/34: write f3 [3635226,85503] 0 2024-03-12T16:10:16.448 INFO:tasks.workunit.client.0.smithi006.stdout:0/76: dwrite d2/f15 [0,4194304] 0 2024-03-12T16:10:16.449 INFO:tasks.workunit.client.0.smithi006.stdout:0/77: fdatasync f0 0 2024-03-12T16:10:16.453 INFO:tasks.workunit.client.0.smithi006.stdout:0/78: creat d2/d6/d10/d11/f18 x:0 0 0 2024-03-12T16:10:16.455 INFO:tasks.workunit.client.0.smithi006.stdout:0/79: write f0 [226815,92681] 0 2024-03-12T16:10:16.456 INFO:tasks.workunit.client.0.smithi006.stdout:7/35: rename l4 to la 0 2024-03-12T16:10:16.458 INFO:tasks.workunit.client.0.smithi006.stdout:7/36: fsync f3 0 2024-03-12T16:10:16.461 INFO:tasks.workunit.client.0.smithi006.stdout:7/37: symlink lb 0 2024-03-12T16:10:16.463 INFO:tasks.workunit.client.0.smithi006.stdout:7/38: dread - f5 zero size 2024-03-12T16:10:16.465 INFO:tasks.workunit.client.0.smithi006.stdout:0/80: dwrite d2/d6/d10/d11/f18 [0,4194304] 0 2024-03-12T16:10:16.465 INFO:tasks.workunit.client.0.smithi006.stdout:7/39: write f5 [764659,46594] 0 2024-03-12T16:10:16.465 INFO:tasks.workunit.client.0.smithi006.stdout:0/81: chown f0 145974 1 2024-03-12T16:10:16.466 INFO:tasks.workunit.client.0.smithi006.stdout:7/40: chown f6 6822628 1 2024-03-12T16:10:16.466 INFO:tasks.workunit.client.0.smithi006.stdout:7/41: fdatasync f3 0 2024-03-12T16:10:16.466 INFO:tasks.workunit.client.0.smithi006.stdout:7/42: rmdir - no directory 2024-03-12T16:10:16.467 INFO:tasks.workunit.client.0.smithi006.stdout:0/82: write d2/fd [4545271,37228] 0 2024-03-12T16:10:16.469 INFO:tasks.workunit.client.0.smithi006.stdout:0/83: write d2/f4 [936838,46449] 0 2024-03-12T16:10:16.470 INFO:tasks.workunit.client.0.smithi006.stdout:0/84: write d2/f4 [4043524,78345] 0 2024-03-12T16:10:16.473 INFO:tasks.workunit.client.0.smithi006.stdout:0/85: creat d2/d6/d10/d11/f19 x:0 0 0 2024-03-12T16:10:16.475 INFO:tasks.workunit.client.0.smithi006.stdout:7/43: unlink la 0 2024-03-12T16:10:16.477 INFO:tasks.workunit.client.0.smithi006.stdout:0/86: rename d2/d6/d10/d11/f19 to d2/d6/d10/f1a 0 2024-03-12T16:10:16.478 INFO:tasks.workunit.client.0.smithi006.stdout:0/87: write d2/d6/f7 [918581,105178] 0 2024-03-12T16:10:16.527 INFO:tasks.workunit.client.0.smithi006.stdout:0/88: fdatasync d2/f4 0 2024-03-12T16:10:16.527 INFO:tasks.workunit.client.0.smithi006.stdout:7/44: creat fc x:0 0 0 2024-03-12T16:10:16.527 INFO:tasks.workunit.client.0.smithi006.stdout:0/89: write d2/f4 [612216,14731] 0 2024-03-12T16:10:16.527 INFO:tasks.workunit.client.0.smithi006.stdout:0/90: readlink d2/d6/le 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/91: chown d2/d6/l17 50992885 1 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/92: symlink d2/d6/d10/d11/l1b 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/93: stat d2/d6/d10/f12 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:7/45: dwrite fc [0,4194304] 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/94: truncate d2/d6/d10/d11/f18 4209137 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/95: creat d2/f1c x:0 0 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/96: write d2/d6/d10/d11/f18 [4396836,116717] 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:7/46: rename lb to ld 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/97: mkdir d2/d6/d10/d11/d1d 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/98: readlink d2/d6/l8 0 2024-03-12T16:10:16.528 INFO:tasks.workunit.client.0.smithi006.stdout:7/47: dread f6 [0,4194304] 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:0/99: rmdir d2/d6/d10 39 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:0/100: fdatasync f0 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:7/48: mkdir de 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:7/49: write f5 [1850098,44646] 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:7/50: creat de/ff x:0 0 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:0/101: symlink d2/d6/d10/d11/l1e 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:7/51: fsync f6 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:7/52: write f6 [1125314,4144] 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:0/102: link f0 d2/f1f 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:7/53: creat de/f10 x:0 0 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:7/54: stat de/ff 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:7/55: fsync f5 0 2024-03-12T16:10:16.529 INFO:tasks.workunit.client.0.smithi006.stdout:7/56: fdatasync de/ff 0 2024-03-12T16:10:16.530 INFO:tasks.workunit.client.0.smithi006.stdout:7/57: mknod de/c11 0 2024-03-12T16:10:16.530 INFO:tasks.workunit.client.0.smithi006.stdout:0/103: dread d2/fd [0,4194304] 0 2024-03-12T16:10:16.530 INFO:tasks.workunit.client.0.smithi006.stdout:7/58: creat de/f12 x:0 0 0 2024-03-12T16:10:16.530 INFO:tasks.workunit.client.0.smithi006.stdout:0/104: symlink d2/l20 0 2024-03-12T16:10:16.530 INFO:tasks.workunit.client.0.smithi006.stdout:7/59: link ld de/l13 0 2024-03-12T16:10:16.530 INFO:tasks.workunit.client.0.smithi006.stdout:7/60: rename de/l13 to de/l14 0 2024-03-12T16:10:16.530 INFO:tasks.workunit.client.0.smithi006.stdout:0/105: rmdir d2 39 2024-03-12T16:10:16.535 INFO:tasks.workunit.client.0.smithi006.stdout:7/61: dwrite f5 [0,4194304] 0 2024-03-12T16:10:16.539 INFO:tasks.workunit.client.0.smithi006.stdout:0/106: link d2/d6/d10/d11/l1b d2/d6/d10/d11/l21 0 2024-03-12T16:10:16.539 INFO:tasks.workunit.client.0.smithi006.stdout:0/107: readlink d2/d6/d10/l16 0 2024-03-12T16:10:16.541 INFO:tasks.workunit.client.0.smithi006.stdout:0/108: rmdir d2/d6/d10 39 2024-03-12T16:10:16.542 INFO:tasks.workunit.client.0.smithi006.stdout:7/62: dread f3 [0,4194304] 0 2024-03-12T16:10:16.545 INFO:tasks.workunit.client.0.smithi006.stdout:7/63: mknod de/c15 0 2024-03-12T16:10:16.546 INFO:tasks.workunit.client.0.smithi006.stdout:7/64: creat de/f16 x:0 0 0 2024-03-12T16:10:16.547 INFO:tasks.workunit.client.0.smithi006.stdout:7/65: dread - de/f10 zero size 2024-03-12T16:10:16.900 INFO:tasks.workunit.client.1.smithi134.stderr:++ readlink -f fsstress 2024-03-12T16:10:16.902 INFO:tasks.workunit.client.1.smithi134.stderr:+ BIN=/home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress 2024-03-12T16:10:16.902 INFO:tasks.workunit.client.1.smithi134.stderr:+ popd 2024-03-12T16:10:16.903 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp/fsstress ~/cephtest/mnt.1/client.1/tmp 2024-03-12T16:10:16.903 INFO:tasks.workunit.client.1.smithi134.stderr:+ popd 2024-03-12T16:10:16.903 INFO:tasks.workunit.client.1.smithi134.stdout:~/cephtest/mnt.1/client.1/tmp 2024-03-12T16:10:16.904 INFO:tasks.workunit.client.1.smithi134.stderr:++ mktemp -d -p . 2024-03-12T16:10:16.907 INFO:tasks.workunit.client.1.smithi134.stderr:+ T=./tmp.goKFlkvstn 2024-03-12T16:10:16.907 INFO:tasks.workunit.client.1.smithi134.stderr:+ /home/ubuntu/cephtest/mnt.1/client.1/tmp/fsstress/ltp-full-20091231/testcases/kernel/fs/fsstress/fsstress -d ./tmp.goKFlkvstn -l 1 -n 1000 -p 10 -v 2024-03-12T16:10:16.910 INFO:tasks.workunit.client.1.smithi134.stdout:seed = 1711119609 2024-03-12T16:10:16.913 INFO:tasks.workunit.client.1.smithi134.stdout:0/0: dwrite - no filename 2024-03-12T16:10:16.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/0: write - no filename 2024-03-12T16:10:16.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/1: stat - no entries 2024-03-12T16:10:16.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/2: fsync - no filename 2024-03-12T16:10:16.917 INFO:tasks.workunit.client.1.smithi134.stdout:1/3: mkdir d0 0 2024-03-12T16:10:16.917 INFO:tasks.workunit.client.1.smithi134.stdout:1/4: chown d0 22 1 2024-03-12T16:10:16.917 INFO:tasks.workunit.client.1.smithi134.stdout:1/5: fsync - no filename 2024-03-12T16:10:16.917 INFO:tasks.workunit.client.1.smithi134.stdout:1/6: write - no filename 2024-03-12T16:10:16.917 INFO:tasks.workunit.client.1.smithi134.stdout:3/0: fdatasync - no filename 2024-03-12T16:10:16.917 INFO:tasks.workunit.client.1.smithi134.stdout:3/1: rename - no filename 2024-03-12T16:10:16.917 INFO:tasks.workunit.client.1.smithi134.stdout:3/2: dread - no filename 2024-03-12T16:10:16.919 INFO:tasks.workunit.client.1.smithi134.stdout:2/0: creat f0 x:0 0 0 2024-03-12T16:10:16.919 INFO:tasks.workunit.client.1.smithi134.stdout:2/1: stat f0 0 2024-03-12T16:10:16.920 INFO:tasks.workunit.client.1.smithi134.stdout:1/7: creat d0/f1 x:0 0 0 2024-03-12T16:10:16.922 INFO:tasks.workunit.client.1.smithi134.stdout:3/3: symlink l0 0 2024-03-12T16:10:16.923 INFO:tasks.workunit.client.1.smithi134.stdout:5/0: readlink - no filename 2024-03-12T16:10:16.923 INFO:tasks.workunit.client.1.smithi134.stdout:5/1: write - no filename 2024-03-12T16:10:16.923 INFO:tasks.workunit.client.1.smithi134.stdout:5/2: write - no filename 2024-03-12T16:10:16.924 INFO:tasks.workunit.client.1.smithi134.stdout:5/3: read - no filename 2024-03-12T16:10:16.924 INFO:tasks.workunit.client.1.smithi134.stdout:5/4: rename - no filename 2024-03-12T16:10:16.924 INFO:tasks.workunit.client.1.smithi134.stdout:5/5: truncate - no filename 2024-03-12T16:10:16.928 INFO:tasks.workunit.client.1.smithi134.stdout:3/4: mkdir d1 0 2024-03-12T16:10:16.929 INFO:tasks.workunit.client.1.smithi134.stdout:4/0: creat f0 x:0 0 0 2024-03-12T16:10:16.929 INFO:tasks.workunit.client.1.smithi134.stdout:6/0: write - no filename 2024-03-12T16:10:16.929 INFO:tasks.workunit.client.1.smithi134.stdout:6/1: write - no filename 2024-03-12T16:10:16.930 INFO:tasks.workunit.client.1.smithi134.stdout:2/2: dwrite f0 [0,4194304] 0 2024-03-12T16:10:16.933 INFO:tasks.workunit.client.1.smithi134.stdout:5/6: mknod c0 0 2024-03-12T16:10:16.933 INFO:tasks.workunit.client.1.smithi134.stdout:5/7: write - no filename 2024-03-12T16:10:16.933 INFO:tasks.workunit.client.1.smithi134.stdout:5/8: dread - no filename 2024-03-12T16:10:16.933 INFO:tasks.workunit.client.1.smithi134.stdout:4/1: mkdir d1 0 2024-03-12T16:10:16.934 INFO:tasks.workunit.client.1.smithi134.stdout:2/3: write f0 [3097300,129458] 0 2024-03-12T16:10:16.935 INFO:tasks.workunit.client.1.smithi134.stdout:5/9: chown c0 813 1 2024-03-12T16:10:16.935 INFO:tasks.workunit.client.1.smithi134.stdout:5/10: fdatasync - no filename 2024-03-12T16:10:16.935 INFO:tasks.workunit.client.1.smithi134.stdout:4/2: chown f0 21660 1 2024-03-12T16:10:16.935 INFO:tasks.workunit.client.1.smithi134.stdout:3/5: unlink l0 0 2024-03-12T16:10:16.935 INFO:tasks.workunit.client.1.smithi134.stdout:3/6: write - no filename 2024-03-12T16:10:16.938 INFO:tasks.workunit.client.1.smithi134.stdout:8/0: dwrite - no filename 2024-03-12T16:10:16.938 INFO:tasks.workunit.client.1.smithi134.stdout:8/1: dread - no filename 2024-03-12T16:10:16.938 INFO:tasks.workunit.client.1.smithi134.stdout:8/2: write - no filename 2024-03-12T16:10:16.938 INFO:tasks.workunit.client.1.smithi134.stdout:6/2: creat f0 x:0 0 0 2024-03-12T16:10:16.941 INFO:tasks.workunit.client.1.smithi134.stdout:5/11: mknod c1 0 2024-03-12T16:10:16.941 INFO:tasks.workunit.client.1.smithi134.stdout:5/12: dwrite - no filename 2024-03-12T16:10:16.943 INFO:tasks.workunit.client.1.smithi134.stdout:7/0: mknod c0 0 2024-03-12T16:10:16.946 INFO:tasks.workunit.client.1.smithi134.stdout:7/1: chown c0 59354 1 2024-03-12T16:10:16.948 INFO:tasks.workunit.client.1.smithi134.stdout:9/0: dread - no filename 2024-03-12T16:10:16.948 INFO:tasks.workunit.client.1.smithi134.stdout:4/3: creat d1/f2 x:0 0 0 2024-03-12T16:10:16.949 INFO:tasks.workunit.client.1.smithi134.stdout:5/13: creat f2 x:0 0 0 2024-03-12T16:10:16.950 INFO:tasks.workunit.client.1.smithi134.stdout:3/7: creat d1/f2 x:0 0 0 2024-03-12T16:10:16.951 INFO:tasks.workunit.client.1.smithi134.stdout:4/4: dread - d1/f2 zero size 2024-03-12T16:10:16.951 INFO:tasks.workunit.client.1.smithi134.stdout:8/3: mkdir d0 0 2024-03-12T16:10:16.951 INFO:tasks.workunit.client.1.smithi134.stdout:5/14: dread - f2 zero size 2024-03-12T16:10:16.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:15.489819+0000 mgr.smithi134.gcntfu (mgr.24383) 41 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 222 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s wr, 597 op/s 2024-03-12T16:10:16.954 INFO:tasks.workunit.client.1.smithi134.stdout:3/8: dread - d1/f2 zero size 2024-03-12T16:10:16.955 INFO:tasks.workunit.client.1.smithi134.stdout:2/4: dwrite f0 [0,4194304] 0 2024-03-12T16:10:16.956 INFO:tasks.workunit.client.1.smithi134.stdout:5/15: chown f2 6887669 1 2024-03-12T16:10:16.956 INFO:tasks.workunit.client.1.smithi134.stdout:6/3: dwrite f0 [0,4194304] 0 2024-03-12T16:10:16.956 INFO:tasks.workunit.client.1.smithi134.stdout:6/4: stat f0 0 2024-03-12T16:10:16.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:15.489819+0000 mgr.smithi134.gcntfu (mgr.24383) 41 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 222 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 7.1 MiB/s wr, 597 op/s 2024-03-12T16:10:16.958 INFO:tasks.workunit.client.1.smithi134.stdout:9/1: creat f0 x:0 0 0 2024-03-12T16:10:16.959 INFO:tasks.workunit.client.1.smithi134.stdout:4/5: creat d1/f3 x:0 0 0 2024-03-12T16:10:16.959 INFO:tasks.workunit.client.1.smithi134.stdout:9/2: stat f0 0 2024-03-12T16:10:16.959 INFO:tasks.workunit.client.1.smithi134.stdout:7/2: link c0 c1 0 2024-03-12T16:10:16.963 INFO:tasks.workunit.client.1.smithi134.stdout:4/6: write d1/f3 [978637,19643] 0 2024-03-12T16:10:16.967 INFO:tasks.workunit.client.1.smithi134.stdout:3/9: creat d1/f3 x:0 0 0 2024-03-12T16:10:16.967 INFO:tasks.workunit.client.1.smithi134.stdout:3/10: readlink - no filename 2024-03-12T16:10:16.968 INFO:tasks.workunit.client.1.smithi134.stdout:6/5: mkdir d1 0 2024-03-12T16:10:16.970 INFO:tasks.workunit.client.1.smithi134.stdout:8/4: rmdir d0 0 2024-03-12T16:10:16.970 INFO:tasks.workunit.client.1.smithi134.stdout:8/5: dread - no filename 2024-03-12T16:10:16.971 INFO:tasks.workunit.client.1.smithi134.stdout:4/7: rename d1/f2 to d1/f4 0 2024-03-12T16:10:16.973 INFO:tasks.workunit.client.1.smithi134.stdout:3/11: creat d1/f4 x:0 0 0 2024-03-12T16:10:16.974 INFO:tasks.workunit.client.1.smithi134.stdout:7/3: rename c0 to c2 0 2024-03-12T16:10:16.975 INFO:tasks.workunit.client.1.smithi134.stdout:9/3: dwrite f0 [0,4194304] 0 2024-03-12T16:10:16.982 INFO:tasks.workunit.client.1.smithi134.stdout:8/6: creat f1 x:0 0 0 2024-03-12T16:10:16.983 INFO:tasks.workunit.client.1.smithi134.stdout:4/8: mkdir d1/d5 0 2024-03-12T16:10:16.984 INFO:tasks.workunit.client.1.smithi134.stdout:3/12: creat d1/f5 x:0 0 0 2024-03-12T16:10:16.984 INFO:tasks.workunit.client.1.smithi134.stdout:6/6: mknod d1/c2 0 2024-03-12T16:10:16.985 INFO:tasks.workunit.client.1.smithi134.stdout:4/9: truncate d1/f3 1526013 0 2024-03-12T16:10:16.985 INFO:tasks.workunit.client.1.smithi134.stdout:3/13: write d1/f4 [73714,24656] 0 2024-03-12T16:10:16.987 INFO:tasks.workunit.client.1.smithi134.stdout:9/4: mknod c1 0 2024-03-12T16:10:16.989 INFO:tasks.workunit.client.1.smithi134.stdout:3/14: creat d1/f6 x:0 0 0 2024-03-12T16:10:16.991 INFO:tasks.workunit.client.1.smithi134.stdout:9/5: creat f2 x:0 0 0 2024-03-12T16:10:16.992 INFO:tasks.workunit.client.1.smithi134.stdout:3/15: creat d1/f7 x:0 0 0 2024-03-12T16:10:16.993 INFO:tasks.workunit.client.1.smithi134.stdout:3/16: write d1/f2 [670026,93675] 0 2024-03-12T16:10:16.994 INFO:tasks.workunit.client.1.smithi134.stdout:4/10: link f0 d1/d5/f6 0 2024-03-12T16:10:16.997 INFO:tasks.workunit.client.1.smithi134.stdout:9/6: creat f3 x:0 0 0 2024-03-12T16:10:16.999 INFO:tasks.workunit.client.1.smithi134.stdout:9/7: read - f2 zero size 2024-03-12T16:10:17.000 INFO:tasks.workunit.client.1.smithi134.stdout:9/8: dread - f2 zero size 2024-03-12T16:10:17.005 INFO:tasks.workunit.client.1.smithi134.stdout:3/17: dwrite d1/f3 [0,4194304] 0 2024-03-12T16:10:17.011 INFO:tasks.workunit.client.1.smithi134.stdout:4/11: dwrite d1/f4 [0,4194304] 0 2024-03-12T16:10:17.018 INFO:tasks.workunit.client.1.smithi134.stdout:4/12: mknod d1/d5/c7 0 2024-03-12T16:10:17.020 INFO:tasks.workunit.client.1.smithi134.stdout:3/18: dwrite d1/f7 [0,4194304] 0 2024-03-12T16:10:17.025 INFO:tasks.workunit.client.1.smithi134.stdout:3/19: unlink d1/f3 0 2024-03-12T16:10:17.028 INFO:tasks.workunit.client.1.smithi134.stdout:3/20: mknod d1/c8 0 2024-03-12T16:10:17.032 INFO:tasks.workunit.client.1.smithi134.stdout:3/21: dread d1/f4 [0,4194304] 0 2024-03-12T16:10:17.034 INFO:tasks.workunit.client.1.smithi134.stdout:4/13: dwrite d1/d5/f6 [0,4194304] 0 2024-03-12T16:10:17.039 INFO:tasks.workunit.client.1.smithi134.stdout:4/14: creat d1/d5/f8 x:0 0 0 2024-03-12T16:10:17.044 INFO:tasks.workunit.client.1.smithi134.stdout:3/22: dwrite d1/f2 [0,4194304] 0 2024-03-12T16:10:17.286 INFO:tasks.workunit.client.1.smithi134.stdout:2/5: getdents . 0 2024-03-12T16:10:17.287 INFO:tasks.workunit.client.1.smithi134.stdout:2/6: rmdir - no directory 2024-03-12T16:10:17.288 INFO:tasks.workunit.client.1.smithi134.stdout:2/7: symlink l1 0 2024-03-12T16:10:17.288 INFO:tasks.workunit.client.1.smithi134.stdout:1/8: rmdir d0 39 2024-03-12T16:10:17.289 INFO:tasks.workunit.client.1.smithi134.stdout:2/8: write f0 [2854730,130797] 0 2024-03-12T16:10:17.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/9: truncate d0/f1 430853 0 2024-03-12T16:10:17.291 INFO:tasks.workunit.client.1.smithi134.stdout:1/10: write d0/f1 [1398307,34839] 0 2024-03-12T16:10:17.292 INFO:tasks.workunit.client.1.smithi134.stdout:1/11: rename d0 to d0/d2 22 2024-03-12T16:10:17.292 INFO:tasks.workunit.client.1.smithi134.stdout:2/9: mknod c2 0 2024-03-12T16:10:17.296 INFO:tasks.workunit.client.1.smithi134.stdout:2/10: dread f0 [0,4194304] 0 2024-03-12T16:10:17.296 INFO:tasks.workunit.client.1.smithi134.stdout:2/11: chown f0 25650312 1 2024-03-12T16:10:17.300 INFO:tasks.workunit.client.1.smithi134.stdout:5/16: fsync f2 0 2024-03-12T16:10:17.300 INFO:tasks.workunit.client.1.smithi134.stdout:5/17: fsync f2 0 2024-03-12T16:10:17.301 INFO:tasks.workunit.client.1.smithi134.stdout:5/18: stat f2 0 2024-03-12T16:10:17.303 INFO:tasks.workunit.client.1.smithi134.stdout:5/19: write f2 [89870,122120] 0 2024-03-12T16:10:17.304 INFO:tasks.workunit.client.1.smithi134.stdout:2/12: dwrite f0 [0,4194304] 0 2024-03-12T16:10:17.308 INFO:tasks.workunit.client.1.smithi134.stdout:2/13: mknod c3 0 2024-03-12T16:10:17.309 INFO:tasks.workunit.client.1.smithi134.stdout:7/4: stat c2 0 2024-03-12T16:10:17.309 INFO:tasks.workunit.client.1.smithi134.stdout:7/5: read - no filename 2024-03-12T16:10:17.311 INFO:tasks.workunit.client.1.smithi134.stdout:8/7: getdents . 0 2024-03-12T16:10:17.317 INFO:tasks.workunit.client.1.smithi134.stdout:7/6: creat f3 x:0 0 0 2024-03-12T16:10:17.319 INFO:tasks.workunit.client.1.smithi134.stdout:6/7: truncate f0 3150911 0 2024-03-12T16:10:17.322 INFO:tasks.workunit.client.1.smithi134.stdout:5/20: dwrite f2 [0,4194304] 0 2024-03-12T16:10:17.322 INFO:tasks.workunit.client.1.smithi134.stdout:7/7: chown c2 2030606 1 2024-03-12T16:10:17.322 INFO:tasks.workunit.client.1.smithi134.stdout:9/9: dwrite f0 [4194304,4194304] 0 2024-03-12T16:10:17.323 INFO:tasks.workunit.client.1.smithi134.stdout:9/10: dread - f3 zero size 2024-03-12T16:10:17.324 INFO:tasks.workunit.client.1.smithi134.stdout:5/21: creat f3 x:0 0 0 2024-03-12T16:10:17.325 INFO:tasks.workunit.client.1.smithi134.stdout:2/14: fdatasync f0 0 2024-03-12T16:10:17.327 INFO:tasks.workunit.client.1.smithi134.stdout:2/15: read f0 [1935987,90540] 0 2024-03-12T16:10:17.329 INFO:tasks.workunit.client.1.smithi134.stdout:7/8: unlink f3 0 2024-03-12T16:10:17.329 INFO:tasks.workunit.client.1.smithi134.stdout:2/16: readlink l1 0 2024-03-12T16:10:17.332 INFO:tasks.workunit.client.1.smithi134.stdout:3/23: getdents d1 0 2024-03-12T16:10:17.334 INFO:tasks.workunit.client.1.smithi134.stdout:8/8: dwrite f1 [0,4194304] 0 2024-03-12T16:10:17.334 INFO:tasks.workunit.client.1.smithi134.stdout:2/17: readlink l1 0 2024-03-12T16:10:17.334 INFO:tasks.workunit.client.1.smithi134.stdout:7/9: chown c1 5 1 2024-03-12T16:10:17.336 INFO:tasks.workunit.client.1.smithi134.stdout:5/22: symlink l4 0 2024-03-12T16:10:17.339 INFO:tasks.workunit.client.1.smithi134.stdout:4/15: truncate f0 1334860 0 2024-03-12T16:10:17.342 INFO:tasks.workunit.client.1.smithi134.stdout:8/9: creat f2 x:0 0 0 2024-03-12T16:10:17.342 INFO:tasks.workunit.client.1.smithi134.stdout:2/18: mkdir d4 0 2024-03-12T16:10:17.343 INFO:tasks.workunit.client.1.smithi134.stdout:5/23: creat f5 x:0 0 0 2024-03-12T16:10:17.345 INFO:tasks.workunit.client.1.smithi134.stdout:3/24: getdents d1 0 2024-03-12T16:10:17.345 INFO:tasks.workunit.client.1.smithi134.stdout:9/11: dwrite f0 [4194304,4194304] 0 2024-03-12T16:10:17.345 INFO:tasks.workunit.client.1.smithi134.stdout:5/24: dread - f3 zero size 2024-03-12T16:10:17.346 INFO:tasks.workunit.client.1.smithi134.stdout:9/12: chown f0 29374795 1 2024-03-12T16:10:17.348 INFO:tasks.workunit.client.1.smithi134.stdout:4/16: symlink d1/d5/l9 0 2024-03-12T16:10:17.350 INFO:tasks.workunit.client.1.smithi134.stdout:9/13: write f3 [373539,107441] 0 2024-03-12T16:10:17.353 INFO:tasks.workunit.client.1.smithi134.stdout:3/25: rename d1/f7 to d1/f9 0 2024-03-12T16:10:17.353 INFO:tasks.workunit.client.1.smithi134.stdout:9/14: write f0 [3443971,31232] 0 2024-03-12T16:10:17.358 INFO:tasks.workunit.client.1.smithi134.stdout:2/19: dwrite f0 [0,4194304] 0 2024-03-12T16:10:17.358 INFO:tasks.workunit.client.1.smithi134.stdout:9/15: creat f4 x:0 0 0 2024-03-12T16:10:17.360 INFO:tasks.workunit.client.1.smithi134.stdout:9/16: chown f0 106478 1 2024-03-12T16:10:17.361 INFO:tasks.workunit.client.1.smithi134.stdout:9/17: chown f2 102 1 2024-03-12T16:10:17.368 INFO:tasks.workunit.client.1.smithi134.stdout:3/26: write d1/f9 [3342373,6473] 0 2024-03-12T16:10:17.368 INFO:tasks.workunit.client.1.smithi134.stdout:3/27: fsync d1/f2 0 2024-03-12T16:10:17.369 INFO:tasks.workunit.client.1.smithi134.stdout:4/17: dwrite d1/d5/f8 [0,4194304] 0 2024-03-12T16:10:17.369 INFO:tasks.workunit.client.1.smithi134.stdout:9/18: unlink f2 0 2024-03-12T16:10:17.369 INFO:tasks.workunit.client.1.smithi134.stdout:3/28: write d1/f5 [587594,124360] 0 2024-03-12T16:10:17.369 INFO:tasks.workunit.client.1.smithi134.stdout:3/29: readlink - no filename 2024-03-12T16:10:17.370 INFO:tasks.workunit.client.1.smithi134.stdout:9/19: write f4 [745625,127783] 0 2024-03-12T16:10:17.374 INFO:tasks.workunit.client.1.smithi134.stdout:3/30: mknod d1/ca 0 2024-03-12T16:10:17.375 INFO:tasks.workunit.client.1.smithi134.stdout:3/31: chown d1/ca 102 1 2024-03-12T16:10:17.378 INFO:tasks.workunit.client.1.smithi134.stdout:9/20: dread f0 [0,4194304] 0 2024-03-12T16:10:17.379 INFO:tasks.workunit.client.1.smithi134.stdout:9/21: write f4 [1390606,93797] 0 2024-03-12T16:10:17.380 INFO:tasks.workunit.client.1.smithi134.stdout:9/22: write f4 [708632,10015] 0 2024-03-12T16:10:17.384 INFO:tasks.workunit.client.1.smithi134.stdout:9/23: unlink f4 0 2024-03-12T16:10:17.386 INFO:tasks.workunit.client.1.smithi134.stdout:9/24: write f0 [237569,22511] 0 2024-03-12T16:10:17.393 INFO:tasks.workunit.client.1.smithi134.stdout:9/25: dwrite f0 [4194304,4194304] 0 2024-03-12T16:10:17.394 INFO:tasks.workunit.client.1.smithi134.stdout:9/26: stat c1 0 2024-03-12T16:10:17.432 INFO:tasks.workunit.client.1.smithi134.stdout:6/8: read f0 [176394,55582] 0 2024-03-12T16:10:17.434 INFO:tasks.workunit.client.1.smithi134.stdout:7/10: getdents . 0 2024-03-12T16:10:17.435 INFO:tasks.workunit.client.1.smithi134.stdout:8/10: write f1 [4781585,93678] 0 2024-03-12T16:10:17.440 INFO:tasks.workunit.client.1.smithi134.stdout:5/25: getdents . 0 2024-03-12T16:10:17.443 INFO:tasks.workunit.client.1.smithi134.stdout:5/26: write f3 [650054,100982] 0 2024-03-12T16:10:17.444 INFO:tasks.workunit.client.1.smithi134.stdout:2/20: truncate f0 2295585 0 2024-03-12T16:10:17.447 INFO:tasks.workunit.client.1.smithi134.stdout:3/32: getdents d1 0 2024-03-12T16:10:17.448 INFO:tasks.workunit.client.1.smithi134.stdout:8/11: dwrite f1 [4194304,4194304] 0 2024-03-12T16:10:17.448 INFO:tasks.workunit.client.1.smithi134.stdout:5/27: unlink f2 0 2024-03-12T16:10:17.449 INFO:tasks.workunit.client.1.smithi134.stdout:4/18: dwrite d1/d5/f6 [0,4194304] 0 2024-03-12T16:10:17.454 INFO:tasks.workunit.client.1.smithi134.stdout:5/28: dread f3 [0,4194304] 0 2024-03-12T16:10:17.461 INFO:tasks.workunit.client.1.smithi134.stdout:3/33: mkdir d1/db 0 2024-03-12T16:10:17.461 INFO:tasks.workunit.client.1.smithi134.stdout:8/12: dread f1 [4194304,4194304] 0 2024-03-12T16:10:17.463 INFO:tasks.workunit.client.1.smithi134.stdout:2/21: creat d4/f5 x:0 0 0 2024-03-12T16:10:17.463 INFO:tasks.workunit.client.1.smithi134.stdout:9/27: getdents . 0 2024-03-12T16:10:17.466 INFO:tasks.workunit.client.1.smithi134.stdout:8/13: dread - f2 zero size 2024-03-12T16:10:17.466 INFO:tasks.workunit.client.1.smithi134.stdout:4/19: dwrite f0 [0,4194304] 0 2024-03-12T16:10:17.467 INFO:tasks.workunit.client.1.smithi134.stdout:8/14: fdatasync f2 0 2024-03-12T16:10:17.468 INFO:tasks.workunit.client.1.smithi134.stdout:6/9: write f0 [1160551,13169] 0 2024-03-12T16:10:17.471 INFO:tasks.workunit.client.1.smithi134.stdout:3/34: link d1/f5 d1/fc 0 2024-03-12T16:10:17.471 INFO:tasks.workunit.client.1.smithi134.stdout:6/10: read f0 [1967978,36116] 0 2024-03-12T16:10:17.474 INFO:tasks.workunit.client.1.smithi134.stdout:8/15: mkdir d3 0 2024-03-12T16:10:17.476 INFO:tasks.workunit.client.1.smithi134.stdout:4/20: symlink d1/la 0 2024-03-12T16:10:17.477 INFO:tasks.workunit.client.1.smithi134.stdout:5/29: dwrite f5 [0,4194304] 0 2024-03-12T16:10:17.479 INFO:tasks.workunit.client.1.smithi134.stdout:8/16: write f2 [779756,72878] 0 2024-03-12T16:10:17.479 INFO:tasks.workunit.client.1.smithi134.stdout:5/30: stat l4 0 2024-03-12T16:10:17.485 INFO:tasks.workunit.client.1.smithi134.stdout:6/11: mkdir d1/d3 0 2024-03-12T16:10:17.485 INFO:tasks.workunit.client.1.smithi134.stdout:8/17: truncate f2 1489354 0 2024-03-12T16:10:17.488 INFO:tasks.workunit.client.1.smithi134.stdout:3/35: symlink d1/db/ld 0 2024-03-12T16:10:17.489 INFO:tasks.workunit.client.1.smithi134.stdout:4/21: dread d1/f4 [0,4194304] 0 2024-03-12T16:10:17.490 INFO:tasks.workunit.client.1.smithi134.stdout:6/12: fsync f0 0 2024-03-12T16:10:17.490 INFO:tasks.workunit.client.1.smithi134.stdout:6/13: readlink - no filename 2024-03-12T16:10:17.492 INFO:tasks.workunit.client.1.smithi134.stdout:9/28: dwrite f0 [8388608,4194304] 0 2024-03-12T16:10:17.492 INFO:tasks.workunit.client.1.smithi134.stdout:3/36: mknod d1/db/ce 0 2024-03-12T16:10:17.492 INFO:tasks.workunit.client.1.smithi134.stdout:4/22: write d1/f3 [331741,99861] 0 2024-03-12T16:10:17.494 INFO:tasks.workunit.client.1.smithi134.stdout:9/29: fsync f3 0 2024-03-12T16:10:17.498 INFO:tasks.workunit.client.1.smithi134.stdout:9/30: mkdir d5 0 2024-03-12T16:10:17.498 INFO:tasks.workunit.client.1.smithi134.stdout:3/37: symlink d1/db/lf 0 2024-03-12T16:10:17.499 INFO:tasks.workunit.client.1.smithi134.stdout:4/23: write d1/d5/f6 [4673167,104392] 0 2024-03-12T16:10:17.502 INFO:tasks.workunit.client.1.smithi134.stdout:4/24: stat d1/d5/f8 0 2024-03-12T16:10:17.502 INFO:tasks.workunit.client.1.smithi134.stdout:5/31: truncate f3 21940 0 2024-03-12T16:10:17.503 INFO:tasks.workunit.client.1.smithi134.stdout:3/38: mkdir d1/db/d10 0 2024-03-12T16:10:17.506 INFO:tasks.workunit.client.1.smithi134.stdout:8/18: dwrite f1 [4194304,4194304] 0 2024-03-12T16:10:17.511 INFO:tasks.workunit.client.1.smithi134.stdout:6/14: dwrite f0 [0,4194304] 0 2024-03-12T16:10:17.519 INFO:tasks.workunit.client.1.smithi134.stdout:9/31: dwrite f0 [8388608,4194304] 0 2024-03-12T16:10:17.526 INFO:tasks.workunit.client.1.smithi134.stdout:9/32: chown f0 2042607 1 2024-03-12T16:10:17.526 INFO:tasks.workunit.client.1.smithi134.stdout:4/25: dread d1/d5/f8 [0,4194304] 0 2024-03-12T16:10:17.530 INFO:tasks.workunit.client.1.smithi134.stdout:9/33: dread f0 [4194304,4194304] 0 2024-03-12T16:10:17.532 INFO:tasks.workunit.client.1.smithi134.stdout:9/34: stat f3 0 2024-03-12T16:10:17.532 INFO:tasks.workunit.client.1.smithi134.stdout:9/35: stat c1 0 2024-03-12T16:10:17.537 INFO:tasks.workunit.client.1.smithi134.stdout:5/32: creat f6 x:0 0 0 2024-03-12T16:10:17.541 INFO:tasks.workunit.client.1.smithi134.stdout:3/39: symlink d1/db/l11 0 2024-03-12T16:10:17.542 INFO:tasks.workunit.client.1.smithi134.stdout:3/40: truncate d1/f4 202133 0 2024-03-12T16:10:17.545 INFO:tasks.workunit.client.1.smithi134.stdout:6/15: mkdir d1/d4 0 2024-03-12T16:10:17.553 INFO:tasks.workunit.client.1.smithi134.stdout:8/19: getdents d3 0 2024-03-12T16:10:17.556 INFO:tasks.workunit.client.1.smithi134.stdout:3/41: mkdir d1/db/d12 0 2024-03-12T16:10:17.559 INFO:tasks.workunit.client.1.smithi134.stdout:9/36: mknod d5/c6 0 2024-03-12T16:10:17.560 INFO:tasks.workunit.client.1.smithi134.stdout:5/33: fdatasync f3 0 2024-03-12T16:10:17.561 INFO:tasks.workunit.client.1.smithi134.stdout:8/20: rename f1 to d3/f4 0 2024-03-12T16:10:17.563 INFO:tasks.workunit.client.1.smithi134.stdout:6/16: link f0 d1/f5 0 2024-03-12T16:10:17.565 INFO:tasks.workunit.client.1.smithi134.stdout:9/37: creat d5/f7 x:0 0 0 2024-03-12T16:10:17.565 INFO:tasks.workunit.client.1.smithi134.stdout:8/21: dread d3/f4 [4194304,4194304] 0 2024-03-12T16:10:17.566 INFO:tasks.workunit.client.1.smithi134.stdout:9/38: write f3 [1212312,44856] 0 2024-03-12T16:10:17.568 INFO:tasks.workunit.client.1.smithi134.stdout:3/42: creat d1/db/d12/f13 x:0 0 0 2024-03-12T16:10:17.568 INFO:tasks.workunit.client.1.smithi134.stdout:4/26: getdents d1 0 2024-03-12T16:10:17.569 INFO:tasks.workunit.client.1.smithi134.stdout:8/22: write d3/f4 [398947,62331] 0 2024-03-12T16:10:17.571 INFO:tasks.workunit.client.1.smithi134.stdout:9/39: mknod d5/c8 0 2024-03-12T16:10:17.571 INFO:tasks.workunit.client.1.smithi134.stdout:8/23: rename d3 to d3/d5 22 2024-03-12T16:10:17.571 INFO:tasks.workunit.client.1.smithi134.stdout:3/43: mkdir d1/db/d14 0 2024-03-12T16:10:17.572 INFO:tasks.workunit.client.1.smithi134.stdout:6/17: symlink d1/d3/l6 0 2024-03-12T16:10:17.572 INFO:tasks.workunit.client.1.smithi134.stdout:3/44: read - d1/f6 zero size 2024-03-12T16:10:17.573 INFO:tasks.workunit.client.1.smithi134.stdout:4/27: rename d1/d5/l9 to d1/d5/lb 0 2024-03-12T16:10:17.574 INFO:tasks.workunit.client.1.smithi134.stdout:4/28: write f0 [5032152,24070] 0 2024-03-12T16:10:17.574 INFO:tasks.workunit.client.1.smithi134.stdout:9/40: mknod d5/c9 0 2024-03-12T16:10:17.575 INFO:tasks.workunit.client.1.smithi134.stdout:4/29: rename d1/d5 to d1/d5/dc 22 2024-03-12T16:10:17.578 INFO:tasks.workunit.client.1.smithi134.stdout:3/45: creat d1/db/f15 x:0 0 0 2024-03-12T16:10:17.580 INFO:tasks.workunit.client.1.smithi134.stdout:9/41: write f0 [1798862,41935] 0 2024-03-12T16:10:17.584 INFO:tasks.workunit.client.1.smithi134.stdout:9/42: write f0 [10181294,19077] 0 2024-03-12T16:10:17.585 INFO:tasks.workunit.client.1.smithi134.stdout:6/18: dwrite f0 [0,4194304] 0 2024-03-12T16:10:17.586 INFO:tasks.workunit.client.1.smithi134.stdout:4/30: dwrite d1/f3 [0,4194304] 0 2024-03-12T16:10:17.588 INFO:tasks.workunit.client.1.smithi134.stdout:6/19: write f0 [5178365,37466] 0 2024-03-12T16:10:17.588 INFO:tasks.workunit.client.1.smithi134.stdout:4/31: chown d1/d5 1587 1 2024-03-12T16:10:17.591 INFO:tasks.workunit.client.1.smithi134.stdout:4/32: symlink d1/ld 0 2024-03-12T16:10:17.592 INFO:tasks.workunit.client.1.smithi134.stdout:6/20: mknod d1/c7 0 2024-03-12T16:10:17.598 INFO:tasks.workunit.client.1.smithi134.stdout:6/21: unlink d1/c7 0 2024-03-12T16:10:17.599 INFO:tasks.workunit.client.1.smithi134.stdout:9/43: dwrite f0 [0,4194304] 0 2024-03-12T16:10:17.601 INFO:tasks.workunit.client.1.smithi134.stdout:9/44: write f3 [1686681,89435] 0 2024-03-12T16:10:17.601 INFO:tasks.workunit.client.1.smithi134.stdout:9/45: stat f3 0 2024-03-12T16:10:17.608 INFO:tasks.workunit.client.1.smithi134.stdout:9/46: dwrite f0 [0,4194304] 0 2024-03-12T16:10:17.613 INFO:tasks.workunit.client.1.smithi134.stdout:9/47: dread f0 [8388608,4194304] 0 2024-03-12T16:10:17.617 INFO:tasks.workunit.client.1.smithi134.stdout:9/48: dread f0 [0,4194304] 0 2024-03-12T16:10:17.619 INFO:tasks.workunit.client.1.smithi134.stdout:9/49: write f0 [6900479,93445] 0 2024-03-12T16:10:17.670 INFO:tasks.workunit.client.1.smithi134.stdout:6/22: fdatasync f0 0 2024-03-12T16:10:17.673 INFO:tasks.workunit.client.1.smithi134.stdout:6/23: mknod d1/d4/c8 0 2024-03-12T16:10:17.684 INFO:tasks.workunit.client.1.smithi134.stdout:8/24: rename d3/f4 to d3/f6 0 2024-03-12T16:10:17.685 INFO:tasks.workunit.client.1.smithi134.stdout:8/25: fdatasync d3/f6 0 2024-03-12T16:10:17.688 INFO:tasks.workunit.client.1.smithi134.stdout:8/26: rename f2 to d3/f7 0 2024-03-12T16:10:17.692 INFO:tasks.workunit.client.1.smithi134.stdout:4/33: rename d1/d5 to d1/de 0 2024-03-12T16:10:17.697 INFO:tasks.workunit.client.1.smithi134.stdout:6/24: truncate d1/f5 3321725 0 2024-03-12T16:10:17.703 INFO:tasks.workunit.client.1.smithi134.stdout:3/46: dwrite d1/f5 [0,4194304] 0 2024-03-12T16:10:17.703 INFO:tasks.workunit.client.1.smithi134.stdout:4/34: dwrite d1/f4 [4194304,4194304] 0 2024-03-12T16:10:17.704 INFO:tasks.workunit.client.1.smithi134.stdout:3/47: read - d1/f6 zero size 2024-03-12T16:10:17.706 INFO:tasks.workunit.client.1.smithi134.stdout:3/48: fdatasync d1/f4 0 2024-03-12T16:10:17.709 INFO:tasks.workunit.client.1.smithi134.stdout:5/34: dread f3 [0,4194304] 0 2024-03-12T16:10:17.715 INFO:tasks.workunit.client.1.smithi134.stdout:8/27: rename d3/f7 to d3/f8 0 2024-03-12T16:10:17.715 INFO:tasks.workunit.client.1.smithi134.stdout:4/35: dread d1/de/f8 [0,4194304] 0 2024-03-12T16:10:17.715 INFO:tasks.workunit.client.1.smithi134.stdout:5/35: mknod c7 0 2024-03-12T16:10:17.722 INFO:tasks.workunit.client.1.smithi134.stdout:4/36: mkdir d1/df 0 2024-03-12T16:10:17.723 INFO:tasks.workunit.client.1.smithi134.stdout:4/37: chown f0 1 1 2024-03-12T16:10:17.727 INFO:tasks.workunit.client.1.smithi134.stdout:8/28: dwrite d3/f8 [0,4194304] 0 2024-03-12T16:10:17.728 INFO:tasks.workunit.client.1.smithi134.stdout:4/38: creat d1/df/f10 x:0 0 0 2024-03-12T16:10:17.731 INFO:tasks.workunit.client.1.smithi134.stdout:6/25: truncate f0 2612759 0 2024-03-12T16:10:17.733 INFO:tasks.workunit.client.1.smithi134.stdout:3/49: truncate d1/f5 3739008 0 2024-03-12T16:10:17.734 INFO:tasks.workunit.client.1.smithi134.stdout:8/29: dread d3/f6 [4194304,4194304] 0 2024-03-12T16:10:17.737 INFO:tasks.workunit.client.1.smithi134.stdout:3/50: symlink d1/db/l16 0 2024-03-12T16:10:17.744 INFO:tasks.workunit.client.1.smithi134.stdout:4/39: dwrite d1/f4 [0,4194304] 0 2024-03-12T16:10:17.745 INFO:tasks.workunit.client.1.smithi134.stdout:3/51: mknod d1/db/d14/c17 0 2024-03-12T16:10:17.753 INFO:tasks.workunit.client.1.smithi134.stdout:3/52: rename d1/db to d1/db/d14/d18 22 2024-03-12T16:10:17.756 INFO:tasks.workunit.client.1.smithi134.stdout:8/30: dwrite d3/f8 [0,4194304] 0 2024-03-12T16:10:17.758 INFO:tasks.workunit.client.1.smithi134.stdout:6/26: dwrite d1/f5 [0,4194304] 0 2024-03-12T16:10:17.761 INFO:tasks.workunit.client.1.smithi134.stdout:3/53: creat d1/db/f19 x:0 0 0 2024-03-12T16:10:17.762 INFO:tasks.workunit.client.1.smithi134.stdout:5/36: dwrite f3 [0,4194304] 0 2024-03-12T16:10:17.764 INFO:tasks.workunit.client.1.smithi134.stdout:8/31: mkdir d3/d9 0 2024-03-12T16:10:17.766 INFO:tasks.workunit.client.1.smithi134.stdout:5/37: symlink l8 0 2024-03-12T16:10:17.767 INFO:tasks.workunit.client.1.smithi134.stdout:3/54: symlink d1/db/d12/l1a 0 2024-03-12T16:10:17.768 INFO:tasks.workunit.client.1.smithi134.stdout:4/40: dwrite d1/f3 [0,4194304] 0 2024-03-12T16:10:17.770 INFO:tasks.workunit.client.1.smithi134.stdout:3/55: read - d1/db/d12/f13 zero size 2024-03-12T16:10:17.771 INFO:tasks.workunit.client.1.smithi134.stdout:5/38: symlink l9 0 2024-03-12T16:10:17.774 INFO:tasks.workunit.client.1.smithi134.stdout:5/39: symlink la 0 2024-03-12T16:10:17.776 INFO:tasks.workunit.client.1.smithi134.stdout:3/56: chown d1/db 20638 1 2024-03-12T16:10:17.776 INFO:tasks.workunit.client.1.smithi134.stdout:5/40: mkdir db 0 2024-03-12T16:10:17.780 INFO:tasks.workunit.client.1.smithi134.stdout:3/57: symlink d1/db/d12/l1b 0 2024-03-12T16:10:17.780 INFO:tasks.workunit.client.1.smithi134.stdout:4/41: dwrite d1/f4 [4194304,4194304] 0 2024-03-12T16:10:17.783 INFO:tasks.workunit.client.1.smithi134.stdout:5/41: dread f5 [0,4194304] 0 2024-03-12T16:10:17.785 INFO:tasks.workunit.client.1.smithi134.stdout:3/58: unlink d1/db/d12/l1b 0 2024-03-12T16:10:17.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/42: rename d1/df/f10 to d1/de/f11 0 2024-03-12T16:10:17.788 INFO:tasks.workunit.client.1.smithi134.stdout:4/43: read d1/de/f6 [4290026,104983] 0 2024-03-12T16:10:17.788 INFO:tasks.workunit.client.1.smithi134.stdout:3/59: mknod d1/db/d14/c1c 0 2024-03-12T16:10:17.790 INFO:tasks.workunit.client.1.smithi134.stdout:5/42: dread f3 [0,4194304] 0 2024-03-12T16:10:17.791 INFO:tasks.workunit.client.1.smithi134.stdout:4/44: truncate d1/de/f8 1353763 0 2024-03-12T16:10:17.792 INFO:tasks.workunit.client.1.smithi134.stdout:5/43: write f5 [4171092,105830] 0 2024-03-12T16:10:17.798 INFO:tasks.workunit.client.1.smithi134.stdout:3/60: dwrite d1/f2 [0,4194304] 0 2024-03-12T16:10:17.800 INFO:tasks.workunit.client.1.smithi134.stdout:6/27: truncate d1/f5 1181653 0 2024-03-12T16:10:17.801 INFO:tasks.workunit.client.1.smithi134.stdout:5/44: dread f5 [0,4194304] 0 2024-03-12T16:10:17.801 INFO:tasks.workunit.client.1.smithi134.stdout:6/28: rename d1 to d1/d3/d9 22 2024-03-12T16:10:17.802 INFO:tasks.workunit.client.1.smithi134.stdout:3/61: symlink d1/db/d10/l1d 0 2024-03-12T16:10:17.803 INFO:tasks.workunit.client.1.smithi134.stdout:6/29: mknod d1/d3/ca 0 2024-03-12T16:10:17.805 INFO:tasks.workunit.client.1.smithi134.stdout:5/45: mkdir db/dc 0 2024-03-12T16:10:17.808 INFO:tasks.workunit.client.1.smithi134.stdout:6/30: creat d1/d4/fb x:0 0 0 2024-03-12T16:10:17.811 INFO:tasks.workunit.client.1.smithi134.stdout:6/31: mkdir d1/dc 0 2024-03-12T16:10:17.813 INFO:tasks.workunit.client.1.smithi134.stdout:3/62: dwrite d1/f5 [0,4194304] 0 2024-03-12T16:10:17.813 INFO:tasks.workunit.client.1.smithi134.stdout:5/46: rmdir db/dc 0 2024-03-12T16:10:17.820 INFO:tasks.workunit.client.1.smithi134.stdout:4/45: truncate d1/f4 157267 0 2024-03-12T16:10:17.825 INFO:tasks.workunit.client.1.smithi134.stdout:4/46: symlink d1/df/l12 0 2024-03-12T16:10:17.827 INFO:tasks.workunit.client.1.smithi134.stdout:3/63: fsync d1/f2 0 2024-03-12T16:10:17.828 INFO:tasks.workunit.client.1.smithi134.stdout:5/47: dwrite f6 [0,4194304] 0 2024-03-12T16:10:17.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/47: unlink d1/df/l12 0 2024-03-12T16:10:17.831 INFO:tasks.workunit.client.1.smithi134.stdout:5/48: chown c7 3530 1 2024-03-12T16:10:17.831 INFO:tasks.workunit.client.1.smithi134.stdout:4/48: dread - d1/de/f11 zero size 2024-03-12T16:10:17.832 INFO:tasks.workunit.client.1.smithi134.stdout:6/32: dwrite d1/f5 [0,4194304] 0 2024-03-12T16:10:17.833 INFO:tasks.workunit.client.1.smithi134.stdout:5/49: chown f5 38 1 2024-03-12T16:10:17.835 INFO:tasks.workunit.client.1.smithi134.stdout:4/49: mkdir d1/d13 0 2024-03-12T16:10:17.839 INFO:tasks.workunit.client.1.smithi134.stdout:6/33: stat d1/d4/c8 0 2024-03-12T16:10:17.843 INFO:tasks.workunit.client.1.smithi134.stdout:3/64: dwrite d1/fc [0,4194304] 0 2024-03-12T16:10:17.845 INFO:tasks.workunit.client.1.smithi134.stdout:4/50: link d1/f3 d1/df/f14 0 2024-03-12T16:10:17.848 INFO:tasks.workunit.client.1.smithi134.stdout:6/34: mknod d1/d4/cd 0 2024-03-12T16:10:17.849 INFO:tasks.workunit.client.1.smithi134.stdout:3/65: creat d1/db/d12/f1e x:0 0 0 2024-03-12T16:10:17.853 INFO:tasks.workunit.client.1.smithi134.stdout:6/35: creat d1/d4/fe x:0 0 0 2024-03-12T16:10:17.854 INFO:tasks.workunit.client.1.smithi134.stdout:5/50: dwrite f3 [4194304,4194304] 0 2024-03-12T16:10:17.854 INFO:tasks.workunit.client.1.smithi134.stdout:3/66: creat d1/db/d10/f1f x:0 0 0 2024-03-12T16:10:17.856 INFO:tasks.workunit.client.1.smithi134.stdout:6/36: write d1/d4/fe [850697,63234] 0 2024-03-12T16:10:17.858 INFO:tasks.workunit.client.1.smithi134.stdout:3/67: unlink d1/db/f15 0 2024-03-12T16:10:17.860 INFO:tasks.workunit.client.1.smithi134.stdout:5/51: creat db/fd x:0 0 0 2024-03-12T16:10:17.862 INFO:tasks.workunit.client.1.smithi134.stdout:5/52: symlink db/le 0 2024-03-12T16:10:17.865 INFO:tasks.workunit.client.1.smithi134.stdout:6/37: dread f0 [0,4194304] 0 2024-03-12T16:10:17.866 INFO:tasks.workunit.client.1.smithi134.stdout:5/53: rename la to db/lf 0 2024-03-12T16:10:17.869 INFO:tasks.workunit.client.1.smithi134.stdout:6/38: creat d1/dc/ff x:0 0 0 2024-03-12T16:10:17.869 INFO:tasks.workunit.client.1.smithi134.stdout:3/68: dwrite d1/f6 [0,4194304] 0 2024-03-12T16:10:17.870 INFO:tasks.workunit.client.1.smithi134.stdout:6/39: chown d1/dc/ff 13 1 2024-03-12T16:10:17.871 INFO:tasks.workunit.client.1.smithi134.stdout:5/54: rename db/fd to db/f10 0 2024-03-12T16:10:17.874 INFO:tasks.workunit.client.1.smithi134.stdout:5/55: creat db/f11 x:0 0 0 2024-03-12T16:10:17.876 INFO:tasks.workunit.client.1.smithi134.stdout:5/56: truncate db/f10 665224 0 2024-03-12T16:10:17.879 INFO:tasks.workunit.client.1.smithi134.stdout:3/69: dwrite d1/f4 [0,4194304] 0 2024-03-12T16:10:17.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/70: write d1/fc [4171612,99822] 0 2024-03-12T16:10:17.889 INFO:tasks.workunit.client.1.smithi134.stdout:3/71: creat d1/db/f20 x:0 0 0 2024-03-12T16:10:17.892 INFO:tasks.workunit.client.1.smithi134.stdout:4/51: dwrite d1/de/f6 [4194304,4194304] 0 2024-03-12T16:10:17.894 INFO:tasks.workunit.client.1.smithi134.stdout:3/72: write d1/db/d12/f13 [1044028,51304] 0 2024-03-12T16:10:17.895 INFO:tasks.workunit.client.1.smithi134.stdout:5/57: dwrite db/f10 [0,4194304] 0 2024-03-12T16:10:17.897 INFO:tasks.workunit.client.1.smithi134.stdout:6/40: rename d1/dc to d1/d3/d10 0 2024-03-12T16:10:17.897 INFO:tasks.workunit.client.1.smithi134.stdout:4/52: stat d1/de/lb 0 2024-03-12T16:10:17.899 INFO:tasks.workunit.client.1.smithi134.stdout:5/58: mkdir db/d12 0 2024-03-12T16:10:17.899 INFO:tasks.workunit.client.1.smithi134.stdout:4/53: dread d1/f4 [0,4194304] 0 2024-03-12T16:10:17.900 INFO:tasks.workunit.client.1.smithi134.stdout:5/59: readlink db/le 0 2024-03-12T16:10:17.901 INFO:tasks.workunit.client.1.smithi134.stdout:3/73: creat d1/db/d10/f21 x:0 0 0 2024-03-12T16:10:17.902 INFO:tasks.workunit.client.1.smithi134.stdout:3/74: fdatasync d1/f2 0 2024-03-12T16:10:17.906 INFO:tasks.workunit.client.1.smithi134.stdout:4/54: link f0 d1/d13/f15 0 2024-03-12T16:10:17.911 INFO:tasks.workunit.client.1.smithi134.stdout:6/41: dwrite d1/f5 [0,4194304] 0 2024-03-12T16:10:17.915 INFO:tasks.workunit.client.1.smithi134.stdout:6/42: write d1/d4/fe [1520525,122907] 0 2024-03-12T16:10:17.918 INFO:tasks.workunit.client.1.smithi134.stdout:6/43: symlink d1/l11 0 2024-03-12T16:10:17.919 INFO:tasks.workunit.client.1.smithi134.stdout:4/55: dwrite d1/de/f6 [4194304,4194304] 0 2024-03-12T16:10:17.920 INFO:tasks.workunit.client.1.smithi134.stdout:6/44: write d1/d4/fe [1667371,98893] 0 2024-03-12T16:10:17.922 INFO:tasks.workunit.client.1.smithi134.stdout:4/56: fdatasync d1/de/f11 0 2024-03-12T16:10:17.922 INFO:tasks.workunit.client.1.smithi134.stdout:6/45: write d1/f5 [722105,10440] 0 2024-03-12T16:10:17.923 INFO:tasks.workunit.client.1.smithi134.stdout:6/46: write f0 [2483320,98316] 0 2024-03-12T16:10:17.927 INFO:tasks.workunit.client.1.smithi134.stdout:6/47: rename d1/d4/cd to d1/c12 0 2024-03-12T16:10:17.928 INFO:tasks.workunit.client.1.smithi134.stdout:6/48: stat d1/d3/d10 0 2024-03-12T16:10:17.931 INFO:tasks.workunit.client.1.smithi134.stdout:4/57: getdents d1/de 0 2024-03-12T16:10:17.931 INFO:tasks.workunit.client.1.smithi134.stdout:4/58: readlink d1/ld 0 2024-03-12T16:10:17.934 INFO:tasks.workunit.client.1.smithi134.stdout:6/49: symlink d1/d3/d10/l13 0 2024-03-12T16:10:17.934 INFO:tasks.workunit.client.1.smithi134.stdout:4/59: symlink d1/d13/l16 0 2024-03-12T16:10:17.945 INFO:tasks.workunit.client.1.smithi134.stdout:6/50: rmdir d1/d4 39 2024-03-12T16:10:17.946 INFO:tasks.workunit.client.1.smithi134.stdout:6/51: write d1/d4/fb [812616,23464] 0 2024-03-12T16:10:17.949 INFO:tasks.workunit.client.1.smithi134.stdout:6/52: creat d1/d4/f14 x:0 0 0 2024-03-12T16:10:17.950 INFO:tasks.workunit.client.1.smithi134.stdout:4/60: dwrite d1/f3 [0,4194304] 0 2024-03-12T16:10:17.951 INFO:tasks.workunit.client.1.smithi134.stdout:4/61: dread - d1/de/f11 zero size 2024-03-12T16:10:17.951 INFO:tasks.workunit.client.1.smithi134.stdout:6/53: creat d1/d3/d10/f15 x:0 0 0 2024-03-12T16:10:17.952 INFO:tasks.workunit.client.1.smithi134.stdout:6/54: fsync f0 0 2024-03-12T16:10:17.956 INFO:tasks.workunit.client.1.smithi134.stdout:4/62: rename d1/d13/f15 to d1/de/f17 0 2024-03-12T16:10:17.957 INFO:tasks.workunit.client.1.smithi134.stdout:6/55: mkdir d1/d16 0 2024-03-12T16:10:17.957 INFO:tasks.workunit.client.1.smithi134.stdout:4/63: stat d1/la 0 2024-03-12T16:10:17.958 INFO:tasks.workunit.client.1.smithi134.stdout:6/56: truncate d1/d4/f14 827578 0 2024-03-12T16:10:17.961 INFO:tasks.workunit.client.1.smithi134.stdout:6/57: creat d1/d3/f17 x:0 0 0 2024-03-12T16:10:17.963 INFO:tasks.workunit.client.1.smithi134.stdout:6/58: rename d1/d4/c8 to d1/d16/c18 0 2024-03-12T16:10:17.965 INFO:tasks.workunit.client.1.smithi134.stdout:6/59: mkdir d1/d3/d19 0 2024-03-12T16:10:17.966 INFO:tasks.workunit.client.1.smithi134.stdout:6/60: readlink d1/l11 0 2024-03-12T16:10:17.967 INFO:tasks.workunit.client.1.smithi134.stdout:6/61: mknod d1/d3/c1a 0 2024-03-12T16:10:17.968 INFO:tasks.workunit.client.1.smithi134.stdout:4/64: write d1/de/f8 [493100,120181] 0 2024-03-12T16:10:17.970 INFO:tasks.workunit.client.1.smithi134.stdout:4/65: dread d1/de/f8 [0,4194304] 0 2024-03-12T16:10:17.974 INFO:tasks.workunit.client.1.smithi134.stdout:4/66: dread d1/f3 [0,4194304] 0 2024-03-12T16:10:17.974 INFO:tasks.workunit.client.1.smithi134.stdout:6/62: rmdir d1 39 2024-03-12T16:10:17.977 INFO:tasks.workunit.client.1.smithi134.stdout:6/63: creat d1/d4/f1b x:0 0 0 2024-03-12T16:10:17.979 INFO:tasks.workunit.client.1.smithi134.stdout:6/64: creat d1/d4/f1c x:0 0 0 2024-03-12T16:10:17.981 INFO:tasks.workunit.client.1.smithi134.stdout:4/67: dwrite d1/df/f14 [0,4194304] 0 2024-03-12T16:10:17.981 INFO:tasks.workunit.client.1.smithi134.stdout:6/65: creat d1/f1d x:0 0 0 2024-03-12T16:10:17.984 INFO:tasks.workunit.client.1.smithi134.stdout:4/68: unlink f0 0 2024-03-12T16:10:17.987 INFO:tasks.workunit.client.1.smithi134.stdout:4/69: mkdir d1/d13/d18 0 2024-03-12T16:10:17.989 INFO:tasks.workunit.client.1.smithi134.stdout:6/66: dwrite d1/f5 [0,4194304] 0 2024-03-12T16:10:17.990 INFO:tasks.workunit.client.1.smithi134.stdout:4/70: write d1/de/f8 [980387,92740] 0 2024-03-12T16:10:17.992 INFO:tasks.workunit.client.1.smithi134.stdout:4/71: write d1/de/f11 [30777,22567] 0 2024-03-12T16:10:17.997 INFO:tasks.workunit.client.1.smithi134.stdout:4/72: rename d1/f4 to d1/df/f19 0 2024-03-12T16:10:17.999 INFO:tasks.workunit.client.1.smithi134.stdout:6/67: dwrite d1/d4/f14 [0,4194304] 0 2024-03-12T16:10:18.001 INFO:tasks.workunit.client.1.smithi134.stdout:6/68: write d1/d4/fe [2337850,8951] 0 2024-03-12T16:10:18.003 INFO:tasks.workunit.client.1.smithi134.stdout:6/69: chown d1/d3/l6 2 1 2024-03-12T16:10:18.005 INFO:tasks.workunit.client.1.smithi134.stdout:6/70: write d1/d3/d10/f15 [556167,83342] 0 2024-03-12T16:10:18.006 INFO:tasks.workunit.client.1.smithi134.stdout:6/71: chown d1 25 1 2024-03-12T16:10:18.007 INFO:tasks.workunit.client.1.smithi134.stdout:4/73: dwrite d1/f3 [0,4194304] 0 2024-03-12T16:10:18.008 INFO:tasks.workunit.client.1.smithi134.stdout:4/74: readlink d1/d13/l16 0 2024-03-12T16:10:18.010 INFO:tasks.workunit.client.1.smithi134.stdout:6/72: creat d1/f1e x:0 0 0 2024-03-12T16:10:18.011 INFO:tasks.workunit.client.1.smithi134.stdout:6/73: write d1/f5 [1745434,49620] 0 2024-03-12T16:10:18.014 INFO:tasks.workunit.client.1.smithi134.stdout:4/75: unlink d1/de/f8 0 2024-03-12T16:10:18.017 INFO:tasks.workunit.client.1.smithi134.stdout:6/74: creat d1/d3/d19/f1f x:0 0 0 2024-03-12T16:10:18.020 INFO:tasks.workunit.client.1.smithi134.stdout:4/76: rename d1/de/f6 to d1/d13/f1a 0 2024-03-12T16:10:18.023 INFO:tasks.workunit.client.1.smithi134.stdout:6/75: rename f0 to d1/d4/f20 0 2024-03-12T16:10:18.025 INFO:tasks.workunit.client.1.smithi134.stdout:4/77: creat d1/d13/f1b x:0 0 0 2024-03-12T16:10:18.028 INFO:tasks.workunit.client.1.smithi134.stdout:6/76: creat d1/d4/f21 x:0 0 0 2024-03-12T16:10:18.032 INFO:tasks.workunit.client.1.smithi134.stdout:6/77: creat d1/d3/f22 x:0 0 0 2024-03-12T16:10:18.033 INFO:tasks.workunit.client.1.smithi134.stdout:4/78: dwrite d1/d13/f1b [0,4194304] 0 2024-03-12T16:10:18.035 INFO:tasks.workunit.client.1.smithi134.stdout:6/78: write d1/f1d [283794,69142] 0 2024-03-12T16:10:18.041 INFO:tasks.workunit.client.1.smithi134.stdout:4/79: write d1/de/f11 [915574,47282] 0 2024-03-12T16:10:18.043 INFO:tasks.workunit.client.1.smithi134.stdout:4/80: mkdir d1/d13/d18/d1c 0 2024-03-12T16:10:18.044 INFO:tasks.workunit.client.1.smithi134.stdout:4/81: read d1/d13/f1a [5471896,54591] 0 2024-03-12T16:10:18.047 INFO:tasks.workunit.client.1.smithi134.stdout:4/82: rename d1/df/f14 to d1/d13/f1d 0 2024-03-12T16:10:18.049 INFO:tasks.workunit.client.1.smithi134.stdout:4/83: write d1/df/f19 [117360,36016] 0 2024-03-12T16:10:18.051 INFO:tasks.workunit.client.1.smithi134.stdout:4/84: symlink d1/d13/d18/d1c/l1e 0 2024-03-12T16:10:18.053 INFO:tasks.workunit.client.1.smithi134.stdout:4/85: creat d1/de/f1f x:0 0 0 2024-03-12T16:10:18.054 INFO:tasks.workunit.client.1.smithi134.stdout:4/86: read d1/de/f17 [2740974,58456] 0 2024-03-12T16:10:18.058 INFO:tasks.workunit.client.1.smithi134.stdout:4/87: dread d1/f3 [0,4194304] 0 2024-03-12T16:10:18.087 INFO:tasks.workunit.client.1.smithi134.stdout:4/88: mkdir d1/d13/d18/d20 0 2024-03-12T16:10:18.087 INFO:tasks.workunit.client.1.smithi134.stdout:4/89: stat d1/d13/d18/d1c 0 2024-03-12T16:10:18.211 INFO:tasks.workunit.client.1.smithi134.stdout:4/90: link d1/ld d1/d13/l21 0 2024-03-12T16:10:18.216 INFO:tasks.workunit.client.1.smithi134.stdout:4/91: dread d1/de/f17 [4194304,4194304] 0 2024-03-12T16:10:18.216 INFO:tasks.workunit.client.1.smithi134.stdout:4/92: stat d1/d13/l16 0 2024-03-12T16:10:18.218 INFO:tasks.workunit.client.1.smithi134.stdout:4/93: mknod d1/de/c22 0 2024-03-12T16:10:18.220 INFO:tasks.workunit.client.1.smithi134.stdout:4/94: creat d1/f23 x:0 0 0 2024-03-12T16:10:18.221 INFO:tasks.workunit.client.1.smithi134.stdout:4/95: write d1/de/f1f [592931,89829] 0 2024-03-12T16:10:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:17.490319+0000 mgr.smithi134.gcntfu (mgr.24383) 42 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 222 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 393 op/s 2024-03-12T16:10:18.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:17.490319+0000 mgr.smithi134.gcntfu (mgr.24383) 42 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 222 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 393 op/s 2024-03-12T16:10:20.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:19.490633+0000 mgr.smithi134.gcntfu (mgr.24383) 43 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 222 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 393 op/s 2024-03-12T16:10:20.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:19.490633+0000 mgr.smithi134.gcntfu (mgr.24383) 43 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 222 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.0 MiB/s wr, 393 op/s 2024-03-12T16:10:22.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:22 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:21.491330+0000 mgr.smithi134.gcntfu (mgr.24383) 44 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 386 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 33 MiB/s wr, 432 op/s 2024-03-12T16:10:22.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:22 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:21.491330+0000 mgr.smithi134.gcntfu (mgr.24383) 44 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 386 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 33 MiB/s wr, 432 op/s 2024-03-12T16:10:24.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:23.491811+0000 mgr.smithi134.gcntfu (mgr.24383) 45 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 386 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 31 MiB/s wr, 227 op/s 2024-03-12T16:10:24.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:23.491811+0000 mgr.smithi134.gcntfu (mgr.24383) 45 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 386 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 31 MiB/s wr, 227 op/s 2024-03-12T16:10:26.593 INFO:tasks.workunit.client.0.smithi006.stdout:4/6: sync 2024-03-12T16:10:26.593 INFO:tasks.workunit.client.0.smithi006.stdout:4/7: dread - no filename 2024-03-12T16:10:26.594 INFO:tasks.workunit.client.0.smithi006.stdout:4/8: chown . 396694 1 2024-03-12T16:10:26.596 INFO:tasks.workunit.client.0.smithi006.stdout:4/9: mknod c0 0 2024-03-12T16:10:26.596 INFO:tasks.workunit.client.0.smithi006.stdout:4/10: dread - no filename 2024-03-12T16:10:26.596 INFO:tasks.workunit.client.0.smithi006.stdout:4/11: write - no filename 2024-03-12T16:10:26.596 INFO:tasks.workunit.client.0.smithi006.stdout:4/12: fsync - no filename 2024-03-12T16:10:26.596 INFO:tasks.workunit.client.0.smithi006.stdout:4/13: dwrite - no filename 2024-03-12T16:10:26.596 INFO:tasks.workunit.client.0.smithi006.stdout:4/14: write - no filename 2024-03-12T16:10:26.598 INFO:tasks.workunit.client.0.smithi006.stdout:4/15: mkdir d1 0 2024-03-12T16:10:26.601 INFO:tasks.workunit.client.0.smithi006.stdout:4/16: rename c0 to d1/c2 0 2024-03-12T16:10:26.602 INFO:tasks.workunit.client.0.smithi006.stdout:4/17: mknod d1/c3 0 2024-03-12T16:10:26.604 INFO:tasks.workunit.client.0.smithi006.stdout:4/18: symlink d1/l4 0 2024-03-12T16:10:26.606 INFO:tasks.workunit.client.0.smithi006.stdout:4/19: mknod d1/c5 0 2024-03-12T16:10:26.607 INFO:tasks.workunit.client.0.smithi006.stdout:4/20: symlink d1/l6 0 2024-03-12T16:10:26.609 INFO:tasks.workunit.client.0.smithi006.stdout:4/21: mknod d1/c7 0 2024-03-12T16:10:26.610 INFO:tasks.workunit.client.0.smithi006.stdout:4/22: symlink d1/l8 0 2024-03-12T16:10:26.612 INFO:tasks.workunit.client.0.smithi006.stdout:4/23: rename d1/c5 to d1/c9 0 2024-03-12T16:10:26.612 INFO:tasks.workunit.client.0.smithi006.stdout:4/24: fdatasync - no filename 2024-03-12T16:10:26.613 INFO:tasks.workunit.client.0.smithi006.stdout:4/25: creat d1/fa x:0 0 0 2024-03-12T16:10:26.614 INFO:tasks.workunit.client.0.smithi006.stdout:4/26: write d1/fa [800529,2234] 0 2024-03-12T16:10:26.616 INFO:tasks.workunit.client.0.smithi006.stdout:4/27: mkdir d1/db 0 2024-03-12T16:10:26.616 INFO:tasks.workunit.client.0.smithi006.stdout:4/28: chown d1/c7 1324200911 1 2024-03-12T16:10:26.617 INFO:tasks.workunit.client.0.smithi006.stdout:4/29: truncate d1/fa 988178 0 2024-03-12T16:10:26.618 INFO:tasks.workunit.client.0.smithi006.stdout:4/30: rename d1/db to d1/db/dc 22 2024-03-12T16:10:26.618 INFO:tasks.workunit.client.0.smithi006.stdout:4/31: fdatasync d1/fa 0 2024-03-12T16:10:26.619 INFO:tasks.workunit.client.0.smithi006.stdout:4/32: readlink d1/l6 0 2024-03-12T16:10:26.621 INFO:tasks.workunit.client.0.smithi006.stdout:4/33: symlink d1/ld 0 2024-03-12T16:10:26.621 INFO:tasks.workunit.client.0.smithi006.stdout:4/34: write d1/fa [786461,21925] 0 2024-03-12T16:10:26.630 INFO:tasks.workunit.client.0.smithi006.stdout:4/35: chown d1/c9 31405 1 2024-03-12T16:10:26.630 INFO:tasks.workunit.client.0.smithi006.stdout:4/36: chown d1/fa 30474 1 2024-03-12T16:10:26.632 INFO:tasks.workunit.client.0.smithi006.stdout:4/37: mkdir d1/de 0 2024-03-12T16:10:26.636 INFO:tasks.workunit.client.0.smithi006.stdout:4/38: dread d1/fa [0,4194304] 0 2024-03-12T16:10:26.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:25.492436+0000 mgr.smithi134.gcntfu (mgr.24383) 46 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 389 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 31 MiB/s wr, 234 op/s 2024-03-12T16:10:26.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:25.492436+0000 mgr.smithi134.gcntfu (mgr.24383) 46 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 389 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 31 MiB/s wr, 234 op/s 2024-03-12T16:10:28.651 INFO:tasks.workunit.client.0.smithi006.stdout:4/39: sync 2024-03-12T16:10:28.651 INFO:tasks.workunit.client.0.smithi006.stdout:1/39: sync 2024-03-12T16:10:28.651 INFO:tasks.workunit.client.0.smithi006.stdout:0/109: sync 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:7/66: sync 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:5/34: sync 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:3/15: sync 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:2/7: sync 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:8/5: sync 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:8/6: fdatasync - no filename 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:8/7: dread - no filename 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:6/13: sync 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:9/13: sync 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:9/14: dwrite - no filename 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:9/15: read - no filename 2024-03-12T16:10:28.652 INFO:tasks.workunit.client.0.smithi006.stdout:9/16: dread - no filename 2024-03-12T16:10:28.654 INFO:tasks.workunit.client.0.smithi006.stdout:3/16: mknod c7 0 2024-03-12T16:10:28.654 INFO:tasks.workunit.client.0.smithi006.stdout:3/17: rmdir - no directory 2024-03-12T16:10:28.655 INFO:tasks.workunit.client.0.smithi006.stdout:4/40: write d1/fa [614235,82264] 0 2024-03-12T16:10:28.656 INFO:tasks.workunit.client.0.smithi006.stdout:2/8: creat d0/f5 x:0 0 0 2024-03-12T16:10:28.657 INFO:tasks.workunit.client.0.smithi006.stdout:4/41: write d1/fa [1320702,95205] 0 2024-03-12T16:10:28.661 INFO:tasks.workunit.client.0.smithi006.stdout:3/18: mkdir d8 0 2024-03-12T16:10:28.662 INFO:tasks.workunit.client.0.smithi006.stdout:8/8: mknod d2/c3 0 2024-03-12T16:10:28.662 INFO:tasks.workunit.client.0.smithi006.stdout:8/9: dread - no filename 2024-03-12T16:10:28.663 INFO:tasks.workunit.client.0.smithi006.stdout:8/10: fdatasync - no filename 2024-03-12T16:10:28.664 INFO:tasks.workunit.client.0.smithi006.stdout:8/11: chown d2 42445938 1 2024-03-12T16:10:28.667 INFO:tasks.workunit.client.0.smithi006.stdout:2/9: chown d0/l3 6 1 2024-03-12T16:10:28.669 INFO:tasks.workunit.client.0.smithi006.stdout:9/17: creat d0/d1/f2 x:0 0 0 2024-03-12T16:10:28.670 INFO:tasks.workunit.client.0.smithi006.stdout:7/67: creat de/f17 x:0 0 0 2024-03-12T16:10:28.671 INFO:tasks.workunit.client.0.smithi006.stdout:5/35: symlink d7/d8/le 0 2024-03-12T16:10:28.672 INFO:tasks.workunit.client.0.smithi006.stdout:6/14: truncate f2 233777 0 2024-03-12T16:10:28.674 INFO:tasks.workunit.client.0.smithi006.stdout:2/10: rename d0/l3 to d0/l6 0 2024-03-12T16:10:28.675 INFO:tasks.workunit.client.0.smithi006.stdout:4/42: dwrite d1/fa [0,4194304] 0 2024-03-12T16:10:28.676 INFO:tasks.workunit.client.0.smithi006.stdout:3/19: symlink d8/l9 0 2024-03-12T16:10:28.676 INFO:tasks.workunit.client.0.smithi006.stdout:8/12: chown l1 2673 1 2024-03-12T16:10:28.678 INFO:tasks.workunit.client.0.smithi006.stdout:7/68: mkdir de/d18 0 2024-03-12T16:10:28.680 INFO:tasks.workunit.client.0.smithi006.stdout:9/18: mknod d0/d1/c3 0 2024-03-12T16:10:28.682 INFO:tasks.workunit.client.0.smithi006.stdout:1/40: dwrite d0/fc [0,4194304] 0 2024-03-12T16:10:28.684 INFO:tasks.workunit.client.0.smithi006.stdout:0/110: dread d2/d6/d10/d11/f18 [0,4194304] 0 2024-03-12T16:10:28.686 INFO:tasks.workunit.client.0.smithi006.stdout:2/11: symlink d0/l7 0 2024-03-12T16:10:28.691 INFO:tasks.workunit.client.0.smithi006.stdout:8/13: creat d2/f4 x:0 0 0 2024-03-12T16:10:28.693 INFO:tasks.workunit.client.0.smithi006.stdout:7/69: fsync f6 0 2024-03-12T16:10:28.695 INFO:tasks.workunit.client.0.smithi006.stdout:9/19: dwrite d0/d1/f2 [0,4194304] 0 2024-03-12T16:10:28.699 INFO:tasks.workunit.client.0.smithi006.stdout:0/111: unlink d2/d6/le 0 2024-03-12T16:10:28.701 INFO:tasks.workunit.client.0.smithi006.stdout:2/12: symlink d0/l8 0 2024-03-12T16:10:28.706 INFO:tasks.workunit.client.0.smithi006.stdout:5/36: write d7/d9/fc [171151,60695] 0 2024-03-12T16:10:28.707 INFO:tasks.workunit.client.0.smithi006.stdout:0/112: dread d2/f15 [0,4194304] 0 2024-03-12T16:10:28.707 INFO:tasks.workunit.client.0.smithi006.stdout:4/43: creat d1/db/ff x:0 0 0 2024-03-12T16:10:28.715 INFO:tasks.workunit.client.0.smithi006.stdout:7/70: getdents de/d18 0 2024-03-12T16:10:28.715 INFO:tasks.workunit.client.0.smithi006.stdout:1/41: link d0/f3 d0/ff 0 2024-03-12T16:10:28.716 INFO:tasks.workunit.client.0.smithi006.stdout:3/20: getdents d8 0 2024-03-12T16:10:28.717 INFO:tasks.workunit.client.0.smithi006.stdout:4/44: rmdir d1 39 2024-03-12T16:10:28.722 INFO:tasks.workunit.client.0.smithi006.stdout:5/37: dwrite f4 [0,4194304] 0 2024-03-12T16:10:28.723 INFO:tasks.workunit.client.0.smithi006.stdout:5/38: chown d7/d8 0 1 2024-03-12T16:10:28.786 INFO:tasks.workunit.client.0.smithi006.stdout:2/13: rename d0/l2 to d0/l9 0 2024-03-12T16:10:28.788 INFO:tasks.workunit.client.0.smithi006.stdout:7/71: truncate de/f10 343525 0 2024-03-12T16:10:28.790 INFO:tasks.workunit.client.0.smithi006.stdout:3/21: symlink d8/la 0 2024-03-12T16:10:28.792 INFO:tasks.workunit.client.0.smithi006.stdout:8/14: getdents d2 0 2024-03-12T16:10:28.794 INFO:tasks.workunit.client.0.smithi006.stdout:1/42: fdatasync d0/f3 0 2024-03-12T16:10:28.794 INFO:tasks.workunit.client.0.smithi006.stdout:4/45: dread d1/fa [0,4194304] 0 2024-03-12T16:10:28.797 INFO:tasks.workunit.client.0.smithi006.stdout:3/22: mkdir d8/db 0 2024-03-12T16:10:28.799 INFO:tasks.workunit.client.0.smithi006.stdout:5/39: rename d7/d8/lb to d7/d8/lf 0 2024-03-12T16:10:28.800 INFO:tasks.workunit.client.0.smithi006.stdout:0/113: getdents d2/d6 0 2024-03-12T16:10:28.801 INFO:tasks.workunit.client.0.smithi006.stdout:8/15: mkdir d2/d5 0 2024-03-12T16:10:28.803 INFO:tasks.workunit.client.0.smithi006.stdout:7/72: creat de/d18/f19 x:0 0 0 2024-03-12T16:10:28.804 INFO:tasks.workunit.client.0.smithi006.stdout:5/40: write d7/d9/fc [917472,36157] 0 2024-03-12T16:10:28.804 INFO:tasks.workunit.client.0.smithi006.stdout:1/43: symlink d0/l10 0 2024-03-12T16:10:28.806 INFO:tasks.workunit.client.0.smithi006.stdout:0/114: fdatasync d2/f15 0 2024-03-12T16:10:28.807 INFO:tasks.workunit.client.0.smithi006.stdout:3/23: dread f5 [0,4194304] 0 2024-03-12T16:10:28.808 INFO:tasks.workunit.client.0.smithi006.stdout:8/16: mknod d2/c6 0 2024-03-12T16:10:28.810 INFO:tasks.workunit.client.0.smithi006.stdout:2/14: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:28.819 INFO:tasks.workunit.client.0.smithi006.stdout:3/24: dread f1 [0,4194304] 0 2024-03-12T16:10:28.819 INFO:tasks.workunit.client.0.smithi006.stdout:5/41: dwrite f4 [0,4194304] 0 2024-03-12T16:10:28.824 INFO:tasks.workunit.client.0.smithi006.stdout:3/25: dread f5 [0,4194304] 0 2024-03-12T16:10:28.825 INFO:tasks.workunit.client.0.smithi006.stdout:2/15: creat d0/fa x:0 0 0 2024-03-12T16:10:28.826 INFO:tasks.workunit.client.0.smithi006.stdout:2/16: dread - d0/fa zero size 2024-03-12T16:10:28.826 INFO:tasks.workunit.client.0.smithi006.stdout:7/73: write f6 [845965,56836] 0 2024-03-12T16:10:28.828 INFO:tasks.workunit.client.0.smithi006.stdout:7/74: chown de/f17 653 1 2024-03-12T16:10:28.828 INFO:tasks.workunit.client.0.smithi006.stdout:5/42: mkdir d7/d9/d10 0 2024-03-12T16:10:28.828 INFO:tasks.workunit.client.0.smithi006.stdout:4/46: truncate d1/fa 3558760 0 2024-03-12T16:10:28.831 INFO:tasks.workunit.client.0.smithi006.stdout:8/17: rmdir d2/d5 0 2024-03-12T16:10:28.832 INFO:tasks.workunit.client.0.smithi006.stdout:8/18: fdatasync d2/f4 0 2024-03-12T16:10:28.832 INFO:tasks.workunit.client.0.smithi006.stdout:2/17: creat d0/fb x:0 0 0 2024-03-12T16:10:28.836 INFO:tasks.workunit.client.0.smithi006.stdout:5/43: symlink d7/l11 0 2024-03-12T16:10:28.838 INFO:tasks.workunit.client.0.smithi006.stdout:3/26: dwrite f1 [4194304,4194304] 0 2024-03-12T16:10:28.838 INFO:tasks.workunit.client.0.smithi006.stdout:1/44: getdents d0 0 2024-03-12T16:10:28.841 INFO:tasks.workunit.client.0.smithi006.stdout:1/45: read - d0/f6 zero size 2024-03-12T16:10:28.841 INFO:tasks.workunit.client.0.smithi006.stdout:0/115: getdents d2/d6/d10 0 2024-03-12T16:10:28.842 INFO:tasks.workunit.client.0.smithi006.stdout:0/116: chown d2/f1f 92 1 2024-03-12T16:10:28.842 INFO:tasks.workunit.client.0.smithi006.stdout:8/19: symlink d2/l7 0 2024-03-12T16:10:28.845 INFO:tasks.workunit.client.0.smithi006.stdout:2/18: unlink d0/fb 0 2024-03-12T16:10:28.846 INFO:tasks.workunit.client.0.smithi006.stdout:2/19: chown d0/f5 3768 1 2024-03-12T16:10:28.847 INFO:tasks.workunit.client.0.smithi006.stdout:1/46: dread d0/f4 [0,4194304] 0 2024-03-12T16:10:28.852 INFO:tasks.workunit.client.0.smithi006.stdout:8/20: rename d2/c3 to d2/c8 0 2024-03-12T16:10:28.853 INFO:tasks.workunit.client.0.smithi006.stdout:2/20: mkdir d0/dc 0 2024-03-12T16:10:28.855 INFO:tasks.workunit.client.0.smithi006.stdout:4/47: write d1/fa [3012506,100914] 0 2024-03-12T16:10:28.856 INFO:tasks.workunit.client.0.smithi006.stdout:7/75: dwrite de/f12 [0,4194304] 0 2024-03-12T16:10:28.859 INFO:tasks.workunit.client.0.smithi006.stdout:3/27: mkdir d8/db/dc 0 2024-03-12T16:10:28.860 INFO:tasks.workunit.client.0.smithi006.stdout:1/47: truncate d0/f5 3981961 0 2024-03-12T16:10:28.860 INFO:tasks.workunit.client.0.smithi006.stdout:3/28: read f1 [805244,43638] 0 2024-03-12T16:10:28.862 INFO:tasks.workunit.client.0.smithi006.stdout:3/29: chown c7 19 1 2024-03-12T16:10:28.863 INFO:tasks.workunit.client.0.smithi006.stdout:8/21: creat d2/f9 x:0 0 0 2024-03-12T16:10:28.865 INFO:tasks.workunit.client.0.smithi006.stdout:7/76: fsync fc 0 2024-03-12T16:10:28.866 INFO:tasks.workunit.client.0.smithi006.stdout:5/44: link l5 d7/d9/l12 0 2024-03-12T16:10:28.869 INFO:tasks.workunit.client.0.smithi006.stdout:4/48: unlink d1/db/ff 0 2024-03-12T16:10:28.869 INFO:tasks.workunit.client.0.smithi006.stdout:2/21: dwrite d0/f5 [0,4194304] 0 2024-03-12T16:10:28.872 INFO:tasks.workunit.client.0.smithi006.stdout:5/45: chown d7/d9/d10 383 1 2024-03-12T16:10:28.873 INFO:tasks.workunit.client.0.smithi006.stdout:4/49: readlink d1/l8 0 2024-03-12T16:10:28.874 INFO:tasks.workunit.client.0.smithi006.stdout:0/117: dwrite d2/d6/f7 [0,4194304] 0 2024-03-12T16:10:28.878 INFO:tasks.workunit.client.0.smithi006.stdout:3/30: dwrite f0 [8388608,4194304] 0 2024-03-12T16:10:28.884 INFO:tasks.workunit.client.0.smithi006.stdout:6/15: sync 2024-03-12T16:10:28.884 INFO:tasks.workunit.client.0.smithi006.stdout:5/46: creat d7/f13 x:0 0 0 2024-03-12T16:10:28.886 INFO:tasks.workunit.client.0.smithi006.stdout:6/16: chown d3 67 1 2024-03-12T16:10:28.886 INFO:tasks.workunit.client.0.smithi006.stdout:2/22: rename d0/fa to d0/dc/fd 0 2024-03-12T16:10:28.890 INFO:tasks.workunit.client.0.smithi006.stdout:8/22: link d2/f4 d2/fa 0 2024-03-12T16:10:28.901 INFO:tasks.workunit.client.0.smithi006.stdout:4/50: dwrite d1/fa [0,4194304] 0 2024-03-12T16:10:28.903 INFO:tasks.workunit.client.0.smithi006.stdout:0/118: getdents d2/d6/d10/d11/d1d 0 2024-03-12T16:10:28.905 INFO:tasks.workunit.client.0.smithi006.stdout:8/23: mkdir d2/db 0 2024-03-12T16:10:28.905 INFO:tasks.workunit.client.0.smithi006.stdout:3/31: dwrite f1 [4194304,4194304] 0 2024-03-12T16:10:28.906 INFO:tasks.workunit.client.0.smithi006.stdout:6/17: mknod d3/c5 0 2024-03-12T16:10:28.907 INFO:tasks.workunit.client.0.smithi006.stdout:1/48: write d0/f5 [3550568,45080] 0 2024-03-12T16:10:28.909 INFO:tasks.workunit.client.0.smithi006.stdout:6/18: stat d3/c5 0 2024-03-12T16:10:28.912 INFO:tasks.workunit.client.0.smithi006.stdout:2/23: dread d0/f4 [0,4194304] 0 2024-03-12T16:10:28.913 INFO:tasks.workunit.client.0.smithi006.stdout:3/32: rename d8 to d8/db/dd 22 2024-03-12T16:10:28.914 INFO:tasks.workunit.client.0.smithi006.stdout:4/51: symlink d1/de/l10 0 2024-03-12T16:10:28.914 INFO:tasks.workunit.client.0.smithi006.stdout:0/119: rename d2/f1c to d2/f22 0 2024-03-12T16:10:28.915 INFO:tasks.workunit.client.0.smithi006.stdout:1/49: dread - d0/fa zero size 2024-03-12T16:10:28.915 INFO:tasks.workunit.client.0.smithi006.stdout:8/24: symlink d2/lc 0 2024-03-12T16:10:28.917 INFO:tasks.workunit.client.0.smithi006.stdout:5/47: getdents d7/d9 0 2024-03-12T16:10:28.918 INFO:tasks.workunit.client.0.smithi006.stdout:6/19: creat d3/f6 x:0 0 0 2024-03-12T16:10:28.918 INFO:tasks.workunit.client.0.smithi006.stdout:8/25: truncate d2/f4 369916 0 2024-03-12T16:10:28.919 INFO:tasks.workunit.client.0.smithi006.stdout:6/20: stat d3/c5 0 2024-03-12T16:10:28.919 INFO:tasks.workunit.client.0.smithi006.stdout:3/33: creat d8/fe x:0 0 0 2024-03-12T16:10:28.920 INFO:tasks.workunit.client.0.smithi006.stdout:4/52: creat d1/de/f11 x:0 0 0 2024-03-12T16:10:28.921 INFO:tasks.workunit.client.0.smithi006.stdout:1/50: unlink d0/l10 0 2024-03-12T16:10:28.922 INFO:tasks.workunit.client.0.smithi006.stdout:0/120: write d2/d6/d10/f1a [34937,75201] 0 2024-03-12T16:10:28.923 INFO:tasks.workunit.client.0.smithi006.stdout:5/48: chown d7/d9/l12 677946 1 2024-03-12T16:10:28.924 INFO:tasks.workunit.client.0.smithi006.stdout:6/21: creat d3/f7 x:0 0 0 2024-03-12T16:10:28.925 INFO:tasks.workunit.client.0.smithi006.stdout:3/34: mkdir d8/df 0 2024-03-12T16:10:28.927 INFO:tasks.workunit.client.0.smithi006.stdout:6/22: write d3/f7 [165153,95086] 0 2024-03-12T16:10:28.927 INFO:tasks.workunit.client.0.smithi006.stdout:3/35: write f1 [9555810,106199] 0 2024-03-12T16:10:28.928 INFO:tasks.workunit.client.0.smithi006.stdout:0/121: fdatasync d2/d6/d10/f12 0 2024-03-12T16:10:28.931 INFO:tasks.workunit.client.0.smithi006.stdout:1/51: dread d0/f7 [0,4194304] 0 2024-03-12T16:10:28.931 INFO:tasks.workunit.client.0.smithi006.stdout:0/122: write d2/d6/d10/f1a [736728,9240] 0 2024-03-12T16:10:28.931 INFO:tasks.workunit.client.0.smithi006.stdout:5/49: dread d7/d9/fc [0,4194304] 0 2024-03-12T16:10:28.933 INFO:tasks.workunit.client.0.smithi006.stdout:2/24: getdents d0 0 2024-03-12T16:10:28.933 INFO:tasks.workunit.client.0.smithi006.stdout:5/50: dread - d7/f13 zero size 2024-03-12T16:10:28.936 INFO:tasks.workunit.client.0.smithi006.stdout:3/36: creat d8/db/f10 x:0 0 0 2024-03-12T16:10:28.937 INFO:tasks.workunit.client.0.smithi006.stdout:1/52: dread d0/f7 [0,4194304] 0 2024-03-12T16:10:28.938 INFO:tasks.workunit.client.0.smithi006.stdout:8/26: write d2/fa [787228,118384] 0 2024-03-12T16:10:28.939 INFO:tasks.workunit.client.0.smithi006.stdout:8/27: chown d2/db 9 1 2024-03-12T16:10:28.939 INFO:tasks.workunit.client.0.smithi006.stdout:0/123: symlink d2/l23 0 2024-03-12T16:10:28.940 INFO:tasks.workunit.client.0.smithi006.stdout:8/28: write d2/f9 [468242,40406] 0 2024-03-12T16:10:28.941 INFO:tasks.workunit.client.0.smithi006.stdout:5/51: rmdir d7/d9 39 2024-03-12T16:10:28.943 INFO:tasks.workunit.client.0.smithi006.stdout:3/37: rename f5 to d8/db/dc/f11 0 2024-03-12T16:10:28.944 INFO:tasks.workunit.client.0.smithi006.stdout:3/38: fdatasync d8/db/f10 0 2024-03-12T16:10:28.944 INFO:tasks.workunit.client.0.smithi006.stdout:1/53: symlink d0/l11 0 2024-03-12T16:10:28.945 INFO:tasks.workunit.client.0.smithi006.stdout:1/54: stat d0/f4 0 2024-03-12T16:10:28.945 INFO:tasks.workunit.client.0.smithi006.stdout:0/124: dread - d2/f22 zero size 2024-03-12T16:10:28.946 INFO:tasks.workunit.client.0.smithi006.stdout:2/25: unlink d0/l6 0 2024-03-12T16:10:28.947 INFO:tasks.workunit.client.0.smithi006.stdout:2/26: dread - d0/dc/fd zero size 2024-03-12T16:10:28.947 INFO:tasks.workunit.client.0.smithi006.stdout:8/29: rmdir d2 39 2024-03-12T16:10:28.950 INFO:tasks.workunit.client.0.smithi006.stdout:5/52: rename d7/f13 to d7/d8/f14 0 2024-03-12T16:10:28.951 INFO:tasks.workunit.client.0.smithi006.stdout:3/39: write d8/db/dc/f11 [5426632,83268] 0 2024-03-12T16:10:28.952 INFO:tasks.workunit.client.0.smithi006.stdout:3/40: write d8/fe [918167,83864] 0 2024-03-12T16:10:28.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:27.492993+0000 mgr.smithi134.gcntfu (mgr.24383) 47 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 389 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-03-12T16:10:28.953 INFO:tasks.workunit.client.0.smithi006.stdout:1/55: creat d0/f12 x:0 0 0 2024-03-12T16:10:28.956 INFO:tasks.workunit.client.0.smithi006.stdout:8/30: write d2/fa [1398659,98761] 0 2024-03-12T16:10:28.956 INFO:tasks.workunit.client.0.smithi006.stdout:2/27: symlink d0/dc/le 0 2024-03-12T16:10:28.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:27.492993+0000 mgr.smithi134.gcntfu (mgr.24383) 47 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 389 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-03-12T16:10:28.957 INFO:tasks.workunit.client.0.smithi006.stdout:8/31: chown l1 262055458 1 2024-03-12T16:10:28.960 INFO:tasks.workunit.client.0.smithi006.stdout:6/23: getdents d3 0 2024-03-12T16:10:28.962 INFO:tasks.workunit.client.0.smithi006.stdout:1/56: rename d0/f5 to d0/f13 0 2024-03-12T16:10:28.964 INFO:tasks.workunit.client.0.smithi006.stdout:0/125: write d2/f4 [1472238,44690] 0 2024-03-12T16:10:28.964 INFO:tasks.workunit.client.0.smithi006.stdout:2/28: rmdir d0 39 2024-03-12T16:10:28.965 INFO:tasks.workunit.client.0.smithi006.stdout:8/32: creat d2/fd x:0 0 0 2024-03-12T16:10:28.966 INFO:tasks.workunit.client.0.smithi006.stdout:0/126: truncate d2/d6/d10/f1a 1082683 0 2024-03-12T16:10:28.969 INFO:tasks.workunit.client.0.smithi006.stdout:0/127: creat d2/d6/f24 x:0 0 0 2024-03-12T16:10:28.970 INFO:tasks.workunit.client.0.smithi006.stdout:0/128: readlink d2/l13 0 2024-03-12T16:10:28.971 INFO:tasks.workunit.client.0.smithi006.stdout:8/33: rename d2/f4 to d2/db/fe 0 2024-03-12T16:10:28.974 INFO:tasks.workunit.client.0.smithi006.stdout:2/29: unlink d0/f5 0 2024-03-12T16:10:28.975 INFO:tasks.workunit.client.0.smithi006.stdout:3/41: getdents d8/db/dc 0 2024-03-12T16:10:28.977 INFO:tasks.workunit.client.0.smithi006.stdout:1/57: write d0/f4 [1264488,36075] 0 2024-03-12T16:10:28.978 INFO:tasks.workunit.client.0.smithi006.stdout:5/53: truncate d7/d9/fc 622106 0 2024-03-12T16:10:28.979 INFO:tasks.workunit.client.0.smithi006.stdout:5/54: read - d7/d8/f14 zero size 2024-03-12T16:10:28.985 INFO:tasks.workunit.client.0.smithi006.stdout:1/58: symlink d0/l14 0 2024-03-12T16:10:28.987 INFO:tasks.workunit.client.0.smithi006.stdout:0/129: dwrite d2/d6/d10/f1a [0,4194304] 0 2024-03-12T16:10:28.991 INFO:tasks.workunit.client.0.smithi006.stdout:8/34: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:29.000 INFO:tasks.workunit.client.0.smithi006.stdout:0/130: unlink d2/d6/d10/d11/f18 0 2024-03-12T16:10:29.000 INFO:tasks.workunit.client.0.smithi006.stdout:3/42: dwrite f1 [8388608,4194304] 0 2024-03-12T16:10:29.003 INFO:tasks.workunit.client.0.smithi006.stdout:0/131: chown d2 2646179 1 2024-03-12T16:10:29.004 INFO:tasks.workunit.client.0.smithi006.stdout:2/30: dwrite d0/dc/fd [0,4194304] 0 2024-03-12T16:10:29.007 INFO:tasks.workunit.client.0.smithi006.stdout:8/35: dread d2/f9 [0,4194304] 0 2024-03-12T16:10:29.008 INFO:tasks.workunit.client.0.smithi006.stdout:2/31: mkdir d0/dc/df 0 2024-03-12T16:10:29.009 INFO:tasks.workunit.client.0.smithi006.stdout:3/43: mknod d8/df/c12 0 2024-03-12T16:10:29.009 INFO:tasks.workunit.client.0.smithi006.stdout:0/132: chown d2/d6/d10/f12 1 1 2024-03-12T16:10:29.012 INFO:tasks.workunit.client.0.smithi006.stdout:8/36: creat d2/ff x:0 0 0 2024-03-12T16:10:29.013 INFO:tasks.workunit.client.0.smithi006.stdout:0/133: readlink d2/d6/l8 0 2024-03-12T16:10:29.014 INFO:tasks.workunit.client.0.smithi006.stdout:2/32: creat d0/f10 x:0 0 0 2024-03-12T16:10:29.014 INFO:tasks.workunit.client.0.smithi006.stdout:5/55: dwrite d7/d9/fc [0,4194304] 0 2024-03-12T16:10:29.018 INFO:tasks.workunit.client.0.smithi006.stdout:8/37: dread - d2/ff zero size 2024-03-12T16:10:29.018 INFO:tasks.workunit.client.0.smithi006.stdout:0/134: fdatasync d2/d6/f24 0 2024-03-12T16:10:29.020 INFO:tasks.workunit.client.0.smithi006.stdout:2/33: chown d0/l8 420 1 2024-03-12T16:10:29.020 INFO:tasks.workunit.client.0.smithi006.stdout:1/59: dwrite d0/fa [0,4194304] 0 2024-03-12T16:10:29.023 INFO:tasks.workunit.client.0.smithi006.stdout:1/60: readlink d0/l9 0 2024-03-12T16:10:29.024 INFO:tasks.workunit.client.0.smithi006.stdout:8/38: fsync d2/f9 0 2024-03-12T16:10:29.025 INFO:tasks.workunit.client.0.smithi006.stdout:1/61: readlink d0/l14 0 2024-03-12T16:10:29.026 INFO:tasks.workunit.client.0.smithi006.stdout:0/135: read d2/fd [1288061,121717] 0 2024-03-12T16:10:29.026 INFO:tasks.workunit.client.0.smithi006.stdout:2/34: symlink d0/l11 0 2024-03-12T16:10:29.028 INFO:tasks.workunit.client.0.smithi006.stdout:1/62: dread - d0/f12 zero size 2024-03-12T16:10:29.030 INFO:tasks.workunit.client.0.smithi006.stdout:3/44: dwrite f0 [4194304,4194304] 0 2024-03-12T16:10:29.031 INFO:tasks.workunit.client.0.smithi006.stdout:8/39: symlink d2/db/l10 0 2024-03-12T16:10:29.033 INFO:tasks.workunit.client.0.smithi006.stdout:5/56: dread f4 [0,4194304] 0 2024-03-12T16:10:29.033 INFO:tasks.workunit.client.0.smithi006.stdout:1/63: mknod d0/c15 0 2024-03-12T16:10:29.033 INFO:tasks.workunit.client.0.smithi006.stdout:2/35: write d0/dc/fd [2600375,44080] 0 2024-03-12T16:10:29.036 INFO:tasks.workunit.client.0.smithi006.stdout:8/40: readlink d2/db/l10 0 2024-03-12T16:10:29.039 INFO:tasks.workunit.client.0.smithi006.stdout:1/64: creat d0/f16 x:0 0 0 2024-03-12T16:10:29.042 INFO:tasks.workunit.client.0.smithi006.stdout:5/57: mknod d7/c15 0 2024-03-12T16:10:29.045 INFO:tasks.workunit.client.0.smithi006.stdout:0/136: dread f0 [0,4194304] 0 2024-03-12T16:10:29.047 INFO:tasks.workunit.client.0.smithi006.stdout:3/45: dwrite d8/db/f10 [0,4194304] 0 2024-03-12T16:10:29.048 INFO:tasks.workunit.client.0.smithi006.stdout:5/58: creat d7/d9/f16 x:0 0 0 2024-03-12T16:10:29.050 INFO:tasks.workunit.client.0.smithi006.stdout:0/137: mknod d2/d6/c25 0 2024-03-12T16:10:29.052 INFO:tasks.workunit.client.0.smithi006.stdout:5/59: rmdir d7/d8 39 2024-03-12T16:10:29.055 INFO:tasks.workunit.client.0.smithi006.stdout:0/138: chown d2/l13 660 1 2024-03-12T16:10:29.056 INFO:tasks.workunit.client.0.smithi006.stdout:2/36: dread d0/dc/fd [0,4194304] 0 2024-03-12T16:10:29.060 INFO:tasks.workunit.client.0.smithi006.stdout:8/41: dwrite d2/ff [0,4194304] 0 2024-03-12T16:10:29.066 INFO:tasks.workunit.client.0.smithi006.stdout:8/42: mkdir d2/d11 0 2024-03-12T16:10:29.071 INFO:tasks.workunit.client.0.smithi006.stdout:5/60: dread d7/d9/fc [0,4194304] 0 2024-03-12T16:10:29.074 INFO:tasks.workunit.client.0.smithi006.stdout:8/43: unlink d2/l7 0 2024-03-12T16:10:29.075 INFO:tasks.workunit.client.0.smithi006.stdout:3/46: dwrite d8/fe [0,4194304] 0 2024-03-12T16:10:29.079 INFO:tasks.workunit.client.0.smithi006.stdout:5/61: read d7/d9/fc [633718,54127] 0 2024-03-12T16:10:29.080 INFO:tasks.workunit.client.0.smithi006.stdout:1/65: dwrite d0/fe [0,4194304] 0 2024-03-12T16:10:29.081 INFO:tasks.workunit.client.0.smithi006.stdout:8/44: fsync d2/db/fe 0 2024-03-12T16:10:29.083 INFO:tasks.workunit.client.0.smithi006.stdout:5/62: stat l2 0 2024-03-12T16:10:29.087 INFO:tasks.workunit.client.0.smithi006.stdout:1/66: mknod d0/c17 0 2024-03-12T16:10:29.087 INFO:tasks.workunit.client.0.smithi006.stdout:0/139: dwrite d2/d6/d10/f12 [0,4194304] 0 2024-03-12T16:10:29.088 INFO:tasks.workunit.client.0.smithi006.stdout:2/37: dwrite d0/dc/fd [0,4194304] 0 2024-03-12T16:10:29.088 INFO:tasks.workunit.client.0.smithi006.stdout:5/63: stat d7/d9/d10 0 2024-03-12T16:10:29.090 INFO:tasks.workunit.client.0.smithi006.stdout:0/140: dread - d2/d6/f24 zero size 2024-03-12T16:10:29.093 INFO:tasks.workunit.client.0.smithi006.stdout:5/64: mknod d7/c17 0 2024-03-12T16:10:29.094 INFO:tasks.workunit.client.0.smithi006.stdout:0/141: mkdir d2/d6/d10/d26 0 2024-03-12T16:10:29.095 INFO:tasks.workunit.client.0.smithi006.stdout:8/45: dread d2/ff [0,4194304] 0 2024-03-12T16:10:29.096 INFO:tasks.workunit.client.0.smithi006.stdout:2/38: rename d0/f10 to d0/f12 0 2024-03-12T16:10:29.098 INFO:tasks.workunit.client.0.smithi006.stdout:9/20: sync 2024-03-12T16:10:29.098 INFO:tasks.workunit.client.0.smithi006.stdout:8/46: mknod d2/d11/c12 0 2024-03-12T16:10:29.099 INFO:tasks.workunit.client.0.smithi006.stdout:3/47: fsync d8/fe 0 2024-03-12T16:10:29.101 INFO:tasks.workunit.client.0.smithi006.stdout:3/48: chown f1 1698263524 1 2024-03-12T16:10:29.101 INFO:tasks.workunit.client.0.smithi006.stdout:9/21: write d0/d1/f2 [1717791,53698] 0 2024-03-12T16:10:29.101 INFO:tasks.workunit.client.0.smithi006.stdout:5/65: rename d7/d8/le to d7/d9/l18 0 2024-03-12T16:10:29.101 INFO:tasks.workunit.client.0.smithi006.stdout:0/142: dread d2/f15 [0,4194304] 0 2024-03-12T16:10:29.126 INFO:tasks.workunit.client.0.smithi006.stdout:2/39: getdents d0/dc 0 2024-03-12T16:10:29.127 INFO:tasks.workunit.client.0.smithi006.stdout:9/22: mkdir d0/d4 0 2024-03-12T16:10:29.127 INFO:tasks.workunit.client.0.smithi006.stdout:5/66: stat d7/d9/l12 0 2024-03-12T16:10:29.130 INFO:tasks.workunit.client.0.smithi006.stdout:5/67: read d7/d9/fc [62895,111687] 0 2024-03-12T16:10:29.130 INFO:tasks.workunit.client.0.smithi006.stdout:0/143: write d2/d6/d10/f1a [3285440,117832] 0 2024-03-12T16:10:29.131 INFO:tasks.workunit.client.0.smithi006.stdout:3/49: link f0 d8/db/f13 0 2024-03-12T16:10:29.137 INFO:tasks.workunit.client.0.smithi006.stdout:8/47: dwrite d2/fa [0,4194304] 0 2024-03-12T16:10:29.139 INFO:tasks.workunit.client.0.smithi006.stdout:0/144: unlink d2/f15 0 2024-03-12T16:10:29.142 INFO:tasks.workunit.client.0.smithi006.stdout:3/50: symlink d8/db/dc/l14 0 2024-03-12T16:10:29.144 INFO:tasks.workunit.client.0.smithi006.stdout:9/23: dwrite d0/d1/f2 [0,4194304] 0 2024-03-12T16:10:29.147 INFO:tasks.workunit.client.0.smithi006.stdout:2/40: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:29.151 INFO:tasks.workunit.client.0.smithi006.stdout:9/24: symlink d0/d1/l5 0 2024-03-12T16:10:29.152 INFO:tasks.workunit.client.0.smithi006.stdout:5/68: link d7/cd d7/c19 0 2024-03-12T16:10:29.153 INFO:tasks.workunit.client.0.smithi006.stdout:2/41: mkdir d0/d13 0 2024-03-12T16:10:29.157 INFO:tasks.workunit.client.0.smithi006.stdout:3/51: dread d8/db/dc/f11 [4194304,4194304] 0 2024-03-12T16:10:29.158 INFO:tasks.workunit.client.0.smithi006.stdout:3/52: read f1 [5555073,13676] 0 2024-03-12T16:10:29.160 INFO:tasks.workunit.client.0.smithi006.stdout:0/145: truncate d2/f4 1072364 0 2024-03-12T16:10:29.162 INFO:tasks.workunit.client.0.smithi006.stdout:5/69: write d7/d9/fc [2430423,6801] 0 2024-03-12T16:10:29.163 INFO:tasks.workunit.client.0.smithi006.stdout:0/146: chown d2/fd 26526 1 2024-03-12T16:10:29.165 INFO:tasks.workunit.client.0.smithi006.stdout:2/42: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:29.168 INFO:tasks.workunit.client.0.smithi006.stdout:0/147: creat d2/d6/d10/d11/f27 x:0 0 0 2024-03-12T16:10:29.168 INFO:tasks.workunit.client.0.smithi006.stdout:2/43: write d0/dc/fd [1417324,58489] 0 2024-03-12T16:10:29.175 INFO:tasks.workunit.client.0.smithi006.stdout:3/53: dread d8/db/dc/f11 [0,4194304] 0 2024-03-12T16:10:29.177 INFO:tasks.workunit.client.0.smithi006.stdout:5/70: dwrite d7/d9/f16 [0,4194304] 0 2024-03-12T16:10:29.177 INFO:tasks.workunit.client.0.smithi006.stdout:3/54: creat d8/f15 x:0 0 0 2024-03-12T16:10:29.179 INFO:tasks.workunit.client.0.smithi006.stdout:2/44: creat d0/dc/df/f14 x:0 0 0 2024-03-12T16:10:29.182 INFO:tasks.workunit.client.0.smithi006.stdout:0/148: rmdir d2/d6/d10/d26 0 2024-03-12T16:10:29.185 INFO:tasks.workunit.client.0.smithi006.stdout:3/55: symlink d8/l16 0 2024-03-12T16:10:29.187 INFO:tasks.workunit.client.0.smithi006.stdout:2/45: write d0/f12 [587811,49380] 0 2024-03-12T16:10:29.188 INFO:tasks.workunit.client.0.smithi006.stdout:3/56: creat d8/f17 x:0 0 0 2024-03-12T16:10:29.189 INFO:tasks.workunit.client.0.smithi006.stdout:5/71: creat d7/d9/d10/f1a x:0 0 0 2024-03-12T16:10:29.195 INFO:tasks.workunit.client.0.smithi006.stdout:5/72: write d7/d9/f16 [5034742,27437] 0 2024-03-12T16:10:29.195 INFO:tasks.workunit.client.0.smithi006.stdout:2/46: creat d0/dc/f15 x:0 0 0 2024-03-12T16:10:29.195 INFO:tasks.workunit.client.0.smithi006.stdout:9/25: fsync d0/d1/f2 0 2024-03-12T16:10:29.195 INFO:tasks.workunit.client.0.smithi006.stdout:5/73: read d7/d9/fc [2110027,80162] 0 2024-03-12T16:10:29.195 INFO:tasks.workunit.client.0.smithi006.stdout:9/26: write d0/d1/f2 [3243177,23508] 0 2024-03-12T16:10:29.196 INFO:tasks.workunit.client.0.smithi006.stdout:3/57: rename d8/db/dc/f11 to d8/df/f18 0 2024-03-12T16:10:29.204 INFO:tasks.workunit.client.0.smithi006.stdout:2/47: dwrite d0/dc/f15 [0,4194304] 0 2024-03-12T16:10:29.204 INFO:tasks.workunit.client.0.smithi006.stdout:9/27: fdatasync d0/d1/f2 0 2024-03-12T16:10:29.208 INFO:tasks.workunit.client.0.smithi006.stdout:9/28: write d0/d1/f2 [2690841,119778] 0 2024-03-12T16:10:29.208 INFO:tasks.workunit.client.0.smithi006.stdout:3/58: truncate f0 909503 0 2024-03-12T16:10:29.209 INFO:tasks.workunit.client.0.smithi006.stdout:2/48: creat d0/dc/df/f16 x:0 0 0 2024-03-12T16:10:29.209 INFO:tasks.workunit.client.0.smithi006.stdout:0/149: dwrite d2/f4 [0,4194304] 0 2024-03-12T16:10:29.212 INFO:tasks.workunit.client.0.smithi006.stdout:2/49: write d0/dc/f15 [702948,38238] 0 2024-03-12T16:10:29.213 INFO:tasks.workunit.client.0.smithi006.stdout:2/50: fdatasync d0/dc/fd 0 2024-03-12T16:10:29.216 INFO:tasks.workunit.client.0.smithi006.stdout:0/150: mknod d2/d6/c28 0 2024-03-12T16:10:29.216 INFO:tasks.workunit.client.0.smithi006.stdout:0/151: chown d2/d6 48875 1 2024-03-12T16:10:29.217 INFO:tasks.workunit.client.0.smithi006.stdout:2/51: symlink d0/dc/l17 0 2024-03-12T16:10:29.218 INFO:tasks.workunit.client.0.smithi006.stdout:9/29: link d0/d1/c3 d0/d1/c6 0 2024-03-12T16:10:29.218 INFO:tasks.workunit.client.0.smithi006.stdout:2/52: fsync d0/f12 0 2024-03-12T16:10:29.222 INFO:tasks.workunit.client.0.smithi006.stdout:0/152: rename d2/d6/f24 to d2/d6/d10/d11/d1d/f29 0 2024-03-12T16:10:29.223 INFO:tasks.workunit.client.0.smithi006.stdout:3/59: dread f1 [0,4194304] 0 2024-03-12T16:10:29.226 INFO:tasks.workunit.client.0.smithi006.stdout:3/60: dread f0 [0,4194304] 0 2024-03-12T16:10:29.227 INFO:tasks.workunit.client.0.smithi006.stdout:9/30: symlink d0/d4/l7 0 2024-03-12T16:10:29.228 INFO:tasks.workunit.client.0.smithi006.stdout:2/53: symlink d0/d13/l18 0 2024-03-12T16:10:29.228 INFO:tasks.workunit.client.0.smithi006.stdout:3/61: mkdir d8/d19 0 2024-03-12T16:10:29.229 INFO:tasks.workunit.client.0.smithi006.stdout:2/54: truncate d0/f12 1633562 0 2024-03-12T16:10:29.229 INFO:tasks.workunit.client.0.smithi006.stdout:0/153: dwrite d2/d6/d10/f1a [0,4194304] 0 2024-03-12T16:10:29.230 INFO:tasks.workunit.client.0.smithi006.stdout:3/62: write d8/fe [2696830,60821] 0 2024-03-12T16:10:29.231 INFO:tasks.workunit.client.0.smithi006.stdout:3/63: write d8/db/f10 [371985,32237] 0 2024-03-12T16:10:29.232 INFO:tasks.workunit.client.0.smithi006.stdout:0/154: mknod d2/c2a 0 2024-03-12T16:10:29.234 INFO:tasks.workunit.client.0.smithi006.stdout:2/55: mknod d0/dc/df/c19 0 2024-03-12T16:10:29.235 INFO:tasks.workunit.client.0.smithi006.stdout:0/155: write d2/d6/f7 [7720817,34585] 0 2024-03-12T16:10:29.238 INFO:tasks.workunit.client.0.smithi006.stdout:2/56: creat d0/dc/f1a x:0 0 0 2024-03-12T16:10:29.239 INFO:tasks.workunit.client.0.smithi006.stdout:2/57: dread - d0/dc/df/f14 zero size 2024-03-12T16:10:29.240 INFO:tasks.workunit.client.0.smithi006.stdout:0/156: truncate d2/fd 3006023 0 2024-03-12T16:10:29.246 INFO:tasks.workunit.client.0.smithi006.stdout:2/58: dwrite d0/dc/f15 [0,4194304] 0 2024-03-12T16:10:29.248 INFO:tasks.workunit.client.0.smithi006.stdout:2/59: symlink d0/dc/l1b 0 2024-03-12T16:10:29.250 INFO:tasks.workunit.client.0.smithi006.stdout:2/60: unlink d0/dc/le 0 2024-03-12T16:10:29.251 INFO:tasks.workunit.client.0.smithi006.stdout:3/64: truncate f1 206792 0 2024-03-12T16:10:29.252 INFO:tasks.workunit.client.0.smithi006.stdout:3/65: readlink d8/la 0 2024-03-12T16:10:29.256 INFO:tasks.workunit.client.0.smithi006.stdout:2/61: dread d0/f12 [0,4194304] 0 2024-03-12T16:10:29.262 INFO:tasks.workunit.client.0.smithi006.stdout:3/66: dwrite d8/db/f10 [0,4194304] 0 2024-03-12T16:10:29.264 INFO:tasks.workunit.client.0.smithi006.stdout:3/67: rmdir d8/db 39 2024-03-12T16:10:29.265 INFO:tasks.workunit.client.0.smithi006.stdout:0/157: dwrite d2/f1f [0,4194304] 0 2024-03-12T16:10:29.270 INFO:tasks.workunit.client.0.smithi006.stdout:3/68: creat d8/df/f1a x:0 0 0 2024-03-12T16:10:29.275 INFO:tasks.workunit.client.0.smithi006.stdout:2/62: truncate d0/f12 1320236 0 2024-03-12T16:10:29.276 INFO:tasks.workunit.client.0.smithi006.stdout:2/63: write d0/dc/f15 [4026347,103578] 0 2024-03-12T16:10:29.283 INFO:tasks.workunit.client.0.smithi006.stdout:3/69: dread d8/db/f13 [0,4194304] 0 2024-03-12T16:10:29.290 INFO:tasks.workunit.client.0.smithi006.stdout:2/64: dwrite d0/dc/f1a [0,4194304] 0 2024-03-12T16:10:29.291 INFO:tasks.workunit.client.0.smithi006.stdout:0/158: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:29.293 INFO:tasks.workunit.client.0.smithi006.stdout:2/65: write d0/dc/fd [2444080,128380] 0 2024-03-12T16:10:29.297 INFO:tasks.workunit.client.0.smithi006.stdout:2/66: read d0/dc/fd [1989690,47683] 0 2024-03-12T16:10:29.298 INFO:tasks.workunit.client.0.smithi006.stdout:0/159: rename d2/d6/d10/f12 to d2/f2b 0 2024-03-12T16:10:29.301 INFO:tasks.workunit.client.0.smithi006.stdout:3/70: dwrite f0 [0,4194304] 0 2024-03-12T16:10:29.302 INFO:tasks.workunit.client.0.smithi006.stdout:2/67: creat d0/f1c x:0 0 0 2024-03-12T16:10:29.312 INFO:tasks.workunit.client.0.smithi006.stdout:3/71: dread f1 [0,4194304] 0 2024-03-12T16:10:29.313 INFO:tasks.workunit.client.0.smithi006.stdout:2/68: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:29.322 INFO:tasks.workunit.client.0.smithi006.stdout:3/72: dread d8/df/f18 [0,4194304] 0 2024-03-12T16:10:29.325 INFO:tasks.workunit.client.0.smithi006.stdout:3/73: creat d8/db/dc/f1b x:0 0 0 2024-03-12T16:10:29.326 INFO:tasks.workunit.client.0.smithi006.stdout:2/69: dwrite d0/dc/fd [0,4194304] 0 2024-03-12T16:10:29.327 INFO:tasks.workunit.client.0.smithi006.stdout:3/74: chown d8/fe 1950120 1 2024-03-12T16:10:29.327 INFO:tasks.workunit.client.0.smithi006.stdout:2/70: write d0/f1c [570659,43912] 0 2024-03-12T16:10:29.330 INFO:tasks.workunit.client.0.smithi006.stdout:2/71: creat d0/d13/f1d x:0 0 0 2024-03-12T16:10:29.335 INFO:tasks.workunit.client.0.smithi006.stdout:3/75: link f0 d8/f1c 0 2024-03-12T16:10:29.337 INFO:tasks.workunit.client.0.smithi006.stdout:2/72: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:29.343 INFO:tasks.workunit.client.0.smithi006.stdout:2/73: mknod d0/d13/c1e 0 2024-03-12T16:10:29.348 INFO:tasks.workunit.client.0.smithi006.stdout:3/76: dwrite d8/f15 [0,4194304] 0 2024-03-12T16:10:29.348 INFO:tasks.workunit.client.0.smithi006.stdout:2/74: creat d0/f1f x:0 0 0 2024-03-12T16:10:29.351 INFO:tasks.workunit.client.0.smithi006.stdout:3/77: creat d8/db/f1d x:0 0 0 2024-03-12T16:10:29.355 INFO:tasks.workunit.client.0.smithi006.stdout:2/75: link d0/dc/df/f16 d0/dc/df/f20 0 2024-03-12T16:10:29.356 INFO:tasks.workunit.client.0.smithi006.stdout:2/76: readlink d0/dc/l17 0 2024-03-12T16:10:29.357 INFO:tasks.workunit.client.0.smithi006.stdout:2/77: write d0/dc/fd [4722795,31459] 0 2024-03-12T16:10:29.359 INFO:tasks.workunit.client.0.smithi006.stdout:2/78: write d0/dc/f1a [4065421,37383] 0 2024-03-12T16:10:29.360 INFO:tasks.workunit.client.0.smithi006.stdout:2/79: dread - d0/f1f zero size 2024-03-12T16:10:29.366 INFO:tasks.workunit.client.0.smithi006.stdout:3/78: dwrite d8/df/f18 [0,4194304] 0 2024-03-12T16:10:29.371 INFO:tasks.workunit.client.0.smithi006.stdout:3/79: creat d8/df/f1e x:0 0 0 2024-03-12T16:10:29.372 INFO:tasks.workunit.client.0.smithi006.stdout:7/77: sync 2024-03-12T16:10:29.372 INFO:tasks.workunit.client.0.smithi006.stdout:4/53: sync 2024-03-12T16:10:29.372 INFO:tasks.workunit.client.0.smithi006.stdout:3/80: creat d8/df/f1f x:0 0 0 2024-03-12T16:10:29.372 INFO:tasks.workunit.client.0.smithi006.stdout:3/81: fsync d8/df/f1a 0 2024-03-12T16:10:29.374 INFO:tasks.workunit.client.0.smithi006.stdout:4/54: mknod d1/c12 0 2024-03-12T16:10:29.376 INFO:tasks.workunit.client.0.smithi006.stdout:4/55: symlink d1/l13 0 2024-03-12T16:10:29.376 INFO:tasks.workunit.client.0.smithi006.stdout:7/78: dread f3 [0,4194304] 0 2024-03-12T16:10:29.377 INFO:tasks.workunit.client.0.smithi006.stdout:7/79: chown de/ff 11 1 2024-03-12T16:10:29.379 INFO:tasks.workunit.client.0.smithi006.stdout:4/56: rename d1/l6 to d1/de/l14 0 2024-03-12T16:10:29.384 INFO:tasks.workunit.client.0.smithi006.stdout:3/82: fsync d8/f1c 0 2024-03-12T16:10:29.386 INFO:tasks.workunit.client.0.smithi006.stdout:4/57: dread d1/fa [0,4194304] 0 2024-03-12T16:10:29.390 INFO:tasks.workunit.client.0.smithi006.stdout:4/58: mknod d1/de/c15 0 2024-03-12T16:10:29.390 INFO:tasks.workunit.client.0.smithi006.stdout:7/80: write de/ff [828457,3021] 0 2024-03-12T16:10:29.391 INFO:tasks.workunit.client.0.smithi006.stdout:3/83: dread d8/db/f10 [0,4194304] 0 2024-03-12T16:10:29.392 INFO:tasks.workunit.client.0.smithi006.stdout:7/81: fsync f5 0 2024-03-12T16:10:29.394 INFO:tasks.workunit.client.0.smithi006.stdout:3/84: creat d8/db/f20 x:0 0 0 2024-03-12T16:10:29.394 INFO:tasks.workunit.client.0.smithi006.stdout:7/82: stat ld 0 2024-03-12T16:10:29.399 INFO:tasks.workunit.client.0.smithi006.stdout:7/83: creat de/f1a x:0 0 0 2024-03-12T16:10:29.399 INFO:tasks.workunit.client.0.smithi006.stdout:7/84: write de/ff [380248,99585] 0 2024-03-12T16:10:29.400 INFO:tasks.workunit.client.0.smithi006.stdout:4/59: truncate d1/fa 3376941 0 2024-03-12T16:10:29.400 INFO:tasks.workunit.client.0.smithi006.stdout:7/85: chown f6 278852521 1 2024-03-12T16:10:29.403 INFO:tasks.workunit.client.0.smithi006.stdout:3/85: dwrite d8/df/f1a [0,4194304] 0 2024-03-12T16:10:29.404 INFO:tasks.workunit.client.0.smithi006.stdout:7/86: fsync f3 0 2024-03-12T16:10:29.409 INFO:tasks.workunit.client.0.smithi006.stdout:4/60: write d1/fa [173508,27084] 0 2024-03-12T16:10:29.414 INFO:tasks.workunit.client.0.smithi006.stdout:7/87: dread de/f12 [0,4194304] 0 2024-03-12T16:10:29.416 INFO:tasks.workunit.client.0.smithi006.stdout:3/86: dwrite d8/db/dc/f1b [0,4194304] 0 2024-03-12T16:10:29.418 INFO:tasks.workunit.client.0.smithi006.stdout:3/87: dread - d8/df/f1e zero size 2024-03-12T16:10:29.422 INFO:tasks.workunit.client.0.smithi006.stdout:3/88: chown d8/db/dc/f1b 23880801 1 2024-03-12T16:10:29.426 INFO:tasks.workunit.client.0.smithi006.stdout:4/61: dwrite d1/de/f11 [0,4194304] 0 2024-03-12T16:10:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.446+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/2307752203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb40fa960 msgr2=0x7f4bb40fcd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.446+0000 7f4bbbdcf700 1 --2- 172.21.15.6:0/2307752203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb40fa960 0x7f4bb40fcd50 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f4ba80047f0 tx=0x7f4ba8009cb0).stop 2024-03-12T16:10:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.446+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/2307752203 shutdown_connections 2024-03-12T16:10:29.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.446+0000 7f4bbbdcf700 1 --2- 172.21.15.6:0/2307752203 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb40fa960 0x7f4bb40fcd50 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.446+0000 7f4bbbdcf700 1 --2- 172.21.15.6:0/2307752203 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bb4061770 0x7f4bb40fa470 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.446+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/2307752203 >> 172.21.15.6:0/2307752203 conn(0x7f4bb40f1ef0 msgr2=0x7f4bb40f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.447+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/2307752203 shutdown_connections 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.447+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/2307752203 wait complete. 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.447+0000 7f4bbbdcf700 1 Processor -- start 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.447+0000 7f4bbbdcf700 1 -- start start 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bbbdcf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4061770 0x7f4bb4107f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bbbdcf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bb40fa960 0x7f4bb4108470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bbbdcf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb4108a20 con 0x7f4bb4061770 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bbbdcf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bb4108b60 con 0x7f4bb40fa960 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bb9b6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4061770 0x7f4bb4107f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bb9b6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4061770 0x7f4bb4107f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36170/0 (socket says 172.21.15.6:36170) 2024-03-12T16:10:29.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bb9b6b700 1 -- 172.21.15.6:0/3398294481 learned_addr learned my addr 172.21.15.6:0/3398294481 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bb936a700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bb40fa960 0x7f4bb4108470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bb9b6b700 1 -- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bb40fa960 msgr2=0x7f4bb4108470 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bb9b6b700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bb40fa960 0x7f4bb4108470 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bb9b6b700 1 -- 172.21.15.6:0/3398294481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4ba8005040 con 0x7f4bb4061770 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bb9b6b700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4061770 0x7f4bb4107f80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f4bb0002820 tx=0x7f4bb0009f00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4ba6ffd700 1 -- 172.21.15.6:0/3398294481 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bb0007b40 con 0x7f4bb4061770 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bb410d600 con 0x7f4bb4061770 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4ba6ffd700 1 -- 172.21.15.6:0/3398294481 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4bb000f040 con 0x7f4bb4061770 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4ba6ffd700 1 -- 172.21.15.6:0/3398294481 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bb0014820 con 0x7f4bb4061770 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.448+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bb410dbc0 con 0x7f4bb4061770 2024-03-12T16:10:29.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.449+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bb40fffc0 con 0x7f4bb4061770 2024-03-12T16:10:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.450+0000 7f4ba6ffd700 1 -- 172.21.15.6:0/3398294481 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f4bb0009110 con 0x7f4bb4061770 2024-03-12T16:10:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.450+0000 7f4ba6ffd700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4ba0066dc0 0x7f4ba0069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.450+0000 7f4ba6ffd700 1 -- 172.21.15.6:0/3398294481 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f4bb0083f50 con 0x7f4bb4061770 2024-03-12T16:10:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.451+0000 7f4bb936a700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4ba0066dc0 0x7f4ba0069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:10:29.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.451+0000 7f4bb936a700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4ba0066dc0 0x7f4ba0069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4ba8004f10 tx=0x7f4ba800b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:29.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.455+0000 7f4ba6ffd700 1 -- 172.21.15.6:0/3398294481 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f4bb00b7320 con 0x7f4bb4061770 2024-03-12T16:10:29.521 INFO:tasks.workunit.client.0.smithi006.stdout:7/88: dread de/f10 [0,4194304] 0 2024-03-12T16:10:29.521 INFO:tasks.workunit.client.0.smithi006.stdout:4/62: mknod d1/db/c16 0 2024-03-12T16:10:29.523 INFO:tasks.workunit.client.0.smithi006.stdout:3/89: getdents d8/db/dc 0 2024-03-12T16:10:29.525 INFO:tasks.workunit.client.0.smithi006.stdout:4/63: rename d1/de to d1/db/d17 0 2024-03-12T16:10:29.526 INFO:tasks.workunit.client.0.smithi006.stdout:7/89: creat de/d18/f1b x:0 0 0 2024-03-12T16:10:29.529 INFO:tasks.workunit.client.0.smithi006.stdout:3/90: creat d8/f21 x:0 0 0 2024-03-12T16:10:29.529 INFO:tasks.workunit.client.0.smithi006.stdout:3/91: stat d8/df 0 2024-03-12T16:10:29.531 INFO:tasks.workunit.client.0.smithi006.stdout:3/92: mknod d8/c22 0 2024-03-12T16:10:29.532 INFO:tasks.workunit.client.0.smithi006.stdout:3/93: fdatasync d8/db/f1d 0 2024-03-12T16:10:29.533 INFO:tasks.workunit.client.0.smithi006.stdout:7/90: fsync de/d18/f1b 0 2024-03-12T16:10:29.534 INFO:tasks.workunit.client.0.smithi006.stdout:4/64: truncate d1/db/d17/f11 1324526 0 2024-03-12T16:10:29.540 INFO:tasks.workunit.client.0.smithi006.stdout:7/91: dwrite de/f1a [0,4194304] 0 2024-03-12T16:10:29.542 INFO:tasks.workunit.client.0.smithi006.stdout:7/92: truncate de/f17 567663 0 2024-03-12T16:10:29.542 INFO:tasks.workunit.client.0.smithi006.stdout:7/93: write de/d18/f1b [65874,69409] 0 2024-03-12T16:10:29.545 INFO:tasks.workunit.client.0.smithi006.stdout:7/94: mkdir de/d1c 0 2024-03-12T16:10:29.546 INFO:tasks.workunit.client.0.smithi006.stdout:6/24: sync 2024-03-12T16:10:29.548 INFO:tasks.workunit.client.0.smithi006.stdout:7/95: mknod de/d1c/c1d 0 2024-03-12T16:10:29.551 INFO:tasks.workunit.client.0.smithi006.stdout:4/65: dwrite d1/db/d17/f11 [0,4194304] 0 2024-03-12T16:10:29.553 INFO:tasks.workunit.client.0.smithi006.stdout:6/25: unlink d3/f6 0 2024-03-12T16:10:29.555 INFO:tasks.workunit.client.0.smithi006.stdout:6/26: dread - f1 zero size 2024-03-12T16:10:29.556 INFO:tasks.workunit.client.0.smithi006.stdout:7/96: getdents de/d18 0 2024-03-12T16:10:29.559 INFO:tasks.workunit.client.0.smithi006.stdout:7/97: chown de/f1a 7496 1 2024-03-12T16:10:29.563 INFO:tasks.workunit.client.0.smithi006.stdout:4/66: dwrite d1/db/d17/f11 [0,4194304] 0 2024-03-12T16:10:29.564 INFO:tasks.workunit.client.0.smithi006.stdout:4/67: readlink d1/ld 0 2024-03-12T16:10:29.565 INFO:tasks.workunit.client.0.smithi006.stdout:7/98: rename de/f1a to de/f1e 0 2024-03-12T16:10:29.565 INFO:tasks.workunit.client.0.smithi006.stdout:4/68: write d1/db/d17/f11 [2085147,17347] 0 2024-03-12T16:10:29.570 INFO:tasks.workunit.client.0.smithi006.stdout:7/99: link de/f12 de/d18/f1f 0 2024-03-12T16:10:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.691+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4bb4059120 con 0x7f4ba0066dc0 2024-03-12T16:10:29.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.692+0000 7f4ba6ffd700 1 -- 172.21.15.6:0/3398294481 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f4bb4059120 con 0x7f4ba0066dc0 2024-03-12T16:10:29.695 INFO:tasks.workunit.client.0.smithi006.stdout:7/100: chown de 606935796 1 2024-03-12T16:10:29.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4ba0066dc0 msgr2=0x7f4ba0069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4ba0066dc0 0x7f4ba0069280 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7f4ba8004f10 tx=0x7f4ba800b040).stop 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4061770 msgr2=0x7f4bb4107f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4061770 0x7f4bb4107f80 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f4bb0002820 tx=0x7f4bb0009f00).stop 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 shutdown_connections 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f4ba0066dc0 0x7f4ba0069280 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bb4061770 0x7f4bb4107f80 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 --2- 172.21.15.6:0/3398294481 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bb40fa960 0x7f4bb4108470 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 >> 172.21.15.6:0/3398294481 conn(0x7f4bb40f1ef0 msgr2=0x7f4bb40f42e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.694+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 shutdown_connections 2024-03-12T16:10:29.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.695+0000 7f4bbbdcf700 1 -- 172.21.15.6:0/3398294481 wait complete. 2024-03-12T16:10:29.698 INFO:tasks.workunit.client.0.smithi006.stdout:4/69: dread d1/db/d17/f11 [0,4194304] 0 2024-03-12T16:10:29.699 INFO:tasks.workunit.client.0.smithi006.stdout:7/101: unlink de/d1c/c1d 0 2024-03-12T16:10:29.700 INFO:tasks.workunit.client.0.smithi006.stdout:6/27: dwrite f2 [0,4194304] 0 2024-03-12T16:10:29.702 INFO:tasks.workunit.client.0.smithi006.stdout:4/70: symlink d1/db/d17/l18 0 2024-03-12T16:10:29.704 INFO:tasks.workunit.client.0.smithi006.stdout:6/28: mknod d3/c8 0 2024-03-12T16:10:29.711 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:10:29.712 INFO:tasks.workunit.client.0.smithi006.stdout:6/29: dwrite f2 [0,4194304] 0 2024-03-12T16:10:29.717 INFO:tasks.workunit.client.0.smithi006.stdout:7/102: write de/f10 [793745,95376] 0 2024-03-12T16:10:29.718 INFO:tasks.workunit.client.0.smithi006.stdout:4/71: truncate d1/fa 2893751 0 2024-03-12T16:10:29.719 INFO:tasks.workunit.client.0.smithi006.stdout:7/103: write de/d18/f1b [505151,51998] 0 2024-03-12T16:10:29.722 INFO:tasks.workunit.client.0.smithi006.stdout:4/72: write d1/db/d17/f11 [5166602,24453] 0 2024-03-12T16:10:29.723 INFO:tasks.workunit.client.0.smithi006.stdout:7/104: creat de/d18/f20 x:0 0 0 2024-03-12T16:10:29.724 INFO:tasks.workunit.client.0.smithi006.stdout:4/73: stat d1/l8 0 2024-03-12T16:10:29.724 INFO:tasks.workunit.client.0.smithi006.stdout:8/48: sync 2024-03-12T16:10:29.724 INFO:tasks.workunit.client.0.smithi006.stdout:1/67: sync 2024-03-12T16:10:29.725 INFO:tasks.workunit.client.0.smithi006.stdout:7/105: read f5 [1231177,21814] 0 2024-03-12T16:10:29.727 INFO:tasks.workunit.client.0.smithi006.stdout:1/68: dread - d0/f6 zero size 2024-03-12T16:10:29.728 INFO:tasks.workunit.client.0.smithi006.stdout:6/30: dwrite f1 [0,4194304] 0 2024-03-12T16:10:29.729 INFO:tasks.workunit.client.0.smithi006.stdout:7/106: chown de/d18/f20 862194002 1 2024-03-12T16:10:29.730 INFO:tasks.workunit.client.0.smithi006.stdout:8/49: write d2/fd [1974854,81669] 0 2024-03-12T16:10:29.731 INFO:tasks.workunit.client.0.smithi006.stdout:7/107: write de/f17 [918823,72137] 0 2024-03-12T16:10:29.732 INFO:tasks.workunit.client.0.smithi006.stdout:8/50: chown d2/fa 9147 1 2024-03-12T16:10:29.734 INFO:tasks.workunit.client.0.smithi006.stdout:1/69: unlink d0/ff 0 2024-03-12T16:10:29.739 INFO:tasks.workunit.client.0.smithi006.stdout:8/51: unlink d2/fa 0 2024-03-12T16:10:29.741 INFO:tasks.workunit.client.0.smithi006.stdout:1/70: mknod d0/c18 0 2024-03-12T16:10:29.743 INFO:tasks.workunit.client.0.smithi006.stdout:7/108: write de/f12 [1412839,13932] 0 2024-03-12T16:10:29.745 INFO:tasks.workunit.client.0.smithi006.stdout:7/109: chown de/d18/f1f 239124026 1 2024-03-12T16:10:29.746 INFO:tasks.workunit.client.0.smithi006.stdout:8/52: write d2/ff [1270839,57852] 0 2024-03-12T16:10:29.746 INFO:tasks.workunit.client.0.smithi006.stdout:1/71: creat d0/f19 x:0 0 0 2024-03-12T16:10:29.746 INFO:tasks.workunit.client.0.smithi006.stdout:6/31: getdents d3 0 2024-03-12T16:10:29.752 INFO:tasks.workunit.client.0.smithi006.stdout:7/110: unlink de/f10 0 2024-03-12T16:10:29.753 INFO:tasks.workunit.client.0.smithi006.stdout:4/74: dread d1/fa [0,4194304] 0 2024-03-12T16:10:29.756 INFO:tasks.workunit.client.0.smithi006.stdout:6/32: creat d3/f9 x:0 0 0 2024-03-12T16:10:29.758 INFO:tasks.workunit.client.0.smithi006.stdout:7/111: symlink de/d18/l21 0 2024-03-12T16:10:29.762 INFO:tasks.workunit.client.0.smithi006.stdout:7/112: write f6 [773134,19071] 0 2024-03-12T16:10:29.764 INFO:tasks.workunit.client.0.smithi006.stdout:7/113: chown de/c15 5283763 1 2024-03-12T16:10:29.765 INFO:tasks.workunit.client.0.smithi006.stdout:4/75: truncate d1/fa 1750109 0 2024-03-12T16:10:29.765 INFO:tasks.workunit.client.0.smithi006.stdout:1/72: dwrite d0/fc [0,4194304] 0 2024-03-12T16:10:29.765 INFO:tasks.workunit.client.0.smithi006.stdout:8/53: dwrite d2/ff [0,4194304] 0 2024-03-12T16:10:29.766 INFO:tasks.workunit.client.0.smithi006.stdout:6/33: truncate f1 1382111 0 2024-03-12T16:10:29.767 INFO:tasks.workunit.client.0.smithi006.stdout:4/76: chown d1/db/d17/l18 726 1 2024-03-12T16:10:29.769 INFO:tasks.workunit.client.0.smithi006.stdout:7/114: rmdir de 39 2024-03-12T16:10:29.774 INFO:tasks.workunit.client.0.smithi006.stdout:6/34: dread d3/f7 [0,4194304] 0 2024-03-12T16:10:29.774 INFO:tasks.workunit.client.0.smithi006.stdout:6/35: chown d3 1054 1 2024-03-12T16:10:29.774 INFO:tasks.workunit.client.0.smithi006.stdout:1/73: unlink d0/f8 0 2024-03-12T16:10:29.780 INFO:tasks.workunit.client.0.smithi006.stdout:1/74: rename d0/f19 to d0/f1a 0 2024-03-12T16:10:29.781 INFO:tasks.workunit.client.0.smithi006.stdout:8/54: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:29.783 INFO:tasks.workunit.client.0.smithi006.stdout:2/80: sync 2024-03-12T16:10:29.783 INFO:tasks.workunit.client.0.smithi006.stdout:9/31: sync 2024-03-12T16:10:29.784 INFO:tasks.workunit.client.0.smithi006.stdout:0/160: sync 2024-03-12T16:10:29.784 INFO:tasks.workunit.client.0.smithi006.stdout:5/74: sync 2024-03-12T16:10:29.787 INFO:tasks.workunit.client.0.smithi006.stdout:5/75: chown d7/c15 0 1 2024-03-12T16:10:29.787 INFO:tasks.workunit.client.0.smithi006.stdout:2/81: write d0/dc/f1a [1284788,65660] 0 2024-03-12T16:10:29.788 INFO:tasks.workunit.client.0.smithi006.stdout:7/115: symlink de/d1c/l22 0 2024-03-12T16:10:29.789 INFO:tasks.workunit.client.0.smithi006.stdout:7/116: fsync de/f12 0 2024-03-12T16:10:29.789 INFO:tasks.workunit.client.0.smithi006.stdout:2/82: stat d0/d13/f1d 0 2024-03-12T16:10:29.790 INFO:tasks.workunit.client.0.smithi006.stdout:6/36: rename f2 to d3/fa 0 2024-03-12T16:10:29.792 INFO:tasks.workunit.client.0.smithi006.stdout:1/75: dread d0/f4 [0,4194304] 0 2024-03-12T16:10:29.796 INFO:tasks.workunit.client.0.smithi006.stdout:7/117: dread fc [0,4194304] 0 2024-03-12T16:10:29.799 INFO:tasks.workunit.client.0.smithi006.stdout:1/76: dread - d0/f16 zero size 2024-03-12T16:10:29.800 INFO:tasks.workunit.client.0.smithi006.stdout:9/32: unlink d0/d1/f2 0 2024-03-12T16:10:29.800 INFO:tasks.workunit.client.0.smithi006.stdout:6/37: mkdir d3/db 0 2024-03-12T16:10:29.803 INFO:tasks.workunit.client.0.smithi006.stdout:7/118: creat de/f23 x:0 0 0 2024-03-12T16:10:29.807 INFO:tasks.workunit.client.0.smithi006.stdout:2/83: dwrite d0/f1f [0,4194304] 0 2024-03-12T16:10:29.810 INFO:tasks.workunit.client.0.smithi006.stdout:6/38: creat d3/fc x:0 0 0 2024-03-12T16:10:29.816 INFO:tasks.workunit.client.0.smithi006.stdout:2/84: read d0/f1c [99948,36472] 0 2024-03-12T16:10:29.822 INFO:tasks.workunit.client.0.smithi006.stdout:7/119: symlink de/d1c/l24 0 2024-03-12T16:10:29.822 INFO:tasks.workunit.client.0.smithi006.stdout:0/161: getdents d2/d6 0 2024-03-12T16:10:29.822 INFO:tasks.workunit.client.0.smithi006.stdout:7/120: readlink de/l14 0 2024-03-12T16:10:29.823 INFO:tasks.workunit.client.0.smithi006.stdout:2/85: write d0/dc/df/f14 [967626,123645] 0 2024-03-12T16:10:29.825 INFO:tasks.workunit.client.0.smithi006.stdout:7/121: chown de/c11 2345 1 2024-03-12T16:10:29.827 INFO:tasks.workunit.client.0.smithi006.stdout:6/39: rename d3/fa to d3/db/fd 0 2024-03-12T16:10:29.828 INFO:tasks.workunit.client.0.smithi006.stdout:1/77: truncate d0/f3 1888187 0 2024-03-12T16:10:29.829 INFO:tasks.workunit.client.0.smithi006.stdout:9/33: rename d0/d1 to d0/d8 0 2024-03-12T16:10:29.833 INFO:tasks.workunit.client.0.smithi006.stdout:2/86: rmdir d0/dc/df 39 2024-03-12T16:10:29.835 INFO:tasks.workunit.client.0.smithi006.stdout:7/122: creat de/d1c/f25 x:0 0 0 2024-03-12T16:10:29.837 INFO:tasks.workunit.client.0.smithi006.stdout:6/40: mknod d3/db/ce 0 2024-03-12T16:10:29.840 INFO:tasks.workunit.client.0.smithi006.stdout:9/34: chown d0/d8/c3 1373746441 1 2024-03-12T16:10:29.841 INFO:tasks.workunit.client.0.smithi006.stdout:7/123: dread de/d18/f1b [0,4194304] 0 2024-03-12T16:10:29.841 INFO:tasks.workunit.client.0.smithi006.stdout:1/78: creat d0/f1b x:0 0 0 2024-03-12T16:10:29.848 INFO:tasks.workunit.client.0.smithi006.stdout:2/87: rmdir d0/dc 39 2024-03-12T16:10:29.849 INFO:tasks.workunit.client.0.smithi006.stdout:6/41: mknod d3/cf 0 2024-03-12T16:10:29.852 INFO:tasks.workunit.client.0.smithi006.stdout:9/35: symlink d0/l9 0 2024-03-12T16:10:29.854 INFO:tasks.workunit.client.0.smithi006.stdout:4/77: dwrite d1/fa [0,4194304] 0 2024-03-12T16:10:29.855 INFO:tasks.workunit.client.0.smithi006.stdout:7/124: dwrite f6 [0,4194304] 0 2024-03-12T16:10:29.855 INFO:tasks.workunit.client.0.smithi006.stdout:1/79: rename d0/l14 to d0/l1c 0 2024-03-12T16:10:29.856 INFO:tasks.workunit.client.0.smithi006.stdout:4/78: chown d1/c7 0 1 2024-03-12T16:10:29.857 INFO:tasks.workunit.client.0.smithi006.stdout:1/80: dread - d0/f1b zero size 2024-03-12T16:10:29.859 INFO:tasks.workunit.client.0.smithi006.stdout:4/79: write d1/db/d17/f11 [1898547,11002] 0 2024-03-12T16:10:29.860 INFO:tasks.workunit.client.0.smithi006.stdout:0/162: truncate d2/f1f 930000 0 2024-03-12T16:10:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.864+0000 7fc12c676700 1 -- 172.21.15.6:0/2227577738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 msgr2=0x7fc12406d970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:29.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.864+0000 7fc12c676700 1 --2- 172.21.15.6:0/2227577738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 0x7fc12406d970 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7fc114004730 tx=0x7fc114009cb0).stop 2024-03-12T16:10:29.866 INFO:tasks.workunit.client.0.smithi006.stdout:2/88: fdatasync d0/dc/fd 0 2024-03-12T16:10:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.864+0000 7fc12c676700 1 -- 172.21.15.6:0/2227577738 shutdown_connections 2024-03-12T16:10:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.864+0000 7fc12c676700 1 --2- 172.21.15.6:0/2227577738 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc12406e840 0x7fc12406ecc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.864+0000 7fc12c676700 1 --2- 172.21.15.6:0/2227577738 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 0x7fc12406d970 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:29.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.864+0000 7fc12c676700 1 -- 172.21.15.6:0/2227577738 >> 172.21.15.6:0/2227577738 conn(0x7fc1240f52f0 msgr2=0x7fc1240f76e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:29.868 INFO:tasks.workunit.client.0.smithi006.stdout:7/125: dread de/ff [0,4194304] 0 2024-03-12T16:10:29.868 INFO:tasks.workunit.client.0.smithi006.stdout:9/36: creat d0/d8/fa x:0 0 0 2024-03-12T16:10:29.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.867+0000 7fc12c676700 1 -- 172.21.15.6:0/2227577738 shutdown_connections 2024-03-12T16:10:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.868+0000 7fc12c676700 1 -- 172.21.15.6:0/2227577738 wait complete. 2024-03-12T16:10:29.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.869+0000 7fc12c676700 1 Processor -- start 2024-03-12T16:10:29.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.869+0000 7fc12c676700 1 -- start start 2024-03-12T16:10:29.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.869+0000 7fc12c676700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 0x7fc12410e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:29.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.869+0000 7fc12c676700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc12406e840 0x7fc12410eab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:29.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.869+0000 7fc12c676700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12410f060 con 0x7fc12406d550 2024-03-12T16:10:29.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.869+0000 7fc12c676700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc12410f1a0 con 0x7fc12406e840 2024-03-12T16:10:29.871 INFO:tasks.workunit.client.0.smithi006.stdout:6/42: rmdir d3 39 2024-03-12T16:10:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.869+0000 7fc129c11700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc12406e840 0x7fc12410eab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.869+0000 7fc12a412700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 0x7fc12410e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc12a412700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 0x7fc12410e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36188/0 (socket says 172.21.15.6:36188) 2024-03-12T16:10:29.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc12a412700 1 -- 172.21.15.6:0/4085247015 learned_addr learned my addr 172.21.15.6:0/4085247015 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc129c11700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc12406e840 0x7fc12410eab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:49234/0 (socket says 172.21.15.6:49234) 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc12a412700 1 -- 172.21.15.6:0/4085247015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc12406e840 msgr2=0x7fc12410eab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc12a412700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc12406e840 0x7fc12410eab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc12a412700 1 -- 172.21.15.6:0/4085247015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc114005040 con 0x7fc12406d550 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc12a412700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 0x7fc12410e5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fc114000c00 tx=0x7fc11400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc11b7fe700 1 -- 172.21.15.6:0/4085247015 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc114019070 con 0x7fc12406d550 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc11b7fe700 1 -- 172.21.15.6:0/4085247015 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc1140097d0 con 0x7fc12406d550 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc11b7fe700 1 -- 172.21.15.6:0/4085247015 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc11401ecf0 con 0x7fc12406d550 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc124113be0 con 0x7fc12406d550 2024-03-12T16:10:29.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.870+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc1241140d0 con 0x7fc12406d550 2024-03-12T16:10:29.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.873+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc1241065e0 con 0x7fc12406d550 2024-03-12T16:10:29.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.874+0000 7fc11b7fe700 1 -- 172.21.15.6:0/4085247015 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fc11401e420 con 0x7fc12406d550 2024-03-12T16:10:29.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.874+0000 7fc11b7fe700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc110066e10 0x7fc1100692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:29.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.875+0000 7fc11b7fe700 1 -- 172.21.15.6:0/4085247015 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fc114085020 con 0x7fc12406d550 2024-03-12T16:10:29.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.875+0000 7fc129c11700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc110066e10 0x7fc1100692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:10:29.877 INFO:tasks.workunit.client.0.smithi006.stdout:9/37: mkdir d0/db 0 2024-03-12T16:10:29.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.876+0000 7fc129c11700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc110066e10 0x7fc1100692d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc120009a00 tx=0x7fc12000b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:29.881 INFO:tasks.workunit.client.0.smithi006.stdout:2/89: symlink d0/l21 0 2024-03-12T16:10:29.881 INFO:tasks.workunit.client.0.smithi006.stdout:9/38: write d0/d8/fa [136522,35000] 0 2024-03-12T16:10:29.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:29.880+0000 7fc11b7fe700 1 -- 172.21.15.6:0/4085247015 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fc1140530c0 con 0x7fc12406d550 2024-03-12T16:10:29.884 INFO:tasks.workunit.client.0.smithi006.stdout:1/81: write d0/f6 [520161,4460] 0 2024-03-12T16:10:29.884 INFO:tasks.workunit.client.0.smithi006.stdout:4/80: fdatasync d1/fa 0 2024-03-12T16:10:29.887 INFO:tasks.workunit.client.0.smithi006.stdout:7/126: write fc [2229900,21190] 0 2024-03-12T16:10:29.890 INFO:tasks.workunit.client.0.smithi006.stdout:1/82: symlink d0/l1d 0 2024-03-12T16:10:29.891 INFO:tasks.workunit.client.0.smithi006.stdout:6/43: getdents d3 0 2024-03-12T16:10:29.892 INFO:tasks.workunit.client.0.smithi006.stdout:1/83: fdatasync d0/f16 0 2024-03-12T16:10:29.892 INFO:tasks.workunit.client.0.smithi006.stdout:4/81: chown d1/c2 565 1 2024-03-12T16:10:29.893 INFO:tasks.workunit.client.0.smithi006.stdout:2/90: rename d0/f1c to d0/dc/f22 0 2024-03-12T16:10:29.894 INFO:tasks.workunit.client.0.smithi006.stdout:2/91: fsync d0/d13/f1d 0 2024-03-12T16:10:29.894 INFO:tasks.workunit.client.0.smithi006.stdout:6/44: mkdir d3/db/d10 0 2024-03-12T16:10:29.895 INFO:tasks.workunit.client.0.smithi006.stdout:6/45: dread - d3/f9 zero size 2024-03-12T16:10:29.897 INFO:tasks.workunit.client.0.smithi006.stdout:0/163: link d2/f1f d2/f2c 0 2024-03-12T16:10:29.897 INFO:tasks.workunit.client.0.smithi006.stdout:4/82: chown d1/db/d17/l10 27 1 2024-03-12T16:10:29.902 INFO:tasks.workunit.client.0.smithi006.stdout:1/84: rmdir d0 39 2024-03-12T16:10:29.905 INFO:tasks.workunit.client.0.smithi006.stdout:2/92: truncate d0/f12 2065426 0 2024-03-12T16:10:29.907 INFO:tasks.workunit.client.0.smithi006.stdout:0/164: rename d2/d6/d10/d11/l21 to d2/d6/l2d 0 2024-03-12T16:10:29.910 INFO:tasks.workunit.client.0.smithi006.stdout:4/83: mknod d1/c19 0 2024-03-12T16:10:29.912 INFO:tasks.workunit.client.0.smithi006.stdout:2/93: chown d0/f12 2 1 2024-03-12T16:10:29.915 INFO:tasks.workunit.client.0.smithi006.stdout:0/165: mkdir d2/d6/d10/d11/d1d/d2e 0 2024-03-12T16:10:29.915 INFO:tasks.workunit.client.0.smithi006.stdout:6/46: dread f1 [0,4194304] 0 2024-03-12T16:10:29.917 INFO:tasks.workunit.client.0.smithi006.stdout:4/84: unlink d1/l13 0 2024-03-12T16:10:29.919 INFO:tasks.workunit.client.0.smithi006.stdout:2/94: write d0/dc/f15 [3710408,50704] 0 2024-03-12T16:10:29.926 INFO:tasks.workunit.client.0.smithi006.stdout:6/47: rmdir d3 39 2024-03-12T16:10:29.929 INFO:tasks.workunit.client.0.smithi006.stdout:1/85: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:29.935 INFO:tasks.workunit.client.0.smithi006.stdout:4/85: dwrite d1/fa [4194304,4194304] 0 2024-03-12T16:10:29.937 INFO:tasks.workunit.client.0.smithi006.stdout:2/95: write d0/dc/df/f14 [2003324,96756] 0 2024-03-12T16:10:29.938 INFO:tasks.workunit.client.0.smithi006.stdout:6/48: truncate d3/f9 147154 0 2024-03-12T16:10:29.938 INFO:tasks.workunit.client.0.smithi006.stdout:0/166: dread d2/f4 [0,4194304] 0 2024-03-12T16:10:29.940 INFO:tasks.workunit.client.0.smithi006.stdout:2/96: fsync d0/dc/fd 0 2024-03-12T16:10:29.940 INFO:tasks.workunit.client.0.smithi006.stdout:3/94: sync 2024-03-12T16:10:29.942 INFO:tasks.workunit.client.0.smithi006.stdout:0/167: chown d2/d6/d10/d11/f27 15976 1 2024-03-12T16:10:29.942 INFO:tasks.workunit.client.0.smithi006.stdout:6/49: rename d3/db to d3/d11 0 2024-03-12T16:10:29.944 INFO:tasks.workunit.client.0.smithi006.stdout:0/168: chown d2/d6/d10/d11/f27 2126 1 2024-03-12T16:10:29.946 INFO:tasks.workunit.client.0.smithi006.stdout:3/95: mknod d8/db/dc/c23 0 2024-03-12T16:10:29.947 INFO:tasks.workunit.client.0.smithi006.stdout:6/50: symlink d3/d11/l12 0 2024-03-12T16:10:29.948 INFO:tasks.workunit.client.0.smithi006.stdout:0/169: creat d2/d6/d10/d11/f2f x:0 0 0 2024-03-12T16:10:29.950 INFO:tasks.workunit.client.0.smithi006.stdout:3/96: mknod d8/db/c24 0 2024-03-12T16:10:29.951 INFO:tasks.workunit.client.0.smithi006.stdout:6/51: dread f1 [0,4194304] 0 2024-03-12T16:10:29.952 INFO:tasks.workunit.client.0.smithi006.stdout:2/97: rename d0/d13/l18 to d0/l23 0 2024-03-12T16:10:29.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:28.719533+0000 mon.smithi006 (mon.0) 709 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:10:29.953 INFO:tasks.workunit.client.0.smithi006.stdout:0/170: mknod d2/c30 0 2024-03-12T16:10:29.955 INFO:tasks.workunit.client.0.smithi006.stdout:6/52: write d3/fc [33932,103504] 0 2024-03-12T16:10:29.956 INFO:tasks.workunit.client.0.smithi006.stdout:3/97: symlink d8/d19/l25 0 2024-03-12T16:10:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:28.719533+0000 mon.smithi006 (mon.0) 709 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:10:29.957 INFO:tasks.workunit.client.0.smithi006.stdout:2/98: fdatasync d0/dc/df/f14 0 2024-03-12T16:10:29.958 INFO:tasks.workunit.client.0.smithi006.stdout:2/99: readlink d0/l8 0 2024-03-12T16:10:29.963 INFO:tasks.workunit.client.0.smithi006.stdout:3/98: dread - d8/db/f1d zero size 2024-03-12T16:10:29.965 INFO:tasks.workunit.client.0.smithi006.stdout:0/171: fsync f0 0 2024-03-12T16:10:29.968 INFO:tasks.workunit.client.0.smithi006.stdout:3/99: mkdir d8/d19/d26 0 2024-03-12T16:10:29.970 INFO:tasks.workunit.client.0.smithi006.stdout:1/86: dwrite d0/fe [0,4194304] 0 2024-03-12T16:10:29.970 INFO:tasks.workunit.client.0.smithi006.stdout:2/100: rmdir d0/dc/df 39 2024-03-12T16:10:29.974 INFO:tasks.workunit.client.0.smithi006.stdout:4/86: dwrite d1/db/d17/f11 [4194304,4194304] 0 2024-03-12T16:10:29.974 INFO:tasks.workunit.client.0.smithi006.stdout:0/172: symlink d2/d6/l31 0 2024-03-12T16:10:29.975 INFO:tasks.workunit.client.0.smithi006.stdout:1/87: read d0/f13 [474657,125188] 0 2024-03-12T16:10:29.978 INFO:tasks.workunit.client.0.smithi006.stdout:3/100: rmdir d8/df 39 2024-03-12T16:10:29.980 INFO:tasks.workunit.client.0.smithi006.stdout:4/87: creat d1/db/d17/f1a x:0 0 0 2024-03-12T16:10:29.986 INFO:tasks.workunit.client.0.smithi006.stdout:4/88: chown d1/db/d17 4032868 1 2024-03-12T16:10:29.987 INFO:tasks.workunit.client.0.smithi006.stdout:0/173: unlink d2/c30 0 2024-03-12T16:10:29.987 INFO:tasks.workunit.client.0.smithi006.stdout:6/53: dwrite f1 [0,4194304] 0 2024-03-12T16:10:29.987 INFO:tasks.workunit.client.0.smithi006.stdout:1/88: creat d0/f1e x:0 0 0 2024-03-12T16:10:29.987 INFO:tasks.workunit.client.0.smithi006.stdout:1/89: write d0/f16 [688954,60598] 0 2024-03-12T16:10:29.988 INFO:tasks.workunit.client.0.smithi006.stdout:3/101: rename d8/f15 to d8/db/f27 0 2024-03-12T16:10:29.990 INFO:tasks.workunit.client.0.smithi006.stdout:6/54: dread d3/fc [0,4194304] 0 2024-03-12T16:10:29.994 INFO:tasks.workunit.client.0.smithi006.stdout:1/90: creat d0/f1f x:0 0 0 2024-03-12T16:10:29.996 INFO:tasks.workunit.client.0.smithi006.stdout:3/102: chown d8/df/c12 174780 1 2024-03-12T16:10:29.996 INFO:tasks.workunit.client.0.smithi006.stdout:3/103: chown d8/df/f1f 7590960 1 2024-03-12T16:10:30.005 INFO:tasks.workunit.client.0.smithi006.stdout:2/101: dread d0/f4 [0,4194304] 0 2024-03-12T16:10:30.005 INFO:tasks.workunit.client.0.smithi006.stdout:1/91: symlink d0/l20 0 2024-03-12T16:10:30.005 INFO:tasks.workunit.client.0.smithi006.stdout:3/104: unlink d8/db/dc/c23 0 2024-03-12T16:10:30.006 INFO:tasks.workunit.client.0.smithi006.stdout:3/105: truncate d8/f1c 4323930 0 2024-03-12T16:10:30.009 INFO:tasks.workunit.client.0.smithi006.stdout:2/102: fdatasync d0/f4 0 2024-03-12T16:10:30.011 INFO:tasks.workunit.client.0.smithi006.stdout:1/92: creat d0/f21 x:0 0 0 2024-03-12T16:10:30.014 INFO:tasks.workunit.client.0.smithi006.stdout:0/174: truncate d2/d6/f7 6808488 0 2024-03-12T16:10:30.015 INFO:tasks.workunit.client.0.smithi006.stdout:1/93: readlink d0/l1d 0 2024-03-12T16:10:30.017 INFO:tasks.workunit.client.0.smithi006.stdout:2/103: chown d0/f12 733003 1 2024-03-12T16:10:30.017 INFO:tasks.workunit.client.0.smithi006.stdout:3/106: dread d8/fe [0,4194304] 0 2024-03-12T16:10:30.017 INFO:tasks.workunit.client.0.smithi006.stdout:6/55: truncate f1 3468399 0 2024-03-12T16:10:30.022 INFO:tasks.workunit.client.0.smithi006.stdout:1/94: mknod d0/c22 0 2024-03-12T16:10:30.024 INFO:tasks.workunit.client.0.smithi006.stdout:3/107: mkdir d8/db/dc/d28 0 2024-03-12T16:10:30.029 INFO:tasks.workunit.client.0.smithi006.stdout:2/104: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:30.029 INFO:tasks.workunit.client.0.smithi006.stdout:0/175: dwrite d2/d6/d10/f1a [0,4194304] 0 2024-03-12T16:10:30.030 INFO:tasks.workunit.client.0.smithi006.stdout:6/56: link d3/c5 d3/d11/d10/c13 0 2024-03-12T16:10:30.032 INFO:tasks.workunit.client.0.smithi006.stdout:2/105: fsync d0/dc/f1a 0 2024-03-12T16:10:30.035 INFO:tasks.workunit.client.0.smithi006.stdout:1/95: rmdir d0 39 2024-03-12T16:10:30.048 INFO:tasks.workunit.client.0.smithi006.stdout:0/176: write d2/d6/d10/d11/d1d/f29 [704110,125759] 0 2024-03-12T16:10:30.050 INFO:tasks.workunit.client.0.smithi006.stdout:3/108: dwrite d8/f1c [4194304,4194304] 0 2024-03-12T16:10:30.053 INFO:tasks.workunit.client.0.smithi006.stdout:6/57: dread f1 [0,4194304] 0 2024-03-12T16:10:30.058 INFO:tasks.workunit.client.0.smithi006.stdout:2/106: dwrite d0/dc/df/f14 [0,4194304] 0 2024-03-12T16:10:30.063 INFO:tasks.workunit.client.0.smithi006.stdout:2/107: write d0/d13/f1d [20797,82557] 0 2024-03-12T16:10:30.063 INFO:tasks.workunit.client.0.smithi006.stdout:1/96: dwrite d0/fe [0,4194304] 0 2024-03-12T16:10:30.064 INFO:tasks.workunit.client.0.smithi006.stdout:2/108: fdatasync d0/f4 0 2024-03-12T16:10:30.069 INFO:tasks.workunit.client.0.smithi006.stdout:3/109: creat d8/db/dc/d28/f29 x:0 0 0 2024-03-12T16:10:30.073 INFO:tasks.workunit.client.0.smithi006.stdout:1/97: creat d0/f23 x:0 0 0 2024-03-12T16:10:30.079 INFO:tasks.workunit.client.0.smithi006.stdout:2/109: dread d0/d13/f1d [0,4194304] 0 2024-03-12T16:10:30.081 INFO:tasks.workunit.client.0.smithi006.stdout:1/98: chown d0/fa 185414 1 2024-03-12T16:10:30.083 INFO:tasks.workunit.client.0.smithi006.stdout:6/58: dwrite d3/d11/fd [0,4194304] 0 2024-03-12T16:10:30.086 INFO:tasks.workunit.client.0.smithi006.stdout:2/110: mknod d0/c24 0 2024-03-12T16:10:30.088 INFO:tasks.workunit.client.0.smithi006.stdout:6/59: creat d3/f14 x:0 0 0 2024-03-12T16:10:30.098 INFO:tasks.workunit.client.0.smithi006.stdout:3/110: truncate f1 6354438 0 2024-03-12T16:10:30.099 INFO:tasks.workunit.client.0.smithi006.stdout:3/111: read - d8/db/f20 zero size 2024-03-12T16:10:30.099 INFO:tasks.workunit.client.0.smithi006.stdout:3/112: stat d8/db/f10 0 2024-03-12T16:10:30.101 INFO:tasks.workunit.client.0.smithi006.stdout:6/60: creat d3/d11/f15 x:0 0 0 2024-03-12T16:10:30.103 INFO:tasks.workunit.client.0.smithi006.stdout:3/113: creat d8/db/dc/f2a x:0 0 0 2024-03-12T16:10:30.104 INFO:tasks.workunit.client.0.smithi006.stdout:6/61: dread - d3/f14 zero size 2024-03-12T16:10:30.110 INFO:tasks.workunit.client.0.smithi006.stdout:6/62: write d3/f9 [202070,100954] 0 2024-03-12T16:10:30.115 INFO:tasks.workunit.client.0.smithi006.stdout:3/114: truncate d8/db/f20 975753 0 2024-03-12T16:10:30.118 INFO:tasks.workunit.client.0.smithi006.stdout:0/177: dwrite d2/d6/f7 [4194304,4194304] 0 2024-03-12T16:10:30.121 INFO:tasks.workunit.client.0.smithi006.stdout:1/99: dwrite d0/f3 [0,4194304] 0 2024-03-12T16:10:30.122 INFO:tasks.workunit.client.0.smithi006.stdout:2/111: dwrite d0/dc/df/f20 [0,4194304] 0 2024-03-12T16:10:30.123 INFO:tasks.workunit.client.0.smithi006.stdout:2/112: chown d0/dc/df 116 1 2024-03-12T16:10:30.126 INFO:tasks.workunit.client.0.smithi006.stdout:6/63: link f1 d3/d11/f16 0 2024-03-12T16:10:30.126 INFO:tasks.workunit.client.0.smithi006.stdout:0/178: mkdir d2/d6/d10/d11/d32 0 2024-03-12T16:10:30.127 INFO:tasks.workunit.client.0.smithi006.stdout:1/100: readlink d0/l1c 0 2024-03-12T16:10:30.133 INFO:tasks.workunit.client.0.smithi006.stdout:1/101: truncate d0/f21 270937 0 2024-03-12T16:10:30.136 INFO:tasks.workunit.client.0.smithi006.stdout:2/113: link d0/c24 d0/dc/c25 0 2024-03-12T16:10:30.137 INFO:tasks.workunit.client.0.smithi006.stdout:1/102: fsync d0/f7 0 2024-03-12T16:10:30.138 INFO:tasks.workunit.client.0.smithi006.stdout:3/115: link d8/f21 d8/db/dc/d28/f2b 0 2024-03-12T16:10:30.142 INFO:tasks.workunit.client.0.smithi006.stdout:6/64: dwrite d3/d11/f15 [0,4194304] 0 2024-03-12T16:10:30.144 INFO:tasks.workunit.client.0.smithi006.stdout:2/114: mknod d0/dc/c26 0 2024-03-12T16:10:30.145 INFO:tasks.workunit.client.0.smithi006.stdout:1/103: write d0/f13 [3328841,87464] 0 2024-03-12T16:10:30.148 INFO:tasks.workunit.client.0.smithi006.stdout:0/179: dwrite d2/f4 [0,4194304] 0 2024-03-12T16:10:30.149 INFO:tasks.workunit.client.0.smithi006.stdout:0/180: chown d2/l13 7 1 2024-03-12T16:10:30.150 INFO:tasks.workunit.client.0.smithi006.stdout:2/115: write d0/dc/f1a [3575537,68540] 0 2024-03-12T16:10:30.150 INFO:tasks.workunit.client.0.smithi006.stdout:3/116: rename d8/db to d8/df/d2c 0 2024-03-12T16:10:30.151 INFO:tasks.workunit.client.0.smithi006.stdout:0/181: chown d2/d6/d10/d11/d1d 22 1 2024-03-12T16:10:30.151 INFO:tasks.workunit.client.0.smithi006.stdout:1/104: chown d0/c15 103 1 2024-03-12T16:10:30.155 INFO:tasks.workunit.client.0.smithi006.stdout:3/117: fdatasync d8/f1c 0 2024-03-12T16:10:30.156 INFO:tasks.workunit.client.0.smithi006.stdout:0/182: read d2/d6/d10/f1a [1830923,44229] 0 2024-03-12T16:10:30.157 INFO:tasks.workunit.client.0.smithi006.stdout:3/118: chown d8/df/f1e 9287 1 2024-03-12T16:10:30.157 INFO:tasks.workunit.client.0.smithi006.stdout:0/183: stat d2/d6 0 2024-03-12T16:10:30.158 INFO:tasks.workunit.client.0.smithi006.stdout:6/65: getdents d3/d11 0 2024-03-12T16:10:30.160 INFO:tasks.workunit.client.0.smithi006.stdout:2/116: rmdir d0/d13 39 2024-03-12T16:10:30.161 INFO:tasks.workunit.client.0.smithi006.stdout:3/119: readlink d8/df/d2c/dc/l14 0 2024-03-12T16:10:30.162 INFO:tasks.workunit.client.0.smithi006.stdout:3/120: read d8/df/f18 [1356987,13105] 0 2024-03-12T16:10:30.162 INFO:tasks.workunit.client.0.smithi006.stdout:6/66: creat d3/f17 x:0 0 0 2024-03-12T16:10:30.167 INFO:tasks.workunit.client.0.smithi006.stdout:2/117: chown d0/l23 5206 1 2024-03-12T16:10:30.167 INFO:tasks.workunit.client.0.smithi006.stdout:2/118: fdatasync d0/dc/df/f20 0 2024-03-12T16:10:30.168 INFO:tasks.workunit.client.0.smithi006.stdout:6/67: creat d3/d11/f18 x:0 0 0 2024-03-12T16:10:30.168 INFO:tasks.workunit.client.0.smithi006.stdout:2/119: fsync d0/dc/df/f16 0 2024-03-12T16:10:30.170 INFO:tasks.workunit.client.0.smithi006.stdout:2/120: truncate d0/dc/f15 4711211 0 2024-03-12T16:10:30.171 INFO:tasks.workunit.client.0.smithi006.stdout:0/184: link d2/d6/d10/d11/f2f d2/d6/d10/d11/d1d/d2e/f33 0 2024-03-12T16:10:30.177 INFO:tasks.workunit.client.0.smithi006.stdout:6/68: fsync d3/fc 0 2024-03-12T16:10:30.180 INFO:tasks.workunit.client.0.smithi006.stdout:3/121: link d8/df/d2c/c24 d8/df/d2c/dc/d28/c2d 0 2024-03-12T16:10:30.182 INFO:tasks.workunit.client.0.smithi006.stdout:6/69: fsync d3/d11/f18 0 2024-03-12T16:10:30.187 INFO:tasks.workunit.client.0.smithi006.stdout:0/185: dread d2/d6/d10/d11/d1d/f29 [0,4194304] 0 2024-03-12T16:10:30.189 INFO:tasks.workunit.client.0.smithi006.stdout:3/122: unlink f0 0 2024-03-12T16:10:30.189 INFO:tasks.workunit.client.0.smithi006.stdout:2/121: dwrite d0/dc/f1a [0,4194304] 0 2024-03-12T16:10:30.190 INFO:tasks.workunit.client.0.smithi006.stdout:6/70: truncate d3/d11/f18 780204 0 2024-03-12T16:10:30.193 INFO:tasks.workunit.client.0.smithi006.stdout:1/105: dwrite d0/fd [0,4194304] 0 2024-03-12T16:10:30.194 INFO:tasks.workunit.client.0.smithi006.stdout:0/186: chown d2/d6/l2d 49092 1 2024-03-12T16:10:30.195 INFO:tasks.workunit.client.0.smithi006.stdout:0/187: chown d2/c14 2286932 1 2024-03-12T16:10:30.198 INFO:tasks.workunit.client.0.smithi006.stdout:3/123: read - d8/df/d2c/dc/f2a zero size 2024-03-12T16:10:30.198 INFO:tasks.workunit.client.0.smithi006.stdout:3/124: truncate d8/df/d2c/f20 1732634 0 2024-03-12T16:10:30.198 INFO:tasks.workunit.client.0.smithi006.stdout:0/188: chown d2/d6/l17 126 1 2024-03-12T16:10:30.202 INFO:tasks.workunit.client.0.smithi006.stdout:0/189: chown d2/f2c 400541 1 2024-03-12T16:10:30.202 INFO:tasks.workunit.client.0.smithi006.stdout:1/106: creat d0/f24 x:0 0 0 2024-03-12T16:10:30.202 INFO:tasks.workunit.client.0.smithi006.stdout:1/107: readlink d0/l20 0 2024-03-12T16:10:30.203 INFO:tasks.workunit.client.0.smithi006.stdout:6/71: mkdir d3/d11/d10/d19 0 2024-03-12T16:10:30.205 INFO:tasks.workunit.client.0.smithi006.stdout:0/190: symlink d2/d6/d10/d11/d1d/l34 0 2024-03-12T16:10:30.207 INFO:tasks.workunit.client.0.smithi006.stdout:1/108: mkdir d0/d25 0 2024-03-12T16:10:30.211 INFO:tasks.workunit.client.0.smithi006.stdout:1/109: dread - d0/f1a zero size 2024-03-12T16:10:30.213 INFO:tasks.workunit.client.0.smithi006.stdout:2/122: dwrite d0/f12 [0,4194304] 0 2024-03-12T16:10:30.214 INFO:tasks.workunit.client.0.smithi006.stdout:1/110: truncate d0/f1b 71204 0 2024-03-12T16:10:30.220 INFO:tasks.workunit.client.0.smithi006.stdout:2/123: rmdir d0 39 2024-03-12T16:10:30.221 INFO:tasks.workunit.client.0.smithi006.stdout:0/191: creat d2/d6/d10/d11/f35 x:0 0 0 2024-03-12T16:10:30.224 INFO:tasks.workunit.client.0.smithi006.stdout:1/111: symlink d0/d25/l26 0 2024-03-12T16:10:30.228 INFO:tasks.workunit.client.0.smithi006.stdout:0/192: rename d2/d6/d10/d11/f27 to d2/d6/d10/f36 0 2024-03-12T16:10:30.230 INFO:tasks.workunit.client.0.smithi006.stdout:2/124: creat d0/d13/f27 x:0 0 0 2024-03-12T16:10:30.232 INFO:tasks.workunit.client.0.smithi006.stdout:2/125: readlink d0/dc/l1b 0 2024-03-12T16:10:30.233 INFO:tasks.workunit.client.0.smithi006.stdout:0/193: mkdir d2/d6/d37 0 2024-03-12T16:10:30.234 INFO:tasks.workunit.client.0.smithi006.stdout:6/72: dwrite f1 [0,4194304] 0 2024-03-12T16:10:30.236 INFO:tasks.workunit.client.0.smithi006.stdout:2/126: write d0/f1f [714319,103704] 0 2024-03-12T16:10:30.239 INFO:tasks.workunit.client.0.smithi006.stdout:6/73: mknod d3/d11/c1a 0 2024-03-12T16:10:30.240 INFO:tasks.workunit.client.0.smithi006.stdout:1/112: dread d0/fd [0,4194304] 0 2024-03-12T16:10:30.241 INFO:tasks.workunit.client.0.smithi006.stdout:0/194: write d2/f22 [215053,101046] 0 2024-03-12T16:10:30.241 INFO:tasks.workunit.client.0.smithi006.stdout:2/127: chown d0/dc/f1a 96 1 2024-03-12T16:10:30.244 INFO:tasks.workunit.client.0.smithi006.stdout:2/128: chown d0/dc/df/c19 699120 1 2024-03-12T16:10:30.244 INFO:tasks.workunit.client.0.smithi006.stdout:1/113: write d0/f12 [348515,92610] 0 2024-03-12T16:10:30.244 INFO:tasks.workunit.client.0.smithi006.stdout:6/74: dread d3/fc [0,4194304] 0 2024-03-12T16:10:30.250 INFO:tasks.workunit.client.0.smithi006.stdout:1/114: rename d0/fd to d0/f27 0 2024-03-12T16:10:30.251 INFO:tasks.workunit.client.0.smithi006.stdout:0/195: dread d2/d6/f7 [0,4194304] 0 2024-03-12T16:10:30.256 INFO:tasks.workunit.client.0.smithi006.stdout:6/75: mkdir d3/d11/d10/d1b 0 2024-03-12T16:10:30.256 INFO:tasks.workunit.client.0.smithi006.stdout:0/196: fdatasync d2/f1f 0 2024-03-12T16:10:30.256 INFO:tasks.workunit.client.0.smithi006.stdout:2/129: link d0/dc/df/c19 d0/dc/df/c28 0 2024-03-12T16:10:30.256 INFO:tasks.workunit.client.0.smithi006.stdout:2/130: stat d0/l11 0 2024-03-12T16:10:30.258 INFO:tasks.workunit.client.0.smithi006.stdout:6/76: unlink d3/d11/f18 0 2024-03-12T16:10:30.262 INFO:tasks.workunit.client.0.smithi006.stdout:6/77: chown d3/d11/d10/d19 3 1 2024-03-12T16:10:30.263 INFO:tasks.workunit.client.0.smithi006.stdout:2/131: dread d0/f1f [0,4194304] 0 2024-03-12T16:10:30.263 INFO:tasks.workunit.client.0.smithi006.stdout:2/132: chown d0/d13/f27 123601 1 2024-03-12T16:10:30.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.263+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc124059120 con 0x7fc110066e10 2024-03-12T16:10:30.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.264+0000 7fc11b7fe700 1 -- 172.21.15.6:0/4085247015 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fc124059120 con 0x7fc110066e10 2024-03-12T16:10:30.268 INFO:tasks.workunit.client.0.smithi006.stdout:6/78: creat d3/f1c x:0 0 0 2024-03-12T16:10:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc110066e10 msgr2=0x7fc1100692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc110066e10 0x7fc1100692d0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7fc120009a00 tx=0x7fc12000b040).stop 2024-03-12T16:10:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 msgr2=0x7fc12410e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 0x7fc12410e5c0 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fc114000c00 tx=0x7fc11400b040).stop 2024-03-12T16:10:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 shutdown_connections 2024-03-12T16:10:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc110066e10 0x7fc1100692d0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc12406d550 0x7fc12410e5c0 secure :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0x7fc114000c00 tx=0x7fc11400b040).stop 2024-03-12T16:10:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 --2- 172.21.15.6:0/4085247015 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc12406e840 0x7fc12410eab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 >> 172.21.15.6:0/4085247015 conn(0x7fc1240f52f0 msgr2=0x7fc1241045f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:30.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 shutdown_connections 2024-03-12T16:10:30.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.267+0000 7fc12c676700 1 -- 172.21.15.6:0/4085247015 wait complete. 2024-03-12T16:10:30.270 INFO:tasks.workunit.client.0.smithi006.stdout:0/197: creat d2/d6/d10/d11/d32/f38 x:0 0 0 2024-03-12T16:10:30.273 INFO:tasks.workunit.client.0.smithi006.stdout:2/133: symlink d0/l29 0 2024-03-12T16:10:30.280 INFO:tasks.workunit.client.0.smithi006.stdout:6/79: dwrite d3/f17 [0,4194304] 0 2024-03-12T16:10:30.282 INFO:tasks.workunit.client.0.smithi006.stdout:0/198: dread d2/d6/f7 [0,4194304] 0 2024-03-12T16:10:30.283 INFO:tasks.workunit.client.0.smithi006.stdout:6/80: truncate d3/f1c 974444 0 2024-03-12T16:10:30.285 INFO:tasks.workunit.client.0.smithi006.stdout:0/199: dread d2/f2c [0,4194304] 0 2024-03-12T16:10:30.288 INFO:tasks.workunit.client.0.smithi006.stdout:2/134: link d0/dc/c25 d0/d13/c2a 0 2024-03-12T16:10:30.289 INFO:tasks.workunit.client.0.smithi006.stdout:6/81: rename d3/d11/f16 to d3/f1d 0 2024-03-12T16:10:30.290 INFO:tasks.workunit.client.0.smithi006.stdout:0/200: mkdir d2/d39 0 2024-03-12T16:10:30.290 INFO:tasks.workunit.client.0.smithi006.stdout:2/135: write d0/dc/f1a [1897424,77361] 0 2024-03-12T16:10:30.291 INFO:tasks.workunit.client.0.smithi006.stdout:2/136: chown d0/l29 70 1 2024-03-12T16:10:30.293 INFO:tasks.workunit.client.0.smithi006.stdout:2/137: write d0/dc/f1a [2816867,56077] 0 2024-03-12T16:10:30.294 INFO:tasks.workunit.client.0.smithi006.stdout:2/138: chown d0/dc 1 1 2024-03-12T16:10:30.299 INFO:tasks.workunit.client.0.smithi006.stdout:0/201: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:30.300 INFO:tasks.workunit.client.0.smithi006.stdout:6/82: creat d3/d11/f1e x:0 0 0 2024-03-12T16:10:30.308 INFO:tasks.workunit.client.0.smithi006.stdout:6/83: dread d3/f1d [0,4194304] 0 2024-03-12T16:10:30.312 INFO:tasks.workunit.client.0.smithi006.stdout:0/202: dwrite d2/d6/d10/d11/d32/f38 [0,4194304] 0 2024-03-12T16:10:30.313 INFO:tasks.workunit.client.0.smithi006.stdout:0/203: dread - d2/d6/d10/d11/f35 zero size 2024-03-12T16:10:30.313 INFO:tasks.workunit.client.0.smithi006.stdout:2/139: mkdir d0/dc/df/d2b 0 2024-03-12T16:10:30.315 INFO:tasks.workunit.client.0.smithi006.stdout:2/140: rename d0/d13 to d0/d13/d2c 22 2024-03-12T16:10:30.317 INFO:tasks.workunit.client.0.smithi006.stdout:0/204: rmdir d2/d6/d10/d11/d1d/d2e 39 2024-03-12T16:10:30.317 INFO:tasks.workunit.client.0.smithi006.stdout:0/205: stat d2/d6/d10/d11/d32 0 2024-03-12T16:10:30.319 INFO:tasks.workunit.client.0.smithi006.stdout:6/84: creat d3/d11/d10/d19/f1f x:0 0 0 2024-03-12T16:10:30.320 INFO:tasks.workunit.client.0.smithi006.stdout:0/206: read d2/f22 [133552,96205] 0 2024-03-12T16:10:30.321 INFO:tasks.workunit.client.0.smithi006.stdout:6/85: chown d3/cf 564247 1 2024-03-12T16:10:30.321 INFO:tasks.workunit.client.0.smithi006.stdout:0/207: chown d2/fd 5182354 1 2024-03-12T16:10:30.322 INFO:tasks.workunit.client.0.smithi006.stdout:0/208: chown d2 2426954 1 2024-03-12T16:10:30.325 INFO:tasks.workunit.client.0.smithi006.stdout:6/86: mkdir d3/d11/d10/d1b/d20 0 2024-03-12T16:10:30.327 INFO:tasks.workunit.client.0.smithi006.stdout:6/87: chown d3/d11/l12 1 1 2024-03-12T16:10:30.330 INFO:tasks.workunit.client.0.smithi006.stdout:2/141: dwrite d0/d13/f1d [0,4194304] 0 2024-03-12T16:10:30.332 INFO:tasks.workunit.client.0.smithi006.stdout:6/88: rmdir d3/d11/d10/d19 39 2024-03-12T16:10:30.333 INFO:tasks.workunit.client.0.smithi006.stdout:6/89: chown d3/d11/ce 7 1 2024-03-12T16:10:30.336 INFO:tasks.workunit.client.0.smithi006.stdout:0/209: write d2/d6/d10/f1a [4697851,36653] 0 2024-03-12T16:10:30.337 INFO:tasks.workunit.client.0.smithi006.stdout:2/142: rename d0/dc/df to d0/d13/d2d 0 2024-03-12T16:10:30.338 INFO:tasks.workunit.client.0.smithi006.stdout:6/90: mknod d3/c21 0 2024-03-12T16:10:30.340 INFO:tasks.workunit.client.0.smithi006.stdout:0/210: creat d2/d6/d10/d11/d32/f3a x:0 0 0 2024-03-12T16:10:30.342 INFO:tasks.workunit.client.0.smithi006.stdout:6/91: truncate d3/fc 22860 0 2024-03-12T16:10:30.347 INFO:tasks.workunit.client.0.smithi006.stdout:6/92: creat d3/d11/d10/d1b/d20/f22 x:0 0 0 2024-03-12T16:10:30.351 INFO:tasks.workunit.client.0.smithi006.stdout:0/211: dwrite d2/d6/d10/f1a [0,4194304] 0 2024-03-12T16:10:30.354 INFO:tasks.workunit.client.0.smithi006.stdout:2/143: dwrite d0/dc/f22 [0,4194304] 0 2024-03-12T16:10:30.359 INFO:tasks.workunit.client.0.smithi006.stdout:0/212: fsync d2/f22 0 2024-03-12T16:10:30.364 INFO:tasks.workunit.client.0.smithi006.stdout:6/93: dwrite d3/f14 [0,4194304] 0 2024-03-12T16:10:30.369 INFO:tasks.workunit.client.0.smithi006.stdout:6/94: chown d3/d11/d10/d1b/d20/f22 0 1 2024-03-12T16:10:30.370 INFO:tasks.workunit.client.0.smithi006.stdout:0/213: symlink d2/d6/d10/d11/d32/l3b 0 2024-03-12T16:10:30.374 INFO:tasks.workunit.client.0.smithi006.stdout:0/214: mknod d2/d6/d10/d11/d32/c3c 0 2024-03-12T16:10:30.376 INFO:tasks.workunit.client.0.smithi006.stdout:2/144: link d0/d13/d2d/f14 d0/d13/f2e 0 2024-03-12T16:10:30.379 INFO:tasks.workunit.client.0.smithi006.stdout:0/215: creat d2/d6/f3d x:0 0 0 2024-03-12T16:10:30.384 INFO:tasks.workunit.client.0.smithi006.stdout:6/95: write d3/fc [894244,68649] 0 2024-03-12T16:10:30.389 INFO:tasks.workunit.client.0.smithi006.stdout:8/55: sync 2024-03-12T16:10:30.392 INFO:tasks.workunit.client.0.smithi006.stdout:6/96: creat d3/d11/d10/d1b/d20/f23 x:0 0 0 2024-03-12T16:10:30.395 INFO:tasks.workunit.client.0.smithi006.stdout:0/216: dwrite d2/d6/f3d [0,4194304] 0 2024-03-12T16:10:30.397 INFO:tasks.workunit.client.0.smithi006.stdout:2/145: dwrite d0/f12 [0,4194304] 0 2024-03-12T16:10:30.401 INFO:tasks.workunit.client.0.smithi006.stdout:0/217: fsync d2/fd 0 2024-03-12T16:10:30.409 INFO:tasks.workunit.client.0.smithi006.stdout:6/97: dwrite d3/fc [0,4194304] 0 2024-03-12T16:10:30.411 INFO:tasks.workunit.client.0.smithi006.stdout:2/146: fdatasync d0/d13/d2d/f14 0 2024-03-12T16:10:30.412 INFO:tasks.workunit.client.0.smithi006.stdout:2/147: fsync d0/dc/f15 0 2024-03-12T16:10:30.416 INFO:tasks.workunit.client.0.smithi006.stdout:6/98: fsync f1 0 2024-03-12T16:10:30.420 INFO:tasks.workunit.client.0.smithi006.stdout:2/148: write d0/d13/f2e [4650463,27384] 0 2024-03-12T16:10:30.421 INFO:tasks.workunit.client.0.smithi006.stdout:0/218: chown d2/d6/d10/d11/d32/c3c 61639 1 2024-03-12T16:10:30.426 INFO:tasks.workunit.client.0.smithi006.stdout:6/99: creat d3/d11/d10/d1b/f24 x:0 0 0 2024-03-12T16:10:30.431 INFO:tasks.workunit.client.0.smithi006.stdout:0/219: symlink d2/d6/d10/l3e 0 2024-03-12T16:10:30.431 INFO:tasks.workunit.client.0.smithi006.stdout:8/56: dwrite d2/f9 [0,4194304] 0 2024-03-12T16:10:30.431 INFO:tasks.workunit.client.0.smithi006.stdout:2/149: mknod d0/d13/d2d/d2b/c2f 0 2024-03-12T16:10:30.433 INFO:tasks.workunit.client.0.smithi006.stdout:6/100: creat d3/d11/f25 x:0 0 0 2024-03-12T16:10:30.433 INFO:tasks.workunit.client.0.smithi006.stdout:8/57: chown d2/ff 3040 1 2024-03-12T16:10:30.434 INFO:tasks.workunit.client.0.smithi006.stdout:6/101: chown d3/f7 9250147 1 2024-03-12T16:10:30.435 INFO:tasks.workunit.client.0.smithi006.stdout:2/150: symlink d0/d13/d2d/d2b/l30 0 2024-03-12T16:10:30.435 INFO:tasks.workunit.client.0.smithi006.stdout:6/102: stat d3 0 2024-03-12T16:10:30.442 INFO:tasks.workunit.client.0.smithi006.stdout:2/151: dread d0/d13/d2d/f14 [0,4194304] 0 2024-03-12T16:10:30.444 INFO:tasks.workunit.client.0.smithi006.stdout:2/152: symlink d0/d13/d2d/d2b/l31 0 2024-03-12T16:10:30.446 INFO:tasks.workunit.client.0.smithi006.stdout:2/153: dread - d0/d13/f27 zero size 2024-03-12T16:10:30.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.446+0000 7fe765c3f700 1 -- 172.21.15.6:0/3714168425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe760061280 msgr2=0x7fe7600f81c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:30.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.446+0000 7fe765c3f700 1 --2- 172.21.15.6:0/3714168425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe760061280 0x7fe7600f81c0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fe7500047f0 tx=0x7fe750009cb0).stop 2024-03-12T16:10:30.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.446+0000 7fe765c3f700 1 -- 172.21.15.6:0/3714168425 shutdown_connections 2024-03-12T16:10:30.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.446+0000 7fe765c3f700 1 --2- 172.21.15.6:0/3714168425 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7600f8740 0x7fe7600fabd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:10:30.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.446+0000 7fe765c3f700 1 --2- 172.21.15.6:0/3714168425 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe760061280 0x7fe7600f81c0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.446+0000 7fe765c3f700 1 -- 172.21.15.6:0/3714168425 >> 172.21.15.6:0/3714168425 conn(0x7fe7600f1e50 msgr2=0x7fe7600f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:30.448 INFO:tasks.workunit.client.0.smithi006.stdout:8/58: write d2/db/fe [4954767,120460] 0 2024-03-12T16:10:30.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.447+0000 7fe765c3f700 1 -- 172.21.15.6:0/3714168425 shutdown_connections 2024-03-12T16:10:30.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.447+0000 7fe765c3f700 1 -- 172.21.15.6:0/3714168425 wait complete. 2024-03-12T16:10:30.449 INFO:tasks.workunit.client.0.smithi006.stdout:6/103: truncate d3/f17 3053035 0 2024-03-12T16:10:30.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.448+0000 7fe765c3f700 1 Processor -- start 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.448+0000 7fe765c3f700 1 -- start start 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.448+0000 7fe765c3f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe760061280 0x7fe76010e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.448+0000 7fe765c3f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7600f8740 0x7fe76010ea50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.448+0000 7fe765c3f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76010f090 con 0x7fe7600f8740 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.448+0000 7fe765c3f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe76010f1d0 con 0x7fe760061280 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.449+0000 7fe757fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7600f8740 0x7fe76010ea50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.449+0000 7fe75f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe760061280 0x7fe76010e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.449+0000 7fe75f7fe700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe760061280 0x7fe76010e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:49238/0 (socket says 172.21.15.6:49238) 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.449+0000 7fe757fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7600f8740 0x7fe76010ea50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36216/0 (socket says 172.21.15.6:36216) 2024-03-12T16:10:30.451 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.449+0000 7fe75f7fe700 1 -- 172.21.15.6:0/792548073 learned_addr learned my addr 172.21.15.6:0/792548073 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:10:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.449+0000 7fe75f7fe700 1 -- 172.21.15.6:0/792548073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7600f8740 msgr2=0x7fe76010ea50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.449+0000 7fe75f7fe700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7600f8740 0x7fe76010ea50 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.449+0000 7fe75f7fe700 1 -- 172.21.15.6:0/792548073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe750005040 con 0x7fe760061280 2024-03-12T16:10:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.449+0000 7fe75f7fe700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe760061280 0x7fe76010e560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe750009f20 tx=0x7fe750009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.450+0000 7fe75d7fa700 1 -- 172.21.15.6:0/792548073 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe75000e030 con 0x7fe760061280 2024-03-12T16:10:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.450+0000 7fe75d7fa700 1 -- 172.21.15.6:0/792548073 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe750007e90 con 0x7fe760061280 2024-03-12T16:10:30.452 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.450+0000 7fe75d7fa700 1 -- 172.21.15.6:0/792548073 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe750018070 con 0x7fe760061280 2024-03-12T16:10:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.450+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7600627c0 con 0x7fe760061280 2024-03-12T16:10:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.450+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe760062c70 con 0x7fe760061280 2024-03-12T16:10:30.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.451+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe760106640 con 0x7fe760061280 2024-03-12T16:10:30.454 INFO:tasks.workunit.client.0.smithi006.stdout:8/59: creat d2/db/f13 x:0 0 0 2024-03-12T16:10:30.454 INFO:tasks.workunit.client.0.smithi006.stdout:2/154: dread d0/f1f [0,4194304] 0 2024-03-12T16:10:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.452+0000 7fe75d7fa700 1 -- 172.21.15.6:0/792548073 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fe75001d420 con 0x7fe760061280 2024-03-12T16:10:30.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.452+0000 7fe75d7fa700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe74c066e60 0x7fe74c069320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:30.456 INFO:tasks.workunit.client.0.smithi006.stdout:2/155: chown d0/d13/f2e 894873 1 2024-03-12T16:10:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.453+0000 7fe75d7fa700 1 -- 172.21.15.6:0/792548073 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fe750085aa0 con 0x7fe760061280 2024-03-12T16:10:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.453+0000 7fe757fff700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe74c066e60 0x7fe74c069320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:10:30.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.453+0000 7fe757fff700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe74c066e60 0x7fe74c069320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe74800b9d0 tx=0x7fe748000f90).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:30.456 INFO:tasks.workunit.client.0.smithi006.stdout:8/60: creat d2/d11/f14 x:0 0 0 2024-03-12T16:10:30.457 INFO:tasks.workunit.client.0.smithi006.stdout:8/61: chown d2/db/f13 1567198053 1 2024-03-12T16:10:30.458 INFO:tasks.workunit.client.0.smithi006.stdout:2/156: unlink d0/dc/f22 0 2024-03-12T16:10:30.459 INFO:tasks.workunit.client.0.smithi006.stdout:6/104: getdents d3/d11/d10/d1b 0 2024-03-12T16:10:30.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.458+0000 7fe75d7fa700 1 -- 172.21.15.6:0/792548073 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fe750053a80 con 0x7fe760061280 2024-03-12T16:10:30.468 INFO:tasks.workunit.client.0.smithi006.stdout:2/157: creat d0/d13/d2d/f32 x:0 0 0 2024-03-12T16:10:30.473 INFO:tasks.workunit.client.0.smithi006.stdout:8/62: truncate d2/db/fe 4214666 0 2024-03-12T16:10:30.475 INFO:tasks.workunit.client.0.smithi006.stdout:6/105: truncate d3/d11/f15 13910 0 2024-03-12T16:10:30.475 INFO:tasks.workunit.client.0.smithi006.stdout:2/158: dwrite d0/dc/f1a [0,4194304] 0 2024-03-12T16:10:30.477 INFO:tasks.workunit.client.0.smithi006.stdout:8/63: unlink l1 0 2024-03-12T16:10:30.477 INFO:tasks.workunit.client.0.smithi006.stdout:2/159: write d0/f12 [311193,86046] 0 2024-03-12T16:10:30.485 INFO:tasks.workunit.client.0.smithi006.stdout:2/160: link d0/dc/c25 d0/d13/d2d/c33 0 2024-03-12T16:10:30.488 INFO:tasks.workunit.client.0.smithi006.stdout:6/106: dwrite d3/d11/d10/d19/f1f [0,4194304] 0 2024-03-12T16:10:30.491 INFO:tasks.workunit.client.0.smithi006.stdout:6/107: rmdir d3/d11/d10 39 2024-03-12T16:10:30.494 INFO:tasks.workunit.client.0.smithi006.stdout:2/161: dread d0/d13/f2e [0,4194304] 0 2024-03-12T16:10:30.495 INFO:tasks.workunit.client.0.smithi006.stdout:6/108: mkdir d3/d11/d10/d1b/d20/d26 0 2024-03-12T16:10:30.501 INFO:tasks.workunit.client.0.smithi006.stdout:2/162: getdents d0/d13/d2d/d2b 0 2024-03-12T16:10:30.509 INFO:tasks.workunit.client.0.smithi006.stdout:8/64: truncate d2/ff 931508 0 2024-03-12T16:10:30.510 INFO:tasks.workunit.client.0.smithi006.stdout:6/109: getdents d3/d11/d10/d1b/d20 0 2024-03-12T16:10:30.510 INFO:tasks.workunit.client.0.smithi006.stdout:2/163: dread d0/d13/d2d/f16 [0,4194304] 0 2024-03-12T16:10:30.511 INFO:tasks.workunit.client.0.smithi006.stdout:2/164: readlink d0/l7 0 2024-03-12T16:10:30.513 INFO:tasks.workunit.client.0.smithi006.stdout:6/110: rename d3/d11/d10/d1b to d3/d11/d10/d1b/d20/d27 22 2024-03-12T16:10:30.519 INFO:tasks.workunit.client.0.smithi006.stdout:8/65: rmdir d2 39 2024-03-12T16:10:30.529 INFO:tasks.workunit.client.0.smithi006.stdout:8/66: write d2/d11/f14 [565467,101060] 0 2024-03-12T16:10:30.529 INFO:tasks.workunit.client.0.smithi006.stdout:2/165: link d0/l11 d0/d13/d2d/d2b/l34 0 2024-03-12T16:10:30.532 INFO:tasks.workunit.client.0.smithi006.stdout:6/111: getdents d3 0 2024-03-12T16:10:30.536 INFO:tasks.workunit.client.0.smithi006.stdout:2/166: chown d0/l9 3472 1 2024-03-12T16:10:30.540 INFO:tasks.workunit.client.0.smithi006.stdout:2/167: creat d0/d13/f35 x:0 0 0 2024-03-12T16:10:30.541 INFO:tasks.workunit.client.0.smithi006.stdout:6/112: dwrite d3/d11/f1e [0,4194304] 0 2024-03-12T16:10:30.543 INFO:tasks.workunit.client.0.smithi006.stdout:2/168: creat d0/d13/d2d/f36 x:0 0 0 2024-03-12T16:10:30.544 INFO:tasks.workunit.client.0.smithi006.stdout:2/169: stat d0/d13/f1d 0 2024-03-12T16:10:30.548 INFO:tasks.workunit.client.0.smithi006.stdout:2/170: symlink d0/d13/d2d/l37 0 2024-03-12T16:10:30.554 INFO:tasks.workunit.client.0.smithi006.stdout:2/171: symlink d0/l38 0 2024-03-12T16:10:30.555 INFO:tasks.workunit.client.0.smithi006.stdout:2/172: write d0/d13/d2d/f16 [865855,90371] 0 2024-03-12T16:10:30.556 INFO:tasks.workunit.client.0.smithi006.stdout:2/173: dread - d0/d13/f35 zero size 2024-03-12T16:10:30.557 INFO:tasks.workunit.client.0.smithi006.stdout:2/174: stat d0/l9 0 2024-03-12T16:10:30.568 INFO:tasks.workunit.client.0.smithi006.stdout:8/67: truncate d2/f9 238518 0 2024-03-12T16:10:30.570 INFO:tasks.workunit.client.0.smithi006.stdout:8/68: creat d2/f15 x:0 0 0 2024-03-12T16:10:30.572 INFO:tasks.workunit.client.0.smithi006.stdout:6/113: write d3/d11/f15 [527616,120618] 0 2024-03-12T16:10:30.572 INFO:tasks.workunit.client.0.smithi006.stdout:2/175: truncate d0/d13/d2d/f16 1684336 0 2024-03-12T16:10:30.578 INFO:tasks.workunit.client.0.smithi006.stdout:8/69: dread d2/ff [0,4194304] 0 2024-03-12T16:10:30.578 INFO:tasks.workunit.client.0.smithi006.stdout:8/70: chown d2/d11 1384 1 2024-03-12T16:10:30.578 INFO:tasks.workunit.client.0.smithi006.stdout:8/71: read d2/fd [1820076,20591] 0 2024-03-12T16:10:30.579 INFO:tasks.workunit.client.0.smithi006.stdout:6/114: dread d3/f14 [0,4194304] 0 2024-03-12T16:10:30.583 INFO:tasks.workunit.client.0.smithi006.stdout:2/176: dread d0/d13/d2d/f20 [0,4194304] 0 2024-03-12T16:10:30.590 INFO:tasks.workunit.client.0.smithi006.stdout:8/72: write d2/db/fe [4651021,10046] 0 2024-03-12T16:10:30.593 INFO:tasks.workunit.client.0.smithi006.stdout:6/115: dwrite d3/f14 [0,4194304] 0 2024-03-12T16:10:30.595 INFO:tasks.workunit.client.0.smithi006.stdout:2/177: write d0/f1f [1447472,113369] 0 2024-03-12T16:10:30.605 INFO:tasks.workunit.client.0.smithi006.stdout:8/73: dwrite d2/f15 [0,4194304] 0 2024-03-12T16:10:30.607 INFO:tasks.workunit.client.0.smithi006.stdout:2/178: write d0/d13/d2d/f20 [1532656,74649] 0 2024-03-12T16:10:30.613 INFO:tasks.workunit.client.0.smithi006.stdout:6/116: mkdir d3/d11/d10/d28 0 2024-03-12T16:10:30.618 INFO:tasks.workunit.client.0.smithi006.stdout:2/179: symlink d0/d13/d2d/d2b/l39 0 2024-03-12T16:10:30.621 INFO:tasks.workunit.client.0.smithi006.stdout:8/74: link d2/ff d2/f16 0 2024-03-12T16:10:30.622 INFO:tasks.workunit.client.0.smithi006.stdout:6/117: mknod d3/d11/d10/d28/c29 0 2024-03-12T16:10:30.628 INFO:tasks.workunit.client.0.smithi006.stdout:8/75: unlink d2/ff 0 2024-03-12T16:10:30.630 INFO:tasks.workunit.client.0.smithi006.stdout:2/180: getdents d0/d13 0 2024-03-12T16:10:30.634 INFO:tasks.workunit.client.0.smithi006.stdout:6/118: rename d3/d11/d10/d1b/d20/f22 to d3/d11/d10/f2a 0 2024-03-12T16:10:30.638 INFO:tasks.workunit.client.0.smithi006.stdout:8/76: dwrite d2/db/f13 [0,4194304] 0 2024-03-12T16:10:30.639 INFO:tasks.workunit.client.0.smithi006.stdout:2/181: rmdir d0/d13 39 2024-03-12T16:10:30.640 INFO:tasks.workunit.client.0.smithi006.stdout:6/119: unlink d3/d11/c1a 0 2024-03-12T16:10:30.645 INFO:tasks.workunit.client.0.smithi006.stdout:6/120: mknod d3/d11/d10/d1b/c2b 0 2024-03-12T16:10:30.649 INFO:tasks.workunit.client.0.smithi006.stdout:8/77: symlink d2/l17 0 2024-03-12T16:10:30.650 INFO:tasks.workunit.client.0.smithi006.stdout:2/182: symlink d0/d13/l3a 0 2024-03-12T16:10:30.651 INFO:tasks.workunit.client.0.smithi006.stdout:6/121: fsync d3/f7 0 2024-03-12T16:10:30.656 INFO:tasks.workunit.client.0.smithi006.stdout:6/122: mknod d3/d11/d10/c2c 0 2024-03-12T16:10:30.656 INFO:tasks.workunit.client.0.smithi006.stdout:2/183: dread d0/dc/fd [4194304,4194304] 0 2024-03-12T16:10:30.660 INFO:tasks.workunit.client.0.smithi006.stdout:2/184: creat d0/d13/d2d/f3b x:0 0 0 2024-03-12T16:10:30.661 INFO:tasks.workunit.client.0.smithi006.stdout:8/78: creat d2/db/f18 x:0 0 0 2024-03-12T16:10:30.662 INFO:tasks.workunit.client.0.smithi006.stdout:2/185: creat d0/d13/f3c x:0 0 0 2024-03-12T16:10:30.667 INFO:tasks.workunit.client.0.smithi006.stdout:8/79: dread d2/f16 [0,4194304] 0 2024-03-12T16:10:30.668 INFO:tasks.workunit.client.0.smithi006.stdout:6/123: dwrite d3/f7 [0,4194304] 0 2024-03-12T16:10:30.668 INFO:tasks.workunit.client.0.smithi006.stdout:8/80: fsync d2/db/f13 0 2024-03-12T16:10:30.669 INFO:tasks.workunit.client.0.smithi006.stdout:8/81: truncate d2/db/fe 4686318 0 2024-03-12T16:10:30.672 INFO:tasks.workunit.client.0.smithi006.stdout:8/82: creat d2/f19 x:0 0 0 2024-03-12T16:10:30.681 INFO:tasks.workunit.client.0.smithi006.stdout:8/83: dwrite d2/db/f13 [0,4194304] 0 2024-03-12T16:10:30.685 INFO:tasks.workunit.client.0.smithi006.stdout:8/84: mkdir d2/db/d1a 0 2024-03-12T16:10:30.690 INFO:tasks.workunit.client.0.smithi006.stdout:8/85: creat d2/d11/f1b x:0 0 0 2024-03-12T16:10:30.693 INFO:tasks.workunit.client.0.smithi006.stdout:8/86: creat d2/db/d1a/f1c x:0 0 0 2024-03-12T16:10:30.698 INFO:tasks.workunit.client.0.smithi006.stdout:8/87: dread d2/d11/f14 [0,4194304] 0 2024-03-12T16:10:30.699 INFO:tasks.workunit.client.0.smithi006.stdout:8/88: chown d2/db/fe 53892 1 2024-03-12T16:10:30.700 INFO:tasks.workunit.client.0.smithi006.stdout:8/89: creat d2/d11/f1d x:0 0 0 2024-03-12T16:10:30.702 INFO:tasks.workunit.client.0.smithi006.stdout:8/90: symlink d2/l1e 0 2024-03-12T16:10:30.702 INFO:tasks.workunit.client.0.smithi006.stdout:8/91: read - d2/f19 zero size 2024-03-12T16:10:30.705 INFO:tasks.workunit.client.0.smithi006.stdout:8/92: mkdir d2/db/d1a/d1f 0 2024-03-12T16:10:30.706 INFO:tasks.workunit.client.0.smithi006.stdout:8/93: creat d2/db/f20 x:0 0 0 2024-03-12T16:10:30.708 INFO:tasks.workunit.client.0.smithi006.stdout:8/94: mkdir d2/db/d1a/d21 0 2024-03-12T16:10:30.708 INFO:tasks.workunit.client.0.smithi006.stdout:8/95: chown d2/db/d1a 19187127 1 2024-03-12T16:10:30.709 INFO:tasks.workunit.client.0.smithi006.stdout:8/96: dread - d2/d11/f1d zero size 2024-03-12T16:10:30.711 INFO:tasks.workunit.client.0.smithi006.stdout:8/97: fsync d2/fd 0 2024-03-12T16:10:30.713 INFO:tasks.workunit.client.0.smithi006.stdout:8/98: symlink d2/db/d1a/l22 0 2024-03-12T16:10:30.714 INFO:tasks.workunit.client.0.smithi006.stdout:8/99: stat d2/c6 0 2024-03-12T16:10:30.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.777+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fe760059120 con 0x7fe74c066e60 2024-03-12T16:10:30.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.787+0000 7fe75d7fa700 1 -- 172.21.15.6:0/792548073 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fe760059120 con 0x7fe74c066e60 2024-03-12T16:10:30.790 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:10:30.790 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 starting - - - - 2024-03-12T16:10:30.790 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (8m) 37s ago 8m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:10:30.791 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (7m) 40s ago 7m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:10:30.791 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (5m) 37s ago 8m 53.7M - 8.3.5 dad864ee21e9 7deda4319993 2024-03-12T16:10:30.791 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (3m) 37s ago 3m 86.1M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:10:30.791 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (3m) 37s ago 2m 12.7M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:10:30.791 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (3m) 40s ago 3m 56.5M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:10:30.792 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (2m) 40s ago 2m 15.3M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:10:30.792 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:9283 running (9m) 37s ago 9m 358M - 16.2.15-1-g8963e9de 727f386679cb f09ce35a51f8 2024-03-12T16:10:30.792 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283 running (56s) 40s ago 7m 477M - 18.2.2-797-g49e4a679 72a574b3d6f5 4b7738c64f1d 2024-03-12T16:10:30.792 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (9m) 37s ago 9m 47.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:10:30.792 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (7m) 40s ago 7m 40.3M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:10:30.793 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (7m) 37s ago 7m 21.5M - 1.3.1 1dbe0e931976 ef9d95e31974 2024-03-12T16:10:30.793 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 40s ago 7m 23.0M - 1.3.1 1dbe0e931976 ee7621f16bde 2024-03-12T16:10:30.793 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (7m) 37s ago 6m 81.0M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:10:30.793 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (6m) 37s ago 6m 87.9M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:10:30.793 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (6m) 37s ago 6m 74.3M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:10:30.793 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (5m) 40s ago 5m 84.5M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:10:30.794 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (5m) 40s ago 5m 83.7M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:10:30.794 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (4m) 40s ago 4m 78.8M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:10:30.794 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 40s ago 6m 66.2M - 2.33.4 514e6a882f6e 344ddc812ba0 2024-03-12T16:10:30.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.789+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe74c066e60 msgr2=0x7fe74c069320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.789+0000 7fe765c3f700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe74c066e60 0x7fe74c069320 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fe74800b9d0 tx=0x7fe748000f90).stop 2024-03-12T16:10:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.790+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe760061280 msgr2=0x7fe76010e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.790+0000 7fe765c3f700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe760061280 0x7fe76010e560 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fe750009f20 tx=0x7fe750009cb0).stop 2024-03-12T16:10:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.790+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 shutdown_connections 2024-03-12T16:10:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.790+0000 7fe765c3f700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fe74c066e60 0x7fe74c069320 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.790+0000 7fe765c3f700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe760061280 0x7fe76010e560 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.790+0000 7fe765c3f700 1 --2- 172.21.15.6:0/792548073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7600f8740 0x7fe76010ea50 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.790+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 >> 172.21.15.6:0/792548073 conn(0x7fe7600f1e50 msgr2=0x7fe7600f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:30.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.790+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 shutdown_connections 2024-03-12T16:10:30.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.790+0000 7fe765c3f700 1 -- 172.21.15.6:0/792548073 wait complete. 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.896+0000 7f079add6700 1 -- 172.21.15.6:0/2481847413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 msgr2=0x7f07940fa3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.896+0000 7f079add6700 1 --2- 172.21.15.6:0/2481847413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 0x7f07940fa3d0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f07880047f0 tx=0x7f0788009cb0).stop 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.896+0000 7f079add6700 1 -- 172.21.15.6:0/2481847413 shutdown_connections 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.896+0000 7f079add6700 1 --2- 172.21.15.6:0/2481847413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07940fa950 0x7f07940fcda0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.896+0000 7f079add6700 1 --2- 172.21.15.6:0/2481847413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 0x7f07940fa3d0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.896+0000 7f079add6700 1 -- 172.21.15.6:0/2481847413 >> 172.21.15.6:0/2481847413 conn(0x7f07940f1e50 msgr2=0x7f07940f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.896+0000 7f079add6700 1 -- 172.21.15.6:0/2481847413 shutdown_connections 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.896+0000 7f079add6700 1 -- 172.21.15.6:0/2481847413 wait complete. 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f079add6700 1 Processor -- start 2024-03-12T16:10:30.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f079add6700 1 -- start start 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f079add6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 0x7f07940f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f079add6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07940fa950 0x7f07940f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f079add6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940f8220 con 0x7f0794061280 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f079add6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f07940f67c0 con 0x7f07940fa950 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f0798b72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 0x7f07940f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f0798b72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 0x7f07940f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36224/0 (socket says 172.21.15.6:36224) 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f0798b72700 1 -- 172.21.15.6:0/2397350690 learned_addr learned my addr 172.21.15.6:0/2397350690 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.897+0000 7f0793fff700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07940fa950 0x7f07940f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f0798b72700 1 -- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07940fa950 msgr2=0x7f07940f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:30.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f0798b72700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07940fa950 0x7f07940f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f0798b72700 1 -- 172.21.15.6:0/2397350690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0788005040 con 0x7f0794061280 2024-03-12T16:10:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f0793fff700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07940fa950 0x7f07940f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:10:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f0798b72700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 0x7f07940f7c70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f0788013560 tx=0x7f0788009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f0791ffb700 1 -- 172.21.15.6:0/2397350690 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0788018070 con 0x7f0794061280 2024-03-12T16:10:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f0791ffb700 1 -- 172.21.15.6:0/2397350690 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0788007e90 con 0x7f0794061280 2024-03-12T16:10:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f07940f69e0 con 0x7f0794061280 2024-03-12T16:10:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f0791ffb700 1 -- 172.21.15.6:0/2397350690 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f078801c380 con 0x7f0794061280 2024-03-12T16:10:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.898+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f07940f6f40 con 0x7f0794061280 2024-03-12T16:10:30.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.899+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0794047540 con 0x7f0794061280 2024-03-12T16:10:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.900+0000 7f0791ffb700 1 -- 172.21.15.6:0/2397350690 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f07880123c0 con 0x7f0794061280 2024-03-12T16:10:30.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.900+0000 7f0791ffb700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f0784066dc0 0x7f0784069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.900+0000 7f0791ffb700 1 -- 172.21.15.6:0/2397350690 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f07880850f0 con 0x7f0794061280 2024-03-12T16:10:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.900+0000 7f0793fff700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f0784066dc0 0x7f0784069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:10:30.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.901+0000 7f0793fff700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f0784066dc0 0x7f0784069280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f0794061050 tx=0x7f078000b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:30.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:30.905+0000 7f0791ffb700 1 -- 172.21.15.6:0/2397350690 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f0788053190 con 0x7f0794061280 2024-03-12T16:10:30.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:29.493543+0000 mgr.smithi134.gcntfu (mgr.24383) 48 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 389 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-03-12T16:10:30.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:29.693307+0000 mgr.smithi134.gcntfu (mgr.24383) 49 : audit [DBG] from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:29.493543+0000 mgr.smithi134.gcntfu (mgr.24383) 48 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 389 MiB data, 3.0 GiB used, 533 GiB / 536 GiB avail; 173 KiB/s rd, 28 MiB/s wr, 46 op/s 2024-03-12T16:10:30.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:29.693307+0000 mgr.smithi134.gcntfu (mgr.24383) 49 : audit [DBG] from='client.14606 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:31.206 INFO:tasks.workunit.client.1.smithi134.stdout:0/1: sync 2024-03-12T16:10:31.207 INFO:tasks.workunit.client.1.smithi134.stdout:0/2: fdatasync - no filename 2024-03-12T16:10:31.207 INFO:tasks.workunit.client.1.smithi134.stdout:0/3: unlink - no file 2024-03-12T16:10:31.208 INFO:tasks.workunit.client.1.smithi134.stdout:0/4: getdents . 0 2024-03-12T16:10:31.211 INFO:tasks.workunit.client.1.smithi134.stdout:0/5: symlink l0 0 2024-03-12T16:10:31.213 INFO:tasks.workunit.client.1.smithi134.stdout:0/6: creat f1 x:0 0 0 2024-03-12T16:10:31.221 INFO:tasks.workunit.client.1.smithi134.stdout:0/7: dwrite f1 [0,4194304] 0 2024-03-12T16:10:31.233 INFO:tasks.workunit.client.1.smithi134.stdout:0/8: dwrite f1 [4194304,4194304] 0 2024-03-12T16:10:31.235 INFO:tasks.workunit.client.1.smithi134.stdout:0/9: symlink l2 0 2024-03-12T16:10:31.239 INFO:tasks.workunit.client.1.smithi134.stdout:0/10: dread f1 [0,4194304] 0 2024-03-12T16:10:31.242 INFO:tasks.workunit.client.1.smithi134.stdout:0/11: unlink f1 0 2024-03-12T16:10:31.242 INFO:tasks.workunit.client.1.smithi134.stdout:0/12: fdatasync - no filename 2024-03-12T16:10:31.243 INFO:tasks.workunit.client.1.smithi134.stdout:0/13: rename l0 to l3 0 2024-03-12T16:10:31.243 INFO:tasks.workunit.client.1.smithi134.stdout:0/14: fdatasync - no filename 2024-03-12T16:10:31.245 INFO:tasks.workunit.client.1.smithi134.stdout:0/15: rename l2 to l4 0 2024-03-12T16:10:31.246 INFO:tasks.workunit.client.1.smithi134.stdout:0/16: dwrite - no filename 2024-03-12T16:10:31.247 INFO:tasks.workunit.client.1.smithi134.stdout:0/17: symlink l5 0 2024-03-12T16:10:31.249 INFO:tasks.workunit.client.1.smithi134.stdout:0/18: mknod c6 0 2024-03-12T16:10:31.249 INFO:tasks.workunit.client.1.smithi134.stdout:0/19: write - no filename 2024-03-12T16:10:31.250 INFO:tasks.workunit.client.1.smithi134.stdout:0/20: creat f7 x:0 0 0 2024-03-12T16:10:31.251 INFO:tasks.workunit.client.1.smithi134.stdout:0/21: write f7 [74973,107675] 0 2024-03-12T16:10:31.258 INFO:tasks.workunit.client.1.smithi134.stdout:0/22: dwrite f7 [0,4194304] 0 2024-03-12T16:10:31.263 INFO:tasks.workunit.client.1.smithi134.stdout:0/23: stat l3 0 2024-03-12T16:10:31.264 INFO:tasks.workunit.client.1.smithi134.stdout:0/24: mknod c8 0 2024-03-12T16:10:31.265 INFO:tasks.workunit.client.1.smithi134.stdout:0/25: read f7 [1667881,75567] 0 2024-03-12T16:10:31.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.284+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0794101e70 con 0x7f0794061280 2024-03-12T16:10:31.286 INFO:tasks.workunit.client.1.smithi134.stdout:0/26: dwrite f7 [4194304,4194304] 0 2024-03-12T16:10:31.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.284+0000 7f0791ffb700 1 -- 172.21.15.6:0/2397350690 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+848 (secure 0 0 0) 0x7f0788052d80 con 0x7f0794061280 2024-03-12T16:10:31.286 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:10:31.286 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-03-12T16:10:31.287 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:10:31.288 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:10:31.288 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:10:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.287+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f0784066dc0 msgr2=0x7f0784069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:31.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.287+0000 7f079add6700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f0784066dc0 0x7f0784069280 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f0794061050 tx=0x7f078000b040).stop 2024-03-12T16:10:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.287+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 msgr2=0x7f07940f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.287+0000 7f079add6700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 0x7f07940f7c70 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f0788013560 tx=0x7f0788009cb0).stop 2024-03-12T16:10:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.287+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 shutdown_connections 2024-03-12T16:10:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.287+0000 7f079add6700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f0784066dc0 0x7f0784069280 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.287+0000 7f079add6700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0794061280 0x7f07940f7c70 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:31.290 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.287+0000 7f079add6700 1 --2- 172.21.15.6:0/2397350690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07940fa950 0x7f07940f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.287+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 >> 172.21.15.6:0/2397350690 conn(0x7f07940f1e50 msgr2=0x7f07940f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.288+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 shutdown_connections 2024-03-12T16:10:31.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.288+0000 7f079add6700 1 -- 172.21.15.6:0/2397350690 wait complete. 2024-03-12T16:10:31.291 INFO:tasks.workunit.client.1.smithi134.stdout:0/27: link l3 l9 0 2024-03-12T16:10:31.294 INFO:tasks.workunit.client.1.smithi134.stdout:0/28: getdents . 0 2024-03-12T16:10:31.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/29: creat fa x:0 0 0 2024-03-12T16:10:31.298 INFO:tasks.workunit.client.1.smithi134.stdout:0/30: dread f7 [0,4194304] 0 2024-03-12T16:10:31.298 INFO:tasks.workunit.client.1.smithi134.stdout:0/31: chown fa 690 1 2024-03-12T16:10:31.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.421+0000 7f5cf8bab700 1 -- 172.21.15.6:0/605125468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 msgr2=0x7f5cf40f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:31.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.421+0000 7f5cf8bab700 1 --2- 172.21.15.6:0/605125468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 0x7f5cf40f6af0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f5ce40047f0 tx=0x7f5ce4009cb0).stop 2024-03-12T16:10:31.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.421+0000 7f5cf8bab700 1 -- 172.21.15.6:0/605125468 shutdown_connections 2024-03-12T16:10:31.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.421+0000 7f5cf8bab700 1 --2- 172.21.15.6:0/605125468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cf40f6fe0 0x7f5cf40f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:31.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.421+0000 7f5cf8bab700 1 --2- 172.21.15.6:0/605125468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 0x7f5cf40f6af0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:31.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.421+0000 7f5cf8bab700 1 -- 172.21.15.6:0/605125468 >> 172.21.15.6:0/605125468 conn(0x7f5cf40f1eb0 msgr2=0x7f5cf40f42f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:31.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.421+0000 7f5cf8bab700 1 -- 172.21.15.6:0/605125468 shutdown_connections 2024-03-12T16:10:31.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.421+0000 7f5cf8bab700 1 -- 172.21.15.6:0/605125468 wait complete. 2024-03-12T16:10:31.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.422+0000 7f5cf8bab700 1 Processor -- start 2024-03-12T16:10:31.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.422+0000 7f5cf8bab700 1 -- start start 2024-03-12T16:10:31.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.422+0000 7f5cf8bab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 0x7f5cf4061650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:31.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.422+0000 7f5cf8bab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cf40f6fe0 0x7f5cf410ce20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:31.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.422+0000 7f5cf8bab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf410d310 con 0x7f5cf40f66d0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.422+0000 7f5cf8bab700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5cf410d450 con 0x7f5cf40f6fe0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5cf259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 0x7f5cf4061650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5cf259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 0x7f5cf4061650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:36254/0 (socket says 172.21.15.6:36254) 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5cf259c700 1 -- 172.21.15.6:0/2992928814 learned_addr learned my addr 172.21.15.6:0/2992928814 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5cf1d9b700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cf40f6fe0 0x7f5cf410ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5cf259c700 1 -- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cf40f6fe0 msgr2=0x7f5cf410ce20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5cf259c700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cf40f6fe0 0x7f5cf410ce20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5cf259c700 1 -- 172.21.15.6:0/2992928814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5ce4005040 con 0x7f5cf40f66d0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5cf259c700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 0x7f5cf4061650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f5ce4005010 tx=0x7f5ce4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5ce37fe700 1 -- 172.21.15.6:0/2992928814 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ce400e030 con 0x7f5cf40f66d0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5cf410d650 con 0x7f5cf40f66d0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5ce37fe700 1 -- 172.21.15.6:0/2992928814 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ce4007e90 con 0x7f5cf40f66d0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.423+0000 7f5ce37fe700 1 -- 172.21.15.6:0/2992928814 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ce4018070 con 0x7f5cf40f66d0 2024-03-12T16:10:31.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.424+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5cf410db80 con 0x7f5cf40f66d0 2024-03-12T16:10:31.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.425+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5cf40feed0 con 0x7f5cf40f66d0 2024-03-12T16:10:31.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.425+0000 7f5ce37fe700 1 -- 172.21.15.6:0/2992928814 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f5ce4009590 con 0x7f5cf40f66d0 2024-03-12T16:10:31.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.426+0000 7f5ce37fe700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f5cdc066dc0 0x7f5cdc069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:10:31.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.426+0000 7f5ce37fe700 1 -- 172.21.15.6:0/2992928814 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f5ce40856a0 con 0x7f5cf40f66d0 2024-03-12T16:10:31.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.426+0000 7f5cf1d9b700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f5cdc066dc0 0x7f5cdc069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:10:31.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.427+0000 7f5cf1d9b700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f5cdc066dc0 0x7f5cdc069280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5ce8004dc0 tx=0x7f5ce800b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:10:31.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.431+0000 7f5ce37fe700 1 -- 172.21.15.6:0/2992928814 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f5ce4053740 con 0x7f5cf40f66d0 2024-03-12T16:10:31.485 INFO:tasks.workunit.client.1.smithi134.stdout:1/12: sync 2024-03-12T16:10:31.485 INFO:tasks.workunit.client.1.smithi134.stdout:2/22: sync 2024-03-12T16:10:31.485 INFO:tasks.workunit.client.1.smithi134.stdout:7/11: sync 2024-03-12T16:10:31.485 INFO:tasks.workunit.client.1.smithi134.stdout:8/32: sync 2024-03-12T16:10:31.485 INFO:tasks.workunit.client.1.smithi134.stdout:7/12: truncate - no filename 2024-03-12T16:10:31.485 INFO:tasks.workunit.client.1.smithi134.stdout:9/50: sync 2024-03-12T16:10:31.489 INFO:tasks.workunit.client.1.smithi134.stdout:7/13: link c2 c4 0 2024-03-12T16:10:31.489 INFO:tasks.workunit.client.1.smithi134.stdout:7/14: write - no filename 2024-03-12T16:10:31.490 INFO:tasks.workunit.client.1.smithi134.stdout:8/33: write d3/f8 [485556,42256] 0 2024-03-12T16:10:31.491 INFO:tasks.workunit.client.1.smithi134.stdout:1/13: getdents d0 0 2024-03-12T16:10:31.493 INFO:tasks.workunit.client.1.smithi134.stdout:7/15: rename c1 to c5 0 2024-03-12T16:10:31.493 INFO:tasks.workunit.client.1.smithi134.stdout:7/16: write - no filename 2024-03-12T16:10:31.494 INFO:tasks.workunit.client.1.smithi134.stdout:7/17: dread - no filename 2024-03-12T16:10:31.494 INFO:tasks.workunit.client.1.smithi134.stdout:8/34: creat d3/d9/fa x:0 0 0 2024-03-12T16:10:31.495 INFO:tasks.workunit.client.1.smithi134.stdout:8/35: rename d3/d9 to d3/d9/db 22 2024-03-12T16:10:31.495 INFO:tasks.workunit.client.1.smithi134.stdout:7/18: creat f6 x:0 0 0 2024-03-12T16:10:31.516 INFO:tasks.workunit.client.1.smithi134.stdout:1/14: dread d0/f1 [0,4194304] 0 2024-03-12T16:10:31.516 INFO:tasks.workunit.client.1.smithi134.stdout:1/15: stat d0/f1 0 2024-03-12T16:10:31.518 INFO:tasks.workunit.client.1.smithi134.stdout:8/36: dread d3/f6 [4194304,4194304] 0 2024-03-12T16:10:31.518 INFO:tasks.workunit.client.1.smithi134.stdout:1/16: creat d0/f3 x:0 0 0 2024-03-12T16:10:31.519 INFO:tasks.workunit.client.1.smithi134.stdout:8/37: write d3/d9/fa [948418,14268] 0 2024-03-12T16:10:31.519 INFO:tasks.workunit.client.1.smithi134.stdout:1/17: dread - d0/f3 zero size 2024-03-12T16:10:31.519 INFO:tasks.workunit.client.1.smithi134.stdout:7/19: fsync f6 0 2024-03-12T16:10:31.520 INFO:tasks.workunit.client.1.smithi134.stdout:8/38: chown d3 3123 1 2024-03-12T16:10:31.520 INFO:tasks.workunit.client.1.smithi134.stdout:8/39: chown d3/d9 682 1 2024-03-12T16:10:31.520 INFO:tasks.workunit.client.1.smithi134.stdout:1/18: write d0/f3 [489497,70109] 0 2024-03-12T16:10:31.557 INFO:tasks.workunit.client.1.smithi134.stdout:3/75: sync 2024-03-12T16:10:31.557 INFO:tasks.workunit.client.1.smithi134.stdout:0/32: sync 2024-03-12T16:10:31.557 INFO:tasks.workunit.client.1.smithi134.stdout:4/96: sync 2024-03-12T16:10:31.557 INFO:tasks.workunit.client.1.smithi134.stdout:5/60: sync 2024-03-12T16:10:31.557 INFO:tasks.workunit.client.1.smithi134.stdout:6/79: sync 2024-03-12T16:10:31.559 INFO:tasks.workunit.client.1.smithi134.stdout:1/19: rename d0/f1 to d0/f4 0 2024-03-12T16:10:31.559 INFO:tasks.workunit.client.1.smithi134.stdout:0/33: chown l4 53991829 1 2024-03-12T16:10:31.559 INFO:tasks.workunit.client.1.smithi134.stdout:6/80: chown d1/d3/d10 0 1 2024-03-12T16:10:31.562 INFO:tasks.workunit.client.1.smithi134.stdout:0/34: chown c6 20741 1 2024-03-12T16:10:31.563 INFO:tasks.workunit.client.1.smithi134.stdout:8/40: getdents d3 0 2024-03-12T16:10:31.563 INFO:tasks.workunit.client.1.smithi134.stdout:4/97: rename d1/df to d1/d24 0 2024-03-12T16:10:31.565 INFO:tasks.workunit.client.1.smithi134.stdout:7/20: dwrite f6 [0,4194304] 0 2024-03-12T16:10:31.565 INFO:tasks.workunit.client.1.smithi134.stdout:1/20: mknod d0/c5 0 2024-03-12T16:10:31.567 INFO:tasks.workunit.client.1.smithi134.stdout:3/76: creat d1/db/d14/f22 x:0 0 0 2024-03-12T16:10:31.568 INFO:tasks.workunit.client.1.smithi134.stdout:6/81: rename d1 to d1/d23 22 2024-03-12T16:10:31.568 INFO:tasks.workunit.client.1.smithi134.stdout:5/61: write f6 [696063,101193] 0 2024-03-12T16:10:31.569 INFO:tasks.workunit.client.1.smithi134.stdout:5/62: write f6 [4317304,75051] 0 2024-03-12T16:10:31.570 INFO:tasks.workunit.client.1.smithi134.stdout:8/41: rmdir d3/d9 39 2024-03-12T16:10:31.572 INFO:tasks.workunit.client.1.smithi134.stdout:4/98: read d1/de/f1f [339580,29626] 0 2024-03-12T16:10:31.572 INFO:tasks.workunit.client.1.smithi134.stdout:1/21: mkdir d0/d6 0 2024-03-12T16:10:31.577 INFO:tasks.workunit.client.1.smithi134.stdout:6/82: mknod d1/d16/c24 0 2024-03-12T16:10:31.578 INFO:tasks.workunit.client.1.smithi134.stdout:0/35: dwrite f7 [4194304,4194304] 0 2024-03-12T16:10:31.580 INFO:tasks.workunit.client.1.smithi134.stdout:3/77: fsync d1/db/d12/f13 0 2024-03-12T16:10:31.581 INFO:tasks.workunit.client.1.smithi134.stdout:5/63: mkdir db/d13 0 2024-03-12T16:10:31.581 INFO:tasks.workunit.client.1.smithi134.stdout:3/78: readlink d1/db/d10/l1d 0 2024-03-12T16:10:31.584 INFO:tasks.workunit.client.1.smithi134.stdout:8/42: truncate d3/d9/fa 1419620 0 2024-03-12T16:10:31.585 INFO:tasks.workunit.client.1.smithi134.stdout:4/99: unlink d1/f3 0 2024-03-12T16:10:31.586 INFO:tasks.workunit.client.1.smithi134.stdout:6/83: creat d1/d3/d10/f25 x:0 0 0 2024-03-12T16:10:31.587 INFO:tasks.workunit.client.1.smithi134.stdout:0/36: mkdir db 0 2024-03-12T16:10:31.588 INFO:tasks.workunit.client.1.smithi134.stdout:0/37: fsync fa 0 2024-03-12T16:10:31.589 INFO:tasks.workunit.client.1.smithi134.stdout:0/38: write f7 [395608,115540] 0 2024-03-12T16:10:31.589 INFO:tasks.workunit.client.1.smithi134.stdout:5/64: mknod db/c14 0 2024-03-12T16:10:31.590 INFO:tasks.workunit.client.1.smithi134.stdout:5/65: chown f3 0 1 2024-03-12T16:10:31.590 INFO:tasks.workunit.client.1.smithi134.stdout:3/79: fdatasync d1/db/d12/f13 0 2024-03-12T16:10:31.591 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:30.265423+0000 mgr.smithi134.gcntfu (mgr.24383) 50 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:31.591 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:30.779914+0000 mgr.smithi134.gcntfu (mgr.24383) 51 : audit [DBG] from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:31.591 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:31.285757+0000 mon.smithi006 (mon.0) 710 : audit [DBG] from='client.? 172.21.15.6:0/2397350690' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:10:31.592 INFO:tasks.workunit.client.1.smithi134.stdout:1/22: fdatasync d0/f4 0 2024-03-12T16:10:31.592 INFO:tasks.workunit.client.1.smithi134.stdout:5/66: chown db/f10 614077137 1 2024-03-12T16:10:31.599 INFO:tasks.workunit.client.1.smithi134.stdout:7/21: truncate f6 359862 0 2024-03-12T16:10:31.601 INFO:tasks.workunit.client.1.smithi134.stdout:3/80: rename d1/f9 to d1/db/d14/f23 0 2024-03-12T16:10:31.604 INFO:tasks.workunit.client.1.smithi134.stdout:0/39: creat db/fc x:0 0 0 2024-03-12T16:10:31.605 INFO:tasks.workunit.client.1.smithi134.stdout:0/40: chown c8 445 1 2024-03-12T16:10:31.605 INFO:tasks.workunit.client.1.smithi134.stdout:0/41: chown fa 167590 1 2024-03-12T16:10:31.606 INFO:tasks.workunit.client.1.smithi134.stdout:8/43: write d3/f6 [2783725,32005] 0 2024-03-12T16:10:31.607 INFO:tasks.workunit.client.1.smithi134.stdout:8/44: write d3/d9/fa [541423,7528] 0 2024-03-12T16:10:31.607 INFO:tasks.workunit.client.1.smithi134.stdout:4/100: rename d1/de/f1f to d1/de/f25 0 2024-03-12T16:10:31.609 INFO:tasks.workunit.client.1.smithi134.stdout:3/81: dread - d1/db/d12/f1e zero size 2024-03-12T16:10:31.610 INFO:tasks.workunit.client.1.smithi134.stdout:3/82: chown d1/c8 55 1 2024-03-12T16:10:31.611 INFO:tasks.workunit.client.1.smithi134.stdout:6/84: creat d1/f26 x:0 0 0 2024-03-12T16:10:31.615 INFO:tasks.workunit.client.1.smithi134.stdout:7/22: write f6 [1159098,84061] 0 2024-03-12T16:10:31.615 INFO:tasks.workunit.client.1.smithi134.stdout:2/23: sync 2024-03-12T16:10:31.617 INFO:tasks.workunit.client.1.smithi134.stdout:7/23: write f6 [39561,57545] 0 2024-03-12T16:10:31.617 INFO:tasks.workunit.client.1.smithi134.stdout:8/45: dwrite d3/d9/fa [0,4194304] 0 2024-03-12T16:10:31.620 INFO:tasks.workunit.client.1.smithi134.stdout:5/67: truncate f6 3660800 0 2024-03-12T16:10:31.622 INFO:tasks.workunit.client.1.smithi134.stdout:3/83: creat d1/db/f24 x:0 0 0 2024-03-12T16:10:31.623 INFO:tasks.workunit.client.1.smithi134.stdout:6/85: mknod d1/d3/d19/c27 0 2024-03-12T16:10:31.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/42: unlink l9 0 2024-03-12T16:10:31.625 INFO:tasks.workunit.client.1.smithi134.stdout:6/86: readlink d1/d3/d10/l13 0 2024-03-12T16:10:31.626 INFO:tasks.workunit.client.1.smithi134.stdout:1/23: truncate d0/f3 222059 0 2024-03-12T16:10:31.628 INFO:tasks.workunit.client.1.smithi134.stdout:8/46: dwrite d3/f8 [0,4194304] 0 2024-03-12T16:10:31.629 INFO:tasks.workunit.client.1.smithi134.stdout:2/24: rename l1 to d4/l6 0 2024-03-12T16:10:31.632 INFO:tasks.workunit.client.1.smithi134.stdout:7/24: mknod c7 0 2024-03-12T16:10:31.641 INFO:tasks.workunit.client.1.smithi134.stdout:0/43: creat db/fd x:0 0 0 2024-03-12T16:10:31.641 INFO:tasks.workunit.client.1.smithi134.stdout:8/47: dwrite d3/f8 [0,4194304] 0 2024-03-12T16:10:31.642 INFO:tasks.workunit.client.1.smithi134.stdout:7/25: dread f6 [0,4194304] 0 2024-03-12T16:10:31.643 INFO:tasks.workunit.client.1.smithi134.stdout:7/26: fdatasync f6 0 2024-03-12T16:10:31.650 INFO:tasks.workunit.client.1.smithi134.stdout:0/44: dwrite f7 [4194304,4194304] 0 2024-03-12T16:10:31.651 INFO:tasks.workunit.client.1.smithi134.stdout:0/45: write fa [718259,94393] 0 2024-03-12T16:10:31.653 INFO:tasks.workunit.client.1.smithi134.stdout:7/27: mkdir d8 0 2024-03-12T16:10:31.654 INFO:tasks.workunit.client.1.smithi134.stdout:5/68: write db/f11 [521597,3412] 0 2024-03-12T16:10:31.661 INFO:tasks.workunit.client.1.smithi134.stdout:1/24: rename d0/f3 to d0/d6/f7 0 2024-03-12T16:10:31.663 INFO:tasks.workunit.client.1.smithi134.stdout:0/46: creat db/fe x:0 0 0 2024-03-12T16:10:31.663 INFO:tasks.workunit.client.1.smithi134.stdout:3/84: dwrite d1/db/d12/f1e [0,4194304] 0 2024-03-12T16:10:31.666 INFO:tasks.workunit.client.1.smithi134.stdout:8/48: creat d3/fc x:0 0 0 2024-03-12T16:10:31.670 INFO:tasks.workunit.client.1.smithi134.stdout:0/47: truncate db/fc 964443 0 2024-03-12T16:10:31.671 INFO:tasks.workunit.client.1.smithi134.stdout:4/101: write d1/d13/f1d [4127739,114184] 0 2024-03-12T16:10:31.671 INFO:tasks.workunit.client.1.smithi134.stdout:5/69: symlink db/d12/l15 0 2024-03-12T16:10:31.672 INFO:tasks.workunit.client.1.smithi134.stdout:6/87: dwrite d1/d4/f21 [0,4194304] 0 2024-03-12T16:10:31.674 INFO:tasks.workunit.client.1.smithi134.stdout:7/28: dread f6 [0,4194304] 0 2024-03-12T16:10:31.675 INFO:tasks.workunit.client.1.smithi134.stdout:3/85: creat d1/db/d14/f25 x:0 0 0 2024-03-12T16:10:31.675 INFO:tasks.workunit.client.1.smithi134.stdout:0/48: read fa [108828,16801] 0 2024-03-12T16:10:31.678 INFO:tasks.workunit.client.1.smithi134.stdout:6/88: rmdir d1/d4 39 2024-03-12T16:10:31.685 INFO:tasks.workunit.client.1.smithi134.stdout:3/86: unlink d1/db/l16 0 2024-03-12T16:10:31.685 INFO:tasks.workunit.client.1.smithi134.stdout:5/70: dread db/f10 [0,4194304] 0 2024-03-12T16:10:31.685 INFO:tasks.workunit.client.1.smithi134.stdout:0/49: dread fa [0,4194304] 0 2024-03-12T16:10:31.686 INFO:tasks.workunit.client.1.smithi134.stdout:5/71: symlink db/l16 2 2024-03-12T16:10:31.687 INFO:tasks.workunit.client.1.smithi134.stdout:7/29: rename c7 to d8/c9 0 2024-03-12T16:10:31.688 INFO:tasks.workunit.client.1.smithi134.stdout:6/89: mknod d1/d16/c28 0 2024-03-12T16:10:31.693 INFO:tasks.workunit.client.1.smithi134.stdout:1/25: read d0/d6/f7 [183963,73392] 0 2024-03-12T16:10:31.693 INFO:tasks.workunit.client.1.smithi134.stdout:3/87: unlink d1/db/f19 0 2024-03-12T16:10:31.694 INFO:tasks.workunit.client.1.smithi134.stdout:5/72: fsync db/f10 0 2024-03-12T16:10:31.696 INFO:tasks.workunit.client.1.smithi134.stdout:3/88: chown d1/f4 199839999 1 2024-03-12T16:10:31.696 INFO:tasks.workunit.client.1.smithi134.stdout:0/50: dwrite db/fc [0,4194304] 0 2024-03-12T16:10:31.697 INFO:tasks.workunit.client.1.smithi134.stdout:8/49: getdents d3/d9 0 2024-03-12T16:10:31.701 INFO:tasks.workunit.client.1.smithi134.stdout:4/102: creat d1/d13/f26 x:0 0 0 2024-03-12T16:10:31.702 INFO:tasks.workunit.client.1.smithi134.stdout:4/103: chown d1/d13 854845768 1 2024-03-12T16:10:31.702 INFO:tasks.workunit.client.1.smithi134.stdout:3/89: dread d1/db/d12/f13 [0,4194304] 0 2024-03-12T16:10:31.704 INFO:tasks.workunit.client.1.smithi134.stdout:6/90: rename d1/d16/c24 to d1/d3/c29 0 2024-03-12T16:10:31.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.703+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5cf4059120 con 0x7f5cdc066dc0 2024-03-12T16:10:31.706 INFO:tasks.workunit.client.1.smithi134.stdout:1/26: creat d0/d6/f8 x:0 0 0 2024-03-12T16:10:31.706 INFO:tasks.workunit.client.1.smithi134.stdout:1/27: stat d0 0 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.705+0000 7f5ce37fe700 1 -- 172.21.15.6:0/2992928814 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f5cf4059120 con 0x7f5cdc066dc0 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [], 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "1/2 daemons upgraded", 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:10:31.707 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:10:31.708 INFO:tasks.workunit.client.1.smithi134.stdout:7/30: unlink c4 0 2024-03-12T16:10:31.708 INFO:tasks.workunit.client.1.smithi134.stdout:0/51: mknod db/cf 0 2024-03-12T16:10:31.708 INFO:tasks.workunit.client.1.smithi134.stdout:1/28: dread d0/f4 [0,4194304] 0 2024-03-12T16:10:31.709 INFO:tasks.workunit.client.1.smithi134.stdout:0/52: read - db/fe zero size 2024-03-12T16:10:31.710 INFO:tasks.workunit.client.1.smithi134.stdout:8/50: creat d3/d9/fd x:0 0 0 2024-03-12T16:10:31.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f5cdc066dc0 msgr2=0x7f5cdc069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:31.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f5cdc066dc0 0x7f5cdc069280 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f5ce8004dc0 tx=0x7f5ce800b040).stop 2024-03-12T16:10:31.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 msgr2=0x7f5cf4061650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:10:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 0x7f5cf4061650 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f5ce4005010 tx=0x7f5ce4009cb0).stop 2024-03-12T16:10:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 shutdown_connections 2024-03-12T16:10:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f5cdc066dc0 0x7f5cdc069280 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5cf40f66d0 0x7f5cf4061650 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 --2- 172.21.15.6:0/2992928814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5cf40f6fe0 0x7f5cf410ce20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:10:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 >> 172.21.15.6:0/2992928814 conn(0x7f5cf40f1eb0 msgr2=0x7f5cf40fb460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:10:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 shutdown_connections 2024-03-12T16:10:31.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:10:31.708+0000 7f5cf8bab700 1 -- 172.21.15.6:0/2992928814 wait complete. 2024-03-12T16:10:31.712 INFO:tasks.workunit.client.1.smithi134.stdout:3/90: creat d1/db/d12/f26 x:0 0 0 2024-03-12T16:10:31.712 INFO:tasks.workunit.client.1.smithi134.stdout:3/91: stat d1/db/d10 0 2024-03-12T16:10:31.712 INFO:tasks.workunit.client.1.smithi134.stdout:3/92: chown d1/db/d12 37007 1 2024-03-12T16:10:31.713 INFO:tasks.workunit.client.1.smithi134.stdout:5/73: rename l8 to db/d12/l17 0 2024-03-12T16:10:31.714 INFO:tasks.workunit.client.1.smithi134.stdout:6/91: creat d1/d3/d10/f2a x:0 0 0 2024-03-12T16:10:31.715 INFO:tasks.workunit.client.1.smithi134.stdout:7/31: symlink d8/la 0 2024-03-12T16:10:31.717 INFO:tasks.workunit.client.1.smithi134.stdout:0/53: creat db/f10 x:0 0 0 2024-03-12T16:10:31.719 INFO:tasks.workunit.client.1.smithi134.stdout:0/54: write db/fc [5191484,46732] 0 2024-03-12T16:10:31.722 INFO:tasks.workunit.client.1.smithi134.stdout:3/93: dread d1/f2 [0,4194304] 0 2024-03-12T16:10:31.722 INFO:tasks.workunit.client.1.smithi134.stdout:4/104: rename d1/d13/d18/d1c/l1e to d1/d13/d18/l27 0 2024-03-12T16:10:31.724 INFO:tasks.workunit.client.1.smithi134.stdout:7/32: creat d8/fb x:0 0 0 2024-03-12T16:10:31.725 INFO:tasks.workunit.client.1.smithi134.stdout:7/33: truncate d8/fb 997688 0 2024-03-12T16:10:31.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/34: read d8/fb [89410,44347] 0 2024-03-12T16:10:31.732 INFO:tasks.workunit.client.1.smithi134.stdout:3/94: unlink d1/db/d14/c1c 0 2024-03-12T16:10:31.733 INFO:tasks.workunit.client.1.smithi134.stdout:6/92: fdatasync d1/d4/f14 0 2024-03-12T16:10:31.733 INFO:tasks.workunit.client.1.smithi134.stdout:3/95: chown d1/f2 91 1 2024-03-12T16:10:31.735 INFO:tasks.workunit.client.1.smithi134.stdout:8/51: link d3/d9/fd d3/fe 0 2024-03-12T16:10:31.737 INFO:tasks.workunit.client.1.smithi134.stdout:1/29: dwrite d0/d6/f7 [0,4194304] 0 2024-03-12T16:10:31.738 INFO:tasks.workunit.client.1.smithi134.stdout:5/74: write f6 [2097927,104202] 0 2024-03-12T16:10:31.739 INFO:tasks.workunit.client.1.smithi134.stdout:4/105: write d1/d24/f19 [1143842,27606] 0 2024-03-12T16:10:31.740 INFO:tasks.workunit.client.1.smithi134.stdout:5/75: stat db/f10 0 2024-03-12T16:10:31.743 INFO:tasks.workunit.client.1.smithi134.stdout:6/93: rmdir d1/d3/d10 39 2024-03-12T16:10:31.745 INFO:tasks.workunit.client.1.smithi134.stdout:3/96: creat d1/db/d12/f27 x:0 0 0 2024-03-12T16:10:31.747 INFO:tasks.workunit.client.1.smithi134.stdout:8/52: symlink d3/d9/lf 0 2024-03-12T16:10:31.747 INFO:tasks.workunit.client.1.smithi134.stdout:3/97: chown d1/db/f24 169747 1 2024-03-12T16:10:31.749 INFO:tasks.workunit.client.1.smithi134.stdout:7/35: dwrite f6 [0,4194304] 0 2024-03-12T16:10:31.754 INFO:tasks.workunit.client.1.smithi134.stdout:6/94: creat d1/d4/f2b x:0 0 0 2024-03-12T16:10:31.755 INFO:tasks.workunit.client.1.smithi134.stdout:0/55: truncate fa 64618 0 2024-03-12T16:10:31.758 INFO:tasks.workunit.client.1.smithi134.stdout:7/36: mkdir d8/dc 0 2024-03-12T16:10:31.758 INFO:tasks.workunit.client.1.smithi134.stdout:6/95: chown d1/d3/d19/f1f 833010 1 2024-03-12T16:10:31.759 INFO:tasks.workunit.client.1.smithi134.stdout:7/37: stat d8 0 2024-03-12T16:10:31.761 INFO:tasks.workunit.client.1.smithi134.stdout:3/98: dwrite d1/db/f24 [0,4194304] 0 2024-03-12T16:10:31.764 INFO:tasks.workunit.client.1.smithi134.stdout:4/106: write d1/f23 [535896,51564] 0 2024-03-12T16:10:31.769 INFO:tasks.workunit.client.1.smithi134.stdout:0/56: dread db/fc [0,4194304] 0 2024-03-12T16:10:31.771 INFO:tasks.workunit.client.1.smithi134.stdout:8/53: mkdir d3/d10 0 2024-03-12T16:10:31.771 INFO:tasks.workunit.client.1.smithi134.stdout:5/76: link c1 db/c18 0 2024-03-12T16:10:31.772 INFO:tasks.workunit.client.1.smithi134.stdout:6/96: dread - d1/d4/f1b zero size 2024-03-12T16:10:31.772 INFO:tasks.workunit.client.1.smithi134.stdout:0/57: write db/fd [173820,124138] 0 2024-03-12T16:10:31.777 INFO:tasks.workunit.client.1.smithi134.stdout:8/54: rmdir d3/d9 39 2024-03-12T16:10:31.778 INFO:tasks.workunit.client.1.smithi134.stdout:7/38: dwrite f6 [0,4194304] 0 2024-03-12T16:10:31.778 INFO:tasks.workunit.client.1.smithi134.stdout:7/39: readlink d8/la 0 2024-03-12T16:10:31.778 INFO:tasks.workunit.client.1.smithi134.stdout:8/55: write d3/f6 [2341107,24643] 0 2024-03-12T16:10:31.779 INFO:tasks.workunit.client.1.smithi134.stdout:7/40: stat f6 0 2024-03-12T16:10:31.779 INFO:tasks.workunit.client.1.smithi134.stdout:4/107: mkdir d1/d13/d18/d28 0 2024-03-12T16:10:31.780 INFO:tasks.workunit.client.1.smithi134.stdout:0/58: creat db/f11 x:0 0 0 2024-03-12T16:10:31.781 INFO:tasks.workunit.client.1.smithi134.stdout:7/41: creat d8/fd x:0 0 0 2024-03-12T16:10:31.785 INFO:tasks.workunit.client.1.smithi134.stdout:3/99: getdents d1/db/d14 0 2024-03-12T16:10:31.785 INFO:tasks.workunit.client.1.smithi134.stdout:5/77: creat db/d13/f19 x:0 0 0 2024-03-12T16:10:31.786 INFO:tasks.workunit.client.1.smithi134.stdout:7/42: write f6 [580126,49972] 0 2024-03-12T16:10:31.786 INFO:tasks.workunit.client.1.smithi134.stdout:9/51: sync 2024-03-12T16:10:31.787 INFO:tasks.workunit.client.1.smithi134.stdout:4/108: stat d1/d13/d18/l27 0 2024-03-12T16:10:31.787 INFO:tasks.workunit.client.1.smithi134.stdout:9/52: stat d5 0 2024-03-12T16:10:31.787 INFO:tasks.workunit.client.1.smithi134.stdout:9/53: readlink - no filename 2024-03-12T16:10:31.792 INFO:tasks.workunit.client.1.smithi134.stdout:0/59: unlink db/fd 0 2024-03-12T16:10:31.792 INFO:tasks.workunit.client.1.smithi134.stdout:1/30: truncate d0/d6/f7 3613968 0 2024-03-12T16:10:31.792 INFO:tasks.workunit.client.1.smithi134.stdout:6/97: dwrite d1/d3/d10/f2a [0,4194304] 0 2024-03-12T16:10:31.794 INFO:tasks.workunit.client.1.smithi134.stdout:8/56: symlink d3/d10/l11 0 2024-03-12T16:10:31.794 INFO:tasks.workunit.client.1.smithi134.stdout:6/98: chown d1/d3/d19 0 1 2024-03-12T16:10:31.798 INFO:tasks.workunit.client.1.smithi134.stdout:5/78: symlink db/l1a 0 2024-03-12T16:10:31.802 INFO:tasks.workunit.client.1.smithi134.stdout:5/79: dread f6 [0,4194304] 0 2024-03-12T16:10:31.806 INFO:tasks.workunit.client.1.smithi134.stdout:0/60: rename l5 to db/l12 0 2024-03-12T16:10:31.806 INFO:tasks.workunit.client.1.smithi134.stdout:4/109: dread d1/f23 [0,4194304] 0 2024-03-12T16:10:31.806 INFO:tasks.workunit.client.1.smithi134.stdout:1/31: mkdir d0/d6/d9 0 2024-03-12T16:10:31.808 INFO:tasks.workunit.client.1.smithi134.stdout:7/43: symlink d8/dc/le 0 2024-03-12T16:10:31.809 INFO:tasks.workunit.client.1.smithi134.stdout:5/80: symlink db/l1b 0 2024-03-12T16:10:31.813 INFO:tasks.workunit.client.1.smithi134.stdout:8/57: mknod d3/c12 0 2024-03-12T16:10:31.813 INFO:tasks.workunit.client.1.smithi134.stdout:6/99: mknod d1/c2c 0 2024-03-12T16:10:31.814 INFO:tasks.workunit.client.1.smithi134.stdout:5/81: dread db/f11 [0,4194304] 0 2024-03-12T16:10:31.814 INFO:tasks.workunit.client.1.smithi134.stdout:2/25: sync 2024-03-12T16:10:31.815 INFO:tasks.workunit.client.1.smithi134.stdout:4/110: chown d1/d13/f1a 102 1 2024-03-12T16:10:31.818 INFO:tasks.workunit.client.1.smithi134.stdout:3/100: write d1/fc [1054490,112188] 0 2024-03-12T16:10:31.821 INFO:tasks.workunit.client.1.smithi134.stdout:6/100: mknod d1/d4/c2d 0 2024-03-12T16:10:31.823 INFO:tasks.workunit.client.1.smithi134.stdout:5/82: read f6 [3551981,31275] 0 2024-03-12T16:10:31.824 INFO:tasks.workunit.client.1.smithi134.stdout:9/54: write f3 [2489009,109352] 0 2024-03-12T16:10:31.825 INFO:tasks.workunit.client.1.smithi134.stdout:2/26: mknod d4/c7 0 2024-03-12T16:10:31.825 INFO:tasks.workunit.client.1.smithi134.stdout:2/27: read f0 [1002350,95931] 0 2024-03-12T16:10:31.827 INFO:tasks.workunit.client.1.smithi134.stdout:3/101: creat d1/db/d10/f28 x:0 0 0 2024-03-12T16:10:31.830 INFO:tasks.workunit.client.1.smithi134.stdout:6/101: rename d1/d3/d10/f25 to d1/d16/f2e 0 2024-03-12T16:10:31.831 INFO:tasks.workunit.client.1.smithi134.stdout:1/32: link d0/c5 d0/d6/ca 0 2024-03-12T16:10:31.832 INFO:tasks.workunit.client.1.smithi134.stdout:4/111: truncate d1/d13/f1b 4486126 0 2024-03-12T16:10:31.891 INFO:tasks.workunit.client.1.smithi134.stdout:6/102: chown d1/d4/f21 20149883 1 2024-03-12T16:10:31.892 INFO:tasks.workunit.client.1.smithi134.stdout:9/55: creat d5/fa x:0 0 0 2024-03-12T16:10:31.894 INFO:tasks.workunit.client.1.smithi134.stdout:4/112: chown d1/f23 15778 1 2024-03-12T16:10:31.894 INFO:tasks.workunit.client.1.smithi134.stdout:2/28: rename f0 to d4/f8 0 2024-03-12T16:10:31.895 INFO:tasks.workunit.client.1.smithi134.stdout:3/102: dwrite d1/db/d12/f27 [0,4194304] 0 2024-03-12T16:10:31.898 INFO:tasks.workunit.client.1.smithi134.stdout:0/61: write fa [901562,30812] 0 2024-03-12T16:10:31.898 INFO:tasks.workunit.client.1.smithi134.stdout:2/29: stat c2 0 2024-03-12T16:10:31.899 INFO:tasks.workunit.client.1.smithi134.stdout:3/103: chown d1/db/ld 508 1 2024-03-12T16:10:31.903 INFO:tasks.workunit.client.1.smithi134.stdout:8/58: getdents d3/d9 0 2024-03-12T16:10:31.903 INFO:tasks.workunit.client.1.smithi134.stdout:6/103: mknod d1/c2f 0 2024-03-12T16:10:31.904 INFO:tasks.workunit.client.1.smithi134.stdout:9/56: write d5/f7 [75404,97576] 0 2024-03-12T16:10:31.909 INFO:tasks.workunit.client.1.smithi134.stdout:3/104: chown d1/db/d12/f26 1 1 2024-03-12T16:10:31.909 INFO:tasks.workunit.client.1.smithi134.stdout:7/44: dwrite d8/fb [0,4194304] 0 2024-03-12T16:10:31.909 INFO:tasks.workunit.client.1.smithi134.stdout:4/113: getdents d1/d13 0 2024-03-12T16:10:31.913 INFO:tasks.workunit.client.1.smithi134.stdout:8/59: mkdir d3/d13 0 2024-03-12T16:10:31.913 INFO:tasks.workunit.client.1.smithi134.stdout:6/104: read - d1/d4/f1c zero size 2024-03-12T16:10:31.914 INFO:tasks.workunit.client.1.smithi134.stdout:2/30: getdents d4 0 2024-03-12T16:10:31.918 INFO:tasks.workunit.client.1.smithi134.stdout:1/33: truncate d0/d6/f7 3270531 0 2024-03-12T16:10:31.921 INFO:tasks.workunit.client.1.smithi134.stdout:0/62: dwrite fa [0,4194304] 0 2024-03-12T16:10:31.921 INFO:tasks.workunit.client.1.smithi134.stdout:7/45: creat d8/ff x:0 0 0 2024-03-12T16:10:31.922 INFO:tasks.workunit.client.1.smithi134.stdout:6/105: chown d1/d3/f17 16204 1 2024-03-12T16:10:31.924 INFO:tasks.workunit.client.1.smithi134.stdout:3/105: creat d1/db/d14/f29 x:0 0 0 2024-03-12T16:10:31.926 INFO:tasks.workunit.client.1.smithi134.stdout:8/60: creat d3/d9/f14 x:0 0 0 2024-03-12T16:10:31.928 INFO:tasks.workunit.client.1.smithi134.stdout:7/46: mknod d8/dc/c10 0 2024-03-12T16:10:31.929 INFO:tasks.workunit.client.1.smithi134.stdout:0/63: rename db/cf to db/c13 0 2024-03-12T16:10:31.930 INFO:tasks.workunit.client.1.smithi134.stdout:8/61: dread - d3/fc zero size 2024-03-12T16:10:31.932 INFO:tasks.workunit.client.1.smithi134.stdout:1/34: chown d0/c5 40195040 1 2024-03-12T16:10:31.933 INFO:tasks.workunit.client.1.smithi134.stdout:6/106: creat d1/d3/d19/f30 x:0 0 0 2024-03-12T16:10:31.937 INFO:tasks.workunit.client.1.smithi134.stdout:3/106: mkdir d1/db/d10/d2a 0 2024-03-12T16:10:31.938 INFO:tasks.workunit.client.1.smithi134.stdout:7/47: mkdir d8/d11 0 2024-03-12T16:10:31.939 INFO:tasks.workunit.client.1.smithi134.stdout:9/57: dwrite d5/fa [0,4194304] 0 2024-03-12T16:10:31.940 INFO:tasks.workunit.client.1.smithi134.stdout:4/114: dwrite d1/f23 [0,4194304] 0 2024-03-12T16:10:31.943 INFO:tasks.workunit.client.1.smithi134.stdout:7/48: fsync d8/ff 0 2024-03-12T16:10:31.943 INFO:tasks.workunit.client.1.smithi134.stdout:3/107: chown d1/db/d10/f21 6615813 1 2024-03-12T16:10:31.948 INFO:tasks.workunit.client.1.smithi134.stdout:2/31: truncate d4/f8 1297392 0 2024-03-12T16:10:31.949 INFO:tasks.workunit.client.1.smithi134.stdout:2/32: stat c3 0 2024-03-12T16:10:31.950 INFO:tasks.workunit.client.1.smithi134.stdout:0/64: link db/f11 db/f14 0 2024-03-12T16:10:31.951 INFO:tasks.workunit.client.1.smithi134.stdout:3/108: creat d1/db/d14/f2b x:0 0 0 2024-03-12T16:10:31.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:30.265423+0000 mgr.smithi134.gcntfu (mgr.24383) 50 : audit [DBG] from='client.14610 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:31.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:30.779914+0000 mgr.smithi134.gcntfu (mgr.24383) 51 : audit [DBG] from='client.24441 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:31.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:31.285757+0000 mon.smithi006 (mon.0) 710 : audit [DBG] from='client.? 172.21.15.6:0/2397350690' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:10:31.954 INFO:tasks.workunit.client.1.smithi134.stdout:6/107: creat d1/f31 x:0 0 0 2024-03-12T16:10:31.957 INFO:tasks.workunit.client.1.smithi134.stdout:1/35: dwrite d0/d6/f8 [0,4194304] 0 2024-03-12T16:10:31.957 INFO:tasks.workunit.client.1.smithi134.stdout:8/62: getdents d3/d10 0 2024-03-12T16:10:31.958 INFO:tasks.workunit.client.1.smithi134.stdout:6/108: read d1/d4/f20 [3102889,5621] 0 2024-03-12T16:10:31.958 INFO:tasks.workunit.client.1.smithi134.stdout:4/115: rmdir d1/d13/d18/d20 0 2024-03-12T16:10:31.959 INFO:tasks.workunit.client.1.smithi134.stdout:3/109: read d1/f4 [299039,58358] 0 2024-03-12T16:10:31.960 INFO:tasks.workunit.client.1.smithi134.stdout:0/65: write db/f11 [618046,2838] 0 2024-03-12T16:10:31.961 INFO:tasks.workunit.client.1.smithi134.stdout:4/116: chown d1/d13/f1d 1 1 2024-03-12T16:10:31.963 INFO:tasks.workunit.client.1.smithi134.stdout:7/49: getdents d8 0 2024-03-12T16:10:31.963 INFO:tasks.workunit.client.1.smithi134.stdout:8/63: mkdir d3/d13/d15 0 2024-03-12T16:10:31.965 INFO:tasks.workunit.client.1.smithi134.stdout:0/66: creat db/f15 x:0 0 0 2024-03-12T16:10:31.971 INFO:tasks.workunit.client.1.smithi134.stdout:6/109: read d1/f1d [29369,85056] 0 2024-03-12T16:10:31.971 INFO:tasks.workunit.client.1.smithi134.stdout:1/36: symlink d0/d6/d9/lb 0 2024-03-12T16:10:31.977 INFO:tasks.workunit.client.1.smithi134.stdout:7/50: getdents d8/d11 0 2024-03-12T16:10:31.977 INFO:tasks.workunit.client.1.smithi134.stdout:8/64: rename d3/d9/fd to d3/d10/f16 0 2024-03-12T16:10:31.980 INFO:tasks.workunit.client.1.smithi134.stdout:1/37: symlink d0/d6/d9/lc 0 2024-03-12T16:10:31.987 INFO:tasks.workunit.client.1.smithi134.stdout:8/65: mkdir d3/d9/d17 0 2024-03-12T16:10:31.988 INFO:tasks.workunit.client.1.smithi134.stdout:6/110: write d1/d4/fe [2301822,74004] 0 2024-03-12T16:10:31.990 INFO:tasks.workunit.client.1.smithi134.stdout:3/110: dwrite d1/db/d14/f2b [0,4194304] 0 2024-03-12T16:10:31.996 INFO:tasks.workunit.client.1.smithi134.stdout:4/117: rename d1/de/f11 to d1/d13/d18/d1c/f29 0 2024-03-12T16:10:31.999 INFO:tasks.workunit.client.1.smithi134.stdout:3/111: symlink d1/db/d12/l2c 0 2024-03-12T16:10:32.001 INFO:tasks.workunit.client.1.smithi134.stdout:4/118: chown d1/de 60368 1 2024-03-12T16:10:32.002 INFO:tasks.workunit.client.1.smithi134.stdout:1/38: fdatasync d0/d6/f7 0 2024-03-12T16:10:32.002 INFO:tasks.workunit.client.1.smithi134.stdout:9/58: dwrite f0 [8388608,4194304] 0 2024-03-12T16:10:32.005 INFO:tasks.workunit.client.1.smithi134.stdout:0/67: dwrite db/f11 [0,4194304] 0 2024-03-12T16:10:32.006 INFO:tasks.workunit.client.1.smithi134.stdout:3/112: mkdir d1/db/d10/d2d 0 2024-03-12T16:10:32.006 INFO:tasks.workunit.client.1.smithi134.stdout:2/33: dwrite d4/f5 [0,4194304] 0 2024-03-12T16:10:32.010 INFO:tasks.workunit.client.1.smithi134.stdout:8/66: mknod d3/c18 0 2024-03-12T16:10:32.022 INFO:tasks.workunit.client.1.smithi134.stdout:7/51: truncate d8/fb 2676048 0 2024-03-12T16:10:32.023 INFO:tasks.workunit.client.1.smithi134.stdout:2/34: getdents d4 0 2024-03-12T16:10:32.029 INFO:tasks.workunit.client.1.smithi134.stdout:1/39: link d0/d6/f8 d0/fd 0 2024-03-12T16:10:32.029 INFO:tasks.workunit.client.1.smithi134.stdout:3/113: dwrite d1/db/f24 [0,4194304] 0 2024-03-12T16:10:32.029 INFO:tasks.workunit.client.1.smithi134.stdout:8/67: link d3/d9/f14 d3/d9/f19 0 2024-03-12T16:10:32.029 INFO:tasks.workunit.client.1.smithi134.stdout:7/52: symlink d8/dc/l12 0 2024-03-12T16:10:32.029 INFO:tasks.workunit.client.1.smithi134.stdout:6/111: dwrite d1/f5 [0,4194304] 0 2024-03-12T16:10:32.032 INFO:tasks.workunit.client.1.smithi134.stdout:0/68: dwrite f7 [0,4194304] 0 2024-03-12T16:10:32.035 INFO:tasks.workunit.client.1.smithi134.stdout:1/40: rmdir d0/d6/d9 39 2024-03-12T16:10:32.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/68: chown d3/d9/f14 8 1 2024-03-12T16:10:32.041 INFO:tasks.workunit.client.1.smithi134.stdout:0/69: truncate db/f10 141693 0 2024-03-12T16:10:32.042 INFO:tasks.workunit.client.1.smithi134.stdout:8/69: unlink d3/c12 0 2024-03-12T16:10:32.046 INFO:tasks.workunit.client.1.smithi134.stdout:0/70: fdatasync db/f10 0 2024-03-12T16:10:32.047 INFO:tasks.workunit.client.1.smithi134.stdout:4/119: write d1/d13/f1b [5205286,1105] 0 2024-03-12T16:10:32.049 INFO:tasks.workunit.client.1.smithi134.stdout:0/71: stat f7 0 2024-03-12T16:10:32.050 INFO:tasks.workunit.client.1.smithi134.stdout:7/53: dwrite d8/ff [0,4194304] 0 2024-03-12T16:10:32.052 INFO:tasks.workunit.client.1.smithi134.stdout:5/83: sync 2024-03-12T16:10:32.053 INFO:tasks.workunit.client.1.smithi134.stdout:0/72: fdatasync fa 0 2024-03-12T16:10:32.056 INFO:tasks.workunit.client.1.smithi134.stdout:8/70: creat d3/d9/d17/f1a x:0 0 0 2024-03-12T16:10:32.060 INFO:tasks.workunit.client.1.smithi134.stdout:0/73: mknod db/c16 0 2024-03-12T16:10:32.061 INFO:tasks.workunit.client.1.smithi134.stdout:6/112: dwrite d1/d16/f2e [0,4194304] 0 2024-03-12T16:10:32.064 INFO:tasks.workunit.client.1.smithi134.stdout:4/120: mkdir d1/de/d2a 0 2024-03-12T16:10:32.064 INFO:tasks.workunit.client.1.smithi134.stdout:8/71: dread - d3/d9/d17/f1a zero size 2024-03-12T16:10:32.065 INFO:tasks.workunit.client.1.smithi134.stdout:0/74: read db/fc [4894025,121345] 0 2024-03-12T16:10:32.065 INFO:tasks.workunit.client.1.smithi134.stdout:5/84: rename db/d12/l15 to db/l1c 0 2024-03-12T16:10:32.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/114: dwrite d1/db/d12/f1e [4194304,4194304] 0 2024-03-12T16:10:32.071 INFO:tasks.workunit.client.1.smithi134.stdout:2/35: truncate d4/f5 2275346 0 2024-03-12T16:10:32.074 INFO:tasks.workunit.client.1.smithi134.stdout:4/121: truncate d1/d13/f1a 2828088 0 2024-03-12T16:10:32.074 INFO:tasks.workunit.client.1.smithi134.stdout:5/85: truncate db/f10 1652305 0 2024-03-12T16:10:32.075 INFO:tasks.workunit.client.1.smithi134.stdout:6/113: mkdir d1/d3/d19/d32 0 2024-03-12T16:10:32.078 INFO:tasks.workunit.client.1.smithi134.stdout:4/122: write d1/d13/f1d [2189670,23799] 0 2024-03-12T16:10:32.083 INFO:tasks.workunit.client.1.smithi134.stdout:2/36: rename c2 to d4/c9 0 2024-03-12T16:10:32.085 INFO:tasks.workunit.client.1.smithi134.stdout:7/54: getdents d8 0 2024-03-12T16:10:32.085 INFO:tasks.workunit.client.1.smithi134.stdout:1/41: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:32.087 INFO:tasks.workunit.client.1.smithi134.stdout:6/114: dread d1/d16/f2e [0,4194304] 0 2024-03-12T16:10:32.088 INFO:tasks.workunit.client.1.smithi134.stdout:6/115: dread - d1/f31 zero size 2024-03-12T16:10:32.089 INFO:tasks.workunit.client.1.smithi134.stdout:3/115: mkdir d1/db/d10/d2d/d2e 0 2024-03-12T16:10:32.089 INFO:tasks.workunit.client.1.smithi134.stdout:7/55: stat d8/dc/l12 0 2024-03-12T16:10:32.091 INFO:tasks.workunit.client.1.smithi134.stdout:5/86: dread db/f11 [0,4194304] 0 2024-03-12T16:10:32.095 INFO:tasks.workunit.client.1.smithi134.stdout:8/72: rename d3/d9 to d3/d1b 0 2024-03-12T16:10:32.102 INFO:tasks.workunit.client.1.smithi134.stdout:1/42: dread d0/d6/f8 [0,4194304] 0 2024-03-12T16:10:32.102 INFO:tasks.workunit.client.1.smithi134.stdout:6/116: dwrite d1/d4/fe [0,4194304] 0 2024-03-12T16:10:32.104 INFO:tasks.workunit.client.1.smithi134.stdout:6/117: chown d1/d4/f2b 51228 1 2024-03-12T16:10:32.105 INFO:tasks.workunit.client.1.smithi134.stdout:3/116: dread d1/f2 [0,4194304] 0 2024-03-12T16:10:32.106 INFO:tasks.workunit.client.1.smithi134.stdout:0/75: getdents db 0 2024-03-12T16:10:32.108 INFO:tasks.workunit.client.1.smithi134.stdout:6/118: write d1/d3/d19/f30 [834130,95707] 0 2024-03-12T16:10:32.109 INFO:tasks.workunit.client.1.smithi134.stdout:5/87: rename db/d13 to db/d12/d1d 0 2024-03-12T16:10:32.110 INFO:tasks.workunit.client.1.smithi134.stdout:5/88: chown db/le 6 1 2024-03-12T16:10:32.112 INFO:tasks.workunit.client.1.smithi134.stdout:5/89: dread db/f11 [0,4194304] 0 2024-03-12T16:10:32.114 INFO:tasks.workunit.client.1.smithi134.stdout:1/43: symlink d0/le 0 2024-03-12T16:10:32.116 INFO:tasks.workunit.client.1.smithi134.stdout:7/56: creat d8/d11/f13 x:0 0 0 2024-03-12T16:10:32.117 INFO:tasks.workunit.client.1.smithi134.stdout:0/76: unlink db/f15 0 2024-03-12T16:10:32.119 INFO:tasks.workunit.client.1.smithi134.stdout:3/117: unlink d1/db/d12/l2c 0 2024-03-12T16:10:32.122 INFO:tasks.workunit.client.1.smithi134.stdout:6/119: fsync d1/f1e 0 2024-03-12T16:10:32.125 INFO:tasks.workunit.client.1.smithi134.stdout:8/73: mkdir d3/d13/d15/d1c 0 2024-03-12T16:10:32.125 INFO:tasks.workunit.client.1.smithi134.stdout:2/37: write d4/f5 [782943,87259] 0 2024-03-12T16:10:32.128 INFO:tasks.workunit.client.1.smithi134.stdout:1/44: unlink d0/le 0 2024-03-12T16:10:32.130 INFO:tasks.workunit.client.1.smithi134.stdout:2/38: write d4/f5 [948555,5161] 0 2024-03-12T16:10:32.131 INFO:tasks.workunit.client.1.smithi134.stdout:0/77: dwrite db/fe [0,4194304] 0 2024-03-12T16:10:32.131 INFO:tasks.workunit.client.1.smithi134.stdout:7/57: symlink d8/d11/l14 0 2024-03-12T16:10:32.133 INFO:tasks.workunit.client.1.smithi134.stdout:3/118: mknod d1/db/d12/c2f 0 2024-03-12T16:10:32.135 INFO:tasks.workunit.client.1.smithi134.stdout:4/123: write d1/de/f17 [1761459,40390] 0 2024-03-12T16:10:32.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/45: symlink d0/lf 0 2024-03-12T16:10:32.139 INFO:tasks.workunit.client.1.smithi134.stdout:9/59: sync 2024-03-12T16:10:32.140 INFO:tasks.workunit.client.1.smithi134.stdout:0/78: dread db/fe [0,4194304] 0 2024-03-12T16:10:32.140 INFO:tasks.workunit.client.1.smithi134.stdout:4/124: write d1/d13/f1d [509571,66498] 0 2024-03-12T16:10:32.143 INFO:tasks.workunit.client.1.smithi134.stdout:7/58: chown c5 25461 1 2024-03-12T16:10:32.144 INFO:tasks.workunit.client.1.smithi134.stdout:3/119: mkdir d1/db/d10/d2d/d30 0 2024-03-12T16:10:32.146 INFO:tasks.workunit.client.1.smithi134.stdout:2/39: dread d4/f8 [0,4194304] 0 2024-03-12T16:10:32.146 INFO:tasks.workunit.client.1.smithi134.stdout:1/46: mkdir d0/d10 0 2024-03-12T16:10:32.148 INFO:tasks.workunit.client.1.smithi134.stdout:4/125: write d1/d13/f26 [968008,115818] 0 2024-03-12T16:10:32.149 INFO:tasks.workunit.client.1.smithi134.stdout:7/59: rmdir d8 39 2024-03-12T16:10:32.150 INFO:tasks.workunit.client.1.smithi134.stdout:1/47: chown d0/lf 17143 1 2024-03-12T16:10:32.150 INFO:tasks.workunit.client.1.smithi134.stdout:2/40: write d4/f5 [3001728,38328] 0 2024-03-12T16:10:32.152 INFO:tasks.workunit.client.1.smithi134.stdout:9/60: rename f3 to d5/fb 0 2024-03-12T16:10:32.155 INFO:tasks.workunit.client.1.smithi134.stdout:3/120: dread d1/db/d12/f13 [0,4194304] 0 2024-03-12T16:10:32.155 INFO:tasks.workunit.client.1.smithi134.stdout:8/74: link d3/fe d3/d1b/f1d 0 2024-03-12T16:10:32.155 INFO:tasks.workunit.client.1.smithi134.stdout:5/90: dwrite f3 [0,4194304] 0 2024-03-12T16:10:32.161 INFO:tasks.workunit.client.1.smithi134.stdout:4/126: rmdir d1/d24 39 2024-03-12T16:10:32.161 INFO:tasks.workunit.client.1.smithi134.stdout:0/79: dwrite db/f10 [0,4194304] 0 2024-03-12T16:10:32.161 INFO:tasks.workunit.client.1.smithi134.stdout:6/120: link d1/c12 d1/d3/d19/d32/c33 0 2024-03-12T16:10:32.169 INFO:tasks.workunit.client.0.smithi006.stdout:5/76: sync 2024-03-12T16:10:32.174 INFO:tasks.workunit.client.0.smithi006.stdout:5/77: link d7/d9/f16 d7/d9/d10/f1b 0 2024-03-12T16:10:32.174 INFO:tasks.workunit.client.1.smithi134.stdout:6/121: dread - d1/f31 zero size 2024-03-12T16:10:32.176 INFO:tasks.workunit.client.1.smithi134.stdout:5/91: stat db/f10 0 2024-03-12T16:10:32.176 INFO:tasks.workunit.client.0.smithi006.stdout:5/78: unlink d7/l11 0 2024-03-12T16:10:32.178 INFO:tasks.workunit.client.0.smithi006.stdout:5/79: symlink d7/d9/l1c 0 2024-03-12T16:10:32.180 INFO:tasks.workunit.client.0.smithi006.stdout:5/80: fdatasync d7/d9/f16 0 2024-03-12T16:10:32.180 INFO:tasks.workunit.client.1.smithi134.stdout:4/127: unlink d1/d13/f1b 0 2024-03-12T16:10:32.182 INFO:tasks.workunit.client.0.smithi006.stdout:5/81: symlink d7/d8/l1d 0 2024-03-12T16:10:32.183 INFO:tasks.workunit.client.1.smithi134.stdout:9/61: dwrite d5/fa [0,4194304] 0 2024-03-12T16:10:32.183 INFO:tasks.workunit.client.1.smithi134.stdout:8/75: mknod d3/d13/d15/d1c/c1e 0 2024-03-12T16:10:32.185 INFO:tasks.workunit.client.0.smithi006.stdout:5/82: symlink d7/d8/l1e 0 2024-03-12T16:10:32.189 INFO:tasks.workunit.client.1.smithi134.stdout:2/41: dwrite d4/f5 [0,4194304] 0 2024-03-12T16:10:32.190 INFO:tasks.workunit.client.0.smithi006.stdout:5/83: link d7/d9/l1c d7/d8/l1f 0 2024-03-12T16:10:32.192 INFO:tasks.workunit.client.1.smithi134.stdout:5/92: fsync db/f10 0 2024-03-12T16:10:32.192 INFO:tasks.workunit.client.1.smithi134.stdout:7/60: dread d8/ff [0,4194304] 0 2024-03-12T16:10:32.192 INFO:tasks.workunit.client.0.smithi006.stdout:5/84: creat d7/d9/f20 x:0 0 0 2024-03-12T16:10:32.193 INFO:tasks.workunit.client.1.smithi134.stdout:1/48: dwrite d0/fd [0,4194304] 0 2024-03-12T16:10:32.193 INFO:tasks.workunit.client.0.smithi006.stdout:5/85: readlink d7/d8/l1d 0 2024-03-12T16:10:32.194 INFO:tasks.workunit.client.1.smithi134.stdout:6/122: symlink d1/l34 0 2024-03-12T16:10:32.195 INFO:tasks.workunit.client.1.smithi134.stdout:9/62: mknod d5/cc 0 2024-03-12T16:10:32.195 INFO:tasks.workunit.client.1.smithi134.stdout:9/63: readlink - no filename 2024-03-12T16:10:32.197 INFO:tasks.workunit.client.1.smithi134.stdout:3/121: dwrite d1/db/d12/f1e [0,4194304] 0 2024-03-12T16:10:32.198 INFO:tasks.workunit.client.0.smithi006.stdout:5/86: link l5 d7/d8/l21 0 2024-03-12T16:10:32.203 INFO:tasks.workunit.client.1.smithi134.stdout:1/49: write d0/d6/f8 [2882316,51003] 0 2024-03-12T16:10:32.206 INFO:tasks.workunit.client.1.smithi134.stdout:0/80: dread db/fc [0,4194304] 0 2024-03-12T16:10:32.207 INFO:tasks.workunit.client.1.smithi134.stdout:1/50: readlink d0/lf 0 2024-03-12T16:10:32.209 INFO:tasks.workunit.client.1.smithi134.stdout:0/81: write db/f14 [1216349,123736] 0 2024-03-12T16:10:32.210 INFO:tasks.workunit.client.1.smithi134.stdout:6/123: rename d1/l11 to d1/d16/l35 0 2024-03-12T16:10:32.212 INFO:tasks.workunit.client.1.smithi134.stdout:1/51: write d0/f4 [3871913,86642] 0 2024-03-12T16:10:32.212 INFO:tasks.workunit.client.1.smithi134.stdout:9/64: link f0 d5/fd 0 2024-03-12T16:10:32.213 INFO:tasks.workunit.client.1.smithi134.stdout:4/128: stat d1/d13/l16 0 2024-03-12T16:10:32.213 INFO:tasks.workunit.client.1.smithi134.stdout:3/122: fsync d1/db/d12/f13 0 2024-03-12T16:10:32.217 INFO:tasks.workunit.client.1.smithi134.stdout:5/93: link db/c14 db/d12/c1e 0 2024-03-12T16:10:32.218 INFO:tasks.workunit.client.1.smithi134.stdout:6/124: truncate d1/f1d 278040 0 2024-03-12T16:10:32.220 INFO:tasks.workunit.client.1.smithi134.stdout:7/61: dwrite f6 [4194304,4194304] 0 2024-03-12T16:10:32.222 INFO:tasks.workunit.client.1.smithi134.stdout:3/123: truncate d1/db/d14/f25 51811 0 2024-03-12T16:10:32.222 INFO:tasks.workunit.client.1.smithi134.stdout:1/52: mkdir d0/d10/d11 0 2024-03-12T16:10:32.223 INFO:tasks.workunit.client.1.smithi134.stdout:5/94: dread db/f11 [0,4194304] 0 2024-03-12T16:10:32.224 INFO:tasks.workunit.client.1.smithi134.stdout:6/125: fsync d1/d3/f17 0 2024-03-12T16:10:32.230 INFO:tasks.workunit.client.1.smithi134.stdout:0/82: dwrite db/f11 [0,4194304] 0 2024-03-12T16:10:32.231 INFO:tasks.workunit.client.1.smithi134.stdout:7/62: chown d8/la 357193500 1 2024-03-12T16:10:32.231 INFO:tasks.workunit.client.1.smithi134.stdout:2/42: write d4/f8 [1131694,62659] 0 2024-03-12T16:10:32.232 INFO:tasks.workunit.client.1.smithi134.stdout:3/124: write d1/db/f24 [240150,65781] 0 2024-03-12T16:10:32.235 INFO:tasks.workunit.client.1.smithi134.stdout:9/65: dwrite d5/fa [4194304,4194304] 0 2024-03-12T16:10:32.238 INFO:tasks.workunit.client.1.smithi134.stdout:3/125: chown d1/db/l11 1932418 1 2024-03-12T16:10:32.241 INFO:tasks.workunit.client.1.smithi134.stdout:6/126: creat d1/d3/d19/f36 x:0 0 0 2024-03-12T16:10:32.241 INFO:tasks.workunit.client.1.smithi134.stdout:9/66: fdatasync d5/f7 0 2024-03-12T16:10:32.241 INFO:tasks.workunit.client.1.smithi134.stdout:1/53: readlink d0/d6/d9/lb 0 2024-03-12T16:10:32.242 INFO:tasks.workunit.client.1.smithi134.stdout:4/129: link d1/de/lb d1/l2b 0 2024-03-12T16:10:32.245 INFO:tasks.workunit.client.1.smithi134.stdout:5/95: truncate db/f10 1822646 0 2024-03-12T16:10:32.245 INFO:tasks.workunit.client.1.smithi134.stdout:2/43: creat d4/fa x:0 0 0 2024-03-12T16:10:32.245 INFO:tasks.workunit.client.1.smithi134.stdout:0/83: creat db/f17 x:0 0 0 2024-03-12T16:10:32.246 INFO:tasks.workunit.client.1.smithi134.stdout:3/126: unlink d1/db/d14/f29 0 2024-03-12T16:10:32.247 INFO:tasks.workunit.client.1.smithi134.stdout:6/127: read - d1/d3/d10/ff zero size 2024-03-12T16:10:32.248 INFO:tasks.workunit.client.1.smithi134.stdout:1/54: creat d0/f12 x:0 0 0 2024-03-12T16:10:32.249 INFO:tasks.workunit.client.1.smithi134.stdout:0/84: creat db/f18 x:0 0 0 2024-03-12T16:10:32.250 INFO:tasks.workunit.client.1.smithi134.stdout:2/44: mknod d4/cb 0 2024-03-12T16:10:32.251 INFO:tasks.workunit.client.1.smithi134.stdout:9/67: write d5/fb [3157793,25427] 0 2024-03-12T16:10:32.254 INFO:tasks.workunit.client.1.smithi134.stdout:9/68: write d5/fa [2394702,59360] 0 2024-03-12T16:10:32.256 INFO:tasks.workunit.client.1.smithi134.stdout:2/45: creat d4/fc x:0 0 0 2024-03-12T16:10:32.258 INFO:tasks.workunit.client.1.smithi134.stdout:7/63: dwrite d8/ff [0,4194304] 0 2024-03-12T16:10:32.258 INFO:tasks.workunit.client.1.smithi134.stdout:2/46: chown d4/fa 240712 1 2024-03-12T16:10:32.260 INFO:tasks.workunit.client.1.smithi134.stdout:7/64: read - d8/fd zero size 2024-03-12T16:10:32.261 INFO:tasks.workunit.client.1.smithi134.stdout:7/65: readlink d8/dc/l12 0 2024-03-12T16:10:32.261 INFO:tasks.workunit.client.1.smithi134.stdout:2/47: truncate d4/fc 354251 0 2024-03-12T16:10:32.262 INFO:tasks.workunit.client.1.smithi134.stdout:7/66: chown c2 14 1 2024-03-12T16:10:32.262 INFO:tasks.workunit.client.1.smithi134.stdout:6/128: rename d1/d4/f2b to d1/d3/d19/d32/f37 0 2024-03-12T16:10:32.265 INFO:tasks.workunit.client.1.smithi134.stdout:0/85: dread db/fe [0,4194304] 0 2024-03-12T16:10:32.265 INFO:tasks.workunit.client.1.smithi134.stdout:7/67: write d8/fd [226559,16850] 0 2024-03-12T16:10:32.268 INFO:tasks.workunit.client.1.smithi134.stdout:3/127: rename d1/db/d14/c17 to d1/db/d10/d2d/d2e/c31 0 2024-03-12T16:10:32.274 INFO:tasks.workunit.client.1.smithi134.stdout:2/48: rename d4/f5 to d4/fd 0 2024-03-12T16:10:32.274 INFO:tasks.workunit.client.1.smithi134.stdout:7/68: rmdir d8/dc 39 2024-03-12T16:10:32.274 INFO:tasks.workunit.client.1.smithi134.stdout:3/128: read d1/db/d12/f27 [1718629,7500] 0 2024-03-12T16:10:32.274 INFO:tasks.workunit.client.1.smithi134.stdout:2/49: fsync d4/f8 0 2024-03-12T16:10:32.275 INFO:tasks.workunit.client.1.smithi134.stdout:2/50: chown c3 256946483 1 2024-03-12T16:10:32.276 INFO:tasks.workunit.client.1.smithi134.stdout:6/129: dwrite d1/d4/fe [0,4194304] 0 2024-03-12T16:10:32.276 INFO:tasks.workunit.client.1.smithi134.stdout:1/55: rename d0/d10/d11 to d0/d6/d9/d13 0 2024-03-12T16:10:32.277 INFO:tasks.workunit.client.1.smithi134.stdout:6/130: chown d1/d4/fe 5421 1 2024-03-12T16:10:32.278 INFO:tasks.workunit.client.1.smithi134.stdout:5/96: truncate f3 1620844 0 2024-03-12T16:10:32.283 INFO:tasks.workunit.client.1.smithi134.stdout:1/56: dread d0/d6/f8 [0,4194304] 0 2024-03-12T16:10:32.284 INFO:tasks.workunit.client.1.smithi134.stdout:1/57: write d0/fd [1320036,72515] 0 2024-03-12T16:10:32.288 INFO:tasks.workunit.client.1.smithi134.stdout:9/69: dwrite d5/fd [4194304,4194304] 0 2024-03-12T16:10:32.288 INFO:tasks.workunit.client.1.smithi134.stdout:2/51: chown d4/c9 2038867 1 2024-03-12T16:10:32.289 INFO:tasks.workunit.client.1.smithi134.stdout:2/52: stat d4/c7 0 2024-03-12T16:10:32.291 INFO:tasks.workunit.client.1.smithi134.stdout:2/53: chown d4/fa 504379112 1 2024-03-12T16:10:32.296 INFO:tasks.workunit.client.1.smithi134.stdout:1/58: dwrite d0/d6/f8 [0,4194304] 0 2024-03-12T16:10:32.298 INFO:tasks.workunit.client.1.smithi134.stdout:6/131: creat d1/d3/d19/f38 x:0 0 0 2024-03-12T16:10:32.298 INFO:tasks.workunit.client.1.smithi134.stdout:1/59: stat d0/lf 0 2024-03-12T16:10:32.299 INFO:tasks.workunit.client.1.smithi134.stdout:0/86: truncate db/fe 4070622 0 2024-03-12T16:10:32.299 INFO:tasks.workunit.client.1.smithi134.stdout:1/60: stat d0 0 2024-03-12T16:10:32.300 INFO:tasks.workunit.client.1.smithi134.stdout:3/129: write d1/db/d14/f23 [605954,34687] 0 2024-03-12T16:10:32.300 INFO:tasks.workunit.client.1.smithi134.stdout:9/70: creat d5/fe x:0 0 0 2024-03-12T16:10:32.300 INFO:tasks.workunit.client.1.smithi134.stdout:0/87: read - db/f17 zero size 2024-03-12T16:10:32.302 INFO:tasks.workunit.client.1.smithi134.stdout:9/71: dread - d5/fe zero size 2024-03-12T16:10:32.303 INFO:tasks.workunit.client.1.smithi134.stdout:2/54: creat d4/fe x:0 0 0 2024-03-12T16:10:32.304 INFO:tasks.workunit.client.1.smithi134.stdout:9/72: dread - d5/fe zero size 2024-03-12T16:10:32.304 INFO:tasks.workunit.client.1.smithi134.stdout:5/97: truncate db/f10 581355 0 2024-03-12T16:10:32.305 INFO:tasks.workunit.client.1.smithi134.stdout:6/132: mknod d1/d16/c39 0 2024-03-12T16:10:32.306 INFO:tasks.workunit.client.1.smithi134.stdout:9/73: write d5/f7 [85278,45435] 0 2024-03-12T16:10:32.309 INFO:tasks.workunit.client.1.smithi134.stdout:0/88: unlink l4 0 2024-03-12T16:10:32.310 INFO:tasks.workunit.client.1.smithi134.stdout:7/69: getdents d8 0 2024-03-12T16:10:32.312 INFO:tasks.workunit.client.1.smithi134.stdout:7/70: write f6 [2627022,51454] 0 2024-03-12T16:10:32.314 INFO:tasks.workunit.client.1.smithi134.stdout:5/98: mknod db/d12/c1f 0 2024-03-12T16:10:32.316 INFO:tasks.workunit.client.1.smithi134.stdout:3/130: truncate d1/db/d10/f1f 171145 0 2024-03-12T16:10:32.316 INFO:tasks.workunit.client.1.smithi134.stdout:0/89: mknod db/c19 0 2024-03-12T16:10:32.316 INFO:tasks.workunit.client.1.smithi134.stdout:9/74: dwrite d5/fd [8388608,4194304] 0 2024-03-12T16:10:32.318 INFO:tasks.workunit.client.1.smithi134.stdout:9/75: write d5/fe [749314,21670] 0 2024-03-12T16:10:32.319 INFO:tasks.workunit.client.1.smithi134.stdout:6/133: mkdir d1/d3a 0 2024-03-12T16:10:32.319 INFO:tasks.workunit.client.1.smithi134.stdout:7/71: rmdir d8/dc 39 2024-03-12T16:10:32.321 INFO:tasks.workunit.client.1.smithi134.stdout:5/99: unlink c0 0 2024-03-12T16:10:32.323 INFO:tasks.workunit.client.1.smithi134.stdout:1/61: rename d0/d6/f8 to d0/d6/f14 0 2024-03-12T16:10:32.324 INFO:tasks.workunit.client.1.smithi134.stdout:3/131: creat d1/db/d10/f32 x:0 0 0 2024-03-12T16:10:32.326 INFO:tasks.workunit.client.1.smithi134.stdout:0/90: creat db/f1a x:0 0 0 2024-03-12T16:10:32.327 INFO:tasks.workunit.client.1.smithi134.stdout:9/76: mknod d5/cf 0 2024-03-12T16:10:32.330 INFO:tasks.workunit.client.1.smithi134.stdout:1/62: dread d0/d6/f7 [0,4194304] 0 2024-03-12T16:10:32.334 INFO:tasks.workunit.client.1.smithi134.stdout:1/63: read d0/fd [1410939,100980] 0 2024-03-12T16:10:32.335 INFO:tasks.workunit.client.1.smithi134.stdout:5/100: mknod db/d12/d1d/c20 0 2024-03-12T16:10:32.337 INFO:tasks.workunit.client.1.smithi134.stdout:3/132: creat d1/db/d10/d2d/f33 x:0 0 0 2024-03-12T16:10:32.339 INFO:tasks.workunit.client.1.smithi134.stdout:0/91: unlink c6 0 2024-03-12T16:10:32.340 INFO:tasks.workunit.client.1.smithi134.stdout:9/77: dwrite f0 [4194304,4194304] 0 2024-03-12T16:10:32.343 INFO:tasks.workunit.client.1.smithi134.stdout:9/78: write d5/fb [3808183,59298] 0 2024-03-12T16:10:32.346 INFO:tasks.workunit.client.1.smithi134.stdout:5/101: stat db/l1c 0 2024-03-12T16:10:32.346 INFO:tasks.workunit.client.1.smithi134.stdout:1/64: dwrite d0/f4 [4194304,4194304] 0 2024-03-12T16:10:32.346 INFO:tasks.workunit.client.1.smithi134.stdout:3/133: truncate d1/db/f20 932221 0 2024-03-12T16:10:32.347 INFO:tasks.workunit.client.1.smithi134.stdout:2/55: truncate d4/fd 3542975 0 2024-03-12T16:10:32.347 INFO:tasks.workunit.client.1.smithi134.stdout:1/65: chown d0/d6/d9/d13 113027 1 2024-03-12T16:10:32.349 INFO:tasks.workunit.client.1.smithi134.stdout:0/92: dread f7 [0,4194304] 0 2024-03-12T16:10:32.350 INFO:tasks.workunit.client.1.smithi134.stdout:0/93: chown db/fc 427 1 2024-03-12T16:10:32.352 INFO:tasks.workunit.client.1.smithi134.stdout:5/102: write f5 [2740266,32016] 0 2024-03-12T16:10:32.355 INFO:tasks.workunit.client.1.smithi134.stdout:3/134: rmdir d1/db/d12 39 2024-03-12T16:10:32.360 INFO:tasks.workunit.client.1.smithi134.stdout:0/94: dwrite db/f1a [0,4194304] 0 2024-03-12T16:10:32.363 INFO:tasks.workunit.client.1.smithi134.stdout:5/103: mknod db/c21 0 2024-03-12T16:10:32.363 INFO:tasks.workunit.client.1.smithi134.stdout:0/95: stat db/c13 0 2024-03-12T16:10:32.363 INFO:tasks.workunit.client.1.smithi134.stdout:0/96: write db/f1a [2900681,83384] 0 2024-03-12T16:10:32.364 INFO:tasks.workunit.client.1.smithi134.stdout:3/135: dread - d1/db/d10/f21 zero size 2024-03-12T16:10:32.364 INFO:tasks.workunit.client.1.smithi134.stdout:6/134: write d1/f1e [989707,81749] 0 2024-03-12T16:10:32.375 INFO:tasks.workunit.client.1.smithi134.stdout:6/135: unlink d1/d3/d19/f30 0 2024-03-12T16:10:32.376 INFO:tasks.workunit.client.1.smithi134.stdout:3/136: dwrite d1/db/d14/f22 [0,4194304] 0 2024-03-12T16:10:32.377 INFO:tasks.workunit.client.1.smithi134.stdout:1/66: link d0/d6/ca d0/d10/c15 0 2024-03-12T16:10:32.378 INFO:tasks.workunit.client.1.smithi134.stdout:7/72: link d8/la d8/d11/l15 0 2024-03-12T16:10:32.378 INFO:tasks.workunit.client.1.smithi134.stdout:7/73: read f6 [3023714,32685] 0 2024-03-12T16:10:32.382 INFO:tasks.workunit.client.1.smithi134.stdout:2/56: unlink d4/fd 0 2024-03-12T16:10:32.382 INFO:tasks.workunit.client.1.smithi134.stdout:2/57: fsync d4/fc 0 2024-03-12T16:10:32.383 INFO:tasks.workunit.client.1.smithi134.stdout:2/58: truncate d4/fa 427513 0 2024-03-12T16:10:32.384 INFO:tasks.workunit.client.1.smithi134.stdout:2/59: write d4/f8 [1630,129893] 0 2024-03-12T16:10:32.390 INFO:tasks.workunit.client.1.smithi134.stdout:2/60: dwrite d4/fe [0,4194304] 0 2024-03-12T16:10:32.391 INFO:tasks.workunit.client.1.smithi134.stdout:2/61: chown d4/fe 706010682 1 2024-03-12T16:10:32.392 INFO:tasks.workunit.client.1.smithi134.stdout:2/62: write d4/fa [964753,98799] 0 2024-03-12T16:10:32.438 INFO:tasks.workunit.client.1.smithi134.stdout:8/76: sync 2024-03-12T16:10:32.452 INFO:tasks.workunit.client.1.smithi134.stdout:1/67: rename d0/d6 to d0/d16 0 2024-03-12T16:10:32.453 INFO:tasks.workunit.client.1.smithi134.stdout:1/68: read d0/d16/f14 [1294102,79654] 0 2024-03-12T16:10:32.455 INFO:tasks.workunit.client.1.smithi134.stdout:0/97: link c8 db/c1b 0 2024-03-12T16:10:32.459 INFO:tasks.workunit.client.1.smithi134.stdout:0/98: dread db/f14 [0,4194304] 0 2024-03-12T16:10:32.460 INFO:tasks.workunit.client.1.smithi134.stdout:2/63: rename d4/f8 to d4/ff 0 2024-03-12T16:10:32.461 INFO:tasks.workunit.client.1.smithi134.stdout:0/99: write db/f10 [3073640,43264] 0 2024-03-12T16:10:32.462 INFO:tasks.workunit.client.1.smithi134.stdout:8/77: creat d3/d1b/f1f x:0 0 0 2024-03-12T16:10:32.462 INFO:tasks.workunit.client.1.smithi134.stdout:8/78: stat d3/fc 0 2024-03-12T16:10:32.463 INFO:tasks.workunit.client.1.smithi134.stdout:6/136: fsync d1/f1d 0 2024-03-12T16:10:32.466 INFO:tasks.workunit.client.1.smithi134.stdout:2/64: dread d4/fe [0,4194304] 0 2024-03-12T16:10:32.469 INFO:tasks.workunit.client.1.smithi134.stdout:7/74: rename d8/d11/l14 to d8/dc/l16 0 2024-03-12T16:10:32.471 INFO:tasks.workunit.client.1.smithi134.stdout:2/65: dread d4/fa [0,4194304] 0 2024-03-12T16:10:32.472 INFO:tasks.workunit.client.1.smithi134.stdout:2/66: write d4/fa [525591,123680] 0 2024-03-12T16:10:32.474 INFO:tasks.workunit.client.1.smithi134.stdout:2/67: rename d4 to d4/d10 22 2024-03-12T16:10:32.475 INFO:tasks.workunit.client.1.smithi134.stdout:1/69: dwrite d0/fd [0,4194304] 0 2024-03-12T16:10:32.477 INFO:tasks.workunit.client.1.smithi134.stdout:6/137: stat d1/d3/d19/d32/c33 0 2024-03-12T16:10:32.483 INFO:tasks.workunit.client.1.smithi134.stdout:7/75: rmdir d8/d11 39 2024-03-12T16:10:32.485 INFO:tasks.workunit.client.1.smithi134.stdout:2/68: fdatasync d4/fe 0 2024-03-12T16:10:32.487 INFO:tasks.workunit.client.1.smithi134.stdout:1/70: creat d0/d16/d9/d13/f17 x:0 0 0 2024-03-12T16:10:32.487 INFO:tasks.workunit.client.1.smithi134.stdout:3/137: link d1/db/d10/d2d/d2e/c31 d1/db/d10/c34 0 2024-03-12T16:10:32.490 INFO:tasks.workunit.client.1.smithi134.stdout:6/138: rmdir d1/d3/d19 39 2024-03-12T16:10:32.491 INFO:tasks.workunit.client.1.smithi134.stdout:6/139: chown d1/d3/l6 26576808 1 2024-03-12T16:10:32.491 INFO:tasks.workunit.client.1.smithi134.stdout:6/140: fdatasync d1/f26 0 2024-03-12T16:10:32.493 INFO:tasks.workunit.client.1.smithi134.stdout:7/76: readlink d8/dc/l16 0 2024-03-12T16:10:32.495 INFO:tasks.workunit.client.1.smithi134.stdout:8/79: link d3/d13/d15/d1c/c1e d3/d13/c20 0 2024-03-12T16:10:32.496 INFO:tasks.workunit.client.1.smithi134.stdout:2/69: dread d4/fa [0,4194304] 0 2024-03-12T16:10:32.498 INFO:tasks.workunit.client.1.smithi134.stdout:6/141: mkdir d1/d3a/d3b 0 2024-03-12T16:10:32.500 INFO:tasks.workunit.client.1.smithi134.stdout:2/70: symlink d4/l11 0 2024-03-12T16:10:32.502 INFO:tasks.workunit.client.1.smithi134.stdout:7/77: rename d8/dc/l16 to d8/l17 0 2024-03-12T16:10:32.504 INFO:tasks.workunit.client.1.smithi134.stdout:6/142: fdatasync d1/d4/f1b 0 2024-03-12T16:10:32.505 INFO:tasks.workunit.client.1.smithi134.stdout:2/71: fdatasync d4/fa 0 2024-03-12T16:10:32.548 INFO:tasks.workunit.client.1.smithi134.stdout:4/130: sync 2024-03-12T16:10:32.561 INFO:tasks.workunit.client.1.smithi134.stdout:7/78: truncate d8/d11/f13 302168 0 2024-03-12T16:10:32.561 INFO:tasks.workunit.client.1.smithi134.stdout:3/138: link d1/db/f20 d1/db/d10/d2d/d30/f35 0 2024-03-12T16:10:32.564 INFO:tasks.workunit.client.1.smithi134.stdout:2/72: write d4/ff [2260887,85488] 0 2024-03-12T16:10:32.567 INFO:tasks.workunit.client.1.smithi134.stdout:8/80: link d3/fe d3/d13/d15/d1c/f21 0 2024-03-12T16:10:32.567 INFO:tasks.workunit.client.1.smithi134.stdout:8/81: read - d3/d1b/f1f zero size 2024-03-12T16:10:32.568 INFO:tasks.workunit.client.1.smithi134.stdout:7/79: fsync d8/ff 0 2024-03-12T16:10:32.571 INFO:tasks.workunit.client.1.smithi134.stdout:6/143: creat d1/d3/d19/d32/f3c x:0 0 0 2024-03-12T16:10:32.572 INFO:tasks.workunit.client.1.smithi134.stdout:8/82: dread d3/f6 [0,4194304] 0 2024-03-12T16:10:32.573 INFO:tasks.workunit.client.1.smithi134.stdout:8/83: fdatasync d3/fc 0 2024-03-12T16:10:32.573 INFO:tasks.workunit.client.1.smithi134.stdout:2/73: unlink d4/l11 0 2024-03-12T16:10:32.577 INFO:tasks.workunit.client.1.smithi134.stdout:7/80: fsync d8/fd 0 2024-03-12T16:10:32.579 INFO:tasks.workunit.client.1.smithi134.stdout:2/74: mkdir d4/d12 0 2024-03-12T16:10:32.584 INFO:tasks.workunit.client.1.smithi134.stdout:7/81: chown d8/d11/l15 6060813 1 2024-03-12T16:10:32.585 INFO:tasks.workunit.client.1.smithi134.stdout:3/139: link d1/fc d1/f36 0 2024-03-12T16:10:32.586 INFO:tasks.workunit.client.1.smithi134.stdout:2/75: creat d4/f13 x:0 0 0 2024-03-12T16:10:32.586 INFO:tasks.workunit.client.1.smithi134.stdout:2/76: stat d4/c9 0 2024-03-12T16:10:32.590 INFO:tasks.workunit.client.1.smithi134.stdout:6/144: creat d1/d3/f3d x:0 0 0 2024-03-12T16:10:32.591 INFO:tasks.workunit.client.1.smithi134.stdout:7/82: rmdir d8/dc 39 2024-03-12T16:10:32.592 INFO:tasks.workunit.client.1.smithi134.stdout:3/140: mknod d1/db/d14/c37 0 2024-03-12T16:10:32.594 INFO:tasks.workunit.client.1.smithi134.stdout:4/131: link d1/de/f25 d1/f2c 0 2024-03-12T16:10:32.597 INFO:tasks.workunit.client.1.smithi134.stdout:6/145: unlink d1/d4/f1c 0 2024-03-12T16:10:32.599 INFO:tasks.workunit.client.1.smithi134.stdout:2/77: creat d4/d12/f14 x:0 0 0 2024-03-12T16:10:32.600 INFO:tasks.workunit.client.1.smithi134.stdout:3/141: rmdir d1/db/d10 39 2024-03-12T16:10:32.602 INFO:tasks.workunit.client.1.smithi134.stdout:7/83: mknod d8/c18 0 2024-03-12T16:10:32.605 INFO:tasks.workunit.client.1.smithi134.stdout:8/84: dwrite d3/d13/d15/d1c/f21 [0,4194304] 0 2024-03-12T16:10:32.607 INFO:tasks.workunit.client.1.smithi134.stdout:3/142: dread - d1/db/d12/f26 zero size 2024-03-12T16:10:32.612 INFO:tasks.workunit.client.1.smithi134.stdout:8/85: truncate d3/f6 6123827 0 2024-03-12T16:10:32.612 INFO:tasks.workunit.client.1.smithi134.stdout:4/132: dwrite d1/d13/f1d [0,4194304] 0 2024-03-12T16:10:32.614 INFO:tasks.workunit.client.1.smithi134.stdout:3/143: unlink d1/db/d14/f2b 0 2024-03-12T16:10:32.614 INFO:tasks.workunit.client.1.smithi134.stdout:8/86: dread - d3/d1b/f19 zero size 2024-03-12T16:10:32.614 INFO:tasks.workunit.client.1.smithi134.stdout:6/146: link d1/d16/c39 d1/d3a/d3b/c3e 0 2024-03-12T16:10:32.617 INFO:tasks.workunit.client.1.smithi134.stdout:7/84: rename d8/dc/l12 to d8/d11/l19 0 2024-03-12T16:10:32.624 INFO:tasks.workunit.client.1.smithi134.stdout:4/133: mknod d1/c2d 0 2024-03-12T16:10:32.625 INFO:tasks.workunit.client.1.smithi134.stdout:8/87: dwrite d3/d13/d15/d1c/f21 [4194304,4194304] 0 2024-03-12T16:10:32.627 INFO:tasks.workunit.client.1.smithi134.stdout:6/147: rename d1/d16/l35 to d1/d3/d19/l3f 0 2024-03-12T16:10:32.628 INFO:tasks.workunit.client.1.smithi134.stdout:3/144: read d1/db/d10/d2d/d30/f35 [335093,121291] 0 2024-03-12T16:10:32.630 INFO:tasks.workunit.client.1.smithi134.stdout:4/134: read d1/d24/f19 [928190,9028] 0 2024-03-12T16:10:32.631 INFO:tasks.workunit.client.1.smithi134.stdout:7/85: creat d8/f1a x:0 0 0 2024-03-12T16:10:32.632 INFO:tasks.workunit.client.1.smithi134.stdout:8/88: rename d3/d13 to d3/d1b/d17/d22 0 2024-03-12T16:10:32.635 INFO:tasks.workunit.client.1.smithi134.stdout:3/145: creat d1/db/d10/f38 x:0 0 0 2024-03-12T16:10:32.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/146: write d1/db/f24 [24989,84588] 0 2024-03-12T16:10:32.638 INFO:tasks.workunit.client.1.smithi134.stdout:4/135: creat d1/d24/f2e x:0 0 0 2024-03-12T16:10:32.642 INFO:tasks.workunit.client.1.smithi134.stdout:4/136: dread d1/de/f17 [0,4194304] 0 2024-03-12T16:10:32.643 INFO:tasks.workunit.client.1.smithi134.stdout:8/89: truncate d3/d1b/f14 844669 0 2024-03-12T16:10:32.646 INFO:tasks.workunit.client.1.smithi134.stdout:3/147: mknod d1/db/d10/d2d/d2e/c39 0 2024-03-12T16:10:32.650 INFO:tasks.workunit.client.1.smithi134.stdout:6/148: rename d1/d3/c29 to d1/d3/d10/c40 0 2024-03-12T16:10:32.652 INFO:tasks.workunit.client.1.smithi134.stdout:6/149: truncate d1/d3/f3d 520300 0 2024-03-12T16:10:32.655 INFO:tasks.workunit.client.1.smithi134.stdout:3/148: rename d1/db/lf to d1/db/d10/d2d/d2e/l3a 0 2024-03-12T16:10:32.657 INFO:tasks.workunit.client.1.smithi134.stdout:4/137: truncate d1/de/f25 586221 0 2024-03-12T16:10:32.659 INFO:tasks.workunit.client.0.smithi006.stdout:9/39: sync 2024-03-12T16:10:32.661 INFO:tasks.workunit.client.0.smithi006.stdout:9/40: creat d0/fc x:0 0 0 2024-03-12T16:10:32.661 INFO:tasks.workunit.client.1.smithi134.stdout:3/149: creat d1/db/d10/f3b x:0 0 0 2024-03-12T16:10:32.662 INFO:tasks.workunit.client.1.smithi134.stdout:3/150: chown d1/db/d12/f26 7851698 1 2024-03-12T16:10:32.662 INFO:tasks.workunit.client.1.smithi134.stdout:4/138: write d1/de/f17 [2000280,81432] 0 2024-03-12T16:10:32.663 INFO:tasks.workunit.client.0.smithi006.stdout:9/41: creat d0/fd x:0 0 0 2024-03-12T16:10:32.663 INFO:tasks.workunit.client.0.smithi006.stdout:9/42: stat d0/d8 0 2024-03-12T16:10:32.664 INFO:tasks.workunit.client.1.smithi134.stdout:6/150: symlink d1/d3/l41 0 2024-03-12T16:10:32.666 INFO:tasks.workunit.client.1.smithi134.stdout:8/90: read d3/d1b/f14 [724297,96640] 0 2024-03-12T16:10:32.667 INFO:tasks.workunit.client.1.smithi134.stdout:3/151: mknod d1/db/d12/c3c 0 2024-03-12T16:10:32.668 INFO:tasks.workunit.client.1.smithi134.stdout:3/152: chown d1 428667311 1 2024-03-12T16:10:32.670 INFO:tasks.workunit.client.0.smithi006.stdout:9/43: dwrite d0/d8/fa [0,4194304] 0 2024-03-12T16:10:32.672 INFO:tasks.workunit.client.1.smithi134.stdout:4/139: symlink d1/de/l2f 0 2024-03-12T16:10:32.674 INFO:tasks.workunit.client.1.smithi134.stdout:7/86: dwrite d8/fb [0,4194304] 0 2024-03-12T16:10:32.675 INFO:tasks.workunit.client.1.smithi134.stdout:3/153: chown d1/db/d10/d2d/f33 415 1 2024-03-12T16:10:32.675 INFO:tasks.workunit.client.0.smithi006.stdout:9/44: link d0/d4/l7 d0/db/le 0 2024-03-12T16:10:32.682 INFO:tasks.workunit.client.1.smithi134.stdout:6/151: dwrite d1/f1e [0,4194304] 0 2024-03-12T16:10:32.683 INFO:tasks.workunit.client.1.smithi134.stdout:8/91: dread d3/d1b/d17/d22/d15/d1c/f21 [0,4194304] 0 2024-03-12T16:10:32.686 INFO:tasks.workunit.client.1.smithi134.stdout:3/154: dread d1/f36 [0,4194304] 0 2024-03-12T16:10:32.687 INFO:tasks.workunit.client.1.smithi134.stdout:6/152: rename d1/d3/d19/f38 to d1/d4/f42 0 2024-03-12T16:10:32.689 INFO:tasks.workunit.client.1.smithi134.stdout:6/153: read d1/d16/f2e [525170,119315] 0 2024-03-12T16:10:32.689 INFO:tasks.workunit.client.1.smithi134.stdout:4/140: creat d1/de/f30 x:0 0 0 2024-03-12T16:10:32.690 INFO:tasks.workunit.client.1.smithi134.stdout:3/155: chown d1/db/d10/f21 25067290 1 2024-03-12T16:10:32.691 INFO:tasks.workunit.client.1.smithi134.stdout:6/154: write d1/d4/f20 [1102705,131056] 0 2024-03-12T16:10:32.695 INFO:tasks.workunit.client.1.smithi134.stdout:4/141: dread d1/de/f17 [0,4194304] 0 2024-03-12T16:10:32.695 INFO:tasks.workunit.client.1.smithi134.stdout:3/156: mknod d1/c3d 0 2024-03-12T16:10:32.697 INFO:tasks.workunit.client.1.smithi134.stdout:7/87: getdents d8 0 2024-03-12T16:10:32.697 INFO:tasks.workunit.client.1.smithi134.stdout:7/88: chown d8/d11 851 1 2024-03-12T16:10:32.698 INFO:tasks.workunit.client.1.smithi134.stdout:6/155: dread d1/f5 [0,4194304] 0 2024-03-12T16:10:32.699 INFO:tasks.workunit.client.1.smithi134.stdout:4/142: stat d1/d13/f1a 0 2024-03-12T16:10:32.700 INFO:tasks.workunit.client.1.smithi134.stdout:3/157: read d1/db/d12/f27 [1732648,55762] 0 2024-03-12T16:10:32.701 INFO:tasks.workunit.client.1.smithi134.stdout:6/156: creat d1/d3/d19/d32/f43 x:0 0 0 2024-03-12T16:10:32.705 INFO:tasks.workunit.client.1.smithi134.stdout:6/157: mknod d1/d3/d10/c44 0 2024-03-12T16:10:32.706 INFO:tasks.workunit.client.1.smithi134.stdout:6/158: readlink d1/d3/d10/l13 0 2024-03-12T16:10:32.708 INFO:tasks.workunit.client.1.smithi134.stdout:4/143: getdents d1/d24 0 2024-03-12T16:10:32.710 INFO:tasks.workunit.client.1.smithi134.stdout:6/159: rmdir d1/d3/d19/d32 39 2024-03-12T16:10:32.710 INFO:tasks.workunit.client.1.smithi134.stdout:5/104: sync 2024-03-12T16:10:32.710 INFO:tasks.workunit.client.1.smithi134.stdout:9/79: sync 2024-03-12T16:10:32.711 INFO:tasks.workunit.client.1.smithi134.stdout:3/158: write d1/f2 [5231601,88182] 0 2024-03-12T16:10:32.713 INFO:tasks.workunit.client.1.smithi134.stdout:4/144: chown d1/d13/d18/d1c/f29 48620 1 2024-03-12T16:10:32.713 INFO:tasks.workunit.client.1.smithi134.stdout:5/105: chown db/le 162 1 2024-03-12T16:10:32.714 INFO:tasks.workunit.client.1.smithi134.stdout:6/160: creat d1/d3a/f45 x:0 0 0 2024-03-12T16:10:32.716 INFO:tasks.workunit.client.1.smithi134.stdout:3/159: read - d1/db/d10/f38 zero size 2024-03-12T16:10:32.717 INFO:tasks.workunit.client.1.smithi134.stdout:7/89: dwrite f6 [0,4194304] 0 2024-03-12T16:10:32.718 INFO:tasks.workunit.client.1.smithi134.stdout:6/161: symlink d1/d16/l46 0 2024-03-12T16:10:32.719 INFO:tasks.workunit.client.1.smithi134.stdout:4/145: truncate d1/d24/f19 1740006 0 2024-03-12T16:10:32.721 INFO:tasks.workunit.client.1.smithi134.stdout:5/106: rename db/f10 to db/d12/d1d/f22 0 2024-03-12T16:10:32.721 INFO:tasks.workunit.client.1.smithi134.stdout:7/90: rename d8 to d8/dc/d1b 22 2024-03-12T16:10:32.722 INFO:tasks.workunit.client.1.smithi134.stdout:9/80: truncate d5/fd 9094690 0 2024-03-12T16:10:32.723 INFO:tasks.workunit.client.1.smithi134.stdout:6/162: fdatasync d1/d3/f17 0 2024-03-12T16:10:32.724 INFO:tasks.workunit.client.1.smithi134.stdout:5/107: rmdir db/d12 39 2024-03-12T16:10:32.726 INFO:tasks.workunit.client.1.smithi134.stdout:3/160: rename d1/db/d10/f38 to d1/db/d12/f3e 0 2024-03-12T16:10:32.727 INFO:tasks.workunit.client.1.smithi134.stdout:3/161: write d1/db/f24 [132289,44377] 0 2024-03-12T16:10:32.737 INFO:tasks.workunit.client.1.smithi134.stdout:3/162: rmdir d1/db/d12 39 2024-03-12T16:10:32.740 INFO:tasks.workunit.client.1.smithi134.stdout:4/146: rename d1/f2c to d1/d13/d18/f31 0 2024-03-12T16:10:32.744 INFO:tasks.workunit.client.1.smithi134.stdout:7/91: rename d8/la to d8/dc/l1c 0 2024-03-12T16:10:32.744 INFO:tasks.workunit.client.1.smithi134.stdout:9/81: chown f0 7174044 1 2024-03-12T16:10:32.745 INFO:tasks.workunit.client.1.smithi134.stdout:6/163: dwrite d1/f1d [0,4194304] 0 2024-03-12T16:10:32.750 INFO:tasks.workunit.client.1.smithi134.stdout:4/147: creat d1/de/d2a/f32 x:0 0 0 2024-03-12T16:10:32.753 INFO:tasks.workunit.client.1.smithi134.stdout:9/82: mkdir d5/d10 0 2024-03-12T16:10:32.755 INFO:tasks.workunit.client.1.smithi134.stdout:6/164: creat d1/d4/f47 x:0 0 0 2024-03-12T16:10:32.756 INFO:tasks.workunit.client.1.smithi134.stdout:3/163: dwrite d1/f5 [4194304,4194304] 0 2024-03-12T16:10:32.758 INFO:tasks.workunit.client.1.smithi134.stdout:5/108: rename f3 to db/d12/d1d/f23 0 2024-03-12T16:10:32.759 INFO:tasks.workunit.client.1.smithi134.stdout:7/92: chown d8/f1a 5686361 1 2024-03-12T16:10:32.759 INFO:tasks.workunit.client.1.smithi134.stdout:7/93: dread - d8/f1a zero size 2024-03-12T16:10:32.762 INFO:tasks.workunit.client.1.smithi134.stdout:9/83: dread d5/fa [0,4194304] 0 2024-03-12T16:10:32.762 INFO:tasks.workunit.client.1.smithi134.stdout:9/84: readlink - no filename 2024-03-12T16:10:32.763 INFO:tasks.workunit.client.1.smithi134.stdout:5/109: symlink db/d12/d1d/l24 0 2024-03-12T16:10:32.765 INFO:tasks.workunit.client.1.smithi134.stdout:7/94: write d8/ff [2847091,117856] 0 2024-03-12T16:10:32.766 INFO:tasks.workunit.client.1.smithi134.stdout:6/165: creat d1/d3/f48 x:0 0 0 2024-03-12T16:10:32.770 INFO:tasks.workunit.client.1.smithi134.stdout:4/148: rename d1/d13/d18/f31 to d1/f33 0 2024-03-12T16:10:32.773 INFO:tasks.workunit.client.1.smithi134.stdout:5/110: getdents db/d12 0 2024-03-12T16:10:32.774 INFO:tasks.workunit.client.1.smithi134.stdout:9/85: dwrite d5/f7 [0,4194304] 0 2024-03-12T16:10:32.774 INFO:tasks.workunit.client.1.smithi134.stdout:3/164: rename d1/db/d12/f3e to d1/db/d10/d2d/d2e/f3f 0 2024-03-12T16:10:32.776 INFO:tasks.workunit.client.1.smithi134.stdout:6/166: mknod d1/d3/c49 0 2024-03-12T16:10:32.780 INFO:tasks.workunit.client.1.smithi134.stdout:3/165: dread - d1/db/d10/f32 zero size 2024-03-12T16:10:32.782 INFO:tasks.workunit.client.1.smithi134.stdout:5/111: dread db/f11 [0,4194304] 0 2024-03-12T16:10:32.783 INFO:tasks.workunit.client.1.smithi134.stdout:9/86: mknod d5/d10/c11 0 2024-03-12T16:10:32.785 INFO:tasks.workunit.client.1.smithi134.stdout:7/95: dwrite d8/fd [0,4194304] 0 2024-03-12T16:10:32.786 INFO:tasks.workunit.client.1.smithi134.stdout:4/149: dread d1/d13/f1d [0,4194304] 0 2024-03-12T16:10:32.787 INFO:tasks.workunit.client.1.smithi134.stdout:6/167: truncate d1/d3/d19/d32/f37 473558 0 2024-03-12T16:10:32.790 INFO:tasks.workunit.client.1.smithi134.stdout:3/166: rename d1/db/d14/f25 to d1/db/d14/f40 0 2024-03-12T16:10:32.792 INFO:tasks.workunit.client.1.smithi134.stdout:3/167: fdatasync d1/db/d14/f22 0 2024-03-12T16:10:32.794 INFO:tasks.workunit.client.1.smithi134.stdout:7/96: creat d8/d11/f1d x:0 0 0 2024-03-12T16:10:32.797 INFO:tasks.workunit.client.1.smithi134.stdout:4/150: dwrite d1/de/d2a/f32 [0,4194304] 0 2024-03-12T16:10:32.797 INFO:tasks.workunit.client.1.smithi134.stdout:5/112: creat db/f25 x:0 0 0 2024-03-12T16:10:32.806 INFO:tasks.workunit.client.1.smithi134.stdout:9/87: truncate d5/f7 3585744 0 2024-03-12T16:10:32.806 INFO:tasks.workunit.client.1.smithi134.stdout:4/151: mkdir d1/d24/d34 0 2024-03-12T16:10:32.806 INFO:tasks.workunit.client.1.smithi134.stdout:6/168: dwrite d1/d4/f42 [0,4194304] 0 2024-03-12T16:10:32.809 INFO:tasks.workunit.client.1.smithi134.stdout:7/97: creat d8/dc/f1e x:0 0 0 2024-03-12T16:10:32.815 INFO:tasks.workunit.client.1.smithi134.stdout:6/169: mkdir d1/d3/d19/d32/d4a 0 2024-03-12T16:10:32.815 INFO:tasks.workunit.client.1.smithi134.stdout:4/152: rename d1/d13/d18/d1c to d1/d13/d18/d35 0 2024-03-12T16:10:32.819 INFO:tasks.workunit.client.1.smithi134.stdout:7/98: dread f6 [0,4194304] 0 2024-03-12T16:10:32.820 INFO:tasks.workunit.client.1.smithi134.stdout:4/153: rmdir d1/d13/d18 39 2024-03-12T16:10:32.822 INFO:tasks.workunit.client.1.smithi134.stdout:9/88: dwrite d5/fe [0,4194304] 0 2024-03-12T16:10:32.826 INFO:tasks.workunit.client.1.smithi134.stdout:5/113: write db/d12/d1d/f22 [882174,119716] 0 2024-03-12T16:10:32.831 INFO:tasks.workunit.client.1.smithi134.stdout:3/168: dwrite d1/f6 [0,4194304] 0 2024-03-12T16:10:32.834 INFO:tasks.workunit.client.1.smithi134.stdout:5/114: dread db/f11 [0,4194304] 0 2024-03-12T16:10:32.837 INFO:tasks.workunit.client.1.smithi134.stdout:3/169: rmdir d1/db/d10 39 2024-03-12T16:10:32.838 INFO:tasks.workunit.client.1.smithi134.stdout:7/99: dwrite d8/d11/f1d [0,4194304] 0 2024-03-12T16:10:32.843 INFO:tasks.workunit.client.1.smithi134.stdout:7/100: fdatasync d8/ff 0 2024-03-12T16:10:32.845 INFO:tasks.workunit.client.1.smithi134.stdout:6/170: dwrite d1/d4/f14 [0,4194304] 0 2024-03-12T16:10:32.845 INFO:tasks.workunit.client.1.smithi134.stdout:5/115: dread db/d12/d1d/f22 [0,4194304] 0 2024-03-12T16:10:32.846 INFO:tasks.workunit.client.1.smithi134.stdout:9/89: dwrite d5/fe [0,4194304] 0 2024-03-12T16:10:32.848 INFO:tasks.workunit.client.1.smithi134.stdout:6/171: write d1/d4/f47 [560910,107175] 0 2024-03-12T16:10:32.852 INFO:tasks.workunit.client.1.smithi134.stdout:5/116: dread db/d12/d1d/f22 [0,4194304] 0 2024-03-12T16:10:32.852 INFO:tasks.workunit.client.1.smithi134.stdout:7/101: readlink d8/dc/l1c 0 2024-03-12T16:10:32.852 INFO:tasks.workunit.client.1.smithi134.stdout:6/172: fsync d1/d4/f21 0 2024-03-12T16:10:32.859 INFO:tasks.workunit.client.1.smithi134.stdout:3/170: link d1/db/d12/c2f d1/c41 0 2024-03-12T16:10:32.859 INFO:tasks.workunit.client.1.smithi134.stdout:5/117: dread f6 [0,4194304] 0 2024-03-12T16:10:32.860 INFO:tasks.workunit.client.1.smithi134.stdout:6/173: write d1/d16/f2e [2442131,31634] 0 2024-03-12T16:10:32.862 INFO:tasks.workunit.client.1.smithi134.stdout:7/102: dread d8/d11/f1d [0,4194304] 0 2024-03-12T16:10:32.862 INFO:tasks.workunit.client.1.smithi134.stdout:0/100: sync 2024-03-12T16:10:32.863 INFO:tasks.workunit.client.1.smithi134.stdout:7/103: stat d8/fd 0 2024-03-12T16:10:32.863 INFO:tasks.workunit.client.1.smithi134.stdout:1/71: sync 2024-03-12T16:10:32.865 INFO:tasks.workunit.client.1.smithi134.stdout:1/72: fdatasync d0/f4 0 2024-03-12T16:10:32.865 INFO:tasks.workunit.client.1.smithi134.stdout:3/171: dread d1/db/d10/d2d/d30/f35 [0,4194304] 0 2024-03-12T16:10:32.866 INFO:tasks.workunit.client.1.smithi134.stdout:5/118: rename c7 to db/c26 0 2024-03-12T16:10:32.873 INFO:tasks.workunit.client.1.smithi134.stdout:3/172: creat d1/db/d14/f42 x:0 0 0 2024-03-12T16:10:32.875 INFO:tasks.workunit.client.1.smithi134.stdout:6/174: rename d1/d3/c1a to d1/d4/c4b 0 2024-03-12T16:10:32.876 INFO:tasks.workunit.client.1.smithi134.stdout:9/90: dwrite d5/fa [4194304,4194304] 0 2024-03-12T16:10:32.878 INFO:tasks.workunit.client.1.smithi134.stdout:7/104: creat d8/f1f x:0 0 0 2024-03-12T16:10:32.880 INFO:tasks.workunit.client.1.smithi134.stdout:3/173: mknod d1/db/d10/c43 0 2024-03-12T16:10:32.882 INFO:tasks.workunit.client.1.smithi134.stdout:6/175: mkdir d1/d16/d4c 0 2024-03-12T16:10:32.884 INFO:tasks.workunit.client.1.smithi134.stdout:1/73: creat d0/d16/f18 x:0 0 0 2024-03-12T16:10:32.885 INFO:tasks.workunit.client.1.smithi134.stdout:5/119: creat db/f27 x:0 0 0 2024-03-12T16:10:32.886 INFO:tasks.workunit.client.1.smithi134.stdout:3/174: creat d1/db/d10/d2a/f44 x:0 0 0 2024-03-12T16:10:32.890 INFO:tasks.workunit.client.1.smithi134.stdout:1/74: symlink d0/l19 0 2024-03-12T16:10:32.890 INFO:tasks.workunit.client.1.smithi134.stdout:5/120: rmdir db/d12/d1d 39 2024-03-12T16:10:32.890 INFO:tasks.workunit.client.1.smithi134.stdout:0/101: dwrite db/f11 [0,4194304] 0 2024-03-12T16:10:32.891 INFO:tasks.workunit.client.1.smithi134.stdout:1/75: symlink d0/d16/d9/d13/l1a 0 2024-03-12T16:10:32.893 INFO:tasks.workunit.client.1.smithi134.stdout:9/91: dread d5/fd [4194304,4194304] 0 2024-03-12T16:10:32.897 INFO:tasks.workunit.client.1.smithi134.stdout:5/121: creat db/d12/d1d/f28 x:0 0 0 2024-03-12T16:10:32.898 INFO:tasks.workunit.client.1.smithi134.stdout:9/92: rename f0 to d5/d10/f12 0 2024-03-12T16:10:32.905 INFO:tasks.workunit.client.1.smithi134.stdout:5/122: mkdir db/d12/d29 0 2024-03-12T16:10:32.906 INFO:tasks.workunit.client.1.smithi134.stdout:5/123: chown db/d12 1322569730 1 2024-03-12T16:10:32.907 INFO:tasks.workunit.client.1.smithi134.stdout:6/176: truncate d1/d4/f47 411816 0 2024-03-12T16:10:32.907 INFO:tasks.workunit.client.1.smithi134.stdout:3/175: link d1/db/d10/d2d/d2e/c31 d1/db/c45 0 2024-03-12T16:10:32.908 INFO:tasks.workunit.client.1.smithi134.stdout:1/76: link d0/c5 d0/d16/d9/c1b 0 2024-03-12T16:10:32.910 INFO:tasks.workunit.client.1.smithi134.stdout:5/124: rename l4 to db/d12/d1d/l2a 0 2024-03-12T16:10:32.915 INFO:tasks.workunit.client.1.smithi134.stdout:9/93: chown d5/d10/f12 1555150 1 2024-03-12T16:10:32.916 INFO:tasks.workunit.client.1.smithi134.stdout:5/125: dread db/d12/d1d/f22 [0,4194304] 0 2024-03-12T16:10:32.917 INFO:tasks.workunit.client.1.smithi134.stdout:6/177: mkdir d1/d4d 0 2024-03-12T16:10:32.918 INFO:tasks.workunit.client.1.smithi134.stdout:1/77: chown d0/d16/d9/c1b 334867 1 2024-03-12T16:10:32.919 INFO:tasks.workunit.client.1.smithi134.stdout:9/94: chown d5/fb 109 1 2024-03-12T16:10:32.920 INFO:tasks.workunit.client.1.smithi134.stdout:3/176: dwrite d1/db/d10/f32 [0,4194304] 0 2024-03-12T16:10:32.920 INFO:tasks.workunit.client.1.smithi134.stdout:5/126: fsync db/f25 0 2024-03-12T16:10:32.924 INFO:tasks.workunit.client.1.smithi134.stdout:5/127: stat db/l1c 0 2024-03-12T16:10:32.924 INFO:tasks.workunit.client.1.smithi134.stdout:3/177: readlink d1/db/l11 0 2024-03-12T16:10:32.924 INFO:tasks.workunit.client.1.smithi134.stdout:9/95: mkdir d5/d13 0 2024-03-12T16:10:32.924 INFO:tasks.workunit.client.1.smithi134.stdout:0/102: dwrite db/fe [4194304,4194304] 0 2024-03-12T16:10:32.925 INFO:tasks.workunit.client.1.smithi134.stdout:5/128: fdatasync db/d12/d1d/f28 0 2024-03-12T16:10:32.927 INFO:tasks.workunit.client.1.smithi134.stdout:6/178: rename d1/d4/fb to d1/d4d/f4e 0 2024-03-12T16:10:32.930 INFO:tasks.workunit.client.1.smithi134.stdout:1/78: mkdir d0/d16/d9/d1c 0 2024-03-12T16:10:32.930 INFO:tasks.workunit.client.1.smithi134.stdout:1/79: fsync d0/fd 0 2024-03-12T16:10:32.931 INFO:tasks.workunit.client.1.smithi134.stdout:1/80: chown d0/f4 25 1 2024-03-12T16:10:32.931 INFO:tasks.workunit.client.1.smithi134.stdout:0/103: dread db/f1a [0,4194304] 0 2024-03-12T16:10:32.933 INFO:tasks.workunit.client.1.smithi134.stdout:9/96: unlink d5/fd 0 2024-03-12T16:10:32.939 INFO:tasks.workunit.client.1.smithi134.stdout:0/104: rename db/f17 to db/f1c 0 2024-03-12T16:10:32.942 INFO:tasks.workunit.client.1.smithi134.stdout:5/129: mknod db/d12/c2b 0 2024-03-12T16:10:32.942 INFO:tasks.workunit.client.1.smithi134.stdout:1/81: dwrite d0/d16/f18 [0,4194304] 0 2024-03-12T16:10:32.944 INFO:tasks.workunit.client.1.smithi134.stdout:9/97: dread d5/fa [4194304,4194304] 0 2024-03-12T16:10:32.944 INFO:tasks.workunit.client.1.smithi134.stdout:6/179: rename d1/d3a/d3b/c3e to d1/d16/c4f 0 2024-03-12T16:10:32.946 INFO:tasks.workunit.client.1.smithi134.stdout:0/105: stat l3 0 2024-03-12T16:10:32.946 INFO:tasks.workunit.client.1.smithi134.stdout:0/106: read - db/f1c zero size 2024-03-12T16:10:32.951 INFO:tasks.workunit.client.1.smithi134.stdout:9/98: creat d5/f14 x:0 0 0 2024-03-12T16:10:32.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:31.494025+0000 mgr.smithi134.gcntfu (mgr.24383) 52 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 432 KiB/s rd, 45 MiB/s wr, 71 op/s 2024-03-12T16:10:32.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:31.706040+0000 mgr.smithi134.gcntfu (mgr.24383) 53 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:32.954 INFO:tasks.workunit.client.1.smithi134.stdout:0/107: creat db/f1d x:0 0 0 2024-03-12T16:10:32.956 INFO:tasks.workunit.client.1.smithi134.stdout:1/82: unlink d0/c5 0 2024-03-12T16:10:32.956 INFO:tasks.workunit.client.1.smithi134.stdout:3/178: truncate d1/fc 1616628 0 2024-03-12T16:10:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:31.494025+0000 mgr.smithi134.gcntfu (mgr.24383) 52 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 432 KiB/s rd, 45 MiB/s wr, 71 op/s 2024-03-12T16:10:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:31.706040+0000 mgr.smithi134.gcntfu (mgr.24383) 53 : audit [DBG] from='client.14622 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:10:32.958 INFO:tasks.workunit.client.1.smithi134.stdout:9/99: creat d5/d10/f15 x:0 0 0 2024-03-12T16:10:32.958 INFO:tasks.workunit.client.1.smithi134.stdout:5/130: dwrite db/d12/d1d/f22 [0,4194304] 0 2024-03-12T16:10:32.963 INFO:tasks.workunit.client.1.smithi134.stdout:5/131: fsync f6 0 2024-03-12T16:10:32.964 INFO:tasks.workunit.client.1.smithi134.stdout:6/180: write d1/d3/d10/ff [159583,21810] 0 2024-03-12T16:10:32.967 INFO:tasks.workunit.client.1.smithi134.stdout:0/108: rmdir db 39 2024-03-12T16:10:32.968 INFO:tasks.workunit.client.1.smithi134.stdout:3/179: symlink d1/db/d10/d2d/d2e/l46 0 2024-03-12T16:10:32.969 INFO:tasks.workunit.client.1.smithi134.stdout:1/83: creat d0/d16/d9/d1c/f1d x:0 0 0 2024-03-12T16:10:32.970 INFO:tasks.workunit.client.1.smithi134.stdout:3/180: dread - d1/db/d12/f26 zero size 2024-03-12T16:10:32.974 INFO:tasks.workunit.client.1.smithi134.stdout:5/132: fdatasync db/f11 0 2024-03-12T16:10:32.976 INFO:tasks.workunit.client.1.smithi134.stdout:9/100: unlink d5/d10/f12 0 2024-03-12T16:10:32.977 INFO:tasks.workunit.client.1.smithi134.stdout:1/84: dread d0/d16/f14 [0,4194304] 0 2024-03-12T16:10:32.977 INFO:tasks.workunit.client.1.smithi134.stdout:9/101: chown d5/d10/f15 0 1 2024-03-12T16:10:32.978 INFO:tasks.workunit.client.1.smithi134.stdout:9/102: read d5/fb [1735528,299] 0 2024-03-12T16:10:32.978 INFO:tasks.workunit.client.1.smithi134.stdout:6/181: unlink d1/d3/l6 0 2024-03-12T16:10:32.979 INFO:tasks.workunit.client.1.smithi134.stdout:6/182: chown d1/d3/d19/d32 33815433 1 2024-03-12T16:10:32.981 INFO:tasks.workunit.client.1.smithi134.stdout:3/181: rename d1/db/d10/d2d/d2e/l46 to d1/db/d12/l47 0 2024-03-12T16:10:32.988 INFO:tasks.workunit.client.1.smithi134.stdout:9/103: rmdir d5/d10 39 2024-03-12T16:10:32.989 INFO:tasks.workunit.client.1.smithi134.stdout:0/109: rmdir db 39 2024-03-12T16:10:32.992 INFO:tasks.workunit.client.1.smithi134.stdout:3/182: mkdir d1/db/d14/d48 0 2024-03-12T16:10:32.993 INFO:tasks.workunit.client.1.smithi134.stdout:3/183: chown d1/c8 512124999 1 2024-03-12T16:10:32.995 INFO:tasks.workunit.client.1.smithi134.stdout:5/133: mkdir db/d2c 0 2024-03-12T16:10:32.996 INFO:tasks.workunit.client.1.smithi134.stdout:5/134: write db/f27 [269,107682] 0 2024-03-12T16:10:32.998 INFO:tasks.workunit.client.1.smithi134.stdout:6/183: symlink d1/l50 0 2024-03-12T16:10:32.999 INFO:tasks.workunit.client.1.smithi134.stdout:3/184: dread d1/f2 [0,4194304] 0 2024-03-12T16:10:32.999 INFO:tasks.workunit.client.1.smithi134.stdout:5/135: truncate db/f25 37409 0 2024-03-12T16:10:33.000 INFO:tasks.workunit.client.1.smithi134.stdout:0/110: mknod db/c1e 0 2024-03-12T16:10:33.001 INFO:tasks.workunit.client.1.smithi134.stdout:6/184: fsync d1/d3/d10/ff 0 2024-03-12T16:10:33.001 INFO:tasks.workunit.client.1.smithi134.stdout:1/85: symlink d0/d10/l1e 0 2024-03-12T16:10:33.003 INFO:tasks.workunit.client.1.smithi134.stdout:5/136: mknod db/d12/d1d/c2d 0 2024-03-12T16:10:33.007 INFO:tasks.workunit.client.1.smithi134.stdout:5/137: write db/d12/d1d/f19 [521329,118390] 0 2024-03-12T16:10:33.007 INFO:tasks.workunit.client.1.smithi134.stdout:9/104: dwrite d5/f7 [0,4194304] 0 2024-03-12T16:10:33.007 INFO:tasks.workunit.client.1.smithi134.stdout:1/86: chown d0/d16/ca 38 1 2024-03-12T16:10:33.019 INFO:tasks.workunit.client.1.smithi134.stdout:5/138: rename db/l1a to db/d12/l2e 0 2024-03-12T16:10:33.026 INFO:tasks.workunit.client.1.smithi134.stdout:6/185: dwrite d1/d3/d19/f36 [0,4194304] 0 2024-03-12T16:10:33.027 INFO:tasks.workunit.client.1.smithi134.stdout:3/185: dwrite d1/db/d10/d2d/d2e/f3f [0,4194304] 0 2024-03-12T16:10:33.027 INFO:tasks.workunit.client.1.smithi134.stdout:0/111: dwrite db/fe [0,4194304] 0 2024-03-12T16:10:33.034 INFO:tasks.workunit.client.1.smithi134.stdout:1/87: dread d0/d16/f7 [0,4194304] 0 2024-03-12T16:10:33.035 INFO:tasks.workunit.client.1.smithi134.stdout:9/105: dwrite d5/f14 [0,4194304] 0 2024-03-12T16:10:33.035 INFO:tasks.workunit.client.1.smithi134.stdout:0/112: creat db/f1f x:0 0 0 2024-03-12T16:10:33.037 INFO:tasks.workunit.client.1.smithi134.stdout:3/186: unlink d1/db/d10/f3b 0 2024-03-12T16:10:33.037 INFO:tasks.workunit.client.1.smithi134.stdout:5/139: dread db/d12/d1d/f22 [0,4194304] 0 2024-03-12T16:10:33.038 INFO:tasks.workunit.client.1.smithi134.stdout:0/113: chown db/f1c 311451 1 2024-03-12T16:10:33.039 INFO:tasks.workunit.client.1.smithi134.stdout:9/106: stat d5/d10/c11 0 2024-03-12T16:10:33.044 INFO:tasks.workunit.client.1.smithi134.stdout:3/187: mkdir d1/db/d10/d2d/d30/d49 0 2024-03-12T16:10:33.045 INFO:tasks.workunit.client.1.smithi134.stdout:3/188: write d1/db/d10/f32 [4753723,9604] 0 2024-03-12T16:10:33.048 INFO:tasks.workunit.client.1.smithi134.stdout:6/186: rename d1/d3a/f45 to d1/d3/d19/f51 0 2024-03-12T16:10:33.050 INFO:tasks.workunit.client.1.smithi134.stdout:5/140: mknod db/d12/d29/c2f 0 2024-03-12T16:10:33.051 INFO:tasks.workunit.client.1.smithi134.stdout:5/141: readlink db/l1c 0 2024-03-12T16:10:33.052 INFO:tasks.workunit.client.1.smithi134.stdout:5/142: chown db/l1b 11761 1 2024-03-12T16:10:33.054 INFO:tasks.workunit.client.1.smithi134.stdout:6/187: dread - d1/d3/d19/f1f zero size 2024-03-12T16:10:33.056 INFO:tasks.workunit.client.1.smithi134.stdout:9/107: getdents d5 0 2024-03-12T16:10:33.059 INFO:tasks.workunit.client.1.smithi134.stdout:5/143: symlink db/l30 0 2024-03-12T16:10:33.060 INFO:tasks.workunit.client.1.smithi134.stdout:3/189: dwrite d1/db/d10/d2d/f33 [0,4194304] 0 2024-03-12T16:10:33.061 INFO:tasks.workunit.client.1.smithi134.stdout:9/108: symlink d5/l16 0 2024-03-12T16:10:33.063 INFO:tasks.workunit.client.1.smithi134.stdout:1/88: dwrite d0/d16/f7 [0,4194304] 0 2024-03-12T16:10:33.063 INFO:tasks.workunit.client.1.smithi134.stdout:3/190: stat d1/db/d12/l1a 0 2024-03-12T16:10:33.064 INFO:tasks.workunit.client.1.smithi134.stdout:5/144: rmdir db/d12 39 2024-03-12T16:10:33.070 INFO:tasks.workunit.client.1.smithi134.stdout:6/188: dread d1/d4/f14 [0,4194304] 0 2024-03-12T16:10:33.070 INFO:tasks.workunit.client.1.smithi134.stdout:1/89: symlink d0/l1f 0 2024-03-12T16:10:33.071 INFO:tasks.workunit.client.1.smithi134.stdout:1/90: chown d0/l1f 0 1 2024-03-12T16:10:33.071 INFO:tasks.workunit.client.1.smithi134.stdout:5/145: creat db/d12/d1d/f31 x:0 0 0 2024-03-12T16:10:33.072 INFO:tasks.workunit.client.1.smithi134.stdout:6/189: write d1/d3/d10/f2a [1580003,96251] 0 2024-03-12T16:10:33.072 INFO:tasks.workunit.client.1.smithi134.stdout:5/146: chown db/l1b 2042 1 2024-03-12T16:10:33.073 INFO:tasks.workunit.client.1.smithi134.stdout:5/147: chown l9 59741 1 2024-03-12T16:10:33.073 INFO:tasks.workunit.client.1.smithi134.stdout:6/190: truncate d1/f26 129303 0 2024-03-12T16:10:33.073 INFO:tasks.workunit.client.1.smithi134.stdout:5/148: stat db/d12/d1d/c2d 0 2024-03-12T16:10:33.101 INFO:tasks.workunit.client.1.smithi134.stdout:2/78: sync 2024-03-12T16:10:33.101 INFO:tasks.workunit.client.1.smithi134.stdout:8/92: sync 2024-03-12T16:10:33.104 INFO:tasks.workunit.client.1.smithi134.stdout:8/93: chown d3/d1b 5893134 1 2024-03-12T16:10:33.104 INFO:tasks.workunit.client.1.smithi134.stdout:3/191: link d1/db/ce d1/db/c4a 0 2024-03-12T16:10:33.105 INFO:tasks.workunit.client.1.smithi134.stdout:1/91: mkdir d0/d10/d20 0 2024-03-12T16:10:33.106 INFO:tasks.workunit.client.1.smithi134.stdout:2/79: symlink d4/d12/l15 0 2024-03-12T16:10:33.107 INFO:tasks.workunit.client.1.smithi134.stdout:6/191: dread d1/f5 [0,4194304] 0 2024-03-12T16:10:33.107 INFO:tasks.workunit.client.1.smithi134.stdout:5/149: mkdir db/d12/d32 0 2024-03-12T16:10:33.108 INFO:tasks.workunit.client.1.smithi134.stdout:2/80: write d4/f13 [404510,46965] 0 2024-03-12T16:10:33.112 INFO:tasks.workunit.client.1.smithi134.stdout:8/94: symlink d3/d1b/d17/l23 0 2024-03-12T16:10:33.114 INFO:tasks.workunit.client.1.smithi134.stdout:2/81: dread d4/f13 [0,4194304] 0 2024-03-12T16:10:33.116 INFO:tasks.workunit.client.1.smithi134.stdout:8/95: truncate d3/d10/f16 8655405 0 2024-03-12T16:10:33.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/150: dwrite db/f27 [0,4194304] 0 2024-03-12T16:10:33.118 INFO:tasks.workunit.client.1.smithi134.stdout:2/82: dread d4/f13 [0,4194304] 0 2024-03-12T16:10:33.119 INFO:tasks.workunit.client.1.smithi134.stdout:3/192: rmdir d1/db 39 2024-03-12T16:10:33.120 INFO:tasks.workunit.client.1.smithi134.stdout:6/192: mknod d1/d3/c52 0 2024-03-12T16:10:33.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/92: rename d0/d10 to d0/d16/d9/d13/d21 0 2024-03-12T16:10:33.128 INFO:tasks.workunit.client.1.smithi134.stdout:9/109: mknod d5/d10/c17 0 2024-03-12T16:10:33.129 INFO:tasks.workunit.client.1.smithi134.stdout:8/96: chown d3/d1b/d17/d22/c20 56 1 2024-03-12T16:10:33.129 INFO:tasks.workunit.client.1.smithi134.stdout:2/83: write d4/f13 [1462073,75330] 0 2024-03-12T16:10:33.130 INFO:tasks.workunit.client.1.smithi134.stdout:8/97: stat d3/d1b/f14 0 2024-03-12T16:10:33.130 INFO:tasks.workunit.client.1.smithi134.stdout:5/151: symlink db/d12/d32/l33 0 2024-03-12T16:10:33.132 INFO:tasks.workunit.client.1.smithi134.stdout:2/84: chown d4/c7 1 1 2024-03-12T16:10:33.132 INFO:tasks.workunit.client.1.smithi134.stdout:3/193: truncate d1/db/d12/f26 548769 0 2024-03-12T16:10:33.132 INFO:tasks.workunit.client.1.smithi134.stdout:6/193: symlink d1/d3/d19/d32/d4a/l53 0 2024-03-12T16:10:33.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/93: creat d0/f22 x:0 0 0 2024-03-12T16:10:33.134 INFO:tasks.workunit.client.1.smithi134.stdout:2/85: write d4/fc [1048860,72339] 0 2024-03-12T16:10:33.134 INFO:tasks.workunit.client.1.smithi134.stdout:8/98: mkdir d3/d1b/d17/d24 0 2024-03-12T16:10:33.134 INFO:tasks.workunit.client.1.smithi134.stdout:3/194: fdatasync d1/db/d10/f28 0 2024-03-12T16:10:33.138 INFO:tasks.workunit.client.1.smithi134.stdout:2/86: mkdir d4/d16 0 2024-03-12T16:10:33.141 INFO:tasks.workunit.client.1.smithi134.stdout:8/99: dread d3/d1b/f14 [0,4194304] 0 2024-03-12T16:10:33.141 INFO:tasks.workunit.client.1.smithi134.stdout:6/194: rename d1/d3/d19/d32/d4a/l53 to d1/d4/l54 0 2024-03-12T16:10:33.143 INFO:tasks.workunit.client.1.smithi134.stdout:6/195: readlink d1/l34 0 2024-03-12T16:10:33.143 INFO:tasks.workunit.client.1.smithi134.stdout:8/100: stat d3/fe 0 2024-03-12T16:10:33.144 INFO:tasks.workunit.client.1.smithi134.stdout:3/195: mknod d1/db/d10/d2d/d30/d49/c4b 0 2024-03-12T16:10:33.145 INFO:tasks.workunit.client.1.smithi134.stdout:1/94: dread d0/d16/f18 [0,4194304] 0 2024-03-12T16:10:33.146 INFO:tasks.workunit.client.1.smithi134.stdout:9/110: dwrite d5/fa [0,4194304] 0 2024-03-12T16:10:33.147 INFO:tasks.workunit.client.1.smithi134.stdout:6/196: write d1/f5 [2273990,50204] 0 2024-03-12T16:10:33.147 INFO:tasks.workunit.client.1.smithi134.stdout:3/196: readlink d1/db/d10/l1d 0 2024-03-12T16:10:33.149 INFO:tasks.workunit.client.1.smithi134.stdout:2/87: dread d4/fe [0,4194304] 0 2024-03-12T16:10:33.150 INFO:tasks.workunit.client.1.smithi134.stdout:6/197: write d1/d3/d10/ff [811276,20998] 0 2024-03-12T16:10:33.151 INFO:tasks.workunit.client.1.smithi134.stdout:9/111: read d5/fe [3077124,42547] 0 2024-03-12T16:10:33.152 INFO:tasks.workunit.client.1.smithi134.stdout:5/152: truncate f5 2534236 0 2024-03-12T16:10:33.152 INFO:tasks.workunit.client.1.smithi134.stdout:9/112: stat d5/d10/f15 0 2024-03-12T16:10:33.153 INFO:tasks.workunit.client.1.smithi134.stdout:5/153: readlink db/l1b 0 2024-03-12T16:10:33.156 INFO:tasks.workunit.client.1.smithi134.stdout:9/113: dread d5/fe [0,4194304] 0 2024-03-12T16:10:33.157 INFO:tasks.workunit.client.1.smithi134.stdout:8/101: write d3/d1b/f14 [483773,130427] 0 2024-03-12T16:10:33.163 INFO:tasks.workunit.client.1.smithi134.stdout:1/95: creat d0/d16/d9/d13/d21/f23 x:0 0 0 2024-03-12T16:10:33.163 INFO:tasks.workunit.client.1.smithi134.stdout:8/102: mkdir d3/d1b/d17/d25 0 2024-03-12T16:10:33.167 INFO:tasks.workunit.client.1.smithi134.stdout:3/197: creat d1/db/f4c x:0 0 0 2024-03-12T16:10:33.168 INFO:tasks.workunit.client.1.smithi134.stdout:2/88: link d4/cb d4/c17 0 2024-03-12T16:10:33.169 INFO:tasks.workunit.client.1.smithi134.stdout:1/96: dread - d0/d16/d9/d13/f17 zero size 2024-03-12T16:10:33.170 INFO:tasks.workunit.client.1.smithi134.stdout:6/198: dwrite d1/d3/d19/d32/f37 [0,4194304] 0 2024-03-12T16:10:33.172 INFO:tasks.workunit.client.1.smithi134.stdout:8/103: rename d3/fc to d3/d10/f26 0 2024-03-12T16:10:33.173 INFO:tasks.workunit.client.1.smithi134.stdout:6/199: fsync d1/d3/d19/d32/f3c 0 2024-03-12T16:10:33.174 INFO:tasks.workunit.client.1.smithi134.stdout:2/89: creat d4/d12/f18 x:0 0 0 2024-03-12T16:10:33.175 INFO:tasks.workunit.client.1.smithi134.stdout:2/90: stat d4/fe 0 2024-03-12T16:10:33.177 INFO:tasks.workunit.client.1.smithi134.stdout:5/154: dwrite f6 [0,4194304] 0 2024-03-12T16:10:33.178 INFO:tasks.workunit.client.1.smithi134.stdout:5/155: stat db/d12/d32 0 2024-03-12T16:10:33.179 INFO:tasks.workunit.client.1.smithi134.stdout:5/156: stat db/d12/d32 0 2024-03-12T16:10:33.181 INFO:tasks.workunit.client.1.smithi134.stdout:1/97: rmdir d0/d16/d9/d1c 39 2024-03-12T16:10:33.182 INFO:tasks.workunit.client.1.smithi134.stdout:8/104: mknod d3/d1b/c27 0 2024-03-12T16:10:33.184 INFO:tasks.workunit.client.1.smithi134.stdout:9/114: truncate d5/f7 934182 0 2024-03-12T16:10:33.186 INFO:tasks.workunit.client.1.smithi134.stdout:6/200: write d1/d4/f14 [2724501,87101] 0 2024-03-12T16:10:33.186 INFO:tasks.workunit.client.1.smithi134.stdout:8/105: dread d3/d1b/f14 [0,4194304] 0 2024-03-12T16:10:33.187 INFO:tasks.workunit.client.1.smithi134.stdout:2/91: rename d4/d12/l15 to d4/l19 0 2024-03-12T16:10:33.189 INFO:tasks.workunit.client.1.smithi134.stdout:6/201: fdatasync d1/d3/d10/f2a 0 2024-03-12T16:10:33.189 INFO:tasks.workunit.client.1.smithi134.stdout:6/202: dread - d1/d3/d19/f1f zero size 2024-03-12T16:10:33.190 INFO:tasks.workunit.client.1.smithi134.stdout:6/203: fsync d1/f5 0 2024-03-12T16:10:33.192 INFO:tasks.workunit.client.1.smithi134.stdout:3/198: rename d1/db/f24 to d1/db/f4d 0 2024-03-12T16:10:33.192 INFO:tasks.workunit.client.1.smithi134.stdout:6/204: fdatasync d1/d4/f42 0 2024-03-12T16:10:33.192 INFO:tasks.workunit.client.1.smithi134.stdout:1/98: mknod d0/d16/d9/d13/d21/d20/c24 0 2024-03-12T16:10:33.193 INFO:tasks.workunit.client.1.smithi134.stdout:2/92: mknod d4/c1a 0 2024-03-12T16:10:33.195 INFO:tasks.workunit.client.1.smithi134.stdout:2/93: dread - d4/d12/f14 zero size 2024-03-12T16:10:33.200 INFO:tasks.workunit.client.1.smithi134.stdout:8/106: getdents d3/d1b/d17/d24 0 2024-03-12T16:10:33.200 INFO:tasks.workunit.client.1.smithi134.stdout:9/115: dwrite d5/f14 [0,4194304] 0 2024-03-12T16:10:33.204 INFO:tasks.workunit.client.1.smithi134.stdout:3/199: rename d1/db/d10/f21 to d1/db/d10/d2d/f4e 0 2024-03-12T16:10:33.205 INFO:tasks.workunit.client.1.smithi134.stdout:1/99: dwrite d0/fd [0,4194304] 0 2024-03-12T16:10:33.209 INFO:tasks.workunit.client.1.smithi134.stdout:9/116: creat d5/d10/f18 x:0 0 0 2024-03-12T16:10:33.213 INFO:tasks.workunit.client.1.smithi134.stdout:8/107: mkdir d3/d1b/d17/d24/d28 0 2024-03-12T16:10:33.217 INFO:tasks.workunit.client.1.smithi134.stdout:2/94: dread d4/ff [0,4194304] 0 2024-03-12T16:10:33.220 INFO:tasks.workunit.client.1.smithi134.stdout:2/95: creat d4/f1b x:0 0 0 2024-03-12T16:10:33.220 INFO:tasks.workunit.client.1.smithi134.stdout:3/200: dread d1/db/d14/f22 [0,4194304] 0 2024-03-12T16:10:33.223 INFO:tasks.workunit.client.1.smithi134.stdout:8/108: truncate d3/d1b/f14 1543728 0 2024-03-12T16:10:33.224 INFO:tasks.workunit.client.1.smithi134.stdout:5/157: dread f5 [0,4194304] 0 2024-03-12T16:10:33.224 INFO:tasks.workunit.client.1.smithi134.stdout:9/117: symlink d5/d13/l19 0 2024-03-12T16:10:33.225 INFO:tasks.workunit.client.1.smithi134.stdout:9/118: chown d5/d13/l19 446594 1 2024-03-12T16:10:33.226 INFO:tasks.workunit.client.1.smithi134.stdout:3/201: chown d1/f5 5253453 1 2024-03-12T16:10:33.228 INFO:tasks.workunit.client.1.smithi134.stdout:1/100: link d0/d16/d9/d13/d21/l1e d0/l25 0 2024-03-12T16:10:33.231 INFO:tasks.workunit.client.1.smithi134.stdout:5/158: mkdir db/d12/d1d/d34 0 2024-03-12T16:10:33.232 INFO:tasks.workunit.client.1.smithi134.stdout:5/159: readlink db/d12/d32/l33 0 2024-03-12T16:10:33.232 INFO:tasks.workunit.client.1.smithi134.stdout:6/205: truncate d1/d4/fe 1877625 0 2024-03-12T16:10:33.233 INFO:tasks.workunit.client.1.smithi134.stdout:2/96: creat d4/d16/f1c x:0 0 0 2024-03-12T16:10:33.234 INFO:tasks.workunit.client.1.smithi134.stdout:6/206: chown d1/d3/d10/l13 11116 1 2024-03-12T16:10:33.234 INFO:tasks.workunit.client.1.smithi134.stdout:5/160: truncate db/d12/d1d/f28 706759 0 2024-03-12T16:10:33.235 INFO:tasks.workunit.client.1.smithi134.stdout:2/97: dread - d4/d12/f14 zero size 2024-03-12T16:10:33.237 INFO:tasks.workunit.client.1.smithi134.stdout:5/161: chown db/d12/d1d/f22 224 1 2024-03-12T16:10:33.239 INFO:tasks.workunit.client.1.smithi134.stdout:2/98: mkdir d4/d12/d1d 0 2024-03-12T16:10:33.241 INFO:tasks.workunit.client.1.smithi134.stdout:9/119: getdents d5 0 2024-03-12T16:10:33.241 INFO:tasks.workunit.client.1.smithi134.stdout:5/162: creat db/d12/d1d/f35 x:0 0 0 2024-03-12T16:10:33.244 INFO:tasks.workunit.client.1.smithi134.stdout:2/99: mknod d4/d16/c1e 0 2024-03-12T16:10:33.245 INFO:tasks.workunit.client.1.smithi134.stdout:8/109: dread d3/d1b/f19 [0,4194304] 0 2024-03-12T16:10:33.248 INFO:tasks.workunit.client.1.smithi134.stdout:8/110: read d3/d1b/f1d [449454,107410] 0 2024-03-12T16:10:33.249 INFO:tasks.workunit.client.1.smithi134.stdout:2/100: creat d4/f1f x:0 0 0 2024-03-12T16:10:33.249 INFO:tasks.workunit.client.1.smithi134.stdout:3/202: write d1/db/f20 [629712,473] 0 2024-03-12T16:10:33.251 INFO:tasks.workunit.client.1.smithi134.stdout:8/111: read d3/d1b/f19 [1268368,32067] 0 2024-03-12T16:10:33.253 INFO:tasks.workunit.client.1.smithi134.stdout:1/101: truncate d0/d16/f14 742095 0 2024-03-12T16:10:33.253 INFO:tasks.workunit.client.1.smithi134.stdout:2/101: stat d4 0 2024-03-12T16:10:33.253 INFO:tasks.workunit.client.1.smithi134.stdout:9/120: dwrite d5/d10/f15 [0,4194304] 0 2024-03-12T16:10:33.255 INFO:tasks.workunit.client.1.smithi134.stdout:5/163: getdents db 0 2024-03-12T16:10:33.256 INFO:tasks.workunit.client.1.smithi134.stdout:3/203: write d1/db/d14/f23 [5208678,38871] 0 2024-03-12T16:10:33.257 INFO:tasks.workunit.client.1.smithi134.stdout:6/207: write d1/d3/d10/f15 [1417464,13023] 0 2024-03-12T16:10:33.260 INFO:tasks.workunit.client.1.smithi134.stdout:2/102: truncate d4/f1b 521480 0 2024-03-12T16:10:33.263 INFO:tasks.workunit.client.1.smithi134.stdout:5/164: write db/d12/d1d/f35 [121030,62154] 0 2024-03-12T16:10:33.265 INFO:tasks.workunit.client.1.smithi134.stdout:2/103: creat d4/d12/f20 x:0 0 0 2024-03-12T16:10:33.268 INFO:tasks.workunit.client.1.smithi134.stdout:1/102: creat d0/d16/d9/d13/d21/f26 x:0 0 0 2024-03-12T16:10:33.268 INFO:tasks.workunit.client.1.smithi134.stdout:9/121: dread d5/d10/f15 [0,4194304] 0 2024-03-12T16:10:33.269 INFO:tasks.workunit.client.1.smithi134.stdout:6/208: mkdir d1/d3a/d3b/d55 0 2024-03-12T16:10:33.269 INFO:tasks.workunit.client.1.smithi134.stdout:2/104: read d4/fa [795036,34852] 0 2024-03-12T16:10:33.269 INFO:tasks.workunit.client.1.smithi134.stdout:8/112: dread d3/d10/f16 [0,4194304] 0 2024-03-12T16:10:33.270 INFO:tasks.workunit.client.1.smithi134.stdout:5/165: creat db/d12/d29/f36 x:0 0 0 2024-03-12T16:10:33.270 INFO:tasks.workunit.client.1.smithi134.stdout:9/122: stat d5/fe 0 2024-03-12T16:10:33.272 INFO:tasks.workunit.client.1.smithi134.stdout:5/166: fsync f6 0 2024-03-12T16:10:33.276 INFO:tasks.workunit.client.1.smithi134.stdout:6/209: truncate d1/d3/d10/ff 1712118 0 2024-03-12T16:10:33.276 INFO:tasks.workunit.client.1.smithi134.stdout:8/113: fdatasync d3/d10/f26 0 2024-03-12T16:10:33.277 INFO:tasks.workunit.client.1.smithi134.stdout:1/103: creat d0/d16/d9/d1c/f27 x:0 0 0 2024-03-12T16:10:33.278 INFO:tasks.workunit.client.1.smithi134.stdout:9/123: rename d5/fb to d5/d13/f1a 0 2024-03-12T16:10:33.281 INFO:tasks.workunit.client.1.smithi134.stdout:3/204: dwrite d1/db/d14/f23 [4194304,4194304] 0 2024-03-12T16:10:33.281 INFO:tasks.workunit.client.1.smithi134.stdout:5/167: dread db/d12/d1d/f35 [0,4194304] 0 2024-03-12T16:10:33.281 INFO:tasks.workunit.client.1.smithi134.stdout:1/104: fsync d0/d16/d9/d13/f17 0 2024-03-12T16:10:33.283 INFO:tasks.workunit.client.1.smithi134.stdout:6/210: mkdir d1/d3a/d56 0 2024-03-12T16:10:33.283 INFO:tasks.workunit.client.1.smithi134.stdout:5/168: chown db/d12/d29 204625 1 2024-03-12T16:10:33.288 INFO:tasks.workunit.client.1.smithi134.stdout:2/105: link d4/d12/f20 d4/d12/d1d/f21 0 2024-03-12T16:10:33.289 INFO:tasks.workunit.client.1.smithi134.stdout:8/114: creat d3/d1b/d17/d22/d15/d1c/f29 x:0 0 0 2024-03-12T16:10:33.290 INFO:tasks.workunit.client.1.smithi134.stdout:3/205: creat d1/db/d10/f4f x:0 0 0 2024-03-12T16:10:33.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/105: fsync d0/d16/f18 0 2024-03-12T16:10:33.291 INFO:tasks.workunit.client.1.smithi134.stdout:6/211: symlink d1/d3a/l57 0 2024-03-12T16:10:33.294 INFO:tasks.workunit.client.1.smithi134.stdout:2/106: rename d4/fe to d4/d12/f22 0 2024-03-12T16:10:33.295 INFO:tasks.workunit.client.1.smithi134.stdout:3/206: read - d1/db/d10/d2d/f4e zero size 2024-03-12T16:10:33.299 INFO:tasks.workunit.client.1.smithi134.stdout:4/154: sync 2024-03-12T16:10:33.299 INFO:tasks.workunit.client.1.smithi134.stdout:7/105: sync 2024-03-12T16:10:33.302 INFO:tasks.workunit.client.1.smithi134.stdout:9/124: write d5/f14 [2943449,61258] 0 2024-03-12T16:10:33.304 INFO:tasks.workunit.client.1.smithi134.stdout:6/212: mkdir d1/d16/d4c/d58 0 2024-03-12T16:10:33.305 INFO:tasks.workunit.client.1.smithi134.stdout:6/213: dread - d1/f31 zero size 2024-03-12T16:10:33.306 INFO:tasks.workunit.client.1.smithi134.stdout:8/115: write d3/f6 [2514177,17059] 0 2024-03-12T16:10:33.309 INFO:tasks.workunit.client.1.smithi134.stdout:8/116: dread - d3/d10/f26 zero size 2024-03-12T16:10:33.311 INFO:tasks.workunit.client.1.smithi134.stdout:1/106: creat d0/d16/d9/d13/d21/f28 x:0 0 0 2024-03-12T16:10:33.311 INFO:tasks.workunit.client.1.smithi134.stdout:2/107: link d4/d16/c1e d4/d12/d1d/c23 0 2024-03-12T16:10:33.313 INFO:tasks.workunit.client.1.smithi134.stdout:3/207: rmdir d1/db/d14/d48 0 2024-03-12T16:10:33.316 INFO:tasks.workunit.client.1.smithi134.stdout:9/125: symlink d5/l1b 0 2024-03-12T16:10:33.317 INFO:tasks.workunit.client.1.smithi134.stdout:5/169: dwrite f5 [0,4194304] 0 2024-03-12T16:10:33.318 INFO:tasks.workunit.client.1.smithi134.stdout:4/155: creat d1/de/f36 x:0 0 0 2024-03-12T16:10:33.322 INFO:tasks.workunit.client.1.smithi134.stdout:7/106: dwrite d8/fb [0,4194304] 0 2024-03-12T16:10:33.322 INFO:tasks.workunit.client.1.smithi134.stdout:2/108: rmdir d4 39 2024-03-12T16:10:33.323 INFO:tasks.workunit.client.1.smithi134.stdout:7/107: stat c2 0 2024-03-12T16:10:33.324 INFO:tasks.workunit.client.1.smithi134.stdout:5/170: write f5 [405695,93638] 0 2024-03-12T16:10:33.330 INFO:tasks.workunit.client.1.smithi134.stdout:8/117: dwrite d3/f6 [0,4194304] 0 2024-03-12T16:10:33.333 INFO:tasks.workunit.client.1.smithi134.stdout:7/108: truncate d8/f1a 883621 0 2024-03-12T16:10:33.334 INFO:tasks.workunit.client.1.smithi134.stdout:6/214: rename d1/d4/fe to d1/d3/d19/f59 0 2024-03-12T16:10:33.338 INFO:tasks.workunit.client.1.smithi134.stdout:5/171: mkdir db/d12/d37 0 2024-03-12T16:10:33.338 INFO:tasks.workunit.client.1.smithi134.stdout:9/126: creat d5/d10/f1c x:0 0 0 2024-03-12T16:10:33.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/118: creat d3/d1b/f2a x:0 0 0 2024-03-12T16:10:33.340 INFO:tasks.workunit.client.1.smithi134.stdout:4/156: mknod d1/d24/d34/c37 0 2024-03-12T16:10:33.341 INFO:tasks.workunit.client.1.smithi134.stdout:1/107: link d0/d16/d9/d13/d21/f28 d0/d16/f29 0 2024-03-12T16:10:33.341 INFO:tasks.workunit.client.1.smithi134.stdout:2/109: creat d4/f24 x:0 0 0 2024-03-12T16:10:33.343 INFO:tasks.workunit.client.1.smithi134.stdout:1/108: fsync d0/d16/d9/d13/f17 0 2024-03-12T16:10:33.343 INFO:tasks.workunit.client.1.smithi134.stdout:2/110: read - d4/d12/d1d/f21 zero size 2024-03-12T16:10:33.345 INFO:tasks.workunit.client.1.smithi134.stdout:3/208: rename d1/db/d12/f13 to d1/db/d10/d2d/d30/d49/f50 0 2024-03-12T16:10:33.346 INFO:tasks.workunit.client.1.smithi134.stdout:6/215: dread d1/d4/f47 [0,4194304] 0 2024-03-12T16:10:33.350 INFO:tasks.workunit.client.1.smithi134.stdout:8/119: mkdir d3/d1b/d17/d22/d15/d2b 0 2024-03-12T16:10:33.350 INFO:tasks.workunit.client.1.smithi134.stdout:0/114: sync 2024-03-12T16:10:33.353 INFO:tasks.workunit.client.1.smithi134.stdout:4/157: dread d1/f33 [0,4194304] 0 2024-03-12T16:10:33.354 INFO:tasks.workunit.client.1.smithi134.stdout:8/120: write d3/f6 [7169126,95911] 0 2024-03-12T16:10:33.357 INFO:tasks.workunit.client.1.smithi134.stdout:9/127: dread d5/f14 [0,4194304] 0 2024-03-12T16:10:33.362 INFO:tasks.workunit.client.1.smithi134.stdout:1/109: dwrite d0/d16/d9/d13/d21/f23 [0,4194304] 0 2024-03-12T16:10:33.362 INFO:tasks.workunit.client.1.smithi134.stdout:7/109: rename d8/d11 to d8/dc/d20 0 2024-03-12T16:10:33.368 INFO:tasks.workunit.client.1.smithi134.stdout:1/110: write d0/d16/f7 [3818813,107478] 0 2024-03-12T16:10:33.369 INFO:tasks.workunit.client.1.smithi134.stdout:0/115: dwrite db/f11 [0,4194304] 0 2024-03-12T16:10:33.371 INFO:tasks.workunit.client.1.smithi134.stdout:2/111: link c3 d4/d16/c25 0 2024-03-12T16:10:33.371 INFO:tasks.workunit.client.1.smithi134.stdout:5/172: write db/d12/d1d/f23 [1312451,33328] 0 2024-03-12T16:10:33.373 INFO:tasks.workunit.client.1.smithi134.stdout:9/128: write d5/f14 [2835610,76347] 0 2024-03-12T16:10:33.374 INFO:tasks.workunit.client.1.smithi134.stdout:2/112: write d4/f1f [203969,110253] 0 2024-03-12T16:10:33.377 INFO:tasks.workunit.client.1.smithi134.stdout:4/158: dwrite d1/f23 [4194304,4194304] 0 2024-03-12T16:10:33.378 INFO:tasks.workunit.client.1.smithi134.stdout:8/121: creat d3/d1b/d17/d22/f2c x:0 0 0 2024-03-12T16:10:33.379 INFO:tasks.workunit.client.1.smithi134.stdout:1/111: creat d0/f2a x:0 0 0 2024-03-12T16:10:33.380 INFO:tasks.workunit.client.1.smithi134.stdout:0/116: mknod db/c20 0 2024-03-12T16:10:33.382 INFO:tasks.workunit.client.1.smithi134.stdout:0/117: readlink l3 0 2024-03-12T16:10:33.388 INFO:tasks.workunit.client.1.smithi134.stdout:2/113: creat d4/f26 x:0 0 0 2024-03-12T16:10:33.389 INFO:tasks.workunit.client.1.smithi134.stdout:3/209: getdents d1/db/d10/d2d/d30/d49 0 2024-03-12T16:10:33.392 INFO:tasks.workunit.client.1.smithi134.stdout:8/122: dwrite d3/f8 [4194304,4194304] 0 2024-03-12T16:10:33.392 INFO:tasks.workunit.client.1.smithi134.stdout:3/210: dread - d1/db/d10/f4f zero size 2024-03-12T16:10:33.392 INFO:tasks.workunit.client.1.smithi134.stdout:2/114: mknod d4/d16/c27 0 2024-03-12T16:10:33.393 INFO:tasks.workunit.client.1.smithi134.stdout:5/173: rmdir db/d2c 0 2024-03-12T16:10:33.393 INFO:tasks.workunit.client.1.smithi134.stdout:1/112: dread d0/d16/f18 [0,4194304] 0 2024-03-12T16:10:33.396 INFO:tasks.workunit.client.1.smithi134.stdout:6/216: rename d1/d16/c18 to d1/c5a 0 2024-03-12T16:10:33.399 INFO:tasks.workunit.client.1.smithi134.stdout:2/115: fdatasync d4/d12/d1d/f21 0 2024-03-12T16:10:33.402 INFO:tasks.workunit.client.1.smithi134.stdout:7/110: rename d8/dc/f1e to d8/dc/d20/f21 0 2024-03-12T16:10:33.403 INFO:tasks.workunit.client.1.smithi134.stdout:9/129: read d5/d13/f1a [238052,125893] 0 2024-03-12T16:10:33.406 INFO:tasks.workunit.client.1.smithi134.stdout:2/116: chown d4/d16/c1e 10 1 2024-03-12T16:10:33.408 INFO:tasks.workunit.client.1.smithi134.stdout:9/130: truncate d5/d10/f18 980878 0 2024-03-12T16:10:33.408 INFO:tasks.workunit.client.1.smithi134.stdout:6/217: dwrite d1/d3/d19/d32/f3c [0,4194304] 0 2024-03-12T16:10:33.410 INFO:tasks.workunit.client.1.smithi134.stdout:2/117: chown d4/d12/d1d/c23 1 1 2024-03-12T16:10:33.412 INFO:tasks.workunit.client.1.smithi134.stdout:8/123: rename d3/d1b/d17/d22/d15/d1c/f21 to d3/d1b/d17/d24/f2d 0 2024-03-12T16:10:33.412 INFO:tasks.workunit.client.1.smithi134.stdout:6/218: rename d1/d3/d19/d32 to d1/d3/d19/d32/d4a/d5b 22 2024-03-12T16:10:33.415 INFO:tasks.workunit.client.1.smithi134.stdout:7/111: fsync d8/dc/d20/f1d 0 2024-03-12T16:10:33.421 INFO:tasks.workunit.client.1.smithi134.stdout:8/124: read d3/fe [8548650,114922] 0 2024-03-12T16:10:33.422 INFO:tasks.workunit.client.1.smithi134.stdout:3/211: truncate d1/db/d14/f40 42876 0 2024-03-12T16:10:33.424 INFO:tasks.workunit.client.1.smithi134.stdout:9/131: write d5/fa [3906629,41529] 0 2024-03-12T16:10:33.424 INFO:tasks.workunit.client.1.smithi134.stdout:4/159: dwrite d1/d24/f19 [0,4194304] 0 2024-03-12T16:10:33.429 INFO:tasks.workunit.client.1.smithi134.stdout:7/112: mknod d8/c22 0 2024-03-12T16:10:33.433 INFO:tasks.workunit.client.1.smithi134.stdout:2/118: dwrite d4/f1f [0,4194304] 0 2024-03-12T16:10:33.437 INFO:tasks.workunit.client.1.smithi134.stdout:1/113: dwrite d0/d16/f29 [0,4194304] 0 2024-03-12T16:10:33.437 INFO:tasks.workunit.client.1.smithi134.stdout:4/160: readlink d1/de/lb 0 2024-03-12T16:10:33.438 INFO:tasks.workunit.client.1.smithi134.stdout:9/132: chown d5/f7 55741 1 2024-03-12T16:10:33.439 INFO:tasks.workunit.client.1.smithi134.stdout:5/174: rename db/d12/d1d/f28 to db/f38 0 2024-03-12T16:10:33.441 INFO:tasks.workunit.client.1.smithi134.stdout:7/113: symlink d8/dc/d20/l23 0 2024-03-12T16:10:33.444 INFO:tasks.workunit.client.1.smithi134.stdout:0/118: dread fa [0,4194304] 0 2024-03-12T16:10:33.445 INFO:tasks.workunit.client.1.smithi134.stdout:3/212: truncate d1/db/d10/d2d/d30/d49/f50 1354485 0 2024-03-12T16:10:33.447 INFO:tasks.workunit.client.1.smithi134.stdout:6/219: dwrite d1/d3/d19/f36 [0,4194304] 0 2024-03-12T16:10:33.448 INFO:tasks.workunit.client.1.smithi134.stdout:8/125: creat d3/d1b/d17/d22/d15/d2b/f2e x:0 0 0 2024-03-12T16:10:33.452 INFO:tasks.workunit.client.1.smithi134.stdout:8/126: write d3/f6 [910883,15841] 0 2024-03-12T16:10:33.456 INFO:tasks.workunit.client.1.smithi134.stdout:5/175: write db/d12/d1d/f23 [2384242,101386] 0 2024-03-12T16:10:33.460 INFO:tasks.workunit.client.1.smithi134.stdout:8/127: truncate d3/d1b/f1f 431362 0 2024-03-12T16:10:33.460 INFO:tasks.workunit.client.1.smithi134.stdout:9/133: dwrite d5/d10/f18 [0,4194304] 0 2024-03-12T16:10:33.460 INFO:tasks.workunit.client.1.smithi134.stdout:6/220: dread - d1/d3/f48 zero size 2024-03-12T16:10:33.462 INFO:tasks.workunit.client.1.smithi134.stdout:1/114: rename d0/d16/d9/d13/d21/l1e to d0/d16/d9/d13/l2b 0 2024-03-12T16:10:33.464 INFO:tasks.workunit.client.1.smithi134.stdout:2/119: truncate d4/fc 937524 0 2024-03-12T16:10:33.465 INFO:tasks.workunit.client.1.smithi134.stdout:7/114: creat d8/f24 x:0 0 0 2024-03-12T16:10:33.467 INFO:tasks.workunit.client.1.smithi134.stdout:1/115: stat d0/d16/d9/d13/d21 0 2024-03-12T16:10:33.467 INFO:tasks.workunit.client.1.smithi134.stdout:5/176: stat db/l30 0 2024-03-12T16:10:33.468 INFO:tasks.workunit.client.1.smithi134.stdout:9/134: mknod d5/d13/c1d 0 2024-03-12T16:10:33.468 INFO:tasks.workunit.client.1.smithi134.stdout:3/213: dwrite d1/db/d14/f22 [0,4194304] 0 2024-03-12T16:10:33.472 INFO:tasks.workunit.client.1.smithi134.stdout:8/128: rename d3/d1b/d17/d22/c20 to d3/d1b/d17/d22/d15/d1c/c2f 0 2024-03-12T16:10:33.472 INFO:tasks.workunit.client.1.smithi134.stdout:7/115: rmdir d8/dc/d20 39 2024-03-12T16:10:33.478 INFO:tasks.workunit.client.1.smithi134.stdout:1/116: creat d0/f2c x:0 0 0 2024-03-12T16:10:33.478 INFO:tasks.workunit.client.1.smithi134.stdout:9/135: mknod d5/d10/c1e 0 2024-03-12T16:10:33.481 INFO:tasks.workunit.client.1.smithi134.stdout:6/221: creat d1/d3a/d56/f5c x:0 0 0 2024-03-12T16:10:33.481 INFO:tasks.workunit.client.1.smithi134.stdout:8/129: dread d3/d1b/f1f [0,4194304] 0 2024-03-12T16:10:33.482 INFO:tasks.workunit.client.1.smithi134.stdout:9/136: write d5/f14 [4543833,130728] 0 2024-03-12T16:10:33.482 INFO:tasks.workunit.client.1.smithi134.stdout:9/137: chown d5/d13 125151 1 2024-03-12T16:10:33.484 INFO:tasks.workunit.client.1.smithi134.stdout:7/116: dread f6 [0,4194304] 0 2024-03-12T16:10:33.485 INFO:tasks.workunit.client.1.smithi134.stdout:5/177: rename f6 to db/d12/d37/f39 0 2024-03-12T16:10:33.487 INFO:tasks.workunit.client.1.smithi134.stdout:0/119: getdents db 0 2024-03-12T16:10:33.487 INFO:tasks.workunit.client.1.smithi134.stdout:8/130: dread - d3/d1b/d17/d22/d15/d2b/f2e zero size 2024-03-12T16:10:33.490 INFO:tasks.workunit.client.1.smithi134.stdout:8/131: truncate d3/d1b/d17/f1a 722703 0 2024-03-12T16:10:33.492 INFO:tasks.workunit.client.1.smithi134.stdout:8/132: chown d3/d1b/d17/d22/d15/d2b 689494 1 2024-03-12T16:10:33.497 INFO:tasks.workunit.client.1.smithi134.stdout:8/133: dread - d3/d1b/d17/d22/d15/d2b/f2e zero size 2024-03-12T16:10:33.499 INFO:tasks.workunit.client.1.smithi134.stdout:2/120: link d4/l19 d4/d12/l28 0 2024-03-12T16:10:33.500 INFO:tasks.workunit.client.1.smithi134.stdout:5/178: dread db/d12/d1d/f19 [0,4194304] 0 2024-03-12T16:10:33.502 INFO:tasks.workunit.client.1.smithi134.stdout:6/222: dwrite d1/d16/f2e [4194304,4194304] 0 2024-03-12T16:10:33.503 INFO:tasks.workunit.client.1.smithi134.stdout:2/121: fdatasync d4/d12/f18 0 2024-03-12T16:10:33.505 INFO:tasks.workunit.client.1.smithi134.stdout:5/179: truncate db/f38 1047315 0 2024-03-12T16:10:33.505 INFO:tasks.workunit.client.1.smithi134.stdout:9/138: write d5/f7 [90788,17533] 0 2024-03-12T16:10:33.506 INFO:tasks.workunit.client.1.smithi134.stdout:8/134: write d3/d1b/d17/d22/f2c [959594,5454] 0 2024-03-12T16:10:33.508 INFO:tasks.workunit.client.1.smithi134.stdout:0/120: write db/f1a [3702335,28307] 0 2024-03-12T16:10:33.508 INFO:tasks.workunit.client.1.smithi134.stdout:3/214: dwrite d1/f4 [0,4194304] 0 2024-03-12T16:10:33.510 INFO:tasks.workunit.client.1.smithi134.stdout:2/122: rename d4/d12 to d4/d12/d29 22 2024-03-12T16:10:33.512 INFO:tasks.workunit.client.1.smithi134.stdout:8/135: unlink d3/c18 0 2024-03-12T16:10:33.512 INFO:tasks.workunit.client.1.smithi134.stdout:3/215: read d1/f4 [761020,18061] 0 2024-03-12T16:10:33.513 INFO:tasks.workunit.client.1.smithi134.stdout:6/223: symlink d1/d16/d4c/d58/l5d 0 2024-03-12T16:10:33.515 INFO:tasks.workunit.client.1.smithi134.stdout:8/136: read d3/f8 [6126123,73529] 0 2024-03-12T16:10:33.515 INFO:tasks.workunit.client.1.smithi134.stdout:7/117: dwrite d8/ff [0,4194304] 0 2024-03-12T16:10:33.515 INFO:tasks.workunit.client.1.smithi134.stdout:5/180: mkdir db/d12/d1d/d3a 0 2024-03-12T16:10:33.517 INFO:tasks.workunit.client.1.smithi134.stdout:2/123: mkdir d4/d16/d2a 0 2024-03-12T16:10:33.523 INFO:tasks.workunit.client.1.smithi134.stdout:5/181: write f5 [3246269,117685] 0 2024-03-12T16:10:33.523 INFO:tasks.workunit.client.1.smithi134.stdout:3/216: fdatasync d1/db/d14/f40 0 2024-03-12T16:10:33.524 INFO:tasks.workunit.client.1.smithi134.stdout:8/137: unlink d3/d10/f16 0 2024-03-12T16:10:33.525 INFO:tasks.workunit.client.1.smithi134.stdout:3/217: fsync d1/db/f4c 0 2024-03-12T16:10:33.526 INFO:tasks.workunit.client.1.smithi134.stdout:2/124: write d4/f1b [323122,17688] 0 2024-03-12T16:10:33.529 INFO:tasks.workunit.client.1.smithi134.stdout:6/224: dread d1/d3/f3d [0,4194304] 0 2024-03-12T16:10:33.532 INFO:tasks.workunit.client.1.smithi134.stdout:7/118: mknod d8/dc/c25 0 2024-03-12T16:10:33.533 INFO:tasks.workunit.client.1.smithi134.stdout:9/139: dwrite d5/f14 [4194304,4194304] 0 2024-03-12T16:10:33.534 INFO:tasks.workunit.client.1.smithi134.stdout:0/121: dwrite fa [0,4194304] 0 2024-03-12T16:10:33.535 INFO:tasks.workunit.client.1.smithi134.stdout:5/182: mknod db/d12/c3b 0 2024-03-12T16:10:33.537 INFO:tasks.workunit.client.1.smithi134.stdout:2/125: creat d4/f2b x:0 0 0 2024-03-12T16:10:33.538 INFO:tasks.workunit.client.1.smithi134.stdout:3/218: fdatasync d1/f5 0 2024-03-12T16:10:33.539 INFO:tasks.workunit.client.1.smithi134.stdout:2/126: fsync d4/f1f 0 2024-03-12T16:10:33.540 INFO:tasks.workunit.client.1.smithi134.stdout:9/140: mkdir d5/d10/d1f 0 2024-03-12T16:10:33.541 INFO:tasks.workunit.client.1.smithi134.stdout:3/219: write d1/db/d10/d2d/d2e/f3f [2422695,57853] 0 2024-03-12T16:10:33.544 INFO:tasks.workunit.client.1.smithi134.stdout:0/122: creat db/f21 x:0 0 0 2024-03-12T16:10:33.545 INFO:tasks.workunit.client.1.smithi134.stdout:0/123: truncate db/f1f 48664 0 2024-03-12T16:10:33.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/124: write fa [3919982,118256] 0 2024-03-12T16:10:33.548 INFO:tasks.workunit.client.1.smithi134.stdout:9/141: chown d5/c9 608437552 1 2024-03-12T16:10:33.548 INFO:tasks.workunit.client.1.smithi134.stdout:3/220: creat d1/db/d10/d2a/f51 x:0 0 0 2024-03-12T16:10:33.551 INFO:tasks.workunit.client.1.smithi134.stdout:5/183: rename db/lf to db/d12/d37/l3c 0 2024-03-12T16:10:33.556 INFO:tasks.workunit.client.1.smithi134.stdout:5/184: read db/f11 [350213,8698] 0 2024-03-12T16:10:33.558 INFO:tasks.workunit.client.1.smithi134.stdout:8/138: getdents d3/d10 0 2024-03-12T16:10:33.558 INFO:tasks.workunit.client.1.smithi134.stdout:5/185: truncate db/d12/d29/f36 830471 0 2024-03-12T16:10:33.559 INFO:tasks.workunit.client.1.smithi134.stdout:8/139: fsync d3/f6 0 2024-03-12T16:10:33.561 INFO:tasks.workunit.client.1.smithi134.stdout:3/221: write d1/f5 [1171323,105160] 0 2024-03-12T16:10:33.568 INFO:tasks.workunit.client.1.smithi134.stdout:5/186: rename db/d12/d1d/d34 to db/d12/d29/d3d 0 2024-03-12T16:10:33.568 INFO:tasks.workunit.client.1.smithi134.stdout:0/125: rmdir db 39 2024-03-12T16:10:33.568 INFO:tasks.workunit.client.1.smithi134.stdout:3/222: symlink d1/db/d10/l52 0 2024-03-12T16:10:33.569 INFO:tasks.workunit.client.1.smithi134.stdout:3/223: chown d1/db/d14/f40 81178413 1 2024-03-12T16:10:33.570 INFO:tasks.workunit.client.1.smithi134.stdout:2/127: write d4/d12/f20 [630322,76098] 0 2024-03-12T16:10:33.572 INFO:tasks.workunit.client.1.smithi134.stdout:0/126: symlink db/l22 0 2024-03-12T16:10:33.573 INFO:tasks.workunit.client.1.smithi134.stdout:6/225: truncate d1/d3/d19/d32/f37 2776778 0 2024-03-12T16:10:33.573 INFO:tasks.workunit.client.1.smithi134.stdout:0/127: truncate db/f18 953016 0 2024-03-12T16:10:33.574 INFO:tasks.workunit.client.1.smithi134.stdout:3/224: symlink d1/db/d10/d2d/d2e/l53 0 2024-03-12T16:10:33.574 INFO:tasks.workunit.client.1.smithi134.stdout:6/226: dread - d1/d4/f1b zero size 2024-03-12T16:10:33.578 INFO:tasks.workunit.client.1.smithi134.stdout:5/187: creat db/d12/f3e x:0 0 0 2024-03-12T16:10:33.578 INFO:tasks.workunit.client.1.smithi134.stdout:9/142: truncate d5/fa 8043461 0 2024-03-12T16:10:33.580 INFO:tasks.workunit.client.1.smithi134.stdout:3/225: unlink d1/f6 0 2024-03-12T16:10:33.580 INFO:tasks.workunit.client.1.smithi134.stdout:2/128: dwrite d4/f2b [0,4194304] 0 2024-03-12T16:10:33.587 INFO:tasks.workunit.client.1.smithi134.stdout:2/129: write d4/d12/d1d/f21 [713224,71990] 0 2024-03-12T16:10:33.588 INFO:tasks.workunit.client.1.smithi134.stdout:0/128: dwrite fa [4194304,4194304] 0 2024-03-12T16:10:33.593 INFO:tasks.workunit.client.1.smithi134.stdout:2/130: read d4/f13 [893018,111915] 0 2024-03-12T16:10:33.595 INFO:tasks.workunit.client.1.smithi134.stdout:5/188: dwrite db/d12/f3e [0,4194304] 0 2024-03-12T16:10:33.601 INFO:tasks.workunit.client.1.smithi134.stdout:9/143: mkdir d5/d20 0 2024-03-12T16:10:33.602 INFO:tasks.workunit.client.1.smithi134.stdout:0/129: symlink db/l23 0 2024-03-12T16:10:33.604 INFO:tasks.workunit.client.1.smithi134.stdout:3/226: mknod d1/db/c54 0 2024-03-12T16:10:33.605 INFO:tasks.workunit.client.1.smithi134.stdout:2/131: dwrite d4/d12/f18 [0,4194304] 0 2024-03-12T16:10:33.606 INFO:tasks.workunit.client.1.smithi134.stdout:8/140: creat d3/d1b/d17/d22/d15/d2b/f30 x:0 0 0 2024-03-12T16:10:33.608 INFO:tasks.workunit.client.1.smithi134.stdout:5/189: mknod db/d12/d37/c3f 0 2024-03-12T16:10:33.608 INFO:tasks.workunit.client.1.smithi134.stdout:3/227: dread - d1/db/d10/d2a/f51 zero size 2024-03-12T16:10:33.609 INFO:tasks.workunit.client.1.smithi134.stdout:8/141: chown d3/f6 58079413 1 2024-03-12T16:10:33.611 INFO:tasks.workunit.client.1.smithi134.stdout:5/190: write db/d12/f3e [3095029,14992] 0 2024-03-12T16:10:33.614 INFO:tasks.workunit.client.1.smithi134.stdout:2/132: unlink d4/d16/f1c 0 2024-03-12T16:10:33.618 INFO:tasks.workunit.client.1.smithi134.stdout:8/142: write d3/d1b/d17/d22/d15/d2b/f30 [211356,49365] 0 2024-03-12T16:10:33.618 INFO:tasks.workunit.client.1.smithi134.stdout:0/130: dread db/f1a [0,4194304] 0 2024-03-12T16:10:33.619 INFO:tasks.workunit.client.1.smithi134.stdout:6/227: dwrite d1/d3/d19/f1f [0,4194304] 0 2024-03-12T16:10:33.620 INFO:tasks.workunit.client.1.smithi134.stdout:9/144: creat d5/d20/f21 x:0 0 0 2024-03-12T16:10:33.621 INFO:tasks.workunit.client.1.smithi134.stdout:3/228: rename d1/db/d14/f22 to d1/db/d10/d2d/d30/f55 0 2024-03-12T16:10:33.622 INFO:tasks.workunit.client.1.smithi134.stdout:5/191: read db/f25 [3374,22004] 0 2024-03-12T16:10:33.623 INFO:tasks.workunit.client.1.smithi134.stdout:2/133: symlink d4/l2c 0 2024-03-12T16:10:33.623 INFO:tasks.workunit.client.1.smithi134.stdout:8/143: stat d3/d1b/d17 0 2024-03-12T16:10:33.627 INFO:tasks.workunit.client.1.smithi134.stdout:3/229: read d1/db/d10/d2d/d30/f35 [659178,27338] 0 2024-03-12T16:10:33.627 INFO:tasks.workunit.client.1.smithi134.stdout:5/192: write db/f27 [2913597,57966] 0 2024-03-12T16:10:33.629 INFO:tasks.workunit.client.1.smithi134.stdout:5/193: dread - db/d12/d1d/f31 zero size 2024-03-12T16:10:33.630 INFO:tasks.workunit.client.1.smithi134.stdout:0/131: creat db/f24 x:0 0 0 2024-03-12T16:10:33.630 INFO:tasks.workunit.client.1.smithi134.stdout:2/134: rename d4/d16/c27 to d4/d16/d2a/c2d 0 2024-03-12T16:10:33.635 INFO:tasks.workunit.client.1.smithi134.stdout:0/132: symlink db/l25 0 2024-03-12T16:10:33.635 INFO:tasks.workunit.client.1.smithi134.stdout:2/135: dread d4/f1b [0,4194304] 0 2024-03-12T16:10:33.636 INFO:tasks.workunit.client.1.smithi134.stdout:3/230: mknod d1/c56 0 2024-03-12T16:10:33.638 INFO:tasks.workunit.client.1.smithi134.stdout:2/136: write d4/fa [126407,89919] 0 2024-03-12T16:10:33.639 INFO:tasks.workunit.client.1.smithi134.stdout:2/137: chown d4 6259 1 2024-03-12T16:10:33.640 INFO:tasks.workunit.client.1.smithi134.stdout:8/144: dwrite d3/d1b/f2a [0,4194304] 0 2024-03-12T16:10:33.640 INFO:tasks.workunit.client.1.smithi134.stdout:0/133: creat db/f26 x:0 0 0 2024-03-12T16:10:33.642 INFO:tasks.workunit.client.1.smithi134.stdout:0/134: fdatasync db/f10 0 2024-03-12T16:10:33.649 INFO:tasks.workunit.client.1.smithi134.stdout:5/194: creat db/d12/f40 x:0 0 0 2024-03-12T16:10:33.654 INFO:tasks.workunit.client.1.smithi134.stdout:3/231: mkdir d1/db/d57 0 2024-03-12T16:10:33.657 INFO:tasks.workunit.client.1.smithi134.stdout:8/145: truncate d3/d1b/f14 536604 0 2024-03-12T16:10:33.660 INFO:tasks.workunit.client.1.smithi134.stdout:0/135: rmdir db 39 2024-03-12T16:10:33.660 INFO:tasks.workunit.client.1.smithi134.stdout:2/138: dwrite d4/d12/f18 [0,4194304] 0 2024-03-12T16:10:33.664 INFO:tasks.workunit.client.1.smithi134.stdout:6/228: dread d1/d4/f42 [0,4194304] 0 2024-03-12T16:10:33.666 INFO:tasks.workunit.client.1.smithi134.stdout:6/229: fdatasync d1/f1d 0 2024-03-12T16:10:33.667 INFO:tasks.workunit.client.1.smithi134.stdout:2/139: chown d4/c9 330594805 1 2024-03-12T16:10:33.668 INFO:tasks.workunit.client.1.smithi134.stdout:5/195: dwrite db/d12/f40 [0,4194304] 0 2024-03-12T16:10:33.670 INFO:tasks.workunit.client.1.smithi134.stdout:0/136: mknod db/c27 0 2024-03-12T16:10:33.679 INFO:tasks.workunit.client.1.smithi134.stdout:0/137: creat db/f28 x:0 0 0 2024-03-12T16:10:33.680 INFO:tasks.workunit.client.1.smithi134.stdout:3/232: dwrite d1/db/d10/f4f [0,4194304] 0 2024-03-12T16:10:33.683 INFO:tasks.workunit.client.1.smithi134.stdout:9/145: dread d5/fa [4194304,4194304] 0 2024-03-12T16:10:33.685 INFO:tasks.workunit.client.1.smithi134.stdout:0/138: creat db/f29 x:0 0 0 2024-03-12T16:10:33.686 INFO:tasks.workunit.client.1.smithi134.stdout:0/139: chown db/l23 40310 1 2024-03-12T16:10:33.686 INFO:tasks.workunit.client.1.smithi134.stdout:0/140: stat l3 0 2024-03-12T16:10:33.690 INFO:tasks.workunit.client.1.smithi134.stdout:6/230: creat d1/d3/d19/f5e x:0 0 0 2024-03-12T16:10:33.690 INFO:tasks.workunit.client.1.smithi134.stdout:8/146: dwrite d3/d1b/d17/d24/f2d [4194304,4194304] 0 2024-03-12T16:10:33.690 INFO:tasks.workunit.client.1.smithi134.stdout:5/196: getdents db/d12/d29 0 2024-03-12T16:10:33.690 INFO:tasks.workunit.client.1.smithi134.stdout:0/141: creat db/f2a x:0 0 0 2024-03-12T16:10:33.693 INFO:tasks.workunit.client.1.smithi134.stdout:3/233: write d1/db/d10/d2a/f44 [982323,74861] 0 2024-03-12T16:10:33.695 INFO:tasks.workunit.client.1.smithi134.stdout:2/140: dwrite d4/d12/d1d/f21 [0,4194304] 0 2024-03-12T16:10:33.695 INFO:tasks.workunit.client.1.smithi134.stdout:3/234: chown d1 11 1 2024-03-12T16:10:33.696 INFO:tasks.workunit.client.1.smithi134.stdout:8/147: mkdir d3/d10/d31 0 2024-03-12T16:10:33.697 INFO:tasks.workunit.client.1.smithi134.stdout:0/142: truncate db/f1c 328674 0 2024-03-12T16:10:33.697 INFO:tasks.workunit.client.1.smithi134.stdout:9/146: creat d5/d13/f22 x:0 0 0 2024-03-12T16:10:33.697 INFO:tasks.workunit.client.1.smithi134.stdout:6/231: mknod d1/d16/d4c/d58/c5f 0 2024-03-12T16:10:33.702 INFO:tasks.workunit.client.1.smithi134.stdout:3/235: rmdir d1 39 2024-03-12T16:10:33.704 INFO:tasks.workunit.client.1.smithi134.stdout:9/147: write d5/d10/f1c [1001326,55223] 0 2024-03-12T16:10:33.707 INFO:tasks.workunit.client.1.smithi134.stdout:2/141: mkdir d4/d2e 0 2024-03-12T16:10:33.707 INFO:tasks.workunit.client.1.smithi134.stdout:9/148: read - d5/d13/f22 zero size 2024-03-12T16:10:33.710 INFO:tasks.workunit.client.1.smithi134.stdout:8/148: dread d3/d1b/d17/d22/d15/d2b/f30 [0,4194304] 0 2024-03-12T16:10:33.710 INFO:tasks.workunit.client.1.smithi134.stdout:3/236: readlink d1/db/l11 0 2024-03-12T16:10:33.713 INFO:tasks.workunit.client.1.smithi134.stdout:5/197: dwrite db/d12/d29/f36 [0,4194304] 0 2024-03-12T16:10:33.715 INFO:tasks.workunit.client.1.smithi134.stdout:2/142: write d4/d12/f14 [790547,5928] 0 2024-03-12T16:10:33.718 INFO:tasks.workunit.client.1.smithi134.stdout:8/149: write d3/d1b/fa [3623577,87010] 0 2024-03-12T16:10:33.721 INFO:tasks.workunit.client.1.smithi134.stdout:8/150: chown d3/d10/d31 3282102 1 2024-03-12T16:10:33.722 INFO:tasks.workunit.client.1.smithi134.stdout:2/143: symlink d4/d12/d1d/l2f 0 2024-03-12T16:10:33.724 INFO:tasks.workunit.client.1.smithi134.stdout:3/237: getdents d1/db/d10/d2d/d30/d49 0 2024-03-12T16:10:33.725 INFO:tasks.workunit.client.1.smithi134.stdout:6/232: dwrite d1/d4/f14 [0,4194304] 0 2024-03-12T16:10:33.730 INFO:tasks.workunit.client.1.smithi134.stdout:8/151: write d3/fe [6615824,40351] 0 2024-03-12T16:10:33.732 INFO:tasks.workunit.client.1.smithi134.stdout:0/143: dread db/fc [0,4194304] 0 2024-03-12T16:10:33.735 INFO:tasks.workunit.client.1.smithi134.stdout:2/144: mknod d4/d12/d1d/c30 0 2024-03-12T16:10:33.739 INFO:tasks.workunit.client.1.smithi134.stdout:8/152: dread d3/d1b/d17/d22/d15/d2b/f30 [0,4194304] 0 2024-03-12T16:10:33.739 INFO:tasks.workunit.client.1.smithi134.stdout:0/144: dread db/f1c [0,4194304] 0 2024-03-12T16:10:33.740 INFO:tasks.workunit.client.1.smithi134.stdout:9/149: dwrite d5/fe [0,4194304] 0 2024-03-12T16:10:33.742 INFO:tasks.workunit.client.1.smithi134.stdout:5/198: dwrite db/d12/d1d/f31 [0,4194304] 0 2024-03-12T16:10:33.745 INFO:tasks.workunit.client.1.smithi134.stdout:5/199: read db/d12/d1d/f31 [653681,89949] 0 2024-03-12T16:10:33.747 INFO:tasks.workunit.client.1.smithi134.stdout:0/145: mknod db/c2b 0 2024-03-12T16:10:33.749 INFO:tasks.workunit.client.1.smithi134.stdout:5/200: truncate db/d12/d1d/f22 5169737 0 2024-03-12T16:10:33.750 INFO:tasks.workunit.client.1.smithi134.stdout:8/153: dread d3/d1b/d17/d24/f2d [0,4194304] 0 2024-03-12T16:10:33.752 INFO:tasks.workunit.client.1.smithi134.stdout:9/150: dread d5/f14 [0,4194304] 0 2024-03-12T16:10:33.753 INFO:tasks.workunit.client.1.smithi134.stdout:3/238: write d1/db/d10/d2d/f4e [214169,114957] 0 2024-03-12T16:10:33.755 INFO:tasks.workunit.client.1.smithi134.stdout:2/145: truncate d4/f2b 3083355 0 2024-03-12T16:10:33.757 INFO:tasks.workunit.client.1.smithi134.stdout:5/201: mknod db/c41 0 2024-03-12T16:10:33.760 INFO:tasks.workunit.client.1.smithi134.stdout:0/146: dwrite db/f24 [0,4194304] 0 2024-03-12T16:10:33.761 INFO:tasks.workunit.client.1.smithi134.stdout:0/147: fdatasync db/f2a 0 2024-03-12T16:10:33.762 INFO:tasks.workunit.client.1.smithi134.stdout:0/148: write db/f28 [538721,36843] 0 2024-03-12T16:10:33.763 INFO:tasks.workunit.client.1.smithi134.stdout:9/151: rename d5/d10/f18 to d5/d20/f23 0 2024-03-12T16:10:33.764 INFO:tasks.workunit.client.1.smithi134.stdout:0/149: chown db/c2b 36 1 2024-03-12T16:10:33.766 INFO:tasks.workunit.client.1.smithi134.stdout:5/202: unlink db/d12/d1d/l24 0 2024-03-12T16:10:33.769 INFO:tasks.workunit.client.1.smithi134.stdout:9/152: unlink d5/d10/f15 0 2024-03-12T16:10:33.769 INFO:tasks.workunit.client.1.smithi134.stdout:5/203: dread db/f38 [0,4194304] 0 2024-03-12T16:10:33.772 INFO:tasks.workunit.client.1.smithi134.stdout:0/150: rename db/f28 to db/f2c 0 2024-03-12T16:10:33.775 INFO:tasks.workunit.client.1.smithi134.stdout:3/239: creat d1/db/f58 x:0 0 0 2024-03-12T16:10:33.775 INFO:tasks.workunit.client.1.smithi134.stdout:9/153: dread d5/fa [4194304,4194304] 0 2024-03-12T16:10:33.776 INFO:tasks.workunit.client.1.smithi134.stdout:3/240: fdatasync d1/f36 0 2024-03-12T16:10:33.778 INFO:tasks.workunit.client.1.smithi134.stdout:8/154: write d3/d1b/f19 [1364917,21397] 0 2024-03-12T16:10:33.779 INFO:tasks.workunit.client.1.smithi134.stdout:5/204: creat db/d12/d37/f42 x:0 0 0 2024-03-12T16:10:33.783 INFO:tasks.workunit.client.1.smithi134.stdout:0/151: rename db/f2a to db/f2d 0 2024-03-12T16:10:33.784 INFO:tasks.workunit.client.1.smithi134.stdout:0/152: chown db/fc 53 1 2024-03-12T16:10:33.785 INFO:tasks.workunit.client.1.smithi134.stdout:9/154: stat d5/c6 0 2024-03-12T16:10:33.785 INFO:tasks.workunit.client.1.smithi134.stdout:8/155: dwrite d3/d1b/f2a [0,4194304] 0 2024-03-12T16:10:33.786 INFO:tasks.workunit.client.1.smithi134.stdout:9/155: dread - d5/d20/f21 zero size 2024-03-12T16:10:33.788 INFO:tasks.workunit.client.1.smithi134.stdout:2/146: truncate d4/fa 568078 0 2024-03-12T16:10:33.792 INFO:tasks.workunit.client.1.smithi134.stdout:9/156: dread d5/fa [4194304,4194304] 0 2024-03-12T16:10:33.792 INFO:tasks.workunit.client.1.smithi134.stdout:5/205: symlink db/d12/d29/d3d/l43 0 2024-03-12T16:10:33.795 INFO:tasks.workunit.client.1.smithi134.stdout:0/153: rename db/l23 to db/l2e 0 2024-03-12T16:10:33.797 INFO:tasks.workunit.client.1.smithi134.stdout:0/154: write fa [5904014,6716] 0 2024-03-12T16:10:33.797 INFO:tasks.workunit.client.1.smithi134.stdout:8/156: creat d3/d1b/d17/d22/d15/d2b/f32 x:0 0 0 2024-03-12T16:10:33.798 INFO:tasks.workunit.client.1.smithi134.stdout:0/155: dread - db/f26 zero size 2024-03-12T16:10:33.798 INFO:tasks.workunit.client.1.smithi134.stdout:5/206: dread db/d12/d29/f36 [0,4194304] 0 2024-03-12T16:10:33.799 INFO:tasks.workunit.client.1.smithi134.stdout:0/156: chown db/f1d 163 1 2024-03-12T16:10:33.799 INFO:tasks.workunit.client.1.smithi134.stdout:5/207: chown db/d12/d37 59089194 1 2024-03-12T16:10:33.803 INFO:tasks.workunit.client.1.smithi134.stdout:5/208: dread db/d12/d1d/f31 [0,4194304] 0 2024-03-12T16:10:33.899 INFO:tasks.workunit.client.1.smithi134.stdout:2/147: mknod d4/d2e/c31 0 2024-03-12T16:10:33.900 INFO:tasks.workunit.client.1.smithi134.stdout:0/157: mkdir db/d2f 0 2024-03-12T16:10:33.906 INFO:tasks.workunit.client.1.smithi134.stdout:4/161: sync 2024-03-12T16:10:33.907 INFO:tasks.workunit.client.1.smithi134.stdout:3/241: truncate d1/db/d10/d2a/f44 1052371 0 2024-03-12T16:10:33.907 INFO:tasks.workunit.client.1.smithi134.stdout:8/157: rename d3/d1b/d17/d22 to d3/d1b/d17/d25/d33 0 2024-03-12T16:10:33.909 INFO:tasks.workunit.client.1.smithi134.stdout:2/148: creat d4/d12/f32 x:0 0 0 2024-03-12T16:10:33.912 INFO:tasks.workunit.client.1.smithi134.stdout:3/242: creat d1/db/d14/f59 x:0 0 0 2024-03-12T16:10:33.913 INFO:tasks.workunit.client.1.smithi134.stdout:8/158: creat d3/d1b/d17/d25/d33/f34 x:0 0 0 2024-03-12T16:10:33.914 INFO:tasks.workunit.client.1.smithi134.stdout:5/209: mknod db/c44 0 2024-03-12T16:10:33.916 INFO:tasks.workunit.client.1.smithi134.stdout:0/158: creat db/d2f/f30 x:0 0 0 2024-03-12T16:10:33.917 INFO:tasks.workunit.client.1.smithi134.stdout:9/157: truncate d5/fe 3424917 0 2024-03-12T16:10:33.921 INFO:tasks.workunit.client.1.smithi134.stdout:4/162: symlink d1/l38 0 2024-03-12T16:10:33.922 INFO:tasks.workunit.client.1.smithi134.stdout:8/159: dwrite d3/d1b/d17/d25/d33/f34 [0,4194304] 0 2024-03-12T16:10:33.922 INFO:tasks.workunit.client.1.smithi134.stdout:4/163: fsync d1/de/f30 0 2024-03-12T16:10:33.923 INFO:tasks.workunit.client.1.smithi134.stdout:8/160: stat d3/d1b/d17/d24/f2d 0 2024-03-12T16:10:33.924 INFO:tasks.workunit.client.1.smithi134.stdout:3/243: rename d1/db/d10/d2d/d30/d49 to d1/db/d14/d5a 0 2024-03-12T16:10:33.926 INFO:tasks.workunit.client.1.smithi134.stdout:5/210: rmdir db/d12/d37 39 2024-03-12T16:10:33.931 INFO:tasks.workunit.client.1.smithi134.stdout:8/161: rmdir d3/d1b/d17/d25/d33/d15/d2b 39 2024-03-12T16:10:33.933 INFO:tasks.workunit.client.1.smithi134.stdout:8/162: write d3/d1b/f14 [2167573,15857] 0 2024-03-12T16:10:33.933 INFO:tasks.workunit.client.1.smithi134.stdout:5/211: fdatasync db/d12/d1d/f22 0 2024-03-12T16:10:33.934 INFO:tasks.workunit.client.1.smithi134.stdout:8/163: readlink d3/d10/l11 0 2024-03-12T16:10:33.935 INFO:tasks.workunit.client.1.smithi134.stdout:8/164: read d3/fe [3865552,5335] 0 2024-03-12T16:10:33.936 INFO:tasks.workunit.client.1.smithi134.stdout:9/158: creat d5/d10/d1f/f24 x:0 0 0 2024-03-12T16:10:33.938 INFO:tasks.workunit.client.1.smithi134.stdout:9/159: write d5/d10/f1c [1447981,116352] 0 2024-03-12T16:10:33.939 INFO:tasks.workunit.client.1.smithi134.stdout:8/165: dread d3/d1b/d17/f1a [0,4194304] 0 2024-03-12T16:10:33.944 INFO:tasks.workunit.client.1.smithi134.stdout:3/244: rename d1/db/c4a to d1/db/d10/d2d/d2e/c5b 0 2024-03-12T16:10:33.947 INFO:tasks.workunit.client.1.smithi134.stdout:8/166: dwrite d3/f6 [0,4194304] 0 2024-03-12T16:10:33.949 INFO:tasks.workunit.client.1.smithi134.stdout:0/159: truncate db/f1a 2963768 0 2024-03-12T16:10:33.949 INFO:tasks.workunit.client.1.smithi134.stdout:2/149: link d4/d16/c25 d4/d16/d2a/c33 0 2024-03-12T16:10:33.950 INFO:tasks.workunit.client.1.smithi134.stdout:8/167: write d3/d1b/d17/d25/d33/f34 [4600587,2680] 0 2024-03-12T16:10:33.950 INFO:tasks.workunit.client.1.smithi134.stdout:2/150: chown d4/d2e/c31 14 1 2024-03-12T16:10:33.954 INFO:tasks.workunit.client.1.smithi134.stdout:5/212: dread db/d12/d1d/f22 [0,4194304] 0 2024-03-12T16:10:33.955 INFO:tasks.workunit.client.1.smithi134.stdout:0/160: mkdir db/d2f/d31 0 2024-03-12T16:10:33.957 INFO:tasks.workunit.client.1.smithi134.stdout:2/151: dread d4/d12/d1d/f21 [0,4194304] 0 2024-03-12T16:10:33.959 INFO:tasks.workunit.client.1.smithi134.stdout:5/213: dread db/f25 [0,4194304] 0 2024-03-12T16:10:33.961 INFO:tasks.workunit.client.1.smithi134.stdout:3/245: rmdir d1/db/d57 0 2024-03-12T16:10:33.964 INFO:tasks.workunit.client.1.smithi134.stdout:0/161: unlink db/f29 0 2024-03-12T16:10:33.967 INFO:tasks.workunit.client.1.smithi134.stdout:9/160: getdents d5/d10/d1f 0 2024-03-12T16:10:33.967 INFO:tasks.workunit.client.1.smithi134.stdout:2/152: dwrite d4/f1f [4194304,4194304] 0 2024-03-12T16:10:33.968 INFO:tasks.workunit.client.1.smithi134.stdout:8/168: unlink d3/d1b/d17/d25/d33/d15/d1c/c2f 0 2024-03-12T16:10:33.968 INFO:tasks.workunit.client.1.smithi134.stdout:2/153: fdatasync d4/d12/f14 0 2024-03-12T16:10:33.975 INFO:tasks.workunit.client.1.smithi134.stdout:3/246: rename d1/db/d12/l1a to d1/db/d10/d2d/d2e/l5c 0 2024-03-12T16:10:33.981 INFO:tasks.workunit.client.1.smithi134.stdout:5/214: dwrite db/d12/d1d/f31 [0,4194304] 0 2024-03-12T16:10:33.983 INFO:tasks.workunit.client.1.smithi134.stdout:2/154: rmdir d4/d16/d2a 39 2024-03-12T16:10:33.984 INFO:tasks.workunit.client.1.smithi134.stdout:5/215: chown db/d12/d1d/c20 848 1 2024-03-12T16:10:33.984 INFO:tasks.workunit.client.1.smithi134.stdout:3/247: creat d1/db/d14/f5d x:0 0 0 2024-03-12T16:10:33.986 INFO:tasks.workunit.client.1.smithi134.stdout:0/162: symlink db/d2f/d31/l32 0 2024-03-12T16:10:33.987 INFO:tasks.workunit.client.1.smithi134.stdout:0/163: chown f7 24807 1 2024-03-12T16:10:33.989 INFO:tasks.workunit.client.1.smithi134.stdout:2/155: rmdir d4 39 2024-03-12T16:10:33.991 INFO:tasks.workunit.client.1.smithi134.stdout:5/216: symlink db/d12/d32/l45 0 2024-03-12T16:10:33.991 INFO:tasks.workunit.client.1.smithi134.stdout:8/169: dwrite d3/d1b/d17/d24/f2d [4194304,4194304] 0 2024-03-12T16:10:33.996 INFO:tasks.workunit.client.1.smithi134.stdout:0/164: rename db/l25 to db/d2f/l33 0 2024-03-12T16:10:33.997 INFO:tasks.workunit.client.1.smithi134.stdout:9/161: write d5/d13/f1a [967542,109440] 0 2024-03-12T16:10:34.000 INFO:tasks.workunit.client.1.smithi134.stdout:2/156: mkdir d4/d12/d1d/d34 0 2024-03-12T16:10:34.001 INFO:tasks.workunit.client.1.smithi134.stdout:8/170: creat d3/d1b/d17/d25/d33/d15/d1c/f35 x:0 0 0 2024-03-12T16:10:34.002 INFO:tasks.workunit.client.1.smithi134.stdout:3/248: getdents d1/db/d10/d2d/d2e 0 2024-03-12T16:10:34.007 INFO:tasks.workunit.client.1.smithi134.stdout:0/165: link db/c2b db/d2f/d31/c34 0 2024-03-12T16:10:34.009 INFO:tasks.workunit.client.1.smithi134.stdout:5/217: link db/d12/l2e db/d12/l46 0 2024-03-12T16:10:34.010 INFO:tasks.workunit.client.1.smithi134.stdout:9/162: getdents d5/d20 0 2024-03-12T16:10:34.012 INFO:tasks.workunit.client.1.smithi134.stdout:8/171: rename d3/d1b/d17/l23 to d3/d1b/l36 0 2024-03-12T16:10:34.014 INFO:tasks.workunit.client.1.smithi134.stdout:5/218: chown db/d12/d37/f39 0 1 2024-03-12T16:10:34.015 INFO:tasks.workunit.client.1.smithi134.stdout:5/219: fsync db/d12/f40 0 2024-03-12T16:10:34.015 INFO:tasks.workunit.client.1.smithi134.stdout:0/166: link db/f1d db/f35 0 2024-03-12T16:10:34.019 INFO:tasks.workunit.client.1.smithi134.stdout:2/157: rename d4/ff to d4/d16/d2a/f35 0 2024-03-12T16:10:34.019 INFO:tasks.workunit.client.1.smithi134.stdout:0/167: dread db/f14 [0,4194304] 0 2024-03-12T16:10:34.020 INFO:tasks.workunit.client.1.smithi134.stdout:2/158: dread - d4/f26 zero size 2024-03-12T16:10:34.022 INFO:tasks.workunit.client.1.smithi134.stdout:3/249: write d1/db/d12/f27 [695976,87406] 0 2024-03-12T16:10:34.022 INFO:tasks.workunit.client.1.smithi134.stdout:9/163: getdents d5/d20 0 2024-03-12T16:10:34.026 INFO:tasks.workunit.client.1.smithi134.stdout:2/159: rename d4/d12/f14 to d4/d16/d2a/f36 0 2024-03-12T16:10:34.028 INFO:tasks.workunit.client.1.smithi134.stdout:2/160: dread - d4/d12/f32 zero size 2024-03-12T16:10:34.030 INFO:tasks.workunit.client.1.smithi134.stdout:0/168: dwrite db/f2c [0,4194304] 0 2024-03-12T16:10:34.031 INFO:tasks.workunit.client.1.smithi134.stdout:3/250: creat d1/db/d10/d2d/f5e x:0 0 0 2024-03-12T16:10:34.035 INFO:tasks.workunit.client.1.smithi134.stdout:2/161: write d4/f1b [84565,20270] 0 2024-03-12T16:10:34.037 INFO:tasks.workunit.client.1.smithi134.stdout:3/251: mkdir d1/db/d14/d5f 0 2024-03-12T16:10:34.039 INFO:tasks.workunit.client.1.smithi134.stdout:0/169: dwrite db/f1f [0,4194304] 0 2024-03-12T16:10:34.041 INFO:tasks.workunit.client.1.smithi134.stdout:2/162: stat d4/f2b 0 2024-03-12T16:10:34.041 INFO:tasks.workunit.client.1.smithi134.stdout:8/172: write d3/d1b/d17/d25/d33/d15/d2b/f30 [831016,27740] 0 2024-03-12T16:10:34.042 INFO:tasks.workunit.client.1.smithi134.stdout:3/252: truncate d1/db/d14/f5d 955693 0 2024-03-12T16:10:34.044 INFO:tasks.workunit.client.1.smithi134.stdout:3/253: fdatasync d1/db/d10/d2d/f33 0 2024-03-12T16:10:34.046 INFO:tasks.workunit.client.1.smithi134.stdout:0/170: truncate db/f1a 134341 0 2024-03-12T16:10:34.052 INFO:tasks.workunit.client.1.smithi134.stdout:0/171: rename c8 to db/d2f/d31/c36 0 2024-03-12T16:10:34.052 INFO:tasks.workunit.client.1.smithi134.stdout:9/164: write d5/fe [3927492,45727] 0 2024-03-12T16:10:34.054 INFO:tasks.workunit.client.1.smithi134.stdout:0/172: chown db/f35 11 1 2024-03-12T16:10:34.054 INFO:tasks.workunit.client.1.smithi134.stdout:8/173: dwrite d3/d1b/d17/d25/d33/d15/d1c/f35 [0,4194304] 0 2024-03-12T16:10:34.056 INFO:tasks.workunit.client.1.smithi134.stdout:0/173: dread - db/f1d zero size 2024-03-12T16:10:34.056 INFO:tasks.workunit.client.1.smithi134.stdout:9/165: rmdir d5/d13 39 2024-03-12T16:10:34.057 INFO:tasks.workunit.client.1.smithi134.stdout:8/174: write d3/fe [2179007,65680] 0 2024-03-12T16:10:34.068 INFO:tasks.workunit.client.1.smithi134.stdout:8/175: rename d3/d1b/d17/d25/d33/f2c to d3/d1b/d17/d25/d33/d15/d2b/f37 0 2024-03-12T16:10:34.071 INFO:tasks.workunit.client.1.smithi134.stdout:2/163: dwrite d4/fa [0,4194304] 0 2024-03-12T16:10:34.071 INFO:tasks.workunit.client.1.smithi134.stdout:0/174: rmdir db 39 2024-03-12T16:10:34.076 INFO:tasks.workunit.client.1.smithi134.stdout:8/176: read d3/d1b/f14 [214506,62411] 0 2024-03-12T16:10:34.077 INFO:tasks.workunit.client.1.smithi134.stdout:3/254: dwrite d1/db/d10/f1f [0,4194304] 0 2024-03-12T16:10:34.077 INFO:tasks.workunit.client.1.smithi134.stdout:8/177: stat d3/f6 0 2024-03-12T16:10:34.078 INFO:tasks.workunit.client.1.smithi134.stdout:2/164: creat d4/d12/d1d/f37 x:0 0 0 2024-03-12T16:10:34.080 INFO:tasks.workunit.client.1.smithi134.stdout:3/255: write d1/db/d10/d2d/d2e/f3f [316969,43163] 0 2024-03-12T16:10:34.082 INFO:tasks.workunit.client.1.smithi134.stdout:0/175: mknod db/d2f/d31/c37 0 2024-03-12T16:10:34.083 INFO:tasks.workunit.client.1.smithi134.stdout:3/256: write d1/db/d12/f27 [1353054,101376] 0 2024-03-12T16:10:34.086 INFO:tasks.workunit.client.1.smithi134.stdout:9/166: dread d5/d13/f1a [0,4194304] 0 2024-03-12T16:10:34.089 INFO:tasks.workunit.client.1.smithi134.stdout:0/176: dread db/f1f [0,4194304] 0 2024-03-12T16:10:34.090 INFO:tasks.workunit.client.1.smithi134.stdout:3/257: rmdir d1/db/d10/d2a 39 2024-03-12T16:10:34.091 INFO:tasks.workunit.client.1.smithi134.stdout:0/177: fdatasync db/f26 0 2024-03-12T16:10:34.092 INFO:tasks.workunit.client.1.smithi134.stdout:2/165: mknod d4/d16/c38 0 2024-03-12T16:10:34.094 INFO:tasks.workunit.client.1.smithi134.stdout:2/166: dread - d4/f26 zero size 2024-03-12T16:10:34.095 INFO:tasks.workunit.client.1.smithi134.stdout:0/178: creat db/f38 x:0 0 0 2024-03-12T16:10:34.097 INFO:tasks.workunit.client.1.smithi134.stdout:9/167: dwrite d5/d13/f22 [0,4194304] 0 2024-03-12T16:10:34.097 INFO:tasks.workunit.client.1.smithi134.stdout:3/258: creat d1/db/d12/f60 x:0 0 0 2024-03-12T16:10:34.099 INFO:tasks.workunit.client.1.smithi134.stdout:2/167: mkdir d4/d12/d39 0 2024-03-12T16:10:34.102 INFO:tasks.workunit.client.1.smithi134.stdout:9/168: write d5/d13/f1a [2635633,65850] 0 2024-03-12T16:10:34.103 INFO:tasks.workunit.client.1.smithi134.stdout:3/259: truncate d1/db/d10/d2a/f51 815435 0 2024-03-12T16:10:34.104 INFO:tasks.workunit.client.1.smithi134.stdout:2/168: creat d4/d2e/f3a x:0 0 0 2024-03-12T16:10:34.106 INFO:tasks.workunit.client.1.smithi134.stdout:3/260: symlink d1/db/d10/d2a/l61 0 2024-03-12T16:10:34.111 INFO:tasks.workunit.client.1.smithi134.stdout:2/169: stat d4/d16/d2a/c33 0 2024-03-12T16:10:34.111 INFO:tasks.workunit.client.1.smithi134.stdout:2/170: fsync d4/f26 0 2024-03-12T16:10:34.111 INFO:tasks.workunit.client.1.smithi134.stdout:9/169: mknod d5/c25 0 2024-03-12T16:10:34.111 INFO:tasks.workunit.client.1.smithi134.stdout:2/171: mkdir d4/d12/d3b 0 2024-03-12T16:10:34.111 INFO:tasks.workunit.client.1.smithi134.stdout:3/261: mknod d1/db/c62 0 2024-03-12T16:10:34.114 INFO:tasks.workunit.client.1.smithi134.stdout:3/262: mkdir d1/d63 0 2024-03-12T16:10:34.118 INFO:tasks.workunit.client.1.smithi134.stdout:0/179: dwrite db/f14 [0,4194304] 0 2024-03-12T16:10:34.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/172: dwrite d4/d12/f22 [0,4194304] 0 2024-03-12T16:10:34.119 INFO:tasks.workunit.client.1.smithi134.stdout:8/178: dread d3/f8 [0,4194304] 0 2024-03-12T16:10:34.120 INFO:tasks.workunit.client.1.smithi134.stdout:2/173: read d4/fa [3714524,94082] 0 2024-03-12T16:10:34.120 INFO:tasks.workunit.client.1.smithi134.stdout:2/174: readlink d4/l2c 0 2024-03-12T16:10:34.169 INFO:tasks.workunit.client.1.smithi134.stdout:1/117: sync 2024-03-12T16:10:34.170 INFO:tasks.workunit.client.1.smithi134.stdout:3/263: symlink d1/db/l64 0 2024-03-12T16:10:34.170 INFO:tasks.workunit.client.1.smithi134.stdout:0/180: symlink db/d2f/d31/l39 0 2024-03-12T16:10:34.171 INFO:tasks.workunit.client.1.smithi134.stdout:0/181: chown db/l22 57 1 2024-03-12T16:10:34.173 INFO:tasks.workunit.client.1.smithi134.stdout:2/175: mkdir d4/d3c 0 2024-03-12T16:10:34.173 INFO:tasks.workunit.client.1.smithi134.stdout:0/182: dread - db/d2f/f30 zero size 2024-03-12T16:10:34.180 INFO:tasks.workunit.client.1.smithi134.stdout:0/183: creat db/d2f/d31/f3a x:0 0 0 2024-03-12T16:10:34.181 INFO:tasks.workunit.client.1.smithi134.stdout:1/118: dwrite d0/f4 [4194304,4194304] 0 2024-03-12T16:10:34.182 INFO:tasks.workunit.client.1.smithi134.stdout:2/176: mkdir d4/d16/d3d 0 2024-03-12T16:10:34.183 INFO:tasks.workunit.client.1.smithi134.stdout:8/179: dwrite d3/d1b/f2a [0,4194304] 0 2024-03-12T16:10:34.184 INFO:tasks.workunit.client.1.smithi134.stdout:1/119: chown d0/d16/d9/d1c/f1d 636 1 2024-03-12T16:10:34.187 INFO:tasks.workunit.client.1.smithi134.stdout:3/264: dread d1/db/d12/f1e [0,4194304] 0 2024-03-12T16:10:34.188 INFO:tasks.workunit.client.1.smithi134.stdout:0/184: rename db/f18 to db/d2f/d31/f3b 0 2024-03-12T16:10:34.189 INFO:tasks.workunit.client.1.smithi134.stdout:8/180: readlink d3/d1b/lf 0 2024-03-12T16:10:34.191 INFO:tasks.workunit.client.1.smithi134.stdout:1/120: mknod d0/d16/d9/d1c/c2d 0 2024-03-12T16:10:34.191 INFO:tasks.workunit.client.1.smithi134.stdout:2/177: rename d4/d16 to d4/d16/d3e 22 2024-03-12T16:10:34.197 INFO:tasks.workunit.client.1.smithi134.stdout:8/181: unlink d3/d1b/fa 0 2024-03-12T16:10:34.197 INFO:tasks.workunit.client.1.smithi134.stdout:0/185: dread db/f2c [0,4194304] 0 2024-03-12T16:10:34.199 INFO:tasks.workunit.client.1.smithi134.stdout:1/121: mknod d0/d16/c2e 0 2024-03-12T16:10:34.201 INFO:tasks.workunit.client.1.smithi134.stdout:0/186: creat db/f3c x:0 0 0 2024-03-12T16:10:34.205 INFO:tasks.workunit.client.1.smithi134.stdout:0/187: symlink db/d2f/d31/l3d 0 2024-03-12T16:10:34.208 INFO:tasks.workunit.client.1.smithi134.stdout:1/122: mkdir d0/d16/d9/d13/d21/d2f 0 2024-03-12T16:10:34.209 INFO:tasks.workunit.client.1.smithi134.stdout:1/123: stat d0/d16/d9/d1c/c2d 0 2024-03-12T16:10:34.209 INFO:tasks.workunit.client.1.smithi134.stdout:1/124: write d0/f2a [760299,2848] 0 2024-03-12T16:10:34.210 INFO:tasks.workunit.client.1.smithi134.stdout:0/188: rename db/l22 to db/d2f/d31/l3e 0 2024-03-12T16:10:34.214 INFO:tasks.workunit.client.1.smithi134.stdout:1/125: mkdir d0/d30 0 2024-03-12T16:10:34.214 INFO:tasks.workunit.client.1.smithi134.stdout:3/265: dread d1/db/d10/d2d/f33 [0,4194304] 0 2024-03-12T16:10:34.215 INFO:tasks.workunit.client.1.smithi134.stdout:1/126: fsync d0/d16/d9/d1c/f27 0 2024-03-12T16:10:34.215 INFO:tasks.workunit.client.1.smithi134.stdout:2/178: write d4/fc [398101,18373] 0 2024-03-12T16:10:34.216 INFO:tasks.workunit.client.1.smithi134.stdout:0/189: dread db/f1a [0,4194304] 0 2024-03-12T16:10:34.218 INFO:tasks.workunit.client.1.smithi134.stdout:8/182: write d3/d1b/f1f [933906,55802] 0 2024-03-12T16:10:34.221 INFO:tasks.workunit.client.1.smithi134.stdout:1/127: creat d0/d16/f31 x:0 0 0 2024-03-12T16:10:34.223 INFO:tasks.workunit.client.1.smithi134.stdout:3/266: rename d1/db/d14/d5a/f50 to d1/f65 0 2024-03-12T16:10:34.224 INFO:tasks.workunit.client.1.smithi134.stdout:1/128: write d0/d16/f18 [445864,120715] 0 2024-03-12T16:10:34.227 INFO:tasks.workunit.client.1.smithi134.stdout:8/183: write d3/d1b/f1d [4308791,99830] 0 2024-03-12T16:10:34.229 INFO:tasks.workunit.client.1.smithi134.stdout:0/190: dwrite db/d2f/f30 [0,4194304] 0 2024-03-12T16:10:34.232 INFO:tasks.workunit.client.1.smithi134.stdout:2/179: dwrite d4/f1b [0,4194304] 0 2024-03-12T16:10:34.232 INFO:tasks.workunit.client.1.smithi134.stdout:3/267: creat d1/f66 x:0 0 0 2024-03-12T16:10:34.235 INFO:tasks.workunit.client.1.smithi134.stdout:2/180: write d4/fc [1962069,91664] 0 2024-03-12T16:10:34.239 INFO:tasks.workunit.client.1.smithi134.stdout:1/129: dwrite d0/d16/d9/d13/d21/f23 [0,4194304] 0 2024-03-12T16:10:34.239 INFO:tasks.workunit.client.1.smithi134.stdout:0/191: rename fa to db/d2f/d31/f3f 0 2024-03-12T16:10:34.244 INFO:tasks.workunit.client.1.smithi134.stdout:8/184: mknod d3/c38 0 2024-03-12T16:10:34.244 INFO:tasks.workunit.client.1.smithi134.stdout:8/185: chown d3/d1b/d17/f1a 305291 1 2024-03-12T16:10:34.247 INFO:tasks.workunit.client.1.smithi134.stdout:1/130: rename d0/f4 to d0/d16/d9/d13/d21/d20/f32 0 2024-03-12T16:10:34.249 INFO:tasks.workunit.client.1.smithi134.stdout:1/131: dread - d0/d16/d9/d13/f17 zero size 2024-03-12T16:10:34.250 INFO:tasks.workunit.client.1.smithi134.stdout:1/132: chown d0/d16/d9/d13/f17 11 1 2024-03-12T16:10:34.250 INFO:tasks.workunit.client.1.smithi134.stdout:2/181: dread d4/fc [0,4194304] 0 2024-03-12T16:10:34.250 INFO:tasks.workunit.client.1.smithi134.stdout:0/192: link db/c19 db/d2f/c40 0 2024-03-12T16:10:34.253 INFO:tasks.workunit.client.1.smithi134.stdout:8/186: getdents d3/d1b/d17/d25/d33/d15/d1c 0 2024-03-12T16:10:34.254 INFO:tasks.workunit.client.1.smithi134.stdout:0/193: symlink db/d2f/d31/l41 0 2024-03-12T16:10:34.256 INFO:tasks.workunit.client.1.smithi134.stdout:2/182: mkdir d4/d12/d3b/d3f 0 2024-03-12T16:10:34.262 INFO:tasks.workunit.client.1.smithi134.stdout:0/194: rename db/d2f/d31/c36 to db/c42 0 2024-03-12T16:10:34.262 INFO:tasks.workunit.client.1.smithi134.stdout:1/133: dwrite d0/d16/d9/d13/f17 [0,4194304] 0 2024-03-12T16:10:34.262 INFO:tasks.workunit.client.1.smithi134.stdout:2/183: symlink d4/d3c/l40 0 2024-03-12T16:10:34.264 INFO:tasks.workunit.client.1.smithi134.stdout:3/268: dread d1/db/f4d [0,4194304] 0 2024-03-12T16:10:34.269 INFO:tasks.workunit.client.1.smithi134.stdout:0/195: creat db/d2f/f43 x:0 0 0 2024-03-12T16:10:34.269 INFO:tasks.workunit.client.1.smithi134.stdout:3/269: write d1/db/d10/d2a/f51 [1531007,50473] 0 2024-03-12T16:10:34.269 INFO:tasks.workunit.client.1.smithi134.stdout:8/187: dwrite d3/d1b/d17/d25/d33/d15/d2b/f32 [0,4194304] 0 2024-03-12T16:10:34.271 INFO:tasks.workunit.client.1.smithi134.stdout:2/184: mknod d4/d12/c41 0 2024-03-12T16:10:34.271 INFO:tasks.workunit.client.1.smithi134.stdout:0/196: dread - db/f35 zero size 2024-03-12T16:10:34.273 INFO:tasks.workunit.client.1.smithi134.stdout:8/188: rename d3/d1b/d17 to d3/d1b/d17/d39 22 2024-03-12T16:10:34.276 INFO:tasks.workunit.client.1.smithi134.stdout:0/197: mkdir db/d2f/d44 0 2024-03-12T16:10:34.280 INFO:tasks.workunit.client.1.smithi134.stdout:3/270: symlink d1/l67 0 2024-03-12T16:10:34.283 INFO:tasks.workunit.client.1.smithi134.stdout:1/134: link d0/d16/f31 d0/d16/d9/d13/d21/f33 0 2024-03-12T16:10:34.287 INFO:tasks.workunit.client.1.smithi134.stdout:2/185: creat d4/d12/d1d/d34/f42 x:0 0 0 2024-03-12T16:10:34.287 INFO:tasks.workunit.client.1.smithi134.stdout:1/135: read d0/d16/d9/d13/d21/d20/f32 [251692,29562] 0 2024-03-12T16:10:34.288 INFO:tasks.workunit.client.1.smithi134.stdout:1/136: stat d0/d30 0 2024-03-12T16:10:34.290 INFO:tasks.workunit.client.1.smithi134.stdout:2/186: write d4/f1f [5021879,48566] 0 2024-03-12T16:10:34.295 INFO:tasks.workunit.client.1.smithi134.stdout:2/187: readlink d4/d12/l28 0 2024-03-12T16:10:34.295 INFO:tasks.workunit.client.1.smithi134.stdout:3/271: dread d1/f36 [0,4194304] 0 2024-03-12T16:10:34.296 INFO:tasks.workunit.client.1.smithi134.stdout:0/198: dwrite db/d2f/d31/f3f [4194304,4194304] 0 2024-03-12T16:10:34.298 INFO:tasks.workunit.client.1.smithi134.stdout:3/272: fdatasync d1/db/f4c 0 2024-03-12T16:10:34.298 INFO:tasks.workunit.client.1.smithi134.stdout:2/188: mkdir d4/d12/d43 0 2024-03-12T16:10:34.300 INFO:tasks.workunit.client.1.smithi134.stdout:0/199: creat db/f45 x:0 0 0 2024-03-12T16:10:34.301 INFO:tasks.workunit.client.1.smithi134.stdout:1/137: dread d0/d16/d9/d13/d21/f23 [0,4194304] 0 2024-03-12T16:10:34.303 INFO:tasks.workunit.client.1.smithi134.stdout:2/189: creat d4/d12/d3b/f44 x:0 0 0 2024-03-12T16:10:34.303 INFO:tasks.workunit.client.1.smithi134.stdout:0/200: rename db to db/d2f/d31/d46 22 2024-03-12T16:10:34.303 INFO:tasks.workunit.client.1.smithi134.stdout:8/189: dwrite d3/d1b/f19 [0,4194304] 0 2024-03-12T16:10:34.305 INFO:tasks.workunit.client.1.smithi134.stdout:1/138: write d0/f22 [194653,100227] 0 2024-03-12T16:10:34.308 INFO:tasks.workunit.client.1.smithi134.stdout:7/119: sync 2024-03-12T16:10:34.308 INFO:tasks.workunit.client.1.smithi134.stdout:6/233: sync 2024-03-12T16:10:34.308 INFO:tasks.workunit.client.1.smithi134.stdout:4/164: sync 2024-03-12T16:10:34.308 INFO:tasks.workunit.client.1.smithi134.stdout:5/220: sync 2024-03-12T16:10:34.312 INFO:tasks.workunit.client.1.smithi134.stdout:4/165: write d1/de/d2a/f32 [4681289,56478] 0 2024-03-12T16:10:34.312 INFO:tasks.workunit.client.1.smithi134.stdout:3/273: link d1/db/c62 d1/db/d12/c68 0 2024-03-12T16:10:34.313 INFO:tasks.workunit.client.1.smithi134.stdout:1/139: mkdir d0/d34 0 2024-03-12T16:10:34.313 INFO:tasks.workunit.client.1.smithi134.stdout:5/221: rmdir db 39 2024-03-12T16:10:34.313 INFO:tasks.workunit.client.1.smithi134.stdout:8/190: dread d3/f8 [4194304,4194304] 0 2024-03-12T16:10:34.320 INFO:tasks.workunit.client.1.smithi134.stdout:0/201: rmdir db/d2f/d44 0 2024-03-12T16:10:34.320 INFO:tasks.workunit.client.1.smithi134.stdout:2/190: dwrite d4/d12/d1d/f21 [0,4194304] 0 2024-03-12T16:10:34.321 INFO:tasks.workunit.client.1.smithi134.stdout:7/120: mkdir d8/dc/d20/d26 0 2024-03-12T16:10:34.325 INFO:tasks.workunit.client.1.smithi134.stdout:1/140: creat d0/d16/d9/d13/f35 x:0 0 0 2024-03-12T16:10:34.327 INFO:tasks.workunit.client.1.smithi134.stdout:8/191: mknod d3/d1b/d17/c3a 0 2024-03-12T16:10:34.327 INFO:tasks.workunit.client.1.smithi134.stdout:5/222: unlink db/d12/d37/f42 0 2024-03-12T16:10:34.327 INFO:tasks.workunit.client.1.smithi134.stdout:3/274: stat d1/db/d12/c68 0 2024-03-12T16:10:34.327 INFO:tasks.workunit.client.1.smithi134.stdout:0/202: creat db/d2f/d31/f47 x:0 0 0 2024-03-12T16:10:34.329 INFO:tasks.workunit.client.1.smithi134.stdout:1/141: chown d0/d16/d9/d13/l2b 81585321 1 2024-03-12T16:10:34.331 INFO:tasks.workunit.client.1.smithi134.stdout:2/191: creat d4/d12/d3b/d3f/f45 x:0 0 0 2024-03-12T16:10:34.333 INFO:tasks.workunit.client.1.smithi134.stdout:0/203: chown db/d2f/c40 20114254 1 2024-03-12T16:10:34.333 INFO:tasks.workunit.client.1.smithi134.stdout:0/204: stat db/d2f/d31/f47 0 2024-03-12T16:10:34.334 INFO:tasks.workunit.client.1.smithi134.stdout:5/223: creat db/d12/d29/d3d/f47 x:0 0 0 2024-03-12T16:10:34.336 INFO:tasks.workunit.client.1.smithi134.stdout:0/205: truncate db/d2f/d31/f47 689058 0 2024-03-12T16:10:34.336 INFO:tasks.workunit.client.1.smithi134.stdout:3/275: mknod d1/db/d14/d5a/c69 0 2024-03-12T16:10:34.336 INFO:tasks.workunit.client.1.smithi134.stdout:5/224: read db/d12/d1d/f35 [31237,63529] 0 2024-03-12T16:10:34.337 INFO:tasks.workunit.client.1.smithi134.stdout:8/192: mkdir d3/d1b/d17/d25/d33/d15/d2b/d3b 0 2024-03-12T16:10:34.339 INFO:tasks.workunit.client.1.smithi134.stdout:5/225: read db/d12/d37/f39 [1722197,40402] 0 2024-03-12T16:10:34.340 INFO:tasks.workunit.client.1.smithi134.stdout:4/166: creat d1/d13/f39 x:0 0 0 2024-03-12T16:10:34.342 INFO:tasks.workunit.client.1.smithi134.stdout:4/167: stat d1/l2b 0 2024-03-12T16:10:34.343 INFO:tasks.workunit.client.1.smithi134.stdout:0/206: rename db/d2f/d31/l3d to db/d2f/d31/l48 0 2024-03-12T16:10:34.346 INFO:tasks.workunit.client.1.smithi134.stdout:3/276: dwrite d1/db/d14/f23 [4194304,4194304] 0 2024-03-12T16:10:34.347 INFO:tasks.workunit.client.1.smithi134.stdout:0/207: write db/d2f/d31/f47 [578262,116685] 0 2024-03-12T16:10:34.348 INFO:tasks.workunit.client.1.smithi134.stdout:7/121: getdents d8 0 2024-03-12T16:10:34.352 INFO:tasks.workunit.client.1.smithi134.stdout:3/277: write d1/db/f4c [412389,73526] 0 2024-03-12T16:10:34.353 INFO:tasks.workunit.client.1.smithi134.stdout:2/192: link d4/d12/d1d/f37 d4/d16/f46 0 2024-03-12T16:10:34.355 INFO:tasks.workunit.client.1.smithi134.stdout:2/193: read - d4/d12/f32 zero size 2024-03-12T16:10:34.357 INFO:tasks.workunit.client.1.smithi134.stdout:8/193: dwrite d3/d1b/d17/d25/d33/d15/d2b/f2e [0,4194304] 0 2024-03-12T16:10:34.359 INFO:tasks.workunit.client.1.smithi134.stdout:0/208: mknod db/d2f/d31/c49 0 2024-03-12T16:10:34.361 INFO:tasks.workunit.client.1.smithi134.stdout:1/142: rename d0/d16/d9/d13/d21/c15 to d0/d16/d9/c36 0 2024-03-12T16:10:34.363 INFO:tasks.workunit.client.1.smithi134.stdout:3/278: creat d1/db/d10/d2d/d2e/f6a x:0 0 0 2024-03-12T16:10:34.364 INFO:tasks.workunit.client.1.smithi134.stdout:2/194: fdatasync d4/d16/d2a/f35 0 2024-03-12T16:10:34.365 INFO:tasks.workunit.client.1.smithi134.stdout:3/279: write d1/db/d10/d2a/f51 [1512136,51022] 0 2024-03-12T16:10:34.365 INFO:tasks.workunit.client.1.smithi134.stdout:0/209: mknod db/d2f/d31/c4a 0 2024-03-12T16:10:34.367 INFO:tasks.workunit.client.1.smithi134.stdout:1/143: unlink d0/f22 0 2024-03-12T16:10:34.369 INFO:tasks.workunit.client.1.smithi134.stdout:1/144: write d0/d16/d9/d13/d21/f28 [4198943,58048] 0 2024-03-12T16:10:34.369 INFO:tasks.workunit.client.1.smithi134.stdout:1/145: chown d0/f2c 24524 1 2024-03-12T16:10:34.372 INFO:tasks.workunit.client.1.smithi134.stdout:8/194: symlink d3/d1b/d17/d25/d33/d15/l3c 0 2024-03-12T16:10:34.373 INFO:tasks.workunit.client.1.smithi134.stdout:1/146: chown d0/d16/d9/d13/l1a 56716271 1 2024-03-12T16:10:34.373 INFO:tasks.workunit.client.1.smithi134.stdout:2/195: mkdir d4/d12/d1d/d34/d47 0 2024-03-12T16:10:34.378 INFO:tasks.workunit.client.1.smithi134.stdout:5/226: dwrite db/f25 [0,4194304] 0 2024-03-12T16:10:34.387 INFO:tasks.workunit.client.1.smithi134.stdout:2/196: dwrite d4/d12/d1d/d34/f42 [0,4194304] 0 2024-03-12T16:10:34.387 INFO:tasks.workunit.client.1.smithi134.stdout:8/195: creat d3/d1b/d17/d25/d33/d15/d1c/f3d x:0 0 0 2024-03-12T16:10:34.389 INFO:tasks.workunit.client.1.smithi134.stdout:3/280: symlink d1/db/d10/l6b 0 2024-03-12T16:10:34.389 INFO:tasks.workunit.client.1.smithi134.stdout:7/122: truncate d8/ff 3785803 0 2024-03-12T16:10:34.391 INFO:tasks.workunit.client.1.smithi134.stdout:1/147: rename d0/l25 to d0/d16/d9/d13/d21/d2f/l37 0 2024-03-12T16:10:34.392 INFO:tasks.workunit.client.1.smithi134.stdout:0/210: rename db/d2f/d31/c34 to db/d2f/d31/c4b 0 2024-03-12T16:10:34.395 INFO:tasks.workunit.client.1.smithi134.stdout:7/123: readlink d8/dc/d20/l15 0 2024-03-12T16:10:34.396 INFO:tasks.workunit.client.1.smithi134.stdout:2/197: creat d4/d12/f48 x:0 0 0 2024-03-12T16:10:34.396 INFO:tasks.workunit.client.1.smithi134.stdout:7/124: dread - d8/f24 zero size 2024-03-12T16:10:34.396 INFO:tasks.workunit.client.1.smithi134.stdout:3/281: write d1/db/d12/f1e [3422048,9350] 0 2024-03-12T16:10:34.397 INFO:tasks.workunit.client.1.smithi134.stdout:5/227: creat db/d12/d1d/d3a/f48 x:0 0 0 2024-03-12T16:10:34.398 INFO:tasks.workunit.client.1.smithi134.stdout:7/125: write d8/f1a [1409045,21770] 0 2024-03-12T16:10:34.399 INFO:tasks.workunit.client.1.smithi134.stdout:5/228: stat db/l30 0 2024-03-12T16:10:34.399 INFO:tasks.workunit.client.1.smithi134.stdout:8/196: rename d3/d1b/d17/d25/d33/d15/d2b/f2e to d3/d1b/d17/d24/d28/f3e 0 2024-03-12T16:10:34.400 INFO:tasks.workunit.client.1.smithi134.stdout:5/229: write db/f27 [3067925,111140] 0 2024-03-12T16:10:34.401 INFO:tasks.workunit.client.1.smithi134.stdout:5/230: fdatasync db/f25 0 2024-03-12T16:10:34.405 INFO:tasks.workunit.client.1.smithi134.stdout:7/126: mkdir d8/d27 0 2024-03-12T16:10:34.410 INFO:tasks.workunit.client.1.smithi134.stdout:0/211: truncate db/f10 2297791 0 2024-03-12T16:10:34.412 INFO:tasks.workunit.client.1.smithi134.stdout:5/231: fdatasync db/d12/d37/f39 0 2024-03-12T16:10:34.414 INFO:tasks.workunit.client.1.smithi134.stdout:3/282: mkdir d1/d63/d6c 0 2024-03-12T16:10:34.417 INFO:tasks.workunit.client.1.smithi134.stdout:5/232: dread db/d12/d1d/f19 [0,4194304] 0 2024-03-12T16:10:34.422 INFO:tasks.workunit.client.1.smithi134.stdout:7/127: write d8/dc/d20/f13 [671502,63256] 0 2024-03-12T16:10:34.423 INFO:tasks.workunit.client.1.smithi134.stdout:2/198: getdents d4/d3c 0 2024-03-12T16:10:34.424 INFO:tasks.workunit.client.1.smithi134.stdout:9/170: sync 2024-03-12T16:10:34.425 INFO:tasks.workunit.client.1.smithi134.stdout:5/233: mkdir db/d12/d1d/d3a/d49 0 2024-03-12T16:10:34.426 INFO:tasks.workunit.client.1.smithi134.stdout:9/171: write d5/d10/d1f/f24 [799796,52215] 0 2024-03-12T16:10:34.427 INFO:tasks.workunit.client.1.smithi134.stdout:3/283: link d1/db/d12/f27 d1/d63/d6c/f6d 0 2024-03-12T16:10:34.428 INFO:tasks.workunit.client.1.smithi134.stdout:9/172: write d5/d10/f1c [1531113,126738] 0 2024-03-12T16:10:34.431 INFO:tasks.workunit.client.1.smithi134.stdout:7/128: write d8/f1a [1741755,129003] 0 2024-03-12T16:10:34.433 INFO:tasks.workunit.client.1.smithi134.stdout:0/212: dwrite db/f1d [0,4194304] 0 2024-03-12T16:10:34.434 INFO:tasks.workunit.client.1.smithi134.stdout:2/199: creat d4/d16/d3d/f49 x:0 0 0 2024-03-12T16:10:34.436 INFO:tasks.workunit.client.1.smithi134.stdout:9/173: mknod d5/d20/c26 0 2024-03-12T16:10:34.438 INFO:tasks.workunit.client.1.smithi134.stdout:3/284: mknod d1/db/c6e 0 2024-03-12T16:10:34.438 INFO:tasks.workunit.client.1.smithi134.stdout:3/285: chown d1/db/l64 662 1 2024-03-12T16:10:34.440 INFO:tasks.workunit.client.1.smithi134.stdout:0/213: symlink db/d2f/d31/l4c 0 2024-03-12T16:10:34.441 INFO:tasks.workunit.client.1.smithi134.stdout:0/214: read db/f14 [2938638,75488] 0 2024-03-12T16:10:34.443 INFO:tasks.workunit.client.1.smithi134.stdout:9/174: creat d5/d20/f27 x:0 0 0 2024-03-12T16:10:34.444 INFO:tasks.workunit.client.1.smithi134.stdout:9/175: write d5/d10/f1c [1227074,18139] 0 2024-03-12T16:10:34.445 INFO:tasks.workunit.client.1.smithi134.stdout:7/129: mknod d8/d27/c28 0 2024-03-12T16:10:34.446 INFO:tasks.workunit.client.1.smithi134.stdout:3/286: rmdir d1/db/d10/d2a 39 2024-03-12T16:10:34.447 INFO:tasks.workunit.client.1.smithi134.stdout:3/287: stat d1/db/d10/d2d/d2e/f6a 0 2024-03-12T16:10:34.448 INFO:tasks.workunit.client.1.smithi134.stdout:9/176: fdatasync d5/d10/f1c 0 2024-03-12T16:10:34.450 INFO:tasks.workunit.client.1.smithi134.stdout:5/234: link db/d12/l2e db/d12/d32/l4a 0 2024-03-12T16:10:34.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/215: rmdir db/d2f/d31 39 2024-03-12T16:10:34.455 INFO:tasks.workunit.client.1.smithi134.stdout:5/235: creat db/d12/d37/f4b x:0 0 0 2024-03-12T16:10:34.456 INFO:tasks.workunit.client.1.smithi134.stdout:7/130: symlink d8/l29 0 2024-03-12T16:10:34.457 INFO:tasks.workunit.client.1.smithi134.stdout:3/288: creat d1/db/d14/d5f/f6f x:0 0 0 2024-03-12T16:10:34.459 INFO:tasks.workunit.client.1.smithi134.stdout:2/200: truncate d4/d12/f20 2562221 0 2024-03-12T16:10:34.460 INFO:tasks.workunit.client.1.smithi134.stdout:2/201: write d4/d12/f32 [436569,50187] 0 2024-03-12T16:10:34.461 INFO:tasks.workunit.client.1.smithi134.stdout:2/202: chown d4/d12/d1d/f37 52379 1 2024-03-12T16:10:34.462 INFO:tasks.workunit.client.1.smithi134.stdout:2/203: stat d4/f1b 0 2024-03-12T16:10:34.462 INFO:tasks.workunit.client.1.smithi134.stdout:5/236: rename db/c44 to db/d12/d1d/c4c 0 2024-03-12T16:10:34.463 INFO:tasks.workunit.client.1.smithi134.stdout:9/177: creat d5/f28 x:0 0 0 2024-03-12T16:10:34.464 INFO:tasks.workunit.client.1.smithi134.stdout:0/216: creat db/d2f/d31/f4d x:0 0 0 2024-03-12T16:10:34.465 INFO:tasks.workunit.client.1.smithi134.stdout:2/204: creat d4/d12/f4a x:0 0 0 2024-03-12T16:10:34.466 INFO:tasks.workunit.client.1.smithi134.stdout:0/217: chown db/d2f/d31/l39 4035083 1 2024-03-12T16:10:34.466 INFO:tasks.workunit.client.1.smithi134.stdout:5/237: symlink db/d12/d1d/l4d 0 2024-03-12T16:10:34.472 INFO:tasks.workunit.client.1.smithi134.stdout:9/178: mknod d5/c29 0 2024-03-12T16:10:34.474 INFO:tasks.workunit.client.1.smithi134.stdout:3/289: dread d1/f2 [0,4194304] 0 2024-03-12T16:10:34.476 INFO:tasks.workunit.client.1.smithi134.stdout:7/131: rename f6 to d8/f2a 0 2024-03-12T16:10:34.478 INFO:tasks.workunit.client.1.smithi134.stdout:9/179: dread d5/fe [0,4194304] 0 2024-03-12T16:10:34.481 INFO:tasks.workunit.client.1.smithi134.stdout:3/290: rmdir d1/db/d10/d2d/d2e 39 2024-03-12T16:10:34.487 INFO:tasks.workunit.client.1.smithi134.stdout:3/291: mknod d1/db/d14/c70 0 2024-03-12T16:10:34.487 INFO:tasks.workunit.client.1.smithi134.stdout:2/205: rmdir d4/d12 39 2024-03-12T16:10:34.489 INFO:tasks.workunit.client.1.smithi134.stdout:3/292: dread - d1/db/f58 zero size 2024-03-12T16:10:34.490 INFO:tasks.workunit.client.1.smithi134.stdout:7/132: write d8/dc/d20/f21 [241354,21499] 0 2024-03-12T16:10:34.494 INFO:tasks.workunit.client.1.smithi134.stdout:5/238: write db/f11 [272388,60200] 0 2024-03-12T16:10:34.496 INFO:tasks.workunit.client.1.smithi134.stdout:9/180: dwrite d5/f14 [4194304,4194304] 0 2024-03-12T16:10:34.499 INFO:tasks.workunit.client.1.smithi134.stdout:5/239: chown db/d12/d29/d3d 7584572 1 2024-03-12T16:10:34.500 INFO:tasks.workunit.client.1.smithi134.stdout:0/218: write db/f10 [2380517,94268] 0 2024-03-12T16:10:34.501 INFO:tasks.workunit.client.1.smithi134.stdout:0/219: dread - db/d2f/d31/f3a zero size 2024-03-12T16:10:34.504 INFO:tasks.workunit.client.1.smithi134.stdout:9/181: write d5/d20/f23 [4751176,55147] 0 2024-03-12T16:10:34.508 INFO:tasks.workunit.client.1.smithi134.stdout:5/240: mkdir db/d12/d1d/d3a/d4e 0 2024-03-12T16:10:34.509 INFO:tasks.workunit.client.1.smithi134.stdout:7/133: creat d8/dc/d20/d26/f2b x:0 0 0 2024-03-12T16:10:34.512 INFO:tasks.workunit.client.1.smithi134.stdout:5/241: dread db/f38 [0,4194304] 0 2024-03-12T16:10:34.513 INFO:tasks.workunit.client.1.smithi134.stdout:0/220: dread db/f24 [0,4194304] 0 2024-03-12T16:10:34.514 INFO:tasks.workunit.client.1.smithi134.stdout:2/206: write d4/d12/f20 [493442,34198] 0 2024-03-12T16:10:34.518 INFO:tasks.workunit.client.1.smithi134.stdout:7/134: creat d8/dc/d20/d26/f2c x:0 0 0 2024-03-12T16:10:34.518 INFO:tasks.workunit.client.1.smithi134.stdout:2/207: chown d4/l19 962042660 1 2024-03-12T16:10:34.519 INFO:tasks.workunit.client.1.smithi134.stdout:9/182: dwrite d5/f14 [0,4194304] 0 2024-03-12T16:10:34.521 INFO:tasks.workunit.client.1.smithi134.stdout:7/135: symlink d8/dc/l2d 0 2024-03-12T16:10:34.524 INFO:tasks.workunit.client.1.smithi134.stdout:3/293: dwrite d1/db/d12/f27 [0,4194304] 0 2024-03-12T16:10:34.524 INFO:tasks.workunit.client.1.smithi134.stdout:5/242: creat db/d12/d1d/d3a/d4e/f4f x:0 0 0 2024-03-12T16:10:34.524 INFO:tasks.workunit.client.1.smithi134.stdout:9/183: mknod d5/d10/d1f/c2a 0 2024-03-12T16:10:34.524 INFO:tasks.workunit.client.1.smithi134.stdout:2/208: fdatasync d4/d16/d2a/f36 0 2024-03-12T16:10:34.525 INFO:tasks.workunit.client.1.smithi134.stdout:7/136: creat d8/dc/d20/f2e x:0 0 0 2024-03-12T16:10:34.539 INFO:tasks.workunit.client.1.smithi134.stdout:7/137: stat d8/f1a 0 2024-03-12T16:10:34.540 INFO:tasks.workunit.client.1.smithi134.stdout:9/184: dwrite d5/d20/f23 [0,4194304] 0 2024-03-12T16:10:34.541 INFO:tasks.workunit.client.1.smithi134.stdout:7/138: chown d8/dc/c25 20827 1 2024-03-12T16:10:34.542 INFO:tasks.workunit.client.1.smithi134.stdout:0/221: dread db/f10 [0,4194304] 0 2024-03-12T16:10:34.543 INFO:tasks.workunit.client.0.smithi006.stdout:7/127: sync 2024-03-12T16:10:34.546 INFO:tasks.workunit.client.1.smithi134.stdout:3/294: dwrite d1/db/d14/f23 [0,4194304] 0 2024-03-12T16:10:34.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/222: chown db/d2f/d31/f3f 9393 1 2024-03-12T16:10:34.546 INFO:tasks.workunit.client.0.smithi006.stdout:7/128: creat de/d1c/f26 x:0 0 0 2024-03-12T16:10:34.547 INFO:tasks.workunit.client.1.smithi134.stdout:0/223: write db/d2f/f43 [180455,64553] 0 2024-03-12T16:10:34.548 INFO:tasks.workunit.client.1.smithi134.stdout:7/139: mkdir d8/dc/d2f 0 2024-03-12T16:10:34.549 INFO:tasks.workunit.client.1.smithi134.stdout:9/185: dread d5/f14 [4194304,4194304] 0 2024-03-12T16:10:34.552 INFO:tasks.workunit.client.0.smithi006.stdout:7/129: getdents de 0 2024-03-12T16:10:34.554 INFO:tasks.workunit.client.1.smithi134.stdout:9/186: fdatasync d5/d10/d1f/f24 0 2024-03-12T16:10:34.560 INFO:tasks.workunit.client.1.smithi134.stdout:5/243: rmdir db/d12/d1d/d3a/d4e 39 2024-03-12T16:10:34.561 INFO:tasks.workunit.client.1.smithi134.stdout:7/140: rename d8/fb to d8/dc/d20/f30 0 2024-03-12T16:10:34.562 INFO:tasks.workunit.client.1.smithi134.stdout:9/187: creat d5/d20/f2b x:0 0 0 2024-03-12T16:10:34.563 INFO:tasks.workunit.client.1.smithi134.stdout:7/141: fsync d8/dc/d20/f13 0 2024-03-12T16:10:34.565 INFO:tasks.workunit.client.1.smithi134.stdout:3/295: link d1/db/d10/d2d/f5e d1/db/d12/f71 0 2024-03-12T16:10:34.566 INFO:tasks.workunit.client.1.smithi134.stdout:3/296: stat d1/db/d14/c70 0 2024-03-12T16:10:34.567 INFO:tasks.workunit.client.0.smithi006.stdout:7/130: getdents de/d1c 0 2024-03-12T16:10:34.567 INFO:tasks.workunit.client.1.smithi134.stdout:2/209: dwrite d4/fa [0,4194304] 0 2024-03-12T16:10:34.568 INFO:tasks.workunit.client.1.smithi134.stdout:0/224: link db/d2f/d31/c49 db/d2f/c4e 0 2024-03-12T16:10:34.569 INFO:tasks.workunit.client.0.smithi006.stdout:7/131: mkdir de/d27 0 2024-03-12T16:10:34.571 INFO:tasks.workunit.client.1.smithi134.stdout:9/188: rename d5/d20/c26 to d5/d10/d1f/c2c 0 2024-03-12T16:10:34.573 INFO:tasks.workunit.client.1.smithi134.stdout:9/189: write d5/d13/f22 [2935182,111740] 0 2024-03-12T16:10:34.578 INFO:tasks.workunit.client.0.smithi006.stdout:7/132: dwrite de/d18/f20 [0,4194304] 0 2024-03-12T16:10:34.578 INFO:tasks.workunit.client.1.smithi134.stdout:9/190: creat d5/d10/f2d x:0 0 0 2024-03-12T16:10:34.581 INFO:tasks.workunit.client.1.smithi134.stdout:0/225: rename db/f1c to db/d2f/f4f 0 2024-03-12T16:10:34.582 INFO:tasks.workunit.client.0.smithi006.stdout:7/133: rmdir de/d18 39 2024-03-12T16:10:34.583 INFO:tasks.workunit.client.1.smithi134.stdout:9/191: creat d5/d13/f2e x:0 0 0 2024-03-12T16:10:34.583 INFO:tasks.workunit.client.1.smithi134.stdout:0/226: creat db/f50 x:0 0 0 2024-03-12T16:10:34.584 INFO:tasks.workunit.client.0.smithi006.stdout:7/134: creat de/d1c/f28 x:0 0 0 2024-03-12T16:10:34.589 INFO:tasks.workunit.client.1.smithi134.stdout:5/244: dread db/f27 [0,4194304] 0 2024-03-12T16:10:34.590 INFO:tasks.workunit.client.1.smithi134.stdout:5/245: dread - db/d12/d37/f4b zero size 2024-03-12T16:10:34.591 INFO:tasks.workunit.client.1.smithi134.stdout:5/246: chown db/d12/d1d/d3a 3109 1 2024-03-12T16:10:34.593 INFO:tasks.workunit.client.1.smithi134.stdout:9/192: truncate d5/d10/d1f/f24 392195 0 2024-03-12T16:10:34.593 INFO:tasks.workunit.client.0.smithi006.stdout:7/135: dwrite f6 [4194304,4194304] 0 2024-03-12T16:10:34.594 INFO:tasks.workunit.client.0.smithi006.stdout:7/136: stat f6 0 2024-03-12T16:10:34.594 INFO:tasks.workunit.client.1.smithi134.stdout:9/193: write d5/d20/f21 [741583,45783] 0 2024-03-12T16:10:34.595 INFO:tasks.workunit.client.0.smithi006.stdout:7/137: write de/f23 [753393,56582] 0 2024-03-12T16:10:34.595 INFO:tasks.workunit.client.1.smithi134.stdout:5/247: write db/d12/d1d/f35 [757620,124366] 0 2024-03-12T16:10:34.596 INFO:tasks.workunit.client.1.smithi134.stdout:5/248: fsync db/d12/d1d/d3a/f48 0 2024-03-12T16:10:34.598 INFO:tasks.workunit.client.1.smithi134.stdout:9/194: symlink d5/d13/l2f 0 2024-03-12T16:10:34.599 INFO:tasks.workunit.client.1.smithi134.stdout:2/210: truncate d4/d12/d1d/f21 895876 0 2024-03-12T16:10:34.603 INFO:tasks.workunit.client.0.smithi006.stdout:7/138: dread de/d18/f20 [0,4194304] 0 2024-03-12T16:10:34.603 INFO:tasks.workunit.client.1.smithi134.stdout:0/227: truncate db/f24 669304 0 2024-03-12T16:10:34.604 INFO:tasks.workunit.client.1.smithi134.stdout:6/234: sync 2024-03-12T16:10:34.606 INFO:tasks.workunit.client.1.smithi134.stdout:0/228: chown f7 13 1 2024-03-12T16:10:34.607 INFO:tasks.workunit.client.1.smithi134.stdout:3/297: dwrite d1/db/d14/f40 [0,4194304] 0 2024-03-12T16:10:34.607 INFO:tasks.workunit.client.1.smithi134.stdout:5/249: creat db/d12/d1d/d3a/d49/f50 x:0 0 0 2024-03-12T16:10:34.609 INFO:tasks.workunit.client.0.smithi006.stdout:7/139: dread f5 [0,4194304] 0 2024-03-12T16:10:34.609 INFO:tasks.workunit.client.0.smithi006.stdout:7/140: rmdir de 39 2024-03-12T16:10:34.612 INFO:tasks.workunit.client.0.smithi006.stdout:7/141: symlink de/l29 0 2024-03-12T16:10:34.616 INFO:tasks.workunit.client.0.smithi006.stdout:7/142: mkdir de/d18/d2a 0 2024-03-12T16:10:34.616 INFO:tasks.workunit.client.1.smithi134.stdout:2/211: dwrite d4/d12/f32 [0,4194304] 0 2024-03-12T16:10:34.617 INFO:tasks.workunit.client.1.smithi134.stdout:9/195: dread d5/d20/f23 [0,4194304] 0 2024-03-12T16:10:34.619 INFO:tasks.workunit.client.0.smithi006.stdout:7/143: mkdir de/d27/d2b 0 2024-03-12T16:10:34.621 INFO:tasks.workunit.client.1.smithi134.stdout:5/250: creat db/d12/d1d/f51 x:0 0 0 2024-03-12T16:10:34.622 INFO:tasks.workunit.client.1.smithi134.stdout:7/142: dread d8/fd [0,4194304] 0 2024-03-12T16:10:34.626 INFO:tasks.workunit.client.1.smithi134.stdout:9/196: symlink d5/d10/d1f/l30 0 2024-03-12T16:10:34.626 INFO:tasks.workunit.client.1.smithi134.stdout:0/229: dwrite db/f26 [0,4194304] 0 2024-03-12T16:10:34.626 INFO:tasks.workunit.client.0.smithi006.stdout:7/144: mkdir de/d2c 0 2024-03-12T16:10:34.626 INFO:tasks.workunit.client.1.smithi134.stdout:0/230: read db/f1d [1393846,91375] 0 2024-03-12T16:10:34.627 INFO:tasks.workunit.client.1.smithi134.stdout:9/197: write d5/d10/f2d [169498,45337] 0 2024-03-12T16:10:34.629 INFO:tasks.workunit.client.1.smithi134.stdout:5/251: mknod db/d12/d32/c52 0 2024-03-12T16:10:34.629 INFO:tasks.workunit.client.1.smithi134.stdout:0/231: write db/d2f/d31/f3f [7286719,35952] 0 2024-03-12T16:10:34.630 INFO:tasks.workunit.client.1.smithi134.stdout:6/235: link d1/c2c d1/d4/c60 0 2024-03-12T16:10:34.632 INFO:tasks.workunit.client.1.smithi134.stdout:0/232: chown db/fc 72430 1 2024-03-12T16:10:34.633 INFO:tasks.workunit.client.0.smithi006.stdout:7/145: dread - de/d18/f19 zero size 2024-03-12T16:10:34.634 INFO:tasks.workunit.client.1.smithi134.stdout:5/252: read db/d12/d1d/f19 [129726,64443] 0 2024-03-12T16:10:34.634 INFO:tasks.workunit.client.1.smithi134.stdout:9/198: dread d5/d20/f21 [0,4194304] 0 2024-03-12T16:10:34.635 INFO:tasks.workunit.client.1.smithi134.stdout:7/143: mkdir d8/dc/d2f/d31 0 2024-03-12T16:10:34.635 INFO:tasks.workunit.client.0.smithi006.stdout:7/146: creat de/d27/f2d x:0 0 0 2024-03-12T16:10:34.636 INFO:tasks.workunit.client.1.smithi134.stdout:6/236: dread d1/d4/f47 [0,4194304] 0 2024-03-12T16:10:34.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/298: getdents d1/db/d10/d2d/d30 0 2024-03-12T16:10:34.637 INFO:tasks.workunit.client.1.smithi134.stdout:9/199: chown d5/d13/f22 27328720 1 2024-03-12T16:10:34.637 INFO:tasks.workunit.client.1.smithi134.stdout:7/144: chown d8/dc/d20/f30 237 1 2024-03-12T16:10:34.637 INFO:tasks.workunit.client.1.smithi134.stdout:2/212: creat d4/d16/f4b x:0 0 0 2024-03-12T16:10:34.637 INFO:tasks.workunit.client.0.smithi006.stdout:7/147: fsync de/d1c/f26 0 2024-03-12T16:10:34.638 INFO:tasks.workunit.client.1.smithi134.stdout:6/237: chown d1/d3a/d3b 23119 1 2024-03-12T16:10:34.641 INFO:tasks.workunit.client.1.smithi134.stdout:5/253: write db/d12/d1d/f19 [1243071,55107] 0 2024-03-12T16:10:34.643 INFO:tasks.workunit.client.1.smithi134.stdout:5/254: write db/d12/d1d/f51 [1022229,59754] 0 2024-03-12T16:10:34.645 INFO:tasks.workunit.client.0.smithi006.stdout:7/148: link de/c15 de/c2e 0 2024-03-12T16:10:34.645 INFO:tasks.workunit.client.1.smithi134.stdout:5/255: chown db/d12/d32/l33 60597 1 2024-03-12T16:10:34.646 INFO:tasks.workunit.client.1.smithi134.stdout:5/256: write db/f25 [615853,97276] 0 2024-03-12T16:10:34.647 INFO:tasks.workunit.client.1.smithi134.stdout:7/145: creat d8/dc/d2f/f32 x:0 0 0 2024-03-12T16:10:34.648 INFO:tasks.workunit.client.1.smithi134.stdout:5/257: write db/d12/d1d/f51 [1818536,14917] 0 2024-03-12T16:10:34.650 INFO:tasks.workunit.client.1.smithi134.stdout:5/258: write db/d12/f3e [4459104,103412] 0 2024-03-12T16:10:34.650 INFO:tasks.workunit.client.1.smithi134.stdout:9/200: mknod d5/c31 0 2024-03-12T16:10:34.651 INFO:tasks.workunit.client.1.smithi134.stdout:0/233: fsync db/f24 0 2024-03-12T16:10:34.653 INFO:tasks.workunit.client.1.smithi134.stdout:2/213: creat d4/d12/d43/f4c x:0 0 0 2024-03-12T16:10:34.653 INFO:tasks.workunit.client.1.smithi134.stdout:3/299: mkdir d1/db/d10/d2d/d2e/d72 0 2024-03-12T16:10:34.654 INFO:tasks.workunit.client.0.smithi006.stdout:7/149: dwrite de/f1e [0,4194304] 0 2024-03-12T16:10:34.655 INFO:tasks.workunit.client.1.smithi134.stdout:2/214: chown d4/d12/d1d/c23 297 1 2024-03-12T16:10:34.656 INFO:tasks.workunit.client.0.smithi006.stdout:7/150: truncate f5 2408220 0 2024-03-12T16:10:34.657 INFO:tasks.workunit.client.1.smithi134.stdout:6/238: dread d1/d3/d19/f1f [0,4194304] 0 2024-03-12T16:10:34.658 INFO:tasks.workunit.client.0.smithi006.stdout:7/151: symlink de/d2c/l2f 0 2024-03-12T16:10:34.659 INFO:tasks.workunit.client.1.smithi134.stdout:5/259: creat db/d12/d29/d3d/f53 x:0 0 0 2024-03-12T16:10:34.662 INFO:tasks.workunit.client.1.smithi134.stdout:5/260: dread db/f38 [0,4194304] 0 2024-03-12T16:10:34.662 INFO:tasks.workunit.client.0.smithi006.stdout:7/152: rename de/l14 to de/d2c/l30 0 2024-03-12T16:10:34.662 INFO:tasks.workunit.client.1.smithi134.stdout:3/300: read d1/db/d10/d2d/d30/f35 [404164,11410] 0 2024-03-12T16:10:34.664 INFO:tasks.workunit.client.1.smithi134.stdout:2/215: creat d4/d16/d2a/f4d x:0 0 0 2024-03-12T16:10:34.664 INFO:tasks.workunit.client.1.smithi134.stdout:3/301: readlink d1/db/d10/d2d/d2e/l53 0 2024-03-12T16:10:34.666 INFO:tasks.workunit.client.1.smithi134.stdout:0/234: mkdir db/d2f/d51 0 2024-03-12T16:10:34.666 INFO:tasks.workunit.client.1.smithi134.stdout:3/302: fdatasync d1/f66 0 2024-03-12T16:10:34.666 INFO:tasks.workunit.client.1.smithi134.stdout:6/239: fdatasync d1/d3/f17 0 2024-03-12T16:10:34.667 INFO:tasks.workunit.client.1.smithi134.stdout:5/261: rmdir db/d12/d1d/d3a/d49 39 2024-03-12T16:10:34.669 INFO:tasks.workunit.client.0.smithi006.stdout:7/153: dwrite de/f23 [0,4194304] 0 2024-03-12T16:10:34.674 INFO:tasks.workunit.client.1.smithi134.stdout:2/216: symlink d4/d12/d1d/d34/d47/l4e 0 2024-03-12T16:10:34.674 INFO:tasks.workunit.client.1.smithi134.stdout:9/201: write d5/fe [307950,107802] 0 2024-03-12T16:10:34.676 INFO:tasks.workunit.client.1.smithi134.stdout:6/240: truncate d1/d3/f3d 205801 0 2024-03-12T16:10:34.676 INFO:tasks.workunit.client.1.smithi134.stdout:9/202: write d5/f7 [200125,28365] 0 2024-03-12T16:10:34.676 INFO:tasks.workunit.client.1.smithi134.stdout:6/241: chown d1/l50 50920091 1 2024-03-12T16:10:34.677 INFO:tasks.workunit.client.1.smithi134.stdout:7/146: truncate d8/dc/d20/f30 3761854 0 2024-03-12T16:10:34.678 INFO:tasks.workunit.client.1.smithi134.stdout:7/147: readlink d8/dc/le 0 2024-03-12T16:10:34.680 INFO:tasks.workunit.client.1.smithi134.stdout:7/148: chown d8/dc/d20/l15 349209429 1 2024-03-12T16:10:34.680 INFO:tasks.workunit.client.1.smithi134.stdout:2/217: chown d4/d12/f20 7 1 2024-03-12T16:10:34.684 INFO:tasks.workunit.client.1.smithi134.stdout:6/242: mkdir d1/d3a/d56/d61 0 2024-03-12T16:10:34.684 INFO:tasks.workunit.client.1.smithi134.stdout:0/235: write db/f11 [1701441,24135] 0 2024-03-12T16:10:34.685 INFO:tasks.workunit.client.1.smithi134.stdout:9/203: dread d5/d10/d1f/f24 [0,4194304] 0 2024-03-12T16:10:34.685 INFO:tasks.workunit.client.0.smithi006.stdout:7/154: dwrite de/d18/f1b [0,4194304] 0 2024-03-12T16:10:34.686 INFO:tasks.workunit.client.1.smithi134.stdout:0/236: chown db/fc 1930 1 2024-03-12T16:10:34.688 INFO:tasks.workunit.client.1.smithi134.stdout:7/149: symlink d8/l33 0 2024-03-12T16:10:34.690 INFO:tasks.workunit.client.1.smithi134.stdout:9/204: chown d5/cc 681733 1 2024-03-12T16:10:34.690 INFO:tasks.workunit.client.1.smithi134.stdout:6/243: symlink d1/d3/l62 0 2024-03-12T16:10:34.691 INFO:tasks.workunit.client.0.smithi006.stdout:7/155: rename f5 to de/d18/d2a/f31 0 2024-03-12T16:10:34.692 INFO:tasks.workunit.client.1.smithi134.stdout:0/237: rmdir db/d2f/d31 39 2024-03-12T16:10:34.693 INFO:tasks.workunit.client.0.smithi006.stdout:7/156: creat de/d2c/f32 x:0 0 0 2024-03-12T16:10:34.694 INFO:tasks.workunit.client.0.smithi006.stdout:7/157: read de/d18/f1b [3454444,111040] 0 2024-03-12T16:10:34.695 INFO:tasks.workunit.client.1.smithi134.stdout:4/168: sync 2024-03-12T16:10:34.697 INFO:tasks.workunit.client.0.smithi006.stdout:7/158: creat de/d1c/f33 x:0 0 0 2024-03-12T16:10:34.698 INFO:tasks.workunit.client.1.smithi134.stdout:9/205: creat d5/d10/f32 x:0 0 0 2024-03-12T16:10:34.698 INFO:tasks.workunit.client.0.smithi006.stdout:7/159: write de/d1c/f33 [92255,120419] 0 2024-03-12T16:10:34.699 INFO:tasks.workunit.client.1.smithi134.stdout:9/206: chown d5/fa 995595648 1 2024-03-12T16:10:34.700 INFO:tasks.workunit.client.0.smithi006.stdout:7/160: readlink ld 0 2024-03-12T16:10:34.700 INFO:tasks.workunit.client.1.smithi134.stdout:5/262: dread f5 [0,4194304] 0 2024-03-12T16:10:34.701 INFO:tasks.workunit.client.0.smithi006.stdout:7/161: write de/d18/f1f [218852,114296] 0 2024-03-12T16:10:34.701 INFO:tasks.workunit.client.1.smithi134.stdout:2/218: truncate d4/f1f 4034124 0 2024-03-12T16:10:34.701 INFO:tasks.workunit.client.1.smithi134.stdout:1/148: sync 2024-03-12T16:10:34.704 INFO:tasks.workunit.client.0.smithi006.stdout:7/162: rename de/ff to de/d18/f34 0 2024-03-12T16:10:34.705 INFO:tasks.workunit.client.1.smithi134.stdout:5/263: rmdir db/d12/d29/d3d 39 2024-03-12T16:10:34.706 INFO:tasks.workunit.client.1.smithi134.stdout:4/169: truncate d1/d13/f39 1024133 0 2024-03-12T16:10:34.706 INFO:tasks.workunit.client.1.smithi134.stdout:9/207: write d5/d20/f21 [1724486,88679] 0 2024-03-12T16:10:34.707 INFO:tasks.workunit.client.1.smithi134.stdout:0/238: dread db/f1d [0,4194304] 0 2024-03-12T16:10:34.709 INFO:tasks.workunit.client.1.smithi134.stdout:0/239: dread - db/f38 zero size 2024-03-12T16:10:34.710 INFO:tasks.workunit.client.1.smithi134.stdout:2/219: fsync d4/d12/d1d/f37 0 2024-03-12T16:10:34.711 INFO:tasks.workunit.client.0.smithi006.stdout:7/163: dwrite de/d1c/f33 [0,4194304] 0 2024-03-12T16:10:34.713 INFO:tasks.workunit.client.1.smithi134.stdout:7/150: getdents d8 0 2024-03-12T16:10:34.713 INFO:tasks.workunit.client.1.smithi134.stdout:2/220: stat d4/d12/d3b 0 2024-03-12T16:10:34.714 INFO:tasks.workunit.client.0.smithi006.stdout:7/164: fdatasync f3 0 2024-03-12T16:10:34.716 INFO:tasks.workunit.client.0.smithi006.stdout:7/165: mkdir de/d1c/d35 0 2024-03-12T16:10:34.718 INFO:tasks.workunit.client.0.smithi006.stdout:7/166: creat de/d27/f36 x:0 0 0 2024-03-12T16:10:34.723 INFO:tasks.workunit.client.1.smithi134.stdout:6/244: getdents d1/d3a 0 2024-03-12T16:10:34.723 INFO:tasks.workunit.client.1.smithi134.stdout:2/221: dread - d4/d12/f48 zero size 2024-03-12T16:10:34.723 INFO:tasks.workunit.client.1.smithi134.stdout:5/264: dwrite db/d12/d37/f4b [0,4194304] 0 2024-03-12T16:10:34.723 INFO:tasks.workunit.client.1.smithi134.stdout:9/208: mkdir d5/d10/d33 0 2024-03-12T16:10:34.723 INFO:tasks.workunit.client.1.smithi134.stdout:0/240: rmdir db/d2f 39 2024-03-12T16:10:34.724 INFO:tasks.workunit.client.0.smithi006.stdout:7/167: creat de/d27/d2b/f37 x:0 0 0 2024-03-12T16:10:34.724 INFO:tasks.workunit.client.0.smithi006.stdout:7/168: chown de/d27/d2b/f37 29459777 1 2024-03-12T16:10:34.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/151: rename d8/l33 to d8/d27/l34 0 2024-03-12T16:10:34.726 INFO:tasks.workunit.client.0.smithi006.stdout:7/169: write f6 [5906169,55757] 0 2024-03-12T16:10:34.727 INFO:tasks.workunit.client.1.smithi134.stdout:2/222: symlink d4/d3c/l4f 0 2024-03-12T16:10:34.727 INFO:tasks.workunit.client.0.smithi006.stdout:7/170: chown de/d1c 65065 1 2024-03-12T16:10:34.729 INFO:tasks.workunit.client.0.smithi006.stdout:7/171: mknod de/c38 0 2024-03-12T16:10:34.731 INFO:tasks.workunit.client.0.smithi006.stdout:7/172: mkdir de/d18/d2a/d39 0 2024-03-12T16:10:34.733 INFO:tasks.workunit.client.1.smithi134.stdout:4/170: creat d1/f3a x:0 0 0 2024-03-12T16:10:34.734 INFO:tasks.workunit.client.1.smithi134.stdout:2/223: symlink d4/d12/d1d/d34/l50 0 2024-03-12T16:10:34.736 INFO:tasks.workunit.client.0.smithi006.stdout:7/173: mknod de/d1c/d35/c3a 0 2024-03-12T16:10:34.737 INFO:tasks.workunit.client.0.smithi006.stdout:7/174: mknod de/d27/c3b 0 2024-03-12T16:10:34.738 INFO:tasks.workunit.client.0.smithi006.stdout:7/175: readlink de/d18/l21 0 2024-03-12T16:10:34.738 INFO:tasks.workunit.client.0.smithi006.stdout:7/176: dread - de/d27/d2b/f37 zero size 2024-03-12T16:10:34.739 INFO:tasks.workunit.client.1.smithi134.stdout:5/265: dwrite db/d12/f40 [4194304,4194304] 0 2024-03-12T16:10:34.740 INFO:tasks.workunit.client.0.smithi006.stdout:7/177: creat de/d2c/f3c x:0 0 0 2024-03-12T16:10:34.740 INFO:tasks.workunit.client.1.smithi134.stdout:2/224: write d4/d16/d3d/f49 [830570,32286] 0 2024-03-12T16:10:34.741 INFO:tasks.workunit.client.0.smithi006.stdout:7/178: chown de/d18 3642 1 2024-03-12T16:10:34.741 INFO:tasks.workunit.client.1.smithi134.stdout:5/266: chown db/d12/d1d/f31 3946 1 2024-03-12T16:10:34.742 INFO:tasks.workunit.client.0.smithi006.stdout:7/179: mknod de/d1c/d35/c3d 0 2024-03-12T16:10:34.743 INFO:tasks.workunit.client.1.smithi134.stdout:0/241: creat db/d2f/f52 x:0 0 0 2024-03-12T16:10:34.745 INFO:tasks.workunit.client.1.smithi134.stdout:1/149: dwrite d0/fd [0,4194304] 0 2024-03-12T16:10:34.746 INFO:tasks.workunit.client.0.smithi006.stdout:7/180: rename de/c38 to de/d18/c3e 0 2024-03-12T16:10:34.751 INFO:tasks.workunit.client.1.smithi134.stdout:6/245: rename d1/d3/f3d to d1/d3/d19/f63 0 2024-03-12T16:10:34.752 INFO:tasks.workunit.client.1.smithi134.stdout:9/209: write d5/fa [3560029,99962] 0 2024-03-12T16:10:34.753 INFO:tasks.workunit.client.1.smithi134.stdout:2/225: dwrite d4/fa [0,4194304] 0 2024-03-12T16:10:34.754 INFO:tasks.workunit.client.1.smithi134.stdout:4/171: creat d1/d13/d18/d28/f3b x:0 0 0 2024-03-12T16:10:34.755 INFO:tasks.workunit.client.0.smithi006.stdout:7/181: dwrite de/d18/f34 [0,4194304] 0 2024-03-12T16:10:34.755 INFO:tasks.workunit.client.1.smithi134.stdout:9/210: dread - d5/d20/f2b zero size 2024-03-12T16:10:34.756 INFO:tasks.workunit.client.1.smithi134.stdout:1/150: mkdir d0/d16/d9/d13/d38 0 2024-03-12T16:10:34.758 INFO:tasks.workunit.client.1.smithi134.stdout:7/152: readlink d8/dc/le 0 2024-03-12T16:10:34.758 INFO:tasks.workunit.client.1.smithi134.stdout:1/151: chown d0/d16/d9/d1c/f1d 252535004 1 2024-03-12T16:10:34.761 INFO:tasks.workunit.client.1.smithi134.stdout:5/267: creat db/d12/d29/d3d/f54 x:0 0 0 2024-03-12T16:10:34.762 INFO:tasks.workunit.client.1.smithi134.stdout:0/242: mknod db/c53 0 2024-03-12T16:10:34.765 INFO:tasks.workunit.client.1.smithi134.stdout:2/226: dwrite d4/d12/f18 [0,4194304] 0 2024-03-12T16:10:34.767 INFO:tasks.workunit.client.1.smithi134.stdout:9/211: creat d5/d13/f34 x:0 0 0 2024-03-12T16:10:34.769 INFO:tasks.workunit.client.1.smithi134.stdout:5/268: fdatasync f5 0 2024-03-12T16:10:34.770 INFO:tasks.workunit.client.0.smithi006.stdout:7/182: dwrite f3 [0,4194304] 0 2024-03-12T16:10:34.773 INFO:tasks.workunit.client.1.smithi134.stdout:5/269: fsync db/d12/f40 0 2024-03-12T16:10:34.775 INFO:tasks.workunit.client.1.smithi134.stdout:1/152: mkdir d0/d16/d39 0 2024-03-12T16:10:34.775 INFO:tasks.workunit.client.1.smithi134.stdout:4/172: chown d1/d13/l16 268080244 1 2024-03-12T16:10:34.775 INFO:tasks.workunit.client.1.smithi134.stdout:0/243: rmdir db/d2f/d31 39 2024-03-12T16:10:34.779 INFO:tasks.workunit.client.1.smithi134.stdout:2/227: rename d4/d16/d2a to d4/d12/d1d/d51 0 2024-03-12T16:10:34.779 INFO:tasks.workunit.client.0.smithi006.stdout:7/183: dread de/d1c/f33 [0,4194304] 0 2024-03-12T16:10:34.783 INFO:tasks.workunit.client.1.smithi134.stdout:7/153: dwrite d8/f1f [0,4194304] 0 2024-03-12T16:10:34.788 INFO:tasks.workunit.client.0.smithi006.stdout:7/184: dwrite de/d27/f2d [0,4194304] 0 2024-03-12T16:10:34.788 INFO:tasks.workunit.client.1.smithi134.stdout:5/270: creat db/d12/d1d/d3a/d4e/f55 x:0 0 0 2024-03-12T16:10:34.790 INFO:tasks.workunit.client.1.smithi134.stdout:0/244: mknod db/d2f/d51/c54 0 2024-03-12T16:10:34.793 INFO:tasks.workunit.client.1.smithi134.stdout:5/271: mknod db/d12/d32/c56 0 2024-03-12T16:10:34.794 INFO:tasks.workunit.client.0.smithi006.stdout:7/185: dread f6 [4194304,4194304] 0 2024-03-12T16:10:34.794 INFO:tasks.workunit.client.1.smithi134.stdout:7/154: getdents d8/dc/d2f/d31 0 2024-03-12T16:10:34.800 INFO:tasks.workunit.client.1.smithi134.stdout:4/173: rename d1/f33 to d1/de/f3c 0 2024-03-12T16:10:34.800 INFO:tasks.workunit.client.1.smithi134.stdout:0/245: mknod db/d2f/d51/c55 0 2024-03-12T16:10:34.802 INFO:tasks.workunit.client.0.smithi006.stdout:7/186: dwrite de/d1c/f26 [0,4194304] 0 2024-03-12T16:10:34.803 INFO:tasks.workunit.client.1.smithi134.stdout:6/246: write d1/d3/f22 [10463,63455] 0 2024-03-12T16:10:34.808 INFO:tasks.workunit.client.1.smithi134.stdout:9/212: truncate d5/d13/f1a 3366229 0 2024-03-12T16:10:34.809 INFO:tasks.workunit.client.1.smithi134.stdout:1/153: rename d0/d16/d9/d13/d21/f26 to d0/f3a 0 2024-03-12T16:10:34.810 INFO:tasks.workunit.client.1.smithi134.stdout:2/228: write d4/d16/f46 [802342,95193] 0 2024-03-12T16:10:34.815 INFO:tasks.workunit.client.1.smithi134.stdout:7/155: dread d8/f1a [0,4194304] 0 2024-03-12T16:10:34.815 INFO:tasks.workunit.client.1.smithi134.stdout:0/246: mkdir db/d2f/d31/d56 0 2024-03-12T16:10:34.818 INFO:tasks.workunit.client.1.smithi134.stdout:1/154: creat d0/d16/d9/d1c/f3b x:0 0 0 2024-03-12T16:10:34.819 INFO:tasks.workunit.client.1.smithi134.stdout:9/213: getdents d5/d13 0 2024-03-12T16:10:34.823 INFO:tasks.workunit.client.1.smithi134.stdout:0/247: dread db/f10 [0,4194304] 0 2024-03-12T16:10:34.823 INFO:tasks.workunit.client.1.smithi134.stdout:7/156: link d8/f1a d8/dc/d2f/d31/f35 0 2024-03-12T16:10:34.824 INFO:tasks.workunit.client.1.smithi134.stdout:1/155: mknod d0/d16/d9/d13/d38/c3c 0 2024-03-12T16:10:34.825 INFO:tasks.workunit.client.1.smithi134.stdout:4/174: dread d1/de/f17 [0,4194304] 0 2024-03-12T16:10:34.827 INFO:tasks.workunit.client.1.smithi134.stdout:0/248: write db/d2f/f4f [1253858,117496] 0 2024-03-12T16:10:34.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/175: mknod d1/d13/c3d 0 2024-03-12T16:10:34.829 INFO:tasks.workunit.client.0.smithi006.stdout:7/187: write de/d18/d2a/f31 [1734122,15423] 0 2024-03-12T16:10:34.830 INFO:tasks.workunit.client.1.smithi134.stdout:9/214: dwrite d5/d10/f32 [0,4194304] 0 2024-03-12T16:10:34.831 INFO:tasks.workunit.client.1.smithi134.stdout:9/215: chown d5 37538 1 2024-03-12T16:10:34.832 INFO:tasks.workunit.client.1.smithi134.stdout:1/156: read d0/d16/d9/d13/d21/f28 [820909,48341] 0 2024-03-12T16:10:34.832 INFO:tasks.workunit.client.0.smithi006.stdout:7/188: symlink de/d18/d2a/l3f 0 2024-03-12T16:10:34.833 INFO:tasks.workunit.client.0.smithi006.stdout:7/189: mkdir de/d18/d2a/d40 0 2024-03-12T16:10:34.838 INFO:tasks.workunit.client.1.smithi134.stdout:5/272: dread db/d12/d37/f39 [0,4194304] 0 2024-03-12T16:10:34.838 INFO:tasks.workunit.client.1.smithi134.stdout:5/273: readlink db/d12/d32/l45 0 2024-03-12T16:10:34.843 INFO:tasks.workunit.client.1.smithi134.stdout:6/247: dread d1/d3/d10/f2a [0,4194304] 0 2024-03-12T16:10:34.844 INFO:tasks.workunit.client.1.smithi134.stdout:6/248: fsync d1/d4/f14 0 2024-03-12T16:10:34.857 INFO:tasks.workunit.client.0.smithi006.stdout:7/190: dread de/f12 [0,4194304] 0 2024-03-12T16:10:34.857 INFO:tasks.workunit.client.0.smithi006.stdout:7/191: chown de/f1e 338 1 2024-03-12T16:10:34.859 INFO:tasks.workunit.client.0.smithi006.stdout:7/192: symlink de/d1c/l41 0 2024-03-12T16:10:34.860 INFO:tasks.workunit.client.0.smithi006.stdout:7/193: fdatasync de/d27/f36 0 2024-03-12T16:10:34.862 INFO:tasks.workunit.client.0.smithi006.stdout:7/194: creat de/d1c/d35/f42 x:0 0 0 2024-03-12T16:10:34.862 INFO:tasks.workunit.client.0.smithi006.stdout:7/195: stat de/d2c/f3c 0 2024-03-12T16:10:34.865 INFO:tasks.workunit.client.0.smithi006.stdout:7/196: link de/d2c/l2f de/d1c/l43 0 2024-03-12T16:10:34.867 INFO:tasks.workunit.client.0.smithi006.stdout:7/197: creat de/d18/d2a/f44 x:0 0 0 2024-03-12T16:10:34.867 INFO:tasks.workunit.client.0.smithi006.stdout:7/198: stat de/d18/d2a/d39 0 2024-03-12T16:10:34.869 INFO:tasks.workunit.client.1.smithi134.stdout:4/176: readlink d1/d13/d18/l27 0 2024-03-12T16:10:34.870 INFO:tasks.workunit.client.0.smithi006.stdout:7/199: mknod de/d18/d2a/d39/c45 0 2024-03-12T16:10:34.870 INFO:tasks.workunit.client.0.smithi006.stdout:7/200: fdatasync de/f1e 0 2024-03-12T16:10:34.872 INFO:tasks.workunit.client.1.smithi134.stdout:1/157: unlink d0/d16/d9/d13/d21/f28 0 2024-03-12T16:10:34.873 INFO:tasks.workunit.client.0.smithi006.stdout:7/201: rename de/d1c/f28 to de/d18/d2a/d39/f46 0 2024-03-12T16:10:34.875 INFO:tasks.workunit.client.0.smithi006.stdout:7/202: creat de/d18/f47 x:0 0 0 2024-03-12T16:10:34.876 INFO:tasks.workunit.client.0.smithi006.stdout:7/203: symlink de/d18/d2a/l48 0 2024-03-12T16:10:34.882 INFO:tasks.workunit.client.0.smithi006.stdout:7/204: dwrite de/d1c/f26 [0,4194304] 0 2024-03-12T16:10:34.884 INFO:tasks.workunit.client.0.smithi006.stdout:7/205: dread - de/d18/d2a/f44 zero size 2024-03-12T16:10:34.884 INFO:tasks.workunit.client.0.smithi006.stdout:7/206: stat de/d18/f34 0 2024-03-12T16:10:34.887 INFO:tasks.workunit.client.0.smithi006.stdout:7/207: chown de/d1c/d35/c3a 460558214 1 2024-03-12T16:10:34.889 INFO:tasks.workunit.client.0.smithi006.stdout:7/208: readlink l8 0 2024-03-12T16:10:34.889 INFO:tasks.workunit.client.0.smithi006.stdout:7/209: chown de 524788516 1 2024-03-12T16:10:34.890 INFO:tasks.workunit.client.0.smithi006.stdout:7/210: fdatasync de/d18/f1f 0 2024-03-12T16:10:34.890 INFO:tasks.workunit.client.0.smithi006.stdout:7/211: chown de/c11 2304 1 2024-03-12T16:10:34.894 INFO:tasks.workunit.client.0.smithi006.stdout:7/212: dread de/f12 [0,4194304] 0 2024-03-12T16:10:34.894 INFO:tasks.workunit.client.0.smithi006.stdout:7/213: fdatasync de/f23 0 2024-03-12T16:10:34.896 INFO:tasks.workunit.client.0.smithi006.stdout:7/214: write de/d18/d2a/d39/f46 [199219,24810] 0 2024-03-12T16:10:34.897 INFO:tasks.workunit.client.0.smithi006.stdout:7/215: write de/d1c/f26 [2963543,49493] 0 2024-03-12T16:10:34.898 INFO:tasks.workunit.client.1.smithi134.stdout:8/197: sync 2024-03-12T16:10:34.898 INFO:tasks.workunit.client.1.smithi134.stdout:5/274: unlink db/f25 0 2024-03-12T16:10:34.898 INFO:tasks.workunit.client.0.smithi006.stdout:7/216: chown ld 61 1 2024-03-12T16:10:34.899 INFO:tasks.workunit.client.0.smithi006.stdout:7/217: read f3 [1768173,84759] 0 2024-03-12T16:10:34.900 INFO:tasks.workunit.client.1.smithi134.stdout:6/249: write d1/d3/d19/f1f [1138537,30987] 0 2024-03-12T16:10:34.902 INFO:tasks.workunit.client.1.smithi134.stdout:6/250: dread - d1/d3/f48 zero size 2024-03-12T16:10:34.903 INFO:tasks.workunit.client.0.smithi006.stdout:7/218: dread de/f23 [0,4194304] 0 2024-03-12T16:10:34.904 INFO:tasks.workunit.client.1.smithi134.stdout:1/158: mknod d0/d16/d9/d13/d21/d20/c3d 0 2024-03-12T16:10:34.905 INFO:tasks.workunit.client.1.smithi134.stdout:8/198: mkdir d3/d1b/d17/d3f 0 2024-03-12T16:10:34.906 INFO:tasks.workunit.client.0.smithi006.stdout:7/219: dread f6 [0,4194304] 0 2024-03-12T16:10:34.906 INFO:tasks.workunit.client.1.smithi134.stdout:2/229: dwrite d4/d12/f20 [0,4194304] 0 2024-03-12T16:10:34.912 INFO:tasks.workunit.client.0.smithi006.stdout:7/220: dwrite de/d1c/f25 [0,4194304] 0 2024-03-12T16:10:34.913 INFO:tasks.workunit.client.1.smithi134.stdout:0/249: write db/f1f [4953206,51675] 0 2024-03-12T16:10:34.914 INFO:tasks.workunit.client.1.smithi134.stdout:8/199: creat d3/d1b/d17/d25/d33/d15/d1c/f40 x:0 0 0 2024-03-12T16:10:34.915 INFO:tasks.workunit.client.0.smithi006.stdout:7/221: mknod de/d18/d2a/d40/c49 0 2024-03-12T16:10:34.916 INFO:tasks.workunit.client.0.smithi006.stdout:7/222: chown de/d27/c3b 45 1 2024-03-12T16:10:34.917 INFO:tasks.workunit.client.0.smithi006.stdout:7/223: read de/d1c/f33 [642219,39992] 0 2024-03-12T16:10:34.919 INFO:tasks.workunit.client.1.smithi134.stdout:5/275: dwrite db/d12/d1d/f22 [0,4194304] 0 2024-03-12T16:10:34.919 INFO:tasks.workunit.client.0.smithi006.stdout:7/224: mkdir de/d27/d2b/d4a 0 2024-03-12T16:10:34.920 INFO:tasks.workunit.client.1.smithi134.stdout:1/159: mkdir d0/d16/d3e 0 2024-03-12T16:10:34.933 INFO:tasks.workunit.client.1.smithi134.stdout:4/177: getdents d1/de 0 2024-03-12T16:10:34.934 INFO:tasks.workunit.client.1.smithi134.stdout:5/276: truncate db/d12/d29/f36 2400180 0 2024-03-12T16:10:34.937 INFO:tasks.workunit.client.0.smithi006.stdout:7/225: symlink de/d18/d2a/d40/l4b 0 2024-03-12T16:10:34.937 INFO:tasks.workunit.client.1.smithi134.stdout:0/250: dwrite db/f21 [0,4194304] 0 2024-03-12T16:10:34.940 INFO:tasks.workunit.client.0.smithi006.stdout:7/226: write de/d18/f20 [774839,7350] 0 2024-03-12T16:10:34.940 INFO:tasks.workunit.client.1.smithi134.stdout:6/251: dread d1/d16/f2e [0,4194304] 0 2024-03-12T16:10:34.941 INFO:tasks.workunit.client.0.smithi006.stdout:7/227: dread - de/d18/f47 zero size 2024-03-12T16:10:34.943 INFO:tasks.workunit.client.0.smithi006.stdout:7/228: write de/d27/d2b/f37 [416484,73328] 0 2024-03-12T16:10:34.944 INFO:tasks.workunit.client.0.smithi006.stdout:7/229: dread - de/d2c/f3c zero size 2024-03-12T16:10:34.946 INFO:tasks.workunit.client.1.smithi134.stdout:8/200: rename d3/d10/f26 to d3/d1b/f41 0 2024-03-12T16:10:34.948 INFO:tasks.workunit.client.1.smithi134.stdout:6/252: chown d1/f1e 1091 1 2024-03-12T16:10:34.951 INFO:tasks.workunit.client.0.smithi006.stdout:7/230: getdents de/d1c 0 2024-03-12T16:10:34.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:33.494401+0000 mgr.smithi134.gcntfu (mgr.24383) 54 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 259 KiB/s rd, 16 MiB/s wr, 31 op/s 2024-03-12T16:10:34.953 INFO:tasks.workunit.client.0.smithi006.stdout:7/231: symlink de/d1c/d35/l4c 0 2024-03-12T16:10:34.954 INFO:tasks.workunit.client.1.smithi134.stdout:4/178: dread d1/de/f17 [0,4194304] 0 2024-03-12T16:10:34.956 INFO:tasks.workunit.client.1.smithi134.stdout:6/253: symlink d1/d3a/d56/l64 0 2024-03-12T16:10:34.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:33.494401+0000 mgr.smithi134.gcntfu (mgr.24383) 54 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 487 MiB data, 3.2 GiB used, 533 GiB / 536 GiB avail; 259 KiB/s rd, 16 MiB/s wr, 31 op/s 2024-03-12T16:10:34.958 INFO:tasks.workunit.client.0.smithi006.stdout:7/232: link de/c11 de/d18/d2a/d40/c4d 0 2024-03-12T16:10:34.959 INFO:tasks.workunit.client.0.smithi006.stdout:7/233: readlink de/d18/d2a/l48 0 2024-03-12T16:10:34.963 INFO:tasks.workunit.client.0.smithi006.stdout:7/234: dread de/d1c/f33 [0,4194304] 0 2024-03-12T16:10:34.963 INFO:tasks.workunit.client.1.smithi134.stdout:8/201: rename d3/d1b/d17/d25/d33/d15/d2b/d3b to d3/d1b/d17/d25/d33/d15/d2b/d42 0 2024-03-12T16:10:34.963 INFO:tasks.workunit.client.1.smithi134.stdout:4/179: fsync d1/de/d2a/f32 0 2024-03-12T16:10:34.964 INFO:tasks.workunit.client.1.smithi134.stdout:5/277: dwrite db/d12/d1d/d3a/f48 [0,4194304] 0 2024-03-12T16:10:34.967 INFO:tasks.workunit.client.0.smithi006.stdout:7/235: dread de/f23 [0,4194304] 0 2024-03-12T16:10:34.967 INFO:tasks.workunit.client.1.smithi134.stdout:0/251: getdents db/d2f/d31 0 2024-03-12T16:10:34.968 INFO:tasks.workunit.client.0.smithi006.stdout:7/236: chown de/f23 6300 1 2024-03-12T16:10:34.968 INFO:tasks.workunit.client.0.smithi006.stdout:7/237: write fc [4282039,67255] 0 2024-03-12T16:10:34.969 INFO:tasks.workunit.client.1.smithi134.stdout:5/278: chown db/d12/d1d/f35 12549413 1 2024-03-12T16:10:34.969 INFO:tasks.workunit.client.1.smithi134.stdout:0/252: chown db/f21 632707292 1 2024-03-12T16:10:34.969 INFO:tasks.workunit.client.1.smithi134.stdout:6/254: rename d1/d3a/d56 to d1/d16/d4c/d65 0 2024-03-12T16:10:34.970 INFO:tasks.workunit.client.1.smithi134.stdout:4/180: fsync d1/f3a 0 2024-03-12T16:10:34.970 INFO:tasks.workunit.client.1.smithi134.stdout:1/160: truncate d0/d16/f29 2469531 0 2024-03-12T16:10:34.973 INFO:tasks.workunit.client.1.smithi134.stdout:6/255: dread - d1/d4/f1b zero size 2024-03-12T16:10:34.973 INFO:tasks.workunit.client.1.smithi134.stdout:0/253: rmdir db/d2f/d31 39 2024-03-12T16:10:34.974 INFO:tasks.workunit.client.0.smithi006.stdout:7/238: dread de/d18/d2a/f31 [0,4194304] 0 2024-03-12T16:10:34.975 INFO:tasks.workunit.client.1.smithi134.stdout:1/161: write d0/f12 [731128,66914] 0 2024-03-12T16:10:34.976 INFO:tasks.workunit.client.0.smithi006.stdout:7/239: symlink de/d27/d2b/l4e 0 2024-03-12T16:10:34.977 INFO:tasks.workunit.client.0.smithi006.stdout:7/240: fdatasync de/d18/f20 0 2024-03-12T16:10:34.981 INFO:tasks.workunit.client.1.smithi134.stdout:6/256: chown d1/d3/l62 4 1 2024-03-12T16:10:34.982 INFO:tasks.workunit.client.1.smithi134.stdout:5/279: creat db/d12/d1d/d3a/d49/f57 x:0 0 0 2024-03-12T16:10:34.984 INFO:tasks.workunit.client.1.smithi134.stdout:6/257: write d1/d4/f42 [1305919,66710] 0 2024-03-12T16:10:34.984 INFO:tasks.workunit.client.0.smithi006.stdout:7/241: dwrite de/d18/f1f [0,4194304] 0 2024-03-12T16:10:34.986 INFO:tasks.workunit.client.1.smithi134.stdout:4/181: rename d1/d13/l21 to d1/de/d2a/l3e 0 2024-03-12T16:10:34.986 INFO:tasks.workunit.client.1.smithi134.stdout:0/254: dwrite db/d2f/f30 [0,4194304] 0 2024-03-12T16:10:34.987 INFO:tasks.workunit.client.0.smithi006.stdout:7/242: mkdir de/d2c/d4f 0 2024-03-12T16:10:34.988 INFO:tasks.workunit.client.0.smithi006.stdout:7/243: fsync de/f17 0 2024-03-12T16:10:34.988 INFO:tasks.workunit.client.1.smithi134.stdout:8/202: dread d3/d1b/d17/d25/d33/d15/d2b/f32 [0,4194304] 0 2024-03-12T16:10:34.988 INFO:tasks.workunit.client.0.smithi006.stdout:7/244: dread - de/f16 zero size 2024-03-12T16:10:34.989 INFO:tasks.workunit.client.1.smithi134.stdout:0/255: truncate db/f2d 197854 0 2024-03-12T16:10:34.990 INFO:tasks.workunit.client.0.smithi006.stdout:7/245: mknod de/d2c/c50 0 2024-03-12T16:10:34.991 INFO:tasks.workunit.client.1.smithi134.stdout:6/258: creat d1/d3a/d3b/f66 x:0 0 0 2024-03-12T16:10:34.992 INFO:tasks.workunit.client.1.smithi134.stdout:0/256: truncate f7 8440578 0 2024-03-12T16:10:34.993 INFO:tasks.workunit.client.1.smithi134.stdout:0/257: dread db/f1a [0,4194304] 0 2024-03-12T16:10:34.995 INFO:tasks.workunit.client.1.smithi134.stdout:5/280: creat db/f58 x:0 0 0 2024-03-12T16:10:34.996 INFO:tasks.workunit.client.1.smithi134.stdout:4/182: dread d1/de/f17 [0,4194304] 0 2024-03-12T16:10:34.996 INFO:tasks.workunit.client.1.smithi134.stdout:5/281: stat db/d12/d37/c3f 0 2024-03-12T16:10:34.997 INFO:tasks.workunit.client.1.smithi134.stdout:8/203: rename d3/d1b/lf to d3/d1b/d17/d25/d33/d15/d1c/l43 0 2024-03-12T16:10:34.998 INFO:tasks.workunit.client.1.smithi134.stdout:0/258: rmdir db/d2f/d51 39 2024-03-12T16:10:35.001 INFO:tasks.workunit.client.1.smithi134.stdout:6/259: rename d1/d3/f17 to d1/d4/f67 0 2024-03-12T16:10:35.003 INFO:tasks.workunit.client.1.smithi134.stdout:1/162: creat d0/d16/d9/d13/f3f x:0 0 0 2024-03-12T16:10:35.003 INFO:tasks.workunit.client.1.smithi134.stdout:5/282: fsync db/d12/d29/f36 0 2024-03-12T16:10:35.004 INFO:tasks.workunit.client.1.smithi134.stdout:1/163: fsync d0/d16/d9/d13/f35 0 2024-03-12T16:10:35.005 INFO:tasks.workunit.client.1.smithi134.stdout:5/283: dread - db/d12/d1d/d3a/d4e/f55 zero size 2024-03-12T16:10:35.005 INFO:tasks.workunit.client.1.smithi134.stdout:8/204: symlink d3/d1b/d17/d25/d33/d15/d1c/l44 0 2024-03-12T16:10:35.006 INFO:tasks.workunit.client.1.smithi134.stdout:6/260: mknod d1/d16/d4c/d58/c68 0 2024-03-12T16:10:35.007 INFO:tasks.workunit.client.1.smithi134.stdout:6/261: chown d1/d3/d10/f2a 1495309 1 2024-03-12T16:10:35.009 INFO:tasks.workunit.client.1.smithi134.stdout:0/259: unlink db/d2f/d31/f3a 0 2024-03-12T16:10:35.010 INFO:tasks.workunit.client.1.smithi134.stdout:5/284: dread db/d12/d37/f39 [0,4194304] 0 2024-03-12T16:10:35.011 INFO:tasks.workunit.client.1.smithi134.stdout:8/205: mkdir d3/d1b/d17/d45 0 2024-03-12T16:10:35.014 INFO:tasks.workunit.client.1.smithi134.stdout:6/262: unlink d1/d4/f1b 0 2024-03-12T16:10:35.019 INFO:tasks.workunit.client.1.smithi134.stdout:5/285: mkdir db/d12/d1d/d59 0 2024-03-12T16:10:35.019 INFO:tasks.workunit.client.1.smithi134.stdout:8/206: dwrite d3/d1b/d17/d25/d33/d15/d2b/f30 [0,4194304] 0 2024-03-12T16:10:35.020 INFO:tasks.workunit.client.1.smithi134.stdout:5/286: chown db/d12/d37/f39 16 1 2024-03-12T16:10:35.022 INFO:tasks.workunit.client.1.smithi134.stdout:1/164: creat d0/d16/f40 x:0 0 0 2024-03-12T16:10:35.024 INFO:tasks.workunit.client.1.smithi134.stdout:5/287: rmdir db/d12/d29 39 2024-03-12T16:10:35.025 INFO:tasks.workunit.client.1.smithi134.stdout:1/165: write d0/f2a [520711,80790] 0 2024-03-12T16:10:35.027 INFO:tasks.workunit.client.1.smithi134.stdout:1/166: fdatasync d0/f3a 0 2024-03-12T16:10:35.028 INFO:tasks.workunit.client.1.smithi134.stdout:8/207: link d3/d1b/f41 d3/d1b/d17/d25/f46 0 2024-03-12T16:10:35.031 INFO:tasks.workunit.client.1.smithi134.stdout:6/263: dread d1/f1e [0,4194304] 0 2024-03-12T16:10:35.033 INFO:tasks.workunit.client.1.smithi134.stdout:6/264: write d1/f26 [726309,57603] 0 2024-03-12T16:10:35.034 INFO:tasks.workunit.client.1.smithi134.stdout:8/208: rename d3/d1b/d17/d24/d28/f3e to d3/d1b/d17/f47 0 2024-03-12T16:10:35.040 INFO:tasks.workunit.client.1.smithi134.stdout:1/167: rename d0/d16/f40 to d0/d16/d9/d13/d38/f41 0 2024-03-12T16:10:35.041 INFO:tasks.workunit.client.1.smithi134.stdout:6/265: dwrite d1/d3/d10/f2a [4194304,4194304] 0 2024-03-12T16:10:35.041 INFO:tasks.workunit.client.1.smithi134.stdout:8/209: chown d3/d1b/l36 189166132 1 2024-03-12T16:10:35.044 INFO:tasks.workunit.client.1.smithi134.stdout:5/288: getdents db/d12/d1d 0 2024-03-12T16:10:35.044 INFO:tasks.workunit.client.1.smithi134.stdout:0/260: truncate db/d2f/d31/f3f 5637685 0 2024-03-12T16:10:35.045 INFO:tasks.workunit.client.1.smithi134.stdout:1/168: mkdir d0/d42 0 2024-03-12T16:10:35.050 INFO:tasks.workunit.client.1.smithi134.stdout:8/210: readlink d3/d1b/d17/d25/d33/d15/d1c/l43 0 2024-03-12T16:10:35.057 INFO:tasks.workunit.client.1.smithi134.stdout:5/289: dwrite db/f38 [0,4194304] 0 2024-03-12T16:10:35.058 INFO:tasks.workunit.client.1.smithi134.stdout:1/169: mknod d0/d16/d9/c43 0 2024-03-12T16:10:35.060 INFO:tasks.workunit.client.1.smithi134.stdout:3/303: sync 2024-03-12T16:10:35.062 INFO:tasks.workunit.client.1.smithi134.stdout:5/290: chown db/d12/d1d/d3a/d49/f57 265005 1 2024-03-12T16:10:35.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/211: dwrite d3/d1b/f14 [0,4194304] 0 2024-03-12T16:10:35.066 INFO:tasks.workunit.client.1.smithi134.stdout:0/261: getdents db/d2f/d31 0 2024-03-12T16:10:35.068 INFO:tasks.workunit.client.1.smithi134.stdout:8/212: fsync d3/d1b/d17/d25/d33/d15/d1c/f29 0 2024-03-12T16:10:35.068 INFO:tasks.workunit.client.1.smithi134.stdout:1/170: unlink d0/d16/d9/d13/d21/d20/f32 0 2024-03-12T16:10:35.070 INFO:tasks.workunit.client.1.smithi134.stdout:6/266: dread d1/d3/d19/d32/f37 [0,4194304] 0 2024-03-12T16:10:35.071 INFO:tasks.workunit.client.1.smithi134.stdout:0/262: unlink db/c13 0 2024-03-12T16:10:35.071 INFO:tasks.workunit.client.1.smithi134.stdout:1/171: read - d0/d16/d9/d13/f35 zero size 2024-03-12T16:10:35.071 INFO:tasks.workunit.client.1.smithi134.stdout:8/213: write d3/fe [5660786,73764] 0 2024-03-12T16:10:35.072 INFO:tasks.workunit.client.1.smithi134.stdout:5/291: mknod db/d12/c5a 0 2024-03-12T16:10:35.076 INFO:tasks.workunit.client.1.smithi134.stdout:8/214: rmdir d3/d10 39 2024-03-12T16:10:35.078 INFO:tasks.workunit.client.1.smithi134.stdout:6/267: symlink d1/d3/d19/d32/l69 0 2024-03-12T16:10:35.079 INFO:tasks.workunit.client.1.smithi134.stdout:1/172: creat d0/d16/d9/d13/d21/d20/f44 x:0 0 0 2024-03-12T16:10:35.079 INFO:tasks.workunit.client.1.smithi134.stdout:3/304: link d1/db/ce d1/db/d10/d2d/c73 0 2024-03-12T16:10:35.080 INFO:tasks.workunit.client.1.smithi134.stdout:3/305: write d1/db/f58 [690649,120772] 0 2024-03-12T16:10:35.081 INFO:tasks.workunit.client.1.smithi134.stdout:3/306: readlink d1/db/l64 0 2024-03-12T16:10:35.081 INFO:tasks.workunit.client.1.smithi134.stdout:5/292: unlink db/d12/d29/f36 0 2024-03-12T16:10:35.082 INFO:tasks.workunit.client.1.smithi134.stdout:0/263: creat db/d2f/f57 x:0 0 0 2024-03-12T16:10:35.083 INFO:tasks.workunit.client.1.smithi134.stdout:0/264: chown db/f21 36360679 1 2024-03-12T16:10:35.083 INFO:tasks.workunit.client.1.smithi134.stdout:0/265: truncate f7 9408695 0 2024-03-12T16:10:35.084 INFO:tasks.workunit.client.1.smithi134.stdout:0/266: chown db/f3c 495973596 1 2024-03-12T16:10:35.084 INFO:tasks.workunit.client.1.smithi134.stdout:6/268: creat d1/d16/f6a x:0 0 0 2024-03-12T16:10:35.085 INFO:tasks.workunit.client.1.smithi134.stdout:6/269: write d1/d3/d10/ff [2371651,50719] 0 2024-03-12T16:10:35.087 INFO:tasks.workunit.client.1.smithi134.stdout:8/215: link d3/f6 d3/d1b/d17/d25/d33/d15/d2b/d42/f48 0 2024-03-12T16:10:35.089 INFO:tasks.workunit.client.1.smithi134.stdout:5/293: symlink db/l5b 0 2024-03-12T16:10:35.091 INFO:tasks.workunit.client.1.smithi134.stdout:0/267: mknod db/c58 0 2024-03-12T16:10:35.092 INFO:tasks.workunit.client.1.smithi134.stdout:1/173: getdents d0/d16/d39 0 2024-03-12T16:10:35.092 INFO:tasks.workunit.client.1.smithi134.stdout:6/270: fdatasync d1/d4/f67 0 2024-03-12T16:10:35.093 INFO:tasks.workunit.client.1.smithi134.stdout:3/307: dwrite d1/f2 [4194304,4194304] 0 2024-03-12T16:10:35.095 INFO:tasks.workunit.client.1.smithi134.stdout:5/294: write db/f58 [902604,31960] 0 2024-03-12T16:10:35.098 INFO:tasks.workunit.client.1.smithi134.stdout:1/174: truncate d0/d16/d9/d13/f3f 752731 0 2024-03-12T16:10:35.099 INFO:tasks.workunit.client.1.smithi134.stdout:6/271: creat d1/d16/d4c/d65/f6b x:0 0 0 2024-03-12T16:10:35.101 INFO:tasks.workunit.client.1.smithi134.stdout:6/272: dread - d1/d4/f67 zero size 2024-03-12T16:10:35.102 INFO:tasks.workunit.client.1.smithi134.stdout:0/268: creat db/d2f/d31/f59 x:0 0 0 2024-03-12T16:10:35.105 INFO:tasks.workunit.client.1.smithi134.stdout:1/175: creat d0/d42/f45 x:0 0 0 2024-03-12T16:10:35.107 INFO:tasks.workunit.client.1.smithi134.stdout:0/269: write f7 [548405,76103] 0 2024-03-12T16:10:35.109 INFO:tasks.workunit.client.1.smithi134.stdout:0/270: truncate db/f38 975025 0 2024-03-12T16:10:35.109 INFO:tasks.workunit.client.1.smithi134.stdout:6/273: mkdir d1/d3/d6c 0 2024-03-12T16:10:35.112 INFO:tasks.workunit.client.1.smithi134.stdout:5/295: getdents db/d12/d1d/d3a/d4e 0 2024-03-12T16:10:35.115 INFO:tasks.workunit.client.1.smithi134.stdout:1/176: creat d0/d16/d39/f46 x:0 0 0 2024-03-12T16:10:35.115 INFO:tasks.workunit.client.1.smithi134.stdout:8/216: dread d3/d1b/d17/d25/d33/d15/d1c/f35 [0,4194304] 0 2024-03-12T16:10:35.117 INFO:tasks.workunit.client.1.smithi134.stdout:5/296: rmdir db/d12/d1d/d3a/d49 39 2024-03-12T16:10:35.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/297: chown db 138721 1 2024-03-12T16:10:35.118 INFO:tasks.workunit.client.1.smithi134.stdout:0/271: dread db/d2f/f30 [0,4194304] 0 2024-03-12T16:10:35.121 INFO:tasks.workunit.client.1.smithi134.stdout:6/274: dwrite d1/d3/f48 [0,4194304] 0 2024-03-12T16:10:35.121 INFO:tasks.workunit.client.1.smithi134.stdout:8/217: mkdir d3/d1b/d17/d25/d49 0 2024-03-12T16:10:35.124 INFO:tasks.workunit.client.1.smithi134.stdout:5/298: mkdir db/d12/d1d/d5c 0 2024-03-12T16:10:35.126 INFO:tasks.workunit.client.1.smithi134.stdout:6/275: mkdir d1/d3a/d3b/d6d 0 2024-03-12T16:10:35.137 INFO:tasks.workunit.client.1.smithi134.stdout:1/177: dwrite d0/d16/f7 [0,4194304] 0 2024-03-12T16:10:35.138 INFO:tasks.workunit.client.1.smithi134.stdout:0/272: dwrite db/f3c [0,4194304] 0 2024-03-12T16:10:35.140 INFO:tasks.workunit.client.1.smithi134.stdout:5/299: link db/d12/d32/l45 db/d12/d29/d3d/l5d 0 2024-03-12T16:10:35.142 INFO:tasks.workunit.client.1.smithi134.stdout:5/300: fsync db/d12/d1d/f22 0 2024-03-12T16:10:35.150 INFO:tasks.workunit.client.1.smithi134.stdout:6/276: dwrite d1/d3/d10/f2a [4194304,4194304] 0 2024-03-12T16:10:35.150 INFO:tasks.workunit.client.1.smithi134.stdout:0/273: chown db/c2b 2 1 2024-03-12T16:10:35.150 INFO:tasks.workunit.client.1.smithi134.stdout:6/277: truncate d1/f26 1330681 0 2024-03-12T16:10:35.150 INFO:tasks.workunit.client.1.smithi134.stdout:8/218: dread d3/f8 [0,4194304] 0 2024-03-12T16:10:35.153 INFO:tasks.workunit.client.1.smithi134.stdout:1/178: getdents d0/d30 0 2024-03-12T16:10:35.154 INFO:tasks.workunit.client.1.smithi134.stdout:5/301: symlink db/d12/d1d/d3a/d49/l5e 0 2024-03-12T16:10:35.155 INFO:tasks.workunit.client.1.smithi134.stdout:8/219: rmdir d3/d1b/d17/d25/d33/d15/d1c 39 2024-03-12T16:10:35.155 INFO:tasks.workunit.client.1.smithi134.stdout:0/274: mkdir db/d2f/d51/d5a 0 2024-03-12T16:10:35.157 INFO:tasks.workunit.client.1.smithi134.stdout:8/220: symlink d3/d1b/d17/d25/d33/l4a 0 2024-03-12T16:10:35.171 INFO:tasks.workunit.client.1.smithi134.stdout:5/302: rename db/d12/d32 to db/d12/d5f 0 2024-03-12T16:10:35.173 INFO:tasks.workunit.client.1.smithi134.stdout:5/303: mknod db/d12/d1d/d3a/d49/c60 0 2024-03-12T16:10:35.177 INFO:tasks.workunit.client.1.smithi134.stdout:5/304: dread db/f27 [0,4194304] 0 2024-03-12T16:10:35.179 INFO:tasks.workunit.client.1.smithi134.stdout:5/305: symlink db/d12/l61 0 2024-03-12T16:10:35.180 INFO:tasks.workunit.client.1.smithi134.stdout:5/306: write db/d12/d1d/d3a/d49/f57 [647067,44348] 0 2024-03-12T16:10:35.182 INFO:tasks.workunit.client.1.smithi134.stdout:0/275: dread db/f2c [0,4194304] 0 2024-03-12T16:10:35.183 INFO:tasks.workunit.client.1.smithi134.stdout:5/307: creat db/d12/d1d/d3a/d49/f62 x:0 0 0 2024-03-12T16:10:35.186 INFO:tasks.workunit.client.1.smithi134.stdout:5/308: mknod db/d12/d1d/d3a/d4e/c63 0 2024-03-12T16:10:35.189 INFO:tasks.workunit.client.1.smithi134.stdout:0/276: dwrite db/f2d [0,4194304] 0 2024-03-12T16:10:35.190 INFO:tasks.workunit.client.1.smithi134.stdout:0/277: fsync db/d2f/f4f 0 2024-03-12T16:10:35.191 INFO:tasks.workunit.client.1.smithi134.stdout:5/309: symlink db/d12/d1d/d5c/l64 0 2024-03-12T16:10:35.195 INFO:tasks.workunit.client.1.smithi134.stdout:5/310: link db/d12/d29/d3d/f53 db/d12/d1d/d5c/f65 0 2024-03-12T16:10:35.199 INFO:tasks.workunit.client.1.smithi134.stdout:0/278: getdents db 0 2024-03-12T16:10:35.199 INFO:tasks.workunit.client.1.smithi134.stdout:5/311: write db/f27 [399199,61290] 0 2024-03-12T16:10:35.200 INFO:tasks.workunit.client.1.smithi134.stdout:0/279: chown db/d2f/d31/l41 0 1 2024-03-12T16:10:35.200 INFO:tasks.workunit.client.1.smithi134.stdout:0/280: dread - db/f45 zero size 2024-03-12T16:10:35.202 INFO:tasks.workunit.client.1.smithi134.stdout:5/312: creat db/d12/d1d/f66 x:0 0 0 2024-03-12T16:10:35.203 INFO:tasks.workunit.client.1.smithi134.stdout:5/313: chown db/le 50636627 1 2024-03-12T16:10:35.204 INFO:tasks.workunit.client.1.smithi134.stdout:5/314: chown db/d12/d1d/f31 8 1 2024-03-12T16:10:35.207 INFO:tasks.workunit.client.1.smithi134.stdout:5/315: creat db/d12/d1d/d3a/f67 x:0 0 0 2024-03-12T16:10:35.207 INFO:tasks.workunit.client.1.smithi134.stdout:5/316: readlink db/l1b 0 2024-03-12T16:10:35.209 INFO:tasks.workunit.client.1.smithi134.stdout:5/317: mkdir db/d12/d1d/d3a/d4e/d68 0 2024-03-12T16:10:35.209 INFO:tasks.workunit.client.1.smithi134.stdout:5/318: chown db/l30 3 1 2024-03-12T16:10:35.210 INFO:tasks.workunit.client.1.smithi134.stdout:5/319: fsync db/f27 0 2024-03-12T16:10:35.210 INFO:tasks.workunit.client.1.smithi134.stdout:5/320: dread - db/d12/d1d/d3a/d49/f62 zero size 2024-03-12T16:10:35.218 INFO:tasks.workunit.client.1.smithi134.stdout:5/321: dread db/d12/d1d/f23 [0,4194304] 0 2024-03-12T16:10:35.219 INFO:tasks.workunit.client.1.smithi134.stdout:5/322: write db/d12/d1d/f23 [3140364,69395] 0 2024-03-12T16:10:35.220 INFO:tasks.workunit.client.1.smithi134.stdout:5/323: write db/d12/f40 [5671248,56170] 0 2024-03-12T16:10:35.223 INFO:tasks.workunit.client.1.smithi134.stdout:5/324: creat db/d12/d1d/f69 x:0 0 0 2024-03-12T16:10:35.226 INFO:tasks.workunit.client.1.smithi134.stdout:5/325: dread db/d12/d37/f4b [0,4194304] 0 2024-03-12T16:10:35.227 INFO:tasks.workunit.client.1.smithi134.stdout:5/326: chown db/d12/d1d/d3a/d4e/f4f 15942 1 2024-03-12T16:10:35.228 INFO:tasks.workunit.client.1.smithi134.stdout:5/327: readlink db/l1b 0 2024-03-12T16:10:35.232 INFO:tasks.workunit.client.1.smithi134.stdout:5/328: dwrite db/f27 [0,4194304] 0 2024-03-12T16:10:35.240 INFO:tasks.workunit.client.1.smithi134.stdout:5/329: dwrite db/d12/d1d/f35 [0,4194304] 0 2024-03-12T16:10:35.247 INFO:tasks.workunit.client.1.smithi134.stdout:5/330: dwrite db/d12/d37/f39 [0,4194304] 0 2024-03-12T16:10:35.248 INFO:tasks.workunit.client.1.smithi134.stdout:5/331: chown db/d12/l61 23912 1 2024-03-12T16:10:35.252 INFO:tasks.workunit.client.1.smithi134.stdout:5/332: link db/d12/d1d/l4d db/d12/d1d/d3a/d49/l6a 0 2024-03-12T16:10:35.255 INFO:tasks.workunit.client.1.smithi134.stdout:5/333: mkdir db/d12/d6b 0 2024-03-12T16:10:35.255 INFO:tasks.workunit.client.1.smithi134.stdout:5/334: truncate db/f11 551361 0 2024-03-12T16:10:35.256 INFO:tasks.workunit.client.1.smithi134.stdout:5/335: readlink db/l30 0 2024-03-12T16:10:35.256 INFO:tasks.workunit.client.1.smithi134.stdout:5/336: dread - db/d12/d29/d3d/f53 zero size 2024-03-12T16:10:35.259 INFO:tasks.workunit.client.1.smithi134.stdout:5/337: symlink db/d12/d29/d3d/l6c 0 2024-03-12T16:10:35.260 INFO:tasks.workunit.client.1.smithi134.stdout:5/338: truncate db/d12/d1d/f51 2545415 0 2024-03-12T16:10:35.261 INFO:tasks.workunit.client.1.smithi134.stdout:5/339: write db/d12/d1d/d3a/f48 [1127509,33962] 0 2024-03-12T16:10:35.264 INFO:tasks.workunit.client.1.smithi134.stdout:5/340: creat db/f6d x:0 0 0 2024-03-12T16:10:35.267 INFO:tasks.workunit.client.1.smithi134.stdout:5/341: rmdir db/d12/d6b 0 2024-03-12T16:10:35.273 INFO:tasks.workunit.client.1.smithi134.stdout:5/342: rename db/d12/l2e to db/d12/d29/l6e 0 2024-03-12T16:10:35.274 INFO:tasks.workunit.client.1.smithi134.stdout:5/343: truncate db/d12/d37/f39 5092505 0 2024-03-12T16:10:35.275 INFO:tasks.workunit.client.1.smithi134.stdout:5/344: read - db/d12/d29/d3d/f53 zero size 2024-03-12T16:10:35.275 INFO:tasks.workunit.client.1.smithi134.stdout:5/345: dread - db/d12/d29/d3d/f53 zero size 2024-03-12T16:10:35.278 INFO:tasks.workunit.client.1.smithi134.stdout:5/346: dread db/d12/d1d/f22 [0,4194304] 0 2024-03-12T16:10:35.284 INFO:tasks.workunit.client.1.smithi134.stdout:5/347: dwrite db/d12/d1d/d3a/d49/f62 [0,4194304] 0 2024-03-12T16:10:35.289 INFO:tasks.workunit.client.1.smithi134.stdout:5/348: mknod db/d12/d1d/d3a/d4e/d68/c6f 0 2024-03-12T16:10:35.309 INFO:tasks.workunit.client.1.smithi134.stdout:7/157: sync 2024-03-12T16:10:35.342 INFO:tasks.workunit.client.1.smithi134.stdout:5/349: truncate f5 3907695 0 2024-03-12T16:10:35.343 INFO:tasks.workunit.client.1.smithi134.stdout:7/158: truncate d8/dc/d20/f30 13758 0 2024-03-12T16:10:35.344 INFO:tasks.workunit.client.1.smithi134.stdout:7/159: write d8/dc/d20/f21 [776251,74172] 0 2024-03-12T16:10:35.346 INFO:tasks.workunit.client.1.smithi134.stdout:5/350: mkdir db/d12/d1d/d3a/d70 0 2024-03-12T16:10:35.347 INFO:tasks.workunit.client.1.smithi134.stdout:7/160: mkdir d8/dc/d20/d26/d36 0 2024-03-12T16:10:35.347 INFO:tasks.workunit.client.1.smithi134.stdout:5/351: mkdir db/d12/d37/d71 0 2024-03-12T16:10:35.394 INFO:tasks.workunit.client.1.smithi134.stdout:5/352: mkdir db/d12/d37/d72 0 2024-03-12T16:10:35.397 INFO:tasks.workunit.client.1.smithi134.stdout:5/353: mkdir db/d12/d37/d73 0 2024-03-12T16:10:35.400 INFO:tasks.workunit.client.1.smithi134.stdout:7/161: dwrite d8/f1a [0,4194304] 0 2024-03-12T16:10:35.400 INFO:tasks.workunit.client.1.smithi134.stdout:7/162: stat d8/dc/c10 0 2024-03-12T16:10:35.402 INFO:tasks.workunit.client.1.smithi134.stdout:7/163: truncate d8/dc/d2f/f32 48838 0 2024-03-12T16:10:35.405 INFO:tasks.workunit.client.1.smithi134.stdout:7/164: creat d8/dc/d20/d26/f37 x:0 0 0 2024-03-12T16:10:35.407 INFO:tasks.workunit.client.1.smithi134.stdout:7/165: mknod d8/dc/d20/d26/d36/c38 0 2024-03-12T16:10:35.409 INFO:tasks.workunit.client.1.smithi134.stdout:7/166: mkdir d8/d39 0 2024-03-12T16:10:35.431 INFO:tasks.workunit.client.1.smithi134.stdout:2/230: sync 2024-03-12T16:10:35.431 INFO:tasks.workunit.client.1.smithi134.stdout:4/183: sync 2024-03-12T16:10:35.432 INFO:tasks.workunit.client.1.smithi134.stdout:9/216: sync 2024-03-12T16:10:35.434 INFO:tasks.workunit.client.1.smithi134.stdout:9/217: rmdir d5/d10/d1f 39 2024-03-12T16:10:35.437 INFO:tasks.workunit.client.1.smithi134.stdout:2/231: dwrite d4/f1b [0,4194304] 0 2024-03-12T16:10:35.440 INFO:tasks.workunit.client.1.smithi134.stdout:2/232: mknod d4/d12/d3b/c52 0 2024-03-12T16:10:35.445 INFO:tasks.workunit.client.1.smithi134.stdout:9/218: dwrite d5/d13/f1a [0,4194304] 0 2024-03-12T16:10:35.447 INFO:tasks.workunit.client.1.smithi134.stdout:2/233: truncate d4/d12/f32 2291944 0 2024-03-12T16:10:35.449 INFO:tasks.workunit.client.1.smithi134.stdout:2/234: creat d4/d3c/f53 x:0 0 0 2024-03-12T16:10:35.449 INFO:tasks.workunit.client.1.smithi134.stdout:2/235: dread - d4/d16/f4b zero size 2024-03-12T16:10:35.450 INFO:tasks.workunit.client.1.smithi134.stdout:9/219: rename d5/d13 to d5/d10/d35 0 2024-03-12T16:10:35.452 INFO:tasks.workunit.client.1.smithi134.stdout:2/236: creat d4/d12/d1d/d34/f54 x:0 0 0 2024-03-12T16:10:35.453 INFO:tasks.workunit.client.1.smithi134.stdout:9/220: unlink d5/d10/d35/f22 0 2024-03-12T16:10:35.455 INFO:tasks.workunit.client.1.smithi134.stdout:2/237: creat d4/d12/d1d/d51/f55 x:0 0 0 2024-03-12T16:10:35.458 INFO:tasks.workunit.client.1.smithi134.stdout:2/238: mkdir d4/d12/d1d/d34/d47/d56 0 2024-03-12T16:10:35.460 INFO:tasks.workunit.client.1.smithi134.stdout:9/221: dwrite d5/d10/d35/f1a [0,4194304] 0 2024-03-12T16:10:35.461 INFO:tasks.workunit.client.1.smithi134.stdout:2/239: creat d4/d12/d39/f57 x:0 0 0 2024-03-12T16:10:35.461 INFO:tasks.workunit.client.1.smithi134.stdout:2/240: readlink d4/d3c/l40 0 2024-03-12T16:10:35.462 INFO:tasks.workunit.client.1.smithi134.stdout:2/241: chown d4/d12/d3b 869 1 2024-03-12T16:10:35.463 INFO:tasks.workunit.client.1.smithi134.stdout:2/242: dread - d4/d12/d3b/d3f/f45 zero size 2024-03-12T16:10:35.465 INFO:tasks.workunit.client.1.smithi134.stdout:2/243: write d4/d12/d1d/d51/f35 [2151584,87745] 0 2024-03-12T16:10:35.467 INFO:tasks.workunit.client.1.smithi134.stdout:2/244: mkdir d4/d12/d1d/d34/d58 0 2024-03-12T16:10:35.473 INFO:tasks.workunit.client.1.smithi134.stdout:2/245: mknod d4/d3c/c59 0 2024-03-12T16:10:35.473 INFO:tasks.workunit.client.1.smithi134.stdout:2/246: mknod d4/d12/d1d/c5a 0 2024-03-12T16:10:35.476 INFO:tasks.workunit.client.1.smithi134.stdout:2/247: mkdir d4/d5b 0 2024-03-12T16:10:35.480 INFO:tasks.workunit.client.1.smithi134.stdout:9/222: write d5/d10/d1f/f24 [676500,108389] 0 2024-03-12T16:10:35.492 INFO:tasks.workunit.client.1.smithi134.stdout:2/248: dwrite d4/f1f [0,4194304] 0 2024-03-12T16:10:35.493 INFO:tasks.workunit.client.1.smithi134.stdout:2/249: chown d4/f2b 153019 1 2024-03-12T16:10:35.495 INFO:tasks.workunit.client.1.smithi134.stdout:2/250: symlink d4/d12/d43/l5c 0 2024-03-12T16:10:35.503 INFO:tasks.workunit.client.1.smithi134.stdout:9/223: dread d5/f14 [0,4194304] 0 2024-03-12T16:10:35.507 INFO:tasks.workunit.client.1.smithi134.stdout:9/224: dread d5/d10/d35/f1a [0,4194304] 0 2024-03-12T16:10:35.508 INFO:tasks.workunit.client.1.smithi134.stdout:9/225: readlink d5/l1b 0 2024-03-12T16:10:35.512 INFO:tasks.workunit.client.1.smithi134.stdout:3/308: sync 2024-03-12T16:10:35.512 INFO:tasks.workunit.client.1.smithi134.stdout:6/278: sync 2024-03-12T16:10:35.513 INFO:tasks.workunit.client.1.smithi134.stdout:9/226: dwrite d5/f14 [0,4194304] 0 2024-03-12T16:10:35.519 INFO:tasks.workunit.client.1.smithi134.stdout:9/227: fdatasync d5/d20/f23 0 2024-03-12T16:10:35.521 INFO:tasks.workunit.client.1.smithi134.stdout:3/309: dwrite d1/f65 [0,4194304] 0 2024-03-12T16:10:35.522 INFO:tasks.workunit.client.1.smithi134.stdout:3/310: dread - d1/db/d10/f28 zero size 2024-03-12T16:10:35.523 INFO:tasks.workunit.client.1.smithi134.stdout:3/311: write d1/db/f4c [1205804,97494] 0 2024-03-12T16:10:35.529 INFO:tasks.workunit.client.1.smithi134.stdout:3/312: write d1/db/d10/d2d/f4e [1130680,27835] 0 2024-03-12T16:10:35.534 INFO:tasks.workunit.client.1.smithi134.stdout:6/279: dwrite d1/d3/d19/f59 [0,4194304] 0 2024-03-12T16:10:35.537 INFO:tasks.workunit.client.1.smithi134.stdout:3/313: rename d1/db/d10/c34 to d1/db/d14/d5f/c74 0 2024-03-12T16:10:35.539 INFO:tasks.workunit.client.1.smithi134.stdout:3/314: chown d1/db/d10/d2a/f44 227447 1 2024-03-12T16:10:35.540 INFO:tasks.workunit.client.1.smithi134.stdout:3/315: fsync d1/db/d14/f59 0 2024-03-12T16:10:35.541 INFO:tasks.workunit.client.1.smithi134.stdout:6/280: rename d1/d3/ca to d1/c6e 0 2024-03-12T16:10:35.542 INFO:tasks.workunit.client.1.smithi134.stdout:6/281: write d1/d4/f20 [755364,32773] 0 2024-03-12T16:10:35.600 INFO:tasks.workunit.client.1.smithi134.stdout:3/316: rename d1/db/d10/f4f to d1/db/d10/d2d/f75 0 2024-03-12T16:10:35.601 INFO:tasks.workunit.client.1.smithi134.stdout:6/282: creat d1/d3a/d3b/d6d/f6f x:0 0 0 2024-03-12T16:10:35.603 INFO:tasks.workunit.client.1.smithi134.stdout:6/283: write d1/d16/f2e [3959984,4762] 0 2024-03-12T16:10:35.606 INFO:tasks.workunit.client.1.smithi134.stdout:6/284: mkdir d1/d16/d4c/d65/d70 0 2024-03-12T16:10:35.607 INFO:tasks.workunit.client.1.smithi134.stdout:3/317: link d1/db/d10/l52 d1/db/d10/d2d/d2e/l76 0 2024-03-12T16:10:35.608 INFO:tasks.workunit.client.1.smithi134.stdout:6/285: fdatasync d1/d3/d19/f51 0 2024-03-12T16:10:35.609 INFO:tasks.workunit.client.1.smithi134.stdout:6/286: fsync d1/d16/d4c/d65/f6b 0 2024-03-12T16:10:35.612 INFO:tasks.workunit.client.1.smithi134.stdout:6/287: creat d1/d4d/f71 x:0 0 0 2024-03-12T16:10:35.613 INFO:tasks.workunit.client.1.smithi134.stdout:3/318: link d1/db/c6e d1/c77 0 2024-03-12T16:10:35.615 INFO:tasks.workunit.client.1.smithi134.stdout:3/319: creat d1/db/d10/d2d/d2e/f78 x:0 0 0 2024-03-12T16:10:35.616 INFO:tasks.workunit.client.1.smithi134.stdout:6/288: rmdir d1/d3/d6c 0 2024-03-12T16:10:35.617 INFO:tasks.workunit.client.1.smithi134.stdout:3/320: fdatasync d1/db/f20 0 2024-03-12T16:10:35.623 INFO:tasks.workunit.client.1.smithi134.stdout:6/289: link d1/d3/d19/f51 d1/d16/f72 0 2024-03-12T16:10:35.626 INFO:tasks.workunit.client.1.smithi134.stdout:6/290: symlink d1/l73 0 2024-03-12T16:10:35.627 INFO:tasks.workunit.client.1.smithi134.stdout:6/291: creat d1/d3a/d3b/d6d/f74 x:0 0 0 2024-03-12T16:10:35.630 INFO:tasks.workunit.client.1.smithi134.stdout:3/321: dread d1/db/d14/f40 [0,4194304] 0 2024-03-12T16:10:35.630 INFO:tasks.workunit.client.1.smithi134.stdout:6/292: mkdir d1/d3a/d3b/d6d/d75 0 2024-03-12T16:10:35.630 INFO:tasks.workunit.client.1.smithi134.stdout:8/221: sync 2024-03-12T16:10:35.631 INFO:tasks.workunit.client.1.smithi134.stdout:5/354: sync 2024-03-12T16:10:35.631 INFO:tasks.workunit.client.1.smithi134.stdout:1/179: sync 2024-03-12T16:10:35.631 INFO:tasks.workunit.client.1.smithi134.stdout:0/281: sync 2024-03-12T16:10:35.631 INFO:tasks.workunit.client.1.smithi134.stdout:7/167: sync 2024-03-12T16:10:35.631 INFO:tasks.workunit.client.1.smithi134.stdout:4/184: sync 2024-03-12T16:10:35.632 INFO:tasks.workunit.client.1.smithi134.stdout:3/322: mknod d1/db/d14/d5a/c79 0 2024-03-12T16:10:35.632 INFO:tasks.workunit.client.1.smithi134.stdout:7/168: chown c5 55 1 2024-03-12T16:10:35.633 INFO:tasks.workunit.client.1.smithi134.stdout:1/180: write d0/fd [1687785,108920] 0 2024-03-12T16:10:35.634 INFO:tasks.workunit.client.1.smithi134.stdout:5/355: chown db/d12/d1d/d3a/f48 88547727 1 2024-03-12T16:10:35.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/185: chown d1/de/f25 5645323 1 2024-03-12T16:10:35.636 INFO:tasks.workunit.client.1.smithi134.stdout:1/181: chown d0/d16/d9/d13/d21/d2f 222636 1 2024-03-12T16:10:35.636 INFO:tasks.workunit.client.1.smithi134.stdout:5/356: dread - db/d12/d1d/d5c/f65 zero size 2024-03-12T16:10:35.637 INFO:tasks.workunit.client.1.smithi134.stdout:0/282: rmdir db/d2f 39 2024-03-12T16:10:35.642 INFO:tasks.workunit.client.1.smithi134.stdout:4/186: rmdir d1/de 39 2024-03-12T16:10:35.644 INFO:tasks.workunit.client.1.smithi134.stdout:3/323: dwrite d1/d63/d6c/f6d [4194304,4194304] 0 2024-03-12T16:10:35.644 INFO:tasks.workunit.client.1.smithi134.stdout:8/222: write d3/f8 [6641559,122581] 0 2024-03-12T16:10:35.645 INFO:tasks.workunit.client.1.smithi134.stdout:5/357: dread db/d12/f40 [4194304,4194304] 0 2024-03-12T16:10:35.646 INFO:tasks.workunit.client.1.smithi134.stdout:1/182: rmdir d0/d42 39 2024-03-12T16:10:35.649 INFO:tasks.workunit.client.1.smithi134.stdout:7/169: creat d8/dc/d20/d26/f3a x:0 0 0 2024-03-12T16:10:35.651 INFO:tasks.workunit.client.1.smithi134.stdout:0/283: rmdir db 39 2024-03-12T16:10:35.652 INFO:tasks.workunit.client.1.smithi134.stdout:8/223: symlink d3/d1b/d17/d25/d33/l4b 0 2024-03-12T16:10:35.653 INFO:tasks.workunit.client.1.smithi134.stdout:6/293: getdents d1/d3a/d3b/d6d 0 2024-03-12T16:10:35.654 INFO:tasks.workunit.client.1.smithi134.stdout:6/294: dread - d1/d16/d4c/d65/f5c zero size 2024-03-12T16:10:35.654 INFO:tasks.workunit.client.1.smithi134.stdout:6/295: chown d1/d4/c2d 513249 1 2024-03-12T16:10:35.656 INFO:tasks.workunit.client.1.smithi134.stdout:3/324: rename d1/db/d10/d2d/f4e to d1/db/d12/f7a 0 2024-03-12T16:10:35.657 INFO:tasks.workunit.client.1.smithi134.stdout:4/187: write d1/d13/f1d [828544,107266] 0 2024-03-12T16:10:35.659 INFO:tasks.workunit.client.1.smithi134.stdout:5/358: symlink db/d12/d37/d72/l74 0 2024-03-12T16:10:35.660 INFO:tasks.workunit.client.1.smithi134.stdout:8/224: creat d3/d1b/d17/d24/f4c x:0 0 0 2024-03-12T16:10:35.663 INFO:tasks.workunit.client.1.smithi134.stdout:3/325: dwrite d1/db/d10/f32 [0,4194304] 0 2024-03-12T16:10:35.719 INFO:tasks.workunit.client.1.smithi134.stdout:5/359: rmdir db/d12/d1d/d3a/d4e 39 2024-03-12T16:10:35.719 INFO:tasks.workunit.client.1.smithi134.stdout:5/360: dread - db/d12/d29/d3d/f53 zero size 2024-03-12T16:10:35.722 INFO:tasks.workunit.client.1.smithi134.stdout:3/326: creat d1/db/d14/f7b x:0 0 0 2024-03-12T16:10:35.723 INFO:tasks.workunit.client.1.smithi134.stdout:3/327: write d1/db/d12/f60 [86445,122138] 0 2024-03-12T16:10:35.723 INFO:tasks.workunit.client.1.smithi134.stdout:1/183: truncate d0/f2a 492641 0 2024-03-12T16:10:35.724 INFO:tasks.workunit.client.1.smithi134.stdout:3/328: stat d1/db/d14/f23 0 2024-03-12T16:10:35.729 INFO:tasks.workunit.client.1.smithi134.stdout:7/170: getdents d8/dc/d2f/d31 0 2024-03-12T16:10:35.732 INFO:tasks.workunit.client.1.smithi134.stdout:3/329: symlink d1/db/d10/d2a/l7c 0 2024-03-12T16:10:35.734 INFO:tasks.workunit.client.1.smithi134.stdout:7/171: dread - d8/dc/d20/d26/f37 zero size 2024-03-12T16:10:35.734 INFO:tasks.workunit.client.1.smithi134.stdout:5/361: creat db/d12/d1d/d3a/d70/f75 x:0 0 0 2024-03-12T16:10:35.738 INFO:tasks.workunit.client.1.smithi134.stdout:1/184: mkdir d0/d42/d47 0 2024-03-12T16:10:35.738 INFO:tasks.workunit.client.1.smithi134.stdout:0/284: dwrite db/d2f/d31/f3b [0,4194304] 0 2024-03-12T16:10:35.743 INFO:tasks.workunit.client.1.smithi134.stdout:8/225: dwrite d3/d1b/d17/f1a [0,4194304] 0 2024-03-12T16:10:35.743 INFO:tasks.workunit.client.1.smithi134.stdout:5/362: chown db/d12/d5f/l33 90 1 2024-03-12T16:10:35.745 INFO:tasks.workunit.client.1.smithi134.stdout:7/172: symlink d8/dc/d20/l3b 0 2024-03-12T16:10:35.749 INFO:tasks.workunit.client.1.smithi134.stdout:7/173: readlink d8/dc/d20/l15 0 2024-03-12T16:10:35.749 INFO:tasks.workunit.client.1.smithi134.stdout:5/363: symlink db/d12/d1d/l76 0 2024-03-12T16:10:35.750 INFO:tasks.workunit.client.1.smithi134.stdout:4/188: dwrite d1/de/f3c [0,4194304] 0 2024-03-12T16:10:35.751 INFO:tasks.workunit.client.1.smithi134.stdout:7/174: stat d8/d39 0 2024-03-12T16:10:35.758 INFO:tasks.workunit.client.1.smithi134.stdout:3/330: dwrite d1/db/f58 [0,4194304] 0 2024-03-12T16:10:35.758 INFO:tasks.workunit.client.1.smithi134.stdout:7/175: symlink d8/l3c 0 2024-03-12T16:10:35.760 INFO:tasks.workunit.client.1.smithi134.stdout:5/364: chown db/d12/d1d/d3a/d49/f62 27953 1 2024-03-12T16:10:35.763 INFO:tasks.workunit.client.1.smithi134.stdout:4/189: rename d1/de/f25 to d1/d13/d18/d28/f3f 0 2024-03-12T16:10:35.763 INFO:tasks.workunit.client.1.smithi134.stdout:7/176: fdatasync d8/dc/d2f/f32 0 2024-03-12T16:10:35.764 INFO:tasks.workunit.client.1.smithi134.stdout:2/251: sync 2024-03-12T16:10:35.765 INFO:tasks.workunit.client.1.smithi134.stdout:0/285: dwrite db/fe [4194304,4194304] 0 2024-03-12T16:10:35.771 INFO:tasks.workunit.client.1.smithi134.stdout:1/185: dwrite d0/d16/d9/d13/f3f [0,4194304] 0 2024-03-12T16:10:35.777 INFO:tasks.workunit.client.1.smithi134.stdout:7/177: creat d8/dc/d20/d26/f3d x:0 0 0 2024-03-12T16:10:35.777 INFO:tasks.workunit.client.1.smithi134.stdout:0/286: mknod db/d2f/d31/c5b 0 2024-03-12T16:10:35.782 INFO:tasks.workunit.client.1.smithi134.stdout:3/331: dwrite d1/db/d14/f5d [0,4194304] 0 2024-03-12T16:10:35.785 INFO:tasks.workunit.client.1.smithi134.stdout:5/365: link db/d12/d5f/l4a db/d12/d1d/d59/l77 0 2024-03-12T16:10:35.788 INFO:tasks.workunit.client.1.smithi134.stdout:4/190: dwrite d1/f3a [0,4194304] 0 2024-03-12T16:10:35.791 INFO:tasks.workunit.client.1.smithi134.stdout:4/191: readlink d1/de/l2f 0 2024-03-12T16:10:35.797 INFO:tasks.workunit.client.1.smithi134.stdout:3/332: unlink d1/db/d12/c68 0 2024-03-12T16:10:35.798 INFO:tasks.workunit.client.1.smithi134.stdout:5/366: link db/d12/d1d/d59/l77 db/d12/d37/d71/l78 0 2024-03-12T16:10:35.798 INFO:tasks.workunit.client.1.smithi134.stdout:3/333: write d1/db/f4c [501694,65951] 0 2024-03-12T16:10:35.804 INFO:tasks.workunit.client.1.smithi134.stdout:3/334: readlink d1/db/d10/d2d/d2e/l76 0 2024-03-12T16:10:35.821 INFO:tasks.workunit.client.1.smithi134.stdout:4/192: fsync d1/d13/d18/d28/f3f 0 2024-03-12T16:10:35.824 INFO:tasks.workunit.client.1.smithi134.stdout:4/193: read d1/d13/f26 [974388,103680] 0 2024-03-12T16:10:35.824 INFO:tasks.workunit.client.1.smithi134.stdout:2/252: truncate d4/f1b 3946948 0 2024-03-12T16:10:35.826 INFO:tasks.workunit.client.1.smithi134.stdout:2/253: chown d4/d12/f32 6285 1 2024-03-12T16:10:35.827 INFO:tasks.workunit.client.1.smithi134.stdout:4/194: mknod d1/d13/d18/d35/c40 0 2024-03-12T16:10:35.829 INFO:tasks.workunit.client.1.smithi134.stdout:0/287: truncate db/d2f/f30 3814967 0 2024-03-12T16:10:35.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/195: chown d1/de/c22 0 1 2024-03-12T16:10:35.831 INFO:tasks.workunit.client.1.smithi134.stdout:2/254: rename d4/d16/f46 to d4/d12/d3b/d3f/f5d 0 2024-03-12T16:10:35.832 INFO:tasks.workunit.client.1.smithi134.stdout:5/367: rmdir db/d12 39 2024-03-12T16:10:35.833 INFO:tasks.workunit.client.1.smithi134.stdout:1/186: dwrite d0/f2a [0,4194304] 0 2024-03-12T16:10:35.833 INFO:tasks.workunit.client.1.smithi134.stdout:1/187: dread - d0/d16/d9/d13/d21/d20/f44 zero size 2024-03-12T16:10:35.834 INFO:tasks.workunit.client.1.smithi134.stdout:1/188: dread - d0/d16/d9/d13/d21/d20/f44 zero size 2024-03-12T16:10:35.836 INFO:tasks.workunit.client.1.smithi134.stdout:4/196: symlink d1/d24/l41 0 2024-03-12T16:10:35.873 INFO:tasks.workunit.client.1.smithi134.stdout:9/228: sync 2024-03-12T16:10:35.873 INFO:tasks.workunit.client.1.smithi134.stdout:2/255: write d4/d12/d1d/f37 [1175115,87064] 0 2024-03-12T16:10:35.875 INFO:tasks.workunit.client.1.smithi134.stdout:1/189: mkdir d0/d30/d48 0 2024-03-12T16:10:35.876 INFO:tasks.workunit.client.1.smithi134.stdout:0/288: link db/f38 db/d2f/d31/f5c 0 2024-03-12T16:10:35.876 INFO:tasks.workunit.client.1.smithi134.stdout:1/190: chown d0/d16/d9/lc 46 1 2024-03-12T16:10:35.878 INFO:tasks.workunit.client.1.smithi134.stdout:9/229: mkdir d5/d20/d36 0 2024-03-12T16:10:35.878 INFO:tasks.workunit.client.1.smithi134.stdout:1/191: write d0/d16/d9/d1c/f3b [404428,31265] 0 2024-03-12T16:10:35.879 INFO:tasks.workunit.client.1.smithi134.stdout:5/368: mkdir db/d12/d29/d3d/d79 0 2024-03-12T16:10:35.880 INFO:tasks.workunit.client.1.smithi134.stdout:1/192: chown d0/d16/d9/d13/d21/d20/f44 98 1 2024-03-12T16:10:35.881 INFO:tasks.workunit.client.1.smithi134.stdout:4/197: creat d1/f42 x:0 0 0 2024-03-12T16:10:35.882 INFO:tasks.workunit.client.1.smithi134.stdout:9/230: symlink d5/d10/d1f/l37 0 2024-03-12T16:10:35.883 INFO:tasks.workunit.client.1.smithi134.stdout:9/231: fsync d5/f7 0 2024-03-12T16:10:35.884 INFO:tasks.workunit.client.1.smithi134.stdout:1/193: symlink d0/d16/d9/d13/d21/d20/l49 0 2024-03-12T16:10:35.884 INFO:tasks.workunit.client.1.smithi134.stdout:4/198: creat d1/d13/d18/d28/f43 x:0 0 0 2024-03-12T16:10:35.886 INFO:tasks.workunit.client.1.smithi134.stdout:9/232: mknod d5/d10/d1f/c38 0 2024-03-12T16:10:35.889 INFO:tasks.workunit.client.1.smithi134.stdout:4/199: unlink d1/de/d2a/l3e 0 2024-03-12T16:10:35.959 INFO:tasks.workunit.client.0.smithi006.stdout:4/89: sync 2024-03-12T16:10:35.961 INFO:tasks.workunit.client.0.smithi006.stdout:4/90: fsync d1/fa 0 2024-03-12T16:10:35.965 INFO:tasks.workunit.client.1.smithi134.stdout:5/369: rename db/d12/d1d/d3a/d4e/d68 to db/d7a 0 2024-03-12T16:10:35.966 INFO:tasks.workunit.client.1.smithi134.stdout:1/194: creat d0/d16/f4a x:0 0 0 2024-03-12T16:10:35.969 INFO:tasks.workunit.client.1.smithi134.stdout:5/370: unlink db/d12/c1f 0 2024-03-12T16:10:35.970 INFO:tasks.workunit.client.0.smithi006.stdout:4/91: dwrite d1/db/d17/f11 [0,4194304] 0 2024-03-12T16:10:35.971 INFO:tasks.workunit.client.1.smithi134.stdout:9/233: dwrite d5/d10/d35/f1a [0,4194304] 0 2024-03-12T16:10:35.972 INFO:tasks.workunit.client.1.smithi134.stdout:4/200: dread d1/de/f17 [0,4194304] 0 2024-03-12T16:10:35.973 INFO:tasks.workunit.client.1.smithi134.stdout:5/371: dread - db/d12/d1d/d3a/f67 zero size 2024-03-12T16:10:35.977 INFO:tasks.workunit.client.1.smithi134.stdout:0/289: dread db/f1d [0,4194304] 0 2024-03-12T16:10:35.977 INFO:tasks.workunit.client.1.smithi134.stdout:4/201: chown d1/de/l2f 0 1 2024-03-12T16:10:35.980 INFO:tasks.workunit.client.1.smithi134.stdout:5/372: write db/f27 [1532452,127621] 0 2024-03-12T16:10:35.981 INFO:tasks.workunit.client.1.smithi134.stdout:1/195: dwrite d0/d42/f45 [0,4194304] 0 2024-03-12T16:10:35.984 INFO:tasks.workunit.client.1.smithi134.stdout:0/290: chown db/f50 34 1 2024-03-12T16:10:35.985 INFO:tasks.workunit.client.1.smithi134.stdout:9/234: dread d5/d10/d35/f1a [0,4194304] 0 2024-03-12T16:10:35.985 INFO:tasks.workunit.client.0.smithi006.stdout:4/92: dread d1/fa [0,4194304] 0 2024-03-12T16:10:35.987 INFO:tasks.workunit.client.0.smithi006.stdout:4/93: write d1/db/d17/f11 [3932886,119467] 0 2024-03-12T16:10:35.988 INFO:tasks.workunit.client.0.smithi006.stdout:4/94: chown d1/ld 83 1 2024-03-12T16:10:35.989 INFO:tasks.workunit.client.0.smithi006.stdout:4/95: chown d1/db/d17/c15 123618 1 2024-03-12T16:10:35.989 INFO:tasks.workunit.client.0.smithi006.stdout:4/96: readlink d1/l8 0 2024-03-12T16:10:35.993 INFO:tasks.workunit.client.0.smithi006.stdout:4/97: rename d1/c2 to d1/db/c1b 0 2024-03-12T16:10:35.994 INFO:tasks.workunit.client.1.smithi134.stdout:5/373: mkdir db/d12/d7b 0 2024-03-12T16:10:35.994 INFO:tasks.workunit.client.0.smithi006.stdout:4/98: creat d1/db/d17/f1c x:0 0 0 2024-03-12T16:10:35.995 INFO:tasks.workunit.client.1.smithi134.stdout:4/202: dwrite d1/d13/f1d [4194304,4194304] 0 2024-03-12T16:10:35.995 INFO:tasks.workunit.client.1.smithi134.stdout:9/235: mknod d5/d20/c39 0 2024-03-12T16:10:35.996 INFO:tasks.workunit.client.0.smithi006.stdout:4/99: mkdir d1/db/d1d 0 2024-03-12T16:10:35.997 INFO:tasks.workunit.client.1.smithi134.stdout:4/203: mknod d1/d24/c44 0 2024-03-12T16:10:36.001 INFO:tasks.workunit.client.1.smithi134.stdout:9/236: creat d5/d10/d35/f3a x:0 0 0 2024-03-12T16:10:36.002 INFO:tasks.workunit.client.0.smithi006.stdout:4/100: dwrite d1/fa [4194304,4194304] 0 2024-03-12T16:10:36.003 INFO:tasks.workunit.client.0.smithi006.stdout:4/101: dread - d1/db/d17/f1c zero size 2024-03-12T16:10:36.004 INFO:tasks.workunit.client.1.smithi134.stdout:0/291: rename db/d2f/d31/f4d to db/f5d 0 2024-03-12T16:10:36.004 INFO:tasks.workunit.client.1.smithi134.stdout:6/296: sync 2024-03-12T16:10:36.005 INFO:tasks.workunit.client.1.smithi134.stdout:0/292: write db/f50 [90481,57537] 0 2024-03-12T16:10:36.006 INFO:tasks.workunit.client.1.smithi134.stdout:6/297: chown d1/d3/d19/d32 184654785 1 2024-03-12T16:10:36.007 INFO:tasks.workunit.client.0.smithi006.stdout:4/102: write d1/fa [7989446,56494] 0 2024-03-12T16:10:36.008 INFO:tasks.workunit.client.1.smithi134.stdout:5/374: link db/d12/d1d/f35 db/d12/d37/d72/f7c 0 2024-03-12T16:10:36.010 INFO:tasks.workunit.client.1.smithi134.stdout:4/204: symlink d1/d13/l45 0 2024-03-12T16:10:36.015 INFO:tasks.workunit.client.1.smithi134.stdout:6/298: symlink d1/d16/d4c/d65/d70/l76 0 2024-03-12T16:10:36.016 INFO:tasks.workunit.client.1.smithi134.stdout:9/237: getdents d5/d10 0 2024-03-12T16:10:36.020 INFO:tasks.workunit.client.1.smithi134.stdout:6/299: write d1/d3/d19/f36 [313952,123179] 0 2024-03-12T16:10:36.020 INFO:tasks.workunit.client.1.smithi134.stdout:1/196: dread d0/d16/f29 [0,4194304] 0 2024-03-12T16:10:36.022 INFO:tasks.workunit.client.1.smithi134.stdout:5/375: dread db/d12/d1d/f19 [0,4194304] 0 2024-03-12T16:10:36.023 INFO:tasks.workunit.client.1.smithi134.stdout:0/293: dread db/f2c [0,4194304] 0 2024-03-12T16:10:36.023 INFO:tasks.workunit.client.1.smithi134.stdout:4/205: dwrite d1/de/f36 [0,4194304] 0 2024-03-12T16:10:36.024 INFO:tasks.workunit.client.1.smithi134.stdout:6/300: read - d1/d3a/d3b/d6d/f6f zero size 2024-03-12T16:10:36.025 INFO:tasks.workunit.client.1.smithi134.stdout:1/197: creat d0/d42/f4b x:0 0 0 2024-03-12T16:10:36.028 INFO:tasks.workunit.client.1.smithi134.stdout:1/198: dread - d0/d16/d39/f46 zero size 2024-03-12T16:10:36.029 INFO:tasks.workunit.client.1.smithi134.stdout:5/376: dread db/d12/d1d/f19 [0,4194304] 0 2024-03-12T16:10:36.030 INFO:tasks.workunit.client.1.smithi134.stdout:4/206: fdatasync d1/d13/d18/d35/f29 0 2024-03-12T16:10:36.032 INFO:tasks.workunit.client.1.smithi134.stdout:6/301: symlink d1/l77 0 2024-03-12T16:10:36.034 INFO:tasks.workunit.client.1.smithi134.stdout:1/199: unlink d0/d16/d9/d1c/f3b 0 2024-03-12T16:10:36.036 INFO:tasks.workunit.client.1.smithi134.stdout:0/294: dwrite db/f14 [0,4194304] 0 2024-03-12T16:10:36.042 INFO:tasks.workunit.client.1.smithi134.stdout:9/238: dread d5/d20/f23 [0,4194304] 0 2024-03-12T16:10:36.045 INFO:tasks.workunit.client.1.smithi134.stdout:7/178: sync 2024-03-12T16:10:36.045 INFO:tasks.workunit.client.1.smithi134.stdout:3/335: sync 2024-03-12T16:10:36.045 INFO:tasks.workunit.client.1.smithi134.stdout:8/226: sync 2024-03-12T16:10:36.047 INFO:tasks.workunit.client.1.smithi134.stdout:0/295: write db/f45 [530326,67711] 0 2024-03-12T16:10:36.047 INFO:tasks.workunit.client.1.smithi134.stdout:4/207: symlink d1/d13/l46 0 2024-03-12T16:10:36.047 INFO:tasks.workunit.client.1.smithi134.stdout:3/336: readlink d1/db/d10/d2d/d2e/l3a 0 2024-03-12T16:10:36.048 INFO:tasks.workunit.client.1.smithi134.stdout:4/208: readlink d1/de/l2f 0 2024-03-12T16:10:36.049 INFO:tasks.workunit.client.1.smithi134.stdout:6/302: unlink d1/d4/l54 0 2024-03-12T16:10:36.051 INFO:tasks.workunit.client.1.smithi134.stdout:5/377: rename db/d12/d37/d72 to db/d7d 0 2024-03-12T16:10:36.052 INFO:tasks.workunit.client.1.smithi134.stdout:8/227: chown d3/d1b/c27 73605557 1 2024-03-12T16:10:36.053 INFO:tasks.workunit.client.1.smithi134.stdout:5/378: write db/d12/d29/d3d/f47 [341666,53783] 0 2024-03-12T16:10:36.053 INFO:tasks.workunit.client.1.smithi134.stdout:7/179: mknod d8/dc/d20/d26/d36/c3e 0 2024-03-12T16:10:36.053 INFO:tasks.workunit.client.1.smithi134.stdout:9/239: mknod d5/d20/d36/c3b 0 2024-03-12T16:10:36.055 INFO:tasks.workunit.client.1.smithi134.stdout:3/337: creat d1/db/d14/d5f/f7d x:0 0 0 2024-03-12T16:10:36.056 INFO:tasks.workunit.client.1.smithi134.stdout:8/228: write d3/d1b/d17/d24/f2d [8511563,31867] 0 2024-03-12T16:10:36.057 INFO:tasks.workunit.client.1.smithi134.stdout:4/209: creat d1/d24/d34/f47 x:0 0 0 2024-03-12T16:10:36.058 INFO:tasks.workunit.client.1.smithi134.stdout:0/296: read db/f21 [1146081,115147] 0 2024-03-12T16:10:36.058 INFO:tasks.workunit.client.1.smithi134.stdout:7/180: read d8/dc/d2f/d31/f35 [2192766,38224] 0 2024-03-12T16:10:36.058 INFO:tasks.workunit.client.1.smithi134.stdout:1/200: rmdir d0/d34 0 2024-03-12T16:10:36.061 INFO:tasks.workunit.client.1.smithi134.stdout:4/210: truncate d1/f42 327677 0 2024-03-12T16:10:36.062 INFO:tasks.workunit.client.1.smithi134.stdout:3/338: read d1/db/d10/d2a/f44 [877072,119428] 0 2024-03-12T16:10:36.063 INFO:tasks.workunit.client.1.smithi134.stdout:4/211: rename d1/d24 to d1/d24/d48 22 2024-03-12T16:10:36.065 INFO:tasks.workunit.client.1.smithi134.stdout:6/303: creat d1/f78 x:0 0 0 2024-03-12T16:10:36.066 INFO:tasks.workunit.client.1.smithi134.stdout:4/212: chown d1/d24 658 1 2024-03-12T16:10:36.066 INFO:tasks.workunit.client.1.smithi134.stdout:5/379: truncate db/d12/d1d/d5c/f65 598751 0 2024-03-12T16:10:36.067 INFO:tasks.workunit.client.1.smithi134.stdout:3/339: chown d1/db/d12/f26 439 1 2024-03-12T16:10:36.067 INFO:tasks.workunit.client.1.smithi134.stdout:0/297: chown db/d2f/d31/c49 2256 1 2024-03-12T16:10:36.068 INFO:tasks.workunit.client.1.smithi134.stdout:8/229: dread d3/d1b/d17/d25/d33/d15/d2b/f37 [0,4194304] 0 2024-03-12T16:10:36.068 INFO:tasks.workunit.client.1.smithi134.stdout:7/181: dread d8/dc/d20/f21 [0,4194304] 0 2024-03-12T16:10:36.071 INFO:tasks.workunit.client.1.smithi134.stdout:4/213: write d1/d13/d18/d28/f3b [241756,27445] 0 2024-03-12T16:10:36.071 INFO:tasks.workunit.client.1.smithi134.stdout:6/304: mknod d1/d3/d10/c79 0 2024-03-12T16:10:36.072 INFO:tasks.workunit.client.1.smithi134.stdout:7/182: dread - d8/dc/d20/d26/f3a zero size 2024-03-12T16:10:36.073 INFO:tasks.workunit.client.1.smithi134.stdout:0/298: read db/d2f/d31/f47 [565999,31067] 0 2024-03-12T16:10:36.074 INFO:tasks.workunit.client.1.smithi134.stdout:5/380: chown db/d12/d1d/l4d 14714115 1 2024-03-12T16:10:36.078 INFO:tasks.workunit.client.1.smithi134.stdout:8/230: rmdir d3/d1b/d17/d25 39 2024-03-12T16:10:36.081 INFO:tasks.workunit.client.1.smithi134.stdout:4/214: dwrite d1/d24/d34/f47 [0,4194304] 0 2024-03-12T16:10:36.083 INFO:tasks.workunit.client.1.smithi134.stdout:6/305: unlink d1/d3a/d3b/f66 0 2024-03-12T16:10:36.085 INFO:tasks.workunit.client.1.smithi134.stdout:2/256: sync 2024-03-12T16:10:36.086 INFO:tasks.workunit.client.1.smithi134.stdout:5/381: symlink db/d12/d29/d3d/l7e 0 2024-03-12T16:10:36.086 INFO:tasks.workunit.client.1.smithi134.stdout:2/257: fsync d4/d12/f4a 0 2024-03-12T16:10:36.086 INFO:tasks.workunit.client.1.smithi134.stdout:6/306: fdatasync d1/d3a/d3b/d6d/f74 0 2024-03-12T16:10:36.088 INFO:tasks.workunit.client.1.smithi134.stdout:9/240: truncate d5/fa 5533208 0 2024-03-12T16:10:36.094 INFO:tasks.workunit.client.1.smithi134.stdout:4/215: dwrite d1/f3a [4194304,4194304] 0 2024-03-12T16:10:36.102 INFO:tasks.workunit.client.1.smithi134.stdout:0/299: unlink db/c1e 0 2024-03-12T16:10:36.105 INFO:tasks.workunit.client.1.smithi134.stdout:2/258: dwrite d4/d12/d1d/f37 [0,4194304] 0 2024-03-12T16:10:36.106 INFO:tasks.workunit.client.1.smithi134.stdout:3/340: write d1/db/d10/d2a/f44 [41857,22679] 0 2024-03-12T16:10:36.112 INFO:tasks.workunit.client.1.smithi134.stdout:4/216: dread d1/d24/d34/f47 [0,4194304] 0 2024-03-12T16:10:36.113 INFO:tasks.workunit.client.1.smithi134.stdout:9/241: creat d5/d10/d1f/f3c x:0 0 0 2024-03-12T16:10:36.113 INFO:tasks.workunit.client.1.smithi134.stdout:7/183: fsync d8/f1a 0 2024-03-12T16:10:36.113 INFO:tasks.workunit.client.1.smithi134.stdout:2/259: write d4/d12/f48 [868572,54174] 0 2024-03-12T16:10:36.118 INFO:tasks.workunit.client.1.smithi134.stdout:5/382: dwrite db/d12/d1d/d3a/d70/f75 [0,4194304] 0 2024-03-12T16:10:36.120 INFO:tasks.workunit.client.1.smithi134.stdout:3/341: write d1/d63/d6c/f6d [5685889,50348] 0 2024-03-12T16:10:36.120 INFO:tasks.workunit.client.1.smithi134.stdout:2/260: write d4/d12/d43/f4c [300825,130504] 0 2024-03-12T16:10:36.121 INFO:tasks.workunit.client.1.smithi134.stdout:1/201: dwrite d0/d16/f29 [0,4194304] 0 2024-03-12T16:10:36.122 INFO:tasks.workunit.client.1.smithi134.stdout:8/231: getdents d3 0 2024-03-12T16:10:36.125 INFO:tasks.workunit.client.1.smithi134.stdout:7/184: creat d8/d27/f3f x:0 0 0 2024-03-12T16:10:36.130 INFO:tasks.workunit.client.1.smithi134.stdout:9/242: truncate d5/d10/d1f/f3c 438365 0 2024-03-12T16:10:36.130 INFO:tasks.workunit.client.1.smithi134.stdout:2/261: write d4/d16/f4b [332483,106227] 0 2024-03-12T16:10:36.130 INFO:tasks.workunit.client.1.smithi134.stdout:0/300: creat db/d2f/d31/d56/f5e x:0 0 0 2024-03-12T16:10:36.130 INFO:tasks.workunit.client.1.smithi134.stdout:3/342: readlink d1/db/d10/l6b 0 2024-03-12T16:10:36.132 INFO:tasks.workunit.client.1.smithi134.stdout:5/383: read db/d7d/f7c [2883716,11072] 0 2024-03-12T16:10:36.134 INFO:tasks.workunit.client.1.smithi134.stdout:4/217: rename d1/de/d2a to d1/d13/d49 0 2024-03-12T16:10:36.140 INFO:tasks.workunit.client.1.smithi134.stdout:2/262: read - d4/d12/f4a zero size 2024-03-12T16:10:36.141 INFO:tasks.workunit.client.1.smithi134.stdout:5/384: fdatasync db/d12/d1d/f31 0 2024-03-12T16:10:36.144 INFO:tasks.workunit.client.1.smithi134.stdout:2/263: dread - d4/f26 zero size 2024-03-12T16:10:36.150 INFO:tasks.workunit.client.1.smithi134.stdout:3/343: creat d1/f7e x:0 0 0 2024-03-12T16:10:36.150 INFO:tasks.workunit.client.1.smithi134.stdout:7/185: dwrite d8/d27/f3f [0,4194304] 0 2024-03-12T16:10:36.150 INFO:tasks.workunit.client.1.smithi134.stdout:0/301: rmdir db/d2f/d51/d5a 0 2024-03-12T16:10:36.151 INFO:tasks.workunit.client.1.smithi134.stdout:7/186: dread - d8/dc/d20/f2e zero size 2024-03-12T16:10:36.152 INFO:tasks.workunit.client.1.smithi134.stdout:9/243: dread d5/d20/f21 [0,4194304] 0 2024-03-12T16:10:36.154 INFO:tasks.workunit.client.1.smithi134.stdout:2/264: symlink d4/d12/d3b/l5e 0 2024-03-12T16:10:36.156 INFO:tasks.workunit.client.1.smithi134.stdout:0/302: write db/f5d [837127,76067] 0 2024-03-12T16:10:36.156 INFO:tasks.workunit.client.1.smithi134.stdout:4/218: write d1/d13/d18/d35/f29 [704625,74998] 0 2024-03-12T16:10:36.157 INFO:tasks.workunit.client.1.smithi134.stdout:5/385: mkdir db/d12/d37/d73/d7f 0 2024-03-12T16:10:36.159 INFO:tasks.workunit.client.1.smithi134.stdout:3/344: mknod d1/db/d10/c7f 0 2024-03-12T16:10:36.165 INFO:tasks.workunit.client.1.smithi134.stdout:4/219: mkdir d1/d13/d18/d35/d4a 0 2024-03-12T16:10:36.165 INFO:tasks.workunit.client.1.smithi134.stdout:3/345: chown d1/fc 299653995 1 2024-03-12T16:10:36.166 INFO:tasks.workunit.client.1.smithi134.stdout:0/303: write db/fc [2739349,58726] 0 2024-03-12T16:10:36.171 INFO:tasks.workunit.client.1.smithi134.stdout:9/244: dwrite d5/fe [0,4194304] 0 2024-03-12T16:10:36.172 INFO:tasks.workunit.client.1.smithi134.stdout:5/386: creat db/d12/f80 x:0 0 0 2024-03-12T16:10:36.172 INFO:tasks.workunit.client.1.smithi134.stdout:2/265: dwrite d4/f24 [0,4194304] 0 2024-03-12T16:10:36.175 INFO:tasks.workunit.client.1.smithi134.stdout:8/232: dread d3/d1b/d17/d25/d33/d15/d2b/d42/f48 [4194304,4194304] 0 2024-03-12T16:10:36.177 INFO:tasks.workunit.client.1.smithi134.stdout:0/304: mknod db/d2f/c5f 0 2024-03-12T16:10:36.178 INFO:tasks.workunit.client.1.smithi134.stdout:4/220: creat d1/d13/f4b x:0 0 0 2024-03-12T16:10:36.181 INFO:tasks.workunit.client.1.smithi134.stdout:3/346: getdents d1/db/d10/d2d/d2e/d72 0 2024-03-12T16:10:36.182 INFO:tasks.workunit.client.1.smithi134.stdout:9/245: creat d5/d10/d35/f3d x:0 0 0 2024-03-12T16:10:36.183 INFO:tasks.workunit.client.1.smithi134.stdout:0/305: creat db/d2f/d31/f60 x:0 0 0 2024-03-12T16:10:36.184 INFO:tasks.workunit.client.1.smithi134.stdout:7/187: dwrite d8/dc/d20/f30 [0,4194304] 0 2024-03-12T16:10:36.186 INFO:tasks.workunit.client.1.smithi134.stdout:3/347: readlink d1/db/d10/l1d 0 2024-03-12T16:10:36.186 INFO:tasks.workunit.client.1.smithi134.stdout:5/387: dread db/d12/d1d/d5c/f65 [0,4194304] 0 2024-03-12T16:10:36.188 INFO:tasks.workunit.client.1.smithi134.stdout:4/221: fsync d1/d13/f1a 0 2024-03-12T16:10:36.191 INFO:tasks.workunit.client.1.smithi134.stdout:8/233: write d3/d1b/d17/d25/d33/d15/d1c/f35 [4169226,3512] 0 2024-03-12T16:10:36.192 INFO:tasks.workunit.client.1.smithi134.stdout:4/222: write d1/d24/f19 [4273428,93100] 0 2024-03-12T16:10:36.194 INFO:tasks.workunit.client.1.smithi134.stdout:0/306: truncate db/f1d 675395 0 2024-03-12T16:10:36.195 INFO:tasks.workunit.client.1.smithi134.stdout:0/307: fsync db/f14 0 2024-03-12T16:10:36.197 INFO:tasks.workunit.client.1.smithi134.stdout:9/246: creat d5/f3e x:0 0 0 2024-03-12T16:10:36.197 INFO:tasks.workunit.client.1.smithi134.stdout:2/266: link d4/d12/d1d/d34/d47/l4e d4/d12/d1d/d34/d58/l5f 0 2024-03-12T16:10:36.199 INFO:tasks.workunit.client.1.smithi134.stdout:4/223: rename d1/d24/c44 to d1/d24/d34/c4c 0 2024-03-12T16:10:36.206 INFO:tasks.workunit.client.1.smithi134.stdout:7/188: dwrite d8/dc/d20/d26/f37 [0,4194304] 0 2024-03-12T16:10:36.209 INFO:tasks.workunit.client.1.smithi134.stdout:4/224: unlink d1/d13/c3d 0 2024-03-12T16:10:36.210 INFO:tasks.workunit.client.1.smithi134.stdout:2/267: symlink d4/d12/d1d/d34/d47/d56/l60 0 2024-03-12T16:10:36.211 INFO:tasks.workunit.client.1.smithi134.stdout:7/189: chown d8/d27/f3f 6 1 2024-03-12T16:10:36.211 INFO:tasks.workunit.client.1.smithi134.stdout:4/225: readlink d1/de/l2f 0 2024-03-12T16:10:36.212 INFO:tasks.workunit.client.1.smithi134.stdout:9/247: rename d5/c8 to d5/d20/d36/c3f 0 2024-03-12T16:10:36.214 INFO:tasks.workunit.client.1.smithi134.stdout:0/308: dwrite db/f2c [0,4194304] 0 2024-03-12T16:10:36.217 INFO:tasks.workunit.client.1.smithi134.stdout:4/226: stat d1/d13/d18/l27 0 2024-03-12T16:10:36.218 INFO:tasks.workunit.client.1.smithi134.stdout:2/268: symlink d4/d12/d1d/l61 0 2024-03-12T16:10:36.218 INFO:tasks.workunit.client.1.smithi134.stdout:5/388: dwrite f5 [4194304,4194304] 0 2024-03-12T16:10:36.219 INFO:tasks.workunit.client.1.smithi134.stdout:0/309: dread - db/d2f/f52 zero size 2024-03-12T16:10:36.220 INFO:tasks.workunit.client.1.smithi134.stdout:9/248: symlink d5/d10/d35/l40 0 2024-03-12T16:10:36.221 INFO:tasks.workunit.client.1.smithi134.stdout:3/348: dread d1/db/d10/f1f [0,4194304] 0 2024-03-12T16:10:36.222 INFO:tasks.workunit.client.1.smithi134.stdout:7/190: mknod d8/dc/d2f/d31/c40 0 2024-03-12T16:10:36.222 INFO:tasks.workunit.client.1.smithi134.stdout:0/310: read - db/d2f/f57 zero size 2024-03-12T16:10:36.223 INFO:tasks.workunit.client.1.smithi134.stdout:3/349: readlink d1/db/d10/d2a/l7c 0 2024-03-12T16:10:36.225 INFO:tasks.workunit.client.1.smithi134.stdout:4/227: rename d1/d24/f2e to d1/de/f4d 0 2024-03-12T16:10:36.227 INFO:tasks.workunit.client.1.smithi134.stdout:5/389: symlink db/d12/d1d/d5c/l81 0 2024-03-12T16:10:36.227 INFO:tasks.workunit.client.1.smithi134.stdout:4/228: chown d1/d13/f4b 231064461 1 2024-03-12T16:10:36.227 INFO:tasks.workunit.client.1.smithi134.stdout:7/191: dread d8/f1a [0,4194304] 0 2024-03-12T16:10:36.228 INFO:tasks.workunit.client.1.smithi134.stdout:3/350: symlink d1/db/d10/d2a/l80 0 2024-03-12T16:10:36.229 INFO:tasks.workunit.client.1.smithi134.stdout:4/229: write d1/d13/d18/d28/f3f [5050268,99321] 0 2024-03-12T16:10:36.229 INFO:tasks.workunit.client.1.smithi134.stdout:7/192: dread - d8/dc/d20/d26/f2b zero size 2024-03-12T16:10:36.229 INFO:tasks.workunit.client.1.smithi134.stdout:4/230: readlink d1/l38 0 2024-03-12T16:10:36.231 INFO:tasks.workunit.client.1.smithi134.stdout:2/269: rename d4/d12/d1d/d51/f4d to d4/d12/f62 0 2024-03-12T16:10:36.231 INFO:tasks.workunit.client.1.smithi134.stdout:4/231: write d1/d13/f1a [2122207,4302] 0 2024-03-12T16:10:36.232 INFO:tasks.workunit.client.1.smithi134.stdout:2/270: readlink d4/d3c/l40 0 2024-03-12T16:10:36.232 INFO:tasks.workunit.client.1.smithi134.stdout:0/311: mkdir db/d2f/d61 0 2024-03-12T16:10:36.235 INFO:tasks.workunit.client.1.smithi134.stdout:7/193: dread - d8/f24 zero size 2024-03-12T16:10:36.235 INFO:tasks.workunit.client.1.smithi134.stdout:9/249: rename d5/c25 to d5/d10/c41 0 2024-03-12T16:10:36.239 INFO:tasks.workunit.client.1.smithi134.stdout:0/312: symlink db/l62 0 2024-03-12T16:10:36.242 INFO:tasks.workunit.client.1.smithi134.stdout:2/271: mkdir d4/d12/d1d/d51/d63 0 2024-03-12T16:10:36.243 INFO:tasks.workunit.client.1.smithi134.stdout:3/351: dwrite d1/db/d10/d2d/f33 [4194304,4194304] 0 2024-03-12T16:10:36.243 INFO:tasks.workunit.client.1.smithi134.stdout:7/194: truncate d8/dc/d20/f2e 617282 0 2024-03-12T16:10:36.245 INFO:tasks.workunit.client.1.smithi134.stdout:0/313: rmdir db/d2f/d31 39 2024-03-12T16:10:36.247 INFO:tasks.workunit.client.1.smithi134.stdout:2/272: dread - d4/d2e/f3a zero size 2024-03-12T16:10:36.250 INFO:tasks.workunit.client.1.smithi134.stdout:7/195: dread - d8/dc/d20/d26/f3d zero size 2024-03-12T16:10:36.250 INFO:tasks.workunit.client.1.smithi134.stdout:3/352: dread - d1/db/d14/d5f/f7d zero size 2024-03-12T16:10:36.250 INFO:tasks.workunit.client.1.smithi134.stdout:5/390: dwrite db/d12/d1d/f19 [0,4194304] 0 2024-03-12T16:10:36.256 INFO:tasks.workunit.client.1.smithi134.stdout:2/273: creat d4/d16/d3d/f64 x:0 0 0 2024-03-12T16:10:36.258 INFO:tasks.workunit.client.1.smithi134.stdout:7/196: truncate d8/dc/d20/d26/f3d 719802 0 2024-03-12T16:10:36.259 INFO:tasks.workunit.client.1.smithi134.stdout:0/314: creat db/d2f/f63 x:0 0 0 2024-03-12T16:10:36.259 INFO:tasks.workunit.client.1.smithi134.stdout:2/274: write d4/d12/d43/f4c [986433,5487] 0 2024-03-12T16:10:36.261 INFO:tasks.workunit.client.1.smithi134.stdout:2/275: write d4/d12/f18 [4935131,98800] 0 2024-03-12T16:10:36.264 INFO:tasks.workunit.client.1.smithi134.stdout:3/353: rename d1/c56 to d1/db/d10/d2a/c81 0 2024-03-12T16:10:36.264 INFO:tasks.workunit.client.1.smithi134.stdout:4/232: dread d1/d24/f19 [0,4194304] 0 2024-03-12T16:10:36.266 INFO:tasks.workunit.client.1.smithi134.stdout:9/250: write d5/d10/f32 [3092959,24995] 0 2024-03-12T16:10:36.267 INFO:tasks.workunit.client.1.smithi134.stdout:7/197: creat d8/dc/d2f/f41 x:0 0 0 2024-03-12T16:10:36.267 INFO:tasks.workunit.client.1.smithi134.stdout:4/233: write d1/d13/f1a [946689,93471] 0 2024-03-12T16:10:36.269 INFO:tasks.workunit.client.1.smithi134.stdout:4/234: fsync d1/f42 0 2024-03-12T16:10:36.271 INFO:tasks.workunit.client.1.smithi134.stdout:0/315: creat db/d2f/d51/f64 x:0 0 0 2024-03-12T16:10:36.272 INFO:tasks.workunit.client.1.smithi134.stdout:9/251: symlink d5/d20/d36/l42 0 2024-03-12T16:10:36.273 INFO:tasks.workunit.client.1.smithi134.stdout:7/198: dread d8/dc/d20/f2e [0,4194304] 0 2024-03-12T16:10:36.279 INFO:tasks.workunit.client.1.smithi134.stdout:0/316: fsync db/f2d 0 2024-03-12T16:10:36.280 INFO:tasks.workunit.client.1.smithi134.stdout:5/391: dwrite db/d12/d1d/f35 [0,4194304] 0 2024-03-12T16:10:36.281 INFO:tasks.workunit.client.1.smithi134.stdout:9/252: chown d5/d10/d1f/l37 1526 1 2024-03-12T16:10:36.287 INFO:tasks.workunit.client.1.smithi134.stdout:4/235: symlink d1/l4e 0 2024-03-12T16:10:36.288 INFO:tasks.workunit.client.1.smithi134.stdout:7/199: rename d8/dc/d20/d26/d36/c3e to d8/dc/d20/d26/c42 0 2024-03-12T16:10:36.288 INFO:tasks.workunit.client.1.smithi134.stdout:3/354: write d1/db/f20 [102161,58986] 0 2024-03-12T16:10:36.288 INFO:tasks.workunit.client.1.smithi134.stdout:0/317: dwrite db/d2f/f52 [0,4194304] 0 2024-03-12T16:10:36.290 INFO:tasks.workunit.client.1.smithi134.stdout:7/200: dread - d8/f24 zero size 2024-03-12T16:10:36.293 INFO:tasks.workunit.client.1.smithi134.stdout:7/201: fsync d8/f24 0 2024-03-12T16:10:36.295 INFO:tasks.workunit.client.1.smithi134.stdout:5/392: creat db/d12/d1d/d3a/d4e/f82 x:0 0 0 2024-03-12T16:10:36.296 INFO:tasks.workunit.client.1.smithi134.stdout:6/307: sync 2024-03-12T16:10:36.297 INFO:tasks.workunit.client.1.smithi134.stdout:2/276: truncate d4/d12/d3b/d3f/f5d 3960405 0 2024-03-12T16:10:36.299 INFO:tasks.workunit.client.1.smithi134.stdout:7/202: symlink d8/dc/d20/d26/d36/l43 0 2024-03-12T16:10:36.301 INFO:tasks.workunit.client.1.smithi134.stdout:4/236: mkdir d1/d13/d18/d28/d4f 0 2024-03-12T16:10:36.304 INFO:tasks.workunit.client.1.smithi134.stdout:6/308: chown d1/d3/d19/f63 3492 1 2024-03-12T16:10:36.304 INFO:tasks.workunit.client.1.smithi134.stdout:0/318: creat db/d2f/d31/d56/f65 x:0 0 0 2024-03-12T16:10:36.305 INFO:tasks.workunit.client.1.smithi134.stdout:5/393: symlink db/d12/d7b/l83 0 2024-03-12T16:10:36.306 INFO:tasks.workunit.client.1.smithi134.stdout:7/203: stat d8/dc/d2f 0 2024-03-12T16:10:36.308 INFO:tasks.workunit.client.1.smithi134.stdout:5/394: stat f5 0 2024-03-12T16:10:36.308 INFO:tasks.workunit.client.1.smithi134.stdout:3/355: dwrite d1/f66 [0,4194304] 0 2024-03-12T16:10:36.316 INFO:tasks.workunit.client.1.smithi134.stdout:4/237: rmdir d1/d13/d18/d28 39 2024-03-12T16:10:36.316 INFO:tasks.workunit.client.1.smithi134.stdout:9/253: dwrite d5/d10/f1c [0,4194304] 0 2024-03-12T16:10:36.320 INFO:tasks.workunit.client.1.smithi134.stdout:0/319: dread db/f1d [0,4194304] 0 2024-03-12T16:10:36.321 INFO:tasks.workunit.client.1.smithi134.stdout:7/204: write d8/dc/d20/f21 [632051,56644] 0 2024-03-12T16:10:36.323 INFO:tasks.workunit.client.1.smithi134.stdout:9/254: rmdir d5/d20 39 2024-03-12T16:10:36.324 INFO:tasks.workunit.client.1.smithi134.stdout:2/277: dwrite d4/f24 [0,4194304] 0 2024-03-12T16:10:36.326 INFO:tasks.workunit.client.1.smithi134.stdout:9/255: stat d5/f28 0 2024-03-12T16:10:36.327 INFO:tasks.workunit.client.1.smithi134.stdout:4/238: symlink d1/d24/d34/l50 0 2024-03-12T16:10:36.334 INFO:tasks.workunit.client.1.smithi134.stdout:3/356: rename d1/db/ld to d1/db/d10/l82 0 2024-03-12T16:10:36.337 INFO:tasks.workunit.client.1.smithi134.stdout:9/256: creat d5/d10/d1f/f43 x:0 0 0 2024-03-12T16:10:36.337 INFO:tasks.workunit.client.1.smithi134.stdout:5/395: dwrite db/d12/d1d/d3a/d4e/f4f [0,4194304] 0 2024-03-12T16:10:36.338 INFO:tasks.workunit.client.1.smithi134.stdout:2/278: truncate d4/f13 1543169 0 2024-03-12T16:10:36.338 INFO:tasks.workunit.client.1.smithi134.stdout:6/309: dwrite d1/d3/f22 [0,4194304] 0 2024-03-12T16:10:36.340 INFO:tasks.workunit.client.1.smithi134.stdout:3/357: creat d1/d63/f83 x:0 0 0 2024-03-12T16:10:36.343 INFO:tasks.workunit.client.1.smithi134.stdout:7/205: dread d8/dc/d20/d26/f37 [0,4194304] 0 2024-03-12T16:10:36.346 INFO:tasks.workunit.client.1.smithi134.stdout:9/257: dwrite d5/d10/f32 [0,4194304] 0 2024-03-12T16:10:36.347 INFO:tasks.workunit.client.1.smithi134.stdout:2/279: unlink d4/d12/d3b/f44 0 2024-03-12T16:10:36.352 INFO:tasks.workunit.client.1.smithi134.stdout:5/396: mknod db/d12/d37/d73/c84 0 2024-03-12T16:10:36.355 INFO:tasks.workunit.client.1.smithi134.stdout:2/280: write d4/d12/f48 [825039,68712] 0 2024-03-12T16:10:36.356 INFO:tasks.workunit.client.1.smithi134.stdout:7/206: chown d8/f2a 444247966 1 2024-03-12T16:10:36.361 INFO:tasks.workunit.client.1.smithi134.stdout:2/281: write d4/fc [1733011,9044] 0 2024-03-12T16:10:36.362 INFO:tasks.workunit.client.1.smithi134.stdout:0/320: dwrite db/f1d [0,4194304] 0 2024-03-12T16:10:36.362 INFO:tasks.workunit.client.1.smithi134.stdout:9/258: dwrite d5/fe [4194304,4194304] 0 2024-03-12T16:10:36.364 INFO:tasks.workunit.client.1.smithi134.stdout:2/282: chown d4/d12/d1d 103065 1 2024-03-12T16:10:36.364 INFO:tasks.workunit.client.1.smithi134.stdout:7/207: creat d8/d39/f44 x:0 0 0 2024-03-12T16:10:36.365 INFO:tasks.workunit.client.1.smithi134.stdout:2/283: chown d4 193051 1 2024-03-12T16:10:36.367 INFO:tasks.workunit.client.1.smithi134.stdout:2/284: write d4/d12/d1d/d34/f54 [928437,29052] 0 2024-03-12T16:10:36.369 INFO:tasks.workunit.client.1.smithi134.stdout:7/208: creat d8/d39/f45 x:0 0 0 2024-03-12T16:10:36.371 INFO:tasks.workunit.client.1.smithi134.stdout:0/321: unlink db/c1b 0 2024-03-12T16:10:36.375 INFO:tasks.workunit.client.1.smithi134.stdout:9/259: creat d5/d10/d33/f44 x:0 0 0 2024-03-12T16:10:36.375 INFO:tasks.workunit.client.1.smithi134.stdout:7/209: dread d8/dc/d20/f21 [0,4194304] 0 2024-03-12T16:10:36.376 INFO:tasks.workunit.client.1.smithi134.stdout:0/322: mkdir db/d2f/d31/d56/d66 0 2024-03-12T16:10:36.379 INFO:tasks.workunit.client.1.smithi134.stdout:2/285: dread d4/d12/d3b/d3f/f5d [0,4194304] 0 2024-03-12T16:10:36.381 INFO:tasks.workunit.client.1.smithi134.stdout:2/286: chown d4/l6 14601787 1 2024-03-12T16:10:36.383 INFO:tasks.workunit.client.1.smithi134.stdout:2/287: readlink d4/d12/d1d/d34/d47/d56/l60 0 2024-03-12T16:10:36.383 INFO:tasks.workunit.client.1.smithi134.stdout:0/323: truncate db/d2f/f4f 846234 0 2024-03-12T16:10:36.386 INFO:tasks.workunit.client.1.smithi134.stdout:7/210: dwrite d8/dc/d20/d26/f2c [0,4194304] 0 2024-03-12T16:10:36.388 INFO:tasks.workunit.client.1.smithi134.stdout:0/324: unlink db/d2f/d31/f60 0 2024-03-12T16:10:36.389 INFO:tasks.workunit.client.1.smithi134.stdout:2/288: symlink d4/d12/d3b/d3f/l65 0 2024-03-12T16:10:36.391 INFO:tasks.workunit.client.1.smithi134.stdout:7/211: creat d8/d27/f46 x:0 0 0 2024-03-12T16:10:36.393 INFO:tasks.workunit.client.1.smithi134.stdout:0/325: mkdir db/d2f/d61/d67 0 2024-03-12T16:10:36.394 INFO:tasks.workunit.client.1.smithi134.stdout:7/212: truncate d8/ff 372046 0 2024-03-12T16:10:36.397 INFO:tasks.workunit.client.1.smithi134.stdout:0/326: mkdir db/d2f/d31/d68 0 2024-03-12T16:10:36.399 INFO:tasks.workunit.client.1.smithi134.stdout:0/327: creat db/d2f/d61/d67/f69 x:0 0 0 2024-03-12T16:10:36.401 INFO:tasks.workunit.client.1.smithi134.stdout:7/213: dread d8/dc/d20/f13 [0,4194304] 0 2024-03-12T16:10:36.427 INFO:tasks.workunit.client.1.smithi134.stdout:1/202: sync 2024-03-12T16:10:36.442 INFO:tasks.workunit.client.1.smithi134.stdout:1/203: fdatasync d0/f2c 0 2024-03-12T16:10:36.442 INFO:tasks.workunit.client.1.smithi134.stdout:0/328: link db/c53 db/d2f/d31/d56/c6a 0 2024-03-12T16:10:36.443 INFO:tasks.workunit.client.1.smithi134.stdout:1/204: write d0/d16/d9/d13/f17 [3531837,35945] 0 2024-03-12T16:10:36.445 INFO:tasks.workunit.client.1.smithi134.stdout:1/205: write d0/d16/f29 [3130101,17717] 0 2024-03-12T16:10:36.447 INFO:tasks.workunit.client.1.smithi134.stdout:7/214: getdents d8/dc 0 2024-03-12T16:10:36.447 INFO:tasks.workunit.client.1.smithi134.stdout:0/329: mknod db/d2f/d31/d68/c6b 0 2024-03-12T16:10:36.449 INFO:tasks.workunit.client.1.smithi134.stdout:1/206: truncate d0/d16/d9/d13/d21/f33 98763 0 2024-03-12T16:10:36.450 INFO:tasks.workunit.client.1.smithi134.stdout:0/330: read db/f21 [3880812,47455] 0 2024-03-12T16:10:36.450 INFO:tasks.workunit.client.1.smithi134.stdout:7/215: symlink d8/dc/d20/l47 0 2024-03-12T16:10:36.451 INFO:tasks.workunit.client.1.smithi134.stdout:1/207: write d0/d16/d9/d13/f35 [382448,49158] 0 2024-03-12T16:10:36.452 INFO:tasks.workunit.client.1.smithi134.stdout:7/216: write d8/f24 [589821,74350] 0 2024-03-12T16:10:36.455 INFO:tasks.workunit.client.1.smithi134.stdout:0/331: mkdir db/d2f/d61/d6c 0 2024-03-12T16:10:36.455 INFO:tasks.workunit.client.1.smithi134.stdout:1/208: dread d0/d16/d9/d13/d21/f33 [0,4194304] 0 2024-03-12T16:10:36.456 INFO:tasks.workunit.client.1.smithi134.stdout:0/332: chown db/f50 5354832 1 2024-03-12T16:10:36.456 INFO:tasks.workunit.client.1.smithi134.stdout:1/209: readlink d0/d16/d9/d13/l1a 0 2024-03-12T16:10:36.458 INFO:tasks.workunit.client.1.smithi134.stdout:1/210: chown d0/d16/d9/d13/d38/c3c 20769386 1 2024-03-12T16:10:36.465 INFO:tasks.workunit.client.1.smithi134.stdout:1/211: getdents d0/d16/d9 0 2024-03-12T16:10:36.466 INFO:tasks.workunit.client.1.smithi134.stdout:7/217: write d8/dc/d20/f2e [413632,127553] 0 2024-03-12T16:10:36.467 INFO:tasks.workunit.client.1.smithi134.stdout:1/212: chown d0/d16/d9/c36 244928 1 2024-03-12T16:10:36.470 INFO:tasks.workunit.client.1.smithi134.stdout:7/218: link c5 d8/dc/d20/c48 0 2024-03-12T16:10:36.476 INFO:tasks.workunit.client.1.smithi134.stdout:0/333: dread db/f1f [0,4194304] 0 2024-03-12T16:10:36.477 INFO:tasks.workunit.client.1.smithi134.stdout:7/219: dwrite d8/d27/f3f [0,4194304] 0 2024-03-12T16:10:36.479 INFO:tasks.workunit.client.1.smithi134.stdout:7/220: dread d8/dc/d20/f13 [0,4194304] 0 2024-03-12T16:10:36.480 INFO:tasks.workunit.client.1.smithi134.stdout:0/334: symlink db/d2f/d31/d68/l6d 0 2024-03-12T16:10:36.480 INFO:tasks.workunit.client.1.smithi134.stdout:1/213: link d0/d16/f31 d0/d16/d9/d13/d21/f4c 0 2024-03-12T16:10:36.482 INFO:tasks.workunit.client.1.smithi134.stdout:1/214: write d0/d16/d9/d13/f35 [322455,41408] 0 2024-03-12T16:10:36.483 INFO:tasks.workunit.client.1.smithi134.stdout:7/221: mknod d8/dc/c49 0 2024-03-12T16:10:36.488 INFO:tasks.workunit.client.1.smithi134.stdout:0/335: creat db/f6e x:0 0 0 2024-03-12T16:10:36.490 INFO:tasks.workunit.client.1.smithi134.stdout:1/215: creat d0/d16/d9/d13/d21/f4d x:0 0 0 2024-03-12T16:10:36.491 INFO:tasks.workunit.client.1.smithi134.stdout:0/336: symlink db/d2f/l6f 0 2024-03-12T16:10:36.493 INFO:tasks.workunit.client.1.smithi134.stdout:1/216: creat d0/d16/d9/d1c/f4e x:0 0 0 2024-03-12T16:10:36.496 INFO:tasks.workunit.client.1.smithi134.stdout:0/337: write db/f1f [4077700,68937] 0 2024-03-12T16:10:36.497 INFO:tasks.workunit.client.1.smithi134.stdout:1/217: write d0/d16/d9/d1c/f27 [940957,58903] 0 2024-03-12T16:10:36.502 INFO:tasks.workunit.client.1.smithi134.stdout:1/218: unlink d0/d42/f4b 0 2024-03-12T16:10:36.504 INFO:tasks.workunit.client.1.smithi134.stdout:0/338: rmdir db/d2f 39 2024-03-12T16:10:36.504 INFO:tasks.workunit.client.1.smithi134.stdout:7/222: dread d8/dc/d20/d26/f37 [0,4194304] 0 2024-03-12T16:10:36.507 INFO:tasks.workunit.client.1.smithi134.stdout:1/219: rename d0/d16/d9/d13/f35 to d0/d16/d9/d13/d21/d20/f4f 0 2024-03-12T16:10:36.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/339: mkdir db/d2f/d31/d68/d70 0 2024-03-12T16:10:36.510 INFO:tasks.workunit.client.1.smithi134.stdout:1/220: mknod d0/d16/d9/d13/d21/d20/c50 0 2024-03-12T16:10:36.510 INFO:tasks.workunit.client.1.smithi134.stdout:7/223: truncate d8/dc/d2f/d31/f35 1791038 0 2024-03-12T16:10:36.512 INFO:tasks.workunit.client.1.smithi134.stdout:1/221: mkdir d0/d16/d9/d51 0 2024-03-12T16:10:36.513 INFO:tasks.workunit.client.1.smithi134.stdout:7/224: creat d8/dc/d2f/d31/f4a x:0 0 0 2024-03-12T16:10:36.517 INFO:tasks.workunit.client.1.smithi134.stdout:7/225: rename d8/d39 to d8/dc/d4b 0 2024-03-12T16:10:36.521 INFO:tasks.workunit.client.1.smithi134.stdout:7/226: symlink d8/dc/d20/d26/l4c 0 2024-03-12T16:10:36.522 INFO:tasks.workunit.client.1.smithi134.stdout:7/227: mknod d8/dc/d20/d26/c4d 0 2024-03-12T16:10:36.527 INFO:tasks.workunit.client.1.smithi134.stdout:1/222: write d0/d16/d9/d13/d21/f33 [850346,105443] 0 2024-03-12T16:10:36.528 INFO:tasks.workunit.client.1.smithi134.stdout:1/223: stat d0/d16/d9/d13/d21/f4d 0 2024-03-12T16:10:36.536 INFO:tasks.workunit.client.1.smithi134.stdout:1/224: dwrite d0/d16/d9/d13/d21/f23 [4194304,4194304] 0 2024-03-12T16:10:36.540 INFO:tasks.workunit.client.1.smithi134.stdout:7/228: dread d8/f1f [0,4194304] 0 2024-03-12T16:10:36.541 INFO:tasks.workunit.client.1.smithi134.stdout:1/225: dread d0/d16/d9/d13/d21/f23 [4194304,4194304] 0 2024-03-12T16:10:36.542 INFO:tasks.workunit.client.1.smithi134.stdout:1/226: mknod d0/d42/c52 0 2024-03-12T16:10:36.543 INFO:tasks.workunit.client.1.smithi134.stdout:7/229: mkdir d8/d4e 0 2024-03-12T16:10:36.544 INFO:tasks.workunit.client.1.smithi134.stdout:1/227: mknod d0/d16/d9/c53 0 2024-03-12T16:10:36.545 INFO:tasks.workunit.client.1.smithi134.stdout:7/230: chown d8/fd 8472 1 2024-03-12T16:10:36.546 INFO:tasks.workunit.client.1.smithi134.stdout:8/234: sync 2024-03-12T16:10:36.550 INFO:tasks.workunit.client.1.smithi134.stdout:7/231: rename d8/dc/d20/l19 to d8/dc/d20/d26/l4f 0 2024-03-12T16:10:36.550 INFO:tasks.workunit.client.1.smithi134.stdout:1/228: getdents d0/d16/d9/d13/d21/d2f 0 2024-03-12T16:10:36.554 INFO:tasks.workunit.client.1.smithi134.stdout:7/232: creat d8/dc/d20/d26/f50 x:0 0 0 2024-03-12T16:10:36.555 INFO:tasks.workunit.client.1.smithi134.stdout:8/235: dwrite d3/d1b/d17/d25/d33/d15/d1c/f3d [0,4194304] 0 2024-03-12T16:10:36.555 INFO:tasks.workunit.client.1.smithi134.stdout:1/229: mknod d0/d42/d47/c54 0 2024-03-12T16:10:36.556 INFO:tasks.workunit.client.1.smithi134.stdout:1/230: write d0/d16/f4a [285367,106401] 0 2024-03-12T16:10:36.557 INFO:tasks.workunit.client.1.smithi134.stdout:8/236: stat d3/d1b/d17/d25/d33/d15/l3c 0 2024-03-12T16:10:36.558 INFO:tasks.workunit.client.1.smithi134.stdout:8/237: fsync d3/fe 0 2024-03-12T16:10:36.563 INFO:tasks.workunit.client.1.smithi134.stdout:7/233: write d8/ff [960105,108371] 0 2024-03-12T16:10:36.563 INFO:tasks.workunit.client.1.smithi134.stdout:1/231: creat d0/d16/d9/d51/f55 x:0 0 0 2024-03-12T16:10:36.564 INFO:tasks.workunit.client.1.smithi134.stdout:8/238: symlink d3/d1b/d17/d25/d49/l4d 0 2024-03-12T16:10:36.567 INFO:tasks.workunit.client.1.smithi134.stdout:1/232: rename d0/d16/f4a to d0/d16/d9/d13/d21/d2f/f56 0 2024-03-12T16:10:36.570 INFO:tasks.workunit.client.1.smithi134.stdout:1/233: creat d0/d16/d9/d13/d21/f57 x:0 0 0 2024-03-12T16:10:36.570 INFO:tasks.workunit.client.1.smithi134.stdout:8/239: read d3/d1b/d17/d25/d33/d15/d2b/d42/f48 [1272923,126064] 0 2024-03-12T16:10:36.572 INFO:tasks.workunit.client.1.smithi134.stdout:1/234: mknod d0/d16/d9/d13/d21/d20/c58 0 2024-03-12T16:10:36.580 INFO:tasks.workunit.client.1.smithi134.stdout:1/235: truncate d0/d16/d9/d13/f3f 3564351 0 2024-03-12T16:10:36.581 INFO:tasks.workunit.client.1.smithi134.stdout:1/236: mknod d0/d42/c59 0 2024-03-12T16:10:36.583 INFO:tasks.workunit.client.1.smithi134.stdout:1/237: write d0/d16/d9/d13/d21/f23 [4469726,116080] 0 2024-03-12T16:10:36.586 INFO:tasks.workunit.client.1.smithi134.stdout:8/240: dread d3/d1b/d17/d25/d33/d15/d2b/f32 [0,4194304] 0 2024-03-12T16:10:36.586 INFO:tasks.workunit.client.1.smithi134.stdout:8/241: rename d3/d10/d31 to d3/d10/d31/d4e 22 2024-03-12T16:10:36.587 INFO:tasks.workunit.client.1.smithi134.stdout:8/242: chown d3/d1b/d17/d25/d33/d15/d2b/f30 12225296 1 2024-03-12T16:10:36.588 INFO:tasks.workunit.client.1.smithi134.stdout:8/243: write d3/d1b/f1d [7643852,122009] 0 2024-03-12T16:10:36.588 INFO:tasks.workunit.client.1.smithi134.stdout:8/244: fsync d3/d1b/d17/d24/f4c 0 2024-03-12T16:10:36.590 INFO:tasks.workunit.client.1.smithi134.stdout:8/245: read d3/d1b/f19 [2742427,43579] 0 2024-03-12T16:10:36.593 INFO:tasks.workunit.client.1.smithi134.stdout:8/246: rename d3/d1b/d17/d25/d33/d15/d1c to d3/d1b/d17/d25/d33/d15/d2b/d4f 0 2024-03-12T16:10:36.602 INFO:tasks.workunit.client.1.smithi134.stdout:8/247: truncate d3/d1b/d17/d25/d33/d15/d2b/f32 1289835 0 2024-03-12T16:10:36.603 INFO:tasks.workunit.client.1.smithi134.stdout:8/248: symlink d3/d1b/d17/d25/d33/l50 0 2024-03-12T16:10:36.605 INFO:tasks.workunit.client.1.smithi134.stdout:8/249: write d3/d1b/f19 [3609254,14550] 0 2024-03-12T16:10:36.612 INFO:tasks.workunit.client.1.smithi134.stdout:8/250: truncate d3/d1b/f1d 812832 0 2024-03-12T16:10:36.613 INFO:tasks.workunit.client.1.smithi134.stdout:8/251: write d3/d1b/f19 [2706850,125686] 0 2024-03-12T16:10:36.616 INFO:tasks.workunit.client.1.smithi134.stdout:8/252: symlink d3/d1b/d17/d25/d33/d15/d2b/d42/l51 0 2024-03-12T16:10:36.624 INFO:tasks.workunit.client.1.smithi134.stdout:8/253: write d3/d1b/d17/d24/f2d [1503105,118297] 0 2024-03-12T16:10:36.626 INFO:tasks.workunit.client.1.smithi134.stdout:8/254: creat d3/d1b/d17/d3f/f52 x:0 0 0 2024-03-12T16:10:36.637 INFO:tasks.workunit.client.1.smithi134.stdout:8/255: dread d3/d1b/f2a [0,4194304] 0 2024-03-12T16:10:36.638 INFO:tasks.workunit.client.1.smithi134.stdout:8/256: write d3/d1b/d17/d25/d33/d15/d2b/f30 [1564857,94593] 0 2024-03-12T16:10:36.641 INFO:tasks.workunit.client.1.smithi134.stdout:8/257: unlink d3/d1b/d17/d25/d33/d15/l3c 0 2024-03-12T16:10:36.643 INFO:tasks.workunit.client.1.smithi134.stdout:8/258: creat d3/d10/d31/f53 x:0 0 0 2024-03-12T16:10:36.645 INFO:tasks.workunit.client.1.smithi134.stdout:8/259: write d3/d1b/d17/d25/d33/d15/d2b/f37 [1231041,108628] 0 2024-03-12T16:10:36.647 INFO:tasks.workunit.client.1.smithi134.stdout:8/260: creat d3/d10/d31/f54 x:0 0 0 2024-03-12T16:10:36.661 INFO:tasks.workunit.client.1.smithi134.stdout:8/261: dread d3/d1b/d17/d25/d33/f34 [0,4194304] 0 2024-03-12T16:10:36.662 INFO:tasks.workunit.client.1.smithi134.stdout:8/262: write d3/d1b/d17/d25/d33/d15/d2b/f30 [4112146,121578] 0 2024-03-12T16:10:36.663 INFO:tasks.workunit.client.1.smithi134.stdout:8/263: stat d3/d1b/c27 0 2024-03-12T16:10:36.664 INFO:tasks.workunit.client.1.smithi134.stdout:8/264: write d3/d1b/d17/d25/d33/d15/d2b/f30 [4375115,88491] 0 2024-03-12T16:10:36.670 INFO:tasks.workunit.client.1.smithi134.stdout:8/265: dwrite d3/d1b/d17/d24/f2d [0,4194304] 0 2024-03-12T16:10:36.673 INFO:tasks.workunit.client.1.smithi134.stdout:8/266: write d3/d1b/d17/d25/d33/f34 [1901444,15144] 0 2024-03-12T16:10:36.674 INFO:tasks.workunit.client.1.smithi134.stdout:8/267: rmdir d3/d10 39 2024-03-12T16:10:36.678 INFO:tasks.workunit.client.1.smithi134.stdout:8/268: symlink d3/d10/d31/l55 0 2024-03-12T16:10:36.681 INFO:tasks.workunit.client.1.smithi134.stdout:8/269: mknod d3/d1b/d17/d25/d33/d15/c56 0 2024-03-12T16:10:36.682 INFO:tasks.workunit.client.1.smithi134.stdout:8/270: fdatasync d3/d1b/d17/d25/d33/d15/d2b/f30 0 2024-03-12T16:10:36.685 INFO:tasks.workunit.client.1.smithi134.stdout:8/271: creat d3/f57 x:0 0 0 2024-03-12T16:10:36.687 INFO:tasks.workunit.client.1.smithi134.stdout:8/272: unlink d3/d10/d31/f54 0 2024-03-12T16:10:36.689 INFO:tasks.workunit.client.1.smithi134.stdout:8/273: rmdir d3/d1b/d17/d25/d33/d15/d2b/d4f 39 2024-03-12T16:10:36.690 INFO:tasks.workunit.client.1.smithi134.stdout:8/274: creat d3/d10/f58 x:0 0 0 2024-03-12T16:10:36.691 INFO:tasks.workunit.client.1.smithi134.stdout:8/275: stat d3/d1b/c27 0 2024-03-12T16:10:36.696 INFO:tasks.workunit.client.1.smithi134.stdout:8/276: dwrite d3/d10/f58 [0,4194304] 0 2024-03-12T16:10:36.701 INFO:tasks.workunit.client.1.smithi134.stdout:8/277: mkdir d3/d1b/d17/d25/d33/d15/d2b/d42/d59 0 2024-03-12T16:10:36.702 INFO:tasks.workunit.client.1.smithi134.stdout:8/278: write d3/d1b/d17/f1a [228875,66272] 0 2024-03-12T16:10:36.704 INFO:tasks.workunit.client.1.smithi134.stdout:8/279: write d3/fe [2203970,12821] 0 2024-03-12T16:10:36.708 INFO:tasks.workunit.client.1.smithi134.stdout:8/280: fsync d3/d1b/d17/d25/d33/d15/d2b/f32 0 2024-03-12T16:10:36.714 INFO:tasks.workunit.client.1.smithi134.stdout:8/281: truncate d3/f8 3178247 0 2024-03-12T16:10:36.715 INFO:tasks.workunit.client.1.smithi134.stdout:8/282: fsync d3/d1b/d17/d25/d33/d15/d2b/f30 0 2024-03-12T16:10:36.716 INFO:tasks.workunit.client.1.smithi134.stdout:8/283: stat d3/f57 0 2024-03-12T16:10:36.717 INFO:tasks.workunit.client.1.smithi134.stdout:8/284: chown d3/d1b/d17/d25/d33/d15/d2b/d4f/f40 18910186 1 2024-03-12T16:10:36.718 INFO:tasks.workunit.client.1.smithi134.stdout:8/285: fsync d3/d1b/d17/f47 0 2024-03-12T16:10:36.720 INFO:tasks.workunit.client.1.smithi134.stdout:8/286: symlink d3/d1b/d17/d25/d33/d15/d2b/d42/l5a 0 2024-03-12T16:10:36.720 INFO:tasks.workunit.client.1.smithi134.stdout:8/287: dread - d3/d1b/f41 zero size 2024-03-12T16:10:36.726 INFO:tasks.workunit.client.1.smithi134.stdout:8/288: rmdir d3/d1b/d17/d25/d33/d15 39 2024-03-12T16:10:36.727 INFO:tasks.workunit.client.1.smithi134.stdout:8/289: dread - d3/d1b/d17/d3f/f52 zero size 2024-03-12T16:10:36.729 INFO:tasks.workunit.client.1.smithi134.stdout:4/239: sync 2024-03-12T16:10:36.729 INFO:tasks.workunit.client.1.smithi134.stdout:6/310: sync 2024-03-12T16:10:36.730 INFO:tasks.workunit.client.1.smithi134.stdout:3/358: sync 2024-03-12T16:10:36.731 INFO:tasks.workunit.client.1.smithi134.stdout:3/359: fdatasync d1/db/d14/f59 0 2024-03-12T16:10:36.731 INFO:tasks.workunit.client.1.smithi134.stdout:4/240: write d1/de/f36 [5073081,14335] 0 2024-03-12T16:10:36.739 INFO:tasks.workunit.client.1.smithi134.stdout:8/290: dwrite d3/d1b/d17/d25/d33/d15/d2b/f37 [0,4194304] 0 2024-03-12T16:10:36.739 INFO:tasks.workunit.client.1.smithi134.stdout:6/311: getdents d1/d3/d19/d32/d4a 0 2024-03-12T16:10:36.746 INFO:tasks.workunit.client.1.smithi134.stdout:6/312: fsync d1/f1e 0 2024-03-12T16:10:36.746 INFO:tasks.workunit.client.1.smithi134.stdout:3/360: dwrite d1/db/f20 [0,4194304] 0 2024-03-12T16:10:36.746 INFO:tasks.workunit.client.1.smithi134.stdout:4/241: dread d1/f3a [4194304,4194304] 0 2024-03-12T16:10:36.752 INFO:tasks.workunit.client.1.smithi134.stdout:3/361: symlink d1/db/d12/l84 0 2024-03-12T16:10:36.752 INFO:tasks.workunit.client.1.smithi134.stdout:8/291: mkdir d3/d1b/d17/d25/d33/d15/d2b/d5b 0 2024-03-12T16:10:36.754 INFO:tasks.workunit.client.1.smithi134.stdout:3/362: creat d1/d63/d6c/f85 x:0 0 0 2024-03-12T16:10:36.755 INFO:tasks.workunit.client.1.smithi134.stdout:6/313: dwrite d1/f1e [0,4194304] 0 2024-03-12T16:10:36.756 INFO:tasks.workunit.client.1.smithi134.stdout:3/363: readlink d1/db/d10/d2d/d2e/l3a 0 2024-03-12T16:10:36.757 INFO:tasks.workunit.client.1.smithi134.stdout:4/242: creat d1/d13/d18/d28/d4f/f51 x:0 0 0 2024-03-12T16:10:36.758 INFO:tasks.workunit.client.1.smithi134.stdout:4/243: chown d1/la 9799292 1 2024-03-12T16:10:36.762 INFO:tasks.workunit.client.1.smithi134.stdout:6/314: rename d1/d16/f6a to d1/d3/d19/d32/d4a/f7a 0 2024-03-12T16:10:36.763 INFO:tasks.workunit.client.1.smithi134.stdout:6/315: write d1/f1d [1587329,109622] 0 2024-03-12T16:10:36.766 INFO:tasks.workunit.client.1.smithi134.stdout:6/316: mkdir d1/d16/d4c/d65/d7b 0 2024-03-12T16:10:36.767 INFO:tasks.workunit.client.1.smithi134.stdout:4/244: link d1/de/l2f d1/l52 0 2024-03-12T16:10:36.767 INFO:tasks.workunit.client.1.smithi134.stdout:8/292: dwrite d3/f6 [0,4194304] 0 2024-03-12T16:10:36.770 INFO:tasks.workunit.client.1.smithi134.stdout:4/245: write d1/d13/d18/d28/f3f [3293310,111145] 0 2024-03-12T16:10:36.772 INFO:tasks.workunit.client.1.smithi134.stdout:4/246: chown d1/d24/d34/c37 141 1 2024-03-12T16:10:36.775 INFO:tasks.workunit.client.1.smithi134.stdout:6/317: symlink d1/d3a/d3b/l7c 0 2024-03-12T16:10:36.776 INFO:tasks.workunit.client.1.smithi134.stdout:8/293: dread d3/d1b/d17/d25/d33/d15/d2b/f37 [0,4194304] 0 2024-03-12T16:10:36.776 INFO:tasks.workunit.client.1.smithi134.stdout:3/364: dread d1/db/d12/f7a [0,4194304] 0 2024-03-12T16:10:36.777 INFO:tasks.workunit.client.1.smithi134.stdout:6/318: dread - d1/d16/d4c/d65/f6b zero size 2024-03-12T16:10:36.779 INFO:tasks.workunit.client.1.smithi134.stdout:3/365: symlink d1/d63/l86 0 2024-03-12T16:10:36.780 INFO:tasks.workunit.client.1.smithi134.stdout:8/294: dread d3/d1b/d17/d25/d33/d15/d2b/f32 [0,4194304] 0 2024-03-12T16:10:36.781 INFO:tasks.workunit.client.1.smithi134.stdout:6/319: mknod d1/d3/d19/c7d 0 2024-03-12T16:10:36.783 INFO:tasks.workunit.client.1.smithi134.stdout:6/320: mkdir d1/d16/d7e 0 2024-03-12T16:10:36.785 INFO:tasks.workunit.client.1.smithi134.stdout:8/295: mknod d3/d1b/d17/d25/d33/d15/d2b/d42/c5c 0 2024-03-12T16:10:36.787 INFO:tasks.workunit.client.1.smithi134.stdout:8/296: write d3/d1b/f1f [280921,109973] 0 2024-03-12T16:10:36.787 INFO:tasks.workunit.client.1.smithi134.stdout:3/366: read d1/db/d10/d2d/d30/f55 [2170979,126740] 0 2024-03-12T16:10:36.788 INFO:tasks.workunit.client.1.smithi134.stdout:3/367: chown d1/db/d12/f7a 749123 1 2024-03-12T16:10:36.789 INFO:tasks.workunit.client.1.smithi134.stdout:6/321: rename d1/f1d to d1/d3a/d3b/d6d/d75/f7f 0 2024-03-12T16:10:36.795 INFO:tasks.workunit.client.1.smithi134.stdout:4/247: dread d1/f23 [0,4194304] 0 2024-03-12T16:10:36.797 INFO:tasks.workunit.client.1.smithi134.stdout:8/297: dwrite d3/f57 [0,4194304] 0 2024-03-12T16:10:36.798 INFO:tasks.workunit.client.1.smithi134.stdout:8/298: stat d3/f57 0 2024-03-12T16:10:36.799 INFO:tasks.workunit.client.1.smithi134.stdout:3/368: dread d1/db/f20 [0,4194304] 0 2024-03-12T16:10:36.799 INFO:tasks.workunit.client.1.smithi134.stdout:4/248: mkdir d1/d13/d49/d53 0 2024-03-12T16:10:36.803 INFO:tasks.workunit.client.1.smithi134.stdout:3/369: mknod d1/d63/c87 0 2024-03-12T16:10:36.806 INFO:tasks.workunit.client.1.smithi134.stdout:3/370: chown d1/db/d14/f5d 9697 1 2024-03-12T16:10:36.810 INFO:tasks.workunit.client.1.smithi134.stdout:8/299: dwrite d3/d10/d31/f53 [0,4194304] 0 2024-03-12T16:10:36.811 INFO:tasks.workunit.client.1.smithi134.stdout:4/249: dwrite d1/f23 [4194304,4194304] 0 2024-03-12T16:10:36.813 INFO:tasks.workunit.client.1.smithi134.stdout:8/300: dread - d3/d1b/d17/d25/d33/d15/d2b/d4f/f29 zero size 2024-03-12T16:10:36.815 INFO:tasks.workunit.client.1.smithi134.stdout:4/250: creat d1/d13/d18/d35/f54 x:0 0 0 2024-03-12T16:10:36.817 INFO:tasks.workunit.client.1.smithi134.stdout:8/301: symlink d3/d1b/d17/d25/d49/l5d 0 2024-03-12T16:10:36.820 INFO:tasks.workunit.client.1.smithi134.stdout:4/251: write d1/de/f4d [301562,123029] 0 2024-03-12T16:10:36.823 INFO:tasks.workunit.client.1.smithi134.stdout:8/302: rmdir d3/d1b/d17/d25/d33/d15/d2b/d42/d59 0 2024-03-12T16:10:36.824 INFO:tasks.workunit.client.1.smithi134.stdout:8/303: write d3/d1b/d17/d24/f2d [755199,121904] 0 2024-03-12T16:10:36.827 INFO:tasks.workunit.client.1.smithi134.stdout:8/304: write d3/d1b/d17/d24/f4c [214299,109531] 0 2024-03-12T16:10:36.828 INFO:tasks.workunit.client.1.smithi134.stdout:4/252: dwrite d1/d13/d18/d28/d4f/f51 [0,4194304] 0 2024-03-12T16:10:36.832 INFO:tasks.workunit.client.1.smithi134.stdout:8/305: symlink d3/d1b/d17/d25/d49/l5e 0 2024-03-12T16:10:36.838 INFO:tasks.workunit.client.1.smithi134.stdout:4/253: dwrite d1/d13/d49/f32 [0,4194304] 0 2024-03-12T16:10:36.839 INFO:tasks.workunit.client.1.smithi134.stdout:4/254: readlink d1/l38 0 2024-03-12T16:10:36.843 INFO:tasks.workunit.client.1.smithi134.stdout:8/306: dwrite d3/d1b/f1d [0,4194304] 0 2024-03-12T16:10:36.853 INFO:tasks.workunit.client.1.smithi134.stdout:4/255: dwrite d1/de/f17 [0,4194304] 0 2024-03-12T16:10:36.854 INFO:tasks.workunit.client.1.smithi134.stdout:3/371: dread d1/d63/d6c/f6d [4194304,4194304] 0 2024-03-12T16:10:36.859 INFO:tasks.workunit.client.1.smithi134.stdout:3/372: symlink d1/db/d10/d2d/d2e/d72/l88 0 2024-03-12T16:10:36.861 INFO:tasks.workunit.client.1.smithi134.stdout:3/373: mkdir d1/db/d14/d5a/d89 0 2024-03-12T16:10:36.865 INFO:tasks.workunit.client.1.smithi134.stdout:3/374: creat d1/db/d10/f8a x:0 0 0 2024-03-12T16:10:36.869 INFO:tasks.workunit.client.1.smithi134.stdout:3/375: unlink d1/db/d10/d2d/d30/f55 0 2024-03-12T16:10:36.870 INFO:tasks.workunit.client.1.smithi134.stdout:4/256: truncate d1/d13/f1a 2780964 0 2024-03-12T16:10:36.872 INFO:tasks.workunit.client.1.smithi134.stdout:3/376: symlink d1/db/d10/d2a/l8b 0 2024-03-12T16:10:36.873 INFO:tasks.workunit.client.1.smithi134.stdout:8/307: dread d3/f8 [0,4194304] 0 2024-03-12T16:10:36.874 INFO:tasks.workunit.client.1.smithi134.stdout:8/308: truncate d3/d1b/d17/d3f/f52 692692 0 2024-03-12T16:10:36.879 INFO:tasks.workunit.client.1.smithi134.stdout:3/377: dwrite d1/f36 [0,4194304] 0 2024-03-12T16:10:36.879 INFO:tasks.workunit.client.1.smithi134.stdout:8/309: rename d3/d1b/d17/d25/d33/l4b to d3/d10/d31/l5f 0 2024-03-12T16:10:36.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/378: creat d1/d63/f8c x:0 0 0 2024-03-12T16:10:36.885 INFO:tasks.workunit.client.1.smithi134.stdout:8/310: symlink d3/d1b/d17/d25/d33/d15/l60 0 2024-03-12T16:10:36.885 INFO:tasks.workunit.client.1.smithi134.stdout:8/311: fsync d3/d1b/d17/f47 0 2024-03-12T16:10:36.887 INFO:tasks.workunit.client.1.smithi134.stdout:3/379: rename d1/db/d10/c43 to d1/db/d10/d2a/c8d 0 2024-03-12T16:10:36.888 INFO:tasks.workunit.client.1.smithi134.stdout:8/312: rmdir d3/d1b/d17/d25/d33/d15/d2b/d4f 39 2024-03-12T16:10:36.892 INFO:tasks.workunit.client.1.smithi134.stdout:3/380: rename d1/db/d10/d2d/d30/f35 to d1/db/d10/d2d/d2e/d72/f8e 0 2024-03-12T16:10:36.894 INFO:tasks.workunit.client.1.smithi134.stdout:8/313: unlink d3/d1b/f41 0 2024-03-12T16:10:36.896 INFO:tasks.workunit.client.1.smithi134.stdout:4/257: truncate d1/d13/f1d 4947707 0 2024-03-12T16:10:36.897 INFO:tasks.workunit.client.1.smithi134.stdout:3/381: symlink d1/db/l8f 0 2024-03-12T16:10:36.898 INFO:tasks.workunit.client.1.smithi134.stdout:8/314: readlink d3/d1b/d17/d25/d33/d15/d2b/d4f/l43 0 2024-03-12T16:10:36.899 INFO:tasks.workunit.client.1.smithi134.stdout:4/258: symlink d1/d13/d18/d28/l55 0 2024-03-12T16:10:36.902 INFO:tasks.workunit.client.1.smithi134.stdout:8/315: mknod d3/d1b/d17/d45/c61 0 2024-03-12T16:10:36.905 INFO:tasks.workunit.client.1.smithi134.stdout:4/259: rename d1/d13/d18/d28/f43 to d1/d24/f56 0 2024-03-12T16:10:36.906 INFO:tasks.workunit.client.1.smithi134.stdout:3/382: creat d1/db/f90 x:0 0 0 2024-03-12T16:10:36.908 INFO:tasks.workunit.client.1.smithi134.stdout:8/316: dwrite d3/d1b/d17/f1a [0,4194304] 0 2024-03-12T16:10:36.909 INFO:tasks.workunit.client.1.smithi134.stdout:4/260: rename d1/d13/f1a to d1/d24/d34/f57 0 2024-03-12T16:10:36.910 INFO:tasks.workunit.client.1.smithi134.stdout:3/383: symlink d1/db/d10/d2a/l91 0 2024-03-12T16:10:36.914 INFO:tasks.workunit.client.1.smithi134.stdout:4/261: rename d1/d24/l41 to d1/d13/d49/d53/l58 0 2024-03-12T16:10:36.916 INFO:tasks.workunit.client.1.smithi134.stdout:8/317: dwrite d3/d1b/d17/d25/d33/f34 [0,4194304] 0 2024-03-12T16:10:36.918 INFO:tasks.workunit.client.1.smithi134.stdout:3/384: dread d1/db/d10/f1f [0,4194304] 0 2024-03-12T16:10:36.919 INFO:tasks.workunit.client.1.smithi134.stdout:3/385: chown d1/db/d10/d2d 2 1 2024-03-12T16:10:36.921 INFO:tasks.workunit.client.1.smithi134.stdout:8/318: creat d3/d10/f62 x:0 0 0 2024-03-12T16:10:36.921 INFO:tasks.workunit.client.1.smithi134.stdout:3/386: write d1/db/d10/f8a [21259,76545] 0 2024-03-12T16:10:36.923 INFO:tasks.workunit.client.1.smithi134.stdout:8/319: readlink d3/d1b/d17/d25/d33/d15/d2b/d4f/l44 0 2024-03-12T16:10:36.923 INFO:tasks.workunit.client.1.smithi134.stdout:3/387: chown d1/db/d12/f26 0 1 2024-03-12T16:10:36.925 INFO:tasks.workunit.client.1.smithi134.stdout:4/262: dwrite d1/d13/d18/d28/f3b [0,4194304] 0 2024-03-12T16:10:36.928 INFO:tasks.workunit.client.1.smithi134.stdout:4/263: symlink d1/d24/l59 0 2024-03-12T16:10:36.932 INFO:tasks.workunit.client.1.smithi134.stdout:2/289: sync 2024-03-12T16:10:36.932 INFO:tasks.workunit.client.1.smithi134.stdout:5/397: sync 2024-03-12T16:10:36.932 INFO:tasks.workunit.client.1.smithi134.stdout:9/260: sync 2024-03-12T16:10:36.938 INFO:tasks.workunit.client.1.smithi134.stdout:2/290: mknod d4/d12/d39/c66 0 2024-03-12T16:10:36.941 INFO:tasks.workunit.client.1.smithi134.stdout:5/398: dwrite db/d12/d1d/f19 [0,4194304] 0 2024-03-12T16:10:36.942 INFO:tasks.workunit.client.1.smithi134.stdout:9/261: mknod d5/d20/d36/c45 0 2024-03-12T16:10:36.943 INFO:tasks.workunit.client.1.smithi134.stdout:5/399: write f5 [9349454,100737] 0 2024-03-12T16:10:36.951 INFO:tasks.workunit.client.1.smithi134.stdout:2/291: dwrite d4/d12/d1d/f21 [0,4194304] 0 2024-03-12T16:10:36.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:35.494878+0000 mgr.smithi134.gcntfu (mgr.24383) 55 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 903 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 6.6 MiB/s rd, 88 MiB/s wr, 136 op/s 2024-03-12T16:10:36.955 INFO:tasks.workunit.client.1.smithi134.stdout:5/400: rename db/d12/d29/d3d/l7e to db/d12/d37/d73/d7f/l85 0 2024-03-12T16:10:36.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:35.494878+0000 mgr.smithi134.gcntfu (mgr.24383) 55 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 903 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 6.6 MiB/s rd, 88 MiB/s wr, 136 op/s 2024-03-12T16:10:36.957 INFO:tasks.workunit.client.1.smithi134.stdout:8/320: dwrite d3/f8 [0,4194304] 0 2024-03-12T16:10:36.957 INFO:tasks.workunit.client.1.smithi134.stdout:9/262: unlink d5/d10/d35/f34 0 2024-03-12T16:10:36.958 INFO:tasks.workunit.client.1.smithi134.stdout:2/292: mknod d4/d12/d1d/c67 0 2024-03-12T16:10:36.960 INFO:tasks.workunit.client.1.smithi134.stdout:5/401: creat db/d7d/f86 x:0 0 0 2024-03-12T16:10:36.962 INFO:tasks.workunit.client.1.smithi134.stdout:2/293: symlink d4/d12/d39/l68 0 2024-03-12T16:10:36.963 INFO:tasks.workunit.client.1.smithi134.stdout:5/402: rmdir db/d12/d1d/d3a/d49 39 2024-03-12T16:10:36.964 INFO:tasks.workunit.client.1.smithi134.stdout:9/263: mkdir d5/d46 0 2024-03-12T16:10:36.966 INFO:tasks.workunit.client.1.smithi134.stdout:2/294: creat d4/d3c/f69 x:0 0 0 2024-03-12T16:10:36.967 INFO:tasks.workunit.client.1.smithi134.stdout:9/264: mkdir d5/d20/d47 0 2024-03-12T16:10:36.969 INFO:tasks.workunit.client.1.smithi134.stdout:2/295: unlink d4/f26 0 2024-03-12T16:10:36.972 INFO:tasks.workunit.client.1.smithi134.stdout:9/265: truncate d5/f7 394444 0 2024-03-12T16:10:36.973 INFO:tasks.workunit.client.1.smithi134.stdout:2/296: dread d4/d16/f4b [0,4194304] 0 2024-03-12T16:10:36.976 INFO:tasks.workunit.client.1.smithi134.stdout:3/388: truncate d1/db/d10/d2d/d2e/d72/f8e 1247513 0 2024-03-12T16:10:36.977 INFO:tasks.workunit.client.1.smithi134.stdout:3/389: chown d1/db/d14/d5a 541439835 1 2024-03-12T16:10:36.980 INFO:tasks.workunit.client.1.smithi134.stdout:2/297: symlink d4/d12/d1d/d34/d58/l6a 0 2024-03-12T16:10:36.981 INFO:tasks.workunit.client.1.smithi134.stdout:9/266: getdents d5/d10/d33 0 2024-03-12T16:10:36.981 INFO:tasks.workunit.client.1.smithi134.stdout:2/298: fsync d4/d12/f4a 0 2024-03-12T16:10:36.982 INFO:tasks.workunit.client.1.smithi134.stdout:9/267: chown d5/d20/d36/c45 1506505927 1 2024-03-12T16:10:36.983 INFO:tasks.workunit.client.1.smithi134.stdout:2/299: write d4/d12/f20 [2143672,121279] 0 2024-03-12T16:10:36.985 INFO:tasks.workunit.client.1.smithi134.stdout:9/268: write d5/d10/d33/f44 [621922,58898] 0 2024-03-12T16:10:36.987 INFO:tasks.workunit.client.1.smithi134.stdout:2/300: mknod d4/d12/d1d/c6b 0 2024-03-12T16:10:36.988 INFO:tasks.workunit.client.1.smithi134.stdout:3/390: dwrite d1/db/f4d [0,4194304] 0 2024-03-12T16:10:36.993 INFO:tasks.workunit.client.1.smithi134.stdout:3/391: creat d1/db/d10/d2d/d30/f92 x:0 0 0 2024-03-12T16:10:36.998 INFO:tasks.workunit.client.1.smithi134.stdout:9/269: dwrite d5/f28 [0,4194304] 0 2024-03-12T16:10:36.999 INFO:tasks.workunit.client.1.smithi134.stdout:3/392: readlink d1/db/d10/d2a/l61 0 2024-03-12T16:10:37.000 INFO:tasks.workunit.client.1.smithi134.stdout:5/403: dread db/d12/f40 [4194304,4194304] 0 2024-03-12T16:10:37.003 INFO:tasks.workunit.client.1.smithi134.stdout:3/393: unlink d1/db/d14/c37 0 2024-03-12T16:10:37.003 INFO:tasks.workunit.client.1.smithi134.stdout:3/394: chown d1/db/d12/f1e 3711 1 2024-03-12T16:10:37.005 INFO:tasks.workunit.client.1.smithi134.stdout:9/270: rename d5/d10/d35/f3d to d5/d10/d35/f48 0 2024-03-12T16:10:37.007 INFO:tasks.workunit.client.1.smithi134.stdout:9/271: write d5/d20/f23 [334130,113536] 0 2024-03-12T16:10:37.007 INFO:tasks.workunit.client.1.smithi134.stdout:5/404: fdatasync db/d12/d1d/d5c/f65 0 2024-03-12T16:10:37.009 INFO:tasks.workunit.client.1.smithi134.stdout:5/405: fdatasync db/d12/d1d/f19 0 2024-03-12T16:10:37.011 INFO:tasks.workunit.client.1.smithi134.stdout:5/406: write db/d12/d1d/d3a/f48 [1952509,115919] 0 2024-03-12T16:10:37.014 INFO:tasks.workunit.client.1.smithi134.stdout:9/272: rmdir d5/d20 39 2024-03-12T16:10:37.018 INFO:tasks.workunit.client.1.smithi134.stdout:5/407: dwrite db/d12/f3e [0,4194304] 0 2024-03-12T16:10:37.020 INFO:tasks.workunit.client.1.smithi134.stdout:5/408: write db/d12/d1d/f66 [993801,27824] 0 2024-03-12T16:10:37.026 INFO:tasks.workunit.client.1.smithi134.stdout:8/321: getdents d3/d1b/d17/d25/d33/d15/d2b/d4f 0 2024-03-12T16:10:37.029 INFO:tasks.workunit.client.1.smithi134.stdout:2/301: truncate d4/d12/f20 81434 0 2024-03-12T16:10:37.034 INFO:tasks.workunit.client.1.smithi134.stdout:8/322: creat d3/d1b/d17/d25/d49/f63 x:0 0 0 2024-03-12T16:10:37.035 INFO:tasks.workunit.client.1.smithi134.stdout:5/409: dwrite db/d12/d29/d3d/f54 [0,4194304] 0 2024-03-12T16:10:37.037 INFO:tasks.workunit.client.1.smithi134.stdout:2/302: creat d4/d12/d1d/d34/f6c x:0 0 0 2024-03-12T16:10:37.038 INFO:tasks.workunit.client.1.smithi134.stdout:9/273: dwrite d5/d20/f2b [0,4194304] 0 2024-03-12T16:10:37.038 INFO:tasks.workunit.client.1.smithi134.stdout:8/323: write d3/d1b/d17/d24/f2d [3147314,10213] 0 2024-03-12T16:10:37.039 INFO:tasks.workunit.client.1.smithi134.stdout:3/395: write d1/db/d10/d2d/d2e/d72/f8e [2051885,122919] 0 2024-03-12T16:10:37.043 INFO:tasks.workunit.client.1.smithi134.stdout:2/303: creat d4/d12/f6d x:0 0 0 2024-03-12T16:10:37.043 INFO:tasks.workunit.client.1.smithi134.stdout:5/410: fsync db/d12/d1d/d3a/d49/f57 0 2024-03-12T16:10:37.043 INFO:tasks.workunit.client.1.smithi134.stdout:3/396: write d1/d63/f8c [525221,71163] 0 2024-03-12T16:10:37.045 INFO:tasks.workunit.client.1.smithi134.stdout:9/274: stat d5/d10/f2d 0 2024-03-12T16:10:37.049 INFO:tasks.workunit.client.1.smithi134.stdout:8/324: rename d3/d1b/d17/d25/d49/l5d to d3/d1b/d17/d45/l64 0 2024-03-12T16:10:37.050 INFO:tasks.workunit.client.1.smithi134.stdout:3/397: dread d1/db/d12/f27 [4194304,4194304] 0 2024-03-12T16:10:37.051 INFO:tasks.workunit.client.1.smithi134.stdout:8/325: write d3/d10/d31/f53 [758913,91198] 0 2024-03-12T16:10:37.051 INFO:tasks.workunit.client.1.smithi134.stdout:5/411: symlink db/d12/d1d/d3a/d70/l87 0 2024-03-12T16:10:37.053 INFO:tasks.workunit.client.1.smithi134.stdout:2/304: getdents d4/d12/d1d/d51 0 2024-03-12T16:10:37.054 INFO:tasks.workunit.client.1.smithi134.stdout:2/305: stat d4/d12/d1d/l61 0 2024-03-12T16:10:37.056 INFO:tasks.workunit.client.1.smithi134.stdout:2/306: truncate d4/d12/d39/f57 460479 0 2024-03-12T16:10:37.056 INFO:tasks.workunit.client.1.smithi134.stdout:5/412: creat db/d12/d1d/d3a/f88 x:0 0 0 2024-03-12T16:10:37.058 INFO:tasks.workunit.client.1.smithi134.stdout:5/413: dread - db/d12/d1d/d3a/d4e/f82 zero size 2024-03-12T16:10:37.058 INFO:tasks.workunit.client.1.smithi134.stdout:8/326: rename d3/d1b/d17/d25/d33/d15/d2b/d42 to d3/d1b/d17/d25/d33/d15/d2b/d4f/d65 0 2024-03-12T16:10:37.060 INFO:tasks.workunit.client.1.smithi134.stdout:3/398: getdents d1/db/d10 0 2024-03-12T16:10:37.061 INFO:tasks.workunit.client.1.smithi134.stdout:5/414: unlink db/d12/d1d/d3a/d49/f50 0 2024-03-12T16:10:37.062 INFO:tasks.workunit.client.1.smithi134.stdout:5/415: fdatasync db/d12/d1d/d3a/d49/f57 0 2024-03-12T16:10:37.063 INFO:tasks.workunit.client.1.smithi134.stdout:3/399: symlink d1/db/d10/l93 0 2024-03-12T16:10:37.064 INFO:tasks.workunit.client.1.smithi134.stdout:3/400: write d1/db/d14/f5d [4808733,57560] 0 2024-03-12T16:10:37.064 INFO:tasks.workunit.client.1.smithi134.stdout:8/327: symlink d3/d1b/d17/d25/d33/d15/d2b/d5b/l66 0 2024-03-12T16:10:37.066 INFO:tasks.workunit.client.1.smithi134.stdout:3/401: fdatasync d1/f5 0 2024-03-12T16:10:37.068 INFO:tasks.workunit.client.1.smithi134.stdout:8/328: stat d3/d1b/d17/d25/d33/d15/d2b/d4f 0 2024-03-12T16:10:37.072 INFO:tasks.workunit.client.1.smithi134.stdout:5/416: dwrite db/f58 [0,4194304] 0 2024-03-12T16:10:37.075 INFO:tasks.workunit.client.1.smithi134.stdout:8/329: dread d3/d1b/d17/d24/f2d [0,4194304] 0 2024-03-12T16:10:37.076 INFO:tasks.workunit.client.1.smithi134.stdout:5/417: creat db/d12/d1d/f89 x:0 0 0 2024-03-12T16:10:37.078 INFO:tasks.workunit.client.1.smithi134.stdout:5/418: chown db/d12/d5f/c52 3033 1 2024-03-12T16:10:37.078 INFO:tasks.workunit.client.1.smithi134.stdout:3/402: fdatasync d1/db/d10/d2d/f33 0 2024-03-12T16:10:37.079 INFO:tasks.workunit.client.1.smithi134.stdout:5/419: write db/d7d/f86 [288517,114351] 0 2024-03-12T16:10:37.079 INFO:tasks.workunit.client.1.smithi134.stdout:3/403: chown d1/f5 9045 1 2024-03-12T16:10:37.083 INFO:tasks.workunit.client.1.smithi134.stdout:3/404: mknod d1/d63/c94 0 2024-03-12T16:10:37.084 INFO:tasks.workunit.client.1.smithi134.stdout:5/420: creat db/d12/d1d/d3a/d4e/f8a x:0 0 0 2024-03-12T16:10:37.086 INFO:tasks.workunit.client.1.smithi134.stdout:8/330: rename d3/d1b/d17/d25/f46 to d3/d1b/d17/d25/d33/d15/d2b/d4f/f67 0 2024-03-12T16:10:37.088 INFO:tasks.workunit.client.1.smithi134.stdout:5/421: unlink db/d12/d5f/c56 0 2024-03-12T16:10:37.089 INFO:tasks.workunit.client.1.smithi134.stdout:8/331: mknod d3/d10/d31/c68 0 2024-03-12T16:10:37.093 INFO:tasks.workunit.client.1.smithi134.stdout:3/405: link d1/db/d10/d2a/l61 d1/db/l95 0 2024-03-12T16:10:37.094 INFO:tasks.workunit.client.1.smithi134.stdout:3/406: readlink d1/db/d10/d2a/l91 0 2024-03-12T16:10:37.097 INFO:tasks.workunit.client.1.smithi134.stdout:3/407: symlink d1/db/d10/d2d/d2e/l96 0 2024-03-12T16:10:37.099 INFO:tasks.workunit.client.1.smithi134.stdout:8/332: chown d3/d1b/d17/d25/d33/d15/l60 1445196 1 2024-03-12T16:10:37.100 INFO:tasks.workunit.client.1.smithi134.stdout:3/408: mkdir d1/db/d10/d2d/d2e/d72/d97 0 2024-03-12T16:10:37.101 INFO:tasks.workunit.client.1.smithi134.stdout:8/333: fdatasync d3/d1b/f2a 0 2024-03-12T16:10:37.101 INFO:tasks.workunit.client.1.smithi134.stdout:5/422: dread db/d12/d37/f39 [0,4194304] 0 2024-03-12T16:10:37.106 INFO:tasks.workunit.client.1.smithi134.stdout:3/409: link d1/db/d14/f40 d1/d63/d6c/f98 0 2024-03-12T16:10:37.107 INFO:tasks.workunit.client.1.smithi134.stdout:3/410: write d1/db/d14/f5d [1675467,98928] 0 2024-03-12T16:10:37.108 INFO:tasks.workunit.client.1.smithi134.stdout:8/334: unlink d3/d1b/d17/d25/d49/f63 0 2024-03-12T16:10:37.109 INFO:tasks.workunit.client.1.smithi134.stdout:8/335: stat d3/d1b/d17/d25/d49/l4d 0 2024-03-12T16:10:37.113 INFO:tasks.workunit.client.1.smithi134.stdout:8/336: rmdir d3/d1b/d17/d25/d33/d15/d2b/d5b 39 2024-03-12T16:10:37.114 INFO:tasks.workunit.client.1.smithi134.stdout:3/411: dwrite d1/f65 [0,4194304] 0 2024-03-12T16:10:37.117 INFO:tasks.workunit.client.1.smithi134.stdout:8/337: write d3/d1b/d17/d24/f2d [5164100,60664] 0 2024-03-12T16:10:37.120 INFO:tasks.workunit.client.1.smithi134.stdout:5/423: truncate db/d12/d1d/d3a/d49/f62 125478 0 2024-03-12T16:10:37.121 INFO:tasks.workunit.client.1.smithi134.stdout:5/424: write db/d12/d29/d3d/f47 [322587,101894] 0 2024-03-12T16:10:37.123 INFO:tasks.workunit.client.1.smithi134.stdout:5/425: truncate db/d12/d29/d3d/f54 4570614 0 2024-03-12T16:10:37.124 INFO:tasks.workunit.client.1.smithi134.stdout:3/412: link d1/d63/c94 d1/db/d10/d2a/c99 0 2024-03-12T16:10:37.126 INFO:tasks.workunit.client.1.smithi134.stdout:5/426: readlink db/d12/d1d/d59/l77 0 2024-03-12T16:10:37.127 INFO:tasks.workunit.client.1.smithi134.stdout:5/427: chown db/d12/d1d/d3a/d49/l5e 1844130 1 2024-03-12T16:10:37.128 INFO:tasks.workunit.client.1.smithi134.stdout:5/428: chown db/d12/d1d/d3a/d4e/f82 5 1 2024-03-12T16:10:37.131 INFO:tasks.workunit.client.1.smithi134.stdout:3/413: link d1/d63/d6c/f98 d1/db/d10/d2d/f9a 0 2024-03-12T16:10:37.133 INFO:tasks.workunit.client.1.smithi134.stdout:8/338: truncate d3/d1b/f14 2600075 0 2024-03-12T16:10:37.133 INFO:tasks.workunit.client.1.smithi134.stdout:3/414: chown d1/db/d14/f7b 25762220 1 2024-03-12T16:10:37.136 INFO:tasks.workunit.client.1.smithi134.stdout:5/429: dwrite db/d12/d1d/d3a/d4e/f8a [0,4194304] 0 2024-03-12T16:10:37.136 INFO:tasks.workunit.client.1.smithi134.stdout:8/339: chown d3/d1b/f14 31329 1 2024-03-12T16:10:37.137 INFO:tasks.workunit.client.1.smithi134.stdout:3/415: truncate d1/db/d10/f28 467369 0 2024-03-12T16:10:37.138 INFO:tasks.workunit.client.1.smithi134.stdout:3/416: chown d1/db/d12/f27 0 1 2024-03-12T16:10:37.140 INFO:tasks.workunit.client.1.smithi134.stdout:3/417: write d1/db/d12/f60 [326899,28893] 0 2024-03-12T16:10:37.145 INFO:tasks.workunit.client.1.smithi134.stdout:8/340: symlink d3/l69 0 2024-03-12T16:10:37.145 INFO:tasks.workunit.client.1.smithi134.stdout:5/430: creat db/d12/d1d/d59/f8b x:0 0 0 2024-03-12T16:10:37.147 INFO:tasks.workunit.client.1.smithi134.stdout:3/418: symlink d1/db/d10/d2d/d2e/l9b 0 2024-03-12T16:10:37.148 INFO:tasks.workunit.client.1.smithi134.stdout:3/419: creat d1/d63/f9c x:0 0 0 2024-03-12T16:10:37.149 INFO:tasks.workunit.client.1.smithi134.stdout:8/341: mknod d3/d1b/d17/d25/c6a 0 2024-03-12T16:10:37.150 INFO:tasks.workunit.client.1.smithi134.stdout:3/420: mkdir d1/db/d12/d9d 0 2024-03-12T16:10:37.152 INFO:tasks.workunit.client.1.smithi134.stdout:3/421: creat d1/d63/f9e x:0 0 0 2024-03-12T16:10:37.154 INFO:tasks.workunit.client.1.smithi134.stdout:8/342: creat d3/d1b/d17/d25/d33/f6b x:0 0 0 2024-03-12T16:10:37.155 INFO:tasks.workunit.client.1.smithi134.stdout:3/422: mkdir d1/db/d12/d9d/d9f 0 2024-03-12T16:10:37.155 INFO:tasks.workunit.client.1.smithi134.stdout:8/343: read d3/d1b/d17/f1a [398663,92586] 0 2024-03-12T16:10:37.157 INFO:tasks.workunit.client.1.smithi134.stdout:8/344: rmdir d3/d10 39 2024-03-12T16:10:37.159 INFO:tasks.workunit.client.1.smithi134.stdout:8/345: mkdir d3/d1b/d17/d6c 0 2024-03-12T16:10:37.162 INFO:tasks.workunit.client.1.smithi134.stdout:8/346: mkdir d3/d1b/d17/d25/d33/d15/d2b/d6d 0 2024-03-12T16:10:37.171 INFO:tasks.workunit.client.1.smithi134.stdout:7/234: sync 2024-03-12T16:10:37.171 INFO:tasks.workunit.client.1.smithi134.stdout:6/322: sync 2024-03-12T16:10:37.171 INFO:tasks.workunit.client.1.smithi134.stdout:1/238: sync 2024-03-12T16:10:37.171 INFO:tasks.workunit.client.1.smithi134.stdout:0/340: sync 2024-03-12T16:10:37.174 INFO:tasks.workunit.client.1.smithi134.stdout:7/235: write d8/dc/d4b/f45 [523282,89304] 0 2024-03-12T16:10:37.175 INFO:tasks.workunit.client.1.smithi134.stdout:6/323: read d1/f5 [462086,27840] 0 2024-03-12T16:10:37.176 INFO:tasks.workunit.client.1.smithi134.stdout:1/239: mknod d0/d16/d9/c5a 0 2024-03-12T16:10:37.176 INFO:tasks.workunit.client.1.smithi134.stdout:0/341: rmdir db/d2f/d51 39 2024-03-12T16:10:37.185 INFO:tasks.workunit.client.1.smithi134.stdout:1/240: mknod d0/c5b 0 2024-03-12T16:10:37.187 INFO:tasks.workunit.client.1.smithi134.stdout:8/347: dread d3/f6 [4194304,4194304] 0 2024-03-12T16:10:37.187 INFO:tasks.workunit.client.1.smithi134.stdout:3/423: getdents d1/db/d10/d2d/d2e 0 2024-03-12T16:10:37.187 INFO:tasks.workunit.client.1.smithi134.stdout:0/342: mkdir db/d2f/d71 0 2024-03-12T16:10:37.188 INFO:tasks.workunit.client.1.smithi134.stdout:5/431: dread f5 [0,4194304] 0 2024-03-12T16:10:37.190 INFO:tasks.workunit.client.1.smithi134.stdout:7/236: dwrite d8/dc/d2f/f32 [0,4194304] 0 2024-03-12T16:10:37.191 INFO:tasks.workunit.client.1.smithi134.stdout:3/424: chown d1/db/f4c 0 1 2024-03-12T16:10:37.193 INFO:tasks.workunit.client.1.smithi134.stdout:6/324: getdents d1/d3/d19/d32/d4a 0 2024-03-12T16:10:37.196 INFO:tasks.workunit.client.1.smithi134.stdout:0/343: write db/d2f/d31/f3b [3413426,74769] 0 2024-03-12T16:10:37.198 INFO:tasks.workunit.client.1.smithi134.stdout:7/237: write d8/dc/d20/d26/f37 [4160687,107540] 0 2024-03-12T16:10:37.199 INFO:tasks.workunit.client.1.smithi134.stdout:6/325: creat d1/d4/f80 x:0 0 0 2024-03-12T16:10:37.199 INFO:tasks.workunit.client.1.smithi134.stdout:1/241: dread d0/d16/d9/d13/d21/d2f/f56 [0,4194304] 0 2024-03-12T16:10:37.202 INFO:tasks.workunit.client.1.smithi134.stdout:8/348: unlink d3/d1b/d17/d25/d33/d15/d2b/d4f/f29 0 2024-03-12T16:10:37.205 INFO:tasks.workunit.client.1.smithi134.stdout:0/344: creat db/d2f/d31/d56/f72 x:0 0 0 2024-03-12T16:10:37.206 INFO:tasks.workunit.client.1.smithi134.stdout:0/345: write db/f6e [1002074,36888] 0 2024-03-12T16:10:37.208 INFO:tasks.workunit.client.1.smithi134.stdout:0/346: write db/f2d [4619451,34960] 0 2024-03-12T16:10:37.212 INFO:tasks.workunit.client.1.smithi134.stdout:8/349: creat d3/d1b/d17/d25/d33/d15/d2b/d4f/d65/f6e x:0 0 0 2024-03-12T16:10:37.218 INFO:tasks.workunit.client.1.smithi134.stdout:5/432: dread db/d12/d1d/f35 [0,4194304] 0 2024-03-12T16:10:37.219 INFO:tasks.workunit.client.1.smithi134.stdout:3/425: dread d1/f2 [0,4194304] 0 2024-03-12T16:10:37.220 INFO:tasks.workunit.client.1.smithi134.stdout:7/238: creat d8/dc/f51 x:0 0 0 2024-03-12T16:10:37.221 INFO:tasks.workunit.client.1.smithi134.stdout:0/347: symlink db/l73 0 2024-03-12T16:10:37.221 INFO:tasks.workunit.client.1.smithi134.stdout:3/426: stat d1/f5 0 2024-03-12T16:10:37.223 INFO:tasks.workunit.client.1.smithi134.stdout:7/239: chown d8/d27/c28 0 1 2024-03-12T16:10:37.223 INFO:tasks.workunit.client.1.smithi134.stdout:5/433: mkdir db/d12/d37/d73/d8c 0 2024-03-12T16:10:37.228 INFO:tasks.workunit.client.1.smithi134.stdout:0/348: fsync db/f11 0 2024-03-12T16:10:37.229 INFO:tasks.workunit.client.1.smithi134.stdout:5/434: creat db/d7d/f8d x:0 0 0 2024-03-12T16:10:37.229 INFO:tasks.workunit.client.1.smithi134.stdout:3/427: creat d1/db/d10/d2d/d30/fa0 x:0 0 0 2024-03-12T16:10:37.230 INFO:tasks.workunit.client.1.smithi134.stdout:8/350: dwrite d3/d10/f62 [0,4194304] 0 2024-03-12T16:10:37.233 INFO:tasks.workunit.client.1.smithi134.stdout:7/240: creat d8/d4e/f52 x:0 0 0 2024-03-12T16:10:37.234 INFO:tasks.workunit.client.1.smithi134.stdout:5/435: mknod db/d12/d37/c8e 0 2024-03-12T16:10:37.236 INFO:tasks.workunit.client.1.smithi134.stdout:3/428: creat d1/db/d14/d5a/fa1 x:0 0 0 2024-03-12T16:10:37.236 INFO:tasks.workunit.client.1.smithi134.stdout:8/351: fdatasync d3/d1b/d17/d25/d33/f6b 0 2024-03-12T16:10:37.237 INFO:tasks.workunit.client.1.smithi134.stdout:5/436: readlink db/d12/d1d/l4d 0 2024-03-12T16:10:37.238 INFO:tasks.workunit.client.1.smithi134.stdout:6/326: dwrite d1/d3/d19/d32/f37 [0,4194304] 0 2024-03-12T16:10:37.242 INFO:tasks.workunit.client.1.smithi134.stdout:1/242: dwrite d0/d16/d9/d13/f3f [0,4194304] 0 2024-03-12T16:10:37.243 INFO:tasks.workunit.client.1.smithi134.stdout:6/327: chown d1/d3/c49 1535 1 2024-03-12T16:10:37.244 INFO:tasks.workunit.client.1.smithi134.stdout:1/243: fsync d0/fd 0 2024-03-12T16:10:37.245 INFO:tasks.workunit.client.1.smithi134.stdout:3/429: symlink d1/db/la2 0 2024-03-12T16:10:37.248 INFO:tasks.workunit.client.1.smithi134.stdout:0/349: dwrite db/d2f/d31/f3b [4194304,4194304] 0 2024-03-12T16:10:37.248 INFO:tasks.workunit.client.1.smithi134.stdout:5/437: rename db/le to db/d12/d37/d73/l8f 0 2024-03-12T16:10:37.258 INFO:tasks.workunit.client.1.smithi134.stdout:6/328: link d1/f1e d1/d16/d4c/d65/f81 0 2024-03-12T16:10:37.260 INFO:tasks.workunit.client.1.smithi134.stdout:3/430: dread d1/db/f4d [0,4194304] 0 2024-03-12T16:10:37.261 INFO:tasks.workunit.client.1.smithi134.stdout:0/350: chown db/c58 114 1 2024-03-12T16:10:37.263 INFO:tasks.workunit.client.1.smithi134.stdout:7/241: dwrite d8/dc/d4b/f45 [0,4194304] 0 2024-03-12T16:10:37.263 INFO:tasks.workunit.client.1.smithi134.stdout:6/329: creat d1/d3/d19/d32/d4a/f82 x:0 0 0 2024-03-12T16:10:37.264 INFO:tasks.workunit.client.1.smithi134.stdout:3/431: write d1/db/d12/f7a [309304,78504] 0 2024-03-12T16:10:37.268 INFO:tasks.workunit.client.1.smithi134.stdout:0/351: creat db/d2f/d31/d68/d70/f74 x:0 0 0 2024-03-12T16:10:37.268 INFO:tasks.workunit.client.1.smithi134.stdout:6/330: symlink d1/d3/d19/l83 0 2024-03-12T16:10:37.269 INFO:tasks.workunit.client.1.smithi134.stdout:0/352: readlink db/d2f/d31/l4c 0 2024-03-12T16:10:37.270 INFO:tasks.workunit.client.1.smithi134.stdout:7/242: creat d8/dc/d2f/d31/f53 x:0 0 0 2024-03-12T16:10:37.273 INFO:tasks.workunit.client.1.smithi134.stdout:6/331: creat d1/d3a/d3b/f84 x:0 0 0 2024-03-12T16:10:37.273 INFO:tasks.workunit.client.1.smithi134.stdout:7/243: write d8/dc/d2f/d31/f4a [537696,111390] 0 2024-03-12T16:10:37.275 INFO:tasks.workunit.client.1.smithi134.stdout:0/353: unlink db/d2f/c5f 0 2024-03-12T16:10:37.276 INFO:tasks.workunit.client.1.smithi134.stdout:3/432: rename d1/db/d10/d2d/f75 to d1/db/d10/d2d/d2e/d72/d97/fa3 0 2024-03-12T16:10:37.280 INFO:tasks.workunit.client.1.smithi134.stdout:0/354: mkdir db/d2f/d31/d75 0 2024-03-12T16:10:37.280 INFO:tasks.workunit.client.1.smithi134.stdout:5/438: dread db/d12/d1d/f31 [0,4194304] 0 2024-03-12T16:10:37.281 INFO:tasks.workunit.client.1.smithi134.stdout:0/355: readlink db/d2f/d31/l3e 0 2024-03-12T16:10:37.281 INFO:tasks.workunit.client.1.smithi134.stdout:6/332: mkdir d1/d3a/d3b/d55/d85 0 2024-03-12T16:10:37.286 INFO:tasks.workunit.client.1.smithi134.stdout:0/356: mkdir db/d2f/d31/d76 0 2024-03-12T16:10:37.287 INFO:tasks.workunit.client.1.smithi134.stdout:7/244: creat d8/dc/f54 x:0 0 0 2024-03-12T16:10:37.290 INFO:tasks.workunit.client.1.smithi134.stdout:6/333: mknod d1/c86 0 2024-03-12T16:10:37.291 INFO:tasks.workunit.client.1.smithi134.stdout:8/352: truncate d3/d1b/d17/d25/d33/f34 584396 0 2024-03-12T16:10:37.292 INFO:tasks.workunit.client.1.smithi134.stdout:7/245: chown d8/dc/d20/d26/l4f 1 1 2024-03-12T16:10:37.293 INFO:tasks.workunit.client.1.smithi134.stdout:7/246: dread - d8/dc/d2f/f41 zero size 2024-03-12T16:10:37.294 INFO:tasks.workunit.client.1.smithi134.stdout:7/247: fdatasync d8/dc/d20/d26/f50 0 2024-03-12T16:10:37.295 INFO:tasks.workunit.client.1.smithi134.stdout:6/334: unlink d1/d3/d10/ff 0 2024-03-12T16:10:37.296 INFO:tasks.workunit.client.1.smithi134.stdout:6/335: chown d1/d3a/d3b 3989 1 2024-03-12T16:10:37.298 INFO:tasks.workunit.client.1.smithi134.stdout:3/433: rename d1/db/d10/f32 to d1/db/d10/d2d/fa4 0 2024-03-12T16:10:37.299 INFO:tasks.workunit.client.1.smithi134.stdout:5/439: getdents db/d7d 0 2024-03-12T16:10:37.303 INFO:tasks.workunit.client.1.smithi134.stdout:0/357: creat db/d2f/f77 x:0 0 0 2024-03-12T16:10:37.304 INFO:tasks.workunit.client.1.smithi134.stdout:5/440: dread db/d12/d1d/f35 [0,4194304] 0 2024-03-12T16:10:37.310 INFO:tasks.workunit.client.1.smithi134.stdout:6/336: dread d1/d3/d19/f36 [0,4194304] 0 2024-03-12T16:10:37.312 INFO:tasks.workunit.client.1.smithi134.stdout:6/337: write d1/d3/d19/d32/f43 [68983,89590] 0 2024-03-12T16:10:37.313 INFO:tasks.workunit.client.1.smithi134.stdout:6/338: chown d1/d3a/d3b/d55/d85 195467544 1 2024-03-12T16:10:37.315 INFO:tasks.workunit.client.1.smithi134.stdout:0/358: dread db/f1a [0,4194304] 0 2024-03-12T16:10:37.318 INFO:tasks.workunit.client.1.smithi134.stdout:6/339: creat d1/d3a/d3b/d55/d85/f87 x:0 0 0 2024-03-12T16:10:37.320 INFO:tasks.workunit.client.1.smithi134.stdout:6/340: write d1/d3/d19/f5e [518370,8842] 0 2024-03-12T16:10:37.322 INFO:tasks.workunit.client.1.smithi134.stdout:3/434: dread d1/db/d10/d2a/f44 [0,4194304] 0 2024-03-12T16:10:37.322 INFO:tasks.workunit.client.1.smithi134.stdout:7/248: truncate d8/f2a 1085571 0 2024-03-12T16:10:37.324 INFO:tasks.workunit.client.1.smithi134.stdout:6/341: rmdir d1/d4 39 2024-03-12T16:10:37.325 INFO:tasks.workunit.client.0.smithi006.stdout:2/186: sync 2024-03-12T16:10:37.325 INFO:tasks.workunit.client.0.smithi006.stdout:4/103: sync 2024-03-12T16:10:37.325 INFO:tasks.workunit.client.0.smithi006.stdout:8/100: sync 2024-03-12T16:10:37.325 INFO:tasks.workunit.client.0.smithi006.stdout:3/125: sync 2024-03-12T16:10:37.325 INFO:tasks.workunit.client.0.smithi006.stdout:9/45: sync 2024-03-12T16:10:37.325 INFO:tasks.workunit.client.0.smithi006.stdout:5/87: sync 2024-03-12T16:10:37.325 INFO:tasks.workunit.client.0.smithi006.stdout:0/220: sync 2024-03-12T16:10:37.325 INFO:tasks.workunit.client.0.smithi006.stdout:7/246: sync 2024-03-12T16:10:37.325 INFO:tasks.workunit.client.0.smithi006.stdout:1/115: sync 2024-03-12T16:10:37.326 INFO:tasks.workunit.client.0.smithi006.stdout:6/124: sync 2024-03-12T16:10:37.327 INFO:tasks.workunit.client.1.smithi134.stdout:5/441: dread db/d12/d37/f4b [0,4194304] 0 2024-03-12T16:10:37.329 INFO:tasks.workunit.client.0.smithi006.stdout:5/88: write d7/d9/f20 [596266,28981] 0 2024-03-12T16:10:37.331 INFO:tasks.workunit.client.0.smithi006.stdout:2/187: unlink d0/l21 0 2024-03-12T16:10:37.332 INFO:tasks.workunit.client.1.smithi134.stdout:3/435: write d1/db/d10/d2d/f33 [1127542,111408] 0 2024-03-12T16:10:37.332 INFO:tasks.workunit.client.1.smithi134.stdout:5/442: chown db/d12/c3b 58 1 2024-03-12T16:10:37.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/342: rename d1/f31 to d1/d3a/d3b/f88 0 2024-03-12T16:10:37.335 INFO:tasks.workunit.client.0.smithi006.stdout:1/116: creat d0/d25/f28 x:0 0 0 2024-03-12T16:10:37.336 INFO:tasks.workunit.client.1.smithi134.stdout:0/359: dwrite db/f10 [0,4194304] 0 2024-03-12T16:10:37.336 INFO:tasks.workunit.client.0.smithi006.stdout:8/101: mkdir d2/db/d1a/d23 0 2024-03-12T16:10:37.337 INFO:tasks.workunit.client.0.smithi006.stdout:4/104: dwrite d1/db/d17/f11 [0,4194304] 0 2024-03-12T16:10:37.338 INFO:tasks.workunit.client.1.smithi134.stdout:7/249: dwrite d8/dc/d20/f2e [0,4194304] 0 2024-03-12T16:10:37.339 INFO:tasks.workunit.client.0.smithi006.stdout:6/125: dread f1 [0,4194304] 0 2024-03-12T16:10:37.339 INFO:tasks.workunit.client.0.smithi006.stdout:7/247: symlink de/d27/l51 0 2024-03-12T16:10:37.339 INFO:tasks.workunit.client.1.smithi134.stdout:6/343: mkdir d1/d89 0 2024-03-12T16:10:37.341 INFO:tasks.workunit.client.1.smithi134.stdout:0/360: write db/f2c [1404966,94015] 0 2024-03-12T16:10:37.341 INFO:tasks.workunit.client.0.smithi006.stdout:5/89: stat d7/d9/l1c 0 2024-03-12T16:10:37.342 INFO:tasks.workunit.client.1.smithi134.stdout:6/344: chown d1/d16/d4c/d65/d70 429354897 1 2024-03-12T16:10:37.344 INFO:tasks.workunit.client.0.smithi006.stdout:5/90: chown d7/d9/d10 375460 1 2024-03-12T16:10:37.344 INFO:tasks.workunit.client.1.smithi134.stdout:3/436: creat d1/db/d10/d2d/d2e/d72/d97/fa5 x:0 0 0 2024-03-12T16:10:37.348 INFO:tasks.workunit.client.1.smithi134.stdout:0/361: fdatasync db/f1a 0 2024-03-12T16:10:37.351 INFO:tasks.workunit.client.1.smithi134.stdout:6/345: mknod d1/d16/d4c/d65/d7b/c8a 0 2024-03-12T16:10:37.353 INFO:tasks.workunit.client.0.smithi006.stdout:4/105: rename d1/fa to d1/db/d17/f1e 0 2024-03-12T16:10:37.353 INFO:tasks.workunit.client.0.smithi006.stdout:1/117: truncate d0/f21 851141 0 2024-03-12T16:10:37.354 INFO:tasks.workunit.client.0.smithi006.stdout:2/188: dread d0/f1f [0,4194304] 0 2024-03-12T16:10:37.355 INFO:tasks.workunit.client.0.smithi006.stdout:3/126: dread d8/df/d2c/f27 [0,4194304] 0 2024-03-12T16:10:37.357 INFO:tasks.workunit.client.0.smithi006.stdout:6/126: mknod d3/c2d 0 2024-03-12T16:10:37.359 INFO:tasks.workunit.client.0.smithi006.stdout:5/91: mknod d7/d9/d10/c22 0 2024-03-12T16:10:37.360 INFO:tasks.workunit.client.1.smithi134.stdout:0/362: fdatasync db/d2f/f4f 0 2024-03-12T16:10:37.360 INFO:tasks.workunit.client.1.smithi134.stdout:7/250: getdents d8/d27 0 2024-03-12T16:10:37.360 INFO:tasks.workunit.client.1.smithi134.stdout:3/437: getdents d1/db/d10/d2d 0 2024-03-12T16:10:37.361 INFO:tasks.workunit.client.1.smithi134.stdout:6/346: write d1/d4/f20 [644980,48175] 0 2024-03-12T16:10:37.361 INFO:tasks.workunit.client.1.smithi134.stdout:7/251: readlink d8/dc/d20/l47 0 2024-03-12T16:10:37.363 INFO:tasks.workunit.client.1.smithi134.stdout:7/252: readlink d8/dc/d20/l3b 0 2024-03-12T16:10:37.363 INFO:tasks.workunit.client.1.smithi134.stdout:3/438: write d1/db/d14/f59 [318924,104197] 0 2024-03-12T16:10:37.365 INFO:tasks.workunit.client.1.smithi134.stdout:6/347: symlink d1/l8b 0 2024-03-12T16:10:37.366 INFO:tasks.workunit.client.0.smithi006.stdout:7/248: symlink de/d27/d2b/d4a/l52 0 2024-03-12T16:10:37.366 INFO:tasks.workunit.client.0.smithi006.stdout:2/189: dread d0/d13/d2d/f16 [0,4194304] 0 2024-03-12T16:10:37.367 INFO:tasks.workunit.client.0.smithi006.stdout:6/127: dread - d3/d11/d10/d1b/d20/f23 zero size 2024-03-12T16:10:37.368 INFO:tasks.workunit.client.1.smithi134.stdout:7/253: fdatasync d8/dc/d20/f2e 0 2024-03-12T16:10:37.369 INFO:tasks.workunit.client.0.smithi006.stdout:5/92: symlink d7/d9/l23 0 2024-03-12T16:10:37.369 INFO:tasks.workunit.client.1.smithi134.stdout:7/254: chown d8/dc/d2f 216263829 1 2024-03-12T16:10:37.369 INFO:tasks.workunit.client.1.smithi134.stdout:7/255: chown d8/d27 1464549 1 2024-03-12T16:10:37.371 INFO:tasks.workunit.client.1.smithi134.stdout:3/439: link d1/db/c6e d1/db/ca6 0 2024-03-12T16:10:37.371 INFO:tasks.workunit.client.1.smithi134.stdout:3/440: stat d1/db/d10/d2d/d2e/d72/f8e 0 2024-03-12T16:10:37.372 INFO:tasks.workunit.client.0.smithi006.stdout:7/249: symlink de/d18/l53 0 2024-03-12T16:10:37.372 INFO:tasks.workunit.client.1.smithi134.stdout:7/256: mkdir d8/dc/d55 0 2024-03-12T16:10:37.373 INFO:tasks.workunit.client.1.smithi134.stdout:3/441: write d1/f4 [3717967,56770] 0 2024-03-12T16:10:37.375 INFO:tasks.workunit.client.1.smithi134.stdout:7/257: rmdir d8/dc/d2f 39 2024-03-12T16:10:37.375 INFO:tasks.workunit.client.0.smithi006.stdout:6/128: write d3/d11/d10/d19/f1f [2016692,93254] 0 2024-03-12T16:10:37.376 INFO:tasks.workunit.client.0.smithi006.stdout:5/93: mkdir d7/d9/d10/d24 0 2024-03-12T16:10:37.378 INFO:tasks.workunit.client.0.smithi006.stdout:2/190: symlink d0/dc/l3d 0 2024-03-12T16:10:37.379 INFO:tasks.workunit.client.0.smithi006.stdout:7/250: mknod de/d27/d2b/c54 0 2024-03-12T16:10:37.381 INFO:tasks.workunit.client.1.smithi134.stdout:4/264: sync 2024-03-12T16:10:37.381 INFO:tasks.workunit.client.1.smithi134.stdout:7/258: getdents d8/dc/d20 0 2024-03-12T16:10:37.381 INFO:tasks.workunit.client.1.smithi134.stdout:3/442: dread d1/db/f4c [0,4194304] 0 2024-03-12T16:10:37.381 INFO:tasks.workunit.client.0.smithi006.stdout:3/127: getdents d8/df/d2c 0 2024-03-12T16:10:37.384 INFO:tasks.workunit.client.0.smithi006.stdout:7/251: symlink de/d1c/l55 0 2024-03-12T16:10:37.384 INFO:tasks.workunit.client.0.smithi006.stdout:6/129: dread d3/d11/f15 [0,4194304] 0 2024-03-12T16:10:37.384 INFO:tasks.workunit.client.1.smithi134.stdout:7/259: creat d8/dc/d20/f56 x:0 0 0 2024-03-12T16:10:37.386 INFO:tasks.workunit.client.1.smithi134.stdout:4/265: dread d1/f23 [4194304,4194304] 0 2024-03-12T16:10:37.387 INFO:tasks.workunit.client.1.smithi134.stdout:3/443: rename d1/db/d14/d5f/f6f to d1/db/d10/fa7 0 2024-03-12T16:10:37.389 INFO:tasks.workunit.client.1.smithi134.stdout:7/260: mkdir d8/dc/d55/d57 0 2024-03-12T16:10:37.389 INFO:tasks.workunit.client.0.smithi006.stdout:7/252: unlink de/d27/d2b/l4e 0 2024-03-12T16:10:37.390 INFO:tasks.workunit.client.1.smithi134.stdout:3/444: write d1/db/d14/f42 [618452,26451] 0 2024-03-12T16:10:37.391 INFO:tasks.workunit.client.0.smithi006.stdout:6/130: truncate d3/d11/fd 1399211 0 2024-03-12T16:10:37.391 INFO:tasks.workunit.client.1.smithi134.stdout:7/261: fdatasync d8/dc/d2f/f41 0 2024-03-12T16:10:37.392 INFO:tasks.workunit.client.0.smithi006.stdout:2/191: link d0/l29 d0/d13/d2d/l3e 0 2024-03-12T16:10:37.392 INFO:tasks.workunit.client.1.smithi134.stdout:4/266: dwrite d1/d13/d18/d35/f29 [0,4194304] 0 2024-03-12T16:10:37.393 INFO:tasks.workunit.client.1.smithi134.stdout:4/267: dread - d1/de/f30 zero size 2024-03-12T16:10:37.394 INFO:tasks.workunit.client.0.smithi006.stdout:7/253: fdatasync de/f16 0 2024-03-12T16:10:37.395 INFO:tasks.workunit.client.0.smithi006.stdout:7/254: read - de/d2c/f3c zero size 2024-03-12T16:10:37.397 INFO:tasks.workunit.client.0.smithi006.stdout:6/131: rename d3/d11/d10/d1b/f24 to d3/d11/d10/d1b/d20/d26/f2e 0 2024-03-12T16:10:37.398 INFO:tasks.workunit.client.0.smithi006.stdout:3/128: getdents d8/d19 0 2024-03-12T16:10:37.400 INFO:tasks.workunit.client.1.smithi134.stdout:4/268: dwrite d1/de/f3c [0,4194304] 0 2024-03-12T16:10:37.403 INFO:tasks.workunit.client.0.smithi006.stdout:7/255: rename de/f16 to de/d27/f56 0 2024-03-12T16:10:37.403 INFO:tasks.workunit.client.1.smithi134.stdout:4/269: mkdir d1/de/d5a 0 2024-03-12T16:10:37.406 INFO:tasks.workunit.client.0.smithi006.stdout:2/192: creat d0/f3f x:0 0 0 2024-03-12T16:10:37.407 INFO:tasks.workunit.client.1.smithi134.stdout:4/270: creat d1/d13/f5b x:0 0 0 2024-03-12T16:10:37.408 INFO:tasks.workunit.client.0.smithi006.stdout:3/129: symlink d8/df/d2c/dc/l2e 0 2024-03-12T16:10:37.408 INFO:tasks.workunit.client.0.smithi006.stdout:2/193: truncate d0/d13/d2d/f16 2271299 0 2024-03-12T16:10:37.409 INFO:tasks.workunit.client.1.smithi134.stdout:4/271: symlink d1/d13/d18/d35/d4a/l5c 0 2024-03-12T16:10:37.409 INFO:tasks.workunit.client.0.smithi006.stdout:7/256: creat de/d27/d2b/f57 x:0 0 0 2024-03-12T16:10:37.411 INFO:tasks.workunit.client.0.smithi006.stdout:0/221: write d2/f1f [425983,82164] 0 2024-03-12T16:10:37.412 INFO:tasks.workunit.client.1.smithi134.stdout:4/272: unlink d1/de/l2f 0 2024-03-12T16:10:37.412 INFO:tasks.workunit.client.0.smithi006.stdout:3/130: rmdir d8/df/d2c/dc 39 2024-03-12T16:10:37.414 INFO:tasks.workunit.client.1.smithi134.stdout:4/273: mknod d1/d13/d18/d35/d4a/c5d 0 2024-03-12T16:10:37.414 INFO:tasks.workunit.client.0.smithi006.stdout:3/131: chown d8/df/f1f 44101908 1 2024-03-12T16:10:37.414 INFO:tasks.workunit.client.0.smithi006.stdout:0/222: stat d2/d6/d10/d11/d1d/d2e/f33 0 2024-03-12T16:10:37.416 INFO:tasks.workunit.client.1.smithi134.stdout:4/274: unlink d1/d13/d18/l27 0 2024-03-12T16:10:37.416 INFO:tasks.workunit.client.0.smithi006.stdout:7/257: unlink fc 0 2024-03-12T16:10:37.417 INFO:tasks.workunit.client.1.smithi134.stdout:4/275: write d1/f3a [1296333,32197] 0 2024-03-12T16:10:37.417 INFO:tasks.workunit.client.1.smithi134.stdout:4/276: chown d1/d13/f4b 48698 1 2024-03-12T16:10:37.420 INFO:tasks.workunit.client.1.smithi134.stdout:4/277: creat d1/d13/d18/d28/f5e x:0 0 0 2024-03-12T16:10:37.421 INFO:tasks.workunit.client.1.smithi134.stdout:4/278: creat d1/d13/d49/f5f x:0 0 0 2024-03-12T16:10:37.422 INFO:tasks.workunit.client.0.smithi006.stdout:3/132: dread d8/f1c [0,4194304] 0 2024-03-12T16:10:37.423 INFO:tasks.workunit.client.0.smithi006.stdout:7/258: write de/d18/f1b [4868221,50613] 0 2024-03-12T16:10:37.424 INFO:tasks.workunit.client.0.smithi006.stdout:2/194: creat d0/f40 x:0 0 0 2024-03-12T16:10:37.425 INFO:tasks.workunit.client.1.smithi134.stdout:4/279: link d1/de/f36 d1/d13/d18/d35/d4a/f60 0 2024-03-12T16:10:37.425 INFO:tasks.workunit.client.0.smithi006.stdout:0/223: mknod d2/d39/c3f 0 2024-03-12T16:10:37.426 INFO:tasks.workunit.client.0.smithi006.stdout:8/102: write d2/f9 [402268,64254] 0 2024-03-12T16:10:37.428 INFO:tasks.workunit.client.1.smithi134.stdout:4/280: dread d1/d24/d34/f57 [0,4194304] 0 2024-03-12T16:10:37.428 INFO:tasks.workunit.client.1.smithi134.stdout:4/281: dread - d1/d13/d18/d35/f54 zero size 2024-03-12T16:10:37.429 INFO:tasks.workunit.client.0.smithi006.stdout:1/118: write d0/fa [2760958,66402] 0 2024-03-12T16:10:37.430 INFO:tasks.workunit.client.0.smithi006.stdout:3/133: dread d8/df/d2c/f27 [0,4194304] 0 2024-03-12T16:10:37.430 INFO:tasks.workunit.client.0.smithi006.stdout:8/103: creat d2/db/f24 x:0 0 0 2024-03-12T16:10:37.431 INFO:tasks.workunit.client.1.smithi134.stdout:4/282: write d1/d13/d18/d35/d4a/f60 [3338927,2485] 0 2024-03-12T16:10:37.432 INFO:tasks.workunit.client.0.smithi006.stdout:7/259: unlink de/c11 0 2024-03-12T16:10:37.433 INFO:tasks.workunit.client.0.smithi006.stdout:8/104: chown d2/c6 2949305 1 2024-03-12T16:10:37.437 INFO:tasks.workunit.client.0.smithi006.stdout:0/224: dread d2/d6/d10/d11/d1d/f29 [0,4194304] 0 2024-03-12T16:10:37.438 INFO:tasks.workunit.client.1.smithi134.stdout:4/283: dwrite d1/de/f4d [0,4194304] 0 2024-03-12T16:10:37.439 INFO:tasks.workunit.client.0.smithi006.stdout:4/106: dwrite d1/db/d17/f1a [0,4194304] 0 2024-03-12T16:10:37.439 INFO:tasks.workunit.client.1.smithi134.stdout:4/284: stat d1/d13/d49/f5f 0 2024-03-12T16:10:37.442 INFO:tasks.workunit.client.1.smithi134.stdout:4/285: truncate d1/d13/d18/d35/f54 760748 0 2024-03-12T16:10:37.443 INFO:tasks.workunit.client.0.smithi006.stdout:7/260: creat de/d18/d2a/d39/f58 x:0 0 0 2024-03-12T16:10:37.445 INFO:tasks.workunit.client.0.smithi006.stdout:3/134: mkdir d8/df/d2c/dc/d28/d2f 0 2024-03-12T16:10:37.447 INFO:tasks.workunit.client.0.smithi006.stdout:5/94: truncate d7/d9/f20 134068 0 2024-03-12T16:10:37.447 INFO:tasks.workunit.client.0.smithi006.stdout:3/135: dread - d8/f21 zero size 2024-03-12T16:10:37.447 INFO:tasks.workunit.client.1.smithi134.stdout:4/286: rename d1/d24/d34/l50 to d1/d13/d49/d53/l61 0 2024-03-12T16:10:37.449 INFO:tasks.workunit.client.1.smithi134.stdout:4/287: mknod d1/de/c62 0 2024-03-12T16:10:37.450 INFO:tasks.workunit.client.0.smithi006.stdout:4/107: dwrite d1/db/d17/f1a [0,4194304] 0 2024-03-12T16:10:37.450 INFO:tasks.workunit.client.1.smithi134.stdout:4/288: truncate d1/d24/f56 812840 0 2024-03-12T16:10:37.452 INFO:tasks.workunit.client.1.smithi134.stdout:4/289: stat d1/d13/l16 0 2024-03-12T16:10:37.454 INFO:tasks.workunit.client.0.smithi006.stdout:7/261: symlink de/d27/l59 0 2024-03-12T16:10:37.454 INFO:tasks.workunit.client.1.smithi134.stdout:4/290: fsync d1/d13/d18/d35/f54 0 2024-03-12T16:10:37.455 INFO:tasks.workunit.client.1.smithi134.stdout:4/291: write d1/de/f3c [4668471,71539] 0 2024-03-12T16:10:37.457 INFO:tasks.workunit.client.1.smithi134.stdout:4/292: write d1/de/f30 [188586,16994] 0 2024-03-12T16:10:37.459 INFO:tasks.workunit.client.0.smithi006.stdout:4/108: chown d1/db/c1b 139438 1 2024-03-12T16:10:37.460 INFO:tasks.workunit.client.0.smithi006.stdout:3/136: fsync d8/df/d2c/f1d 0 2024-03-12T16:10:37.461 INFO:tasks.workunit.client.1.smithi134.stdout:4/293: link d1/la d1/d13/d49/d53/l63 0 2024-03-12T16:10:37.462 INFO:tasks.workunit.client.0.smithi006.stdout:7/262: symlink de/d27/d2b/l5a 0 2024-03-12T16:10:37.462 INFO:tasks.workunit.client.0.smithi006.stdout:2/195: dread d0/dc/f15 [0,4194304] 0 2024-03-12T16:10:37.465 INFO:tasks.workunit.client.0.smithi006.stdout:4/109: mknod d1/db/c1f 0 2024-03-12T16:10:37.468 INFO:tasks.workunit.client.1.smithi134.stdout:4/294: dwrite d1/f23 [4194304,4194304] 0 2024-03-12T16:10:37.468 INFO:tasks.workunit.client.0.smithi006.stdout:6/132: dwrite d3/f1d [0,4194304] 0 2024-03-12T16:10:37.471 INFO:tasks.workunit.client.0.smithi006.stdout:2/196: symlink d0/d13/d2d/l41 0 2024-03-12T16:10:37.472 INFO:tasks.workunit.client.0.smithi006.stdout:3/137: write d8/df/d2c/f27 [5154665,107332] 0 2024-03-12T16:10:37.474 INFO:tasks.workunit.client.0.smithi006.stdout:7/263: dread de/d18/d2a/f31 [0,4194304] 0 2024-03-12T16:10:37.475 INFO:tasks.workunit.client.1.smithi134.stdout:5/443: dread db/d12/d1d/f51 [0,4194304] 0 2024-03-12T16:10:37.476 INFO:tasks.workunit.client.0.smithi006.stdout:6/133: symlink d3/d11/d10/d1b/d20/l2f 0 2024-03-12T16:10:37.476 INFO:tasks.workunit.client.0.smithi006.stdout:1/119: write d0/f16 [599353,28577] 0 2024-03-12T16:10:37.484 INFO:tasks.workunit.client.0.smithi006.stdout:3/138: dread f1 [4194304,4194304] 0 2024-03-12T16:10:37.484 INFO:tasks.workunit.client.1.smithi134.stdout:5/444: mkdir db/d12/d37/d71/d90 0 2024-03-12T16:10:37.486 INFO:tasks.workunit.client.0.smithi006.stdout:7/264: mknod de/d27/c5b 0 2024-03-12T16:10:37.486 INFO:tasks.workunit.client.0.smithi006.stdout:7/265: chown de/f1e 1710833 1 2024-03-12T16:10:37.487 INFO:tasks.workunit.client.0.smithi006.stdout:8/105: dwrite d2/d11/f1d [0,4194304] 0 2024-03-12T16:10:37.487 INFO:tasks.workunit.client.1.smithi134.stdout:0/363: truncate db/f10 1489052 0 2024-03-12T16:10:37.488 INFO:tasks.workunit.client.1.smithi134.stdout:5/445: symlink db/d12/d37/d71/d90/l91 0 2024-03-12T16:10:37.489 INFO:tasks.workunit.client.0.smithi006.stdout:0/225: write d2/d6/d10/d11/d1d/f29 [1273408,216] 0 2024-03-12T16:10:37.489 INFO:tasks.workunit.client.0.smithi006.stdout:4/110: creat d1/db/d1d/f20 x:0 0 0 2024-03-12T16:10:37.493 INFO:tasks.workunit.client.1.smithi134.stdout:5/446: rmdir db/d12/d1d 39 2024-03-12T16:10:37.495 INFO:tasks.workunit.client.0.smithi006.stdout:8/106: rmdir d2/db/d1a 39 2024-03-12T16:10:37.496 INFO:tasks.workunit.client.0.smithi006.stdout:4/111: dread d1/db/d17/f11 [0,4194304] 0 2024-03-12T16:10:37.498 INFO:tasks.workunit.client.0.smithi006.stdout:7/266: symlink de/d27/d2b/d4a/l5c 0 2024-03-12T16:10:37.499 INFO:tasks.workunit.client.1.smithi134.stdout:5/447: fsync db/d12/d1d/d3a/f67 0 2024-03-12T16:10:37.499 INFO:tasks.workunit.client.1.smithi134.stdout:0/364: dwrite db/d2f/d51/f64 [0,4194304] 0 2024-03-12T16:10:37.501 INFO:tasks.workunit.client.1.smithi134.stdout:0/365: chown db/d2f/d31/d56 938 1 2024-03-12T16:10:37.501 INFO:tasks.workunit.client.0.smithi006.stdout:0/226: creat d2/d39/f40 x:0 0 0 2024-03-12T16:10:37.508 INFO:tasks.workunit.client.0.smithi006.stdout:4/112: creat d1/db/f21 x:0 0 0 2024-03-12T16:10:37.513 INFO:tasks.workunit.client.0.smithi006.stdout:7/267: dwrite de/d18/d2a/d39/f46 [0,4194304] 0 2024-03-12T16:10:37.514 INFO:tasks.workunit.client.0.smithi006.stdout:0/227: unlink d2/d6/l8 0 2024-03-12T16:10:37.515 INFO:tasks.workunit.client.0.smithi006.stdout:4/113: dread d1/db/d17/f1e [0,4194304] 0 2024-03-12T16:10:37.518 INFO:tasks.workunit.client.0.smithi006.stdout:4/114: truncate d1/db/d1d/f20 149697 0 2024-03-12T16:10:37.522 INFO:tasks.workunit.client.0.smithi006.stdout:1/120: getdents d0/d25 0 2024-03-12T16:10:37.523 INFO:tasks.workunit.client.0.smithi006.stdout:0/228: truncate d2/d6/d10/d11/d1d/d2e/f33 578066 0 2024-03-12T16:10:37.523 INFO:tasks.workunit.client.0.smithi006.stdout:7/268: mknod de/d18/c5d 0 2024-03-12T16:10:37.526 INFO:tasks.workunit.client.0.smithi006.stdout:2/197: getdents d0 0 2024-03-12T16:10:37.528 INFO:tasks.workunit.client.0.smithi006.stdout:1/121: chown d0/f27 3637 1 2024-03-12T16:10:37.530 INFO:tasks.workunit.client.0.smithi006.stdout:0/229: symlink d2/d6/d10/l41 0 2024-03-12T16:10:37.533 INFO:tasks.workunit.client.0.smithi006.stdout:4/115: link d1/db/d17/f1a d1/db/f22 0 2024-03-12T16:10:37.533 INFO:tasks.workunit.client.0.smithi006.stdout:0/230: chown d2/f22 49250 1 2024-03-12T16:10:37.538 INFO:tasks.workunit.client.0.smithi006.stdout:2/198: creat d0/f42 x:0 0 0 2024-03-12T16:10:37.538 INFO:tasks.workunit.client.0.smithi006.stdout:6/134: dwrite d3/d11/fd [0,4194304] 0 2024-03-12T16:10:37.538 INFO:tasks.workunit.client.0.smithi006.stdout:8/107: write d2/db/d1a/f1c [747923,123792] 0 2024-03-12T16:10:37.539 INFO:tasks.workunit.client.0.smithi006.stdout:3/139: dwrite d8/fe [0,4194304] 0 2024-03-12T16:10:37.539 INFO:tasks.workunit.client.0.smithi006.stdout:4/116: readlink d1/db/d17/l10 0 2024-03-12T16:10:37.540 INFO:tasks.workunit.client.1.smithi134.stdout:5/448: link l9 db/d12/d37/d73/d8c/l92 0 2024-03-12T16:10:37.540 INFO:tasks.workunit.client.0.smithi006.stdout:1/122: symlink d0/l29 0 2024-03-12T16:10:37.541 INFO:tasks.workunit.client.1.smithi134.stdout:5/449: fdatasync db/d12/d1d/d3a/f67 0 2024-03-12T16:10:37.543 INFO:tasks.workunit.client.0.smithi006.stdout:3/140: stat d8/d19 0 2024-03-12T16:10:37.543 INFO:tasks.workunit.client.0.smithi006.stdout:0/231: mkdir d2/d39/d42 0 2024-03-12T16:10:37.545 INFO:tasks.workunit.client.0.smithi006.stdout:1/123: fsync d0/f1e 0 2024-03-12T16:10:37.547 INFO:tasks.workunit.client.0.smithi006.stdout:7/269: dwrite de/d1c/f33 [0,4194304] 0 2024-03-12T16:10:37.547 INFO:tasks.workunit.client.0.smithi006.stdout:8/108: write d2/db/f24 [895115,21619] 0 2024-03-12T16:10:37.548 INFO:tasks.workunit.client.0.smithi006.stdout:4/117: symlink d1/db/d1d/l23 0 2024-03-12T16:10:37.549 INFO:tasks.workunit.client.0.smithi006.stdout:6/135: symlink d3/d11/d10/d1b/d20/d26/l30 0 2024-03-12T16:10:37.554 INFO:tasks.workunit.client.0.smithi006.stdout:1/124: mkdir d0/d25/d2a 0 2024-03-12T16:10:37.556 INFO:tasks.workunit.client.0.smithi006.stdout:8/109: rename d2/c6 to d2/db/d1a/d23/c25 0 2024-03-12T16:10:37.557 INFO:tasks.workunit.client.1.smithi134.stdout:4/295: truncate d1/d13/d18/d28/f3b 1040707 0 2024-03-12T16:10:37.559 INFO:tasks.workunit.client.0.smithi006.stdout:4/118: symlink d1/db/l24 0 2024-03-12T16:10:37.561 INFO:tasks.workunit.client.0.smithi006.stdout:0/232: creat d2/d39/d42/f43 x:0 0 0 2024-03-12T16:10:37.562 INFO:tasks.workunit.client.0.smithi006.stdout:0/233: write d2/f2c [666697,99523] 0 2024-03-12T16:10:37.563 INFO:tasks.workunit.client.0.smithi006.stdout:0/234: chown d2/d6/d10/f1a 371641 1 2024-03-12T16:10:37.564 INFO:tasks.workunit.client.0.smithi006.stdout:1/125: write d0/f4 [1564965,27850] 0 2024-03-12T16:10:37.565 INFO:tasks.workunit.client.0.smithi006.stdout:8/110: read d2/d11/f14 [476368,23163] 0 2024-03-12T16:10:37.566 INFO:tasks.workunit.client.0.smithi006.stdout:2/199: read d0/d13/d2d/f16 [1492792,69216] 0 2024-03-12T16:10:37.567 INFO:tasks.workunit.client.1.smithi134.stdout:9/275: sync 2024-03-12T16:10:37.568 INFO:tasks.workunit.client.1.smithi134.stdout:9/276: readlink d5/l1b 0 2024-03-12T16:10:37.569 INFO:tasks.workunit.client.1.smithi134.stdout:0/366: truncate db/f45 387996 0 2024-03-12T16:10:37.570 INFO:tasks.workunit.client.0.smithi006.stdout:1/126: read d0/fc [192087,18635] 0 2024-03-12T16:10:37.572 INFO:tasks.workunit.client.1.smithi134.stdout:2/307: sync 2024-03-12T16:10:37.572 INFO:tasks.workunit.client.0.smithi006.stdout:6/136: rename d3/d11/f1e to d3/d11/f31 0 2024-03-12T16:10:37.573 INFO:tasks.workunit.client.0.smithi006.stdout:6/137: write f1 [2943379,70768] 0 2024-03-12T16:10:37.574 INFO:tasks.workunit.client.1.smithi134.stdout:2/308: readlink d4/d12/d1d/l2f 0 2024-03-12T16:10:37.574 INFO:tasks.workunit.client.1.smithi134.stdout:0/367: read db/d2f/f43 [242121,72233] 0 2024-03-12T16:10:37.574 INFO:tasks.workunit.client.0.smithi006.stdout:8/111: creat d2/db/d1a/f26 x:0 0 0 2024-03-12T16:10:37.574 INFO:tasks.workunit.client.0.smithi006.stdout:2/200: dread - d0/d13/f27 zero size 2024-03-12T16:10:37.575 INFO:tasks.workunit.client.1.smithi134.stdout:0/368: fdatasync db/f1f 0 2024-03-12T16:10:37.582 INFO:tasks.workunit.client.0.smithi006.stdout:1/127: dread d0/f12 [0,4194304] 0 2024-03-12T16:10:37.582 INFO:tasks.workunit.client.0.smithi006.stdout:2/201: chown d0/d13/d2d/c19 0 1 2024-03-12T16:10:37.582 INFO:tasks.workunit.client.0.smithi006.stdout:1/128: dread - d0/f24 zero size 2024-03-12T16:10:37.582 INFO:tasks.workunit.client.1.smithi134.stdout:2/309: dread d4/d12/f48 [0,4194304] 0 2024-03-12T16:10:37.583 INFO:tasks.workunit.client.1.smithi134.stdout:9/277: getdents d5/d20 0 2024-03-12T16:10:37.584 INFO:tasks.workunit.client.0.smithi006.stdout:1/129: unlink d0/c17 0 2024-03-12T16:10:37.585 INFO:tasks.workunit.client.1.smithi134.stdout:9/278: truncate d5/d20/f27 914945 0 2024-03-12T16:10:37.585 INFO:tasks.workunit.client.0.smithi006.stdout:7/270: truncate de/d27/f2d 2938551 0 2024-03-12T16:10:37.588 INFO:tasks.workunit.client.1.smithi134.stdout:2/310: getdents d4/d16/d3d 0 2024-03-12T16:10:37.588 INFO:tasks.workunit.client.0.smithi006.stdout:1/130: creat d0/d25/f2b x:0 0 0 2024-03-12T16:10:37.589 INFO:tasks.workunit.client.0.smithi006.stdout:4/119: dwrite d1/db/f22 [0,4194304] 0 2024-03-12T16:10:37.589 INFO:tasks.workunit.client.1.smithi134.stdout:4/296: rename d1/d13/d18 to d1/d13/d49/d64 0 2024-03-12T16:10:37.591 INFO:tasks.workunit.client.0.smithi006.stdout:7/271: symlink de/l5e 0 2024-03-12T16:10:37.592 INFO:tasks.workunit.client.1.smithi134.stdout:4/297: write d1/d13/d49/d64/d28/d4f/f51 [1230079,57841] 0 2024-03-12T16:10:37.593 INFO:tasks.workunit.client.1.smithi134.stdout:4/298: fsync d1/d13/d49/d64/d28/f3f 0 2024-03-12T16:10:37.595 INFO:tasks.workunit.client.0.smithi006.stdout:4/120: creat d1/db/d17/f25 x:0 0 0 2024-03-12T16:10:37.596 INFO:tasks.workunit.client.0.smithi006.stdout:1/131: creat d0/d25/d2a/f2c x:0 0 0 2024-03-12T16:10:37.597 INFO:tasks.workunit.client.1.smithi134.stdout:2/311: rmdir d4 39 2024-03-12T16:10:37.597 INFO:tasks.workunit.client.0.smithi006.stdout:4/121: readlink d1/db/d17/l10 0 2024-03-12T16:10:37.597 INFO:tasks.workunit.client.0.smithi006.stdout:0/235: dwrite d2/d6/f3d [4194304,4194304] 0 2024-03-12T16:10:37.598 INFO:tasks.workunit.client.0.smithi006.stdout:7/272: unlink de/d18/d2a/l48 0 2024-03-12T16:10:37.602 INFO:tasks.workunit.client.1.smithi134.stdout:0/369: dread db/fc [0,4194304] 0 2024-03-12T16:10:37.602 INFO:tasks.workunit.client.0.smithi006.stdout:8/112: write d2/d11/f14 [116498,53104] 0 2024-03-12T16:10:37.602 INFO:tasks.workunit.client.0.smithi006.stdout:4/122: symlink d1/db/d1d/l26 0 2024-03-12T16:10:37.603 INFO:tasks.workunit.client.1.smithi134.stdout:0/370: dread - db/d2f/f57 zero size 2024-03-12T16:10:37.603 INFO:tasks.workunit.client.0.smithi006.stdout:0/236: symlink d2/l44 0 2024-03-12T16:10:37.606 INFO:tasks.workunit.client.1.smithi134.stdout:9/279: dread d5/d20/f23 [0,4194304] 0 2024-03-12T16:10:37.607 INFO:tasks.workunit.client.0.smithi006.stdout:4/123: chown d1/c12 1 1 2024-03-12T16:10:37.609 INFO:tasks.workunit.client.0.smithi006.stdout:8/113: creat d2/d11/f27 x:0 0 0 2024-03-12T16:10:37.612 INFO:tasks.workunit.client.0.smithi006.stdout:8/114: stat d2/db/d1a 0 2024-03-12T16:10:37.614 INFO:tasks.workunit.client.1.smithi134.stdout:2/312: readlink d4/d12/d3b/d3f/l65 0 2024-03-12T16:10:37.614 INFO:tasks.workunit.client.0.smithi006.stdout:0/237: dread d2/f2c [0,4194304] 0 2024-03-12T16:10:37.615 INFO:tasks.workunit.client.1.smithi134.stdout:9/280: mkdir d5/d10/d35/d49 0 2024-03-12T16:10:37.616 INFO:tasks.workunit.client.1.smithi134.stdout:0/371: creat db/d2f/d31/d76/f78 x:0 0 0 2024-03-12T16:10:37.616 INFO:tasks.workunit.client.1.smithi134.stdout:9/281: write d5/d10/f32 [1986871,113569] 0 2024-03-12T16:10:37.617 INFO:tasks.workunit.client.1.smithi134.stdout:4/299: truncate d1/d13/f1d 2743682 0 2024-03-12T16:10:37.618 INFO:tasks.workunit.client.0.smithi006.stdout:6/138: dwrite d3/f1c [0,4194304] 0 2024-03-12T16:10:37.619 INFO:tasks.workunit.client.1.smithi134.stdout:2/313: symlink d4/d12/d1d/l6e 0 2024-03-12T16:10:37.619 INFO:tasks.workunit.client.1.smithi134.stdout:0/372: write db/d2f/f52 [2159020,57554] 0 2024-03-12T16:10:37.619 INFO:tasks.workunit.client.1.smithi134.stdout:9/282: write d5/d20/f27 [415084,122555] 0 2024-03-12T16:10:37.623 INFO:tasks.workunit.client.1.smithi134.stdout:0/373: write db/f3c [2540682,69413] 0 2024-03-12T16:10:37.624 INFO:tasks.workunit.client.0.smithi006.stdout:7/273: dwrite de/f23 [4194304,4194304] 0 2024-03-12T16:10:37.626 INFO:tasks.workunit.client.1.smithi134.stdout:2/314: rename d4/d12/c41 to d4/d12/d1d/d34/d58/c6f 0 2024-03-12T16:10:37.628 INFO:tasks.workunit.client.0.smithi006.stdout:7/274: symlink de/d27/l5f 0 2024-03-12T16:10:37.629 INFO:tasks.workunit.client.0.smithi006.stdout:8/115: getdents d2/db/d1a/d21 0 2024-03-12T16:10:37.630 INFO:tasks.workunit.client.0.smithi006.stdout:0/238: dread d2/f1f [0,4194304] 0 2024-03-12T16:10:37.631 INFO:tasks.workunit.client.0.smithi006.stdout:2/202: dwrite d0/dc/f1a [0,4194304] 0 2024-03-12T16:10:37.631 INFO:tasks.workunit.client.1.smithi134.stdout:9/283: creat d5/d10/d35/d49/f4a x:0 0 0 2024-03-12T16:10:37.632 INFO:tasks.workunit.client.1.smithi134.stdout:2/315: mknod d4/d12/d43/c70 0 2024-03-12T16:10:37.632 INFO:tasks.workunit.client.0.smithi006.stdout:4/124: dread d1/db/d17/f1e [4194304,4194304] 0 2024-03-12T16:10:37.633 INFO:tasks.workunit.client.1.smithi134.stdout:4/300: unlink d1/f3a 0 2024-03-12T16:10:37.637 INFO:tasks.workunit.client.1.smithi134.stdout:4/301: read d1/d13/d49/d64/d35/f29 [1761939,112807] 0 2024-03-12T16:10:37.637 INFO:tasks.workunit.client.1.smithi134.stdout:0/374: dread db/d2f/f43 [0,4194304] 0 2024-03-12T16:10:37.638 INFO:tasks.workunit.client.0.smithi006.stdout:8/116: mknod d2/c28 0 2024-03-12T16:10:37.638 INFO:tasks.workunit.client.0.smithi006.stdout:1/132: dwrite d0/f12 [0,4194304] 0 2024-03-12T16:10:37.639 INFO:tasks.workunit.client.0.smithi006.stdout:4/125: dread - d1/db/d17/f1c zero size 2024-03-12T16:10:37.639 INFO:tasks.workunit.client.0.smithi006.stdout:6/139: truncate d3/d11/f31 3273989 0 2024-03-12T16:10:37.639 INFO:tasks.workunit.client.0.smithi006.stdout:2/203: chown d0/l38 224755 1 2024-03-12T16:10:37.641 INFO:tasks.workunit.client.1.smithi134.stdout:2/316: dwrite d4/d12/d39/f57 [0,4194304] 0 2024-03-12T16:10:37.644 INFO:tasks.workunit.client.1.smithi134.stdout:0/375: mknod db/c79 0 2024-03-12T16:10:37.646 INFO:tasks.workunit.client.0.smithi006.stdout:2/204: readlink d0/dc/l3d 0 2024-03-12T16:10:37.647 INFO:tasks.workunit.client.0.smithi006.stdout:0/239: creat d2/d6/d37/f45 x:0 0 0 2024-03-12T16:10:37.647 INFO:tasks.workunit.client.0.smithi006.stdout:4/126: write d1/db/f22 [993598,25558] 0 2024-03-12T16:10:37.648 INFO:tasks.workunit.client.0.smithi006.stdout:1/133: creat d0/d25/d2a/f2d x:0 0 0 2024-03-12T16:10:37.648 INFO:tasks.workunit.client.1.smithi134.stdout:4/302: write d1/d24/f19 [4316194,117721] 0 2024-03-12T16:10:37.648 INFO:tasks.workunit.client.1.smithi134.stdout:0/376: mkdir db/d2f/d61/d7a 0 2024-03-12T16:10:37.649 INFO:tasks.workunit.client.0.smithi006.stdout:7/275: dwrite de/d1c/f26 [4194304,4194304] 0 2024-03-12T16:10:37.654 INFO:tasks.workunit.client.0.smithi006.stdout:2/205: rmdir d0/d13/d2d/d2b 39 2024-03-12T16:10:37.655 INFO:tasks.workunit.client.0.smithi006.stdout:4/127: truncate d1/db/d17/f1c 430575 0 2024-03-12T16:10:37.658 INFO:tasks.workunit.client.0.smithi006.stdout:1/134: chown d0/f21 13 1 2024-03-12T16:10:37.658 INFO:tasks.workunit.client.1.smithi134.stdout:2/317: dwrite d4/d12/d1d/d51/f36 [0,4194304] 0 2024-03-12T16:10:37.660 INFO:tasks.workunit.client.0.smithi006.stdout:4/128: creat d1/db/d1d/f27 x:0 0 0 2024-03-12T16:10:37.661 INFO:tasks.workunit.client.0.smithi006.stdout:4/129: stat d1/c9 0 2024-03-12T16:10:37.661 INFO:tasks.workunit.client.0.smithi006.stdout:4/130: readlink d1/l4 0 2024-03-12T16:10:37.662 INFO:tasks.workunit.client.0.smithi006.stdout:1/135: unlink d0/f7 0 2024-03-12T16:10:37.664 INFO:tasks.workunit.client.1.smithi134.stdout:4/303: dwrite d1/d13/d49/d64/d28/f3f [0,4194304] 0 2024-03-12T16:10:37.664 INFO:tasks.workunit.client.0.smithi006.stdout:6/140: rename d3/f7 to d3/d11/d10/f32 0 2024-03-12T16:10:37.665 INFO:tasks.workunit.client.0.smithi006.stdout:2/206: truncate d0/f4 5029137 0 2024-03-12T16:10:37.669 INFO:tasks.workunit.client.1.smithi134.stdout:2/318: mkdir d4/d16/d3d/d71 0 2024-03-12T16:10:37.670 INFO:tasks.workunit.client.1.smithi134.stdout:2/319: rmdir d4/d2e 39 2024-03-12T16:10:37.671 INFO:tasks.workunit.client.0.smithi006.stdout:7/276: creat de/d18/d2a/d40/f60 x:0 0 0 2024-03-12T16:10:37.673 INFO:tasks.workunit.client.0.smithi006.stdout:4/131: dwrite d1/db/d1d/f20 [0,4194304] 0 2024-03-12T16:10:37.673 INFO:tasks.workunit.client.0.smithi006.stdout:6/141: fdatasync d3/d11/f31 0 2024-03-12T16:10:37.674 INFO:tasks.workunit.client.1.smithi134.stdout:2/320: mknod d4/d16/d3d/d71/c72 0 2024-03-12T16:10:37.679 INFO:tasks.workunit.client.0.smithi006.stdout:6/142: dread - d3/d11/d10/f2a zero size 2024-03-12T16:10:37.679 INFO:tasks.workunit.client.0.smithi006.stdout:1/136: link d0/f1a d0/d25/f2e 0 2024-03-12T16:10:37.680 INFO:tasks.workunit.client.0.smithi006.stdout:4/132: write d1/db/d1d/f27 [150400,39810] 0 2024-03-12T16:10:37.680 INFO:tasks.workunit.client.0.smithi006.stdout:2/207: mknod d0/c43 0 2024-03-12T16:10:37.681 INFO:tasks.workunit.client.1.smithi134.stdout:4/304: dwrite d1/d24/f56 [0,4194304] 0 2024-03-12T16:10:37.682 INFO:tasks.workunit.client.0.smithi006.stdout:4/133: stat d1/db/c1f 0 2024-03-12T16:10:37.683 INFO:tasks.workunit.client.1.smithi134.stdout:0/377: dwrite db/d2f/d31/f47 [0,4194304] 0 2024-03-12T16:10:37.683 INFO:tasks.workunit.client.0.smithi006.stdout:1/137: stat d0/f21 0 2024-03-12T16:10:37.684 INFO:tasks.workunit.client.0.smithi006.stdout:4/134: chown d1/c19 1132 1 2024-03-12T16:10:37.684 INFO:tasks.workunit.client.0.smithi006.stdout:6/143: chown d3/c2d 20126 1 2024-03-12T16:10:37.685 INFO:tasks.workunit.client.0.smithi006.stdout:1/138: chown d0/fe 4085250 1 2024-03-12T16:10:37.687 INFO:tasks.workunit.client.0.smithi006.stdout:2/208: rename d0/d13/f3c to d0/d13/f44 0 2024-03-12T16:10:37.687 INFO:tasks.workunit.client.0.smithi006.stdout:8/117: write d2/fd [1592821,709] 0 2024-03-12T16:10:37.687 INFO:tasks.workunit.client.1.smithi134.stdout:4/305: write d1/d13/d49/f32 [637488,26549] 0 2024-03-12T16:10:37.687 INFO:tasks.workunit.client.1.smithi134.stdout:0/378: read db/f11 [1021852,70108] 0 2024-03-12T16:10:37.688 INFO:tasks.workunit.client.0.smithi006.stdout:4/135: symlink d1/db/d17/l28 0 2024-03-12T16:10:37.689 INFO:tasks.workunit.client.1.smithi134.stdout:0/379: stat db/d2f/d31/c4a 0 2024-03-12T16:10:37.691 INFO:tasks.workunit.client.1.smithi134.stdout:0/380: write db/d2f/d31/d56/f5e [1010982,23344] 0 2024-03-12T16:10:37.691 INFO:tasks.workunit.client.1.smithi134.stdout:4/306: creat d1/d13/d49/f65 x:0 0 0 2024-03-12T16:10:37.692 INFO:tasks.workunit.client.0.smithi006.stdout:4/136: dread d1/db/d17/f1c [0,4194304] 0 2024-03-12T16:10:37.693 INFO:tasks.workunit.client.1.smithi134.stdout:0/381: chown db/d2f/f4f 461540031 1 2024-03-12T16:10:37.693 INFO:tasks.workunit.client.0.smithi006.stdout:0/240: write d2/d6/d10/d11/d32/f38 [1150035,115495] 0 2024-03-12T16:10:37.694 INFO:tasks.workunit.client.1.smithi134.stdout:4/307: creat d1/d13/d49/f66 x:0 0 0 2024-03-12T16:10:37.696 INFO:tasks.workunit.client.1.smithi134.stdout:0/382: creat db/d2f/d31/f7b x:0 0 0 2024-03-12T16:10:37.697 INFO:tasks.workunit.client.0.smithi006.stdout:8/118: symlink d2/db/d1a/l29 0 2024-03-12T16:10:37.698 INFO:tasks.workunit.client.0.smithi006.stdout:3/141: sync 2024-03-12T16:10:37.698 INFO:tasks.workunit.client.0.smithi006.stdout:5/95: sync 2024-03-12T16:10:37.698 INFO:tasks.workunit.client.0.smithi006.stdout:9/46: sync 2024-03-12T16:10:37.698 INFO:tasks.workunit.client.1.smithi134.stdout:0/383: creat db/d2f/d51/f7c x:0 0 0 2024-03-12T16:10:37.699 INFO:tasks.workunit.client.0.smithi006.stdout:9/47: dread - d0/fc zero size 2024-03-12T16:10:37.702 INFO:tasks.workunit.client.1.smithi134.stdout:0/384: link db/l2e db/d2f/d61/d67/l7d 0 2024-03-12T16:10:37.704 INFO:tasks.workunit.client.0.smithi006.stdout:4/137: creat d1/db/f29 x:0 0 0 2024-03-12T16:10:37.704 INFO:tasks.workunit.client.1.smithi134.stdout:0/385: symlink db/d2f/l7e 0 2024-03-12T16:10:37.704 INFO:tasks.workunit.client.0.smithi006.stdout:0/241: symlink d2/d6/l46 0 2024-03-12T16:10:37.707 INFO:tasks.workunit.client.0.smithi006.stdout:2/209: creat d0/f45 x:0 0 0 2024-03-12T16:10:37.707 INFO:tasks.workunit.client.1.smithi134.stdout:0/386: creat db/d2f/d31/d75/f7f x:0 0 0 2024-03-12T16:10:37.708 INFO:tasks.workunit.client.0.smithi006.stdout:3/142: mkdir d8/d19/d30 0 2024-03-12T16:10:37.709 INFO:tasks.workunit.client.0.smithi006.stdout:5/96: read - d7/d9/d10/f1a zero size 2024-03-12T16:10:37.709 INFO:tasks.workunit.client.1.smithi134.stdout:2/321: write d4/d12/d1d/f37 [4189002,51821] 0 2024-03-12T16:10:37.710 INFO:tasks.workunit.client.1.smithi134.stdout:2/322: stat d4/d16 0 2024-03-12T16:10:37.711 INFO:tasks.workunit.client.0.smithi006.stdout:7/277: link de/d1c/l43 de/l61 0 2024-03-12T16:10:37.712 INFO:tasks.workunit.client.1.smithi134.stdout:2/323: fsync d4/d12/f48 0 2024-03-12T16:10:37.713 INFO:tasks.workunit.client.0.smithi006.stdout:4/138: write d1/db/d17/f1c [793637,66480] 0 2024-03-12T16:10:37.714 INFO:tasks.workunit.client.1.smithi134.stdout:0/387: dwrite db/f2d [4194304,4194304] 0 2024-03-12T16:10:37.715 INFO:tasks.workunit.client.1.smithi134.stdout:2/324: write d4/d12/d43/f4c [1576689,14793] 0 2024-03-12T16:10:37.718 INFO:tasks.workunit.client.0.smithi006.stdout:2/210: fsync d0/d13/d2d/f14 0 2024-03-12T16:10:37.719 INFO:tasks.workunit.client.1.smithi134.stdout:0/388: mknod db/d2f/d61/c80 0 2024-03-12T16:10:37.720 INFO:tasks.workunit.client.0.smithi006.stdout:2/211: dread - d0/f42 zero size 2024-03-12T16:10:37.721 INFO:tasks.workunit.client.0.smithi006.stdout:3/143: unlink d8/df/d2c/f27 0 2024-03-12T16:10:37.722 INFO:tasks.workunit.client.1.smithi134.stdout:0/389: symlink db/d2f/d31/d68/l81 0 2024-03-12T16:10:37.723 INFO:tasks.workunit.client.0.smithi006.stdout:6/144: truncate d3/d11/fd 329932 0 2024-03-12T16:10:37.724 INFO:tasks.workunit.client.0.smithi006.stdout:4/139: dread d1/db/d17/f1c [0,4194304] 0 2024-03-12T16:10:37.724 INFO:tasks.workunit.client.0.smithi006.stdout:1/139: dwrite d0/f6 [0,4194304] 0 2024-03-12T16:10:37.725 INFO:tasks.workunit.client.1.smithi134.stdout:0/390: symlink db/d2f/d51/l82 0 2024-03-12T16:10:37.725 INFO:tasks.workunit.client.1.smithi134.stdout:2/325: dwrite d4/d2e/f3a [0,4194304] 0 2024-03-12T16:10:37.726 INFO:tasks.workunit.client.0.smithi006.stdout:6/145: rename d3/d11 to d3/d11/d10/d1b/d20/d26/d33 22 2024-03-12T16:10:37.727 INFO:tasks.workunit.client.1.smithi134.stdout:0/391: write db/f5d [1911041,87744] 0 2024-03-12T16:10:37.729 INFO:tasks.workunit.client.1.smithi134.stdout:0/392: fdatasync db/d2f/d51/f64 0 2024-03-12T16:10:37.734 INFO:tasks.workunit.client.1.smithi134.stdout:2/326: rename d4/d12/d1d/d34/d58/l5f to d4/d2e/l73 0 2024-03-12T16:10:37.738 INFO:tasks.workunit.client.1.smithi134.stdout:2/327: mkdir d4/d12/d1d/d34/d58/d74 0 2024-03-12T16:10:37.739 INFO:tasks.workunit.client.0.smithi006.stdout:5/97: truncate d7/d9/f16 1699488 0 2024-03-12T16:10:37.742 INFO:tasks.workunit.client.0.smithi006.stdout:3/144: fdatasync d8/df/f1e 0 2024-03-12T16:10:37.743 INFO:tasks.workunit.client.0.smithi006.stdout:0/242: dwrite d2/d6/d10/d11/d32/f3a [0,4194304] 0 2024-03-12T16:10:37.745 INFO:tasks.workunit.client.0.smithi006.stdout:8/119: getdents d2/d11 0 2024-03-12T16:10:37.746 INFO:tasks.workunit.client.1.smithi134.stdout:2/328: getdents d4/d12/d1d/d34 0 2024-03-12T16:10:37.746 INFO:tasks.workunit.client.0.smithi006.stdout:8/120: chown d2/db/d1a 76813670 1 2024-03-12T16:10:37.746 INFO:tasks.workunit.client.0.smithi006.stdout:2/212: mknod d0/c46 0 2024-03-12T16:10:37.747 INFO:tasks.workunit.client.1.smithi134.stdout:0/393: truncate db/f10 1294951 0 2024-03-12T16:10:37.747 INFO:tasks.workunit.client.0.smithi006.stdout:9/48: getdents d0/d8 0 2024-03-12T16:10:37.749 INFO:tasks.workunit.client.0.smithi006.stdout:5/98: symlink d7/d9/d10/l25 0 2024-03-12T16:10:37.752 INFO:tasks.workunit.client.0.smithi006.stdout:7/278: mknod de/d18/d2a/d40/c62 0 2024-03-12T16:10:37.754 INFO:tasks.workunit.client.1.smithi134.stdout:2/329: creat d4/d12/d1d/d34/d58/f75 x:0 0 0 2024-03-12T16:10:37.755 INFO:tasks.workunit.client.1.smithi134.stdout:2/330: link d4/d12/f18 d4/d12/d43/f76 0 2024-03-12T16:10:37.756 INFO:tasks.workunit.client.0.smithi006.stdout:8/121: symlink d2/db/d1a/d23/l2a 0 2024-03-12T16:10:37.757 INFO:tasks.workunit.client.0.smithi006.stdout:1/140: write d0/f1e [853413,68140] 0 2024-03-12T16:10:37.758 INFO:tasks.workunit.client.0.smithi006.stdout:2/213: read - d0/d13/f35 zero size 2024-03-12T16:10:37.760 INFO:tasks.workunit.client.0.smithi006.stdout:4/140: link d1/c7 d1/c2a 0 2024-03-12T16:10:37.760 INFO:tasks.workunit.client.1.smithi134.stdout:2/331: creat d4/f77 x:0 0 0 2024-03-12T16:10:37.760 INFO:tasks.workunit.client.0.smithi006.stdout:2/214: write d0/f45 [660171,124094] 0 2024-03-12T16:10:37.761 INFO:tasks.workunit.client.1.smithi134.stdout:2/332: stat d4/d3c/l40 0 2024-03-12T16:10:37.763 INFO:tasks.workunit.client.1.smithi134.stdout:0/394: dwrite db/d2f/f43 [0,4194304] 0 2024-03-12T16:10:37.764 INFO:tasks.workunit.client.0.smithi006.stdout:1/141: unlink d0/f1e 0 2024-03-12T16:10:37.765 INFO:tasks.workunit.client.1.smithi134.stdout:0/395: write db/d2f/d61/d67/f69 [953382,9561] 0 2024-03-12T16:10:37.766 INFO:tasks.workunit.client.1.smithi134.stdout:2/333: getdents d4/d12/d1d/d34/d47/d56 0 2024-03-12T16:10:37.766 INFO:tasks.workunit.client.1.smithi134.stdout:2/334: dread - d4/d12/d1d/d34/f6c zero size 2024-03-12T16:10:37.767 INFO:tasks.workunit.client.0.smithi006.stdout:6/146: getdents d3/d11/d10/d19 0 2024-03-12T16:10:37.768 INFO:tasks.workunit.client.1.smithi134.stdout:2/335: write d4/d12/d1d/d34/f42 [4467717,64588] 0 2024-03-12T16:10:37.771 INFO:tasks.workunit.client.0.smithi006.stdout:5/99: dwrite d7/d9/fc [0,4194304] 0 2024-03-12T16:10:37.772 INFO:tasks.workunit.client.0.smithi006.stdout:9/49: rename d0/d4/l7 to d0/d4/lf 0 2024-03-12T16:10:37.774 INFO:tasks.workunit.client.1.smithi134.stdout:2/336: link d4/d12/d1d/d34/f6c d4/d12/d1d/d34/d58/f78 0 2024-03-12T16:10:37.774 INFO:tasks.workunit.client.0.smithi006.stdout:4/141: creat d1/db/d1d/f2b x:0 0 0 2024-03-12T16:10:37.776 INFO:tasks.workunit.client.0.smithi006.stdout:3/145: write d8/f1c [1754414,75449] 0 2024-03-12T16:10:37.777 INFO:tasks.workunit.client.0.smithi006.stdout:4/142: fsync d1/db/d1d/f27 0 2024-03-12T16:10:37.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/337: symlink d4/d12/d1d/d34/l79 0 2024-03-12T16:10:37.778 INFO:tasks.workunit.client.0.smithi006.stdout:8/122: mkdir d2/db/d1a/d21/d2b 0 2024-03-12T16:10:37.779 INFO:tasks.workunit.client.0.smithi006.stdout:1/142: creat d0/f2f x:0 0 0 2024-03-12T16:10:37.780 INFO:tasks.workunit.client.1.smithi134.stdout:2/338: creat d4/d12/d1d/d51/f7a x:0 0 0 2024-03-12T16:10:37.781 INFO:tasks.workunit.client.0.smithi006.stdout:6/147: creat d3/d11/d10/d1b/d20/d26/f34 x:0 0 0 2024-03-12T16:10:37.782 INFO:tasks.workunit.client.0.smithi006.stdout:7/279: creat de/d18/d2a/d40/f63 x:0 0 0 2024-03-12T16:10:37.783 INFO:tasks.workunit.client.1.smithi134.stdout:2/339: getdents d4/d16/d3d/d71 0 2024-03-12T16:10:37.783 INFO:tasks.workunit.client.0.smithi006.stdout:1/143: dread - d0/d25/f28 zero size 2024-03-12T16:10:37.785 INFO:tasks.workunit.client.0.smithi006.stdout:3/146: mkdir d8/d19/d31 0 2024-03-12T16:10:37.786 INFO:tasks.workunit.client.0.smithi006.stdout:8/123: fsync d2/d11/f27 0 2024-03-12T16:10:37.786 INFO:tasks.workunit.client.0.smithi006.stdout:4/143: mknod d1/db/d17/c2c 0 2024-03-12T16:10:37.787 INFO:tasks.workunit.client.0.smithi006.stdout:2/215: symlink d0/dc/l47 0 2024-03-12T16:10:37.787 INFO:tasks.workunit.client.0.smithi006.stdout:3/147: chown d8/df/d2c 72406422 1 2024-03-12T16:10:37.790 INFO:tasks.workunit.client.0.smithi006.stdout:9/50: dwrite d0/fd [0,4194304] 0 2024-03-12T16:10:37.791 INFO:tasks.workunit.client.0.smithi006.stdout:0/243: dread d2/fd [0,4194304] 0 2024-03-12T16:10:37.795 INFO:tasks.workunit.client.0.smithi006.stdout:1/144: rename d0/f24 to d0/f30 0 2024-03-12T16:10:37.795 INFO:tasks.workunit.client.0.smithi006.stdout:6/148: creat d3/d11/d10/f35 x:0 0 0 2024-03-12T16:10:37.795 INFO:tasks.workunit.client.0.smithi006.stdout:4/144: mknod d1/db/c2d 0 2024-03-12T16:10:37.796 INFO:tasks.workunit.client.0.smithi006.stdout:9/51: symlink d0/d8/l10 0 2024-03-12T16:10:37.798 INFO:tasks.workunit.client.0.smithi006.stdout:7/280: dread de/d18/d2a/f31 [0,4194304] 0 2024-03-12T16:10:37.798 INFO:tasks.workunit.client.0.smithi006.stdout:4/145: write d1/db/f22 [3598280,122392] 0 2024-03-12T16:10:37.799 INFO:tasks.workunit.client.0.smithi006.stdout:2/216: fdatasync d0/d13/f27 0 2024-03-12T16:10:37.800 INFO:tasks.workunit.client.0.smithi006.stdout:4/146: read d1/db/f22 [1651068,122245] 0 2024-03-12T16:10:37.800 INFO:tasks.workunit.client.0.smithi006.stdout:8/124: rmdir d2/db/d1a/d21 39 2024-03-12T16:10:37.801 INFO:tasks.workunit.client.0.smithi006.stdout:3/148: creat d8/d19/d31/f32 x:0 0 0 2024-03-12T16:10:37.802 INFO:tasks.workunit.client.0.smithi006.stdout:1/145: mknod d0/d25/c31 0 2024-03-12T16:10:37.804 INFO:tasks.workunit.client.0.smithi006.stdout:6/149: dread d3/d11/fd [0,4194304] 0 2024-03-12T16:10:37.805 INFO:tasks.workunit.client.0.smithi006.stdout:0/244: rmdir d2/d6/d10/d11/d1d/d2e 39 2024-03-12T16:10:37.810 INFO:tasks.workunit.client.0.smithi006.stdout:2/217: chown d0/d13/d2d/d2b/c2f 56364 1 2024-03-12T16:10:37.812 INFO:tasks.workunit.client.0.smithi006.stdout:4/147: creat d1/db/d17/f2e x:0 0 0 2024-03-12T16:10:37.814 INFO:tasks.workunit.client.0.smithi006.stdout:3/149: unlink d8/df/d2c/dc/l2e 0 2024-03-12T16:10:37.816 INFO:tasks.workunit.client.0.smithi006.stdout:1/146: creat d0/d25/f32 x:0 0 0 2024-03-12T16:10:37.817 INFO:tasks.workunit.client.0.smithi006.stdout:3/150: dread - d8/df/d2c/f1d zero size 2024-03-12T16:10:37.818 INFO:tasks.workunit.client.0.smithi006.stdout:3/151: readlink d8/la 0 2024-03-12T16:10:37.818 INFO:tasks.workunit.client.0.smithi006.stdout:6/150: chown d3/d11/d10/d1b/d20/d26/f2e 184634 1 2024-03-12T16:10:37.819 INFO:tasks.workunit.client.0.smithi006.stdout:9/52: mknod d0/db/c11 0 2024-03-12T16:10:37.820 INFO:tasks.workunit.client.0.smithi006.stdout:7/281: mknod de/c64 0 2024-03-12T16:10:37.820 INFO:tasks.workunit.client.0.smithi006.stdout:0/245: write d2/f1f [283893,71604] 0 2024-03-12T16:10:37.820 INFO:tasks.workunit.client.1.smithi134.stdout:1/244: sync 2024-03-12T16:10:37.820 INFO:tasks.workunit.client.1.smithi134.stdout:1/245: chown d0/d42/d47 8424489 1 2024-03-12T16:10:37.821 INFO:tasks.workunit.client.1.smithi134.stdout:1/246: fsync d0/d16/d9/d13/d21/f57 0 2024-03-12T16:10:37.822 INFO:tasks.workunit.client.0.smithi006.stdout:8/125: symlink d2/db/d1a/d1f/l2c 0 2024-03-12T16:10:37.822 INFO:tasks.workunit.client.0.smithi006.stdout:4/148: dwrite d1/db/d1d/f2b [0,4194304] 0 2024-03-12T16:10:37.822 INFO:tasks.workunit.client.1.smithi134.stdout:1/247: chown d0/c5b 120784 1 2024-03-12T16:10:37.823 INFO:tasks.workunit.client.0.smithi006.stdout:9/53: truncate d0/fc 552551 0 2024-03-12T16:10:37.823 INFO:tasks.workunit.client.0.smithi006.stdout:0/246: chown d2/d6/l17 7481919 1 2024-03-12T16:10:37.824 INFO:tasks.workunit.client.0.smithi006.stdout:1/147: symlink d0/d25/l33 0 2024-03-12T16:10:37.824 INFO:tasks.workunit.client.0.smithi006.stdout:8/126: readlink d2/db/d1a/d23/l2a 0 2024-03-12T16:10:37.826 INFO:tasks.workunit.client.0.smithi006.stdout:3/152: truncate d8/df/d2c/f1d 752103 0 2024-03-12T16:10:37.827 INFO:tasks.workunit.client.0.smithi006.stdout:2/218: rename d0/dc/l1b to d0/dc/l48 0 2024-03-12T16:10:37.828 INFO:tasks.workunit.client.0.smithi006.stdout:1/148: creat d0/f34 x:0 0 0 2024-03-12T16:10:37.829 INFO:tasks.workunit.client.0.smithi006.stdout:4/149: mkdir d1/db/d1d/d2f 0 2024-03-12T16:10:37.832 INFO:tasks.workunit.client.0.smithi006.stdout:0/247: unlink d2/d6/l17 0 2024-03-12T16:10:37.834 INFO:tasks.workunit.client.0.smithi006.stdout:8/127: unlink d2/f9 0 2024-03-12T16:10:37.835 INFO:tasks.workunit.client.0.smithi006.stdout:9/54: rename d0/d8/c6 to d0/d8/c12 0 2024-03-12T16:10:37.836 INFO:tasks.workunit.client.0.smithi006.stdout:3/153: chown l4 4297 1 2024-03-12T16:10:37.841 INFO:tasks.workunit.client.0.smithi006.stdout:4/150: rename d1/db/c2d to d1/db/d1d/c30 0 2024-03-12T16:10:37.842 INFO:tasks.workunit.client.0.smithi006.stdout:4/151: chown d1/db/d17/f1c 236 1 2024-03-12T16:10:37.843 INFO:tasks.workunit.client.0.smithi006.stdout:0/248: symlink d2/d6/d10/d11/d32/l47 0 2024-03-12T16:10:37.844 INFO:tasks.workunit.client.0.smithi006.stdout:0/249: stat d2/d6/d10/d11/f35 0 2024-03-12T16:10:37.845 INFO:tasks.workunit.client.0.smithi006.stdout:8/128: chown d2/db/d1a/d21/d2b 2463534 1 2024-03-12T16:10:37.849 INFO:tasks.workunit.client.0.smithi006.stdout:7/282: getdents de/d1c/d35 0 2024-03-12T16:10:37.852 INFO:tasks.workunit.client.0.smithi006.stdout:4/152: creat d1/f31 x:0 0 0 2024-03-12T16:10:37.853 INFO:tasks.workunit.client.0.smithi006.stdout:0/250: mknod d2/d39/c48 0 2024-03-12T16:10:37.858 INFO:tasks.workunit.client.0.smithi006.stdout:8/129: creat d2/d11/f2d x:0 0 0 2024-03-12T16:10:37.859 INFO:tasks.workunit.client.0.smithi006.stdout:1/149: dwrite d0/fc [0,4194304] 0 2024-03-12T16:10:37.861 INFO:tasks.workunit.client.0.smithi006.stdout:4/153: fdatasync d1/db/d17/f11 0 2024-03-12T16:10:37.864 INFO:tasks.workunit.client.1.smithi134.stdout:2/340: dwrite d4/d12/d43/f76 [0,4194304] 0 2024-03-12T16:10:37.865 INFO:tasks.workunit.client.0.smithi006.stdout:8/130: fsync d2/f19 0 2024-03-12T16:10:37.865 INFO:tasks.workunit.client.1.smithi134.stdout:2/341: readlink d4/d3c/l4f 0 2024-03-12T16:10:37.868 INFO:tasks.workunit.client.0.smithi006.stdout:4/154: creat d1/db/d17/f32 x:0 0 0 2024-03-12T16:10:37.868 INFO:tasks.workunit.client.0.smithi006.stdout:2/219: write d0/d13/f44 [355729,73077] 0 2024-03-12T16:10:37.871 INFO:tasks.workunit.client.1.smithi134.stdout:0/396: dread db/d2f/f30 [0,4194304] 0 2024-03-12T16:10:37.872 INFO:tasks.workunit.client.1.smithi134.stdout:0/397: fsync db/d2f/d31/d56/f65 0 2024-03-12T16:10:37.873 INFO:tasks.workunit.client.0.smithi006.stdout:4/155: fsync d1/db/d1d/f20 0 2024-03-12T16:10:37.873 INFO:tasks.workunit.client.1.smithi134.stdout:0/398: chown db/d2f/d31/c4a 5 1 2024-03-12T16:10:37.874 INFO:tasks.workunit.client.0.smithi006.stdout:4/156: write d1/db/d17/f32 [978835,104024] 0 2024-03-12T16:10:37.875 INFO:tasks.workunit.client.0.smithi006.stdout:4/157: dread - d1/db/f29 zero size 2024-03-12T16:10:37.882 INFO:tasks.workunit.client.0.smithi006.stdout:3/154: dwrite d8/f21 [0,4194304] 0 2024-03-12T16:10:37.882 INFO:tasks.workunit.client.0.smithi006.stdout:9/55: truncate d0/d8/fa 3611781 0 2024-03-12T16:10:37.882 INFO:tasks.workunit.client.0.smithi006.stdout:2/220: dread - d0/d13/d2d/f3b zero size 2024-03-12T16:10:37.883 INFO:tasks.workunit.client.1.smithi134.stdout:2/342: truncate d4/d12/d43/f4c 446068 0 2024-03-12T16:10:37.884 INFO:tasks.workunit.client.1.smithi134.stdout:2/343: symlink d4/d12/l7b 0 2024-03-12T16:10:37.884 INFO:tasks.workunit.client.0.smithi006.stdout:4/158: symlink d1/db/d1d/l33 0 2024-03-12T16:10:37.885 INFO:tasks.workunit.client.1.smithi134.stdout:2/344: write d4/d16/d3d/f64 [320870,11986] 0 2024-03-12T16:10:37.885 INFO:tasks.workunit.client.0.smithi006.stdout:2/221: chown d0/d13/c1e 116364 1 2024-03-12T16:10:37.887 INFO:tasks.workunit.client.0.smithi006.stdout:7/283: write de/d27/f56 [575649,109303] 0 2024-03-12T16:10:37.888 INFO:tasks.workunit.client.1.smithi134.stdout:2/345: rmdir d4/d12/d1d/d51 39 2024-03-12T16:10:37.888 INFO:tasks.workunit.client.0.smithi006.stdout:3/155: unlink d8/f1c 0 2024-03-12T16:10:37.889 INFO:tasks.workunit.client.1.smithi134.stdout:2/346: read - d4/d3c/f69 zero size 2024-03-12T16:10:37.892 INFO:tasks.workunit.client.0.smithi006.stdout:2/222: read - d0/f40 zero size 2024-03-12T16:10:37.893 INFO:tasks.workunit.client.1.smithi134.stdout:0/399: dread db/f24 [0,4194304] 0 2024-03-12T16:10:37.893 INFO:tasks.workunit.client.0.smithi006.stdout:4/159: unlink d1/db/d17/f2e 0 2024-03-12T16:10:37.895 INFO:tasks.workunit.client.0.smithi006.stdout:9/56: dwrite d0/fd [4194304,4194304] 0 2024-03-12T16:10:37.897 INFO:tasks.workunit.client.1.smithi134.stdout:0/400: unlink db/f1a 0 2024-03-12T16:10:37.899 INFO:tasks.workunit.client.1.smithi134.stdout:0/401: truncate db/f2c 5135052 0 2024-03-12T16:10:37.900 INFO:tasks.workunit.client.1.smithi134.stdout:2/347: dwrite d4/f77 [0,4194304] 0 2024-03-12T16:10:37.900 INFO:tasks.workunit.client.0.smithi006.stdout:7/284: creat de/d27/d2b/f65 x:0 0 0 2024-03-12T16:10:37.901 INFO:tasks.workunit.client.1.smithi134.stdout:0/402: chown db/f1f 0 1 2024-03-12T16:10:37.901 INFO:tasks.workunit.client.0.smithi006.stdout:4/160: symlink d1/l34 0 2024-03-12T16:10:37.903 INFO:tasks.workunit.client.0.smithi006.stdout:4/161: dread - d1/f31 zero size 2024-03-12T16:10:37.905 INFO:tasks.workunit.client.1.smithi134.stdout:2/348: creat d4/d12/d1d/d34/d58/f7c x:0 0 0 2024-03-12T16:10:37.905 INFO:tasks.workunit.client.1.smithi134.stdout:1/248: dread d0/d16/f14 [0,4194304] 0 2024-03-12T16:10:37.905 INFO:tasks.workunit.client.0.smithi006.stdout:8/131: dwrite d2/f15 [0,4194304] 0 2024-03-12T16:10:37.905 INFO:tasks.workunit.client.0.smithi006.stdout:9/57: creat d0/d8/f13 x:0 0 0 2024-03-12T16:10:37.906 INFO:tasks.workunit.client.1.smithi134.stdout:0/403: mknod db/d2f/d61/c83 0 2024-03-12T16:10:37.906 INFO:tasks.workunit.client.1.smithi134.stdout:1/249: dread - d0/f2c zero size 2024-03-12T16:10:37.910 INFO:tasks.workunit.client.1.smithi134.stdout:2/349: rename d4/d2e to d4/d12/d1d/d51/d7d 0 2024-03-12T16:10:37.911 INFO:tasks.workunit.client.0.smithi006.stdout:2/223: dread d0/d13/f44 [0,4194304] 0 2024-03-12T16:10:37.913 INFO:tasks.workunit.client.1.smithi134.stdout:1/250: rename d0/d42/c59 to d0/d16/c5c 0 2024-03-12T16:10:37.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/251: write d0/d16/d9/d1c/f4e [249576,115762] 0 2024-03-12T16:10:37.914 INFO:tasks.workunit.client.0.smithi006.stdout:9/58: mknod d0/c14 0 2024-03-12T16:10:37.916 INFO:tasks.workunit.client.0.smithi006.stdout:9/59: rename d0 to d0/d4/d15 22 2024-03-12T16:10:37.917 INFO:tasks.workunit.client.0.smithi006.stdout:0/251: dread d2/d6/f7 [4194304,4194304] 0 2024-03-12T16:10:37.917 INFO:tasks.workunit.client.0.smithi006.stdout:2/224: readlink d0/d13/d2d/d2b/l30 0 2024-03-12T16:10:37.917 INFO:tasks.workunit.client.0.smithi006.stdout:7/285: dread de/d18/f1b [0,4194304] 0 2024-03-12T16:10:37.920 INFO:tasks.workunit.client.0.smithi006.stdout:9/60: write d0/fc [1125110,123536] 0 2024-03-12T16:10:37.921 INFO:tasks.workunit.client.1.smithi134.stdout:1/252: dwrite d0/d16/f29 [0,4194304] 0 2024-03-12T16:10:37.923 INFO:tasks.workunit.client.0.smithi006.stdout:2/225: read - d0/d13/d2d/f36 zero size 2024-03-12T16:10:37.923 INFO:tasks.workunit.client.0.smithi006.stdout:9/61: write d0/fc [342053,69360] 0 2024-03-12T16:10:37.924 INFO:tasks.workunit.client.0.smithi006.stdout:0/252: creat d2/d6/d10/d11/d32/f49 x:0 0 0 2024-03-12T16:10:37.925 INFO:tasks.workunit.client.1.smithi134.stdout:1/253: rename d0/d16/d9/d13/d21/f57 to d0/f5d 0 2024-03-12T16:10:37.926 INFO:tasks.workunit.client.0.smithi006.stdout:8/132: creat d2/db/f2e x:0 0 0 2024-03-12T16:10:37.928 INFO:tasks.workunit.client.0.smithi006.stdout:9/62: write d0/fc [579430,58240] 0 2024-03-12T16:10:37.929 INFO:tasks.workunit.client.1.smithi134.stdout:1/254: getdents d0/d16/d9/d1c 0 2024-03-12T16:10:37.930 INFO:tasks.workunit.client.0.smithi006.stdout:7/286: dread de/f1e [0,4194304] 0 2024-03-12T16:10:37.930 INFO:tasks.workunit.client.1.smithi134.stdout:1/255: read d0/d16/d9/d1c/f27 [567586,59824] 0 2024-03-12T16:10:37.932 INFO:tasks.workunit.client.1.smithi134.stdout:1/256: fsync d0/d16/d9/d13/f3f 0 2024-03-12T16:10:37.932 INFO:tasks.workunit.client.0.smithi006.stdout:0/253: creat d2/d6/d10/d11/d32/f4a x:0 0 0 2024-03-12T16:10:37.933 INFO:tasks.workunit.client.0.smithi006.stdout:2/226: mkdir d0/d13/d49 0 2024-03-12T16:10:37.933 INFO:tasks.workunit.client.1.smithi134.stdout:1/257: dread - d0/d16/d9/d13/d21/f4d zero size 2024-03-12T16:10:37.933 INFO:tasks.workunit.client.0.smithi006.stdout:8/133: truncate d2/d11/f1b 665904 0 2024-03-12T16:10:37.936 INFO:tasks.workunit.client.0.smithi006.stdout:3/156: dread d8/df/d2c/f10 [0,4194304] 0 2024-03-12T16:10:37.936 INFO:tasks.workunit.client.1.smithi134.stdout:1/258: mknod d0/d16/d9/d13/d21/c5e 0 2024-03-12T16:10:37.937 INFO:tasks.workunit.client.0.smithi006.stdout:7/287: unlink de/d1c/l22 0 2024-03-12T16:10:37.937 INFO:tasks.workunit.client.1.smithi134.stdout:1/259: write d0/f2c [533815,18320] 0 2024-03-12T16:10:37.937 INFO:tasks.workunit.client.0.smithi006.stdout:4/162: dwrite d1/db/d17/f1e [4194304,4194304] 0 2024-03-12T16:10:37.939 INFO:tasks.workunit.client.0.smithi006.stdout:8/134: truncate d2/d11/f27 428216 0 2024-03-12T16:10:37.943 INFO:tasks.workunit.client.0.smithi006.stdout:2/227: symlink d0/l4a 0 2024-03-12T16:10:37.944 INFO:tasks.workunit.client.0.smithi006.stdout:7/288: mkdir de/d27/d2b/d66 0 2024-03-12T16:10:37.946 INFO:tasks.workunit.client.0.smithi006.stdout:4/163: mknod d1/c35 0 2024-03-12T16:10:37.948 INFO:tasks.workunit.client.0.smithi006.stdout:4/164: readlink d1/db/l24 0 2024-03-12T16:10:37.948 INFO:tasks.workunit.client.0.smithi006.stdout:7/289: truncate de/d18/f47 680153 0 2024-03-12T16:10:37.948 INFO:tasks.workunit.client.0.smithi006.stdout:9/63: dwrite d0/fd [4194304,4194304] 0 2024-03-12T16:10:37.949 INFO:tasks.workunit.client.0.smithi006.stdout:2/228: rmdir d0/dc 39 2024-03-12T16:10:37.950 INFO:tasks.workunit.client.0.smithi006.stdout:8/135: rmdir d2/db/d1a/d1f 39 2024-03-12T16:10:37.951 INFO:tasks.workunit.client.0.smithi006.stdout:3/157: mknod d8/df/d2c/dc/d28/d2f/c33 0 2024-03-12T16:10:37.952 INFO:tasks.workunit.client.0.smithi006.stdout:3/158: chown d8/l9 26594 1 2024-03-12T16:10:37.953 INFO:tasks.workunit.client.1.smithi134.stdout:1/260: dread d0/d42/f45 [0,4194304] 0 2024-03-12T16:10:37.953 INFO:tasks.workunit.client.0.smithi006.stdout:9/64: mkdir d0/d8/d16 0 2024-03-12T16:10:37.958 INFO:tasks.workunit.client.0.smithi006.stdout:4/165: dwrite d1/db/d17/f11 [4194304,4194304] 0 2024-03-12T16:10:37.959 INFO:tasks.workunit.client.0.smithi006.stdout:7/290: creat de/d18/d2a/f67 x:0 0 0 2024-03-12T16:10:37.961 INFO:tasks.workunit.client.1.smithi134.stdout:1/261: dwrite d0/d16/d9/d1c/f27 [0,4194304] 0 2024-03-12T16:10:37.963 INFO:tasks.workunit.client.1.smithi134.stdout:8/353: sync 2024-03-12T16:10:37.963 INFO:tasks.workunit.client.1.smithi134.stdout:5/450: sync 2024-03-12T16:10:37.963 INFO:tasks.workunit.client.1.smithi134.stdout:3/445: sync 2024-03-12T16:10:37.963 INFO:tasks.workunit.client.1.smithi134.stdout:6/348: sync 2024-03-12T16:10:37.963 INFO:tasks.workunit.client.1.smithi134.stdout:7/262: sync 2024-03-12T16:10:37.963 INFO:tasks.workunit.client.0.smithi006.stdout:4/166: fsync d1/db/d1d/f2b 0 2024-03-12T16:10:37.964 INFO:tasks.workunit.client.1.smithi134.stdout:5/451: readlink db/d12/d1d/l2a 0 2024-03-12T16:10:37.965 INFO:tasks.workunit.client.0.smithi006.stdout:4/167: readlink d1/db/l24 0 2024-03-12T16:10:37.966 INFO:tasks.workunit.client.1.smithi134.stdout:1/262: mkdir d0/d16/d9/d13/d21/d5f 0 2024-03-12T16:10:37.967 INFO:tasks.workunit.client.1.smithi134.stdout:6/349: write d1/d3/d19/d32/d4a/f82 [203411,72737] 0 2024-03-12T16:10:37.968 INFO:tasks.workunit.client.1.smithi134.stdout:7/263: chown d8/dc/d20/d26/d36/l43 55 1 2024-03-12T16:10:37.971 INFO:tasks.workunit.client.1.smithi134.stdout:3/446: readlink d1/db/d10/d2d/d2e/d72/l88 0 2024-03-12T16:10:37.971 INFO:tasks.workunit.client.0.smithi006.stdout:0/254: write d2/f22 [102921,123897] 0 2024-03-12T16:10:37.973 INFO:tasks.workunit.client.0.smithi006.stdout:3/159: creat d8/df/d2c/f34 x:0 0 0 2024-03-12T16:10:37.973 INFO:tasks.workunit.client.1.smithi134.stdout:7/264: symlink d8/dc/d20/d26/d36/l58 0 2024-03-12T16:10:37.974 INFO:tasks.workunit.client.0.smithi006.stdout:2/229: link d0/d13/d2d/c33 d0/d13/d2d/d2b/c4b 0 2024-03-12T16:10:37.975 INFO:tasks.workunit.client.1.smithi134.stdout:5/452: creat db/d12/d7b/f93 x:0 0 0 2024-03-12T16:10:37.975 INFO:tasks.workunit.client.0.smithi006.stdout:9/65: dread d0/fc [0,4194304] 0 2024-03-12T16:10:37.975 INFO:tasks.workunit.client.0.smithi006.stdout:8/136: getdents d2 0 2024-03-12T16:10:37.976 INFO:tasks.workunit.client.1.smithi134.stdout:3/447: dread - d1/db/d10/d2d/d2e/f6a zero size 2024-03-12T16:10:37.976 INFO:tasks.workunit.client.1.smithi134.stdout:1/263: symlink d0/d16/d9/d13/d21/d20/l60 0 2024-03-12T16:10:37.976 INFO:tasks.workunit.client.0.smithi006.stdout:7/291: dwrite de/f1e [0,4194304] 0 2024-03-12T16:10:37.977 INFO:tasks.workunit.client.1.smithi134.stdout:8/354: dread d3/d10/f62 [0,4194304] 0 2024-03-12T16:10:37.979 INFO:tasks.workunit.client.1.smithi134.stdout:7/265: truncate d8/dc/f54 541435 0 2024-03-12T16:10:37.979 INFO:tasks.workunit.client.1.smithi134.stdout:5/453: write db/d12/d1d/f89 [852928,104885] 0 2024-03-12T16:10:37.980 INFO:tasks.workunit.client.0.smithi006.stdout:0/255: write d2/d6/d10/d11/d32/f49 [15275,122506] 0 2024-03-12T16:10:37.980 INFO:tasks.workunit.client.0.smithi006.stdout:8/137: chown d2/db/d1a/d21/d2b 836459 1 2024-03-12T16:10:37.981 INFO:tasks.workunit.client.1.smithi134.stdout:6/350: dwrite d1/d4/f21 [0,4194304] 0 2024-03-12T16:10:37.982 INFO:tasks.workunit.client.1.smithi134.stdout:3/448: unlink d1/db/d12/c3c 0 2024-03-12T16:10:37.983 INFO:tasks.workunit.client.0.smithi006.stdout:3/160: truncate f1 3230863 0 2024-03-12T16:10:37.983 INFO:tasks.workunit.client.0.smithi006.stdout:9/66: unlink d0/d8/l10 0 2024-03-12T16:10:37.985 INFO:tasks.workunit.client.0.smithi006.stdout:0/256: unlink c1 0 2024-03-12T16:10:37.992 INFO:tasks.workunit.client.0.smithi006.stdout:4/168: dwrite d1/db/f21 [0,4194304] 0 2024-03-12T16:10:37.992 INFO:tasks.workunit.client.0.smithi006.stdout:9/67: mknod d0/c17 0 2024-03-12T16:10:37.992 INFO:tasks.workunit.client.0.smithi006.stdout:7/292: link ld de/d27/d2b/l68 0 2024-03-12T16:10:37.993 INFO:tasks.workunit.client.1.smithi134.stdout:3/449: readlink d1/db/l64 0 2024-03-12T16:10:37.993 INFO:tasks.workunit.client.1.smithi134.stdout:7/266: rename d8/dc/d20/d26/f3d to d8/d27/f59 0 2024-03-12T16:10:37.993 INFO:tasks.workunit.client.1.smithi134.stdout:5/454: write db/d12/d1d/d3a/d4e/f8a [2559766,1172] 0 2024-03-12T16:10:37.994 INFO:tasks.workunit.client.0.smithi006.stdout:9/68: mkdir d0/d4/d18 0 2024-03-12T16:10:37.996 INFO:tasks.workunit.client.0.smithi006.stdout:4/169: creat d1/db/d1d/d2f/f36 x:0 0 0 2024-03-12T16:10:37.997 INFO:tasks.workunit.client.1.smithi134.stdout:8/355: dread d3/fe [0,4194304] 0 2024-03-12T16:10:37.999 INFO:tasks.workunit.client.0.smithi006.stdout:9/69: rmdir d0/d4 39 2024-03-12T16:10:38.001 INFO:tasks.workunit.client.1.smithi134.stdout:6/351: rename d1/d16/f2e to d1/d3a/d3b/f8c 0 2024-03-12T16:10:38.001 INFO:tasks.workunit.client.1.smithi134.stdout:1/264: dwrite d0/d16/d9/d13/d21/f4d [0,4194304] 0 2024-03-12T16:10:38.001 INFO:tasks.workunit.client.1.smithi134.stdout:8/356: write d3/d1b/f1f [133230,94924] 0 2024-03-12T16:10:38.002 INFO:tasks.workunit.client.1.smithi134.stdout:1/265: stat d0/c5b 0 2024-03-12T16:10:38.003 INFO:tasks.workunit.client.0.smithi006.stdout:4/170: mknod d1/db/c37 0 2024-03-12T16:10:38.003 INFO:tasks.workunit.client.0.smithi006.stdout:7/293: dwrite de/d18/d2a/d40/f63 [0,4194304] 0 2024-03-12T16:10:38.004 INFO:tasks.workunit.client.1.smithi134.stdout:8/357: write d3/d1b/d17/d25/d33/d15/d2b/d4f/f3d [425409,89561] 0 2024-03-12T16:10:38.007 INFO:tasks.workunit.client.1.smithi134.stdout:7/267: unlink d8/dc/d20/f2e 0 2024-03-12T16:10:38.011 INFO:tasks.workunit.client.0.smithi006.stdout:0/257: dwrite d2/d39/d42/f43 [0,4194304] 0 2024-03-12T16:10:38.011 INFO:tasks.workunit.client.0.smithi006.stdout:0/258: chown d2/c14 40711 1 2024-03-12T16:10:38.012 INFO:tasks.workunit.client.1.smithi134.stdout:6/352: creat d1/d3/f8d x:0 0 0 2024-03-12T16:10:38.012 INFO:tasks.workunit.client.1.smithi134.stdout:7/268: write d8/dc/d20/f56 [511241,50867] 0 2024-03-12T16:10:38.013 INFO:tasks.workunit.client.1.smithi134.stdout:1/266: dread d0/d16/d9/d13/d21/f4d [0,4194304] 0 2024-03-12T16:10:38.013 INFO:tasks.workunit.client.0.smithi006.stdout:7/294: rename de/f12 to de/d27/f69 0 2024-03-12T16:10:38.014 INFO:tasks.workunit.client.1.smithi134.stdout:7/269: stat d8/d27/f3f 0 2024-03-12T16:10:38.016 INFO:tasks.workunit.client.1.smithi134.stdout:6/353: unlink d1/d16/d4c/d65/d7b/c8a 0 2024-03-12T16:10:38.016 INFO:tasks.workunit.client.0.smithi006.stdout:0/259: dread - d2/d6/d10/d11/f35 zero size 2024-03-12T16:10:38.017 INFO:tasks.workunit.client.0.smithi006.stdout:9/70: dread d0/d8/fa [0,4194304] 0 2024-03-12T16:10:38.019 INFO:tasks.workunit.client.1.smithi134.stdout:1/267: creat d0/d16/d9/d1c/f61 x:0 0 0 2024-03-12T16:10:38.021 INFO:tasks.workunit.client.1.smithi134.stdout:6/354: mkdir d1/d16/d4c/d58/d8e 0 2024-03-12T16:10:38.022 INFO:tasks.workunit.client.0.smithi006.stdout:4/171: dwrite d1/db/d17/f1e [0,4194304] 0 2024-03-12T16:10:38.029 INFO:tasks.workunit.client.1.smithi134.stdout:1/268: dread d0/f2c [0,4194304] 0 2024-03-12T16:10:38.032 INFO:tasks.workunit.client.1.smithi134.stdout:7/270: link d8/dc/c10 d8/dc/d55/c5a 0 2024-03-12T16:10:38.033 INFO:tasks.workunit.client.0.smithi006.stdout:0/260: unlink d2/d6/d10/f36 0 2024-03-12T16:10:38.033 INFO:tasks.workunit.client.0.smithi006.stdout:3/161: write d8/df/d2c/dc/f1b [269438,108471] 0 2024-03-12T16:10:38.033 INFO:tasks.workunit.client.0.smithi006.stdout:0/261: chown d2/d6/d10 13333 1 2024-03-12T16:10:38.033 INFO:tasks.workunit.client.0.smithi006.stdout:7/295: unlink de/d18/d2a/d40/l4b 0 2024-03-12T16:10:38.033 INFO:tasks.workunit.client.0.smithi006.stdout:2/230: dwrite d0/f12 [0,4194304] 0 2024-03-12T16:10:38.033 INFO:tasks.workunit.client.0.smithi006.stdout:4/172: truncate d1/db/d17/f1a 3491730 0 2024-03-12T16:10:38.034 INFO:tasks.workunit.client.1.smithi134.stdout:7/271: write d8/dc/d20/f1d [1813143,67241] 0 2024-03-12T16:10:38.035 INFO:tasks.workunit.client.0.smithi006.stdout:7/296: dread - de/d27/d2b/f57 zero size 2024-03-12T16:10:38.035 INFO:tasks.workunit.client.0.smithi006.stdout:0/262: rmdir d2/d6/d10/d11 39 2024-03-12T16:10:38.037 INFO:tasks.workunit.client.0.smithi006.stdout:0/263: fdatasync d2/f1f 0 2024-03-12T16:10:38.037 INFO:tasks.workunit.client.1.smithi134.stdout:5/455: dread db/d12/d1d/d3a/f48 [0,4194304] 0 2024-03-12T16:10:38.041 INFO:tasks.workunit.client.1.smithi134.stdout:5/456: stat db/d12/d37/d73/d7f/l85 0 2024-03-12T16:10:38.041 INFO:tasks.workunit.client.1.smithi134.stdout:8/358: dwrite d3/d1b/f14 [0,4194304] 0 2024-03-12T16:10:38.042 INFO:tasks.workunit.client.0.smithi006.stdout:4/173: write d1/db/d17/f1c [1890850,122539] 0 2024-03-12T16:10:38.042 INFO:tasks.workunit.client.0.smithi006.stdout:9/71: link d0/d8/c12 d0/db/c19 0 2024-03-12T16:10:38.046 INFO:tasks.workunit.client.0.smithi006.stdout:2/231: getdents d0/d13/d49 0 2024-03-12T16:10:38.048 INFO:tasks.workunit.client.1.smithi134.stdout:8/359: creat d3/d1b/d17/d24/f6f x:0 0 0 2024-03-12T16:10:38.048 INFO:tasks.workunit.client.1.smithi134.stdout:5/457: write db/d7d/f86 [465517,114231] 0 2024-03-12T16:10:38.050 INFO:tasks.workunit.client.0.smithi006.stdout:9/72: write d0/fc [918414,121056] 0 2024-03-12T16:10:38.051 INFO:tasks.workunit.client.0.smithi006.stdout:7/297: dread de/d27/d2b/f37 [0,4194304] 0 2024-03-12T16:10:38.051 INFO:tasks.workunit.client.0.smithi006.stdout:3/162: dwrite d8/d19/d31/f32 [0,4194304] 0 2024-03-12T16:10:38.051 INFO:tasks.workunit.client.1.smithi134.stdout:7/272: dwrite d8/dc/d20/d26/f2b [0,4194304] 0 2024-03-12T16:10:38.055 INFO:tasks.workunit.client.1.smithi134.stdout:5/458: rename db/d12/d5f to db/d12/d1d/d59/d94 0 2024-03-12T16:10:38.056 INFO:tasks.workunit.client.1.smithi134.stdout:7/273: mkdir d8/d27/d5b 0 2024-03-12T16:10:38.056 INFO:tasks.workunit.client.0.smithi006.stdout:3/163: chown d8/df/d2c/f34 1561 1 2024-03-12T16:10:38.057 INFO:tasks.workunit.client.0.smithi006.stdout:2/232: unlink d0/d13/d2d/d2b/l39 0 2024-03-12T16:10:38.062 INFO:tasks.workunit.client.0.smithi006.stdout:0/264: dwrite d2/d39/d42/f43 [4194304,4194304] 0 2024-03-12T16:10:38.065 INFO:tasks.workunit.client.0.smithi006.stdout:2/233: rename d0/dc/c26 to d0/d13/c4c 0 2024-03-12T16:10:38.065 INFO:tasks.workunit.client.1.smithi134.stdout:5/459: link db/c14 db/d12/d1d/c95 0 2024-03-12T16:10:38.067 INFO:tasks.workunit.client.0.smithi006.stdout:4/174: dwrite d1/db/d17/f32 [0,4194304] 0 2024-03-12T16:10:38.069 INFO:tasks.workunit.client.0.smithi006.stdout:3/164: link d8/d19/d31/f32 d8/d19/d31/f35 0 2024-03-12T16:10:38.070 INFO:tasks.workunit.client.1.smithi134.stdout:8/360: dwrite d3/d1b/d17/f47 [0,4194304] 0 2024-03-12T16:10:38.070 INFO:tasks.workunit.client.1.smithi134.stdout:6/355: dread d1/d4/f20 [0,4194304] 0 2024-03-12T16:10:38.071 INFO:tasks.workunit.client.0.smithi006.stdout:2/234: truncate d0/d13/d2d/f3b 493221 0 2024-03-12T16:10:38.073 INFO:tasks.workunit.client.0.smithi006.stdout:3/165: mknod d8/d19/c36 0 2024-03-12T16:10:38.074 INFO:tasks.workunit.client.0.smithi006.stdout:2/235: symlink d0/d13/l4d 0 2024-03-12T16:10:38.074 INFO:tasks.workunit.client.1.smithi134.stdout:6/356: chown d1/d3/d19/f1f 5 1 2024-03-12T16:10:38.075 INFO:tasks.workunit.client.1.smithi134.stdout:5/460: dread db/d7d/f86 [0,4194304] 0 2024-03-12T16:10:38.076 INFO:tasks.workunit.client.0.smithi006.stdout:3/166: getdents d8/d19/d26 0 2024-03-12T16:10:38.077 INFO:tasks.workunit.client.0.smithi006.stdout:2/236: fdatasync d0/f4 0 2024-03-12T16:10:38.080 INFO:tasks.workunit.client.0.smithi006.stdout:2/237: mknod d0/d13/d2d/c4e 0 2024-03-12T16:10:38.080 INFO:tasks.workunit.client.0.smithi006.stdout:4/175: dread d1/db/d1d/f27 [0,4194304] 0 2024-03-12T16:10:38.089 INFO:tasks.workunit.client.1.smithi134.stdout:8/361: creat d3/d1b/d17/d25/d33/d15/d2b/d4f/f70 x:0 0 0 2024-03-12T16:10:38.089 INFO:tasks.workunit.client.1.smithi134.stdout:6/357: mknod d1/d16/d4c/d58/d8e/c8f 0 2024-03-12T16:10:38.090 INFO:tasks.workunit.client.1.smithi134.stdout:8/362: chown d3/d1b/d17/d25/d33/d15 1546657956 1 2024-03-12T16:10:38.092 INFO:tasks.workunit.client.1.smithi134.stdout:5/461: getdents db 0 2024-03-12T16:10:38.093 INFO:tasks.workunit.client.1.smithi134.stdout:6/358: read d1/d3/d10/f2a [6809439,21293] 0 2024-03-12T16:10:38.094 INFO:tasks.workunit.client.1.smithi134.stdout:8/363: mknod d3/d1b/d17/d25/c71 0 2024-03-12T16:10:38.094 INFO:tasks.workunit.client.1.smithi134.stdout:5/462: fdatasync db/d12/d1d/d3a/f48 0 2024-03-12T16:10:38.096 INFO:tasks.workunit.client.1.smithi134.stdout:7/274: dread d8/f1a [0,4194304] 0 2024-03-12T16:10:38.097 INFO:tasks.workunit.client.1.smithi134.stdout:6/359: mknod d1/d3a/d3b/d55/d85/c90 0 2024-03-12T16:10:38.098 INFO:tasks.workunit.client.1.smithi134.stdout:5/463: symlink db/d12/l96 0 2024-03-12T16:10:38.102 INFO:tasks.workunit.client.1.smithi134.stdout:5/464: write db/d12/d1d/f35 [2461447,69966] 0 2024-03-12T16:10:38.103 INFO:tasks.workunit.client.1.smithi134.stdout:7/275: rename d8/dc/d20/d26/d36/c38 to d8/c5c 0 2024-03-12T16:10:38.104 INFO:tasks.workunit.client.1.smithi134.stdout:5/465: mkdir db/d7a/d97 0 2024-03-12T16:10:38.107 INFO:tasks.workunit.client.1.smithi134.stdout:5/466: creat db/d12/d37/f98 x:0 0 0 2024-03-12T16:10:38.108 INFO:tasks.workunit.client.1.smithi134.stdout:7/276: creat d8/dc/f5d x:0 0 0 2024-03-12T16:10:38.109 INFO:tasks.workunit.client.1.smithi134.stdout:5/467: mkdir db/d12/d1d/d3a/d70/d99 0 2024-03-12T16:10:38.110 INFO:tasks.workunit.client.1.smithi134.stdout:7/277: creat d8/dc/d20/d26/f5e x:0 0 0 2024-03-12T16:10:38.111 INFO:tasks.workunit.client.1.smithi134.stdout:7/278: chown d8/dc/d20/f30 109256537 1 2024-03-12T16:10:38.113 INFO:tasks.workunit.client.1.smithi134.stdout:7/279: write d8/dc/d2f/d31/f4a [1417094,12528] 0 2024-03-12T16:10:38.115 INFO:tasks.workunit.client.1.smithi134.stdout:9/284: sync 2024-03-12T16:10:38.117 INFO:tasks.workunit.client.1.smithi134.stdout:7/280: creat d8/dc/d55/f5f x:0 0 0 2024-03-12T16:10:38.121 INFO:tasks.workunit.client.1.smithi134.stdout:5/468: dwrite db/d12/d1d/d3a/d4e/f55 [0,4194304] 0 2024-03-12T16:10:38.121 INFO:tasks.workunit.client.1.smithi134.stdout:7/281: fdatasync d8/d27/f46 0 2024-03-12T16:10:38.121 INFO:tasks.workunit.client.1.smithi134.stdout:9/285: dread d5/d20/f23 [4194304,4194304] 0 2024-03-12T16:10:38.121 INFO:tasks.workunit.client.1.smithi134.stdout:7/282: write d8/dc/d20/d26/f50 [450861,123004] 0 2024-03-12T16:10:38.122 INFO:tasks.workunit.client.1.smithi134.stdout:5/469: truncate db/d12/d29/d3d/f47 718279 0 2024-03-12T16:10:38.122 INFO:tasks.workunit.client.1.smithi134.stdout:6/360: truncate d1/d3/d19/d32/d4a/f82 207845 0 2024-03-12T16:10:38.123 INFO:tasks.workunit.client.1.smithi134.stdout:8/364: write d3/d1b/d17/d25/d33/d15/d2b/f32 [2016182,21391] 0 2024-03-12T16:10:38.128 INFO:tasks.workunit.client.1.smithi134.stdout:7/283: fdatasync d8/dc/d20/f21 0 2024-03-12T16:10:38.130 INFO:tasks.workunit.client.1.smithi134.stdout:8/365: rmdir d3/d1b/d17/d25/d33/d15 39 2024-03-12T16:10:38.131 INFO:tasks.workunit.client.1.smithi134.stdout:8/366: fsync d3/d1b/f1f 0 2024-03-12T16:10:38.132 INFO:tasks.workunit.client.1.smithi134.stdout:5/470: creat db/d12/d29/f9a x:0 0 0 2024-03-12T16:10:38.133 INFO:tasks.workunit.client.1.smithi134.stdout:7/284: creat d8/dc/d20/d26/d36/f60 x:0 0 0 2024-03-12T16:10:38.135 INFO:tasks.workunit.client.1.smithi134.stdout:5/471: chown db/l1c 235 1 2024-03-12T16:10:38.136 INFO:tasks.workunit.client.1.smithi134.stdout:6/361: write d1/f1e [1389190,128467] 0 2024-03-12T16:10:38.136 INFO:tasks.workunit.client.1.smithi134.stdout:9/286: dwrite d5/d20/f23 [0,4194304] 0 2024-03-12T16:10:38.138 INFO:tasks.workunit.client.1.smithi134.stdout:6/362: stat d1/d4/f42 0 2024-03-12T16:10:38.139 INFO:tasks.workunit.client.1.smithi134.stdout:7/285: write d8/dc/d20/d26/f37 [2952032,124671] 0 2024-03-12T16:10:38.140 INFO:tasks.workunit.client.1.smithi134.stdout:9/287: write d5/fe [3645439,70255] 0 2024-03-12T16:10:38.140 INFO:tasks.workunit.client.1.smithi134.stdout:6/363: read - d1/d4/f80 zero size 2024-03-12T16:10:38.142 INFO:tasks.workunit.client.1.smithi134.stdout:8/367: dread d3/d1b/f1f [0,4194304] 0 2024-03-12T16:10:38.143 INFO:tasks.workunit.client.1.smithi134.stdout:7/286: chown d8/dc/d20/d26/f2b 23662974 1 2024-03-12T16:10:38.143 INFO:tasks.workunit.client.1.smithi134.stdout:5/472: rename db/d12/d29/d3d/l6c to db/d12/d37/d73/l9b 0 2024-03-12T16:10:38.144 INFO:tasks.workunit.client.1.smithi134.stdout:8/368: chown d3/d1b/d17/d45 2654 1 2024-03-12T16:10:38.152 INFO:tasks.workunit.client.1.smithi134.stdout:5/473: write db/d12/d1d/f69 [436392,34099] 0 2024-03-12T16:10:38.154 INFO:tasks.workunit.client.1.smithi134.stdout:9/288: write d5/fa [3243143,39457] 0 2024-03-12T16:10:38.155 INFO:tasks.workunit.client.1.smithi134.stdout:5/474: dread - db/d12/d1d/d3a/f67 zero size 2024-03-12T16:10:38.155 INFO:tasks.workunit.client.1.smithi134.stdout:7/287: symlink d8/dc/d55/d57/l61 0 2024-03-12T16:10:38.155 INFO:tasks.workunit.client.1.smithi134.stdout:6/364: write d1/d3/d19/d32/f37 [666632,38643] 0 2024-03-12T16:10:38.155 INFO:tasks.workunit.client.1.smithi134.stdout:9/289: creat d5/d10/d1f/f4b x:0 0 0 2024-03-12T16:10:38.157 INFO:tasks.workunit.client.1.smithi134.stdout:5/475: read - db/d12/d1d/d3a/f88 zero size 2024-03-12T16:10:38.157 INFO:tasks.workunit.client.1.smithi134.stdout:6/365: chown d1/d16/d4c/d58/c68 1575 1 2024-03-12T16:10:38.158 INFO:tasks.workunit.client.1.smithi134.stdout:9/290: write d5/d10/d35/d49/f4a [48325,32626] 0 2024-03-12T16:10:38.161 INFO:tasks.workunit.client.1.smithi134.stdout:7/288: rename d8/dc/d20/d26/l4f to d8/dc/l62 0 2024-03-12T16:10:38.162 INFO:tasks.workunit.client.1.smithi134.stdout:5/476: symlink db/d12/d1d/d3a/d49/l9c 0 2024-03-12T16:10:38.162 INFO:tasks.workunit.client.1.smithi134.stdout:6/366: write d1/d16/d4c/d65/f6b [974929,105074] 0 2024-03-12T16:10:38.163 INFO:tasks.workunit.client.1.smithi134.stdout:6/367: fsync d1/d3/d10/f15 0 2024-03-12T16:10:38.165 INFO:tasks.workunit.client.1.smithi134.stdout:6/368: chown d1/d4/f67 3 1 2024-03-12T16:10:38.168 INFO:tasks.workunit.client.1.smithi134.stdout:5/477: dread db/d12/d1d/f31 [0,4194304] 0 2024-03-12T16:10:38.169 INFO:tasks.workunit.client.1.smithi134.stdout:5/478: fdatasync db/d12/d1d/f69 0 2024-03-12T16:10:38.171 INFO:tasks.workunit.client.1.smithi134.stdout:5/479: truncate db/d12/d37/f39 5902605 0 2024-03-12T16:10:38.172 INFO:tasks.workunit.client.1.smithi134.stdout:7/289: write d8/dc/d20/f21 [799762,59708] 0 2024-03-12T16:10:38.172 INFO:tasks.workunit.client.1.smithi134.stdout:6/369: write d1/d3/d19/f63 [62346,30028] 0 2024-03-12T16:10:38.173 INFO:tasks.workunit.client.1.smithi134.stdout:5/480: chown db/c14 1085 1 2024-03-12T16:10:38.176 INFO:tasks.workunit.client.1.smithi134.stdout:8/369: dread d3/d1b/f2a [0,4194304] 0 2024-03-12T16:10:38.179 INFO:tasks.workunit.client.1.smithi134.stdout:7/290: write d8/f2a [980159,14480] 0 2024-03-12T16:10:38.184 INFO:tasks.workunit.client.1.smithi134.stdout:5/481: dwrite db/d12/d7b/f93 [0,4194304] 0 2024-03-12T16:10:38.187 INFO:tasks.workunit.client.1.smithi134.stdout:5/482: fsync db/d12/d1d/d59/f8b 0 2024-03-12T16:10:38.189 INFO:tasks.workunit.client.1.smithi134.stdout:6/370: dwrite d1/d3/d19/d32/d4a/f82 [0,4194304] 0 2024-03-12T16:10:38.193 INFO:tasks.workunit.client.1.smithi134.stdout:7/291: dwrite d8/dc/d4b/f44 [0,4194304] 0 2024-03-12T16:10:38.195 INFO:tasks.workunit.client.1.smithi134.stdout:7/292: chown d8/dc/d20/d26/f5e 64018 1 2024-03-12T16:10:38.197 INFO:tasks.workunit.client.1.smithi134.stdout:5/483: link db/d12/d37/f98 db/d12/d29/d3d/f9d 0 2024-03-12T16:10:38.199 INFO:tasks.workunit.client.1.smithi134.stdout:7/293: rename d8/dc/d2f/f41 to d8/dc/d55/f63 0 2024-03-12T16:10:38.201 INFO:tasks.workunit.client.1.smithi134.stdout:7/294: fdatasync d8/fd 0 2024-03-12T16:10:38.202 INFO:tasks.workunit.client.1.smithi134.stdout:5/484: creat db/d12/d1d/d3a/f9e x:0 0 0 2024-03-12T16:10:38.203 INFO:tasks.workunit.client.1.smithi134.stdout:7/295: creat d8/dc/d20/d26/d36/f64 x:0 0 0 2024-03-12T16:10:38.203 INFO:tasks.workunit.client.1.smithi134.stdout:5/485: readlink db/d12/d1d/d3a/d49/l5e 0 2024-03-12T16:10:38.205 INFO:tasks.workunit.client.0.smithi006.stdout:3/167: dwrite d8/df/d2c/f34 [0,4194304] 0 2024-03-12T16:10:38.206 INFO:tasks.workunit.client.1.smithi134.stdout:5/486: mknod db/d7d/c9f 0 2024-03-12T16:10:38.209 INFO:tasks.workunit.client.0.smithi006.stdout:9/73: dwrite d0/d8/fa [0,4194304] 0 2024-03-12T16:10:38.209 INFO:tasks.workunit.client.0.smithi006.stdout:2/238: link d0/d13/d2d/d2b/l31 d0/d13/d49/l4f 0 2024-03-12T16:10:38.211 INFO:tasks.workunit.client.1.smithi134.stdout:7/296: dwrite d8/dc/d20/f1d [0,4194304] 0 2024-03-12T16:10:38.211 INFO:tasks.workunit.client.0.smithi006.stdout:9/74: truncate d0/fd 9191007 0 2024-03-12T16:10:38.212 INFO:tasks.workunit.client.1.smithi134.stdout:6/371: truncate d1/d4/f20 648875 0 2024-03-12T16:10:38.213 INFO:tasks.workunit.client.0.smithi006.stdout:9/75: read d0/fc [1058818,95466] 0 2024-03-12T16:10:38.214 INFO:tasks.workunit.client.0.smithi006.stdout:2/239: unlink d0/d13/c1e 0 2024-03-12T16:10:38.215 INFO:tasks.workunit.client.0.smithi006.stdout:3/168: truncate d8/df/d2c/dc/d28/f29 120461 0 2024-03-12T16:10:38.215 INFO:tasks.workunit.client.1.smithi134.stdout:7/297: unlink d8/fd 0 2024-03-12T16:10:38.217 INFO:tasks.workunit.client.1.smithi134.stdout:7/298: fdatasync d8/dc/f5d 0 2024-03-12T16:10:38.219 INFO:tasks.workunit.client.0.smithi006.stdout:3/169: creat d8/d19/d31/f37 x:0 0 0 2024-03-12T16:10:38.220 INFO:tasks.workunit.client.0.smithi006.stdout:9/76: unlink d0/db/le 0 2024-03-12T16:10:38.220 INFO:tasks.workunit.client.1.smithi134.stdout:6/372: chown d1/d16/d4c/d65/f6b 338932 1 2024-03-12T16:10:38.222 INFO:tasks.workunit.client.0.smithi006.stdout:2/240: creat d0/f50 x:0 0 0 2024-03-12T16:10:38.223 INFO:tasks.workunit.client.0.smithi006.stdout:2/241: chown d0/dc/fd 26420 1 2024-03-12T16:10:38.223 INFO:tasks.workunit.client.1.smithi134.stdout:6/373: mknod d1/d3a/d3b/d6d/c91 0 2024-03-12T16:10:38.225 INFO:tasks.workunit.client.0.smithi006.stdout:3/170: truncate d8/df/d2c/f10 2577980 0 2024-03-12T16:10:38.225 INFO:tasks.workunit.client.1.smithi134.stdout:6/374: creat d1/d3a/d3b/d55/f92 x:0 0 0 2024-03-12T16:10:38.227 INFO:tasks.workunit.client.1.smithi134.stdout:6/375: symlink d1/d16/d4c/d58/d8e/l93 0 2024-03-12T16:10:38.228 INFO:tasks.workunit.client.1.smithi134.stdout:6/376: write d1/d4/f21 [2318448,6941] 0 2024-03-12T16:10:38.230 INFO:tasks.workunit.client.0.smithi006.stdout:9/77: rename d0/c17 to d0/c1a 0 2024-03-12T16:10:38.232 INFO:tasks.workunit.client.0.smithi006.stdout:9/78: dread - d0/d8/f13 zero size 2024-03-12T16:10:38.233 INFO:tasks.workunit.client.0.smithi006.stdout:3/171: link d8/d19/d31/f32 d8/df/d2c/dc/f38 0 2024-03-12T16:10:38.233 INFO:tasks.workunit.client.1.smithi134.stdout:6/377: dwrite d1/d4/f21 [0,4194304] 0 2024-03-12T16:10:38.234 INFO:tasks.workunit.client.0.smithi006.stdout:4/176: dwrite d1/db/d17/f1a [0,4194304] 0 2024-03-12T16:10:38.236 INFO:tasks.workunit.client.0.smithi006.stdout:3/172: read - d8/d19/d31/f37 zero size 2024-03-12T16:10:38.239 INFO:tasks.workunit.client.0.smithi006.stdout:2/242: dwrite d0/d13/f44 [0,4194304] 0 2024-03-12T16:10:38.241 INFO:tasks.workunit.client.0.smithi006.stdout:4/177: chown d1/c2a 264678 1 2024-03-12T16:10:38.241 INFO:tasks.workunit.client.0.smithi006.stdout:3/173: dread - d8/d19/d31/f37 zero size 2024-03-12T16:10:38.241 INFO:tasks.workunit.client.0.smithi006.stdout:2/243: chown d0/f12 783758 1 2024-03-12T16:10:38.241 INFO:tasks.workunit.client.0.smithi006.stdout:4/178: stat d1/c35 0 2024-03-12T16:10:38.241 INFO:tasks.workunit.client.1.smithi134.stdout:7/299: truncate d8/ff 907471 0 2024-03-12T16:10:38.242 INFO:tasks.workunit.client.0.smithi006.stdout:9/79: rename d0/d8/c3 to d0/d4/c1b 0 2024-03-12T16:10:38.246 INFO:tasks.workunit.client.0.smithi006.stdout:4/179: mkdir d1/d38 0 2024-03-12T16:10:38.247 INFO:tasks.workunit.client.1.smithi134.stdout:6/378: dwrite d1/d3/f22 [4194304,4194304] 0 2024-03-12T16:10:38.247 INFO:tasks.workunit.client.0.smithi006.stdout:4/180: chown d1/db/d17/f1c 4430961 1 2024-03-12T16:10:38.250 INFO:tasks.workunit.client.0.smithi006.stdout:2/244: mknod d0/dc/c51 0 2024-03-12T16:10:38.251 INFO:tasks.workunit.client.1.smithi134.stdout:7/300: write d8/d27/f59 [1469572,53645] 0 2024-03-12T16:10:38.254 INFO:tasks.workunit.client.1.smithi134.stdout:7/301: chown d8/dc/d4b 3 1 2024-03-12T16:10:38.254 INFO:tasks.workunit.client.0.smithi006.stdout:9/80: mknod d0/c1c 0 2024-03-12T16:10:38.256 INFO:tasks.workunit.client.1.smithi134.stdout:7/302: mknod d8/dc/d4b/c65 0 2024-03-12T16:10:38.258 INFO:tasks.workunit.client.0.smithi006.stdout:3/174: rmdir d8/d19/d30 0 2024-03-12T16:10:38.259 INFO:tasks.workunit.client.1.smithi134.stdout:6/379: rename d1/d3a/d3b/d6d to d1/d3a/d3b/d55/d94 0 2024-03-12T16:10:38.261 INFO:tasks.workunit.client.0.smithi006.stdout:4/181: dwrite d1/db/d1d/f20 [0,4194304] 0 2024-03-12T16:10:38.262 INFO:tasks.workunit.client.1.smithi134.stdout:7/303: symlink d8/dc/l66 0 2024-03-12T16:10:38.264 INFO:tasks.workunit.client.0.smithi006.stdout:4/182: chown d1/db/d1d/f27 252124137 1 2024-03-12T16:10:38.266 INFO:tasks.workunit.client.1.smithi134.stdout:7/304: creat d8/dc/d20/f67 x:0 0 0 2024-03-12T16:10:38.266 INFO:tasks.workunit.client.0.smithi006.stdout:4/183: mkdir d1/db/d39 0 2024-03-12T16:10:38.267 INFO:tasks.workunit.client.0.smithi006.stdout:5/100: sync 2024-03-12T16:10:38.268 INFO:tasks.workunit.client.0.smithi006.stdout:4/184: read d1/db/d1d/f27 [39281,65257] 0 2024-03-12T16:10:38.268 INFO:tasks.workunit.client.1.smithi134.stdout:6/380: dwrite d1/d4/f80 [0,4194304] 0 2024-03-12T16:10:38.270 INFO:tasks.workunit.client.1.smithi134.stdout:7/305: dread d8/dc/d2f/d31/f35 [0,4194304] 0 2024-03-12T16:10:38.270 INFO:tasks.workunit.client.0.smithi006.stdout:5/101: creat d7/d9/d10/f26 x:0 0 0 2024-03-12T16:10:38.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/306: write d8/f2a [1270793,49419] 0 2024-03-12T16:10:38.272 INFO:tasks.workunit.client.0.smithi006.stdout:4/185: mknod d1/db/c3a 0 2024-03-12T16:10:38.273 INFO:tasks.workunit.client.0.smithi006.stdout:4/186: write d1/db/d1d/f27 [1025901,121872] 0 2024-03-12T16:10:38.274 INFO:tasks.workunit.client.0.smithi006.stdout:5/102: mkdir d7/d9/d27 0 2024-03-12T16:10:38.276 INFO:tasks.workunit.client.0.smithi006.stdout:4/187: creat d1/db/d39/f3b x:0 0 0 2024-03-12T16:10:38.279 INFO:tasks.workunit.client.0.smithi006.stdout:4/188: creat d1/db/f3c x:0 0 0 2024-03-12T16:10:38.280 INFO:tasks.workunit.client.0.smithi006.stdout:4/189: fsync d1/db/d17/f1e 0 2024-03-12T16:10:38.282 INFO:tasks.workunit.client.0.smithi006.stdout:4/190: rename d1/db/d17/f11 to d1/db/d17/f3d 0 2024-03-12T16:10:38.284 INFO:tasks.workunit.client.1.smithi134.stdout:0/404: sync 2024-03-12T16:10:38.284 INFO:tasks.workunit.client.1.smithi134.stdout:4/308: sync 2024-03-12T16:10:38.284 INFO:tasks.workunit.client.0.smithi006.stdout:4/191: mknod d1/d38/c3e 0 2024-03-12T16:10:38.286 INFO:tasks.workunit.client.0.smithi006.stdout:4/192: mknod d1/db/d17/c3f 0 2024-03-12T16:10:38.288 INFO:tasks.workunit.client.1.smithi134.stdout:4/309: mkdir d1/d13/d49/d64/d28/d4f/d67 0 2024-03-12T16:10:38.289 INFO:tasks.workunit.client.0.smithi006.stdout:4/193: creat d1/db/f40 x:0 0 0 2024-03-12T16:10:38.289 INFO:tasks.workunit.client.0.smithi006.stdout:4/194: readlink d1/l4 0 2024-03-12T16:10:38.289 INFO:tasks.workunit.client.1.smithi134.stdout:0/405: creat db/d2f/d61/d7a/f84 x:0 0 0 2024-03-12T16:10:38.291 INFO:tasks.workunit.client.1.smithi134.stdout:4/310: chown d1/de/c62 0 1 2024-03-12T16:10:38.294 INFO:tasks.workunit.client.0.smithi006.stdout:3/175: write d8/df/d2c/dc/f38 [1154954,24488] 0 2024-03-12T16:10:38.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/406: creat db/d2f/d31/f85 x:0 0 0 2024-03-12T16:10:38.296 INFO:tasks.workunit.client.1.smithi134.stdout:0/407: write db/f3c [4876600,10758] 0 2024-03-12T16:10:38.298 INFO:tasks.workunit.client.0.smithi006.stdout:5/103: truncate d7/d9/fc 638460 0 2024-03-12T16:10:38.300 INFO:tasks.workunit.client.1.smithi134.stdout:4/311: creat d1/d13/f68 x:0 0 0 2024-03-12T16:10:38.302 INFO:tasks.workunit.client.0.smithi006.stdout:5/104: chown d7/d9/f16 256796868 1 2024-03-12T16:10:38.302 INFO:tasks.workunit.client.0.smithi006.stdout:2/245: dwrite d0/d13/f2e [0,4194304] 0 2024-03-12T16:10:38.303 INFO:tasks.workunit.client.1.smithi134.stdout:4/312: write d1/d13/f68 [234292,111837] 0 2024-03-12T16:10:38.304 INFO:tasks.workunit.client.1.smithi134.stdout:0/408: read db/f26 [3901357,104572] 0 2024-03-12T16:10:38.305 INFO:tasks.workunit.client.0.smithi006.stdout:9/81: dwrite d0/fc [0,4194304] 0 2024-03-12T16:10:38.305 INFO:tasks.workunit.client.1.smithi134.stdout:6/381: dwrite d1/d4/f67 [0,4194304] 0 2024-03-12T16:10:38.306 INFO:tasks.workunit.client.1.smithi134.stdout:7/307: dread d8/dc/d2f/f32 [0,4194304] 0 2024-03-12T16:10:38.306 INFO:tasks.workunit.client.1.smithi134.stdout:4/313: stat d1/la 0 2024-03-12T16:10:38.308 INFO:tasks.workunit.client.0.smithi006.stdout:4/195: truncate d1/db/d1d/f20 2433416 0 2024-03-12T16:10:38.309 INFO:tasks.workunit.client.1.smithi134.stdout:6/382: stat d1/d4/f47 0 2024-03-12T16:10:38.310 INFO:tasks.workunit.client.1.smithi134.stdout:6/383: fdatasync d1/d4/f80 0 2024-03-12T16:10:38.311 INFO:tasks.workunit.client.0.smithi006.stdout:3/176: link d8/d19/c36 d8/df/d2c/dc/d28/d2f/c39 0 2024-03-12T16:10:38.311 INFO:tasks.workunit.client.0.smithi006.stdout:9/82: dread d0/fd [0,4194304] 0 2024-03-12T16:10:38.312 INFO:tasks.workunit.client.1.smithi134.stdout:7/308: symlink d8/d27/d5b/l68 0 2024-03-12T16:10:38.313 INFO:tasks.workunit.client.0.smithi006.stdout:4/196: symlink d1/db/d1d/d2f/l41 0 2024-03-12T16:10:38.313 INFO:tasks.workunit.client.1.smithi134.stdout:4/314: chown d1/d13/d49/d64/d35/d4a/f60 5051175 1 2024-03-12T16:10:38.313 INFO:tasks.workunit.client.1.smithi134.stdout:6/384: symlink d1/d3a/d3b/d55/l95 0 2024-03-12T16:10:38.313 INFO:tasks.workunit.client.1.smithi134.stdout:7/309: chown d8/dc/d20/l23 471283936 1 2024-03-12T16:10:38.315 INFO:tasks.workunit.client.1.smithi134.stdout:6/385: stat d1/d16/d4c/d65/d70/l76 0 2024-03-12T16:10:38.316 INFO:tasks.workunit.client.0.smithi006.stdout:9/83: creat d0/d4/d18/f1d x:0 0 0 2024-03-12T16:10:38.318 INFO:tasks.workunit.client.0.smithi006.stdout:9/84: read d0/d8/fa [105207,64646] 0 2024-03-12T16:10:38.319 INFO:tasks.workunit.client.1.smithi134.stdout:6/386: write d1/d16/d4c/d65/f81 [4931119,114978] 0 2024-03-12T16:10:38.320 INFO:tasks.workunit.client.0.smithi006.stdout:9/85: truncate d0/fd 9278529 0 2024-03-12T16:10:38.320 INFO:tasks.workunit.client.1.smithi134.stdout:7/310: write d8/f24 [572770,10281] 0 2024-03-12T16:10:38.323 INFO:tasks.workunit.client.0.smithi006.stdout:2/246: write d0/d13/f35 [552168,93763] 0 2024-03-12T16:10:38.324 INFO:tasks.workunit.client.0.smithi006.stdout:9/86: unlink d0/d4/d18/f1d 0 2024-03-12T16:10:38.327 INFO:tasks.workunit.client.1.smithi134.stdout:6/387: rename d1/d16/c28 to d1/d16/d4c/d65/d61/c96 0 2024-03-12T16:10:38.328 INFO:tasks.workunit.client.0.smithi006.stdout:9/87: mknod d0/db/c1e 0 2024-03-12T16:10:38.329 INFO:tasks.workunit.client.0.smithi006.stdout:2/247: mknod d0/c52 0 2024-03-12T16:10:38.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/388: dread d1/d3/d19/f63 [0,4194304] 0 2024-03-12T16:10:38.334 INFO:tasks.workunit.client.1.smithi134.stdout:7/311: getdents d8/dc 0 2024-03-12T16:10:38.334 INFO:tasks.workunit.client.1.smithi134.stdout:7/312: chown d8/dc/l1c 27 1 2024-03-12T16:10:38.337 INFO:tasks.workunit.client.0.smithi006.stdout:9/88: dwrite d0/d8/fa [0,4194304] 0 2024-03-12T16:10:38.339 INFO:tasks.workunit.client.1.smithi134.stdout:6/389: getdents d1/d3 0 2024-03-12T16:10:38.339 INFO:tasks.workunit.client.0.smithi006.stdout:2/248: creat d0/d13/d2d/f53 x:0 0 0 2024-03-12T16:10:38.339 INFO:tasks.workunit.client.0.smithi006.stdout:9/89: read - d0/d8/f13 zero size 2024-03-12T16:10:38.345 INFO:tasks.workunit.client.1.smithi134.stdout:6/390: mkdir d1/d3a/d3b/d55/d97 0 2024-03-12T16:10:38.346 INFO:tasks.workunit.client.0.smithi006.stdout:9/90: mkdir d0/d1f 0 2024-03-12T16:10:38.347 INFO:tasks.workunit.client.1.smithi134.stdout:7/313: dwrite d8/dc/d2f/f32 [0,4194304] 0 2024-03-12T16:10:38.349 INFO:tasks.workunit.client.0.smithi006.stdout:9/91: stat d0/d8/l5 0 2024-03-12T16:10:38.350 INFO:tasks.workunit.client.1.smithi134.stdout:6/391: dread d1/d4/f20 [0,4194304] 0 2024-03-12T16:10:38.350 INFO:tasks.workunit.client.0.smithi006.stdout:2/249: rename d0/d13/d2d/d2b/c2f to d0/dc/c54 0 2024-03-12T16:10:38.351 INFO:tasks.workunit.client.1.smithi134.stdout:4/315: dread d1/f23 [0,4194304] 0 2024-03-12T16:10:38.351 INFO:tasks.workunit.client.1.smithi134.stdout:7/314: chown c2 13560 1 2024-03-12T16:10:38.354 INFO:tasks.workunit.client.1.smithi134.stdout:6/392: symlink d1/d89/l98 0 2024-03-12T16:10:38.354 INFO:tasks.workunit.client.1.smithi134.stdout:0/409: dread db/f21 [0,4194304] 0 2024-03-12T16:10:38.354 INFO:tasks.workunit.client.1.smithi134.stdout:7/315: dread - d8/dc/d20/d26/f3a zero size 2024-03-12T16:10:38.356 INFO:tasks.workunit.client.1.smithi134.stdout:7/316: dread - d8/dc/d55/f63 zero size 2024-03-12T16:10:38.356 INFO:tasks.workunit.client.1.smithi134.stdout:0/410: chown db/d2f/f52 1669 1 2024-03-12T16:10:38.358 INFO:tasks.workunit.client.1.smithi134.stdout:6/393: creat d1/d3a/d3b/d55/d97/f99 x:0 0 0 2024-03-12T16:10:38.359 INFO:tasks.workunit.client.1.smithi134.stdout:7/317: mknod d8/d4e/c69 0 2024-03-12T16:10:38.359 INFO:tasks.workunit.client.0.smithi006.stdout:4/197: dwrite d1/db/d17/f32 [4194304,4194304] 0 2024-03-12T16:10:38.360 INFO:tasks.workunit.client.0.smithi006.stdout:9/92: write d0/d8/f13 [833983,106580] 0 2024-03-12T16:10:38.360 INFO:tasks.workunit.client.1.smithi134.stdout:6/394: truncate d1/d4/f67 5121220 0 2024-03-12T16:10:38.360 INFO:tasks.workunit.client.0.smithi006.stdout:5/105: dwrite d7/d9/fc [0,4194304] 0 2024-03-12T16:10:38.360 INFO:tasks.workunit.client.0.smithi006.stdout:3/177: dwrite d8/df/d2c/f13 [0,4194304] 0 2024-03-12T16:10:38.361 INFO:tasks.workunit.client.0.smithi006.stdout:2/250: chown d0/d13/d2d/l3e 412389 1 2024-03-12T16:10:38.362 INFO:tasks.workunit.client.0.smithi006.stdout:4/198: chown d1/d38 255998132 1 2024-03-12T16:10:38.364 INFO:tasks.workunit.client.0.smithi006.stdout:2/251: readlink d0/l9 0 2024-03-12T16:10:38.364 INFO:tasks.workunit.client.1.smithi134.stdout:7/318: creat d8/dc/d55/d57/f6a x:0 0 0 2024-03-12T16:10:38.365 INFO:tasks.workunit.client.0.smithi006.stdout:2/252: stat d0/l9 0 2024-03-12T16:10:38.365 INFO:tasks.workunit.client.1.smithi134.stdout:6/395: rename d1/d4/f21 to d1/d16/d7e/f9a 0 2024-03-12T16:10:38.365 INFO:tasks.workunit.client.0.smithi006.stdout:4/199: chown d1/db/c1b 0 1 2024-03-12T16:10:38.367 INFO:tasks.workunit.client.0.smithi006.stdout:9/93: mkdir d0/db/d20 0 2024-03-12T16:10:38.367 INFO:tasks.workunit.client.0.smithi006.stdout:5/106: chown d7/d8/l1f 41478155 1 2024-03-12T16:10:38.367 INFO:tasks.workunit.client.1.smithi134.stdout:0/411: link db/d2f/f30 db/f86 0 2024-03-12T16:10:38.369 INFO:tasks.workunit.client.0.smithi006.stdout:4/200: write d1/db/d39/f3b [651650,14665] 0 2024-03-12T16:10:38.370 INFO:tasks.workunit.client.0.smithi006.stdout:4/201: stat d1/db/d17/c3f 0 2024-03-12T16:10:38.371 INFO:tasks.workunit.client.1.smithi134.stdout:7/319: unlink d8/dc/d2f/d31/f4a 0 2024-03-12T16:10:38.371 INFO:tasks.workunit.client.0.smithi006.stdout:9/94: symlink d0/d4/l21 0 2024-03-12T16:10:38.371 INFO:tasks.workunit.client.0.smithi006.stdout:9/95: chown d0/d1f 1 1 2024-03-12T16:10:38.373 INFO:tasks.workunit.client.1.smithi134.stdout:6/396: write d1/d3a/d3b/d55/d94/d75/f7f [2553233,48436] 0 2024-03-12T16:10:38.374 INFO:tasks.workunit.client.0.smithi006.stdout:2/253: symlink d0/d13/d49/l55 0 2024-03-12T16:10:38.380 INFO:tasks.workunit.client.1.smithi134.stdout:4/316: dwrite d1/d13/d49/d64/d35/f29 [4194304,4194304] 0 2024-03-12T16:10:38.381 INFO:tasks.workunit.client.0.smithi006.stdout:4/202: dwrite d1/db/d1d/f27 [0,4194304] 0 2024-03-12T16:10:38.381 INFO:tasks.workunit.client.0.smithi006.stdout:2/254: rename d0/d13/d2d/f20 to d0/d13/d2d/d2b/f56 0 2024-03-12T16:10:38.382 INFO:tasks.workunit.client.0.smithi006.stdout:4/203: chown d1/l8 66605 1 2024-03-12T16:10:38.383 INFO:tasks.workunit.client.1.smithi134.stdout:4/317: creat d1/d24/d34/f69 x:0 0 0 2024-03-12T16:10:38.385 INFO:tasks.workunit.client.0.smithi006.stdout:4/204: truncate d1/db/d17/f25 150606 0 2024-03-12T16:10:38.385 INFO:tasks.workunit.client.1.smithi134.stdout:6/397: dwrite d1/d4/f80 [0,4194304] 0 2024-03-12T16:10:38.390 INFO:tasks.workunit.client.0.smithi006.stdout:4/205: mkdir d1/db/d39/d42 0 2024-03-12T16:10:38.391 INFO:tasks.workunit.client.1.smithi134.stdout:0/412: fsync db/d2f/f30 0 2024-03-12T16:10:38.391 INFO:tasks.workunit.client.1.smithi134.stdout:4/318: creat d1/de/f6a x:0 0 0 2024-03-12T16:10:38.393 INFO:tasks.workunit.client.0.smithi006.stdout:5/107: write d7/d8/f14 [555908,90533] 0 2024-03-12T16:10:38.398 INFO:tasks.workunit.client.0.smithi006.stdout:9/96: truncate d0/d8/f13 644770 0 2024-03-12T16:10:38.398 INFO:tasks.workunit.client.1.smithi134.stdout:7/320: truncate d8/f2a 474565 0 2024-03-12T16:10:38.400 INFO:tasks.workunit.client.1.smithi134.stdout:6/398: rename d1/d3a/d3b/d55/l95 to d1/d3a/d3b/d55/d94/l9b 0 2024-03-12T16:10:38.401 INFO:tasks.workunit.client.0.smithi006.stdout:9/97: readlink d0/d4/lf 0 2024-03-12T16:10:38.401 INFO:tasks.workunit.client.0.smithi006.stdout:1/150: sync 2024-03-12T16:10:38.401 INFO:tasks.workunit.client.0.smithi006.stdout:2/255: write d0/d13/d2d/f16 [1891024,94107] 0 2024-03-12T16:10:38.401 INFO:tasks.workunit.client.0.smithi006.stdout:6/151: sync 2024-03-12T16:10:38.402 INFO:tasks.workunit.client.1.smithi134.stdout:6/399: chown d1/d3/d19/c7d 312131626 1 2024-03-12T16:10:38.403 INFO:tasks.workunit.client.1.smithi134.stdout:7/321: symlink d8/l6b 0 2024-03-12T16:10:38.403 INFO:tasks.workunit.client.0.smithi006.stdout:4/206: dread d1/db/d1d/f2b [0,4194304] 0 2024-03-12T16:10:38.404 INFO:tasks.workunit.client.1.smithi134.stdout:6/400: mknod d1/d4d/c9c 0 2024-03-12T16:10:38.404 INFO:tasks.workunit.client.0.smithi006.stdout:3/178: dwrite d8/df/f1e [0,4194304] 0 2024-03-12T16:10:38.404 INFO:tasks.workunit.client.1.smithi134.stdout:0/413: creat db/f87 x:0 0 0 2024-03-12T16:10:38.405 INFO:tasks.workunit.client.0.smithi006.stdout:1/151: write d0/d25/f28 [117612,5777] 0 2024-03-12T16:10:38.405 INFO:tasks.workunit.client.1.smithi134.stdout:7/322: symlink d8/dc/l6c 0 2024-03-12T16:10:38.405 INFO:tasks.workunit.client.0.smithi006.stdout:5/108: creat d7/f28 x:0 0 0 2024-03-12T16:10:38.406 INFO:tasks.workunit.client.1.smithi134.stdout:4/319: read d1/d13/f1d [1621544,130680] 0 2024-03-12T16:10:38.407 INFO:tasks.workunit.client.0.smithi006.stdout:1/152: chown d0/f21 903224 1 2024-03-12T16:10:38.407 INFO:tasks.workunit.client.1.smithi134.stdout:0/414: mkdir db/d2f/d31/d75/d88 0 2024-03-12T16:10:38.409 INFO:tasks.workunit.client.0.smithi006.stdout:6/152: dread d3/d11/f15 [0,4194304] 0 2024-03-12T16:10:38.409 INFO:tasks.workunit.client.0.smithi006.stdout:2/256: symlink d0/d13/l57 0 2024-03-12T16:10:38.409 INFO:tasks.workunit.client.1.smithi134.stdout:4/320: symlink d1/d13/d49/d64/d28/l6b 0 2024-03-12T16:10:38.410 INFO:tasks.workunit.client.0.smithi006.stdout:2/257: stat d0/f4 0 2024-03-12T16:10:38.411 INFO:tasks.workunit.client.0.smithi006.stdout:4/207: mkdir d1/db/d17/d43 0 2024-03-12T16:10:38.413 INFO:tasks.workunit.client.1.smithi134.stdout:4/321: truncate d1/d13/d49/d64/d35/f54 1662711 0 2024-03-12T16:10:38.413 INFO:tasks.workunit.client.0.smithi006.stdout:1/153: rmdir d0/d25/d2a 39 2024-03-12T16:10:38.414 INFO:tasks.workunit.client.1.smithi134.stdout:0/415: rename db/f10 to db/d2f/d71/f89 0 2024-03-12T16:10:38.414 INFO:tasks.workunit.client.1.smithi134.stdout:4/322: dread - d1/de/f6a zero size 2024-03-12T16:10:38.415 INFO:tasks.workunit.client.0.smithi006.stdout:9/98: dread d0/fd [0,4194304] 0 2024-03-12T16:10:38.415 INFO:tasks.workunit.client.0.smithi006.stdout:1/154: write d0/f4 [495914,40462] 0 2024-03-12T16:10:38.415 INFO:tasks.workunit.client.0.smithi006.stdout:5/109: dread d7/d9/f20 [0,4194304] 0 2024-03-12T16:10:38.416 INFO:tasks.workunit.client.0.smithi006.stdout:1/155: stat d0/l29 0 2024-03-12T16:10:38.417 INFO:tasks.workunit.client.0.smithi006.stdout:5/110: dread - d7/d9/d10/f26 zero size 2024-03-12T16:10:38.417 INFO:tasks.workunit.client.1.smithi134.stdout:4/323: symlink d1/d13/d49/d64/d28/d4f/l6c 0 2024-03-12T16:10:38.419 INFO:tasks.workunit.client.1.smithi134.stdout:4/324: rmdir d1/d13/d49/d53 39 2024-03-12T16:10:38.420 INFO:tasks.workunit.client.1.smithi134.stdout:1/269: sync 2024-03-12T16:10:38.420 INFO:tasks.workunit.client.1.smithi134.stdout:3/450: sync 2024-03-12T16:10:38.420 INFO:tasks.workunit.client.1.smithi134.stdout:2/350: sync 2024-03-12T16:10:38.421 INFO:tasks.workunit.client.0.smithi006.stdout:3/179: getdents d8/df/d2c/dc 0 2024-03-12T16:10:38.421 INFO:tasks.workunit.client.1.smithi134.stdout:2/351: chown d4/d3c/c59 1 1 2024-03-12T16:10:38.422 INFO:tasks.workunit.client.1.smithi134.stdout:1/270: stat d0/f2a 0 2024-03-12T16:10:38.422 INFO:tasks.workunit.client.0.smithi006.stdout:2/258: rename d0/d13/l3a to d0/dc/l58 0 2024-03-12T16:10:38.422 INFO:tasks.workunit.client.0.smithi006.stdout:5/111: mknod d7/d9/d27/c29 0 2024-03-12T16:10:38.423 INFO:tasks.workunit.client.1.smithi134.stdout:1/271: readlink d0/lf 0 2024-03-12T16:10:38.423 INFO:tasks.workunit.client.1.smithi134.stdout:2/352: readlink d4/d12/d1d/l2f 0 2024-03-12T16:10:38.426 INFO:tasks.workunit.client.1.smithi134.stdout:3/451: creat d1/db/d10/d2d/d2e/d72/d97/fa8 x:0 0 0 2024-03-12T16:10:38.426 INFO:tasks.workunit.client.0.smithi006.stdout:2/259: stat d0/d13/d2d/f53 0 2024-03-12T16:10:38.427 INFO:tasks.workunit.client.0.smithi006.stdout:4/208: rename d1/c2a to d1/db/d17/c44 0 2024-03-12T16:10:38.429 INFO:tasks.workunit.client.1.smithi134.stdout:2/353: creat d4/d12/d1d/d34/d47/f7e x:0 0 0 2024-03-12T16:10:38.430 INFO:tasks.workunit.client.1.smithi134.stdout:4/325: dwrite d1/d24/d34/f69 [0,4194304] 0 2024-03-12T16:10:38.431 INFO:tasks.workunit.client.0.smithi006.stdout:1/156: dwrite d0/f34 [0,4194304] 0 2024-03-12T16:10:38.431 INFO:tasks.workunit.client.0.smithi006.stdout:9/99: write d0/d8/f13 [261275,111621] 0 2024-03-12T16:10:38.431 INFO:tasks.workunit.client.1.smithi134.stdout:2/354: read d4/d12/d1d/d51/d7d/f3a [4013698,99170] 0 2024-03-12T16:10:38.432 INFO:tasks.workunit.client.1.smithi134.stdout:4/326: read d1/d13/f39 [572796,90650] 0 2024-03-12T16:10:38.433 INFO:tasks.workunit.client.0.smithi006.stdout:4/209: chown d1/db/d17/f3d 266548694 1 2024-03-12T16:10:38.433 INFO:tasks.workunit.client.1.smithi134.stdout:2/355: fdatasync d4/d3c/f53 0 2024-03-12T16:10:38.434 INFO:tasks.workunit.client.0.smithi006.stdout:2/260: symlink d0/d13/l59 0 2024-03-12T16:10:38.435 INFO:tasks.workunit.client.1.smithi134.stdout:4/327: write d1/de/f30 [320838,84799] 0 2024-03-12T16:10:38.436 INFO:tasks.workunit.client.1.smithi134.stdout:3/452: dread d1/db/d12/f26 [0,4194304] 0 2024-03-12T16:10:38.437 INFO:tasks.workunit.client.0.smithi006.stdout:9/100: fdatasync d0/fc 0 2024-03-12T16:10:38.437 INFO:tasks.workunit.client.0.smithi006.stdout:1/157: fdatasync d0/f12 0 2024-03-12T16:10:38.437 INFO:tasks.workunit.client.0.smithi006.stdout:6/153: truncate d3/f1d 2445249 0 2024-03-12T16:10:38.442 INFO:tasks.workunit.client.0.smithi006.stdout:1/158: readlink d0/l20 0 2024-03-12T16:10:38.444 INFO:tasks.workunit.client.1.smithi134.stdout:4/328: truncate d1/de/f6a 512590 0 2024-03-12T16:10:38.444 INFO:tasks.workunit.client.0.smithi006.stdout:3/180: dwrite d8/df/d2c/f13 [4194304,4194304] 0 2024-03-12T16:10:38.446 INFO:tasks.workunit.client.0.smithi006.stdout:6/154: read - d3/d11/d10/d1b/d20/d26/f2e zero size 2024-03-12T16:10:38.448 INFO:tasks.workunit.client.0.smithi006.stdout:9/101: creat d0/d8/f22 x:0 0 0 2024-03-12T16:10:38.449 INFO:tasks.workunit.client.1.smithi134.stdout:2/356: creat d4/d12/d1d/d51/f7f x:0 0 0 2024-03-12T16:10:38.451 INFO:tasks.workunit.client.1.smithi134.stdout:4/329: dread d1/d13/d49/d64/d35/f29 [0,4194304] 0 2024-03-12T16:10:38.451 INFO:tasks.workunit.client.0.smithi006.stdout:3/181: creat d8/df/d2c/dc/f3a x:0 0 0 2024-03-12T16:10:38.452 INFO:tasks.workunit.client.0.smithi006.stdout:1/159: dread d0/f1b [0,4194304] 0 2024-03-12T16:10:38.452 INFO:tasks.workunit.client.1.smithi134.stdout:7/323: stat d8/dc/le 0 2024-03-12T16:10:38.453 INFO:tasks.workunit.client.0.smithi006.stdout:9/102: mkdir d0/d8/d23 0 2024-03-12T16:10:38.454 INFO:tasks.workunit.client.1.smithi134.stdout:1/272: rmdir d0/d16/d3e 0 2024-03-12T16:10:38.455 INFO:tasks.workunit.client.0.smithi006.stdout:5/112: dread d7/d9/d10/f1b [0,4194304] 0 2024-03-12T16:10:38.455 INFO:tasks.workunit.client.1.smithi134.stdout:0/416: dwrite db/f38 [0,4194304] 0 2024-03-12T16:10:38.456 INFO:tasks.workunit.client.0.smithi006.stdout:6/155: creat d3/d11/d10/d1b/d20/f36 x:0 0 0 2024-03-12T16:10:38.456 INFO:tasks.workunit.client.1.smithi134.stdout:0/417: stat db/fc 0 2024-03-12T16:10:38.457 INFO:tasks.workunit.client.0.smithi006.stdout:8/138: sync 2024-03-12T16:10:38.457 INFO:tasks.workunit.client.0.smithi006.stdout:7/298: sync 2024-03-12T16:10:38.458 INFO:tasks.workunit.client.0.smithi006.stdout:6/156: stat d3/c8 0 2024-03-12T16:10:38.459 INFO:tasks.workunit.client.0.smithi006.stdout:5/113: chown d7/d9/d10/l25 253 1 2024-03-12T16:10:38.460 INFO:tasks.workunit.client.1.smithi134.stdout:3/453: creat d1/db/d12/d9d/d9f/fa9 x:0 0 0 2024-03-12T16:10:38.464 INFO:tasks.workunit.client.0.smithi006.stdout:1/160: read d0/f13 [1780709,68757] 0 2024-03-12T16:10:38.467 INFO:tasks.workunit.client.1.smithi134.stdout:2/357: dwrite d4/f77 [0,4194304] 0 2024-03-12T16:10:38.468 INFO:tasks.workunit.client.0.smithi006.stdout:4/210: write d1/db/d1d/f27 [4446525,77471] 0 2024-03-12T16:10:38.468 INFO:tasks.workunit.client.0.smithi006.stdout:5/114: creat d7/d9/d27/f2a x:0 0 0 2024-03-12T16:10:38.468 INFO:tasks.workunit.client.0.smithi006.stdout:7/299: mkdir de/d27/d2b/d4a/d6a 0 2024-03-12T16:10:38.471 INFO:tasks.workunit.client.1.smithi134.stdout:3/454: dread d1/db/d10/f28 [0,4194304] 0 2024-03-12T16:10:38.471 INFO:tasks.workunit.client.0.smithi006.stdout:6/157: symlink d3/d11/d10/d1b/d20/l37 0 2024-03-12T16:10:38.472 INFO:tasks.workunit.client.1.smithi134.stdout:2/358: read - d4/d12/d1d/d51/f7a zero size 2024-03-12T16:10:38.473 INFO:tasks.workunit.client.1.smithi134.stdout:1/273: getdents d0/d42 0 2024-03-12T16:10:38.475 INFO:tasks.workunit.client.1.smithi134.stdout:0/418: dwrite db/d2f/d31/f59 [0,4194304] 0 2024-03-12T16:10:38.475 INFO:tasks.workunit.client.1.smithi134.stdout:3/455: symlink d1/db/d14/laa 0 2024-03-12T16:10:38.479 INFO:tasks.workunit.client.0.smithi006.stdout:9/103: dwrite d0/d8/f13 [0,4194304] 0 2024-03-12T16:10:38.479 INFO:tasks.workunit.client.0.smithi006.stdout:4/211: chown d1/db/d17 205929 1 2024-03-12T16:10:38.480 INFO:tasks.workunit.client.0.smithi006.stdout:3/182: write d8/df/d2c/f10 [3275908,60125] 0 2024-03-12T16:10:38.480 INFO:tasks.workunit.client.0.smithi006.stdout:1/161: mkdir d0/d25/d2a/d35 0 2024-03-12T16:10:38.483 INFO:tasks.workunit.client.1.smithi134.stdout:2/359: mknod d4/d12/d1d/d34/d47/c80 0 2024-03-12T16:10:38.483 INFO:tasks.workunit.client.1.smithi134.stdout:7/324: dwrite d8/dc/d55/f63 [0,4194304] 0 2024-03-12T16:10:38.483 INFO:tasks.workunit.client.1.smithi134.stdout:1/274: mknod d0/d16/d9/d13/d38/c62 0 2024-03-12T16:10:38.484 INFO:tasks.workunit.client.1.smithi134.stdout:1/275: dread - d0/d16/d39/f46 zero size 2024-03-12T16:10:38.485 INFO:tasks.workunit.client.0.smithi006.stdout:6/158: mknod d3/d11/d10/d1b/d20/d26/c38 0 2024-03-12T16:10:38.486 INFO:tasks.workunit.client.0.smithi006.stdout:2/261: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:38.486 INFO:tasks.workunit.client.1.smithi134.stdout:3/456: creat d1/db/d14/d5f/fab x:0 0 0 2024-03-12T16:10:38.488 INFO:tasks.workunit.client.0.smithi006.stdout:7/300: rename de/d18/f34 to de/d1c/d35/f6b 0 2024-03-12T16:10:38.489 INFO:tasks.workunit.client.0.smithi006.stdout:3/183: mkdir d8/df/d3b 0 2024-03-12T16:10:38.490 INFO:tasks.workunit.client.0.smithi006.stdout:7/301: fdatasync de/d18/d2a/f44 0 2024-03-12T16:10:38.491 INFO:tasks.workunit.client.1.smithi134.stdout:2/360: creat d4/d12/d1d/d34/d47/d56/f81 x:0 0 0 2024-03-12T16:10:38.492 INFO:tasks.workunit.client.1.smithi134.stdout:0/419: dwrite db/d2f/f43 [0,4194304] 0 2024-03-12T16:10:38.492 INFO:tasks.workunit.client.0.smithi006.stdout:5/115: truncate d7/d9/d10/f1b 572407 0 2024-03-12T16:10:38.493 INFO:tasks.workunit.client.0.smithi006.stdout:4/212: mknod d1/db/d1d/d2f/c45 0 2024-03-12T16:10:38.495 INFO:tasks.workunit.client.0.smithi006.stdout:2/262: mknod d0/d13/d2d/d2b/c5a 0 2024-03-12T16:10:38.497 INFO:tasks.workunit.client.1.smithi134.stdout:1/276: dread d0/f12 [0,4194304] 0 2024-03-12T16:10:38.497 INFO:tasks.workunit.client.0.smithi006.stdout:6/159: creat d3/d11/d10/d19/f39 x:0 0 0 2024-03-12T16:10:38.498 INFO:tasks.workunit.client.1.smithi134.stdout:2/361: fdatasync d4/d12/d1d/d34/d58/f7c 0 2024-03-12T16:10:38.498 INFO:tasks.workunit.client.0.smithi006.stdout:7/302: creat de/d18/d2a/f6c x:0 0 0 2024-03-12T16:10:38.499 INFO:tasks.workunit.client.1.smithi134.stdout:3/457: rename d1/db/d10/l82 to d1/db/d14/lac 0 2024-03-12T16:10:38.500 INFO:tasks.workunit.client.1.smithi134.stdout:1/277: fdatasync d0/d16/d9/d13/d21/f33 0 2024-03-12T16:10:38.502 INFO:tasks.workunit.client.0.smithi006.stdout:4/213: rename d1/db/d17/c3f to d1/db/d1d/c46 0 2024-03-12T16:10:38.503 INFO:tasks.workunit.client.1.smithi134.stdout:2/362: chown d4/l2c 21 1 2024-03-12T16:10:38.503 INFO:tasks.workunit.client.0.smithi006.stdout:3/184: write d8/df/d2c/dc/f38 [4708699,102097] 0 2024-03-12T16:10:38.504 INFO:tasks.workunit.client.0.smithi006.stdout:4/214: dread - d1/db/f29 zero size 2024-03-12T16:10:38.505 INFO:tasks.workunit.client.0.smithi006.stdout:4/215: dread - d1/f31 zero size 2024-03-12T16:10:38.507 INFO:tasks.workunit.client.1.smithi134.stdout:3/458: getdents d1 0 2024-03-12T16:10:38.508 INFO:tasks.workunit.client.1.smithi134.stdout:7/325: dwrite d8/dc/d20/d26/f5e [0,4194304] 0 2024-03-12T16:10:38.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/420: dwrite db/f26 [0,4194304] 0 2024-03-12T16:10:38.510 INFO:tasks.workunit.client.0.smithi006.stdout:7/303: chown de/c2e 832549 1 2024-03-12T16:10:38.511 INFO:tasks.workunit.client.1.smithi134.stdout:1/278: write d0/d16/d9/d13/d21/f4d [3706328,26710] 0 2024-03-12T16:10:38.513 INFO:tasks.workunit.client.0.smithi006.stdout:1/162: getdents d0 0 2024-03-12T16:10:38.513 INFO:tasks.workunit.client.1.smithi134.stdout:1/279: chown d0/d16/d9/d13/d21/d20/c24 1 1 2024-03-12T16:10:38.513 INFO:tasks.workunit.client.1.smithi134.stdout:2/363: write d4/d12/d1d/d34/f54 [1836152,89071] 0 2024-03-12T16:10:38.513 INFO:tasks.workunit.client.0.smithi006.stdout:4/216: creat d1/db/d39/f47 x:0 0 0 2024-03-12T16:10:38.514 INFO:tasks.workunit.client.1.smithi134.stdout:0/421: chown db/d2f/f43 6 1 2024-03-12T16:10:38.516 INFO:tasks.workunit.client.0.smithi006.stdout:7/304: fdatasync f3 0 2024-03-12T16:10:38.517 INFO:tasks.workunit.client.0.smithi006.stdout:3/185: unlink d8/l9 0 2024-03-12T16:10:38.517 INFO:tasks.workunit.client.1.smithi134.stdout:3/459: chown d1/db/d12/l47 33047166 1 2024-03-12T16:10:38.517 INFO:tasks.workunit.client.1.smithi134.stdout:1/280: chown d0/d30 662776470 1 2024-03-12T16:10:38.519 INFO:tasks.workunit.client.0.smithi006.stdout:7/305: stat de/d27/d2b/d4a/l52 0 2024-03-12T16:10:38.520 INFO:tasks.workunit.client.0.smithi006.stdout:1/163: truncate d0/f30 662423 0 2024-03-12T16:10:38.521 INFO:tasks.workunit.client.1.smithi134.stdout:0/422: creat db/d2f/d31/d75/f8a x:0 0 0 2024-03-12T16:10:38.521 INFO:tasks.workunit.client.1.smithi134.stdout:1/281: write d0/d16/f7 [1441408,78891] 0 2024-03-12T16:10:38.523 INFO:tasks.workunit.client.0.smithi006.stdout:2/263: dread d0/d13/f2e [0,4194304] 0 2024-03-12T16:10:38.524 INFO:tasks.workunit.client.1.smithi134.stdout:1/282: read d0/d16/f29 [1594910,60848] 0 2024-03-12T16:10:38.525 INFO:tasks.workunit.client.0.smithi006.stdout:1/164: chown d0/d25/d2a 125894264 1 2024-03-12T16:10:38.526 INFO:tasks.workunit.client.0.smithi006.stdout:1/165: dread - d0/f1f zero size 2024-03-12T16:10:38.528 INFO:tasks.workunit.client.1.smithi134.stdout:7/326: dwrite d8/dc/d20/d26/f50 [0,4194304] 0 2024-03-12T16:10:38.529 INFO:tasks.workunit.client.0.smithi006.stdout:4/217: rename d1/db/d17/l14 to d1/db/d17/d43/l48 0 2024-03-12T16:10:38.530 INFO:tasks.workunit.client.1.smithi134.stdout:3/460: dwrite d1/db/d14/f59 [0,4194304] 0 2024-03-12T16:10:38.530 INFO:tasks.workunit.client.1.smithi134.stdout:1/283: rmdir d0/d16/d39 39 2024-03-12T16:10:38.532 INFO:tasks.workunit.client.1.smithi134.stdout:0/423: rename db/d2f/d31/f3f to db/d2f/d61/d67/f8b 0 2024-03-12T16:10:38.533 INFO:tasks.workunit.client.0.smithi006.stdout:8/139: dread d2/db/f13 [0,4194304] 0 2024-03-12T16:10:38.533 INFO:tasks.workunit.client.0.smithi006.stdout:7/306: dwrite de/d18/d2a/d39/f46 [0,4194304] 0 2024-03-12T16:10:38.534 INFO:tasks.workunit.client.1.smithi134.stdout:3/461: creat d1/fad x:0 0 0 2024-03-12T16:10:38.535 INFO:tasks.workunit.client.0.smithi006.stdout:3/186: rename d8/d19/d31/f37 to d8/df/d2c/dc/d28/d2f/f3c 0 2024-03-12T16:10:38.536 INFO:tasks.workunit.client.0.smithi006.stdout:7/307: chown de/d1c/f25 338838646 1 2024-03-12T16:10:38.536 INFO:tasks.workunit.client.1.smithi134.stdout:7/327: rename d8/dc/d20/d26/d36/l58 to d8/dc/d20/d26/l6d 0 2024-03-12T16:10:38.538 INFO:tasks.workunit.client.1.smithi134.stdout:1/284: symlink d0/l63 0 2024-03-12T16:10:38.540 INFO:tasks.workunit.client.1.smithi134.stdout:0/424: rename db/d2f/d31/l4c to db/d2f/d31/d75/d88/l8c 0 2024-03-12T16:10:38.542 INFO:tasks.workunit.client.1.smithi134.stdout:7/328: symlink d8/dc/l6e 0 2024-03-12T16:10:38.542 INFO:tasks.workunit.client.0.smithi006.stdout:8/140: chown d2/d11/f2d 8187161 1 2024-03-12T16:10:38.543 INFO:tasks.workunit.client.0.smithi006.stdout:3/187: symlink d8/d19/l3d 0 2024-03-12T16:10:38.543 INFO:tasks.workunit.client.0.smithi006.stdout:8/141: fdatasync d2/d11/f27 0 2024-03-12T16:10:38.544 INFO:tasks.workunit.client.1.smithi134.stdout:0/425: chown db/c53 0 1 2024-03-12T16:10:38.545 INFO:tasks.workunit.client.0.smithi006.stdout:2/264: creat d0/dc/f5b x:0 0 0 2024-03-12T16:10:38.546 INFO:tasks.workunit.client.0.smithi006.stdout:7/308: creat de/d27/d2b/d4a/d6a/f6d x:0 0 0 2024-03-12T16:10:38.548 INFO:tasks.workunit.client.0.smithi006.stdout:2/265: write d0/f42 [1017690,91148] 0 2024-03-12T16:10:38.548 INFO:tasks.workunit.client.1.smithi134.stdout:1/285: dwrite d0/d16/d9/d51/f55 [0,4194304] 0 2024-03-12T16:10:38.549 INFO:tasks.workunit.client.0.smithi006.stdout:4/218: getdents d1/d38 0 2024-03-12T16:10:38.550 INFO:tasks.workunit.client.1.smithi134.stdout:0/426: symlink db/d2f/d31/d56/d66/l8d 0 2024-03-12T16:10:38.551 INFO:tasks.workunit.client.0.smithi006.stdout:2/266: write d0/d13/d2d/f53 [968731,123820] 0 2024-03-12T16:10:38.551 INFO:tasks.workunit.client.0.smithi006.stdout:7/309: symlink de/d18/d2a/d39/l6e 0 2024-03-12T16:10:38.554 INFO:tasks.workunit.client.1.smithi134.stdout:0/427: write db/f26 [4588527,39177] 0 2024-03-12T16:10:38.554 INFO:tasks.workunit.client.0.smithi006.stdout:3/188: dread d8/f21 [0,4194304] 0 2024-03-12T16:10:38.555 INFO:tasks.workunit.client.0.smithi006.stdout:4/219: write d1/db/f3c [275821,10826] 0 2024-03-12T16:10:38.555 INFO:tasks.workunit.client.0.smithi006.stdout:7/310: write de/f1e [115943,3100] 0 2024-03-12T16:10:38.559 INFO:tasks.workunit.client.1.smithi134.stdout:1/286: rename d0/d16/d9/d13/d38/c62 to d0/c64 0 2024-03-12T16:10:38.561 INFO:tasks.workunit.client.1.smithi134.stdout:7/329: dread d8/dc/d20/f1d [0,4194304] 0 2024-03-12T16:10:38.562 INFO:tasks.workunit.client.0.smithi006.stdout:7/311: rename de/d1c/d35/f42 to de/d2c/f6f 0 2024-03-12T16:10:38.563 INFO:tasks.workunit.client.0.smithi006.stdout:2/267: link d0/c52 d0/d13/d49/c5c 0 2024-03-12T16:10:38.563 INFO:tasks.workunit.client.1.smithi134.stdout:7/330: write d8/dc/d20/d26/f3a [216523,51430] 0 2024-03-12T16:10:38.564 INFO:tasks.workunit.client.1.smithi134.stdout:0/428: rmdir db/d2f/d61 39 2024-03-12T16:10:38.565 INFO:tasks.workunit.client.0.smithi006.stdout:4/220: fsync d1/db/d1d/f20 0 2024-03-12T16:10:38.566 INFO:tasks.workunit.client.0.smithi006.stdout:5/116: fsync d7/d9/d10/f1b 0 2024-03-12T16:10:38.567 INFO:tasks.workunit.client.0.smithi006.stdout:4/221: write d1/db/d1d/f27 [4241181,75082] 0 2024-03-12T16:10:38.569 INFO:tasks.workunit.client.1.smithi134.stdout:1/287: rename d0/l63 to d0/d16/d9/d13/d21/d2f/l65 0 2024-03-12T16:10:38.570 INFO:tasks.workunit.client.0.smithi006.stdout:7/312: dread de/d1c/f26 [4194304,4194304] 0 2024-03-12T16:10:38.571 INFO:tasks.workunit.client.1.smithi134.stdout:7/331: chown d8/dc/f54 6816 1 2024-03-12T16:10:38.573 INFO:tasks.workunit.client.1.smithi134.stdout:0/429: dread db/d2f/d31/f5c [0,4194304] 0 2024-03-12T16:10:38.574 INFO:tasks.workunit.client.1.smithi134.stdout:0/430: fsync f7 0 2024-03-12T16:10:38.575 INFO:tasks.workunit.client.0.smithi006.stdout:6/160: write d3/fc [3166483,7399] 0 2024-03-12T16:10:38.576 INFO:tasks.workunit.client.0.smithi006.stdout:4/222: creat d1/db/d1d/f49 x:0 0 0 2024-03-12T16:10:38.579 INFO:tasks.workunit.client.1.smithi134.stdout:7/332: truncate d8/dc/d2f/d31/f53 13402 0 2024-03-12T16:10:38.579 INFO:tasks.workunit.client.0.smithi006.stdout:2/268: creat d0/f5d x:0 0 0 2024-03-12T16:10:38.581 INFO:tasks.workunit.client.0.smithi006.stdout:4/223: creat d1/d38/f4a x:0 0 0 2024-03-12T16:10:38.581 INFO:tasks.workunit.client.0.smithi006.stdout:4/224: stat d1/db/c3a 0 2024-03-12T16:10:38.583 INFO:tasks.workunit.client.0.smithi006.stdout:6/161: fsync d3/d11/d10/d1b/d20/d26/f2e 0 2024-03-12T16:10:38.583 INFO:tasks.workunit.client.1.smithi134.stdout:1/288: dwrite d0/fd [0,4194304] 0 2024-03-12T16:10:38.586 INFO:tasks.workunit.client.0.smithi006.stdout:2/269: fdatasync d0/d13/d2d/f14 0 2024-03-12T16:10:38.587 INFO:tasks.workunit.client.1.smithi134.stdout:2/364: dwrite d4/d12/f32 [0,4194304] 0 2024-03-12T16:10:38.588 INFO:tasks.workunit.client.1.smithi134.stdout:0/431: rename db/d2f/f77 to db/f8e 0 2024-03-12T16:10:38.591 INFO:tasks.workunit.client.0.smithi006.stdout:7/313: link de/d18/f19 de/d18/f70 0 2024-03-12T16:10:38.593 INFO:tasks.workunit.client.1.smithi134.stdout:8/370: sync 2024-03-12T16:10:38.593 INFO:tasks.workunit.client.1.smithi134.stdout:9/291: sync 2024-03-12T16:10:38.593 INFO:tasks.workunit.client.1.smithi134.stdout:1/289: creat d0/d42/d47/f66 x:0 0 0 2024-03-12T16:10:38.593 INFO:tasks.workunit.client.1.smithi134.stdout:5/487: sync 2024-03-12T16:10:38.594 INFO:tasks.workunit.client.0.smithi006.stdout:4/225: dwrite d1/db/f22 [0,4194304] 0 2024-03-12T16:10:38.597 INFO:tasks.workunit.client.0.smithi006.stdout:2/270: mknod d0/d13/d2d/d2b/c5e 0 2024-03-12T16:10:38.597 INFO:tasks.workunit.client.1.smithi134.stdout:2/365: creat d4/d12/d1d/d34/d58/f82 x:0 0 0 2024-03-12T16:10:38.602 INFO:tasks.workunit.client.0.smithi006.stdout:7/314: dread - de/d18/f19 zero size 2024-03-12T16:10:38.604 INFO:tasks.workunit.client.1.smithi134.stdout:3/462: dwrite d1/db/f4c [0,4194304] 0 2024-03-12T16:10:38.604 INFO:tasks.workunit.client.1.smithi134.stdout:5/488: symlink db/d7d/la0 0 2024-03-12T16:10:38.605 INFO:tasks.workunit.client.0.smithi006.stdout:7/315: write de/d18/f20 [5084481,89704] 0 2024-03-12T16:10:38.606 INFO:tasks.workunit.client.1.smithi134.stdout:8/371: dread - d3/d1b/d17/d25/d33/d15/d2b/d4f/f70 zero size 2024-03-12T16:10:38.606 INFO:tasks.workunit.client.1.smithi134.stdout:0/432: dread db/d2f/f30 [0,4194304] 0 2024-03-12T16:10:38.607 INFO:tasks.workunit.client.0.smithi006.stdout:4/226: rename d1/db/d17/c2c to d1/db/d1d/d2f/c4b 0 2024-03-12T16:10:38.609 INFO:tasks.workunit.client.0.smithi006.stdout:8/142: dwrite d2/f19 [0,4194304] 0 2024-03-12T16:10:38.611 INFO:tasks.workunit.client.0.smithi006.stdout:4/227: chown d1/db/f22 1537997 1 2024-03-12T16:10:38.611 INFO:tasks.workunit.client.1.smithi134.stdout:8/372: readlink d3/d1b/d17/d25/d33/d15/d2b/d4f/l44 0 2024-03-12T16:10:38.611 INFO:tasks.workunit.client.1.smithi134.stdout:3/463: write d1/db/d10/d2d/d2e/d72/d97/fa5 [103223,129665] 0 2024-03-12T16:10:38.616 INFO:tasks.workunit.client.1.smithi134.stdout:4/330: sync 2024-03-12T16:10:38.619 INFO:tasks.workunit.client.0.smithi006.stdout:4/228: write d1/db/d1d/f49 [535045,123288] 0 2024-03-12T16:10:38.619 INFO:tasks.workunit.client.0.smithi006.stdout:2/271: rename d0/l8 to d0/l5f 0 2024-03-12T16:10:38.620 INFO:tasks.workunit.client.1.smithi134.stdout:1/290: mknod d0/d16/d9/d13/d21/d5f/c67 0 2024-03-12T16:10:38.621 INFO:tasks.workunit.client.1.smithi134.stdout:2/366: mknod d4/d12/d1d/d51/d63/c83 0 2024-03-12T16:10:38.623 INFO:tasks.workunit.client.0.smithi006.stdout:4/229: dread - d1/db/d39/f47 zero size 2024-03-12T16:10:38.625 INFO:tasks.workunit.client.0.smithi006.stdout:8/143: symlink d2/d11/l2f 0 2024-03-12T16:10:38.627 INFO:tasks.workunit.client.1.smithi134.stdout:9/292: getdents d5/d20 0 2024-03-12T16:10:38.628 INFO:tasks.workunit.client.0.smithi006.stdout:3/189: dwrite d8/df/d2c/f20 [0,4194304] 0 2024-03-12T16:10:38.629 INFO:tasks.workunit.client.1.smithi134.stdout:6/401: sync 2024-03-12T16:10:38.630 INFO:tasks.workunit.client.0.smithi006.stdout:7/316: dwrite de/d18/d2a/d40/f60 [0,4194304] 0 2024-03-12T16:10:38.630 INFO:tasks.workunit.client.0.smithi006.stdout:5/117: dwrite d7/d9/d10/f1a [0,4194304] 0 2024-03-12T16:10:38.632 INFO:tasks.workunit.client.1.smithi134.stdout:2/367: chown d4/d16/c1e 1908852 1 2024-03-12T16:10:38.632 INFO:tasks.workunit.client.1.smithi134.stdout:6/402: read - d1/d3/d19/f51 zero size 2024-03-12T16:10:38.632 INFO:tasks.workunit.client.0.smithi006.stdout:0/265: sync 2024-03-12T16:10:38.637 INFO:tasks.workunit.client.1.smithi134.stdout:0/433: getdents db 0 2024-03-12T16:10:38.638 INFO:tasks.workunit.client.0.smithi006.stdout:8/144: symlink d2/d11/l30 0 2024-03-12T16:10:38.639 INFO:tasks.workunit.client.0.smithi006.stdout:2/272: dread d0/d13/d2d/f14 [0,4194304] 0 2024-03-12T16:10:38.639 INFO:tasks.workunit.client.0.smithi006.stdout:4/230: rename d1/d38/f4a to d1/db/d1d/d2f/f4c 0 2024-03-12T16:10:38.646 INFO:tasks.workunit.client.0.smithi006.stdout:7/317: rmdir de/d18/d2a/d40 39 2024-03-12T16:10:38.646 INFO:tasks.workunit.client.0.smithi006.stdout:0/266: dread - d2/d6/d10/d11/d32/f4a zero size 2024-03-12T16:10:38.648 INFO:tasks.workunit.client.0.smithi006.stdout:5/118: dwrite d7/f28 [0,4194304] 0 2024-03-12T16:10:38.648 INFO:tasks.workunit.client.1.smithi134.stdout:6/403: stat d1/d4d/c9c 0 2024-03-12T16:10:38.649 INFO:tasks.workunit.client.1.smithi134.stdout:7/333: dwrite d8/f1a [0,4194304] 0 2024-03-12T16:10:38.651 INFO:tasks.workunit.client.0.smithi006.stdout:5/119: readlink d7/d8/l1d 0 2024-03-12T16:10:38.652 INFO:tasks.workunit.client.0.smithi006.stdout:3/190: getdents d8/d19 0 2024-03-12T16:10:38.654 INFO:tasks.workunit.client.0.smithi006.stdout:7/318: mknod de/d27/d2b/c71 0 2024-03-12T16:10:38.654 INFO:tasks.workunit.client.1.smithi134.stdout:1/291: dwrite d0/d16/d9/d1c/f27 [0,4194304] 0 2024-03-12T16:10:38.657 INFO:tasks.workunit.client.0.smithi006.stdout:0/267: creat d2/f4b x:0 0 0 2024-03-12T16:10:38.658 INFO:tasks.workunit.client.0.smithi006.stdout:4/231: dwrite d1/db/f22 [0,4194304] 0 2024-03-12T16:10:38.660 INFO:tasks.workunit.client.1.smithi134.stdout:7/334: chown d8/dc/le 0 1 2024-03-12T16:10:38.661 INFO:tasks.workunit.client.0.smithi006.stdout:5/120: rename d7/d9/d27/f2a to d7/d8/f2b 0 2024-03-12T16:10:38.661 INFO:tasks.workunit.client.0.smithi006.stdout:7/319: mknod de/d2c/c72 0 2024-03-12T16:10:38.668 INFO:tasks.workunit.client.1.smithi134.stdout:4/331: dwrite d1/d24/f56 [0,4194304] 0 2024-03-12T16:10:38.671 INFO:tasks.workunit.client.1.smithi134.stdout:4/332: chown d1/f23 67063238 1 2024-03-12T16:10:38.671 INFO:tasks.workunit.client.0.smithi006.stdout:0/268: creat d2/d6/d10/f4c x:0 0 0 2024-03-12T16:10:38.674 INFO:tasks.workunit.client.1.smithi134.stdout:8/373: dwrite d3/d1b/d17/d25/d33/d15/d2b/f32 [0,4194304] 0 2024-03-12T16:10:38.675 INFO:tasks.workunit.client.0.smithi006.stdout:0/269: creat d2/d39/f4d x:0 0 0 2024-03-12T16:10:38.676 INFO:tasks.workunit.client.0.smithi006.stdout:0/270: chown d2/d6 23 1 2024-03-12T16:10:38.677 INFO:tasks.workunit.client.0.smithi006.stdout:7/320: dwrite de/d2c/f6f [0,4194304] 0 2024-03-12T16:10:38.677 INFO:tasks.workunit.client.1.smithi134.stdout:5/489: truncate db/d12/d1d/f35 3932714 0 2024-03-12T16:10:38.677 INFO:tasks.workunit.client.1.smithi134.stdout:4/333: truncate d1/d13/d49/f65 254546 0 2024-03-12T16:10:38.679 INFO:tasks.workunit.client.0.smithi006.stdout:4/232: dwrite d1/db/d17/f3d [4194304,4194304] 0 2024-03-12T16:10:38.681 INFO:tasks.workunit.client.0.smithi006.stdout:0/271: readlink d2/d6/d10/d11/d1d/l34 0 2024-03-12T16:10:38.683 INFO:tasks.workunit.client.1.smithi134.stdout:1/292: creat d0/d16/d9/d13/d21/d2f/f68 x:0 0 0 2024-03-12T16:10:38.683 INFO:tasks.workunit.client.1.smithi134.stdout:8/374: stat d3/d1b/d17/d24 0 2024-03-12T16:10:38.683 INFO:tasks.workunit.client.1.smithi134.stdout:9/293: dwrite d5/d10/d35/f3a [0,4194304] 0 2024-03-12T16:10:38.689 INFO:tasks.workunit.client.0.smithi006.stdout:0/272: write d2/d6/d10/f4c [765919,92909] 0 2024-03-12T16:10:38.689 INFO:tasks.workunit.client.0.smithi006.stdout:4/233: getdents d1/db 0 2024-03-12T16:10:38.693 INFO:tasks.workunit.client.1.smithi134.stdout:6/404: dwrite d1/d3/d19/d32/d4a/f7a [0,4194304] 0 2024-03-12T16:10:38.693 INFO:tasks.workunit.client.0.smithi006.stdout:8/145: dread d2/db/fe [0,4194304] 0 2024-03-12T16:10:38.695 INFO:tasks.workunit.client.1.smithi134.stdout:1/293: write d0/d16/f14 [1788197,12398] 0 2024-03-12T16:10:38.695 INFO:tasks.workunit.client.1.smithi134.stdout:7/335: unlink d8/dc/d2f/d31/f53 0 2024-03-12T16:10:38.697 INFO:tasks.workunit.client.0.smithi006.stdout:7/321: dwrite de/d18/d2a/d40/f60 [0,4194304] 0 2024-03-12T16:10:38.698 INFO:tasks.workunit.client.1.smithi134.stdout:3/464: truncate d1/db/d10/f1f 2470627 0 2024-03-12T16:10:38.699 INFO:tasks.workunit.client.1.smithi134.stdout:0/434: getdents db/d2f/d31/d56 0 2024-03-12T16:10:38.700 INFO:tasks.workunit.client.0.smithi006.stdout:2/273: truncate d0/f42 218173 0 2024-03-12T16:10:38.701 INFO:tasks.workunit.client.1.smithi134.stdout:6/405: write d1/d4/f80 [1796323,14250] 0 2024-03-12T16:10:38.701 INFO:tasks.workunit.client.0.smithi006.stdout:8/146: truncate d2/db/f2e 561178 0 2024-03-12T16:10:38.705 INFO:tasks.workunit.client.1.smithi134.stdout:5/490: unlink db/d12/d1d/d3a/d49/f57 0 2024-03-12T16:10:38.706 INFO:tasks.workunit.client.0.smithi006.stdout:0/273: rename d2/d6/d10/d11/d32/c3c to d2/d39/d42/c4e 0 2024-03-12T16:10:38.708 INFO:tasks.workunit.client.0.smithi006.stdout:7/322: unlink de/d18/d2a/f6c 0 2024-03-12T16:10:38.708 INFO:tasks.workunit.client.0.smithi006.stdout:6/162: dread d3/d11/d10/f32 [0,4194304] 0 2024-03-12T16:10:38.711 INFO:tasks.workunit.client.0.smithi006.stdout:2/274: write d0/d13/f44 [775117,24940] 0 2024-03-12T16:10:38.712 INFO:tasks.workunit.client.1.smithi134.stdout:7/336: dwrite d8/d27/f59 [0,4194304] 0 2024-03-12T16:10:38.716 INFO:tasks.workunit.client.0.smithi006.stdout:4/234: dwrite d1/db/d1d/f27 [0,4194304] 0 2024-03-12T16:10:38.717 INFO:tasks.workunit.client.1.smithi134.stdout:6/406: mkdir d1/d16/d4c/d65/d9d 0 2024-03-12T16:10:38.718 INFO:tasks.workunit.client.0.smithi006.stdout:3/191: dwrite d8/f17 [0,4194304] 0 2024-03-12T16:10:38.719 INFO:tasks.workunit.client.0.smithi006.stdout:8/147: creat d2/db/d1a/d1f/f31 x:0 0 0 2024-03-12T16:10:38.723 INFO:tasks.workunit.client.1.smithi134.stdout:8/375: creat d3/d1b/d17/d25/d33/f72 x:0 0 0 2024-03-12T16:10:38.723 INFO:tasks.workunit.client.1.smithi134.stdout:4/334: rename d1/d13/d49/d64/d35/d4a to d1/d13/d49/d6d 0 2024-03-12T16:10:38.728 INFO:tasks.workunit.client.1.smithi134.stdout:5/491: link db/d12/l17 db/d7a/la1 0 2024-03-12T16:10:38.729 INFO:tasks.workunit.client.1.smithi134.stdout:2/368: truncate d4/d12/d39/f57 735187 0 2024-03-12T16:10:38.731 INFO:tasks.workunit.client.1.smithi134.stdout:8/376: mknod d3/d1b/c73 0 2024-03-12T16:10:38.733 INFO:tasks.workunit.client.1.smithi134.stdout:5/492: creat db/d12/d1d/d3a/d4e/fa2 x:0 0 0 2024-03-12T16:10:38.737 INFO:tasks.workunit.client.1.smithi134.stdout:8/377: mknod d3/d1b/d17/d6c/c74 0 2024-03-12T16:10:38.738 INFO:tasks.workunit.client.1.smithi134.stdout:5/493: truncate db/d12/f40 2803716 0 2024-03-12T16:10:38.742 INFO:tasks.workunit.client.1.smithi134.stdout:9/294: dread d5/d10/f32 [0,4194304] 0 2024-03-12T16:10:38.743 INFO:tasks.workunit.client.1.smithi134.stdout:9/295: write d5/fa [2381297,5107] 0 2024-03-12T16:10:38.744 INFO:tasks.workunit.client.1.smithi134.stdout:9/296: fsync d5/d20/f27 0 2024-03-12T16:10:38.744 INFO:tasks.workunit.client.1.smithi134.stdout:5/494: rename db/d12/d37/f4b to db/fa3 0 2024-03-12T16:10:38.745 INFO:tasks.workunit.client.1.smithi134.stdout:8/378: creat d3/d1b/d17/d25/d49/f75 x:0 0 0 2024-03-12T16:10:38.747 INFO:tasks.workunit.client.1.smithi134.stdout:8/379: chown d3/d1b/d17/d25/d33/d15/d2b/d4f/d65/l5a 225579103 1 2024-03-12T16:10:38.748 INFO:tasks.workunit.client.1.smithi134.stdout:8/380: readlink d3/d1b/d17/d25/d33/l4a 0 2024-03-12T16:10:38.749 INFO:tasks.workunit.client.1.smithi134.stdout:0/435: dread db/f1f [0,4194304] 0 2024-03-12T16:10:38.751 INFO:tasks.workunit.client.1.smithi134.stdout:3/465: truncate d1/d63/f8c 296651 0 2024-03-12T16:10:38.752 INFO:tasks.workunit.client.1.smithi134.stdout:9/297: symlink d5/d10/d35/d49/l4c 0 2024-03-12T16:10:38.753 INFO:tasks.workunit.client.1.smithi134.stdout:8/381: write d3/d10/f62 [5229531,33900] 0 2024-03-12T16:10:38.755 INFO:tasks.workunit.client.1.smithi134.stdout:5/495: unlink db/d7a/la1 0 2024-03-12T16:10:38.758 INFO:tasks.workunit.client.1.smithi134.stdout:4/335: truncate d1/d13/d49/f65 28622 0 2024-03-12T16:10:38.761 INFO:tasks.workunit.client.1.smithi134.stdout:4/336: chown d1/d24/d34/f69 97554131 1 2024-03-12T16:10:38.764 INFO:tasks.workunit.client.1.smithi134.stdout:0/436: mknod db/d2f/d61/d7a/c8f 0 2024-03-12T16:10:38.767 INFO:tasks.workunit.client.1.smithi134.stdout:5/496: dwrite db/d12/d29/d3d/f47 [0,4194304] 0 2024-03-12T16:10:38.768 INFO:tasks.workunit.client.1.smithi134.stdout:0/437: chown db/d2f/l6f 96093431 1 2024-03-12T16:10:38.773 INFO:tasks.workunit.client.1.smithi134.stdout:5/497: mknod db/d12/d37/d71/ca4 0 2024-03-12T16:10:38.775 INFO:tasks.workunit.client.0.smithi006.stdout:7/323: write de/d27/d2b/f37 [785804,76948] 0 2024-03-12T16:10:38.776 INFO:tasks.workunit.client.0.smithi006.stdout:2/275: rename d0/d13/d2d to d0/d13/d49/d60 0 2024-03-12T16:10:38.776 INFO:tasks.workunit.client.0.smithi006.stdout:5/121: rmdir d7 39 2024-03-12T16:10:38.777 INFO:tasks.workunit.client.0.smithi006.stdout:0/274: symlink d2/d6/d10/l4f 0 2024-03-12T16:10:38.777 INFO:tasks.workunit.client.1.smithi134.stdout:3/466: getdents d1/db/d12 0 2024-03-12T16:10:38.777 INFO:tasks.workunit.client.0.smithi006.stdout:4/235: rmdir d1/db/d1d/d2f 39 2024-03-12T16:10:38.778 INFO:tasks.workunit.client.1.smithi134.stdout:8/382: dread d3/f8 [0,4194304] 0 2024-03-12T16:10:38.779 INFO:tasks.workunit.client.0.smithi006.stdout:8/148: chown d2/db/d1a/d23/l2a 3599 1 2024-03-12T16:10:38.779 INFO:tasks.workunit.client.1.smithi134.stdout:2/369: write d4/d12/d39/f57 [94498,78736] 0 2024-03-12T16:10:38.780 INFO:tasks.workunit.client.1.smithi134.stdout:4/337: symlink d1/d13/d49/d64/d28/d4f/d67/l6e 0 2024-03-12T16:10:38.782 INFO:tasks.workunit.client.0.smithi006.stdout:0/275: fdatasync d2/f4 0 2024-03-12T16:10:38.782 INFO:tasks.workunit.client.0.smithi006.stdout:5/122: fsync d7/d9/fc 0 2024-03-12T16:10:38.783 INFO:tasks.workunit.client.1.smithi134.stdout:0/438: mknod db/d2f/d61/d6c/c90 0 2024-03-12T16:10:38.785 INFO:tasks.workunit.client.1.smithi134.stdout:0/439: write db/f11 [5233195,67490] 0 2024-03-12T16:10:38.785 INFO:tasks.workunit.client.0.smithi006.stdout:3/192: mknod d8/d19/d26/c3e 0 2024-03-12T16:10:38.785 INFO:tasks.workunit.client.0.smithi006.stdout:8/149: chown d2/db/d1a/d23/l2a 2 1 2024-03-12T16:10:38.786 INFO:tasks.workunit.client.1.smithi134.stdout:3/467: mknod d1/db/d14/cae 0 2024-03-12T16:10:38.786 INFO:tasks.workunit.client.0.smithi006.stdout:3/193: readlink l4 0 2024-03-12T16:10:38.787 INFO:tasks.workunit.client.1.smithi134.stdout:5/498: mkdir db/d12/d29/d3d/d79/da5 0 2024-03-12T16:10:38.788 INFO:tasks.workunit.client.0.smithi006.stdout:4/236: rename d1/c3 to d1/db/c4d 0 2024-03-12T16:10:38.788 INFO:tasks.workunit.client.0.smithi006.stdout:0/276: rename d2/d6 to d2/d6/d10/d11/d32/d50 22 2024-03-12T16:10:38.789 INFO:tasks.workunit.client.0.smithi006.stdout:5/123: mkdir d7/d9/d2c 0 2024-03-12T16:10:38.791 INFO:tasks.workunit.client.1.smithi134.stdout:4/338: symlink d1/d13/d49/d64/d28/l6f 0 2024-03-12T16:10:38.792 INFO:tasks.workunit.client.1.smithi134.stdout:8/383: dread - d3/d1b/d17/d25/d33/d15/d2b/d4f/f67 zero size 2024-03-12T16:10:38.793 INFO:tasks.workunit.client.0.smithi006.stdout:5/124: fdatasync d7/d9/d10/f26 0 2024-03-12T16:10:38.793 INFO:tasks.workunit.client.0.smithi006.stdout:7/324: getdents de/d2c/d4f 0 2024-03-12T16:10:38.793 INFO:tasks.workunit.client.0.smithi006.stdout:8/150: mkdir d2/d32 0 2024-03-12T16:10:38.793 INFO:tasks.workunit.client.1.smithi134.stdout:0/440: symlink db/d2f/d61/d6c/l91 0 2024-03-12T16:10:38.794 INFO:tasks.workunit.client.1.smithi134.stdout:5/499: truncate db/d12/d29/d3d/f9d 446177 0 2024-03-12T16:10:38.795 INFO:tasks.workunit.client.1.smithi134.stdout:3/468: rmdir d1/db/d12/d9d/d9f 39 2024-03-12T16:10:38.795 INFO:tasks.workunit.client.0.smithi006.stdout:5/125: write d7/d8/f2b [813982,81291] 0 2024-03-12T16:10:38.796 INFO:tasks.workunit.client.1.smithi134.stdout:9/298: write d5/f7 [1276902,40518] 0 2024-03-12T16:10:38.796 INFO:tasks.workunit.client.0.smithi006.stdout:4/237: dread d1/db/d17/f32 [0,4194304] 0 2024-03-12T16:10:38.799 INFO:tasks.workunit.client.1.smithi134.stdout:5/500: dread db/d12/d1d/d5c/f65 [0,4194304] 0 2024-03-12T16:10:38.799 INFO:tasks.workunit.client.1.smithi134.stdout:0/441: symlink db/d2f/d51/l92 0 2024-03-12T16:10:38.800 INFO:tasks.workunit.client.0.smithi006.stdout:7/325: creat de/d2c/f73 x:0 0 0 2024-03-12T16:10:38.800 INFO:tasks.workunit.client.0.smithi006.stdout:4/238: stat d1/db/d17/f3d 0 2024-03-12T16:10:38.800 INFO:tasks.workunit.client.0.smithi006.stdout:3/194: link d8/df/f1a d8/df/f3f 0 2024-03-12T16:10:38.800 INFO:tasks.workunit.client.0.smithi006.stdout:0/277: dread d2/d6/f7 [4194304,4194304] 0 2024-03-12T16:10:38.802 INFO:tasks.workunit.client.0.smithi006.stdout:5/126: dread d7/d8/f14 [0,4194304] 0 2024-03-12T16:10:38.807 INFO:tasks.workunit.client.0.smithi006.stdout:3/195: read d8/df/d2c/f13 [5856738,70299] 0 2024-03-12T16:10:38.807 INFO:tasks.workunit.client.0.smithi006.stdout:4/239: dread - d1/db/d1d/d2f/f36 zero size 2024-03-12T16:10:38.807 INFO:tasks.workunit.client.0.smithi006.stdout:2/276: write d0/d13/d49/d60/f32 [647101,96335] 0 2024-03-12T16:10:38.807 INFO:tasks.workunit.client.1.smithi134.stdout:2/370: rename d4/d12/d1d/d51 to d4/d84 0 2024-03-12T16:10:38.807 INFO:tasks.workunit.client.1.smithi134.stdout:9/299: mknod d5/d10/d1f/c4d 0 2024-03-12T16:10:38.807 INFO:tasks.workunit.client.1.smithi134.stdout:9/300: truncate d5/d20/f23 5554665 0 2024-03-12T16:10:38.808 INFO:tasks.workunit.client.1.smithi134.stdout:3/469: mkdir d1/db/d10/daf 0 2024-03-12T16:10:38.808 INFO:tasks.workunit.client.1.smithi134.stdout:9/301: write d5/d20/f27 [592603,27477] 0 2024-03-12T16:10:38.810 INFO:tasks.workunit.client.1.smithi134.stdout:0/442: write db/fc [1750623,112837] 0 2024-03-12T16:10:38.812 INFO:tasks.workunit.client.1.smithi134.stdout:0/443: fdatasync db/f87 0 2024-03-12T16:10:38.813 INFO:tasks.workunit.client.1.smithi134.stdout:5/501: dread db/fa3 [0,4194304] 0 2024-03-12T16:10:38.815 INFO:tasks.workunit.client.0.smithi006.stdout:0/278: link d2/f1f d2/d39/d42/f51 0 2024-03-12T16:10:38.816 INFO:tasks.workunit.client.1.smithi134.stdout:3/470: unlink d1/db/d12/l84 0 2024-03-12T16:10:38.817 INFO:tasks.workunit.client.0.smithi006.stdout:3/196: dwrite d8/df/f1e [0,4194304] 0 2024-03-12T16:10:38.817 INFO:tasks.workunit.client.0.smithi006.stdout:4/240: dwrite d1/db/d17/f25 [0,4194304] 0 2024-03-12T16:10:38.818 INFO:tasks.workunit.client.1.smithi134.stdout:0/444: creat db/d2f/d31/d76/f93 x:0 0 0 2024-03-12T16:10:38.819 INFO:tasks.workunit.client.0.smithi006.stdout:7/326: write de/d18/f19 [421143,100857] 0 2024-03-12T16:10:38.820 INFO:tasks.workunit.client.0.smithi006.stdout:0/279: read - d2/d6/d10/d11/f35 zero size 2024-03-12T16:10:38.820 INFO:tasks.workunit.client.0.smithi006.stdout:8/151: creat d2/db/d1a/d21/f33 x:0 0 0 2024-03-12T16:10:38.822 INFO:tasks.workunit.client.1.smithi134.stdout:9/302: symlink d5/d10/l4e 0 2024-03-12T16:10:38.822 INFO:tasks.workunit.client.0.smithi006.stdout:2/277: getdents d0/d13 0 2024-03-12T16:10:38.823 INFO:tasks.workunit.client.1.smithi134.stdout:9/303: truncate d5/d20/f21 2452256 0 2024-03-12T16:10:38.827 INFO:tasks.workunit.client.1.smithi134.stdout:2/371: dread d4/d12/d43/f76 [0,4194304] 0 2024-03-12T16:10:38.827 INFO:tasks.workunit.client.1.smithi134.stdout:5/502: unlink db/d12/d37/d73/l9b 0 2024-03-12T16:10:38.827 INFO:tasks.workunit.client.0.smithi006.stdout:3/197: creat d8/df/d2c/dc/d28/f40 x:0 0 0 2024-03-12T16:10:38.829 INFO:tasks.workunit.client.1.smithi134.stdout:8/384: truncate d3/d1b/d17/d25/d33/d15/d2b/f37 3738723 0 2024-03-12T16:10:38.831 INFO:tasks.workunit.client.1.smithi134.stdout:2/372: fsync d4/d16/f4b 0 2024-03-12T16:10:38.831 INFO:tasks.workunit.client.0.smithi006.stdout:8/152: fdatasync d2/d11/f2d 0 2024-03-12T16:10:38.833 INFO:tasks.workunit.client.0.smithi006.stdout:0/280: rmdir d2/d39/d42 39 2024-03-12T16:10:38.834 INFO:tasks.workunit.client.1.smithi134.stdout:3/471: creat d1/fb0 x:0 0 0 2024-03-12T16:10:38.835 INFO:tasks.workunit.client.0.smithi006.stdout:7/327: rename de/d1c/d35/l4c to de/d1c/d35/l74 0 2024-03-12T16:10:38.836 INFO:tasks.workunit.client.1.smithi134.stdout:2/373: creat d4/d12/f85 x:0 0 0 2024-03-12T16:10:38.838 INFO:tasks.workunit.client.0.smithi006.stdout:4/241: dread d1/db/d17/f1c [0,4194304] 0 2024-03-12T16:10:38.838 INFO:tasks.workunit.client.0.smithi006.stdout:3/198: mkdir d8/df/d2c/d41 0 2024-03-12T16:10:38.839 INFO:tasks.workunit.client.1.smithi134.stdout:5/503: dwrite db/d12/d7b/f93 [0,4194304] 0 2024-03-12T16:10:38.839 INFO:tasks.workunit.client.0.smithi006.stdout:0/281: dread d2/d6/d10/d11/f2f [0,4194304] 0 2024-03-12T16:10:38.839 INFO:tasks.workunit.client.0.smithi006.stdout:8/153: symlink d2/db/l34 0 2024-03-12T16:10:38.840 INFO:tasks.workunit.client.0.smithi006.stdout:7/328: dread - de/d27/d2b/d4a/d6a/f6d zero size 2024-03-12T16:10:38.840 INFO:tasks.workunit.client.1.smithi134.stdout:5/504: dread - db/d12/d1d/d3a/d4e/f82 zero size 2024-03-12T16:10:38.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/472: chown d1/db/d14/f42 28454 1 2024-03-12T16:10:38.841 INFO:tasks.workunit.client.1.smithi134.stdout:2/374: mknod d4/d12/d1d/d34/d58/c86 0 2024-03-12T16:10:38.842 INFO:tasks.workunit.client.0.smithi006.stdout:3/199: dread - d8/df/d2c/dc/d28/f40 zero size 2024-03-12T16:10:38.842 INFO:tasks.workunit.client.0.smithi006.stdout:8/154: dread - d2/db/f18 zero size 2024-03-12T16:10:38.843 INFO:tasks.workunit.client.0.smithi006.stdout:7/329: creat de/d1c/f75 x:0 0 0 2024-03-12T16:10:38.845 INFO:tasks.workunit.client.0.smithi006.stdout:4/242: mknod d1/db/d1d/c4e 0 2024-03-12T16:10:38.845 INFO:tasks.workunit.client.0.smithi006.stdout:4/243: dread - d1/f31 zero size 2024-03-12T16:10:38.846 INFO:tasks.workunit.client.0.smithi006.stdout:0/282: symlink d2/d6/d10/d11/d1d/l52 0 2024-03-12T16:10:38.847 INFO:tasks.workunit.client.0.smithi006.stdout:3/200: write d8/df/d2c/dc/d28/d2f/f3c [643991,113101] 0 2024-03-12T16:10:38.848 INFO:tasks.workunit.client.0.smithi006.stdout:0/283: fsync d2/d6/d10/d11/d32/f3a 0 2024-03-12T16:10:38.848 INFO:tasks.workunit.client.0.smithi006.stdout:4/244: creat d1/d38/f4f x:0 0 0 2024-03-12T16:10:38.849 INFO:tasks.workunit.client.0.smithi006.stdout:4/245: dread - d1/d38/f4f zero size 2024-03-12T16:10:38.849 INFO:tasks.workunit.client.1.smithi134.stdout:2/375: dread d4/f77 [0,4194304] 0 2024-03-12T16:10:38.850 INFO:tasks.workunit.client.0.smithi006.stdout:7/330: creat de/d18/d2a/f76 x:0 0 0 2024-03-12T16:10:38.851 INFO:tasks.workunit.client.1.smithi134.stdout:0/445: truncate db/fc 996747 0 2024-03-12T16:10:38.851 INFO:tasks.workunit.client.1.smithi134.stdout:3/473: dwrite d1/db/d14/d5f/fab [0,4194304] 0 2024-03-12T16:10:38.851 INFO:tasks.workunit.client.0.smithi006.stdout:4/246: chown d1/db/c37 224679 1 2024-03-12T16:10:38.852 INFO:tasks.workunit.client.1.smithi134.stdout:2/376: chown d4/d12/d39/f57 1 1 2024-03-12T16:10:38.852 INFO:tasks.workunit.client.0.smithi006.stdout:3/201: creat d8/df/f42 x:0 0 0 2024-03-12T16:10:38.853 INFO:tasks.workunit.client.1.smithi134.stdout:9/304: truncate d5/f7 670955 0 2024-03-12T16:10:38.854 INFO:tasks.workunit.client.0.smithi006.stdout:0/284: unlink d2/f22 0 2024-03-12T16:10:38.856 INFO:tasks.workunit.client.0.smithi006.stdout:4/247: symlink d1/db/d17/l50 0 2024-03-12T16:10:38.857 INFO:tasks.workunit.client.1.smithi134.stdout:8/385: truncate d3/d1b/f14 647740 0 2024-03-12T16:10:38.857 INFO:tasks.workunit.client.1.smithi134.stdout:0/446: mkdir db/d2f/d61/d94 0 2024-03-12T16:10:38.860 INFO:tasks.workunit.client.1.smithi134.stdout:0/447: write db/d2f/d31/d76/f78 [945277,48289] 0 2024-03-12T16:10:38.861 INFO:tasks.workunit.client.1.smithi134.stdout:8/386: mknod d3/d10/c76 0 2024-03-12T16:10:38.863 INFO:tasks.workunit.client.1.smithi134.stdout:8/387: chown d3/d1b/d17/d25/d33/d15 3 1 2024-03-12T16:10:38.864 INFO:tasks.workunit.client.1.smithi134.stdout:3/474: unlink d1/db/d10/d2d/d2e/d72/d97/fa3 0 2024-03-12T16:10:38.865 INFO:tasks.workunit.client.0.smithi006.stdout:2/278: dwrite d0/f1f [0,4194304] 0 2024-03-12T16:10:38.865 INFO:tasks.workunit.client.1.smithi134.stdout:9/305: symlink d5/d10/d33/l4f 0 2024-03-12T16:10:38.866 INFO:tasks.workunit.client.1.smithi134.stdout:2/377: getdents d4/d3c 0 2024-03-12T16:10:38.866 INFO:tasks.workunit.client.0.smithi006.stdout:7/331: getdents de/d27 0 2024-03-12T16:10:38.868 INFO:tasks.workunit.client.1.smithi134.stdout:2/378: fsync d4/d12/d3b/d3f/f5d 0 2024-03-12T16:10:38.869 INFO:tasks.workunit.client.1.smithi134.stdout:3/475: fdatasync d1/db/f4d 0 2024-03-12T16:10:38.869 INFO:tasks.workunit.client.1.smithi134.stdout:0/448: dwrite db/f11 [0,4194304] 0 2024-03-12T16:10:38.870 INFO:tasks.workunit.client.0.smithi006.stdout:7/332: readlink l9 0 2024-03-12T16:10:38.871 INFO:tasks.workunit.client.0.smithi006.stdout:4/248: dwrite d1/db/d17/f1a [0,4194304] 0 2024-03-12T16:10:38.874 INFO:tasks.workunit.client.0.smithi006.stdout:2/279: fdatasync d0/dc/fd 0 2024-03-12T16:10:38.874 INFO:tasks.workunit.client.1.smithi134.stdout:2/379: dread - d4/d12/d1d/d34/d58/f82 zero size 2024-03-12T16:10:38.876 INFO:tasks.workunit.client.1.smithi134.stdout:0/449: rmdir db/d2f/d61/d7a 39 2024-03-12T16:10:38.877 INFO:tasks.workunit.client.0.smithi006.stdout:2/280: read d0/d13/f2e [3146387,71230] 0 2024-03-12T16:10:38.878 INFO:tasks.workunit.client.0.smithi006.stdout:2/281: dread - d0/f5d zero size 2024-03-12T16:10:38.879 INFO:tasks.workunit.client.1.smithi134.stdout:3/476: rename d1/db/d10/d2d/fa4 to d1/db/d12/fb1 0 2024-03-12T16:10:38.879 INFO:tasks.workunit.client.0.smithi006.stdout:4/249: getdents d1/db 0 2024-03-12T16:10:38.880 INFO:tasks.workunit.client.1.smithi134.stdout:2/380: mkdir d4/d84/d7d/d87 0 2024-03-12T16:10:38.882 INFO:tasks.workunit.client.0.smithi006.stdout:2/282: truncate d0/f5d 296709 0 2024-03-12T16:10:38.882 INFO:tasks.workunit.client.0.smithi006.stdout:0/285: dwrite d2/d6/d10/f1a [0,4194304] 0 2024-03-12T16:10:38.885 INFO:tasks.workunit.client.0.smithi006.stdout:2/283: write d0/d13/d49/d60/f53 [1138564,48736] 0 2024-03-12T16:10:38.887 INFO:tasks.workunit.client.1.smithi134.stdout:2/381: rename d4/d12/d1d/d34/d58 to d4/d12/d1d/d34/d58/d74/d88 22 2024-03-12T16:10:38.888 INFO:tasks.workunit.client.0.smithi006.stdout:4/250: rename d1/db/d1d/f27 to d1/db/d39/d42/f51 0 2024-03-12T16:10:38.888 INFO:tasks.workunit.client.1.smithi134.stdout:0/450: symlink db/d2f/l95 0 2024-03-12T16:10:38.888 INFO:tasks.workunit.client.0.smithi006.stdout:4/251: chown d1/l4 36 1 2024-03-12T16:10:38.889 INFO:tasks.workunit.client.0.smithi006.stdout:0/286: creat d2/f53 x:0 0 0 2024-03-12T16:10:38.889 INFO:tasks.workunit.client.0.smithi006.stdout:4/252: dread - d1/f31 zero size 2024-03-12T16:10:38.890 INFO:tasks.workunit.client.1.smithi134.stdout:9/306: rmdir d5 39 2024-03-12T16:10:38.890 INFO:tasks.workunit.client.0.smithi006.stdout:4/253: fsync d1/db/d1d/f49 0 2024-03-12T16:10:38.891 INFO:tasks.workunit.client.1.smithi134.stdout:0/451: chown db/d2f/d31/l41 281 1 2024-03-12T16:10:38.892 INFO:tasks.workunit.client.0.smithi006.stdout:0/287: fdatasync d2/d6/f7 0 2024-03-12T16:10:38.894 INFO:tasks.workunit.client.0.smithi006.stdout:4/254: unlink d1/db/d1d/d2f/c45 0 2024-03-12T16:10:38.895 INFO:tasks.workunit.client.1.smithi134.stdout:2/382: read d4/d12/d3b/d3f/f5d [1270131,60753] 0 2024-03-12T16:10:38.898 INFO:tasks.workunit.client.0.smithi006.stdout:2/284: rename d0/d13/d49/d60/l3e to d0/dc/l61 0 2024-03-12T16:10:38.899 INFO:tasks.workunit.client.0.smithi006.stdout:4/255: mknod d1/db/d1d/d2f/c52 0 2024-03-12T16:10:38.900 INFO:tasks.workunit.client.0.smithi006.stdout:2/285: write d0/f1f [1324277,42416] 0 2024-03-12T16:10:38.901 INFO:tasks.workunit.client.1.smithi134.stdout:2/383: readlink d4/d12/d43/l5c 0 2024-03-12T16:10:38.901 INFO:tasks.workunit.client.1.smithi134.stdout:8/388: dwrite d3/d1b/d17/d25/d33/d15/d2b/d4f/f67 [0,4194304] 0 2024-03-12T16:10:38.902 INFO:tasks.workunit.client.0.smithi006.stdout:4/256: chown d1/db/d17/c44 26651 1 2024-03-12T16:10:38.903 INFO:tasks.workunit.client.0.smithi006.stdout:2/286: mkdir d0/d13/d49/d60/d2b/d62 0 2024-03-12T16:10:38.904 INFO:tasks.workunit.client.0.smithi006.stdout:2/287: readlink d0/d13/l59 0 2024-03-12T16:10:38.904 INFO:tasks.workunit.client.1.smithi134.stdout:8/389: write d3/d1b/f2a [3155956,109945] 0 2024-03-12T16:10:38.905 INFO:tasks.workunit.client.1.smithi134.stdout:3/477: rename d1/db/d12/f26 to d1/db/d10/d2d/d2e/fb2 0 2024-03-12T16:10:38.908 INFO:tasks.workunit.client.0.smithi006.stdout:0/288: write f0 [666972,120870] 0 2024-03-12T16:10:38.909 INFO:tasks.workunit.client.1.smithi134.stdout:9/307: link d5/d20/f23 d5/d10/d1f/f50 0 2024-03-12T16:10:38.911 INFO:tasks.workunit.client.0.smithi006.stdout:4/257: dwrite d1/db/d39/f47 [0,4194304] 0 2024-03-12T16:10:38.912 INFO:tasks.workunit.client.1.smithi134.stdout:2/384: rename d4/d5b to d4/d12/d1d/d89 0 2024-03-12T16:10:38.912 INFO:tasks.workunit.client.0.smithi006.stdout:0/289: creat d2/d6/d10/f54 x:0 0 0 2024-03-12T16:10:38.914 INFO:tasks.workunit.client.1.smithi134.stdout:3/478: creat d1/db/d12/d9d/fb3 x:0 0 0 2024-03-12T16:10:38.915 INFO:tasks.workunit.client.1.smithi134.stdout:8/390: dread d3/d1b/d17/d25/d33/d15/d2b/d4f/d65/f48 [4194304,4194304] 0 2024-03-12T16:10:38.915 INFO:tasks.workunit.client.1.smithi134.stdout:0/452: dread db/d2f/d71/f89 [0,4194304] 0 2024-03-12T16:10:38.916 INFO:tasks.workunit.client.1.smithi134.stdout:2/385: write d4/d12/d1d/d34/d47/f7e [994894,44203] 0 2024-03-12T16:10:38.916 INFO:tasks.workunit.client.1.smithi134.stdout:9/308: mkdir d5/d10/d51 0 2024-03-12T16:10:38.919 INFO:tasks.workunit.client.1.smithi134.stdout:0/453: write db/f11 [3611247,64248] 0 2024-03-12T16:10:38.920 INFO:tasks.workunit.client.0.smithi006.stdout:0/290: link d2/d39/c48 d2/d6/d10/d11/d1d/c55 0 2024-03-12T16:10:38.920 INFO:tasks.workunit.client.1.smithi134.stdout:2/386: stat d4/d12/d1d/d34/d58/d74 0 2024-03-12T16:10:38.920 INFO:tasks.workunit.client.0.smithi006.stdout:4/258: getdents d1/db/d1d/d2f 0 2024-03-12T16:10:38.922 INFO:tasks.workunit.client.0.smithi006.stdout:0/291: rmdir d2/d6/d10/d11/d1d 39 2024-03-12T16:10:38.922 INFO:tasks.workunit.client.0.smithi006.stdout:0/292: read - d2/f53 zero size 2024-03-12T16:10:38.923 INFO:tasks.workunit.client.0.smithi006.stdout:0/293: readlink d2/l44 0 2024-03-12T16:10:38.924 INFO:tasks.workunit.client.0.smithi006.stdout:0/294: chown d2/d6/d10/f4c 84190 1 2024-03-12T16:10:38.925 INFO:tasks.workunit.client.0.smithi006.stdout:4/259: dread d1/db/d39/f3b [0,4194304] 0 2024-03-12T16:10:38.926 INFO:tasks.workunit.client.1.smithi134.stdout:3/479: link d1/f4 d1/db/d10/d2a/fb4 0 2024-03-12T16:10:38.927 INFO:tasks.workunit.client.0.smithi006.stdout:0/295: read d2/fd [1069068,122349] 0 2024-03-12T16:10:38.927 INFO:tasks.workunit.client.0.smithi006.stdout:4/260: truncate d1/db/d1d/d2f/f36 387719 0 2024-03-12T16:10:38.930 INFO:tasks.workunit.client.0.smithi006.stdout:0/296: unlink d2/d6/d10/d11/f2f 0 2024-03-12T16:10:38.930 INFO:tasks.workunit.client.0.smithi006.stdout:4/261: creat d1/db/d17/f53 x:0 0 0 2024-03-12T16:10:38.931 INFO:tasks.workunit.client.1.smithi134.stdout:2/387: creat d4/d12/d1d/f8a x:0 0 0 2024-03-12T16:10:38.932 INFO:tasks.workunit.client.0.smithi006.stdout:4/262: mkdir d1/db/d54 0 2024-03-12T16:10:38.932 INFO:tasks.workunit.client.1.smithi134.stdout:0/454: dwrite db/d2f/d61/d67/f69 [0,4194304] 0 2024-03-12T16:10:38.933 INFO:tasks.workunit.client.0.smithi006.stdout:4/263: write d1/db/f3c [740952,21563] 0 2024-03-12T16:10:38.933 INFO:tasks.workunit.client.1.smithi134.stdout:0/455: write db/f2c [5645944,58837] 0 2024-03-12T16:10:38.934 INFO:tasks.workunit.client.1.smithi134.stdout:3/480: creat d1/fb5 x:0 0 0 2024-03-12T16:10:38.935 INFO:tasks.workunit.client.1.smithi134.stdout:2/388: creat d4/d12/d43/f8b x:0 0 0 2024-03-12T16:10:38.938 INFO:tasks.workunit.client.1.smithi134.stdout:3/481: symlink d1/lb6 0 2024-03-12T16:10:38.939 INFO:tasks.workunit.client.1.smithi134.stdout:0/456: symlink db/d2f/d31/d75/d88/l96 0 2024-03-12T16:10:38.940 INFO:tasks.workunit.client.1.smithi134.stdout:2/389: mkdir d4/d12/d1d/d34/d47/d8c 0 2024-03-12T16:10:38.940 INFO:tasks.workunit.client.1.smithi134.stdout:0/457: dread - db/d2f/d31/d68/d70/f74 zero size 2024-03-12T16:10:38.941 INFO:tasks.workunit.client.0.smithi006.stdout:4/264: dwrite d1/db/f3c [0,4194304] 0 2024-03-12T16:10:38.943 INFO:tasks.workunit.client.1.smithi134.stdout:3/482: truncate d1/db/d10/d2a/f51 1675312 0 2024-03-12T16:10:38.943 INFO:tasks.workunit.client.1.smithi134.stdout:8/391: dread d3/d10/d31/f53 [0,4194304] 0 2024-03-12T16:10:38.945 INFO:tasks.workunit.client.0.smithi006.stdout:4/265: unlink d1/db/f21 0 2024-03-12T16:10:38.947 INFO:tasks.workunit.client.0.smithi006.stdout:4/266: write d1/db/d17/f1c [1230857,122710] 0 2024-03-12T16:10:38.948 INFO:tasks.workunit.client.1.smithi134.stdout:9/309: dread d5/fa [0,4194304] 0 2024-03-12T16:10:38.948 INFO:tasks.workunit.client.1.smithi134.stdout:3/483: write d1/d63/f9c [218292,48972] 0 2024-03-12T16:10:38.949 INFO:tasks.workunit.client.0.smithi006.stdout:4/267: creat d1/db/d54/f55 x:0 0 0 2024-03-12T16:10:38.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:37.495233+0000 mgr.smithi134.gcntfu (mgr.24383) 56 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 903 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 6.6 MiB/s rd, 88 MiB/s wr, 130 op/s 2024-03-12T16:10:38.953 INFO:tasks.workunit.client.1.smithi134.stdout:0/458: dwrite db/f6e [0,4194304] 0 2024-03-12T16:10:38.953 INFO:tasks.workunit.client.1.smithi134.stdout:2/390: rename d4/d12/d1d/d34/d47/d56 to d4/d12/d1d/d8d 0 2024-03-12T16:10:38.955 INFO:tasks.workunit.client.1.smithi134.stdout:0/459: fsync db/d2f/d31/d76/f78 0 2024-03-12T16:10:38.956 INFO:tasks.workunit.client.1.smithi134.stdout:9/310: creat d5/d20/f52 x:0 0 0 2024-03-12T16:10:38.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:37.495233+0000 mgr.smithi134.gcntfu (mgr.24383) 56 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 903 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 6.6 MiB/s rd, 88 MiB/s wr, 130 op/s 2024-03-12T16:10:38.957 INFO:tasks.workunit.client.0.smithi006.stdout:4/268: dwrite d1/db/d17/f53 [0,4194304] 0 2024-03-12T16:10:38.959 INFO:tasks.workunit.client.1.smithi134.stdout:9/311: fdatasync d5/d10/d35/f2e 0 2024-03-12T16:10:38.960 INFO:tasks.workunit.client.1.smithi134.stdout:2/391: unlink d4/d84/d7d/l73 0 2024-03-12T16:10:38.962 INFO:tasks.workunit.client.1.smithi134.stdout:2/392: write d4/d3c/f53 [603141,105234] 0 2024-03-12T16:10:38.962 INFO:tasks.workunit.client.1.smithi134.stdout:0/460: chown db/d2f/d61/d67/l7d 452938906 1 2024-03-12T16:10:38.965 INFO:tasks.workunit.client.1.smithi134.stdout:3/484: truncate d1/db/d10/d2d/f9a 5132886 0 2024-03-12T16:10:38.967 INFO:tasks.workunit.client.0.smithi006.stdout:4/269: rmdir d1/db/d17 39 2024-03-12T16:10:38.967 INFO:tasks.workunit.client.1.smithi134.stdout:9/312: rename d5/d20/d36/c3b to d5/d10/d1f/c53 0 2024-03-12T16:10:38.970 INFO:tasks.workunit.client.1.smithi134.stdout:0/461: creat db/d2f/d31/d75/d88/f97 x:0 0 0 2024-03-12T16:10:38.971 INFO:tasks.workunit.client.1.smithi134.stdout:8/392: dread d3/f6 [0,4194304] 0 2024-03-12T16:10:38.971 INFO:tasks.workunit.client.0.smithi006.stdout:4/270: mknod d1/db/d1d/c56 0 2024-03-12T16:10:38.972 INFO:tasks.workunit.client.1.smithi134.stdout:3/485: creat d1/db/d10/d2d/d2e/d72/d97/fb7 x:0 0 0 2024-03-12T16:10:38.974 INFO:tasks.workunit.client.1.smithi134.stdout:9/313: mkdir d5/d10/d35/d49/d54 0 2024-03-12T16:10:38.976 INFO:tasks.workunit.client.1.smithi134.stdout:0/462: creat db/d2f/d31/d68/f98 x:0 0 0 2024-03-12T16:10:38.979 INFO:tasks.workunit.client.0.smithi006.stdout:4/271: write d1/db/f3c [4470820,34895] 0 2024-03-12T16:10:38.981 INFO:tasks.workunit.client.0.smithi006.stdout:4/272: readlink d1/db/d17/l10 0 2024-03-12T16:10:38.983 INFO:tasks.workunit.client.0.smithi006.stdout:4/273: creat d1/d38/f57 x:0 0 0 2024-03-12T16:10:38.985 INFO:tasks.workunit.client.0.smithi006.stdout:4/274: getdents d1/db/d39 0 2024-03-12T16:10:38.987 INFO:tasks.workunit.client.0.smithi006.stdout:4/275: unlink d1/db/l24 0 2024-03-12T16:10:38.988 INFO:tasks.workunit.client.0.smithi006.stdout:4/276: write d1/d38/f57 [700119,63975] 0 2024-03-12T16:10:38.989 INFO:tasks.workunit.client.0.smithi006.stdout:9/104: sync 2024-03-12T16:10:38.990 INFO:tasks.workunit.client.0.smithi006.stdout:1/166: sync 2024-03-12T16:10:38.990 INFO:tasks.workunit.client.0.smithi006.stdout:4/277: write d1/db/d1d/d2f/f4c [973449,4031] 0 2024-03-12T16:10:38.992 INFO:tasks.workunit.client.1.smithi134.stdout:9/314: dread d5/f14 [0,4194304] 0 2024-03-12T16:10:38.993 INFO:tasks.workunit.client.0.smithi006.stdout:9/105: unlink d0/db/c19 0 2024-03-12T16:10:38.995 INFO:tasks.workunit.client.0.smithi006.stdout:1/167: dread d0/f16 [0,4194304] 0 2024-03-12T16:10:38.998 INFO:tasks.workunit.client.0.smithi006.stdout:4/278: getdents d1/db/d17 0 2024-03-12T16:10:39.005 INFO:tasks.workunit.client.0.smithi006.stdout:9/106: dwrite d0/d8/f13 [0,4194304] 0 2024-03-12T16:10:39.014 INFO:tasks.workunit.client.0.smithi006.stdout:1/168: dwrite d0/d25/f28 [0,4194304] 0 2024-03-12T16:10:39.014 INFO:tasks.workunit.client.0.smithi006.stdout:4/279: dwrite d1/d38/f4f [0,4194304] 0 2024-03-12T16:10:39.017 INFO:tasks.workunit.client.0.smithi006.stdout:9/107: rename d0/c1c to d0/d8/d23/c24 0 2024-03-12T16:10:39.018 INFO:tasks.workunit.client.0.smithi006.stdout:4/280: mknod d1/db/d1d/d2f/c58 0 2024-03-12T16:10:39.019 INFO:tasks.workunit.client.0.smithi006.stdout:9/108: chown d0/db 3 1 2024-03-12T16:10:39.021 INFO:tasks.workunit.client.0.smithi006.stdout:9/109: fsync d0/d8/f22 0 2024-03-12T16:10:39.022 INFO:tasks.workunit.client.0.smithi006.stdout:1/169: dwrite d0/fa [0,4194304] 0 2024-03-12T16:10:39.024 INFO:tasks.workunit.client.0.smithi006.stdout:9/110: creat d0/d4/f25 x:0 0 0 2024-03-12T16:10:39.024 INFO:tasks.workunit.client.0.smithi006.stdout:9/111: fsync d0/fc 0 2024-03-12T16:10:39.028 INFO:tasks.workunit.client.1.smithi134.stdout:1/294: sync 2024-03-12T16:10:39.031 INFO:tasks.workunit.client.0.smithi006.stdout:9/112: dwrite d0/d8/f13 [0,4194304] 0 2024-03-12T16:10:39.032 INFO:tasks.workunit.client.1.smithi134.stdout:1/295: write d0/d16/f31 [590815,89109] 0 2024-03-12T16:10:39.033 INFO:tasks.workunit.client.1.smithi134.stdout:3/486: mknod d1/db/d10/d2d/d2e/d72/cb8 0 2024-03-12T16:10:39.035 INFO:tasks.workunit.client.0.smithi006.stdout:9/113: unlink d0/fd 0 2024-03-12T16:10:39.035 INFO:tasks.workunit.client.1.smithi134.stdout:1/296: chown d0/d16/d9/d13/d21/d20/c3d 60 1 2024-03-12T16:10:39.035 INFO:tasks.workunit.client.0.smithi006.stdout:9/114: stat d0/db/c1e 0 2024-03-12T16:10:39.037 INFO:tasks.workunit.client.1.smithi134.stdout:0/463: creat db/d2f/d31/d68/f99 x:0 0 0 2024-03-12T16:10:39.042 INFO:tasks.workunit.client.0.smithi006.stdout:9/115: link d0/d8/l5 d0/d1f/l26 0 2024-03-12T16:10:39.042 INFO:tasks.workunit.client.1.smithi134.stdout:9/315: dread d5/d10/f32 [0,4194304] 0 2024-03-12T16:10:39.044 INFO:tasks.workunit.client.0.smithi006.stdout:4/281: fsync d1/d38/f57 0 2024-03-12T16:10:39.044 INFO:tasks.workunit.client.1.smithi134.stdout:9/316: write d5/f3e [815252,111165] 0 2024-03-12T16:10:39.044 INFO:tasks.workunit.client.1.smithi134.stdout:1/297: creat d0/d16/d9/d13/d38/f69 x:0 0 0 2024-03-12T16:10:39.045 INFO:tasks.workunit.client.0.smithi006.stdout:9/116: chown d0/d1f/l26 3 1 2024-03-12T16:10:39.046 INFO:tasks.workunit.client.0.smithi006.stdout:9/117: readlink d0/d4/lf 0 2024-03-12T16:10:39.046 INFO:tasks.workunit.client.0.smithi006.stdout:4/282: truncate d1/db/f29 235312 0 2024-03-12T16:10:39.047 INFO:tasks.workunit.client.1.smithi134.stdout:9/317: mknod d5/d10/d35/d49/c55 0 2024-03-12T16:10:39.048 INFO:tasks.workunit.client.0.smithi006.stdout:4/283: dread d1/db/f29 [0,4194304] 0 2024-03-12T16:10:39.049 INFO:tasks.workunit.client.1.smithi134.stdout:1/298: fdatasync d0/d16/d9/d13/d21/d2f/f56 0 2024-03-12T16:10:39.052 INFO:tasks.workunit.client.1.smithi134.stdout:9/318: getdents d5/d10/d33 0 2024-03-12T16:10:39.053 INFO:tasks.workunit.client.0.smithi006.stdout:4/284: creat d1/db/d17/f59 x:0 0 0 2024-03-12T16:10:39.054 INFO:tasks.workunit.client.0.smithi006.stdout:9/118: truncate d0/fc 1624901 0 2024-03-12T16:10:39.057 INFO:tasks.workunit.client.0.smithi006.stdout:1/170: dread d0/fe [0,4194304] 0 2024-03-12T16:10:39.057 INFO:tasks.workunit.client.0.smithi006.stdout:4/285: dread d1/db/d1d/d2f/f36 [0,4194304] 0 2024-03-12T16:10:39.058 INFO:tasks.workunit.client.0.smithi006.stdout:9/119: fsync d0/d4/f25 0 2024-03-12T16:10:39.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/299: dwrite d0/f5d [0,4194304] 0 2024-03-12T16:10:39.061 INFO:tasks.workunit.client.1.smithi134.stdout:9/319: link d5/d10/d1f/f24 d5/d10/f56 0 2024-03-12T16:10:39.061 INFO:tasks.workunit.client.0.smithi006.stdout:4/286: mkdir d1/db/d17/d5a 0 2024-03-12T16:10:39.063 INFO:tasks.workunit.client.0.smithi006.stdout:9/120: dread d0/d8/f13 [0,4194304] 0 2024-03-12T16:10:39.065 INFO:tasks.workunit.client.1.smithi134.stdout:3/487: dread d1/f66 [0,4194304] 0 2024-03-12T16:10:39.066 INFO:tasks.workunit.client.1.smithi134.stdout:1/300: rename d0/d16/d9/d13/d21/d20/c3d to d0/d30/d48/c6a 0 2024-03-12T16:10:39.067 INFO:tasks.workunit.client.1.smithi134.stdout:2/393: truncate d4/f77 3895227 0 2024-03-12T16:10:39.070 INFO:tasks.workunit.client.1.smithi134.stdout:9/320: dwrite d5/fe [8388608,4194304] 0 2024-03-12T16:10:39.071 INFO:tasks.workunit.client.1.smithi134.stdout:8/393: truncate d3/f8 392216 0 2024-03-12T16:10:39.074 INFO:tasks.workunit.client.0.smithi006.stdout:9/121: getdents d0/d4 0 2024-03-12T16:10:39.075 INFO:tasks.workunit.client.1.smithi134.stdout:3/488: creat d1/db/d10/fb9 x:0 0 0 2024-03-12T16:10:39.078 INFO:tasks.workunit.client.1.smithi134.stdout:9/321: creat d5/d46/f57 x:0 0 0 2024-03-12T16:10:39.078 INFO:tasks.workunit.client.0.smithi006.stdout:1/171: dwrite d0/d25/f2e [0,4194304] 0 2024-03-12T16:10:39.079 INFO:tasks.workunit.client.1.smithi134.stdout:3/489: write d1/db/d10/d2a/f44 [849873,100674] 0 2024-03-12T16:10:39.079 INFO:tasks.workunit.client.0.smithi006.stdout:1/172: dread - d0/f23 zero size 2024-03-12T16:10:39.080 INFO:tasks.workunit.client.1.smithi134.stdout:9/322: dread - d5/d10/d1f/f43 zero size 2024-03-12T16:10:39.080 INFO:tasks.workunit.client.0.smithi006.stdout:9/122: creat d0/f27 x:0 0 0 2024-03-12T16:10:39.081 INFO:tasks.workunit.client.0.smithi006.stdout:1/173: chown d0/f4 1348 1 2024-03-12T16:10:39.082 INFO:tasks.workunit.client.0.smithi006.stdout:9/123: write d0/d8/f22 [131964,107221] 0 2024-03-12T16:10:39.083 INFO:tasks.workunit.client.1.smithi134.stdout:8/394: rename d3/d10/d31/l5f to d3/d1b/d17/d25/d33/l77 0 2024-03-12T16:10:39.085 INFO:tasks.workunit.client.1.smithi134.stdout:9/323: creat d5/d20/d36/f58 x:0 0 0 2024-03-12T16:10:39.087 INFO:tasks.workunit.client.1.smithi134.stdout:9/324: chown d5/d20/d36/c45 42 1 2024-03-12T16:10:39.087 INFO:tasks.workunit.client.0.smithi006.stdout:1/174: dwrite d0/f6 [0,4194304] 0 2024-03-12T16:10:39.089 INFO:tasks.workunit.client.1.smithi134.stdout:9/325: stat d5/d10/d1f/c2c 0 2024-03-12T16:10:39.094 INFO:tasks.workunit.client.0.smithi006.stdout:1/175: rename d0/f6 to d0/d25/f36 0 2024-03-12T16:10:39.096 INFO:tasks.workunit.client.0.smithi006.stdout:1/176: fsync d0/f13 0 2024-03-12T16:10:39.098 INFO:tasks.workunit.client.1.smithi134.stdout:9/326: dwrite d5/d20/f52 [0,4194304] 0 2024-03-12T16:10:39.099 INFO:tasks.workunit.client.0.smithi006.stdout:1/177: rename d0/f1a to d0/f37 0 2024-03-12T16:10:39.101 INFO:tasks.workunit.client.0.smithi006.stdout:1/178: mknod d0/d25/d2a/d35/c38 0 2024-03-12T16:10:39.102 INFO:tasks.workunit.client.0.smithi006.stdout:1/179: chown d0/d25/l33 1804258 1 2024-03-12T16:10:39.103 INFO:tasks.workunit.client.0.smithi006.stdout:1/180: chown d0/f21 214985588 1 2024-03-12T16:10:39.105 INFO:tasks.workunit.client.1.smithi134.stdout:2/394: dread d4/d12/d3b/d3f/f5d [0,4194304] 0 2024-03-12T16:10:39.106 INFO:tasks.workunit.client.1.smithi134.stdout:2/395: dread - d4/d12/f4a zero size 2024-03-12T16:10:39.107 INFO:tasks.workunit.client.0.smithi006.stdout:9/124: fdatasync d0/d8/f22 0 2024-03-12T16:10:39.108 INFO:tasks.workunit.client.1.smithi134.stdout:2/396: truncate d4/d84/f7a 41144 0 2024-03-12T16:10:39.108 INFO:tasks.workunit.client.1.smithi134.stdout:2/397: dread - d4/d84/f7f zero size 2024-03-12T16:10:39.112 INFO:tasks.workunit.client.1.smithi134.stdout:2/398: creat d4/d12/d1d/d89/f8e x:0 0 0 2024-03-12T16:10:39.113 INFO:tasks.workunit.client.1.smithi134.stdout:2/399: fsync d4/f1f 0 2024-03-12T16:10:39.115 INFO:tasks.workunit.client.1.smithi134.stdout:3/490: dread d1/d63/d6c/f98 [0,4194304] 0 2024-03-12T16:10:39.117 INFO:tasks.workunit.client.1.smithi134.stdout:2/400: creat d4/d12/d3b/f8f x:0 0 0 2024-03-12T16:10:39.118 INFO:tasks.workunit.client.1.smithi134.stdout:2/401: readlink d4/d12/d3b/d3f/l65 0 2024-03-12T16:10:39.119 INFO:tasks.workunit.client.1.smithi134.stdout:3/491: symlink d1/db/d14/d5f/lba 0 2024-03-12T16:10:39.119 INFO:tasks.workunit.client.1.smithi134.stdout:9/327: write d5/d20/f23 [1278170,117135] 0 2024-03-12T16:10:39.120 INFO:tasks.workunit.client.1.smithi134.stdout:2/402: dread - d4/d12/d1d/d34/d58/f82 zero size 2024-03-12T16:10:39.126 INFO:tasks.workunit.client.1.smithi134.stdout:9/328: dread d5/d10/f56 [0,4194304] 0 2024-03-12T16:10:39.128 INFO:tasks.workunit.client.0.smithi006.stdout:1/181: dwrite d0/f3 [0,4194304] 0 2024-03-12T16:10:39.129 INFO:tasks.workunit.client.1.smithi134.stdout:2/403: dwrite d4/d12/d43/f8b [0,4194304] 0 2024-03-12T16:10:39.129 INFO:tasks.workunit.client.0.smithi006.stdout:9/125: dwrite d0/fc [0,4194304] 0 2024-03-12T16:10:39.129 INFO:tasks.workunit.client.0.smithi006.stdout:1/182: readlink d0/l29 0 2024-03-12T16:10:39.131 INFO:tasks.workunit.client.1.smithi134.stdout:3/492: truncate d1/db/d10/d2a/f51 238150 0 2024-03-12T16:10:39.131 INFO:tasks.workunit.client.1.smithi134.stdout:3/493: dread - d1/fad zero size 2024-03-12T16:10:39.132 INFO:tasks.workunit.client.0.smithi006.stdout:1/183: mkdir d0/d39 0 2024-03-12T16:10:39.133 INFO:tasks.workunit.client.1.smithi134.stdout:9/329: symlink d5/d10/d35/d49/l59 0 2024-03-12T16:10:39.134 INFO:tasks.workunit.client.1.smithi134.stdout:2/404: unlink d4/d12/d1d/d89/f8e 0 2024-03-12T16:10:39.134 INFO:tasks.workunit.client.0.smithi006.stdout:9/126: creat d0/f28 x:0 0 0 2024-03-12T16:10:39.135 INFO:tasks.workunit.client.1.smithi134.stdout:2/405: read - d4/d12/d1d/d8d/f81 zero size 2024-03-12T16:10:39.136 INFO:tasks.workunit.client.0.smithi006.stdout:9/127: fdatasync d0/f27 0 2024-03-12T16:10:39.137 INFO:tasks.workunit.client.1.smithi134.stdout:9/330: fsync d5/fa 0 2024-03-12T16:10:39.137 INFO:tasks.workunit.client.1.smithi134.stdout:3/494: mknod d1/db/d14/d5a/d89/cbb 0 2024-03-12T16:10:39.138 INFO:tasks.workunit.client.0.smithi006.stdout:1/184: dread d0/d25/f36 [0,4194304] 0 2024-03-12T16:10:39.138 INFO:tasks.workunit.client.1.smithi134.stdout:9/331: chown c1 2976 1 2024-03-12T16:10:39.139 INFO:tasks.workunit.client.0.smithi006.stdout:9/128: creat d0/d4/f29 x:0 0 0 2024-03-12T16:10:39.140 INFO:tasks.workunit.client.1.smithi134.stdout:7/337: sync 2024-03-12T16:10:39.141 INFO:tasks.workunit.client.1.smithi134.stdout:6/407: sync 2024-03-12T16:10:39.142 INFO:tasks.workunit.client.0.smithi006.stdout:1/185: creat d0/d25/d2a/d35/f3a x:0 0 0 2024-03-12T16:10:39.142 INFO:tasks.workunit.client.0.smithi006.stdout:1/186: readlink d0/l20 0 2024-03-12T16:10:39.142 INFO:tasks.workunit.client.1.smithi134.stdout:7/338: write d8/dc/d20/f67 [1033821,106660] 0 2024-03-12T16:10:39.143 INFO:tasks.workunit.client.1.smithi134.stdout:7/339: stat d8/d27/l34 0 2024-03-12T16:10:39.143 INFO:tasks.workunit.client.1.smithi134.stdout:3/495: mknod d1/db/d10/d2d/d30/cbc 0 2024-03-12T16:10:39.144 INFO:tasks.workunit.client.0.smithi006.stdout:9/129: getdents d0/d1f 0 2024-03-12T16:10:39.145 INFO:tasks.workunit.client.1.smithi134.stdout:3/496: write d1/db/f4d [1402234,1381] 0 2024-03-12T16:10:39.145 INFO:tasks.workunit.client.0.smithi006.stdout:9/130: dread - d0/f28 zero size 2024-03-12T16:10:39.145 INFO:tasks.workunit.client.1.smithi134.stdout:2/406: creat d4/f90 x:0 0 0 2024-03-12T16:10:39.146 INFO:tasks.workunit.client.0.smithi006.stdout:9/131: write d0/d8/f22 [427710,34547] 0 2024-03-12T16:10:39.147 INFO:tasks.workunit.client.0.smithi006.stdout:1/187: link d0/fe d0/d25/d2a/f3b 0 2024-03-12T16:10:39.148 INFO:tasks.workunit.client.1.smithi134.stdout:3/497: stat d1/db/l95 0 2024-03-12T16:10:39.148 INFO:tasks.workunit.client.0.smithi006.stdout:9/132: readlink d0/l9 0 2024-03-12T16:10:39.149 INFO:tasks.workunit.client.0.smithi006.stdout:9/133: dread - d0/d4/f25 zero size 2024-03-12T16:10:39.149 INFO:tasks.workunit.client.0.smithi006.stdout:1/188: symlink d0/d25/d2a/l3c 0 2024-03-12T16:10:39.151 INFO:tasks.workunit.client.1.smithi134.stdout:7/340: rename d8/dc/d20/d26/d36/l43 to d8/dc/d2f/d31/l6f 0 2024-03-12T16:10:39.152 INFO:tasks.workunit.client.0.smithi006.stdout:9/134: getdents d0/d1f 0 2024-03-12T16:10:39.155 INFO:tasks.workunit.client.0.smithi006.stdout:9/135: rmdir d0/d8 39 2024-03-12T16:10:39.157 INFO:tasks.workunit.client.0.smithi006.stdout:1/189: dwrite d0/f34 [0,4194304] 0 2024-03-12T16:10:39.157 INFO:tasks.workunit.client.1.smithi134.stdout:7/341: write d8/dc/d2f/f32 [4551572,68645] 0 2024-03-12T16:10:39.158 INFO:tasks.workunit.client.1.smithi134.stdout:3/498: write d1/db/d10/d2d/f33 [5517031,76405] 0 2024-03-12T16:10:39.158 INFO:tasks.workunit.client.0.smithi006.stdout:9/136: unlink d0/f27 0 2024-03-12T16:10:39.159 INFO:tasks.workunit.client.1.smithi134.stdout:7/342: fdatasync d8/dc/d20/d26/f2c 0 2024-03-12T16:10:39.161 INFO:tasks.workunit.client.0.smithi006.stdout:1/190: symlink d0/d39/l3d 0 2024-03-12T16:10:39.162 INFO:tasks.workunit.client.0.smithi006.stdout:9/137: mknod d0/d4/d18/c2a 0 2024-03-12T16:10:39.162 INFO:tasks.workunit.client.1.smithi134.stdout:9/332: truncate d5/f28 2603422 0 2024-03-12T16:10:39.166 INFO:tasks.workunit.client.1.smithi134.stdout:9/333: fdatasync d5/d10/d35/f3a 0 2024-03-12T16:10:39.168 INFO:tasks.workunit.client.0.smithi006.stdout:9/138: rename d0/db to d0/d8/d2b 0 2024-03-12T16:10:39.170 INFO:tasks.workunit.client.1.smithi134.stdout:3/499: creat d1/d63/d6c/fbd x:0 0 0 2024-03-12T16:10:39.170 INFO:tasks.workunit.client.1.smithi134.stdout:7/343: creat d8/dc/d2f/f70 x:0 0 0 2024-03-12T16:10:39.173 INFO:tasks.workunit.client.1.smithi134.stdout:7/344: write d8/dc/d20/f21 [659600,66862] 0 2024-03-12T16:10:39.173 INFO:tasks.workunit.client.0.smithi006.stdout:9/139: getdents d0/d8/d2b 0 2024-03-12T16:10:39.176 INFO:tasks.workunit.client.0.smithi006.stdout:9/140: mknod d0/d8/d2b/c2c 0 2024-03-12T16:10:39.176 INFO:tasks.workunit.client.1.smithi134.stdout:3/500: creat d1/db/d14/d5f/fbe x:0 0 0 2024-03-12T16:10:39.180 INFO:tasks.workunit.client.1.smithi134.stdout:9/334: dwrite d5/d10/d35/f48 [0,4194304] 0 2024-03-12T16:10:39.180 INFO:tasks.workunit.client.1.smithi134.stdout:7/345: symlink d8/l71 0 2024-03-12T16:10:39.181 INFO:tasks.workunit.client.1.smithi134.stdout:2/407: dread d4/f1f [0,4194304] 0 2024-03-12T16:10:39.182 INFO:tasks.workunit.client.0.smithi006.stdout:1/191: getdents d0/d39 0 2024-03-12T16:10:39.182 INFO:tasks.workunit.client.1.smithi134.stdout:3/501: mkdir d1/d63/d6c/dbf 0 2024-03-12T16:10:39.183 INFO:tasks.workunit.client.0.smithi006.stdout:1/192: read - d0/f23 zero size 2024-03-12T16:10:39.183 INFO:tasks.workunit.client.0.smithi006.stdout:9/141: dwrite d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:39.184 INFO:tasks.workunit.client.1.smithi134.stdout:2/408: read - d4/d12/d3b/d3f/f45 zero size 2024-03-12T16:10:39.184 INFO:tasks.workunit.client.1.smithi134.stdout:7/346: fsync d8/dc/d2f/d31/f35 0 2024-03-12T16:10:39.185 INFO:tasks.workunit.client.1.smithi134.stdout:9/335: dread d5/d10/d35/d49/f4a [0,4194304] 0 2024-03-12T16:10:39.188 INFO:tasks.workunit.client.1.smithi134.stdout:2/409: symlink d4/d84/d63/l91 0 2024-03-12T16:10:39.188 INFO:tasks.workunit.client.0.smithi006.stdout:9/142: mknod d0/d4/c2d 0 2024-03-12T16:10:39.192 INFO:tasks.workunit.client.0.smithi006.stdout:9/143: symlink d0/d8/d23/l2e 0 2024-03-12T16:10:39.193 INFO:tasks.workunit.client.1.smithi134.stdout:3/502: rename d1/d63/d6c/fbd to d1/db/d12/d9d/fc0 0 2024-03-12T16:10:39.194 INFO:tasks.workunit.client.0.smithi006.stdout:9/144: mkdir d0/d8/d16/d2f 0 2024-03-12T16:10:39.197 INFO:tasks.workunit.client.1.smithi134.stdout:7/347: dwrite d8/dc/f54 [0,4194304] 0 2024-03-12T16:10:39.198 INFO:tasks.workunit.client.1.smithi134.stdout:2/410: rename d4/f2b to d4/d12/d3b/d3f/f92 0 2024-03-12T16:10:39.199 INFO:tasks.workunit.client.0.smithi006.stdout:9/145: getdents d0/d8/d2b 0 2024-03-12T16:10:39.200 INFO:tasks.workunit.client.1.smithi134.stdout:2/411: stat d4/d12/d1d/d8d 0 2024-03-12T16:10:39.202 INFO:tasks.workunit.client.1.smithi134.stdout:9/336: dwrite d5/d10/f2d [0,4194304] 0 2024-03-12T16:10:39.205 INFO:tasks.workunit.client.1.smithi134.stdout:7/348: dread d8/f1a [0,4194304] 0 2024-03-12T16:10:39.207 INFO:tasks.workunit.client.1.smithi134.stdout:3/503: link d1/db/d10/d2d/d2e/l76 d1/db/d10/d2d/d2e/lc1 0 2024-03-12T16:10:39.208 INFO:tasks.workunit.client.0.smithi006.stdout:9/146: dwrite d0/d8/fa [0,4194304] 0 2024-03-12T16:10:39.210 INFO:tasks.workunit.client.1.smithi134.stdout:7/349: dread - d8/dc/f51 zero size 2024-03-12T16:10:39.212 INFO:tasks.workunit.client.1.smithi134.stdout:2/412: dwrite d4/d12/f20 [0,4194304] 0 2024-03-12T16:10:39.215 INFO:tasks.workunit.client.1.smithi134.stdout:9/337: link d5/d10/d1f/f24 d5/d10/f5a 0 2024-03-12T16:10:39.218 INFO:tasks.workunit.client.0.smithi006.stdout:9/147: dread d0/d8/f13 [0,4194304] 0 2024-03-12T16:10:39.220 INFO:tasks.workunit.client.1.smithi134.stdout:2/413: rename d4/d16/d3d/f49 to d4/d12/d1d/d34/d58/f93 0 2024-03-12T16:10:39.223 INFO:tasks.workunit.client.1.smithi134.stdout:2/414: write d4/d12/d3b/d3f/f45 [5922,117530] 0 2024-03-12T16:10:39.225 INFO:tasks.workunit.client.1.smithi134.stdout:9/338: dwrite d5/d10/d1f/f43 [0,4194304] 0 2024-03-12T16:10:39.227 INFO:tasks.workunit.client.1.smithi134.stdout:7/350: dread d8/f2a [0,4194304] 0 2024-03-12T16:10:39.230 INFO:tasks.workunit.client.1.smithi134.stdout:7/351: mknod d8/c72 0 2024-03-12T16:10:39.233 INFO:tasks.workunit.client.1.smithi134.stdout:9/339: link d5/d10/d35/c1d d5/d10/c5b 0 2024-03-12T16:10:39.237 INFO:tasks.workunit.client.1.smithi134.stdout:9/340: unlink d5/d10/d35/f48 0 2024-03-12T16:10:39.239 INFO:tasks.workunit.client.1.smithi134.stdout:7/352: dwrite d8/dc/d20/f1d [4194304,4194304] 0 2024-03-12T16:10:39.240 INFO:tasks.workunit.client.1.smithi134.stdout:9/341: creat d5/d46/f5c x:0 0 0 2024-03-12T16:10:39.241 INFO:tasks.workunit.client.1.smithi134.stdout:9/342: write d5/d46/f57 [129444,38761] 0 2024-03-12T16:10:39.243 INFO:tasks.workunit.client.0.smithi006.stdout:9/148: truncate d0/fc 230838 0 2024-03-12T16:10:39.244 INFO:tasks.workunit.client.0.smithi006.stdout:9/149: rename d0 to d0/d8/d2b/d20/d30 22 2024-03-12T16:10:39.245 INFO:tasks.workunit.client.1.smithi134.stdout:3/504: truncate d1/db/f58 2614280 0 2024-03-12T16:10:39.245 INFO:tasks.workunit.client.1.smithi134.stdout:7/353: creat d8/d27/f73 x:0 0 0 2024-03-12T16:10:39.245 INFO:tasks.workunit.client.0.smithi006.stdout:9/150: rmdir d0/d8/d16 39 2024-03-12T16:10:39.247 INFO:tasks.workunit.client.1.smithi134.stdout:3/505: mkdir d1/d63/dc2 0 2024-03-12T16:10:39.248 INFO:tasks.workunit.client.0.smithi006.stdout:9/151: creat d0/d8/d16/f31 x:0 0 0 2024-03-12T16:10:39.249 INFO:tasks.workunit.client.1.smithi134.stdout:9/343: symlink d5/d20/d47/l5d 0 2024-03-12T16:10:39.249 INFO:tasks.workunit.client.1.smithi134.stdout:7/354: write d8/dc/d20/d26/f5e [3300703,69579] 0 2024-03-12T16:10:39.251 INFO:tasks.workunit.client.0.smithi006.stdout:9/152: unlink d0/d8/d23/c24 0 2024-03-12T16:10:39.253 INFO:tasks.workunit.client.0.smithi006.stdout:9/153: mknod d0/d4/c32 0 2024-03-12T16:10:39.254 INFO:tasks.workunit.client.0.smithi006.stdout:9/154: dread - d0/f28 zero size 2024-03-12T16:10:39.255 INFO:tasks.workunit.client.0.smithi006.stdout:9/155: truncate d0/d4/f25 248629 0 2024-03-12T16:10:39.255 INFO:tasks.workunit.client.1.smithi134.stdout:7/355: unlink d8/dc/d55/f63 0 2024-03-12T16:10:39.257 INFO:tasks.workunit.client.1.smithi134.stdout:9/344: mkdir d5/d10/d35/d49/d54/d5e 0 2024-03-12T16:10:39.258 INFO:tasks.workunit.client.1.smithi134.stdout:9/345: write d5/fa [5723608,68816] 0 2024-03-12T16:10:39.259 INFO:tasks.workunit.client.0.smithi006.stdout:9/156: rename d0/d8/d2b/c11 to d0/d8/c33 0 2024-03-12T16:10:39.262 INFO:tasks.workunit.client.1.smithi134.stdout:9/346: creat d5/d10/d35/f5f x:0 0 0 2024-03-12T16:10:39.262 INFO:tasks.workunit.client.1.smithi134.stdout:3/506: write d1/db/d12/f71 [837812,14584] 0 2024-03-12T16:10:39.264 INFO:tasks.workunit.client.1.smithi134.stdout:3/507: dread - d1/db/d10/d2d/d2e/f6a zero size 2024-03-12T16:10:39.265 INFO:tasks.workunit.client.0.smithi006.stdout:9/157: dwrite d0/f28 [0,4194304] 0 2024-03-12T16:10:39.267 INFO:tasks.workunit.client.1.smithi134.stdout:7/356: write d8/f2a [216754,23671] 0 2024-03-12T16:10:39.268 INFO:tasks.workunit.client.0.smithi006.stdout:9/158: rmdir d0/d8 39 2024-03-12T16:10:39.269 INFO:tasks.workunit.client.1.smithi134.stdout:9/347: link d5/d10/d35/d49/f4a d5/d20/d36/f60 0 2024-03-12T16:10:39.269 INFO:tasks.workunit.client.1.smithi134.stdout:7/357: chown d8/d4e/c69 199892435 1 2024-03-12T16:10:39.271 INFO:tasks.workunit.client.0.smithi006.stdout:9/159: chown d0/d1f/l26 928 1 2024-03-12T16:10:39.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/358: write d8/f1a [4383125,104192] 0 2024-03-12T16:10:39.275 INFO:tasks.workunit.client.1.smithi134.stdout:7/359: unlink d8/dc/c49 0 2024-03-12T16:10:39.276 INFO:tasks.workunit.client.1.smithi134.stdout:7/360: fsync d8/dc/f54 0 2024-03-12T16:10:39.276 INFO:tasks.workunit.client.1.smithi134.stdout:9/348: link d5/d20/f27 d5/d10/d35/f61 0 2024-03-12T16:10:39.277 INFO:tasks.workunit.client.1.smithi134.stdout:9/349: chown d5/d10/d1f/f4b 5170 1 2024-03-12T16:10:39.280 INFO:tasks.workunit.client.1.smithi134.stdout:9/350: symlink d5/d10/d33/l62 0 2024-03-12T16:10:39.282 INFO:tasks.workunit.client.1.smithi134.stdout:7/361: getdents d8/dc/d20 0 2024-03-12T16:10:39.283 INFO:tasks.workunit.client.1.smithi134.stdout:9/351: chown d5/d10/d35/c1d 59411 1 2024-03-12T16:10:39.283 INFO:tasks.workunit.client.0.smithi006.stdout:9/160: fsync d0/f28 0 2024-03-12T16:10:39.284 INFO:tasks.workunit.client.1.smithi134.stdout:7/362: write d8/f1f [2865464,29614] 0 2024-03-12T16:10:39.284 INFO:tasks.workunit.client.1.smithi134.stdout:9/352: truncate d5/d46/f5c 734669 0 2024-03-12T16:10:39.286 INFO:tasks.workunit.client.1.smithi134.stdout:7/363: write d8/dc/d20/f1d [2759327,77137] 0 2024-03-12T16:10:39.288 INFO:tasks.workunit.client.1.smithi134.stdout:9/353: symlink d5/d10/d1f/l63 0 2024-03-12T16:10:39.290 INFO:tasks.workunit.client.1.smithi134.stdout:9/354: fsync d5/d10/d1f/f4b 0 2024-03-12T16:10:39.290 INFO:tasks.workunit.client.1.smithi134.stdout:3/508: dread d1/db/d10/d2d/d2e/f3f [0,4194304] 0 2024-03-12T16:10:39.291 INFO:tasks.workunit.client.0.smithi006.stdout:9/161: truncate d0/fc 738548 0 2024-03-12T16:10:39.291 INFO:tasks.workunit.client.0.smithi006.stdout:9/162: chown d0/l9 0 1 2024-03-12T16:10:39.291 INFO:tasks.workunit.client.1.smithi134.stdout:7/364: write d8/dc/d4b/f44 [4947032,63885] 0 2024-03-12T16:10:39.293 INFO:tasks.workunit.client.1.smithi134.stdout:9/355: read d5/d20/f27 [294371,40938] 0 2024-03-12T16:10:39.294 INFO:tasks.workunit.client.1.smithi134.stdout:7/365: write d8/dc/d20/f56 [871262,101220] 0 2024-03-12T16:10:39.295 INFO:tasks.workunit.client.1.smithi134.stdout:9/356: fdatasync d5/d10/d35/f2e 0 2024-03-12T16:10:39.298 INFO:tasks.workunit.client.0.smithi006.stdout:9/163: write d0/fc [1644413,123948] 0 2024-03-12T16:10:39.299 INFO:tasks.workunit.client.1.smithi134.stdout:7/366: unlink d8/d27/f3f 0 2024-03-12T16:10:39.300 INFO:tasks.workunit.client.1.smithi134.stdout:9/357: creat d5/d46/f64 x:0 0 0 2024-03-12T16:10:39.300 INFO:tasks.workunit.client.1.smithi134.stdout:7/367: write d8/f1f [2200764,80644] 0 2024-03-12T16:10:39.301 INFO:tasks.workunit.client.1.smithi134.stdout:3/509: rename d1/db/d10/d2d/d2e/d72/l88 to d1/db/d12/d9d/d9f/lc3 0 2024-03-12T16:10:39.302 INFO:tasks.workunit.client.1.smithi134.stdout:7/368: fsync d8/dc/d20/f67 0 2024-03-12T16:10:39.302 INFO:tasks.workunit.client.0.smithi006.stdout:9/164: rename d0/d8/f22 to d0/d8/d2b/d20/f34 0 2024-03-12T16:10:39.303 INFO:tasks.workunit.client.1.smithi134.stdout:9/358: symlink d5/d10/d35/d49/l65 0 2024-03-12T16:10:39.304 INFO:tasks.workunit.client.1.smithi134.stdout:7/369: write d8/d27/f73 [274309,18619] 0 2024-03-12T16:10:39.305 INFO:tasks.workunit.client.0.smithi006.stdout:9/165: truncate d0/f28 654363 0 2024-03-12T16:10:39.306 INFO:tasks.workunit.client.1.smithi134.stdout:3/510: symlink d1/db/d10/d2d/d2e/d72/d97/lc4 0 2024-03-12T16:10:39.308 INFO:tasks.workunit.client.1.smithi134.stdout:7/370: rename d8/dc/d20/f30 to d8/d4e/f74 0 2024-03-12T16:10:39.308 INFO:tasks.workunit.client.1.smithi134.stdout:7/371: chown d8/d27/d5b/l68 487550511 1 2024-03-12T16:10:39.309 INFO:tasks.workunit.client.0.smithi006.stdout:9/166: link d0/c1a d0/d1f/c35 0 2024-03-12T16:10:39.310 INFO:tasks.workunit.client.1.smithi134.stdout:7/372: truncate d8/dc/d4b/f45 5168325 0 2024-03-12T16:10:39.310 INFO:tasks.workunit.client.1.smithi134.stdout:7/373: read d8/dc/d20/f13 [685260,42662] 0 2024-03-12T16:10:39.311 INFO:tasks.workunit.client.1.smithi134.stdout:3/511: readlink d1/db/d10/d2d/d2e/lc1 0 2024-03-12T16:10:39.311 INFO:tasks.workunit.client.1.smithi134.stdout:7/374: chown d8/dc/d20/f1d 23553338 1 2024-03-12T16:10:39.313 INFO:tasks.workunit.client.0.smithi006.stdout:9/167: dread d0/d8/d2b/d20/f34 [0,4194304] 0 2024-03-12T16:10:39.313 INFO:tasks.workunit.client.1.smithi134.stdout:7/375: creat d8/d27/f75 x:0 0 0 2024-03-12T16:10:39.314 INFO:tasks.workunit.client.0.smithi006.stdout:9/168: readlink d0/d8/d23/l2e 0 2024-03-12T16:10:39.315 INFO:tasks.workunit.client.1.smithi134.stdout:9/359: write d5/d20/d36/f60 [1088964,42073] 0 2024-03-12T16:10:39.316 INFO:tasks.workunit.client.0.smithi006.stdout:9/169: creat d0/d8/d2b/d20/f36 x:0 0 0 2024-03-12T16:10:39.316 INFO:tasks.workunit.client.1.smithi134.stdout:7/376: fsync d8/dc/d20/d26/f2c 0 2024-03-12T16:10:39.317 INFO:tasks.workunit.client.0.smithi006.stdout:9/170: dread d0/d4/f25 [0,4194304] 0 2024-03-12T16:10:39.317 INFO:tasks.workunit.client.1.smithi134.stdout:9/360: fdatasync d5/d20/f52 0 2024-03-12T16:10:39.319 INFO:tasks.workunit.client.1.smithi134.stdout:7/377: mknod d8/c76 0 2024-03-12T16:10:39.320 INFO:tasks.workunit.client.1.smithi134.stdout:9/361: chown d5/d20/f23 761505731 1 2024-03-12T16:10:39.320 INFO:tasks.workunit.client.0.smithi006.stdout:9/171: mkdir d0/d8/d2b/d20/d37 0 2024-03-12T16:10:39.320 INFO:tasks.workunit.client.1.smithi134.stdout:3/512: dwrite d1/db/d14/d5f/fbe [0,4194304] 0 2024-03-12T16:10:39.321 INFO:tasks.workunit.client.1.smithi134.stdout:9/362: readlink d5/l16 0 2024-03-12T16:10:39.322 INFO:tasks.workunit.client.1.smithi134.stdout:9/363: read - d5/d20/d36/f58 zero size 2024-03-12T16:10:39.322 INFO:tasks.workunit.client.0.smithi006.stdout:9/172: link d0/fc d0/d8/f38 0 2024-03-12T16:10:39.323 INFO:tasks.workunit.client.1.smithi134.stdout:9/364: write d5/d10/d1f/f43 [2090096,62010] 0 2024-03-12T16:10:39.323 INFO:tasks.workunit.client.0.smithi006.stdout:9/173: chown d0/d8/d2b 3325659 1 2024-03-12T16:10:39.325 INFO:tasks.workunit.client.1.smithi134.stdout:9/365: write d5/d10/d35/f2e [298430,33529] 0 2024-03-12T16:10:39.325 INFO:tasks.workunit.client.0.smithi006.stdout:9/174: creat d0/d8/d2b/d20/d37/f39 x:0 0 0 2024-03-12T16:10:39.326 INFO:tasks.workunit.client.1.smithi134.stdout:7/378: mknod d8/dc/c77 0 2024-03-12T16:10:39.327 INFO:tasks.workunit.client.1.smithi134.stdout:7/379: write d8/dc/d2f/d31/f35 [2265493,93399] 0 2024-03-12T16:10:39.327 INFO:tasks.workunit.client.0.smithi006.stdout:9/175: write d0/d8/f38 [1483764,57054] 0 2024-03-12T16:10:39.330 INFO:tasks.workunit.client.1.smithi134.stdout:7/380: readlink d8/dc/le 0 2024-03-12T16:10:39.330 INFO:tasks.workunit.client.1.smithi134.stdout:3/513: mkdir d1/db/d12/d9d/dc5 0 2024-03-12T16:10:39.330 INFO:tasks.workunit.client.1.smithi134.stdout:9/366: fdatasync d5/d10/d35/f61 0 2024-03-12T16:10:39.332 INFO:tasks.workunit.client.1.smithi134.stdout:7/381: chown d8/dc/d55/f5f 0 1 2024-03-12T16:10:39.333 INFO:tasks.workunit.client.1.smithi134.stdout:7/382: fsync d8/f2a 0 2024-03-12T16:10:39.333 INFO:tasks.workunit.client.1.smithi134.stdout:9/367: mknod d5/d20/d36/c66 0 2024-03-12T16:10:39.334 INFO:tasks.workunit.client.0.smithi006.stdout:9/176: getdents d0/d1f 0 2024-03-12T16:10:39.334 INFO:tasks.workunit.client.1.smithi134.stdout:3/514: write d1/f2 [2233139,76146] 0 2024-03-12T16:10:39.336 INFO:tasks.workunit.client.0.smithi006.stdout:9/177: symlink d0/l3a 0 2024-03-12T16:10:39.337 INFO:tasks.workunit.client.1.smithi134.stdout:7/383: symlink d8/dc/d20/l78 0 2024-03-12T16:10:39.338 INFO:tasks.workunit.client.0.smithi006.stdout:9/178: write d0/d8/d16/f31 [89625,105986] 0 2024-03-12T16:10:39.339 INFO:tasks.workunit.client.1.smithi134.stdout:3/515: mkdir d1/db/d10/d2a/dc6 0 2024-03-12T16:10:39.340 INFO:tasks.workunit.client.0.smithi006.stdout:9/179: mkdir d0/d4/d3b 0 2024-03-12T16:10:39.341 INFO:tasks.workunit.client.0.smithi006.stdout:9/180: readlink d0/d8/d23/l2e 0 2024-03-12T16:10:39.344 INFO:tasks.workunit.client.1.smithi134.stdout:7/384: dwrite d8/f1f [0,4194304] 0 2024-03-12T16:10:39.345 INFO:tasks.workunit.client.1.smithi134.stdout:9/368: write d5/f14 [5669373,32073] 0 2024-03-12T16:10:39.345 INFO:tasks.workunit.client.0.smithi006.stdout:9/181: dread d0/d8/fa [0,4194304] 0 2024-03-12T16:10:39.346 INFO:tasks.workunit.client.0.smithi006.stdout:9/182: truncate d0/d8/d2b/d20/d37/f39 340456 0 2024-03-12T16:10:39.348 INFO:tasks.workunit.client.0.smithi006.stdout:9/183: unlink d0/d8/fa 0 2024-03-12T16:10:39.349 INFO:tasks.workunit.client.1.smithi134.stdout:9/369: mknod d5/c67 0 2024-03-12T16:10:39.349 INFO:tasks.workunit.client.0.smithi006.stdout:9/184: readlink d0/d8/d23/l2e 0 2024-03-12T16:10:39.350 INFO:tasks.workunit.client.0.smithi006.stdout:9/185: read d0/d4/f25 [134441,4097] 0 2024-03-12T16:10:39.352 INFO:tasks.workunit.client.1.smithi134.stdout:9/370: unlink d5/l1b 0 2024-03-12T16:10:39.353 INFO:tasks.workunit.client.1.smithi134.stdout:3/516: dwrite d1/db/f58 [0,4194304] 0 2024-03-12T16:10:39.354 INFO:tasks.workunit.client.1.smithi134.stdout:7/385: dwrite d8/dc/d2f/f32 [0,4194304] 0 2024-03-12T16:10:39.355 INFO:tasks.workunit.client.0.smithi006.stdout:9/186: dread d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:39.355 INFO:tasks.workunit.client.1.smithi134.stdout:4/339: sync 2024-03-12T16:10:39.357 INFO:tasks.workunit.client.0.smithi006.stdout:9/187: dread d0/d4/f25 [0,4194304] 0 2024-03-12T16:10:39.357 INFO:tasks.workunit.client.1.smithi134.stdout:4/340: chown d1/d13/d49/f66 92343844 1 2024-03-12T16:10:39.360 INFO:tasks.workunit.client.0.smithi006.stdout:9/188: symlink d0/d8/d2b/d20/d37/l3c 0 2024-03-12T16:10:39.360 INFO:tasks.workunit.client.0.smithi006.stdout:9/189: chown d0/d8/d2b 2018587 1 2024-03-12T16:10:39.362 INFO:tasks.workunit.client.1.smithi134.stdout:4/341: readlink d1/d13/d49/d64/d28/l55 0 2024-03-12T16:10:39.362 INFO:tasks.workunit.client.1.smithi134.stdout:9/371: chown d5/d20/d36/c3f 1850 1 2024-03-12T16:10:39.362 INFO:tasks.workunit.client.1.smithi134.stdout:3/517: chown d1/db/d12/d9d/d9f 4 1 2024-03-12T16:10:39.364 INFO:tasks.workunit.client.0.smithi006.stdout:9/190: creat d0/d4/d3b/f3d x:0 0 0 2024-03-12T16:10:39.365 INFO:tasks.workunit.client.0.smithi006.stdout:9/191: readlink d0/d1f/l26 0 2024-03-12T16:10:39.367 INFO:tasks.workunit.client.1.smithi134.stdout:9/372: mknod d5/d10/d35/d49/d54/c68 0 2024-03-12T16:10:39.368 INFO:tasks.workunit.client.1.smithi134.stdout:4/342: mkdir d1/de/d5a/d70 0 2024-03-12T16:10:39.368 INFO:tasks.workunit.client.1.smithi134.stdout:3/518: creat d1/db/d10/d2d/d2e/d72/fc7 x:0 0 0 2024-03-12T16:10:39.369 INFO:tasks.workunit.client.1.smithi134.stdout:3/519: stat d1/db/d12 0 2024-03-12T16:10:39.369 INFO:tasks.workunit.client.1.smithi134.stdout:4/343: read - d1/d13/d49/f5f zero size 2024-03-12T16:10:39.370 INFO:tasks.workunit.client.1.smithi134.stdout:9/373: write d5/d10/f1c [3929861,87011] 0 2024-03-12T16:10:39.370 INFO:tasks.workunit.client.1.smithi134.stdout:3/520: dread - d1/db/d12/d9d/fb3 zero size 2024-03-12T16:10:39.371 INFO:tasks.workunit.client.1.smithi134.stdout:9/374: readlink d5/d10/d1f/l30 0 2024-03-12T16:10:39.372 INFO:tasks.workunit.client.1.smithi134.stdout:3/521: dread - d1/db/d12/d9d/fc0 zero size 2024-03-12T16:10:39.372 INFO:tasks.workunit.client.0.smithi006.stdout:6/163: sync 2024-03-12T16:10:39.372 INFO:tasks.workunit.client.0.smithi006.stdout:8/155: sync 2024-03-12T16:10:39.372 INFO:tasks.workunit.client.0.smithi006.stdout:7/333: sync 2024-03-12T16:10:39.372 INFO:tasks.workunit.client.0.smithi006.stdout:5/127: sync 2024-03-12T16:10:39.372 INFO:tasks.workunit.client.0.smithi006.stdout:2/288: sync 2024-03-12T16:10:39.372 INFO:tasks.workunit.client.0.smithi006.stdout:3/202: sync 2024-03-12T16:10:39.372 INFO:tasks.workunit.client.0.smithi006.stdout:0/297: sync 2024-03-12T16:10:39.373 INFO:tasks.workunit.client.1.smithi134.stdout:9/375: mkdir d5/d20/d47/d69 0 2024-03-12T16:10:39.373 INFO:tasks.workunit.client.0.smithi006.stdout:5/128: fdatasync d7/f28 0 2024-03-12T16:10:39.374 INFO:tasks.workunit.client.1.smithi134.stdout:9/376: chown d5/d10/d35/f3a 1640577234 1 2024-03-12T16:10:39.374 INFO:tasks.workunit.client.0.smithi006.stdout:8/156: stat d2/d11/f27 0 2024-03-12T16:10:39.375 INFO:tasks.workunit.client.1.smithi134.stdout:3/522: dread d1/db/d10/d2a/f51 [0,4194304] 0 2024-03-12T16:10:39.377 INFO:tasks.workunit.client.1.smithi134.stdout:9/377: creat d5/d10/f6a x:0 0 0 2024-03-12T16:10:39.378 INFO:tasks.workunit.client.1.smithi134.stdout:3/523: symlink d1/db/d12/d9d/dc5/lc8 0 2024-03-12T16:10:39.378 INFO:tasks.workunit.client.1.smithi134.stdout:9/378: readlink d5/d10/l4e 0 2024-03-12T16:10:39.380 INFO:tasks.workunit.client.0.smithi006.stdout:0/298: creat d2/d39/d42/f56 x:0 0 0 2024-03-12T16:10:39.381 INFO:tasks.workunit.client.0.smithi006.stdout:0/299: fdatasync d2/f2c 0 2024-03-12T16:10:39.381 INFO:tasks.workunit.client.1.smithi134.stdout:7/386: fsync d8/f1f 0 2024-03-12T16:10:39.385 INFO:tasks.workunit.client.0.smithi006.stdout:8/157: dwrite d2/db/d1a/d1f/f31 [0,4194304] 0 2024-03-12T16:10:39.388 INFO:tasks.workunit.client.1.smithi134.stdout:3/524: dwrite d1/db/d14/f7b [0,4194304] 0 2024-03-12T16:10:39.388 INFO:tasks.workunit.client.0.smithi006.stdout:9/192: write d0/d8/f13 [149072,51216] 0 2024-03-12T16:10:39.389 INFO:tasks.workunit.client.1.smithi134.stdout:7/387: creat d8/f79 x:0 0 0 2024-03-12T16:10:39.390 INFO:tasks.workunit.client.0.smithi006.stdout:5/129: creat d7/d9/d10/d24/f2d x:0 0 0 2024-03-12T16:10:39.391 INFO:tasks.workunit.client.0.smithi006.stdout:9/193: dread d0/d4/f25 [0,4194304] 0 2024-03-12T16:10:39.392 INFO:tasks.workunit.client.0.smithi006.stdout:6/164: getdents d3/d11 0 2024-03-12T16:10:39.393 INFO:tasks.workunit.client.0.smithi006.stdout:3/203: write d8/df/d2c/dc/d28/f29 [956966,122537] 0 2024-03-12T16:10:39.393 INFO:tasks.workunit.client.0.smithi006.stdout:6/165: chown d3/f9 7787857 1 2024-03-12T16:10:39.394 INFO:tasks.workunit.client.1.smithi134.stdout:4/344: dread d1/de/f17 [0,4194304] 0 2024-03-12T16:10:39.396 INFO:tasks.workunit.client.0.smithi006.stdout:9/194: dread d0/d8/d2b/d20/f34 [0,4194304] 0 2024-03-12T16:10:39.396 INFO:tasks.workunit.client.0.smithi006.stdout:0/300: mknod d2/d39/d42/c57 0 2024-03-12T16:10:39.398 INFO:tasks.workunit.client.0.smithi006.stdout:2/289: link d0/dc/f15 d0/d13/d49/d60/d2b/f63 0 2024-03-12T16:10:39.399 INFO:tasks.workunit.client.0.smithi006.stdout:3/204: write d8/df/d2c/dc/f38 [5473006,5847] 0 2024-03-12T16:10:39.399 INFO:tasks.workunit.client.1.smithi134.stdout:7/388: link d8/dc/d2f/d31/l6f d8/d4e/l7a 0 2024-03-12T16:10:39.401 INFO:tasks.workunit.client.0.smithi006.stdout:4/287: sync 2024-03-12T16:10:39.401 INFO:tasks.workunit.client.0.smithi006.stdout:5/130: fsync d7/d9/d10/d24/f2d 0 2024-03-12T16:10:39.402 INFO:tasks.workunit.client.1.smithi134.stdout:7/389: mkdir d8/dc/d7b 0 2024-03-12T16:10:39.403 INFO:tasks.workunit.client.0.smithi006.stdout:7/334: link de/c64 de/d18/d2a/d40/c77 0 2024-03-12T16:10:39.404 INFO:tasks.workunit.client.0.smithi006.stdout:3/205: write d8/df/f1e [3952600,80869] 0 2024-03-12T16:10:39.404 INFO:tasks.workunit.client.0.smithi006.stdout:0/301: truncate d2/d39/d42/f56 163229 0 2024-03-12T16:10:39.405 INFO:tasks.workunit.client.0.smithi006.stdout:9/195: truncate d0/d8/d16/f31 1236801 0 2024-03-12T16:10:39.408 INFO:tasks.workunit.client.0.smithi006.stdout:7/335: mknod de/d18/c78 0 2024-03-12T16:10:39.408 INFO:tasks.workunit.client.0.smithi006.stdout:3/206: dread - d8/df/d2c/dc/f2a zero size 2024-03-12T16:10:39.408 INFO:tasks.workunit.client.0.smithi006.stdout:4/288: stat d1/db/d1d/d2f/c58 0 2024-03-12T16:10:39.409 INFO:tasks.workunit.client.0.smithi006.stdout:5/131: creat d7/d9/d27/f2e x:0 0 0 2024-03-12T16:10:39.410 INFO:tasks.workunit.client.1.smithi134.stdout:7/390: dwrite d8/dc/d55/f5f [0,4194304] 0 2024-03-12T16:10:39.410 INFO:tasks.workunit.client.0.smithi006.stdout:3/207: fsync d8/d19/d31/f35 0 2024-03-12T16:10:39.411 INFO:tasks.workunit.client.0.smithi006.stdout:9/196: chown d0/f28 632 1 2024-03-12T16:10:39.412 INFO:tasks.workunit.client.0.smithi006.stdout:2/290: truncate d0/d13/d49/d60/f36 242288 0 2024-03-12T16:10:39.413 INFO:tasks.workunit.client.0.smithi006.stdout:0/302: creat d2/d39/d42/f58 x:0 0 0 2024-03-12T16:10:39.413 INFO:tasks.workunit.client.1.smithi134.stdout:7/391: rmdir d8/d27 39 2024-03-12T16:10:39.413 INFO:tasks.workunit.client.0.smithi006.stdout:7/336: chown de/d27/d2b/d66 20 1 2024-03-12T16:10:39.414 INFO:tasks.workunit.client.1.smithi134.stdout:7/392: mkdir d8/dc/d2f/d31/d7c 0 2024-03-12T16:10:39.418 INFO:tasks.workunit.client.1.smithi134.stdout:3/525: dread d1/d63/d6c/f6d [4194304,4194304] 0 2024-03-12T16:10:39.419 INFO:tasks.workunit.client.0.smithi006.stdout:8/158: dread d2/f16 [0,4194304] 0 2024-03-12T16:10:39.419 INFO:tasks.workunit.client.0.smithi006.stdout:2/291: fdatasync d0/dc/f1a 0 2024-03-12T16:10:39.419 INFO:tasks.workunit.client.0.smithi006.stdout:6/166: write d3/d11/d10/d1b/d20/d26/f2e [823570,6296] 0 2024-03-12T16:10:39.419 INFO:tasks.workunit.client.0.smithi006.stdout:7/337: fsync de/d18/d2a/f67 0 2024-03-12T16:10:39.419 INFO:tasks.workunit.client.0.smithi006.stdout:0/303: stat d2/d6/d10/l16 0 2024-03-12T16:10:39.420 INFO:tasks.workunit.client.0.smithi006.stdout:5/132: rmdir d7/d9/d10/d24 39 2024-03-12T16:10:39.420 INFO:tasks.workunit.client.0.smithi006.stdout:0/304: stat d2/fd 0 2024-03-12T16:10:39.421 INFO:tasks.workunit.client.0.smithi006.stdout:3/208: truncate d8/df/f18 3887325 0 2024-03-12T16:10:39.422 INFO:tasks.workunit.client.1.smithi134.stdout:3/526: creat d1/db/d10/d2d/d30/fc9 x:0 0 0 2024-03-12T16:10:39.422 INFO:tasks.workunit.client.1.smithi134.stdout:4/345: write d1/d13/d49/d64/d28/f3b [1735872,61787] 0 2024-03-12T16:10:39.423 INFO:tasks.workunit.client.0.smithi006.stdout:7/338: readlink de/d27/l5f 0 2024-03-12T16:10:39.426 INFO:tasks.workunit.client.0.smithi006.stdout:2/292: chown d0/dc/f15 7 1 2024-03-12T16:10:39.427 INFO:tasks.workunit.client.1.smithi134.stdout:3/527: dread d1/db/d14/f42 [0,4194304] 0 2024-03-12T16:10:39.427 INFO:tasks.workunit.client.0.smithi006.stdout:6/167: truncate d3/d11/d10/d1b/d20/d26/f34 111362 0 2024-03-12T16:10:39.428 INFO:tasks.workunit.client.0.smithi006.stdout:4/289: link d1/c12 d1/d38/c5b 0 2024-03-12T16:10:39.428 INFO:tasks.workunit.client.0.smithi006.stdout:7/339: stat de/d18/d2a/f67 0 2024-03-12T16:10:39.429 INFO:tasks.workunit.client.1.smithi134.stdout:7/393: dread d8/dc/d20/f21 [0,4194304] 0 2024-03-12T16:10:39.429 INFO:tasks.workunit.client.0.smithi006.stdout:8/159: symlink d2/db/d1a/l35 0 2024-03-12T16:10:39.430 INFO:tasks.workunit.client.1.smithi134.stdout:4/346: dwrite d1/d13/d49/f32 [4194304,4194304] 0 2024-03-12T16:10:39.432 INFO:tasks.workunit.client.1.smithi134.stdout:4/347: read - d1/d13/f5b zero size 2024-03-12T16:10:39.432 INFO:tasks.workunit.client.1.smithi134.stdout:3/528: unlink d1/db/d10/d2d/d2e/l3a 0 2024-03-12T16:10:39.436 INFO:tasks.workunit.client.1.smithi134.stdout:4/348: unlink d1/la 0 2024-03-12T16:10:39.436 INFO:tasks.workunit.client.0.smithi006.stdout:0/305: dwrite d2/f1f [0,4194304] 0 2024-03-12T16:10:39.436 INFO:tasks.workunit.client.0.smithi006.stdout:8/160: fdatasync d2/db/d1a/f1c 0 2024-03-12T16:10:39.437 INFO:tasks.workunit.client.1.smithi134.stdout:7/394: creat d8/dc/f7d x:0 0 0 2024-03-12T16:10:39.437 INFO:tasks.workunit.client.1.smithi134.stdout:7/395: read d8/f1f [3553259,101383] 0 2024-03-12T16:10:39.438 INFO:tasks.workunit.client.0.smithi006.stdout:9/197: truncate d0/d8/f38 182545 0 2024-03-12T16:10:39.438 INFO:tasks.workunit.client.1.smithi134.stdout:3/529: mkdir d1/db/d10/dca 0 2024-03-12T16:10:39.440 INFO:tasks.workunit.client.0.smithi006.stdout:7/340: creat de/d27/d2b/d4a/d6a/f79 x:0 0 0 2024-03-12T16:10:39.440 INFO:tasks.workunit.client.1.smithi134.stdout:3/530: truncate d1/db/d10/d2a/f44 1676864 0 2024-03-12T16:10:39.441 INFO:tasks.workunit.client.0.smithi006.stdout:0/306: write d2/d6/d10/d11/d32/f4a [147260,47238] 0 2024-03-12T16:10:39.444 INFO:tasks.workunit.client.0.smithi006.stdout:4/290: creat d1/db/d17/d5a/f5c x:0 0 0 2024-03-12T16:10:39.444 INFO:tasks.workunit.client.0.smithi006.stdout:7/341: fdatasync de/d1c/f25 0 2024-03-12T16:10:39.445 INFO:tasks.workunit.client.1.smithi134.stdout:3/531: creat d1/db/d10/d2d/d2e/d72/d97/fcb x:0 0 0 2024-03-12T16:10:39.446 INFO:tasks.workunit.client.1.smithi134.stdout:7/396: getdents d8/dc/d55/d57 0 2024-03-12T16:10:39.446 INFO:tasks.workunit.client.0.smithi006.stdout:7/342: readlink de/d1c/l41 0 2024-03-12T16:10:39.449 INFO:tasks.workunit.client.1.smithi134.stdout:3/532: creat d1/db/d10/fcc x:0 0 0 2024-03-12T16:10:39.450 INFO:tasks.workunit.client.1.smithi134.stdout:3/533: stat d1/db/d10/d2a/l7c 0 2024-03-12T16:10:39.453 INFO:tasks.workunit.client.0.smithi006.stdout:5/133: dread f4 [0,4194304] 0 2024-03-12T16:10:39.454 INFO:tasks.workunit.client.1.smithi134.stdout:3/534: rename d1/f5 to d1/d63/d6c/fcd 0 2024-03-12T16:10:39.463 INFO:tasks.workunit.client.1.smithi134.stdout:4/349: dwrite d1/d13/f26 [0,4194304] 0 2024-03-12T16:10:39.465 INFO:tasks.workunit.client.1.smithi134.stdout:3/535: dwrite d1/db/d10/d2d/f5e [0,4194304] 0 2024-03-12T16:10:39.467 INFO:tasks.workunit.client.1.smithi134.stdout:3/536: write d1/db/d12/f60 [796873,76010] 0 2024-03-12T16:10:39.471 INFO:tasks.workunit.client.1.smithi134.stdout:4/350: creat d1/d13/f71 x:0 0 0 2024-03-12T16:10:39.473 INFO:tasks.workunit.client.1.smithi134.stdout:3/537: creat d1/db/d10/d2d/d2e/d72/fce x:0 0 0 2024-03-12T16:10:39.477 INFO:tasks.workunit.client.1.smithi134.stdout:3/538: unlink d1/db/d14/laa 0 2024-03-12T16:10:39.477 INFO:tasks.workunit.client.1.smithi134.stdout:3/539: chown d1/db/d12/f1e 3138354 1 2024-03-12T16:10:39.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/540: chown d1/db/d14/c70 1108905 1 2024-03-12T16:10:39.478 INFO:tasks.workunit.client.1.smithi134.stdout:3/541: stat d1/db/c54 0 2024-03-12T16:10:39.479 INFO:tasks.workunit.client.1.smithi134.stdout:4/351: rename d1/l2b to d1/d13/d49/d64/d35/l72 0 2024-03-12T16:10:39.481 INFO:tasks.workunit.client.1.smithi134.stdout:7/397: dread d8/dc/d4b/f44 [0,4194304] 0 2024-03-12T16:10:39.482 INFO:tasks.workunit.client.1.smithi134.stdout:3/542: creat d1/db/d10/d2d/d2e/fcf x:0 0 0 2024-03-12T16:10:39.483 INFO:tasks.workunit.client.1.smithi134.stdout:4/352: write d1/f23 [1545014,123428] 0 2024-03-12T16:10:39.484 INFO:tasks.workunit.client.1.smithi134.stdout:7/398: creat d8/dc/d55/d57/f7e x:0 0 0 2024-03-12T16:10:39.486 INFO:tasks.workunit.client.1.smithi134.stdout:3/543: creat d1/db/d10/d2a/dc6/fd0 x:0 0 0 2024-03-12T16:10:39.488 INFO:tasks.workunit.client.1.smithi134.stdout:3/544: stat d1/db/d14/lac 0 2024-03-12T16:10:39.495 INFO:tasks.workunit.client.0.smithi006.stdout:3/209: rename d8/df/f18 to d8/d19/d26/f43 0 2024-03-12T16:10:39.497 INFO:tasks.workunit.client.1.smithi134.stdout:7/399: link d8/dc/d55/c5a d8/d27/c7f 0 2024-03-12T16:10:39.498 INFO:tasks.workunit.client.0.smithi006.stdout:3/210: dread - d8/df/d2c/dc/d28/f40 zero size 2024-03-12T16:10:39.498 INFO:tasks.workunit.client.1.smithi134.stdout:7/400: truncate d8/dc/f7d 633763 0 2024-03-12T16:10:39.500 INFO:tasks.workunit.client.1.smithi134.stdout:7/401: chown d8/dc/d2f/d31/l6f 179 1 2024-03-12T16:10:39.501 INFO:tasks.workunit.client.0.smithi006.stdout:6/168: dwrite f1 [0,4194304] 0 2024-03-12T16:10:39.501 INFO:tasks.workunit.client.1.smithi134.stdout:4/353: getdents d1/d13/d49/d64/d35 0 2024-03-12T16:10:39.502 INFO:tasks.workunit.client.1.smithi134.stdout:4/354: write d1/d13/d49/f32 [2347210,57460] 0 2024-03-12T16:10:39.503 INFO:tasks.workunit.client.0.smithi006.stdout:6/169: truncate d3/d11/d10/d1b/d20/f36 552400 0 2024-03-12T16:10:39.504 INFO:tasks.workunit.client.0.smithi006.stdout:6/170: read d3/d11/f15 [417218,106588] 0 2024-03-12T16:10:39.508 INFO:tasks.workunit.client.1.smithi134.stdout:3/545: getdents d1/db/d10/d2d/d2e 0 2024-03-12T16:10:39.508 INFO:tasks.workunit.client.1.smithi134.stdout:7/402: chown d8/dc/d55/c5a 424 1 2024-03-12T16:10:39.508 INFO:tasks.workunit.client.1.smithi134.stdout:4/355: mkdir d1/d24/d34/d73 0 2024-03-12T16:10:39.510 INFO:tasks.workunit.client.1.smithi134.stdout:7/403: mknod d8/d27/c80 0 2024-03-12T16:10:39.513 INFO:tasks.workunit.client.1.smithi134.stdout:7/404: dread d8/dc/d4b/f44 [4194304,4194304] 0 2024-03-12T16:10:39.514 INFO:tasks.workunit.client.1.smithi134.stdout:7/405: chown d8/f1f 1987928 1 2024-03-12T16:10:39.516 INFO:tasks.workunit.client.1.smithi134.stdout:3/546: dwrite d1/f7e [0,4194304] 0 2024-03-12T16:10:39.518 INFO:tasks.workunit.client.1.smithi134.stdout:7/406: mkdir d8/dc/d55/d81 0 2024-03-12T16:10:39.518 INFO:tasks.workunit.client.1.smithi134.stdout:6/408: sync 2024-03-12T16:10:39.518 INFO:tasks.workunit.client.1.smithi134.stdout:5/505: sync 2024-03-12T16:10:39.518 INFO:tasks.workunit.client.1.smithi134.stdout:1/301: sync 2024-03-12T16:10:39.518 INFO:tasks.workunit.client.1.smithi134.stdout:0/464: sync 2024-03-12T16:10:39.519 INFO:tasks.workunit.client.1.smithi134.stdout:8/395: sync 2024-03-12T16:10:39.519 INFO:tasks.workunit.client.1.smithi134.stdout:4/356: creat d1/f74 x:0 0 0 2024-03-12T16:10:39.521 INFO:tasks.workunit.client.1.smithi134.stdout:7/407: fdatasync d8/dc/d55/d57/f7e 0 2024-03-12T16:10:39.522 INFO:tasks.workunit.client.1.smithi134.stdout:5/506: unlink db/l5b 0 2024-03-12T16:10:39.523 INFO:tasks.workunit.client.1.smithi134.stdout:7/408: chown d8/dc/d2f 0 1 2024-03-12T16:10:39.525 INFO:tasks.workunit.client.1.smithi134.stdout:6/409: truncate d1/f5 469852 0 2024-03-12T16:10:39.527 INFO:tasks.workunit.client.1.smithi134.stdout:3/547: truncate d1/db/d10/d2d/f9a 1331149 0 2024-03-12T16:10:39.528 INFO:tasks.workunit.client.1.smithi134.stdout:8/396: rmdir d3/d1b/d17/d24 39 2024-03-12T16:10:39.531 INFO:tasks.workunit.client.1.smithi134.stdout:7/409: creat d8/d4e/f82 x:0 0 0 2024-03-12T16:10:39.533 INFO:tasks.workunit.client.1.smithi134.stdout:0/465: dwrite db/f24 [0,4194304] 0 2024-03-12T16:10:39.534 INFO:tasks.workunit.client.1.smithi134.stdout:5/507: creat db/d12/d37/d71/d90/fa6 x:0 0 0 2024-03-12T16:10:39.535 INFO:tasks.workunit.client.1.smithi134.stdout:4/357: write d1/d13/f1d [1025533,18429] 0 2024-03-12T16:10:39.536 INFO:tasks.workunit.client.0.smithi006.stdout:1/193: sync 2024-03-12T16:10:39.540 INFO:tasks.workunit.client.1.smithi134.stdout:5/508: dread - db/d12/d29/f9a zero size 2024-03-12T16:10:39.541 INFO:tasks.workunit.client.1.smithi134.stdout:1/302: dwrite d0/d16/d9/d1c/f61 [0,4194304] 0 2024-03-12T16:10:39.542 INFO:tasks.workunit.client.1.smithi134.stdout:0/466: mkdir db/d2f/d31/d56/d9a 0 2024-03-12T16:10:39.545 INFO:tasks.workunit.client.1.smithi134.stdout:4/358: symlink d1/de/l75 0 2024-03-12T16:10:39.547 INFO:tasks.workunit.client.1.smithi134.stdout:6/410: dwrite d1/f26 [0,4194304] 0 2024-03-12T16:10:39.550 INFO:tasks.workunit.client.1.smithi134.stdout:7/410: creat d8/dc/d55/d57/f83 x:0 0 0 2024-03-12T16:10:39.550 INFO:tasks.workunit.client.1.smithi134.stdout:7/411: chown d8 2671 1 2024-03-12T16:10:39.552 INFO:tasks.workunit.client.1.smithi134.stdout:8/397: mknod d3/d1b/d17/d24/c78 0 2024-03-12T16:10:39.553 INFO:tasks.workunit.client.1.smithi134.stdout:1/303: unlink d0/f5d 0 2024-03-12T16:10:39.557 INFO:tasks.workunit.client.1.smithi134.stdout:4/359: creat d1/d13/d49/d6d/f76 x:0 0 0 2024-03-12T16:10:39.559 INFO:tasks.workunit.client.1.smithi134.stdout:3/548: truncate d1/db/d12/fb1 1963554 0 2024-03-12T16:10:39.561 INFO:tasks.workunit.client.0.smithi006.stdout:5/134: rmdir d7/d9/d27 39 2024-03-12T16:10:39.561 INFO:tasks.workunit.client.1.smithi134.stdout:8/398: fsync d3/d1b/d17/d24/f2d 0 2024-03-12T16:10:39.564 INFO:tasks.workunit.client.0.smithi006.stdout:2/293: dwrite d0/d13/d49/d60/f3b [0,4194304] 0 2024-03-12T16:10:39.566 INFO:tasks.workunit.client.1.smithi134.stdout:7/412: rename d8/dc/l1c to d8/dc/d2f/d31/l84 0 2024-03-12T16:10:39.566 INFO:tasks.workunit.client.0.smithi006.stdout:3/211: symlink d8/df/l44 0 2024-03-12T16:10:39.568 INFO:tasks.workunit.client.1.smithi134.stdout:0/467: getdents db 0 2024-03-12T16:10:39.569 INFO:tasks.workunit.client.1.smithi134.stdout:3/549: dwrite d1/db/d10/d2d/d2e/d72/d97/fa5 [0,4194304] 0 2024-03-12T16:10:39.570 INFO:tasks.workunit.client.1.smithi134.stdout:0/468: fdatasync db/d2f/f52 0 2024-03-12T16:10:39.570 INFO:tasks.workunit.client.1.smithi134.stdout:4/360: symlink d1/d13/l77 0 2024-03-12T16:10:39.570 INFO:tasks.workunit.client.0.smithi006.stdout:1/194: rename d0/f12 to d0/f3e 0 2024-03-12T16:10:39.571 INFO:tasks.workunit.client.0.smithi006.stdout:9/198: dwrite d0/d4/f25 [0,4194304] 0 2024-03-12T16:10:39.572 INFO:tasks.workunit.client.0.smithi006.stdout:4/291: truncate d1/d38/f57 31686 0 2024-03-12T16:10:39.573 INFO:tasks.workunit.client.0.smithi006.stdout:7/343: symlink de/d2c/d4f/l7a 0 2024-03-12T16:10:39.574 INFO:tasks.workunit.client.0.smithi006.stdout:7/344: chown de/d18/d2a/f67 1 1 2024-03-12T16:10:39.574 INFO:tasks.workunit.client.1.smithi134.stdout:5/509: getdents db/d12/d1d/d3a/d4e 0 2024-03-12T16:10:39.578 INFO:tasks.workunit.client.0.smithi006.stdout:5/135: write d7/d9/d27/f2e [229231,124677] 0 2024-03-12T16:10:39.578 INFO:tasks.workunit.client.1.smithi134.stdout:5/510: write db/d12/d1d/d59/f8b [807915,125068] 0 2024-03-12T16:10:39.584 INFO:tasks.workunit.client.0.smithi006.stdout:1/195: mkdir d0/d25/d2a/d35/d3f 0 2024-03-12T16:10:39.584 INFO:tasks.workunit.client.1.smithi134.stdout:6/411: getdents d1/d16/d4c/d65 0 2024-03-12T16:10:39.584 INFO:tasks.workunit.client.1.smithi134.stdout:0/469: mknod db/d2f/d61/d7a/c9b 0 2024-03-12T16:10:39.584 INFO:tasks.workunit.client.1.smithi134.stdout:1/304: getdents d0/d16/d9/d51 0 2024-03-12T16:10:39.584 INFO:tasks.workunit.client.0.smithi006.stdout:4/292: dwrite d1/db/f22 [0,4194304] 0 2024-03-12T16:10:39.585 INFO:tasks.workunit.client.0.smithi006.stdout:0/307: getdents d2/d6/d10/d11 0 2024-03-12T16:10:39.587 INFO:tasks.workunit.client.0.smithi006.stdout:9/199: mknod d0/d8/c3e 0 2024-03-12T16:10:39.589 INFO:tasks.workunit.client.0.smithi006.stdout:4/293: dread - d1/db/f40 zero size 2024-03-12T16:10:39.589 INFO:tasks.workunit.client.0.smithi006.stdout:7/345: mkdir de/d7b 0 2024-03-12T16:10:39.589 INFO:tasks.workunit.client.0.smithi006.stdout:9/200: readlink d0/d1f/l26 0 2024-03-12T16:10:39.589 INFO:tasks.workunit.client.0.smithi006.stdout:9/201: stat d0 0 2024-03-12T16:10:39.590 INFO:tasks.workunit.client.1.smithi134.stdout:7/413: dwrite d8/dc/d20/f67 [0,4194304] 0 2024-03-12T16:10:39.591 INFO:tasks.workunit.client.1.smithi134.stdout:5/511: stat db/d12/d37/c8e 0 2024-03-12T16:10:39.592 INFO:tasks.workunit.client.1.smithi134.stdout:4/361: creat d1/d13/d49/f78 x:0 0 0 2024-03-12T16:10:39.593 INFO:tasks.workunit.client.0.smithi006.stdout:4/294: write d1/db/d17/f3d [6984251,56026] 0 2024-03-12T16:10:39.594 INFO:tasks.workunit.client.0.smithi006.stdout:4/295: readlink d1/db/d17/l28 0 2024-03-12T16:10:39.596 INFO:tasks.workunit.client.1.smithi134.stdout:6/412: creat d1/d3/d10/f9e x:0 0 0 2024-03-12T16:10:39.597 INFO:tasks.workunit.client.0.smithi006.stdout:0/308: creat d2/d39/d42/f59 x:0 0 0 2024-03-12T16:10:39.597 INFO:tasks.workunit.client.0.smithi006.stdout:3/212: getdents d8/df/d2c/dc/d28 0 2024-03-12T16:10:39.598 INFO:tasks.workunit.client.1.smithi134.stdout:7/414: chown d8/ff 70871 1 2024-03-12T16:10:39.601 INFO:tasks.workunit.client.1.smithi134.stdout:3/550: dwrite d1/db/d14/f23 [4194304,4194304] 0 2024-03-12T16:10:39.606 INFO:tasks.workunit.client.0.smithi006.stdout:7/346: dwrite de/d18/f19 [0,4194304] 0 2024-03-12T16:10:39.607 INFO:tasks.workunit.client.0.smithi006.stdout:4/296: rmdir d1 39 2024-03-12T16:10:39.607 INFO:tasks.workunit.client.1.smithi134.stdout:6/413: creat d1/d4d/f9f x:0 0 0 2024-03-12T16:10:39.607 INFO:tasks.workunit.client.1.smithi134.stdout:6/414: fdatasync d1/d3/f22 0 2024-03-12T16:10:39.608 INFO:tasks.workunit.client.1.smithi134.stdout:4/362: creat d1/d13/d49/d64/d35/f79 x:0 0 0 2024-03-12T16:10:39.610 INFO:tasks.workunit.client.1.smithi134.stdout:1/305: creat d0/f6b x:0 0 0 2024-03-12T16:10:39.611 INFO:tasks.workunit.client.0.smithi006.stdout:5/136: creat d7/f2f x:0 0 0 2024-03-12T16:10:39.611 INFO:tasks.workunit.client.1.smithi134.stdout:1/306: read - d0/f6b zero size 2024-03-12T16:10:39.612 INFO:tasks.workunit.client.0.smithi006.stdout:1/196: creat d0/d25/f40 x:0 0 0 2024-03-12T16:10:39.612 INFO:tasks.workunit.client.1.smithi134.stdout:4/363: chown d1/d13/d49/d64/d35/c40 12073290 1 2024-03-12T16:10:39.613 INFO:tasks.workunit.client.1.smithi134.stdout:1/307: readlink d0/d16/d9/d13/d21/d20/l49 0 2024-03-12T16:10:39.615 INFO:tasks.workunit.client.0.smithi006.stdout:3/213: chown d8/df/d2c/f1d 7 1 2024-03-12T16:10:39.617 INFO:tasks.workunit.client.1.smithi134.stdout:5/512: symlink db/d12/d37/d73/d8c/la7 0 2024-03-12T16:10:39.618 INFO:tasks.workunit.client.1.smithi134.stdout:3/551: rmdir d1/db/d14/d5a 39 2024-03-12T16:10:39.618 INFO:tasks.workunit.client.0.smithi006.stdout:0/309: dread f0 [0,4194304] 0 2024-03-12T16:10:39.619 INFO:tasks.workunit.client.0.smithi006.stdout:7/347: unlink de/d18/d2a/f44 0 2024-03-12T16:10:39.619 INFO:tasks.workunit.client.0.smithi006.stdout:3/214: fsync d8/df/d2c/f34 0 2024-03-12T16:10:39.619 INFO:tasks.workunit.client.1.smithi134.stdout:3/552: dread - d1/db/d12/d9d/d9f/fa9 zero size 2024-03-12T16:10:39.620 INFO:tasks.workunit.client.0.smithi006.stdout:9/202: dwrite d0/d4/f25 [0,4194304] 0 2024-03-12T16:10:39.620 INFO:tasks.workunit.client.1.smithi134.stdout:6/415: mkdir d1/d16/d4c/d58/da0 0 2024-03-12T16:10:39.621 INFO:tasks.workunit.client.1.smithi134.stdout:7/415: mknod d8/dc/d55/d81/c85 0 2024-03-12T16:10:39.622 INFO:tasks.workunit.client.0.smithi006.stdout:1/197: symlink d0/d25/d2a/l41 0 2024-03-12T16:10:39.623 INFO:tasks.workunit.client.0.smithi006.stdout:0/310: dread - d2/d6/d37/f45 zero size 2024-03-12T16:10:39.623 INFO:tasks.workunit.client.0.smithi006.stdout:1/198: chown d0/c22 139653 1 2024-03-12T16:10:39.625 INFO:tasks.workunit.client.0.smithi006.stdout:0/311: chown d2/d6/d10/l16 524018 1 2024-03-12T16:10:39.625 INFO:tasks.workunit.client.0.smithi006.stdout:9/203: write d0/d4/d3b/f3d [699997,62986] 0 2024-03-12T16:10:39.626 INFO:tasks.workunit.client.0.smithi006.stdout:7/348: mkdir de/d27/d7c 0 2024-03-12T16:10:39.629 INFO:tasks.workunit.client.0.smithi006.stdout:5/137: unlink d7/d8/l21 0 2024-03-12T16:10:39.629 INFO:tasks.workunit.client.1.smithi134.stdout:7/416: creat d8/dc/d2f/f86 x:0 0 0 2024-03-12T16:10:39.632 INFO:tasks.workunit.client.0.smithi006.stdout:3/215: mkdir d8/df/d2c/d41/d45 0 2024-03-12T16:10:39.633 INFO:tasks.workunit.client.0.smithi006.stdout:1/199: creat d0/d25/d2a/d35/f42 x:0 0 0 2024-03-12T16:10:39.634 INFO:tasks.workunit.client.1.smithi134.stdout:7/417: mkdir d8/dc/d55/d81/d87 0 2024-03-12T16:10:39.634 INFO:tasks.workunit.client.1.smithi134.stdout:6/416: creat d1/d3/d19/fa1 x:0 0 0 2024-03-12T16:10:39.635 INFO:tasks.workunit.client.0.smithi006.stdout:1/200: chown d0 800835 1 2024-03-12T16:10:39.635 INFO:tasks.workunit.client.1.smithi134.stdout:1/308: link d0/d16/d9/d13/l2b d0/d42/d47/l6c 0 2024-03-12T16:10:39.635 INFO:tasks.workunit.client.0.smithi006.stdout:9/204: rename d0/l3a to d0/d8/d16/d2f/l3f 0 2024-03-12T16:10:39.636 INFO:tasks.workunit.client.0.smithi006.stdout:7/349: dwrite de/d27/d2b/f37 [0,4194304] 0 2024-03-12T16:10:39.637 INFO:tasks.workunit.client.1.smithi134.stdout:5/513: dread db/d12/d1d/f23 [0,4194304] 0 2024-03-12T16:10:39.637 INFO:tasks.workunit.client.1.smithi134.stdout:6/417: write d1/d4/f14 [3515602,32357] 0 2024-03-12T16:10:39.641 INFO:tasks.workunit.client.0.smithi006.stdout:4/297: creat d1/db/d1d/f5d x:0 0 0 2024-03-12T16:10:39.645 INFO:tasks.workunit.client.0.smithi006.stdout:3/216: mknod d8/df/d2c/dc/c46 0 2024-03-12T16:10:39.646 INFO:tasks.workunit.client.0.smithi006.stdout:7/350: dwrite de/d18/f20 [0,4194304] 0 2024-03-12T16:10:39.646 INFO:tasks.workunit.client.1.smithi134.stdout:4/364: truncate d1/d24/f56 559936 0 2024-03-12T16:10:39.646 INFO:tasks.workunit.client.1.smithi134.stdout:5/514: mkdir db/d7a/da8 0 2024-03-12T16:10:39.646 INFO:tasks.workunit.client.1.smithi134.stdout:6/418: read d1/d3/d19/d32/f3c [3711740,20060] 0 2024-03-12T16:10:39.647 INFO:tasks.workunit.client.1.smithi134.stdout:1/309: rename d0/f2c to d0/d16/f6d 0 2024-03-12T16:10:39.647 INFO:tasks.workunit.client.1.smithi134.stdout:7/418: link d8/dc/d55/d81/c85 d8/dc/d4b/c88 0 2024-03-12T16:10:39.647 INFO:tasks.workunit.client.0.smithi006.stdout:1/201: mkdir d0/d25/d2a/d43 0 2024-03-12T16:10:39.649 INFO:tasks.workunit.client.1.smithi134.stdout:6/419: chown d1/d16/f72 814917 1 2024-03-12T16:10:39.649 INFO:tasks.workunit.client.1.smithi134.stdout:5/515: mkdir db/d12/d37/d71/da9 0 2024-03-12T16:10:39.650 INFO:tasks.workunit.client.1.smithi134.stdout:1/310: rename d0/d42 to d0/d42/d6e 22 2024-03-12T16:10:39.650 INFO:tasks.workunit.client.0.smithi006.stdout:9/205: symlink d0/d8/d23/l40 0 2024-03-12T16:10:39.650 INFO:tasks.workunit.client.0.smithi006.stdout:3/217: mkdir d8/d19/d47 0 2024-03-12T16:10:39.651 INFO:tasks.workunit.client.1.smithi134.stdout:2/415: sync 2024-03-12T16:10:39.652 INFO:tasks.workunit.client.1.smithi134.stdout:7/419: creat d8/d4e/f89 x:0 0 0 2024-03-12T16:10:39.653 INFO:tasks.workunit.client.1.smithi134.stdout:4/365: truncate d1/d13/d49/f65 887987 0 2024-03-12T16:10:39.653 INFO:tasks.workunit.client.0.smithi006.stdout:1/202: write d0/f16 [1557669,8079] 0 2024-03-12T16:10:39.654 INFO:tasks.workunit.client.0.smithi006.stdout:9/206: mknod d0/c41 0 2024-03-12T16:10:39.654 INFO:tasks.workunit.client.1.smithi134.stdout:3/553: dwrite d1/db/d14/f40 [0,4194304] 0 2024-03-12T16:10:39.657 INFO:tasks.workunit.client.0.smithi006.stdout:9/207: dread d0/d8/d2b/d20/f34 [0,4194304] 0 2024-03-12T16:10:39.657 INFO:tasks.workunit.client.0.smithi006.stdout:4/298: rename d1/db/d17/f3d to d1/db/d1d/f5e 0 2024-03-12T16:10:39.657 INFO:tasks.workunit.client.1.smithi134.stdout:6/420: mknod d1/d16/d4c/d58/d8e/ca2 0 2024-03-12T16:10:39.658 INFO:tasks.workunit.client.1.smithi134.stdout:1/311: write d0/d16/f18 [4403380,130684] 0 2024-03-12T16:10:39.660 INFO:tasks.workunit.client.1.smithi134.stdout:4/366: rmdir d1/de 39 2024-03-12T16:10:39.663 INFO:tasks.workunit.client.1.smithi134.stdout:7/420: rename d8/dc/f7d to d8/dc/d7b/f8a 0 2024-03-12T16:10:39.664 INFO:tasks.workunit.client.0.smithi006.stdout:3/218: rename d8/df/d2c/dc/l14 to d8/d19/d47/l48 0 2024-03-12T16:10:39.664 INFO:tasks.workunit.client.1.smithi134.stdout:3/554: write d1/db/d12/d9d/fc0 [609478,67877] 0 2024-03-12T16:10:39.664 INFO:tasks.workunit.client.0.smithi006.stdout:4/299: dread d1/db/d17/f53 [0,4194304] 0 2024-03-12T16:10:39.665 INFO:tasks.workunit.client.1.smithi134.stdout:6/421: mknod d1/d16/d7e/ca3 0 2024-03-12T16:10:39.666 INFO:tasks.workunit.client.0.smithi006.stdout:4/300: stat d1/db/d17/f1a 0 2024-03-12T16:10:39.666 INFO:tasks.workunit.client.1.smithi134.stdout:6/422: write d1/d3/f8d [181465,33932] 0 2024-03-12T16:10:39.667 INFO:tasks.workunit.client.1.smithi134.stdout:2/416: creat d4/d16/f94 x:0 0 0 2024-03-12T16:10:39.669 INFO:tasks.workunit.client.0.smithi006.stdout:9/208: write d0/d8/d2b/d20/f34 [273740,92453] 0 2024-03-12T16:10:39.669 INFO:tasks.workunit.client.1.smithi134.stdout:1/312: dread - d0/d16/d9/d1c/f1d zero size 2024-03-12T16:10:39.672 INFO:tasks.workunit.client.0.smithi006.stdout:4/301: symlink d1/db/d39/l5f 0 2024-03-12T16:10:39.672 INFO:tasks.workunit.client.0.smithi006.stdout:9/209: fsync d0/d4/d3b/f3d 0 2024-03-12T16:10:39.674 INFO:tasks.workunit.client.1.smithi134.stdout:7/421: creat d8/d4e/f8b x:0 0 0 2024-03-12T16:10:39.675 INFO:tasks.workunit.client.0.smithi006.stdout:4/302: chown d1/db/f3c 1 1 2024-03-12T16:10:39.676 INFO:tasks.workunit.client.1.smithi134.stdout:2/417: dread d4/d12/d1d/d34/d58/f93 [0,4194304] 0 2024-03-12T16:10:39.677 INFO:tasks.workunit.client.0.smithi006.stdout:4/303: readlink d1/l8 0 2024-03-12T16:10:39.677 INFO:tasks.workunit.client.0.smithi006.stdout:5/138: dwrite d7/d9/d10/f1b [0,4194304] 0 2024-03-12T16:10:39.677 INFO:tasks.workunit.client.1.smithi134.stdout:2/418: readlink d4/d12/d1d/d34/d58/l6a 0 2024-03-12T16:10:39.677 INFO:tasks.workunit.client.1.smithi134.stdout:1/313: mkdir d0/d16/d9/d13/d21/d5f/d6f 0 2024-03-12T16:10:39.679 INFO:tasks.workunit.client.1.smithi134.stdout:5/516: write db/d12/f40 [1183298,24035] 0 2024-03-12T16:10:39.680 INFO:tasks.workunit.client.0.smithi006.stdout:4/304: fsync d1/db/f29 0 2024-03-12T16:10:39.682 INFO:tasks.workunit.client.1.smithi134.stdout:7/422: mknod d8/dc/d2f/d31/c8c 0 2024-03-12T16:10:39.682 INFO:tasks.workunit.client.1.smithi134.stdout:5/517: readlink db/d12/d7b/l83 0 2024-03-12T16:10:39.684 INFO:tasks.workunit.client.0.smithi006.stdout:9/210: rename d0/d8/d16/d2f/l3f to d0/d8/d2b/d20/l42 0 2024-03-12T16:10:39.686 INFO:tasks.workunit.client.0.smithi006.stdout:9/211: chown d0/d8/d16 27198377 1 2024-03-12T16:10:39.687 INFO:tasks.workunit.client.0.smithi006.stdout:1/203: dwrite d0/f23 [0,4194304] 0 2024-03-12T16:10:39.688 INFO:tasks.workunit.client.0.smithi006.stdout:4/305: mkdir d1/db/d17/d5a/d60 0 2024-03-12T16:10:39.689 INFO:tasks.workunit.client.1.smithi134.stdout:4/367: getdents d1/d13/d49/d64/d28 0 2024-03-12T16:10:39.690 INFO:tasks.workunit.client.0.smithi006.stdout:5/139: creat d7/d9/f30 x:0 0 0 2024-03-12T16:10:39.692 INFO:tasks.workunit.client.1.smithi134.stdout:6/423: getdents d1 0 2024-03-12T16:10:39.692 INFO:tasks.workunit.client.0.smithi006.stdout:5/140: chown d7/d9/d10/f1a 2 1 2024-03-12T16:10:39.692 INFO:tasks.workunit.client.1.smithi134.stdout:7/423: symlink d8/dc/d2f/l8d 0 2024-03-12T16:10:39.693 INFO:tasks.workunit.client.1.smithi134.stdout:4/368: symlink d1/d13/d49/d64/d28/l7a 0 2024-03-12T16:10:39.693 INFO:tasks.workunit.client.0.smithi006.stdout:9/212: rename d0/d8/f13 to d0/d8/d16/f43 0 2024-03-12T16:10:39.694 INFO:tasks.workunit.client.0.smithi006.stdout:4/306: mkdir d1/db/d39/d42/d61 0 2024-03-12T16:10:39.696 INFO:tasks.workunit.client.0.smithi006.stdout:9/213: creat d0/d4/d18/f44 x:0 0 0 2024-03-12T16:10:39.697 INFO:tasks.workunit.client.0.smithi006.stdout:4/307: chown d1/c35 93 1 2024-03-12T16:10:39.697 INFO:tasks.workunit.client.0.smithi006.stdout:9/214: readlink d0/d1f/l26 0 2024-03-12T16:10:39.698 INFO:tasks.workunit.client.0.smithi006.stdout:4/308: chown d1/l34 107316029 1 2024-03-12T16:10:39.699 INFO:tasks.workunit.client.1.smithi134.stdout:7/424: chown d8/dc/d20/d26/f2b 134 1 2024-03-12T16:10:39.699 INFO:tasks.workunit.client.0.smithi006.stdout:1/204: dwrite d0/f2f [0,4194304] 0 2024-03-12T16:10:39.700 INFO:tasks.workunit.client.0.smithi006.stdout:9/215: symlink d0/d1f/l45 0 2024-03-12T16:10:39.700 INFO:tasks.workunit.client.1.smithi134.stdout:3/555: dwrite d1/fc [4194304,4194304] 0 2024-03-12T16:10:39.702 INFO:tasks.workunit.client.1.smithi134.stdout:1/314: dwrite d0/d16/d9/d1c/f61 [4194304,4194304] 0 2024-03-12T16:10:39.703 INFO:tasks.workunit.client.0.smithi006.stdout:9/216: chown d0/d8/c33 52529721 1 2024-03-12T16:10:39.707 INFO:tasks.workunit.client.1.smithi134.stdout:7/425: truncate d8/d4e/f82 318650 0 2024-03-12T16:10:39.712 INFO:tasks.workunit.client.0.smithi006.stdout:1/205: creat d0/d25/d2a/d43/f44 x:0 0 0 2024-03-12T16:10:39.715 INFO:tasks.workunit.client.1.smithi134.stdout:5/518: dwrite db/d12/d1d/d3a/f88 [0,4194304] 0 2024-03-12T16:10:39.716 INFO:tasks.workunit.client.1.smithi134.stdout:7/426: mknod d8/c8e 0 2024-03-12T16:10:39.718 INFO:tasks.workunit.client.0.smithi006.stdout:1/206: dwrite d0/d25/f32 [0,4194304] 0 2024-03-12T16:10:39.720 INFO:tasks.workunit.client.1.smithi134.stdout:7/427: chown d8/d4e/f82 136847 1 2024-03-12T16:10:39.721 INFO:tasks.workunit.client.1.smithi134.stdout:1/315: dwrite d0/d16/d9/d13/d21/d20/f44 [0,4194304] 0 2024-03-12T16:10:39.722 INFO:tasks.workunit.client.1.smithi134.stdout:5/519: creat db/d12/d37/d73/d8c/faa x:0 0 0 2024-03-12T16:10:39.724 INFO:tasks.workunit.client.1.smithi134.stdout:1/316: truncate d0/d16/d9/d13/d38/f41 490190 0 2024-03-12T16:10:39.724 INFO:tasks.workunit.client.1.smithi134.stdout:7/428: unlink d8/dc/d20/d26/f2c 0 2024-03-12T16:10:39.725 INFO:tasks.workunit.client.1.smithi134.stdout:6/424: dread d1/d16/d4c/d65/f6b [0,4194304] 0 2024-03-12T16:10:39.726 INFO:tasks.workunit.client.1.smithi134.stdout:1/317: fdatasync d0/f12 0 2024-03-12T16:10:39.727 INFO:tasks.workunit.client.1.smithi134.stdout:5/520: fdatasync db/d7d/f7c 0 2024-03-12T16:10:39.729 INFO:tasks.workunit.client.1.smithi134.stdout:1/318: write d0/d16/d9/d1c/f4e [973690,80018] 0 2024-03-12T16:10:39.730 INFO:tasks.workunit.client.1.smithi134.stdout:5/521: chown db/c21 7 1 2024-03-12T16:10:39.734 INFO:tasks.workunit.client.1.smithi134.stdout:4/369: dread d1/d13/d49/f32 [0,4194304] 0 2024-03-12T16:10:39.735 INFO:tasks.workunit.client.1.smithi134.stdout:7/429: dwrite d8/f2a [0,4194304] 0 2024-03-12T16:10:39.736 INFO:tasks.workunit.client.1.smithi134.stdout:1/319: unlink d0/d16/d9/d13/d21/d20/l60 0 2024-03-12T16:10:39.739 INFO:tasks.workunit.client.1.smithi134.stdout:7/430: symlink d8/l8f 0 2024-03-12T16:10:39.741 INFO:tasks.workunit.client.1.smithi134.stdout:4/370: rename d1/de/f6a to d1/d13/d49/d6d/f7b 0 2024-03-12T16:10:39.744 INFO:tasks.workunit.client.1.smithi134.stdout:4/371: stat d1/l52 0 2024-03-12T16:10:39.746 INFO:tasks.workunit.client.1.smithi134.stdout:5/522: dread db/d12/d1d/f35 [0,4194304] 0 2024-03-12T16:10:39.746 INFO:tasks.workunit.client.1.smithi134.stdout:4/372: stat d1/d13/l16 0 2024-03-12T16:10:39.747 INFO:tasks.workunit.client.1.smithi134.stdout:1/320: link d0/d16/d9/d1c/f4e d0/d16/d9/f70 0 2024-03-12T16:10:39.748 INFO:tasks.workunit.client.1.smithi134.stdout:7/431: mknod d8/c90 0 2024-03-12T16:10:39.749 INFO:tasks.workunit.client.1.smithi134.stdout:4/373: read d1/d13/d49/d64/d35/f54 [236596,21811] 0 2024-03-12T16:10:39.749 INFO:tasks.workunit.client.0.smithi006.stdout:1/207: unlink d0/l11 0 2024-03-12T16:10:39.749 INFO:tasks.workunit.client.1.smithi134.stdout:5/523: mkdir db/d12/d37/d73/d8c/dab 0 2024-03-12T16:10:39.750 INFO:tasks.workunit.client.0.smithi006.stdout:1/208: chown d0/f13 1868392 1 2024-03-12T16:10:39.752 INFO:tasks.workunit.client.1.smithi134.stdout:7/432: fsync d8/d4e/f52 0 2024-03-12T16:10:39.754 INFO:tasks.workunit.client.1.smithi134.stdout:7/433: write d8/d27/f73 [1235348,18194] 0 2024-03-12T16:10:39.755 INFO:tasks.workunit.client.0.smithi006.stdout:4/309: truncate d1/db/f22 309189 0 2024-03-12T16:10:39.755 INFO:tasks.workunit.client.1.smithi134.stdout:2/419: dread d4/f77 [0,4194304] 0 2024-03-12T16:10:39.756 INFO:tasks.workunit.client.0.smithi006.stdout:4/310: chown d1/c35 6992363 1 2024-03-12T16:10:39.756 INFO:tasks.workunit.client.0.smithi006.stdout:9/217: truncate d0/d4/f29 3416055 0 2024-03-12T16:10:39.757 INFO:tasks.workunit.client.1.smithi134.stdout:1/321: read d0/d16/d9/d13/d21/d20/f4f [51232,16053] 0 2024-03-12T16:10:39.757 INFO:tasks.workunit.client.0.smithi006.stdout:4/311: read d1/db/f29 [103038,97211] 0 2024-03-12T16:10:39.758 INFO:tasks.workunit.client.1.smithi134.stdout:4/374: rename d1/f74 to d1/d13/f7c 0 2024-03-12T16:10:39.759 INFO:tasks.workunit.client.0.smithi006.stdout:1/209: unlink d0/fa 0 2024-03-12T16:10:39.761 INFO:tasks.workunit.client.1.smithi134.stdout:7/434: mkdir d8/d4e/d91 0 2024-03-12T16:10:39.761 INFO:tasks.workunit.client.0.smithi006.stdout:9/218: chown d0/d4/f29 117809 1 2024-03-12T16:10:39.762 INFO:tasks.workunit.client.0.smithi006.stdout:1/210: creat d0/d25/d2a/d35/d3f/f45 x:0 0 0 2024-03-12T16:10:39.763 INFO:tasks.workunit.client.0.smithi006.stdout:9/219: creat d0/d8/d16/f46 x:0 0 0 2024-03-12T16:10:39.764 INFO:tasks.workunit.client.1.smithi134.stdout:1/322: write d0/f2a [4449364,99685] 0 2024-03-12T16:10:39.769 INFO:tasks.workunit.client.1.smithi134.stdout:3/556: dwrite d1/db/d10/f28 [0,4194304] 0 2024-03-12T16:10:39.775 INFO:tasks.workunit.client.1.smithi134.stdout:1/323: mkdir d0/d42/d71 0 2024-03-12T16:10:39.776 INFO:tasks.workunit.client.1.smithi134.stdout:7/435: link d8/d4e/f82 d8/dc/d2f/d31/d7c/f92 0 2024-03-12T16:10:39.778 INFO:tasks.workunit.client.1.smithi134.stdout:3/557: chown d1/db/d10/d2a/c8d 77 1 2024-03-12T16:10:39.778 INFO:tasks.workunit.client.1.smithi134.stdout:7/436: write d8/dc/d20/d26/f3a [538715,68964] 0 2024-03-12T16:10:39.779 INFO:tasks.workunit.client.1.smithi134.stdout:1/324: unlink d0/c5b 0 2024-03-12T16:10:39.779 INFO:tasks.workunit.client.1.smithi134.stdout:3/558: fdatasync d1/db/d10/d2d/d2e/d72/d97/fb7 0 2024-03-12T16:10:39.781 INFO:tasks.workunit.client.1.smithi134.stdout:3/559: read d1/db/d10/d2d/f9a [2216222,96283] 0 2024-03-12T16:10:39.783 INFO:tasks.workunit.client.1.smithi134.stdout:7/437: link d8/d27/f59 d8/dc/d2f/f93 0 2024-03-12T16:10:39.785 INFO:tasks.workunit.client.1.smithi134.stdout:3/560: symlink d1/db/d10/daf/ld1 0 2024-03-12T16:10:39.786 INFO:tasks.workunit.client.1.smithi134.stdout:1/325: read d0/d16/d9/d13/d21/d20/f4f [356655,65736] 0 2024-03-12T16:10:39.788 INFO:tasks.workunit.client.1.smithi134.stdout:3/561: mknod d1/d63/d6c/cd2 0 2024-03-12T16:10:39.789 INFO:tasks.workunit.client.1.smithi134.stdout:1/326: rmdir d0/d30/d48 39 2024-03-12T16:10:39.791 INFO:tasks.workunit.client.1.smithi134.stdout:3/562: readlink d1/db/d10/d2a/l8b 0 2024-03-12T16:10:39.791 INFO:tasks.workunit.client.1.smithi134.stdout:4/375: dread d1/d13/d49/d64/d28/f3b [0,4194304] 0 2024-03-12T16:10:39.794 INFO:tasks.workunit.client.1.smithi134.stdout:4/376: chown d1/d24 477920 1 2024-03-12T16:10:39.795 INFO:tasks.workunit.client.0.smithi006.stdout:4/312: dread d1/db/d17/f1e [4194304,4194304] 0 2024-03-12T16:10:39.796 INFO:tasks.workunit.client.0.smithi006.stdout:1/211: truncate d0/fc 3353845 0 2024-03-12T16:10:39.796 INFO:tasks.workunit.client.0.smithi006.stdout:1/212: readlink d0/d39/l3d 0 2024-03-12T16:10:39.797 INFO:tasks.workunit.client.1.smithi134.stdout:7/438: dwrite d8/dc/d20/f56 [0,4194304] 0 2024-03-12T16:10:39.797 INFO:tasks.workunit.client.0.smithi006.stdout:9/220: write d0/d8/f38 [611083,93988] 0 2024-03-12T16:10:39.798 INFO:tasks.workunit.client.0.smithi006.stdout:1/213: chown d0/d25/f36 2005146 1 2024-03-12T16:10:39.799 INFO:tasks.workunit.client.0.smithi006.stdout:4/313: link d1/db/d17/f1c d1/db/d17/d5a/f62 0 2024-03-12T16:10:39.801 INFO:tasks.workunit.client.1.smithi134.stdout:2/420: dread d4/d12/f32 [0,4194304] 0 2024-03-12T16:10:39.801 INFO:tasks.workunit.client.0.smithi006.stdout:1/214: creat d0/d25/d2a/d43/f46 x:0 0 0 2024-03-12T16:10:39.802 INFO:tasks.workunit.client.1.smithi134.stdout:3/563: dread d1/d63/f8c [0,4194304] 0 2024-03-12T16:10:39.803 INFO:tasks.workunit.client.0.smithi006.stdout:4/314: rmdir d1/db/d17/d5a 39 2024-03-12T16:10:39.803 INFO:tasks.workunit.client.1.smithi134.stdout:1/327: rename d0/d16/d9/d13/d21/f4d to d0/d16/d9/d13/d38/f72 0 2024-03-12T16:10:39.804 INFO:tasks.workunit.client.1.smithi134.stdout:2/421: readlink d4/d12/l28 0 2024-03-12T16:10:39.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/377: dread d1/d13/d49/d64/d28/f3b [0,4194304] 0 2024-03-12T16:10:39.806 INFO:tasks.workunit.client.0.smithi006.stdout:4/315: write d1/db/d1d/f49 [1662572,93950] 0 2024-03-12T16:10:39.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/328: write d0/d16/d9/d1c/f27 [4699692,39423] 0 2024-03-12T16:10:39.807 INFO:tasks.workunit.client.1.smithi134.stdout:3/564: read - d1/db/d10/d2d/d2e/d72/d97/fa8 zero size 2024-03-12T16:10:39.808 INFO:tasks.workunit.client.1.smithi134.stdout:2/422: mknod d4/d12/d3b/d3f/c95 0 2024-03-12T16:10:39.809 INFO:tasks.workunit.client.0.smithi006.stdout:9/221: dwrite d0/d8/d2b/d20/d37/f39 [0,4194304] 0 2024-03-12T16:10:39.809 INFO:tasks.workunit.client.1.smithi134.stdout:2/423: readlink d4/d12/d3b/l5e 0 2024-03-12T16:10:39.810 INFO:tasks.workunit.client.1.smithi134.stdout:2/424: chown d4/c1a 0 1 2024-03-12T16:10:39.810 INFO:tasks.workunit.client.1.smithi134.stdout:1/329: mkdir d0/d16/d9/d73 0 2024-03-12T16:10:39.812 INFO:tasks.workunit.client.0.smithi006.stdout:9/222: write d0/d8/d16/f46 [383314,110884] 0 2024-03-12T16:10:39.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/378: unlink d1/ld 0 2024-03-12T16:10:39.816 INFO:tasks.workunit.client.0.smithi006.stdout:4/316: creat d1/db/d1d/d2f/f63 x:0 0 0 2024-03-12T16:10:39.817 INFO:tasks.workunit.client.1.smithi134.stdout:7/439: write d8/ff [781259,87552] 0 2024-03-12T16:10:39.819 INFO:tasks.workunit.client.0.smithi006.stdout:1/215: dwrite d0/f37 [0,4194304] 0 2024-03-12T16:10:39.820 INFO:tasks.workunit.client.1.smithi134.stdout:7/440: getdents d8/d27 0 2024-03-12T16:10:39.822 INFO:tasks.workunit.client.1.smithi134.stdout:7/441: mknod d8/d4e/d91/c94 0 2024-03-12T16:10:39.826 INFO:tasks.workunit.client.1.smithi134.stdout:7/442: chown d8/dc/c77 17 1 2024-03-12T16:10:39.826 INFO:tasks.workunit.client.1.smithi134.stdout:7/443: chown d8/c5c 476583554 1 2024-03-12T16:10:39.827 INFO:tasks.workunit.client.1.smithi134.stdout:7/444: creat d8/dc/f95 x:0 0 0 2024-03-12T16:10:39.829 INFO:tasks.workunit.client.1.smithi134.stdout:7/445: symlink d8/d4e/d91/l96 0 2024-03-12T16:10:39.830 INFO:tasks.workunit.client.0.smithi006.stdout:9/223: dwrite d0/d8/d16/f46 [0,4194304] 0 2024-03-12T16:10:39.832 INFO:tasks.workunit.client.0.smithi006.stdout:4/317: dwrite d1/db/d17/f1e [0,4194304] 0 2024-03-12T16:10:39.835 INFO:tasks.workunit.client.1.smithi134.stdout:9/379: sync 2024-03-12T16:10:39.837 INFO:tasks.workunit.client.0.smithi006.stdout:9/224: fsync d0/d4/f25 0 2024-03-12T16:10:39.838 INFO:tasks.workunit.client.1.smithi134.stdout:3/565: write d1/db/d10/d2d/f9a [4388066,63072] 0 2024-03-12T16:10:39.840 INFO:tasks.workunit.client.0.smithi006.stdout:1/216: dwrite d0/d25/f32 [0,4194304] 0 2024-03-12T16:10:39.841 INFO:tasks.workunit.client.1.smithi134.stdout:3/566: mknod d1/db/d10/d2a/cd3 0 2024-03-12T16:10:39.841 INFO:tasks.workunit.client.1.smithi134.stdout:4/379: write d1/d13/d49/d64/d35/f54 [757408,28744] 0 2024-03-12T16:10:39.845 INFO:tasks.workunit.client.1.smithi134.stdout:9/380: creat d5/d20/d36/f6b x:0 0 0 2024-03-12T16:10:39.846 INFO:tasks.workunit.client.1.smithi134.stdout:3/567: chown d1/db/d10/d2d/d30/f92 30852 1 2024-03-12T16:10:39.847 INFO:tasks.workunit.client.1.smithi134.stdout:9/381: chown d5/d20/d36 420844914 1 2024-03-12T16:10:39.850 INFO:tasks.workunit.client.0.smithi006.stdout:9/225: dwrite d0/d4/d3b/f3d [0,4194304] 0 2024-03-12T16:10:39.851 INFO:tasks.workunit.client.1.smithi134.stdout:9/382: truncate d5/d20/f2b 4964614 0 2024-03-12T16:10:39.853 INFO:tasks.workunit.client.1.smithi134.stdout:7/446: dwrite d8/dc/d2f/d31/d7c/f92 [0,4194304] 0 2024-03-12T16:10:39.853 INFO:tasks.workunit.client.1.smithi134.stdout:4/380: rename d1/d13/d49/d64/d35/f29 to d1/d13/d49/d64/f7d 0 2024-03-12T16:10:39.853 INFO:tasks.workunit.client.0.smithi006.stdout:9/226: creat d0/d8/d2b/d20/d37/f47 x:0 0 0 2024-03-12T16:10:39.854 INFO:tasks.workunit.client.1.smithi134.stdout:4/381: chown d1/de/f17 84105 1 2024-03-12T16:10:39.858 INFO:tasks.workunit.client.1.smithi134.stdout:7/447: mkdir d8/dc/d4b/d97 0 2024-03-12T16:10:39.860 INFO:tasks.workunit.client.1.smithi134.stdout:7/448: fdatasync d8/d27/f73 0 2024-03-12T16:10:39.862 INFO:tasks.workunit.client.1.smithi134.stdout:4/382: unlink d1/d13/l16 0 2024-03-12T16:10:39.862 INFO:tasks.workunit.client.0.smithi006.stdout:8/161: sync 2024-03-12T16:10:39.863 INFO:tasks.workunit.client.1.smithi134.stdout:7/449: write d8/ff [209732,79987] 0 2024-03-12T16:10:39.863 INFO:tasks.workunit.client.1.smithi134.stdout:3/568: link d1/f65 d1/db/d14/fd4 0 2024-03-12T16:10:39.863 INFO:tasks.workunit.client.0.smithi006.stdout:8/162: write d2/d11/f2d [861292,68106] 0 2024-03-12T16:10:39.864 INFO:tasks.workunit.client.1.smithi134.stdout:9/383: dwrite d5/d46/f5c [0,4194304] 0 2024-03-12T16:10:39.866 INFO:tasks.workunit.client.0.smithi006.stdout:8/163: fdatasync d2/db/f13 0 2024-03-12T16:10:39.869 INFO:tasks.workunit.client.1.smithi134.stdout:3/569: write d1/d63/d6c/f6d [7963338,33960] 0 2024-03-12T16:10:39.870 INFO:tasks.workunit.client.1.smithi134.stdout:7/450: creat d8/dc/d2f/d31/f98 x:0 0 0 2024-03-12T16:10:39.870 INFO:tasks.workunit.client.0.smithi006.stdout:8/164: dread d2/d11/f27 [0,4194304] 0 2024-03-12T16:10:39.871 INFO:tasks.workunit.client.1.smithi134.stdout:4/383: truncate d1/d13/f26 5035703 0 2024-03-12T16:10:39.871 INFO:tasks.workunit.client.1.smithi134.stdout:9/384: getdents d5/d10/d35/d49/d54/d5e 0 2024-03-12T16:10:39.873 INFO:tasks.workunit.client.0.smithi006.stdout:1/217: write d0/d25/d2a/f3b [1744894,78236] 0 2024-03-12T16:10:39.873 INFO:tasks.workunit.client.1.smithi134.stdout:3/570: rename d1/db/d10/d2a/fb4 to d1/d63/d6c/dbf/fd5 0 2024-03-12T16:10:39.874 INFO:tasks.workunit.client.1.smithi134.stdout:7/451: creat d8/dc/d20/f99 x:0 0 0 2024-03-12T16:10:39.875 INFO:tasks.workunit.client.1.smithi134.stdout:3/571: write d1/db/d10/fcc [973694,15853] 0 2024-03-12T16:10:39.877 INFO:tasks.workunit.client.1.smithi134.stdout:3/572: chown d1/db/d14 0 1 2024-03-12T16:10:39.880 INFO:tasks.workunit.client.0.smithi006.stdout:1/218: rename d0/f3 to d0/d25/d2a/d43/f47 0 2024-03-12T16:10:39.881 INFO:tasks.workunit.client.0.smithi006.stdout:4/318: dwrite d1/db/d1d/f20 [0,4194304] 0 2024-03-12T16:10:39.884 INFO:tasks.workunit.client.1.smithi134.stdout:9/385: rename d5/d20/d36 to d5/d10/d6c 0 2024-03-12T16:10:39.885 INFO:tasks.workunit.client.1.smithi134.stdout:9/386: readlink d5/d20/d47/l5d 0 2024-03-12T16:10:39.886 INFO:tasks.workunit.client.1.smithi134.stdout:9/387: write d5/d46/f57 [142939,29124] 0 2024-03-12T16:10:39.889 INFO:tasks.workunit.client.0.smithi006.stdout:1/219: mknod d0/d25/c48 0 2024-03-12T16:10:39.889 INFO:tasks.workunit.client.0.smithi006.stdout:9/227: dwrite d0/d4/d3b/f3d [4194304,4194304] 0 2024-03-12T16:10:39.891 INFO:tasks.workunit.client.0.smithi006.stdout:9/228: chown d0/d4/f25 848253 1 2024-03-12T16:10:39.891 INFO:tasks.workunit.client.1.smithi134.stdout:9/388: symlink d5/d10/d35/d49/d54/l6d 0 2024-03-12T16:10:39.892 INFO:tasks.workunit.client.0.smithi006.stdout:9/229: chown d0/d8/d16/d2f 0 1 2024-03-12T16:10:39.892 INFO:tasks.workunit.client.0.smithi006.stdout:1/220: fdatasync d0/d25/d2a/d43/f47 0 2024-03-12T16:10:39.893 INFO:tasks.workunit.client.0.smithi006.stdout:9/230: chown d0/d8/c3e 306 1 2024-03-12T16:10:39.893 INFO:tasks.workunit.client.1.smithi134.stdout:4/384: truncate d1/d24/d34/f69 3693729 0 2024-03-12T16:10:39.893 INFO:tasks.workunit.client.0.smithi006.stdout:1/221: write d0/f2f [1585296,108922] 0 2024-03-12T16:10:39.899 INFO:tasks.workunit.client.1.smithi134.stdout:4/385: rename d1/d13/d49/d64/d28/d4f to d1/d13/d49/d64/d28/d4f/d7e 22 2024-03-12T16:10:39.899 INFO:tasks.workunit.client.1.smithi134.stdout:7/452: dread d8/dc/d20/f1d [0,4194304] 0 2024-03-12T16:10:39.899 INFO:tasks.workunit.client.0.smithi006.stdout:9/231: getdents d0/d8/d16/d2f 0 2024-03-12T16:10:39.901 INFO:tasks.workunit.client.1.smithi134.stdout:7/453: creat d8/dc/d55/d57/f9a x:0 0 0 2024-03-12T16:10:39.902 INFO:tasks.workunit.client.1.smithi134.stdout:4/386: creat d1/d13/f7f x:0 0 0 2024-03-12T16:10:39.902 INFO:tasks.workunit.client.1.smithi134.stdout:7/454: creat d8/dc/d20/d26/d36/f9b x:0 0 0 2024-03-12T16:10:39.905 INFO:tasks.workunit.client.0.smithi006.stdout:4/319: fsync d1/db/d1d/f20 0 2024-03-12T16:10:39.906 INFO:tasks.workunit.client.1.smithi134.stdout:4/387: rename d1/d13/d49/d6d/f7b to d1/d13/f80 0 2024-03-12T16:10:39.908 INFO:tasks.workunit.client.0.smithi006.stdout:4/320: chown d1/db/d17/f53 9116 1 2024-03-12T16:10:39.909 INFO:tasks.workunit.client.0.smithi006.stdout:9/232: dread d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:39.911 INFO:tasks.workunit.client.0.smithi006.stdout:1/222: dwrite d0/f21 [0,4194304] 0 2024-03-12T16:10:39.911 INFO:tasks.workunit.client.0.smithi006.stdout:4/321: read d1/db/f22 [33235,55844] 0 2024-03-12T16:10:39.912 INFO:tasks.workunit.client.0.smithi006.stdout:9/233: write d0/d4/d3b/f3d [4438018,126128] 0 2024-03-12T16:10:39.913 INFO:tasks.workunit.client.0.smithi006.stdout:1/223: readlink d0/d25/d2a/l41 0 2024-03-12T16:10:39.915 INFO:tasks.workunit.client.0.smithi006.stdout:4/322: read - d1/db/d1d/d2f/f63 zero size 2024-03-12T16:10:39.917 INFO:tasks.workunit.client.0.smithi006.stdout:9/234: creat d0/d8/d2b/f48 x:0 0 0 2024-03-12T16:10:39.917 INFO:tasks.workunit.client.0.smithi006.stdout:8/165: dread d2/f19 [0,4194304] 0 2024-03-12T16:10:39.919 INFO:tasks.workunit.client.0.smithi006.stdout:4/323: unlink d1/db/c16 0 2024-03-12T16:10:39.920 INFO:tasks.workunit.client.0.smithi006.stdout:1/224: rename d0/d25/d2a/d35/f42 to d0/d25/d2a/d43/f49 0 2024-03-12T16:10:39.922 INFO:tasks.workunit.client.0.smithi006.stdout:1/225: dread - d0/d25/d2a/d43/f46 zero size 2024-03-12T16:10:39.925 INFO:tasks.workunit.client.1.smithi134.stdout:7/455: truncate d8/dc/d20/d26/f50 1187024 0 2024-03-12T16:10:39.926 INFO:tasks.workunit.client.1.smithi134.stdout:9/389: dread d5/d10/d35/f3a [0,4194304] 0 2024-03-12T16:10:39.926 INFO:tasks.workunit.client.1.smithi134.stdout:4/388: write d1/d24/f56 [511259,56464] 0 2024-03-12T16:10:39.928 INFO:tasks.workunit.client.1.smithi134.stdout:7/456: write d8/dc/d20/f99 [244870,121895] 0 2024-03-12T16:10:39.931 INFO:tasks.workunit.client.1.smithi134.stdout:9/390: unlink d5/d10/d35/d49/l59 0 2024-03-12T16:10:39.933 INFO:tasks.workunit.client.1.smithi134.stdout:9/391: read d5/d10/d35/f1a [3629999,76317] 0 2024-03-12T16:10:39.934 INFO:tasks.workunit.client.0.smithi006.stdout:9/235: rename d0/c14 to d0/d1f/c49 0 2024-03-12T16:10:39.936 INFO:tasks.workunit.client.1.smithi134.stdout:4/389: creat d1/d13/d49/f81 x:0 0 0 2024-03-12T16:10:39.937 INFO:tasks.workunit.client.0.smithi006.stdout:1/226: fsync d0/fc 0 2024-03-12T16:10:39.938 INFO:tasks.workunit.client.1.smithi134.stdout:9/392: unlink d5/d10/d6c/c45 0 2024-03-12T16:10:39.939 INFO:tasks.workunit.client.0.smithi006.stdout:8/166: creat d2/f36 x:0 0 0 2024-03-12T16:10:39.941 INFO:tasks.workunit.client.0.smithi006.stdout:1/227: write d0/d25/f28 [580115,100970] 0 2024-03-12T16:10:39.941 INFO:tasks.workunit.client.1.smithi134.stdout:4/390: rmdir d1/d24/d34 39 2024-03-12T16:10:39.942 INFO:tasks.workunit.client.1.smithi134.stdout:7/457: read d8/dc/d20/d26/f50 [438742,15911] 0 2024-03-12T16:10:39.943 INFO:tasks.workunit.client.1.smithi134.stdout:7/458: dread - d8/dc/d2f/d31/f98 zero size 2024-03-12T16:10:39.944 INFO:tasks.workunit.client.1.smithi134.stdout:9/393: creat d5/d10/d1f/f6e x:0 0 0 2024-03-12T16:10:39.945 INFO:tasks.workunit.client.0.smithi006.stdout:0/312: sync 2024-03-12T16:10:39.945 INFO:tasks.workunit.client.0.smithi006.stdout:2/294: sync 2024-03-12T16:10:39.945 INFO:tasks.workunit.client.0.smithi006.stdout:6/171: sync 2024-03-12T16:10:39.946 INFO:tasks.workunit.client.0.smithi006.stdout:9/236: dwrite d0/d8/d16/f46 [0,4194304] 0 2024-03-12T16:10:39.947 INFO:tasks.workunit.client.1.smithi134.stdout:7/459: write d8/dc/d55/d57/f7e [519229,1776] 0 2024-03-12T16:10:39.948 INFO:tasks.workunit.client.0.smithi006.stdout:8/167: chown d2/db/d1a/f1c 9 1 2024-03-12T16:10:39.949 INFO:tasks.workunit.client.0.smithi006.stdout:4/324: link d1/db/d17/f1a d1/db/f64 0 2024-03-12T16:10:39.950 INFO:tasks.workunit.client.1.smithi134.stdout:9/394: unlink d5/d10/c17 0 2024-03-12T16:10:39.951 INFO:tasks.workunit.client.0.smithi006.stdout:1/228: symlink d0/d25/d2a/d43/l4a 0 2024-03-12T16:10:39.951 INFO:tasks.workunit.client.1.smithi134.stdout:7/460: mknod d8/dc/d55/d81/c9c 0 2024-03-12T16:10:39.952 INFO:tasks.workunit.client.1.smithi134.stdout:9/395: readlink d5/d10/d1f/l37 0 2024-03-12T16:10:39.954 INFO:tasks.workunit.client.1.smithi134.stdout:4/391: dwrite d1/d13/d49/d64/d28/f3b [0,4194304] 0 2024-03-12T16:10:39.955 INFO:tasks.workunit.client.0.smithi006.stdout:1/229: chown d0/d25/d2a/d43/f44 118825 1 2024-03-12T16:10:39.955 INFO:tasks.workunit.client.0.smithi006.stdout:9/237: mkdir d0/d4/d3b/d4a 0 2024-03-12T16:10:39.956 INFO:tasks.workunit.client.0.smithi006.stdout:0/313: symlink d2/d6/d10/d11/d1d/l5a 0 2024-03-12T16:10:39.958 INFO:tasks.workunit.client.0.smithi006.stdout:6/172: symlink d3/d11/d10/d1b/d20/d26/l3a 0 2024-03-12T16:10:39.960 INFO:tasks.workunit.client.0.smithi006.stdout:4/325: symlink d1/db/d1d/d2f/l65 0 2024-03-12T16:10:39.962 INFO:tasks.workunit.client.1.smithi134.stdout:9/396: dwrite d5/d10/d1f/f43 [0,4194304] 0 2024-03-12T16:10:39.963 INFO:tasks.workunit.client.0.smithi006.stdout:4/326: chown d1/db/d1d/l23 2 1 2024-03-12T16:10:39.963 INFO:tasks.workunit.client.0.smithi006.stdout:8/168: rename d2/db/d1a/d23/l2a to d2/db/d1a/d21/d2b/l37 0 2024-03-12T16:10:39.965 INFO:tasks.workunit.client.1.smithi134.stdout:7/461: rename d8/dc/d2f to d8/d27/d9d 0 2024-03-12T16:10:39.965 INFO:tasks.workunit.client.1.smithi134.stdout:4/392: dread d1/d13/f68 [0,4194304] 0 2024-03-12T16:10:39.968 INFO:tasks.workunit.client.1.smithi134.stdout:4/393: creat d1/de/f82 x:0 0 0 2024-03-12T16:10:39.968 INFO:tasks.workunit.client.0.smithi006.stdout:9/238: creat d0/d4/d3b/f4b x:0 0 0 2024-03-12T16:10:39.969 INFO:tasks.workunit.client.0.smithi006.stdout:1/230: creat d0/d25/d2a/d35/f4b x:0 0 0 2024-03-12T16:10:39.969 INFO:tasks.workunit.client.0.smithi006.stdout:0/314: truncate d2/f4 114500 0 2024-03-12T16:10:39.971 INFO:tasks.workunit.client.0.smithi006.stdout:4/327: mknod d1/db/d39/c66 0 2024-03-12T16:10:39.971 INFO:tasks.workunit.client.0.smithi006.stdout:6/173: dwrite d3/d11/d10/d19/f39 [0,4194304] 0 2024-03-12T16:10:39.974 INFO:tasks.workunit.client.1.smithi134.stdout:4/394: read d1/d13/d49/d64/d28/d4f/f51 [4160576,69264] 0 2024-03-12T16:10:39.975 INFO:tasks.workunit.client.1.smithi134.stdout:7/462: dwrite d8/dc/d20/d26/d36/f64 [0,4194304] 0 2024-03-12T16:10:39.978 INFO:tasks.workunit.client.0.smithi006.stdout:1/231: symlink d0/d39/l4c 0 2024-03-12T16:10:39.980 INFO:tasks.workunit.client.0.smithi006.stdout:6/174: write d3/d11/d10/d1b/d20/d26/f34 [808035,128645] 0 2024-03-12T16:10:39.980 INFO:tasks.workunit.client.1.smithi134.stdout:4/395: dread d1/d13/f80 [0,4194304] 0 2024-03-12T16:10:39.981 INFO:tasks.workunit.client.0.smithi006.stdout:4/328: mknod d1/db/d1d/d2f/c67 0 2024-03-12T16:10:39.982 INFO:tasks.workunit.client.1.smithi134.stdout:4/396: stat d1/d13/d49/d64/d28/l7a 0 2024-03-12T16:10:39.984 INFO:tasks.workunit.client.0.smithi006.stdout:8/169: dwrite d2/db/d1a/d1f/f31 [4194304,4194304] 0 2024-03-12T16:10:39.986 INFO:tasks.workunit.client.1.smithi134.stdout:7/463: getdents d8/dc/d20/d26/d36 0 2024-03-12T16:10:39.989 INFO:tasks.workunit.client.0.smithi006.stdout:1/232: creat d0/d25/d2a/f4d x:0 0 0 2024-03-12T16:10:39.990 INFO:tasks.workunit.client.1.smithi134.stdout:7/464: truncate d8/dc/d20/f13 489002 0 2024-03-12T16:10:39.997 INFO:tasks.workunit.client.1.smithi134.stdout:7/465: dread d8/dc/d20/f67 [0,4194304] 0 2024-03-12T16:10:39.997 INFO:tasks.workunit.client.0.smithi006.stdout:0/315: dwrite f0 [0,4194304] 0 2024-03-12T16:10:39.997 INFO:tasks.workunit.client.0.smithi006.stdout:4/329: dread d1/db/d17/f1a [0,4194304] 0 2024-03-12T16:10:39.997 INFO:tasks.workunit.client.0.smithi006.stdout:1/233: write d0/f4 [1473587,29710] 0 2024-03-12T16:10:39.999 INFO:tasks.workunit.client.1.smithi134.stdout:7/466: creat d8/dc/d55/d57/f9e x:0 0 0 2024-03-12T16:10:40.000 INFO:tasks.workunit.client.1.smithi134.stdout:7/467: dread - d8/dc/d20/d26/d36/f9b zero size 2024-03-12T16:10:40.000 INFO:tasks.workunit.client.0.smithi006.stdout:0/316: stat d2/lb 0 2024-03-12T16:10:40.002 INFO:tasks.workunit.client.1.smithi134.stdout:7/468: fdatasync d8/dc/d55/d57/f7e 0 2024-03-12T16:10:40.006 INFO:tasks.workunit.client.0.smithi006.stdout:4/330: write d1/db/d17/f32 [2439125,116684] 0 2024-03-12T16:10:40.007 INFO:tasks.workunit.client.0.smithi006.stdout:9/239: dwrite d0/d8/d16/f43 [4194304,4194304] 0 2024-03-12T16:10:40.007 INFO:tasks.workunit.client.1.smithi134.stdout:7/469: link d8/d27/d9d/d31/d7c/f92 d8/dc/d55/d81/d87/f9f 0 2024-03-12T16:10:40.009 INFO:tasks.workunit.client.0.smithi006.stdout:6/175: dwrite d3/fc [4194304,4194304] 0 2024-03-12T16:10:40.009 INFO:tasks.workunit.client.1.smithi134.stdout:7/470: mkdir d8/dc/d7b/da0 0 2024-03-12T16:10:40.012 INFO:tasks.workunit.client.0.smithi006.stdout:4/331: chown d1/db/d1d/f5d 494 1 2024-03-12T16:10:40.013 INFO:tasks.workunit.client.1.smithi134.stdout:7/471: mkdir d8/d4e/d91/da1 0 2024-03-12T16:10:40.014 INFO:tasks.workunit.client.0.smithi006.stdout:0/317: symlink d2/d6/d10/l5b 0 2024-03-12T16:10:40.014 INFO:tasks.workunit.client.0.smithi006.stdout:6/176: mkdir d3/d11/d3b 0 2024-03-12T16:10:40.015 INFO:tasks.workunit.client.1.smithi134.stdout:7/472: dread d8/dc/d20/f99 [0,4194304] 0 2024-03-12T16:10:40.016 INFO:tasks.workunit.client.1.smithi134.stdout:7/473: dread - d8/d27/f75 zero size 2024-03-12T16:10:40.016 INFO:tasks.workunit.client.0.smithi006.stdout:9/240: creat d0/d8/d16/d2f/f4c x:0 0 0 2024-03-12T16:10:40.016 INFO:tasks.workunit.client.1.smithi134.stdout:7/474: truncate d8/ff 1913393 0 2024-03-12T16:10:40.019 INFO:tasks.workunit.client.1.smithi134.stdout:7/475: unlink d8/d27/d9d/d31/c40 0 2024-03-12T16:10:40.020 INFO:tasks.workunit.client.1.smithi134.stdout:7/476: read d8/d27/d9d/f32 [1821175,10936] 0 2024-03-12T16:10:40.023 INFO:tasks.workunit.client.0.smithi006.stdout:0/318: chown d2/d39/d42/c57 13 1 2024-03-12T16:10:40.024 INFO:tasks.workunit.client.0.smithi006.stdout:9/241: mkdir d0/d4/d18/d4d 0 2024-03-12T16:10:40.027 INFO:tasks.workunit.client.0.smithi006.stdout:8/170: dwrite d2/db/f18 [0,4194304] 0 2024-03-12T16:10:40.027 INFO:tasks.workunit.client.0.smithi006.stdout:0/319: read - d2/d39/d42/f59 zero size 2024-03-12T16:10:40.029 INFO:tasks.workunit.client.0.smithi006.stdout:8/171: readlink d2/db/d1a/l35 0 2024-03-12T16:10:40.035 INFO:tasks.workunit.client.0.smithi006.stdout:0/320: rename d2/d6/d10/l3e to d2/d6/l5c 0 2024-03-12T16:10:40.035 INFO:tasks.workunit.client.0.smithi006.stdout:9/242: creat d0/d4/d18/d4d/f4e x:0 0 0 2024-03-12T16:10:40.037 INFO:tasks.workunit.client.0.smithi006.stdout:0/321: chown d2/d6/c25 142969 1 2024-03-12T16:10:40.040 INFO:tasks.workunit.client.0.smithi006.stdout:0/322: symlink d2/d6/l5d 0 2024-03-12T16:10:40.041 INFO:tasks.workunit.client.0.smithi006.stdout:4/332: write d1/d38/f57 [85466,2034] 0 2024-03-12T16:10:40.043 INFO:tasks.workunit.client.0.smithi006.stdout:0/323: chown d2/f2b 18605497 1 2024-03-12T16:10:40.043 INFO:tasks.workunit.client.0.smithi006.stdout:1/234: dread d0/f4 [0,4194304] 0 2024-03-12T16:10:40.048 INFO:tasks.workunit.client.0.smithi006.stdout:9/243: dread d0/d8/d2b/d20/d37/f39 [0,4194304] 0 2024-03-12T16:10:40.050 INFO:tasks.workunit.client.0.smithi006.stdout:6/177: dwrite d3/d11/d10/f2a [0,4194304] 0 2024-03-12T16:10:40.050 INFO:tasks.workunit.client.0.smithi006.stdout:4/333: mknod d1/db/d17/d43/c68 0 2024-03-12T16:10:40.056 INFO:tasks.workunit.client.0.smithi006.stdout:9/244: mknod d0/d8/d16/d2f/c4f 0 2024-03-12T16:10:40.059 INFO:tasks.workunit.client.0.smithi006.stdout:8/172: dread d2/db/fe [0,4194304] 0 2024-03-12T16:10:40.060 INFO:tasks.workunit.client.0.smithi006.stdout:9/245: dread - d0/d4/d3b/f4b zero size 2024-03-12T16:10:40.061 INFO:tasks.workunit.client.0.smithi006.stdout:1/235: dwrite d0/d25/f32 [0,4194304] 0 2024-03-12T16:10:40.063 INFO:tasks.workunit.client.0.smithi006.stdout:0/324: creat d2/d6/d10/d11/d1d/d2e/f5e x:0 0 0 2024-03-12T16:10:40.064 INFO:tasks.workunit.client.0.smithi006.stdout:4/334: rename d1/db/d54 to d1/db/d39/d42/d61/d69 0 2024-03-12T16:10:40.064 INFO:tasks.workunit.client.0.smithi006.stdout:1/236: mkdir d0/d4e 0 2024-03-12T16:10:40.066 INFO:tasks.workunit.client.0.smithi006.stdout:8/173: symlink d2/db/d1a/d23/l38 0 2024-03-12T16:10:40.067 INFO:tasks.workunit.client.1.smithi134.stdout:0/470: sync 2024-03-12T16:10:40.067 INFO:tasks.workunit.client.1.smithi134.stdout:8/399: sync 2024-03-12T16:10:40.068 INFO:tasks.workunit.client.1.smithi134.stdout:0/471: write db/d2f/d31/f59 [899362,10575] 0 2024-03-12T16:10:40.068 INFO:tasks.workunit.client.1.smithi134.stdout:8/400: stat d3/d1b/d17/d25/d33/d15/d2b 0 2024-03-12T16:10:40.069 INFO:tasks.workunit.client.1.smithi134.stdout:0/472: readlink db/d2f/d31/l41 0 2024-03-12T16:10:40.069 INFO:tasks.workunit.client.0.smithi006.stdout:4/335: read d1/db/d17/d5a/f62 [529598,102543] 0 2024-03-12T16:10:40.070 INFO:tasks.workunit.client.1.smithi134.stdout:0/473: fdatasync f7 0 2024-03-12T16:10:40.071 INFO:tasks.workunit.client.0.smithi006.stdout:0/325: rename d2/d6/d10/d11/d1d/l52 to d2/d39/d42/l5f 0 2024-03-12T16:10:40.072 INFO:tasks.workunit.client.1.smithi134.stdout:8/401: creat d3/d1b/d17/d25/f79 x:0 0 0 2024-03-12T16:10:40.072 INFO:tasks.workunit.client.0.smithi006.stdout:0/326: chown d2/fd 303993 1 2024-03-12T16:10:40.073 INFO:tasks.workunit.client.1.smithi134.stdout:0/474: creat db/d2f/d31/d76/f9c x:0 0 0 2024-03-12T16:10:40.073 INFO:tasks.workunit.client.1.smithi134.stdout:8/402: stat d3/d1b/d17/d25/d49/l5e 0 2024-03-12T16:10:40.074 INFO:tasks.workunit.client.1.smithi134.stdout:8/403: chown d3/d1b/f1d 11 1 2024-03-12T16:10:40.079 INFO:tasks.workunit.client.0.smithi006.stdout:6/178: dread d3/f1c [0,4194304] 0 2024-03-12T16:10:40.081 INFO:tasks.workunit.client.0.smithi006.stdout:9/246: getdents d0/d8/d16/d2f 0 2024-03-12T16:10:40.081 INFO:tasks.workunit.client.0.smithi006.stdout:1/237: dwrite d0/f23 [0,4194304] 0 2024-03-12T16:10:40.081 INFO:tasks.workunit.client.0.smithi006.stdout:8/174: dread d2/db/f24 [0,4194304] 0 2024-03-12T16:10:40.083 INFO:tasks.workunit.client.1.smithi134.stdout:8/404: link d3/d1b/d17/d25/d33/d15/d2b/d5b/l66 d3/d1b/d17/d25/d33/d15/d2b/d6d/l7a 0 2024-03-12T16:10:40.084 INFO:tasks.workunit.client.1.smithi134.stdout:8/405: fdatasync d3/d1b/d17/d25/d33/d15/d2b/d4f/f3d 0 2024-03-12T16:10:40.088 INFO:tasks.workunit.client.1.smithi134.stdout:0/475: rmdir db/d2f/d31 39 2024-03-12T16:10:40.088 INFO:tasks.workunit.client.0.smithi006.stdout:4/336: link d1/db/c37 d1/db/d39/d42/d61/d69/c6a 0 2024-03-12T16:10:40.088 INFO:tasks.workunit.client.0.smithi006.stdout:9/247: dread d0/d8/d16/f46 [0,4194304] 0 2024-03-12T16:10:40.089 INFO:tasks.workunit.client.1.smithi134.stdout:8/406: getdents d3/d1b/d17/d24/d28 0 2024-03-12T16:10:40.089 INFO:tasks.workunit.client.0.smithi006.stdout:9/248: chown d0/d4 256069 1 2024-03-12T16:10:40.090 INFO:tasks.workunit.client.1.smithi134.stdout:0/476: fdatasync db/d2f/d31/d75/f8a 0 2024-03-12T16:10:40.091 INFO:tasks.workunit.client.0.smithi006.stdout:4/337: fdatasync d1/db/f22 0 2024-03-12T16:10:40.092 INFO:tasks.workunit.client.0.smithi006.stdout:8/175: creat d2/db/f39 x:0 0 0 2024-03-12T16:10:40.093 INFO:tasks.workunit.client.0.smithi006.stdout:4/338: write d1/db/d1d/f5d [93529,28053] 0 2024-03-12T16:10:40.095 INFO:tasks.workunit.client.0.smithi006.stdout:9/249: dread d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:40.095 INFO:tasks.workunit.client.1.smithi134.stdout:8/407: rename d3/d1b/d17/d25/d33/d15/d2b/d5b/l66 to d3/d1b/d17/d3f/l7b 0 2024-03-12T16:10:40.096 INFO:tasks.workunit.client.0.smithi006.stdout:4/339: truncate d1/db/d39/d42/d61/d69/f55 491765 0 2024-03-12T16:10:40.097 INFO:tasks.workunit.client.0.smithi006.stdout:8/176: unlink d2/d11/f1d 0 2024-03-12T16:10:40.100 INFO:tasks.workunit.client.0.smithi006.stdout:9/250: dread d0/d4/f25 [0,4194304] 0 2024-03-12T16:10:40.100 INFO:tasks.workunit.client.0.smithi006.stdout:8/177: rmdir d2/db/d1a/d21 39 2024-03-12T16:10:40.100 INFO:tasks.workunit.client.1.smithi134.stdout:8/408: rename d3/d1b/d17/d25/d33/d15/d2b/f37 to d3/d10/f7c 0 2024-03-12T16:10:40.103 INFO:tasks.workunit.client.0.smithi006.stdout:8/178: creat d2/f3a x:0 0 0 2024-03-12T16:10:40.106 INFO:tasks.workunit.client.1.smithi134.stdout:8/409: dwrite d3/d1b/f1f [0,4194304] 0 2024-03-12T16:10:40.108 INFO:tasks.workunit.client.0.smithi006.stdout:9/251: dwrite d0/d8/d2b/d20/d37/f47 [0,4194304] 0 2024-03-12T16:10:40.112 INFO:tasks.workunit.client.0.smithi006.stdout:8/179: dwrite d2/f15 [0,4194304] 0 2024-03-12T16:10:40.114 INFO:tasks.workunit.client.0.smithi006.stdout:7/351: sync 2024-03-12T16:10:40.114 INFO:tasks.workunit.client.0.smithi006.stdout:3/219: sync 2024-03-12T16:10:40.114 INFO:tasks.workunit.client.0.smithi006.stdout:5/141: sync 2024-03-12T16:10:40.116 INFO:tasks.workunit.client.0.smithi006.stdout:5/142: stat d7/d9 0 2024-03-12T16:10:40.116 INFO:tasks.workunit.client.1.smithi134.stdout:8/410: dwrite d3/d1b/d17/d25/d33/d15/d2b/d4f/d65/f48 [0,4194304] 0 2024-03-12T16:10:40.117 INFO:tasks.workunit.client.0.smithi006.stdout:3/220: truncate d8/df/f42 790342 0 2024-03-12T16:10:40.117 INFO:tasks.workunit.client.0.smithi006.stdout:8/180: truncate d2/db/d1a/f1c 1275586 0 2024-03-12T16:10:40.122 INFO:tasks.workunit.client.0.smithi006.stdout:7/352: rename de/f1e to de/d1c/d35/f7d 0 2024-03-12T16:10:40.173 INFO:tasks.workunit.client.0.smithi006.stdout:9/252: dwrite d0/d4/d3b/f4b [0,4194304] 0 2024-03-12T16:10:40.173 INFO:tasks.workunit.client.0.smithi006.stdout:3/221: symlink d8/df/d2c/dc/d28/l49 0 2024-03-12T16:10:40.175 INFO:tasks.workunit.client.0.smithi006.stdout:5/143: rmdir d7/d9/d10/d24 39 2024-03-12T16:10:40.176 INFO:tasks.workunit.client.0.smithi006.stdout:4/340: truncate d1/db/d17/d5a/f62 2304551 0 2024-03-12T16:10:40.178 INFO:tasks.workunit.client.0.smithi006.stdout:7/353: unlink de/d2c/c72 0 2024-03-12T16:10:40.178 INFO:tasks.workunit.client.0.smithi006.stdout:3/222: symlink d8/df/l4a 0 2024-03-12T16:10:40.179 INFO:tasks.workunit.client.0.smithi006.stdout:8/181: mknod d2/d32/c3b 0 2024-03-12T16:10:40.179 INFO:tasks.workunit.client.1.smithi134.stdout:0/477: dread db/f3c [0,4194304] 0 2024-03-12T16:10:40.182 INFO:tasks.workunit.client.0.smithi006.stdout:9/253: rename d0/d8/d2b/c1e to d0/d8/d16/c50 0 2024-03-12T16:10:40.182 INFO:tasks.workunit.client.1.smithi134.stdout:0/478: unlink db/d2f/f30 0 2024-03-12T16:10:40.183 INFO:tasks.workunit.client.0.smithi006.stdout:4/341: mkdir d1/db/d1d/d2f/d6b 0 2024-03-12T16:10:40.183 INFO:tasks.workunit.client.1.smithi134.stdout:0/479: stat db/d2f/d51/f64 0 2024-03-12T16:10:40.183 INFO:tasks.workunit.client.0.smithi006.stdout:9/254: write d0/d8/d2b/d20/f34 [1474458,7522] 0 2024-03-12T16:10:40.185 INFO:tasks.workunit.client.1.smithi134.stdout:0/480: unlink db/f87 0 2024-03-12T16:10:40.186 INFO:tasks.workunit.client.0.smithi006.stdout:4/342: write d1/db/d1d/f49 [2777429,50064] 0 2024-03-12T16:10:40.186 INFO:tasks.workunit.client.0.smithi006.stdout:7/354: write de/d18/f1b [3546453,73507] 0 2024-03-12T16:10:40.186 INFO:tasks.workunit.client.0.smithi006.stdout:3/223: mknod d8/df/d3b/c4b 0 2024-03-12T16:10:40.189 INFO:tasks.workunit.client.1.smithi134.stdout:0/481: rename f7 to db/d2f/d31/d56/d9a/f9d 0 2024-03-12T16:10:40.189 INFO:tasks.workunit.client.0.smithi006.stdout:7/355: write de/d27/f36 [418011,30363] 0 2024-03-12T16:10:40.189 INFO:tasks.workunit.client.0.smithi006.stdout:9/255: creat d0/d8/d2b/d20/f51 x:0 0 0 2024-03-12T16:10:40.189 INFO:tasks.workunit.client.0.smithi006.stdout:4/343: write d1/d38/f57 [637676,63138] 0 2024-03-12T16:10:40.191 INFO:tasks.workunit.client.0.smithi006.stdout:5/144: rename d7/d9/d27 to d7/d9/d31 0 2024-03-12T16:10:40.191 INFO:tasks.workunit.client.0.smithi006.stdout:9/256: readlink d0/d8/d23/l2e 0 2024-03-12T16:10:40.194 INFO:tasks.workunit.client.0.smithi006.stdout:7/356: stat de/d27/d2b/f37 0 2024-03-12T16:10:40.195 INFO:tasks.workunit.client.0.smithi006.stdout:8/182: getdents d2/db/d1a/d21/d2b 0 2024-03-12T16:10:40.196 INFO:tasks.workunit.client.1.smithi134.stdout:8/411: fdatasync d3/f6 0 2024-03-12T16:10:40.198 INFO:tasks.workunit.client.0.smithi006.stdout:4/344: write d1/db/d39/f47 [1332058,110177] 0 2024-03-12T16:10:40.199 INFO:tasks.workunit.client.0.smithi006.stdout:9/257: read d0/d8/d2b/d20/f34 [1282874,44513] 0 2024-03-12T16:10:40.199 INFO:tasks.workunit.client.0.smithi006.stdout:0/327: write d2/fd [4548155,68544] 0 2024-03-12T16:10:40.202 INFO:tasks.workunit.client.1.smithi134.stdout:8/412: link d3/d1b/d17/d25/d33/l77 d3/d1b/d17/d25/l7d 0 2024-03-12T16:10:40.204 INFO:tasks.workunit.client.0.smithi006.stdout:6/179: write d3/d11/fd [477369,16641] 0 2024-03-12T16:10:40.205 INFO:tasks.workunit.client.0.smithi006.stdout:5/145: creat d7/d9/d10/f32 x:0 0 0 2024-03-12T16:10:40.205 INFO:tasks.workunit.client.0.smithi006.stdout:9/258: readlink d0/d1f/l45 0 2024-03-12T16:10:40.206 INFO:tasks.workunit.client.1.smithi134.stdout:0/482: dread db/fe [4194304,4194304] 0 2024-03-12T16:10:40.206 INFO:tasks.workunit.client.1.smithi134.stdout:8/413: mkdir d3/d1b/d17/d25/d33/d15/d7e 0 2024-03-12T16:10:40.207 INFO:tasks.workunit.client.0.smithi006.stdout:0/328: write d2/f1f [5154982,120546] 0 2024-03-12T16:10:40.207 INFO:tasks.workunit.client.0.smithi006.stdout:3/224: dwrite d8/df/f42 [0,4194304] 0 2024-03-12T16:10:40.207 INFO:tasks.workunit.client.1.smithi134.stdout:5/524: sync 2024-03-12T16:10:40.208 INFO:tasks.workunit.client.1.smithi134.stdout:6/425: sync 2024-03-12T16:10:40.208 INFO:tasks.workunit.client.1.smithi134.stdout:5/525: stat db/d12/d1d/d3a/d49 0 2024-03-12T16:10:40.209 INFO:tasks.workunit.client.1.smithi134.stdout:8/414: symlink d3/d1b/d17/d25/d33/d15/d2b/d4f/d65/l7f 0 2024-03-12T16:10:40.211 INFO:tasks.workunit.client.1.smithi134.stdout:5/526: dread - db/d12/d1d/d3a/d4e/fa2 zero size 2024-03-12T16:10:40.211 INFO:tasks.workunit.client.0.smithi006.stdout:9/259: chown d0/d8/d16/f31 957989793 1 2024-03-12T16:10:40.211 INFO:tasks.workunit.client.0.smithi006.stdout:0/329: write d2/f1f [4444029,36033] 0 2024-03-12T16:10:40.211 INFO:tasks.workunit.client.0.smithi006.stdout:8/183: unlink d2/db/d1a/d23/l38 0 2024-03-12T16:10:40.211 INFO:tasks.workunit.client.1.smithi134.stdout:6/426: symlink d1/d3/d19/d32/la4 0 2024-03-12T16:10:40.214 INFO:tasks.workunit.client.0.smithi006.stdout:5/146: dread d7/d9/f20 [0,4194304] 0 2024-03-12T16:10:40.214 INFO:tasks.workunit.client.0.smithi006.stdout:9/260: stat d0/d4/d18/d4d 0 2024-03-12T16:10:40.215 INFO:tasks.workunit.client.1.smithi134.stdout:6/427: symlink d1/la5 0 2024-03-12T16:10:40.215 INFO:tasks.workunit.client.0.smithi006.stdout:7/357: mkdir de/d7b/d7e 0 2024-03-12T16:10:40.216 INFO:tasks.workunit.client.1.smithi134.stdout:5/527: symlink db/d12/d37/d73/lac 0 2024-03-12T16:10:40.216 INFO:tasks.workunit.client.1.smithi134.stdout:0/483: link db/fc db/d2f/d71/f9e 0 2024-03-12T16:10:40.217 INFO:tasks.workunit.client.1.smithi134.stdout:0/484: dread - db/d2f/f63 zero size 2024-03-12T16:10:40.218 INFO:tasks.workunit.client.1.smithi134.stdout:8/415: creat d3/d1b/d17/d25/d33/d15/d2b/d6d/f80 x:0 0 0 2024-03-12T16:10:40.219 INFO:tasks.workunit.client.1.smithi134.stdout:5/528: fdatasync db/fa3 0 2024-03-12T16:10:40.220 INFO:tasks.workunit.client.1.smithi134.stdout:0/485: mkdir db/d2f/d31/d76/d9f 0 2024-03-12T16:10:40.221 INFO:tasks.workunit.client.1.smithi134.stdout:8/416: truncate d3/d1b/d17/d25/d33/f6b 880770 0 2024-03-12T16:10:40.222 INFO:tasks.workunit.client.0.smithi006.stdout:4/345: dwrite d1/db/d1d/f2b [0,4194304] 0 2024-03-12T16:10:40.222 INFO:tasks.workunit.client.0.smithi006.stdout:3/225: mkdir d8/d4c 0 2024-03-12T16:10:40.222 INFO:tasks.workunit.client.1.smithi134.stdout:0/486: chown db/d2f/d31/d68/l81 631015 1 2024-03-12T16:10:40.225 INFO:tasks.workunit.client.1.smithi134.stdout:0/487: creat db/d2f/d61/d67/fa0 x:0 0 0 2024-03-12T16:10:40.228 INFO:tasks.workunit.client.1.smithi134.stdout:8/417: dwrite d3/d1b/d17/d25/d33/d15/d2b/f30 [0,4194304] 0 2024-03-12T16:10:40.230 INFO:tasks.workunit.client.1.smithi134.stdout:8/418: write d3/d1b/d17/d24/f6f [106345,95035] 0 2024-03-12T16:10:40.230 INFO:tasks.workunit.client.0.smithi006.stdout:8/184: fdatasync d2/f16 0 2024-03-12T16:10:40.232 INFO:tasks.workunit.client.0.smithi006.stdout:4/346: unlink d1/db/d1d/f20 0 2024-03-12T16:10:40.232 INFO:tasks.workunit.client.1.smithi134.stdout:8/419: read d3/fe [408499,75390] 0 2024-03-12T16:10:40.234 INFO:tasks.workunit.client.0.smithi006.stdout:4/347: chown d1/db/d1d/l33 1189269 1 2024-03-12T16:10:40.235 INFO:tasks.workunit.client.1.smithi134.stdout:8/420: symlink d3/l81 0 2024-03-12T16:10:40.235 INFO:tasks.workunit.client.0.smithi006.stdout:0/330: dwrite d2/f4b [0,4194304] 0 2024-03-12T16:10:40.236 INFO:tasks.workunit.client.0.smithi006.stdout:5/147: dwrite d7/d9/fc [0,4194304] 0 2024-03-12T16:10:40.237 INFO:tasks.workunit.client.1.smithi134.stdout:8/421: mkdir d3/d82 0 2024-03-12T16:10:40.240 INFO:tasks.workunit.client.0.smithi006.stdout:0/331: write f0 [5668145,123512] 0 2024-03-12T16:10:40.243 INFO:tasks.workunit.client.0.smithi006.stdout:8/185: creat d2/db/d1a/d1f/f3c x:0 0 0 2024-03-12T16:10:40.245 INFO:tasks.workunit.client.0.smithi006.stdout:3/226: unlink d8/df/d2c/f1d 0 2024-03-12T16:10:40.245 INFO:tasks.workunit.client.0.smithi006.stdout:8/186: chown d2/d11/l2f 87377 1 2024-03-12T16:10:40.245 INFO:tasks.workunit.client.0.smithi006.stdout:7/358: creat de/d18/d2a/d40/f7f x:0 0 0 2024-03-12T16:10:40.247 INFO:tasks.workunit.client.0.smithi006.stdout:4/348: write d1/db/d39/f3b [1153060,95839] 0 2024-03-12T16:10:40.248 INFO:tasks.workunit.client.1.smithi134.stdout:8/422: getdents d3/d1b/d17/d25/d33 0 2024-03-12T16:10:40.252 INFO:tasks.workunit.client.0.smithi006.stdout:4/349: chown d1/db/c1b 372 1 2024-03-12T16:10:40.255 INFO:tasks.workunit.client.0.smithi006.stdout:5/148: mknod d7/d9/d10/d24/c33 0 2024-03-12T16:10:40.255 INFO:tasks.workunit.client.1.smithi134.stdout:8/423: mknod d3/d1b/c83 0 2024-03-12T16:10:40.256 INFO:tasks.workunit.client.0.smithi006.stdout:0/332: dread d2/f1f [0,4194304] 0 2024-03-12T16:10:40.256 INFO:tasks.workunit.client.0.smithi006.stdout:5/149: readlink d7/d9/l23 0 2024-03-12T16:10:40.257 INFO:tasks.workunit.client.1.smithi134.stdout:8/424: write d3/d1b/d17/d24/f4c [387094,94968] 0 2024-03-12T16:10:40.257 INFO:tasks.workunit.client.0.smithi006.stdout:3/227: mknod d8/df/d2c/dc/d28/c4d 0 2024-03-12T16:10:40.257 INFO:tasks.workunit.client.0.smithi006.stdout:0/333: stat f0 0 2024-03-12T16:10:40.259 INFO:tasks.workunit.client.0.smithi006.stdout:8/187: dwrite d2/db/f39 [0,4194304] 0 2024-03-12T16:10:40.259 INFO:tasks.workunit.client.0.smithi006.stdout:0/334: readlink d2/d6/l31 0 2024-03-12T16:10:40.260 INFO:tasks.workunit.client.1.smithi134.stdout:8/425: creat d3/d1b/d17/d25/d33/f84 x:0 0 0 2024-03-12T16:10:40.262 INFO:tasks.workunit.client.1.smithi134.stdout:5/529: write db/d12/d1d/d3a/d49/f62 [632249,23647] 0 2024-03-12T16:10:40.264 INFO:tasks.workunit.client.1.smithi134.stdout:5/530: chown db/d12/d37/d73/d8c 6411 1 2024-03-12T16:10:40.264 INFO:tasks.workunit.client.0.smithi006.stdout:7/359: creat de/f80 x:0 0 0 2024-03-12T16:10:40.265 INFO:tasks.workunit.client.1.smithi134.stdout:0/488: truncate db/f3c 2300443 0 2024-03-12T16:10:40.266 INFO:tasks.workunit.client.0.smithi006.stdout:4/350: mkdir d1/db/d1d/d6c 0 2024-03-12T16:10:40.267 INFO:tasks.workunit.client.0.smithi006.stdout:2/295: sync 2024-03-12T16:10:40.267 INFO:tasks.workunit.client.1.smithi134.stdout:5/531: write db/d12/d1d/d3a/d4e/f8a [2415196,3944] 0 2024-03-12T16:10:40.268 INFO:tasks.workunit.client.0.smithi006.stdout:4/351: readlink d1/l4 0 2024-03-12T16:10:40.269 INFO:tasks.workunit.client.1.smithi134.stdout:8/426: dread d3/f6 [0,4194304] 0 2024-03-12T16:10:40.269 INFO:tasks.workunit.client.0.smithi006.stdout:8/188: rename d2/d11/c12 to d2/db/d1a/d1f/c3d 0 2024-03-12T16:10:40.270 INFO:tasks.workunit.client.0.smithi006.stdout:9/261: dwrite d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:40.270 INFO:tasks.workunit.client.0.smithi006.stdout:3/228: read d8/df/d2c/f13 [624851,39626] 0 2024-03-12T16:10:40.271 INFO:tasks.workunit.client.0.smithi006.stdout:7/360: mkdir de/d18/d2a/d39/d81 0 2024-03-12T16:10:40.272 INFO:tasks.workunit.client.1.smithi134.stdout:5/532: read db/d12/d29/d3d/f54 [3176444,71909] 0 2024-03-12T16:10:40.274 INFO:tasks.workunit.client.1.smithi134.stdout:5/533: write db/d12/d7b/f93 [2147370,34186] 0 2024-03-12T16:10:40.275 INFO:tasks.workunit.client.1.smithi134.stdout:6/428: rename d1/d3a/d3b to d1/da6 0 2024-03-12T16:10:40.275 INFO:tasks.workunit.client.0.smithi006.stdout:2/296: mkdir d0/dc/d64 0 2024-03-12T16:10:40.275 INFO:tasks.workunit.client.0.smithi006.stdout:7/361: chown de/d27 86457 1 2024-03-12T16:10:40.276 INFO:tasks.workunit.client.1.smithi134.stdout:5/534: chown db/d12/d29/d3d/d79/da5 97 1 2024-03-12T16:10:40.282 INFO:tasks.workunit.client.1.smithi134.stdout:0/489: readlink db/d2f/d31/d75/d88/l96 0 2024-03-12T16:10:40.285 INFO:tasks.workunit.client.0.smithi006.stdout:5/150: dwrite d7/d9/d10/f1a [0,4194304] 0 2024-03-12T16:10:40.286 INFO:tasks.workunit.client.1.smithi134.stdout:5/535: truncate db/d12/d1d/d3a/f48 109179 0 2024-03-12T16:10:40.287 INFO:tasks.workunit.client.0.smithi006.stdout:3/229: truncate d8/df/d2c/f20 5099669 0 2024-03-12T16:10:40.287 INFO:tasks.workunit.client.1.smithi134.stdout:8/427: mkdir d3/d1b/d17/d25/d33/d85 0 2024-03-12T16:10:40.288 INFO:tasks.workunit.client.1.smithi134.stdout:0/490: symlink db/d2f/d31/d76/d9f/la1 0 2024-03-12T16:10:40.288 INFO:tasks.workunit.client.0.smithi006.stdout:2/297: rmdir d0/d13/d49 39 2024-03-12T16:10:40.289 INFO:tasks.workunit.client.1.smithi134.stdout:0/491: readlink db/d2f/d51/l82 0 2024-03-12T16:10:40.290 INFO:tasks.workunit.client.1.smithi134.stdout:6/429: rename d1/d16/f72 to d1/d16/d4c/d65/d61/fa7 0 2024-03-12T16:10:40.291 INFO:tasks.workunit.client.0.smithi006.stdout:8/189: write d2/db/d1a/d1f/f3c [694424,16851] 0 2024-03-12T16:10:40.293 INFO:tasks.workunit.client.1.smithi134.stdout:0/492: mkdir db/d2f/d31/d68/da2 0 2024-03-12T16:10:40.293 INFO:tasks.workunit.client.1.smithi134.stdout:0/493: dread - db/d2f/d31/f7b zero size 2024-03-12T16:10:40.294 INFO:tasks.workunit.client.0.smithi006.stdout:2/298: symlink d0/d13/l65 0 2024-03-12T16:10:40.295 INFO:tasks.workunit.client.1.smithi134.stdout:5/536: link db/d12/d1d/f31 db/d7a/d97/fad 0 2024-03-12T16:10:40.296 INFO:tasks.workunit.client.1.smithi134.stdout:5/537: truncate db/d7d/f86 1077091 0 2024-03-12T16:10:40.296 INFO:tasks.workunit.client.0.smithi006.stdout:8/190: mkdir d2/db/d1a/d23/d3e 0 2024-03-12T16:10:40.297 INFO:tasks.workunit.client.1.smithi134.stdout:5/538: chown db/d12/d37/f39 28985 1 2024-03-12T16:10:40.298 INFO:tasks.workunit.client.0.smithi006.stdout:3/230: rename d8/f21 to d8/df/f4e 0 2024-03-12T16:10:40.298 INFO:tasks.workunit.client.1.smithi134.stdout:6/430: mknod d1/d16/d4c/d58/da0/ca8 0 2024-03-12T16:10:40.299 INFO:tasks.workunit.client.1.smithi134.stdout:0/494: creat db/d2f/d31/d75/fa3 x:0 0 0 2024-03-12T16:10:40.299 INFO:tasks.workunit.client.1.smithi134.stdout:5/539: rmdir db/d12/d29/d3d/d79 39 2024-03-12T16:10:40.300 INFO:tasks.workunit.client.0.smithi006.stdout:9/262: link d0/d4/d3b/f4b d0/d8/f52 0 2024-03-12T16:10:40.301 INFO:tasks.workunit.client.1.smithi134.stdout:5/540: readlink db/d12/d1d/d3a/d49/l9c 0 2024-03-12T16:10:40.301 INFO:tasks.workunit.client.1.smithi134.stdout:0/495: chown db/d2f/d61/d67/f69 0 1 2024-03-12T16:10:40.302 INFO:tasks.workunit.client.1.smithi134.stdout:5/541: read - db/d12/d1d/d3a/d4e/fa2 zero size 2024-03-12T16:10:40.303 INFO:tasks.workunit.client.1.smithi134.stdout:6/431: creat d1/d16/d4c/d58/fa9 x:0 0 0 2024-03-12T16:10:40.303 INFO:tasks.workunit.client.1.smithi134.stdout:8/428: link d3/d1b/d17/d25/d33/l50 d3/d1b/d17/l86 0 2024-03-12T16:10:40.304 INFO:tasks.workunit.client.0.smithi006.stdout:5/151: link d7/d9/d10/f32 d7/f34 0 2024-03-12T16:10:40.305 INFO:tasks.workunit.client.0.smithi006.stdout:0/335: dread d2/f2b [0,4194304] 0 2024-03-12T16:10:40.306 INFO:tasks.workunit.client.0.smithi006.stdout:5/152: dread - d7/d9/d10/f32 zero size 2024-03-12T16:10:40.306 INFO:tasks.workunit.client.1.smithi134.stdout:0/496: mkdir db/d2f/d31/d75/da4 0 2024-03-12T16:10:40.307 INFO:tasks.workunit.client.0.smithi006.stdout:3/231: creat d8/d19/f4f x:0 0 0 2024-03-12T16:10:40.307 INFO:tasks.workunit.client.1.smithi134.stdout:6/432: write d1/f26 [1994735,117840] 0 2024-03-12T16:10:40.308 INFO:tasks.workunit.client.1.smithi134.stdout:5/542: creat db/d12/d1d/d59/d94/fae x:0 0 0 2024-03-12T16:10:40.311 INFO:tasks.workunit.client.1.smithi134.stdout:6/433: chown d1/d4/f67 3 1 2024-03-12T16:10:40.314 INFO:tasks.workunit.client.1.smithi134.stdout:8/429: creat d3/d1b/d17/f87 x:0 0 0 2024-03-12T16:10:40.314 INFO:tasks.workunit.client.1.smithi134.stdout:5/543: unlink db/d12/d37/d71/l78 0 2024-03-12T16:10:40.315 INFO:tasks.workunit.client.0.smithi006.stdout:7/362: dread de/d1c/d35/f7d [0,4194304] 0 2024-03-12T16:10:40.315 INFO:tasks.workunit.client.0.smithi006.stdout:7/363: read - de/d1c/f75 zero size 2024-03-12T16:10:40.316 INFO:tasks.workunit.client.1.smithi134.stdout:5/544: write db/d7d/f8d [136984,81193] 0 2024-03-12T16:10:40.316 INFO:tasks.workunit.client.0.smithi006.stdout:7/364: fdatasync de/f80 0 2024-03-12T16:10:40.316 INFO:tasks.workunit.client.0.smithi006.stdout:0/336: creat d2/f60 x:0 0 0 2024-03-12T16:10:40.317 INFO:tasks.workunit.client.1.smithi134.stdout:6/434: creat d1/d16/d4c/faa x:0 0 0 2024-03-12T16:10:40.318 INFO:tasks.workunit.client.0.smithi006.stdout:7/365: dread - de/d27/d2b/f65 zero size 2024-03-12T16:10:40.318 INFO:tasks.workunit.client.0.smithi006.stdout:5/153: unlink d7/f34 0 2024-03-12T16:10:40.319 INFO:tasks.workunit.client.1.smithi134.stdout:8/430: write d3/d1b/d17/d25/d33/d15/d2b/d4f/d65/f48 [8116169,85398] 0 2024-03-12T16:10:40.320 INFO:tasks.workunit.client.1.smithi134.stdout:8/431: chown d3/d1b 4137653 1 2024-03-12T16:10:40.320 INFO:tasks.workunit.client.1.smithi134.stdout:8/432: write d3/d1b/f1d [5775495,84043] 0 2024-03-12T16:10:40.322 INFO:tasks.workunit.client.1.smithi134.stdout:6/435: dread - d1/d3/d10/f9e zero size 2024-03-12T16:10:40.323 INFO:tasks.workunit.client.1.smithi134.stdout:8/433: readlink d3/d1b/d17/d25/d33/l50 0 2024-03-12T16:10:40.324 INFO:tasks.workunit.client.0.smithi006.stdout:5/154: chown d7/c19 123 1 2024-03-12T16:10:40.324 INFO:tasks.workunit.client.0.smithi006.stdout:3/232: symlink d8/l50 0 2024-03-12T16:10:40.325 INFO:tasks.workunit.client.1.smithi134.stdout:6/436: creat d1/d16/fab x:0 0 0 2024-03-12T16:10:40.325 INFO:tasks.workunit.client.1.smithi134.stdout:8/434: write d3/d1b/d17/d25/d33/d15/d2b/f30 [321115,112307] 0 2024-03-12T16:10:40.326 INFO:tasks.workunit.client.0.smithi006.stdout:9/263: write d0/f28 [891642,72339] 0 2024-03-12T16:10:40.327 INFO:tasks.workunit.client.1.smithi134.stdout:8/435: fsync d3/d1b/d17/d25/d49/f75 0 2024-03-12T16:10:40.327 INFO:tasks.workunit.client.1.smithi134.stdout:6/437: chown d1/d3/d19/fa1 91 1 2024-03-12T16:10:40.328 INFO:tasks.workunit.client.0.smithi006.stdout:5/155: chown d7/d9/d31 99990 1 2024-03-12T16:10:40.330 INFO:tasks.workunit.client.1.smithi134.stdout:6/438: creat d1/d4/fac x:0 0 0 2024-03-12T16:10:40.330 INFO:tasks.workunit.client.0.smithi006.stdout:2/299: dwrite d0/dc/f15 [4194304,4194304] 0 2024-03-12T16:10:40.331 INFO:tasks.workunit.client.1.smithi134.stdout:0/497: write db/f6e [5101787,37488] 0 2024-03-12T16:10:40.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/439: creat d1/d16/d4c/d58/fad x:0 0 0 2024-03-12T16:10:40.333 INFO:tasks.workunit.client.0.smithi006.stdout:5/156: readlink d7/d9/d10/l25 0 2024-03-12T16:10:40.335 INFO:tasks.workunit.client.0.smithi006.stdout:0/337: truncate d2/d39/d42/f51 3017 0 2024-03-12T16:10:40.336 INFO:tasks.workunit.client.1.smithi134.stdout:6/440: symlink d1/d3/d19/d32/lae 0 2024-03-12T16:10:40.337 INFO:tasks.workunit.client.0.smithi006.stdout:9/264: symlink d0/d8/d16/d2f/l53 0 2024-03-12T16:10:40.338 INFO:tasks.workunit.client.0.smithi006.stdout:7/366: dwrite de/d18/f47 [0,4194304] 0 2024-03-12T16:10:40.338 INFO:tasks.workunit.client.1.smithi134.stdout:6/441: fsync d1/d16/d7e/f9a 0 2024-03-12T16:10:40.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/436: write d3/d1b/d17/d25/d33/d15/d2b/d4f/f40 [941732,51918] 0 2024-03-12T16:10:40.340 INFO:tasks.workunit.client.1.smithi134.stdout:6/442: chown d1/d89 14691269 1 2024-03-12T16:10:40.342 INFO:tasks.workunit.client.0.smithi006.stdout:8/191: dwrite d2/f16 [0,4194304] 0 2024-03-12T16:10:40.343 INFO:tasks.workunit.client.1.smithi134.stdout:0/498: dwrite db/f24 [0,4194304] 0 2024-03-12T16:10:40.343 INFO:tasks.workunit.client.1.smithi134.stdout:6/443: chown d1/d16/d4c/d58/c68 51038727 1 2024-03-12T16:10:40.345 INFO:tasks.workunit.client.1.smithi134.stdout:8/437: mkdir d3/d10/d31/d88 0 2024-03-12T16:10:40.345 INFO:tasks.workunit.client.1.smithi134.stdout:6/444: chown d1/d16/d4c/d58/d8e/ca2 30 1 2024-03-12T16:10:40.347 INFO:tasks.workunit.client.1.smithi134.stdout:0/499: mkdir db/d2f/d31/d56/d66/da5 0 2024-03-12T16:10:40.347 INFO:tasks.workunit.client.0.smithi006.stdout:5/157: read - d7/d9/d10/f32 zero size 2024-03-12T16:10:40.347 INFO:tasks.workunit.client.0.smithi006.stdout:7/367: dread - de/d18/d2a/d39/f58 zero size 2024-03-12T16:10:40.348 INFO:tasks.workunit.client.0.smithi006.stdout:8/192: unlink d2/d11/l30 0 2024-03-12T16:10:40.348 INFO:tasks.workunit.client.0.smithi006.stdout:0/338: chown d2/d6/f7 94287251 1 2024-03-12T16:10:40.349 INFO:tasks.workunit.client.0.smithi006.stdout:5/158: stat d7/d8 0 2024-03-12T16:10:40.350 INFO:tasks.workunit.client.1.smithi134.stdout:8/438: creat d3/d1b/d17/d25/d33/d15/d2b/d6d/f89 x:0 0 0 2024-03-12T16:10:40.350 INFO:tasks.workunit.client.0.smithi006.stdout:9/265: creat d0/d8/d16/f54 x:0 0 0 2024-03-12T16:10:40.352 INFO:tasks.workunit.client.1.smithi134.stdout:6/445: rename d1/d3/d19/fa1 to d1/d16/d4c/d58/d8e/faf 0 2024-03-12T16:10:40.353 INFO:tasks.workunit.client.0.smithi006.stdout:8/193: stat d2/db/d1a/l29 0 2024-03-12T16:10:40.353 INFO:tasks.workunit.client.0.smithi006.stdout:2/300: chown d0/d13/d49/d60/d2b/l30 39 1 2024-03-12T16:10:40.354 INFO:tasks.workunit.client.0.smithi006.stdout:9/266: chown d0/d8/d16/d2f 159 1 2024-03-12T16:10:40.359 INFO:tasks.workunit.client.1.smithi134.stdout:6/446: rename d1/da6/f8c to d1/da6/d55/d85/fb0 0 2024-03-12T16:10:40.360 INFO:tasks.workunit.client.0.smithi006.stdout:8/194: stat d2/db/f20 0 2024-03-12T16:10:40.360 INFO:tasks.workunit.client.1.smithi134.stdout:0/500: dwrite db/d2f/d51/f7c [0,4194304] 0 2024-03-12T16:10:40.361 INFO:tasks.workunit.client.1.smithi134.stdout:6/447: stat d1/c86 0 2024-03-12T16:10:40.362 INFO:tasks.workunit.client.0.smithi006.stdout:9/267: fdatasync d0/d8/d16/d2f/f4c 0 2024-03-12T16:10:40.362 INFO:tasks.workunit.client.0.smithi006.stdout:0/339: symlink d2/d6/d10/d11/d1d/d2e/l61 0 2024-03-12T16:10:40.363 INFO:tasks.workunit.client.0.smithi006.stdout:3/233: dwrite d8/df/f4e [0,4194304] 0 2024-03-12T16:10:40.364 INFO:tasks.workunit.client.0.smithi006.stdout:8/195: readlink d2/db/l34 0 2024-03-12T16:10:40.367 INFO:tasks.workunit.client.0.smithi006.stdout:7/368: dwrite de/d1c/f26 [4194304,4194304] 0 2024-03-12T16:10:40.369 INFO:tasks.workunit.client.0.smithi006.stdout:5/159: dread d7/d8/f2b [0,4194304] 0 2024-03-12T16:10:40.370 INFO:tasks.workunit.client.0.smithi006.stdout:0/340: chown d2/d6/l5c 438 1 2024-03-12T16:10:40.371 INFO:tasks.workunit.client.1.smithi134.stdout:0/501: dwrite db/f50 [0,4194304] 0 2024-03-12T16:10:40.371 INFO:tasks.workunit.client.0.smithi006.stdout:8/196: mkdir d2/d11/d3f 0 2024-03-12T16:10:40.372 INFO:tasks.workunit.client.0.smithi006.stdout:7/369: write de/d18/f20 [1338475,93975] 0 2024-03-12T16:10:40.373 INFO:tasks.workunit.client.0.smithi006.stdout:0/341: write d2/fd [3845219,112238] 0 2024-03-12T16:10:40.374 INFO:tasks.workunit.client.1.smithi134.stdout:6/448: dread d1/d3/d10/f15 [0,4194304] 0 2024-03-12T16:10:40.376 INFO:tasks.workunit.client.1.smithi134.stdout:0/502: creat db/d2f/d61/d67/fa6 x:0 0 0 2024-03-12T16:10:40.377 INFO:tasks.workunit.client.0.smithi006.stdout:0/342: fdatasync d2/f4b 0 2024-03-12T16:10:40.377 INFO:tasks.workunit.client.0.smithi006.stdout:7/370: dread - de/d27/d2b/d4a/d6a/f79 zero size 2024-03-12T16:10:40.382 INFO:tasks.workunit.client.0.smithi006.stdout:0/343: chown d2/d6/l31 0 1 2024-03-12T16:10:40.382 INFO:tasks.workunit.client.0.smithi006.stdout:9/268: link d0/d8/d2b/d20/f51 d0/d4/d3b/d4a/f55 0 2024-03-12T16:10:40.383 INFO:tasks.workunit.client.0.smithi006.stdout:5/160: mkdir d7/d9/d10/d35 0 2024-03-12T16:10:40.384 INFO:tasks.workunit.client.1.smithi134.stdout:6/449: rename d1/d3/d19/l83 to d1/d4d/lb1 0 2024-03-12T16:10:40.385 INFO:tasks.workunit.client.1.smithi134.stdout:6/450: chown d1/d3/d19/d32/la4 297112629 1 2024-03-12T16:10:40.387 INFO:tasks.workunit.client.0.smithi006.stdout:0/344: creat d2/d6/f62 x:0 0 0 2024-03-12T16:10:40.388 INFO:tasks.workunit.client.1.smithi134.stdout:8/439: write d3/d1b/f14 [665649,90018] 0 2024-03-12T16:10:40.389 INFO:tasks.workunit.client.1.smithi134.stdout:8/440: chown d3/d1b/f14 26737882 1 2024-03-12T16:10:40.391 INFO:tasks.workunit.client.1.smithi134.stdout:8/441: dread - d3/d1b/d17/f87 zero size 2024-03-12T16:10:40.393 INFO:tasks.workunit.client.0.smithi006.stdout:7/371: mknod de/d27/d2b/d66/c82 0 2024-03-12T16:10:40.393 INFO:tasks.workunit.client.1.smithi134.stdout:0/503: getdents db/d2f/d31/d76 0 2024-03-12T16:10:40.393 INFO:tasks.workunit.client.1.smithi134.stdout:6/451: creat d1/fb2 x:0 0 0 2024-03-12T16:10:40.394 INFO:tasks.workunit.client.0.smithi006.stdout:5/161: dwrite d7/f2f [0,4194304] 0 2024-03-12T16:10:40.394 INFO:tasks.workunit.client.1.smithi134.stdout:0/504: symlink db/d2f/d31/d68/d70/la7 0 2024-03-12T16:10:40.394 INFO:tasks.workunit.client.1.smithi134.stdout:6/452: symlink d1/d3/lb3 0 2024-03-12T16:10:40.395 INFO:tasks.workunit.client.0.smithi006.stdout:0/345: chown f0 3 1 2024-03-12T16:10:40.396 INFO:tasks.workunit.client.0.smithi006.stdout:7/372: readlink de/l61 0 2024-03-12T16:10:40.401 INFO:tasks.workunit.client.1.smithi134.stdout:8/442: dwrite d3/d1b/f19 [0,4194304] 0 2024-03-12T16:10:40.402 INFO:tasks.workunit.client.0.smithi006.stdout:5/162: truncate d7/f28 306165 0 2024-03-12T16:10:40.404 INFO:tasks.workunit.client.0.smithi006.stdout:7/373: truncate de/d2c/f32 640381 0 2024-03-12T16:10:40.405 INFO:tasks.workunit.client.1.smithi134.stdout:8/443: symlink d3/d1b/d17/d3f/l8a 0 2024-03-12T16:10:40.405 INFO:tasks.workunit.client.0.smithi006.stdout:2/301: truncate d0/d13/d49/d60/d2b/f63 3643519 0 2024-03-12T16:10:40.406 INFO:tasks.workunit.client.1.smithi134.stdout:6/453: rmdir d1/d3/d19 39 2024-03-12T16:10:40.407 INFO:tasks.workunit.client.1.smithi134.stdout:6/454: write d1/fb2 [802043,93259] 0 2024-03-12T16:10:40.407 INFO:tasks.workunit.client.0.smithi006.stdout:7/374: mkdir de/d2c/d4f/d83 0 2024-03-12T16:10:40.409 INFO:tasks.workunit.client.0.smithi006.stdout:5/163: creat d7/d9/d2c/f36 x:0 0 0 2024-03-12T16:10:40.411 INFO:tasks.workunit.client.0.smithi006.stdout:7/375: creat de/d27/d2b/d4a/d6a/f84 x:0 0 0 2024-03-12T16:10:40.412 INFO:tasks.workunit.client.0.smithi006.stdout:2/302: mkdir d0/d13/d49/d60/d2b/d62/d66 0 2024-03-12T16:10:40.413 INFO:tasks.workunit.client.1.smithi134.stdout:6/455: unlink d1/da6/d55/f92 0 2024-03-12T16:10:40.413 INFO:tasks.workunit.client.0.smithi006.stdout:9/269: rmdir d0 39 2024-03-12T16:10:40.416 INFO:tasks.workunit.client.0.smithi006.stdout:5/164: creat d7/d9/d10/d24/f37 x:0 0 0 2024-03-12T16:10:40.417 INFO:tasks.workunit.client.1.smithi134.stdout:8/444: creat d3/d1b/d17/d25/d33/f8b x:0 0 0 2024-03-12T16:10:40.418 INFO:tasks.workunit.client.0.smithi006.stdout:8/197: dwrite d2/db/f20 [0,4194304] 0 2024-03-12T16:10:40.419 INFO:tasks.workunit.client.1.smithi134.stdout:8/445: truncate d3/d1b/d17/d24/f6f 740592 0 2024-03-12T16:10:40.422 INFO:tasks.workunit.client.0.smithi006.stdout:2/303: mkdir d0/d13/d49/d60/d2b/d62/d66/d67 0 2024-03-12T16:10:40.424 INFO:tasks.workunit.client.1.smithi134.stdout:0/505: dread db/d2f/d31/f3b [0,4194304] 0 2024-03-12T16:10:40.425 INFO:tasks.workunit.client.1.smithi134.stdout:6/456: dwrite d1/d16/d4c/d58/d8e/faf [0,4194304] 0 2024-03-12T16:10:40.427 INFO:tasks.workunit.client.1.smithi134.stdout:8/446: dread d3/f6 [4194304,4194304] 0 2024-03-12T16:10:40.428 INFO:tasks.workunit.client.0.smithi006.stdout:8/198: creat d2/db/d1a/d21/d2b/f40 x:0 0 0 2024-03-12T16:10:40.428 INFO:tasks.workunit.client.0.smithi006.stdout:5/165: truncate d7/d9/d10/f1b 4935869 0 2024-03-12T16:10:40.428 INFO:tasks.workunit.client.0.smithi006.stdout:9/270: rename d0/d8/c3e to d0/d8/d2b/d20/d37/c56 0 2024-03-12T16:10:40.428 INFO:tasks.workunit.client.1.smithi134.stdout:6/457: truncate d1/da6/d55/d94/d75/f7f 5063562 0 2024-03-12T16:10:40.431 INFO:tasks.workunit.client.0.smithi006.stdout:0/346: dwrite d2/f4 [0,4194304] 0 2024-03-12T16:10:40.432 INFO:tasks.workunit.client.1.smithi134.stdout:2/425: sync 2024-03-12T16:10:40.433 INFO:tasks.workunit.client.0.smithi006.stdout:8/199: mknod d2/db/d1a/c41 0 2024-03-12T16:10:40.439 INFO:tasks.workunit.client.0.smithi006.stdout:3/234: dread d8/df/f1a [0,4194304] 0 2024-03-12T16:10:40.439 INFO:tasks.workunit.client.0.smithi006.stdout:8/200: chown d2/d11/f14 105183454 1 2024-03-12T16:10:40.439 INFO:tasks.workunit.client.0.smithi006.stdout:9/271: getdents d0/d8/d2b/d20 0 2024-03-12T16:10:40.442 INFO:tasks.workunit.client.0.smithi006.stdout:3/235: dread - d8/df/d2c/dc/f3a zero size 2024-03-12T16:10:40.442 INFO:tasks.workunit.client.0.smithi006.stdout:0/347: dread d2/d6/d10/f4c [0,4194304] 0 2024-03-12T16:10:40.443 INFO:tasks.workunit.client.0.smithi006.stdout:8/201: creat d2/d11/f42 x:0 0 0 2024-03-12T16:10:40.443 INFO:tasks.workunit.client.0.smithi006.stdout:5/166: dwrite d7/d8/f2b [0,4194304] 0 2024-03-12T16:10:40.445 INFO:tasks.workunit.client.0.smithi006.stdout:3/236: write d8/df/f1e [2353341,105160] 0 2024-03-12T16:10:40.446 INFO:tasks.workunit.client.0.smithi006.stdout:0/348: fsync d2/d6/d10/d11/d32/f4a 0 2024-03-12T16:10:40.446 INFO:tasks.workunit.client.1.smithi134.stdout:6/458: mknod d1/d16/d4c/d65/d9d/cb4 0 2024-03-12T16:10:40.448 INFO:tasks.workunit.client.1.smithi134.stdout:0/506: dwrite db/d2f/d31/d76/f9c [0,4194304] 0 2024-03-12T16:10:40.449 INFO:tasks.workunit.client.0.smithi006.stdout:9/272: creat d0/d8/d2b/d20/d37/f57 x:0 0 0 2024-03-12T16:10:40.450 INFO:tasks.workunit.client.0.smithi006.stdout:8/202: symlink d2/db/d1a/d21/d2b/l43 0 2024-03-12T16:10:40.451 INFO:tasks.workunit.client.0.smithi006.stdout:5/167: dread d7/d9/d10/f1b [0,4194304] 0 2024-03-12T16:10:40.454 INFO:tasks.workunit.client.0.smithi006.stdout:3/237: dread d8/df/f4e [0,4194304] 0 2024-03-12T16:10:40.455 INFO:tasks.workunit.client.1.smithi134.stdout:2/426: symlink d4/d84/d7d/l96 0 2024-03-12T16:10:40.458 INFO:tasks.workunit.client.0.smithi006.stdout:9/273: creat d0/d8/d16/f58 x:0 0 0 2024-03-12T16:10:40.459 INFO:tasks.workunit.client.0.smithi006.stdout:9/274: stat d0/d1f/l26 0 2024-03-12T16:10:40.460 INFO:tasks.workunit.client.0.smithi006.stdout:5/168: dread d7/d9/fc [0,4194304] 0 2024-03-12T16:10:40.461 INFO:tasks.workunit.client.1.smithi134.stdout:2/427: truncate d4/d3c/f69 321273 0 2024-03-12T16:10:40.461 INFO:tasks.workunit.client.0.smithi006.stdout:8/203: symlink d2/db/d1a/d1f/l44 0 2024-03-12T16:10:40.462 INFO:tasks.workunit.client.1.smithi134.stdout:2/428: readlink d4/d12/d1d/l6e 0 2024-03-12T16:10:40.466 INFO:tasks.workunit.client.1.smithi134.stdout:2/429: link d4/d12/d1d/d34/d58/f82 d4/d12/d1d/f97 0 2024-03-12T16:10:40.466 INFO:tasks.workunit.client.1.smithi134.stdout:2/430: fdatasync d4/d12/d1d/d34/d58/f7c 0 2024-03-12T16:10:40.467 INFO:tasks.workunit.client.0.smithi006.stdout:9/275: dread d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:40.473 INFO:tasks.workunit.client.0.smithi006.stdout:2/304: truncate d0/d13/f44 2733848 0 2024-03-12T16:10:40.473 INFO:tasks.workunit.client.0.smithi006.stdout:7/376: dread f6 [4194304,4194304] 0 2024-03-12T16:10:40.478 INFO:tasks.workunit.client.1.smithi134.stdout:6/459: truncate d1/d16/d4c/d58/d8e/faf 1560868 0 2024-03-12T16:10:40.478 INFO:tasks.workunit.client.0.smithi006.stdout:2/305: mknod d0/d13/d49/d60/d2b/c68 0 2024-03-12T16:10:40.479 INFO:tasks.workunit.client.1.smithi134.stdout:0/507: truncate db/fe 1411484 0 2024-03-12T16:10:40.479 INFO:tasks.workunit.client.0.smithi006.stdout:7/377: readlink de/d1c/d35/l74 0 2024-03-12T16:10:40.480 INFO:tasks.workunit.client.0.smithi006.stdout:0/349: getdents d2/d39 0 2024-03-12T16:10:40.481 INFO:tasks.workunit.client.1.smithi134.stdout:6/460: mkdir d1/d3a/db5 0 2024-03-12T16:10:40.481 INFO:tasks.workunit.client.0.smithi006.stdout:2/306: truncate d0/d13/d49/d60/f3b 4755120 0 2024-03-12T16:10:40.483 INFO:tasks.workunit.client.1.smithi134.stdout:0/508: symlink db/d2f/d31/d56/la8 0 2024-03-12T16:10:40.484 INFO:tasks.workunit.client.0.smithi006.stdout:7/378: rmdir de/d18/d2a/d39 39 2024-03-12T16:10:40.486 INFO:tasks.workunit.client.0.smithi006.stdout:3/238: getdents d8/df/d2c/dc 0 2024-03-12T16:10:40.486 INFO:tasks.workunit.client.1.smithi134.stdout:6/461: unlink d1/d3/d19/c7d 0 2024-03-12T16:10:40.487 INFO:tasks.workunit.client.0.smithi006.stdout:0/350: rmdir d2/d39 39 2024-03-12T16:10:40.488 INFO:tasks.workunit.client.1.smithi134.stdout:0/509: getdents db/d2f/d31/d76 0 2024-03-12T16:10:40.489 INFO:tasks.workunit.client.0.smithi006.stdout:0/351: chown d2/d6/f7 107 1 2024-03-12T16:10:40.489 INFO:tasks.workunit.client.0.smithi006.stdout:2/307: chown d0/c24 3 1 2024-03-12T16:10:40.490 INFO:tasks.workunit.client.1.smithi134.stdout:2/431: dwrite d4/d12/d1d/d34/f6c [0,4194304] 0 2024-03-12T16:10:40.490 INFO:tasks.workunit.client.0.smithi006.stdout:7/379: dread de/d18/f20 [0,4194304] 0 2024-03-12T16:10:40.492 INFO:tasks.workunit.client.0.smithi006.stdout:7/380: write de/f23 [1643803,106931] 0 2024-03-12T16:10:40.492 INFO:tasks.workunit.client.1.smithi134.stdout:2/432: readlink d4/d12/d1d/l6e 0 2024-03-12T16:10:40.494 INFO:tasks.workunit.client.0.smithi006.stdout:3/239: creat d8/df/d3b/f51 x:0 0 0 2024-03-12T16:10:40.495 INFO:tasks.workunit.client.0.smithi006.stdout:9/276: link d0/d8/d23/l2e d0/d8/l59 0 2024-03-12T16:10:40.496 INFO:tasks.workunit.client.0.smithi006.stdout:3/240: dread - d8/df/d2c/dc/d28/f40 zero size 2024-03-12T16:10:40.499 INFO:tasks.workunit.client.1.smithi134.stdout:6/462: dwrite d1/d4/f80 [0,4194304] 0 2024-03-12T16:10:40.500 INFO:tasks.workunit.client.0.smithi006.stdout:2/308: mkdir d0/d13/d49/d60/d2b/d62/d66/d69 0 2024-03-12T16:10:40.500 INFO:tasks.workunit.client.0.smithi006.stdout:9/277: read d0/f28 [742663,119504] 0 2024-03-12T16:10:40.505 INFO:tasks.workunit.client.0.smithi006.stdout:1/238: sync 2024-03-12T16:10:40.505 INFO:tasks.workunit.client.0.smithi006.stdout:4/352: sync 2024-03-12T16:10:40.505 INFO:tasks.workunit.client.0.smithi006.stdout:6/180: sync 2024-03-12T16:10:40.507 INFO:tasks.workunit.client.0.smithi006.stdout:0/352: creat d2/d39/f63 x:0 0 0 2024-03-12T16:10:40.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/510: dwrite db/f6e [0,4194304] 0 2024-03-12T16:10:40.509 INFO:tasks.workunit.client.1.smithi134.stdout:2/433: mknod d4/d12/d1d/d34/d47/d8c/c98 0 2024-03-12T16:10:40.512 INFO:tasks.workunit.client.1.smithi134.stdout:0/511: chown db/d2f/d31/d75/f7f 15288329 1 2024-03-12T16:10:40.513 INFO:tasks.workunit.client.1.smithi134.stdout:2/434: dread d4/d84/f7a [0,4194304] 0 2024-03-12T16:10:40.514 INFO:tasks.workunit.client.0.smithi006.stdout:9/278: write d0/d8/d2b/f48 [794555,108889] 0 2024-03-12T16:10:40.515 INFO:tasks.workunit.client.1.smithi134.stdout:0/512: creat db/d2f/d61/d6c/fa9 x:0 0 0 2024-03-12T16:10:40.516 INFO:tasks.workunit.client.0.smithi006.stdout:2/309: write d0/d13/d49/d60/d2b/f56 [3256479,97711] 0 2024-03-12T16:10:40.517 INFO:tasks.workunit.client.1.smithi134.stdout:6/463: write d1/d16/d4c/d65/d61/fa7 [591117,83543] 0 2024-03-12T16:10:40.517 INFO:tasks.workunit.client.0.smithi006.stdout:7/381: mknod de/d18/d2a/d39/d81/c85 0 2024-03-12T16:10:40.519 INFO:tasks.workunit.client.1.smithi134.stdout:2/435: mknod d4/c99 0 2024-03-12T16:10:40.519 INFO:tasks.workunit.client.1.smithi134.stdout:6/464: write d1/d3/d19/d32/f37 [466666,78858] 0 2024-03-12T16:10:40.520 INFO:tasks.workunit.client.0.smithi006.stdout:1/239: symlink d0/d25/l4f 0 2024-03-12T16:10:40.521 INFO:tasks.workunit.client.1.smithi134.stdout:2/436: stat d4/d12/d1d/d34/d58/f75 0 2024-03-12T16:10:40.522 INFO:tasks.workunit.client.1.smithi134.stdout:0/513: getdents db/d2f/d31/d56/d66 0 2024-03-12T16:10:40.523 INFO:tasks.workunit.client.1.smithi134.stdout:6/465: mknod d1/da6/d55/d85/cb6 0 2024-03-12T16:10:40.524 INFO:tasks.workunit.client.1.smithi134.stdout:2/437: mknod d4/d12/d43/c9a 0 2024-03-12T16:10:40.525 INFO:tasks.workunit.client.0.smithi006.stdout:5/169: dwrite d7/f28 [0,4194304] 0 2024-03-12T16:10:40.526 INFO:tasks.workunit.client.1.smithi134.stdout:2/438: write d4/d84/f35 [2637746,74129] 0 2024-03-12T16:10:40.528 INFO:tasks.workunit.client.0.smithi006.stdout:8/204: dwrite d2/db/fe [0,4194304] 0 2024-03-12T16:10:40.529 INFO:tasks.workunit.client.1.smithi134.stdout:6/466: rename d1/d4d to d1/d16/d4c/d58/da0/db7 0 2024-03-12T16:10:40.530 INFO:tasks.workunit.client.1.smithi134.stdout:2/439: mkdir d4/d12/d3b/d9b 0 2024-03-12T16:10:40.531 INFO:tasks.workunit.client.1.smithi134.stdout:6/467: symlink d1/da6/d55/d85/lb8 0 2024-03-12T16:10:40.537 INFO:tasks.workunit.client.0.smithi006.stdout:4/353: write d1/db/d39/d42/f51 [3541609,90189] 0 2024-03-12T16:10:40.537 INFO:tasks.workunit.client.0.smithi006.stdout:6/181: unlink d3/d11/d10/d1b/d20/d26/l30 0 2024-03-12T16:10:40.537 INFO:tasks.workunit.client.0.smithi006.stdout:3/241: dwrite d8/df/d2c/dc/d28/d2f/f3c [0,4194304] 0 2024-03-12T16:10:40.537 INFO:tasks.workunit.client.0.smithi006.stdout:9/279: mknod d0/d8/d2b/d20/d37/c5a 0 2024-03-12T16:10:40.543 INFO:tasks.workunit.client.0.smithi006.stdout:5/170: creat d7/d9/d10/d24/f38 x:0 0 0 2024-03-12T16:10:40.544 INFO:tasks.workunit.client.0.smithi006.stdout:7/382: mknod de/d27/d2b/d4a/d6a/c86 0 2024-03-12T16:10:40.548 INFO:tasks.workunit.client.1.smithi134.stdout:6/468: dwrite d1/d16/d4c/d58/da0/db7/f71 [0,4194304] 0 2024-03-12T16:10:40.551 INFO:tasks.workunit.client.1.smithi134.stdout:6/469: symlink d1/d3/d10/lb9 0 2024-03-12T16:10:40.552 INFO:tasks.workunit.client.0.smithi006.stdout:8/205: dwrite d2/db/fe [0,4194304] 0 2024-03-12T16:10:40.552 INFO:tasks.workunit.client.0.smithi006.stdout:9/280: rename d0/d8/d2b/d20/l42 to d0/d1f/l5b 0 2024-03-12T16:10:40.553 INFO:tasks.workunit.client.0.smithi006.stdout:0/353: dread d2/d39/d42/f51 [0,4194304] 0 2024-03-12T16:10:40.555 INFO:tasks.workunit.client.0.smithi006.stdout:7/383: chown de/d2c/l30 52 1 2024-03-12T16:10:40.556 INFO:tasks.workunit.client.1.smithi134.stdout:6/470: truncate d1/d16/d4c/d58/d8e/faf 1238354 0 2024-03-12T16:10:40.557 INFO:tasks.workunit.client.0.smithi006.stdout:3/242: read d8/fe [475951,123999] 0 2024-03-12T16:10:40.558 INFO:tasks.workunit.client.1.smithi134.stdout:6/471: creat d1/d16/d4c/d58/fba x:0 0 0 2024-03-12T16:10:40.560 INFO:tasks.workunit.client.1.smithi134.stdout:1/330: sync 2024-03-12T16:10:40.560 INFO:tasks.workunit.client.1.smithi134.stdout:9/397: sync 2024-03-12T16:10:40.560 INFO:tasks.workunit.client.1.smithi134.stdout:3/573: sync 2024-03-12T16:10:40.560 INFO:tasks.workunit.client.1.smithi134.stdout:4/397: sync 2024-03-12T16:10:40.563 INFO:tasks.workunit.client.1.smithi134.stdout:0/514: dread db/d2f/f52 [0,4194304] 0 2024-03-12T16:10:40.565 INFO:tasks.workunit.client.1.smithi134.stdout:1/331: read d0/d16/d9/d13/d21/f4c [896112,6342] 0 2024-03-12T16:10:40.565 INFO:tasks.workunit.client.1.smithi134.stdout:6/472: rename d1/d3/d19/f63 to d1/da6/d55/d94/fbb 0 2024-03-12T16:10:40.568 INFO:tasks.workunit.client.1.smithi134.stdout:6/473: fdatasync d1/d16/d4c/d65/f5c 0 2024-03-12T16:10:40.569 INFO:tasks.workunit.client.0.smithi006.stdout:6/182: link d3/d11/d10/f32 d3/d11/f3c 0 2024-03-12T16:10:40.571 INFO:tasks.workunit.client.1.smithi134.stdout:9/398: rename d5/d10/d35/f5f to d5/d10/d35/f6f 0 2024-03-12T16:10:40.573 INFO:tasks.workunit.client.0.smithi006.stdout:2/310: dwrite d0/dc/f15 [0,4194304] 0 2024-03-12T16:10:40.573 INFO:tasks.workunit.client.1.smithi134.stdout:9/399: readlink d5/d10/d33/l62 0 2024-03-12T16:10:40.573 INFO:tasks.workunit.client.0.smithi006.stdout:7/384: read de/d1c/f25 [1650914,27560] 0 2024-03-12T16:10:40.574 INFO:tasks.workunit.client.1.smithi134.stdout:2/440: dread d4/d12/d3b/d3f/f5d [0,4194304] 0 2024-03-12T16:10:40.574 INFO:tasks.workunit.client.1.smithi134.stdout:0/515: mkdir db/d2f/d31/d68/d70/daa 0 2024-03-12T16:10:40.575 INFO:tasks.workunit.client.0.smithi006.stdout:1/240: dwrite d0/f13 [0,4194304] 0 2024-03-12T16:10:40.576 INFO:tasks.workunit.client.0.smithi006.stdout:0/354: creat d2/d39/d42/f64 x:0 0 0 2024-03-12T16:10:40.576 INFO:tasks.workunit.client.1.smithi134.stdout:2/441: write d4/d12/f4a [390125,52697] 0 2024-03-12T16:10:40.576 INFO:tasks.workunit.client.0.smithi006.stdout:4/354: dwrite d1/db/d1d/d2f/f4c [0,4194304] 0 2024-03-12T16:10:40.578 INFO:tasks.workunit.client.0.smithi006.stdout:4/355: truncate d1/db/d17/f32 8701300 0 2024-03-12T16:10:40.580 INFO:tasks.workunit.client.1.smithi134.stdout:6/474: rename d1/da6/d55/d94/c91 to d1/d16/d4c/cbc 0 2024-03-12T16:10:40.580 INFO:tasks.workunit.client.1.smithi134.stdout:9/400: creat d5/d20/f70 x:0 0 0 2024-03-12T16:10:40.580 INFO:tasks.workunit.client.1.smithi134.stdout:4/398: dread d1/d13/d49/d64/d28/f3b [0,4194304] 0 2024-03-12T16:10:40.581 INFO:tasks.workunit.client.1.smithi134.stdout:6/475: stat d1/d3/l62 0 2024-03-12T16:10:40.581 INFO:tasks.workunit.client.0.smithi006.stdout:8/206: creat d2/db/d1a/d23/f45 x:0 0 0 2024-03-12T16:10:40.584 INFO:tasks.workunit.client.0.smithi006.stdout:9/281: creat d0/d8/d2b/d20/d37/f5c x:0 0 0 2024-03-12T16:10:40.584 INFO:tasks.workunit.client.1.smithi134.stdout:0/516: mknod db/d2f/d31/cab 0 2024-03-12T16:10:40.584 INFO:tasks.workunit.client.1.smithi134.stdout:1/332: creat d0/f74 x:0 0 0 2024-03-12T16:10:40.585 INFO:tasks.workunit.client.0.smithi006.stdout:7/385: chown de/f17 7 1 2024-03-12T16:10:40.587 INFO:tasks.workunit.client.0.smithi006.stdout:6/183: stat d3/d11/d10/d1b 0 2024-03-12T16:10:40.587 INFO:tasks.workunit.client.0.smithi006.stdout:1/241: rename d0/d25/f28 to d0/d25/d2a/d35/d3f/f50 0 2024-03-12T16:10:40.589 INFO:tasks.workunit.client.0.smithi006.stdout:5/171: dread d7/f2f [0,4194304] 0 2024-03-12T16:10:40.590 INFO:tasks.workunit.client.1.smithi134.stdout:2/442: dread d4/d3c/f53 [0,4194304] 0 2024-03-12T16:10:40.592 INFO:tasks.workunit.client.1.smithi134.stdout:4/399: unlink d1/d13/d49/f5f 0 2024-03-12T16:10:40.593 INFO:tasks.workunit.client.1.smithi134.stdout:7/477: sync 2024-03-12T16:10:40.593 INFO:tasks.workunit.client.1.smithi134.stdout:8/447: sync 2024-03-12T16:10:40.593 INFO:tasks.workunit.client.1.smithi134.stdout:5/545: sync 2024-03-12T16:10:40.595 INFO:tasks.workunit.client.0.smithi006.stdout:3/243: getdents d8/df/d2c 0 2024-03-12T16:10:40.597 INFO:tasks.workunit.client.0.smithi006.stdout:4/356: getdents d1/db/d1d 0 2024-03-12T16:10:40.597 INFO:tasks.workunit.client.1.smithi134.stdout:0/517: rename db/d2f/d31/d68/d70/la7 to db/d2f/d61/d67/lac 0 2024-03-12T16:10:40.601 INFO:tasks.workunit.client.0.smithi006.stdout:9/282: rename d0/d8/d23/l2e to d0/d4/d3b/l5d 0 2024-03-12T16:10:40.601 INFO:tasks.workunit.client.0.smithi006.stdout:6/184: mknod d3/d11/c3d 0 2024-03-12T16:10:40.601 INFO:tasks.workunit.client.1.smithi134.stdout:9/401: creat d5/d10/d35/d49/d54/d5e/f71 x:0 0 0 2024-03-12T16:10:40.603 INFO:tasks.workunit.client.1.smithi134.stdout:5/546: stat db/d12/d29/d3d/l5d 0 2024-03-12T16:10:40.605 INFO:tasks.workunit.client.0.smithi006.stdout:7/386: dwrite de/d1c/f75 [0,4194304] 0 2024-03-12T16:10:40.605 INFO:tasks.workunit.client.1.smithi134.stdout:3/574: dread d1/f66 [0,4194304] 0 2024-03-12T16:10:40.606 INFO:tasks.workunit.client.1.smithi134.stdout:0/518: creat db/d2f/d71/fad x:0 0 0 2024-03-12T16:10:40.607 INFO:tasks.workunit.client.1.smithi134.stdout:4/400: dread d1/d24/f56 [0,4194304] 0 2024-03-12T16:10:40.608 INFO:tasks.workunit.client.1.smithi134.stdout:7/478: chown d8/dc/d20/l15 216 1 2024-03-12T16:10:40.609 INFO:tasks.workunit.client.1.smithi134.stdout:3/575: write d1/fb0 [66773,129838] 0 2024-03-12T16:10:40.610 INFO:tasks.workunit.client.0.smithi006.stdout:1/242: link d0/d25/f2b d0/d25/d2a/d35/f51 0 2024-03-12T16:10:40.610 INFO:tasks.workunit.client.1.smithi134.stdout:9/402: mkdir d5/d20/d72 0 2024-03-12T16:10:40.610 INFO:tasks.workunit.client.0.smithi006.stdout:8/207: link d2/db/d1a/c41 d2/db/d1a/d23/c46 0 2024-03-12T16:10:40.611 INFO:tasks.workunit.client.0.smithi006.stdout:9/283: fsync d0/d8/d2b/d20/f36 0 2024-03-12T16:10:40.612 INFO:tasks.workunit.client.1.smithi134.stdout:0/519: write db/d2f/d61/d67/fa6 [686898,79377] 0 2024-03-12T16:10:40.613 INFO:tasks.workunit.client.0.smithi006.stdout:3/244: mkdir d8/d52 0 2024-03-12T16:10:40.615 INFO:tasks.workunit.client.0.smithi006.stdout:4/357: getdents d1/db/d17/d5a/d60 0 2024-03-12T16:10:40.615 INFO:tasks.workunit.client.0.smithi006.stdout:5/172: creat d7/d9/d10/f39 x:0 0 0 2024-03-12T16:10:40.615 INFO:tasks.workunit.client.0.smithi006.stdout:8/208: read d2/d11/f27 [103434,6963] 0 2024-03-12T16:10:40.616 INFO:tasks.workunit.client.1.smithi134.stdout:0/520: chown db/d2f/d61/d67/fa0 1657287528 1 2024-03-12T16:10:40.616 INFO:tasks.workunit.client.1.smithi134.stdout:7/479: write d8/dc/f5d [829855,21228] 0 2024-03-12T16:10:40.617 INFO:tasks.workunit.client.0.smithi006.stdout:3/245: write d8/df/f42 [3563848,67993] 0 2024-03-12T16:10:40.618 INFO:tasks.workunit.client.1.smithi134.stdout:7/480: write d8/dc/d20/d26/f2b [4495816,98419] 0 2024-03-12T16:10:40.620 INFO:tasks.workunit.client.0.smithi006.stdout:9/284: write d0/d8/d16/f46 [145648,74003] 0 2024-03-12T16:10:40.620 INFO:tasks.workunit.client.0.smithi006.stdout:3/246: write d8/f17 [2743717,81544] 0 2024-03-12T16:10:40.620 INFO:tasks.workunit.client.0.smithi006.stdout:8/209: chown d2/db/d1a/d23/d3e 424670830 1 2024-03-12T16:10:40.621 INFO:tasks.workunit.client.0.smithi006.stdout:1/243: rmdir d0/d25/d2a/d43 39 2024-03-12T16:10:40.622 INFO:tasks.workunit.client.1.smithi134.stdout:9/403: unlink d5/fe 0 2024-03-12T16:10:40.622 INFO:tasks.workunit.client.1.smithi134.stdout:5/547: dread db/d12/d1d/d3a/f88 [0,4194304] 0 2024-03-12T16:10:40.623 INFO:tasks.workunit.client.0.smithi006.stdout:1/244: chown d0/d25/f2b 15 1 2024-03-12T16:10:40.623 INFO:tasks.workunit.client.0.smithi006.stdout:2/311: dread d0/d13/f1d [0,4194304] 0 2024-03-12T16:10:40.624 INFO:tasks.workunit.client.1.smithi134.stdout:5/548: chown db/d12/d37/c8e 117920 1 2024-03-12T16:10:40.624 INFO:tasks.workunit.client.0.smithi006.stdout:5/173: creat d7/d9/d2c/f3a x:0 0 0 2024-03-12T16:10:40.626 INFO:tasks.workunit.client.1.smithi134.stdout:5/549: chown db/d12/d37/c3f 3073 1 2024-03-12T16:10:40.626 INFO:tasks.workunit.client.0.smithi006.stdout:1/245: write d0/d25/d2a/d35/f4b [354112,128843] 0 2024-03-12T16:10:40.627 INFO:tasks.workunit.client.0.smithi006.stdout:4/358: mknod d1/db/d17/d43/c6d 0 2024-03-12T16:10:40.627 INFO:tasks.workunit.client.0.smithi006.stdout:9/285: rmdir d0/d8/d16/d2f 39 2024-03-12T16:10:40.627 INFO:tasks.workunit.client.0.smithi006.stdout:1/246: chown d0/f21 1485 1 2024-03-12T16:10:40.628 INFO:tasks.workunit.client.1.smithi134.stdout:4/401: creat d1/d24/d34/f83 x:0 0 0 2024-03-12T16:10:40.630 INFO:tasks.workunit.client.0.smithi006.stdout:8/210: mkdir d2/db/d1a/d23/d47 0 2024-03-12T16:10:40.630 INFO:tasks.workunit.client.0.smithi006.stdout:3/247: mknod d8/df/d2c/dc/d28/d2f/c53 0 2024-03-12T16:10:40.631 INFO:tasks.workunit.client.1.smithi134.stdout:0/521: dwrite db/d2f/d31/f47 [0,4194304] 0 2024-03-12T16:10:40.631 INFO:tasks.workunit.client.1.smithi134.stdout:7/481: mkdir d8/d4e/da2 0 2024-03-12T16:10:40.634 INFO:tasks.workunit.client.0.smithi006.stdout:2/312: chown d0/d13/f44 0 1 2024-03-12T16:10:40.634 INFO:tasks.workunit.client.0.smithi006.stdout:5/174: mkdir d7/d9/d31/d3b 0 2024-03-12T16:10:40.634 INFO:tasks.workunit.client.1.smithi134.stdout:9/404: dread d5/d46/f5c [0,4194304] 0 2024-03-12T16:10:40.635 INFO:tasks.workunit.client.0.smithi006.stdout:9/286: mknod d0/d8/d23/c5e 0 2024-03-12T16:10:40.637 INFO:tasks.workunit.client.1.smithi134.stdout:6/476: truncate d1/d4/f14 3175043 0 2024-03-12T16:10:40.638 INFO:tasks.workunit.client.1.smithi134.stdout:0/522: dread db/d2f/d31/d56/f5e [0,4194304] 0 2024-03-12T16:10:40.642 INFO:tasks.workunit.client.1.smithi134.stdout:5/550: readlink db/d12/d37/d73/l8f 0 2024-03-12T16:10:40.643 INFO:tasks.workunit.client.1.smithi134.stdout:4/402: mkdir d1/de/d5a/d84 0 2024-03-12T16:10:40.643 INFO:tasks.workunit.client.1.smithi134.stdout:4/403: fdatasync d1/de/f36 0 2024-03-12T16:10:40.643 INFO:tasks.workunit.client.0.smithi006.stdout:5/175: dread - d7/d9/f30 zero size 2024-03-12T16:10:40.643 INFO:tasks.workunit.client.0.smithi006.stdout:3/248: creat d8/d4c/f54 x:0 0 0 2024-03-12T16:10:40.644 INFO:tasks.workunit.client.1.smithi134.stdout:1/333: truncate d0/d16/d9/d13/d38/f72 1501547 0 2024-03-12T16:10:40.644 INFO:tasks.workunit.client.0.smithi006.stdout:1/247: dwrite d0/d25/f40 [0,4194304] 0 2024-03-12T16:10:40.645 INFO:tasks.workunit.client.1.smithi134.stdout:1/334: chown d0/d16/d9/d13/d21/d5f/c67 3 1 2024-03-12T16:10:40.645 INFO:tasks.workunit.client.0.smithi006.stdout:7/387: dread de/d18/f19 [0,4194304] 0 2024-03-12T16:10:40.646 INFO:tasks.workunit.client.0.smithi006.stdout:9/287: creat d0/d8/d2b/d20/d37/f5f x:0 0 0 2024-03-12T16:10:40.646 INFO:tasks.workunit.client.0.smithi006.stdout:1/248: stat d0/d25/c31 0 2024-03-12T16:10:40.647 INFO:tasks.workunit.client.0.smithi006.stdout:6/185: write d3/f17 [40046,1105] 0 2024-03-12T16:10:40.648 INFO:tasks.workunit.client.0.smithi006.stdout:2/313: mkdir d0/d13/d49/d60/d2b/d62/d66/d67/d6a 0 2024-03-12T16:10:40.651 INFO:tasks.workunit.client.1.smithi134.stdout:9/405: creat d5/d10/d35/f73 x:0 0 0 2024-03-12T16:10:40.652 INFO:tasks.workunit.client.1.smithi134.stdout:0/523: unlink l3 0 2024-03-12T16:10:40.652 INFO:tasks.workunit.client.0.smithi006.stdout:8/211: dwrite d2/f3a [0,4194304] 0 2024-03-12T16:10:40.653 INFO:tasks.workunit.client.0.smithi006.stdout:2/314: dread - d0/d13/f27 zero size 2024-03-12T16:10:40.654 INFO:tasks.workunit.client.1.smithi134.stdout:7/482: symlink d8/dc/la3 0 2024-03-12T16:10:40.655 INFO:tasks.workunit.client.0.smithi006.stdout:3/249: symlink d8/d52/l55 0 2024-03-12T16:10:40.655 INFO:tasks.workunit.client.0.smithi006.stdout:9/288: symlink d0/d8/d2b/l60 0 2024-03-12T16:10:40.655 INFO:tasks.workunit.client.0.smithi006.stdout:8/212: read d2/db/f2e [140734,43480] 0 2024-03-12T16:10:40.656 INFO:tasks.workunit.client.1.smithi134.stdout:2/443: dwrite d4/d12/d3b/d3f/f92 [0,4194304] 0 2024-03-12T16:10:40.656 INFO:tasks.workunit.client.0.smithi006.stdout:1/249: mknod d0/d25/d2a/d35/d3f/c52 0 2024-03-12T16:10:40.657 INFO:tasks.workunit.client.0.smithi006.stdout:6/186: mknod d3/d11/d10/d19/c3e 0 2024-03-12T16:10:40.657 INFO:tasks.workunit.client.0.smithi006.stdout:9/289: fsync d0/d8/d16/f43 0 2024-03-12T16:10:40.658 INFO:tasks.workunit.client.1.smithi134.stdout:3/576: rename d1/l67 to d1/db/ld6 0 2024-03-12T16:10:40.659 INFO:tasks.workunit.client.1.smithi134.stdout:2/444: chown d4/d12/d1d/d34/d58/d74 75012 1 2024-03-12T16:10:40.660 INFO:tasks.workunit.client.0.smithi006.stdout:9/290: truncate d0/d4/d3b/d4a/f55 466710 0 2024-03-12T16:10:40.661 INFO:tasks.workunit.client.1.smithi134.stdout:5/551: creat db/d7a/da8/faf x:0 0 0 2024-03-12T16:10:40.662 INFO:tasks.workunit.client.0.smithi006.stdout:9/291: write d0/d8/d2b/d20/d37/f5c [87245,95861] 0 2024-03-12T16:10:40.663 INFO:tasks.workunit.client.0.smithi006.stdout:2/315: creat d0/d13/d49/d60/d2b/f6b x:0 0 0 2024-03-12T16:10:40.664 INFO:tasks.workunit.client.1.smithi134.stdout:4/404: creat d1/de/d5a/d84/f85 x:0 0 0 2024-03-12T16:10:40.664 INFO:tasks.workunit.client.1.smithi134.stdout:7/483: rmdir d8/d27 39 2024-03-12T16:10:40.665 INFO:tasks.workunit.client.0.smithi006.stdout:3/250: creat d8/d4c/f56 x:0 0 0 2024-03-12T16:10:40.665 INFO:tasks.workunit.client.0.smithi006.stdout:2/316: chown d0 73273 1 2024-03-12T16:10:40.667 INFO:tasks.workunit.client.0.smithi006.stdout:1/250: rename d0/c18 to d0/d39/c53 0 2024-03-12T16:10:40.672 INFO:tasks.workunit.client.1.smithi134.stdout:2/445: symlink d4/d12/d3b/d3f/l9c 0 2024-03-12T16:10:40.673 INFO:tasks.workunit.client.1.smithi134.stdout:5/552: creat db/d12/d1d/d59/d94/fb0 x:0 0 0 2024-03-12T16:10:40.674 INFO:tasks.workunit.client.0.smithi006.stdout:5/176: link d7/d9/f20 d7/d9/d10/d35/f3c 0 2024-03-12T16:10:40.674 INFO:tasks.workunit.client.0.smithi006.stdout:9/292: rmdir d0/d8/d23 39 2024-03-12T16:10:40.674 INFO:tasks.workunit.client.0.smithi006.stdout:3/251: mknod d8/df/d2c/dc/d28/c57 0 2024-03-12T16:10:40.674 INFO:tasks.workunit.client.0.smithi006.stdout:9/293: truncate d0/d8/f38 1190901 0 2024-03-12T16:10:40.675 INFO:tasks.workunit.client.0.smithi006.stdout:5/177: creat d7/d9/d10/d24/f3d x:0 0 0 2024-03-12T16:10:40.676 INFO:tasks.workunit.client.0.smithi006.stdout:9/294: read d0/d4/d3b/f3d [1277219,19206] 0 2024-03-12T16:10:40.677 INFO:tasks.workunit.client.0.smithi006.stdout:3/252: fsync d8/df/f1f 0 2024-03-12T16:10:40.678 INFO:tasks.workunit.client.1.smithi134.stdout:0/524: dwrite db/f1d [0,4194304] 0 2024-03-12T16:10:40.678 INFO:tasks.workunit.client.0.smithi006.stdout:5/178: creat d7/d9/d10/d24/f3e x:0 0 0 2024-03-12T16:10:40.680 INFO:tasks.workunit.client.1.smithi134.stdout:9/406: getdents d5/d10/d51 0 2024-03-12T16:10:40.682 INFO:tasks.workunit.client.1.smithi134.stdout:4/405: creat d1/d13/d49/d64/d28/d4f/d67/f86 x:0 0 0 2024-03-12T16:10:40.682 INFO:tasks.workunit.client.0.smithi006.stdout:3/253: mknod d8/df/d2c/d41/d45/c58 0 2024-03-12T16:10:40.682 INFO:tasks.workunit.client.0.smithi006.stdout:6/187: dread d3/d11/f15 [0,4194304] 0 2024-03-12T16:10:40.683 INFO:tasks.workunit.client.1.smithi134.stdout:2/446: dread d4/d12/d1d/d34/d58/f93 [0,4194304] 0 2024-03-12T16:10:40.683 INFO:tasks.workunit.client.1.smithi134.stdout:0/525: chown db/d2f/d61/c83 486552 1 2024-03-12T16:10:40.683 INFO:tasks.workunit.client.1.smithi134.stdout:6/477: truncate d1/f26 307939 0 2024-03-12T16:10:40.684 INFO:tasks.workunit.client.0.smithi006.stdout:3/254: rmdir d8/df 39 2024-03-12T16:10:40.684 INFO:tasks.workunit.client.1.smithi134.stdout:7/484: rename d8/dc/c10 to d8/dc/d55/ca4 0 2024-03-12T16:10:40.685 INFO:tasks.workunit.client.0.smithi006.stdout:6/188: creat d3/d11/d10/d1b/f3f x:0 0 0 2024-03-12T16:10:40.692 INFO:tasks.workunit.client.1.smithi134.stdout:3/577: dwrite d1/db/d10/f8a [0,4194304] 0 2024-03-12T16:10:40.692 INFO:tasks.workunit.client.1.smithi134.stdout:9/407: fdatasync d5/d10/d35/f1a 0 2024-03-12T16:10:40.692 INFO:tasks.workunit.client.0.smithi006.stdout:6/189: mkdir d3/d40 0 2024-03-12T16:10:40.692 INFO:tasks.workunit.client.1.smithi134.stdout:5/553: link db/d12/d37/d73/lac db/d12/d37/d73/d8c/dab/lb1 0 2024-03-12T16:10:40.695 INFO:tasks.workunit.client.0.smithi006.stdout:7/388: truncate de/d18/f1f 1457151 0 2024-03-12T16:10:40.697 INFO:tasks.workunit.client.0.smithi006.stdout:7/389: write de/d18/f1b [3261412,129556] 0 2024-03-12T16:10:40.697 INFO:tasks.workunit.client.1.smithi134.stdout:0/526: write db/d2f/d31/d68/d70/f74 [240422,95440] 0 2024-03-12T16:10:40.697 INFO:tasks.workunit.client.0.smithi006.stdout:6/190: creat d3/d11/d10/f41 x:0 0 0 2024-03-12T16:10:40.700 INFO:tasks.workunit.client.1.smithi134.stdout:2/447: rename d4/d16 to d4/d84/d63/d9d 0 2024-03-12T16:10:40.701 INFO:tasks.workunit.client.1.smithi134.stdout:1/335: dread d0/d16/d9/d1c/f27 [0,4194304] 0 2024-03-12T16:10:40.702 INFO:tasks.workunit.client.1.smithi134.stdout:3/578: symlink d1/db/d10/d2d/d2e/d72/d97/ld7 0 2024-03-12T16:10:40.702 INFO:tasks.workunit.client.1.smithi134.stdout:0/527: chown db/d2f/d31/d68/d70/daa 704330 1 2024-03-12T16:10:40.703 INFO:tasks.workunit.client.1.smithi134.stdout:2/448: readlink d4/l19 0 2024-03-12T16:10:40.703 INFO:tasks.workunit.client.1.smithi134.stdout:5/554: creat db/d12/d1d/d59/fb2 x:0 0 0 2024-03-12T16:10:40.705 INFO:tasks.workunit.client.1.smithi134.stdout:3/579: chown d1/db/d12/d9d 134 1 2024-03-12T16:10:40.706 INFO:tasks.workunit.client.0.smithi006.stdout:1/251: dread d0/d25/d2a/d35/d3f/f50 [0,4194304] 0 2024-03-12T16:10:40.709 INFO:tasks.workunit.client.0.smithi006.stdout:6/191: rmdir d3/d40 0 2024-03-12T16:10:40.709 INFO:tasks.workunit.client.0.smithi006.stdout:7/390: dwrite de/d18/d2a/d40/f7f [0,4194304] 0 2024-03-12T16:10:40.709 INFO:tasks.workunit.client.0.smithi006.stdout:2/317: truncate d0/d13/d49/d60/f32 622835 0 2024-03-12T16:10:40.711 INFO:tasks.workunit.client.1.smithi134.stdout:7/485: dread d8/dc/d20/d26/f3a [0,4194304] 0 2024-03-12T16:10:40.712 INFO:tasks.workunit.client.1.smithi134.stdout:4/406: dwrite d1/d24/f56 [0,4194304] 0 2024-03-12T16:10:40.712 INFO:tasks.workunit.client.1.smithi134.stdout:1/336: creat d0/d16/d9/d13/d38/f75 x:0 0 0 2024-03-12T16:10:40.712 INFO:tasks.workunit.client.0.smithi006.stdout:7/391: dread - de/d27/d2b/d4a/d6a/f84 zero size 2024-03-12T16:10:40.713 INFO:tasks.workunit.client.0.smithi006.stdout:3/255: rename d8/df to d8/d19/d26/d59 0 2024-03-12T16:10:40.713 INFO:tasks.workunit.client.0.smithi006.stdout:6/192: read d3/d11/d10/d1b/d20/d26/f2e [575091,85569] 0 2024-03-12T16:10:40.714 INFO:tasks.workunit.client.0.smithi006.stdout:7/392: readlink de/d2c/d4f/l7a 0 2024-03-12T16:10:40.715 INFO:tasks.workunit.client.0.smithi006.stdout:6/193: fdatasync f1 0 2024-03-12T16:10:40.715 INFO:tasks.workunit.client.1.smithi134.stdout:9/408: dread d5/d10/d35/d49/f4a [0,4194304] 0 2024-03-12T16:10:40.716 INFO:tasks.workunit.client.1.smithi134.stdout:4/407: stat d1/d13/d49/d64/d28/d4f/d67/l6e 0 2024-03-12T16:10:40.719 INFO:tasks.workunit.client.0.smithi006.stdout:3/256: chown d8/d19/d26/d59/f1e 5743 1 2024-03-12T16:10:40.719 INFO:tasks.workunit.client.1.smithi134.stdout:6/478: link d1/d3/d19/c27 d1/d16/d4c/d65/d70/cbd 0 2024-03-12T16:10:40.720 INFO:tasks.workunit.client.0.smithi006.stdout:7/393: fdatasync f6 0 2024-03-12T16:10:40.721 INFO:tasks.workunit.client.1.smithi134.stdout:3/580: unlink d1/d63/f8c 0 2024-03-12T16:10:40.722 INFO:tasks.workunit.client.1.smithi134.stdout:4/408: fdatasync d1/de/f82 0 2024-03-12T16:10:40.724 INFO:tasks.workunit.client.1.smithi134.stdout:3/581: write d1/fc [2350276,35205] 0 2024-03-12T16:10:40.725 INFO:tasks.workunit.client.1.smithi134.stdout:5/555: creat db/d12/d1d/d3a/d70/d99/fb3 x:0 0 0 2024-03-12T16:10:40.725 INFO:tasks.workunit.client.1.smithi134.stdout:2/449: dwrite d4/f24 [0,4194304] 0 2024-03-12T16:10:40.726 INFO:tasks.workunit.client.0.smithi006.stdout:7/394: fdatasync de/d27/d2b/d4a/d6a/f79 0 2024-03-12T16:10:40.728 INFO:tasks.workunit.client.0.smithi006.stdout:2/318: getdents d0 0 2024-03-12T16:10:40.728 INFO:tasks.workunit.client.0.smithi006.stdout:5/179: dwrite d7/d9/d10/d35/f3c [0,4194304] 0 2024-03-12T16:10:40.729 INFO:tasks.workunit.client.1.smithi134.stdout:6/479: rename d1/d16/d4c/d58/c68 to d1/d3/d10/cbe 0 2024-03-12T16:10:40.729 INFO:tasks.workunit.client.0.smithi006.stdout:3/257: mknod d8/d19/d26/d59/d2c/d41/c5a 0 2024-03-12T16:10:40.731 INFO:tasks.workunit.client.1.smithi134.stdout:8/448: sync 2024-03-12T16:10:40.731 INFO:tasks.workunit.client.0.smithi006.stdout:6/194: creat d3/d11/d10/f42 x:0 0 0 2024-03-12T16:10:40.731 INFO:tasks.workunit.client.0.smithi006.stdout:5/180: fsync d7/d9/d10/f39 0 2024-03-12T16:10:40.734 INFO:tasks.workunit.client.0.smithi006.stdout:3/258: mkdir d8/d19/d26/d59/d5b 0 2024-03-12T16:10:40.737 INFO:tasks.workunit.client.1.smithi134.stdout:5/556: dread db/d12/d29/d3d/f53 [0,4194304] 0 2024-03-12T16:10:40.738 INFO:tasks.workunit.client.0.smithi006.stdout:1/252: dread d0/d25/f36 [0,4194304] 0 2024-03-12T16:10:40.740 INFO:tasks.workunit.client.1.smithi134.stdout:8/449: write d3/d1b/d17/d24/f2d [835929,81317] 0 2024-03-12T16:10:40.741 INFO:tasks.workunit.client.0.smithi006.stdout:6/195: mkdir d3/d11/d43 0 2024-03-12T16:10:40.741 INFO:tasks.workunit.client.0.smithi006.stdout:3/259: creat d8/d19/f5c x:0 0 0 2024-03-12T16:10:40.743 INFO:tasks.workunit.client.1.smithi134.stdout:7/486: rename d8/dc/l62 to d8/dc/d20/d26/d36/la5 0 2024-03-12T16:10:40.747 INFO:tasks.workunit.client.1.smithi134.stdout:6/480: dwrite d1/d3/d10/f9e [0,4194304] 0 2024-03-12T16:10:40.748 INFO:tasks.workunit.client.0.smithi006.stdout:3/260: rename d8/d19/d26/d59/d2c/dc/c46 to d8/d19/d26/d59/d2c/dc/d28/c5d 0 2024-03-12T16:10:40.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/409: creat d1/d13/d49/d64/f87 x:0 0 0 2024-03-12T16:10:40.748 INFO:tasks.workunit.client.1.smithi134.stdout:2/450: symlink d4/d12/d1d/l9e 0 2024-03-12T16:10:40.751 INFO:tasks.workunit.client.0.smithi006.stdout:6/196: symlink d3/d11/d10/d1b/d20/d26/l44 0 2024-03-12T16:10:40.753 INFO:tasks.workunit.client.1.smithi134.stdout:4/410: read d1/d24/f56 [3373751,98763] 0 2024-03-12T16:10:40.753 INFO:tasks.workunit.client.0.smithi006.stdout:3/261: symlink d8/d19/d26/d59/d2c/dc/d28/d2f/l5e 0 2024-03-12T16:10:40.754 INFO:tasks.workunit.client.1.smithi134.stdout:7/487: creat d8/dc/d55/fa6 x:0 0 0 2024-03-12T16:10:40.754 INFO:tasks.workunit.client.1.smithi134.stdout:8/450: symlink d3/d1b/d17/d24/l8c 0 2024-03-12T16:10:40.759 INFO:tasks.workunit.client.0.smithi006.stdout:3/262: truncate d8/d19/d26/d59/f1e 4966061 0 2024-03-12T16:10:40.759 INFO:tasks.workunit.client.1.smithi134.stdout:4/411: chown d1/de/d5a 56466 1 2024-03-12T16:10:40.761 INFO:tasks.workunit.client.1.smithi134.stdout:2/451: creat d4/d12/d39/f9f x:0 0 0 2024-03-12T16:10:40.764 INFO:tasks.workunit.client.1.smithi134.stdout:4/412: rmdir d1/de/d5a/d84 39 2024-03-12T16:10:40.764 INFO:tasks.workunit.client.1.smithi134.stdout:0/528: dwrite db/f21 [0,4194304] 0 2024-03-12T16:10:40.766 INFO:tasks.workunit.client.1.smithi134.stdout:1/337: dread d0/d16/f18 [0,4194304] 0 2024-03-12T16:10:40.767 INFO:tasks.workunit.client.1.smithi134.stdout:6/481: getdents d1/d16/d4c/d58/da0/db7 0 2024-03-12T16:10:40.768 INFO:tasks.workunit.client.1.smithi134.stdout:3/582: dread d1/db/d10/d2d/d2e/d72/f8e [0,4194304] 0 2024-03-12T16:10:40.769 INFO:tasks.workunit.client.1.smithi134.stdout:7/488: creat d8/dc/d7b/da0/fa7 x:0 0 0 2024-03-12T16:10:40.770 INFO:tasks.workunit.client.1.smithi134.stdout:0/529: dread - db/d2f/d31/d56/f72 zero size 2024-03-12T16:10:40.773 INFO:tasks.workunit.client.1.smithi134.stdout:1/338: write d0/d16/d9/d13/d38/f69 [1026138,21286] 0 2024-03-12T16:10:40.773 INFO:tasks.workunit.client.1.smithi134.stdout:0/530: dread - db/d2f/d31/f85 zero size 2024-03-12T16:10:40.774 INFO:tasks.workunit.client.1.smithi134.stdout:7/489: mknod d8/d4e/d91/ca8 0 2024-03-12T16:10:40.779 INFO:tasks.workunit.client.1.smithi134.stdout:5/557: dwrite db/d12/d1d/d59/d94/fb0 [0,4194304] 0 2024-03-12T16:10:40.780 INFO:tasks.workunit.client.1.smithi134.stdout:0/531: write db/d2f/f57 [221628,130122] 0 2024-03-12T16:10:40.784 INFO:tasks.workunit.client.1.smithi134.stdout:6/482: link d1/la5 d1/d89/lbf 0 2024-03-12T16:10:40.784 INFO:tasks.workunit.client.1.smithi134.stdout:5/558: dread db/d12/d1d/d5c/f65 [0,4194304] 0 2024-03-12T16:10:40.784 INFO:tasks.workunit.client.1.smithi134.stdout:5/559: dread - db/d12/d37/d73/d8c/faa zero size 2024-03-12T16:10:40.785 INFO:tasks.workunit.client.1.smithi134.stdout:6/483: mknod d1/d16/d4c/d58/cc0 0 2024-03-12T16:10:40.785 INFO:tasks.workunit.client.1.smithi134.stdout:5/560: dread - db/f6d zero size 2024-03-12T16:10:40.787 INFO:tasks.workunit.client.1.smithi134.stdout:5/561: chown db/d12/d37/d71/ca4 46684235 1 2024-03-12T16:10:40.790 INFO:tasks.workunit.client.1.smithi134.stdout:6/484: creat d1/d16/d4c/d58/da0/fc1 x:0 0 0 2024-03-12T16:10:40.791 INFO:tasks.workunit.client.1.smithi134.stdout:6/485: stat d1/d3/lb3 0 2024-03-12T16:10:40.795 INFO:tasks.workunit.client.1.smithi134.stdout:6/486: write d1/f1e [4196651,44311] 0 2024-03-12T16:10:40.795 INFO:tasks.workunit.client.1.smithi134.stdout:0/532: dwrite db/d2f/d31/d76/f93 [0,4194304] 0 2024-03-12T16:10:40.800 INFO:tasks.workunit.client.1.smithi134.stdout:5/562: dwrite db/d12/d1d/d3a/d70/f75 [0,4194304] 0 2024-03-12T16:10:40.800 INFO:tasks.workunit.client.1.smithi134.stdout:0/533: mknod db/d2f/d31/d76/d9f/cae 0 2024-03-12T16:10:40.800 INFO:tasks.workunit.client.1.smithi134.stdout:6/487: symlink d1/da6/d55/d94/lc2 0 2024-03-12T16:10:40.803 INFO:tasks.workunit.client.0.smithi006.stdout:2/319: truncate d0/f45 539408 0 2024-03-12T16:10:40.803 INFO:tasks.workunit.client.0.smithi006.stdout:5/181: dwrite d7/d9/d10/d35/f3c [4194304,4194304] 0 2024-03-12T16:10:40.805 INFO:tasks.workunit.client.0.smithi006.stdout:2/320: write d0/f40 [617174,116081] 0 2024-03-12T16:10:40.807 INFO:tasks.workunit.client.0.smithi006.stdout:5/182: fdatasync d7/d9/d10/d24/f3d 0 2024-03-12T16:10:40.807 INFO:tasks.workunit.client.0.smithi006.stdout:1/253: truncate d0/f37 2299918 0 2024-03-12T16:10:40.812 INFO:tasks.workunit.client.0.smithi006.stdout:2/321: link d0/c43 d0/c6c 0 2024-03-12T16:10:40.812 INFO:tasks.workunit.client.1.smithi134.stdout:0/534: dread db/d2f/d31/d76/f93 [0,4194304] 0 2024-03-12T16:10:40.816 INFO:tasks.workunit.client.1.smithi134.stdout:5/563: dwrite db/d12/d1d/d3a/d4e/f82 [0,4194304] 0 2024-03-12T16:10:40.817 INFO:tasks.workunit.client.1.smithi134.stdout:2/452: write d4/fa [3213058,68624] 0 2024-03-12T16:10:40.817 INFO:tasks.workunit.client.1.smithi134.stdout:3/583: dread d1/f65 [0,4194304] 0 2024-03-12T16:10:40.818 INFO:tasks.workunit.client.1.smithi134.stdout:6/488: rename d1/da6/d55/d85/cb6 to d1/d16/d7e/cc3 0 2024-03-12T16:10:40.819 INFO:tasks.workunit.client.0.smithi006.stdout:5/183: dwrite d7/d8/f14 [0,4194304] 0 2024-03-12T16:10:40.823 INFO:tasks.workunit.client.1.smithi134.stdout:8/451: truncate d3/d1b/f14 970348 0 2024-03-12T16:10:40.823 INFO:tasks.workunit.client.1.smithi134.stdout:4/413: truncate d1/d24/d34/f47 3694765 0 2024-03-12T16:10:40.826 INFO:tasks.workunit.client.1.smithi134.stdout:0/535: mkdir db/d2f/d51/daf 0 2024-03-12T16:10:40.830 INFO:tasks.workunit.client.0.smithi006.stdout:6/197: write d3/d11/d10/d1b/d20/d26/f2e [39313,37173] 0 2024-03-12T16:10:40.832 INFO:tasks.workunit.client.1.smithi134.stdout:5/564: mkdir db/d12/d37/db4 0 2024-03-12T16:10:40.833 INFO:tasks.workunit.client.1.smithi134.stdout:1/339: dwrite d0/f3a [0,4194304] 0 2024-03-12T16:10:40.834 INFO:tasks.workunit.client.0.smithi006.stdout:6/198: rmdir d3/d11/d10/d1b 39 2024-03-12T16:10:40.835 INFO:tasks.workunit.client.1.smithi134.stdout:6/489: rename d1/da6/d55/d94/fbb to d1/da6/fc4 0 2024-03-12T16:10:40.837 INFO:tasks.workunit.client.0.smithi006.stdout:6/199: readlink d3/d11/d10/d1b/d20/d26/l44 0 2024-03-12T16:10:40.838 INFO:tasks.workunit.client.0.smithi006.stdout:6/200: chown d3/cf 893 1 2024-03-12T16:10:40.839 INFO:tasks.workunit.client.1.smithi134.stdout:0/536: rmdir db/d2f/d31/d75/d88 39 2024-03-12T16:10:40.839 INFO:tasks.workunit.client.1.smithi134.stdout:1/340: dread - d0/d16/d9/d13/d38/f75 zero size 2024-03-12T16:10:40.840 INFO:tasks.workunit.client.0.smithi006.stdout:6/201: readlink d3/d11/d10/d1b/d20/l2f 0 2024-03-12T16:10:40.840 INFO:tasks.workunit.client.0.smithi006.stdout:3/263: dwrite d8/d19/d26/f43 [0,4194304] 0 2024-03-12T16:10:40.842 INFO:tasks.workunit.client.1.smithi134.stdout:1/341: dread - d0/d42/d47/f66 zero size 2024-03-12T16:10:40.845 INFO:tasks.workunit.client.1.smithi134.stdout:7/490: dwrite d8/dc/d20/f13 [0,4194304] 0 2024-03-12T16:10:40.845 INFO:tasks.workunit.client.1.smithi134.stdout:3/584: rename d1/db/d10/d2d/d2e/d72/d97/ld7 to d1/d63/dc2/ld8 0 2024-03-12T16:10:40.847 INFO:tasks.workunit.client.0.smithi006.stdout:6/202: mkdir d3/d11/d10/d28/d45 0 2024-03-12T16:10:40.848 INFO:tasks.workunit.client.1.smithi134.stdout:6/490: mknod d1/d3/d10/cc5 0 2024-03-12T16:10:40.856 INFO:tasks.workunit.client.1.smithi134.stdout:1/342: mknod d0/d42/d47/c76 0 2024-03-12T16:10:40.856 INFO:tasks.workunit.client.1.smithi134.stdout:5/565: dwrite db/d7d/f86 [0,4194304] 0 2024-03-12T16:10:40.858 INFO:tasks.workunit.client.1.smithi134.stdout:1/343: stat d0/d16/f29 0 2024-03-12T16:10:40.859 INFO:tasks.workunit.client.1.smithi134.stdout:1/344: chown d0/d30 174 1 2024-03-12T16:10:40.860 INFO:tasks.workunit.client.1.smithi134.stdout:1/345: fsync d0/d16/d9/d13/d21/f23 0 2024-03-12T16:10:40.860 INFO:tasks.workunit.client.1.smithi134.stdout:3/585: unlink d1/db/d12/f27 0 2024-03-12T16:10:40.866 INFO:tasks.workunit.client.1.smithi134.stdout:4/414: link d1/f42 d1/d24/d34/f88 0 2024-03-12T16:10:40.867 INFO:tasks.workunit.client.1.smithi134.stdout:6/491: mknod d1/da6/d55/d97/cc6 0 2024-03-12T16:10:40.869 INFO:tasks.workunit.client.1.smithi134.stdout:3/586: dread d1/f66 [0,4194304] 0 2024-03-12T16:10:40.870 INFO:tasks.workunit.client.1.smithi134.stdout:2/453: getdents d4/d84/d63 0 2024-03-12T16:10:40.870 INFO:tasks.workunit.client.1.smithi134.stdout:3/587: dread - d1/d63/f9e zero size 2024-03-12T16:10:40.872 INFO:tasks.workunit.client.1.smithi134.stdout:2/454: write d4/d12/d1d/d34/d58/f78 [3380401,17365] 0 2024-03-12T16:10:40.872 INFO:tasks.workunit.client.1.smithi134.stdout:5/566: creat db/d12/d37/d71/fb5 x:0 0 0 2024-03-12T16:10:40.876 INFO:tasks.workunit.client.1.smithi134.stdout:2/455: chown d4/d12/d1d/d8d/f81 104240 1 2024-03-12T16:10:40.877 INFO:tasks.workunit.client.1.smithi134.stdout:1/346: rename d0/d16/d9/d1c/f4e to d0/d16/d9/d13/d21/d2f/f77 0 2024-03-12T16:10:40.878 INFO:tasks.workunit.client.1.smithi134.stdout:4/415: mknod d1/de/c89 0 2024-03-12T16:10:40.878 INFO:tasks.workunit.client.1.smithi134.stdout:8/452: dread d3/d1b/d17/f1a [0,4194304] 0 2024-03-12T16:10:40.880 INFO:tasks.workunit.client.1.smithi134.stdout:9/409: sync 2024-03-12T16:10:40.881 INFO:tasks.workunit.client.1.smithi134.stdout:3/588: dwrite d1/fc [0,4194304] 0 2024-03-12T16:10:40.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/589: stat d1/db/f4d 0 2024-03-12T16:10:40.886 INFO:tasks.workunit.client.1.smithi134.stdout:0/537: write db/d2f/d71/f9e [1535816,40832] 0 2024-03-12T16:10:40.887 INFO:tasks.workunit.client.1.smithi134.stdout:5/567: rmdir db/d12/d37/d73/d7f 39 2024-03-12T16:10:40.891 INFO:tasks.workunit.client.1.smithi134.stdout:2/456: creat d4/d12/d1d/d34/fa0 x:0 0 0 2024-03-12T16:10:40.892 INFO:tasks.workunit.client.1.smithi134.stdout:1/347: mknod d0/d16/d9/d1c/c78 0 2024-03-12T16:10:40.894 INFO:tasks.workunit.client.0.smithi006.stdout:3/264: creat d8/d19/f5f x:0 0 0 2024-03-12T16:10:40.894 INFO:tasks.workunit.client.1.smithi134.stdout:9/410: mkdir d5/d10/d35/d49/d74 0 2024-03-12T16:10:40.895 INFO:tasks.workunit.client.0.smithi006.stdout:7/395: write de/d27/f69 [575316,15890] 0 2024-03-12T16:10:40.896 INFO:tasks.workunit.client.0.smithi006.stdout:1/254: truncate d0/f37 726937 0 2024-03-12T16:10:40.897 INFO:tasks.workunit.client.0.smithi006.stdout:6/203: write d3/d11/d10/d1b/f3f [715136,42950] 0 2024-03-12T16:10:40.899 INFO:tasks.workunit.client.0.smithi006.stdout:7/396: mkdir de/d1c/d87 0 2024-03-12T16:10:40.900 INFO:tasks.workunit.client.0.smithi006.stdout:3/265: truncate d8/d19/d26/d59/d3b/f51 361273 0 2024-03-12T16:10:40.901 INFO:tasks.workunit.client.1.smithi134.stdout:3/590: unlink d1/db/d14/f40 0 2024-03-12T16:10:40.902 INFO:tasks.workunit.client.0.smithi006.stdout:3/266: read d8/d19/d26/d59/f3f [158544,73640] 0 2024-03-12T16:10:40.903 INFO:tasks.workunit.client.0.smithi006.stdout:7/397: symlink de/d1c/d35/l88 0 2024-03-12T16:10:40.904 INFO:tasks.workunit.client.1.smithi134.stdout:0/538: rmdir db/d2f 39 2024-03-12T16:10:40.905 INFO:tasks.workunit.client.0.smithi006.stdout:1/255: link d0/f16 d0/d25/d2a/f54 0 2024-03-12T16:10:40.907 INFO:tasks.workunit.client.0.smithi006.stdout:1/256: read d0/f2f [3803105,113711] 0 2024-03-12T16:10:40.907 INFO:tasks.workunit.client.1.smithi134.stdout:8/453: dread d3/d1b/d17/d25/d33/d15/d2b/f32 [0,4194304] 0 2024-03-12T16:10:40.908 INFO:tasks.workunit.client.1.smithi134.stdout:1/348: creat d0/d16/d9/d13/d21/d5f/f79 x:0 0 0 2024-03-12T16:10:40.908 INFO:tasks.workunit.client.0.smithi006.stdout:2/322: creat d0/d13/d49/d60/d2b/d62/d66/d67/d6a/f6d x:0 0 0 2024-03-12T16:10:40.908 INFO:tasks.workunit.client.0.smithi006.stdout:1/257: readlink d0/d25/l33 0 2024-03-12T16:10:40.908 INFO:tasks.workunit.client.0.smithi006.stdout:3/267: getdents d8/d19/d26/d59/d5b 0 2024-03-12T16:10:40.909 INFO:tasks.workunit.client.1.smithi134.stdout:7/491: getdents d8/d27/d9d/d31 0 2024-03-12T16:10:40.909 INFO:tasks.workunit.client.0.smithi006.stdout:1/258: rmdir d0 39 2024-03-12T16:10:40.910 INFO:tasks.workunit.client.0.smithi006.stdout:3/268: write d8/d19/d31/f32 [4970590,48672] 0 2024-03-12T16:10:40.913 INFO:tasks.workunit.client.0.smithi006.stdout:6/204: dread d3/f17 [0,4194304] 0 2024-03-12T16:10:40.914 INFO:tasks.workunit.client.1.smithi134.stdout:3/591: chown d1/db/d12/fb1 13606 1 2024-03-12T16:10:40.915 INFO:tasks.workunit.client.0.smithi006.stdout:1/259: read - d0/d25/d2a/d43/f46 zero size 2024-03-12T16:10:40.915 INFO:tasks.workunit.client.1.smithi134.stdout:3/592: chown d1/f2 200 1 2024-03-12T16:10:40.915 INFO:tasks.workunit.client.0.smithi006.stdout:3/269: fsync d8/d19/d26/d59/d2c/dc/d28/d2f/f3c 0 2024-03-12T16:10:40.916 INFO:tasks.workunit.client.1.smithi134.stdout:0/539: write db/d2f/d31/d75/f7f [79664,130779] 0 2024-03-12T16:10:40.919 INFO:tasks.workunit.client.1.smithi134.stdout:6/492: link d1/d89/lbf d1/d16/d4c/d65/d9d/lc7 0 2024-03-12T16:10:40.920 INFO:tasks.workunit.client.1.smithi134.stdout:8/454: write d3/d1b/d17/d25/d33/d15/d2b/d4f/d65/f48 [2830096,87004] 0 2024-03-12T16:10:40.920 INFO:tasks.workunit.client.0.smithi006.stdout:6/205: creat d3/d11/d43/f46 x:0 0 0 2024-03-12T16:10:40.921 INFO:tasks.workunit.client.1.smithi134.stdout:9/411: creat d5/d20/d47/d69/f75 x:0 0 0 2024-03-12T16:10:40.922 INFO:tasks.workunit.client.1.smithi134.stdout:9/412: write d5/d20/f70 [436578,16039] 0 2024-03-12T16:10:40.922 INFO:tasks.workunit.client.0.smithi006.stdout:3/270: creat d8/d19/d26/d59/d2c/dc/d28/d2f/f60 x:0 0 0 2024-03-12T16:10:40.924 INFO:tasks.workunit.client.1.smithi134.stdout:5/568: symlink db/d12/d29/d3d/d79/da5/lb6 0 2024-03-12T16:10:40.924 INFO:tasks.workunit.client.0.smithi006.stdout:6/206: mkdir d3/d47 0 2024-03-12T16:10:40.925 INFO:tasks.workunit.client.1.smithi134.stdout:9/413: write d5/d10/d1f/f50 [1919764,28170] 0 2024-03-12T16:10:40.926 INFO:tasks.workunit.client.1.smithi134.stdout:2/457: creat d4/d84/d63/d9d/fa1 x:0 0 0 2024-03-12T16:10:40.926 INFO:tasks.workunit.client.1.smithi134.stdout:4/416: link d1/l52 d1/d13/d49/l8a 0 2024-03-12T16:10:40.929 INFO:tasks.workunit.client.1.smithi134.stdout:1/349: unlink d0/d16/d9/d13/d21/d2f/l37 0 2024-03-12T16:10:40.929 INFO:tasks.workunit.client.0.smithi006.stdout:2/323: write d0/d13/d49/d60/f32 [1598153,105178] 0 2024-03-12T16:10:40.930 INFO:tasks.workunit.client.1.smithi134.stdout:1/350: read d0/d16/d9/f70 [894054,44868] 0 2024-03-12T16:10:40.931 INFO:tasks.workunit.client.1.smithi134.stdout:1/351: stat d0/d16/d9/d13/d38/f41 0 2024-03-12T16:10:40.932 INFO:tasks.workunit.client.0.smithi006.stdout:6/207: link d3/c8 d3/d11/d10/d1b/d20/d26/c48 0 2024-03-12T16:10:40.932 INFO:tasks.workunit.client.1.smithi134.stdout:6/493: rmdir d1/da6/d55 39 2024-03-12T16:10:40.934 INFO:tasks.workunit.client.1.smithi134.stdout:8/455: mknod d3/d1b/d17/d25/d33/d15/d2b/d5b/c8d 0 2024-03-12T16:10:40.935 INFO:tasks.workunit.client.1.smithi134.stdout:8/456: readlink d3/d1b/d17/d25/d33/d15/d2b/d4f/d65/l7f 0 2024-03-12T16:10:40.936 INFO:tasks.workunit.client.0.smithi006.stdout:1/260: dread d0/d25/d2a/f3b [0,4194304] 0 2024-03-12T16:10:40.937 INFO:tasks.workunit.client.0.smithi006.stdout:3/271: truncate f1 774876 0 2024-03-12T16:10:40.937 INFO:tasks.workunit.client.1.smithi134.stdout:5/569: truncate db/f38 2019157 0 2024-03-12T16:10:40.938 INFO:tasks.workunit.client.0.smithi006.stdout:6/208: creat d3/d11/d10/f49 x:0 0 0 2024-03-12T16:10:40.940 INFO:tasks.workunit.client.0.smithi006.stdout:2/324: dwrite d0/f5d [0,4194304] 0 2024-03-12T16:10:40.940 INFO:tasks.workunit.client.1.smithi134.stdout:0/540: symlink db/d2f/d61/lb0 0 2024-03-12T16:10:40.941 INFO:tasks.workunit.client.0.smithi006.stdout:1/261: write d0/d25/d2a/d43/f49 [720627,2569] 0 2024-03-12T16:10:40.942 INFO:tasks.workunit.client.0.smithi006.stdout:6/209: readlink d3/d11/d10/d1b/d20/l2f 0 2024-03-12T16:10:40.942 INFO:tasks.workunit.client.0.smithi006.stdout:1/262: chown d0/d4e 15016471 1 2024-03-12T16:10:40.943 INFO:tasks.workunit.client.1.smithi134.stdout:8/457: dwrite d3/d1b/f1d [0,4194304] 0 2024-03-12T16:10:40.944 INFO:tasks.workunit.client.1.smithi134.stdout:2/458: rename d4/d3c to d4/d12/d43/da2 0 2024-03-12T16:10:40.945 INFO:tasks.workunit.client.1.smithi134.stdout:7/492: link d8/dc/l6e d8/d4e/d91/da1/la9 0 2024-03-12T16:10:40.949 INFO:tasks.workunit.client.0.smithi006.stdout:3/272: dwrite d8/d19/d26/d59/d3b/f51 [0,4194304] 0 2024-03-12T16:10:40.951 INFO:tasks.workunit.client.0.smithi006.stdout:6/210: mknod d3/d47/c4a 0 2024-03-12T16:10:40.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:39.495633+0000 mgr.smithi134.gcntfu (mgr.24383) 57 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 903 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 6.6 MiB/s rd, 88 MiB/s wr, 130 op/s 2024-03-12T16:10:40.954 INFO:tasks.workunit.client.1.smithi134.stdout:6/494: rename d1/d3/d10/c79 to d1/d3/d10/cc8 0 2024-03-12T16:10:40.955 INFO:tasks.workunit.client.0.smithi006.stdout:6/211: write d3/d11/d10/d19/f1f [4208666,69006] 0 2024-03-12T16:10:40.955 INFO:tasks.workunit.client.0.smithi006.stdout:1/263: unlink d0/d39/c53 0 2024-03-12T16:10:40.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:39.495633+0000 mgr.smithi134.gcntfu (mgr.24383) 57 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 903 MiB data, 4.3 GiB used, 532 GiB / 536 GiB avail; 6.6 MiB/s rd, 88 MiB/s wr, 130 op/s 2024-03-12T16:10:40.958 INFO:tasks.workunit.client.1.smithi134.stdout:9/414: symlink d5/d10/l76 0 2024-03-12T16:10:40.958 INFO:tasks.workunit.client.0.smithi006.stdout:6/212: chown d3/d11/d43/f46 12565507 1 2024-03-12T16:10:40.959 INFO:tasks.workunit.client.1.smithi134.stdout:8/458: creat d3/d1b/d17/d25/d33/d15/d2b/d5b/f8e x:0 0 0 2024-03-12T16:10:40.959 INFO:tasks.workunit.client.1.smithi134.stdout:1/352: symlink d0/d30/l7a 0 2024-03-12T16:10:40.962 INFO:tasks.workunit.client.1.smithi134.stdout:6/495: symlink d1/d16/d4c/d65/d9d/lc9 0 2024-03-12T16:10:40.962 INFO:tasks.workunit.client.1.smithi134.stdout:3/593: truncate d1/db/d10/d2d/d30/f92 366275 0 2024-03-12T16:10:40.964 INFO:tasks.workunit.client.0.smithi006.stdout:1/264: getdents d0/d25/d2a 0 2024-03-12T16:10:40.965 INFO:tasks.workunit.client.0.smithi006.stdout:6/213: rename d3/d11/d10/d1b/d20/d26/c48 to d3/d11/d10/d28/c4b 0 2024-03-12T16:10:40.966 INFO:tasks.workunit.client.0.smithi006.stdout:3/273: dwrite d8/d19/d26/d59/d2c/dc/f38 [0,4194304] 0 2024-03-12T16:10:40.967 INFO:tasks.workunit.client.0.smithi006.stdout:6/214: stat d3/d11/d3b 0 2024-03-12T16:10:40.968 INFO:tasks.workunit.client.1.smithi134.stdout:1/353: write d0/d16/d39/f46 [594744,25869] 0 2024-03-12T16:10:40.969 INFO:tasks.workunit.client.1.smithi134.stdout:0/541: creat db/d2f/d31/d75/fb1 x:0 0 0 2024-03-12T16:10:40.970 INFO:tasks.workunit.client.0.smithi006.stdout:1/265: creat d0/d25/d2a/d35/f55 x:0 0 0 2024-03-12T16:10:40.970 INFO:tasks.workunit.client.1.smithi134.stdout:8/459: fdatasync d3/d1b/d17/d25/d33/f8b 0 2024-03-12T16:10:40.971 INFO:tasks.workunit.client.0.smithi006.stdout:6/215: rmdir d3/d47 39 2024-03-12T16:10:40.972 INFO:tasks.workunit.client.0.smithi006.stdout:2/325: dread d0/f4 [0,4194304] 0 2024-03-12T16:10:40.974 INFO:tasks.workunit.client.1.smithi134.stdout:6/496: mkdir d1/d16/d4c/d65/d70/dca 0 2024-03-12T16:10:40.974 INFO:tasks.workunit.client.1.smithi134.stdout:4/417: write d1/d13/d49/f65 [1295289,19655] 0 2024-03-12T16:10:40.975 INFO:tasks.workunit.client.0.smithi006.stdout:2/326: chown d0/d13/d49/d60/d2b 43461 1 2024-03-12T16:10:40.977 INFO:tasks.workunit.client.0.smithi006.stdout:3/274: dwrite d8/f17 [0,4194304] 0 2024-03-12T16:10:40.978 INFO:tasks.workunit.client.0.smithi006.stdout:6/216: creat d3/d47/f4c x:0 0 0 2024-03-12T16:10:40.981 INFO:tasks.workunit.client.1.smithi134.stdout:1/354: write d0/d16/d9/d13/d21/d2f/f68 [699698,65194] 0 2024-03-12T16:10:40.981 INFO:tasks.workunit.client.1.smithi134.stdout:2/459: link d4/f1b d4/d12/d1d/d34/d58/fa3 0 2024-03-12T16:10:40.981 INFO:tasks.workunit.client.1.smithi134.stdout:9/415: dwrite d5/d20/d47/d69/f75 [0,4194304] 0 2024-03-12T16:10:40.982 INFO:tasks.workunit.client.1.smithi134.stdout:2/460: dread - d4/d84/f7f zero size 2024-03-12T16:10:40.984 INFO:tasks.workunit.client.0.smithi006.stdout:6/217: truncate d3/f1d 955436 0 2024-03-12T16:10:40.984 INFO:tasks.workunit.client.1.smithi134.stdout:9/416: read d5/d20/f23 [2001013,39095] 0 2024-03-12T16:10:40.987 INFO:tasks.workunit.client.0.smithi006.stdout:2/327: dwrite d0/d13/d49/d60/f53 [0,4194304] 0 2024-03-12T16:10:40.987 INFO:tasks.workunit.client.0.smithi006.stdout:6/218: creat d3/d11/d10/d1b/f4d x:0 0 0 2024-03-12T16:10:40.990 INFO:tasks.workunit.client.0.smithi006.stdout:2/328: write d0/f3f [570781,17082] 0 2024-03-12T16:10:40.992 INFO:tasks.workunit.client.1.smithi134.stdout:1/355: symlink d0/d42/d47/l7b 0 2024-03-12T16:10:40.992 INFO:tasks.workunit.client.0.smithi006.stdout:6/219: creat d3/d11/d10/d1b/d20/d26/f4e x:0 0 0 2024-03-12T16:10:40.995 INFO:tasks.workunit.client.1.smithi134.stdout:2/461: mkdir d4/d12/d1d/d34/d47/d8c/da4 0 2024-03-12T16:10:40.999 INFO:tasks.workunit.client.0.smithi006.stdout:6/220: read d3/d11/d10/f2a [1897896,84071] 0 2024-03-12T16:10:41.001 INFO:tasks.workunit.client.0.smithi006.stdout:1/266: rename d0/d39 to d0/d25/d2a/d43/d56 0 2024-03-12T16:10:41.001 INFO:tasks.workunit.client.1.smithi134.stdout:0/542: mkdir db/d2f/d31/d68/da2/db2 0 2024-03-12T16:10:41.002 INFO:tasks.workunit.client.1.smithi134.stdout:7/493: dread d8/dc/d4b/f44 [0,4194304] 0 2024-03-12T16:10:41.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/460: dread d3/f6 [0,4194304] 0 2024-03-12T16:10:41.003 INFO:tasks.workunit.client.1.smithi134.stdout:9/417: truncate d5/d10/d6c/f60 1733019 0 2024-03-12T16:10:41.004 INFO:tasks.workunit.client.1.smithi134.stdout:3/594: truncate d1/db/d14/fd4 2877341 0 2024-03-12T16:10:41.005 INFO:tasks.workunit.client.0.smithi006.stdout:3/275: rename d8/d19/d26/d59/d2c/dc/f1b to d8/d52/f61 0 2024-03-12T16:10:41.006 INFO:tasks.workunit.client.0.smithi006.stdout:6/221: creat d3/d11/d10/d1b/d20/d26/f4f x:0 0 0 2024-03-12T16:10:41.007 INFO:tasks.workunit.client.1.smithi134.stdout:6/497: dread d1/d16/d4c/d58/da0/db7/f71 [0,4194304] 0 2024-03-12T16:10:41.007 INFO:tasks.workunit.client.0.smithi006.stdout:3/276: read d8/d19/d26/d59/f1e [4408649,114804] 0 2024-03-12T16:10:41.009 INFO:tasks.workunit.client.1.smithi134.stdout:4/418: dwrite d1/d13/f71 [0,4194304] 0 2024-03-12T16:10:41.010 INFO:tasks.workunit.client.0.smithi006.stdout:1/267: rmdir d0/d4e 0 2024-03-12T16:10:41.010 INFO:tasks.workunit.client.1.smithi134.stdout:9/418: write d5/d20/d47/d69/f75 [4269023,14117] 0 2024-03-12T16:10:41.011 INFO:tasks.workunit.client.0.smithi006.stdout:6/222: symlink d3/d11/d10/d1b/d20/l50 0 2024-03-12T16:10:41.011 INFO:tasks.workunit.client.0.smithi006.stdout:3/277: chown c7 2 1 2024-03-12T16:10:41.012 INFO:tasks.workunit.client.1.smithi134.stdout:0/543: creat db/d2f/d31/d68/d70/fb3 x:0 0 0 2024-03-12T16:10:41.013 INFO:tasks.workunit.client.0.smithi006.stdout:6/223: symlink d3/d11/d43/l51 0 2024-03-12T16:10:41.013 INFO:tasks.workunit.client.0.smithi006.stdout:0/355: sync 2024-03-12T16:10:41.014 INFO:tasks.workunit.client.1.smithi134.stdout:7/494: write d8/dc/d4b/f44 [2601217,108076] 0 2024-03-12T16:10:41.015 INFO:tasks.workunit.client.1.smithi134.stdout:4/419: dread - d1/de/f82 zero size 2024-03-12T16:10:41.015 INFO:tasks.workunit.client.1.smithi134.stdout:6/498: readlink d1/d3/d10/l13 0 2024-03-12T16:10:41.016 INFO:tasks.workunit.client.0.smithi006.stdout:1/268: read d0/f27 [1308843,19689] 0 2024-03-12T16:10:41.016 INFO:tasks.workunit.client.0.smithi006.stdout:3/278: creat d8/d19/d26/d59/d2c/d41/f62 x:0 0 0 2024-03-12T16:10:41.018 INFO:tasks.workunit.client.0.smithi006.stdout:1/269: mknod d0/c57 0 2024-03-12T16:10:41.020 INFO:tasks.workunit.client.1.smithi134.stdout:0/544: mkdir db/d2f/d51/db4 0 2024-03-12T16:10:41.021 INFO:tasks.workunit.client.0.smithi006.stdout:0/356: dread d2/f4b [0,4194304] 0 2024-03-12T16:10:41.026 INFO:tasks.workunit.client.1.smithi134.stdout:6/499: dread d1/d16/d4c/d58/da0/db7/f4e [0,4194304] 0 2024-03-12T16:10:41.027 INFO:tasks.workunit.client.1.smithi134.stdout:7/495: fsync d8/d27/f59 0 2024-03-12T16:10:41.028 INFO:tasks.workunit.client.1.smithi134.stdout:0/545: write db/d2f/d31/d75/fa3 [550123,58616] 0 2024-03-12T16:10:41.028 INFO:tasks.workunit.client.1.smithi134.stdout:3/595: dwrite d1/d63/f9e [0,4194304] 0 2024-03-12T16:10:41.033 INFO:tasks.workunit.client.1.smithi134.stdout:2/462: link d4/d12/d1d/l6e d4/d84/d63/d9d/la5 0 2024-03-12T16:10:41.034 INFO:tasks.workunit.client.1.smithi134.stdout:0/546: fsync db/d2f/d31/f47 0 2024-03-12T16:10:41.035 INFO:tasks.workunit.client.1.smithi134.stdout:8/461: link d3/f57 d3/d1b/d17/d25/d33/f8f 0 2024-03-12T16:10:41.037 INFO:tasks.workunit.client.1.smithi134.stdout:4/420: mknod d1/de/d5a/d84/c8b 0 2024-03-12T16:10:41.037 INFO:tasks.workunit.client.1.smithi134.stdout:1/356: dread d0/d16/f7 [0,4194304] 0 2024-03-12T16:10:41.039 INFO:tasks.workunit.client.1.smithi134.stdout:0/547: fsync db/d2f/d31/d68/f99 0 2024-03-12T16:10:41.040 INFO:tasks.workunit.client.1.smithi134.stdout:2/463: chown d4/d12/d3b/d3f/l65 111856336 1 2024-03-12T16:10:41.043 INFO:tasks.workunit.client.1.smithi134.stdout:9/419: dwrite d5/d20/f27 [0,4194304] 0 2024-03-12T16:10:41.044 INFO:tasks.workunit.client.1.smithi134.stdout:1/357: write d0/d16/d9/d13/d21/d20/f44 [4105843,22854] 0 2024-03-12T16:10:41.045 INFO:tasks.workunit.client.1.smithi134.stdout:6/500: mkdir d1/d3/dcb 0 2024-03-12T16:10:41.052 INFO:tasks.workunit.client.1.smithi134.stdout:2/464: symlink d4/d12/d3b/la6 0 2024-03-12T16:10:41.054 INFO:tasks.workunit.client.1.smithi134.stdout:3/596: creat d1/d63/d6c/dbf/fd9 x:0 0 0 2024-03-12T16:10:41.056 INFO:tasks.workunit.client.1.smithi134.stdout:2/465: chown d4/d12/f85 465 1 2024-03-12T16:10:41.057 INFO:tasks.workunit.client.1.smithi134.stdout:7/496: dwrite d8/dc/d20/f21 [0,4194304] 0 2024-03-12T16:10:41.058 INFO:tasks.workunit.client.1.smithi134.stdout:0/548: dwrite db/d2f/d31/d75/fb1 [0,4194304] 0 2024-03-12T16:10:41.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/358: rmdir d0/d16/d9/d13/d21/d5f 39 2024-03-12T16:10:41.059 INFO:tasks.workunit.client.1.smithi134.stdout:0/549: chown db/d2f/d31/c49 6067 1 2024-03-12T16:10:41.061 INFO:tasks.workunit.client.1.smithi134.stdout:9/420: symlink d5/d10/l77 0 2024-03-12T16:10:41.061 INFO:tasks.workunit.client.1.smithi134.stdout:6/501: mkdir d1/da6/d55/dcc 0 2024-03-12T16:10:41.061 INFO:tasks.workunit.client.1.smithi134.stdout:1/359: readlink d0/l1f 0 2024-03-12T16:10:41.063 INFO:tasks.workunit.client.1.smithi134.stdout:8/462: rename d3/f57 to d3/d1b/d17/d25/f90 0 2024-03-12T16:10:41.068 INFO:tasks.workunit.client.1.smithi134.stdout:6/502: write d1/d3/d19/f51 [1496208,105526] 0 2024-03-12T16:10:41.069 INFO:tasks.workunit.client.1.smithi134.stdout:3/597: creat d1/d63/dc2/fda x:0 0 0 2024-03-12T16:10:41.080 INFO:tasks.workunit.client.1.smithi134.stdout:3/598: chown d1/db/d10/d2d/d2e/f6a 11035 1 2024-03-12T16:10:41.083 INFO:tasks.workunit.client.1.smithi134.stdout:1/360: link d0/d16/d9/d13/d21/d2f/f56 d0/d16/d9/d51/f7c 0 2024-03-12T16:10:41.083 INFO:tasks.workunit.client.1.smithi134.stdout:9/421: dwrite d5/d10/d6c/f58 [0,4194304] 0 2024-03-12T16:10:41.087 INFO:tasks.workunit.client.1.smithi134.stdout:7/497: dwrite d8/d4e/f52 [0,4194304] 0 2024-03-12T16:10:41.088 INFO:tasks.workunit.client.1.smithi134.stdout:0/550: dread db/d2f/d31/d76/f93 [0,4194304] 0 2024-03-12T16:10:41.088 INFO:tasks.workunit.client.0.smithi006.stdout:6/224: dwrite d3/d11/d10/f2a [0,4194304] 0 2024-03-12T16:10:41.089 INFO:tasks.workunit.client.0.smithi006.stdout:1/270: fdatasync d0/d25/d2a/d35/f51 0 2024-03-12T16:10:41.091 INFO:tasks.workunit.client.0.smithi006.stdout:2/329: truncate d0/d13/d49/d60/f16 3293949 0 2024-03-12T16:10:41.092 INFO:tasks.workunit.client.1.smithi134.stdout:2/466: dwrite d4/d12/f32 [0,4194304] 0 2024-03-12T16:10:41.094 INFO:tasks.workunit.client.1.smithi134.stdout:8/463: dread d3/fe [0,4194304] 0 2024-03-12T16:10:41.094 INFO:tasks.workunit.client.1.smithi134.stdout:3/599: mkdir d1/db/d10/d2a/dc6/ddb 0 2024-03-12T16:10:41.097 INFO:tasks.workunit.client.0.smithi006.stdout:3/279: link d8/d19/d26/d59/f3f d8/d19/d47/f63 0 2024-03-12T16:10:41.097 INFO:tasks.workunit.client.0.smithi006.stdout:2/330: chown d0/d13/d49/d60/f14 2602616 1 2024-03-12T16:10:41.097 INFO:tasks.workunit.client.0.smithi006.stdout:0/357: creat d2/f65 x:0 0 0 2024-03-12T16:10:41.099 INFO:tasks.workunit.client.0.smithi006.stdout:6/225: dread - d3/d11/d10/d1b/d20/f23 zero size 2024-03-12T16:10:41.099 INFO:tasks.workunit.client.1.smithi134.stdout:3/600: write d1/db/d10/fcc [1214919,100367] 0 2024-03-12T16:10:41.100 INFO:tasks.workunit.client.0.smithi006.stdout:2/331: unlink d0/dc/l17 0 2024-03-12T16:10:41.102 INFO:tasks.workunit.client.0.smithi006.stdout:0/358: chown d2/d6/d10/d11/d1d/c55 6 1 2024-03-12T16:10:41.102 INFO:tasks.workunit.client.0.smithi006.stdout:6/226: chown d3/d11/d10/d1b/d20 44806 1 2024-03-12T16:10:41.104 INFO:tasks.workunit.client.1.smithi134.stdout:4/421: dwrite d1/d24/d34/f47 [0,4194304] 0 2024-03-12T16:10:41.104 INFO:tasks.workunit.client.1.smithi134.stdout:0/551: fdatasync db/d2f/d31/d75/f8a 0 2024-03-12T16:10:41.105 INFO:tasks.workunit.client.0.smithi006.stdout:6/227: write d3/f1c [4091923,87038] 0 2024-03-12T16:10:41.108 INFO:tasks.workunit.client.1.smithi134.stdout:3/601: write d1/db/d14/f23 [4024528,3978] 0 2024-03-12T16:10:41.109 INFO:tasks.workunit.client.1.smithi134.stdout:8/464: symlink d3/d1b/d17/d25/d33/d15/d2b/d4f/l91 0 2024-03-12T16:10:41.112 INFO:tasks.workunit.client.1.smithi134.stdout:9/422: dread d5/d20/d47/d69/f75 [0,4194304] 0 2024-03-12T16:10:41.115 INFO:tasks.workunit.client.1.smithi134.stdout:6/503: truncate d1/d3/d10/f2a 5467524 0 2024-03-12T16:10:41.116 INFO:tasks.workunit.client.0.smithi006.stdout:6/228: truncate d3/f9 436554 0 2024-03-12T16:10:41.117 INFO:tasks.workunit.client.0.smithi006.stdout:0/359: dwrite d2/d39/d42/f56 [0,4194304] 0 2024-03-12T16:10:41.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/467: mknod d4/d12/d1d/d34/d47/d8c/da4/ca7 0 2024-03-12T16:10:41.120 INFO:tasks.workunit.client.0.smithi006.stdout:0/360: chown d2/f53 24 1 2024-03-12T16:10:41.121 INFO:tasks.workunit.client.1.smithi134.stdout:0/552: dread db/f6e [0,4194304] 0 2024-03-12T16:10:41.122 INFO:tasks.workunit.client.1.smithi134.stdout:8/465: creat d3/d1b/d17/d25/d33/d15/d2b/d6d/f92 x:0 0 0 2024-03-12T16:10:41.122 INFO:tasks.workunit.client.1.smithi134.stdout:3/602: rename d1/db/f4d to d1/d63/fdc 0 2024-03-12T16:10:41.122 INFO:tasks.workunit.client.1.smithi134.stdout:9/423: chown d5/d10/f32 793781777 1 2024-03-12T16:10:41.123 INFO:tasks.workunit.client.1.smithi134.stdout:6/504: read d1/d3/d19/d32/d4a/f7a [1080423,93612] 0 2024-03-12T16:10:41.123 INFO:tasks.workunit.client.0.smithi006.stdout:0/361: readlink d2/d6/d10/d11/d1d/l5a 0 2024-03-12T16:10:41.126 INFO:tasks.workunit.client.0.smithi006.stdout:3/280: dwrite d8/d19/d26/d59/d2c/dc/d28/f2b [0,4194304] 0 2024-03-12T16:10:41.127 INFO:tasks.workunit.client.1.smithi134.stdout:8/466: dread - d3/d1b/d17/d25/f79 zero size 2024-03-12T16:10:41.127 INFO:tasks.workunit.client.1.smithi134.stdout:9/424: readlink d5/d20/d47/l5d 0 2024-03-12T16:10:41.127 INFO:tasks.workunit.client.1.smithi134.stdout:2/468: write d4/d12/d3b/f8f [645634,31180] 0 2024-03-12T16:10:41.128 INFO:tasks.workunit.client.0.smithi006.stdout:3/281: fsync d8/d19/d26/d59/d2c/f20 0 2024-03-12T16:10:41.129 INFO:tasks.workunit.client.0.smithi006.stdout:0/362: creat d2/d6/d10/d11/f66 x:0 0 0 2024-03-12T16:10:41.130 INFO:tasks.workunit.client.1.smithi134.stdout:1/361: dread d0/d16/d9/d13/f17 [0,4194304] 0 2024-03-12T16:10:41.130 INFO:tasks.workunit.client.1.smithi134.stdout:0/553: mknod db/d2f/d61/d7a/cb5 0 2024-03-12T16:10:41.134 INFO:tasks.workunit.client.0.smithi006.stdout:0/363: mkdir d2/d39/d42/d67 0 2024-03-12T16:10:41.135 INFO:tasks.workunit.client.1.smithi134.stdout:2/469: readlink d4/d12/d43/da2/l40 0 2024-03-12T16:10:41.135 INFO:tasks.workunit.client.1.smithi134.stdout:8/467: truncate d3/d1b/d17/d3f/f52 1609436 0 2024-03-12T16:10:41.137 INFO:tasks.workunit.client.1.smithi134.stdout:8/468: fdatasync d3/d1b/d17/d25/d33/d15/d2b/d4f/d65/f6e 0 2024-03-12T16:10:41.139 INFO:tasks.workunit.client.1.smithi134.stdout:3/603: symlink d1/db/d10/daf/ldd 0 2024-03-12T16:10:41.139 INFO:tasks.workunit.client.1.smithi134.stdout:0/554: creat db/d2f/d51/fb6 x:0 0 0 2024-03-12T16:10:41.140 INFO:tasks.workunit.client.0.smithi006.stdout:2/332: dwrite d0/d13/d49/d60/f16 [0,4194304] 0 2024-03-12T16:10:41.140 INFO:tasks.workunit.client.0.smithi006.stdout:3/282: dwrite d8/d19/d26/d59/f4e [0,4194304] 0 2024-03-12T16:10:41.142 INFO:tasks.workunit.client.0.smithi006.stdout:2/333: read - d0/d13/d49/d60/d2b/f6b zero size 2024-03-12T16:10:41.143 INFO:tasks.workunit.client.0.smithi006.stdout:1/271: dread d0/f21 [0,4194304] 0 2024-03-12T16:10:41.143 INFO:tasks.workunit.client.1.smithi134.stdout:2/470: creat d4/d84/fa8 x:0 0 0 2024-03-12T16:10:41.144 INFO:tasks.workunit.client.0.smithi006.stdout:1/272: chown d0 45297 1 2024-03-12T16:10:41.144 INFO:tasks.workunit.client.0.smithi006.stdout:1/273: readlink d0/d25/l4f 0 2024-03-12T16:10:41.145 INFO:tasks.workunit.client.0.smithi006.stdout:1/274: write d0/d25/d2a/f4d [579973,63030] 0 2024-03-12T16:10:41.145 INFO:tasks.workunit.client.0.smithi006.stdout:2/334: mknod d0/dc/d64/c6e 0 2024-03-12T16:10:41.146 INFO:tasks.workunit.client.1.smithi134.stdout:7/498: dread d8/d27/d9d/d31/f35 [0,4194304] 0 2024-03-12T16:10:41.146 INFO:tasks.workunit.client.1.smithi134.stdout:8/469: symlink d3/d1b/d17/d24/d28/l93 0 2024-03-12T16:10:41.150 INFO:tasks.workunit.client.1.smithi134.stdout:4/422: rename d1/d13/d49/d53/l63 to d1/d24/l8c 0 2024-03-12T16:10:41.151 INFO:tasks.workunit.client.0.smithi006.stdout:2/335: readlink d0/d13/l65 0 2024-03-12T16:10:41.151 INFO:tasks.workunit.client.1.smithi134.stdout:1/362: rename d0/d16/d9/d13/d21/d5f to d0/d16/d9/d13/d21/d5f/d7d 22 2024-03-12T16:10:41.154 INFO:tasks.workunit.client.0.smithi006.stdout:3/283: truncate d8/d19/d31/f35 329989 0 2024-03-12T16:10:41.154 INFO:tasks.workunit.client.1.smithi134.stdout:3/604: creat d1/d63/d6c/dbf/fde x:0 0 0 2024-03-12T16:10:41.157 INFO:tasks.workunit.client.0.smithi006.stdout:0/364: unlink d2/d6/d10/d11/d32/f49 0 2024-03-12T16:10:41.158 INFO:tasks.workunit.client.1.smithi134.stdout:4/423: read d1/d13/f1d [1185588,74229] 0 2024-03-12T16:10:41.158 INFO:tasks.workunit.client.1.smithi134.stdout:9/425: creat d5/d10/d35/d49/d74/f78 x:0 0 0 2024-03-12T16:10:41.158 INFO:tasks.workunit.client.1.smithi134.stdout:1/363: chown d0/d16/d9/d1c/f27 110403968 1 2024-03-12T16:10:41.159 INFO:tasks.workunit.client.1.smithi134.stdout:7/499: dwrite d8/dc/f54 [0,4194304] 0 2024-03-12T16:10:41.159 INFO:tasks.workunit.client.0.smithi006.stdout:0/365: chown d2/f2b 54162 1 2024-03-12T16:10:41.162 INFO:tasks.workunit.client.0.smithi006.stdout:0/366: fdatasync d2/d39/d42/f64 0 2024-03-12T16:10:41.163 INFO:tasks.workunit.client.0.smithi006.stdout:1/275: dwrite d0/d25/d2a/f2c [0,4194304] 0 2024-03-12T16:10:41.164 INFO:tasks.workunit.client.0.smithi006.stdout:2/336: dwrite d0/d13/d49/d60/f3b [0,4194304] 0 2024-03-12T16:10:41.167 INFO:tasks.workunit.client.1.smithi134.stdout:0/555: mknod db/d2f/d31/d56/d66/cb7 0 2024-03-12T16:10:41.168 INFO:tasks.workunit.client.0.smithi006.stdout:0/367: creat d2/d39/d42/f68 x:0 0 0 2024-03-12T16:10:41.169 INFO:tasks.workunit.client.0.smithi006.stdout:0/368: dread - d2/d39/f63 zero size 2024-03-12T16:10:41.169 INFO:tasks.workunit.client.1.smithi134.stdout:8/470: mkdir d3/d1b/d17/d25/d49/d94 0 2024-03-12T16:10:41.174 INFO:tasks.workunit.client.1.smithi134.stdout:4/424: rename d1/d13/d49/d6d/f60 to d1/d24/d34/d73/f8d 0 2024-03-12T16:10:41.175 INFO:tasks.workunit.client.1.smithi134.stdout:9/426: chown d5/d10/c41 10710 1 2024-03-12T16:10:41.175 INFO:tasks.workunit.client.1.smithi134.stdout:7/500: dread d8/dc/f5d [0,4194304] 0 2024-03-12T16:10:41.175 INFO:tasks.workunit.client.0.smithi006.stdout:1/276: creat d0/d25/d2a/d43/f58 x:0 0 0 2024-03-12T16:10:41.175 INFO:tasks.workunit.client.0.smithi006.stdout:2/337: chown d0/dc/l58 82746879 1 2024-03-12T16:10:41.175 INFO:tasks.workunit.client.0.smithi006.stdout:2/338: fdatasync d0/dc/f1a 0 2024-03-12T16:10:41.175 INFO:tasks.workunit.client.0.smithi006.stdout:0/369: symlink d2/d6/l69 0 2024-03-12T16:10:41.175 INFO:tasks.workunit.client.0.smithi006.stdout:2/339: truncate d0/d13/d49/d60/d2b/f63 4794838 0 2024-03-12T16:10:41.177 INFO:tasks.workunit.client.1.smithi134.stdout:7/501: readlink d8/l6b 0 2024-03-12T16:10:41.180 INFO:tasks.workunit.client.0.smithi006.stdout:1/277: dwrite d0/d25/d2a/d43/f49 [0,4194304] 0 2024-03-12T16:10:41.182 INFO:tasks.workunit.client.1.smithi134.stdout:0/556: creat db/d2f/d31/d76/d9f/fb8 x:0 0 0 2024-03-12T16:10:41.185 INFO:tasks.workunit.client.1.smithi134.stdout:6/505: dwrite d1/d3/d19/d32/f3c [0,4194304] 0 2024-03-12T16:10:41.185 INFO:tasks.workunit.client.1.smithi134.stdout:7/502: write d8/dc/d55/d57/f83 [799488,62360] 0 2024-03-12T16:10:41.187 INFO:tasks.workunit.client.1.smithi134.stdout:6/506: chown d1/d3/d19/d32 416 1 2024-03-12T16:10:41.188 INFO:tasks.workunit.client.0.smithi006.stdout:6/229: dread d3/d11/d10/f32 [0,4194304] 0 2024-03-12T16:10:41.188 INFO:tasks.workunit.client.0.smithi006.stdout:1/278: rename d0/d25/d2a/d35/d3f/f50 to d0/d25/f59 0 2024-03-12T16:10:41.189 INFO:tasks.workunit.client.0.smithi006.stdout:6/230: chown d3/d47 188 1 2024-03-12T16:10:41.190 INFO:tasks.workunit.client.1.smithi134.stdout:4/425: mkdir d1/d24/d34/d8e 0 2024-03-12T16:10:41.191 INFO:tasks.workunit.client.0.smithi006.stdout:6/231: write d3/fc [3474791,117058] 0 2024-03-12T16:10:41.193 INFO:tasks.workunit.client.1.smithi134.stdout:9/427: link d5/d10/f6a d5/d10/d1f/f79 0 2024-03-12T16:10:41.193 INFO:tasks.workunit.client.1.smithi134.stdout:2/471: link d4/d12/d1d/d34/d58/c6f d4/d12/ca9 0 2024-03-12T16:10:41.193 INFO:tasks.workunit.client.1.smithi134.stdout:0/557: read db/fe [770075,12350] 0 2024-03-12T16:10:41.194 INFO:tasks.workunit.client.1.smithi134.stdout:5/570: sync 2024-03-12T16:10:41.198 INFO:tasks.workunit.client.0.smithi006.stdout:6/232: creat d3/f52 x:0 0 0 2024-03-12T16:10:41.200 INFO:tasks.workunit.client.1.smithi134.stdout:6/507: creat d1/d16/d4c/d58/da0/fcd x:0 0 0 2024-03-12T16:10:41.200 INFO:tasks.workunit.client.1.smithi134.stdout:9/428: rename d5/fa to d5/d20/d72/f7a 0 2024-03-12T16:10:41.200 INFO:tasks.workunit.client.1.smithi134.stdout:2/472: chown d4/d84/f7a 2770385 1 2024-03-12T16:10:41.200 INFO:tasks.workunit.client.1.smithi134.stdout:1/364: dread d0/d16/d9/d13/d21/f4c [0,4194304] 0 2024-03-12T16:10:41.201 INFO:tasks.workunit.client.1.smithi134.stdout:8/471: rename d3/d1b/d17/d25/d33/d15/d2b to d3/d1b/d17/d25/d33/d15/d95 0 2024-03-12T16:10:41.203 INFO:tasks.workunit.client.1.smithi134.stdout:8/472: chown d3/d1b/d17/d25/d33 8166496 1 2024-03-12T16:10:41.203 INFO:tasks.workunit.client.1.smithi134.stdout:2/473: dread d4/d12/d1d/d34/d58/f93 [0,4194304] 0 2024-03-12T16:10:41.205 INFO:tasks.workunit.client.1.smithi134.stdout:2/474: dread - d4/d84/d63/d9d/fa1 zero size 2024-03-12T16:10:41.206 INFO:tasks.workunit.client.1.smithi134.stdout:2/475: fdatasync d4/fa 0 2024-03-12T16:10:41.207 INFO:tasks.workunit.client.1.smithi134.stdout:0/558: unlink db/d2f/d31/d56/c6a 0 2024-03-12T16:10:41.210 INFO:tasks.workunit.client.1.smithi134.stdout:1/365: creat d0/d16/d9/d13/d21/d20/f7e x:0 0 0 2024-03-12T16:10:41.211 INFO:tasks.workunit.client.1.smithi134.stdout:4/426: dread d1/d13/d49/d64/d28/f3f [4194304,4194304] 0 2024-03-12T16:10:41.211 INFO:tasks.workunit.client.0.smithi006.stdout:6/233: dwrite d3/d11/d10/f35 [0,4194304] 0 2024-03-12T16:10:41.212 INFO:tasks.workunit.client.1.smithi134.stdout:2/476: mkdir d4/d84/d63/daa 0 2024-03-12T16:10:41.213 INFO:tasks.workunit.client.1.smithi134.stdout:8/473: mkdir d3/d1b/d17/d25/d33/d96 0 2024-03-12T16:10:41.220 INFO:tasks.workunit.client.0.smithi006.stdout:2/340: dread d0/d13/f2e [0,4194304] 0 2024-03-12T16:10:41.221 INFO:tasks.workunit.client.1.smithi134.stdout:8/474: write d3/d1b/d17/d25/d33/f84 [40246,83734] 0 2024-03-12T16:10:41.222 INFO:tasks.workunit.client.1.smithi134.stdout:2/477: rename d4/d12/d1d/d34/d58/d74 to d4/d12/d1d/d34/d58/d74/dab 22 2024-03-12T16:10:41.222 INFO:tasks.workunit.client.0.smithi006.stdout:2/341: write d0/d13/f35 [754270,113328] 0 2024-03-12T16:10:41.227 INFO:tasks.workunit.client.0.smithi006.stdout:2/342: creat d0/d13/d49/d60/f6f x:0 0 0 2024-03-12T16:10:41.228 INFO:tasks.workunit.client.1.smithi134.stdout:3/605: dread d1/db/d14/f23 [0,4194304] 0 2024-03-12T16:10:41.228 INFO:tasks.workunit.client.1.smithi134.stdout:8/475: write d3/d1b/d17/d25/d49/f75 [107991,22105] 0 2024-03-12T16:10:41.228 INFO:tasks.workunit.client.0.smithi006.stdout:0/370: write f0 [208407,17265] 0 2024-03-12T16:10:41.229 INFO:tasks.workunit.client.0.smithi006.stdout:0/371: readlink d2/l44 0 2024-03-12T16:10:41.231 INFO:tasks.workunit.client.0.smithi006.stdout:1/279: write d0/f30 [966801,126559] 0 2024-03-12T16:10:41.232 INFO:tasks.workunit.client.1.smithi134.stdout:0/559: dwrite db/f38 [0,4194304] 0 2024-03-12T16:10:41.232 INFO:tasks.workunit.client.0.smithi006.stdout:3/284: write d8/d19/d26/d59/d2c/dc/f38 [1368299,67513] 0 2024-03-12T16:10:41.233 INFO:tasks.workunit.client.0.smithi006.stdout:6/234: dread d3/d11/f31 [0,4194304] 0 2024-03-12T16:10:41.235 INFO:tasks.workunit.client.1.smithi134.stdout:4/427: dwrite d1/d13/f7f [0,4194304] 0 2024-03-12T16:10:41.236 INFO:tasks.workunit.client.0.smithi006.stdout:3/285: chown d8/d19/c36 130022 1 2024-03-12T16:10:41.237 INFO:tasks.workunit.client.1.smithi134.stdout:8/476: stat d3/d1b/d17/d25/d33/d15/d7e 0 2024-03-12T16:10:41.238 INFO:tasks.workunit.client.0.smithi006.stdout:1/280: creat d0/d25/d2a/d35/d3f/f5a x:0 0 0 2024-03-12T16:10:41.239 INFO:tasks.workunit.client.0.smithi006.stdout:6/235: write d3/d11/fd [478415,101498] 0 2024-03-12T16:10:41.240 INFO:tasks.workunit.client.0.smithi006.stdout:3/286: creat d8/d19/f64 x:0 0 0 2024-03-12T16:10:41.240 INFO:tasks.workunit.client.0.smithi006.stdout:2/343: link d0/d13/c2a d0/dc/c70 0 2024-03-12T16:10:41.241 INFO:tasks.workunit.client.0.smithi006.stdout:4/359: sync 2024-03-12T16:10:41.241 INFO:tasks.workunit.client.0.smithi006.stdout:9/295: sync 2024-03-12T16:10:41.241 INFO:tasks.workunit.client.0.smithi006.stdout:8/213: sync 2024-03-12T16:10:41.241 INFO:tasks.workunit.client.0.smithi006.stdout:6/236: chown d3/d11/d10/f41 815371961 1 2024-03-12T16:10:41.241 INFO:tasks.workunit.client.1.smithi134.stdout:6/508: dread d1/d3/d19/f59 [0,4194304] 0 2024-03-12T16:10:41.242 INFO:tasks.workunit.client.0.smithi006.stdout:3/287: write d8/d4c/f56 [99642,49165] 0 2024-03-12T16:10:41.244 INFO:tasks.workunit.client.1.smithi134.stdout:9/429: getdents d5/d10/d1f 0 2024-03-12T16:10:41.244 INFO:tasks.workunit.client.1.smithi134.stdout:5/571: dread db/d12/d1d/f23 [0,4194304] 0 2024-03-12T16:10:41.244 INFO:tasks.workunit.client.1.smithi134.stdout:7/503: truncate d8/dc/d20/f1d 2933087 0 2024-03-12T16:10:41.245 INFO:tasks.workunit.client.0.smithi006.stdout:4/360: dread d1/db/f29 [0,4194304] 0 2024-03-12T16:10:41.245 INFO:tasks.workunit.client.0.smithi006.stdout:0/372: rename d2/d39/d42/f43 to d2/d6/d10/d11/d1d/d2e/f6a 0 2024-03-12T16:10:41.246 INFO:tasks.workunit.client.1.smithi134.stdout:2/478: dread d4/d12/d3b/d3f/f5d [0,4194304] 0 2024-03-12T16:10:41.247 INFO:tasks.workunit.client.0.smithi006.stdout:6/237: creat d3/d11/d10/d28/f53 x:0 0 0 2024-03-12T16:10:41.247 INFO:tasks.workunit.client.0.smithi006.stdout:9/296: read d0/d8/d2b/d20/d37/f47 [4008772,119065] 0 2024-03-12T16:10:41.248 INFO:tasks.workunit.client.0.smithi006.stdout:8/214: mknod d2/c48 0 2024-03-12T16:10:41.249 INFO:tasks.workunit.client.1.smithi134.stdout:6/509: readlink d1/l50 0 2024-03-12T16:10:41.249 INFO:tasks.workunit.client.1.smithi134.stdout:9/430: symlink d5/d10/d35/d49/d74/l7b 0 2024-03-12T16:10:41.249 INFO:tasks.workunit.client.1.smithi134.stdout:3/606: getdents d1/db/d10/dca 0 2024-03-12T16:10:41.249 INFO:tasks.workunit.client.0.smithi006.stdout:3/288: creat d8/d4c/f65 x:0 0 0 2024-03-12T16:10:41.250 INFO:tasks.workunit.client.1.smithi134.stdout:0/560: creat db/d2f/d31/d56/d66/da5/fb9 x:0 0 0 2024-03-12T16:10:41.250 INFO:tasks.workunit.client.1.smithi134.stdout:8/477: read d3/d1b/d17/d25/d33/f34 [263297,51904] 0 2024-03-12T16:10:41.254 INFO:tasks.workunit.client.1.smithi134.stdout:9/431: chown d5/d20 0 1 2024-03-12T16:10:41.254 INFO:tasks.workunit.client.1.smithi134.stdout:4/428: symlink d1/de/d5a/d70/l8f 0 2024-03-12T16:10:41.254 INFO:tasks.workunit.client.1.smithi134.stdout:9/432: chown d5/d10/d1f/l30 29 1 2024-03-12T16:10:41.255 INFO:tasks.workunit.client.1.smithi134.stdout:5/572: symlink db/d12/d37/d73/d8c/lb7 0 2024-03-12T16:10:41.255 INFO:tasks.workunit.client.0.smithi006.stdout:8/215: fsync d2/f15 0 2024-03-12T16:10:41.255 INFO:tasks.workunit.client.0.smithi006.stdout:2/344: dwrite d0/d13/d49/d60/f3b [0,4194304] 0 2024-03-12T16:10:41.256 INFO:tasks.workunit.client.1.smithi134.stdout:3/607: unlink d1/db/d10/d2a/f44 0 2024-03-12T16:10:41.256 INFO:tasks.workunit.client.0.smithi006.stdout:6/238: mknod d3/d47/c54 0 2024-03-12T16:10:41.257 INFO:tasks.workunit.client.0.smithi006.stdout:0/373: dread d2/d6/d10/d11/d1d/d2e/f33 [0,4194304] 0 2024-03-12T16:10:41.257 INFO:tasks.workunit.client.0.smithi006.stdout:9/297: unlink d0/d8/f38 0 2024-03-12T16:10:41.258 INFO:tasks.workunit.client.1.smithi134.stdout:4/429: chown d1/d24/f56 218 1 2024-03-12T16:10:41.259 INFO:tasks.workunit.client.1.smithi134.stdout:5/573: readlink db/d12/d1d/l4d 0 2024-03-12T16:10:41.261 INFO:tasks.workunit.client.1.smithi134.stdout:9/433: unlink d5/d10/d1f/l63 0 2024-03-12T16:10:41.261 INFO:tasks.workunit.client.1.smithi134.stdout:0/561: mknod db/d2f/d31/d68/cba 0 2024-03-12T16:10:41.262 INFO:tasks.workunit.client.0.smithi006.stdout:6/239: write d3/d11/d10/f49 [48620,68353] 0 2024-03-12T16:10:41.262 INFO:tasks.workunit.client.0.smithi006.stdout:1/281: getdents d0 0 2024-03-12T16:10:41.262 INFO:tasks.workunit.client.1.smithi134.stdout:0/562: readlink db/d2f/l7e 0 2024-03-12T16:10:41.264 INFO:tasks.workunit.client.0.smithi006.stdout:3/289: rmdir d8/d19/d26 39 2024-03-12T16:10:41.265 INFO:tasks.workunit.client.0.smithi006.stdout:8/216: chown d2/l1e 79 1 2024-03-12T16:10:41.267 INFO:tasks.workunit.client.0.smithi006.stdout:2/345: symlink d0/dc/l71 0 2024-03-12T16:10:41.267 INFO:tasks.workunit.client.0.smithi006.stdout:6/240: fdatasync d3/d11/d10/f35 0 2024-03-12T16:10:41.268 INFO:tasks.workunit.client.1.smithi134.stdout:2/479: dread d4/f13 [0,4194304] 0 2024-03-12T16:10:41.270 INFO:tasks.workunit.client.0.smithi006.stdout:1/282: symlink d0/d25/d2a/d35/l5b 0 2024-03-12T16:10:41.271 INFO:tasks.workunit.client.1.smithi134.stdout:6/510: rename d1/c2c to d1/d16/d4c/d65/d61/cce 0 2024-03-12T16:10:41.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/504: truncate d8/dc/d55/d81/d87/f9f 4148164 0 2024-03-12T16:10:41.273 INFO:tasks.workunit.client.0.smithi006.stdout:8/217: write d2/db/fe [3972260,19730] 0 2024-03-12T16:10:41.274 INFO:tasks.workunit.client.1.smithi134.stdout:4/430: mkdir d1/de/d90 0 2024-03-12T16:10:41.275 INFO:tasks.workunit.client.0.smithi006.stdout:0/374: dwrite d2/f65 [0,4194304] 0 2024-03-12T16:10:41.277 INFO:tasks.workunit.client.0.smithi006.stdout:1/283: fsync d0/d25/d2a/d43/f47 0 2024-03-12T16:10:41.278 INFO:tasks.workunit.client.0.smithi006.stdout:8/218: fdatasync d2/f16 0 2024-03-12T16:10:41.278 INFO:tasks.workunit.client.0.smithi006.stdout:2/346: truncate d0/d13/f1d 4980514 0 2024-03-12T16:10:41.278 INFO:tasks.workunit.client.0.smithi006.stdout:6/241: chown d3/f9 576605 1 2024-03-12T16:10:41.283 INFO:tasks.workunit.client.0.smithi006.stdout:2/347: write d0/d13/f2e [3453613,124080] 0 2024-03-12T16:10:41.283 INFO:tasks.workunit.client.1.smithi134.stdout:4/431: truncate d1/d13/d49/f81 932706 0 2024-03-12T16:10:41.284 INFO:tasks.workunit.client.0.smithi006.stdout:8/219: write d2/db/fe [1786982,48225] 0 2024-03-12T16:10:41.284 INFO:tasks.workunit.client.1.smithi134.stdout:3/608: creat d1/db/d10/dca/fdf x:0 0 0 2024-03-12T16:10:41.285 INFO:tasks.workunit.client.0.smithi006.stdout:4/361: write d1/db/d17/f53 [2103826,68977] 0 2024-03-12T16:10:41.286 INFO:tasks.workunit.client.1.smithi134.stdout:9/434: mknod d5/d10/c7c 0 2024-03-12T16:10:41.288 INFO:tasks.workunit.client.0.smithi006.stdout:4/362: chown d1/db/c3a 0 1 2024-03-12T16:10:41.288 INFO:tasks.workunit.client.0.smithi006.stdout:1/284: rename d0/f37 to d0/d25/d2a/d35/f5c 0 2024-03-12T16:10:41.289 INFO:tasks.workunit.client.1.smithi134.stdout:8/478: link d3/d1b/d17/d25/d33/d15/d95/d4f/l91 d3/d1b/d17/d3f/l97 0 2024-03-12T16:10:41.289 INFO:tasks.workunit.client.0.smithi006.stdout:2/348: write d0/d13/f2e [608196,41347] 0 2024-03-12T16:10:41.291 INFO:tasks.workunit.client.0.smithi006.stdout:6/242: write d3/d11/d10/d1b/d20/d26/f34 [610716,63632] 0 2024-03-12T16:10:41.291 INFO:tasks.workunit.client.0.smithi006.stdout:8/220: chown d2/c48 11851038 1 2024-03-12T16:10:41.291 INFO:tasks.workunit.client.1.smithi134.stdout:7/505: dwrite d8/d27/f46 [0,4194304] 0 2024-03-12T16:10:41.291 INFO:tasks.workunit.client.0.smithi006.stdout:0/375: dread d2/f4 [0,4194304] 0 2024-03-12T16:10:41.292 INFO:tasks.workunit.client.0.smithi006.stdout:2/349: fsync d0/f12 0 2024-03-12T16:10:41.293 INFO:tasks.workunit.client.0.smithi006.stdout:9/298: dread d0/f28 [0,4194304] 0 2024-03-12T16:10:41.294 INFO:tasks.workunit.client.1.smithi134.stdout:8/479: write d3/d1b/d17/d25/d33/d15/d95/d6d/f80 [90209,99036] 0 2024-03-12T16:10:41.295 INFO:tasks.workunit.client.1.smithi134.stdout:5/574: creat db/d12/fb8 x:0 0 0 2024-03-12T16:10:41.296 INFO:tasks.workunit.client.0.smithi006.stdout:1/285: chown d0/d25/d2a/d35/l5b 11 1 2024-03-12T16:10:41.296 INFO:tasks.workunit.client.1.smithi134.stdout:0/563: getdents db/d2f/d61 0 2024-03-12T16:10:41.297 INFO:tasks.workunit.client.1.smithi134.stdout:6/511: link d1/d4/f47 d1/da6/d55/dcc/fcf 0 2024-03-12T16:10:41.299 INFO:tasks.workunit.client.1.smithi134.stdout:2/480: write d4/d84/f7a [202642,125986] 0 2024-03-12T16:10:41.299 INFO:tasks.workunit.client.1.smithi134.stdout:4/432: creat d1/d13/d49/d64/d35/f91 x:0 0 0 2024-03-12T16:10:41.302 INFO:tasks.workunit.client.0.smithi006.stdout:8/221: mknod d2/d11/c49 0 2024-03-12T16:10:41.304 INFO:tasks.workunit.client.0.smithi006.stdout:0/376: truncate d2/d39/f40 340717 0 2024-03-12T16:10:41.305 INFO:tasks.workunit.client.1.smithi134.stdout:0/564: readlink db/l2e 0 2024-03-12T16:10:41.305 INFO:tasks.workunit.client.1.smithi134.stdout:1/366: dread d0/d42/f45 [0,4194304] 0 2024-03-12T16:10:41.306 INFO:tasks.workunit.client.0.smithi006.stdout:2/350: symlink d0/dc/d64/l72 0 2024-03-12T16:10:41.306 INFO:tasks.workunit.client.0.smithi006.stdout:6/243: write d3/d11/d10/d1b/d20/f23 [751536,113801] 0 2024-03-12T16:10:41.307 INFO:tasks.workunit.client.0.smithi006.stdout:9/299: creat d0/d8/d2b/d20/f61 x:0 0 0 2024-03-12T16:10:41.309 INFO:tasks.workunit.client.1.smithi134.stdout:5/575: mkdir db/d12/d37/db4/db9 0 2024-03-12T16:10:41.310 INFO:tasks.workunit.client.0.smithi006.stdout:2/351: fdatasync d0/f42 0 2024-03-12T16:10:41.312 INFO:tasks.workunit.client.1.smithi134.stdout:1/367: unlink d0/d42/d47/f66 0 2024-03-12T16:10:41.314 INFO:tasks.workunit.client.0.smithi006.stdout:1/286: creat d0/d25/f5d x:0 0 0 2024-03-12T16:10:41.314 INFO:tasks.workunit.client.1.smithi134.stdout:8/480: creat d3/d82/f98 x:0 0 0 2024-03-12T16:10:41.315 INFO:tasks.workunit.client.0.smithi006.stdout:6/244: creat d3/d11/d10/d28/d45/f55 x:0 0 0 2024-03-12T16:10:41.316 INFO:tasks.workunit.client.0.smithi006.stdout:8/222: rmdir d2/db/d1a/d23/d3e 0 2024-03-12T16:10:41.316 INFO:tasks.workunit.client.0.smithi006.stdout:4/363: dwrite d1/db/d17/f1c [0,4194304] 0 2024-03-12T16:10:41.317 INFO:tasks.workunit.client.1.smithi134.stdout:5/576: readlink db/d12/d1d/d59/d94/l33 0 2024-03-12T16:10:41.317 INFO:tasks.workunit.client.1.smithi134.stdout:6/512: rename d1/d16/d4c/d58/fa9 to d1/da6/d55/d85/fd0 0 2024-03-12T16:10:41.317 INFO:tasks.workunit.client.0.smithi006.stdout:1/287: write d0/d25/d2a/d35/f3a [967287,62172] 0 2024-03-12T16:10:41.318 INFO:tasks.workunit.client.0.smithi006.stdout:8/223: chown d2/db/l34 59928105 1 2024-03-12T16:10:41.318 INFO:tasks.workunit.client.0.smithi006.stdout:2/352: rename d0/f42 to d0/d13/d49/f73 0 2024-03-12T16:10:41.319 INFO:tasks.workunit.client.1.smithi134.stdout:9/435: dwrite d5/d10/f2d [0,4194304] 0 2024-03-12T16:10:41.320 INFO:tasks.workunit.client.1.smithi134.stdout:2/481: link d4/d84/f7f d4/d12/d3b/d3f/fac 0 2024-03-12T16:10:41.324 INFO:tasks.workunit.client.1.smithi134.stdout:8/481: creat d3/d10/f99 x:0 0 0 2024-03-12T16:10:41.327 INFO:tasks.workunit.client.1.smithi134.stdout:1/368: fdatasync d0/d16/d9/d1c/f27 0 2024-03-12T16:10:41.330 INFO:tasks.workunit.client.1.smithi134.stdout:9/436: write d5/d46/f5c [2260384,109403] 0 2024-03-12T16:10:41.331 INFO:tasks.workunit.client.1.smithi134.stdout:7/506: dwrite d8/dc/d20/d26/f50 [0,4194304] 0 2024-03-12T16:10:41.333 INFO:tasks.workunit.client.1.smithi134.stdout:2/482: symlink d4/d84/d63/d9d/d3d/d71/lad 0 2024-03-12T16:10:41.334 INFO:tasks.workunit.client.1.smithi134.stdout:6/513: write d1/da6/d55/d97/f99 [629329,85638] 0 2024-03-12T16:10:41.337 INFO:tasks.workunit.client.1.smithi134.stdout:3/609: dread d1/db/d10/d2d/d2e/f3f [0,4194304] 0 2024-03-12T16:10:41.337 INFO:tasks.workunit.client.1.smithi134.stdout:0/565: dread db/f5d [0,4194304] 0 2024-03-12T16:10:41.339 INFO:tasks.workunit.client.1.smithi134.stdout:1/369: write d0/d16/d9/d51/f55 [136048,120980] 0 2024-03-12T16:10:41.339 INFO:tasks.workunit.client.1.smithi134.stdout:7/507: mkdir d8/d27/d9d/daa 0 2024-03-12T16:10:41.340 INFO:tasks.workunit.client.1.smithi134.stdout:3/610: fdatasync d1/db/d10/f28 0 2024-03-12T16:10:41.341 INFO:tasks.workunit.client.1.smithi134.stdout:4/433: dread d1/d13/d49/f32 [0,4194304] 0 2024-03-12T16:10:41.341 INFO:tasks.workunit.client.1.smithi134.stdout:6/514: write d1/d16/d4c/d58/fad [186128,25677] 0 2024-03-12T16:10:41.345 INFO:tasks.workunit.client.1.smithi134.stdout:4/434: chown d1/de/c7 1 1 2024-03-12T16:10:41.345 INFO:tasks.workunit.client.1.smithi134.stdout:3/611: fdatasync d1/db/d14/d5f/f7d 0 2024-03-12T16:10:41.345 INFO:tasks.workunit.client.1.smithi134.stdout:1/370: read d0/d16/d9/d13/d21/d2f/f56 [320613,103207] 0 2024-03-12T16:10:41.347 INFO:tasks.workunit.client.1.smithi134.stdout:8/482: mknod d3/d1b/d17/d25/d33/d15/d95/c9a 0 2024-03-12T16:10:41.350 INFO:tasks.workunit.client.1.smithi134.stdout:2/483: creat d4/d12/d3b/d9b/fae x:0 0 0 2024-03-12T16:10:41.351 INFO:tasks.workunit.client.1.smithi134.stdout:0/566: symlink db/d2f/d31/d56/d66/da5/lbb 0 2024-03-12T16:10:41.356 INFO:tasks.workunit.client.1.smithi134.stdout:8/483: unlink d3/d1b/d17/f87 0 2024-03-12T16:10:41.358 INFO:tasks.workunit.client.1.smithi134.stdout:6/515: getdents d1/d16/d4c/d58/da0/db7 0 2024-03-12T16:10:41.359 INFO:tasks.workunit.client.1.smithi134.stdout:0/567: unlink db/d2f/d51/l82 0 2024-03-12T16:10:41.361 INFO:tasks.workunit.client.1.smithi134.stdout:4/435: dwrite d1/d13/d49/d64/f87 [0,4194304] 0 2024-03-12T16:10:41.362 INFO:tasks.workunit.client.1.smithi134.stdout:1/371: dwrite d0/d16/d9/d13/d21/d20/f44 [0,4194304] 0 2024-03-12T16:10:41.364 INFO:tasks.workunit.client.1.smithi134.stdout:5/577: dwrite db/d12/d29/d3d/f53 [0,4194304] 0 2024-03-12T16:10:41.365 INFO:tasks.workunit.client.1.smithi134.stdout:8/484: mkdir d3/d10/d31/d9b 0 2024-03-12T16:10:41.366 INFO:tasks.workunit.client.1.smithi134.stdout:5/578: stat db/d12/d1d/d59/d94/l33 0 2024-03-12T16:10:41.368 INFO:tasks.workunit.client.1.smithi134.stdout:7/508: link d8/c9 d8/d4e/cab 0 2024-03-12T16:10:41.369 INFO:tasks.workunit.client.0.smithi006.stdout:5/184: sync 2024-03-12T16:10:41.370 INFO:tasks.workunit.client.1.smithi134.stdout:7/509: dread - d8/dc/d55/fa6 zero size 2024-03-12T16:10:41.370 INFO:tasks.workunit.client.1.smithi134.stdout:1/372: creat d0/d16/d9/d13/f7f x:0 0 0 2024-03-12T16:10:41.374 INFO:tasks.workunit.client.1.smithi134.stdout:2/484: getdents d4/d12/d39 0 2024-03-12T16:10:41.376 INFO:tasks.workunit.client.1.smithi134.stdout:5/579: dread db/d12/d29/d3d/f53 [0,4194304] 0 2024-03-12T16:10:41.376 INFO:tasks.workunit.client.1.smithi134.stdout:4/436: creat d1/d13/d49/d64/f92 x:0 0 0 2024-03-12T16:10:41.377 INFO:tasks.workunit.client.1.smithi134.stdout:2/485: read d4/d12/d43/f76 [4750145,94106] 0 2024-03-12T16:10:41.378 INFO:tasks.workunit.client.1.smithi134.stdout:7/510: rename d8/c72 to d8/d27/d9d/d31/cac 0 2024-03-12T16:10:41.380 INFO:tasks.workunit.client.1.smithi134.stdout:2/486: chown d4/d84/d63/d9d/d3d 350444589 1 2024-03-12T16:10:41.381 INFO:tasks.workunit.client.1.smithi134.stdout:1/373: unlink d0/d16/c2e 0 2024-03-12T16:10:41.384 INFO:tasks.workunit.client.1.smithi134.stdout:5/580: mkdir db/d12/d1d/d59/d94/dba 0 2024-03-12T16:10:41.388 INFO:tasks.workunit.client.1.smithi134.stdout:5/581: symlink db/d12/d37/db4/db9/lbb 0 2024-03-12T16:10:41.389 INFO:tasks.workunit.client.1.smithi134.stdout:8/485: dread d3/d1b/d17/d25/d33/d15/d95/d4f/f35 [0,4194304] 0 2024-03-12T16:10:41.393 INFO:tasks.workunit.client.0.smithi006.stdout:5/185: write d7/f2f [1425091,96458] 0 2024-03-12T16:10:41.393 INFO:tasks.workunit.client.1.smithi134.stdout:7/511: dwrite d8/dc/d20/f99 [0,4194304] 0 2024-03-12T16:10:41.393 INFO:tasks.workunit.client.0.smithi006.stdout:8/224: mknod d2/db/c4a 0 2024-03-12T16:10:41.394 INFO:tasks.workunit.client.1.smithi134.stdout:8/486: symlink d3/d82/l9c 0 2024-03-12T16:10:41.395 INFO:tasks.workunit.client.1.smithi134.stdout:1/374: read d0/d16/d9/d13/d21/d20/f4f [281119,106274] 0 2024-03-12T16:10:41.396 INFO:tasks.workunit.client.0.smithi006.stdout:4/364: dwrite d1/db/d1d/f49 [0,4194304] 0 2024-03-12T16:10:41.397 INFO:tasks.workunit.client.0.smithi006.stdout:1/288: dread d0/fb [0,4194304] 0 2024-03-12T16:10:41.397 INFO:tasks.workunit.client.0.smithi006.stdout:9/300: dwrite d0/d4/d3b/f4b [0,4194304] 0 2024-03-12T16:10:41.400 INFO:tasks.workunit.client.1.smithi134.stdout:2/487: read d4/f1f [447962,45675] 0 2024-03-12T16:10:41.402 INFO:tasks.workunit.client.1.smithi134.stdout:8/487: chown d3/d1b/d17/d6c/c74 188460464 1 2024-03-12T16:10:41.404 INFO:tasks.workunit.client.1.smithi134.stdout:2/488: mkdir d4/d12/daf 0 2024-03-12T16:10:41.404 INFO:tasks.workunit.client.1.smithi134.stdout:8/488: read - d3/d1b/d17/d25/d33/d15/d95/d4f/d65/f6e zero size 2024-03-12T16:10:41.408 INFO:tasks.workunit.client.1.smithi134.stdout:1/375: creat d0/d30/d48/f80 x:0 0 0 2024-03-12T16:10:41.409 INFO:tasks.workunit.client.1.smithi134.stdout:2/489: write d4/d84/d63/d9d/d3d/f64 [98248,126856] 0 2024-03-12T16:10:41.410 INFO:tasks.workunit.client.1.smithi134.stdout:6/516: fsync d1/d16/d4c/d58/fad 0 2024-03-12T16:10:41.413 INFO:tasks.workunit.client.1.smithi134.stdout:7/512: dread d8/f24 [0,4194304] 0 2024-03-12T16:10:41.413 INFO:tasks.workunit.client.0.smithi006.stdout:9/301: mknod d0/d4/d18/d4d/c62 0 2024-03-12T16:10:41.414 INFO:tasks.workunit.client.0.smithi006.stdout:5/186: dwrite d7/d8/f2b [0,4194304] 0 2024-03-12T16:10:41.414 INFO:tasks.workunit.client.0.smithi006.stdout:9/302: rmdir d0 39 2024-03-12T16:10:41.414 INFO:tasks.workunit.client.1.smithi134.stdout:8/489: mknod d3/d1b/d17/d25/d33/d15/d95/d5b/c9d 0 2024-03-12T16:10:41.416 INFO:tasks.workunit.client.0.smithi006.stdout:1/289: dread d0/d25/f40 [0,4194304] 0 2024-03-12T16:10:41.416 INFO:tasks.workunit.client.1.smithi134.stdout:8/490: fdatasync d3/d82/f98 0 2024-03-12T16:10:41.417 INFO:tasks.workunit.client.0.smithi006.stdout:5/187: read d7/d9/d10/f1a [1065228,101991] 0 2024-03-12T16:10:41.417 INFO:tasks.workunit.client.1.smithi134.stdout:7/513: fdatasync d8/dc/d55/d57/f83 0 2024-03-12T16:10:41.417 INFO:tasks.workunit.client.1.smithi134.stdout:6/517: rmdir d1 39 2024-03-12T16:10:41.418 INFO:tasks.workunit.client.0.smithi006.stdout:4/365: unlink d1/db/c37 0 2024-03-12T16:10:41.419 INFO:tasks.workunit.client.0.smithi006.stdout:5/188: write d7/d9/d10/d35/f3c [6722378,41821] 0 2024-03-12T16:10:41.420 INFO:tasks.workunit.client.1.smithi134.stdout:1/376: fsync d0/d16/d9/f70 0 2024-03-12T16:10:41.420 INFO:tasks.workunit.client.0.smithi006.stdout:4/366: chown d1/db/d39/d42/d61 1054591391 1 2024-03-12T16:10:41.424 INFO:tasks.workunit.client.0.smithi006.stdout:1/290: mknod d0/d25/d2a/d43/c5e 0 2024-03-12T16:10:41.424 INFO:tasks.workunit.client.1.smithi134.stdout:7/514: write d8/dc/d55/d57/f9e [796990,122002] 0 2024-03-12T16:10:41.425 INFO:tasks.workunit.client.1.smithi134.stdout:7/515: truncate d8/f24 1570278 0 2024-03-12T16:10:41.431 INFO:tasks.workunit.client.0.smithi006.stdout:4/367: symlink d1/d38/l6e 0 2024-03-12T16:10:41.432 INFO:tasks.workunit.client.1.smithi134.stdout:1/377: rmdir d0/d16/d9/d13/d38 39 2024-03-12T16:10:41.432 INFO:tasks.workunit.client.1.smithi134.stdout:6/518: dread d1/d16/d4c/d58/fad [0,4194304] 0 2024-03-12T16:10:41.433 INFO:tasks.workunit.client.0.smithi006.stdout:8/225: write d2/db/f2e [1175542,93849] 0 2024-03-12T16:10:41.433 INFO:tasks.workunit.client.0.smithi006.stdout:6/245: dwrite d3/d11/f3c [4194304,4194304] 0 2024-03-12T16:10:41.435 INFO:tasks.workunit.client.1.smithi134.stdout:0/568: dread db/f26 [0,4194304] 0 2024-03-12T16:10:41.435 INFO:tasks.workunit.client.1.smithi134.stdout:9/437: dwrite d5/d10/d1f/f3c [0,4194304] 0 2024-03-12T16:10:41.438 INFO:tasks.workunit.client.1.smithi134.stdout:8/491: creat d3/f9e x:0 0 0 2024-03-12T16:10:41.438 INFO:tasks.workunit.client.0.smithi006.stdout:2/353: write d0/f40 [775292,127910] 0 2024-03-12T16:10:41.440 INFO:tasks.workunit.client.1.smithi134.stdout:1/378: mkdir d0/d16/d39/d81 0 2024-03-12T16:10:41.441 INFO:tasks.workunit.client.1.smithi134.stdout:1/379: chown d0/lf 94081904 1 2024-03-12T16:10:41.443 INFO:tasks.workunit.client.0.smithi006.stdout:4/368: creat d1/db/d17/d43/f6f x:0 0 0 2024-03-12T16:10:41.444 INFO:tasks.workunit.client.1.smithi134.stdout:8/492: creat d3/d1b/d17/d24/d28/f9f x:0 0 0 2024-03-12T16:10:41.445 INFO:tasks.workunit.client.0.smithi006.stdout:9/303: dwrite d0/d8/d2b/d20/d37/f5c [0,4194304] 0 2024-03-12T16:10:41.445 INFO:tasks.workunit.client.0.smithi006.stdout:6/246: creat d3/d11/d10/d28/f56 x:0 0 0 2024-03-12T16:10:41.445 INFO:tasks.workunit.client.1.smithi134.stdout:8/493: fsync d3/d82/f98 0 2024-03-12T16:10:41.446 INFO:tasks.workunit.client.1.smithi134.stdout:0/569: chown db/d2f/d31/d75/d88/l8c 335 1 2024-03-12T16:10:41.450 INFO:tasks.workunit.client.1.smithi134.stdout:3/612: dread d1/db/d10/d2d/f33 [4194304,4194304] 0 2024-03-12T16:10:41.452 INFO:tasks.workunit.client.0.smithi006.stdout:8/226: chown d2/db/d1a/d23/c46 2 1 2024-03-12T16:10:41.453 INFO:tasks.workunit.client.1.smithi134.stdout:4/437: truncate d1/de/f17 337997 0 2024-03-12T16:10:41.453 INFO:tasks.workunit.client.0.smithi006.stdout:2/354: creat d0/d13/d49/f74 x:0 0 0 2024-03-12T16:10:41.454 INFO:tasks.workunit.client.0.smithi006.stdout:4/369: mknod d1/db/d17/d43/c70 0 2024-03-12T16:10:41.458 INFO:tasks.workunit.client.1.smithi134.stdout:8/494: write d3/d1b/d17/d25/d33/f72 [267602,51727] 0 2024-03-12T16:10:41.459 INFO:tasks.workunit.client.0.smithi006.stdout:5/189: dwrite d7/d9/d10/f32 [0,4194304] 0 2024-03-12T16:10:41.459 INFO:tasks.workunit.client.1.smithi134.stdout:0/570: mkdir db/d2f/d31/d56/dbc 0 2024-03-12T16:10:41.460 INFO:tasks.workunit.client.0.smithi006.stdout:9/304: rename d0/d8/d16/f58 to d0/d8/d23/f63 0 2024-03-12T16:10:41.460 INFO:tasks.workunit.client.0.smithi006.stdout:4/370: chown d1/db/d1d/c30 90176595 1 2024-03-12T16:10:41.464 INFO:tasks.workunit.client.1.smithi134.stdout:0/571: write db/d2f/d61/d67/fa0 [43298,67284] 0 2024-03-12T16:10:41.464 INFO:tasks.workunit.client.1.smithi134.stdout:1/380: creat d0/d16/d9/d13/d38/f82 x:0 0 0 2024-03-12T16:10:41.466 INFO:tasks.workunit.client.1.smithi134.stdout:8/495: mkdir d3/d1b/d17/d25/d33/d15/d95/d6d/da0 0 2024-03-12T16:10:41.466 INFO:tasks.workunit.client.0.smithi006.stdout:8/227: symlink d2/l4b 0 2024-03-12T16:10:41.466 INFO:tasks.workunit.client.1.smithi134.stdout:1/381: read d0/f12 [513658,113436] 0 2024-03-12T16:10:41.467 INFO:tasks.workunit.client.1.smithi134.stdout:2/490: truncate d4/d84/f35 1277537 0 2024-03-12T16:10:41.467 INFO:tasks.workunit.client.1.smithi134.stdout:4/438: chown d1/l52 125 1 2024-03-12T16:10:41.467 INFO:tasks.workunit.client.0.smithi006.stdout:9/305: write d0/d4/f25 [1496325,11819] 0 2024-03-12T16:10:41.468 INFO:tasks.workunit.client.1.smithi134.stdout:3/613: symlink d1/db/d12/d9d/le0 0 2024-03-12T16:10:41.469 INFO:tasks.workunit.client.1.smithi134.stdout:2/491: readlink d4/l19 0 2024-03-12T16:10:41.469 INFO:tasks.workunit.client.1.smithi134.stdout:7/516: truncate d8/dc/d20/d26/f5e 584103 0 2024-03-12T16:10:41.470 INFO:tasks.workunit.client.0.smithi006.stdout:1/291: dwrite d0/f16 [0,4194304] 0 2024-03-12T16:10:41.471 INFO:tasks.workunit.client.0.smithi006.stdout:6/247: dwrite d3/d11/d10/f2a [4194304,4194304] 0 2024-03-12T16:10:41.472 INFO:tasks.workunit.client.1.smithi134.stdout:9/438: fsync d5/d20/f21 0 2024-03-12T16:10:41.476 INFO:tasks.workunit.client.1.smithi134.stdout:1/382: creat d0/d16/d39/d81/f83 x:0 0 0 2024-03-12T16:10:41.477 INFO:tasks.workunit.client.0.smithi006.stdout:4/371: symlink d1/db/d39/d42/d61/l71 0 2024-03-12T16:10:41.477 INFO:tasks.workunit.client.0.smithi006.stdout:5/190: creat d7/d9/d31/d3b/f3f x:0 0 0 2024-03-12T16:10:41.478 INFO:tasks.workunit.client.1.smithi134.stdout:7/517: write d8/dc/d20/f21 [594807,39694] 0 2024-03-12T16:10:41.478 INFO:tasks.workunit.client.0.smithi006.stdout:5/191: chown d7/d9/d31/d3b/f3f 44 1 2024-03-12T16:10:41.479 INFO:tasks.workunit.client.1.smithi134.stdout:3/614: symlink d1/db/d10/d2d/d2e/d72/d97/le1 0 2024-03-12T16:10:41.480 INFO:tasks.workunit.client.1.smithi134.stdout:4/439: creat d1/d13/f93 x:0 0 0 2024-03-12T16:10:41.482 INFO:tasks.workunit.client.0.smithi006.stdout:4/372: dread - d1/db/d17/d43/f6f zero size 2024-03-12T16:10:41.483 INFO:tasks.workunit.client.0.smithi006.stdout:6/248: creat d3/d11/d10/d1b/d20/d26/f57 x:0 0 0 2024-03-12T16:10:41.484 INFO:tasks.workunit.client.1.smithi134.stdout:9/439: symlink d5/d20/d72/l7d 0 2024-03-12T16:10:41.484 INFO:tasks.workunit.client.1.smithi134.stdout:3/615: stat d1/f66 0 2024-03-12T16:10:41.485 INFO:tasks.workunit.client.0.smithi006.stdout:5/192: mknod d7/d8/c40 0 2024-03-12T16:10:41.487 INFO:tasks.workunit.client.1.smithi134.stdout:9/440: chown d5/d10/d1f/f79 27022524 1 2024-03-12T16:10:41.488 INFO:tasks.workunit.client.1.smithi134.stdout:2/492: link d4/d84/d63/d9d/f94 d4/d12/d1d/d34/d58/d74/fb0 0 2024-03-12T16:10:41.489 INFO:tasks.workunit.client.0.smithi006.stdout:8/228: rmdir d2/db/d1a/d23/d47 0 2024-03-12T16:10:41.490 INFO:tasks.workunit.client.0.smithi006.stdout:9/306: dwrite d0/d4/d3b/f4b [4194304,4194304] 0 2024-03-12T16:10:41.490 INFO:tasks.workunit.client.1.smithi134.stdout:9/441: stat d5/l16 0 2024-03-12T16:10:41.490 INFO:tasks.workunit.client.1.smithi134.stdout:1/383: write d0/d16/f7 [4576851,18637] 0 2024-03-12T16:10:41.491 INFO:tasks.workunit.client.1.smithi134.stdout:8/496: dwrite d3/d1b/d17/d25/d33/d15/d95/f32 [0,4194304] 0 2024-03-12T16:10:41.491 INFO:tasks.workunit.client.0.smithi006.stdout:8/229: fdatasync d2/db/f18 0 2024-03-12T16:10:41.493 INFO:tasks.workunit.client.1.smithi134.stdout:4/440: unlink d1/d13/d49/f81 0 2024-03-12T16:10:41.493 INFO:tasks.workunit.client.1.smithi134.stdout:2/493: stat d4/d12/d1d/f97 0 2024-03-12T16:10:41.493 INFO:tasks.workunit.client.1.smithi134.stdout:7/518: truncate d8/dc/d55/d57/f83 1193986 0 2024-03-12T16:10:41.494 INFO:tasks.workunit.client.0.smithi006.stdout:4/373: creat d1/db/d1d/d6c/f72 x:0 0 0 2024-03-12T16:10:41.495 INFO:tasks.workunit.client.0.smithi006.stdout:8/230: readlink d2/db/d1a/d1f/l44 0 2024-03-12T16:10:41.496 INFO:tasks.workunit.client.1.smithi134.stdout:3/616: chown d1/db/d10/d2a/l61 207787 1 2024-03-12T16:10:41.497 INFO:tasks.workunit.client.0.smithi006.stdout:2/355: dwrite d0/f45 [0,4194304] 0 2024-03-12T16:10:41.497 INFO:tasks.workunit.client.0.smithi006.stdout:5/193: mkdir d7/d41 0 2024-03-12T16:10:41.500 INFO:tasks.workunit.client.1.smithi134.stdout:9/442: creat d5/d10/d35/d49/d54/d5e/f7e x:0 0 0 2024-03-12T16:10:41.503 INFO:tasks.workunit.client.1.smithi134.stdout:7/519: dread d8/d27/f46 [0,4194304] 0 2024-03-12T16:10:41.506 INFO:tasks.workunit.client.1.smithi134.stdout:0/572: truncate db/d2f/d71/f9e 1256559 0 2024-03-12T16:10:41.507 INFO:tasks.workunit.client.0.smithi006.stdout:8/231: creat d2/db/d1a/d23/f4c x:0 0 0 2024-03-12T16:10:41.508 INFO:tasks.workunit.client.1.smithi134.stdout:3/617: dwrite d1/f2 [4194304,4194304] 0 2024-03-12T16:10:41.508 INFO:tasks.workunit.client.0.smithi006.stdout:2/356: truncate d0/d13/f35 1468988 0 2024-03-12T16:10:41.508 INFO:tasks.workunit.client.0.smithi006.stdout:9/307: mknod d0/d8/d16/c64 0 2024-03-12T16:10:41.511 INFO:tasks.workunit.client.1.smithi134.stdout:8/497: rename d3/f6 to d3/d1b/d17/d25/d33/d15/d95/d4f/fa1 0 2024-03-12T16:10:41.511 INFO:tasks.workunit.client.1.smithi134.stdout:8/498: stat d3/f9e 0 2024-03-12T16:10:41.514 INFO:tasks.workunit.client.0.smithi006.stdout:6/249: write d3/f14 [2938014,14751] 0 2024-03-12T16:10:41.517 INFO:tasks.workunit.client.1.smithi134.stdout:9/443: creat d5/d46/f7f x:0 0 0 2024-03-12T16:10:41.520 INFO:tasks.workunit.client.1.smithi134.stdout:4/441: symlink d1/d13/d49/d64/l94 0 2024-03-12T16:10:41.521 INFO:tasks.workunit.client.1.smithi134.stdout:2/494: symlink d4/d84/d63/daa/lb1 0 2024-03-12T16:10:41.527 INFO:tasks.workunit.client.0.smithi006.stdout:5/194: dwrite d7/d9/d2c/f36 [0,4194304] 0 2024-03-12T16:10:41.527 INFO:tasks.workunit.client.0.smithi006.stdout:6/250: creat d3/d11/d10/d28/d45/f58 x:0 0 0 2024-03-12T16:10:41.527 INFO:tasks.workunit.client.1.smithi134.stdout:9/444: dwrite d5/d10/d1f/f43 [0,4194304] 0 2024-03-12T16:10:41.531 INFO:tasks.workunit.client.0.smithi006.stdout:8/232: dwrite d2/d11/f27 [0,4194304] 0 2024-03-12T16:10:41.532 INFO:tasks.workunit.client.0.smithi006.stdout:1/292: dwrite d0/d25/f2e [0,4194304] 0 2024-03-12T16:10:41.533 INFO:tasks.workunit.client.0.smithi006.stdout:2/357: dwrite d0/d13/f35 [0,4194304] 0 2024-03-12T16:10:41.533 INFO:tasks.workunit.client.0.smithi006.stdout:6/251: readlink d3/d11/d10/d1b/d20/l2f 0 2024-03-12T16:10:41.534 INFO:tasks.workunit.client.1.smithi134.stdout:2/495: write d4/d12/d1d/d34/fa0 [968747,21061] 0 2024-03-12T16:10:41.536 INFO:tasks.workunit.client.0.smithi006.stdout:7/398: sync 2024-03-12T16:10:41.536 INFO:tasks.workunit.client.0.smithi006.stdout:8/233: stat d2/db/fe 0 2024-03-12T16:10:41.536 INFO:tasks.workunit.client.0.smithi006.stdout:6/252: mkdir d3/d11/d3b/d59 0 2024-03-12T16:10:41.537 INFO:tasks.workunit.client.1.smithi134.stdout:4/442: write d1/de/f36 [3713715,77959] 0 2024-03-12T16:10:41.539 INFO:tasks.workunit.client.0.smithi006.stdout:8/234: dread - d2/d11/f42 zero size 2024-03-12T16:10:41.543 INFO:tasks.workunit.client.0.smithi006.stdout:6/253: mkdir d3/d11/d10/d1b/d20/d5a 0 2024-03-12T16:10:41.544 INFO:tasks.workunit.client.1.smithi134.stdout:4/443: truncate d1/d13/d49/d64/d35/f79 755606 0 2024-03-12T16:10:41.550 INFO:tasks.workunit.client.1.smithi134.stdout:8/499: creat d3/d1b/d17/d25/d49/d94/fa2 x:0 0 0 2024-03-12T16:10:41.550 INFO:tasks.workunit.client.1.smithi134.stdout:1/384: getdents d0/d42/d47 0 2024-03-12T16:10:41.551 INFO:tasks.workunit.client.0.smithi006.stdout:1/293: dread d0/d25/f59 [0,4194304] 0 2024-03-12T16:10:41.552 INFO:tasks.workunit.client.1.smithi134.stdout:4/444: fsync d1/d13/d49/f32 0 2024-03-12T16:10:41.552 INFO:tasks.workunit.client.1.smithi134.stdout:9/445: dwrite d5/d10/d6c/f58 [0,4194304] 0 2024-03-12T16:10:41.553 INFO:tasks.workunit.client.1.smithi134.stdout:7/520: getdents d8/dc/d4b 0 2024-03-12T16:10:41.554 INFO:tasks.workunit.client.0.smithi006.stdout:1/294: read d0/d25/d2a/d43/f49 [2499523,58653] 0 2024-03-12T16:10:41.555 INFO:tasks.workunit.client.0.smithi006.stdout:8/235: dread d2/d11/f2d [0,4194304] 0 2024-03-12T16:10:41.555 INFO:tasks.workunit.client.0.smithi006.stdout:1/295: readlink d0/l20 0 2024-03-12T16:10:41.555 INFO:tasks.workunit.client.0.smithi006.stdout:6/254: creat d3/d11/d43/f5b x:0 0 0 2024-03-12T16:10:41.555 INFO:tasks.workunit.client.0.smithi006.stdout:5/195: link d7/cd d7/d9/d10/d24/c42 0 2024-03-12T16:10:41.555 INFO:tasks.workunit.client.1.smithi134.stdout:4/445: fdatasync d1/d24/d34/f83 0 2024-03-12T16:10:41.556 INFO:tasks.workunit.client.1.smithi134.stdout:3/618: link d1/db/c45 d1/db/d10/d2d/ce2 0 2024-03-12T16:10:41.560 INFO:tasks.workunit.client.1.smithi134.stdout:4/446: write d1/d13/d49/f78 [826996,91259] 0 2024-03-12T16:10:41.560 INFO:tasks.workunit.client.1.smithi134.stdout:3/619: readlink d1/db/d12/d9d/le0 0 2024-03-12T16:10:41.560 INFO:tasks.workunit.client.0.smithi006.stdout:8/236: write d2/db/d1a/d1f/f31 [3150034,4334] 0 2024-03-12T16:10:41.561 INFO:tasks.workunit.client.0.smithi006.stdout:9/308: truncate d0/d8/d2b/f48 445282 0 2024-03-12T16:10:41.561 INFO:tasks.workunit.client.1.smithi134.stdout:8/500: mknod d3/d1b/d17/ca3 0 2024-03-12T16:10:41.561 INFO:tasks.workunit.client.1.smithi134.stdout:1/385: mknod d0/d16/c84 0 2024-03-12T16:10:41.562 INFO:tasks.workunit.client.0.smithi006.stdout:1/296: mknod d0/d25/d2a/c5f 0 2024-03-12T16:10:41.562 INFO:tasks.workunit.client.1.smithi134.stdout:9/446: truncate d5/d10/d35/d49/d54/d5e/f71 316683 0 2024-03-12T16:10:41.564 INFO:tasks.workunit.client.1.smithi134.stdout:4/447: chown d1/d13/l46 1 1 2024-03-12T16:10:41.566 INFO:tasks.workunit.client.1.smithi134.stdout:4/448: write d1/d13/f5b [756810,42358] 0 2024-03-12T16:10:41.570 INFO:tasks.workunit.client.0.smithi006.stdout:5/196: rename l5 to d7/d9/d31/l43 0 2024-03-12T16:10:41.572 INFO:tasks.workunit.client.1.smithi134.stdout:9/447: creat d5/d10/d35/d49/d54/f80 x:0 0 0 2024-03-12T16:10:41.573 INFO:tasks.workunit.client.0.smithi006.stdout:8/237: write d2/f36 [893290,12633] 0 2024-03-12T16:10:41.574 INFO:tasks.workunit.client.1.smithi134.stdout:4/449: dread - d1/d13/f93 zero size 2024-03-12T16:10:41.574 INFO:tasks.workunit.client.1.smithi134.stdout:8/501: creat d3/d1b/d17/d25/d33/d96/fa4 x:0 0 0 2024-03-12T16:10:41.574 INFO:tasks.workunit.client.1.smithi134.stdout:3/620: truncate d1/d63/d6c/f6d 3798435 0 2024-03-12T16:10:41.575 INFO:tasks.workunit.client.0.smithi006.stdout:5/197: dread - d7/d9/d10/f26 zero size 2024-03-12T16:10:41.578 INFO:tasks.workunit.client.1.smithi134.stdout:8/502: dread - d3/d1b/d17/d25/d33/d15/d95/d6d/f92 zero size 2024-03-12T16:10:41.578 INFO:tasks.workunit.client.0.smithi006.stdout:6/255: dwrite d3/d11/d10/f42 [0,4194304] 0 2024-03-12T16:10:41.578 INFO:tasks.workunit.client.1.smithi134.stdout:1/386: rename d0/d16/d39/d81 to d0/d16/d9/d13/d21/d5f/d6f/d85 0 2024-03-12T16:10:41.579 INFO:tasks.workunit.client.1.smithi134.stdout:3/621: write d1/db/f4c [2619881,116644] 0 2024-03-12T16:10:41.580 INFO:tasks.workunit.client.0.smithi006.stdout:6/256: readlink d3/d11/d10/d1b/d20/d26/l3a 0 2024-03-12T16:10:41.580 INFO:tasks.workunit.client.0.smithi006.stdout:8/238: symlink d2/d11/l4d 0 2024-03-12T16:10:41.586 INFO:tasks.workunit.client.0.smithi006.stdout:8/239: creat d2/d11/f4e x:0 0 0 2024-03-12T16:10:41.587 INFO:tasks.workunit.client.0.smithi006.stdout:8/240: read d2/f3a [3608548,12286] 0 2024-03-12T16:10:41.588 INFO:tasks.workunit.client.0.smithi006.stdout:5/198: dwrite d7/d9/d10/d24/f3e [0,4194304] 0 2024-03-12T16:10:41.592 INFO:tasks.workunit.client.1.smithi134.stdout:3/622: write d1/db/d14/f59 [795553,16587] 0 2024-03-12T16:10:41.593 INFO:tasks.workunit.client.0.smithi006.stdout:6/257: rename d3/f1d to d3/d11/d43/f5c 0 2024-03-12T16:10:41.594 INFO:tasks.workunit.client.1.smithi134.stdout:2/496: dread d4/d12/d3b/d3f/f92 [0,4194304] 0 2024-03-12T16:10:41.595 INFO:tasks.workunit.client.1.smithi134.stdout:7/521: dread d8/d4e/f74 [0,4194304] 0 2024-03-12T16:10:41.595 INFO:tasks.workunit.client.0.smithi006.stdout:7/399: truncate de/d18/d2a/d40/f60 3796758 0 2024-03-12T16:10:41.600 INFO:tasks.workunit.client.0.smithi006.stdout:6/258: fdatasync d3/d11/d10/d19/f39 0 2024-03-12T16:10:41.601 INFO:tasks.workunit.client.0.smithi006.stdout:8/241: dwrite d2/d11/f27 [4194304,4194304] 0 2024-03-12T16:10:41.603 INFO:tasks.workunit.client.1.smithi134.stdout:9/448: creat d5/d10/f81 x:0 0 0 2024-03-12T16:10:41.604 INFO:tasks.workunit.client.0.smithi006.stdout:8/242: chown d2/db/d1a/d23 167 1 2024-03-12T16:10:41.608 INFO:tasks.workunit.client.1.smithi134.stdout:8/503: dwrite d3/d1b/d17/d25/d33/d15/d95/f30 [4194304,4194304] 0 2024-03-12T16:10:41.609 INFO:tasks.workunit.client.0.smithi006.stdout:8/243: fdatasync d2/f16 0 2024-03-12T16:10:41.611 INFO:tasks.workunit.client.0.smithi006.stdout:8/244: truncate d2/d11/f14 692977 0 2024-03-12T16:10:41.611 INFO:tasks.workunit.client.0.smithi006.stdout:6/259: mkdir d3/d11/d3b/d5d 0 2024-03-12T16:10:41.611 INFO:tasks.workunit.client.1.smithi134.stdout:7/522: creat d8/dc/d55/fad x:0 0 0 2024-03-12T16:10:41.611 INFO:tasks.workunit.client.1.smithi134.stdout:2/497: mknod d4/d84/d63/cb2 0 2024-03-12T16:10:41.612 INFO:tasks.workunit.client.1.smithi134.stdout:8/504: fdatasync d3/d1b/d17/d25/d33/d15/d95/d6d/f92 0 2024-03-12T16:10:41.613 INFO:tasks.workunit.client.0.smithi006.stdout:8/245: readlink d2/db/d1a/d21/d2b/l43 0 2024-03-12T16:10:41.614 INFO:tasks.workunit.client.0.smithi006.stdout:8/246: fsync d2/f16 0 2024-03-12T16:10:41.617 INFO:tasks.workunit.client.1.smithi134.stdout:4/450: rename d1/d13/d49/d64/d28/d4f/f51 to d1/d13/d49/d64/d28/d4f/d67/f95 0 2024-03-12T16:10:41.617 INFO:tasks.workunit.client.1.smithi134.stdout:2/498: mknod d4/d12/d1d/d34/d58/cb3 0 2024-03-12T16:10:41.620 INFO:tasks.workunit.client.1.smithi134.stdout:7/523: mknod d8/dc/d55/d81/d87/cae 0 2024-03-12T16:10:41.621 INFO:tasks.workunit.client.1.smithi134.stdout:4/451: truncate d1/de/d5a/d84/f85 563558 0 2024-03-12T16:10:41.621 INFO:tasks.workunit.client.0.smithi006.stdout:5/199: write d7/d9/d10/f1a [2065092,43] 0 2024-03-12T16:10:41.623 INFO:tasks.workunit.client.1.smithi134.stdout:9/449: getdents d5/d10/d35/d49 0 2024-03-12T16:10:41.624 INFO:tasks.workunit.client.0.smithi006.stdout:8/247: mkdir d2/db/d1a/d21/d4f 0 2024-03-12T16:10:41.625 INFO:tasks.workunit.client.1.smithi134.stdout:7/524: creat d8/dc/d20/faf x:0 0 0 2024-03-12T16:10:41.626 INFO:tasks.workunit.client.1.smithi134.stdout:4/452: mkdir d1/d13/d49/d6d/d96 0 2024-03-12T16:10:41.627 INFO:tasks.workunit.client.1.smithi134.stdout:7/525: chown d8/dc/d55/f5f 1623066308 1 2024-03-12T16:10:41.627 INFO:tasks.workunit.client.0.smithi006.stdout:9/309: dwrite d0/d4/d3b/d4a/f55 [0,4194304] 0 2024-03-12T16:10:41.627 INFO:tasks.workunit.client.0.smithi006.stdout:5/200: symlink d7/l44 0 2024-03-12T16:10:41.627 INFO:tasks.workunit.client.0.smithi006.stdout:8/248: readlink d2/db/l34 0 2024-03-12T16:10:41.628 INFO:tasks.workunit.client.1.smithi134.stdout:1/387: truncate d0/f3a 3834799 0 2024-03-12T16:10:41.628 INFO:tasks.workunit.client.1.smithi134.stdout:7/526: readlink d8/dc/le 0 2024-03-12T16:10:41.629 INFO:tasks.workunit.client.0.smithi006.stdout:6/260: write d3/d11/d43/f5c [1076216,55070] 0 2024-03-12T16:10:41.629 INFO:tasks.workunit.client.1.smithi134.stdout:9/450: unlink d5/d10/d1f/f3c 0 2024-03-12T16:10:41.630 INFO:tasks.workunit.client.0.smithi006.stdout:7/400: dread de/d18/d2a/d40/f63 [0,4194304] 0 2024-03-12T16:10:41.631 INFO:tasks.workunit.client.1.smithi134.stdout:9/451: dread - d5/d10/d6c/f6b zero size 2024-03-12T16:10:41.632 INFO:tasks.workunit.client.0.smithi006.stdout:1/297: dwrite d0/f2f [0,4194304] 0 2024-03-12T16:10:41.632 INFO:tasks.workunit.client.1.smithi134.stdout:4/453: creat d1/d24/d34/f97 x:0 0 0 2024-03-12T16:10:41.633 INFO:tasks.workunit.client.1.smithi134.stdout:9/452: write d5/d10/d35/f61 [3389873,86252] 0 2024-03-12T16:10:41.634 INFO:tasks.workunit.client.0.smithi006.stdout:7/401: write de/d2c/f6f [3706723,126510] 0 2024-03-12T16:10:41.634 INFO:tasks.workunit.client.0.smithi006.stdout:5/201: symlink d7/l45 0 2024-03-12T16:10:41.634 INFO:tasks.workunit.client.0.smithi006.stdout:6/261: write d3/f14 [3672559,20790] 0 2024-03-12T16:10:41.635 INFO:tasks.workunit.client.1.smithi134.stdout:9/453: chown d5/d10/d35/d49/d54/c68 0 1 2024-03-12T16:10:41.637 INFO:tasks.workunit.client.1.smithi134.stdout:3/623: rename d1/db/d10/d2d/d2e/d72/d97/fb7 to d1/db/d12/d9d/fe3 0 2024-03-12T16:10:41.640 INFO:tasks.workunit.client.0.smithi006.stdout:8/249: dread d2/db/d1a/f1c [0,4194304] 0 2024-03-12T16:10:41.641 INFO:tasks.workunit.client.1.smithi134.stdout:2/499: link d4/d12/d1d/d34/d58/c6f d4/d84/cb4 0 2024-03-12T16:10:41.641 INFO:tasks.workunit.client.0.smithi006.stdout:5/202: write d7/d9/f30 [515818,36688] 0 2024-03-12T16:10:41.641 INFO:tasks.workunit.client.0.smithi006.stdout:9/310: dread d0/d8/d16/f31 [0,4194304] 0 2024-03-12T16:10:41.644 INFO:tasks.workunit.client.1.smithi134.stdout:9/454: mkdir d5/d10/d35/d49/d54/d5e/d82 0 2024-03-12T16:10:41.646 INFO:tasks.workunit.client.1.smithi134.stdout:2/500: chown d4/d12/d1d/d34/d58/d74 86 1 2024-03-12T16:10:41.647 INFO:tasks.workunit.client.1.smithi134.stdout:3/624: rmdir d1/db/d10/d2a/dc6 39 2024-03-12T16:10:41.647 INFO:tasks.workunit.client.1.smithi134.stdout:2/501: read d4/d12/d1d/d34/fa0 [840431,61615] 0 2024-03-12T16:10:41.648 INFO:tasks.workunit.client.1.smithi134.stdout:3/625: fdatasync d1/db/d14/d5f/fbe 0 2024-03-12T16:10:41.648 INFO:tasks.workunit.client.1.smithi134.stdout:4/454: creat d1/d24/d34/d8e/f98 x:0 0 0 2024-03-12T16:10:41.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/455: mkdir d5/d10/d35/d49/d74/d83 0 2024-03-12T16:10:41.650 INFO:tasks.workunit.client.0.smithi006.stdout:6/262: creat d3/d11/d43/f5e x:0 0 0 2024-03-12T16:10:41.650 INFO:tasks.workunit.client.0.smithi006.stdout:7/402: mknod de/d27/d7c/c89 0 2024-03-12T16:10:41.651 INFO:tasks.workunit.client.0.smithi006.stdout:8/250: rename d2/db/d1a/d23/f4c to d2/db/d1a/d23/f50 0 2024-03-12T16:10:41.652 INFO:tasks.workunit.client.1.smithi134.stdout:8/505: rename d3/d1b/d17/d25/d33/d15/d95/c9a to d3/d1b/d17/d25/d33/ca5 0 2024-03-12T16:10:41.652 INFO:tasks.workunit.client.0.smithi006.stdout:5/203: chown d7/d9/d31/l43 3996199 1 2024-03-12T16:10:41.653 INFO:tasks.workunit.client.1.smithi134.stdout:4/455: unlink d1/l52 0 2024-03-12T16:10:41.654 INFO:tasks.workunit.client.1.smithi134.stdout:9/456: creat d5/d20/d47/d69/f84 x:0 0 0 2024-03-12T16:10:41.655 INFO:tasks.workunit.client.0.smithi006.stdout:7/403: mkdir de/d2c/d4f/d8a 0 2024-03-12T16:10:41.655 INFO:tasks.workunit.client.0.smithi006.stdout:1/298: dwrite d0/d25/d2a/d43/f47 [0,4194304] 0 2024-03-12T16:10:41.655 INFO:tasks.workunit.client.1.smithi134.stdout:3/626: mkdir d1/db/d12/de4 0 2024-03-12T16:10:41.658 INFO:tasks.workunit.client.0.smithi006.stdout:1/299: readlink d0/d25/d2a/d43/l4a 0 2024-03-12T16:10:41.658 INFO:tasks.workunit.client.1.smithi134.stdout:9/457: chown d5/d10/d6c/c66 9649 1 2024-03-12T16:10:41.659 INFO:tasks.workunit.client.0.smithi006.stdout:7/404: fsync de/d18/d2a/f67 0 2024-03-12T16:10:41.660 INFO:tasks.workunit.client.1.smithi134.stdout:2/502: dwrite d4/d12/d3b/d9b/fae [0,4194304] 0 2024-03-12T16:10:41.662 INFO:tasks.workunit.client.0.smithi006.stdout:5/204: creat d7/d9/d31/f46 x:0 0 0 2024-03-12T16:10:41.663 INFO:tasks.workunit.client.0.smithi006.stdout:1/300: stat d0/d25/d2a/d43/d56/l4c 0 2024-03-12T16:10:41.664 INFO:tasks.workunit.client.0.smithi006.stdout:8/251: write d2/f19 [2787752,35477] 0 2024-03-12T16:10:41.664 INFO:tasks.workunit.client.1.smithi134.stdout:9/458: truncate d5/d10/d1f/f79 800909 0 2024-03-12T16:10:41.665 INFO:tasks.workunit.client.0.smithi006.stdout:6/263: dwrite d3/d11/d10/d1b/f3f [0,4194304] 0 2024-03-12T16:10:41.665 INFO:tasks.workunit.client.0.smithi006.stdout:9/311: truncate d0/d8/d2b/d20/f51 34646 0 2024-03-12T16:10:41.666 INFO:tasks.workunit.client.1.smithi134.stdout:9/459: chown d5/d10/d35/d49/d54/d5e/f71 13161 1 2024-03-12T16:10:41.668 INFO:tasks.workunit.client.1.smithi134.stdout:3/627: creat d1/db/d14/d5f/fe5 x:0 0 0 2024-03-12T16:10:41.668 INFO:tasks.workunit.client.1.smithi134.stdout:9/460: chown d5/d10/d35/d49/d74 203447 1 2024-03-12T16:10:41.673 INFO:tasks.workunit.client.1.smithi134.stdout:3/628: mknod d1/db/d12/de4/ce6 0 2024-03-12T16:10:41.676 INFO:tasks.workunit.client.0.smithi006.stdout:1/301: creat d0/d25/d2a/d43/f60 x:0 0 0 2024-03-12T16:10:41.676 INFO:tasks.workunit.client.0.smithi006.stdout:0/377: sync 2024-03-12T16:10:41.676 INFO:tasks.workunit.client.0.smithi006.stdout:3/290: sync 2024-03-12T16:10:41.676 INFO:tasks.workunit.client.0.smithi006.stdout:5/205: mkdir d7/d9/d47 0 2024-03-12T16:10:41.676 INFO:tasks.workunit.client.1.smithi134.stdout:4/456: rename d1/d24/d34/f69 to d1/d13/d49/d64/d28/f99 0 2024-03-12T16:10:41.677 INFO:tasks.workunit.client.0.smithi006.stdout:6/264: creat d3/d11/d10/d28/f5f x:0 0 0 2024-03-12T16:10:41.678 INFO:tasks.workunit.client.0.smithi006.stdout:8/252: truncate d2/f3a 120192 0 2024-03-12T16:10:41.678 INFO:tasks.workunit.client.0.smithi006.stdout:9/312: chown d0/d8/c12 0 1 2024-03-12T16:10:41.679 INFO:tasks.workunit.client.1.smithi134.stdout:9/461: dwrite d5/d10/d35/f3a [0,4194304] 0 2024-03-12T16:10:41.679 INFO:tasks.workunit.client.0.smithi006.stdout:7/405: link ld de/d18/d2a/d39/d81/l8b 0 2024-03-12T16:10:41.680 INFO:tasks.workunit.client.1.smithi134.stdout:3/629: symlink d1/db/d10/d2d/d2e/d72/le7 0 2024-03-12T16:10:41.686 INFO:tasks.workunit.client.1.smithi134.stdout:9/462: fsync d5/d10/d35/f61 0 2024-03-12T16:10:41.686 INFO:tasks.workunit.client.1.smithi134.stdout:1/388: dwrite d0/d16/f29 [0,4194304] 0 2024-03-12T16:10:41.689 INFO:tasks.workunit.client.1.smithi134.stdout:8/506: truncate d3/d10/f58 1231563 0 2024-03-12T16:10:41.690 INFO:tasks.workunit.client.1.smithi134.stdout:3/630: fdatasync d1/db/d10/fa7 0 2024-03-12T16:10:41.693 INFO:tasks.workunit.client.1.smithi134.stdout:2/503: dread d4/d12/f20 [0,4194304] 0 2024-03-12T16:10:41.693 INFO:tasks.workunit.client.1.smithi134.stdout:4/457: unlink d1/de/f17 0 2024-03-12T16:10:41.694 INFO:tasks.workunit.client.1.smithi134.stdout:9/463: dwrite d5/f3e [0,4194304] 0 2024-03-12T16:10:41.696 INFO:tasks.workunit.client.1.smithi134.stdout:9/464: stat d5/c29 0 2024-03-12T16:10:41.696 INFO:tasks.workunit.client.1.smithi134.stdout:9/465: fsync d5/d10/f1c 0 2024-03-12T16:10:41.698 INFO:tasks.workunit.client.1.smithi134.stdout:8/507: mknod d3/d1b/d17/d45/ca6 0 2024-03-12T16:10:41.698 INFO:tasks.workunit.client.1.smithi134.stdout:3/631: fdatasync d1/db/d10/d2d/d30/fa0 0 2024-03-12T16:10:41.699 INFO:tasks.workunit.client.1.smithi134.stdout:8/508: chown d3/d1b/d17/d25/d33/d15/d95/d5b/c9d 2194 1 2024-03-12T16:10:41.700 INFO:tasks.workunit.client.1.smithi134.stdout:2/504: creat d4/d12/d3b/d3f/fb5 x:0 0 0 2024-03-12T16:10:41.703 INFO:tasks.workunit.client.1.smithi134.stdout:1/389: rename d0/d16/d9/d1c to d0/d30/d86 0 2024-03-12T16:10:41.704 INFO:tasks.workunit.client.1.smithi134.stdout:3/632: symlink d1/db/d10/d2d/d2e/d72/le8 0 2024-03-12T16:10:41.706 INFO:tasks.workunit.client.1.smithi134.stdout:3/633: write d1/db/d12/d9d/fc0 [950179,79206] 0 2024-03-12T16:10:41.706 INFO:tasks.workunit.client.1.smithi134.stdout:2/505: rename d4/d12/f62 to d4/d84/d7d/fb6 0 2024-03-12T16:10:41.709 INFO:tasks.workunit.client.1.smithi134.stdout:9/466: fsync d5/d10/f56 0 2024-03-12T16:10:41.709 INFO:tasks.workunit.client.1.smithi134.stdout:3/634: chown d1/db/d10/d2a/l91 1668655 1 2024-03-12T16:10:41.709 INFO:tasks.workunit.client.1.smithi134.stdout:2/506: dread - d4/d84/d63/d9d/fa1 zero size 2024-03-12T16:10:41.710 INFO:tasks.workunit.client.1.smithi134.stdout:2/507: read - d4/f90 zero size 2024-03-12T16:10:41.711 INFO:tasks.workunit.client.1.smithi134.stdout:3/635: readlink d1/db/d14/d5f/lba 0 2024-03-12T16:10:41.712 INFO:tasks.workunit.client.1.smithi134.stdout:9/467: symlink d5/l85 0 2024-03-12T16:10:41.712 INFO:tasks.workunit.client.1.smithi134.stdout:8/509: dwrite d3/d1b/d17/d24/f2d [0,4194304] 0 2024-03-12T16:10:41.714 INFO:tasks.workunit.client.1.smithi134.stdout:9/468: write d5/d10/d35/f61 [1011602,83737] 0 2024-03-12T16:10:41.715 INFO:tasks.workunit.client.1.smithi134.stdout:2/508: mkdir d4/d12/d1d/d34/db7 0 2024-03-12T16:10:41.717 INFO:tasks.workunit.client.1.smithi134.stdout:3/636: creat d1/db/d10/fe9 x:0 0 0 2024-03-12T16:10:41.719 INFO:tasks.workunit.client.1.smithi134.stdout:2/509: creat d4/d12/d1d/d34/d47/fb8 x:0 0 0 2024-03-12T16:10:41.721 INFO:tasks.workunit.client.1.smithi134.stdout:2/510: dread - d4/d12/d1d/f97 zero size 2024-03-12T16:10:41.721 INFO:tasks.workunit.client.1.smithi134.stdout:9/469: link d5/d10/d1f/l37 d5/d20/d72/l86 0 2024-03-12T16:10:41.724 INFO:tasks.workunit.client.1.smithi134.stdout:9/470: creat d5/d20/f87 x:0 0 0 2024-03-12T16:10:41.725 INFO:tasks.workunit.client.1.smithi134.stdout:2/511: rename d4/d12/d43/da2/l40 to d4/d12/daf/lb9 0 2024-03-12T16:10:41.726 INFO:tasks.workunit.client.1.smithi134.stdout:2/512: dread - d4/d12/d1d/f97 zero size 2024-03-12T16:10:41.728 INFO:tasks.workunit.client.1.smithi134.stdout:2/513: mkdir d4/d84/d63/d9d/dba 0 2024-03-12T16:10:41.729 INFO:tasks.workunit.client.1.smithi134.stdout:9/471: read d5/f7 [270702,90215] 0 2024-03-12T16:10:41.729 INFO:tasks.workunit.client.1.smithi134.stdout:2/514: chown d4/d12/d3b/d3f/fb5 600 1 2024-03-12T16:10:41.731 INFO:tasks.workunit.client.1.smithi134.stdout:2/515: write d4/f24 [4821793,130077] 0 2024-03-12T16:10:41.733 INFO:tasks.workunit.client.1.smithi134.stdout:9/472: mkdir d5/d10/d35/d49/d54/d88 0 2024-03-12T16:10:41.735 INFO:tasks.workunit.client.1.smithi134.stdout:9/473: symlink d5/d10/d35/d49/d54/d5e/d82/l89 0 2024-03-12T16:10:41.739 INFO:tasks.workunit.client.0.smithi006.stdout:5/206: truncate d7/d9/d31/d3b/f3f 982492 0 2024-03-12T16:10:41.739 INFO:tasks.workunit.client.1.smithi134.stdout:8/510: dread d3/d1b/d17/d25/f90 [0,4194304] 0 2024-03-12T16:10:41.741 INFO:tasks.workunit.client.1.smithi134.stdout:9/474: rmdir d5/d10/d35/d49/d74/d83 0 2024-03-12T16:10:41.742 INFO:tasks.workunit.client.1.smithi134.stdout:3/637: dread d1/db/d14/d5f/fbe [0,4194304] 0 2024-03-12T16:10:41.743 INFO:tasks.workunit.client.1.smithi134.stdout:9/475: chown d5/d10/d35/f61 44375089 1 2024-03-12T16:10:41.743 INFO:tasks.workunit.client.0.smithi006.stdout:9/313: write d0/d8/f52 [9274786,97818] 0 2024-03-12T16:10:41.745 INFO:tasks.workunit.client.0.smithi006.stdout:8/253: creat d2/db/f51 x:0 0 0 2024-03-12T16:10:41.747 INFO:tasks.workunit.client.1.smithi134.stdout:3/638: unlink d1/db/d14/f5d 0 2024-03-12T16:10:41.749 INFO:tasks.workunit.client.1.smithi134.stdout:8/511: truncate d3/d10/f7c 3044977 0 2024-03-12T16:10:41.751 INFO:tasks.workunit.client.0.smithi006.stdout:0/378: dwrite d2/d39/d42/f59 [0,4194304] 0 2024-03-12T16:10:41.751 INFO:tasks.workunit.client.0.smithi006.stdout:6/265: mkdir d3/d11/d10/d28/d45/d60 0 2024-03-12T16:10:41.752 INFO:tasks.workunit.client.1.smithi134.stdout:8/512: mkdir d3/d1b/d17/d25/d33/d15/d95/d5b/da7 0 2024-03-12T16:10:41.753 INFO:tasks.workunit.client.0.smithi006.stdout:6/266: fsync d3/f14 0 2024-03-12T16:10:41.757 INFO:tasks.workunit.client.0.smithi006.stdout:0/379: mknod d2/d6/d37/c6b 0 2024-03-12T16:10:41.757 INFO:tasks.workunit.client.0.smithi006.stdout:8/254: dread d2/db/d1a/f1c [0,4194304] 0 2024-03-12T16:10:41.757 INFO:tasks.workunit.client.1.smithi134.stdout:3/639: mkdir d1/db/d14/d5a/d89/dea 0 2024-03-12T16:10:41.758 INFO:tasks.workunit.client.1.smithi134.stdout:3/640: chown d1/db/c54 11914888 1 2024-03-12T16:10:41.760 INFO:tasks.workunit.client.0.smithi006.stdout:3/291: rename d8/d19/d47/l48 to d8/d19/d26/d59/d2c/dc/d28/d2f/l66 0 2024-03-12T16:10:41.761 INFO:tasks.workunit.client.1.smithi134.stdout:8/513: creat d3/d1b/d17/d25/d33/d15/d95/d4f/fa8 x:0 0 0 2024-03-12T16:10:41.763 INFO:tasks.workunit.client.0.smithi006.stdout:3/292: write d8/d19/d26/d59/d2c/dc/d28/d2f/f60 [642209,42044] 0 2024-03-12T16:10:41.765 INFO:tasks.workunit.client.0.smithi006.stdout:7/406: rename de/d27/d2b/l5a to de/d27/d2b/d4a/d6a/l8c 0 2024-03-12T16:10:41.765 INFO:tasks.workunit.client.0.smithi006.stdout:8/255: dread d2/db/d1a/d1f/f3c [0,4194304] 0 2024-03-12T16:10:41.766 INFO:tasks.workunit.client.1.smithi134.stdout:4/458: stat d1/d13/d49/d64/d28/d4f 0 2024-03-12T16:10:41.769 INFO:tasks.workunit.client.0.smithi006.stdout:5/207: rename d7/d9/fc to d7/d8/f48 0 2024-03-12T16:10:41.770 INFO:tasks.workunit.client.0.smithi006.stdout:7/407: fsync de/d18/f19 0 2024-03-12T16:10:41.770 INFO:tasks.workunit.client.1.smithi134.stdout:4/459: truncate d1/d13/d49/f65 2357381 0 2024-03-12T16:10:41.771 INFO:tasks.workunit.client.1.smithi134.stdout:8/514: mknod d3/d1b/d17/ca9 0 2024-03-12T16:10:41.772 INFO:tasks.workunit.client.0.smithi006.stdout:7/408: chown de/d27/d2b 892932158 1 2024-03-12T16:10:41.772 INFO:tasks.workunit.client.1.smithi134.stdout:1/390: write d0/d30/d86/f1d [3291,46236] 0 2024-03-12T16:10:41.772 INFO:tasks.workunit.client.1.smithi134.stdout:1/391: chown d0 17 1 2024-03-12T16:10:41.772 INFO:tasks.workunit.client.1.smithi134.stdout:3/641: mknod d1/db/d10/d2a/dc6/ddb/ceb 0 2024-03-12T16:10:41.774 INFO:tasks.workunit.client.0.smithi006.stdout:6/267: rename d3/d11/d10/f32 to d3/d11/d10/d28/d45/d60/f61 0 2024-03-12T16:10:41.774 INFO:tasks.workunit.client.1.smithi134.stdout:9/476: truncate d5/d10/d1f/f24 864134 0 2024-03-12T16:10:41.775 INFO:tasks.workunit.client.1.smithi134.stdout:4/460: chown d1/d13/d49/d6d/c5d 250 1 2024-03-12T16:10:41.775 INFO:tasks.workunit.client.1.smithi134.stdout:8/515: mknod d3/d1b/d17/d45/caa 0 2024-03-12T16:10:41.775 INFO:tasks.workunit.client.1.smithi134.stdout:1/392: write d0/d16/d9/d13/d38/f75 [3332,98715] 0 2024-03-12T16:10:41.777 INFO:tasks.workunit.client.0.smithi006.stdout:3/293: creat d8/d19/d26/d59/d2c/f67 x:0 0 0 2024-03-12T16:10:41.778 INFO:tasks.workunit.client.1.smithi134.stdout:4/461: rmdir d1/d24 39 2024-03-12T16:10:41.778 INFO:tasks.workunit.client.0.smithi006.stdout:5/208: mknod d7/d9/d10/c49 0 2024-03-12T16:10:41.780 INFO:tasks.workunit.client.1.smithi134.stdout:8/516: chown d3/d1b/d17/d3f/l7b 4558241 1 2024-03-12T16:10:41.781 INFO:tasks.workunit.client.0.smithi006.stdout:7/409: rename de/d18/d2a/d39/c45 to de/d1c/d35/c8d 0 2024-03-12T16:10:41.782 INFO:tasks.workunit.client.0.smithi006.stdout:6/268: mknod d3/d11/d10/d19/c62 0 2024-03-12T16:10:41.783 INFO:tasks.workunit.client.0.smithi006.stdout:8/256: link d2/db/d1a/d21/d2b/f40 d2/db/d1a/d1f/f52 0 2024-03-12T16:10:41.785 INFO:tasks.workunit.client.0.smithi006.stdout:3/294: mknod d8/d52/c68 0 2024-03-12T16:10:41.785 INFO:tasks.workunit.client.1.smithi134.stdout:1/393: creat d0/d16/d9/d13/d21/d5f/d6f/f87 x:0 0 0 2024-03-12T16:10:41.785 INFO:tasks.workunit.client.0.smithi006.stdout:8/257: write d2/f19 [4218056,35497] 0 2024-03-12T16:10:41.787 INFO:tasks.workunit.client.1.smithi134.stdout:3/642: dwrite d1/db/d12/f7a [0,4194304] 0 2024-03-12T16:10:41.787 INFO:tasks.workunit.client.0.smithi006.stdout:7/410: mknod de/d27/d2b/d4a/c8e 0 2024-03-12T16:10:41.787 INFO:tasks.workunit.client.1.smithi134.stdout:2/516: dread d4/d12/d43/f76 [0,4194304] 0 2024-03-12T16:10:41.788 INFO:tasks.workunit.client.0.smithi006.stdout:5/209: mknod d7/d41/c4a 0 2024-03-12T16:10:41.789 INFO:tasks.workunit.client.0.smithi006.stdout:8/258: symlink d2/d11/l53 0 2024-03-12T16:10:41.789 INFO:tasks.workunit.client.0.smithi006.stdout:7/411: stat de/d1c/d35/c3a 0 2024-03-12T16:10:41.791 INFO:tasks.workunit.client.0.smithi006.stdout:6/269: dwrite d3/d11/f31 [0,4194304] 0 2024-03-12T16:10:41.791 INFO:tasks.workunit.client.1.smithi134.stdout:2/517: chown d4/d12/d1d/d34/d58/f93 211469 1 2024-03-12T16:10:41.792 INFO:tasks.workunit.client.1.smithi134.stdout:8/517: mknod d3/d1b/d17/d25/d33/d15/d95/d4f/d65/cab 0 2024-03-12T16:10:41.794 INFO:tasks.workunit.client.1.smithi134.stdout:9/477: dwrite d5/d20/d47/d69/f75 [4194304,4194304] 0 2024-03-12T16:10:41.794 INFO:tasks.workunit.client.0.smithi006.stdout:8/259: unlink d2/db/d1a/d23/f45 0 2024-03-12T16:10:41.796 INFO:tasks.workunit.client.1.smithi134.stdout:2/518: fdatasync d4/d84/fa8 0 2024-03-12T16:10:41.796 INFO:tasks.workunit.client.1.smithi134.stdout:3/643: mkdir d1/db/d12/d9d/dc5/dec 0 2024-03-12T16:10:41.796 INFO:tasks.workunit.client.0.smithi006.stdout:7/412: truncate de/d27/f56 1219655 0 2024-03-12T16:10:41.796 INFO:tasks.workunit.client.0.smithi006.stdout:6/270: fsync d3/d11/d10/d28/d45/f55 0 2024-03-12T16:10:41.797 INFO:tasks.workunit.client.0.smithi006.stdout:8/260: write d2/db/d1a/f26 [307152,15970] 0 2024-03-12T16:10:41.797 INFO:tasks.workunit.client.0.smithi006.stdout:7/413: write de/d1c/f25 [2398918,76563] 0 2024-03-12T16:10:41.799 INFO:tasks.workunit.client.0.smithi006.stdout:6/271: write d3/d11/f31 [1809368,97033] 0 2024-03-12T16:10:41.799 INFO:tasks.workunit.client.0.smithi006.stdout:7/414: fsync de/d27/d2b/f57 0 2024-03-12T16:10:41.803 INFO:tasks.workunit.client.0.smithi006.stdout:7/415: stat de/d18/d2a/d40/f60 0 2024-03-12T16:10:41.804 INFO:tasks.workunit.client.1.smithi134.stdout:9/478: symlink d5/d20/d47/d69/l8a 0 2024-03-12T16:10:41.804 INFO:tasks.workunit.client.1.smithi134.stdout:3/644: mknod d1/db/d12/d9d/dc5/ced 0 2024-03-12T16:10:41.805 INFO:tasks.workunit.client.0.smithi006.stdout:6/272: symlink d3/l63 0 2024-03-12T16:10:41.805 INFO:tasks.workunit.client.1.smithi134.stdout:2/519: dread - d4/d84/f55 zero size 2024-03-12T16:10:41.806 INFO:tasks.workunit.client.0.smithi006.stdout:7/416: symlink de/d27/d7c/l8f 0 2024-03-12T16:10:41.808 INFO:tasks.workunit.client.1.smithi134.stdout:4/462: truncate d1/d24/d34/f97 532802 0 2024-03-12T16:10:41.811 INFO:tasks.workunit.client.1.smithi134.stdout:8/518: link d3/d1b/d17/d25/d33/d15/d95/d4f/d65/cab d3/d10/cac 0 2024-03-12T16:10:41.811 INFO:tasks.workunit.client.1.smithi134.stdout:2/520: truncate d4/d12/d39/f9f 519801 0 2024-03-12T16:10:41.812 INFO:tasks.workunit.client.0.smithi006.stdout:6/273: creat d3/d11/d10/d1b/d20/d5a/f64 x:0 0 0 2024-03-12T16:10:41.812 INFO:tasks.workunit.client.1.smithi134.stdout:9/479: symlink d5/d10/d35/d49/d54/d88/l8b 0 2024-03-12T16:10:41.813 INFO:tasks.workunit.client.0.smithi006.stdout:6/274: chown d3/d11/d10/d28 426406535 1 2024-03-12T16:10:41.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/463: creat d1/de/f9a x:0 0 0 2024-03-12T16:10:41.813 INFO:tasks.workunit.client.1.smithi134.stdout:8/519: mkdir d3/d10/dad 0 2024-03-12T16:10:41.815 INFO:tasks.workunit.client.0.smithi006.stdout:6/275: creat d3/d11/d10/d19/f65 x:0 0 0 2024-03-12T16:10:41.816 INFO:tasks.workunit.client.1.smithi134.stdout:9/480: creat d5/d10/d35/d49/f8c x:0 0 0 2024-03-12T16:10:41.816 INFO:tasks.workunit.client.0.smithi006.stdout:6/276: write d3/d11/d10/d1b/d20/d26/f34 [1847615,106364] 0 2024-03-12T16:10:41.817 INFO:tasks.workunit.client.1.smithi134.stdout:4/464: symlink d1/de/d5a/d70/l9b 0 2024-03-12T16:10:41.818 INFO:tasks.workunit.client.0.smithi006.stdout:3/295: read d8/d19/d26/d59/d2c/f20 [3422607,7814] 0 2024-03-12T16:10:41.820 INFO:tasks.workunit.client.0.smithi006.stdout:6/277: unlink d3/d11/d10/f35 0 2024-03-12T16:10:41.822 INFO:tasks.workunit.client.0.smithi006.stdout:6/278: chown d3/d11/d10/d1b/d20/d26/l3a 7 1 2024-03-12T16:10:41.823 INFO:tasks.workunit.client.0.smithi006.stdout:6/279: dread - d3/d11/d10/d19/f65 zero size 2024-03-12T16:10:41.823 INFO:tasks.workunit.client.0.smithi006.stdout:3/296: dread - d8/d19/d26/d59/d2c/d41/f62 zero size 2024-03-12T16:10:41.825 INFO:tasks.workunit.client.0.smithi006.stdout:3/297: readlink d8/d19/d26/d59/l44 0 2024-03-12T16:10:41.825 INFO:tasks.workunit.client.0.smithi006.stdout:6/280: symlink d3/d11/d10/d1b/l66 0 2024-03-12T16:10:41.827 INFO:tasks.workunit.client.0.smithi006.stdout:3/298: creat d8/d19/d31/f69 x:0 0 0 2024-03-12T16:10:41.832 INFO:tasks.workunit.client.0.smithi006.stdout:6/281: truncate d3/d11/d10/d1b/d20/d26/f34 2988712 0 2024-03-12T16:10:41.834 INFO:tasks.workunit.client.0.smithi006.stdout:5/210: dwrite d7/d9/d10/f1b [4194304,4194304] 0 2024-03-12T16:10:41.837 INFO:tasks.workunit.client.0.smithi006.stdout:6/282: read - d3/d11/d10/d1b/d20/d26/f57 zero size 2024-03-12T16:10:41.837 INFO:tasks.workunit.client.0.smithi006.stdout:5/211: chown d7/d41/c4a 7317 1 2024-03-12T16:10:41.839 INFO:tasks.workunit.client.0.smithi006.stdout:7/417: dwrite f6 [4194304,4194304] 0 2024-03-12T16:10:41.845 INFO:tasks.workunit.client.0.smithi006.stdout:5/212: symlink d7/d9/d31/l4b 0 2024-03-12T16:10:41.846 INFO:tasks.workunit.client.0.smithi006.stdout:3/299: dwrite d8/d19/d26/d59/d2c/dc/d28/f2b [0,4194304] 0 2024-03-12T16:10:41.850 INFO:tasks.workunit.client.0.smithi006.stdout:5/213: truncate d7/d9/d10/f39 744597 0 2024-03-12T16:10:41.851 INFO:tasks.workunit.client.0.smithi006.stdout:7/418: dwrite de/d27/f56 [0,4194304] 0 2024-03-12T16:10:41.852 INFO:tasks.workunit.client.0.smithi006.stdout:5/214: dread - d7/d9/d10/d24/f37 zero size 2024-03-12T16:10:41.853 INFO:tasks.workunit.client.0.smithi006.stdout:6/283: dread d3/d11/fd [0,4194304] 0 2024-03-12T16:10:41.858 INFO:tasks.workunit.client.0.smithi006.stdout:5/215: creat d7/d8/f4c x:0 0 0 2024-03-12T16:10:41.859 INFO:tasks.workunit.client.0.smithi006.stdout:3/300: link d8/d19/d26/d59/d2c/f20 d8/d19/d26/d59/d2c/dc/d28/f6a 0 2024-03-12T16:10:41.860 INFO:tasks.workunit.client.0.smithi006.stdout:6/284: rename d3/d11/d10/d1b/d20/f36 to d3/d11/d10/d19/f67 0 2024-03-12T16:10:41.863 INFO:tasks.workunit.client.0.smithi006.stdout:5/216: creat d7/d8/f4d x:0 0 0 2024-03-12T16:10:41.864 INFO:tasks.workunit.client.0.smithi006.stdout:6/285: creat d3/d11/d10/d1b/d20/f68 x:0 0 0 2024-03-12T16:10:41.865 INFO:tasks.workunit.client.0.smithi006.stdout:6/286: chown d3/d47 778060 1 2024-03-12T16:10:41.865 INFO:tasks.workunit.client.0.smithi006.stdout:3/301: truncate f1 707484 0 2024-03-12T16:10:41.866 INFO:tasks.workunit.client.0.smithi006.stdout:5/217: mknod d7/d9/d31/d3b/c4e 0 2024-03-12T16:10:41.867 INFO:tasks.workunit.client.0.smithi006.stdout:3/302: chown d8/d19/d26/d59/d2c/d41/d45 62884890 1 2024-03-12T16:10:41.867 INFO:tasks.workunit.client.0.smithi006.stdout:5/218: fdatasync d7/f2f 0 2024-03-12T16:10:41.871 INFO:tasks.workunit.client.0.smithi006.stdout:6/287: dread d3/d11/d10/f42 [0,4194304] 0 2024-03-12T16:10:41.872 INFO:tasks.workunit.client.0.smithi006.stdout:5/219: mkdir d7/d9/d31/d3b/d4f 0 2024-03-12T16:10:41.873 INFO:tasks.workunit.client.0.smithi006.stdout:6/288: dread - d3/d11/d43/f5b zero size 2024-03-12T16:10:41.873 INFO:tasks.workunit.client.0.smithi006.stdout:5/220: stat d7/d9/d10/d24/f37 0 2024-03-12T16:10:41.874 INFO:tasks.workunit.client.0.smithi006.stdout:3/303: dread d8/d19/d26/d59/d2c/dc/d28/f29 [0,4194304] 0 2024-03-12T16:10:41.876 INFO:tasks.workunit.client.0.smithi006.stdout:6/289: mknod d3/d11/d43/c69 0 2024-03-12T16:10:41.877 INFO:tasks.workunit.client.0.smithi006.stdout:6/290: chown d3/d11/d43/f46 3 1 2024-03-12T16:10:41.877 INFO:tasks.workunit.client.1.smithi134.stdout:3/645: dwrite d1/db/d14/d5f/fe5 [0,4194304] 0 2024-03-12T16:10:41.878 INFO:tasks.workunit.client.1.smithi134.stdout:8/520: rename d3/d1b/d17/d45/c61 to d3/d1b/d17/d45/cae 0 2024-03-12T16:10:41.880 INFO:tasks.workunit.client.0.smithi006.stdout:2/358: sync 2024-03-12T16:10:41.880 INFO:tasks.workunit.client.0.smithi006.stdout:4/374: sync 2024-03-12T16:10:41.881 INFO:tasks.workunit.client.0.smithi006.stdout:7/419: write de/f17 [664384,16570] 0 2024-03-12T16:10:41.882 INFO:tasks.workunit.client.1.smithi134.stdout:4/465: write d1/d13/d49/d64/d28/d4f/d67/f86 [1048124,113775] 0 2024-03-12T16:10:41.884 INFO:tasks.workunit.client.1.smithi134.stdout:4/466: write d1/d13/d49/d64/f87 [4821219,96951] 0 2024-03-12T16:10:41.885 INFO:tasks.workunit.client.0.smithi006.stdout:2/359: chown d0/d13/c4c 592402 1 2024-03-12T16:10:41.885 INFO:tasks.workunit.client.0.smithi006.stdout:6/291: rename d3/d11/d10/f2a to d3/d11/d10/d19/f6a 0 2024-03-12T16:10:41.888 INFO:tasks.workunit.client.1.smithi134.stdout:3/646: unlink d1/db/d10/d2d/d2e/c39 0 2024-03-12T16:10:41.889 INFO:tasks.workunit.client.1.smithi134.stdout:3/647: chown d1/db/d12/f7a 2888258 1 2024-03-12T16:10:41.890 INFO:tasks.workunit.client.0.smithi006.stdout:4/375: creat d1/db/d39/f73 x:0 0 0 2024-03-12T16:10:41.891 INFO:tasks.workunit.client.0.smithi006.stdout:4/376: readlink d1/db/d1d/d2f/l41 0 2024-03-12T16:10:41.893 INFO:tasks.workunit.client.0.smithi006.stdout:7/420: truncate de/d18/f70 3098381 0 2024-03-12T16:10:41.894 INFO:tasks.workunit.client.1.smithi134.stdout:9/481: rename d5/d20/d47/d69 to d5/d10/d35/d49/d8d 0 2024-03-12T16:10:41.897 INFO:tasks.workunit.client.1.smithi134.stdout:4/467: dwrite d1/d13/d49/d64/f87 [0,4194304] 0 2024-03-12T16:10:41.898 INFO:tasks.workunit.client.0.smithi006.stdout:4/377: dread d1/db/d1d/f49 [0,4194304] 0 2024-03-12T16:10:41.899 INFO:tasks.workunit.client.0.smithi006.stdout:7/421: symlink de/d2c/d4f/d83/l90 0 2024-03-12T16:10:41.900 INFO:tasks.workunit.client.1.smithi134.stdout:4/468: dread - d1/d13/f7c zero size 2024-03-12T16:10:41.900 INFO:tasks.workunit.client.1.smithi134.stdout:8/521: rename d3/d1b/d17/d25/d33/d15/d95/d4f/f67 to d3/d1b/d17/d3f/faf 0 2024-03-12T16:10:41.902 INFO:tasks.workunit.client.1.smithi134.stdout:9/482: write d5/d10/d1f/f6e [75349,20247] 0 2024-03-12T16:10:41.904 INFO:tasks.workunit.client.1.smithi134.stdout:3/648: truncate d1/db/d14/fd4 2348857 0 2024-03-12T16:10:41.904 INFO:tasks.workunit.client.1.smithi134.stdout:4/469: read - d1/de/f82 zero size 2024-03-12T16:10:41.904 INFO:tasks.workunit.client.0.smithi006.stdout:7/422: fsync de/d27/d2b/d4a/d6a/f79 0 2024-03-12T16:10:41.904 INFO:tasks.workunit.client.1.smithi134.stdout:1/394: dread d0/d16/f14 [0,4194304] 0 2024-03-12T16:10:41.905 INFO:tasks.workunit.client.0.smithi006.stdout:4/378: creat d1/db/d17/f74 x:0 0 0 2024-03-12T16:10:41.906 INFO:tasks.workunit.client.1.smithi134.stdout:8/522: mkdir d3/db0 0 2024-03-12T16:10:41.907 INFO:tasks.workunit.client.1.smithi134.stdout:3/649: chown d1/db/d14/d5f/fbe 59628 1 2024-03-12T16:10:41.908 INFO:tasks.workunit.client.1.smithi134.stdout:4/470: dread d1/de/f3c [4194304,4194304] 0 2024-03-12T16:10:41.908 INFO:tasks.workunit.client.0.smithi006.stdout:5/221: dread d7/d8/f48 [0,4194304] 0 2024-03-12T16:10:41.909 INFO:tasks.workunit.client.1.smithi134.stdout:3/650: readlink d1/db/d10/daf/ldd 0 2024-03-12T16:10:41.909 INFO:tasks.workunit.client.1.smithi134.stdout:9/483: write d5/d10/d35/d49/d54/d5e/f71 [929515,63369] 0 2024-03-12T16:10:41.910 INFO:tasks.workunit.client.1.smithi134.stdout:1/395: mknod d0/d16/d9/d13/d21/c88 0 2024-03-12T16:10:41.910 INFO:tasks.workunit.client.0.smithi006.stdout:5/222: readlink d7/d8/l1d 0 2024-03-12T16:10:41.911 INFO:tasks.workunit.client.0.smithi006.stdout:6/292: dread d3/f14 [0,4194304] 0 2024-03-12T16:10:41.912 INFO:tasks.workunit.client.1.smithi134.stdout:8/523: readlink d3/d1b/d17/d25/d33/d15/d95/d4f/l44 0 2024-03-12T16:10:41.912 INFO:tasks.workunit.client.0.smithi006.stdout:4/379: creat d1/db/d39/d42/d61/f75 x:0 0 0 2024-03-12T16:10:41.914 INFO:tasks.workunit.client.0.smithi006.stdout:4/380: fsync d1/db/d17/f1e 0 2024-03-12T16:10:41.915 INFO:tasks.workunit.client.0.smithi006.stdout:5/223: truncate d7/d8/f4d 659300 0 2024-03-12T16:10:41.916 INFO:tasks.workunit.client.0.smithi006.stdout:4/381: read - d1/db/f40 zero size 2024-03-12T16:10:41.917 INFO:tasks.workunit.client.0.smithi006.stdout:6/293: write d3/d11/d10/d1b/f3f [3515552,635] 0 2024-03-12T16:10:41.917 INFO:tasks.workunit.client.1.smithi134.stdout:9/484: unlink d5/d10/f32 0 2024-03-12T16:10:41.918 INFO:tasks.workunit.client.0.smithi006.stdout:3/304: dwrite d8/d19/d26/d59/d2c/f13 [0,4194304] 0 2024-03-12T16:10:41.919 INFO:tasks.workunit.client.0.smithi006.stdout:5/224: write d7/d9/f20 [3356036,12836] 0 2024-03-12T16:10:41.919 INFO:tasks.workunit.client.0.smithi006.stdout:6/294: fdatasync d3/f14 0 2024-03-12T16:10:41.920 INFO:tasks.workunit.client.1.smithi134.stdout:8/524: mknod d3/d1b/d17/cb1 0 2024-03-12T16:10:41.920 INFO:tasks.workunit.client.1.smithi134.stdout:4/471: dwrite d1/de/d5a/d84/f85 [0,4194304] 0 2024-03-12T16:10:41.925 INFO:tasks.workunit.client.1.smithi134.stdout:3/651: dwrite d1/db/d10/d2d/d30/fc9 [0,4194304] 0 2024-03-12T16:10:41.925 INFO:tasks.workunit.client.1.smithi134.stdout:9/485: creat d5/d10/d35/d49/d54/d5e/d82/f8e x:0 0 0 2024-03-12T16:10:41.927 INFO:tasks.workunit.client.0.smithi006.stdout:6/295: mknod d3/d11/d3b/d5d/c6b 0 2024-03-12T16:10:41.930 INFO:tasks.workunit.client.1.smithi134.stdout:4/472: chown d1/d24/d34/f88 76557 1 2024-03-12T16:10:41.931 INFO:tasks.workunit.client.1.smithi134.stdout:8/525: rename d3/d1b/d17/d3f/l7b to d3/d1b/d17/d25/d33/d15/d95/d6d/da0/lb2 0 2024-03-12T16:10:41.932 INFO:tasks.workunit.client.0.smithi006.stdout:6/296: unlink d3/fc 0 2024-03-12T16:10:41.933 INFO:tasks.workunit.client.1.smithi134.stdout:3/652: chown d1/db/d10/d2d/d2e/d72/d97/le1 757 1 2024-03-12T16:10:41.934 INFO:tasks.workunit.client.1.smithi134.stdout:4/473: creat d1/d13/d49/d64/d28/d4f/f9c x:0 0 0 2024-03-12T16:10:41.935 INFO:tasks.workunit.client.1.smithi134.stdout:5/582: sync 2024-03-12T16:10:41.936 INFO:tasks.workunit.client.0.smithi006.stdout:5/225: symlink d7/d9/d31/d3b/d4f/l50 0 2024-03-12T16:10:41.936 INFO:tasks.workunit.client.1.smithi134.stdout:9/486: symlink d5/d10/l8f 0 2024-03-12T16:10:41.938 INFO:tasks.workunit.client.0.smithi006.stdout:7/423: dread de/d27/f69 [0,4194304] 0 2024-03-12T16:10:41.939 INFO:tasks.workunit.client.1.smithi134.stdout:3/653: unlink d1/db/d10/d2d/d2e/d72/d97/fa8 0 2024-03-12T16:10:41.939 INFO:tasks.workunit.client.0.smithi006.stdout:5/226: mknod d7/d9/d10/d24/c51 0 2024-03-12T16:10:41.940 INFO:tasks.workunit.client.1.smithi134.stdout:3/654: dread - d1/db/d12/d9d/fb3 zero size 2024-03-12T16:10:41.941 INFO:tasks.workunit.client.0.smithi006.stdout:6/297: symlink d3/d11/d10/d19/l6c 0 2024-03-12T16:10:41.943 INFO:tasks.workunit.client.0.smithi006.stdout:4/382: dwrite d1/db/d17/d5a/f62 [0,4194304] 0 2024-03-12T16:10:41.947 INFO:tasks.workunit.client.0.smithi006.stdout:6/298: write d3/d11/d10/d28/d45/f55 [149331,5658] 0 2024-03-12T16:10:41.948 INFO:tasks.workunit.client.0.smithi006.stdout:3/305: dwrite d8/d19/d26/d59/f1a [0,4194304] 0 2024-03-12T16:10:41.951 INFO:tasks.workunit.client.1.smithi134.stdout:3/655: creat d1/db/d10/d2d/d30/fee x:0 0 0 2024-03-12T16:10:41.951 INFO:tasks.workunit.client.1.smithi134.stdout:4/474: dwrite d1/d13/d49/d64/d28/d4f/d67/f95 [0,4194304] 0 2024-03-12T16:10:41.953 INFO:tasks.workunit.client.0.smithi006.stdout:4/383: getdents d1/db/d17 0 2024-03-12T16:10:41.956 INFO:tasks.workunit.client.0.smithi006.stdout:5/227: dwrite d7/d9/d31/f2e [0,4194304] 0 2024-03-12T16:10:41.956 INFO:tasks.workunit.client.1.smithi134.stdout:5/583: dwrite db/d12/d37/f39 [0,4194304] 0 2024-03-12T16:10:41.956 INFO:tasks.workunit.client.1.smithi134.stdout:8/526: creat d3/d1b/d17/d25/fb3 x:0 0 0 2024-03-12T16:10:41.958 INFO:tasks.workunit.client.0.smithi006.stdout:6/299: symlink d3/d11/d10/d28/l6d 0 2024-03-12T16:10:41.960 INFO:tasks.workunit.client.0.smithi006.stdout:4/384: mknod d1/db/d39/d42/d61/c76 0 2024-03-12T16:10:41.965 INFO:tasks.workunit.client.0.smithi006.stdout:5/228: chown d7/d8/l1f 26835519 1 2024-03-12T16:10:41.966 INFO:tasks.workunit.client.1.smithi134.stdout:3/656: mkdir d1/db/d10/d2d/d2e/d72/def 0 2024-03-12T16:10:41.966 INFO:tasks.workunit.client.1.smithi134.stdout:5/584: symlink db/d7d/lbc 0 2024-03-12T16:10:41.968 INFO:tasks.workunit.client.0.smithi006.stdout:7/424: dread f3 [0,4194304] 0 2024-03-12T16:10:41.969 INFO:tasks.workunit.client.0.smithi006.stdout:3/306: dwrite d8/d19/f64 [0,4194304] 0 2024-03-12T16:10:41.969 INFO:tasks.workunit.client.0.smithi006.stdout:4/385: write d1/db/d1d/f5e [1176158,71432] 0 2024-03-12T16:10:41.974 INFO:tasks.workunit.client.0.smithi006.stdout:4/386: dread - d1/db/d39/d42/d61/f75 zero size 2024-03-12T16:10:41.975 INFO:tasks.workunit.client.1.smithi134.stdout:3/657: unlink d1/d63/d6c/dbf/fde 0 2024-03-12T16:10:41.976 INFO:tasks.workunit.client.0.smithi006.stdout:5/229: read d7/f2f [809381,35750] 0 2024-03-12T16:10:41.980 INFO:tasks.workunit.client.0.smithi006.stdout:3/307: rename d8/d19/f5c to d8/d19/f6b 0 2024-03-12T16:10:41.980 INFO:tasks.workunit.client.0.smithi006.stdout:6/300: dwrite d3/f14 [0,4194304] 0 2024-03-12T16:10:41.983 INFO:tasks.workunit.client.1.smithi134.stdout:4/475: creat d1/d13/d49/d64/d28/f9d x:0 0 0 2024-03-12T16:10:41.983 INFO:tasks.workunit.client.1.smithi134.stdout:8/527: mknod d3/d1b/d17/d25/d33/d15/d95/d6d/cb4 0 2024-03-12T16:10:41.985 INFO:tasks.workunit.client.0.smithi006.stdout:3/308: mkdir d8/d52/d6c 0 2024-03-12T16:10:41.985 INFO:tasks.workunit.client.1.smithi134.stdout:8/528: read d3/d1b/d17/d25/d33/d15/d95/d6d/f80 [186469,67113] 0 2024-03-12T16:10:41.985 INFO:tasks.workunit.client.0.smithi006.stdout:5/230: write d7/d9/d10/d24/f3d [158391,38293] 0 2024-03-12T16:10:41.986 INFO:tasks.workunit.client.0.smithi006.stdout:7/425: dwrite de/d1c/f75 [0,4194304] 0 2024-03-12T16:10:41.986 INFO:tasks.workunit.client.0.smithi006.stdout:4/387: read d1/db/d17/f32 [6238529,42589] 0 2024-03-12T16:10:41.989 INFO:tasks.workunit.client.1.smithi134.stdout:3/658: rmdir d1/db/d10/d2d/d2e/d72/def 0 2024-03-12T16:10:41.990 INFO:tasks.workunit.client.0.smithi006.stdout:4/388: fsync d1/db/d1d/f5d 0 2024-03-12T16:10:41.991 INFO:tasks.workunit.client.1.smithi134.stdout:5/585: dwrite db/d12/d1d/f89 [0,4194304] 0 2024-03-12T16:10:41.991 INFO:tasks.workunit.client.1.smithi134.stdout:9/487: truncate d5/d10/d35/f61 3428366 0 2024-03-12T16:10:41.991 INFO:tasks.workunit.client.1.smithi134.stdout:5/586: fsync db/f58 0 2024-03-12T16:10:41.994 INFO:tasks.workunit.client.0.smithi006.stdout:6/301: unlink d3/d11/d10/d28/d45/f58 0 2024-03-12T16:10:41.996 INFO:tasks.workunit.client.1.smithi134.stdout:9/488: dread - d5/d10/d35/d49/d8d/f84 zero size 2024-03-12T16:10:41.997 INFO:tasks.workunit.client.0.smithi006.stdout:7/426: fdatasync de/d18/f70 0 2024-03-12T16:10:41.997 INFO:tasks.workunit.client.1.smithi134.stdout:9/489: creat d5/d10/d51/f90 x:0 0 0 2024-03-12T16:10:42.000 INFO:tasks.workunit.client.1.smithi134.stdout:9/490: symlink d5/d10/l91 0 2024-03-12T16:10:42.000 INFO:tasks.workunit.client.1.smithi134.stdout:9/491: fsync d5/d10/f81 0 2024-03-12T16:10:42.001 INFO:tasks.workunit.client.1.smithi134.stdout:5/587: dread db/d7d/f8d [0,4194304] 0 2024-03-12T16:10:42.002 INFO:tasks.workunit.client.0.smithi006.stdout:7/427: creat de/d7b/f91 x:0 0 0 2024-03-12T16:10:42.002 INFO:tasks.workunit.client.0.smithi006.stdout:5/231: symlink d7/d9/d10/d24/l52 0 2024-03-12T16:10:42.003 INFO:tasks.workunit.client.0.smithi006.stdout:3/309: dwrite d8/d19/d31/f35 [0,4194304] 0 2024-03-12T16:10:42.005 INFO:tasks.workunit.client.0.smithi006.stdout:6/302: rename d3/d11/d10/d1b/d20/d26 to d3/d11/d10/d1b/d6e 0 2024-03-12T16:10:42.006 INFO:tasks.workunit.client.0.smithi006.stdout:5/232: fsync d7/d9/d10/f1b 0 2024-03-12T16:10:42.007 INFO:tasks.workunit.client.1.smithi134.stdout:9/492: creat d5/d10/d35/d49/d54/d5e/d82/f92 x:0 0 0 2024-03-12T16:10:42.007 INFO:tasks.workunit.client.1.smithi134.stdout:9/493: chown d5/d10/d35/d49/d54/f80 31980 1 2024-03-12T16:10:42.009 INFO:tasks.workunit.client.0.smithi006.stdout:6/303: chown d3/d11/d43/f5b 21 1 2024-03-12T16:10:42.009 INFO:tasks.workunit.client.0.smithi006.stdout:3/310: mknod d8/d19/d26/d59/d5b/c6d 0 2024-03-12T16:10:42.009 INFO:tasks.workunit.client.0.smithi006.stdout:4/389: dwrite d1/db/d39/d42/d61/f75 [0,4194304] 0 2024-03-12T16:10:42.010 INFO:tasks.workunit.client.0.smithi006.stdout:5/233: read - d7/d9/d10/d24/f37 zero size 2024-03-12T16:10:42.014 INFO:tasks.workunit.client.0.smithi006.stdout:5/234: unlink d7/d9/l1c 0 2024-03-12T16:10:42.015 INFO:tasks.workunit.client.1.smithi134.stdout:5/588: getdents db/d12/d37/d71/d90 0 2024-03-12T16:10:42.015 INFO:tasks.workunit.client.1.smithi134.stdout:9/494: dread d5/d10/d1f/f43 [0,4194304] 0 2024-03-12T16:10:42.017 INFO:tasks.workunit.client.0.smithi006.stdout:6/304: symlink d3/d11/d10/d1b/l6f 0 2024-03-12T16:10:42.017 INFO:tasks.workunit.client.1.smithi134.stdout:5/589: symlink db/d12/d1d/d3a/d4e/lbd 0 2024-03-12T16:10:42.018 INFO:tasks.workunit.client.0.smithi006.stdout:6/305: stat d3/d11/d10/d1b/d20/l37 0 2024-03-12T16:10:42.019 INFO:tasks.workunit.client.1.smithi134.stdout:9/495: mkdir d5/d10/d35/d49/d54/d93 0 2024-03-12T16:10:42.019 INFO:tasks.workunit.client.1.smithi134.stdout:5/590: readlink db/d12/d37/d73/l8f 0 2024-03-12T16:10:42.021 INFO:tasks.workunit.client.0.smithi006.stdout:3/311: creat d8/d19/d26/d59/d2c/d41/f6e x:0 0 0 2024-03-12T16:10:42.021 INFO:tasks.workunit.client.0.smithi006.stdout:5/235: dread d7/d9/d10/f1b [4194304,4194304] 0 2024-03-12T16:10:42.022 INFO:tasks.workunit.client.0.smithi006.stdout:6/306: write d3/d11/d10/d1b/d20/d5a/f64 [978656,29150] 0 2024-03-12T16:10:42.022 INFO:tasks.workunit.client.1.smithi134.stdout:5/591: creat db/d12/d1d/d3a/d49/fbe x:0 0 0 2024-03-12T16:10:42.022 INFO:tasks.workunit.client.1.smithi134.stdout:9/496: read d5/d20/d72/f7a [3324004,66653] 0 2024-03-12T16:10:42.024 INFO:tasks.workunit.client.1.smithi134.stdout:5/592: creat db/d12/d1d/d59/fbf x:0 0 0 2024-03-12T16:10:42.024 INFO:tasks.workunit.client.0.smithi006.stdout:5/236: unlink d7/c17 0 2024-03-12T16:10:42.025 INFO:tasks.workunit.client.1.smithi134.stdout:9/497: symlink d5/d10/d6c/l94 0 2024-03-12T16:10:42.025 INFO:tasks.workunit.client.0.smithi006.stdout:3/312: symlink d8/d19/d26/d59/d2c/d41/l6f 0 2024-03-12T16:10:42.026 INFO:tasks.workunit.client.1.smithi134.stdout:5/593: write db/d12/d1d/d3a/f88 [3664412,68682] 0 2024-03-12T16:10:42.027 INFO:tasks.workunit.client.0.smithi006.stdout:5/237: unlink d7/d8/lf 0 2024-03-12T16:10:42.029 INFO:tasks.workunit.client.1.smithi134.stdout:9/498: creat d5/d10/f95 x:0 0 0 2024-03-12T16:10:42.030 INFO:tasks.workunit.client.1.smithi134.stdout:9/499: fsync d5/d20/f87 0 2024-03-12T16:10:42.031 INFO:tasks.workunit.client.1.smithi134.stdout:4/476: dread d1/d13/d49/d64/d28/f3f [0,4194304] 0 2024-03-12T16:10:42.033 INFO:tasks.workunit.client.1.smithi134.stdout:4/477: fsync d1/d13/f39 0 2024-03-12T16:10:42.034 INFO:tasks.workunit.client.1.smithi134.stdout:9/500: rename d5/c67 to d5/d20/d72/c96 0 2024-03-12T16:10:42.042 INFO:tasks.workunit.client.1.smithi134.stdout:9/501: dwrite d5/d20/d72/f7a [4194304,4194304] 0 2024-03-12T16:10:42.045 INFO:tasks.workunit.client.1.smithi134.stdout:9/502: creat d5/d10/d51/f97 x:0 0 0 2024-03-12T16:10:42.048 INFO:tasks.workunit.client.1.smithi134.stdout:9/503: chown d5/d10/d35/f61 1001 1 2024-03-12T16:10:42.050 INFO:tasks.workunit.client.1.smithi134.stdout:9/504: chown d5/cf 12247 1 2024-03-12T16:10:42.056 INFO:tasks.workunit.client.1.smithi134.stdout:3/659: write d1/f4 [513932,92434] 0 2024-03-12T16:10:42.060 INFO:tasks.workunit.client.1.smithi134.stdout:3/660: mknod d1/db/cf0 0 2024-03-12T16:10:42.063 INFO:tasks.workunit.client.0.smithi006.stdout:1/302: sync 2024-03-12T16:10:42.064 INFO:tasks.workunit.client.1.smithi134.stdout:3/661: mkdir d1/db/d10/d2a/dc6/df1 0 2024-03-12T16:10:42.066 INFO:tasks.workunit.client.1.smithi134.stdout:4/478: write d1/d13/d49/d64/d28/f99 [2810647,51501] 0 2024-03-12T16:10:42.068 INFO:tasks.workunit.client.1.smithi134.stdout:9/505: truncate d5/d10/f2d 3143734 0 2024-03-12T16:10:42.071 INFO:tasks.workunit.client.0.smithi006.stdout:3/313: write d8/d19/d26/d59/d2c/dc/d28/f6a [4328198,22074] 0 2024-03-12T16:10:42.072 INFO:tasks.workunit.client.0.smithi006.stdout:5/238: truncate d7/d9/d10/d35/f3c 824313 0 2024-03-12T16:10:42.075 INFO:tasks.workunit.client.1.smithi134.stdout:9/506: truncate d5/d10/f5a 1733877 0 2024-03-12T16:10:42.075 INFO:tasks.workunit.client.1.smithi134.stdout:4/479: dwrite d1/de/f82 [0,4194304] 0 2024-03-12T16:10:42.075 INFO:tasks.workunit.client.1.smithi134.stdout:3/662: dread d1/db/d12/f60 [0,4194304] 0 2024-03-12T16:10:42.076 INFO:tasks.workunit.client.0.smithi006.stdout:3/314: readlink d8/d19/d26/d59/l44 0 2024-03-12T16:10:42.077 INFO:tasks.workunit.client.0.smithi006.stdout:4/390: dwrite d1/db/d17/f1a [0,4194304] 0 2024-03-12T16:10:42.077 INFO:tasks.workunit.client.0.smithi006.stdout:5/239: chown d7/d9/d10/d24/c42 60830 1 2024-03-12T16:10:42.078 INFO:tasks.workunit.client.0.smithi006.stdout:3/315: truncate d8/d4c/f54 474175 0 2024-03-12T16:10:42.079 INFO:tasks.workunit.client.1.smithi134.stdout:5/594: dread db/d12/d1d/d3a/d4e/f4f [0,4194304] 0 2024-03-12T16:10:42.080 INFO:tasks.workunit.client.0.smithi006.stdout:5/240: write d7/d9/d10/f26 [992943,130182] 0 2024-03-12T16:10:42.080 INFO:tasks.workunit.client.0.smithi006.stdout:1/303: link d0/f30 d0/d25/d2a/d35/d3f/f61 0 2024-03-12T16:10:42.082 INFO:tasks.workunit.client.0.smithi006.stdout:1/304: chown d0/d25/l33 260 1 2024-03-12T16:10:42.084 INFO:tasks.workunit.client.0.smithi006.stdout:1/305: rename d0/d25 to d0/d25/d2a/d35/d62 22 2024-03-12T16:10:42.084 INFO:tasks.workunit.client.1.smithi134.stdout:9/507: unlink d5/f7 0 2024-03-12T16:10:42.085 INFO:tasks.workunit.client.1.smithi134.stdout:4/480: creat d1/d13/d49/d6d/d96/f9e x:0 0 0 2024-03-12T16:10:42.086 INFO:tasks.workunit.client.0.smithi006.stdout:3/316: unlink d8/d19/d26/d59/d2c/dc/d28/f29 0 2024-03-12T16:10:42.087 INFO:tasks.workunit.client.1.smithi134.stdout:4/481: write d1/de/f9a [942991,124587] 0 2024-03-12T16:10:42.088 INFO:tasks.workunit.client.0.smithi006.stdout:5/241: creat d7/d9/d10/d35/f53 x:0 0 0 2024-03-12T16:10:42.088 INFO:tasks.workunit.client.1.smithi134.stdout:3/663: creat d1/db/d12/d9d/d9f/ff2 x:0 0 0 2024-03-12T16:10:42.088 INFO:tasks.workunit.client.0.smithi006.stdout:1/306: mkdir d0/d25/d2a/d43/d63 0 2024-03-12T16:10:42.090 INFO:tasks.workunit.client.0.smithi006.stdout:4/391: symlink d1/db/d39/d42/d61/d69/l77 0 2024-03-12T16:10:42.091 INFO:tasks.workunit.client.1.smithi134.stdout:5/595: mkdir db/d12/d29/d3d/d79/da5/dc0 0 2024-03-12T16:10:42.092 INFO:tasks.workunit.client.1.smithi134.stdout:3/664: write d1/fc [7062948,23442] 0 2024-03-12T16:10:42.093 INFO:tasks.workunit.client.1.smithi134.stdout:9/508: symlink d5/d20/d72/l98 0 2024-03-12T16:10:42.094 INFO:tasks.workunit.client.1.smithi134.stdout:3/665: chown d1/db/l64 360121787 1 2024-03-12T16:10:42.094 INFO:tasks.workunit.client.1.smithi134.stdout:4/482: chown d1/l38 48 1 2024-03-12T16:10:42.094 INFO:tasks.workunit.client.1.smithi134.stdout:9/509: fsync d5/d10/d35/f1a 0 2024-03-12T16:10:42.097 INFO:tasks.workunit.client.0.smithi006.stdout:3/317: dread d8/d19/d31/f35 [0,4194304] 0 2024-03-12T16:10:42.099 INFO:tasks.workunit.client.1.smithi134.stdout:4/483: mknod d1/d24/d34/c9f 0 2024-03-12T16:10:42.099 INFO:tasks.workunit.client.0.smithi006.stdout:1/307: dread d0/fb [0,4194304] 0 2024-03-12T16:10:42.099 INFO:tasks.workunit.client.1.smithi134.stdout:9/510: symlink d5/d10/d35/d49/d54/d93/l99 0 2024-03-12T16:10:42.100 INFO:tasks.workunit.client.0.smithi006.stdout:5/242: dwrite d7/d9/d31/f46 [0,4194304] 0 2024-03-12T16:10:42.100 INFO:tasks.workunit.client.1.smithi134.stdout:3/666: fsync d1/db/d10/d2d/d2e/f3f 0 2024-03-12T16:10:42.102 INFO:tasks.workunit.client.1.smithi134.stdout:9/511: write d5/d10/d35/f73 [426244,30034] 0 2024-03-12T16:10:42.102 INFO:tasks.workunit.client.1.smithi134.stdout:3/667: stat d1/db 0 2024-03-12T16:10:42.103 INFO:tasks.workunit.client.0.smithi006.stdout:3/318: write d8/d19/d26/d59/d2c/dc/d28/d2f/f3c [3071777,105284] 0 2024-03-12T16:10:42.104 INFO:tasks.workunit.client.1.smithi134.stdout:5/596: rename db/d12/d1d/c95 to db/d12/d1d/d3a/cc1 0 2024-03-12T16:10:42.106 INFO:tasks.workunit.client.0.smithi006.stdout:4/392: write d1/db/d1d/d2f/f36 [940890,11009] 0 2024-03-12T16:10:42.107 INFO:tasks.workunit.client.0.smithi006.stdout:5/243: write d7/d8/f4c [367700,11570] 0 2024-03-12T16:10:42.109 INFO:tasks.workunit.client.0.smithi006.stdout:3/319: mknod d8/d19/d26/d59/d3b/c70 0 2024-03-12T16:10:42.109 INFO:tasks.workunit.client.0.smithi006.stdout:1/308: mkdir d0/d25/d2a/d64 0 2024-03-12T16:10:42.111 INFO:tasks.workunit.client.0.smithi006.stdout:4/393: creat d1/db/d39/d42/f78 x:0 0 0 2024-03-12T16:10:42.112 INFO:tasks.workunit.client.1.smithi134.stdout:7/527: sync 2024-03-12T16:10:42.112 INFO:tasks.workunit.client.1.smithi134.stdout:0/573: sync 2024-03-12T16:10:42.112 INFO:tasks.workunit.client.1.smithi134.stdout:6/519: sync 2024-03-12T16:10:42.112 INFO:tasks.workunit.client.1.smithi134.stdout:4/484: dwrite d1/d13/d49/f65 [0,4194304] 0 2024-03-12T16:10:42.112 INFO:tasks.workunit.client.1.smithi134.stdout:5/597: unlink db/d12/d1d/d3a/d49/c60 0 2024-03-12T16:10:42.113 INFO:tasks.workunit.client.0.smithi006.stdout:5/244: symlink d7/d9/d10/l54 0 2024-03-12T16:10:42.114 INFO:tasks.workunit.client.0.smithi006.stdout:3/320: unlink d8/d19/d26/d59/d2c/dc/d28/f40 0 2024-03-12T16:10:42.116 INFO:tasks.workunit.client.1.smithi134.stdout:9/512: dwrite d5/d10/d35/f3a [0,4194304] 0 2024-03-12T16:10:42.116 INFO:tasks.workunit.client.1.smithi134.stdout:4/485: chown d1/d13/f39 113967165 1 2024-03-12T16:10:42.116 INFO:tasks.workunit.client.1.smithi134.stdout:5/598: chown db/d12/fb8 374 1 2024-03-12T16:10:42.117 INFO:tasks.workunit.client.0.smithi006.stdout:1/309: rename d0/d25/d2a/l3c to d0/l65 0 2024-03-12T16:10:42.119 INFO:tasks.workunit.client.0.smithi006.stdout:3/321: unlink d8/d19/f6b 0 2024-03-12T16:10:42.119 INFO:tasks.workunit.client.1.smithi134.stdout:4/486: dread - d1/d13/f4b zero size 2024-03-12T16:10:42.121 INFO:tasks.workunit.client.1.smithi134.stdout:7/528: creat d8/d4e/d91/fb0 x:0 0 0 2024-03-12T16:10:42.121 INFO:tasks.workunit.client.1.smithi134.stdout:9/513: write d5/d20/f2b [1854899,28270] 0 2024-03-12T16:10:42.121 INFO:tasks.workunit.client.1.smithi134.stdout:6/520: mkdir d1/d16/d4c/d65/dd1 0 2024-03-12T16:10:42.122 INFO:tasks.workunit.client.1.smithi134.stdout:5/599: write db/d12/d37/d71/fb5 [744432,97910] 0 2024-03-12T16:10:42.123 INFO:tasks.workunit.client.1.smithi134.stdout:3/668: dwrite d1/db/d12/d9d/fe3 [0,4194304] 0 2024-03-12T16:10:42.123 INFO:tasks.workunit.client.0.smithi006.stdout:5/245: dwrite d7/d9/d10/d24/f38 [0,4194304] 0 2024-03-12T16:10:42.124 INFO:tasks.workunit.client.1.smithi134.stdout:9/514: write d5/d10/f1c [4439776,101968] 0 2024-03-12T16:10:42.126 INFO:tasks.workunit.client.0.smithi006.stdout:1/310: symlink d0/d25/l66 0 2024-03-12T16:10:42.127 INFO:tasks.workunit.client.0.smithi006.stdout:4/394: rename d1/db/d39/d42/d61/d69 to d1/d38/d79 0 2024-03-12T16:10:42.127 INFO:tasks.workunit.client.1.smithi134.stdout:3/669: chown d1/db/d10/fe9 6 1 2024-03-12T16:10:42.128 INFO:tasks.workunit.client.1.smithi134.stdout:5/600: dread - db/d12/d1d/d59/fb2 zero size 2024-03-12T16:10:42.132 INFO:tasks.workunit.client.0.smithi006.stdout:5/246: creat d7/d41/f55 x:0 0 0 2024-03-12T16:10:42.134 INFO:tasks.workunit.client.1.smithi134.stdout:3/670: readlink d1/db/d10/d2d/d2e/l9b 0 2024-03-12T16:10:42.136 INFO:tasks.workunit.client.0.smithi006.stdout:1/311: mkdir d0/d25/d67 0 2024-03-12T16:10:42.136 INFO:tasks.workunit.client.1.smithi134.stdout:9/515: getdents d5/d10 0 2024-03-12T16:10:42.140 INFO:tasks.workunit.client.0.smithi006.stdout:5/247: unlink d7/d8/l1e 0 2024-03-12T16:10:42.145 INFO:tasks.workunit.client.1.smithi134.stdout:9/516: mkdir d5/d10/d35/d49/d8d/d9a 0 2024-03-12T16:10:42.147 INFO:tasks.workunit.client.1.smithi134.stdout:6/521: dwrite d1/d16/d4c/faa [0,4194304] 0 2024-03-12T16:10:42.150 INFO:tasks.workunit.client.1.smithi134.stdout:7/529: dwrite d8/dc/d20/f67 [4194304,4194304] 0 2024-03-12T16:10:42.152 INFO:tasks.workunit.client.0.smithi006.stdout:3/322: truncate d8/d19/d47/f63 69840 0 2024-03-12T16:10:42.154 INFO:tasks.workunit.client.1.smithi134.stdout:3/671: rename d1/db/d14/d5f/fab to d1/ff3 0 2024-03-12T16:10:42.155 INFO:tasks.workunit.client.0.smithi006.stdout:4/395: truncate d1/d38/d79/f55 182991 0 2024-03-12T16:10:42.156 INFO:tasks.workunit.client.0.smithi006.stdout:3/323: mknod d8/d19/d47/c71 0 2024-03-12T16:10:42.158 INFO:tasks.workunit.client.1.smithi134.stdout:0/574: dwrite db/f3c [0,4194304] 0 2024-03-12T16:10:42.159 INFO:tasks.workunit.client.1.smithi134.stdout:9/517: rmdir d5/d10/d35/d49/d54/d88 39 2024-03-12T16:10:42.159 INFO:tasks.workunit.client.0.smithi006.stdout:4/396: write d1/d38/f4f [3932267,57840] 0 2024-03-12T16:10:42.159 INFO:tasks.workunit.client.0.smithi006.stdout:1/312: dwrite d0/d25/d2a/f3b [0,4194304] 0 2024-03-12T16:10:42.160 INFO:tasks.workunit.client.1.smithi134.stdout:7/530: creat d8/dc/d20/fb1 x:0 0 0 2024-03-12T16:10:42.162 INFO:tasks.workunit.client.1.smithi134.stdout:0/575: chown db/d2f/d51/c55 397 1 2024-03-12T16:10:42.162 INFO:tasks.workunit.client.1.smithi134.stdout:6/522: chown d1/d3/d19/l3f 1022727380 1 2024-03-12T16:10:42.163 INFO:tasks.workunit.client.1.smithi134.stdout:5/601: dwrite db/d12/d1d/d3a/d70/f75 [4194304,4194304] 0 2024-03-12T16:10:42.164 INFO:tasks.workunit.client.0.smithi006.stdout:4/397: creat d1/db/d1d/d6c/f7a x:0 0 0 2024-03-12T16:10:42.167 INFO:tasks.workunit.client.0.smithi006.stdout:1/313: mkdir d0/d25/d2a/d43/d68 0 2024-03-12T16:10:42.168 INFO:tasks.workunit.client.0.smithi006.stdout:5/248: dread d7/d9/f20 [0,4194304] 0 2024-03-12T16:10:42.170 INFO:tasks.workunit.client.0.smithi006.stdout:3/324: dwrite d8/d19/d26/d59/d2c/f13 [0,4194304] 0 2024-03-12T16:10:42.172 INFO:tasks.workunit.client.0.smithi006.stdout:1/314: chown d0/d25/d2a/f54 2341479 1 2024-03-12T16:10:42.178 INFO:tasks.workunit.client.1.smithi134.stdout:3/672: rename d1/db/d10/d2d/d30/cbc to d1/db/d10/d2a/dc6/ddb/cf4 0 2024-03-12T16:10:42.178 INFO:tasks.workunit.client.1.smithi134.stdout:0/576: mknod db/d2f/d31/d56/d66/cbd 0 2024-03-12T16:10:42.180 INFO:tasks.workunit.client.1.smithi134.stdout:9/518: read d5/d10/d1f/f24 [633155,84161] 0 2024-03-12T16:10:42.181 INFO:tasks.workunit.client.0.smithi006.stdout:5/249: getdents d7/d9/d47 0 2024-03-12T16:10:42.182 INFO:tasks.workunit.client.0.smithi006.stdout:1/315: mknod d0/d25/d2a/d35/c69 0 2024-03-12T16:10:42.182 INFO:tasks.workunit.client.0.smithi006.stdout:5/250: write d7/d9/d2c/f36 [92646,36440] 0 2024-03-12T16:10:42.183 INFO:tasks.workunit.client.1.smithi134.stdout:5/602: creat db/d7a/da8/fc2 x:0 0 0 2024-03-12T16:10:42.183 INFO:tasks.workunit.client.0.smithi006.stdout:0/380: sync 2024-03-12T16:10:42.184 INFO:tasks.workunit.client.1.smithi134.stdout:3/673: creat d1/db/d10/d2d/d2e/d72/d97/ff5 x:0 0 0 2024-03-12T16:10:42.186 INFO:tasks.workunit.client.1.smithi134.stdout:9/519: truncate d5/d46/f64 169617 0 2024-03-12T16:10:42.188 INFO:tasks.workunit.client.0.smithi006.stdout:8/261: sync 2024-03-12T16:10:42.188 INFO:tasks.workunit.client.0.smithi006.stdout:9/314: sync 2024-03-12T16:10:42.190 INFO:tasks.workunit.client.1.smithi134.stdout:3/674: rmdir d1/db/d14/d5a 39 2024-03-12T16:10:42.191 INFO:tasks.workunit.client.1.smithi134.stdout:0/577: link db/d2f/d31/l48 db/d2f/d61/d94/lbe 0 2024-03-12T16:10:42.192 INFO:tasks.workunit.client.0.smithi006.stdout:3/325: dwrite d8/d19/d26/d59/d2c/dc/d28/d2f/f60 [0,4194304] 0 2024-03-12T16:10:42.192 INFO:tasks.workunit.client.0.smithi006.stdout:1/316: link d0/d25/d2a/d43/l4a d0/d25/d2a/d43/d63/l6a 0 2024-03-12T16:10:42.193 INFO:tasks.workunit.client.1.smithi134.stdout:6/523: link d1/d16/d4c/d65/d61/c96 d1/d3/cd2 0 2024-03-12T16:10:42.194 INFO:tasks.workunit.client.0.smithi006.stdout:8/262: read d2/db/f20 [3907717,19709] 0 2024-03-12T16:10:42.195 INFO:tasks.workunit.client.1.smithi134.stdout:5/603: creat db/d12/d29/fc3 x:0 0 0 2024-03-12T16:10:42.195 INFO:tasks.workunit.client.1.smithi134.stdout:3/675: read d1/fc [2389117,84453] 0 2024-03-12T16:10:42.198 INFO:tasks.workunit.client.0.smithi006.stdout:9/315: write d0/d8/d2b/d20/f51 [581049,36018] 0 2024-03-12T16:10:42.198 INFO:tasks.workunit.client.1.smithi134.stdout:3/676: stat d1/db/f90 0 2024-03-12T16:10:42.198 INFO:tasks.workunit.client.0.smithi006.stdout:5/251: dwrite d7/d9/d10/f1b [0,4194304] 0 2024-03-12T16:10:42.200 INFO:tasks.workunit.client.1.smithi134.stdout:5/604: truncate db/d12/d37/d73/d8c/faa 480036 0 2024-03-12T16:10:42.201 INFO:tasks.workunit.client.1.smithi134.stdout:3/677: fdatasync d1/d63/d6c/fcd 0 2024-03-12T16:10:42.203 INFO:tasks.workunit.client.0.smithi006.stdout:3/326: creat d8/d19/d47/f72 x:0 0 0 2024-03-12T16:10:42.203 INFO:tasks.workunit.client.1.smithi134.stdout:5/605: mkdir db/d7a/dc4 0 2024-03-12T16:10:42.205 INFO:tasks.workunit.client.0.smithi006.stdout:5/252: truncate d7/d9/d10/f26 1826309 0 2024-03-12T16:10:42.205 INFO:tasks.workunit.client.0.smithi006.stdout:0/381: rename d2/d6/f7 to d2/d6/d10/d11/d32/f6c 0 2024-03-12T16:10:42.206 INFO:tasks.workunit.client.1.smithi134.stdout:5/606: rmdir db/d12/d29/d3d/d79/da5 39 2024-03-12T16:10:42.206 INFO:tasks.workunit.client.0.smithi006.stdout:1/317: link d0/l9 d0/d25/d2a/d35/d3f/l6b 0 2024-03-12T16:10:42.207 INFO:tasks.workunit.client.1.smithi134.stdout:5/607: chown db/d12/d1d/l4d 4034102 1 2024-03-12T16:10:42.209 INFO:tasks.workunit.client.1.smithi134.stdout:5/608: truncate db/d12/d37/d73/d8c/faa 938009 0 2024-03-12T16:10:42.210 INFO:tasks.workunit.client.1.smithi134.stdout:6/524: dread d1/d16/d4c/d65/f81 [4194304,4194304] 0 2024-03-12T16:10:42.212 INFO:tasks.workunit.client.1.smithi134.stdout:6/525: readlink d1/d89/l98 0 2024-03-12T16:10:42.212 INFO:tasks.workunit.client.1.smithi134.stdout:9/520: truncate d5/d10/d35/d49/f4a 908361 0 2024-03-12T16:10:42.213 INFO:tasks.workunit.client.1.smithi134.stdout:9/521: chown d5/d20 190312 1 2024-03-12T16:10:42.214 INFO:tasks.workunit.client.0.smithi006.stdout:3/327: creat d8/d19/d26/d59/d2c/dc/d28/f73 x:0 0 0 2024-03-12T16:10:42.214 INFO:tasks.workunit.client.0.smithi006.stdout:8/263: write d2/db/f24 [1805748,99550] 0 2024-03-12T16:10:42.215 INFO:tasks.workunit.client.1.smithi134.stdout:0/578: dread db/d2f/d71/f9e [0,4194304] 0 2024-03-12T16:10:42.217 INFO:tasks.workunit.client.1.smithi134.stdout:9/522: creat d5/d10/f9b x:0 0 0 2024-03-12T16:10:42.218 INFO:tasks.workunit.client.0.smithi006.stdout:9/316: creat d0/d4/d3b/d4a/f65 x:0 0 0 2024-03-12T16:10:42.221 INFO:tasks.workunit.client.0.smithi006.stdout:0/382: truncate d2/f4b 5026 0 2024-03-12T16:10:42.221 INFO:tasks.workunit.client.1.smithi134.stdout:5/609: dread db/d12/d1d/f51 [0,4194304] 0 2024-03-12T16:10:42.222 INFO:tasks.workunit.client.1.smithi134.stdout:6/526: rename d1/d16/fab to d1/fd3 0 2024-03-12T16:10:42.222 INFO:tasks.workunit.client.0.smithi006.stdout:3/328: write d8/d19/d47/f72 [960783,3142] 0 2024-03-12T16:10:42.224 INFO:tasks.workunit.client.1.smithi134.stdout:0/579: creat db/d2f/d31/d68/d70/daa/fbf x:0 0 0 2024-03-12T16:10:42.224 INFO:tasks.workunit.client.1.smithi134.stdout:3/678: dread d1/d63/d6c/f6d [0,4194304] 0 2024-03-12T16:10:42.227 INFO:tasks.workunit.client.1.smithi134.stdout:0/580: read db/d2f/d31/d68/d70/f74 [140291,12973] 0 2024-03-12T16:10:42.228 INFO:tasks.workunit.client.0.smithi006.stdout:8/264: rename d2/db/f51 to d2/db/d1a/d1f/f54 0 2024-03-12T16:10:42.228 INFO:tasks.workunit.client.0.smithi006.stdout:0/383: write d2/d39/d42/f56 [992878,80148] 0 2024-03-12T16:10:42.228 INFO:tasks.workunit.client.1.smithi134.stdout:6/527: write d1/f1e [298870,63165] 0 2024-03-12T16:10:42.229 INFO:tasks.workunit.client.0.smithi006.stdout:9/317: creat d0/d8/d2b/f66 x:0 0 0 2024-03-12T16:10:42.230 INFO:tasks.workunit.client.0.smithi006.stdout:4/398: dwrite d1/d38/d79/f55 [0,4194304] 0 2024-03-12T16:10:42.233 INFO:tasks.workunit.client.0.smithi006.stdout:3/329: creat d8/d19/d26/d59/d2c/dc/d28/f74 x:0 0 0 2024-03-12T16:10:42.234 INFO:tasks.workunit.client.0.smithi006.stdout:1/318: dread d0/d25/d2a/d43/f47 [0,4194304] 0 2024-03-12T16:10:42.235 INFO:tasks.workunit.client.1.smithi134.stdout:0/581: dread db/d2f/d61/d67/fa6 [0,4194304] 0 2024-03-12T16:10:42.235 INFO:tasks.workunit.client.1.smithi134.stdout:5/610: creat db/d12/d37/d73/d7f/fc5 x:0 0 0 2024-03-12T16:10:42.235 INFO:tasks.workunit.client.0.smithi006.stdout:4/399: stat d1/db/d17/c44 0 2024-03-12T16:10:42.235 INFO:tasks.workunit.client.0.smithi006.stdout:9/318: dread - d0/d8/d16/f54 zero size 2024-03-12T16:10:42.238 INFO:tasks.workunit.client.1.smithi134.stdout:6/528: symlink d1/d3/d10/ld4 0 2024-03-12T16:10:42.238 INFO:tasks.workunit.client.1.smithi134.stdout:5/611: fdatasync db/d12/d1d/d3a/d4e/f82 0 2024-03-12T16:10:42.239 INFO:tasks.workunit.client.0.smithi006.stdout:9/319: chown d0/d1f/l45 13866 1 2024-03-12T16:10:42.239 INFO:tasks.workunit.client.0.smithi006.stdout:1/319: fdatasync d0/f13 0 2024-03-12T16:10:42.240 INFO:tasks.workunit.client.0.smithi006.stdout:1/320: stat d0/fe 0 2024-03-12T16:10:42.241 INFO:tasks.workunit.client.1.smithi134.stdout:9/523: fdatasync d5/d10/d1f/f6e 0 2024-03-12T16:10:42.241 INFO:tasks.workunit.client.1.smithi134.stdout:3/679: truncate d1/d63/d6c/f98 5207374 0 2024-03-12T16:10:42.241 INFO:tasks.workunit.client.0.smithi006.stdout:5/253: dread d7/f28 [0,4194304] 0 2024-03-12T16:10:42.243 INFO:tasks.workunit.client.0.smithi006.stdout:3/330: symlink d8/d19/d26/d59/d2c/d41/l75 0 2024-03-12T16:10:42.244 INFO:tasks.workunit.client.1.smithi134.stdout:6/529: rename d1/d16/d4c to d1/d16/d4c/d65/d7b/dd5 22 2024-03-12T16:10:42.244 INFO:tasks.workunit.client.1.smithi134.stdout:3/680: chown d1/db/d14/c70 307076 1 2024-03-12T16:10:42.245 INFO:tasks.workunit.client.0.smithi006.stdout:5/254: readlink d7/d8/l1f 0 2024-03-12T16:10:42.246 INFO:tasks.workunit.client.0.smithi006.stdout:9/320: creat d0/d8/d23/f67 x:0 0 0 2024-03-12T16:10:42.246 INFO:tasks.workunit.client.1.smithi134.stdout:5/612: truncate db/d7a/da8/faf 808692 0 2024-03-12T16:10:42.247 INFO:tasks.workunit.client.0.smithi006.stdout:5/255: chown d7/d9/d31/d3b/d4f/l50 478 1 2024-03-12T16:10:42.247 INFO:tasks.workunit.client.0.smithi006.stdout:4/400: creat d1/db/d17/d5a/d60/f7b x:0 0 0 2024-03-12T16:10:42.247 INFO:tasks.workunit.client.1.smithi134.stdout:9/524: getdents d5/d10/d1f 0 2024-03-12T16:10:42.248 INFO:tasks.workunit.client.0.smithi006.stdout:8/265: write d2/db/d1a/d21/d2b/f40 [695876,121783] 0 2024-03-12T16:10:42.249 INFO:tasks.workunit.client.1.smithi134.stdout:0/582: dwrite db/f1d [4194304,4194304] 0 2024-03-12T16:10:42.250 INFO:tasks.workunit.client.1.smithi134.stdout:5/613: chown db/d12/d37/f98 0 1 2024-03-12T16:10:42.250 INFO:tasks.workunit.client.1.smithi134.stdout:3/681: creat d1/d63/dc2/ff6 x:0 0 0 2024-03-12T16:10:42.250 INFO:tasks.workunit.client.0.smithi006.stdout:4/401: fdatasync d1/db/d39/f3b 0 2024-03-12T16:10:42.250 INFO:tasks.workunit.client.0.smithi006.stdout:1/321: mknod d0/d25/d2a/d43/d68/c6c 0 2024-03-12T16:10:42.254 INFO:tasks.workunit.client.1.smithi134.stdout:0/583: dread - db/d2f/d31/d68/f99 zero size 2024-03-12T16:10:42.254 INFO:tasks.workunit.client.0.smithi006.stdout:3/331: creat d8/f76 x:0 0 0 2024-03-12T16:10:42.255 INFO:tasks.workunit.client.0.smithi006.stdout:5/256: mkdir d7/d9/d47/d56 0 2024-03-12T16:10:42.255 INFO:tasks.workunit.client.1.smithi134.stdout:5/614: readlink db/d12/d1d/d3a/d4e/lbd 0 2024-03-12T16:10:42.255 INFO:tasks.workunit.client.1.smithi134.stdout:3/682: chown d1/db/d10/d2d/d2e/l9b 464 1 2024-03-12T16:10:42.257 INFO:tasks.workunit.client.1.smithi134.stdout:9/525: read d5/d10/d35/d49/d54/d5e/f71 [364717,98376] 0 2024-03-12T16:10:42.258 INFO:tasks.workunit.client.1.smithi134.stdout:0/584: mkdir db/d2f/d31/d56/d66/dc0 0 2024-03-12T16:10:42.259 INFO:tasks.workunit.client.1.smithi134.stdout:6/530: dread d1/d3/d19/f51 [0,4194304] 0 2024-03-12T16:10:42.260 INFO:tasks.workunit.client.1.smithi134.stdout:9/526: rmdir d5/d10 39 2024-03-12T16:10:42.261 INFO:tasks.workunit.client.0.smithi006.stdout:9/321: getdents d0/d4/d3b/d4a 0 2024-03-12T16:10:42.261 INFO:tasks.workunit.client.0.smithi006.stdout:0/384: dwrite d2/d6/d10/d11/f35 [0,4194304] 0 2024-03-12T16:10:42.264 INFO:tasks.workunit.client.1.smithi134.stdout:9/527: readlink d5/d10/l4e 0 2024-03-12T16:10:42.265 INFO:tasks.workunit.client.0.smithi006.stdout:4/402: link d1/db/d39/c66 d1/db/d39/c7c 0 2024-03-12T16:10:42.265 INFO:tasks.workunit.client.0.smithi006.stdout:1/322: dwrite d0/d25/d2a/d35/f4b [0,4194304] 0 2024-03-12T16:10:42.266 INFO:tasks.workunit.client.1.smithi134.stdout:6/531: dread d1/d16/d4c/d65/f6b [0,4194304] 0 2024-03-12T16:10:42.266 INFO:tasks.workunit.client.1.smithi134.stdout:9/528: chown d5/d10/d33 3502 1 2024-03-12T16:10:42.267 INFO:tasks.workunit.client.0.smithi006.stdout:9/322: symlink d0/d1f/l68 0 2024-03-12T16:10:42.267 INFO:tasks.workunit.client.0.smithi006.stdout:3/332: read d8/d19/d26/d59/d2c/f13 [3295705,86752] 0 2024-03-12T16:10:42.267 INFO:tasks.workunit.client.0.smithi006.stdout:0/385: chown d2/d6/d10/d11/d1d/d2e/f33 11084924 1 2024-03-12T16:10:42.268 INFO:tasks.workunit.client.0.smithi006.stdout:5/257: symlink d7/d9/d10/l57 0 2024-03-12T16:10:42.270 INFO:tasks.workunit.client.0.smithi006.stdout:1/323: write d0/d25/d2a/d35/f55 [149014,110575] 0 2024-03-12T16:10:42.271 INFO:tasks.workunit.client.0.smithi006.stdout:9/323: symlink d0/d1f/l69 0 2024-03-12T16:10:42.271 INFO:tasks.workunit.client.0.smithi006.stdout:7/428: sync 2024-03-12T16:10:42.271 INFO:tasks.workunit.client.0.smithi006.stdout:6/307: sync 2024-03-12T16:10:42.271 INFO:tasks.workunit.client.0.smithi006.stdout:2/360: sync 2024-03-12T16:10:42.271 INFO:tasks.workunit.client.1.smithi134.stdout:9/529: rmdir d5/d10/d35/d49/d54/d93 39 2024-03-12T16:10:42.275 INFO:tasks.workunit.client.0.smithi006.stdout:4/403: rename d1/db/d17/d5a/f5c to d1/db/d1d/d2f/d6b/f7d 0 2024-03-12T16:10:42.277 INFO:tasks.workunit.client.1.smithi134.stdout:6/532: rename d1/da6/d55/d85/f87 to d1/d89/fd6 0 2024-03-12T16:10:42.280 INFO:tasks.workunit.client.0.smithi006.stdout:7/429: unlink de/d1c/d35/f6b 0 2024-03-12T16:10:42.282 INFO:tasks.workunit.client.1.smithi134.stdout:6/533: symlink d1/d3a/db5/ld7 0 2024-03-12T16:10:42.283 INFO:tasks.workunit.client.0.smithi006.stdout:3/333: rename d8/d4c/f56 to d8/d19/d47/f77 0 2024-03-12T16:10:42.283 INFO:tasks.workunit.client.1.smithi134.stdout:3/683: dread d1/db/d14/f23 [0,4194304] 0 2024-03-12T16:10:42.284 INFO:tasks.workunit.client.1.smithi134.stdout:0/585: dwrite db/f45 [0,4194304] 0 2024-03-12T16:10:42.285 INFO:tasks.workunit.client.1.smithi134.stdout:1/396: sync 2024-03-12T16:10:42.286 INFO:tasks.workunit.client.0.smithi006.stdout:6/308: mknod d3/d47/c70 0 2024-03-12T16:10:42.287 INFO:tasks.workunit.client.1.smithi134.stdout:6/534: write d1/d4/fac [662737,117925] 0 2024-03-12T16:10:42.287 INFO:tasks.workunit.client.1.smithi134.stdout:3/684: readlink d1/lb6 0 2024-03-12T16:10:42.287 INFO:tasks.workunit.client.1.smithi134.stdout:2/521: sync 2024-03-12T16:10:42.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/615: dread db/fa3 [0,4194304] 0 2024-03-12T16:10:42.287 INFO:tasks.workunit.client.1.smithi134.stdout:9/530: dread d5/d10/d1f/f24 [0,4194304] 0 2024-03-12T16:10:42.290 INFO:tasks.workunit.client.1.smithi134.stdout:2/522: read d4/fa [2374905,15665] 0 2024-03-12T16:10:42.291 INFO:tasks.workunit.client.0.smithi006.stdout:1/324: dwrite d0/d25/d2a/d43/f46 [0,4194304] 0 2024-03-12T16:10:42.292 INFO:tasks.workunit.client.1.smithi134.stdout:3/685: write d1/db/d10/f8a [1107729,77111] 0 2024-03-12T16:10:42.292 INFO:tasks.workunit.client.1.smithi134.stdout:6/535: read - d1/d16/d4c/d58/da0/db7/f9f zero size 2024-03-12T16:10:42.293 INFO:tasks.workunit.client.1.smithi134.stdout:5/616: mknod db/cc6 0 2024-03-12T16:10:42.293 INFO:tasks.workunit.client.0.smithi006.stdout:0/386: creat d2/d6/d10/f6d x:0 0 0 2024-03-12T16:10:42.297 INFO:tasks.workunit.client.0.smithi006.stdout:7/430: symlink de/d18/d2a/d39/l92 0 2024-03-12T16:10:42.298 INFO:tasks.workunit.client.0.smithi006.stdout:9/324: dread d0/d8/f52 [4194304,4194304] 0 2024-03-12T16:10:42.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/617: write db/d12/d7b/f93 [2453943,101603] 0 2024-03-12T16:10:42.298 INFO:tasks.workunit.client.0.smithi006.stdout:3/334: mkdir d8/d19/d78 0 2024-03-12T16:10:42.299 INFO:tasks.workunit.client.1.smithi134.stdout:2/523: mkdir d4/d12/d1d/d34/d58/dbb 0 2024-03-12T16:10:42.300 INFO:tasks.workunit.client.0.smithi006.stdout:6/309: chown d3/d11/d3b/d5d/c6b 4 1 2024-03-12T16:10:42.300 INFO:tasks.workunit.client.1.smithi134.stdout:5/618: fdatasync db/d12/fb8 0 2024-03-12T16:10:42.302 INFO:tasks.workunit.client.0.smithi006.stdout:4/404: dwrite d1/db/d39/f47 [0,4194304] 0 2024-03-12T16:10:42.303 INFO:tasks.workunit.client.0.smithi006.stdout:6/310: chown d3/d11/d10/d19 92134291 1 2024-03-12T16:10:42.309 INFO:tasks.workunit.client.0.smithi006.stdout:8/266: dwrite d2/d11/f1b [0,4194304] 0 2024-03-12T16:10:42.309 INFO:tasks.workunit.client.0.smithi006.stdout:7/431: mkdir de/d2c/d93 0 2024-03-12T16:10:42.309 INFO:tasks.workunit.client.0.smithi006.stdout:9/325: stat d0/d8/d2b/d20/d37/c56 0 2024-03-12T16:10:42.309 INFO:tasks.workunit.client.1.smithi134.stdout:4/487: sync 2024-03-12T16:10:42.309 INFO:tasks.workunit.client.1.smithi134.stdout:8/529: sync 2024-03-12T16:10:42.309 INFO:tasks.workunit.client.1.smithi134.stdout:7/531: sync 2024-03-12T16:10:42.310 INFO:tasks.workunit.client.0.smithi006.stdout:4/405: readlink d1/db/d1d/d2f/l65 0 2024-03-12T16:10:42.310 INFO:tasks.workunit.client.1.smithi134.stdout:1/397: mknod d0/d16/d9/d13/d21/c89 0 2024-03-12T16:10:42.314 INFO:tasks.workunit.client.1.smithi134.stdout:5/619: unlink db/d12/d29/d3d/l5d 0 2024-03-12T16:10:42.315 INFO:tasks.workunit.client.1.smithi134.stdout:6/536: mknod d1/d3/cd8 0 2024-03-12T16:10:42.315 INFO:tasks.workunit.client.1.smithi134.stdout:7/532: mknod d8/dc/d20/d26/cb2 0 2024-03-12T16:10:42.316 INFO:tasks.workunit.client.0.smithi006.stdout:1/325: creat d0/d25/d2a/d64/f6d x:0 0 0 2024-03-12T16:10:42.317 INFO:tasks.workunit.client.1.smithi134.stdout:3/686: getdents d1/db/d14/d5a/d89/dea 0 2024-03-12T16:10:42.317 INFO:tasks.workunit.client.0.smithi006.stdout:3/335: dwrite d8/d19/d26/d59/d2c/f20 [0,4194304] 0 2024-03-12T16:10:42.319 INFO:tasks.workunit.client.0.smithi006.stdout:8/267: dread d2/d11/f1b [0,4194304] 0 2024-03-12T16:10:42.319 INFO:tasks.workunit.client.1.smithi134.stdout:6/537: stat d1/d4/f42 0 2024-03-12T16:10:42.322 INFO:tasks.workunit.client.0.smithi006.stdout:6/311: mkdir d3/d11/d10/d28/d45/d71 0 2024-03-12T16:10:42.326 INFO:tasks.workunit.client.1.smithi134.stdout:6/538: mkdir d1/d3/d19/d32/dd9 0 2024-03-12T16:10:42.326 INFO:tasks.workunit.client.1.smithi134.stdout:9/531: getdents d5/d10/d35/d49/d74 0 2024-03-12T16:10:42.327 INFO:tasks.workunit.client.1.smithi134.stdout:7/533: creat d8/dc/d20/d26/d36/fb3 x:0 0 0 2024-03-12T16:10:42.327 INFO:tasks.workunit.client.1.smithi134.stdout:0/586: dread db/f2c [0,4194304] 0 2024-03-12T16:10:42.328 INFO:tasks.workunit.client.1.smithi134.stdout:3/687: write d1/d63/fdc [2482626,8170] 0 2024-03-12T16:10:42.332 INFO:tasks.workunit.client.1.smithi134.stdout:2/524: write d4/d12/f6d [541237,127853] 0 2024-03-12T16:10:42.332 INFO:tasks.workunit.client.1.smithi134.stdout:1/398: link d0/d16/d9/d13/d21/d20/f44 d0/d16/d9/d13/f8a 0 2024-03-12T16:10:42.333 INFO:tasks.workunit.client.0.smithi006.stdout:1/326: mknod d0/d25/d2a/d43/d63/c6e 0 2024-03-12T16:10:42.333 INFO:tasks.workunit.client.0.smithi006.stdout:5/258: truncate d7/d9/d10/d24/f3e 3956709 0 2024-03-12T16:10:42.335 INFO:tasks.workunit.client.0.smithi006.stdout:1/327: readlink d0/d25/d2a/d43/d56/l3d 0 2024-03-12T16:10:42.335 INFO:tasks.workunit.client.1.smithi134.stdout:0/587: creat db/d2f/d61/d7a/fc1 x:0 0 0 2024-03-12T16:10:42.336 INFO:tasks.workunit.client.1.smithi134.stdout:3/688: unlink d1/db/d10/d2a/l7c 0 2024-03-12T16:10:42.340 INFO:tasks.workunit.client.1.smithi134.stdout:5/620: rename db/cc6 to db/d12/d1d/d3a/cc7 0 2024-03-12T16:10:42.341 INFO:tasks.workunit.client.0.smithi006.stdout:4/406: link d1/db/d17/d43/l48 d1/db/d17/d5a/d60/l7e 0 2024-03-12T16:10:42.341 INFO:tasks.workunit.client.0.smithi006.stdout:3/336: link d8/d19/d26/d59/d2c/dc/d28/d2f/f60 d8/d19/d47/f79 0 2024-03-12T16:10:42.342 INFO:tasks.workunit.client.0.smithi006.stdout:1/328: symlink d0/d25/d2a/d43/l6f 0 2024-03-12T16:10:42.342 INFO:tasks.workunit.client.1.smithi134.stdout:9/532: dwrite d5/d10/d35/d49/f8c [0,4194304] 0 2024-03-12T16:10:42.343 INFO:tasks.workunit.client.1.smithi134.stdout:1/399: creat d0/d16/d9/d13/d38/f8b x:0 0 0 2024-03-12T16:10:42.344 INFO:tasks.workunit.client.0.smithi006.stdout:6/312: creat d3/d11/d10/f72 x:0 0 0 2024-03-12T16:10:42.344 INFO:tasks.workunit.client.0.smithi006.stdout:9/326: dread d0/d4/d3b/f4b [0,4194304] 0 2024-03-12T16:10:42.346 INFO:tasks.workunit.client.1.smithi134.stdout:5/621: chown db/d12/d37/d71/d90 420930851 1 2024-03-12T16:10:42.347 INFO:tasks.workunit.client.0.smithi006.stdout:5/259: dwrite d7/d8/f4c [0,4194304] 0 2024-03-12T16:10:42.349 INFO:tasks.workunit.client.1.smithi134.stdout:3/689: rename d1/db/d10/d2d/d2e/l5c to d1/d63/dc2/lf7 0 2024-03-12T16:10:42.351 INFO:tasks.workunit.client.1.smithi134.stdout:4/488: truncate d1/d13/d49/d64/d35/f79 178605 0 2024-03-12T16:10:42.352 INFO:tasks.workunit.client.1.smithi134.stdout:6/539: getdents d1/d3a/db5 0 2024-03-12T16:10:42.353 INFO:tasks.workunit.client.0.smithi006.stdout:5/260: write d7/d9/d10/d24/f2d [498565,104182] 0 2024-03-12T16:10:42.353 INFO:tasks.workunit.client.1.smithi134.stdout:3/690: chown d1/db/d10/d2a/dc6/ddb 13 1 2024-03-12T16:10:42.353 INFO:tasks.workunit.client.0.smithi006.stdout:1/329: rename d0/d25/d2a/d43/c5e to d0/d25/d2a/d35/c70 0 2024-03-12T16:10:42.355 INFO:tasks.workunit.client.0.smithi006.stdout:6/313: symlink d3/d11/d3b/d59/l73 0 2024-03-12T16:10:42.356 INFO:tasks.workunit.client.1.smithi134.stdout:2/525: dwrite d4/d12/d1d/d34/d58/f93 [0,4194304] 0 2024-03-12T16:10:42.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/540: chown d1 87238 1 2024-03-12T16:10:42.357 INFO:tasks.workunit.client.0.smithi006.stdout:8/268: dread d2/db/f18 [0,4194304] 0 2024-03-12T16:10:42.360 INFO:tasks.workunit.client.1.smithi134.stdout:3/691: write d1/d63/d6c/dbf/fd5 [4374070,79303] 0 2024-03-12T16:10:42.360 INFO:tasks.workunit.client.1.smithi134.stdout:5/622: truncate db/d7a/da8/fc2 256869 0 2024-03-12T16:10:42.360 INFO:tasks.workunit.client.0.smithi006.stdout:4/407: dwrite d1/db/d1d/d2f/f63 [0,4194304] 0 2024-03-12T16:10:42.363 INFO:tasks.workunit.client.1.smithi134.stdout:2/526: fdatasync d4/d12/f20 0 2024-03-12T16:10:42.363 INFO:tasks.workunit.client.0.smithi006.stdout:4/408: stat d1/l8 0 2024-03-12T16:10:42.363 INFO:tasks.workunit.client.0.smithi006.stdout:4/409: dread - d1/db/d1d/d6c/f7a zero size 2024-03-12T16:10:42.365 INFO:tasks.workunit.client.1.smithi134.stdout:9/533: dwrite d5/d10/d35/d49/d54/f80 [0,4194304] 0 2024-03-12T16:10:42.365 INFO:tasks.workunit.client.0.smithi006.stdout:9/327: getdents d0/d8/d23 0 2024-03-12T16:10:42.366 INFO:tasks.workunit.client.1.smithi134.stdout:6/541: write d1/d3/d19/d32/d4a/f7a [3010856,31264] 0 2024-03-12T16:10:42.368 INFO:tasks.workunit.client.0.smithi006.stdout:1/330: fdatasync d0/f27 0 2024-03-12T16:10:42.369 INFO:tasks.workunit.client.0.smithi006.stdout:7/432: dread de/d18/d2a/d40/f7f [0,4194304] 0 2024-03-12T16:10:42.369 INFO:tasks.workunit.client.1.smithi134.stdout:3/692: creat d1/db/d14/d5a/ff8 x:0 0 0 2024-03-12T16:10:42.371 INFO:tasks.workunit.client.1.smithi134.stdout:2/527: symlink d4/d12/d43/da2/lbc 0 2024-03-12T16:10:42.372 INFO:tasks.workunit.client.0.smithi006.stdout:9/328: mkdir d0/d4/d3b/d6a 0 2024-03-12T16:10:42.372 INFO:tasks.workunit.client.0.smithi006.stdout:4/410: link d1/db/d39/d42/d61/c76 d1/db/d17/c7f 0 2024-03-12T16:10:42.372 INFO:tasks.workunit.client.1.smithi134.stdout:4/489: creat d1/d13/d49/fa0 x:0 0 0 2024-03-12T16:10:42.373 INFO:tasks.workunit.client.1.smithi134.stdout:5/623: write db/d12/d1d/f51 [1833320,25305] 0 2024-03-12T16:10:42.373 INFO:tasks.workunit.client.0.smithi006.stdout:6/314: creat d3/d11/d10/d1b/d20/d5a/f74 x:0 0 0 2024-03-12T16:10:42.374 INFO:tasks.workunit.client.1.smithi134.stdout:9/534: creat d5/d20/d72/f9c x:0 0 0 2024-03-12T16:10:42.374 INFO:tasks.workunit.client.1.smithi134.stdout:2/528: fsync d4/d12/d3b/d9b/fae 0 2024-03-12T16:10:42.375 INFO:tasks.workunit.client.0.smithi006.stdout:7/433: read - de/d27/d2b/d4a/d6a/f6d zero size 2024-03-12T16:10:42.387 INFO:tasks.workunit.client.1.smithi134.stdout:7/534: dread d8/dc/d20/f1d [0,4194304] 0 2024-03-12T16:10:42.387 INFO:tasks.workunit.client.1.smithi134.stdout:9/535: mknod d5/c9d 0 2024-03-12T16:10:42.388 INFO:tasks.workunit.client.0.smithi006.stdout:6/315: write d3/d11/f31 [3816490,119224] 0 2024-03-12T16:10:42.389 INFO:tasks.workunit.client.1.smithi134.stdout:0/588: write db/f86 [772570,20850] 0 2024-03-12T16:10:42.389 INFO:tasks.workunit.client.1.smithi134.stdout:3/693: dwrite d1/db/d14/f42 [0,4194304] 0 2024-03-12T16:10:42.391 INFO:tasks.workunit.client.0.smithi006.stdout:6/316: stat d3/d11/d10/d19/f6a 0 2024-03-12T16:10:42.392 INFO:tasks.workunit.client.1.smithi134.stdout:6/542: dwrite d1/f1e [0,4194304] 0 2024-03-12T16:10:42.393 INFO:tasks.workunit.client.0.smithi006.stdout:8/269: dwrite d2/db/d1a/d23/f50 [0,4194304] 0 2024-03-12T16:10:42.394 INFO:tasks.workunit.client.1.smithi134.stdout:4/490: mknod d1/d13/d49/d64/ca1 0 2024-03-12T16:10:42.394 INFO:tasks.workunit.client.1.smithi134.stdout:6/543: fsync d1/d4/fac 0 2024-03-12T16:10:42.396 INFO:tasks.workunit.client.1.smithi134.stdout:1/400: truncate d0/f2a 564302 0 2024-03-12T16:10:42.396 INFO:tasks.workunit.client.1.smithi134.stdout:9/536: readlink d5/d10/d6c/l94 0 2024-03-12T16:10:42.397 INFO:tasks.workunit.client.1.smithi134.stdout:0/589: write db/d2f/d31/d56/d9a/f9d [1886861,33027] 0 2024-03-12T16:10:42.398 INFO:tasks.workunit.client.1.smithi134.stdout:7/535: mkdir d8/db4 0 2024-03-12T16:10:42.398 INFO:tasks.workunit.client.1.smithi134.stdout:4/491: chown d1/d13/d49/d64/d28/f5e 779 1 2024-03-12T16:10:42.398 INFO:tasks.workunit.client.0.smithi006.stdout:1/331: rename d0/f27 to d0/d25/d2a/f71 0 2024-03-12T16:10:42.399 INFO:tasks.workunit.client.1.smithi134.stdout:6/544: creat d1/d16/d4c/d65/d70/fda x:0 0 0 2024-03-12T16:10:42.400 INFO:tasks.workunit.client.1.smithi134.stdout:4/492: chown d1/de/d5a/d84 3 1 2024-03-12T16:10:42.401 INFO:tasks.workunit.client.1.smithi134.stdout:7/536: read - d8/d27/d9d/f86 zero size 2024-03-12T16:10:42.402 INFO:tasks.workunit.client.1.smithi134.stdout:4/493: chown d1/d13/f5b 7249734 1 2024-03-12T16:10:42.403 INFO:tasks.workunit.client.1.smithi134.stdout:0/590: chown db/c19 245003 1 2024-03-12T16:10:42.404 INFO:tasks.workunit.client.0.smithi006.stdout:9/329: creat d0/d4/d3b/d6a/f6b x:0 0 0 2024-03-12T16:10:42.404 INFO:tasks.workunit.client.0.smithi006.stdout:7/434: creat de/d7b/d7e/f94 x:0 0 0 2024-03-12T16:10:42.405 INFO:tasks.workunit.client.1.smithi134.stdout:3/694: creat d1/db/d10/d2d/ff9 x:0 0 0 2024-03-12T16:10:42.406 INFO:tasks.workunit.client.0.smithi006.stdout:6/317: creat d3/d11/d10/d1b/d20/f75 x:0 0 0 2024-03-12T16:10:42.406 INFO:tasks.workunit.client.1.smithi134.stdout:0/591: dread - db/d2f/d31/d75/f8a zero size 2024-03-12T16:10:42.408 INFO:tasks.workunit.client.1.smithi134.stdout:3/695: chown d1/db/d12/l47 388 1 2024-03-12T16:10:42.408 INFO:tasks.workunit.client.1.smithi134.stdout:6/545: fsync d1/d16/d4c/d58/da0/db7/f71 0 2024-03-12T16:10:42.409 INFO:tasks.workunit.client.0.smithi006.stdout:1/332: dread - d0/d25/d2a/d35/d3f/f45 zero size 2024-03-12T16:10:42.409 INFO:tasks.workunit.client.0.smithi006.stdout:6/318: readlink d3/d11/d10/d1b/l6f 0 2024-03-12T16:10:42.410 INFO:tasks.workunit.client.1.smithi134.stdout:4/494: truncate d1/d24/f56 770024 0 2024-03-12T16:10:42.412 INFO:tasks.workunit.client.1.smithi134.stdout:3/696: dread - d1/db/d12/d9d/d9f/fa9 zero size 2024-03-12T16:10:42.412 INFO:tasks.workunit.client.1.smithi134.stdout:1/401: creat d0/d30/f8c x:0 0 0 2024-03-12T16:10:42.413 INFO:tasks.workunit.client.0.smithi006.stdout:4/411: dwrite d1/db/d1d/f5d [0,4194304] 0 2024-03-12T16:10:42.414 INFO:tasks.workunit.client.0.smithi006.stdout:9/330: symlink d0/d4/d3b/l6c 0 2024-03-12T16:10:42.416 INFO:tasks.workunit.client.1.smithi134.stdout:0/592: write db/f6e [3715553,63055] 0 2024-03-12T16:10:42.420 INFO:tasks.workunit.client.1.smithi134.stdout:0/593: write db/f1d [8387064,87549] 0 2024-03-12T16:10:42.422 INFO:tasks.workunit.client.0.smithi006.stdout:8/270: mkdir d2/d55 0 2024-03-12T16:10:42.423 INFO:tasks.workunit.client.1.smithi134.stdout:9/537: write d5/d10/d1f/f24 [1191017,70541] 0 2024-03-12T16:10:42.423 INFO:tasks.workunit.client.1.smithi134.stdout:1/402: dread d0/fd [0,4194304] 0 2024-03-12T16:10:42.426 INFO:tasks.workunit.client.0.smithi006.stdout:6/319: getdents d3/d11/d10/d19 0 2024-03-12T16:10:42.426 INFO:tasks.workunit.client.0.smithi006.stdout:1/333: dwrite d0/d25/f2e [0,4194304] 0 2024-03-12T16:10:42.427 INFO:tasks.workunit.client.0.smithi006.stdout:9/331: write d0/d8/d2b/d20/f61 [651145,74599] 0 2024-03-12T16:10:42.427 INFO:tasks.workunit.client.1.smithi134.stdout:3/697: getdents d1/db/d10/d2a 0 2024-03-12T16:10:42.427 INFO:tasks.workunit.client.0.smithi006.stdout:7/435: dwrite de/d1c/f26 [0,4194304] 0 2024-03-12T16:10:42.431 INFO:tasks.workunit.client.1.smithi134.stdout:5/624: dwrite db/d12/f3e [4194304,4194304] 0 2024-03-12T16:10:42.431 INFO:tasks.workunit.client.1.smithi134.stdout:4/495: creat d1/d13/d49/d53/fa2 x:0 0 0 2024-03-12T16:10:42.431 INFO:tasks.workunit.client.1.smithi134.stdout:0/594: read db/d2f/d51/f7c [3818309,84800] 0 2024-03-12T16:10:42.431 INFO:tasks.workunit.client.1.smithi134.stdout:1/403: chown d0/d16/d9/d13/l1a 5 1 2024-03-12T16:10:42.431 INFO:tasks.workunit.client.1.smithi134.stdout:9/538: write d5/d10/d35/f6f [709160,71006] 0 2024-03-12T16:10:42.434 INFO:tasks.workunit.client.0.smithi006.stdout:9/332: creat d0/d1f/f6d x:0 0 0 2024-03-12T16:10:42.434 INFO:tasks.workunit.client.0.smithi006.stdout:9/333: dread - d0/d4/d18/f44 zero size 2024-03-12T16:10:42.434 INFO:tasks.workunit.client.0.smithi006.stdout:9/334: dread - d0/d4/d3b/d4a/f65 zero size 2024-03-12T16:10:42.435 INFO:tasks.workunit.client.1.smithi134.stdout:0/595: fdatasync db/d2f/d31/f59 0 2024-03-12T16:10:42.437 INFO:tasks.workunit.client.0.smithi006.stdout:8/271: creat d2/db/d1a/d21/d4f/f56 x:0 0 0 2024-03-12T16:10:42.439 INFO:tasks.workunit.client.1.smithi134.stdout:3/698: creat d1/db/d12/d9d/d9f/ffa x:0 0 0 2024-03-12T16:10:42.441 INFO:tasks.workunit.client.1.smithi134.stdout:6/546: write d1/da6/d55/d94/f6f [483770,29729] 0 2024-03-12T16:10:42.446 INFO:tasks.workunit.client.1.smithi134.stdout:0/596: rmdir db 39 2024-03-12T16:10:42.446 INFO:tasks.workunit.client.1.smithi134.stdout:3/699: mknod d1/db/d10/d2d/d2e/cfb 0 2024-03-12T16:10:42.447 INFO:tasks.workunit.client.0.smithi006.stdout:6/320: mknod d3/d11/d10/d19/c76 0 2024-03-12T16:10:42.447 INFO:tasks.workunit.client.1.smithi134.stdout:6/547: mknod d1/d16/d4c/cdb 0 2024-03-12T16:10:42.448 INFO:tasks.workunit.client.0.smithi006.stdout:1/334: creat d0/d25/d2a/d43/f72 x:0 0 0 2024-03-12T16:10:42.450 INFO:tasks.workunit.client.1.smithi134.stdout:7/537: dread d8/d27/d9d/d31/d7c/f92 [0,4194304] 0 2024-03-12T16:10:42.450 INFO:tasks.workunit.client.0.smithi006.stdout:1/335: chown d0/d25/d2a/d35 23007432 1 2024-03-12T16:10:42.451 INFO:tasks.workunit.client.0.smithi006.stdout:4/412: truncate d1/db/d17/f1e 2579629 0 2024-03-12T16:10:42.451 INFO:tasks.workunit.client.0.smithi006.stdout:8/272: symlink d2/db/d1a/l57 0 2024-03-12T16:10:42.452 INFO:tasks.workunit.client.1.smithi134.stdout:0/597: chown db/d2f/d31/d56/d66/da5/lbb 0 1 2024-03-12T16:10:42.452 INFO:tasks.workunit.client.1.smithi134.stdout:9/539: getdents d5 0 2024-03-12T16:10:42.452 INFO:tasks.workunit.client.1.smithi134.stdout:4/496: dread d1/d24/d34/d73/f8d [4194304,4194304] 0 2024-03-12T16:10:42.453 INFO:tasks.workunit.client.0.smithi006.stdout:6/321: mknod d3/d11/d10/d19/c77 0 2024-03-12T16:10:42.453 INFO:tasks.workunit.client.1.smithi134.stdout:3/700: symlink d1/d63/dc2/lfc 0 2024-03-12T16:10:42.456 INFO:tasks.workunit.client.1.smithi134.stdout:9/540: fdatasync d5/d10/d6c/f6b 0 2024-03-12T16:10:42.456 INFO:tasks.workunit.client.0.smithi006.stdout:1/336: read d0/d25/d2a/f4d [626671,67452] 0 2024-03-12T16:10:42.457 INFO:tasks.workunit.client.1.smithi134.stdout:0/598: write db/f3c [1799660,14601] 0 2024-03-12T16:10:42.459 INFO:tasks.workunit.client.0.smithi006.stdout:4/413: dwrite d1/db/d1d/f5e [0,4194304] 0 2024-03-12T16:10:42.461 INFO:tasks.workunit.client.0.smithi006.stdout:6/322: dread d3/d11/d10/d1b/d20/f23 [0,4194304] 0 2024-03-12T16:10:42.462 INFO:tasks.workunit.client.1.smithi134.stdout:7/538: rename d8/dc/d20/d26/d36/fb3 to d8/dc/d4b/fb5 0 2024-03-12T16:10:42.464 INFO:tasks.workunit.client.1.smithi134.stdout:9/541: chown d5/d10/c41 790238 1 2024-03-12T16:10:42.465 INFO:tasks.workunit.client.1.smithi134.stdout:7/539: chown d8/d4e/d91/l96 24735221 1 2024-03-12T16:10:42.467 INFO:tasks.workunit.client.1.smithi134.stdout:3/701: link d1/db/d10/d2d/d2e/d72/fc7 d1/d63/d6c/dbf/ffd 0 2024-03-12T16:10:42.467 INFO:tasks.workunit.client.1.smithi134.stdout:5/625: dwrite db/d12/d1d/f31 [0,4194304] 0 2024-03-12T16:10:42.471 INFO:tasks.workunit.client.0.smithi006.stdout:7/436: dread de/d27/d2b/f37 [0,4194304] 0 2024-03-12T16:10:42.471 INFO:tasks.workunit.client.0.smithi006.stdout:7/437: readlink de/d18/d2a/l3f 0 2024-03-12T16:10:42.472 INFO:tasks.workunit.client.1.smithi134.stdout:4/497: truncate d1/d13/d49/f32 4696409 0 2024-03-12T16:10:42.472 INFO:tasks.workunit.client.0.smithi006.stdout:7/438: write de/d7b/f91 [822897,92305] 0 2024-03-12T16:10:42.476 INFO:tasks.workunit.client.1.smithi134.stdout:3/702: creat d1/db/d14/d5a/d89/ffe x:0 0 0 2024-03-12T16:10:42.477 INFO:tasks.workunit.client.1.smithi134.stdout:7/540: creat d8/d27/fb6 x:0 0 0 2024-03-12T16:10:42.479 INFO:tasks.workunit.client.0.smithi006.stdout:8/273: fdatasync d2/d11/f2d 0 2024-03-12T16:10:42.479 INFO:tasks.workunit.client.1.smithi134.stdout:4/498: write d1/d13/f4b [926137,25497] 0 2024-03-12T16:10:42.481 INFO:tasks.workunit.client.1.smithi134.stdout:0/599: dwrite db/f6e [0,4194304] 0 2024-03-12T16:10:42.481 INFO:tasks.workunit.client.1.smithi134.stdout:5/626: creat db/d12/d1d/d5c/fc8 x:0 0 0 2024-03-12T16:10:42.482 INFO:tasks.workunit.client.1.smithi134.stdout:1/404: dwrite d0/d16/f31 [0,4194304] 0 2024-03-12T16:10:42.483 INFO:tasks.workunit.client.0.smithi006.stdout:4/414: write d1/db/d1d/f49 [1145427,53530] 0 2024-03-12T16:10:42.487 INFO:tasks.workunit.client.0.smithi006.stdout:6/323: mkdir d3/d11/d10/d1b/d20/d78 0 2024-03-12T16:10:42.487 INFO:tasks.workunit.client.0.smithi006.stdout:7/439: creat de/d2c/d4f/d83/f95 x:0 0 0 2024-03-12T16:10:42.488 INFO:tasks.workunit.client.1.smithi134.stdout:6/548: write d1/d16/d4c/d58/da0/db7/f4e [1330992,78075] 0 2024-03-12T16:10:42.488 INFO:tasks.workunit.client.0.smithi006.stdout:8/274: symlink d2/db/d1a/d23/l58 0 2024-03-12T16:10:42.491 INFO:tasks.workunit.client.0.smithi006.stdout:1/337: mknod d0/d25/c73 0 2024-03-12T16:10:42.491 INFO:tasks.workunit.client.0.smithi006.stdout:4/415: symlink d1/db/d1d/d2f/l80 0 2024-03-12T16:10:42.492 INFO:tasks.workunit.client.1.smithi134.stdout:4/499: mkdir d1/d13/d49/d64/da3 0 2024-03-12T16:10:42.492 INFO:tasks.workunit.client.1.smithi134.stdout:6/549: chown d1/d16/d4c/d65/d70/dca 13 1 2024-03-12T16:10:42.492 INFO:tasks.workunit.client.1.smithi134.stdout:1/405: mkdir d0/d16/d9/d13/d21/d2f/d8d 0 2024-03-12T16:10:42.493 INFO:tasks.workunit.client.1.smithi134.stdout:1/406: fsync d0/d30/d86/f1d 0 2024-03-12T16:10:42.493 INFO:tasks.workunit.client.0.smithi006.stdout:6/324: write d3/d11/d10/d19/f1f [1050175,63285] 0 2024-03-12T16:10:42.496 INFO:tasks.workunit.client.0.smithi006.stdout:1/338: write d0/d25/d2a/d35/d3f/f5a [918373,24068] 0 2024-03-12T16:10:42.496 INFO:tasks.workunit.client.0.smithi006.stdout:6/325: rename d3/d11 to d3/d11/d3b/d59/d79 22 2024-03-12T16:10:42.497 INFO:tasks.workunit.client.0.smithi006.stdout:4/416: creat d1/db/d39/d42/f81 x:0 0 0 2024-03-12T16:10:42.497 INFO:tasks.workunit.client.1.smithi134.stdout:0/600: unlink db/d2f/d31/c37 0 2024-03-12T16:10:42.500 INFO:tasks.workunit.client.0.smithi006.stdout:6/326: unlink d3/f9 0 2024-03-12T16:10:42.501 INFO:tasks.workunit.client.1.smithi134.stdout:9/542: rename d5/d10/f6a to d5/d10/d35/d49/d54/f9e 0 2024-03-12T16:10:42.502 INFO:tasks.workunit.client.1.smithi134.stdout:5/627: creat db/d12/d1d/d5c/fc9 x:0 0 0 2024-03-12T16:10:42.503 INFO:tasks.workunit.client.0.smithi006.stdout:1/339: mknod d0/d25/d67/c74 0 2024-03-12T16:10:42.503 INFO:tasks.workunit.client.0.smithi006.stdout:7/440: dread de/d27/d2b/f37 [0,4194304] 0 2024-03-12T16:10:42.503 INFO:tasks.workunit.client.1.smithi134.stdout:6/550: chown d1/d3/d10/cc8 1551 1 2024-03-12T16:10:42.503 INFO:tasks.workunit.client.1.smithi134.stdout:5/628: dread - db/d12/d1d/d3a/f67 zero size 2024-03-12T16:10:42.504 INFO:tasks.workunit.client.0.smithi006.stdout:1/340: chown d0/f16 2085 1 2024-03-12T16:10:42.504 INFO:tasks.workunit.client.0.smithi006.stdout:4/417: symlink d1/db/d17/l82 0 2024-03-12T16:10:42.505 INFO:tasks.workunit.client.1.smithi134.stdout:3/703: getdents d1/db/d10/d2d/d30 0 2024-03-12T16:10:42.505 INFO:tasks.workunit.client.0.smithi006.stdout:7/441: readlink ld 0 2024-03-12T16:10:42.506 INFO:tasks.workunit.client.1.smithi134.stdout:7/541: link d8/dc/d20/c48 d8/dc/d20/d26/cb7 0 2024-03-12T16:10:42.507 INFO:tasks.workunit.client.0.smithi006.stdout:4/418: mknod d1/c83 0 2024-03-12T16:10:42.509 INFO:tasks.workunit.client.0.smithi006.stdout:7/442: creat de/d1c/f96 x:0 0 0 2024-03-12T16:10:42.510 INFO:tasks.workunit.client.0.smithi006.stdout:1/341: creat d0/d25/f75 x:0 0 0 2024-03-12T16:10:42.512 INFO:tasks.workunit.client.0.smithi006.stdout:1/342: write d0/f2f [4321648,71885] 0 2024-03-12T16:10:42.512 INFO:tasks.workunit.client.0.smithi006.stdout:7/443: mkdir de/d27/d97 0 2024-03-12T16:10:42.515 INFO:tasks.workunit.client.0.smithi006.stdout:1/343: dread - d0/d25/f2b zero size 2024-03-12T16:10:42.518 INFO:tasks.workunit.client.0.smithi006.stdout:7/444: mkdir de/d98 0 2024-03-12T16:10:42.519 INFO:tasks.workunit.client.0.smithi006.stdout:1/344: unlink d0/c15 0 2024-03-12T16:10:42.521 INFO:tasks.workunit.client.0.smithi006.stdout:1/345: chown d0/d25/d2a/d35/f55 181 1 2024-03-12T16:10:42.525 INFO:tasks.workunit.client.0.smithi006.stdout:8/275: dread d2/f15 [0,4194304] 0 2024-03-12T16:10:42.526 INFO:tasks.workunit.client.0.smithi006.stdout:1/346: fdatasync d0/d25/f2b 0 2024-03-12T16:10:42.532 INFO:tasks.workunit.client.0.smithi006.stdout:1/347: read d0/f16 [321123,26400] 0 2024-03-12T16:10:42.535 INFO:tasks.workunit.client.0.smithi006.stdout:7/445: dwrite de/d18/d2a/f67 [0,4194304] 0 2024-03-12T16:10:42.537 INFO:tasks.workunit.client.0.smithi006.stdout:6/327: dread d3/d11/d10/d19/f39 [0,4194304] 0 2024-03-12T16:10:42.538 INFO:tasks.workunit.client.0.smithi006.stdout:8/276: mknod d2/db/d1a/c59 0 2024-03-12T16:10:42.539 INFO:tasks.workunit.client.0.smithi006.stdout:8/277: stat d2/db/f2e 0 2024-03-12T16:10:42.541 INFO:tasks.workunit.client.0.smithi006.stdout:1/348: dread d0/f13 [0,4194304] 0 2024-03-12T16:10:42.541 INFO:tasks.workunit.client.0.smithi006.stdout:8/278: mkdir d2/d11/d5a 0 2024-03-12T16:10:42.542 INFO:tasks.workunit.client.0.smithi006.stdout:7/446: mknod de/d18/d2a/c99 0 2024-03-12T16:10:42.544 INFO:tasks.workunit.client.0.smithi006.stdout:7/447: fdatasync de/f23 0 2024-03-12T16:10:42.544 INFO:tasks.workunit.client.0.smithi006.stdout:8/279: dread - d2/db/d1a/d21/d4f/f56 zero size 2024-03-12T16:10:42.546 INFO:tasks.workunit.client.1.smithi134.stdout:3/704: mkdir d1/d63/dc2/dff 0 2024-03-12T16:10:42.560 INFO:tasks.workunit.client.1.smithi134.stdout:6/551: getdents d1/d16/d4c/d58/d8e 0 2024-03-12T16:10:42.573 INFO:tasks.workunit.client.0.smithi006.stdout:1/349: dwrite d0/d25/f2e [0,4194304] 0 2024-03-12T16:10:42.574 INFO:tasks.workunit.client.1.smithi134.stdout:3/705: creat d1/db/d14/f100 x:0 0 0 2024-03-12T16:10:42.576 INFO:tasks.workunit.client.0.smithi006.stdout:7/448: unlink de/d1c/f75 0 2024-03-12T16:10:42.578 INFO:tasks.workunit.client.1.smithi134.stdout:3/706: read d1/db/d10/d2d/f9a [4523856,66732] 0 2024-03-12T16:10:42.580 INFO:tasks.workunit.client.0.smithi006.stdout:6/328: getdents d3/d11/d10/d19 0 2024-03-12T16:10:42.591 INFO:tasks.workunit.client.0.smithi006.stdout:6/329: creat d3/d11/d3b/d5d/f7a x:0 0 0 2024-03-12T16:10:42.591 INFO:tasks.workunit.client.0.smithi006.stdout:7/449: symlink de/d2c/d4f/d8a/l9a 0 2024-03-12T16:10:42.601 INFO:tasks.workunit.client.1.smithi134.stdout:6/552: dread d1/da6/d55/d94/d75/f7f [0,4194304] 0 2024-03-12T16:10:42.607 INFO:tasks.workunit.client.1.smithi134.stdout:3/707: dread d1/db/d10/d2d/f5e [0,4194304] 0 2024-03-12T16:10:42.608 INFO:tasks.workunit.client.0.smithi006.stdout:8/280: dread d2/db/f39 [0,4194304] 0 2024-03-12T16:10:42.610 INFO:tasks.workunit.client.0.smithi006.stdout:6/330: dwrite d3/d11/d10/d1b/d20/f75 [0,4194304] 0 2024-03-12T16:10:42.611 INFO:tasks.workunit.client.0.smithi006.stdout:1/350: dwrite d0/d25/d2a/d35/f51 [0,4194304] 0 2024-03-12T16:10:42.612 INFO:tasks.workunit.client.1.smithi134.stdout:4/500: rename d1/d13/d49/d64/d35 to d1/d13/d49/da4 0 2024-03-12T16:10:42.614 INFO:tasks.workunit.client.1.smithi134.stdout:7/542: symlink d8/dc/d20/lb8 0 2024-03-12T16:10:42.615 INFO:tasks.workunit.client.1.smithi134.stdout:4/501: write d1/d13/d49/d64/d28/f9d [342502,128074] 0 2024-03-12T16:10:42.616 INFO:tasks.workunit.client.1.smithi134.stdout:7/543: write d8/dc/d20/d26/f50 [2660771,14085] 0 2024-03-12T16:10:42.616 INFO:tasks.workunit.client.0.smithi006.stdout:8/281: chown d2/c28 676 1 2024-03-12T16:10:42.616 INFO:tasks.workunit.client.0.smithi006.stdout:1/351: symlink d0/l76 0 2024-03-12T16:10:42.618 INFO:tasks.workunit.client.0.smithi006.stdout:6/331: rmdir d3/d11/d10/d28/d45/d60 39 2024-03-12T16:10:42.618 INFO:tasks.workunit.client.1.smithi134.stdout:7/544: write d8/f1f [1984130,73362] 0 2024-03-12T16:10:42.619 INFO:tasks.workunit.client.1.smithi134.stdout:9/543: rename d5/d10/d35/f3a to d5/d10/d35/d49/d54/f9f 0 2024-03-12T16:10:42.620 INFO:tasks.workunit.client.1.smithi134.stdout:9/544: dread - d5/d10/d35/d49/d54/d5e/d82/f8e zero size 2024-03-12T16:10:42.621 INFO:tasks.workunit.client.0.smithi006.stdout:8/282: mknod d2/db/d1a/d1f/c5b 0 2024-03-12T16:10:42.622 INFO:tasks.workunit.client.0.smithi006.stdout:1/352: rename d0/d25/d2a/d43/f60 to d0/d25/d67/f77 0 2024-03-12T16:10:42.622 INFO:tasks.workunit.client.1.smithi134.stdout:7/545: mkdir d8/dc/d55/db9 0 2024-03-12T16:10:42.623 INFO:tasks.workunit.client.1.smithi134.stdout:7/546: chown d8/dc/l6e 125751981 1 2024-03-12T16:10:42.623 INFO:tasks.workunit.client.1.smithi134.stdout:4/502: symlink d1/d13/d49/d53/la5 0 2024-03-12T16:10:42.624 INFO:tasks.workunit.client.0.smithi006.stdout:8/283: fsync d2/db/d1a/d21/f33 0 2024-03-12T16:10:42.625 INFO:tasks.workunit.client.0.smithi006.stdout:6/332: creat d3/d11/d10/f7b x:0 0 0 2024-03-12T16:10:42.626 INFO:tasks.workunit.client.1.smithi134.stdout:5/629: rename db/d12/d1d/d3a/d49/l6a to db/d12/d37/lca 0 2024-03-12T16:10:42.626 INFO:tasks.workunit.client.1.smithi134.stdout:8/530: sync 2024-03-12T16:10:42.627 INFO:tasks.workunit.client.0.smithi006.stdout:1/353: creat d0/d25/d2a/d43/d63/f78 x:0 0 0 2024-03-12T16:10:42.627 INFO:tasks.workunit.client.0.smithi006.stdout:6/333: fsync d3/d11/d43/f46 0 2024-03-12T16:10:42.628 INFO:tasks.workunit.client.1.smithi134.stdout:9/545: symlink d5/d10/d35/d49/d8d/la0 0 2024-03-12T16:10:42.628 INFO:tasks.workunit.client.0.smithi006.stdout:8/284: unlink d2/l4b 0 2024-03-12T16:10:42.629 INFO:tasks.workunit.client.1.smithi134.stdout:5/630: truncate db/d12/d1d/d59/f8b 1734582 0 2024-03-12T16:10:42.630 INFO:tasks.workunit.client.1.smithi134.stdout:8/531: dread - d3/d1b/d17/d25/d33/d15/d95/d5b/f8e zero size 2024-03-12T16:10:42.630 INFO:tasks.workunit.client.0.smithi006.stdout:1/354: symlink d0/d25/d2a/d43/d63/l79 0 2024-03-12T16:10:42.631 INFO:tasks.workunit.client.1.smithi134.stdout:5/631: chown db/f6d 0 1 2024-03-12T16:10:42.632 INFO:tasks.workunit.client.0.smithi006.stdout:8/285: creat d2/db/d1a/d21/d4f/f5c x:0 0 0 2024-03-12T16:10:42.632 INFO:tasks.workunit.client.1.smithi134.stdout:7/547: symlink d8/d4e/d91/lba 0 2024-03-12T16:10:42.633 INFO:tasks.workunit.client.0.smithi006.stdout:7/450: dread de/f23 [4194304,4194304] 0 2024-03-12T16:10:42.634 INFO:tasks.workunit.client.0.smithi006.stdout:1/355: creat d0/d25/d2a/d64/f7a x:0 0 0 2024-03-12T16:10:42.635 INFO:tasks.workunit.client.1.smithi134.stdout:6/553: rename d1/d3/d19/f36 to d1/d16/d4c/d65/d70/dca/fdc 0 2024-03-12T16:10:42.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/503: creat d1/de/d90/fa6 x:0 0 0 2024-03-12T16:10:42.640 INFO:tasks.workunit.client.0.smithi006.stdout:8/286: link d2/c8 d2/db/c5d 0 2024-03-12T16:10:42.641 INFO:tasks.workunit.client.1.smithi134.stdout:8/532: creat d3/d1b/d17/d25/d33/d15/d95/d5b/da7/fb5 x:0 0 0 2024-03-12T16:10:42.642 INFO:tasks.workunit.client.1.smithi134.stdout:9/546: dwrite d5/d10/d1f/f4b [0,4194304] 0 2024-03-12T16:10:42.643 INFO:tasks.workunit.client.1.smithi134.stdout:4/504: chown d1/d13/d49/l8a 231 1 2024-03-12T16:10:42.643 INFO:tasks.workunit.client.0.smithi006.stdout:1/356: dwrite d0/f21 [0,4194304] 0 2024-03-12T16:10:42.644 INFO:tasks.workunit.client.1.smithi134.stdout:5/632: dwrite db/f6d [0,4194304] 0 2024-03-12T16:10:42.645 INFO:tasks.workunit.client.1.smithi134.stdout:3/708: rename d1/d63/d6c/cd2 to d1/db/d10/d2a/dc6/df1/c101 0 2024-03-12T16:10:42.645 INFO:tasks.workunit.client.0.smithi006.stdout:6/334: truncate d3/d11/d10/d28/d45/d60/f61 105 0 2024-03-12T16:10:42.646 INFO:tasks.workunit.client.0.smithi006.stdout:6/335: chown d3/d11/d43 486020592 1 2024-03-12T16:10:42.646 INFO:tasks.workunit.client.0.smithi006.stdout:1/357: creat d0/d25/d2a/d43/d63/f7b x:0 0 0 2024-03-12T16:10:42.647 INFO:tasks.workunit.client.0.smithi006.stdout:7/451: write de/d27/f2d [2108956,127485] 0 2024-03-12T16:10:42.649 INFO:tasks.workunit.client.1.smithi134.stdout:8/533: write d3/d1b/d17/d25/d33/d96/fa4 [917148,66987] 0 2024-03-12T16:10:42.649 INFO:tasks.workunit.client.1.smithi134.stdout:6/554: truncate d1/f78 283517 0 2024-03-12T16:10:42.650 INFO:tasks.workunit.client.0.smithi006.stdout:6/336: mkdir d3/d11/d10/d1b/d20/d7c 0 2024-03-12T16:10:42.652 INFO:tasks.workunit.client.0.smithi006.stdout:1/358: write d0/d25/d2a/d43/f47 [1588318,30643] 0 2024-03-12T16:10:42.653 INFO:tasks.workunit.client.1.smithi134.stdout:9/547: write d5/d10/d35/d49/d74/f78 [847845,109822] 0 2024-03-12T16:10:42.660 INFO:tasks.workunit.client.0.smithi006.stdout:6/337: mknod d3/c7d 0 2024-03-12T16:10:42.660 INFO:tasks.workunit.client.0.smithi006.stdout:1/359: symlink d0/d25/d2a/d43/d68/l7c 0 2024-03-12T16:10:42.661 INFO:tasks.workunit.client.0.smithi006.stdout:1/360: fdatasync d0/f34 0 2024-03-12T16:10:42.661 INFO:tasks.workunit.client.1.smithi134.stdout:3/709: symlink d1/d63/l102 0 2024-03-12T16:10:42.661 INFO:tasks.workunit.client.1.smithi134.stdout:6/555: rmdir d1/d16/d4c/d58/da0/db7 39 2024-03-12T16:10:42.661 INFO:tasks.workunit.client.1.smithi134.stdout:9/548: mkdir d5/d10/d33/da1 0 2024-03-12T16:10:42.662 INFO:tasks.workunit.client.1.smithi134.stdout:7/548: truncate d8/f1a 2103955 0 2024-03-12T16:10:42.662 INFO:tasks.workunit.client.1.smithi134.stdout:9/549: dread - d5/d10/f9b zero size 2024-03-12T16:10:42.663 INFO:tasks.workunit.client.0.smithi006.stdout:1/361: chown d0/d25/d2a/d35 456 1 2024-03-12T16:10:42.663 INFO:tasks.workunit.client.1.smithi134.stdout:8/534: mkdir d3/d1b/d17/d24/db6 0 2024-03-12T16:10:42.665 INFO:tasks.workunit.client.0.smithi006.stdout:7/452: dwrite de/d18/f1f [0,4194304] 0 2024-03-12T16:10:42.665 INFO:tasks.workunit.client.1.smithi134.stdout:3/710: mkdir d1/db/d12/d9d/d9f/d103 0 2024-03-12T16:10:42.666 INFO:tasks.workunit.client.1.smithi134.stdout:4/505: dwrite d1/d13/f26 [4194304,4194304] 0 2024-03-12T16:10:42.668 INFO:tasks.workunit.client.0.smithi006.stdout:7/453: write de/d27/d2b/d4a/d6a/f79 [586983,13921] 0 2024-03-12T16:10:42.668 INFO:tasks.workunit.client.1.smithi134.stdout:6/556: dread - d1/d16/d4c/d58/da0/fcd zero size 2024-03-12T16:10:42.670 INFO:tasks.workunit.client.1.smithi134.stdout:5/633: rmdir db/d12/d1d/d59/d94/dba 0 2024-03-12T16:10:42.670 INFO:tasks.workunit.client.1.smithi134.stdout:3/711: dread d1/db/d10/d2d/d2e/fb2 [0,4194304] 0 2024-03-12T16:10:42.670 INFO:tasks.workunit.client.0.smithi006.stdout:6/338: dwrite d3/d11/d10/d19/f6a [4194304,4194304] 0 2024-03-12T16:10:42.672 INFO:tasks.workunit.client.1.smithi134.stdout:3/712: write d1/db/d12/f7a [1590972,127813] 0 2024-03-12T16:10:42.672 INFO:tasks.workunit.client.0.smithi006.stdout:6/339: write d3/d11/d43/f5e [495750,87850] 0 2024-03-12T16:10:42.674 INFO:tasks.workunit.client.1.smithi134.stdout:3/713: stat d1/db/d14/f59 0 2024-03-12T16:10:42.676 INFO:tasks.workunit.client.1.smithi134.stdout:9/550: rmdir d5/d10/d35/d49/d54/d93 39 2024-03-12T16:10:42.677 INFO:tasks.workunit.client.1.smithi134.stdout:8/535: fsync d3/d1b/f19 0 2024-03-12T16:10:42.683 INFO:tasks.workunit.client.1.smithi134.stdout:5/634: symlink db/d12/d1d/d59/d94/lcb 0 2024-03-12T16:10:42.686 INFO:tasks.workunit.client.0.smithi006.stdout:7/454: write de/d27/f56 [4646729,34198] 0 2024-03-12T16:10:42.687 INFO:tasks.workunit.client.1.smithi134.stdout:6/557: creat d1/da6/d55/fdd x:0 0 0 2024-03-12T16:10:42.687 INFO:tasks.workunit.client.1.smithi134.stdout:4/506: mknod d1/d24/d34/d8e/ca7 0 2024-03-12T16:10:42.687 INFO:tasks.workunit.client.0.smithi006.stdout:7/455: chown de/d1c/d35 215 1 2024-03-12T16:10:42.688 INFO:tasks.workunit.client.1.smithi134.stdout:9/551: rename d5/l16 to d5/d10/d6c/la2 0 2024-03-12T16:10:42.689 INFO:tasks.workunit.client.1.smithi134.stdout:5/635: read - db/d12/d29/f9a zero size 2024-03-12T16:10:42.690 INFO:tasks.workunit.client.1.smithi134.stdout:6/558: chown d1/c12 1454885 1 2024-03-12T16:10:42.690 INFO:tasks.workunit.client.0.smithi006.stdout:7/456: creat de/d98/f9b x:0 0 0 2024-03-12T16:10:42.691 INFO:tasks.workunit.client.1.smithi134.stdout:8/536: creat d3/d1b/d17/d25/d33/d15/d7e/fb7 x:0 0 0 2024-03-12T16:10:42.691 INFO:tasks.workunit.client.0.smithi006.stdout:7/457: mkdir de/d18/d9c 0 2024-03-12T16:10:42.692 INFO:tasks.workunit.client.1.smithi134.stdout:4/507: fsync d1/d24/d34/f88 0 2024-03-12T16:10:42.693 INFO:tasks.workunit.client.1.smithi134.stdout:5/636: creat db/d12/d37/db4/fcc x:0 0 0 2024-03-12T16:10:42.694 INFO:tasks.workunit.client.1.smithi134.stdout:6/559: fdatasync d1/da6/d55/d94/d75/f7f 0 2024-03-12T16:10:42.695 INFO:tasks.workunit.client.1.smithi134.stdout:5/637: fdatasync db/d12/d1d/d5c/fc9 0 2024-03-12T16:10:42.697 INFO:tasks.workunit.client.1.smithi134.stdout:5/638: chown db/d12/d1d/d59/d94/c52 13124 1 2024-03-12T16:10:42.698 INFO:tasks.workunit.client.1.smithi134.stdout:4/508: symlink d1/d13/la8 0 2024-03-12T16:10:42.699 INFO:tasks.workunit.client.0.smithi006.stdout:7/458: dwrite de/d98/f9b [0,4194304] 0 2024-03-12T16:10:42.699 INFO:tasks.workunit.client.1.smithi134.stdout:6/560: rmdir d1/d16/d4c/d65/d70/dca 39 2024-03-12T16:10:42.701 INFO:tasks.workunit.client.1.smithi134.stdout:4/509: dread - d1/d13/d49/d64/d28/d4f/f9c zero size 2024-03-12T16:10:42.702 INFO:tasks.workunit.client.0.smithi006.stdout:7/459: creat de/d18/d9c/f9d x:0 0 0 2024-03-12T16:10:42.703 INFO:tasks.workunit.client.1.smithi134.stdout:6/561: mknod d1/da6/d55/d94/d75/cde 0 2024-03-12T16:10:42.705 INFO:tasks.workunit.client.0.smithi006.stdout:7/460: write de/d27/d2b/f65 [296145,97242] 0 2024-03-12T16:10:42.706 INFO:tasks.workunit.client.1.smithi134.stdout:4/510: unlink d1/d24/f19 0 2024-03-12T16:10:42.706 INFO:tasks.workunit.client.0.smithi006.stdout:6/340: dread f1 [0,4194304] 0 2024-03-12T16:10:42.707 INFO:tasks.workunit.client.0.smithi006.stdout:7/461: chown de/d27/d2b/c54 207 1 2024-03-12T16:10:42.709 INFO:tasks.workunit.client.0.smithi006.stdout:6/341: mkdir d3/d11/d10/d28/d45/d60/d7e 0 2024-03-12T16:10:42.711 INFO:tasks.workunit.client.1.smithi134.stdout:7/549: truncate d8/d4e/f74 380760 0 2024-03-12T16:10:42.712 INFO:tasks.workunit.client.1.smithi134.stdout:8/537: write d3/d1b/f19 [1389601,90204] 0 2024-03-12T16:10:42.715 INFO:tasks.workunit.client.0.smithi006.stdout:7/462: dwrite de/d27/d2b/d4a/d6a/f79 [0,4194304] 0 2024-03-12T16:10:42.715 INFO:tasks.workunit.client.1.smithi134.stdout:4/511: chown d1/d24/d34/c37 1 1 2024-03-12T16:10:42.715 INFO:tasks.workunit.client.1.smithi134.stdout:4/512: write d1/d13/f93 [458142,106090] 0 2024-03-12T16:10:42.719 INFO:tasks.workunit.client.0.smithi006.stdout:6/342: dread d3/d11/f15 [0,4194304] 0 2024-03-12T16:10:42.720 INFO:tasks.workunit.client.1.smithi134.stdout:3/714: write d1/d63/d6c/f98 [3025579,120484] 0 2024-03-12T16:10:42.720 INFO:tasks.workunit.client.1.smithi134.stdout:5/639: link db/d12/l46 db/d12/d1d/d3a/d49/lcd 0 2024-03-12T16:10:42.720 INFO:tasks.workunit.client.0.smithi006.stdout:6/343: chown d3/d11/d10/d28/f56 1807378059 1 2024-03-12T16:10:42.722 INFO:tasks.workunit.client.0.smithi006.stdout:6/344: creat d3/d47/f7f x:0 0 0 2024-03-12T16:10:42.725 INFO:tasks.workunit.client.1.smithi134.stdout:8/538: rename d3/d1b/d17/d25/d33/d15/d95/d4f/l91 to d3/d10/lb8 0 2024-03-12T16:10:42.729 INFO:tasks.workunit.client.1.smithi134.stdout:3/715: mkdir d1/db/d104 0 2024-03-12T16:10:42.730 INFO:tasks.workunit.client.1.smithi134.stdout:9/552: stat d5/d10/d6c/l94 0 2024-03-12T16:10:42.732 INFO:tasks.workunit.client.1.smithi134.stdout:5/640: dwrite db/d12/d37/f39 [0,4194304] 0 2024-03-12T16:10:42.738 INFO:tasks.workunit.client.1.smithi134.stdout:9/553: creat d5/d20/d47/fa3 x:0 0 0 2024-03-12T16:10:42.743 INFO:tasks.workunit.client.1.smithi134.stdout:8/539: rename d3/d1b/d17/d25/d33/d15/d95/d4f/f3d to d3/d1b/d17/d25/d33/d15/d95/d5b/fb9 0 2024-03-12T16:10:42.746 INFO:tasks.workunit.client.1.smithi134.stdout:3/716: dwrite d1/ff3 [0,4194304] 0 2024-03-12T16:10:42.750 INFO:tasks.workunit.client.1.smithi134.stdout:3/717: readlink d1/db/d10/daf/ld1 0 2024-03-12T16:10:42.754 INFO:tasks.workunit.client.1.smithi134.stdout:5/641: dwrite db/d12/d1d/d3a/f88 [0,4194304] 0 2024-03-12T16:10:42.756 INFO:tasks.workunit.client.1.smithi134.stdout:6/562: dwrite d1/d3/d19/f1f [4194304,4194304] 0 2024-03-12T16:10:42.757 INFO:tasks.workunit.client.1.smithi134.stdout:4/513: dread d1/d13/d49/d64/d28/f3b [0,4194304] 0 2024-03-12T16:10:42.758 INFO:tasks.workunit.client.1.smithi134.stdout:9/554: getdents d5/d20/d47 0 2024-03-12T16:10:42.766 INFO:tasks.workunit.client.1.smithi134.stdout:7/550: dwrite d8/d27/f59 [0,4194304] 0 2024-03-12T16:10:42.766 INFO:tasks.workunit.client.1.smithi134.stdout:6/563: write d1/f5 [1230405,74862] 0 2024-03-12T16:10:42.768 INFO:tasks.workunit.client.1.smithi134.stdout:3/718: creat d1/db/d10/d2d/f105 x:0 0 0 2024-03-12T16:10:42.772 INFO:tasks.workunit.client.1.smithi134.stdout:9/555: rename d5/d10/l4e to d5/d10/d33/da1/la4 0 2024-03-12T16:10:42.774 INFO:tasks.workunit.client.1.smithi134.stdout:3/719: write d1/fb5 [859081,105446] 0 2024-03-12T16:10:42.774 INFO:tasks.workunit.client.1.smithi134.stdout:6/564: rmdir d1/d16/d4c/d58 39 2024-03-12T16:10:42.777 INFO:tasks.workunit.client.1.smithi134.stdout:5/642: dread db/d7a/d97/fad [0,4194304] 0 2024-03-12T16:10:42.778 INFO:tasks.workunit.client.1.smithi134.stdout:8/540: dwrite d3/d1b/d17/d25/d33/f8f [0,4194304] 0 2024-03-12T16:10:42.780 INFO:tasks.workunit.client.1.smithi134.stdout:2/529: sync 2024-03-12T16:10:42.781 INFO:tasks.workunit.client.1.smithi134.stdout:6/565: readlink d1/d16/d4c/d58/l5d 0 2024-03-12T16:10:42.783 INFO:tasks.workunit.client.1.smithi134.stdout:3/720: chown d1/db/d10/d2d/d2e/f6a 224 1 2024-03-12T16:10:42.785 INFO:tasks.workunit.client.1.smithi134.stdout:5/643: truncate db/f38 1602007 0 2024-03-12T16:10:42.786 INFO:tasks.workunit.client.1.smithi134.stdout:7/551: dread d8/dc/d55/d57/f83 [0,4194304] 0 2024-03-12T16:10:42.787 INFO:tasks.workunit.client.1.smithi134.stdout:9/556: getdents d5/d10/d51 0 2024-03-12T16:10:42.788 INFO:tasks.workunit.client.1.smithi134.stdout:5/644: chown db/l30 3 1 2024-03-12T16:10:42.788 INFO:tasks.workunit.client.1.smithi134.stdout:6/566: mkdir d1/da6/d55/d85/ddf 0 2024-03-12T16:10:42.788 INFO:tasks.workunit.client.1.smithi134.stdout:8/541: readlink d3/d1b/l36 0 2024-03-12T16:10:42.791 INFO:tasks.workunit.client.1.smithi134.stdout:4/514: dwrite d1/d13/d49/d6d/d96/f9e [0,4194304] 0 2024-03-12T16:10:42.793 INFO:tasks.workunit.client.1.smithi134.stdout:9/557: readlink d5/d20/d72/l7d 0 2024-03-12T16:10:42.796 INFO:tasks.workunit.client.1.smithi134.stdout:7/552: mkdir d8/dc/d7b/dbb 0 2024-03-12T16:10:42.797 INFO:tasks.workunit.client.1.smithi134.stdout:5/645: write db/d12/d37/d73/d8c/faa [119610,112069] 0 2024-03-12T16:10:42.800 INFO:tasks.workunit.client.1.smithi134.stdout:4/515: write d1/de/d90/fa6 [757163,50935] 0 2024-03-12T16:10:42.800 INFO:tasks.workunit.client.1.smithi134.stdout:5/646: fdatasync db/d12/d1d/f51 0 2024-03-12T16:10:42.801 INFO:tasks.workunit.client.1.smithi134.stdout:8/542: truncate d3/d1b/d17/d3f/f52 2079455 0 2024-03-12T16:10:42.803 INFO:tasks.workunit.client.1.smithi134.stdout:8/543: dread - d3/f9e zero size 2024-03-12T16:10:42.804 INFO:tasks.workunit.client.1.smithi134.stdout:5/647: chown db/f27 49 1 2024-03-12T16:10:42.805 INFO:tasks.workunit.client.1.smithi134.stdout:3/721: rename d1/db/d10/fb9 to d1/db/d14/f106 0 2024-03-12T16:10:42.806 INFO:tasks.workunit.client.1.smithi134.stdout:7/553: symlink d8/dc/d55/d81/d87/lbc 0 2024-03-12T16:10:42.807 INFO:tasks.workunit.client.1.smithi134.stdout:3/722: read d1/db/d10/d2d/f5e [4114942,105976] 0 2024-03-12T16:10:42.808 INFO:tasks.workunit.client.1.smithi134.stdout:7/554: dread - d8/d4e/d91/fb0 zero size 2024-03-12T16:10:42.811 INFO:tasks.workunit.client.1.smithi134.stdout:7/555: dread - d8/dc/d20/faf zero size 2024-03-12T16:10:42.811 INFO:tasks.workunit.client.1.smithi134.stdout:9/558: truncate d5/d20/f27 4114878 0 2024-03-12T16:10:42.813 INFO:tasks.workunit.client.1.smithi134.stdout:3/723: creat d1/d63/f107 x:0 0 0 2024-03-12T16:10:42.813 INFO:tasks.workunit.client.0.smithi006.stdout:2/361: sync 2024-03-12T16:10:42.814 INFO:tasks.workunit.client.1.smithi134.stdout:2/530: dread d4/f24 [0,4194304] 0 2024-03-12T16:10:42.814 INFO:tasks.workunit.client.1.smithi134.stdout:7/556: dread - d8/dc/d55/fa6 zero size 2024-03-12T16:10:42.814 INFO:tasks.workunit.client.1.smithi134.stdout:8/544: dwrite d3/d1b/f2a [0,4194304] 0 2024-03-12T16:10:42.816 INFO:tasks.workunit.client.0.smithi006.stdout:2/362: write d0/d13/d49/d60/f32 [2471607,43212] 0 2024-03-12T16:10:42.816 INFO:tasks.workunit.client.1.smithi134.stdout:9/559: truncate d5/d10/f81 271263 0 2024-03-12T16:10:42.817 INFO:tasks.workunit.client.0.smithi006.stdout:2/363: truncate d0/d13/d49/f73 421007 0 2024-03-12T16:10:42.817 INFO:tasks.workunit.client.0.smithi006.stdout:2/364: fdatasync d0/f40 0 2024-03-12T16:10:42.818 INFO:tasks.workunit.client.1.smithi134.stdout:9/560: chown d5/d20/d47/fa3 10466 1 2024-03-12T16:10:42.819 INFO:tasks.workunit.client.0.smithi006.stdout:2/365: fdatasync d0/d13/d49/d60/f14 0 2024-03-12T16:10:42.819 INFO:tasks.workunit.client.1.smithi134.stdout:9/561: fsync d5/d10/d51/f97 0 2024-03-12T16:10:42.820 INFO:tasks.workunit.client.1.smithi134.stdout:8/545: write d3/d1b/d17/d25/d33/f72 [1177931,129121] 0 2024-03-12T16:10:42.822 INFO:tasks.workunit.client.1.smithi134.stdout:8/546: readlink d3/d10/d31/l55 0 2024-03-12T16:10:42.823 INFO:tasks.workunit.client.1.smithi134.stdout:9/562: read - d5/d10/d6c/f6b zero size 2024-03-12T16:10:42.825 INFO:tasks.workunit.client.1.smithi134.stdout:9/563: dread - d5/d20/d72/f9c zero size 2024-03-12T16:10:42.825 INFO:tasks.workunit.client.1.smithi134.stdout:2/531: rename d4/d12/daf/lb9 to d4/d12/d1d/d34/lbd 0 2024-03-12T16:10:42.825 INFO:tasks.workunit.client.1.smithi134.stdout:8/547: fdatasync d3/d1b/d17/d25/d33/d15/d95/d5b/da7/fb5 0 2024-03-12T16:10:42.826 INFO:tasks.workunit.client.1.smithi134.stdout:7/557: mkdir d8/dc/d7b/dbb/dbd 0 2024-03-12T16:10:42.827 INFO:tasks.workunit.client.0.smithi006.stdout:2/366: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:42.828 INFO:tasks.workunit.client.0.smithi006.stdout:2/367: readlink d0/d13/d49/l55 0 2024-03-12T16:10:42.828 INFO:tasks.workunit.client.1.smithi134.stdout:8/548: dread - d3/d1b/d17/d25/d33/d15/d95/d4f/fa8 zero size 2024-03-12T16:10:42.831 INFO:tasks.workunit.client.1.smithi134.stdout:7/558: mknod d8/dc/d7b/cbe 0 2024-03-12T16:10:42.831 INFO:tasks.workunit.client.1.smithi134.stdout:8/549: write d3/d1b/d17/d25/d33/d15/d95/d4f/fa8 [879365,28873] 0 2024-03-12T16:10:42.832 INFO:tasks.workunit.client.1.smithi134.stdout:9/564: mknod d5/d10/d35/d49/d54/ca5 0 2024-03-12T16:10:42.833 INFO:tasks.workunit.client.0.smithi006.stdout:2/368: mknod d0/d13/d49/d60/d2b/d62/d66/c75 0 2024-03-12T16:10:42.833 INFO:tasks.workunit.client.1.smithi134.stdout:8/550: write d3/d1b/d17/d3f/f52 [1744333,120367] 0 2024-03-12T16:10:42.834 INFO:tasks.workunit.client.1.smithi134.stdout:2/532: rmdir d4/d12/d1d/d89 0 2024-03-12T16:10:42.835 INFO:tasks.workunit.client.1.smithi134.stdout:9/565: truncate d5/d10/d1f/f6e 161201 0 2024-03-12T16:10:42.836 INFO:tasks.workunit.client.0.smithi006.stdout:2/369: symlink d0/d13/d49/d60/d2b/l76 0 2024-03-12T16:10:42.836 INFO:tasks.workunit.client.1.smithi134.stdout:2/533: write d4/d12/f48 [1344146,79046] 0 2024-03-12T16:10:42.836 INFO:tasks.workunit.client.0.smithi006.stdout:2/370: fsync d0/d13/d49/d60/f53 0 2024-03-12T16:10:42.839 INFO:tasks.workunit.client.1.smithi134.stdout:7/559: creat d8/dc/d4b/d97/fbf x:0 0 0 2024-03-12T16:10:42.840 INFO:tasks.workunit.client.1.smithi134.stdout:2/534: truncate d4/d12/d3b/d3f/f45 637553 0 2024-03-12T16:10:42.840 INFO:tasks.workunit.client.0.smithi006.stdout:2/371: mkdir d0/d13/d49/d60/d2b/d62/d66/d67/d6a/d77 0 2024-03-12T16:10:42.840 INFO:tasks.workunit.client.0.smithi006.stdout:2/372: dread - d0/d13/d49/d60/d2b/f6b zero size 2024-03-12T16:10:42.841 INFO:tasks.workunit.client.1.smithi134.stdout:9/566: chown d5/d10/d35/d49/d54/d88/l8b 38470681 1 2024-03-12T16:10:42.842 INFO:tasks.workunit.client.0.smithi006.stdout:2/373: fdatasync d0/dc/f1a 0 2024-03-12T16:10:42.842 INFO:tasks.workunit.client.1.smithi134.stdout:8/551: link d3/f9e d3/d10/fba 0 2024-03-12T16:10:42.846 INFO:tasks.workunit.client.1.smithi134.stdout:9/567: dread - d5/d10/f95 zero size 2024-03-12T16:10:42.846 INFO:tasks.workunit.client.1.smithi134.stdout:3/724: dread d1/db/d14/fd4 [0,4194304] 0 2024-03-12T16:10:42.848 INFO:tasks.workunit.client.1.smithi134.stdout:8/552: getdents d3/d10/d31/d88 0 2024-03-12T16:10:42.848 INFO:tasks.workunit.client.0.smithi006.stdout:2/374: dwrite d0/dc/f1a [0,4194304] 0 2024-03-12T16:10:42.849 INFO:tasks.workunit.client.1.smithi134.stdout:8/553: stat d3/d1b/d17/d25/d33/d96 0 2024-03-12T16:10:42.850 INFO:tasks.workunit.client.1.smithi134.stdout:9/568: symlink d5/d10/d33/da1/la6 0 2024-03-12T16:10:42.850 INFO:tasks.workunit.client.1.smithi134.stdout:6/567: dread d1/d3/d19/d32/d4a/f7a [0,4194304] 0 2024-03-12T16:10:42.850 INFO:tasks.workunit.client.0.smithi006.stdout:2/375: write d0/d13/d49/d60/d2b/f63 [1275954,67744] 0 2024-03-12T16:10:42.853 INFO:tasks.workunit.client.0.smithi006.stdout:2/376: symlink d0/d13/d49/d60/d2b/l78 0 2024-03-12T16:10:42.854 INFO:tasks.workunit.client.0.smithi006.stdout:2/377: rmdir d0/d13 39 2024-03-12T16:10:42.855 INFO:tasks.workunit.client.1.smithi134.stdout:9/569: write d5/d10/d35/d49/d54/f9f [5046805,130710] 0 2024-03-12T16:10:42.857 INFO:tasks.workunit.client.0.smithi006.stdout:2/378: chown d0/d13/d49/d60/d2b/d62/d66/d69 0 1 2024-03-12T16:10:42.860 INFO:tasks.workunit.client.0.smithi006.stdout:2/379: mkdir d0/d13/d49/d60/d2b/d62/d79 0 2024-03-12T16:10:42.861 INFO:tasks.workunit.client.1.smithi134.stdout:6/568: dwrite d1/d3/d19/f1f [0,4194304] 0 2024-03-12T16:10:42.863 INFO:tasks.workunit.client.0.smithi006.stdout:2/380: mknod d0/d13/d49/d60/d2b/d62/d66/d67/d6a/d77/c7a 0 2024-03-12T16:10:42.866 INFO:tasks.workunit.client.1.smithi134.stdout:8/554: truncate d3/d1b/f2a 2283879 0 2024-03-12T16:10:42.867 INFO:tasks.workunit.client.1.smithi134.stdout:2/535: dwrite d4/d12/d1d/d34/fa0 [0,4194304] 0 2024-03-12T16:10:42.867 INFO:tasks.workunit.client.0.smithi006.stdout:2/381: rename d0/d13/d49/d60/l41 to d0/d13/d49/d60/d2b/d62/d79/l7b 0 2024-03-12T16:10:42.869 INFO:tasks.workunit.client.1.smithi134.stdout:2/536: write d4/d12/f32 [1437901,83776] 0 2024-03-12T16:10:42.869 INFO:tasks.workunit.client.1.smithi134.stdout:8/555: write d3/d1b/d17/d25/d33/d15/d7e/fb7 [246443,8911] 0 2024-03-12T16:10:42.870 INFO:tasks.workunit.client.0.smithi006.stdout:2/382: creat d0/d13/f7c x:0 0 0 2024-03-12T16:10:42.872 INFO:tasks.workunit.client.1.smithi134.stdout:2/537: mkdir d4/d84/d7d/dbe 0 2024-03-12T16:10:42.873 INFO:tasks.workunit.client.1.smithi134.stdout:8/556: rmdir d3/d1b/d17/d25/d33/d15/d7e 39 2024-03-12T16:10:42.875 INFO:tasks.workunit.client.1.smithi134.stdout:8/557: stat d3/d1b/d17/d25/d33/d15/d95/d4f/fa1 0 2024-03-12T16:10:42.876 INFO:tasks.workunit.client.1.smithi134.stdout:3/725: dread d1/db/d10/d2d/d30/fc9 [0,4194304] 0 2024-03-12T16:10:42.878 INFO:tasks.workunit.client.1.smithi134.stdout:8/558: mknod d3/d82/cbb 0 2024-03-12T16:10:42.879 INFO:tasks.workunit.client.0.smithi006.stdout:2/383: dwrite d0/d13/f7c [0,4194304] 0 2024-03-12T16:10:42.881 INFO:tasks.workunit.client.0.smithi006.stdout:2/384: write d0/d13/d49/d60/f32 [859690,47195] 0 2024-03-12T16:10:42.882 INFO:tasks.workunit.client.1.smithi134.stdout:8/559: link d3/d82/cbb d3/d1b/d17/d24/db6/cbc 0 2024-03-12T16:10:42.885 INFO:tasks.workunit.client.0.smithi006.stdout:2/385: symlink d0/d13/d49/d60/d2b/d62/d66/d69/l7d 0 2024-03-12T16:10:42.889 INFO:tasks.workunit.client.1.smithi134.stdout:3/726: dread d1/db/d12/d9d/fc0 [0,4194304] 0 2024-03-12T16:10:42.892 INFO:tasks.workunit.client.0.smithi006.stdout:2/386: dread d0/d13/d49/d60/f32 [0,4194304] 0 2024-03-12T16:10:42.892 INFO:tasks.workunit.client.1.smithi134.stdout:8/560: rename d3/d1b/d17/d25/d33/d15/d95/d6d/da0 to d3/d1b/d17/d25/d33/d96/dbd 0 2024-03-12T16:10:42.893 INFO:tasks.workunit.client.0.smithi006.stdout:2/387: chown d0/d13/d49/d60/d2b/c68 1887548 1 2024-03-12T16:10:42.894 INFO:tasks.workunit.client.1.smithi134.stdout:2/538: write d4/d12/d1d/d34/d58/fa3 [2341275,121852] 0 2024-03-12T16:10:42.895 INFO:tasks.workunit.client.1.smithi134.stdout:2/539: chown d4/d12/d1d/f21 8144754 1 2024-03-12T16:10:42.896 INFO:tasks.workunit.client.1.smithi134.stdout:3/727: mknod d1/db/d12/d9d/dc5/dec/c108 0 2024-03-12T16:10:42.897 INFO:tasks.workunit.client.0.smithi006.stdout:2/388: dread d0/d13/d49/d60/f32 [0,4194304] 0 2024-03-12T16:10:42.897 INFO:tasks.workunit.client.1.smithi134.stdout:8/561: creat d3/db0/fbe x:0 0 0 2024-03-12T16:10:42.898 INFO:tasks.workunit.client.1.smithi134.stdout:3/728: chown d1/db/d12/l47 0 1 2024-03-12T16:10:42.899 INFO:tasks.workunit.client.1.smithi134.stdout:8/562: mkdir d3/d10/dbf 0 2024-03-12T16:10:42.900 INFO:tasks.workunit.client.1.smithi134.stdout:2/540: dread d4/f24 [0,4194304] 0 2024-03-12T16:10:42.901 INFO:tasks.workunit.client.1.smithi134.stdout:3/729: truncate d1/d63/d6c/f6d 3353858 0 2024-03-12T16:10:42.904 INFO:tasks.workunit.client.1.smithi134.stdout:8/563: rename d3/d1b/d17/d25/c6a to d3/d1b/d17/d25/d33/d15/d95/d4f/cc0 0 2024-03-12T16:10:42.905 INFO:tasks.workunit.client.0.smithi006.stdout:2/389: dread d0/f40 [0,4194304] 0 2024-03-12T16:10:42.905 INFO:tasks.workunit.client.1.smithi134.stdout:3/730: mkdir d1/db/d10/d2d/d109 0 2024-03-12T16:10:42.906 INFO:tasks.workunit.client.1.smithi134.stdout:8/564: rmdir d3/d1b/d17 39 2024-03-12T16:10:42.906 INFO:tasks.workunit.client.1.smithi134.stdout:8/565: stat d3/d10/d31 0 2024-03-12T16:10:42.908 INFO:tasks.workunit.client.1.smithi134.stdout:8/566: mknod d3/d10/dbf/cc1 0 2024-03-12T16:10:42.911 INFO:tasks.workunit.client.1.smithi134.stdout:8/567: creat d3/d10/d31/fc2 x:0 0 0 2024-03-12T16:10:42.911 INFO:tasks.workunit.client.0.smithi006.stdout:2/390: dwrite d0/f12 [0,4194304] 0 2024-03-12T16:10:42.912 INFO:tasks.workunit.client.1.smithi134.stdout:8/568: fsync d3/d1b/d17/d24/f6f 0 2024-03-12T16:10:42.915 INFO:tasks.workunit.client.1.smithi134.stdout:8/569: creat d3/d1b/d17/d24/d28/fc3 x:0 0 0 2024-03-12T16:10:42.917 INFO:tasks.workunit.client.0.smithi006.stdout:2/391: link d0/d13/d49/d60/c19 d0/d13/d49/d60/d2b/d62/d66/d67/d6a/d77/c7e 0 2024-03-12T16:10:42.918 INFO:tasks.workunit.client.1.smithi134.stdout:8/570: creat d3/d1b/d17/d45/fc4 x:0 0 0 2024-03-12T16:10:42.920 INFO:tasks.workunit.client.1.smithi134.stdout:8/571: rmdir d3/d1b/d17/d24 39 2024-03-12T16:10:42.920 INFO:tasks.workunit.client.0.smithi006.stdout:2/392: symlink d0/l7f 0 2024-03-12T16:10:42.922 INFO:tasks.workunit.client.0.smithi006.stdout:2/393: symlink d0/d13/d49/d60/d2b/d62/d66/d69/l80 0 2024-03-12T16:10:42.922 INFO:tasks.workunit.client.1.smithi134.stdout:8/572: mkdir d3/d1b/d17/d25/d33/d15/d95/d6d/dc5 0 2024-03-12T16:10:42.923 INFO:tasks.workunit.client.1.smithi134.stdout:8/573: write d3/d1b/d17/d25/f79 [98850,92712] 0 2024-03-12T16:10:42.924 INFO:tasks.workunit.client.1.smithi134.stdout:1/407: sync 2024-03-12T16:10:42.924 INFO:tasks.workunit.client.1.smithi134.stdout:0/601: sync 2024-03-12T16:10:42.925 INFO:tasks.workunit.client.0.smithi006.stdout:2/394: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81 0 2024-03-12T16:10:42.925 INFO:tasks.workunit.client.0.smithi006.stdout:0/387: sync 2024-03-12T16:10:42.927 INFO:tasks.workunit.client.1.smithi134.stdout:0/602: creat db/d2f/d31/d75/d88/fc2 x:0 0 0 2024-03-12T16:10:42.927 INFO:tasks.workunit.client.0.smithi006.stdout:0/388: truncate d2/d39/d42/f51 942924 0 2024-03-12T16:10:42.927 INFO:tasks.workunit.client.1.smithi134.stdout:0/603: stat db/d2f/d31/d68/d70/fb3 0 2024-03-12T16:10:42.928 INFO:tasks.workunit.client.0.smithi006.stdout:0/389: chown d2/f2c 2296 1 2024-03-12T16:10:42.929 INFO:tasks.workunit.client.0.smithi006.stdout:0/390: write d2/f2c [1584215,69017] 0 2024-03-12T16:10:42.930 INFO:tasks.workunit.client.1.smithi134.stdout:8/574: rename d3/d10/dad to d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6 0 2024-03-12T16:10:42.930 INFO:tasks.workunit.client.0.smithi006.stdout:0/391: fdatasync d2/d39/f4d 0 2024-03-12T16:10:42.932 INFO:tasks.workunit.client.1.smithi134.stdout:1/408: link d0/d16/d9/f70 d0/d16/d9/d13/d21/d20/f8e 0 2024-03-12T16:10:42.932 INFO:tasks.workunit.client.1.smithi134.stdout:3/731: write d1/d63/d6c/f6d [1994420,13357] 0 2024-03-12T16:10:42.934 INFO:tasks.workunit.client.0.smithi006.stdout:0/392: mkdir d2/d6/d10/d11/d1d/d2e/d6e 0 2024-03-12T16:10:42.934 INFO:tasks.workunit.client.0.smithi006.stdout:2/395: write d0/d13/f1d [1526988,24034] 0 2024-03-12T16:10:42.935 INFO:tasks.workunit.client.0.smithi006.stdout:0/393: chown d2/f2b 14016 1 2024-03-12T16:10:42.937 INFO:tasks.workunit.client.1.smithi134.stdout:8/575: creat d3/fc7 x:0 0 0 2024-03-12T16:10:42.938 INFO:tasks.workunit.client.1.smithi134.stdout:0/604: getdents db/d2f/d51 0 2024-03-12T16:10:42.940 INFO:tasks.workunit.client.0.smithi006.stdout:0/394: rename d2/d6/c25 to d2/d6/d10/d11/d1d/c6f 0 2024-03-12T16:10:42.942 INFO:tasks.workunit.client.1.smithi134.stdout:3/732: truncate d1/db/d10/f28 761254 0 2024-03-12T16:10:42.942 INFO:tasks.workunit.client.1.smithi134.stdout:1/409: dwrite d0/d16/d9/d13/d38/f82 [0,4194304] 0 2024-03-12T16:10:42.942 INFO:tasks.workunit.client.0.smithi006.stdout:2/396: truncate d0/f4 2188359 0 2024-03-12T16:10:42.944 INFO:tasks.workunit.client.0.smithi006.stdout:0/395: symlink d2/d6/d10/l70 0 2024-03-12T16:10:42.945 INFO:tasks.workunit.client.0.smithi006.stdout:2/397: mkdir d0/d13/d49/d60/d2b/d82 0 2024-03-12T16:10:42.946 INFO:tasks.workunit.client.0.smithi006.stdout:0/396: unlink d2/d6/l5d 0 2024-03-12T16:10:42.947 INFO:tasks.workunit.client.1.smithi134.stdout:8/576: fsync d3/d1b/d17/d24/f4c 0 2024-03-12T16:10:42.949 INFO:tasks.workunit.client.1.smithi134.stdout:0/605: creat db/d2f/d51/db4/fc3 x:0 0 0 2024-03-12T16:10:42.950 INFO:tasks.workunit.client.1.smithi134.stdout:1/410: dwrite d0/d16/d9/d13/d21/d2f/f68 [0,4194304] 0 2024-03-12T16:10:42.951 INFO:tasks.workunit.client.0.smithi006.stdout:0/397: creat d2/f71 x:0 0 0 2024-03-12T16:10:42.952 INFO:tasks.workunit.client.1.smithi134.stdout:1/411: chown d0/d16/d9/d13/d38/f82 2 1 2024-03-12T16:10:42.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:41.496734+0000 mgr.smithi134.gcntfu (mgr.24383) 58 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 195 MiB/s wr, 326 op/s 2024-03-12T16:10:42.955 INFO:tasks.workunit.client.0.smithi006.stdout:0/398: dread d2/d6/d10/d11/d32/f4a [0,4194304] 0 2024-03-12T16:10:42.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:41.496734+0000 mgr.smithi134.gcntfu (mgr.24383) 58 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 195 MiB/s wr, 326 op/s 2024-03-12T16:10:42.958 INFO:tasks.workunit.client.1.smithi134.stdout:3/733: getdents d1 0 2024-03-12T16:10:42.960 INFO:tasks.workunit.client.1.smithi134.stdout:3/734: write d1/db/d14/f59 [2434209,44208] 0 2024-03-12T16:10:42.962 INFO:tasks.workunit.client.1.smithi134.stdout:8/577: rename d3/d1b/d17/d24/l8c to d3/d1b/lc8 0 2024-03-12T16:10:42.963 INFO:tasks.workunit.client.0.smithi006.stdout:1/362: sync 2024-03-12T16:10:42.963 INFO:tasks.workunit.client.0.smithi006.stdout:5/261: sync 2024-03-12T16:10:42.963 INFO:tasks.workunit.client.0.smithi006.stdout:8/287: sync 2024-03-12T16:10:42.963 INFO:tasks.workunit.client.0.smithi006.stdout:9/335: sync 2024-03-12T16:10:42.964 INFO:tasks.workunit.client.0.smithi006.stdout:6/345: sync 2024-03-12T16:10:42.964 INFO:tasks.workunit.client.0.smithi006.stdout:0/399: rmdir d2/d6/d10 39 2024-03-12T16:10:42.966 INFO:tasks.workunit.client.0.smithi006.stdout:0/400: fdatasync d2/d39/d42/f58 0 2024-03-12T16:10:42.966 INFO:tasks.workunit.client.0.smithi006.stdout:4/419: sync 2024-03-12T16:10:42.966 INFO:tasks.workunit.client.0.smithi006.stdout:7/463: sync 2024-03-12T16:10:42.966 INFO:tasks.workunit.client.0.smithi006.stdout:3/337: sync 2024-03-12T16:10:42.967 INFO:tasks.workunit.client.1.smithi134.stdout:8/578: creat d3/d1b/d17/d24/d28/fc9 x:0 0 0 2024-03-12T16:10:42.969 INFO:tasks.workunit.client.0.smithi006.stdout:4/420: dread - d1/db/d39/f73 zero size 2024-03-12T16:10:42.969 INFO:tasks.workunit.client.1.smithi134.stdout:8/579: creat d3/d1b/d17/d25/d33/d96/fca x:0 0 0 2024-03-12T16:10:42.969 INFO:tasks.workunit.client.1.smithi134.stdout:3/735: dread d1/db/d14/d5f/fbe [0,4194304] 0 2024-03-12T16:10:42.969 INFO:tasks.workunit.client.0.smithi006.stdout:2/398: truncate d0/d13/d49/d60/d2b/f56 2054317 0 2024-03-12T16:10:42.970 INFO:tasks.workunit.client.1.smithi134.stdout:0/606: truncate db/d2f/d31/d75/f7f 144445 0 2024-03-12T16:10:42.970 INFO:tasks.workunit.client.0.smithi006.stdout:4/421: readlink d1/db/d1d/l26 0 2024-03-12T16:10:42.971 INFO:tasks.workunit.client.0.smithi006.stdout:8/288: symlink d2/d11/l5e 0 2024-03-12T16:10:42.971 INFO:tasks.workunit.client.0.smithi006.stdout:2/399: readlink d0/d13/l59 0 2024-03-12T16:10:42.971 INFO:tasks.workunit.client.1.smithi134.stdout:1/412: truncate d0/d16/f31 1363018 0 2024-03-12T16:10:42.972 INFO:tasks.workunit.client.0.smithi006.stdout:6/346: mkdir d3/d11/d10/d1b/d6e/d80 0 2024-03-12T16:10:42.973 INFO:tasks.workunit.client.1.smithi134.stdout:1/413: stat d0/d16/d9/f70 0 2024-03-12T16:10:42.973 INFO:tasks.workunit.client.1.smithi134.stdout:0/607: write db/f11 [5917723,112284] 0 2024-03-12T16:10:42.973 INFO:tasks.workunit.client.1.smithi134.stdout:8/580: unlink d3/d82/cbb 0 2024-03-12T16:10:42.976 INFO:tasks.workunit.client.1.smithi134.stdout:8/581: fsync d3/d1b/d17/d25/d33/d15/d95/d5b/f8e 0 2024-03-12T16:10:42.978 INFO:tasks.workunit.client.0.smithi006.stdout:9/336: symlink d0/d8/d16/d2f/l6e 0 2024-03-12T16:10:42.979 INFO:tasks.workunit.client.1.smithi134.stdout:1/414: rename d0/d42/c52 to d0/d16/d9/d13/d21/c8f 0 2024-03-12T16:10:42.980 INFO:tasks.workunit.client.0.smithi006.stdout:6/347: dread - d3/d11/d10/d1b/d6e/f4f zero size 2024-03-12T16:10:42.980 INFO:tasks.workunit.client.0.smithi006.stdout:0/401: dwrite d2/f65 [0,4194304] 0 2024-03-12T16:10:42.984 INFO:tasks.workunit.client.1.smithi134.stdout:0/608: dwrite db/d2f/d61/d6c/fa9 [0,4194304] 0 2024-03-12T16:10:42.984 INFO:tasks.workunit.client.0.smithi006.stdout:5/262: creat d7/f58 x:0 0 0 2024-03-12T16:10:42.985 INFO:tasks.workunit.client.1.smithi134.stdout:0/609: stat db/d2f/d31/d76/d9f 0 2024-03-12T16:10:42.985 INFO:tasks.workunit.client.1.smithi134.stdout:8/582: link d3/d1b/d17/d25/d33/f8f d3/d1b/d17/d24/d28/fcb 0 2024-03-12T16:10:42.987 INFO:tasks.workunit.client.0.smithi006.stdout:3/338: dread d8/d19/d26/d59/d2c/dc/d28/f6a [0,4194304] 0 2024-03-12T16:10:42.990 INFO:tasks.workunit.client.0.smithi006.stdout:8/289: dread d2/d11/f1b [0,4194304] 0 2024-03-12T16:10:42.990 INFO:tasks.workunit.client.1.smithi134.stdout:0/610: write db/f2c [4978535,126966] 0 2024-03-12T16:10:42.991 INFO:tasks.workunit.client.0.smithi006.stdout:1/363: truncate d0/d25/d2a/d35/f3a 742949 0 2024-03-12T16:10:42.991 INFO:tasks.workunit.client.1.smithi134.stdout:8/583: creat d3/d1b/d17/d45/fcc x:0 0 0 2024-03-12T16:10:42.992 INFO:tasks.workunit.client.0.smithi006.stdout:3/339: chown d8/d19/d26/d59/f42 190059 1 2024-03-12T16:10:42.992 INFO:tasks.workunit.client.0.smithi006.stdout:4/422: dwrite d1/db/d39/f73 [0,4194304] 0 2024-03-12T16:10:42.994 INFO:tasks.workunit.client.1.smithi134.stdout:1/415: rename d0/lf to d0/d16/d9/d13/l90 0 2024-03-12T16:10:42.994 INFO:tasks.workunit.client.1.smithi134.stdout:3/736: truncate d1/db/d10/d2d/d30/fc9 3288264 0 2024-03-12T16:10:42.997 INFO:tasks.workunit.client.0.smithi006.stdout:4/423: write d1/db/f40 [94262,84841] 0 2024-03-12T16:10:43.001 INFO:tasks.workunit.client.0.smithi006.stdout:4/424: truncate d1/db/f22 4876313 0 2024-03-12T16:10:43.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/584: creat d3/d1b/d17/d25/d33/d15/d7e/fcd x:0 0 0 2024-03-12T16:10:43.003 INFO:tasks.workunit.client.0.smithi006.stdout:5/263: mknod d7/d9/d10/d35/c59 0 2024-03-12T16:10:43.003 INFO:tasks.workunit.client.1.smithi134.stdout:3/737: truncate d1/db/d10/d2d/d2e/f3f 30668 0 2024-03-12T16:10:43.004 INFO:tasks.workunit.client.1.smithi134.stdout:1/416: getdents d0/d16/d9/d13/d21/d2f/d8d 0 2024-03-12T16:10:43.005 INFO:tasks.workunit.client.0.smithi006.stdout:7/464: creat de/d18/d2a/f9e x:0 0 0 2024-03-12T16:10:43.005 INFO:tasks.workunit.client.0.smithi006.stdout:2/400: write d0/d13/d49/f73 [146505,38091] 0 2024-03-12T16:10:43.005 INFO:tasks.workunit.client.1.smithi134.stdout:3/738: write d1/db/d12/d9d/fb3 [493496,116167] 0 2024-03-12T16:10:43.006 INFO:tasks.workunit.client.1.smithi134.stdout:8/585: mknod d3/d10/cce 0 2024-03-12T16:10:43.007 INFO:tasks.workunit.client.1.smithi134.stdout:1/417: chown d0/d16/d9/d13/d21/d20/c24 772705 1 2024-03-12T16:10:43.008 INFO:tasks.workunit.client.0.smithi006.stdout:2/401: chown d0/d13/d49/d60/d2b/d62/d66/d67/d6a/f6d 48 1 2024-03-12T16:10:43.009 INFO:tasks.workunit.client.1.smithi134.stdout:3/739: unlink d1/f2 0 2024-03-12T16:10:43.011 INFO:tasks.workunit.client.1.smithi134.stdout:8/586: dread d3/d1b/d17/d24/f6f [0,4194304] 0 2024-03-12T16:10:43.011 INFO:tasks.workunit.client.0.smithi006.stdout:3/340: write d8/d19/d26/d59/d2c/dc/d28/f6a [4084369,53038] 0 2024-03-12T16:10:43.011 INFO:tasks.workunit.client.0.smithi006.stdout:5/264: rename d7/f2f to d7/d41/f5a 0 2024-03-12T16:10:43.011 INFO:tasks.workunit.client.0.smithi006.stdout:9/337: dread d0/fc [0,4194304] 0 2024-03-12T16:10:43.012 INFO:tasks.workunit.client.1.smithi134.stdout:1/418: creat d0/d16/d9/d73/f91 x:0 0 0 2024-03-12T16:10:43.014 INFO:tasks.workunit.client.0.smithi006.stdout:3/341: read - d8/d4c/f65 zero size 2024-03-12T16:10:43.014 INFO:tasks.workunit.client.0.smithi006.stdout:0/402: creat d2/d6/f72 x:0 0 0 2024-03-12T16:10:43.015 INFO:tasks.workunit.client.0.smithi006.stdout:5/265: readlink d7/d9/d31/l4b 0 2024-03-12T16:10:43.015 INFO:tasks.workunit.client.0.smithi006.stdout:4/425: creat d1/d38/d79/f84 x:0 0 0 2024-03-12T16:10:43.017 INFO:tasks.workunit.client.1.smithi134.stdout:1/419: rmdir d0/d42/d71 0 2024-03-12T16:10:43.019 INFO:tasks.workunit.client.0.smithi006.stdout:9/338: chown d0/d8/d2b/d20/d37/f47 4874860 1 2024-03-12T16:10:43.020 INFO:tasks.workunit.client.1.smithi134.stdout:8/587: dwrite d3/d1b/d17/d25/d33/d15/d95/d4f/f35 [0,4194304] 0 2024-03-12T16:10:43.022 INFO:tasks.workunit.client.0.smithi006.stdout:6/348: write d3/d11/f3c [770751,25568] 0 2024-03-12T16:10:43.022 INFO:tasks.workunit.client.0.smithi006.stdout:8/290: write d2/db/f13 [2624206,23979] 0 2024-03-12T16:10:43.025 INFO:tasks.workunit.client.1.smithi134.stdout:8/588: symlink d3/db0/lcf 0 2024-03-12T16:10:43.028 INFO:tasks.workunit.client.0.smithi006.stdout:0/403: stat d2/d6/d10/f6d 0 2024-03-12T16:10:43.029 INFO:tasks.workunit.client.1.smithi134.stdout:8/589: fdatasync d3/d1b/d17/d25/d49/f75 0 2024-03-12T16:10:43.031 INFO:tasks.workunit.client.0.smithi006.stdout:5/266: dread d7/d8/f4d [0,4194304] 0 2024-03-12T16:10:43.031 INFO:tasks.workunit.client.1.smithi134.stdout:1/420: dread d0/d16/f31 [0,4194304] 0 2024-03-12T16:10:43.031 INFO:tasks.workunit.client.0.smithi006.stdout:2/402: dwrite d0/d13/d49/f74 [0,4194304] 0 2024-03-12T16:10:43.032 INFO:tasks.workunit.client.0.smithi006.stdout:9/339: mknod d0/c6f 0 2024-03-12T16:10:43.032 INFO:tasks.workunit.client.1.smithi134.stdout:3/740: unlink d1/db/d12/d9d/le0 0 2024-03-12T16:10:43.033 INFO:tasks.workunit.client.1.smithi134.stdout:3/741: dread - d1/db/d10/d2d/d2e/d72/fce zero size 2024-03-12T16:10:43.034 INFO:tasks.workunit.client.0.smithi006.stdout:3/342: symlink d8/d19/d26/d59/d2c/l7a 0 2024-03-12T16:10:43.034 INFO:tasks.workunit.client.1.smithi134.stdout:1/421: unlink d0/d16/d9/d13/d21/d20/l49 0 2024-03-12T16:10:43.035 INFO:tasks.workunit.client.0.smithi006.stdout:0/404: chown d2/d39/d42/f64 95468577 1 2024-03-12T16:10:43.036 INFO:tasks.workunit.client.0.smithi006.stdout:9/340: mkdir d0/d4/d70 0 2024-03-12T16:10:43.037 INFO:tasks.workunit.client.1.smithi134.stdout:8/590: creat d3/d10/d31/d9b/fd0 x:0 0 0 2024-03-12T16:10:43.038 INFO:tasks.workunit.client.1.smithi134.stdout:3/742: read - d1/db/d10/d2d/d2e/f78 zero size 2024-03-12T16:10:43.038 INFO:tasks.workunit.client.0.smithi006.stdout:7/465: dwrite de/d18/d2a/f31 [0,4194304] 0 2024-03-12T16:10:43.039 INFO:tasks.workunit.client.0.smithi006.stdout:5/267: fsync d7/d9/d10/d24/f2d 0 2024-03-12T16:10:43.041 INFO:tasks.workunit.client.0.smithi006.stdout:4/426: rename d1/db/d1d/f49 to d1/db/d17/f85 0 2024-03-12T16:10:43.041 INFO:tasks.workunit.client.1.smithi134.stdout:8/591: chown d3/d1b/d17/d25/d33/d15/d95/d6d/l7a 4346 1 2024-03-12T16:10:43.045 INFO:tasks.workunit.client.1.smithi134.stdout:1/422: dwrite d0/d16/d9/d13/d21/d5f/f79 [0,4194304] 0 2024-03-12T16:10:43.047 INFO:tasks.workunit.client.0.smithi006.stdout:3/343: write d8/d19/d26/d59/f4e [3845945,124100] 0 2024-03-12T16:10:43.047 INFO:tasks.workunit.client.0.smithi006.stdout:0/405: stat d2/d6/d10/d11/d1d/d2e/f6a 0 2024-03-12T16:10:43.050 INFO:tasks.workunit.client.0.smithi006.stdout:5/268: rmdir d7/d8 39 2024-03-12T16:10:43.052 INFO:tasks.workunit.client.1.smithi134.stdout:1/423: dwrite d0/d16/d9/d13/d21/d20/f7e [0,4194304] 0 2024-03-12T16:10:43.053 INFO:tasks.workunit.client.0.smithi006.stdout:6/349: rename d3/d11/d10/d1b/d6e/f34 to d3/d11/d10/d1b/d20/d5a/f81 0 2024-03-12T16:10:43.053 INFO:tasks.workunit.client.1.smithi134.stdout:1/424: readlink d0/d30/l7a 0 2024-03-12T16:10:43.053 INFO:tasks.workunit.client.0.smithi006.stdout:8/291: dread d2/db/f24 [0,4194304] 0 2024-03-12T16:10:43.054 INFO:tasks.workunit.client.0.smithi006.stdout:6/350: read d3/d11/f3c [782287,122279] 0 2024-03-12T16:10:43.054 INFO:tasks.workunit.client.0.smithi006.stdout:4/427: creat d1/f86 x:0 0 0 2024-03-12T16:10:43.055 INFO:tasks.workunit.client.1.smithi134.stdout:8/592: dread d3/d1b/d17/d25/d33/f84 [0,4194304] 0 2024-03-12T16:10:43.055 INFO:tasks.workunit.client.0.smithi006.stdout:3/344: symlink d8/d52/l7b 0 2024-03-12T16:10:43.057 INFO:tasks.workunit.client.0.smithi006.stdout:9/341: mkdir d0/d4/d70/d71 0 2024-03-12T16:10:43.058 INFO:tasks.workunit.client.1.smithi134.stdout:8/593: symlink d3/d10/d31/ld1 0 2024-03-12T16:10:43.061 INFO:tasks.workunit.client.0.smithi006.stdout:7/466: rmdir de/d7b 39 2024-03-12T16:10:43.062 INFO:tasks.workunit.client.1.smithi134.stdout:8/594: creat d3/d1b/d17/d25/fd2 x:0 0 0 2024-03-12T16:10:43.064 INFO:tasks.workunit.client.0.smithi006.stdout:3/345: mkdir d8/d4c/d7c 0 2024-03-12T16:10:43.068 INFO:tasks.workunit.client.0.smithi006.stdout:4/428: fdatasync d1/db/d17/f59 0 2024-03-12T16:10:43.069 INFO:tasks.workunit.client.0.smithi006.stdout:3/346: read d8/d19/d31/f35 [2781328,23264] 0 2024-03-12T16:10:43.069 INFO:tasks.workunit.client.1.smithi134.stdout:1/425: write d0/d16/d9/d13/d21/d20/f44 [5143530,125173] 0 2024-03-12T16:10:43.070 INFO:tasks.workunit.client.1.smithi134.stdout:8/595: dwrite d3/d1b/d17/d25/d33/d15/d95/d5b/f8e [0,4194304] 0 2024-03-12T16:10:43.071 INFO:tasks.workunit.client.0.smithi006.stdout:4/429: dread - d1/d38/d79/f84 zero size 2024-03-12T16:10:43.072 INFO:tasks.workunit.client.0.smithi006.stdout:6/351: rename d3/d11/ce to d3/d11/d3b/d59/c82 0 2024-03-12T16:10:43.073 INFO:tasks.workunit.client.0.smithi006.stdout:2/403: dread d0/d13/f1d [0,4194304] 0 2024-03-12T16:10:43.074 INFO:tasks.workunit.client.0.smithi006.stdout:8/292: creat d2/d11/d5a/f5f x:0 0 0 2024-03-12T16:10:43.075 INFO:tasks.workunit.client.1.smithi134.stdout:8/596: write d3/d1b/d17/d25/d33/f6b [392529,92683] 0 2024-03-12T16:10:43.076 INFO:tasks.workunit.client.0.smithi006.stdout:6/352: dread d3/d11/f15 [0,4194304] 0 2024-03-12T16:10:43.077 INFO:tasks.workunit.client.0.smithi006.stdout:5/269: mkdir d7/d8/d5b 0 2024-03-12T16:10:43.078 INFO:tasks.workunit.client.0.smithi006.stdout:8/293: truncate d2/db/d1a/d21/d4f/f56 169101 0 2024-03-12T16:10:43.079 INFO:tasks.workunit.client.0.smithi006.stdout:3/347: mknod d8/d4c/d7c/c7d 0 2024-03-12T16:10:43.080 INFO:tasks.workunit.client.1.smithi134.stdout:8/597: symlink d3/d10/d31/ld3 0 2024-03-12T16:10:43.080 INFO:tasks.workunit.client.1.smithi134.stdout:1/426: rename d0/d16/d9/d13/d21/d20/f4f to d0/d42/f92 0 2024-03-12T16:10:43.081 INFO:tasks.workunit.client.1.smithi134.stdout:1/427: mknod d0/d16/d9/d51/c93 0 2024-03-12T16:10:43.083 INFO:tasks.workunit.client.1.smithi134.stdout:8/598: unlink d3/d1b/d17/d25/d33/d15/d95/d4f/fa8 0 2024-03-12T16:10:43.084 INFO:tasks.workunit.client.1.smithi134.stdout:8/599: readlink d3/d1b/d17/d25/d33/l50 0 2024-03-12T16:10:43.085 INFO:tasks.workunit.client.0.smithi006.stdout:8/294: rename d2/d11/f2d to d2/db/d1a/d23/f60 0 2024-03-12T16:10:43.085 INFO:tasks.workunit.client.0.smithi006.stdout:6/353: dwrite d3/d11/d3b/d5d/f7a [0,4194304] 0 2024-03-12T16:10:43.086 INFO:tasks.workunit.client.1.smithi134.stdout:8/600: creat d3/d1b/d17/d25/d33/d15/d95/d5b/fd4 x:0 0 0 2024-03-12T16:10:43.087 INFO:tasks.workunit.client.0.smithi006.stdout:2/404: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83 0 2024-03-12T16:10:43.091 INFO:tasks.workunit.client.0.smithi006.stdout:3/348: creat d8/d4c/d7c/f7e x:0 0 0 2024-03-12T16:10:43.094 INFO:tasks.workunit.client.0.smithi006.stdout:8/295: symlink d2/db/d1a/d23/l61 0 2024-03-12T16:10:43.095 INFO:tasks.workunit.client.0.smithi006.stdout:2/405: write d0/d13/d49/d60/f32 [3560237,1428] 0 2024-03-12T16:10:43.096 INFO:tasks.workunit.client.1.smithi134.stdout:8/601: getdents d3/d10/d31 0 2024-03-12T16:10:43.097 INFO:tasks.workunit.client.0.smithi006.stdout:2/406: chown d0/d13/f27 89664 1 2024-03-12T16:10:43.098 INFO:tasks.workunit.client.0.smithi006.stdout:3/349: chown d8/d19/d26/d59/d2c/dc/d28/c57 2884486 1 2024-03-12T16:10:43.098 INFO:tasks.workunit.client.0.smithi006.stdout:0/406: truncate d2/d39/d42/f56 749938 0 2024-03-12T16:10:43.099 INFO:tasks.workunit.client.1.smithi134.stdout:8/602: mknod d3/d10/d31/d9b/cd5 0 2024-03-12T16:10:43.100 INFO:tasks.workunit.client.0.smithi006.stdout:4/430: creat d1/db/d1d/f87 x:0 0 0 2024-03-12T16:10:43.101 INFO:tasks.workunit.client.0.smithi006.stdout:7/467: write de/d18/f19 [554815,130765] 0 2024-03-12T16:10:43.101 INFO:tasks.workunit.client.1.smithi134.stdout:8/603: mkdir d3/d1b/d17/d25/d33/d15/d7e/dd6 0 2024-03-12T16:10:43.103 INFO:tasks.workunit.client.0.smithi006.stdout:8/296: chown d2/lc 4 1 2024-03-12T16:10:43.104 INFO:tasks.workunit.client.1.smithi134.stdout:1/428: dread d0/d16/f18 [0,4194304] 0 2024-03-12T16:10:43.105 INFO:tasks.workunit.client.0.smithi006.stdout:7/468: write de/d27/f36 [1176703,2090] 0 2024-03-12T16:10:43.106 INFO:tasks.workunit.client.0.smithi006.stdout:9/342: write d0/d8/d2b/f48 [40403,117805] 0 2024-03-12T16:10:43.106 INFO:tasks.workunit.client.0.smithi006.stdout:3/350: write d8/d19/d26/d59/d2c/f34 [2184122,74564] 0 2024-03-12T16:10:43.106 INFO:tasks.workunit.client.0.smithi006.stdout:6/354: creat d3/d11/d10/d28/d45/f83 x:0 0 0 2024-03-12T16:10:43.108 INFO:tasks.workunit.client.1.smithi134.stdout:4/516: sync 2024-03-12T16:10:43.109 INFO:tasks.workunit.client.0.smithi006.stdout:2/407: rename d0/d13/d49/d60/d2b/d62/d66/d67/d6a to d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84 0 2024-03-12T16:10:43.110 INFO:tasks.workunit.client.1.smithi134.stdout:8/604: dwrite d3/d1b/d17/d25/d33/d15/d95/d4f/f35 [0,4194304] 0 2024-03-12T16:10:43.117 INFO:tasks.workunit.client.1.smithi134.stdout:8/605: creat d3/d10/fd7 x:0 0 0 2024-03-12T16:10:43.117 INFO:tasks.workunit.client.1.smithi134.stdout:1/429: dwrite d0/d16/d9/d13/d38/f8b [0,4194304] 0 2024-03-12T16:10:43.121 INFO:tasks.workunit.client.1.smithi134.stdout:8/606: fsync d3/d1b/d17/d25/d33/d15/d95/d6d/f80 0 2024-03-12T16:10:43.125 INFO:tasks.workunit.client.0.smithi006.stdout:0/407: mknod d2/c73 0 2024-03-12T16:10:43.125 INFO:tasks.workunit.client.0.smithi006.stdout:4/431: dwrite d1/db/f40 [0,4194304] 0 2024-03-12T16:10:43.125 INFO:tasks.workunit.client.1.smithi134.stdout:8/607: stat d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6 0 2024-03-12T16:10:43.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/430: dwrite d0/f6b [0,4194304] 0 2024-03-12T16:10:43.131 INFO:tasks.workunit.client.1.smithi134.stdout:1/431: unlink d0/d16/f18 0 2024-03-12T16:10:43.133 INFO:tasks.workunit.client.0.smithi006.stdout:9/343: rename d0/d8/d23/f67 to d0/d4/d70/f72 0 2024-03-12T16:10:43.133 INFO:tasks.workunit.client.0.smithi006.stdout:7/469: dwrite de/d18/d9c/f9d [0,4194304] 0 2024-03-12T16:10:43.135 INFO:tasks.workunit.client.1.smithi134.stdout:8/608: rmdir d3/d10/d31/d88 0 2024-03-12T16:10:43.136 INFO:tasks.workunit.client.0.smithi006.stdout:4/432: creat d1/d38/f88 x:0 0 0 2024-03-12T16:10:43.137 INFO:tasks.workunit.client.0.smithi006.stdout:4/433: dread - d1/db/d17/f59 zero size 2024-03-12T16:10:43.137 INFO:tasks.workunit.client.0.smithi006.stdout:8/297: creat d2/db/f62 x:0 0 0 2024-03-12T16:10:43.138 INFO:tasks.workunit.client.1.smithi134.stdout:1/432: creat d0/d16/d9/d73/f94 x:0 0 0 2024-03-12T16:10:43.138 INFO:tasks.workunit.client.1.smithi134.stdout:8/609: write d3/d1b/d17/d25/d33/d15/d95/d6d/f92 [751982,83733] 0 2024-03-12T16:10:43.139 INFO:tasks.workunit.client.1.smithi134.stdout:1/433: chown d0/d16/d9/d13/d21/f4c 9617793 1 2024-03-12T16:10:43.144 INFO:tasks.workunit.client.0.smithi006.stdout:6/355: creat d3/d11/d10/d1b/d6e/d80/f84 x:0 0 0 2024-03-12T16:10:43.144 INFO:tasks.workunit.client.1.smithi134.stdout:8/610: rename d3/d10/d31/l55 to d3/d1b/d17/d25/d33/d15/d95/d4f/d65/ld8 0 2024-03-12T16:10:43.145 INFO:tasks.workunit.client.1.smithi134.stdout:4/517: dread d1/d13/f71 [0,4194304] 0 2024-03-12T16:10:43.146 INFO:tasks.workunit.client.0.smithi006.stdout:3/351: dwrite d8/d19/d26/d59/d2c/f34 [0,4194304] 0 2024-03-12T16:10:43.150 INFO:tasks.workunit.client.1.smithi134.stdout:1/434: dwrite d0/d16/d9/d13/f8a [4194304,4194304] 0 2024-03-12T16:10:43.151 INFO:tasks.workunit.client.1.smithi134.stdout:4/518: mknod d1/de/ca9 0 2024-03-12T16:10:43.151 INFO:tasks.workunit.client.0.smithi006.stdout:0/408: creat d2/f74 x:0 0 0 2024-03-12T16:10:43.151 INFO:tasks.workunit.client.0.smithi006.stdout:3/352: dread - d8/d19/d26/d59/d2c/f67 zero size 2024-03-12T16:10:43.152 INFO:tasks.workunit.client.0.smithi006.stdout:6/356: write d3/d11/d43/f5c [1961792,71000] 0 2024-03-12T16:10:43.153 INFO:tasks.workunit.client.0.smithi006.stdout:8/298: write d2/fd [2559685,123706] 0 2024-03-12T16:10:43.154 INFO:tasks.workunit.client.0.smithi006.stdout:7/470: creat de/f9f x:0 0 0 2024-03-12T16:10:43.156 INFO:tasks.workunit.client.0.smithi006.stdout:3/353: write d8/d19/d26/d59/f4e [3066277,94079] 0 2024-03-12T16:10:43.157 INFO:tasks.workunit.client.0.smithi006.stdout:7/471: stat de/d18/d2a/l3f 0 2024-03-12T16:10:43.161 INFO:tasks.workunit.client.1.smithi134.stdout:1/435: truncate d0/f3a 1225421 0 2024-03-12T16:10:43.162 INFO:tasks.workunit.client.0.smithi006.stdout:6/357: write d3/d11/d10/d19/f67 [1488676,95138] 0 2024-03-12T16:10:43.162 INFO:tasks.workunit.client.0.smithi006.stdout:3/354: symlink d8/d4c/d7c/l7f 0 2024-03-12T16:10:43.162 INFO:tasks.workunit.client.1.smithi134.stdout:4/519: fdatasync d1/d13/d49/f32 0 2024-03-12T16:10:43.163 INFO:tasks.workunit.client.1.smithi134.stdout:8/611: dwrite d3/d10/d31/d9b/fd0 [0,4194304] 0 2024-03-12T16:10:43.166 INFO:tasks.workunit.client.0.smithi006.stdout:0/409: creat d2/d6/d10/f75 x:0 0 0 2024-03-12T16:10:43.167 INFO:tasks.workunit.client.0.smithi006.stdout:6/358: creat d3/d11/d10/d28/d45/f85 x:0 0 0 2024-03-12T16:10:43.170 INFO:tasks.workunit.client.1.smithi134.stdout:8/612: chown d3/d1b/d17/d24 0 1 2024-03-12T16:10:43.171 INFO:tasks.workunit.client.1.smithi134.stdout:1/436: symlink d0/d30/d86/l95 0 2024-03-12T16:10:43.171 INFO:tasks.workunit.client.0.smithi006.stdout:0/410: truncate d2/d6/d10/d11/d32/f4a 818761 0 2024-03-12T16:10:43.174 INFO:tasks.workunit.client.0.smithi006.stdout:6/359: truncate d3/d11/d10/d28/d45/d60/f61 698366 0 2024-03-12T16:10:43.174 INFO:tasks.workunit.client.1.smithi134.stdout:4/520: rmdir d1/d13/d49/d6d 39 2024-03-12T16:10:43.175 INFO:tasks.workunit.client.1.smithi134.stdout:1/437: mknod d0/d16/d9/d13/d21/d2f/c96 0 2024-03-12T16:10:43.176 INFO:tasks.workunit.client.1.smithi134.stdout:1/438: read - d0/d16/d9/d73/f94 zero size 2024-03-12T16:10:43.179 INFO:tasks.workunit.client.0.smithi006.stdout:6/360: write d3/d11/d10/f41 [729437,16534] 0 2024-03-12T16:10:43.181 INFO:tasks.workunit.client.0.smithi006.stdout:2/408: dread d0/d13/d49/d60/f16 [0,4194304] 0 2024-03-12T16:10:43.182 INFO:tasks.workunit.client.0.smithi006.stdout:7/472: dread de/f17 [0,4194304] 0 2024-03-12T16:10:43.182 INFO:tasks.workunit.client.0.smithi006.stdout:6/361: chown d3/d11/d3b/d5d 287488882 1 2024-03-12T16:10:43.183 INFO:tasks.workunit.client.0.smithi006.stdout:0/411: dwrite d2/f71 [0,4194304] 0 2024-03-12T16:10:43.184 INFO:tasks.workunit.client.1.smithi134.stdout:1/439: truncate d0/f74 312310 0 2024-03-12T16:10:43.184 INFO:tasks.workunit.client.1.smithi134.stdout:4/521: write d1/d24/d34/f97 [1151803,110798] 0 2024-03-12T16:10:43.190 INFO:tasks.workunit.client.0.smithi006.stdout:6/362: creat d3/d11/d3b/d5d/f86 x:0 0 0 2024-03-12T16:10:43.193 INFO:tasks.workunit.client.0.smithi006.stdout:9/344: dread d0/d8/d2b/d20/d37/f39 [0,4194304] 0 2024-03-12T16:10:43.195 INFO:tasks.workunit.client.0.smithi006.stdout:6/363: truncate d3/d11/d10/f41 1460150 0 2024-03-12T16:10:43.195 INFO:tasks.workunit.client.0.smithi006.stdout:2/409: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f85 x:0 0 0 2024-03-12T16:10:43.196 INFO:tasks.workunit.client.1.smithi134.stdout:1/440: symlink d0/d30/d48/l97 0 2024-03-12T16:10:43.196 INFO:tasks.workunit.client.0.smithi006.stdout:0/412: chown d2/d6/d10/d11/d1d/d2e/f5e 13 1 2024-03-12T16:10:43.197 INFO:tasks.workunit.client.0.smithi006.stdout:9/345: symlink d0/d8/d23/l73 0 2024-03-12T16:10:43.198 INFO:tasks.workunit.client.0.smithi006.stdout:9/346: chown d0/d8/d2b/f48 119915439 1 2024-03-12T16:10:43.199 INFO:tasks.workunit.client.0.smithi006.stdout:7/473: dread de/d27/d2b/f37 [0,4194304] 0 2024-03-12T16:10:43.200 INFO:tasks.workunit.client.0.smithi006.stdout:0/413: write d2/f53 [523484,37987] 0 2024-03-12T16:10:43.200 INFO:tasks.workunit.client.0.smithi006.stdout:8/299: write d2/f3a [150085,42300] 0 2024-03-12T16:10:43.202 INFO:tasks.workunit.client.0.smithi006.stdout:7/474: chown de/d18/c5d 3089 1 2024-03-12T16:10:43.203 INFO:tasks.workunit.client.1.smithi134.stdout:4/522: link d1/d13/f71 d1/d13/d49/faa 0 2024-03-12T16:10:43.203 INFO:tasks.workunit.client.0.smithi006.stdout:6/364: write d3/d11/d10/d28/d45/f55 [615148,116984] 0 2024-03-12T16:10:43.204 INFO:tasks.workunit.client.1.smithi134.stdout:1/441: dwrite d0/d16/d9/d13/d21/d2f/f68 [0,4194304] 0 2024-03-12T16:10:43.206 INFO:tasks.workunit.client.0.smithi006.stdout:9/347: mknod d0/d4/d18/c74 0 2024-03-12T16:10:43.207 INFO:tasks.workunit.client.1.smithi134.stdout:4/523: mkdir d1/d13/d49/d64/da3/dab 0 2024-03-12T16:10:43.208 INFO:tasks.workunit.client.0.smithi006.stdout:6/365: stat d3/d11/d10/d28/d45/f55 0 2024-03-12T16:10:43.210 INFO:tasks.workunit.client.0.smithi006.stdout:0/414: write d2/d6/d10/d11/d1d/d2e/f6a [7953186,69252] 0 2024-03-12T16:10:43.210 INFO:tasks.workunit.client.0.smithi006.stdout:2/410: rmdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84 39 2024-03-12T16:10:43.219 INFO:tasks.workunit.client.0.smithi006.stdout:0/415: mknod d2/d39/d42/c76 0 2024-03-12T16:10:43.224 INFO:tasks.workunit.client.0.smithi006.stdout:6/366: write d3/d11/d10/d1b/d20/f68 [502953,38510] 0 2024-03-12T16:10:43.224 INFO:tasks.workunit.client.0.smithi006.stdout:3/355: dread d8/d19/d31/f35 [0,4194304] 0 2024-03-12T16:10:43.225 INFO:tasks.workunit.client.1.smithi134.stdout:4/524: dwrite d1/d13/f1d [0,4194304] 0 2024-03-12T16:10:43.227 INFO:tasks.workunit.client.0.smithi006.stdout:8/300: dwrite d2/db/f62 [0,4194304] 0 2024-03-12T16:10:43.227 INFO:tasks.workunit.client.1.smithi134.stdout:4/525: mkdir d1/de/dac 0 2024-03-12T16:10:43.231 INFO:tasks.workunit.client.1.smithi134.stdout:1/442: dwrite d0/f3a [0,4194304] 0 2024-03-12T16:10:43.233 INFO:tasks.workunit.client.0.smithi006.stdout:3/356: write d8/d19/d26/d59/d2c/dc/d28/f73 [831724,7438] 0 2024-03-12T16:10:43.234 INFO:tasks.workunit.client.0.smithi006.stdout:6/367: creat d3/d11/d10/d28/d45/d60/f87 x:0 0 0 2024-03-12T16:10:43.234 INFO:tasks.workunit.client.1.smithi134.stdout:1/443: creat d0/d42/f98 x:0 0 0 2024-03-12T16:10:43.236 INFO:tasks.workunit.client.0.smithi006.stdout:9/348: dwrite d0/d8/d2b/d20/f34 [0,4194304] 0 2024-03-12T16:10:43.237 INFO:tasks.workunit.client.0.smithi006.stdout:2/411: getdents d0/dc 0 2024-03-12T16:10:43.241 INFO:tasks.workunit.client.0.smithi006.stdout:6/368: readlink d3/d11/d10/d1b/d20/l37 0 2024-03-12T16:10:43.242 INFO:tasks.workunit.client.1.smithi134.stdout:1/444: dwrite d0/d16/d9/d13/d38/f8b [0,4194304] 0 2024-03-12T16:10:43.242 INFO:tasks.workunit.client.0.smithi006.stdout:0/416: getdents d2/d6/d10/d11/d32 0 2024-03-12T16:10:43.244 INFO:tasks.workunit.client.0.smithi006.stdout:6/369: readlink d3/d11/d10/d1b/d6e/l44 0 2024-03-12T16:10:43.245 INFO:tasks.workunit.client.0.smithi006.stdout:2/412: dread d0/f40 [0,4194304] 0 2024-03-12T16:10:43.246 INFO:tasks.workunit.client.0.smithi006.stdout:9/349: rename d0/d4/d70/f72 to d0/d4/d18/d4d/f75 0 2024-03-12T16:10:43.249 INFO:tasks.workunit.client.0.smithi006.stdout:6/370: dread - d3/d11/d10/d28/d45/f85 zero size 2024-03-12T16:10:43.252 INFO:tasks.workunit.client.0.smithi006.stdout:3/357: rename d8/d19/d26/d59/d3b/f51 to d8/d19/d26/d59/d3b/f80 0 2024-03-12T16:10:43.256 INFO:tasks.workunit.client.0.smithi006.stdout:8/301: fdatasync d2/db/f62 0 2024-03-12T16:10:43.256 INFO:tasks.workunit.client.1.smithi134.stdout:5/648: sync 2024-03-12T16:10:43.257 INFO:tasks.workunit.client.1.smithi134.stdout:5/649: chown db/d12/d37/d73/d7f/fc5 6770 1 2024-03-12T16:10:43.258 INFO:tasks.workunit.client.0.smithi006.stdout:9/350: fsync d0/d8/d2b/f66 0 2024-03-12T16:10:43.262 INFO:tasks.workunit.client.0.smithi006.stdout:0/417: dwrite d2/d39/d42/f68 [0,4194304] 0 2024-03-12T16:10:43.263 INFO:tasks.workunit.client.0.smithi006.stdout:7/475: dread de/d18/d2a/d40/f63 [0,4194304] 0 2024-03-12T16:10:43.264 INFO:tasks.workunit.client.0.smithi006.stdout:8/302: dread - d2/db/d1a/d21/d4f/f5c zero size 2024-03-12T16:10:43.265 INFO:tasks.workunit.client.0.smithi006.stdout:0/418: readlink d2/d6/d10/l41 0 2024-03-12T16:10:43.266 INFO:tasks.workunit.client.0.smithi006.stdout:8/303: fsync d2/db/d1a/d21/d4f/f5c 0 2024-03-12T16:10:43.269 INFO:tasks.workunit.client.0.smithi006.stdout:9/351: symlink d0/d8/d16/l76 0 2024-03-12T16:10:43.274 INFO:tasks.workunit.client.0.smithi006.stdout:6/371: link d3/d11/d10/d1b/d20/f23 d3/d11/d10/d1b/d20/d5a/f88 0 2024-03-12T16:10:43.275 INFO:tasks.workunit.client.0.smithi006.stdout:2/413: dwrite d0/d13/f44 [0,4194304] 0 2024-03-12T16:10:43.276 INFO:tasks.workunit.client.0.smithi006.stdout:9/352: mknod d0/d8/d2b/c77 0 2024-03-12T16:10:43.278 INFO:tasks.workunit.client.0.smithi006.stdout:0/419: mkdir d2/d6/d10/d11/d1d/d2e/d77 0 2024-03-12T16:10:43.280 INFO:tasks.workunit.client.0.smithi006.stdout:2/414: creat d0/d13/d49/d60/d2b/d62/f86 x:0 0 0 2024-03-12T16:10:43.284 INFO:tasks.workunit.client.1.smithi134.stdout:1/445: chown d0/d16/ca 15790 1 2024-03-12T16:10:43.284 INFO:tasks.workunit.client.1.smithi134.stdout:4/526: truncate d1/d13/d49/d64/f87 1138079 0 2024-03-12T16:10:43.285 INFO:tasks.workunit.client.0.smithi006.stdout:6/372: dwrite d3/d11/d10/f49 [0,4194304] 0 2024-03-12T16:10:43.286 INFO:tasks.workunit.client.1.smithi134.stdout:5/650: readlink db/d12/l46 0 2024-03-12T16:10:43.287 INFO:tasks.workunit.client.1.smithi134.stdout:5/651: write db/d12/d29/f9a [136114,112490] 0 2024-03-12T16:10:43.289 INFO:tasks.workunit.client.0.smithi006.stdout:2/415: mknod d0/d13/d49/d60/d2b/d62/c87 0 2024-03-12T16:10:43.292 INFO:tasks.workunit.client.0.smithi006.stdout:6/373: link d3/f17 d3/d11/d10/d1b/f89 0 2024-03-12T16:10:43.293 INFO:tasks.workunit.client.0.smithi006.stdout:9/353: write d0/d8/d2b/d20/d37/f47 [4739586,110320] 0 2024-03-12T16:10:43.295 INFO:tasks.workunit.client.1.smithi134.stdout:5/652: dwrite db/fa3 [0,4194304] 0 2024-03-12T16:10:43.295 INFO:tasks.workunit.client.0.smithi006.stdout:6/374: creat d3/d11/d10/d19/f8a x:0 0 0 2024-03-12T16:10:43.297 INFO:tasks.workunit.client.0.smithi006.stdout:9/354: truncate d0/d8/d2b/d20/d37/f57 652576 0 2024-03-12T16:10:43.299 INFO:tasks.workunit.client.0.smithi006.stdout:6/375: write d3/d11/d10/d1b/d6e/d80/f84 [105952,130933] 0 2024-03-12T16:10:43.301 INFO:tasks.workunit.client.0.smithi006.stdout:7/476: dread de/d1c/f33 [0,4194304] 0 2024-03-12T16:10:43.302 INFO:tasks.workunit.client.0.smithi006.stdout:8/304: dread d2/fd [0,4194304] 0 2024-03-12T16:10:43.306 INFO:tasks.workunit.client.0.smithi006.stdout:7/477: creat de/d18/fa0 x:0 0 0 2024-03-12T16:10:43.307 INFO:tasks.workunit.client.0.smithi006.stdout:7/478: creat de/d2c/d4f/fa1 x:0 0 0 2024-03-12T16:10:43.308 INFO:tasks.workunit.client.0.smithi006.stdout:7/479: chown de/d18/l53 58781722 1 2024-03-12T16:10:43.308 INFO:tasks.workunit.client.0.smithi006.stdout:8/305: link d2/f36 d2/f63 0 2024-03-12T16:10:43.308 INFO:tasks.workunit.client.0.smithi006.stdout:3/358: dread d8/d19/d26/d59/d2c/dc/d28/d2f/f3c [0,4194304] 0 2024-03-12T16:10:43.309 INFO:tasks.workunit.client.0.smithi006.stdout:8/306: readlink d2/db/d1a/d23/l61 0 2024-03-12T16:10:43.310 INFO:tasks.workunit.client.0.smithi006.stdout:7/480: creat de/d1c/fa2 x:0 0 0 2024-03-12T16:10:43.311 INFO:tasks.workunit.client.0.smithi006.stdout:8/307: write d2/db/f13 [5124026,78068] 0 2024-03-12T16:10:43.312 INFO:tasks.workunit.client.0.smithi006.stdout:8/308: readlink d2/db/d1a/d23/l61 0 2024-03-12T16:10:43.314 INFO:tasks.workunit.client.0.smithi006.stdout:7/481: creat de/d27/d7c/fa3 x:0 0 0 2024-03-12T16:10:43.315 INFO:tasks.workunit.client.0.smithi006.stdout:8/309: truncate d2/db/d1a/d1f/f54 674782 0 2024-03-12T16:10:43.316 INFO:tasks.workunit.client.0.smithi006.stdout:3/359: rename d8/d19/d26/d59/d2c/dc/d28/d2f/c33 to d8/d19/d26/d59/d5b/c81 0 2024-03-12T16:10:43.317 INFO:tasks.workunit.client.0.smithi006.stdout:1/364: sync 2024-03-12T16:10:43.318 INFO:tasks.workunit.client.0.smithi006.stdout:1/365: fsync d0/d25/f75 0 2024-03-12T16:10:43.320 INFO:tasks.workunit.client.1.smithi134.stdout:5/653: dread db/d7d/f7c [0,4194304] 0 2024-03-12T16:10:43.320 INFO:tasks.workunit.client.0.smithi006.stdout:3/360: mknod d8/d19/c82 0 2024-03-12T16:10:43.322 INFO:tasks.workunit.client.1.smithi134.stdout:5/654: truncate db/d12/d1d/f35 4534126 0 2024-03-12T16:10:43.324 INFO:tasks.workunit.client.0.smithi006.stdout:1/366: creat d0/d25/d2a/f7d x:0 0 0 2024-03-12T16:10:43.326 INFO:tasks.workunit.client.0.smithi006.stdout:7/482: dwrite de/d1c/d35/f7d [4194304,4194304] 0 2024-03-12T16:10:43.327 INFO:tasks.workunit.client.1.smithi134.stdout:5/655: dwrite db/d12/d1d/d3a/d49/f62 [0,4194304] 0 2024-03-12T16:10:43.327 INFO:tasks.workunit.client.0.smithi006.stdout:9/355: dwrite d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:43.328 INFO:tasks.workunit.client.0.smithi006.stdout:3/361: fdatasync d8/d19/d26/d59/d2c/dc/d28/d2f/f3c 0 2024-03-12T16:10:43.334 INFO:tasks.workunit.client.1.smithi134.stdout:5/656: read db/d12/d1d/d3a/f48 [65463,128737] 0 2024-03-12T16:10:43.335 INFO:tasks.workunit.client.0.smithi006.stdout:3/362: truncate d8/d19/d26/d59/d2c/f67 85925 0 2024-03-12T16:10:43.337 INFO:tasks.workunit.client.1.smithi134.stdout:5/657: truncate db/f58 4026065 0 2024-03-12T16:10:43.339 INFO:tasks.workunit.client.0.smithi006.stdout:9/356: symlink d0/d4/d18/d4d/l78 0 2024-03-12T16:10:43.339 INFO:tasks.workunit.client.1.smithi134.stdout:5/658: readlink db/d12/d29/d3d/d79/da5/lb6 0 2024-03-12T16:10:43.340 INFO:tasks.workunit.client.0.smithi006.stdout:7/483: dwrite de/d18/fa0 [0,4194304] 0 2024-03-12T16:10:43.341 INFO:tasks.workunit.client.1.smithi134.stdout:5/659: read db/f38 [742151,118073] 0 2024-03-12T16:10:43.346 INFO:tasks.workunit.client.0.smithi006.stdout:7/484: symlink de/d2c/d4f/la4 0 2024-03-12T16:10:43.347 INFO:tasks.workunit.client.0.smithi006.stdout:9/357: truncate d0/d4/d3b/f3d 8474517 0 2024-03-12T16:10:43.348 INFO:tasks.workunit.client.0.smithi006.stdout:1/367: dread d0/d25/d2a/d35/f3a [0,4194304] 0 2024-03-12T16:10:43.349 INFO:tasks.workunit.client.1.smithi134.stdout:5/660: fsync db/d12/d1d/d3a/d4e/f4f 0 2024-03-12T16:10:43.350 INFO:tasks.workunit.client.0.smithi006.stdout:3/363: rename d8/d19/d31/f69 to d8/d52/d6c/f83 0 2024-03-12T16:10:43.351 INFO:tasks.workunit.client.0.smithi006.stdout:9/358: mknod d0/d4/d3b/c79 0 2024-03-12T16:10:43.351 INFO:tasks.workunit.client.1.smithi134.stdout:5/661: creat db/d7a/fce x:0 0 0 2024-03-12T16:10:43.352 INFO:tasks.workunit.client.0.smithi006.stdout:3/364: fsync d8/d19/d26/d59/d2c/dc/d28/f74 0 2024-03-12T16:10:43.354 INFO:tasks.workunit.client.0.smithi006.stdout:7/485: symlink de/d18/d2a/d39/d81/la5 0 2024-03-12T16:10:43.356 INFO:tasks.workunit.client.0.smithi006.stdout:9/359: readlink d0/d4/d3b/l5d 0 2024-03-12T16:10:43.358 INFO:tasks.workunit.client.0.smithi006.stdout:7/486: fsync de/d2c/f3c 0 2024-03-12T16:10:43.360 INFO:tasks.workunit.client.0.smithi006.stdout:9/360: fsync d0/d8/d16/f31 0 2024-03-12T16:10:43.361 INFO:tasks.workunit.client.0.smithi006.stdout:9/361: readlink d0/d1f/l68 0 2024-03-12T16:10:43.363 INFO:tasks.workunit.client.0.smithi006.stdout:3/365: dwrite d8/d19/d26/d59/d2c/dc/d28/f2b [0,4194304] 0 2024-03-12T16:10:43.365 INFO:tasks.workunit.client.1.smithi134.stdout:5/662: rmdir db/d7a 39 2024-03-12T16:10:43.368 INFO:tasks.workunit.client.0.smithi006.stdout:7/487: getdents de/d1c 0 2024-03-12T16:10:43.368 INFO:tasks.workunit.client.1.smithi134.stdout:5/663: read db/d12/d1d/d59/f8b [291268,113214] 0 2024-03-12T16:10:43.368 INFO:tasks.workunit.client.0.smithi006.stdout:3/366: creat d8/d52/d6c/f84 x:0 0 0 2024-03-12T16:10:43.370 INFO:tasks.workunit.client.1.smithi134.stdout:5/664: symlink db/d12/d29/lcf 0 2024-03-12T16:10:43.372 INFO:tasks.workunit.client.0.smithi006.stdout:7/488: symlink de/d27/d2b/la6 0 2024-03-12T16:10:43.374 INFO:tasks.workunit.client.1.smithi134.stdout:5/665: creat db/d7a/d97/fd0 x:0 0 0 2024-03-12T16:10:43.375 INFO:tasks.workunit.client.0.smithi006.stdout:9/362: rename d0/d8/d23/l73 to d0/d8/d16/l7a 0 2024-03-12T16:10:43.376 INFO:tasks.workunit.client.1.smithi134.stdout:5/666: truncate db/f27 514865 0 2024-03-12T16:10:43.377 INFO:tasks.workunit.client.0.smithi006.stdout:7/489: mknod de/d2c/d4f/ca7 0 2024-03-12T16:10:43.377 INFO:tasks.workunit.client.1.smithi134.stdout:5/667: unlink db/d7a/d97/fad 0 2024-03-12T16:10:43.378 INFO:tasks.workunit.client.0.smithi006.stdout:3/367: mknod d8/d19/d26/d59/d2c/d41/c85 0 2024-03-12T16:10:43.378 INFO:tasks.workunit.client.0.smithi006.stdout:7/490: write de/d1c/fa2 [855050,97114] 0 2024-03-12T16:10:43.380 INFO:tasks.workunit.client.0.smithi006.stdout:1/368: dread d0/f16 [0,4194304] 0 2024-03-12T16:10:43.380 INFO:tasks.workunit.client.0.smithi006.stdout:9/363: write d0/d8/d2b/d20/d37/f39 [2243846,103067] 0 2024-03-12T16:10:43.382 INFO:tasks.workunit.client.0.smithi006.stdout:7/491: write de/d2c/f73 [596264,115722] 0 2024-03-12T16:10:43.384 INFO:tasks.workunit.client.0.smithi006.stdout:9/364: symlink d0/d4/d3b/d6a/l7b 0 2024-03-12T16:10:43.384 INFO:tasks.workunit.client.0.smithi006.stdout:3/368: creat d8/d19/d26/d59/d2c/f86 x:0 0 0 2024-03-12T16:10:43.386 INFO:tasks.workunit.client.0.smithi006.stdout:7/492: read de/d2c/f6f [2753720,15866] 0 2024-03-12T16:10:43.386 INFO:tasks.workunit.client.0.smithi006.stdout:1/369: rename d0/d25/d2a/f7d to d0/d25/d2a/d43/d56/f7e 0 2024-03-12T16:10:43.388 INFO:tasks.workunit.client.0.smithi006.stdout:9/365: creat d0/d4/d18/d4d/f7c x:0 0 0 2024-03-12T16:10:43.389 INFO:tasks.workunit.client.0.smithi006.stdout:1/370: symlink d0/l7f 0 2024-03-12T16:10:43.392 INFO:tasks.workunit.client.0.smithi006.stdout:7/493: rename de/d1c/d35/c3a to de/d1c/ca8 0 2024-03-12T16:10:43.393 INFO:tasks.workunit.client.0.smithi006.stdout:1/371: write d0/d25/d2a/d35/f51 [3883394,16810] 0 2024-03-12T16:10:43.393 INFO:tasks.workunit.client.1.smithi134.stdout:5/668: dread db/f58 [0,4194304] 0 2024-03-12T16:10:43.396 INFO:tasks.workunit.client.0.smithi006.stdout:1/372: dread - d0/d25/d2a/d43/d63/f7b zero size 2024-03-12T16:10:43.396 INFO:tasks.workunit.client.0.smithi006.stdout:3/369: dwrite d8/d19/d26/d59/d2c/dc/f3a [0,4194304] 0 2024-03-12T16:10:43.396 INFO:tasks.workunit.client.1.smithi134.stdout:5/669: getdents db/d12/d37/db4 0 2024-03-12T16:10:43.397 INFO:tasks.workunit.client.1.smithi134.stdout:5/670: dread - db/d12/d1d/d5c/fc8 zero size 2024-03-12T16:10:43.402 INFO:tasks.workunit.client.0.smithi006.stdout:9/366: rename d0/d8/d2b to d0/d8/d16/d7d 0 2024-03-12T16:10:43.404 INFO:tasks.workunit.client.0.smithi006.stdout:1/373: mknod d0/c80 0 2024-03-12T16:10:43.406 INFO:tasks.workunit.client.0.smithi006.stdout:7/494: dwrite de/d7b/d7e/f94 [0,4194304] 0 2024-03-12T16:10:43.408 INFO:tasks.workunit.client.0.smithi006.stdout:7/495: write de/d27/d2b/d4a/d6a/f84 [953092,20017] 0 2024-03-12T16:10:43.412 INFO:tasks.workunit.client.0.smithi006.stdout:3/370: dread d8/d19/d47/f72 [0,4194304] 0 2024-03-12T16:10:43.413 INFO:tasks.workunit.client.0.smithi006.stdout:9/367: fsync d0/d4/d3b/f3d 0 2024-03-12T16:10:43.416 INFO:tasks.workunit.client.0.smithi006.stdout:1/374: mknod d0/d25/c81 0 2024-03-12T16:10:43.419 INFO:tasks.workunit.client.0.smithi006.stdout:9/368: chown d0/d8/d16/d7d/d20/d37/f39 20805 1 2024-03-12T16:10:43.419 INFO:tasks.workunit.client.0.smithi006.stdout:7/496: dwrite de/d27/d2b/d4a/d6a/f84 [0,4194304] 0 2024-03-12T16:10:43.419 INFO:tasks.workunit.client.0.smithi006.stdout:3/371: mknod d8/d19/d26/d59/d5b/c87 0 2024-03-12T16:10:43.421 INFO:tasks.workunit.client.1.smithi134.stdout:5/671: dwrite db/f11 [0,4194304] 0 2024-03-12T16:10:43.422 INFO:tasks.workunit.client.0.smithi006.stdout:7/497: symlink de/d27/d7c/la9 0 2024-03-12T16:10:43.425 INFO:tasks.workunit.client.0.smithi006.stdout:9/369: creat d0/d4/d3b/d4a/f7e x:0 0 0 2024-03-12T16:10:43.425 INFO:tasks.workunit.client.1.smithi134.stdout:5/672: mknod db/d12/d1d/d3a/cd1 0 2024-03-12T16:10:43.426 INFO:tasks.workunit.client.0.smithi006.stdout:9/370: chown d0/d4/d3b/d6a 4978 1 2024-03-12T16:10:43.428 INFO:tasks.workunit.client.0.smithi006.stdout:1/375: rename d0/d25/d2a/c5f to d0/d25/d2a/c82 0 2024-03-12T16:10:43.429 INFO:tasks.workunit.client.1.smithi134.stdout:9/570: sync 2024-03-12T16:10:43.430 INFO:tasks.workunit.client.1.smithi134.stdout:7/560: sync 2024-03-12T16:10:43.431 INFO:tasks.workunit.client.0.smithi006.stdout:9/371: mknod d0/d8/d16/d2f/c7f 0 2024-03-12T16:10:43.433 INFO:tasks.workunit.client.1.smithi134.stdout:7/561: symlink d8/d27/d9d/lc0 0 2024-03-12T16:10:43.435 INFO:tasks.workunit.client.0.smithi006.stdout:3/372: getdents d8/d19/d26/d59/d2c/dc/d28 0 2024-03-12T16:10:43.435 INFO:tasks.workunit.client.1.smithi134.stdout:7/562: read - d8/dc/d55/fad zero size 2024-03-12T16:10:43.436 INFO:tasks.workunit.client.0.smithi006.stdout:7/498: getdents de/d2c/d4f 0 2024-03-12T16:10:43.437 INFO:tasks.workunit.client.0.smithi006.stdout:3/373: chown d8/d19/d26/d59/d2c/dc/d28/d2f 1202 1 2024-03-12T16:10:43.437 INFO:tasks.workunit.client.0.smithi006.stdout:9/372: mkdir d0/d8/d80 0 2024-03-12T16:10:43.438 INFO:tasks.workunit.client.1.smithi134.stdout:9/571: dwrite d5/d10/f5a [0,4194304] 0 2024-03-12T16:10:43.439 INFO:tasks.workunit.client.0.smithi006.stdout:1/376: creat d0/d25/f83 x:0 0 0 2024-03-12T16:10:43.439 INFO:tasks.workunit.client.0.smithi006.stdout:7/499: write de/d7b/d7e/f94 [698983,63612] 0 2024-03-12T16:10:43.440 INFO:tasks.workunit.client.0.smithi006.stdout:3/374: dread - d8/d19/d26/d59/d2c/f86 zero size 2024-03-12T16:10:43.440 INFO:tasks.workunit.client.1.smithi134.stdout:9/572: chown d5/d10/d35/d49/d54/d5e/f71 7632731 1 2024-03-12T16:10:43.442 INFO:tasks.workunit.client.0.smithi006.stdout:9/373: mknod d0/d8/d16/c81 0 2024-03-12T16:10:43.442 INFO:tasks.workunit.client.0.smithi006.stdout:3/375: write d8/f76 [102302,11910] 0 2024-03-12T16:10:43.443 INFO:tasks.workunit.client.0.smithi006.stdout:1/377: write d0/d25/d67/f77 [121039,92721] 0 2024-03-12T16:10:43.444 INFO:tasks.workunit.client.0.smithi006.stdout:7/500: creat de/d2c/faa x:0 0 0 2024-03-12T16:10:43.444 INFO:tasks.workunit.client.1.smithi134.stdout:9/573: creat d5/d10/d51/fa7 x:0 0 0 2024-03-12T16:10:43.446 INFO:tasks.workunit.client.0.smithi006.stdout:9/374: creat d0/d8/d80/f82 x:0 0 0 2024-03-12T16:10:43.447 INFO:tasks.workunit.client.1.smithi134.stdout:7/563: dwrite d8/d27/f73 [0,4194304] 0 2024-03-12T16:10:43.447 INFO:tasks.workunit.client.1.smithi134.stdout:7/564: readlink d8/l3c 0 2024-03-12T16:10:43.448 INFO:tasks.workunit.client.1.smithi134.stdout:9/574: mknod d5/d10/d35/d49/d8d/ca8 0 2024-03-12T16:10:43.448 INFO:tasks.workunit.client.0.smithi006.stdout:7/501: creat de/d2c/d4f/d83/fab x:0 0 0 2024-03-12T16:10:43.449 INFO:tasks.workunit.client.1.smithi134.stdout:4/527: sync 2024-03-12T16:10:43.449 INFO:tasks.workunit.client.1.smithi134.stdout:1/446: sync 2024-03-12T16:10:43.450 INFO:tasks.workunit.client.1.smithi134.stdout:6/569: sync 2024-03-12T16:10:43.450 INFO:tasks.workunit.client.1.smithi134.stdout:0/611: sync 2024-03-12T16:10:43.450 INFO:tasks.workunit.client.1.smithi134.stdout:2/541: sync 2024-03-12T16:10:43.450 INFO:tasks.workunit.client.1.smithi134.stdout:8/613: sync 2024-03-12T16:10:43.450 INFO:tasks.workunit.client.1.smithi134.stdout:3/743: sync 2024-03-12T16:10:43.450 INFO:tasks.workunit.client.0.smithi006.stdout:9/375: mkdir d0/d83 0 2024-03-12T16:10:43.454 INFO:tasks.workunit.client.0.smithi006.stdout:3/376: rename d8/d19/d26/d59/f3f to d8/f88 0 2024-03-12T16:10:43.454 INFO:tasks.workunit.client.1.smithi134.stdout:3/744: truncate d1/fb0 332753 0 2024-03-12T16:10:43.455 INFO:tasks.workunit.client.1.smithi134.stdout:9/575: rename d5/d10/d33/l62 to d5/d20/d72/la9 0 2024-03-12T16:10:43.456 INFO:tasks.workunit.client.0.smithi006.stdout:3/377: readlink l4 0 2024-03-12T16:10:43.456 INFO:tasks.workunit.client.0.smithi006.stdout:9/376: fsync d0/f28 0 2024-03-12T16:10:43.457 INFO:tasks.workunit.client.0.smithi006.stdout:7/502: dwrite de/d7b/f91 [0,4194304] 0 2024-03-12T16:10:43.458 INFO:tasks.workunit.client.1.smithi134.stdout:0/612: truncate db/d2f/d31/d56/f72 28523 0 2024-03-12T16:10:43.458 INFO:tasks.workunit.client.1.smithi134.stdout:9/576: write d5/d10/d35/d49/d54/d5e/d82/f92 [464906,125123] 0 2024-03-12T16:10:43.459 INFO:tasks.workunit.client.1.smithi134.stdout:2/542: creat d4/d84/d63/fbf x:0 0 0 2024-03-12T16:10:43.459 INFO:tasks.workunit.client.0.smithi006.stdout:1/378: rename d0/d25/l26 to d0/d25/d2a/d43/d63/l84 0 2024-03-12T16:10:43.461 INFO:tasks.workunit.client.1.smithi134.stdout:3/745: mkdir d1/db/d10/d2d/d2e/d10a 0 2024-03-12T16:10:43.461 INFO:tasks.workunit.client.1.smithi134.stdout:9/577: dread - d5/d10/d51/f97 zero size 2024-03-12T16:10:43.462 INFO:tasks.workunit.client.1.smithi134.stdout:7/565: link d8/dc/d20/d26/d36/f60 d8/dc/d20/d26/d36/fc1 0 2024-03-12T16:10:43.463 INFO:tasks.workunit.client.1.smithi134.stdout:1/447: symlink d0/d16/d9/d13/l99 0 2024-03-12T16:10:43.465 INFO:tasks.workunit.client.0.smithi006.stdout:1/379: mknod d0/d25/c85 0 2024-03-12T16:10:43.466 INFO:tasks.workunit.client.1.smithi134.stdout:6/570: symlink d1/d16/d4c/d65/d70/le0 0 2024-03-12T16:10:43.467 INFO:tasks.workunit.client.0.smithi006.stdout:7/503: dwrite de/f9f [0,4194304] 0 2024-03-12T16:10:43.468 INFO:tasks.workunit.client.1.smithi134.stdout:8/614: dread d3/d1b/d17/d25/d49/f75 [0,4194304] 0 2024-03-12T16:10:43.468 INFO:tasks.workunit.client.1.smithi134.stdout:7/566: unlink d8/dc/d55/d57/l61 0 2024-03-12T16:10:43.469 INFO:tasks.workunit.client.0.smithi006.stdout:1/380: truncate d0/f1b 393760 0 2024-03-12T16:10:43.469 INFO:tasks.workunit.client.0.smithi006.stdout:1/381: fsync d0/f13 0 2024-03-12T16:10:43.475 INFO:tasks.workunit.client.1.smithi134.stdout:3/746: mknod d1/db/d10/d2d/d2e/d72/d97/c10b 0 2024-03-12T16:10:43.478 INFO:tasks.workunit.client.0.smithi006.stdout:7/504: dwrite de/d2c/faa [0,4194304] 0 2024-03-12T16:10:43.479 INFO:tasks.workunit.client.1.smithi134.stdout:0/613: dwrite db/d2f/d61/d6c/fa9 [0,4194304] 0 2024-03-12T16:10:43.480 INFO:tasks.workunit.client.1.smithi134.stdout:6/571: truncate d1/d4/f47 732823 0 2024-03-12T16:10:43.481 INFO:tasks.workunit.client.0.smithi006.stdout:1/382: dwrite d0/d25/f59 [0,4194304] 0 2024-03-12T16:10:43.485 INFO:tasks.workunit.client.0.smithi006.stdout:9/377: truncate d0/d8/d16/d7d/d20/d37/f5c 456453 0 2024-03-12T16:10:43.488 INFO:tasks.workunit.client.0.smithi006.stdout:9/378: mknod d0/d4/d3b/c84 0 2024-03-12T16:10:43.489 INFO:tasks.workunit.client.1.smithi134.stdout:2/543: dread d4/f13 [0,4194304] 0 2024-03-12T16:10:43.490 INFO:tasks.workunit.client.1.smithi134.stdout:7/567: dread d8/dc/d55/d57/f9e [0,4194304] 0 2024-03-12T16:10:43.493 INFO:tasks.workunit.client.1.smithi134.stdout:8/615: truncate d3/d1b/d17/d24/d28/fcb 4281032 0 2024-03-12T16:10:43.495 INFO:tasks.workunit.client.0.smithi006.stdout:1/383: dwrite d0/d25/d2a/d43/f44 [0,4194304] 0 2024-03-12T16:10:43.495 INFO:tasks.workunit.client.0.smithi006.stdout:7/505: read de/d18/d2a/d40/f60 [2295577,90324] 0 2024-03-12T16:10:43.497 INFO:tasks.workunit.client.1.smithi134.stdout:1/448: dwrite d0/d16/d9/d13/d38/f8b [4194304,4194304] 0 2024-03-12T16:10:43.497 INFO:tasks.workunit.client.1.smithi134.stdout:3/747: write d1/db/d10/f8a [901288,100778] 0 2024-03-12T16:10:43.502 INFO:tasks.workunit.client.0.smithi006.stdout:1/384: read d0/fb [2664770,118405] 0 2024-03-12T16:10:43.503 INFO:tasks.workunit.client.0.smithi006.stdout:1/385: chown d0/l29 12572 1 2024-03-12T16:10:43.503 INFO:tasks.workunit.client.0.smithi006.stdout:7/506: link de/d27/d2b/d4a/l5c de/d1c/d35/lac 0 2024-03-12T16:10:43.504 INFO:tasks.workunit.client.0.smithi006.stdout:7/507: dread - de/d18/d2a/d39/f58 zero size 2024-03-12T16:10:43.505 INFO:tasks.workunit.client.0.smithi006.stdout:1/386: symlink d0/l86 0 2024-03-12T16:10:43.506 INFO:tasks.workunit.client.1.smithi134.stdout:4/528: dwrite d1/d13/f71 [0,4194304] 0 2024-03-12T16:10:43.519 INFO:tasks.workunit.client.1.smithi134.stdout:5/673: dwrite db/d12/d1d/f22 [4194304,4194304] 0 2024-03-12T16:10:43.519 INFO:tasks.workunit.client.1.smithi134.stdout:4/529: dread - d1/d24/d34/d8e/f98 zero size 2024-03-12T16:10:43.526 INFO:tasks.workunit.client.1.smithi134.stdout:9/578: dwrite d5/f28 [0,4194304] 0 2024-03-12T16:10:43.528 INFO:tasks.workunit.client.1.smithi134.stdout:1/449: fsync d0/d42/f92 0 2024-03-12T16:10:43.529 INFO:tasks.workunit.client.1.smithi134.stdout:5/674: rmdir db/d12/d37/d71/da9 0 2024-03-12T16:10:43.529 INFO:tasks.workunit.client.1.smithi134.stdout:8/616: dwrite d3/fc7 [0,4194304] 0 2024-03-12T16:10:43.530 INFO:tasks.workunit.client.1.smithi134.stdout:0/614: dwrite db/f26 [0,4194304] 0 2024-03-12T16:10:43.534 INFO:tasks.workunit.client.1.smithi134.stdout:3/748: write d1/db/d12/f71 [1190299,42408] 0 2024-03-12T16:10:43.543 INFO:tasks.workunit.client.0.smithi006.stdout:1/387: dread d0/fe [0,4194304] 0 2024-03-12T16:10:43.544 INFO:tasks.workunit.client.0.smithi006.stdout:9/379: truncate d0/d8/d16/d7d/d20/d37/f47 1350914 0 2024-03-12T16:10:43.545 INFO:tasks.workunit.client.0.smithi006.stdout:9/380: readlink d0/l9 0 2024-03-12T16:10:43.546 INFO:tasks.workunit.client.1.smithi134.stdout:9/579: truncate d5/d20/f52 4420621 0 2024-03-12T16:10:43.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/615: unlink db/l2e 0 2024-03-12T16:10:43.548 INFO:tasks.workunit.client.1.smithi134.stdout:3/749: symlink d1/db/d12/de4/l10c 0 2024-03-12T16:10:43.548 INFO:tasks.workunit.client.1.smithi134.stdout:2/544: dwrite d4/d84/d63/d9d/d3d/f64 [0,4194304] 0 2024-03-12T16:10:43.549 INFO:tasks.workunit.client.0.smithi006.stdout:1/388: link d0/f4 d0/d25/d2a/d43/f87 0 2024-03-12T16:10:43.549 INFO:tasks.workunit.client.0.smithi006.stdout:1/389: readlink d0/l86 0 2024-03-12T16:10:43.551 INFO:tasks.workunit.client.1.smithi134.stdout:1/450: symlink d0/d16/d9/l9a 0 2024-03-12T16:10:43.552 INFO:tasks.workunit.client.1.smithi134.stdout:4/530: dwrite d1/d13/f1d [0,4194304] 0 2024-03-12T16:10:43.553 INFO:tasks.workunit.client.1.smithi134.stdout:9/580: chown d5/d10/d35/d49/d54/d5e/d82 4371 1 2024-03-12T16:10:43.553 INFO:tasks.workunit.client.1.smithi134.stdout:0/616: fsync db/d2f/d31/d76/d9f/fb8 0 2024-03-12T16:10:43.554 INFO:tasks.workunit.client.0.smithi006.stdout:1/390: dwrite d0/f34 [0,4194304] 0 2024-03-12T16:10:43.562 INFO:tasks.workunit.client.0.smithi006.stdout:5/270: sync 2024-03-12T16:10:43.562 INFO:tasks.workunit.client.0.smithi006.stdout:4/434: sync 2024-03-12T16:10:43.563 INFO:tasks.workunit.client.1.smithi134.stdout:5/675: dwrite db/d12/d1d/f89 [0,4194304] 0 2024-03-12T16:10:43.565 INFO:tasks.workunit.client.0.smithi006.stdout:4/435: write d1/d38/d79/f84 [1025237,35943] 0 2024-03-12T16:10:43.566 INFO:tasks.workunit.client.0.smithi006.stdout:5/271: mknod d7/d9/d2c/c5c 0 2024-03-12T16:10:43.567 INFO:tasks.workunit.client.1.smithi134.stdout:1/451: creat d0/d16/d39/f9b x:0 0 0 2024-03-12T16:10:43.569 INFO:tasks.workunit.client.1.smithi134.stdout:6/572: dread d1/d16/d4c/d58/da0/db7/f71 [0,4194304] 0 2024-03-12T16:10:43.570 INFO:tasks.workunit.client.1.smithi134.stdout:9/581: unlink d5/d10/d1f/c4d 0 2024-03-12T16:10:43.572 INFO:tasks.workunit.client.1.smithi134.stdout:9/582: chown d5/d10/d35/l19 448711858 1 2024-03-12T16:10:43.572 INFO:tasks.workunit.client.0.smithi006.stdout:5/272: rename d7/d9/d31/d3b/c4e to d7/d41/c5d 0 2024-03-12T16:10:43.576 INFO:tasks.workunit.client.1.smithi134.stdout:5/676: symlink db/d12/d37/db4/ld2 0 2024-03-12T16:10:43.576 INFO:tasks.workunit.client.1.smithi134.stdout:1/452: symlink d0/d16/d9/d51/l9c 0 2024-03-12T16:10:43.576 INFO:tasks.workunit.client.1.smithi134.stdout:6/573: read d1/d3/d10/f9e [1190061,74555] 0 2024-03-12T16:10:43.577 INFO:tasks.workunit.client.1.smithi134.stdout:8/617: rename d3/d1b/d17/d25/d33/d15/d7e to d3/d1b/d17/d24/db6/dd9 0 2024-03-12T16:10:43.578 INFO:tasks.workunit.client.1.smithi134.stdout:8/618: chown d3 41456796 1 2024-03-12T16:10:43.579 INFO:tasks.workunit.client.1.smithi134.stdout:5/677: write db/d12/d1d/d3a/d4e/f8a [442060,66616] 0 2024-03-12T16:10:43.579 INFO:tasks.workunit.client.0.smithi006.stdout:4/436: mknod d1/db/d39/d42/d61/c89 0 2024-03-12T16:10:43.580 INFO:tasks.workunit.client.1.smithi134.stdout:1/453: write d0/d16/d9/d13/f7f [839093,8901] 0 2024-03-12T16:10:43.582 INFO:tasks.workunit.client.0.smithi006.stdout:1/391: write d0/f1b [693457,23009] 0 2024-03-12T16:10:43.582 INFO:tasks.workunit.client.1.smithi134.stdout:4/531: creat d1/d24/fad x:0 0 0 2024-03-12T16:10:43.584 INFO:tasks.workunit.client.0.smithi006.stdout:4/437: creat d1/db/d39/d42/d61/f8a x:0 0 0 2024-03-12T16:10:43.586 INFO:tasks.workunit.client.1.smithi134.stdout:6/574: dwrite d1/d4/f67 [0,4194304] 0 2024-03-12T16:10:43.586 INFO:tasks.workunit.client.1.smithi134.stdout:8/619: chown d3/d1b/d17/d25/d33/d15/l60 2053477 1 2024-03-12T16:10:43.586 INFO:tasks.workunit.client.0.smithi006.stdout:5/273: symlink d7/d8/l5e 0 2024-03-12T16:10:43.587 INFO:tasks.workunit.client.1.smithi134.stdout:0/617: read db/f2d [7414505,114380] 0 2024-03-12T16:10:43.590 INFO:tasks.workunit.client.1.smithi134.stdout:6/575: chown d1/d3/d10/c44 6149 1 2024-03-12T16:10:43.591 INFO:tasks.workunit.client.1.smithi134.stdout:8/620: write d3/d1b/d17/d45/fcc [698096,80115] 0 2024-03-12T16:10:43.592 INFO:tasks.workunit.client.0.smithi006.stdout:1/392: dwrite d0/f2f [0,4194304] 0 2024-03-12T16:10:43.593 INFO:tasks.workunit.client.1.smithi134.stdout:6/576: dread - d1/d16/d4c/d65/d70/fda zero size 2024-03-12T16:10:43.593 INFO:tasks.workunit.client.1.smithi134.stdout:0/618: write db/d2f/d31/f47 [725068,91113] 0 2024-03-12T16:10:43.594 INFO:tasks.workunit.client.1.smithi134.stdout:4/532: creat d1/d13/d49/d64/da3/fae x:0 0 0 2024-03-12T16:10:43.595 INFO:tasks.workunit.client.1.smithi134.stdout:6/577: readlink d1/d3/d19/d32/l69 0 2024-03-12T16:10:43.595 INFO:tasks.workunit.client.0.smithi006.stdout:5/274: creat d7/d9/d47/f5f x:0 0 0 2024-03-12T16:10:43.595 INFO:tasks.workunit.client.0.smithi006.stdout:1/393: readlink d0/l1d 0 2024-03-12T16:10:43.596 INFO:tasks.workunit.client.1.smithi134.stdout:1/454: dread d0/d16/d9/d13/d21/d2f/f56 [0,4194304] 0 2024-03-12T16:10:43.597 INFO:tasks.workunit.client.0.smithi006.stdout:5/275: readlink d7/d9/d10/l25 0 2024-03-12T16:10:43.597 INFO:tasks.workunit.client.1.smithi134.stdout:0/619: fdatasync db/d2f/d31/f59 0 2024-03-12T16:10:43.597 INFO:tasks.workunit.client.0.smithi006.stdout:1/394: readlink d0/d25/d2a/d43/l6f 0 2024-03-12T16:10:43.602 INFO:tasks.workunit.client.1.smithi134.stdout:5/678: creat db/d12/d29/d3d/fd3 x:0 0 0 2024-03-12T16:10:43.602 INFO:tasks.workunit.client.1.smithi134.stdout:1/455: stat d0/d16/d9/d13/d21/c88 0 2024-03-12T16:10:43.603 INFO:tasks.workunit.client.1.smithi134.stdout:0/620: write db/d2f/d61/d7a/fc1 [990747,9470] 0 2024-03-12T16:10:43.605 INFO:tasks.workunit.client.1.smithi134.stdout:8/621: fdatasync d3/d1b/d17/d25/d33/d15/d95/d5b/fb9 0 2024-03-12T16:10:43.606 INFO:tasks.workunit.client.0.smithi006.stdout:5/276: link d7/d9/d10/d24/c42 d7/d9/d10/c60 0 2024-03-12T16:10:43.607 INFO:tasks.workunit.client.1.smithi134.stdout:6/578: truncate d1/d89/fd6 718284 0 2024-03-12T16:10:43.607 INFO:tasks.workunit.client.1.smithi134.stdout:2/545: write d4/d12/d1d/d34/d58/f82 [144055,102368] 0 2024-03-12T16:10:43.608 INFO:tasks.workunit.client.0.smithi006.stdout:5/277: fsync d7/d9/d10/d24/f3d 0 2024-03-12T16:10:43.609 INFO:tasks.workunit.client.1.smithi134.stdout:4/533: unlink d1/d13/f71 0 2024-03-12T16:10:43.611 INFO:tasks.workunit.client.1.smithi134.stdout:5/679: creat db/d12/d1d/d3a/d49/fd4 x:0 0 0 2024-03-12T16:10:43.612 INFO:tasks.workunit.client.0.smithi006.stdout:5/278: unlink d7/d8/f48 0 2024-03-12T16:10:43.613 INFO:tasks.workunit.client.1.smithi134.stdout:6/579: write d1/fb2 [864095,15582] 0 2024-03-12T16:10:43.615 INFO:tasks.workunit.client.0.smithi006.stdout:5/279: mkdir d7/d9/d31/d3b/d61 0 2024-03-12T16:10:43.617 INFO:tasks.workunit.client.0.smithi006.stdout:5/280: fdatasync d7/d8/f14 0 2024-03-12T16:10:43.619 INFO:tasks.workunit.client.0.smithi006.stdout:1/395: dread d0/f30 [0,4194304] 0 2024-03-12T16:10:43.619 INFO:tasks.workunit.client.1.smithi134.stdout:2/546: chown d4/d12/d1d/f37 486363 1 2024-03-12T16:10:43.620 INFO:tasks.workunit.client.1.smithi134.stdout:3/750: dwrite d1/f65 [0,4194304] 0 2024-03-12T16:10:43.620 INFO:tasks.workunit.client.1.smithi134.stdout:8/622: write d3/d1b/d17/d3f/faf [4532473,38570] 0 2024-03-12T16:10:43.622 INFO:tasks.workunit.client.0.smithi006.stdout:1/396: chown d0/d25/d2a/d35/l5b 86 1 2024-03-12T16:10:43.625 INFO:tasks.workunit.client.1.smithi134.stdout:9/583: truncate d5/d46/f5c 2654710 0 2024-03-12T16:10:43.626 INFO:tasks.workunit.client.0.smithi006.stdout:4/438: dread d1/db/d17/f53 [0,4194304] 0 2024-03-12T16:10:43.627 INFO:tasks.workunit.client.0.smithi006.stdout:1/397: stat d0/d25/d2a/d43/d68/c6c 0 2024-03-12T16:10:43.628 INFO:tasks.workunit.client.1.smithi134.stdout:4/534: creat d1/de/d5a/d70/faf x:0 0 0 2024-03-12T16:10:43.629 INFO:tasks.workunit.client.0.smithi006.stdout:5/281: dwrite d7/d8/f14 [4194304,4194304] 0 2024-03-12T16:10:43.630 INFO:tasks.workunit.client.1.smithi134.stdout:5/680: truncate db/d12/d1d/f19 4829409 0 2024-03-12T16:10:43.630 INFO:tasks.workunit.client.0.smithi006.stdout:4/439: chown d1/d38/d79/f55 1 1 2024-03-12T16:10:43.630 INFO:tasks.workunit.client.0.smithi006.stdout:1/398: write d0/d25/d2a/d43/f47 [406533,111310] 0 2024-03-12T16:10:43.631 INFO:tasks.workunit.client.1.smithi134.stdout:8/623: write d3/d1b/d17/d25/f79 [1099351,125179] 0 2024-03-12T16:10:43.631 INFO:tasks.workunit.client.1.smithi134.stdout:2/547: creat d4/d12/d1d/d34/d47/d8c/da4/fc0 x:0 0 0 2024-03-12T16:10:43.632 INFO:tasks.workunit.client.1.smithi134.stdout:0/621: link db/d2f/d31/d68/cba db/d2f/d61/d7a/cc4 0 2024-03-12T16:10:43.633 INFO:tasks.workunit.client.1.smithi134.stdout:1/456: dread d0/d16/d9/d13/d21/d2f/f68 [0,4194304] 0 2024-03-12T16:10:43.634 INFO:tasks.workunit.client.1.smithi134.stdout:3/751: unlink d1/db/d10/l93 0 2024-03-12T16:10:43.636 INFO:tasks.workunit.client.1.smithi134.stdout:0/622: fsync db/f38 0 2024-03-12T16:10:43.636 INFO:tasks.workunit.client.1.smithi134.stdout:2/548: fsync d4/d12/f48 0 2024-03-12T16:10:43.636 INFO:tasks.workunit.client.0.smithi006.stdout:1/399: rename d0/d25/d2a/d35/c38 to d0/d25/d67/c88 0 2024-03-12T16:10:43.641 INFO:tasks.workunit.client.0.smithi006.stdout:1/400: link d0/l29 d0/d25/d2a/d43/d68/l89 0 2024-03-12T16:10:43.642 INFO:tasks.workunit.client.1.smithi134.stdout:6/580: dwrite d1/d16/d4c/d65/f6b [0,4194304] 0 2024-03-12T16:10:43.642 INFO:tasks.workunit.client.1.smithi134.stdout:3/752: write d1/db/d14/f42 [4363644,65623] 0 2024-03-12T16:10:43.645 INFO:tasks.workunit.client.1.smithi134.stdout:9/584: mknod d5/d10/d35/d49/d54/caa 0 2024-03-12T16:10:43.646 INFO:tasks.workunit.client.0.smithi006.stdout:1/401: link d0/f4 d0/d25/d2a/d35/d3f/f8a 0 2024-03-12T16:10:43.647 INFO:tasks.workunit.client.1.smithi134.stdout:3/753: chown d1/db/d10/d2d/d2e/lc1 13471 1 2024-03-12T16:10:43.648 INFO:tasks.workunit.client.1.smithi134.stdout:5/681: dread db/d12/d1d/d3a/f88 [0,4194304] 0 2024-03-12T16:10:43.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/585: dread - d5/d10/d35/d49/d8d/f84 zero size 2024-03-12T16:10:43.650 INFO:tasks.workunit.client.0.smithi006.stdout:4/440: truncate d1/db/d17/f85 599186 0 2024-03-12T16:10:43.650 INFO:tasks.workunit.client.1.smithi134.stdout:0/623: creat db/d2f/d31/d56/d9a/fc5 x:0 0 0 2024-03-12T16:10:43.651 INFO:tasks.workunit.client.1.smithi134.stdout:8/624: symlink d3/d1b/d17/d25/d33/d15/d95/d6d/lda 0 2024-03-12T16:10:43.651 INFO:tasks.workunit.client.1.smithi134.stdout:5/682: chown db/d12/d1d 256695438 1 2024-03-12T16:10:43.653 INFO:tasks.workunit.client.1.smithi134.stdout:2/549: chown d4/d84/cb4 1230 1 2024-03-12T16:10:43.654 INFO:tasks.workunit.client.0.smithi006.stdout:5/282: dread d7/d9/d10/f32 [0,4194304] 0 2024-03-12T16:10:43.654 INFO:tasks.workunit.client.0.smithi006.stdout:4/441: readlink d1/db/d1d/l33 0 2024-03-12T16:10:43.654 INFO:tasks.workunit.client.0.smithi006.stdout:1/402: link d0/d25/c85 d0/d25/d2a/d43/d63/c8b 0 2024-03-12T16:10:43.656 INFO:tasks.workunit.client.0.smithi006.stdout:5/283: read d7/d9/d10/d24/f3d [140073,2263] 0 2024-03-12T16:10:43.656 INFO:tasks.workunit.client.1.smithi134.stdout:4/535: rename d1/d13/d49/d53/l61 to d1/d13/d49/d64/d28/d4f/lb0 0 2024-03-12T16:10:43.656 INFO:tasks.workunit.client.1.smithi134.stdout:1/457: dread d0/f2a [0,4194304] 0 2024-03-12T16:10:43.657 INFO:tasks.workunit.client.0.smithi006.stdout:1/403: symlink d0/d25/d2a/d43/d68/l8c 0 2024-03-12T16:10:43.659 INFO:tasks.workunit.client.1.smithi134.stdout:0/624: symlink db/d2f/d31/d75/d88/lc6 0 2024-03-12T16:10:43.660 INFO:tasks.workunit.client.0.smithi006.stdout:1/404: chown d0/d25/d2a/d43/d68/c6c 129 1 2024-03-12T16:10:43.665 INFO:tasks.workunit.client.0.smithi006.stdout:5/284: dwrite d7/d9/f30 [0,4194304] 0 2024-03-12T16:10:43.666 INFO:tasks.workunit.client.1.smithi134.stdout:9/586: dwrite d5/d20/f70 [0,4194304] 0 2024-03-12T16:10:43.667 INFO:tasks.workunit.client.0.smithi006.stdout:1/405: unlink d0/d25/d2a/d43/l4a 0 2024-03-12T16:10:43.667 INFO:tasks.workunit.client.1.smithi134.stdout:4/536: write d1/d24/d34/d73/f8d [4434053,3700] 0 2024-03-12T16:10:43.667 INFO:tasks.workunit.client.1.smithi134.stdout:6/581: dwrite d1/da6/fc4 [0,4194304] 0 2024-03-12T16:10:43.671 INFO:tasks.workunit.client.1.smithi134.stdout:4/537: write d1/d13/f1d [3788664,16153] 0 2024-03-12T16:10:43.673 INFO:tasks.workunit.client.0.smithi006.stdout:4/442: dread d1/db/d1d/f2b [0,4194304] 0 2024-03-12T16:10:43.678 INFO:tasks.workunit.client.0.smithi006.stdout:5/285: dread d7/d9/f20 [0,4194304] 0 2024-03-12T16:10:43.679 INFO:tasks.workunit.client.0.smithi006.stdout:4/443: symlink d1/db/d1d/l8b 0 2024-03-12T16:10:43.681 INFO:tasks.workunit.client.1.smithi134.stdout:5/683: symlink db/d12/d29/d3d/d79/da5/dc0/ld5 0 2024-03-12T16:10:43.681 INFO:tasks.workunit.client.1.smithi134.stdout:8/625: creat d3/d1b/d17/d25/d33/fdb x:0 0 0 2024-03-12T16:10:43.681 INFO:tasks.workunit.client.1.smithi134.stdout:2/550: rename d4/d84/fa8 to d4/d84/d7d/dbe/fc1 0 2024-03-12T16:10:43.685 INFO:tasks.workunit.client.0.smithi006.stdout:5/286: link d7/d9/d2c/c5c d7/c62 0 2024-03-12T16:10:43.685 INFO:tasks.workunit.client.1.smithi134.stdout:9/587: readlink d5/d10/l91 0 2024-03-12T16:10:43.689 INFO:tasks.workunit.client.1.smithi134.stdout:9/588: read d5/d10/d35/d49/d54/f9e [12553,23718] 0 2024-03-12T16:10:43.690 INFO:tasks.workunit.client.1.smithi134.stdout:0/625: rename db/d2f/d31/d75/da4 to db/d2f/d31/d68/d70/dc7 0 2024-03-12T16:10:43.690 INFO:tasks.workunit.client.1.smithi134.stdout:9/589: chown d5/d10 12581 1 2024-03-12T16:10:43.691 INFO:tasks.workunit.client.0.smithi006.stdout:4/444: link d1/db/d17/f1a d1/db/d17/d5a/f8c 0 2024-03-12T16:10:43.692 INFO:tasks.workunit.client.0.smithi006.stdout:1/406: getdents d0/d25/d2a/d43/d68 0 2024-03-12T16:10:43.692 INFO:tasks.workunit.client.1.smithi134.stdout:3/754: write d1/db/f90 [36732,52291] 0 2024-03-12T16:10:43.693 INFO:tasks.workunit.client.0.smithi006.stdout:1/407: fdatasync d0/f23 0 2024-03-12T16:10:43.694 INFO:tasks.workunit.client.0.smithi006.stdout:1/408: chown d0/d25/d2a/d43/f49 7892 1 2024-03-12T16:10:43.696 INFO:tasks.workunit.client.0.smithi006.stdout:5/287: rmdir d7/d8/d5b 0 2024-03-12T16:10:43.697 INFO:tasks.workunit.client.1.smithi134.stdout:8/626: dwrite d3/d1b/d17/d25/d33/d15/d95/d4f/d65/f48 [4194304,4194304] 0 2024-03-12T16:10:43.697 INFO:tasks.workunit.client.0.smithi006.stdout:4/445: creat d1/db/d17/d5a/f8d x:0 0 0 2024-03-12T16:10:43.699 INFO:tasks.workunit.client.0.smithi006.stdout:4/446: chown d1/db/d17/d5a/f8c 175320 1 2024-03-12T16:10:43.700 INFO:tasks.workunit.client.0.smithi006.stdout:5/288: dread d7/d9/d31/d3b/f3f [0,4194304] 0 2024-03-12T16:10:43.703 INFO:tasks.workunit.client.1.smithi134.stdout:2/551: truncate d4/d12/d1d/d34/f42 765682 0 2024-03-12T16:10:43.705 INFO:tasks.workunit.client.0.smithi006.stdout:4/447: write d1/db/d17/f25 [4233929,108256] 0 2024-03-12T16:10:43.706 INFO:tasks.workunit.client.1.smithi134.stdout:5/684: link db/d12/d1d/d3a/d49/f62 db/d12/d29/d3d/d79/fd6 0 2024-03-12T16:10:43.708 INFO:tasks.workunit.client.1.smithi134.stdout:2/552: write d4/f1b [373044,19540] 0 2024-03-12T16:10:43.708 INFO:tasks.workunit.client.1.smithi134.stdout:8/627: stat d3/d1b/d17/d25/d33/d96/dbd 0 2024-03-12T16:10:43.709 INFO:tasks.workunit.client.1.smithi134.stdout:1/458: dwrite d0/f2a [0,4194304] 0 2024-03-12T16:10:43.709 INFO:tasks.workunit.client.1.smithi134.stdout:9/590: mkdir d5/d10/d35/d49/d54/d5e/dab 0 2024-03-12T16:10:43.710 INFO:tasks.workunit.client.1.smithi134.stdout:8/628: chown d3/d10/l11 460366128 1 2024-03-12T16:10:43.714 INFO:tasks.workunit.client.1.smithi134.stdout:0/626: mknod db/cc8 0 2024-03-12T16:10:43.716 INFO:tasks.workunit.client.0.smithi006.stdout:1/409: getdents d0/d25/d2a 0 2024-03-12T16:10:43.716 INFO:tasks.workunit.client.1.smithi134.stdout:9/591: chown d5/d10/d35/f6f 3 1 2024-03-12T16:10:43.716 INFO:tasks.workunit.client.0.smithi006.stdout:4/448: creat d1/db/d17/d43/f8e x:0 0 0 2024-03-12T16:10:43.718 INFO:tasks.workunit.client.0.smithi006.stdout:1/410: mkdir d0/d25/d67/d8d 0 2024-03-12T16:10:43.719 INFO:tasks.workunit.client.1.smithi134.stdout:4/538: stat d1/d13/d49/d53 0 2024-03-12T16:10:43.720 INFO:tasks.workunit.client.0.smithi006.stdout:4/449: symlink d1/d38/l8f 0 2024-03-12T16:10:43.721 INFO:tasks.workunit.client.0.smithi006.stdout:4/450: chown d1/db/d17 11642873 1 2024-03-12T16:10:43.723 INFO:tasks.workunit.client.1.smithi134.stdout:1/459: dread d0/d16/d9/d13/d21/d20/f44 [4194304,4194304] 0 2024-03-12T16:10:43.723 INFO:tasks.workunit.client.1.smithi134.stdout:1/460: chown d0 33172288 1 2024-03-12T16:10:43.724 INFO:tasks.workunit.client.1.smithi134.stdout:3/755: creat d1/d63/d6c/dbf/f10d x:0 0 0 2024-03-12T16:10:43.726 INFO:tasks.workunit.client.1.smithi134.stdout:1/461: chown d0/d42/f45 2 1 2024-03-12T16:10:43.727 INFO:tasks.workunit.client.1.smithi134.stdout:7/568: sync 2024-03-12T16:10:43.728 INFO:tasks.workunit.client.0.smithi006.stdout:1/411: dwrite d0/d25/d2a/d64/f6d [0,4194304] 0 2024-03-12T16:10:43.729 INFO:tasks.workunit.client.1.smithi134.stdout:9/592: rename d5/d10/d51/f97 to d5/d20/d72/fac 0 2024-03-12T16:10:43.729 INFO:tasks.workunit.client.0.smithi006.stdout:1/412: chown d0/d25/f32 129 1 2024-03-12T16:10:43.732 INFO:tasks.workunit.client.0.smithi006.stdout:6/376: sync 2024-03-12T16:10:43.732 INFO:tasks.workunit.client.0.smithi006.stdout:0/420: sync 2024-03-12T16:10:43.732 INFO:tasks.workunit.client.0.smithi006.stdout:8/310: sync 2024-03-12T16:10:43.733 INFO:tasks.workunit.client.1.smithi134.stdout:7/569: write d8/d27/f46 [2322563,1711] 0 2024-03-12T16:10:43.735 INFO:tasks.workunit.client.1.smithi134.stdout:1/462: creat d0/d16/d9/d13/d21/d2f/f9d x:0 0 0 2024-03-12T16:10:43.737 INFO:tasks.workunit.client.0.smithi006.stdout:0/421: mknod d2/d39/d42/c78 0 2024-03-12T16:10:43.738 INFO:tasks.workunit.client.0.smithi006.stdout:6/377: mkdir d3/d11/d3b/d5d/d8b 0 2024-03-12T16:10:43.738 INFO:tasks.workunit.client.1.smithi134.stdout:9/593: mkdir d5/d10/d51/dad 0 2024-03-12T16:10:43.739 INFO:tasks.workunit.client.0.smithi006.stdout:8/311: creat d2/db/d1a/d1f/f64 x:0 0 0 2024-03-12T16:10:43.739 INFO:tasks.workunit.client.0.smithi006.stdout:5/289: dread d7/d9/d2c/f36 [0,4194304] 0 2024-03-12T16:10:43.740 INFO:tasks.workunit.client.0.smithi006.stdout:1/413: symlink d0/d25/d2a/d43/d63/l8e 0 2024-03-12T16:10:43.740 INFO:tasks.workunit.client.1.smithi134.stdout:0/627: write db/fe [419311,43143] 0 2024-03-12T16:10:43.741 INFO:tasks.workunit.client.0.smithi006.stdout:0/422: chown d2/d6/d10/d11/d1d/c6f 6483 1 2024-03-12T16:10:43.742 INFO:tasks.workunit.client.1.smithi134.stdout:7/570: unlink d8/dc/d4b/f44 0 2024-03-12T16:10:43.746 INFO:tasks.workunit.client.0.smithi006.stdout:6/378: creat d3/d11/d10/d28/d45/d60/d7e/f8c x:0 0 0 2024-03-12T16:10:43.746 INFO:tasks.workunit.client.0.smithi006.stdout:8/312: mknod d2/db/d1a/d23/c65 0 2024-03-12T16:10:43.747 INFO:tasks.workunit.client.1.smithi134.stdout:8/629: dwrite d3/d10/f58 [0,4194304] 0 2024-03-12T16:10:43.747 INFO:tasks.workunit.client.1.smithi134.stdout:7/571: chown d8/dc/d7b/dbb/dbd 3012 1 2024-03-12T16:10:43.748 INFO:tasks.workunit.client.0.smithi006.stdout:6/379: dread - d3/d11/d10/d28/f53 zero size 2024-03-12T16:10:43.749 INFO:tasks.workunit.client.0.smithi006.stdout:8/313: chown d2/f15 233 1 2024-03-12T16:10:43.749 INFO:tasks.workunit.client.1.smithi134.stdout:0/628: write db/d2f/d31/f85 [935618,85484] 0 2024-03-12T16:10:43.749 INFO:tasks.workunit.client.1.smithi134.stdout:2/553: rename d4/d12/d1d/d34/f42 to d4/d84/d63/d9d/dba/fc2 0 2024-03-12T16:10:43.750 INFO:tasks.workunit.client.0.smithi006.stdout:1/414: link d0/d25/d2a/d43/f49 d0/d25/d2a/d43/f8f 0 2024-03-12T16:10:43.751 INFO:tasks.workunit.client.1.smithi134.stdout:9/594: chown d5/d10/d33/da1/la4 0 1 2024-03-12T16:10:43.754 INFO:tasks.workunit.client.1.smithi134.stdout:5/685: dread db/d12/d1d/d3a/d4e/f4f [0,4194304] 0 2024-03-12T16:10:43.754 INFO:tasks.workunit.client.1.smithi134.stdout:3/756: rename d1/db/f20 to d1/db/d12/d9d/d9f/d103/f10e 0 2024-03-12T16:10:43.755 INFO:tasks.workunit.client.0.smithi006.stdout:0/423: dwrite d2/d6/d10/f54 [0,4194304] 0 2024-03-12T16:10:43.755 INFO:tasks.workunit.client.1.smithi134.stdout:7/572: rmdir d8/dc/d7b 39 2024-03-12T16:10:43.756 INFO:tasks.workunit.client.1.smithi134.stdout:4/539: truncate d1/d24/d34/f47 404873 0 2024-03-12T16:10:43.757 INFO:tasks.workunit.client.1.smithi134.stdout:7/573: fsync d8/d27/d9d/f93 0 2024-03-12T16:10:43.758 INFO:tasks.workunit.client.0.smithi006.stdout:0/424: truncate d2/d39/f40 684965 0 2024-03-12T16:10:43.759 INFO:tasks.workunit.client.0.smithi006.stdout:8/314: rename d2/c48 to d2/d11/d3f/c66 0 2024-03-12T16:10:43.759 INFO:tasks.workunit.client.1.smithi134.stdout:0/629: rmdir db/d2f 39 2024-03-12T16:10:43.760 INFO:tasks.workunit.client.0.smithi006.stdout:6/380: fsync d3/d11/d10/d1b/d20/d5a/f81 0 2024-03-12T16:10:43.764 INFO:tasks.workunit.client.0.smithi006.stdout:4/451: dread d1/db/d1d/f5e [4194304,4194304] 0 2024-03-12T16:10:43.765 INFO:tasks.workunit.client.1.smithi134.stdout:2/554: unlink d4/d12/d1d/d34/d58/f93 0 2024-03-12T16:10:43.766 INFO:tasks.workunit.client.0.smithi006.stdout:5/290: dwrite d7/d8/f4d [0,4194304] 0 2024-03-12T16:10:43.769 INFO:tasks.workunit.client.0.smithi006.stdout:1/415: getdents d0/d25/d2a/d43/d63 0 2024-03-12T16:10:43.770 INFO:tasks.workunit.client.0.smithi006.stdout:5/291: dread - d7/d41/f55 zero size 2024-03-12T16:10:43.770 INFO:tasks.workunit.client.1.smithi134.stdout:2/555: unlink d4/d84/d7d/dbe/fc1 0 2024-03-12T16:10:43.774 INFO:tasks.workunit.client.0.smithi006.stdout:6/381: write d3/d11/d10/d1b/d6e/f4e [407008,71839] 0 2024-03-12T16:10:43.775 INFO:tasks.workunit.client.0.smithi006.stdout:4/452: dread d1/db/d17/d5a/f8c [4194304,4194304] 0 2024-03-12T16:10:43.776 INFO:tasks.workunit.client.0.smithi006.stdout:5/292: symlink d7/d9/d10/d24/l63 0 2024-03-12T16:10:43.777 INFO:tasks.workunit.client.0.smithi006.stdout:0/425: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:43.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/556: write d4/d12/d43/f76 [1941698,75551] 0 2024-03-12T16:10:43.779 INFO:tasks.workunit.client.0.smithi006.stdout:1/416: write d0/d25/d2a/d43/d63/f78 [779836,106643] 0 2024-03-12T16:10:43.781 INFO:tasks.workunit.client.0.smithi006.stdout:8/315: dwrite d2/db/d1a/d21/d4f/f5c [0,4194304] 0 2024-03-12T16:10:43.781 INFO:tasks.workunit.client.0.smithi006.stdout:6/382: rmdir d3/d11/d43 39 2024-03-12T16:10:43.782 INFO:tasks.workunit.client.1.smithi134.stdout:5/686: getdents db/d12/d37/d73/d8c 0 2024-03-12T16:10:43.784 INFO:tasks.workunit.client.0.smithi006.stdout:0/426: read - d2/d6/d10/d11/f66 zero size 2024-03-12T16:10:43.785 INFO:tasks.workunit.client.1.smithi134.stdout:4/540: link d1/d13/d49/f78 d1/d13/d49/fb1 0 2024-03-12T16:10:43.785 INFO:tasks.workunit.client.0.smithi006.stdout:8/316: chown d2 8491 1 2024-03-12T16:10:43.790 INFO:tasks.workunit.client.1.smithi134.stdout:2/557: rename d4/d12/d1d/l9e to d4/d12/d39/lc3 0 2024-03-12T16:10:43.791 INFO:tasks.workunit.client.0.smithi006.stdout:6/383: rename d3/d11/d10/d1b/d6e/c38 to d3/d11/d10/d19/c8d 0 2024-03-12T16:10:43.791 INFO:tasks.workunit.client.1.smithi134.stdout:5/687: symlink db/d12/d37/db4/ld7 0 2024-03-12T16:10:43.791 INFO:tasks.workunit.client.0.smithi006.stdout:0/427: fsync d2/d6/d10/f4c 0 2024-03-12T16:10:43.793 INFO:tasks.workunit.client.0.smithi006.stdout:4/453: mknod d1/db/d17/c90 0 2024-03-12T16:10:43.793 INFO:tasks.workunit.client.0.smithi006.stdout:5/293: dwrite d7/d9/d10/f1b [4194304,4194304] 0 2024-03-12T16:10:43.796 INFO:tasks.workunit.client.1.smithi134.stdout:5/688: truncate db/f58 406198 0 2024-03-12T16:10:43.800 INFO:tasks.workunit.client.1.smithi134.stdout:3/757: dread d1/d63/fdc [0,4194304] 0 2024-03-12T16:10:43.801 INFO:tasks.workunit.client.0.smithi006.stdout:4/454: mkdir d1/d91 0 2024-03-12T16:10:43.802 INFO:tasks.workunit.client.0.smithi006.stdout:8/317: getdents d2/db/d1a/d1f 0 2024-03-12T16:10:43.802 INFO:tasks.workunit.client.1.smithi134.stdout:2/558: rename d4/d84/d63/daa to d4/d12/d1d/d34/db7/dc4 0 2024-03-12T16:10:43.803 INFO:tasks.workunit.client.1.smithi134.stdout:4/541: unlink d1/d13/d49/d64/d28/l7a 0 2024-03-12T16:10:43.804 INFO:tasks.workunit.client.0.smithi006.stdout:0/428: mkdir d2/d6/d10/d11/d1d/d79 0 2024-03-12T16:10:43.804 INFO:tasks.workunit.client.0.smithi006.stdout:5/294: write d7/f28 [1193808,68882] 0 2024-03-12T16:10:43.805 INFO:tasks.workunit.client.0.smithi006.stdout:0/429: chown f0 1426 1 2024-03-12T16:10:43.805 INFO:tasks.workunit.client.0.smithi006.stdout:8/318: write d2/db/d1a/d21/d4f/f5c [2639831,1366] 0 2024-03-12T16:10:43.807 INFO:tasks.workunit.client.1.smithi134.stdout:9/595: dwrite d5/d10/d35/f61 [0,4194304] 0 2024-03-12T16:10:43.810 INFO:tasks.workunit.client.0.smithi006.stdout:4/455: getdents d1/db 0 2024-03-12T16:10:43.810 INFO:tasks.workunit.client.0.smithi006.stdout:8/319: fdatasync d2/db/d1a/d1f/f3c 0 2024-03-12T16:10:43.810 INFO:tasks.workunit.client.1.smithi134.stdout:5/689: creat db/d12/d29/fd8 x:0 0 0 2024-03-12T16:10:43.812 INFO:tasks.workunit.client.0.smithi006.stdout:8/320: chown d2/db/d1a/d21 369255128 1 2024-03-12T16:10:43.813 INFO:tasks.workunit.client.0.smithi006.stdout:2/416: sync 2024-03-12T16:10:43.813 INFO:tasks.workunit.client.0.smithi006.stdout:7/508: sync 2024-03-12T16:10:43.813 INFO:tasks.workunit.client.0.smithi006.stdout:9/381: sync 2024-03-12T16:10:43.813 INFO:tasks.workunit.client.1.smithi134.stdout:0/630: dwrite db/f1f [0,4194304] 0 2024-03-12T16:10:43.814 INFO:tasks.workunit.client.0.smithi006.stdout:3/378: sync 2024-03-12T16:10:43.814 INFO:tasks.workunit.client.1.smithi134.stdout:7/574: dwrite d8/dc/d20/d26/d36/fc1 [0,4194304] 0 2024-03-12T16:10:43.814 INFO:tasks.workunit.client.0.smithi006.stdout:0/430: rename d2/d6/d37/c6b to d2/d6/c7a 0 2024-03-12T16:10:43.815 INFO:tasks.workunit.client.1.smithi134.stdout:9/596: chown d5/cf 12311 1 2024-03-12T16:10:43.817 INFO:tasks.workunit.client.0.smithi006.stdout:0/431: fdatasync d2/fd 0 2024-03-12T16:10:43.817 INFO:tasks.workunit.client.1.smithi134.stdout:7/575: write d8/dc/d20/f13 [2262863,76927] 0 2024-03-12T16:10:43.820 INFO:tasks.workunit.client.1.smithi134.stdout:4/542: truncate d1/d13/d49/d64/f87 1638978 0 2024-03-12T16:10:43.820 INFO:tasks.workunit.client.0.smithi006.stdout:1/417: dread d0/d25/d2a/d43/f47 [0,4194304] 0 2024-03-12T16:10:43.821 INFO:tasks.workunit.client.0.smithi006.stdout:9/382: fsync d0/d4/d3b/d4a/f55 0 2024-03-12T16:10:43.821 INFO:tasks.workunit.client.1.smithi134.stdout:3/758: rename d1/db/d10/d2d/d2e/c31 to d1/d63/c10f 0 2024-03-12T16:10:43.824 INFO:tasks.workunit.client.1.smithi134.stdout:2/559: read d4/d84/d7d/f3a [709361,99669] 0 2024-03-12T16:10:43.824 INFO:tasks.workunit.client.1.smithi134.stdout:9/597: rmdir d5/d10/d35 39 2024-03-12T16:10:43.825 INFO:tasks.workunit.client.0.smithi006.stdout:3/379: write d8/d19/f5f [874347,91771] 0 2024-03-12T16:10:43.826 INFO:tasks.workunit.client.0.smithi006.stdout:6/384: truncate f1 697610 0 2024-03-12T16:10:43.826 INFO:tasks.workunit.client.1.smithi134.stdout:2/560: write d4/d12/d1d/f37 [1185661,109721] 0 2024-03-12T16:10:43.831 INFO:tasks.workunit.client.1.smithi134.stdout:5/690: truncate db/d12/d29/d3d/f54 1792269 0 2024-03-12T16:10:43.831 INFO:tasks.workunit.client.1.smithi134.stdout:0/631: creat db/d2f/d61/d6c/fc9 x:0 0 0 2024-03-12T16:10:43.831 INFO:tasks.workunit.client.1.smithi134.stdout:0/632: fdatasync db/d2f/d31/d56/f72 0 2024-03-12T16:10:43.832 INFO:tasks.workunit.client.0.smithi006.stdout:2/417: mknod d0/d13/d49/d60/d2b/d62/d66/c88 0 2024-03-12T16:10:43.834 INFO:tasks.workunit.client.0.smithi006.stdout:4/456: dwrite d1/db/d17/d5a/f8d [0,4194304] 0 2024-03-12T16:10:43.839 INFO:tasks.workunit.client.0.smithi006.stdout:8/321: mknod d2/db/c67 0 2024-03-12T16:10:43.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/759: creat d1/d63/dc2/f110 x:0 0 0 2024-03-12T16:10:43.840 INFO:tasks.workunit.client.1.smithi134.stdout:2/561: dwrite d4/d12/f32 [0,4194304] 0 2024-03-12T16:10:43.841 INFO:tasks.workunit.client.0.smithi006.stdout:9/383: unlink d0/d8/d16/d7d/f66 0 2024-03-12T16:10:43.842 INFO:tasks.workunit.client.0.smithi006.stdout:0/432: mknod d2/d6/d10/d11/d1d/d2e/d77/c7b 0 2024-03-12T16:10:43.842 INFO:tasks.workunit.client.1.smithi134.stdout:5/691: getdents db/d7a/dc4 0 2024-03-12T16:10:43.843 INFO:tasks.workunit.client.1.smithi134.stdout:3/760: mkdir d1/db/d10/d111 0 2024-03-12T16:10:43.845 INFO:tasks.workunit.client.1.smithi134.stdout:9/598: rename d5/d10/d35/d49/l65 to d5/d10/d35/d49/d54/d88/lae 0 2024-03-12T16:10:43.845 INFO:tasks.workunit.client.0.smithi006.stdout:5/295: dwrite d7/d9/f20 [0,4194304] 0 2024-03-12T16:10:43.847 INFO:tasks.workunit.client.1.smithi134.stdout:4/543: creat d1/d13/d49/d53/fb2 x:0 0 0 2024-03-12T16:10:43.848 INFO:tasks.workunit.client.1.smithi134.stdout:2/562: write d4/d12/d43/da2/f53 [495781,15753] 0 2024-03-12T16:10:43.849 INFO:tasks.workunit.client.0.smithi006.stdout:6/385: dread d3/d11/d10/d28/d45/f55 [0,4194304] 0 2024-03-12T16:10:43.849 INFO:tasks.workunit.client.0.smithi006.stdout:1/418: mknod d0/d25/d67/d8d/c90 0 2024-03-12T16:10:43.851 INFO:tasks.workunit.client.0.smithi006.stdout:3/380: creat d8/d19/d26/d59/d2c/d41/d45/f89 x:0 0 0 2024-03-12T16:10:43.852 INFO:tasks.workunit.client.0.smithi006.stdout:9/384: rmdir d0/d8/d16/d7d/d20 39 2024-03-12T16:10:43.852 INFO:tasks.workunit.client.1.smithi134.stdout:4/544: dread - d1/d13/d49/f66 zero size 2024-03-12T16:10:43.854 INFO:tasks.workunit.client.0.smithi006.stdout:8/322: read d2/db/d1a/d1f/f31 [4101174,77326] 0 2024-03-12T16:10:43.856 INFO:tasks.workunit.client.1.smithi134.stdout:9/599: creat d5/d10/d35/d49/d8d/faf x:0 0 0 2024-03-12T16:10:43.857 INFO:tasks.workunit.client.1.smithi134.stdout:5/692: symlink db/d12/d37/d73/ld9 0 2024-03-12T16:10:43.858 INFO:tasks.workunit.client.0.smithi006.stdout:5/296: symlink d7/d8/l64 0 2024-03-12T16:10:43.858 INFO:tasks.workunit.client.1.smithi134.stdout:3/761: symlink d1/db/l112 0 2024-03-12T16:10:43.859 INFO:tasks.workunit.client.0.smithi006.stdout:8/323: chown d2/db 234 1 2024-03-12T16:10:43.859 INFO:tasks.workunit.client.0.smithi006.stdout:3/381: mknod d8/d4c/d7c/c8a 0 2024-03-12T16:10:43.859 INFO:tasks.workunit.client.0.smithi006.stdout:1/419: chown d0/d25/d2a/d43/d56/f7e 1 1 2024-03-12T16:10:43.860 INFO:tasks.workunit.client.1.smithi134.stdout:9/600: chown d5/d10/d51/fa7 1317203 1 2024-03-12T16:10:43.860 INFO:tasks.workunit.client.1.smithi134.stdout:2/563: symlink d4/d12/d1d/d34/d47/d8c/da4/lc5 0 2024-03-12T16:10:43.863 INFO:tasks.workunit.client.0.smithi006.stdout:1/420: chown d0/l7f 9444 1 2024-03-12T16:10:43.864 INFO:tasks.workunit.client.1.smithi134.stdout:9/601: symlink d5/d10/d51/lb0 0 2024-03-12T16:10:43.865 INFO:tasks.workunit.client.1.smithi134.stdout:2/564: fsync d4/d12/d1d/d34/d58/f75 0 2024-03-12T16:10:43.868 INFO:tasks.workunit.client.0.smithi006.stdout:4/457: rename d1/db/d1d/c46 to d1/db/d1d/d2f/d6b/c92 0 2024-03-12T16:10:43.869 INFO:tasks.workunit.client.0.smithi006.stdout:0/433: dwrite d2/d6/d10/f75 [0,4194304] 0 2024-03-12T16:10:43.870 INFO:tasks.workunit.client.0.smithi006.stdout:7/509: dwrite de/d18/d2a/d40/f60 [0,4194304] 0 2024-03-12T16:10:43.870 INFO:tasks.workunit.client.0.smithi006.stdout:9/385: link d0/d1f/l68 d0/d8/d16/d2f/l85 0 2024-03-12T16:10:43.874 INFO:tasks.workunit.client.0.smithi006.stdout:5/297: mkdir d7/d9/d31/d3b/d4f/d65 0 2024-03-12T16:10:43.875 INFO:tasks.workunit.client.1.smithi134.stdout:3/762: dwrite d1/db/d14/d5f/f7d [0,4194304] 0 2024-03-12T16:10:43.875 INFO:tasks.workunit.client.1.smithi134.stdout:4/545: dwrite d1/d13/d49/d64/f92 [0,4194304] 0 2024-03-12T16:10:43.875 INFO:tasks.workunit.client.1.smithi134.stdout:7/576: dread d8/dc/d55/d81/d87/f9f [0,4194304] 0 2024-03-12T16:10:43.877 INFO:tasks.workunit.client.0.smithi006.stdout:4/458: fdatasync d1/db/f22 0 2024-03-12T16:10:43.878 INFO:tasks.workunit.client.0.smithi006.stdout:9/386: chown d0/d8/d16/d7d 15772414 1 2024-03-12T16:10:43.882 INFO:tasks.workunit.client.0.smithi006.stdout:6/386: rename d3/d11/d3b/d5d to d3/d11/d10/d1b/d20/d5a/d8e 0 2024-03-12T16:10:43.885 INFO:tasks.workunit.client.1.smithi134.stdout:9/602: rmdir d5/d10/d35/d49/d8d/d9a 0 2024-03-12T16:10:43.887 INFO:tasks.workunit.client.1.smithi134.stdout:7/577: creat d8/d27/d9d/fc2 x:0 0 0 2024-03-12T16:10:43.890 INFO:tasks.workunit.client.1.smithi134.stdout:2/565: link d4/d84/d7d/l96 d4/d12/d43/lc6 0 2024-03-12T16:10:43.890 INFO:tasks.workunit.client.0.smithi006.stdout:9/387: chown d0/d4/d18/c74 168 1 2024-03-12T16:10:43.891 INFO:tasks.workunit.client.0.smithi006.stdout:8/324: dwrite d2/db/f2e [0,4194304] 0 2024-03-12T16:10:43.892 INFO:tasks.workunit.client.0.smithi006.stdout:1/421: fdatasync d0/d25/d2a/d35/d3f/f8a 0 2024-03-12T16:10:43.892 INFO:tasks.workunit.client.0.smithi006.stdout:6/387: chown d3/d11/d10/d28/d45/d71 10984831 1 2024-03-12T16:10:43.892 INFO:tasks.workunit.client.0.smithi006.stdout:3/382: dwrite d8/d19/d26/d59/f4e [4194304,4194304] 0 2024-03-12T16:10:43.893 INFO:tasks.workunit.client.0.smithi006.stdout:4/459: symlink d1/db/d39/d42/l93 0 2024-03-12T16:10:43.899 INFO:tasks.workunit.client.0.smithi006.stdout:4/460: write d1/d38/f57 [357197,111597] 0 2024-03-12T16:10:43.900 INFO:tasks.workunit.client.0.smithi006.stdout:1/422: truncate d0/d25/d2a/d43/d56/f7e 89535 0 2024-03-12T16:10:43.900 INFO:tasks.workunit.client.1.smithi134.stdout:2/566: creat d4/d84/d7d/dbe/fc7 x:0 0 0 2024-03-12T16:10:43.900 INFO:tasks.workunit.client.1.smithi134.stdout:5/693: dread db/f6d [0,4194304] 0 2024-03-12T16:10:43.903 INFO:tasks.workunit.client.1.smithi134.stdout:4/546: dwrite d1/d13/d49/f65 [0,4194304] 0 2024-03-12T16:10:43.903 INFO:tasks.workunit.client.0.smithi006.stdout:5/298: rename d7/d9/l23 to d7/d9/d31/d3b/d4f/l66 0 2024-03-12T16:10:43.905 INFO:tasks.workunit.client.1.smithi134.stdout:9/603: creat d5/d10/d35/d49/d54/fb1 x:0 0 0 2024-03-12T16:10:43.905 INFO:tasks.workunit.client.1.smithi134.stdout:2/567: mknod d4/d84/d63/d9d/d3d/cc8 0 2024-03-12T16:10:43.906 INFO:tasks.workunit.client.0.smithi006.stdout:0/434: getdents d2/d6/d10/d11 0 2024-03-12T16:10:43.909 INFO:tasks.workunit.client.0.smithi006.stdout:2/418: dread d0/d13/d49/f74 [0,4194304] 0 2024-03-12T16:10:43.909 INFO:tasks.workunit.client.0.smithi006.stdout:3/383: mkdir d8/d19/d26/d59/d2c/d41/d8b 0 2024-03-12T16:10:43.910 INFO:tasks.workunit.client.0.smithi006.stdout:4/461: mknod d1/d38/c94 0 2024-03-12T16:10:43.910 INFO:tasks.workunit.client.1.smithi134.stdout:5/694: symlink db/d12/d29/d3d/d79/lda 0 2024-03-12T16:10:43.915 INFO:tasks.workunit.client.1.smithi134.stdout:7/578: link d8/d27/d9d/d31/f35 d8/dc/d4b/fc3 0 2024-03-12T16:10:43.915 INFO:tasks.workunit.client.1.smithi134.stdout:2/568: rename d4/d12/d3b/l5e to d4/d84/d63/d9d/d3d/d71/lc9 0 2024-03-12T16:10:43.916 INFO:tasks.workunit.client.1.smithi134.stdout:7/579: stat d8/dc/d20/d26/f50 0 2024-03-12T16:10:43.917 INFO:tasks.workunit.client.1.smithi134.stdout:5/695: mkdir db/d12/d1d/d59/d94/ddb 0 2024-03-12T16:10:43.918 INFO:tasks.workunit.client.1.smithi134.stdout:5/696: chown db/d12/d37/d73/d8c/faa 403547283 1 2024-03-12T16:10:43.919 INFO:tasks.workunit.client.0.smithi006.stdout:5/299: creat d7/d9/d47/f67 x:0 0 0 2024-03-12T16:10:43.920 INFO:tasks.workunit.client.1.smithi134.stdout:9/604: link d5/c29 d5/d10/d35/cb2 0 2024-03-12T16:10:43.921 INFO:tasks.workunit.client.0.smithi006.stdout:8/325: link d2/d11/f27 d2/db/d1a/d21/d4f/f68 0 2024-03-12T16:10:43.922 INFO:tasks.workunit.client.0.smithi006.stdout:0/435: mknod d2/d6/d10/c7c 0 2024-03-12T16:10:43.922 INFO:tasks.workunit.client.0.smithi006.stdout:4/462: stat d1/db/d1d/l26 0 2024-03-12T16:10:43.923 INFO:tasks.workunit.client.0.smithi006.stdout:6/388: dread d3/d11/fd [0,4194304] 0 2024-03-12T16:10:43.924 INFO:tasks.workunit.client.1.smithi134.stdout:9/605: dread - d5/d10/d35/d49/d54/d5e/f7e zero size 2024-03-12T16:10:43.925 INFO:tasks.workunit.client.0.smithi006.stdout:5/300: mknod d7/d9/c68 0 2024-03-12T16:10:43.926 INFO:tasks.workunit.client.1.smithi134.stdout:7/580: dwrite d8/d27/d9d/fc2 [0,4194304] 0 2024-03-12T16:10:43.928 INFO:tasks.workunit.client.0.smithi006.stdout:4/463: mknod d1/d91/c95 0 2024-03-12T16:10:43.929 INFO:tasks.workunit.client.1.smithi134.stdout:9/606: symlink d5/d10/d35/d49/d54/d88/lb3 0 2024-03-12T16:10:43.931 INFO:tasks.workunit.client.1.smithi134.stdout:9/607: chown d5/d46/f64 0 1 2024-03-12T16:10:43.931 INFO:tasks.workunit.client.1.smithi134.stdout:6/582: sync 2024-03-12T16:10:43.932 INFO:tasks.workunit.client.1.smithi134.stdout:5/697: dread db/fa3 [0,4194304] 0 2024-03-12T16:10:43.934 INFO:tasks.workunit.client.1.smithi134.stdout:3/763: truncate d1/db/d14/d5f/fe5 3817020 0 2024-03-12T16:10:43.934 INFO:tasks.workunit.client.0.smithi006.stdout:5/301: read d7/d9/d10/f26 [472794,32717] 0 2024-03-12T16:10:43.934 INFO:tasks.workunit.client.0.smithi006.stdout:6/389: dread - d3/d11/d10/d1b/d6e/f4f zero size 2024-03-12T16:10:43.935 INFO:tasks.workunit.client.0.smithi006.stdout:3/384: dwrite d8/d19/d26/d59/d2c/dc/d28/d2f/f3c [4194304,4194304] 0 2024-03-12T16:10:43.935 INFO:tasks.workunit.client.1.smithi134.stdout:9/608: mknod d5/d10/d6c/cb4 0 2024-03-12T16:10:43.937 INFO:tasks.workunit.client.1.smithi134.stdout:9/609: readlink d5/d20/d47/l5d 0 2024-03-12T16:10:43.938 INFO:tasks.workunit.client.1.smithi134.stdout:7/581: creat d8/db4/fc4 x:0 0 0 2024-03-12T16:10:43.939 INFO:tasks.workunit.client.1.smithi134.stdout:4/547: write d1/d13/d49/faa [2167864,81742] 0 2024-03-12T16:10:43.941 INFO:tasks.workunit.client.0.smithi006.stdout:4/464: creat d1/d38/d79/f96 x:0 0 0 2024-03-12T16:10:43.941 INFO:tasks.workunit.client.1.smithi134.stdout:3/764: unlink d1/db/d14/f59 0 2024-03-12T16:10:43.942 INFO:tasks.workunit.client.1.smithi134.stdout:9/610: read d5/d10/d35/d49/d74/f78 [141692,120153] 0 2024-03-12T16:10:43.943 INFO:tasks.workunit.client.1.smithi134.stdout:5/698: dwrite db/d12/d1d/d5c/fc9 [0,4194304] 0 2024-03-12T16:10:43.945 INFO:tasks.workunit.client.0.smithi006.stdout:2/419: dwrite d0/f3f [0,4194304] 0 2024-03-12T16:10:43.946 INFO:tasks.workunit.client.1.smithi134.stdout:9/611: fsync d5/d10/d35/f73 0 2024-03-12T16:10:43.946 INFO:tasks.workunit.client.0.smithi006.stdout:4/465: readlink d1/db/d1d/l33 0 2024-03-12T16:10:43.947 INFO:tasks.workunit.client.0.smithi006.stdout:7/510: dread de/d27/d2b/d4a/d6a/f79 [0,4194304] 0 2024-03-12T16:10:43.947 INFO:tasks.workunit.client.1.smithi134.stdout:5/699: write db/d12/d29/fc3 [234957,108102] 0 2024-03-12T16:10:43.948 INFO:tasks.workunit.client.0.smithi006.stdout:0/436: link d2/d6/d10/d11/d1d/d2e/l61 d2/d6/d10/d11/d1d/d2e/d77/l7d 0 2024-03-12T16:10:43.950 INFO:tasks.workunit.client.0.smithi006.stdout:1/423: dwrite d0/d25/d2a/d35/f3a [0,4194304] 0 2024-03-12T16:10:43.950 INFO:tasks.workunit.client.0.smithi006.stdout:3/385: creat d8/d19/d26/d59/d2c/d41/f8c x:0 0 0 2024-03-12T16:10:43.951 INFO:tasks.workunit.client.1.smithi134.stdout:7/582: mknod d8/dc/d55/db9/cc5 0 2024-03-12T16:10:43.951 INFO:tasks.workunit.client.0.smithi006.stdout:6/390: creat d3/d11/d10/d1b/d20/f8f x:0 0 0 2024-03-12T16:10:43.954 INFO:tasks.workunit.client.0.smithi006.stdout:7/511: chown de/d18/d2a/f76 6 1 2024-03-12T16:10:43.954 INFO:tasks.workunit.client.1.smithi134.stdout:5/700: fsync db/d12/d1d/d59/d94/fb0 0 2024-03-12T16:10:43.956 INFO:tasks.workunit.client.0.smithi006.stdout:0/437: chown d2/f1f 238 1 2024-03-12T16:10:43.957 INFO:tasks.workunit.client.1.smithi134.stdout:5/701: write db/d12/d7b/f93 [4721581,127649] 0 2024-03-12T16:10:43.958 INFO:tasks.workunit.client.0.smithi006.stdout:7/512: fsync de/d1c/f25 0 2024-03-12T16:10:43.960 INFO:tasks.workunit.client.0.smithi006.stdout:3/386: write d8/d19/d26/d59/f42 [3560621,92678] 0 2024-03-12T16:10:43.961 INFO:tasks.workunit.client.0.smithi006.stdout:7/513: chown de/d27/d97 6653326 1 2024-03-12T16:10:43.961 INFO:tasks.workunit.client.1.smithi134.stdout:9/612: rename d5/d10/d1f/f43 to d5/d10/d35/d49/d54/d5e/fb5 0 2024-03-12T16:10:43.961 INFO:tasks.workunit.client.1.smithi134.stdout:5/702: write db/d12/d29/fc3 [592106,36297] 0 2024-03-12T16:10:43.962 INFO:tasks.workunit.client.0.smithi006.stdout:4/466: creat d1/db/d1d/d2f/f97 x:0 0 0 2024-03-12T16:10:43.963 INFO:tasks.workunit.client.1.smithi134.stdout:5/703: write db/d12/d1d/d59/d94/fb0 [4624766,121821] 0 2024-03-12T16:10:43.964 INFO:tasks.workunit.client.0.smithi006.stdout:0/438: mkdir d2/d6/d10/d11/d7e 0 2024-03-12T16:10:43.964 INFO:tasks.workunit.client.0.smithi006.stdout:6/391: stat d3/d11/d43/c69 0 2024-03-12T16:10:43.968 INFO:tasks.workunit.client.0.smithi006.stdout:1/424: write d0/f3e [1058591,29853] 0 2024-03-12T16:10:43.971 INFO:tasks.workunit.client.1.smithi134.stdout:5/704: dwrite db/d12/d1d/d3a/d49/fbe [0,4194304] 0 2024-03-12T16:10:43.973 INFO:tasks.workunit.client.1.smithi134.stdout:5/705: chown db/d12/d1d/d3a/d70/d99/fb3 457982 1 2024-03-12T16:10:43.973 INFO:tasks.workunit.client.0.smithi006.stdout:2/420: dwrite d0/d13/d49/d60/d2b/f63 [4194304,4194304] 0 2024-03-12T16:10:43.975 INFO:tasks.workunit.client.0.smithi006.stdout:8/326: dread d2/d11/f27 [0,4194304] 0 2024-03-12T16:10:43.976 INFO:tasks.workunit.client.0.smithi006.stdout:8/327: readlink d2/db/l34 0 2024-03-12T16:10:43.983 INFO:tasks.workunit.client.1.smithi134.stdout:4/548: truncate d1/de/f36 136612 0 2024-03-12T16:10:43.984 INFO:tasks.workunit.client.0.smithi006.stdout:2/421: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89 0 2024-03-12T16:10:43.986 INFO:tasks.workunit.client.0.smithi006.stdout:7/514: creat de/d18/d2a/fad x:0 0 0 2024-03-12T16:10:43.988 INFO:tasks.workunit.client.1.smithi134.stdout:6/583: dread d1/d3/d10/f9e [0,4194304] 0 2024-03-12T16:10:43.988 INFO:tasks.workunit.client.0.smithi006.stdout:7/515: dread - de/d18/d2a/d39/f58 zero size 2024-03-12T16:10:43.989 INFO:tasks.workunit.client.0.smithi006.stdout:3/387: link d8/d19/d26/d59/d2c/f86 d8/d19/d26/f8d 0 2024-03-12T16:10:43.992 INFO:tasks.workunit.client.0.smithi006.stdout:6/392: link d3/d11/d10/d1b/f3f d3/d11/d43/f90 0 2024-03-12T16:10:43.993 INFO:tasks.workunit.client.1.smithi134.stdout:6/584: symlink d1/d16/d4c/d65/d61/le1 0 2024-03-12T16:10:43.993 INFO:tasks.workunit.client.0.smithi006.stdout:7/516: write de/d18/d2a/d39/f46 [2786840,60080] 0 2024-03-12T16:10:43.993 INFO:tasks.workunit.client.0.smithi006.stdout:4/467: write d1/db/d17/f1a [4292760,1715] 0 2024-03-12T16:10:43.993 INFO:tasks.workunit.client.1.smithi134.stdout:7/583: dwrite d8/dc/d4b/f45 [4194304,4194304] 0 2024-03-12T16:10:43.994 INFO:tasks.workunit.client.1.smithi134.stdout:6/585: fdatasync d1/d4/f20 0 2024-03-12T16:10:43.994 INFO:tasks.workunit.client.0.smithi006.stdout:5/302: dread d7/d9/d31/f46 [0,4194304] 0 2024-03-12T16:10:43.996 INFO:tasks.workunit.client.0.smithi006.stdout:6/393: write d3/d11/d10/d28/f53 [112729,7787] 0 2024-03-12T16:10:43.997 INFO:tasks.workunit.client.1.smithi134.stdout:6/586: chown d1/l73 810067188 1 2024-03-12T16:10:43.997 INFO:tasks.workunit.client.0.smithi006.stdout:4/468: chown d1/d38/f57 14432 1 2024-03-12T16:10:43.998 INFO:tasks.workunit.client.0.smithi006.stdout:5/303: chown d7/d9/d31/f2e 4516836 1 2024-03-12T16:10:44.000 INFO:tasks.workunit.client.1.smithi134.stdout:6/587: mkdir d1/d16/d7e/de2 0 2024-03-12T16:10:44.004 INFO:tasks.workunit.client.0.smithi006.stdout:8/328: creat d2/db/f69 x:0 0 0 2024-03-12T16:10:44.006 INFO:tasks.workunit.client.0.smithi006.stdout:8/329: stat d2/d11/f4e 0 2024-03-12T16:10:44.007 INFO:tasks.workunit.client.0.smithi006.stdout:2/422: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/f8a x:0 0 0 2024-03-12T16:10:44.007 INFO:tasks.workunit.client.0.smithi006.stdout:7/517: creat de/d2c/d4f/d83/fae x:0 0 0 2024-03-12T16:10:44.007 INFO:tasks.workunit.client.0.smithi006.stdout:4/469: creat d1/db/d39/d42/f98 x:0 0 0 2024-03-12T16:10:44.007 INFO:tasks.workunit.client.0.smithi006.stdout:6/394: fdatasync d3/d11/d10/d28/d45/f85 0 2024-03-12T16:10:44.007 INFO:tasks.workunit.client.1.smithi134.stdout:7/584: truncate d8/dc/d55/f5f 3946749 0 2024-03-12T16:10:44.009 INFO:tasks.workunit.client.0.smithi006.stdout:0/439: rename d2/d6/d10/f54 to d2/d6/d10/d11/d1d/d79/f7f 0 2024-03-12T16:10:44.009 INFO:tasks.workunit.client.1.smithi134.stdout:7/585: write d8/dc/d20/d26/d36/fc1 [5042168,109110] 0 2024-03-12T16:10:44.011 INFO:tasks.workunit.client.0.smithi006.stdout:3/388: creat d8/f8e x:0 0 0 2024-03-12T16:10:44.011 INFO:tasks.workunit.client.0.smithi006.stdout:5/304: getdents d7/d9/d31/d3b/d4f/d65 0 2024-03-12T16:10:44.014 INFO:tasks.workunit.client.1.smithi134.stdout:9/613: dread d5/d10/d35/f1a [0,4194304] 0 2024-03-12T16:10:44.014 INFO:tasks.workunit.client.1.smithi134.stdout:7/586: dread - d8/dc/d7b/da0/fa7 zero size 2024-03-12T16:10:44.014 INFO:tasks.workunit.client.1.smithi134.stdout:6/588: write d1/d16/d4c/d58/d8e/faf [441516,24398] 0 2024-03-12T16:10:44.014 INFO:tasks.workunit.client.1.smithi134.stdout:9/614: dread - d5/d10/d35/d49/d8d/f84 zero size 2024-03-12T16:10:44.015 INFO:tasks.workunit.client.0.smithi006.stdout:3/389: stat d8/d19/d26/d59/d2c/dc/d28/c5d 0 2024-03-12T16:10:44.016 INFO:tasks.workunit.client.0.smithi006.stdout:7/518: mknod de/d18/d2a/caf 0 2024-03-12T16:10:44.016 INFO:tasks.workunit.client.1.smithi134.stdout:6/589: fdatasync d1/d3/d19/d32/f37 0 2024-03-12T16:10:44.017 INFO:tasks.workunit.client.1.smithi134.stdout:7/587: fdatasync d8/dc/d4b/fb5 0 2024-03-12T16:10:44.017 INFO:tasks.workunit.client.1.smithi134.stdout:9/615: write d5/d20/d72/f7a [1833493,95747] 0 2024-03-12T16:10:44.019 INFO:tasks.workunit.client.0.smithi006.stdout:2/423: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77 11344 1 2024-03-12T16:10:44.019 INFO:tasks.workunit.client.0.smithi006.stdout:5/305: fdatasync d7/d9/d10/d35/f3c 0 2024-03-12T16:10:44.019 INFO:tasks.workunit.client.0.smithi006.stdout:4/470: rename d1/d91/c95 to d1/db/d39/d42/c99 0 2024-03-12T16:10:44.022 INFO:tasks.workunit.client.1.smithi134.stdout:5/706: dread db/d12/d1d/d3a/d70/f75 [4194304,4194304] 0 2024-03-12T16:10:44.024 INFO:tasks.workunit.client.0.smithi006.stdout:2/424: fsync d0/d13/f44 0 2024-03-12T16:10:44.024 INFO:tasks.workunit.client.1.smithi134.stdout:7/588: rename d8/dc/f95 to d8/d27/d9d/d31/d7c/fc6 0 2024-03-12T16:10:44.025 INFO:tasks.workunit.client.1.smithi134.stdout:9/616: unlink d5/f3e 0 2024-03-12T16:10:44.025 INFO:tasks.workunit.client.1.smithi134.stdout:6/590: dread d1/d4/f47 [0,4194304] 0 2024-03-12T16:10:44.028 INFO:tasks.workunit.client.1.smithi134.stdout:6/591: chown d1/d3/d19/f1f 77 1 2024-03-12T16:10:44.028 INFO:tasks.workunit.client.0.smithi006.stdout:0/440: dwrite d2/f1f [0,4194304] 0 2024-03-12T16:10:44.031 INFO:tasks.workunit.client.1.smithi134.stdout:7/589: fsync d8/dc/d55/d81/d87/f9f 0 2024-03-12T16:10:44.031 INFO:tasks.workunit.client.1.smithi134.stdout:9/617: stat d5/d10/d35/d49/d54/d88/lb3 0 2024-03-12T16:10:44.032 INFO:tasks.workunit.client.1.smithi134.stdout:5/707: dwrite db/d7a/fce [0,4194304] 0 2024-03-12T16:10:44.033 INFO:tasks.workunit.client.0.smithi006.stdout:1/425: dread d0/d25/f40 [0,4194304] 0 2024-03-12T16:10:44.033 INFO:tasks.workunit.client.1.smithi134.stdout:6/592: creat d1/d16/d4c/d58/fe3 x:0 0 0 2024-03-12T16:10:44.034 INFO:tasks.workunit.client.1.smithi134.stdout:7/590: write d8/f1f [3883326,68710] 0 2024-03-12T16:10:44.036 INFO:tasks.workunit.client.0.smithi006.stdout:8/330: dread d2/f16 [0,4194304] 0 2024-03-12T16:10:44.040 INFO:tasks.workunit.client.1.smithi134.stdout:9/618: creat d5/d10/d33/fb6 x:0 0 0 2024-03-12T16:10:44.041 INFO:tasks.workunit.client.1.smithi134.stdout:9/619: chown d5/d10/d51/lb0 134067730 1 2024-03-12T16:10:44.043 INFO:tasks.workunit.client.0.smithi006.stdout:3/390: link d8/d4c/d7c/l7f d8/d19/d47/l8f 0 2024-03-12T16:10:44.043 INFO:tasks.workunit.client.0.smithi006.stdout:6/395: write d3/d11/f15 [61715,56303] 0 2024-03-12T16:10:44.044 INFO:tasks.workunit.client.1.smithi134.stdout:7/591: getdents d8/dc/d7b/dbb/dbd 0 2024-03-12T16:10:44.044 INFO:tasks.workunit.client.0.smithi006.stdout:4/471: dwrite d1/db/d17/f25 [0,4194304] 0 2024-03-12T16:10:44.044 INFO:tasks.workunit.client.0.smithi006.stdout:0/441: fdatasync d2/d6/d10/d11/d1d/d2e/f5e 0 2024-03-12T16:10:44.046 INFO:tasks.workunit.client.1.smithi134.stdout:9/620: creat d5/d10/d35/d49/fb7 x:0 0 0 2024-03-12T16:10:44.046 INFO:tasks.workunit.client.1.smithi134.stdout:5/708: getdents db/d7a 0 2024-03-12T16:10:44.046 INFO:tasks.workunit.client.0.smithi006.stdout:8/331: truncate d2/db/f24 2596149 0 2024-03-12T16:10:44.047 INFO:tasks.workunit.client.0.smithi006.stdout:3/391: stat d8/d4c/f65 0 2024-03-12T16:10:44.048 INFO:tasks.workunit.client.1.smithi134.stdout:5/709: write db/d12/d29/d3d/fd3 [373683,121013] 0 2024-03-12T16:10:44.050 INFO:tasks.workunit.client.0.smithi006.stdout:1/426: write d0/d25/d2a/d35/f55 [709467,13869] 0 2024-03-12T16:10:44.050 INFO:tasks.workunit.client.0.smithi006.stdout:7/519: dwrite de/d27/d2b/d4a/d6a/f79 [0,4194304] 0 2024-03-12T16:10:44.050 INFO:tasks.workunit.client.1.smithi134.stdout:9/621: symlink d5/d10/d51/lb8 0 2024-03-12T16:10:44.053 INFO:tasks.workunit.client.0.smithi006.stdout:6/396: dread - d3/d11/d10/f7b zero size 2024-03-12T16:10:44.053 INFO:tasks.workunit.client.1.smithi134.stdout:9/622: symlink d5/d10/d35/d49/lb9 0 2024-03-12T16:10:44.054 INFO:tasks.workunit.client.0.smithi006.stdout:8/332: symlink d2/db/d1a/d1f/l6a 0 2024-03-12T16:10:44.054 INFO:tasks.workunit.client.0.smithi006.stdout:5/306: dwrite d7/d9/d31/f46 [0,4194304] 0 2024-03-12T16:10:44.056 INFO:tasks.workunit.client.1.smithi134.stdout:7/592: dwrite d8/dc/d55/d81/d87/f9f [0,4194304] 0 2024-03-12T16:10:44.056 INFO:tasks.workunit.client.0.smithi006.stdout:7/520: write de/d2c/d4f/d83/f95 [445925,105863] 0 2024-03-12T16:10:44.058 INFO:tasks.workunit.client.0.smithi006.stdout:1/427: creat d0/d25/d2a/d35/d3f/f91 x:0 0 0 2024-03-12T16:10:44.059 INFO:tasks.workunit.client.1.smithi134.stdout:9/623: chown d5/d20/d72/c96 46 1 2024-03-12T16:10:44.060 INFO:tasks.workunit.client.0.smithi006.stdout:6/397: fsync d3/d11/d43/f90 0 2024-03-12T16:10:44.065 INFO:tasks.workunit.client.0.smithi006.stdout:7/521: link de/d18/d2a/d40/c62 de/d27/d97/cb0 0 2024-03-12T16:10:44.065 INFO:tasks.workunit.client.0.smithi006.stdout:3/392: creat d8/d19/d26/d59/d2c/dc/d28/f90 x:0 0 0 2024-03-12T16:10:44.068 INFO:tasks.workunit.client.1.smithi134.stdout:6/593: write d1/d16/d4c/d65/d70/dca/fdc [2455599,80008] 0 2024-03-12T16:10:44.069 INFO:tasks.workunit.client.1.smithi134.stdout:6/594: read d1/d4/fac [354611,2857] 0 2024-03-12T16:10:44.071 INFO:tasks.workunit.client.0.smithi006.stdout:6/398: mknod d3/d11/d10/d1b/d20/d7c/c91 0 2024-03-12T16:10:44.075 INFO:tasks.workunit.client.1.smithi134.stdout:9/624: dwrite d5/d46/f64 [0,4194304] 0 2024-03-12T16:10:44.077 INFO:tasks.workunit.client.1.smithi134.stdout:9/625: chown d5/d10/f81 144 1 2024-03-12T16:10:44.079 INFO:tasks.workunit.client.1.smithi134.stdout:9/626: write d5/d10/d35/d49/d54/f9f [4355885,87213] 0 2024-03-12T16:10:44.081 INFO:tasks.workunit.client.0.smithi006.stdout:1/428: dwrite d0/d25/d2a/d35/d3f/f5a [0,4194304] 0 2024-03-12T16:10:44.081 INFO:tasks.workunit.client.0.smithi006.stdout:3/393: link d8/d19/d47/f77 d8/d19/d26/f91 0 2024-03-12T16:10:44.083 INFO:tasks.workunit.client.0.smithi006.stdout:7/522: dwrite de/d27/f2d [0,4194304] 0 2024-03-12T16:10:44.087 INFO:tasks.workunit.client.0.smithi006.stdout:3/394: write d8/d19/d26/d59/f42 [2844715,4456] 0 2024-03-12T16:10:44.087 INFO:tasks.workunit.client.0.smithi006.stdout:7/523: chown de/d27/d2b/c54 45394 1 2024-03-12T16:10:44.088 INFO:tasks.workunit.client.0.smithi006.stdout:1/429: creat d0/d25/d2a/d43/f92 x:0 0 0 2024-03-12T16:10:44.091 INFO:tasks.workunit.client.0.smithi006.stdout:6/399: write d3/d11/d10/d28/d45/f85 [267158,34550] 0 2024-03-12T16:10:44.092 INFO:tasks.workunit.client.0.smithi006.stdout:7/524: symlink de/d1c/d87/lb1 0 2024-03-12T16:10:44.093 INFO:tasks.workunit.client.0.smithi006.stdout:2/425: dread d0/d13/d49/d60/f32 [0,4194304] 0 2024-03-12T16:10:44.095 INFO:tasks.workunit.client.0.smithi006.stdout:6/400: symlink d3/d11/d10/d1b/d6e/l92 0 2024-03-12T16:10:44.096 INFO:tasks.workunit.client.0.smithi006.stdout:7/525: mknod de/d2c/cb2 0 2024-03-12T16:10:44.097 INFO:tasks.workunit.client.0.smithi006.stdout:6/401: dread - d3/d11/d10/d1b/d20/f8f zero size 2024-03-12T16:10:44.097 INFO:tasks.workunit.client.0.smithi006.stdout:2/426: truncate d0/d13/d49/d60/f14 5067137 0 2024-03-12T16:10:44.100 INFO:tasks.workunit.client.0.smithi006.stdout:7/526: creat de/d1c/d87/fb3 x:0 0 0 2024-03-12T16:10:44.101 INFO:tasks.workunit.client.0.smithi006.stdout:4/472: dread d1/db/f40 [0,4194304] 0 2024-03-12T16:10:44.104 INFO:tasks.workunit.client.0.smithi006.stdout:2/427: truncate d0/d13/d49/d60/f36 567318 0 2024-03-12T16:10:44.106 INFO:tasks.workunit.client.0.smithi006.stdout:4/473: write d1/db/d1d/f2b [2689301,96853] 0 2024-03-12T16:10:44.106 INFO:tasks.workunit.client.0.smithi006.stdout:2/428: stat d0/d13/d49/d60/d2b/l76 0 2024-03-12T16:10:44.108 INFO:tasks.workunit.client.0.smithi006.stdout:6/402: dread d3/d11/d10/d1b/d20/d5a/f64 [0,4194304] 0 2024-03-12T16:10:44.111 INFO:tasks.workunit.client.0.smithi006.stdout:2/429: symlink d0/d13/d49/l8b 0 2024-03-12T16:10:44.112 INFO:tasks.workunit.client.0.smithi006.stdout:4/474: mknod d1/db/d39/d42/d61/c9a 0 2024-03-12T16:10:44.114 INFO:tasks.workunit.client.0.smithi006.stdout:2/430: chown d0/dc/f5b 244988895 1 2024-03-12T16:10:44.114 INFO:tasks.workunit.client.1.smithi134.stdout:1/463: sync 2024-03-12T16:10:44.115 INFO:tasks.workunit.client.0.smithi006.stdout:7/527: dwrite de/d1c/f25 [0,4194304] 0 2024-03-12T16:10:44.115 INFO:tasks.workunit.client.0.smithi006.stdout:4/475: fdatasync d1/db/d17/f1a 0 2024-03-12T16:10:44.120 INFO:tasks.workunit.client.0.smithi006.stdout:4/476: stat d1/d38/d79/f84 0 2024-03-12T16:10:44.124 INFO:tasks.workunit.client.0.smithi006.stdout:4/477: read - d1/db/d1d/d6c/f7a zero size 2024-03-12T16:10:44.126 INFO:tasks.workunit.client.0.smithi006.stdout:6/403: dwrite d3/d11/d10/d1b/d20/f68 [0,4194304] 0 2024-03-12T16:10:44.127 INFO:tasks.workunit.client.0.smithi006.stdout:3/395: dread d8/d19/d26/d59/d2c/f34 [0,4194304] 0 2024-03-12T16:10:44.131 INFO:tasks.workunit.client.0.smithi006.stdout:7/528: dwrite de/d18/d2a/fad [0,4194304] 0 2024-03-12T16:10:44.132 INFO:tasks.workunit.client.1.smithi134.stdout:9/627: dwrite d5/d10/f5a [0,4194304] 0 2024-03-12T16:10:44.133 INFO:tasks.workunit.client.1.smithi134.stdout:1/464: creat d0/d30/d86/f9e x:0 0 0 2024-03-12T16:10:44.136 INFO:tasks.workunit.client.1.smithi134.stdout:1/465: stat d0/d16/d9/d13/d21/f33 0 2024-03-12T16:10:44.138 INFO:tasks.workunit.client.0.smithi006.stdout:4/478: creat d1/db/d1d/d2f/f9b x:0 0 0 2024-03-12T16:10:44.139 INFO:tasks.workunit.client.1.smithi134.stdout:6/595: dwrite d1/d3/d10/f2a [4194304,4194304] 0 2024-03-12T16:10:44.140 INFO:tasks.workunit.client.0.smithi006.stdout:1/430: dread d0/fb [0,4194304] 0 2024-03-12T16:10:44.140 INFO:tasks.workunit.client.1.smithi134.stdout:9/628: symlink d5/d10/d1f/lba 0 2024-03-12T16:10:44.141 INFO:tasks.workunit.client.0.smithi006.stdout:4/479: fsync d1/db/d39/f3b 0 2024-03-12T16:10:44.142 INFO:tasks.workunit.client.0.smithi006.stdout:2/431: truncate d0/f12 3303470 0 2024-03-12T16:10:44.142 INFO:tasks.workunit.client.1.smithi134.stdout:7/593: dread d8/dc/d20/f13 [0,4194304] 0 2024-03-12T16:10:44.144 INFO:tasks.workunit.client.0.smithi006.stdout:7/529: write de/d1c/f96 [136459,126168] 0 2024-03-12T16:10:44.144 INFO:tasks.workunit.client.0.smithi006.stdout:6/404: mknod d3/d11/d10/d1b/d20/d5a/c93 0 2024-03-12T16:10:44.144 INFO:tasks.workunit.client.1.smithi134.stdout:9/629: chown d5/d20/d72/la9 70597 1 2024-03-12T16:10:44.144 INFO:tasks.workunit.client.0.smithi006.stdout:4/480: read - d1/db/d1d/d2f/d6b/f7d zero size 2024-03-12T16:10:44.147 INFO:tasks.workunit.client.0.smithi006.stdout:1/431: write d0/d25/d2a/d35/f4b [3768704,92224] 0 2024-03-12T16:10:44.147 INFO:tasks.workunit.client.1.smithi134.stdout:6/596: fdatasync d1/fd3 0 2024-03-12T16:10:44.151 INFO:tasks.workunit.client.1.smithi134.stdout:6/597: mkdir d1/d16/d4c/d65/d61/de4 0 2024-03-12T16:10:44.153 INFO:tasks.workunit.client.0.smithi006.stdout:1/432: unlink d0/d25/d2a/d43/f46 0 2024-03-12T16:10:44.154 INFO:tasks.workunit.client.1.smithi134.stdout:7/594: link d8/d27/d9d/f93 d8/dc/d4b/fc7 0 2024-03-12T16:10:44.155 INFO:tasks.workunit.client.0.smithi006.stdout:1/433: chown d0/l20 1038509 1 2024-03-12T16:10:44.155 INFO:tasks.workunit.client.0.smithi006.stdout:4/481: write d1/f86 [490487,70663] 0 2024-03-12T16:10:44.157 INFO:tasks.workunit.client.1.smithi134.stdout:7/595: creat d8/dc/d55/d57/fc8 x:0 0 0 2024-03-12T16:10:44.158 INFO:tasks.workunit.client.0.smithi006.stdout:4/482: fdatasync d1/d38/d79/f96 0 2024-03-12T16:10:44.159 INFO:tasks.workunit.client.1.smithi134.stdout:9/630: dwrite d5/d10/d35/d49/d54/d5e/d82/f92 [0,4194304] 0 2024-03-12T16:10:44.159 INFO:tasks.workunit.client.0.smithi006.stdout:6/405: dwrite d3/d11/d10/d28/f53 [0,4194304] 0 2024-03-12T16:10:44.161 INFO:tasks.workunit.client.0.smithi006.stdout:7/530: dwrite de/d18/d2a/d39/f46 [0,4194304] 0 2024-03-12T16:10:44.164 INFO:tasks.workunit.client.0.smithi006.stdout:1/434: dread d0/d25/d2a/f4d [0,4194304] 0 2024-03-12T16:10:44.164 INFO:tasks.workunit.client.0.smithi006.stdout:7/531: write de/d27/d2b/d4a/d6a/f6d [121619,89330] 0 2024-03-12T16:10:44.165 INFO:tasks.workunit.client.0.smithi006.stdout:6/406: creat d3/d11/d10/d1b/d6e/d80/f94 x:0 0 0 2024-03-12T16:10:44.168 INFO:tasks.workunit.client.0.smithi006.stdout:1/435: write d0/d25/d2a/d64/f6d [4729800,93666] 0 2024-03-12T16:10:44.169 INFO:tasks.workunit.client.0.smithi006.stdout:4/483: link d1/db/d39/d42/f98 d1/db/d1d/f9c 0 2024-03-12T16:10:44.170 INFO:tasks.workunit.client.0.smithi006.stdout:1/436: chown d0/d25/d2a/d35 1 1 2024-03-12T16:10:44.171 INFO:tasks.workunit.client.1.smithi134.stdout:6/598: dwrite d1/d16/d4c/d58/da0/db7/f4e [0,4194304] 0 2024-03-12T16:10:44.171 INFO:tasks.workunit.client.1.smithi134.stdout:7/596: mkdir d8/d27/d9d/dc9 0 2024-03-12T16:10:44.171 INFO:tasks.workunit.client.1.smithi134.stdout:9/631: unlink d5/l85 0 2024-03-12T16:10:44.171 INFO:tasks.workunit.client.1.smithi134.stdout:1/466: write d0/d16/f6d [1506546,90176] 0 2024-03-12T16:10:44.171 INFO:tasks.workunit.client.1.smithi134.stdout:7/597: readlink d8/d27/d9d/d31/l6f 0 2024-03-12T16:10:44.173 INFO:tasks.workunit.client.1.smithi134.stdout:1/467: write d0/d16/d9/d73/f94 [644279,108620] 0 2024-03-12T16:10:44.174 INFO:tasks.workunit.client.0.smithi006.stdout:3/396: write d8/d19/d26/d59/d2c/dc/d28/d2f/f60 [2711496,81063] 0 2024-03-12T16:10:44.176 INFO:tasks.workunit.client.0.smithi006.stdout:4/484: read - d1/db/d17/f74 zero size 2024-03-12T16:10:44.177 INFO:tasks.workunit.client.1.smithi134.stdout:9/632: rename d5/d10/d35/c1d to d5/cbb 0 2024-03-12T16:10:44.178 INFO:tasks.workunit.client.0.smithi006.stdout:7/532: symlink de/d2c/d93/lb4 0 2024-03-12T16:10:44.178 INFO:tasks.workunit.client.1.smithi134.stdout:7/598: mkdir d8/d4e/dca 0 2024-03-12T16:10:44.179 INFO:tasks.workunit.client.0.smithi006.stdout:4/485: read - d1/f31 zero size 2024-03-12T16:10:44.179 INFO:tasks.workunit.client.1.smithi134.stdout:6/599: creat d1/d16/d4c/d65/d61/fe5 x:0 0 0 2024-03-12T16:10:44.181 INFO:tasks.workunit.client.0.smithi006.stdout:6/407: truncate d3/f17 916839 0 2024-03-12T16:10:44.182 INFO:tasks.workunit.client.1.smithi134.stdout:7/599: symlink d8/dc/d55/d81/lcb 0 2024-03-12T16:10:44.183 INFO:tasks.workunit.client.0.smithi006.stdout:1/437: getdents d0/d25/d2a/d43/d63 0 2024-03-12T16:10:44.188 INFO:tasks.workunit.client.0.smithi006.stdout:1/438: chown d0/d25/d67/c74 4918452 1 2024-03-12T16:10:44.190 INFO:tasks.workunit.client.0.smithi006.stdout:1/439: dread - d0/d25/d2a/f2d zero size 2024-03-12T16:10:44.190 INFO:tasks.workunit.client.1.smithi134.stdout:6/600: mknod d1/d3/d19/d32/d4a/ce6 0 2024-03-12T16:10:44.191 INFO:tasks.workunit.client.1.smithi134.stdout:1/468: link d0/d16/d9/d13/l1a d0/d16/d9/d13/d21/d5f/l9f 0 2024-03-12T16:10:44.191 INFO:tasks.workunit.client.1.smithi134.stdout:6/601: dread - d1/d16/d4c/d58/fe3 zero size 2024-03-12T16:10:44.194 INFO:tasks.workunit.client.1.smithi134.stdout:1/469: truncate d0/d16/d9/d13/d21/d5f/d6f/d85/f83 985689 0 2024-03-12T16:10:44.194 INFO:tasks.workunit.client.0.smithi006.stdout:3/397: rename d8/d19/d26/d59/d2c/d41/c85 to d8/d19/d26/d59/d2c/d41/d45/c92 0 2024-03-12T16:10:44.194 INFO:tasks.workunit.client.0.smithi006.stdout:1/440: dread d0/f13 [0,4194304] 0 2024-03-12T16:10:44.197 INFO:tasks.workunit.client.0.smithi006.stdout:1/441: symlink d0/d25/d67/l93 0 2024-03-12T16:10:44.198 INFO:tasks.workunit.client.0.smithi006.stdout:3/398: mkdir d8/d19/d26/d59/d2c/d41/d8b/d93 0 2024-03-12T16:10:44.199 INFO:tasks.workunit.client.0.smithi006.stdout:3/399: chown d8/d19/d26/d59/l4a 5082529 1 2024-03-12T16:10:44.202 INFO:tasks.workunit.client.1.smithi134.stdout:7/600: fsync d8/dc/d20/f1d 0 2024-03-12T16:10:44.204 INFO:tasks.workunit.client.1.smithi134.stdout:1/470: symlink d0/d16/d9/d13/d21/d2f/la0 0 2024-03-12T16:10:44.206 INFO:tasks.workunit.client.0.smithi006.stdout:3/400: rename d8/d19/d26/d59/d2c/dc/d28/f6a to d8/d19/d26/d59/d2c/dc/d28/d2f/f94 0 2024-03-12T16:10:44.207 INFO:tasks.workunit.client.1.smithi134.stdout:1/471: mkdir d0/d30/d48/da1 0 2024-03-12T16:10:44.209 INFO:tasks.workunit.client.1.smithi134.stdout:7/601: creat d8/dc/d7b/dbb/dbd/fcc x:0 0 0 2024-03-12T16:10:44.213 INFO:tasks.workunit.client.1.smithi134.stdout:7/602: fdatasync d8/dc/d55/d57/f83 0 2024-03-12T16:10:44.215 INFO:tasks.workunit.client.0.smithi006.stdout:6/408: dread d3/d11/d10/d19/f6a [0,4194304] 0 2024-03-12T16:10:44.215 INFO:tasks.workunit.client.0.smithi006.stdout:4/486: dread d1/db/d39/d42/d61/f75 [0,4194304] 0 2024-03-12T16:10:44.217 INFO:tasks.workunit.client.0.smithi006.stdout:7/533: dread de/d7b/f91 [0,4194304] 0 2024-03-12T16:10:44.217 INFO:tasks.workunit.client.1.smithi134.stdout:9/633: dwrite d5/d10/d33/f44 [0,4194304] 0 2024-03-12T16:10:44.218 INFO:tasks.workunit.client.0.smithi006.stdout:6/409: chown d3/l63 28 1 2024-03-12T16:10:44.219 INFO:tasks.workunit.client.1.smithi134.stdout:9/634: write d5/d20/d72/f9c [238716,28377] 0 2024-03-12T16:10:44.220 INFO:tasks.workunit.client.1.smithi134.stdout:7/603: mknod d8/d27/ccd 0 2024-03-12T16:10:44.221 INFO:tasks.workunit.client.1.smithi134.stdout:9/635: fdatasync d5/d10/f81 0 2024-03-12T16:10:44.224 INFO:tasks.workunit.client.1.smithi134.stdout:7/604: creat d8/dc/d7b/da0/fce x:0 0 0 2024-03-12T16:10:44.224 INFO:tasks.workunit.client.1.smithi134.stdout:7/605: chown d8/dc/d7b/f8a 10 1 2024-03-12T16:10:44.225 INFO:tasks.workunit.client.0.smithi006.stdout:4/487: creat d1/d91/f9d x:0 0 0 2024-03-12T16:10:44.225 INFO:tasks.workunit.client.1.smithi134.stdout:9/636: rmdir d5/d10/d35/d49/d54/d93 39 2024-03-12T16:10:44.226 INFO:tasks.workunit.client.0.smithi006.stdout:1/442: dwrite d0/fc [0,4194304] 0 2024-03-12T16:10:44.227 INFO:tasks.workunit.client.0.smithi006.stdout:6/410: dread - d3/d47/f7f zero size 2024-03-12T16:10:44.227 INFO:tasks.workunit.client.1.smithi134.stdout:9/637: creat d5/d10/d1f/fbc x:0 0 0 2024-03-12T16:10:44.228 INFO:tasks.workunit.client.0.smithi006.stdout:3/401: truncate d8/d19/d26/d59/d2c/f10 3252079 0 2024-03-12T16:10:44.230 INFO:tasks.workunit.client.1.smithi134.stdout:9/638: write d5/d10/d35/d49/f8c [4701351,3278] 0 2024-03-12T16:10:44.232 INFO:tasks.workunit.client.0.smithi006.stdout:6/411: creat d3/d11/d3b/f95 x:0 0 0 2024-03-12T16:10:44.233 INFO:tasks.workunit.client.1.smithi134.stdout:7/606: dwrite d8/dc/d20/faf [0,4194304] 0 2024-03-12T16:10:44.234 INFO:tasks.workunit.client.0.smithi006.stdout:7/534: creat de/fb5 x:0 0 0 2024-03-12T16:10:44.237 INFO:tasks.workunit.client.0.smithi006.stdout:4/488: dwrite d1/db/f64 [4194304,4194304] 0 2024-03-12T16:10:44.237 INFO:tasks.workunit.client.1.smithi134.stdout:1/472: truncate d0/d16/d9/d13/d21/d2f/f68 3371616 0 2024-03-12T16:10:44.237 INFO:tasks.workunit.client.0.smithi006.stdout:1/443: fsync d0/d25/d2a/d35/f55 0 2024-03-12T16:10:44.238 INFO:tasks.workunit.client.1.smithi134.stdout:7/607: dread d8/dc/d20/faf [0,4194304] 0 2024-03-12T16:10:44.240 INFO:tasks.workunit.client.0.smithi006.stdout:4/489: write d1/db/d17/f1a [6638947,91071] 0 2024-03-12T16:10:44.240 INFO:tasks.workunit.client.1.smithi134.stdout:1/473: mknod d0/d16/d9/d13/ca2 0 2024-03-12T16:10:44.241 INFO:tasks.workunit.client.0.smithi006.stdout:3/402: write d8/d52/d6c/f83 [83869,23271] 0 2024-03-12T16:10:44.242 INFO:tasks.workunit.client.0.smithi006.stdout:6/412: mkdir d3/d11/d10/d1b/d6e/d96 0 2024-03-12T16:10:44.242 INFO:tasks.workunit.client.1.smithi134.stdout:7/608: unlink d8/dc/d7b/dbb/dbd/fcc 0 2024-03-12T16:10:44.244 INFO:tasks.workunit.client.1.smithi134.stdout:7/609: stat d8/dc/f54 0 2024-03-12T16:10:44.244 INFO:tasks.workunit.client.1.smithi134.stdout:1/474: creat d0/d16/d9/d73/fa3 x:0 0 0 2024-03-12T16:10:44.245 INFO:tasks.workunit.client.0.smithi006.stdout:7/535: creat de/d2c/d4f/fb6 x:0 0 0 2024-03-12T16:10:44.245 INFO:tasks.workunit.client.1.smithi134.stdout:1/475: dread - d0/d30/f8c zero size 2024-03-12T16:10:44.249 INFO:tasks.workunit.client.0.smithi006.stdout:4/490: unlink d1/db/d39/d42/d61/f75 0 2024-03-12T16:10:44.249 INFO:tasks.workunit.client.1.smithi134.stdout:1/476: creat d0/d16/d9/fa4 x:0 0 0 2024-03-12T16:10:44.250 INFO:tasks.workunit.client.1.smithi134.stdout:1/477: fdatasync d0/d16/d9/d13/d38/f8b 0 2024-03-12T16:10:44.251 INFO:tasks.workunit.client.0.smithi006.stdout:4/491: symlink d1/db/l9e 0 2024-03-12T16:10:44.251 INFO:tasks.workunit.client.1.smithi134.stdout:7/610: creat d8/dc/fcf x:0 0 0 2024-03-12T16:10:44.256 INFO:tasks.workunit.client.1.smithi134.stdout:7/611: creat d8/d27/d9d/dc9/fd0 x:0 0 0 2024-03-12T16:10:44.259 INFO:tasks.workunit.client.1.smithi134.stdout:1/478: rename d0/d16/d9/d13/l99 to d0/d16/d9/d13/d21/la5 0 2024-03-12T16:10:44.260 INFO:tasks.workunit.client.1.smithi134.stdout:7/612: truncate d8/dc/d55/d57/f6a 230423 0 2024-03-12T16:10:44.267 INFO:tasks.workunit.client.1.smithi134.stdout:9/639: dread d5/d10/d1f/f50 [0,4194304] 0 2024-03-12T16:10:44.268 INFO:tasks.workunit.client.1.smithi134.stdout:1/479: dwrite d0/d16/d9/d13/d38/f8b [0,4194304] 0 2024-03-12T16:10:44.268 INFO:tasks.workunit.client.1.smithi134.stdout:7/613: dwrite d8/dc/d55/d81/d87/f9f [0,4194304] 0 2024-03-12T16:10:44.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/614: stat d8/dc/d20/l3b 0 2024-03-12T16:10:44.271 INFO:tasks.workunit.client.1.smithi134.stdout:8/630: sync 2024-03-12T16:10:44.273 INFO:tasks.workunit.client.0.smithi006.stdout:1/444: write d0/f1f [683645,115812] 0 2024-03-12T16:10:44.274 INFO:tasks.workunit.client.1.smithi134.stdout:1/480: symlink d0/d42/la6 0 2024-03-12T16:10:44.275 INFO:tasks.workunit.client.0.smithi006.stdout:3/403: truncate d8/d52/f61 3239678 0 2024-03-12T16:10:44.278 INFO:tasks.workunit.client.0.smithi006.stdout:1/445: chown d0/d25/d2a/d35/c70 95328164 1 2024-03-12T16:10:44.278 INFO:tasks.workunit.client.1.smithi134.stdout:9/640: write d5/d10/d35/d49/d54/d5e/fb5 [1037865,19293] 0 2024-03-12T16:10:44.278 INFO:tasks.workunit.client.0.smithi006.stdout:3/404: dread - d8/d4c/f65 zero size 2024-03-12T16:10:44.282 INFO:tasks.workunit.client.0.smithi006.stdout:3/405: chown d8/d19/d26/d59/l4a 1118399 1 2024-03-12T16:10:44.283 INFO:tasks.workunit.client.1.smithi134.stdout:7/615: dwrite d8/dc/d20/d26/f50 [0,4194304] 0 2024-03-12T16:10:44.283 INFO:tasks.workunit.client.0.smithi006.stdout:7/536: dwrite f3 [4194304,4194304] 0 2024-03-12T16:10:44.284 INFO:tasks.workunit.client.1.smithi134.stdout:8/631: creat d3/d1b/d17/d25/d33/d96/dbd/fdc x:0 0 0 2024-03-12T16:10:44.285 INFO:tasks.workunit.client.1.smithi134.stdout:9/641: truncate d5/d20/f23 1602217 0 2024-03-12T16:10:44.286 INFO:tasks.workunit.client.0.smithi006.stdout:7/537: write de/d18/f70 [2029709,122139] 0 2024-03-12T16:10:44.287 INFO:tasks.workunit.client.1.smithi134.stdout:7/616: link d8/db4/fc4 d8/db4/fd1 0 2024-03-12T16:10:44.288 INFO:tasks.workunit.client.1.smithi134.stdout:1/481: getdents d0/d16/d39 0 2024-03-12T16:10:44.290 INFO:tasks.workunit.client.1.smithi134.stdout:1/482: chown d0/d16/d9/d73/f94 589827 1 2024-03-12T16:10:44.290 INFO:tasks.workunit.client.1.smithi134.stdout:8/632: creat d3/d1b/d17/d25/d33/d85/fdd x:0 0 0 2024-03-12T16:10:44.291 INFO:tasks.workunit.client.1.smithi134.stdout:7/617: creat d8/dc/d4b/fd2 x:0 0 0 2024-03-12T16:10:44.293 INFO:tasks.workunit.client.0.smithi006.stdout:3/406: creat d8/d19/d78/f95 x:0 0 0 2024-03-12T16:10:44.294 INFO:tasks.workunit.client.1.smithi134.stdout:7/618: write d8/dc/d55/d57/f7e [1061336,15781] 0 2024-03-12T16:10:44.294 INFO:tasks.workunit.client.0.smithi006.stdout:1/446: dwrite d0/f30 [0,4194304] 0 2024-03-12T16:10:44.294 INFO:tasks.workunit.client.1.smithi134.stdout:8/633: chown d3/d1b/d17/d24/db6 3242187 1 2024-03-12T16:10:44.295 INFO:tasks.workunit.client.1.smithi134.stdout:1/483: rmdir d0/d16/d9/d13/d21/d20 39 2024-03-12T16:10:44.298 INFO:tasks.workunit.client.0.smithi006.stdout:1/447: write d0/f13 [4136882,18005] 0 2024-03-12T16:10:44.298 INFO:tasks.workunit.client.0.smithi006.stdout:3/407: readlink d8/d19/d26/d59/l4a 0 2024-03-12T16:10:44.299 INFO:tasks.workunit.client.1.smithi134.stdout:7/619: rename d8/dc/d20/fb1 to d8/db4/fd3 0 2024-03-12T16:10:44.301 INFO:tasks.workunit.client.0.smithi006.stdout:3/408: unlink c7 0 2024-03-12T16:10:44.301 INFO:tasks.workunit.client.1.smithi134.stdout:1/484: creat d0/d16/d9/d13/d21/d2f/fa7 x:0 0 0 2024-03-12T16:10:44.303 INFO:tasks.workunit.client.1.smithi134.stdout:8/634: creat d3/d1b/d17/d25/d33/d15/fde x:0 0 0 2024-03-12T16:10:44.303 INFO:tasks.workunit.client.0.smithi006.stdout:1/448: unlink d0/d25/c31 0 2024-03-12T16:10:44.306 INFO:tasks.workunit.client.1.smithi134.stdout:8/635: read - d3/d1b/d17/d25/d33/d15/d95/d5b/da7/fb5 zero size 2024-03-12T16:10:44.307 INFO:tasks.workunit.client.1.smithi134.stdout:1/485: creat d0/d30/fa8 x:0 0 0 2024-03-12T16:10:44.312 INFO:tasks.workunit.client.1.smithi134.stdout:8/636: fdatasync d3/d1b/d17/d25/d33/f84 0 2024-03-12T16:10:44.317 INFO:tasks.workunit.client.1.smithi134.stdout:8/637: dread d3/d10/f58 [0,4194304] 0 2024-03-12T16:10:44.318 INFO:tasks.workunit.client.1.smithi134.stdout:8/638: dread - d3/d1b/d17/d25/d33/d15/d95/d5b/da7/fb5 zero size 2024-03-12T16:10:44.321 INFO:tasks.workunit.client.1.smithi134.stdout:9/642: dread d5/d10/d35/d49/d54/f9f [0,4194304] 0 2024-03-12T16:10:44.322 INFO:tasks.workunit.client.1.smithi134.stdout:9/643: stat d5/d10/d35/l2f 0 2024-03-12T16:10:44.323 INFO:tasks.workunit.client.0.smithi006.stdout:4/492: truncate d1/db/d17/d5a/f8d 2132670 0 2024-03-12T16:10:44.330 INFO:tasks.workunit.client.0.smithi006.stdout:3/409: dwrite f1 [0,4194304] 0 2024-03-12T16:10:44.330 INFO:tasks.workunit.client.0.smithi006.stdout:4/493: dread d1/db/f40 [0,4194304] 0 2024-03-12T16:10:44.330 INFO:tasks.workunit.client.1.smithi134.stdout:1/486: write d0/d16/d9/d13/d38/f72 [32628,80282] 0 2024-03-12T16:10:44.331 INFO:tasks.workunit.client.1.smithi134.stdout:1/487: stat d0/d16/c84 0 2024-03-12T16:10:44.331 INFO:tasks.workunit.client.1.smithi134.stdout:8/639: truncate d3/d1b/d17/d25/d33/d15/d95/f30 7528999 0 2024-03-12T16:10:44.333 INFO:tasks.workunit.client.1.smithi134.stdout:1/488: symlink d0/d30/d48/la9 0 2024-03-12T16:10:44.336 INFO:tasks.workunit.client.1.smithi134.stdout:8/640: getdents d3/d1b/d17 0 2024-03-12T16:10:44.338 INFO:tasks.workunit.client.0.smithi006.stdout:4/494: creat d1/db/d39/d42/d61/f9f x:0 0 0 2024-03-12T16:10:44.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/641: dread - d3/d1b/d17/d24/d28/fc3 zero size 2024-03-12T16:10:44.340 INFO:tasks.workunit.client.1.smithi134.stdout:9/644: dwrite d5/d10/d35/d49/f4a [0,4194304] 0 2024-03-12T16:10:44.341 INFO:tasks.workunit.client.0.smithi006.stdout:4/495: mknod d1/db/d1d/d2f/ca0 0 2024-03-12T16:10:44.342 INFO:tasks.workunit.client.0.smithi006.stdout:4/496: creat d1/db/d39/d42/fa1 x:0 0 0 2024-03-12T16:10:44.343 INFO:tasks.workunit.client.1.smithi134.stdout:1/489: mkdir d0/d16/d9/d13/d21/d5f/d6f/daa 0 2024-03-12T16:10:44.343 INFO:tasks.workunit.client.0.smithi006.stdout:4/497: write d1/db/d39/f47 [2573974,97708] 0 2024-03-12T16:10:44.346 INFO:tasks.workunit.client.0.smithi006.stdout:4/498: write d1/d38/f57 [69533,53778] 0 2024-03-12T16:10:44.348 INFO:tasks.workunit.client.1.smithi134.stdout:1/490: mkdir d0/d30/d48/dab 0 2024-03-12T16:10:44.350 INFO:tasks.workunit.client.0.smithi006.stdout:4/499: creat d1/db/d1d/fa2 x:0 0 0 2024-03-12T16:10:44.351 INFO:tasks.workunit.client.1.smithi134.stdout:1/491: mkdir d0/d16/d9/d13/d21/dac 0 2024-03-12T16:10:44.353 INFO:tasks.workunit.client.0.smithi006.stdout:4/500: rmdir d1/d38/d79 39 2024-03-12T16:10:44.353 INFO:tasks.workunit.client.0.smithi006.stdout:4/501: chown d1/d38/l8f 17097 1 2024-03-12T16:10:44.356 INFO:tasks.workunit.client.1.smithi134.stdout:8/642: write d3/d1b/d17/f47 [2581453,2904] 0 2024-03-12T16:10:44.356 INFO:tasks.workunit.client.0.smithi006.stdout:4/502: symlink d1/db/d39/d42/la3 0 2024-03-12T16:10:44.356 INFO:tasks.workunit.client.0.smithi006.stdout:3/410: dread d8/d19/d26/d59/d3b/f80 [0,4194304] 0 2024-03-12T16:10:44.357 INFO:tasks.workunit.client.1.smithi134.stdout:1/492: dread d0/d16/d9/d13/d38/f75 [0,4194304] 0 2024-03-12T16:10:44.358 INFO:tasks.workunit.client.0.smithi006.stdout:3/411: stat d8/d19/d26/d59/d5b/c87 0 2024-03-12T16:10:44.358 INFO:tasks.workunit.client.1.smithi134.stdout:9/645: truncate d5/f14 4884492 0 2024-03-12T16:10:44.359 INFO:tasks.workunit.client.0.smithi006.stdout:4/503: unlink d1/db/l9e 0 2024-03-12T16:10:44.359 INFO:tasks.workunit.client.1.smithi134.stdout:1/493: fdatasync d0/d30/d86/f9e 0 2024-03-12T16:10:44.361 INFO:tasks.workunit.client.1.smithi134.stdout:8/643: dread d3/d1b/d17/d25/d49/f75 [0,4194304] 0 2024-03-12T16:10:44.361 INFO:tasks.workunit.client.1.smithi134.stdout:9/646: truncate d5/d10/d35/d49/d54/d5e/d82/f8e 225544 0 2024-03-12T16:10:44.363 INFO:tasks.workunit.client.1.smithi134.stdout:1/494: dread d0/d16/d9/d13/d21/d5f/d6f/d85/f83 [0,4194304] 0 2024-03-12T16:10:44.364 INFO:tasks.workunit.client.0.smithi006.stdout:4/504: creat d1/db/d1d/d2f/d6b/fa4 x:0 0 0 2024-03-12T16:10:44.364 INFO:tasks.workunit.client.1.smithi134.stdout:8/644: write d3/d1b/d17/d25/d33/f6b [1724282,50593] 0 2024-03-12T16:10:44.368 INFO:tasks.workunit.client.1.smithi134.stdout:8/645: mknod d3/d1b/d17/d25/d33/d85/cdf 0 2024-03-12T16:10:44.371 INFO:tasks.workunit.client.1.smithi134.stdout:9/647: dwrite d5/d10/d35/d49/d54/d5e/d82/f8e [0,4194304] 0 2024-03-12T16:10:44.372 INFO:tasks.workunit.client.1.smithi134.stdout:1/495: rmdir d0/d16/d9/d13/d21/d5f/d6f/daa 0 2024-03-12T16:10:44.373 INFO:tasks.workunit.client.0.smithi006.stdout:4/505: dwrite d1/db/d17/f74 [0,4194304] 0 2024-03-12T16:10:44.375 INFO:tasks.workunit.client.0.smithi006.stdout:3/412: dread d8/f17 [0,4194304] 0 2024-03-12T16:10:44.378 INFO:tasks.workunit.client.0.smithi006.stdout:4/506: fdatasync d1/d38/d79/f55 0 2024-03-12T16:10:44.380 INFO:tasks.workunit.client.1.smithi134.stdout:1/496: mkdir d0/d16/d9/d13/d21/d5f/d6f/dad 0 2024-03-12T16:10:44.381 INFO:tasks.workunit.client.0.smithi006.stdout:3/413: rmdir d8/d4c/d7c 39 2024-03-12T16:10:44.382 INFO:tasks.workunit.client.1.smithi134.stdout:9/648: creat d5/d10/d35/d49/d54/d5e/dab/fbd x:0 0 0 2024-03-12T16:10:44.384 INFO:tasks.workunit.client.0.smithi006.stdout:3/414: rmdir d8/d19/d26/d59/d3b 39 2024-03-12T16:10:44.386 INFO:tasks.workunit.client.1.smithi134.stdout:1/497: rename d0/d16/c84 to d0/d16/d39/cae 0 2024-03-12T16:10:44.387 INFO:tasks.workunit.client.0.smithi006.stdout:4/507: dwrite d1/db/d17/d43/f6f [0,4194304] 0 2024-03-12T16:10:44.389 INFO:tasks.workunit.client.1.smithi134.stdout:9/649: dwrite d5/d46/f64 [0,4194304] 0 2024-03-12T16:10:44.393 INFO:tasks.workunit.client.1.smithi134.stdout:8/646: link d3/d1b/d17/d25/d33/d15/d95/d5b/c9d d3/d1b/d17/d24/db6/dd9/ce0 0 2024-03-12T16:10:44.395 INFO:tasks.workunit.client.0.smithi006.stdout:3/415: dwrite d8/d19/d26/d59/f4e [4194304,4194304] 0 2024-03-12T16:10:44.395 INFO:tasks.workunit.client.1.smithi134.stdout:8/647: chown d3/d1b/d17/d25/c71 0 1 2024-03-12T16:10:44.396 INFO:tasks.workunit.client.0.smithi006.stdout:3/416: readlink d8/d19/d26/d59/l44 0 2024-03-12T16:10:44.397 INFO:tasks.workunit.client.1.smithi134.stdout:0/633: sync 2024-03-12T16:10:44.397 INFO:tasks.workunit.client.1.smithi134.stdout:4/549: sync 2024-03-12T16:10:44.397 INFO:tasks.workunit.client.1.smithi134.stdout:2/569: sync 2024-03-12T16:10:44.397 INFO:tasks.workunit.client.1.smithi134.stdout:3/765: sync 2024-03-12T16:10:44.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/710: sync 2024-03-12T16:10:44.400 INFO:tasks.workunit.client.1.smithi134.stdout:4/550: readlink d1/d13/l45 0 2024-03-12T16:10:44.400 INFO:tasks.workunit.client.1.smithi134.stdout:0/634: chown db/d2f/d31/d56/d66 72 1 2024-03-12T16:10:44.402 INFO:tasks.workunit.client.0.smithi006.stdout:4/508: dwrite d1/db/d39/d42/f98 [0,4194304] 0 2024-03-12T16:10:44.402 INFO:tasks.workunit.client.0.smithi006.stdout:3/417: link d8/d19/d26/d59/f42 d8/d19/d47/f96 0 2024-03-12T16:10:44.403 INFO:tasks.workunit.client.1.smithi134.stdout:3/766: dread - d1/db/d10/d2d/d30/fa0 zero size 2024-03-12T16:10:44.407 INFO:tasks.workunit.client.1.smithi134.stdout:2/570: readlink d4/d12/d1d/d34/d47/l4e 0 2024-03-12T16:10:44.407 INFO:tasks.workunit.client.0.smithi006.stdout:4/509: write d1/db/f64 [2991487,71690] 0 2024-03-12T16:10:44.407 INFO:tasks.workunit.client.0.smithi006.stdout:4/510: write d1/db/d1d/f5d [4320961,120653] 0 2024-03-12T16:10:44.409 INFO:tasks.workunit.client.0.smithi006.stdout:4/511: write d1/db/d1d/d2f/f36 [1354426,27118] 0 2024-03-12T16:10:44.414 INFO:tasks.workunit.client.0.smithi006.stdout:4/512: truncate d1/db/d39/f3b 319014 0 2024-03-12T16:10:44.415 INFO:tasks.workunit.client.1.smithi134.stdout:4/551: truncate d1/d13/f7f 4756329 0 2024-03-12T16:10:44.416 INFO:tasks.workunit.client.0.smithi006.stdout:4/513: mkdir d1/db/d1d/d6c/da5 0 2024-03-12T16:10:44.419 INFO:tasks.workunit.client.0.smithi006.stdout:4/514: rename d1/db/d1d/d2f/ca0 to d1/db/d17/d5a/d60/ca6 0 2024-03-12T16:10:44.420 INFO:tasks.workunit.client.1.smithi134.stdout:5/711: rename db/d7d/lbc to db/d7a/dc4/ldc 0 2024-03-12T16:10:44.420 INFO:tasks.workunit.client.0.smithi006.stdout:4/515: rmdir d1/d91 39 2024-03-12T16:10:44.424 INFO:tasks.workunit.client.0.smithi006.stdout:4/516: rename d1/db/d1d/fa2 to d1/db/d1d/d2f/d6b/fa7 0 2024-03-12T16:10:44.424 INFO:tasks.workunit.client.1.smithi134.stdout:8/648: getdents d3/d1b/d17/d25/d33/d96/dbd 0 2024-03-12T16:10:44.425 INFO:tasks.workunit.client.1.smithi134.stdout:5/712: symlink db/d12/d37/d73/d7f/ldd 0 2024-03-12T16:10:44.426 INFO:tasks.workunit.client.1.smithi134.stdout:3/767: creat d1/db/d10/d2d/f113 x:0 0 0 2024-03-12T16:10:44.427 INFO:tasks.workunit.client.0.smithi006.stdout:4/517: mkdir d1/db/d17/da8 0 2024-03-12T16:10:44.427 INFO:tasks.workunit.client.1.smithi134.stdout:1/498: dwrite d0/d16/f31 [0,4194304] 0 2024-03-12T16:10:44.428 INFO:tasks.workunit.client.1.smithi134.stdout:5/713: dread - db/d12/d1d/d59/d94/fae zero size 2024-03-12T16:10:44.429 INFO:tasks.workunit.client.1.smithi134.stdout:5/714: chown db/d12/f80 263789 1 2024-03-12T16:10:44.433 INFO:tasks.workunit.client.1.smithi134.stdout:1/499: unlink d0/d16/d9/d51/f7c 0 2024-03-12T16:10:44.435 INFO:tasks.workunit.client.1.smithi134.stdout:5/715: creat db/d7d/fde x:0 0 0 2024-03-12T16:10:44.437 INFO:tasks.workunit.client.1.smithi134.stdout:9/650: dread d5/d10/d35/d49/d8d/f75 [4194304,4194304] 0 2024-03-12T16:10:44.437 INFO:tasks.workunit.client.1.smithi134.stdout:8/649: getdents d3/d1b/d17/d24/db6/dd9 0 2024-03-12T16:10:44.439 INFO:tasks.workunit.client.1.smithi134.stdout:3/768: getdents d1/db/d12/d9d/d9f 0 2024-03-12T16:10:44.440 INFO:tasks.workunit.client.1.smithi134.stdout:9/651: fsync d5/d10/d35/d49/d54/f9e 0 2024-03-12T16:10:44.442 INFO:tasks.workunit.client.1.smithi134.stdout:8/650: unlink d3/d10/fd7 0 2024-03-12T16:10:44.447 INFO:tasks.workunit.client.1.smithi134.stdout:9/652: chown d5/d20/f23 88151910 1 2024-03-12T16:10:44.447 INFO:tasks.workunit.client.1.smithi134.stdout:8/651: write d3/d1b/d17/d25/d33/d15/d95/d5b/f8e [822790,22238] 0 2024-03-12T16:10:44.448 INFO:tasks.workunit.client.1.smithi134.stdout:4/552: dread d1/d13/d49/d64/f87 [0,4194304] 0 2024-03-12T16:10:44.449 INFO:tasks.workunit.client.0.smithi006.stdout:4/518: write d1/db/f3c [3411629,26409] 0 2024-03-12T16:10:44.449 INFO:tasks.workunit.client.1.smithi134.stdout:1/500: link d0/d16/d9/d13/d21/d20/c58 d0/d30/caf 0 2024-03-12T16:10:44.451 INFO:tasks.workunit.client.0.smithi006.stdout:4/519: creat d1/db/d39/fa9 x:0 0 0 2024-03-12T16:10:44.451 INFO:tasks.workunit.client.1.smithi134.stdout:3/769: dwrite d1/db/d10/d2d/f105 [0,4194304] 0 2024-03-12T16:10:44.453 INFO:tasks.workunit.client.0.smithi006.stdout:4/520: creat d1/db/d39/d42/faa x:0 0 0 2024-03-12T16:10:44.454 INFO:tasks.workunit.client.1.smithi134.stdout:9/653: rename d5/d10/d51/f90 to d5/d10/d33/fbe 0 2024-03-12T16:10:44.454 INFO:tasks.workunit.client.1.smithi134.stdout:8/652: write d3/d1b/d17/d25/fb3 [1019372,24080] 0 2024-03-12T16:10:44.455 INFO:tasks.workunit.client.0.smithi006.stdout:4/521: mknod d1/db/d1d/cab 0 2024-03-12T16:10:44.457 INFO:tasks.workunit.client.1.smithi134.stdout:2/571: write d4/d12/d1d/d34/d58/f75 [548914,23211] 0 2024-03-12T16:10:44.458 INFO:tasks.workunit.client.0.smithi006.stdout:4/522: fdatasync d1/db/f3c 0 2024-03-12T16:10:44.459 INFO:tasks.workunit.client.0.smithi006.stdout:4/523: dread - d1/db/d39/d42/d61/f9f zero size 2024-03-12T16:10:44.459 INFO:tasks.workunit.client.1.smithi134.stdout:1/501: rename d0/d16/d9/d13/d21/d2f/fa7 to d0/d42/fb0 0 2024-03-12T16:10:44.460 INFO:tasks.workunit.client.1.smithi134.stdout:9/654: fdatasync d5/d10/f9b 0 2024-03-12T16:10:44.461 INFO:tasks.workunit.client.0.smithi006.stdout:4/524: write d1/db/d39/f47 [1952256,103319] 0 2024-03-12T16:10:44.463 INFO:tasks.workunit.client.1.smithi134.stdout:1/502: chown d0/d42/d47/l7b 43 1 2024-03-12T16:10:44.467 INFO:tasks.workunit.client.1.smithi134.stdout:8/653: rmdir d3/d1b/d17/d25/d49/d94 39 2024-03-12T16:10:44.468 INFO:tasks.workunit.client.1.smithi134.stdout:4/553: dwrite d1/d13/d49/d64/d28/f9d [0,4194304] 0 2024-03-12T16:10:44.469 INFO:tasks.workunit.client.0.smithi006.stdout:4/525: write d1/db/d17/f32 [5105162,3129] 0 2024-03-12T16:10:44.472 INFO:tasks.workunit.client.1.smithi134.stdout:5/716: truncate db/fa3 1357768 0 2024-03-12T16:10:44.475 INFO:tasks.workunit.client.1.smithi134.stdout:9/655: fsync d5/d10/d35/d49/d54/d5e/d82/f8e 0 2024-03-12T16:10:44.477 INFO:tasks.workunit.client.0.smithi006.stdout:4/526: dwrite d1/db/f40 [0,4194304] 0 2024-03-12T16:10:44.478 INFO:tasks.workunit.client.1.smithi134.stdout:0/635: dwrite db/d2f/d61/d67/f69 [0,4194304] 0 2024-03-12T16:10:44.478 INFO:tasks.workunit.client.0.smithi006.stdout:4/527: chown d1/c9 75155121 1 2024-03-12T16:10:44.479 INFO:tasks.workunit.client.1.smithi134.stdout:3/770: write d1/db/d10/d2d/f33 [4397586,107792] 0 2024-03-12T16:10:44.484 INFO:tasks.workunit.client.1.smithi134.stdout:4/554: mknod d1/d13/cb3 0 2024-03-12T16:10:44.486 INFO:tasks.workunit.client.0.smithi006.stdout:4/528: truncate d1/d38/d79/f84 207551 0 2024-03-12T16:10:44.488 INFO:tasks.workunit.client.1.smithi134.stdout:5/717: getdents db/d12/d1d/d59/d94/ddb 0 2024-03-12T16:10:44.488 INFO:tasks.workunit.client.1.smithi134.stdout:1/503: dwrite d0/d16/d9/d13/f7f [0,4194304] 0 2024-03-12T16:10:44.492 INFO:tasks.workunit.client.1.smithi134.stdout:8/654: dread d3/d1b/d17/d3f/f52 [0,4194304] 0 2024-03-12T16:10:44.492 INFO:tasks.workunit.client.0.smithi006.stdout:4/529: rename d1/db/d17/d5a/d60/l7e to d1/db/d1d/d2f/d6b/lac 0 2024-03-12T16:10:44.493 INFO:tasks.workunit.client.1.smithi134.stdout:2/572: dwrite d4/f24 [4194304,4194304] 0 2024-03-12T16:10:44.497 INFO:tasks.workunit.client.1.smithi134.stdout:9/656: rename d5/d10/d35/f6f to d5/d10/d35/d49/d8d/fbf 0 2024-03-12T16:10:44.498 INFO:tasks.workunit.client.0.smithi006.stdout:4/530: link d1/db/d39/l5f d1/db/d1d/lad 0 2024-03-12T16:10:44.499 INFO:tasks.workunit.client.1.smithi134.stdout:5/718: write db/d12/d1d/d3a/f67 [435338,48329] 0 2024-03-12T16:10:44.503 INFO:tasks.workunit.client.1.smithi134.stdout:4/555: creat d1/d24/d34/d8e/fb4 x:0 0 0 2024-03-12T16:10:44.503 INFO:tasks.workunit.client.1.smithi134.stdout:1/504: stat d0/d16/d39/cae 0 2024-03-12T16:10:44.504 INFO:tasks.workunit.client.1.smithi134.stdout:5/719: chown db/d12/fb8 28796 1 2024-03-12T16:10:44.504 INFO:tasks.workunit.client.1.smithi134.stdout:4/556: readlink d1/d13/l45 0 2024-03-12T16:10:44.504 INFO:tasks.workunit.client.0.smithi006.stdout:4/531: rename d1/db/d1d/d2f/l65 to d1/db/d39/d42/d61/lae 0 2024-03-12T16:10:44.506 INFO:tasks.workunit.client.0.smithi006.stdout:4/532: symlink d1/db/d17/d5a/laf 0 2024-03-12T16:10:44.507 INFO:tasks.workunit.client.0.smithi006.stdout:4/533: chown d1/db/d17/f1a 789346 1 2024-03-12T16:10:44.508 INFO:tasks.workunit.client.1.smithi134.stdout:8/655: creat d3/d1b/d17/fe1 x:0 0 0 2024-03-12T16:10:44.508 INFO:tasks.workunit.client.1.smithi134.stdout:3/771: link d1/d63/dc2/f110 d1/d63/f114 0 2024-03-12T16:10:44.508 INFO:tasks.workunit.client.1.smithi134.stdout:0/636: dwrite db/d2f/d31/f3b [4194304,4194304] 0 2024-03-12T16:10:44.508 INFO:tasks.workunit.client.1.smithi134.stdout:6/602: sync 2024-03-12T16:10:44.508 INFO:tasks.workunit.client.1.smithi134.stdout:4/557: chown d1/d24/d34/c9f 68626150 1 2024-03-12T16:10:44.508 INFO:tasks.workunit.client.1.smithi134.stdout:9/657: chown d5/c9 232459128 1 2024-03-12T16:10:44.509 INFO:tasks.workunit.client.0.smithi006.stdout:4/534: chown d1/db/d1d/d2f/f97 9150 1 2024-03-12T16:10:44.509 INFO:tasks.workunit.client.1.smithi134.stdout:2/573: symlink d4/d84/d7d/d87/lca 0 2024-03-12T16:10:44.510 INFO:tasks.workunit.client.1.smithi134.stdout:5/720: mkdir db/d12/d37/db4/db9/ddf 0 2024-03-12T16:10:44.513 INFO:tasks.workunit.client.1.smithi134.stdout:3/772: symlink d1/d63/dc2/l115 0 2024-03-12T16:10:44.514 INFO:tasks.workunit.client.1.smithi134.stdout:6/603: write d1/da6/d55/fdd [437195,109508] 0 2024-03-12T16:10:44.515 INFO:tasks.workunit.client.0.smithi006.stdout:4/535: dwrite d1/d38/f4f [4194304,4194304] 0 2024-03-12T16:10:44.516 INFO:tasks.workunit.client.0.smithi006.stdout:4/536: fsync d1/db/d1d/d2f/d6b/fa4 0 2024-03-12T16:10:44.516 INFO:tasks.workunit.client.1.smithi134.stdout:2/574: mkdir d4/d12/d1d/d34/dcb 0 2024-03-12T16:10:44.517 INFO:tasks.workunit.client.1.smithi134.stdout:5/721: creat db/d7a/d97/fe0 x:0 0 0 2024-03-12T16:10:44.517 INFO:tasks.workunit.client.0.smithi006.stdout:4/537: write d1/db/d39/fa9 [595866,122364] 0 2024-03-12T16:10:44.518 INFO:tasks.workunit.client.0.smithi006.stdout:4/538: dread - d1/f31 zero size 2024-03-12T16:10:44.518 INFO:tasks.workunit.client.0.smithi006.stdout:0/442: sync 2024-03-12T16:10:44.518 INFO:tasks.workunit.client.0.smithi006.stdout:9/388: sync 2024-03-12T16:10:44.519 INFO:tasks.workunit.client.1.smithi134.stdout:2/575: write d4/d12/d43/da2/f69 [229647,84142] 0 2024-03-12T16:10:44.522 INFO:tasks.workunit.client.1.smithi134.stdout:3/773: write d1/d63/f9e [4216900,119430] 0 2024-03-12T16:10:44.523 INFO:tasks.workunit.client.0.smithi006.stdout:4/539: symlink d1/db/d1d/lb0 0 2024-03-12T16:10:44.523 INFO:tasks.workunit.client.0.smithi006.stdout:0/443: creat d2/d39/d42/d67/f80 x:0 0 0 2024-03-12T16:10:44.526 INFO:tasks.workunit.client.0.smithi006.stdout:9/389: getdents d0/d4 0 2024-03-12T16:10:44.526 INFO:tasks.workunit.client.0.smithi006.stdout:4/540: dread d1/db/f29 [0,4194304] 0 2024-03-12T16:10:44.530 INFO:tasks.workunit.client.1.smithi134.stdout:6/604: mknod d1/d3/d19/d32/d4a/ce7 0 2024-03-12T16:10:44.530 INFO:tasks.workunit.client.1.smithi134.stdout:5/722: rmdir db/d12/d29/d3d/d79/da5/dc0 39 2024-03-12T16:10:44.530 INFO:tasks.workunit.client.1.smithi134.stdout:9/658: dwrite d5/d10/d35/d49/d54/fb1 [0,4194304] 0 2024-03-12T16:10:44.532 INFO:tasks.workunit.client.0.smithi006.stdout:9/390: rename d0/d8/d23 to d0/d4/d70/d86 0 2024-03-12T16:10:44.532 INFO:tasks.workunit.client.1.smithi134.stdout:5/723: chown db/d12/d1d/d59/d94/lcb 26253535 1 2024-03-12T16:10:44.533 INFO:tasks.workunit.client.0.smithi006.stdout:9/391: chown d0/d8/d16/d2f/c7f 35 1 2024-03-12T16:10:44.533 INFO:tasks.workunit.client.0.smithi006.stdout:4/541: unlink d1/db/d17/f1e 0 2024-03-12T16:10:44.535 INFO:tasks.workunit.client.0.smithi006.stdout:4/542: dread - d1/db/d39/d42/f81 zero size 2024-03-12T16:10:44.535 INFO:tasks.workunit.client.1.smithi134.stdout:0/637: mknod db/d2f/d31/d68/d70/daa/cca 0 2024-03-12T16:10:44.535 INFO:tasks.workunit.client.1.smithi134.stdout:7/620: sync 2024-03-12T16:10:44.538 INFO:tasks.workunit.client.0.smithi006.stdout:9/392: creat d0/f87 x:0 0 0 2024-03-12T16:10:44.538 INFO:tasks.workunit.client.1.smithi134.stdout:3/774: mkdir d1/db/d10/d2d/d2e/d72/d116 0 2024-03-12T16:10:44.540 INFO:tasks.workunit.client.1.smithi134.stdout:0/638: chown db/f26 32329619 1 2024-03-12T16:10:44.544 INFO:tasks.workunit.client.0.smithi006.stdout:9/393: creat d0/d8/d16/d7d/f88 x:0 0 0 2024-03-12T16:10:44.545 INFO:tasks.workunit.client.0.smithi006.stdout:9/394: readlink d0/d4/d3b/l6c 0 2024-03-12T16:10:44.546 INFO:tasks.workunit.client.0.smithi006.stdout:9/395: write d0/d4/f25 [918793,649] 0 2024-03-12T16:10:44.550 INFO:tasks.workunit.client.1.smithi134.stdout:3/775: mkdir d1/d63/dc2/d117 0 2024-03-12T16:10:44.550 INFO:tasks.workunit.client.1.smithi134.stdout:6/605: rename d1/l8b to d1/d16/d4c/d65/d61/de4/le8 0 2024-03-12T16:10:44.551 INFO:tasks.workunit.client.1.smithi134.stdout:7/621: dread d8/dc/d55/d57/f9e [0,4194304] 0 2024-03-12T16:10:44.554 INFO:tasks.workunit.client.1.smithi134.stdout:5/724: fdatasync db/f27 0 2024-03-12T16:10:44.554 INFO:tasks.workunit.client.0.smithi006.stdout:9/396: fsync d0/d4/f25 0 2024-03-12T16:10:44.556 INFO:tasks.workunit.client.0.smithi006.stdout:9/397: symlink d0/d4/d70/l89 0 2024-03-12T16:10:44.557 INFO:tasks.workunit.client.1.smithi134.stdout:0/639: dwrite db/d2f/f63 [0,4194304] 0 2024-03-12T16:10:44.558 INFO:tasks.workunit.client.0.smithi006.stdout:9/398: symlink d0/d8/d80/l8a 0 2024-03-12T16:10:44.560 INFO:tasks.workunit.client.1.smithi134.stdout:8/656: write d3/d1b/d17/d25/f79 [858176,104295] 0 2024-03-12T16:10:44.563 INFO:tasks.workunit.client.1.smithi134.stdout:3/776: creat d1/db/d10/d2a/f118 x:0 0 0 2024-03-12T16:10:44.563 INFO:tasks.workunit.client.1.smithi134.stdout:2/576: dread d4/d12/d1d/d34/fa0 [0,4194304] 0 2024-03-12T16:10:44.565 INFO:tasks.workunit.client.1.smithi134.stdout:9/659: getdents d5/d10/d35/d49/d8d 0 2024-03-12T16:10:44.566 INFO:tasks.workunit.client.1.smithi134.stdout:3/777: write d1/db/d14/d5f/f7d [2088877,15519] 0 2024-03-12T16:10:44.567 INFO:tasks.workunit.client.1.smithi134.stdout:5/725: symlink db/d12/d37/d73/d7f/le1 0 2024-03-12T16:10:44.567 INFO:tasks.workunit.client.0.smithi006.stdout:4/543: dread d1/db/d39/d42/f51 [0,4194304] 0 2024-03-12T16:10:44.568 INFO:tasks.workunit.client.1.smithi134.stdout:0/640: symlink db/d2f/d71/lcb 0 2024-03-12T16:10:44.569 INFO:tasks.workunit.client.0.smithi006.stdout:4/544: chown d1/db/d17/c44 22 1 2024-03-12T16:10:44.570 INFO:tasks.workunit.client.1.smithi134.stdout:7/622: mknod d8/d27/d9d/d31/d7c/cd4 0 2024-03-12T16:10:44.570 INFO:tasks.workunit.client.1.smithi134.stdout:6/606: dread d1/d16/d4c/d65/d61/fa7 [0,4194304] 0 2024-03-12T16:10:44.571 INFO:tasks.workunit.client.1.smithi134.stdout:8/657: chown d3/d10/d31/c68 437 1 2024-03-12T16:10:44.572 INFO:tasks.workunit.client.0.smithi006.stdout:4/545: creat d1/d38/d79/fb1 x:0 0 0 2024-03-12T16:10:44.573 INFO:tasks.workunit.client.1.smithi134.stdout:2/577: creat d4/d12/d1d/d34/fcc x:0 0 0 2024-03-12T16:10:44.575 INFO:tasks.workunit.client.0.smithi006.stdout:4/546: mknod d1/db/cb2 0 2024-03-12T16:10:44.575 INFO:tasks.workunit.client.1.smithi134.stdout:0/641: chown db/d2f/d61/d7a 5808 1 2024-03-12T16:10:44.576 INFO:tasks.workunit.client.0.smithi006.stdout:4/547: fdatasync d1/db/d17/d5a/f8d 0 2024-03-12T16:10:44.577 INFO:tasks.workunit.client.1.smithi134.stdout:4/558: truncate d1/d13/d49/faa 974561 0 2024-03-12T16:10:44.579 INFO:tasks.workunit.client.1.smithi134.stdout:3/778: fsync d1/db/d14/d5f/fe5 0 2024-03-12T16:10:44.582 INFO:tasks.workunit.client.1.smithi134.stdout:7/623: dread - d8/dc/d20/d26/d36/f9b zero size 2024-03-12T16:10:44.583 INFO:tasks.workunit.client.1.smithi134.stdout:8/658: dread - d3/d1b/d17/fe1 zero size 2024-03-12T16:10:44.583 INFO:tasks.workunit.client.1.smithi134.stdout:2/578: dread - d4/d84/d7d/dbe/fc7 zero size 2024-03-12T16:10:44.584 INFO:tasks.workunit.client.1.smithi134.stdout:9/660: dwrite d5/d20/f87 [0,4194304] 0 2024-03-12T16:10:44.586 INFO:tasks.workunit.client.1.smithi134.stdout:4/559: write d1/d24/d34/f97 [2254326,31331] 0 2024-03-12T16:10:44.588 INFO:tasks.workunit.client.1.smithi134.stdout:6/607: read d1/d16/d4c/d58/da0/db7/f71 [4138654,65027] 0 2024-03-12T16:10:44.590 INFO:tasks.workunit.client.1.smithi134.stdout:3/779: chown d1/db/d10/d2d/f9a 33 1 2024-03-12T16:10:44.590 INFO:tasks.workunit.client.1.smithi134.stdout:0/642: rmdir db/d2f/d61/d94 39 2024-03-12T16:10:44.592 INFO:tasks.workunit.client.1.smithi134.stdout:7/624: readlink d8/dc/d55/d81/d87/lbc 0 2024-03-12T16:10:44.595 INFO:tasks.workunit.client.1.smithi134.stdout:0/643: mkdir db/dcc 0 2024-03-12T16:10:44.598 INFO:tasks.workunit.client.1.smithi134.stdout:8/659: write d3/d1b/d17/d24/f6f [1364285,70615] 0 2024-03-12T16:10:44.600 INFO:tasks.workunit.client.1.smithi134.stdout:5/726: dwrite db/d12/d1d/d5c/fc8 [0,4194304] 0 2024-03-12T16:10:44.600 INFO:tasks.workunit.client.1.smithi134.stdout:4/560: chown d1/d13/d49/f78 26505 1 2024-03-12T16:10:44.605 INFO:tasks.workunit.client.1.smithi134.stdout:0/644: creat db/d2f/d61/d7a/fcd x:0 0 0 2024-03-12T16:10:44.607 INFO:tasks.workunit.client.1.smithi134.stdout:9/661: dwrite d5/d46/f7f [0,4194304] 0 2024-03-12T16:10:44.609 INFO:tasks.workunit.client.1.smithi134.stdout:4/561: chown d1/d13/d49/d64/d28/d4f/f9c 0 1 2024-03-12T16:10:44.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/625: rename d8/dc/d7b/da0 to d8/dc/d7b/dbb/dbd/dd5 0 2024-03-12T16:10:44.616 INFO:tasks.workunit.client.1.smithi134.stdout:8/660: rmdir d3/d1b 39 2024-03-12T16:10:44.616 INFO:tasks.workunit.client.1.smithi134.stdout:6/608: truncate d1/da6/d55/fdd 525421 0 2024-03-12T16:10:44.617 INFO:tasks.workunit.client.1.smithi134.stdout:7/626: rename d8/d27/c28 to d8/dc/d55/d81/cd6 0 2024-03-12T16:10:44.618 INFO:tasks.workunit.client.0.smithi006.stdout:4/548: dread d1/db/d17/f32 [4194304,4194304] 0 2024-03-12T16:10:44.619 INFO:tasks.workunit.client.1.smithi134.stdout:7/627: fsync d8/d4e/f52 0 2024-03-12T16:10:44.620 INFO:tasks.workunit.client.1.smithi134.stdout:6/609: fsync d1/da6/d55/d94/f6f 0 2024-03-12T16:10:44.624 INFO:tasks.workunit.client.1.smithi134.stdout:6/610: creat d1/d3/d10/fe9 x:0 0 0 2024-03-12T16:10:44.625 INFO:tasks.workunit.client.1.smithi134.stdout:5/727: dread db/d12/d1d/f51 [0,4194304] 0 2024-03-12T16:10:44.625 INFO:tasks.workunit.client.0.smithi006.stdout:4/549: truncate d1/db/d17/f32 855325 0 2024-03-12T16:10:44.626 INFO:tasks.workunit.client.1.smithi134.stdout:7/628: link d8/dc/d20/d26/f2b d8/d4e/dca/fd7 0 2024-03-12T16:10:44.629 INFO:tasks.workunit.client.1.smithi134.stdout:6/611: creat d1/d16/d4c/d58/fea x:0 0 0 2024-03-12T16:10:44.630 INFO:tasks.workunit.client.1.smithi134.stdout:5/728: write db/d12/d1d/d3a/f88 [77099,99411] 0 2024-03-12T16:10:44.631 INFO:tasks.workunit.client.1.smithi134.stdout:7/629: symlink d8/dc/d55/d81/d87/ld8 0 2024-03-12T16:10:44.631 INFO:tasks.workunit.client.0.smithi006.stdout:4/550: dwrite d1/db/d39/d42/f51 [0,4194304] 0 2024-03-12T16:10:44.632 INFO:tasks.workunit.client.0.smithi006.stdout:4/551: stat d1/db/d39/d42/fa1 0 2024-03-12T16:10:44.634 INFO:tasks.workunit.client.1.smithi134.stdout:6/612: mkdir d1/d3a/db5/deb 0 2024-03-12T16:10:44.634 INFO:tasks.workunit.client.1.smithi134.stdout:9/662: write d5/d10/d35/d49/d74/f78 [192252,66433] 0 2024-03-12T16:10:44.636 INFO:tasks.workunit.client.1.smithi134.stdout:4/562: dread d1/d13/f7f [0,4194304] 0 2024-03-12T16:10:44.637 INFO:tasks.workunit.client.1.smithi134.stdout:7/630: mkdir d8/dc/d4b/dd9 0 2024-03-12T16:10:44.640 INFO:tasks.workunit.client.1.smithi134.stdout:7/631: chown d8/d27/d5b/l68 0 1 2024-03-12T16:10:44.640 INFO:tasks.workunit.client.1.smithi134.stdout:7/632: read d8/dc/d20/faf [3821701,77752] 0 2024-03-12T16:10:44.642 INFO:tasks.workunit.client.1.smithi134.stdout:5/729: link db/f6d db/d12/d37/d73/d7f/fe2 0 2024-03-12T16:10:44.643 INFO:tasks.workunit.client.1.smithi134.stdout:5/730: readlink db/d12/d37/d73/l8f 0 2024-03-12T16:10:44.649 INFO:tasks.workunit.client.1.smithi134.stdout:4/563: symlink d1/d24/lb5 0 2024-03-12T16:10:44.657 INFO:tasks.workunit.client.1.smithi134.stdout:6/613: read d1/da6/d55/fdd [234877,121318] 0 2024-03-12T16:10:44.658 INFO:tasks.workunit.client.1.smithi134.stdout:4/564: creat d1/fb6 x:0 0 0 2024-03-12T16:10:44.660 INFO:tasks.workunit.client.1.smithi134.stdout:5/731: dwrite db/d12/d29/d3d/f53 [4194304,4194304] 0 2024-03-12T16:10:44.661 INFO:tasks.workunit.client.0.smithi006.stdout:4/552: dread d1/db/d39/f73 [0,4194304] 0 2024-03-12T16:10:44.663 INFO:tasks.workunit.client.1.smithi134.stdout:7/633: dread d8/d27/d9d/d31/f35 [0,4194304] 0 2024-03-12T16:10:44.666 INFO:tasks.workunit.client.1.smithi134.stdout:9/663: dwrite d5/f14 [0,4194304] 0 2024-03-12T16:10:44.668 INFO:tasks.workunit.client.1.smithi134.stdout:6/614: getdents d1/d16/d4c/d65/d7b 0 2024-03-12T16:10:44.673 INFO:tasks.workunit.client.1.smithi134.stdout:4/565: dwrite d1/d24/fad [0,4194304] 0 2024-03-12T16:10:44.676 INFO:tasks.workunit.client.1.smithi134.stdout:9/664: creat d5/d10/d35/d49/d54/d88/fc0 x:0 0 0 2024-03-12T16:10:44.680 INFO:tasks.workunit.client.1.smithi134.stdout:4/566: read d1/de/f82 [2800905,59354] 0 2024-03-12T16:10:44.683 INFO:tasks.workunit.client.1.smithi134.stdout:9/665: mkdir d5/d10/d35/dc1 0 2024-03-12T16:10:44.684 INFO:tasks.workunit.client.1.smithi134.stdout:4/567: read - d1/d13/d49/f66 zero size 2024-03-12T16:10:44.684 INFO:tasks.workunit.client.0.smithi006.stdout:5/307: sync 2024-03-12T16:10:44.685 INFO:tasks.workunit.client.0.smithi006.stdout:2/432: sync 2024-03-12T16:10:44.685 INFO:tasks.workunit.client.0.smithi006.stdout:8/333: sync 2024-03-12T16:10:44.685 INFO:tasks.workunit.client.0.smithi006.stdout:6/413: sync 2024-03-12T16:10:44.685 INFO:tasks.workunit.client.0.smithi006.stdout:8/334: stat d2/db 0 2024-03-12T16:10:44.687 INFO:tasks.workunit.client.1.smithi134.stdout:6/615: dwrite d1/d16/d4c/d65/f5c [0,4194304] 0 2024-03-12T16:10:44.687 INFO:tasks.workunit.client.0.smithi006.stdout:6/414: stat d3/d11/f3c 0 2024-03-12T16:10:44.688 INFO:tasks.workunit.client.0.smithi006.stdout:5/308: write d7/d9/f30 [1860692,82285] 0 2024-03-12T16:10:44.688 INFO:tasks.workunit.client.1.smithi134.stdout:4/568: chown d1/d13/f39 16 1 2024-03-12T16:10:44.688 INFO:tasks.workunit.client.1.smithi134.stdout:9/666: write d5/d10/d1f/f6e [1047883,88973] 0 2024-03-12T16:10:44.689 INFO:tasks.workunit.client.1.smithi134.stdout:7/634: dread d8/d27/f73 [0,4194304] 0 2024-03-12T16:10:44.690 INFO:tasks.workunit.client.0.smithi006.stdout:8/335: symlink d2/d32/l6b 0 2024-03-12T16:10:44.691 INFO:tasks.workunit.client.0.smithi006.stdout:2/433: mknod d0/d13/d49/d60/d2b/d62/d66/c8c 0 2024-03-12T16:10:44.692 INFO:tasks.workunit.client.0.smithi006.stdout:6/415: creat d3/d11/d3b/d59/f97 x:0 0 0 2024-03-12T16:10:44.693 INFO:tasks.workunit.client.1.smithi134.stdout:7/635: write d8/dc/d20/d26/f50 [1510366,102167] 0 2024-03-12T16:10:44.694 INFO:tasks.workunit.client.1.smithi134.stdout:4/569: chown d1/d24/d34/f57 1566814 1 2024-03-12T16:10:44.694 INFO:tasks.workunit.client.1.smithi134.stdout:9/667: dread - d5/d10/d35/d49/d8d/faf zero size 2024-03-12T16:10:44.695 INFO:tasks.workunit.client.0.smithi006.stdout:6/416: dread - d3/d11/d3b/f95 zero size 2024-03-12T16:10:44.696 INFO:tasks.workunit.client.1.smithi134.stdout:6/616: getdents d1/d3a 0 2024-03-12T16:10:44.697 INFO:tasks.workunit.client.1.smithi134.stdout:7/636: mknod d8/dc/d4b/dd9/cda 0 2024-03-12T16:10:44.699 INFO:tasks.workunit.client.0.smithi006.stdout:5/309: truncate d7/d9/d10/d24/f3d 154891 0 2024-03-12T16:10:44.699 INFO:tasks.workunit.client.1.smithi134.stdout:9/668: unlink d5/c9d 0 2024-03-12T16:10:44.699 INFO:tasks.workunit.client.0.smithi006.stdout:6/417: dread - d3/d11/f25 zero size 2024-03-12T16:10:44.700 INFO:tasks.workunit.client.1.smithi134.stdout:4/570: creat d1/de/dac/fb7 x:0 0 0 2024-03-12T16:10:44.702 INFO:tasks.workunit.client.0.smithi006.stdout:8/336: dwrite d2/d11/f1b [0,4194304] 0 2024-03-12T16:10:44.702 INFO:tasks.workunit.client.0.smithi006.stdout:2/434: truncate d0/d13/f44 2629057 0 2024-03-12T16:10:44.702 INFO:tasks.workunit.client.1.smithi134.stdout:9/669: mknod d5/d10/d35/d49/d8d/cc2 0 2024-03-12T16:10:44.702 INFO:tasks.workunit.client.0.smithi006.stdout:6/418: readlink d3/d11/d10/d1b/d6e/l44 0 2024-03-12T16:10:44.703 INFO:tasks.workunit.client.1.smithi134.stdout:7/637: symlink d8/dc/ldb 0 2024-03-12T16:10:44.704 INFO:tasks.workunit.client.0.smithi006.stdout:8/337: stat d2/db/d1a/d23/f50 0 2024-03-12T16:10:44.705 INFO:tasks.workunit.client.0.smithi006.stdout:5/310: mkdir d7/d9/d31/d3b/d4f/d65/d69 0 2024-03-12T16:10:44.706 INFO:tasks.workunit.client.1.smithi134.stdout:4/571: unlink d1/de/c62 0 2024-03-12T16:10:44.706 INFO:tasks.workunit.client.1.smithi134.stdout:6/617: dwrite d1/d16/d4c/d58/fe3 [0,4194304] 0 2024-03-12T16:10:44.709 INFO:tasks.workunit.client.1.smithi134.stdout:7/638: write d8/d27/d9d/d31/d7c/fc6 [522615,27199] 0 2024-03-12T16:10:44.710 INFO:tasks.workunit.client.1.smithi134.stdout:4/572: chown d1/c2d 0 1 2024-03-12T16:10:44.710 INFO:tasks.workunit.client.0.smithi006.stdout:2/435: truncate d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/f8a 574284 0 2024-03-12T16:10:44.711 INFO:tasks.workunit.client.0.smithi006.stdout:8/338: write d2/db/d1a/d21/d4f/f68 [8689422,29362] 0 2024-03-12T16:10:44.712 INFO:tasks.workunit.client.0.smithi006.stdout:5/311: truncate d7/d9/d10/d35/f3c 4665344 0 2024-03-12T16:10:44.714 INFO:tasks.workunit.client.1.smithi134.stdout:6/618: symlink d1/d16/d4c/d65/d61/lec 0 2024-03-12T16:10:44.714 INFO:tasks.workunit.client.1.smithi134.stdout:4/573: stat d1/d13/d49/d64/da3 0 2024-03-12T16:10:44.714 INFO:tasks.workunit.client.1.smithi134.stdout:7/639: rename d8/d4e/d91/c94 to d8/dc/d4b/dd9/cdc 0 2024-03-12T16:10:44.717 INFO:tasks.workunit.client.1.smithi134.stdout:6/619: symlink d1/da6/d55/d94/d75/led 0 2024-03-12T16:10:44.718 INFO:tasks.workunit.client.0.smithi006.stdout:6/419: dwrite d3/d11/d43/f46 [0,4194304] 0 2024-03-12T16:10:44.727 INFO:tasks.workunit.client.1.smithi134.stdout:6/620: mknod d1/d16/d4c/d65/dd1/cee 0 2024-03-12T16:10:44.727 INFO:tasks.workunit.client.1.smithi134.stdout:7/640: dwrite d8/db4/fd3 [0,4194304] 0 2024-03-12T16:10:44.727 INFO:tasks.workunit.client.0.smithi006.stdout:5/312: creat d7/d9/f6a x:0 0 0 2024-03-12T16:10:44.727 INFO:tasks.workunit.client.0.smithi006.stdout:8/339: creat d2/db/f6c x:0 0 0 2024-03-12T16:10:44.728 INFO:tasks.workunit.client.1.smithi134.stdout:4/574: dwrite d1/de/d5a/d84/f85 [0,4194304] 0 2024-03-12T16:10:44.728 INFO:tasks.workunit.client.1.smithi134.stdout:9/670: write d5/d20/f23 [1086853,30018] 0 2024-03-12T16:10:44.728 INFO:tasks.workunit.client.0.smithi006.stdout:2/436: link d0/d13/d49/d60/f32 d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f8d 0 2024-03-12T16:10:44.728 INFO:tasks.workunit.client.0.smithi006.stdout:8/340: chown d2/f63 35949753 1 2024-03-12T16:10:44.729 INFO:tasks.workunit.client.1.smithi134.stdout:6/621: chown d1/d3/d10/cc8 454619428 1 2024-03-12T16:10:44.729 INFO:tasks.workunit.client.1.smithi134.stdout:9/671: write d5/d10/d35/f61 [4673431,60462] 0 2024-03-12T16:10:44.731 INFO:tasks.workunit.client.1.smithi134.stdout:4/575: write d1/d13/f7f [1823075,103739] 0 2024-03-12T16:10:44.731 INFO:tasks.workunit.client.1.smithi134.stdout:7/641: chown d8/d4e/l7a 657139078 1 2024-03-12T16:10:44.732 INFO:tasks.workunit.client.0.smithi006.stdout:8/341: unlink d2/l1e 0 2024-03-12T16:10:44.736 INFO:tasks.workunit.client.1.smithi134.stdout:6/622: mkdir d1/def 0 2024-03-12T16:10:44.736 INFO:tasks.workunit.client.1.smithi134.stdout:4/576: chown d1/d13/d49/d6d/d96 114 1 2024-03-12T16:10:44.737 INFO:tasks.workunit.client.1.smithi134.stdout:6/623: chown d1/d16/d4c/d58/l5d 1007323565 1 2024-03-12T16:10:44.739 INFO:tasks.workunit.client.1.smithi134.stdout:4/577: creat d1/de/dac/fb8 x:0 0 0 2024-03-12T16:10:44.740 INFO:tasks.workunit.client.0.smithi006.stdout:2/437: truncate d0/f4 1805378 0 2024-03-12T16:10:44.740 INFO:tasks.workunit.client.0.smithi006.stdout:6/420: getdents d3/d11/d43 0 2024-03-12T16:10:44.740 INFO:tasks.workunit.client.0.smithi006.stdout:6/421: stat d3/f14 0 2024-03-12T16:10:44.741 INFO:tasks.workunit.client.0.smithi006.stdout:2/438: creat d0/d13/d49/d60/d2b/f8e x:0 0 0 2024-03-12T16:10:44.742 INFO:tasks.workunit.client.1.smithi134.stdout:7/642: rmdir d8/d27/d9d/daa 0 2024-03-12T16:10:44.743 INFO:tasks.workunit.client.1.smithi134.stdout:4/578: creat d1/d13/d49/d64/da3/fb9 x:0 0 0 2024-03-12T16:10:44.744 INFO:tasks.workunit.client.1.smithi134.stdout:7/643: symlink d8/dc/d7b/dbb/dbd/ldd 0 2024-03-12T16:10:44.745 INFO:tasks.workunit.client.0.smithi006.stdout:6/422: write d3/d11/d10/d19/f65 [36719,123629] 0 2024-03-12T16:10:44.745 INFO:tasks.workunit.client.0.smithi006.stdout:2/439: mknod d0/d13/d49/d60/d2b/d62/d66/d69/c8f 0 2024-03-12T16:10:44.746 INFO:tasks.workunit.client.1.smithi134.stdout:6/624: rename d1/d4/c4b to d1/cf0 0 2024-03-12T16:10:44.747 INFO:tasks.workunit.client.0.smithi006.stdout:8/342: dread d2/db/fe [4194304,4194304] 0 2024-03-12T16:10:44.747 INFO:tasks.workunit.client.1.smithi134.stdout:6/625: dread - d1/da6/d55/d85/fd0 zero size 2024-03-12T16:10:44.750 INFO:tasks.workunit.client.1.smithi134.stdout:7/644: mknod d8/d27/d5b/cde 0 2024-03-12T16:10:44.750 INFO:tasks.workunit.client.0.smithi006.stdout:2/440: creat d0/d13/d49/d60/d2b/f90 x:0 0 0 2024-03-12T16:10:44.755 INFO:tasks.workunit.client.0.smithi006.stdout:6/423: dwrite d3/d11/d10/d19/f1f [0,4194304] 0 2024-03-12T16:10:44.756 INFO:tasks.workunit.client.1.smithi134.stdout:4/579: link d1/d13/f1d d1/d13/d49/d53/fba 0 2024-03-12T16:10:44.756 INFO:tasks.workunit.client.1.smithi134.stdout:4/580: readlink d1/d13/l45 0 2024-03-12T16:10:44.756 INFO:tasks.workunit.client.1.smithi134.stdout:6/626: creat d1/d3a/db5/deb/ff1 x:0 0 0 2024-03-12T16:10:44.758 INFO:tasks.workunit.client.1.smithi134.stdout:4/581: readlink d1/d13/l45 0 2024-03-12T16:10:44.758 INFO:tasks.workunit.client.0.smithi006.stdout:5/313: truncate d7/d8/f4c 3547150 0 2024-03-12T16:10:44.759 INFO:tasks.workunit.client.1.smithi134.stdout:9/672: truncate d5/f14 4643071 0 2024-03-12T16:10:44.761 INFO:tasks.workunit.client.0.smithi006.stdout:5/314: rmdir d7/d41 39 2024-03-12T16:10:44.762 INFO:tasks.workunit.client.1.smithi134.stdout:4/582: fsync d1/d13/d49/f78 0 2024-03-12T16:10:44.762 INFO:tasks.workunit.client.1.smithi134.stdout:7/645: dread d8/dc/d55/d81/d87/f9f [0,4194304] 0 2024-03-12T16:10:44.762 INFO:tasks.workunit.client.1.smithi134.stdout:7/646: chown d8/dc 2876 1 2024-03-12T16:10:44.763 INFO:tasks.workunit.client.0.smithi006.stdout:8/343: dread d2/d11/f14 [0,4194304] 0 2024-03-12T16:10:44.764 INFO:tasks.workunit.client.1.smithi134.stdout:4/583: readlink d1/d13/d49/d64/l94 0 2024-03-12T16:10:44.765 INFO:tasks.workunit.client.0.smithi006.stdout:8/344: write d2/db/d1a/f26 [216731,34419] 0 2024-03-12T16:10:44.770 INFO:tasks.workunit.client.1.smithi134.stdout:4/584: symlink d1/d13/d49/lbb 0 2024-03-12T16:10:44.771 INFO:tasks.workunit.client.0.smithi006.stdout:2/441: write d0/dc/f5b [185050,123571] 0 2024-03-12T16:10:44.774 INFO:tasks.workunit.client.0.smithi006.stdout:6/424: truncate d3/d11/d43/f46 2632377 0 2024-03-12T16:10:44.775 INFO:tasks.workunit.client.1.smithi134.stdout:4/585: mkdir d1/dbc 0 2024-03-12T16:10:44.775 INFO:tasks.workunit.client.0.smithi006.stdout:5/315: truncate d7/d9/d2c/f36 3687841 0 2024-03-12T16:10:44.778 INFO:tasks.workunit.client.0.smithi006.stdout:5/316: write d7/d9/d10/f1b [4876552,67972] 0 2024-03-12T16:10:44.778 INFO:tasks.workunit.client.1.smithi134.stdout:4/586: rmdir d1/de 39 2024-03-12T16:10:44.780 INFO:tasks.workunit.client.0.smithi006.stdout:5/317: stat d7/d8/l1d 0 2024-03-12T16:10:44.780 INFO:tasks.workunit.client.1.smithi134.stdout:4/587: stat d1/de/d5a 0 2024-03-12T16:10:44.781 INFO:tasks.workunit.client.1.smithi134.stdout:4/588: chown d1/de/c89 6 1 2024-03-12T16:10:44.781 INFO:tasks.workunit.client.0.smithi006.stdout:5/318: fsync d7/d9/d10/d24/f37 0 2024-03-12T16:10:44.782 INFO:tasks.workunit.client.0.smithi006.stdout:6/425: symlink d3/d11/d10/d1b/d20/d5a/d8e/d8b/l98 0 2024-03-12T16:10:44.783 INFO:tasks.workunit.client.1.smithi134.stdout:6/627: truncate d1/d3/d19/d32/f3c 3770297 0 2024-03-12T16:10:44.784 INFO:tasks.workunit.client.1.smithi134.stdout:4/589: truncate d1/d24/d34/f83 338212 0 2024-03-12T16:10:44.785 INFO:tasks.workunit.client.1.smithi134.stdout:4/590: fdatasync d1/de/dac/fb7 0 2024-03-12T16:10:44.786 INFO:tasks.workunit.client.1.smithi134.stdout:6/628: mkdir d1/d4/df2 0 2024-03-12T16:10:44.787 INFO:tasks.workunit.client.1.smithi134.stdout:9/673: truncate d5/d10/d35/d49/d54/d5e/d82/f92 597336 0 2024-03-12T16:10:44.788 INFO:tasks.workunit.client.0.smithi006.stdout:5/319: unlink d7/d9/d10/d24/f37 0 2024-03-12T16:10:44.788 INFO:tasks.workunit.client.1.smithi134.stdout:9/674: chown d5/d10/d1f/f6e 30528234 1 2024-03-12T16:10:44.790 INFO:tasks.workunit.client.1.smithi134.stdout:7/647: dread d8/f2a [0,4194304] 0 2024-03-12T16:10:44.790 INFO:tasks.workunit.client.1.smithi134.stdout:4/591: symlink d1/d13/d49/d64/d28/d4f/d67/lbd 0 2024-03-12T16:10:44.790 INFO:tasks.workunit.client.1.smithi134.stdout:6/629: mknod d1/d16/d4c/d65/d9d/cf3 0 2024-03-12T16:10:44.792 INFO:tasks.workunit.client.1.smithi134.stdout:6/630: write d1/da6/d55/d97/f99 [173379,116312] 0 2024-03-12T16:10:44.793 INFO:tasks.workunit.client.1.smithi134.stdout:4/592: mkdir d1/d13/d49/d64/d28/d4f/dbe 0 2024-03-12T16:10:44.794 INFO:tasks.workunit.client.0.smithi006.stdout:5/320: mkdir d7/d9/d31/d3b/d6b 0 2024-03-12T16:10:44.794 INFO:tasks.workunit.client.0.smithi006.stdout:6/426: dwrite d3/d11/fd [0,4194304] 0 2024-03-12T16:10:44.796 INFO:tasks.workunit.client.0.smithi006.stdout:2/442: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f8d [0,4194304] 0 2024-03-12T16:10:44.800 INFO:tasks.workunit.client.0.smithi006.stdout:2/443: chown d0/f12 17205822 1 2024-03-12T16:10:44.800 INFO:tasks.workunit.client.0.smithi006.stdout:5/321: dread d7/d9/f20 [4194304,4194304] 0 2024-03-12T16:10:44.801 INFO:tasks.workunit.client.1.smithi134.stdout:9/675: dwrite d5/d10/d33/fbe [0,4194304] 0 2024-03-12T16:10:44.805 INFO:tasks.workunit.client.1.smithi134.stdout:9/676: readlink d5/d10/d35/d49/d54/d88/lb3 0 2024-03-12T16:10:44.806 INFO:tasks.workunit.client.0.smithi006.stdout:5/322: rmdir d7/d8 39 2024-03-12T16:10:44.807 INFO:tasks.workunit.client.0.smithi006.stdout:2/444: readlink d0/d13/d49/d60/d2b/l34 0 2024-03-12T16:10:44.807 INFO:tasks.workunit.client.1.smithi134.stdout:6/631: creat d1/d16/d4c/ff4 x:0 0 0 2024-03-12T16:10:44.809 INFO:tasks.workunit.client.1.smithi134.stdout:4/593: dwrite d1/d13/d49/d64/d28/d4f/d67/f95 [4194304,4194304] 0 2024-03-12T16:10:44.810 INFO:tasks.workunit.client.1.smithi134.stdout:9/677: dread - d5/d10/d35/d49/d8d/faf zero size 2024-03-12T16:10:44.811 INFO:tasks.workunit.client.0.smithi006.stdout:5/323: chown d7/d8/l1d 0 1 2024-03-12T16:10:44.811 INFO:tasks.workunit.client.0.smithi006.stdout:2/445: truncate d0/d13/d49/d60/f14 5143121 0 2024-03-12T16:10:44.812 INFO:tasks.workunit.client.0.smithi006.stdout:6/427: link d3/d11/d10/d1b/d20/f23 d3/d11/d3b/f99 0 2024-03-12T16:10:44.812 INFO:tasks.workunit.client.1.smithi134.stdout:6/632: symlink d1/da6/d55/d94/lf5 0 2024-03-12T16:10:44.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/594: stat d1/d24/d34/d73/f8d 0 2024-03-12T16:10:44.814 INFO:tasks.workunit.client.1.smithi134.stdout:6/633: dread - d1/da6/f88 zero size 2024-03-12T16:10:44.814 INFO:tasks.workunit.client.1.smithi134.stdout:9/678: write d5/d10/d35/d49/d54/d5e/f71 [1161851,97162] 0 2024-03-12T16:10:44.816 INFO:tasks.workunit.client.0.smithi006.stdout:2/446: unlink d0/l9 0 2024-03-12T16:10:44.816 INFO:tasks.workunit.client.0.smithi006.stdout:5/324: truncate d7/d8/f4c 2636774 0 2024-03-12T16:10:44.817 INFO:tasks.workunit.client.1.smithi134.stdout:6/634: truncate d1/d16/d4c/d58/da0/db7/f4e 4313310 0 2024-03-12T16:10:44.817 INFO:tasks.workunit.client.0.smithi006.stdout:6/428: chown d3/d11/d10/d1b/d20/f23 380615 1 2024-03-12T16:10:44.818 INFO:tasks.workunit.client.1.smithi134.stdout:9/679: creat d5/d10/d51/fc3 x:0 0 0 2024-03-12T16:10:44.820 INFO:tasks.workunit.client.1.smithi134.stdout:6/635: chown d1/d16/d4c/d65/d61/fa7 448 1 2024-03-12T16:10:44.821 INFO:tasks.workunit.client.0.smithi006.stdout:6/429: write d3/d11/d10/d1b/d20/d5a/d8e/f7a [532866,116845] 0 2024-03-12T16:10:44.821 INFO:tasks.workunit.client.0.smithi006.stdout:5/325: symlink d7/d9/d10/d35/l6c 0 2024-03-12T16:10:44.822 INFO:tasks.workunit.client.1.smithi134.stdout:4/595: rename d1/d24/l8c to d1/de/d5a/d70/lbf 0 2024-03-12T16:10:44.822 INFO:tasks.workunit.client.0.smithi006.stdout:2/447: truncate d0/d13/d49/d60/f16 2925685 0 2024-03-12T16:10:44.825 INFO:tasks.workunit.client.1.smithi134.stdout:4/596: unlink d1/f42 0 2024-03-12T16:10:44.826 INFO:tasks.workunit.client.0.smithi006.stdout:6/430: mkdir d3/d11/d10/d9a 0 2024-03-12T16:10:44.829 INFO:tasks.workunit.client.1.smithi134.stdout:9/680: dwrite d5/d10/d35/d49/d8d/fbf [0,4194304] 0 2024-03-12T16:10:44.829 INFO:tasks.workunit.client.0.smithi006.stdout:5/326: link d7/d9/d31/l43 d7/d9/d31/d3b/l6d 0 2024-03-12T16:10:44.831 INFO:tasks.workunit.client.1.smithi134.stdout:6/636: getdents d1/d16/d4c 0 2024-03-12T16:10:44.831 INFO:tasks.workunit.client.0.smithi006.stdout:5/327: chown d7/d9/d10/l54 1834380 1 2024-03-12T16:10:44.831 INFO:tasks.workunit.client.0.smithi006.stdout:2/448: dwrite d0/d13/f2e [0,4194304] 0 2024-03-12T16:10:44.831 INFO:tasks.workunit.client.1.smithi134.stdout:4/597: rename d1/de/f82 to d1/dbc/fc0 0 2024-03-12T16:10:44.833 INFO:tasks.workunit.client.1.smithi134.stdout:4/598: chown d1/d13/d49/d64/d28/d4f 4047 1 2024-03-12T16:10:44.834 INFO:tasks.workunit.client.0.smithi006.stdout:5/328: truncate d7/d41/f55 623061 0 2024-03-12T16:10:44.839 INFO:tasks.workunit.client.0.smithi006.stdout:5/329: mknod d7/d9/d47/c6e 0 2024-03-12T16:10:44.842 INFO:tasks.workunit.client.1.smithi134.stdout:6/637: dwrite d1/d4/f80 [0,4194304] 0 2024-03-12T16:10:44.842 INFO:tasks.workunit.client.1.smithi134.stdout:4/599: rename d1/d13/d49/d64/d28/l6b to d1/de/d90/lc1 0 2024-03-12T16:10:44.844 INFO:tasks.workunit.client.1.smithi134.stdout:9/681: dwrite d5/f28 [0,4194304] 0 2024-03-12T16:10:44.844 INFO:tasks.workunit.client.0.smithi006.stdout:5/330: rename d7/cd to d7/d8/c6f 0 2024-03-12T16:10:44.845 INFO:tasks.workunit.client.0.smithi006.stdout:5/331: chown d7/d9/d10/d35/f3c 49274772 1 2024-03-12T16:10:44.845 INFO:tasks.workunit.client.1.smithi134.stdout:9/682: chown d5/d10/d6c/c66 79 1 2024-03-12T16:10:44.849 INFO:tasks.workunit.client.0.smithi006.stdout:2/449: dread d0/d13/d49/f73 [0,4194304] 0 2024-03-12T16:10:44.850 INFO:tasks.workunit.client.0.smithi006.stdout:5/332: truncate d7/d9/d10/d24/f3e 3565396 0 2024-03-12T16:10:44.853 INFO:tasks.workunit.client.1.smithi134.stdout:9/683: write d5/d10/d35/d49/d54/d5e/fb5 [1497149,114881] 0 2024-03-12T16:10:44.853 INFO:tasks.workunit.client.1.smithi134.stdout:4/600: dread - d1/d13/d49/d6d/f76 zero size 2024-03-12T16:10:44.853 INFO:tasks.workunit.client.1.smithi134.stdout:6/638: dread d1/da6/d55/dcc/fcf [0,4194304] 0 2024-03-12T16:10:44.855 INFO:tasks.workunit.client.1.smithi134.stdout:4/601: rename d1/d13/f68 to d1/de/d90/fc2 0 2024-03-12T16:10:44.856 INFO:tasks.workunit.client.0.smithi006.stdout:2/450: dread d0/d13/d49/d60/f36 [0,4194304] 0 2024-03-12T16:10:44.857 INFO:tasks.workunit.client.0.smithi006.stdout:3/418: sync 2024-03-12T16:10:44.857 INFO:tasks.workunit.client.0.smithi006.stdout:7/538: sync 2024-03-12T16:10:44.857 INFO:tasks.workunit.client.0.smithi006.stdout:1/449: sync 2024-03-12T16:10:44.859 INFO:tasks.workunit.client.1.smithi134.stdout:9/684: rename d5/d20/d72/fac to d5/d10/d35/d49/d54/d5e/dab/fc4 0 2024-03-12T16:10:44.861 INFO:tasks.workunit.client.0.smithi006.stdout:7/539: write de/d27/d2b/f57 [434456,24731] 0 2024-03-12T16:10:44.862 INFO:tasks.workunit.client.0.smithi006.stdout:1/450: fdatasync d0/d25/d2a/f4d 0 2024-03-12T16:10:44.864 INFO:tasks.workunit.client.0.smithi006.stdout:7/540: mknod de/d98/cb7 0 2024-03-12T16:10:44.865 INFO:tasks.workunit.client.0.smithi006.stdout:2/451: dread d0/f3f [0,4194304] 0 2024-03-12T16:10:44.866 INFO:tasks.workunit.client.1.smithi134.stdout:9/685: rename d5/d10/d33/f44 to d5/d10/d33/fc5 0 2024-03-12T16:10:44.866 INFO:tasks.workunit.client.1.smithi134.stdout:6/639: dwrite d1/d16/d4c/d58/da0/fc1 [0,4194304] 0 2024-03-12T16:10:44.866 INFO:tasks.workunit.client.0.smithi006.stdout:7/541: read f3 [4633300,126706] 0 2024-03-12T16:10:44.867 INFO:tasks.workunit.client.1.smithi134.stdout:6/640: chown d1/d3/cd8 86674 1 2024-03-12T16:10:44.869 INFO:tasks.workunit.client.1.smithi134.stdout:9/686: mkdir d5/d10/d35/d49/d54/dc6 0 2024-03-12T16:10:44.872 INFO:tasks.workunit.client.1.smithi134.stdout:6/641: getdents d1/d16/d4c/d65/d70 0 2024-03-12T16:10:44.872 INFO:tasks.workunit.client.1.smithi134.stdout:9/687: dread d5/d10/d35/d49/d54/f9e [0,4194304] 0 2024-03-12T16:10:44.874 INFO:tasks.workunit.client.1.smithi134.stdout:6/642: chown d1/d3/d19/d32/d4a 14459 1 2024-03-12T16:10:44.874 INFO:tasks.workunit.client.1.smithi134.stdout:9/688: truncate d5/d20/f27 4907943 0 2024-03-12T16:10:44.875 INFO:tasks.workunit.client.1.smithi134.stdout:1/505: sync 2024-03-12T16:10:44.875 INFO:tasks.workunit.client.1.smithi134.stdout:9/689: write d5/d20/f27 [4032844,289] 0 2024-03-12T16:10:44.875 INFO:tasks.workunit.client.0.smithi006.stdout:1/451: link d0/d25/f75 d0/d25/d2a/d35/f94 0 2024-03-12T16:10:44.875 INFO:tasks.workunit.client.0.smithi006.stdout:2/452: mknod d0/d13/d49/d60/c91 0 2024-03-12T16:10:44.878 INFO:tasks.workunit.client.1.smithi134.stdout:6/643: mkdir d1/d16/d4c/d58/da0/df6 0 2024-03-12T16:10:44.879 INFO:tasks.workunit.client.1.smithi134.stdout:1/506: symlink d0/d16/d9/d13/d21/d2f/lb1 0 2024-03-12T16:10:44.879 INFO:tasks.workunit.client.0.smithi006.stdout:7/542: dwrite de/d27/f2d [0,4194304] 0 2024-03-12T16:10:44.880 INFO:tasks.workunit.client.1.smithi134.stdout:6/644: write d1/da6/d55/d97/f99 [79530,121198] 0 2024-03-12T16:10:44.884 INFO:tasks.workunit.client.0.smithi006.stdout:7/543: fdatasync de/d2c/faa 0 2024-03-12T16:10:44.885 INFO:tasks.workunit.client.0.smithi006.stdout:3/419: write d8/d19/d47/f63 [1055695,112377] 0 2024-03-12T16:10:44.885 INFO:tasks.workunit.client.1.smithi134.stdout:9/690: creat d5/d10/d35/d49/d54/d5e/dab/fc7 x:0 0 0 2024-03-12T16:10:44.888 INFO:tasks.workunit.client.0.smithi006.stdout:5/333: dread d7/d9/f16 [0,4194304] 0 2024-03-12T16:10:44.889 INFO:tasks.workunit.client.0.smithi006.stdout:7/544: symlink de/d27/d2b/d4a/d6a/lb8 0 2024-03-12T16:10:44.890 INFO:tasks.workunit.client.0.smithi006.stdout:5/334: read - d7/d9/d10/d35/f53 zero size 2024-03-12T16:10:44.890 INFO:tasks.workunit.client.1.smithi134.stdout:1/507: dwrite d0/d16/d9/d13/d38/f69 [0,4194304] 0 2024-03-12T16:10:44.891 INFO:tasks.workunit.client.0.smithi006.stdout:7/545: write de/d18/d2a/f67 [4066338,112084] 0 2024-03-12T16:10:44.891 INFO:tasks.workunit.client.1.smithi134.stdout:6/645: fdatasync d1/d3/d19/d32/f3c 0 2024-03-12T16:10:44.892 INFO:tasks.workunit.client.0.smithi006.stdout:3/420: rename d8/d19/d26/d59/d5b to d8/d19/d26/d97 0 2024-03-12T16:10:44.892 INFO:tasks.workunit.client.0.smithi006.stdout:7/546: stat de/d1c/d35/f7d 0 2024-03-12T16:10:44.895 INFO:tasks.workunit.client.0.smithi006.stdout:7/547: readlink de/d18/d2a/d39/l92 0 2024-03-12T16:10:44.898 INFO:tasks.workunit.client.0.smithi006.stdout:5/335: symlink d7/d9/d31/d3b/d4f/l70 0 2024-03-12T16:10:44.898 INFO:tasks.workunit.client.1.smithi134.stdout:6/646: link d1/d16/d4c/d65/d61/fe5 d1/d16/d4c/d58/d8e/ff7 0 2024-03-12T16:10:44.900 INFO:tasks.workunit.client.1.smithi134.stdout:4/602: dread d1/d13/d49/f65 [0,4194304] 0 2024-03-12T16:10:44.902 INFO:tasks.workunit.client.1.smithi134.stdout:4/603: truncate d1/d13/d49/d64/d28/f99 3815106 0 2024-03-12T16:10:44.905 INFO:tasks.workunit.client.1.smithi134.stdout:4/604: write d1/d13/d49/d64/d28/f99 [1263034,119679] 0 2024-03-12T16:10:44.905 INFO:tasks.workunit.client.0.smithi006.stdout:7/548: creat de/d27/d97/fb9 x:0 0 0 2024-03-12T16:10:44.906 INFO:tasks.workunit.client.1.smithi134.stdout:6/647: dwrite d1/f5 [0,4194304] 0 2024-03-12T16:10:44.909 INFO:tasks.workunit.client.0.smithi006.stdout:5/336: mknod d7/d9/d31/d3b/d4f/d65/d69/c71 0 2024-03-12T16:10:44.910 INFO:tasks.workunit.client.0.smithi006.stdout:2/453: dwrite d0/f12 [0,4194304] 0 2024-03-12T16:10:44.910 INFO:tasks.workunit.client.0.smithi006.stdout:1/452: dwrite d0/d25/d2a/f71 [0,4194304] 0 2024-03-12T16:10:44.910 INFO:tasks.workunit.client.1.smithi134.stdout:6/648: creat d1/d16/d4c/d65/d7b/ff8 x:0 0 0 2024-03-12T16:10:44.914 INFO:tasks.workunit.client.1.smithi134.stdout:4/605: rename d1/d13/d49/d64/d28/d4f/lb0 to d1/d13/d49/d53/lc3 0 2024-03-12T16:10:44.914 INFO:tasks.workunit.client.0.smithi006.stdout:2/454: stat d0/d13/d49/d60/d2b/f6b 0 2024-03-12T16:10:44.915 INFO:tasks.workunit.client.1.smithi134.stdout:6/649: mkdir d1/d16/d4c/d65/dd1/df9 0 2024-03-12T16:10:44.916 INFO:tasks.workunit.client.0.smithi006.stdout:7/549: rename de/d18/d2a to de/d2c/d4f/dba 0 2024-03-12T16:10:44.918 INFO:tasks.workunit.client.1.smithi134.stdout:4/606: mknod d1/d13/d49/d64/d28/cc4 0 2024-03-12T16:10:44.924 INFO:tasks.workunit.client.0.smithi006.stdout:1/453: symlink d0/d25/d2a/d43/d68/l95 0 2024-03-12T16:10:44.925 INFO:tasks.workunit.client.0.smithi006.stdout:7/550: write de/d7b/f91 [592638,110337] 0 2024-03-12T16:10:44.931 INFO:tasks.workunit.client.1.smithi134.stdout:6/650: dwrite d1/d16/d4c/d65/d61/fa7 [0,4194304] 0 2024-03-12T16:10:44.931 INFO:tasks.workunit.client.1.smithi134.stdout:6/651: chown d1/d16/d4c/d65 4 1 2024-03-12T16:10:44.931 INFO:tasks.workunit.client.1.smithi134.stdout:4/607: dread d1/d13/d49/d64/d28/d4f/d67/f86 [0,4194304] 0 2024-03-12T16:10:44.935 INFO:tasks.workunit.client.1.smithi134.stdout:6/652: fdatasync d1/d4/f14 0 2024-03-12T16:10:44.936 INFO:tasks.workunit.client.1.smithi134.stdout:4/608: creat d1/de/fc5 x:0 0 0 2024-03-12T16:10:44.937 INFO:tasks.workunit.client.0.smithi006.stdout:7/551: dwrite de/d2c/d4f/d83/f95 [0,4194304] 0 2024-03-12T16:10:44.940 INFO:tasks.workunit.client.1.smithi134.stdout:4/609: chown d1/d13/d49/fa0 605553 1 2024-03-12T16:10:44.941 INFO:tasks.workunit.client.1.smithi134.stdout:4/610: dread - d1/d13/f7c zero size 2024-03-12T16:10:44.941 INFO:tasks.workunit.client.1.smithi134.stdout:4/611: chown d1/d13/l77 17 1 2024-03-12T16:10:44.946 INFO:tasks.workunit.client.1.smithi134.stdout:4/612: fdatasync d1/d24/d34/f83 0 2024-03-12T16:10:44.947 INFO:tasks.workunit.client.1.smithi134.stdout:4/613: chown d1/d13/d49/d53/la5 15 1 2024-03-12T16:10:44.948 INFO:tasks.workunit.client.1.smithi134.stdout:4/614: readlink d1/d13/l46 0 2024-03-12T16:10:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:43.498954+0000 mgr.smithi134.gcntfu (mgr.24383) 59 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 178 MiB/s wr, 301 op/s 2024-03-12T16:10:44.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:43.723193+0000 mon.smithi006 (mon.0) 711 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:10:44.953 INFO:tasks.workunit.client.1.smithi134.stdout:4/615: creat d1/d13/d49/d64/d28/d4f/dbe/fc6 x:0 0 0 2024-03-12T16:10:44.953 INFO:tasks.workunit.client.0.smithi006.stdout:2/455: dread d0/dc/fd [0,4194304] 0 2024-03-12T16:10:44.956 INFO:tasks.workunit.client.1.smithi134.stdout:4/616: truncate d1/d13/d49/fb1 1120659 0 2024-03-12T16:10:44.957 INFO:tasks.workunit.client.1.smithi134.stdout:4/617: dread - d1/d13/d49/d64/da3/fae zero size 2024-03-12T16:10:44.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:43.498954+0000 mgr.smithi134.gcntfu (mgr.24383) 59 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 1.5 GiB data, 6.0 GiB used, 530 GiB / 536 GiB avail; 38 MiB/s rd, 178 MiB/s wr, 301 op/s 2024-03-12T16:10:44.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:43.723193+0000 mon.smithi006 (mon.0) 711 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:10:44.959 INFO:tasks.workunit.client.1.smithi134.stdout:4/618: mknod d1/d13/d49/d64/d28/d4f/d67/cc7 0 2024-03-12T16:10:44.960 INFO:tasks.workunit.client.1.smithi134.stdout:4/619: chown d1/d13/d49/d64/d28/d4f/dbe/fc6 0 1 2024-03-12T16:10:44.962 INFO:tasks.workunit.client.1.smithi134.stdout:4/620: creat d1/d13/d49/d64/da3/fc8 x:0 0 0 2024-03-12T16:10:44.963 INFO:tasks.workunit.client.1.smithi134.stdout:6/653: dread d1/d3/d19/d32/d4a/f82 [0,4194304] 0 2024-03-12T16:10:44.964 INFO:tasks.workunit.client.1.smithi134.stdout:4/621: mkdir d1/de/d90/dc9 0 2024-03-12T16:10:44.965 INFO:tasks.workunit.client.1.smithi134.stdout:4/622: stat d1/de/d5a/d70/l9b 0 2024-03-12T16:10:44.966 INFO:tasks.workunit.client.1.smithi134.stdout:6/654: creat d1/d3/d19/d32/ffa x:0 0 0 2024-03-12T16:10:44.967 INFO:tasks.workunit.client.1.smithi134.stdout:4/623: unlink d1/de/c89 0 2024-03-12T16:10:44.968 INFO:tasks.workunit.client.1.smithi134.stdout:6/655: mknod d1/da6/d55/d85/cfb 0 2024-03-12T16:10:44.969 INFO:tasks.workunit.client.1.smithi134.stdout:4/624: chown d1/d24/d34/d8e 605882132 1 2024-03-12T16:10:44.970 INFO:tasks.workunit.client.1.smithi134.stdout:6/656: creat d1/d3/d19/d32/d4a/ffc x:0 0 0 2024-03-12T16:10:44.971 INFO:tasks.workunit.client.0.smithi006.stdout:7/552: mknod de/d27/d2b/d66/cbb 0 2024-03-12T16:10:44.972 INFO:tasks.workunit.client.0.smithi006.stdout:3/421: dwrite d8/d19/d47/f96 [0,4194304] 0 2024-03-12T16:10:44.975 INFO:tasks.workunit.client.0.smithi006.stdout:3/422: read d8/f88 [157993,24963] 0 2024-03-12T16:10:44.977 INFO:tasks.workunit.client.0.smithi006.stdout:3/423: fdatasync d8/d4c/f65 0 2024-03-12T16:10:44.977 INFO:tasks.workunit.client.1.smithi134.stdout:6/657: dwrite d1/d3/d10/f2a [4194304,4194304] 0 2024-03-12T16:10:44.983 INFO:tasks.workunit.client.1.smithi134.stdout:6/658: mkdir d1/da6/d55/d97/dfd 0 2024-03-12T16:10:44.990 INFO:tasks.workunit.client.0.smithi006.stdout:3/424: symlink d8/d19/d26/d59/d2c/dc/d28/d2f/l98 0 2024-03-12T16:10:44.999 INFO:tasks.workunit.client.1.smithi134.stdout:6/659: truncate d1/d4/f67 4788883 0 2024-03-12T16:10:45.002 INFO:tasks.workunit.client.1.smithi134.stdout:6/660: rename d1/d3/d10/ld4 to d1/da6/lfe 0 2024-03-12T16:10:45.003 INFO:tasks.workunit.client.1.smithi134.stdout:6/661: rename d1/d16/d4c to d1/d16/d4c/d58/da0/dff 22 2024-03-12T16:10:45.004 INFO:tasks.workunit.client.1.smithi134.stdout:6/662: write d1/fb2 [1294315,50366] 0 2024-03-12T16:10:45.015 INFO:tasks.workunit.client.1.smithi134.stdout:6/663: dread d1/d3/d19/f1f [0,4194304] 0 2024-03-12T16:10:45.017 INFO:tasks.workunit.client.1.smithi134.stdout:6/664: mkdir d1/d16/d100 0 2024-03-12T16:10:45.018 INFO:tasks.workunit.client.1.smithi134.stdout:6/665: fdatasync d1/d16/d4c/d65/d70/fda 0 2024-03-12T16:10:45.020 INFO:tasks.workunit.client.1.smithi134.stdout:6/666: rmdir d1/da6/d55 39 2024-03-12T16:10:45.022 INFO:tasks.workunit.client.0.smithi006.stdout:9/399: sync 2024-03-12T16:10:45.022 INFO:tasks.workunit.client.0.smithi006.stdout:0/444: sync 2024-03-12T16:10:45.022 INFO:tasks.workunit.client.0.smithi006.stdout:4/553: sync 2024-03-12T16:10:45.023 INFO:tasks.workunit.client.1.smithi134.stdout:6/667: creat d1/d16/d4c/d65/d70/dca/f101 x:0 0 0 2024-03-12T16:10:45.025 INFO:tasks.workunit.client.0.smithi006.stdout:9/400: creat d0/d1f/f8b x:0 0 0 2024-03-12T16:10:45.025 INFO:tasks.workunit.client.1.smithi134.stdout:6/668: creat d1/d3/d19/d32/f102 x:0 0 0 2024-03-12T16:10:45.026 INFO:tasks.workunit.client.1.smithi134.stdout:6/669: dread - d1/d3/d19/d32/d4a/ffc zero size 2024-03-12T16:10:45.028 INFO:tasks.workunit.client.1.smithi134.stdout:6/670: creat d1/d16/f103 x:0 0 0 2024-03-12T16:10:45.033 INFO:tasks.workunit.client.1.smithi134.stdout:6/671: link d1/d4/c60 d1/d16/d4c/d65/d61/c104 0 2024-03-12T16:10:45.035 INFO:tasks.workunit.client.1.smithi134.stdout:6/672: creat d1/d3/dcb/f105 x:0 0 0 2024-03-12T16:10:45.035 INFO:tasks.workunit.client.0.smithi006.stdout:0/445: rmdir d2/d6/d10/d11/d1d/d2e/d6e 0 2024-03-12T16:10:45.042 INFO:tasks.workunit.client.1.smithi134.stdout:6/673: dwrite d1/d16/d4c/d58/fe3 [4194304,4194304] 0 2024-03-12T16:10:45.045 INFO:tasks.workunit.client.1.smithi134.stdout:6/674: creat d1/d16/d4c/d58/da0/df6/f106 x:0 0 0 2024-03-12T16:10:45.046 INFO:tasks.workunit.client.1.smithi134.stdout:6/675: dread - d1/fd3 zero size 2024-03-12T16:10:45.049 INFO:tasks.workunit.client.0.smithi006.stdout:0/446: dread d2/d6/d10/d11/d1d/f29 [0,4194304] 0 2024-03-12T16:10:45.053 INFO:tasks.workunit.client.1.smithi134.stdout:6/676: dwrite d1/d3a/db5/deb/ff1 [0,4194304] 0 2024-03-12T16:10:45.054 INFO:tasks.workunit.client.0.smithi006.stdout:0/447: symlink d2/d39/l81 0 2024-03-12T16:10:45.057 INFO:tasks.workunit.client.0.smithi006.stdout:0/448: truncate d2/d39/d42/f58 702184 0 2024-03-12T16:10:45.058 INFO:tasks.workunit.client.0.smithi006.stdout:1/454: truncate d0/d25/d2a/d35/f3a 3883493 0 2024-03-12T16:10:45.059 INFO:tasks.workunit.client.1.smithi134.stdout:6/677: dwrite d1/d16/d4c/faa [0,4194304] 0 2024-03-12T16:10:45.059 INFO:tasks.workunit.client.1.smithi134.stdout:6/678: fsync d1/d3/d10/f2a 0 2024-03-12T16:10:45.064 INFO:tasks.workunit.client.0.smithi006.stdout:2/456: write d0/f50 [56129,90100] 0 2024-03-12T16:10:45.070 INFO:tasks.workunit.client.0.smithi006.stdout:5/337: dwrite d7/d9/d10/d24/f3e [0,4194304] 0 2024-03-12T16:10:45.073 INFO:tasks.workunit.client.0.smithi006.stdout:3/425: truncate d8/d19/d26/f43 4184153 0 2024-03-12T16:10:45.073 INFO:tasks.workunit.client.0.smithi006.stdout:2/457: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/l92 0 2024-03-12T16:10:45.081 INFO:tasks.workunit.client.0.smithi006.stdout:3/426: mkdir d8/d19/d26/d59/d2c/dc/d28/d2f/d99 0 2024-03-12T16:10:45.082 INFO:tasks.workunit.client.0.smithi006.stdout:4/554: rmdir d1/db 39 2024-03-12T16:10:45.084 INFO:tasks.workunit.client.0.smithi006.stdout:2/458: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/f8a [0,4194304] 0 2024-03-12T16:10:45.090 INFO:tasks.workunit.client.0.smithi006.stdout:9/401: mkdir d0/d8/d16/d8c 0 2024-03-12T16:10:45.090 INFO:tasks.workunit.client.0.smithi006.stdout:1/455: dread d0/d25/f32 [0,4194304] 0 2024-03-12T16:10:45.095 INFO:tasks.workunit.client.0.smithi006.stdout:2/459: symlink d0/d13/d49/d60/d2b/d62/d79/l93 0 2024-03-12T16:10:45.100 INFO:tasks.workunit.client.0.smithi006.stdout:3/427: creat d8/d19/d26/d59/d2c/f9a x:0 0 0 2024-03-12T16:10:45.102 INFO:tasks.workunit.client.0.smithi006.stdout:2/460: creat d0/d13/d49/d60/d2b/f94 x:0 0 0 2024-03-12T16:10:45.102 INFO:tasks.workunit.client.1.smithi134.stdout:2/579: sync 2024-03-12T16:10:45.104 INFO:tasks.workunit.client.0.smithi006.stdout:9/402: unlink d0/d1f/c35 0 2024-03-12T16:10:45.105 INFO:tasks.workunit.client.1.smithi134.stdout:2/580: creat d4/d12/d3b/d9b/fcd x:0 0 0 2024-03-12T16:10:45.106 INFO:tasks.workunit.client.1.smithi134.stdout:6/679: fsync d1/da6/d55/d85/fb0 0 2024-03-12T16:10:45.107 INFO:tasks.workunit.client.0.smithi006.stdout:4/555: rename d1/db/d1d/f9c to d1/db/d17/fb3 0 2024-03-12T16:10:45.107 INFO:tasks.workunit.client.1.smithi134.stdout:6/680: dread - d1/d3/d19/d32/f102 zero size 2024-03-12T16:10:45.108 INFO:tasks.workunit.client.0.smithi006.stdout:4/556: dread - d1/db/d39/d42/fa1 zero size 2024-03-12T16:10:45.108 INFO:tasks.workunit.client.0.smithi006.stdout:1/456: link d0/d25/d2a/d43/d63/f78 d0/d25/d2a/d43/f96 0 2024-03-12T16:10:45.109 INFO:tasks.workunit.client.1.smithi134.stdout:2/581: creat d4/d12/d1d/d34/d47/d8c/da4/fce x:0 0 0 2024-03-12T16:10:45.109 INFO:tasks.workunit.client.1.smithi134.stdout:6/681: read d1/d16/d4c/d65/f5c [1606563,37651] 0 2024-03-12T16:10:45.109 INFO:tasks.workunit.client.0.smithi006.stdout:3/428: fsync d8/d19/d26/d59/f1f 0 2024-03-12T16:10:45.110 INFO:tasks.workunit.client.0.smithi006.stdout:1/457: write d0/f13 [3145667,59055] 0 2024-03-12T16:10:45.111 INFO:tasks.workunit.client.1.smithi134.stdout:6/682: mknod d1/d3/dcb/c107 0 2024-03-12T16:10:45.112 INFO:tasks.workunit.client.0.smithi006.stdout:2/461: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/d95 0 2024-03-12T16:10:45.112 INFO:tasks.workunit.client.1.smithi134.stdout:2/582: creat d4/d12/d1d/d34/d58/fcf x:0 0 0 2024-03-12T16:10:45.114 INFO:tasks.workunit.client.1.smithi134.stdout:2/583: write d4/d84/d63/d9d/fa1 [878715,96632] 0 2024-03-12T16:10:45.114 INFO:tasks.workunit.client.0.smithi006.stdout:9/403: symlink d0/d4/d70/d71/l8d 0 2024-03-12T16:10:45.116 INFO:tasks.workunit.client.1.smithi134.stdout:6/683: truncate d1/d4/fac 485154 0 2024-03-12T16:10:45.117 INFO:tasks.workunit.client.0.smithi006.stdout:3/429: unlink d8/d19/d26/d59/d2c/dc/d28/f73 0 2024-03-12T16:10:45.117 INFO:tasks.workunit.client.1.smithi134.stdout:6/684: readlink d1/d16/d4c/d65/d61/le1 0 2024-03-12T16:10:45.118 INFO:tasks.workunit.client.1.smithi134.stdout:6/685: stat d1/d16/d4c/d65/f6b 0 2024-03-12T16:10:45.119 INFO:tasks.workunit.client.0.smithi006.stdout:2/462: fdatasync d0/dc/fd 0 2024-03-12T16:10:45.119 INFO:tasks.workunit.client.1.smithi134.stdout:2/584: dread d4/d12/d3b/d3f/f45 [0,4194304] 0 2024-03-12T16:10:45.121 INFO:tasks.workunit.client.1.smithi134.stdout:2/585: fdatasync d4/d12/d1d/d34/fa0 0 2024-03-12T16:10:45.123 INFO:tasks.workunit.client.1.smithi134.stdout:6/686: truncate d1/d3/d19/d32/f43 984270 0 2024-03-12T16:10:45.123 INFO:tasks.workunit.client.0.smithi006.stdout:4/557: dwrite d1/f31 [0,4194304] 0 2024-03-12T16:10:45.123 INFO:tasks.workunit.client.1.smithi134.stdout:2/586: rmdir d4/d84/d63/d9d/d3d 39 2024-03-12T16:10:45.124 INFO:tasks.workunit.client.0.smithi006.stdout:9/404: creat d0/d4/d70/f8e x:0 0 0 2024-03-12T16:10:45.125 INFO:tasks.workunit.client.1.smithi134.stdout:6/687: creat d1/d16/d4c/d58/f108 x:0 0 0 2024-03-12T16:10:45.127 INFO:tasks.workunit.client.1.smithi134.stdout:2/587: dread d4/d12/d43/da2/f69 [0,4194304] 0 2024-03-12T16:10:45.128 INFO:tasks.workunit.client.0.smithi006.stdout:1/458: dwrite d0/d25/d2a/f3b [0,4194304] 0 2024-03-12T16:10:45.130 INFO:tasks.workunit.client.1.smithi134.stdout:6/688: dread d1/d3/d10/f2a [4194304,4194304] 0 2024-03-12T16:10:45.134 INFO:tasks.workunit.client.0.smithi006.stdout:5/338: dread d7/d8/f2b [0,4194304] 0 2024-03-12T16:10:45.135 INFO:tasks.workunit.client.0.smithi006.stdout:9/405: read d0/d4/f25 [2373026,68159] 0 2024-03-12T16:10:45.135 INFO:tasks.workunit.client.1.smithi134.stdout:2/588: getdents d4/d84/d63/d9d 0 2024-03-12T16:10:45.135 INFO:tasks.workunit.client.1.smithi134.stdout:6/689: chown d1/da6/d55/d85 693 1 2024-03-12T16:10:45.135 INFO:tasks.workunit.client.1.smithi134.stdout:6/690: symlink d1/l109 0 2024-03-12T16:10:45.136 INFO:tasks.workunit.client.0.smithi006.stdout:2/463: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f96 x:0 0 0 2024-03-12T16:10:45.139 INFO:tasks.workunit.client.0.smithi006.stdout:5/339: fdatasync d7/d9/d10/d35/f3c 0 2024-03-12T16:10:45.140 INFO:tasks.workunit.client.0.smithi006.stdout:9/406: write d0/d8/f52 [2118811,117948] 0 2024-03-12T16:10:45.142 INFO:tasks.workunit.client.0.smithi006.stdout:9/407: write d0/d1f/f6d [714062,56111] 0 2024-03-12T16:10:45.144 INFO:tasks.workunit.client.0.smithi006.stdout:9/408: dread - d0/d4/d18/d4d/f7c zero size 2024-03-12T16:10:45.148 INFO:tasks.workunit.client.0.smithi006.stdout:5/340: rmdir d7/d9/d47 39 2024-03-12T16:10:45.148 INFO:tasks.workunit.client.1.smithi134.stdout:2/589: write d4/d84/d63/d9d/dba/fc2 [1105100,7738] 0 2024-03-12T16:10:45.150 INFO:tasks.workunit.client.1.smithi134.stdout:6/691: truncate d1/d4/fac 1457936 0 2024-03-12T16:10:45.150 INFO:tasks.workunit.client.0.smithi006.stdout:9/409: dread d0/d1f/f6d [0,4194304] 0 2024-03-12T16:10:45.152 INFO:tasks.workunit.client.1.smithi134.stdout:6/692: getdents d1/d4/df2 0 2024-03-12T16:10:45.154 INFO:tasks.workunit.client.0.smithi006.stdout:2/464: truncate d0/dc/fd 4762253 0 2024-03-12T16:10:45.155 INFO:tasks.workunit.client.0.smithi006.stdout:4/558: dread d1/d38/d79/f55 [0,4194304] 0 2024-03-12T16:10:45.156 INFO:tasks.workunit.client.0.smithi006.stdout:4/559: chown d1/db/d17 585 1 2024-03-12T16:10:45.157 INFO:tasks.workunit.client.1.smithi134.stdout:2/590: dwrite d4/d84/d63/d9d/dba/fc2 [0,4194304] 0 2024-03-12T16:10:45.158 INFO:tasks.workunit.client.0.smithi006.stdout:9/410: mkdir d0/d8f 0 2024-03-12T16:10:45.158 INFO:tasks.workunit.client.1.smithi134.stdout:2/591: dread - d4/d12/d1d/d34/d58/d74/fb0 zero size 2024-03-12T16:10:45.162 INFO:tasks.workunit.client.1.smithi134.stdout:2/592: mknod d4/d84/cd0 0 2024-03-12T16:10:45.164 INFO:tasks.workunit.client.1.smithi134.stdout:6/693: dwrite d1/d3/d10/f9e [0,4194304] 0 2024-03-12T16:10:45.166 INFO:tasks.workunit.client.1.smithi134.stdout:2/593: mknod d4/d12/d1d/d34/db7/cd1 0 2024-03-12T16:10:45.168 INFO:tasks.workunit.client.1.smithi134.stdout:2/594: creat d4/d12/d39/fd2 x:0 0 0 2024-03-12T16:10:45.170 INFO:tasks.workunit.client.1.smithi134.stdout:2/595: fsync d4/d84/f35 0 2024-03-12T16:10:45.194 INFO:tasks.workunit.client.0.smithi006.stdout:6/431: sync 2024-03-12T16:10:45.194 INFO:tasks.workunit.client.0.smithi006.stdout:8/345: sync 2024-03-12T16:10:45.200 INFO:tasks.workunit.client.1.smithi134.stdout:2/596: dread d4/f24 [0,4194304] 0 2024-03-12T16:10:45.201 INFO:tasks.workunit.client.1.smithi134.stdout:2/597: write d4/d12/f48 [2298341,15601] 0 2024-03-12T16:10:45.215 INFO:tasks.workunit.client.1.smithi134.stdout:2/598: write d4/f13 [1087407,105242] 0 2024-03-12T16:10:45.218 INFO:tasks.workunit.client.1.smithi134.stdout:2/599: getdents d4/d12/d1d/d8d 0 2024-03-12T16:10:45.220 INFO:tasks.workunit.client.1.smithi134.stdout:2/600: link d4/d84/c33 d4/d12/d3b/d3f/cd3 0 2024-03-12T16:10:45.222 INFO:tasks.workunit.client.1.smithi134.stdout:2/601: truncate d4/d12/d1d/d34/d47/d8c/da4/fc0 545904 0 2024-03-12T16:10:45.222 INFO:tasks.workunit.client.1.smithi134.stdout:2/602: chown d4/d12/d1d/d34/d47/d8c/da4/lc5 3425 1 2024-03-12T16:10:45.237 INFO:tasks.workunit.client.0.smithi006.stdout:2/465: mkdir d0/dc/d97 0 2024-03-12T16:10:45.238 INFO:tasks.workunit.client.0.smithi006.stdout:1/459: truncate d0/d25/d2a/d35/f5c 2827704 0 2024-03-12T16:10:45.239 INFO:tasks.workunit.client.0.smithi006.stdout:5/341: truncate d7/d9/d10/d24/f3e 1348680 0 2024-03-12T16:10:45.241 INFO:tasks.workunit.client.0.smithi006.stdout:8/346: write d2/db/d1a/d1f/f3c [462769,7308] 0 2024-03-12T16:10:45.242 INFO:tasks.workunit.client.0.smithi006.stdout:1/460: symlink d0/d25/d2a/l97 0 2024-03-12T16:10:45.243 INFO:tasks.workunit.client.0.smithi006.stdout:9/411: truncate d0/d4/d18/f44 523325 0 2024-03-12T16:10:45.246 INFO:tasks.workunit.client.0.smithi006.stdout:1/461: write d0/f30 [2794782,107574] 0 2024-03-12T16:10:45.247 INFO:tasks.workunit.client.0.smithi006.stdout:5/342: fdatasync d7/d9/d31/d3b/f3f 0 2024-03-12T16:10:45.248 INFO:tasks.workunit.client.0.smithi006.stdout:2/466: symlink d0/d13/d49/d60/d2b/d62/d66/d67/l98 0 2024-03-12T16:10:45.249 INFO:tasks.workunit.client.0.smithi006.stdout:9/412: dread - d0/d8/d16/d7d/f88 zero size 2024-03-12T16:10:45.252 INFO:tasks.workunit.client.0.smithi006.stdout:4/560: dwrite d1/db/d1d/d2f/d6b/fa4 [0,4194304] 0 2024-03-12T16:10:45.254 INFO:tasks.workunit.client.0.smithi006.stdout:8/347: truncate d2/d11/d5a/f5f 378017 0 2024-03-12T16:10:45.255 INFO:tasks.workunit.client.1.smithi134.stdout:0/645: sync 2024-03-12T16:10:45.255 INFO:tasks.workunit.client.1.smithi134.stdout:3/780: sync 2024-03-12T16:10:45.255 INFO:tasks.workunit.client.1.smithi134.stdout:8/661: sync 2024-03-12T16:10:45.255 INFO:tasks.workunit.client.0.smithi006.stdout:5/343: mknod d7/d9/d2c/c72 0 2024-03-12T16:10:45.258 INFO:tasks.workunit.client.0.smithi006.stdout:2/467: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/f99 x:0 0 0 2024-03-12T16:10:45.260 INFO:tasks.workunit.client.0.smithi006.stdout:9/413: mkdir d0/d83/d90 0 2024-03-12T16:10:45.262 INFO:tasks.workunit.client.0.smithi006.stdout:2/468: write d0/d13/d49/d60/f53 [1657637,105035] 0 2024-03-12T16:10:45.264 INFO:tasks.workunit.client.0.smithi006.stdout:8/348: rename d2/db/d1a/d21/d2b/l37 to d2/db/d1a/d21/d2b/l6d 0 2024-03-12T16:10:45.265 INFO:tasks.workunit.client.0.smithi006.stdout:6/432: dread d3/d11/d10/d1b/f3f [0,4194304] 0 2024-03-12T16:10:45.266 INFO:tasks.workunit.client.1.smithi134.stdout:2/603: dwrite d4/d12/f48 [0,4194304] 0 2024-03-12T16:10:45.268 INFO:tasks.workunit.client.1.smithi134.stdout:0/646: mkdir db/d2f/d61/d7a/dce 0 2024-03-12T16:10:45.268 INFO:tasks.workunit.client.1.smithi134.stdout:8/662: chown d3/d1b/d17/d25/d33/f84 3 1 2024-03-12T16:10:45.268 INFO:tasks.workunit.client.1.smithi134.stdout:3/781: read d1/db/d10/d2d/d2e/d72/f8e [419417,75177] 0 2024-03-12T16:10:45.269 INFO:tasks.workunit.client.0.smithi006.stdout:9/414: dwrite d0/d8/d16/f43 [0,4194304] 0 2024-03-12T16:10:45.270 INFO:tasks.workunit.client.0.smithi006.stdout:5/344: mknod d7/d9/d31/d3b/d61/c73 0 2024-03-12T16:10:45.271 INFO:tasks.workunit.client.1.smithi134.stdout:2/604: symlink d4/d12/d3b/d9b/ld4 0 2024-03-12T16:10:45.271 INFO:tasks.workunit.client.1.smithi134.stdout:3/782: dread - d1/db/d10/d2d/f113 zero size 2024-03-12T16:10:45.272 INFO:tasks.workunit.client.0.smithi006.stdout:1/462: chown d0/d25/d2a/d64/f6d 136 1 2024-03-12T16:10:45.272 INFO:tasks.workunit.client.1.smithi134.stdout:0/647: mkdir db/d2f/d31/d76/d9f/dcf 0 2024-03-12T16:10:45.273 INFO:tasks.workunit.client.0.smithi006.stdout:8/349: mkdir d2/d11/d6e 0 2024-03-12T16:10:45.273 INFO:tasks.workunit.client.1.smithi134.stdout:3/783: fsync d1/db/d10/dca/fdf 0 2024-03-12T16:10:45.277 INFO:tasks.workunit.client.1.smithi134.stdout:8/663: rename d3/d1b/d17/d25/d33/d15/d95/d6d/l7a to d3/d1b/d17/d6c/le2 0 2024-03-12T16:10:45.277 INFO:tasks.workunit.client.1.smithi134.stdout:0/648: symlink db/dcc/ld0 0 2024-03-12T16:10:45.278 INFO:tasks.workunit.client.0.smithi006.stdout:6/433: fdatasync f1 0 2024-03-12T16:10:45.279 INFO:tasks.workunit.client.1.smithi134.stdout:2/605: link d4/f90 d4/d12/d1d/d34/d58/fd5 0 2024-03-12T16:10:45.279 INFO:tasks.workunit.client.0.smithi006.stdout:1/463: stat d0/d25/d2a/d43/d63/l8e 0 2024-03-12T16:10:45.281 INFO:tasks.workunit.client.1.smithi134.stdout:2/606: write d4/d12/d3b/d9b/fcd [671697,95197] 0 2024-03-12T16:10:45.282 INFO:tasks.workunit.client.1.smithi134.stdout:3/784: rename d1/d63/c94 to d1/db/d12/d9d/d9f/c119 0 2024-03-12T16:10:45.282 INFO:tasks.workunit.client.0.smithi006.stdout:5/345: rename d7/d9/d10/d35/f53 to d7/d9/d31/d3b/d4f/d65/f74 0 2024-03-12T16:10:45.282 INFO:tasks.workunit.client.1.smithi134.stdout:0/649: mkdir db/d2f/d31/d56/dd1 0 2024-03-12T16:10:45.285 INFO:tasks.workunit.client.1.smithi134.stdout:2/607: rename d4/d12/d1d/d34/d58/cb3 to d4/d12/d3b/cd6 0 2024-03-12T16:10:45.286 INFO:tasks.workunit.client.0.smithi006.stdout:6/434: mkdir d3/d11/d10/d1b/d6e/d80/d9b 0 2024-03-12T16:10:45.287 INFO:tasks.workunit.client.0.smithi006.stdout:1/464: symlink d0/d25/d2a/d43/d63/l98 0 2024-03-12T16:10:45.289 INFO:tasks.workunit.client.1.smithi134.stdout:2/608: read d4/d84/d63/d9d/dba/fc2 [79969,34633] 0 2024-03-12T16:10:45.289 INFO:tasks.workunit.client.0.smithi006.stdout:8/350: link d2/db/d1a/c59 d2/d11/d3f/c6f 0 2024-03-12T16:10:45.289 INFO:tasks.workunit.client.0.smithi006.stdout:1/465: stat d0/fc 0 2024-03-12T16:10:45.291 INFO:tasks.workunit.client.1.smithi134.stdout:0/650: dwrite db/d2f/d31/d56/d9a/f9d [8388608,4194304] 0 2024-03-12T16:10:45.292 INFO:tasks.workunit.client.0.smithi006.stdout:8/351: mkdir d2/db/d70 0 2024-03-12T16:10:45.294 INFO:tasks.workunit.client.0.smithi006.stdout:1/466: mknod d0/d25/d2a/d64/c99 0 2024-03-12T16:10:45.294 INFO:tasks.workunit.client.1.smithi134.stdout:0/651: read db/f3c [2005320,82914] 0 2024-03-12T16:10:45.295 INFO:tasks.workunit.client.0.smithi006.stdout:8/352: write d2/db/f62 [4095558,114739] 0 2024-03-12T16:10:45.296 INFO:tasks.workunit.client.0.smithi006.stdout:1/467: readlink d0/l29 0 2024-03-12T16:10:45.298 INFO:tasks.workunit.client.0.smithi006.stdout:6/435: dwrite d3/f14 [0,4194304] 0 2024-03-12T16:10:45.299 INFO:tasks.workunit.client.1.smithi134.stdout:2/609: getdents d4/d12/d1d/d34/db7/dc4 0 2024-03-12T16:10:45.299 INFO:tasks.workunit.client.1.smithi134.stdout:0/652: read db/f26 [1800601,114334] 0 2024-03-12T16:10:45.302 INFO:tasks.workunit.client.1.smithi134.stdout:2/610: symlink d4/d84/d7d/ld7 0 2024-03-12T16:10:45.305 INFO:tasks.workunit.client.1.smithi134.stdout:0/653: creat db/d2f/d51/daf/fd2 x:0 0 0 2024-03-12T16:10:45.307 INFO:tasks.workunit.client.1.smithi134.stdout:2/611: fsync d4/d12/f85 0 2024-03-12T16:10:45.307 INFO:tasks.workunit.client.0.smithi006.stdout:2/469: dread d0/f5d [0,4194304] 0 2024-03-12T16:10:45.308 INFO:tasks.workunit.client.0.smithi006.stdout:1/468: dwrite d0/fe [0,4194304] 0 2024-03-12T16:10:45.311 INFO:tasks.workunit.client.1.smithi134.stdout:0/654: mkdir db/d2f/d31/d68/da2/dd3 0 2024-03-12T16:10:45.311 INFO:tasks.workunit.client.1.smithi134.stdout:8/664: write d3/d1b/f2a [1476781,78547] 0 2024-03-12T16:10:45.312 INFO:tasks.workunit.client.0.smithi006.stdout:2/470: truncate d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f96 235130 0 2024-03-12T16:10:45.313 INFO:tasks.workunit.client.1.smithi134.stdout:0/655: chown db/d2f/d61/d7a/fc1 3 1 2024-03-12T16:10:45.314 INFO:tasks.workunit.client.0.smithi006.stdout:8/353: creat d2/d55/f71 x:0 0 0 2024-03-12T16:10:45.314 INFO:tasks.workunit.client.1.smithi134.stdout:2/612: symlink d4/d12/d39/ld8 0 2024-03-12T16:10:45.315 INFO:tasks.workunit.client.1.smithi134.stdout:3/785: write d1/db/d14/d5a/fa1 [33830,53931] 0 2024-03-12T16:10:45.316 INFO:tasks.workunit.client.0.smithi006.stdout:6/436: mknod d3/d11/d10/d1b/d6e/d96/c9c 0 2024-03-12T16:10:45.316 INFO:tasks.workunit.client.1.smithi134.stdout:8/665: creat d3/db0/fe3 x:0 0 0 2024-03-12T16:10:45.318 INFO:tasks.workunit.client.1.smithi134.stdout:0/656: mkdir db/d2f/d31/d75/d88/dd4 0 2024-03-12T16:10:45.318 INFO:tasks.workunit.client.1.smithi134.stdout:2/613: truncate d4/d12/d1d/f97 1181862 0 2024-03-12T16:10:45.318 INFO:tasks.workunit.client.0.smithi006.stdout:6/437: read d3/d11/d10/d1b/d6e/f2e [100208,3195] 0 2024-03-12T16:10:45.320 INFO:tasks.workunit.client.1.smithi134.stdout:2/614: write d4/d12/d1d/d34/f6c [2907662,10272] 0 2024-03-12T16:10:45.321 INFO:tasks.workunit.client.1.smithi134.stdout:0/657: dread - db/d2f/d51/fb6 zero size 2024-03-12T16:10:45.322 INFO:tasks.workunit.client.0.smithi006.stdout:6/438: write d3/d11/d10/d28/f56 [484865,96902] 0 2024-03-12T16:10:45.322 INFO:tasks.workunit.client.1.smithi134.stdout:2/615: chown d4/d84/d7d/d87/lca 0 1 2024-03-12T16:10:45.323 INFO:tasks.workunit.client.0.smithi006.stdout:1/469: rename d0/l65 to d0/d25/d67/d8d/l9a 0 2024-03-12T16:10:45.325 INFO:tasks.workunit.client.0.smithi006.stdout:1/470: fdatasync d0/d25/d2a/d43/f44 0 2024-03-12T16:10:45.326 INFO:tasks.workunit.client.1.smithi134.stdout:8/666: rename d3/d10/d31/c68 to d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/ce4 0 2024-03-12T16:10:45.326 INFO:tasks.workunit.client.1.smithi134.stdout:2/616: dread - d4/d12/d1d/f8a zero size 2024-03-12T16:10:45.327 INFO:tasks.workunit.client.1.smithi134.stdout:2/617: readlink d4/l6 0 2024-03-12T16:10:45.327 INFO:tasks.workunit.client.0.smithi006.stdout:2/471: truncate d0/d13/d49/d60/d2b/f56 2373141 0 2024-03-12T16:10:45.328 INFO:tasks.workunit.client.1.smithi134.stdout:0/658: mknod db/d2f/d51/db4/cd5 0 2024-03-12T16:10:45.328 INFO:tasks.workunit.client.1.smithi134.stdout:2/618: write d4/d12/d3b/d3f/f5d [1555083,56546] 0 2024-03-12T16:10:45.329 INFO:tasks.workunit.client.0.smithi006.stdout:5/346: dread d7/d9/d10/d24/f38 [0,4194304] 0 2024-03-12T16:10:45.329 INFO:tasks.workunit.client.0.smithi006.stdout:2/472: dread d0/f50 [0,4194304] 0 2024-03-12T16:10:45.329 INFO:tasks.workunit.client.0.smithi006.stdout:5/347: chown d7/d9 190 1 2024-03-12T16:10:45.330 INFO:tasks.workunit.client.0.smithi006.stdout:6/439: mknod d3/d11/d10/d1b/c9d 0 2024-03-12T16:10:45.330 INFO:tasks.workunit.client.1.smithi134.stdout:8/667: write d3/d1b/d17/d45/fcc [371589,53091] 0 2024-03-12T16:10:45.331 INFO:tasks.workunit.client.1.smithi134.stdout:8/668: chown d3/d1b/d17/d6c 557491717 1 2024-03-12T16:10:45.331 INFO:tasks.workunit.client.1.smithi134.stdout:0/659: symlink db/d2f/d51/daf/ld6 0 2024-03-12T16:10:45.333 INFO:tasks.workunit.client.0.smithi006.stdout:2/473: truncate d0/d13/d49/d60/d2b/f90 677667 0 2024-03-12T16:10:45.334 INFO:tasks.workunit.client.0.smithi006.stdout:1/471: symlink d0/d25/d67/d8d/l9b 0 2024-03-12T16:10:45.339 INFO:tasks.workunit.client.0.smithi006.stdout:8/354: link d2/db/f18 d2/db/f72 0 2024-03-12T16:10:45.339 INFO:tasks.workunit.client.0.smithi006.stdout:6/440: mkdir d3/d11/d10/d1b/d20/d5a/d9e 0 2024-03-12T16:10:45.340 INFO:tasks.workunit.client.0.smithi006.stdout:6/441: stat d3/d11/f25 0 2024-03-12T16:10:45.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/669: mkdir d3/d10/de5 0 2024-03-12T16:10:45.340 INFO:tasks.workunit.client.1.smithi134.stdout:0/660: creat db/d2f/d31/d68/da2/db2/fd7 x:0 0 0 2024-03-12T16:10:45.340 INFO:tasks.workunit.client.1.smithi134.stdout:8/670: symlink d3/d1b/d17/d25/d33/d15/d95/d5b/le6 0 2024-03-12T16:10:45.340 INFO:tasks.workunit.client.1.smithi134.stdout:0/661: stat db/d2f/d31/f85 0 2024-03-12T16:10:45.340 INFO:tasks.workunit.client.1.smithi134.stdout:2/619: link d4/d12/d43/f4c d4/d84/d7d/fd9 0 2024-03-12T16:10:45.341 INFO:tasks.workunit.client.0.smithi006.stdout:2/474: mknod d0/d13/d49/d60/d2b/d62/d66/d69/d81/c9a 0 2024-03-12T16:10:45.341 INFO:tasks.workunit.client.0.smithi006.stdout:1/472: symlink d0/d25/d2a/d43/l9c 0 2024-03-12T16:10:45.341 INFO:tasks.workunit.client.0.smithi006.stdout:2/475: dread - d0/d13/d49/d60/d2b/d62/f86 zero size 2024-03-12T16:10:45.342 INFO:tasks.workunit.client.1.smithi134.stdout:0/662: getdents db/d2f/d31/d75/d88/dd4 0 2024-03-12T16:10:45.343 INFO:tasks.workunit.client.1.smithi134.stdout:3/786: dwrite d1/db/d10/d2d/d2e/d72/d97/fa5 [0,4194304] 0 2024-03-12T16:10:45.343 INFO:tasks.workunit.client.1.smithi134.stdout:2/620: truncate d4/d12/f4a 744902 0 2024-03-12T16:10:45.345 INFO:tasks.workunit.client.1.smithi134.stdout:0/663: write db/f50 [807705,64483] 0 2024-03-12T16:10:45.345 INFO:tasks.workunit.client.1.smithi134.stdout:2/621: fdatasync d4/d12/d1d/f21 0 2024-03-12T16:10:45.345 INFO:tasks.workunit.client.1.smithi134.stdout:3/787: chown d1/db/d14/d5a/d89/dea 0 1 2024-03-12T16:10:45.346 INFO:tasks.workunit.client.1.smithi134.stdout:8/671: link d3/d1b/d17/d24/db6/dd9/fcd d3/d82/fe7 0 2024-03-12T16:10:45.346 INFO:tasks.workunit.client.1.smithi134.stdout:3/788: fsync d1/db/d12/d9d/fb3 0 2024-03-12T16:10:45.347 INFO:tasks.workunit.client.0.smithi006.stdout:6/442: rename d3/d11/d10/d19/f6a to d3/d11/d43/f9f 0 2024-03-12T16:10:45.347 INFO:tasks.workunit.client.0.smithi006.stdout:5/348: symlink d7/d9/d47/d56/l75 0 2024-03-12T16:10:45.348 INFO:tasks.workunit.client.1.smithi134.stdout:2/622: creat d4/d12/d43/fda x:0 0 0 2024-03-12T16:10:45.349 INFO:tasks.workunit.client.1.smithi134.stdout:2/623: chown d4/d12/d39/ld8 245 1 2024-03-12T16:10:45.349 INFO:tasks.workunit.client.1.smithi134.stdout:3/789: fdatasync d1/d63/f9c 0 2024-03-12T16:10:45.350 INFO:tasks.workunit.client.0.smithi006.stdout:1/473: mknod d0/d25/d2a/d43/d56/c9d 0 2024-03-12T16:10:45.351 INFO:tasks.workunit.client.1.smithi134.stdout:2/624: truncate d4/d84/f7f 186204 0 2024-03-12T16:10:45.351 INFO:tasks.workunit.client.0.smithi006.stdout:8/355: dread d2/f15 [0,4194304] 0 2024-03-12T16:10:45.352 INFO:tasks.workunit.client.1.smithi134.stdout:8/672: mknod d3/d1b/d17/d25/ce8 0 2024-03-12T16:10:45.352 INFO:tasks.workunit.client.0.smithi006.stdout:5/349: rmdir d7/d9/d31/d3b/d4f 39 2024-03-12T16:10:45.353 INFO:tasks.workunit.client.0.smithi006.stdout:8/356: readlink d2/db/d1a/l35 0 2024-03-12T16:10:45.356 INFO:tasks.workunit.client.1.smithi134.stdout:3/790: rename d1/db/d10/f28 to d1/db/d12/d9d/dc5/dec/f11a 0 2024-03-12T16:10:45.356 INFO:tasks.workunit.client.0.smithi006.stdout:1/474: unlink d0/d25/d2a/d43/d56/c9d 0 2024-03-12T16:10:45.358 INFO:tasks.workunit.client.0.smithi006.stdout:5/350: fdatasync d7/d41/f5a 0 2024-03-12T16:10:45.358 INFO:tasks.workunit.client.1.smithi134.stdout:2/625: creat d4/d12/d1d/d34/d47/d8c/da4/fdb x:0 0 0 2024-03-12T16:10:45.359 INFO:tasks.workunit.client.1.smithi134.stdout:8/673: creat d3/d1b/d17/d25/d33/d15/fe9 x:0 0 0 2024-03-12T16:10:45.361 INFO:tasks.workunit.client.1.smithi134.stdout:8/674: fdatasync d3/d1b/d17/d25/d33/d15/d95/d5b/f8e 0 2024-03-12T16:10:45.361 INFO:tasks.workunit.client.1.smithi134.stdout:3/791: rename d1/d63/l102 to d1/db/d12/d9d/d9f/l11b 0 2024-03-12T16:10:45.362 INFO:tasks.workunit.client.1.smithi134.stdout:8/675: write d3/d82/f98 [787167,93794] 0 2024-03-12T16:10:45.363 INFO:tasks.workunit.client.0.smithi006.stdout:6/443: rename d3/d11/d10/d28/d45/d60/d7e/f8c to d3/d11/d10/d1b/d20/d5a/d9e/fa0 0 2024-03-12T16:10:45.363 INFO:tasks.workunit.client.0.smithi006.stdout:8/357: dwrite d2/db/d1a/d21/d2b/f40 [0,4194304] 0 2024-03-12T16:10:45.365 INFO:tasks.workunit.client.0.smithi006.stdout:8/358: read d2/f15 [2509756,102440] 0 2024-03-12T16:10:45.365 INFO:tasks.workunit.client.1.smithi134.stdout:2/626: rename d4/d84/f7f to d4/d12/d3b/fdc 0 2024-03-12T16:10:45.367 INFO:tasks.workunit.client.0.smithi006.stdout:8/359: chown d2/db/d1a/d21/d4f 932615184 1 2024-03-12T16:10:45.367 INFO:tasks.workunit.client.0.smithi006.stdout:1/475: truncate d0/d25/d2a/d35/d3f/f91 360499 0 2024-03-12T16:10:45.368 INFO:tasks.workunit.client.0.smithi006.stdout:5/351: write d7/d9/d10/f32 [5103481,77197] 0 2024-03-12T16:10:45.368 INFO:tasks.workunit.client.0.smithi006.stdout:8/360: dread - d2/d11/f42 zero size 2024-03-12T16:10:45.368 INFO:tasks.workunit.client.1.smithi134.stdout:2/627: write d4/d12/f20 [924969,25754] 0 2024-03-12T16:10:45.369 INFO:tasks.workunit.client.0.smithi006.stdout:8/361: chown d2/d32/c3b 4 1 2024-03-12T16:10:45.371 INFO:tasks.workunit.client.0.smithi006.stdout:5/352: truncate d7/d9/d2c/f3a 992021 0 2024-03-12T16:10:45.371 INFO:tasks.workunit.client.1.smithi134.stdout:2/628: readlink d4/d12/d1d/l6e 0 2024-03-12T16:10:45.372 INFO:tasks.workunit.client.0.smithi006.stdout:5/353: fdatasync d7/d41/f55 0 2024-03-12T16:10:45.373 INFO:tasks.workunit.client.1.smithi134.stdout:8/676: dwrite d3/d1b/d17/d25/d33/d15/d95/d5b/da7/fb5 [0,4194304] 0 2024-03-12T16:10:45.374 INFO:tasks.workunit.client.1.smithi134.stdout:3/792: truncate d1/db/d10/d2a/f51 944034 0 2024-03-12T16:10:45.375 INFO:tasks.workunit.client.0.smithi006.stdout:2/476: link d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/c7e d0/dc/d64/c9b 0 2024-03-12T16:10:45.376 INFO:tasks.workunit.client.0.smithi006.stdout:2/477: dread - d0/d13/f27 zero size 2024-03-12T16:10:45.376 INFO:tasks.workunit.client.0.smithi006.stdout:6/444: creat d3/d11/fa1 x:0 0 0 2024-03-12T16:10:45.377 INFO:tasks.workunit.client.1.smithi134.stdout:8/677: write d3/d1b/d17/d25/d33/d15/d95/d5b/f8e [3711477,126309] 0 2024-03-12T16:10:45.377 INFO:tasks.workunit.client.0.smithi006.stdout:5/354: dread d7/d9/d10/d24/f2d [0,4194304] 0 2024-03-12T16:10:45.378 INFO:tasks.workunit.client.0.smithi006.stdout:1/476: creat d0/d25/f9e x:0 0 0 2024-03-12T16:10:45.378 INFO:tasks.workunit.client.0.smithi006.stdout:5/355: dread - d7/d9/f6a zero size 2024-03-12T16:10:45.379 INFO:tasks.workunit.client.1.smithi134.stdout:2/629: rename d4/d84/d63/d9d/c1e to d4/d12/d3b/cdd 0 2024-03-12T16:10:45.382 INFO:tasks.workunit.client.1.smithi134.stdout:8/678: mknod d3/d1b/d17/d24/db6/dd9/cea 0 2024-03-12T16:10:45.383 INFO:tasks.workunit.client.1.smithi134.stdout:2/630: mkdir d4/d84/d63/dde 0 2024-03-12T16:10:45.384 INFO:tasks.workunit.client.1.smithi134.stdout:2/631: dread - d4/d84/f55 zero size 2024-03-12T16:10:45.385 INFO:tasks.workunit.client.1.smithi134.stdout:3/793: symlink d1/db/d10/l11c 0 2024-03-12T16:10:45.387 INFO:tasks.workunit.client.0.smithi006.stdout:7/553: sync 2024-03-12T16:10:45.390 INFO:tasks.workunit.client.1.smithi134.stdout:8/679: link d3/d1b/d17/d25/d33/d15/l60 d3/d1b/d17/d25/d33/d96/leb 0 2024-03-12T16:10:45.394 INFO:tasks.workunit.client.0.smithi006.stdout:8/362: creat d2/db/d1a/f73 x:0 0 0 2024-03-12T16:10:45.395 INFO:tasks.workunit.client.0.smithi006.stdout:8/363: chown d2/db/d1a/d1f/f3c 25197029 1 2024-03-12T16:10:45.396 INFO:tasks.workunit.client.0.smithi006.stdout:2/478: unlink d0/d13/d49/d60/d2b/d62/d66/c8c 0 2024-03-12T16:10:45.396 INFO:tasks.workunit.client.0.smithi006.stdout:8/364: fsync d2/db/f2e 0 2024-03-12T16:10:45.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/732: sync 2024-03-12T16:10:45.398 INFO:tasks.workunit.client.0.smithi006.stdout:1/477: creat d0/d25/d67/d8d/f9f x:0 0 0 2024-03-12T16:10:45.398 INFO:tasks.workunit.client.0.smithi006.stdout:7/554: rmdir de/d2c 39 2024-03-12T16:10:45.400 INFO:tasks.workunit.client.0.smithi006.stdout:5/356: creat d7/d9/d10/d24/f76 x:0 0 0 2024-03-12T16:10:45.403 INFO:tasks.workunit.client.0.smithi006.stdout:6/445: rename d3/d11/d3b/d59/c82 to d3/d11/d10/d1b/d6e/d80/ca2 0 2024-03-12T16:10:45.403 INFO:tasks.workunit.client.1.smithi134.stdout:2/632: dwrite d4/d84/f55 [0,4194304] 0 2024-03-12T16:10:45.403 INFO:tasks.workunit.client.1.smithi134.stdout:3/794: dwrite d1/db/d12/fb1 [0,4194304] 0 2024-03-12T16:10:45.404 INFO:tasks.workunit.client.0.smithi006.stdout:5/357: write d7/d9/d31/f46 [5008843,97900] 0 2024-03-12T16:10:45.404 INFO:tasks.workunit.client.1.smithi134.stdout:5/733: creat db/d12/d37/d73/fe3 x:0 0 0 2024-03-12T16:10:45.404 INFO:tasks.workunit.client.0.smithi006.stdout:2/479: dread d0/d13/d49/d60/f14 [4194304,4194304] 0 2024-03-12T16:10:45.409 INFO:tasks.workunit.client.1.smithi134.stdout:2/633: creat d4/d84/fdf x:0 0 0 2024-03-12T16:10:45.410 INFO:tasks.workunit.client.0.smithi006.stdout:7/555: dwrite de/d1c/f26 [0,4194304] 0 2024-03-12T16:10:45.411 INFO:tasks.workunit.client.1.smithi134.stdout:3/795: creat d1/db/d10/d2d/d30/f11d x:0 0 0 2024-03-12T16:10:45.412 INFO:tasks.workunit.client.1.smithi134.stdout:5/734: creat db/fe4 x:0 0 0 2024-03-12T16:10:45.413 INFO:tasks.workunit.client.1.smithi134.stdout:3/796: write d1/f65 [5213809,123207] 0 2024-03-12T16:10:45.415 INFO:tasks.workunit.client.0.smithi006.stdout:8/365: rename d2/db/d1a/f26 to d2/d11/d6e/f74 0 2024-03-12T16:10:45.421 INFO:tasks.workunit.client.1.smithi134.stdout:5/735: rename db/d12/d37/d73/d7f to db/d12/d1d/d59/de5 0 2024-03-12T16:10:45.421 INFO:tasks.workunit.client.1.smithi134.stdout:2/634: link d4/d84/d7d/f3a d4/d12/d1d/d34/d47/d8c/da4/fe0 0 2024-03-12T16:10:45.422 INFO:tasks.workunit.client.0.smithi006.stdout:1/478: unlink d0/d25/d2a/d35/f3a 0 2024-03-12T16:10:45.424 INFO:tasks.workunit.client.0.smithi006.stdout:6/446: symlink d3/d11/d10/d28/d45/d60/la3 0 2024-03-12T16:10:45.424 INFO:tasks.workunit.client.1.smithi134.stdout:3/797: dwrite d1/db/d10/d2a/f118 [0,4194304] 0 2024-03-12T16:10:45.426 INFO:tasks.workunit.client.1.smithi134.stdout:5/736: rmdir db/d12/d1d/d59/d94 39 2024-03-12T16:10:45.426 INFO:tasks.workunit.client.1.smithi134.stdout:3/798: write d1/db/d12/d9d/fe3 [2773719,29001] 0 2024-03-12T16:10:45.429 INFO:tasks.workunit.client.1.smithi134.stdout:3/799: write d1/ff3 [1967571,25876] 0 2024-03-12T16:10:45.430 INFO:tasks.workunit.client.1.smithi134.stdout:5/737: rmdir db/d12/d1d/d3a/d4e 39 2024-03-12T16:10:45.433 INFO:tasks.workunit.client.1.smithi134.stdout:3/800: creat d1/db/d10/d2a/dc6/df1/f11e x:0 0 0 2024-03-12T16:10:45.434 INFO:tasks.workunit.client.0.smithi006.stdout:5/358: mknod d7/d9/d10/c77 0 2024-03-12T16:10:45.435 INFO:tasks.workunit.client.1.smithi134.stdout:5/738: creat db/d12/d1d/d59/d94/fe6 x:0 0 0 2024-03-12T16:10:45.435 INFO:tasks.workunit.client.0.smithi006.stdout:6/447: creat d3/d11/d10/d19/fa4 x:0 0 0 2024-03-12T16:10:45.437 INFO:tasks.workunit.client.1.smithi134.stdout:3/801: symlink d1/d63/dc2/dff/l11f 0 2024-03-12T16:10:45.440 INFO:tasks.workunit.client.0.smithi006.stdout:2/480: dread d0/d13/f44 [0,4194304] 0 2024-03-12T16:10:45.441 INFO:tasks.workunit.client.0.smithi006.stdout:5/359: truncate d7/d9/d10/d24/f3d 779526 0 2024-03-12T16:10:45.442 INFO:tasks.workunit.client.0.smithi006.stdout:2/481: write d0/d13/f35 [4030982,25461] 0 2024-03-12T16:10:45.443 INFO:tasks.workunit.client.0.smithi006.stdout:5/360: rmdir d7/d8 39 2024-03-12T16:10:45.445 INFO:tasks.workunit.client.1.smithi134.stdout:3/802: dwrite d1/d63/d6c/dbf/f10d [0,4194304] 0 2024-03-12T16:10:45.446 INFO:tasks.workunit.client.0.smithi006.stdout:6/448: dwrite d3/d11/d10/d1b/d20/d5a/f81 [0,4194304] 0 2024-03-12T16:10:45.446 INFO:tasks.workunit.client.0.smithi006.stdout:5/361: chown d7/d9/d10/d24/f76 252537198 1 2024-03-12T16:10:45.447 INFO:tasks.workunit.client.1.smithi134.stdout:3/803: readlink d1/db/l112 0 2024-03-12T16:10:45.447 INFO:tasks.workunit.client.0.smithi006.stdout:8/366: rmdir d2/d11 39 2024-03-12T16:10:45.448 INFO:tasks.workunit.client.0.smithi006.stdout:6/449: stat d3/d11/d43/f5b 0 2024-03-12T16:10:45.449 INFO:tasks.workunit.client.0.smithi006.stdout:6/450: chown d3/d11/d10/d28/f53 29166967 1 2024-03-12T16:10:45.454 INFO:tasks.workunit.client.0.smithi006.stdout:6/451: chown d3/d11/d10/d28/d45/d60 630 1 2024-03-12T16:10:45.454 INFO:tasks.workunit.client.1.smithi134.stdout:5/739: dwrite db/d12/d1d/d59/f8b [0,4194304] 0 2024-03-12T16:10:45.455 INFO:tasks.workunit.client.0.smithi006.stdout:1/479: write d0/d25/d2a/d43/f87 [445313,128291] 0 2024-03-12T16:10:45.459 INFO:tasks.workunit.client.0.smithi006.stdout:1/480: chown d0/d25/d2a/d43/d63/f78 102200 1 2024-03-12T16:10:45.461 INFO:tasks.workunit.client.1.smithi134.stdout:3/804: truncate d1/db/d12/fb1 1019713 0 2024-03-12T16:10:45.461 INFO:tasks.workunit.client.0.smithi006.stdout:8/367: creat d2/d11/d6e/f75 x:0 0 0 2024-03-12T16:10:45.461 INFO:tasks.workunit.client.1.smithi134.stdout:5/740: write db/d12/d1d/f69 [1225648,22282] 0 2024-03-12T16:10:45.462 INFO:tasks.workunit.client.0.smithi006.stdout:7/556: dwrite de/d1c/f33 [0,4194304] 0 2024-03-12T16:10:45.465 INFO:tasks.workunit.client.0.smithi006.stdout:1/481: mknod d0/d25/d2a/d43/d56/ca0 0 2024-03-12T16:10:45.467 INFO:tasks.workunit.client.0.smithi006.stdout:7/557: write de/d27/f2d [3976426,14383] 0 2024-03-12T16:10:45.467 INFO:tasks.workunit.client.0.smithi006.stdout:1/482: chown d0/d25/d2a/d64/f7a 20289 1 2024-03-12T16:10:45.469 INFO:tasks.workunit.client.0.smithi006.stdout:1/483: write d0/f21 [1969792,63961] 0 2024-03-12T16:10:45.474 INFO:tasks.workunit.client.1.smithi134.stdout:5/741: dwrite db/d7a/d97/fe0 [0,4194304] 0 2024-03-12T16:10:45.480 INFO:tasks.workunit.client.0.smithi006.stdout:1/484: dread d0/fc [0,4194304] 0 2024-03-12T16:10:45.480 INFO:tasks.workunit.client.0.smithi006.stdout:1/485: mknod d0/ca1 0 2024-03-12T16:10:45.483 INFO:tasks.workunit.client.0.smithi006.stdout:1/486: symlink d0/d25/d2a/d43/d63/la2 0 2024-03-12T16:10:45.486 INFO:tasks.workunit.client.0.smithi006.stdout:5/362: dwrite f4 [0,4194304] 0 2024-03-12T16:10:45.486 INFO:tasks.workunit.client.0.smithi006.stdout:7/558: dread de/d1c/fa2 [0,4194304] 0 2024-03-12T16:10:45.488 INFO:tasks.workunit.client.0.smithi006.stdout:2/482: dread d0/d13/d49/d60/d2b/f63 [0,4194304] 0 2024-03-12T16:10:45.488 INFO:tasks.workunit.client.1.smithi134.stdout:3/805: dwrite d1/db/d10/d2d/d2e/f3f [0,4194304] 0 2024-03-12T16:10:45.488 INFO:tasks.workunit.client.0.smithi006.stdout:7/559: chown de/d27/f56 232 1 2024-03-12T16:10:45.491 INFO:tasks.workunit.client.0.smithi006.stdout:7/560: write de/d27/d2b/f65 [872429,127140] 0 2024-03-12T16:10:45.491 INFO:tasks.workunit.client.1.smithi134.stdout:3/806: readlink d1/db/d10/l52 0 2024-03-12T16:10:45.493 INFO:tasks.workunit.client.0.smithi006.stdout:5/363: chown d7/d9/d31/d3b/d4f 42837 1 2024-03-12T16:10:45.497 INFO:tasks.workunit.client.0.smithi006.stdout:8/368: dread d2/db/d1a/d23/f50 [0,4194304] 0 2024-03-12T16:10:45.497 INFO:tasks.workunit.client.0.smithi006.stdout:5/364: mkdir d7/d9/d31/d3b/d61/d78 0 2024-03-12T16:10:45.497 INFO:tasks.workunit.client.0.smithi006.stdout:7/561: write de/d27/d2b/d4a/d6a/f6d [427194,25895] 0 2024-03-12T16:10:45.498 INFO:tasks.workunit.client.1.smithi134.stdout:3/807: read d1/f36 [6879276,86029] 0 2024-03-12T16:10:45.502 INFO:tasks.workunit.client.0.smithi006.stdout:7/562: creat de/d7b/d7e/fbc x:0 0 0 2024-03-12T16:10:45.503 INFO:tasks.workunit.client.1.smithi134.stdout:3/808: getdents d1 0 2024-03-12T16:10:45.506 INFO:tasks.workunit.client.1.smithi134.stdout:5/742: dread db/d12/f40 [0,4194304] 0 2024-03-12T16:10:45.507 INFO:tasks.workunit.client.0.smithi006.stdout:7/563: unlink de/d1c/l55 0 2024-03-12T16:10:45.512 INFO:tasks.workunit.client.0.smithi006.stdout:5/365: dwrite d7/d9/d10/d24/f38 [4194304,4194304] 0 2024-03-12T16:10:45.513 INFO:tasks.workunit.client.1.smithi134.stdout:5/743: dwrite db/d12/d1d/d3a/f67 [0,4194304] 0 2024-03-12T16:10:45.516 INFO:tasks.workunit.client.0.smithi006.stdout:5/366: mkdir d7/d9/d47/d56/d79 0 2024-03-12T16:10:45.517 INFO:tasks.workunit.client.1.smithi134.stdout:5/744: creat db/d12/d1d/d59/de5/fe7 x:0 0 0 2024-03-12T16:10:45.520 INFO:tasks.workunit.client.0.smithi006.stdout:8/369: truncate d2/d11/f27 6506982 0 2024-03-12T16:10:45.521 INFO:tasks.workunit.client.0.smithi006.stdout:8/370: chown d2/d11/f42 362040 1 2024-03-12T16:10:45.521 INFO:tasks.workunit.client.0.smithi006.stdout:5/367: chown d7/d9/d31/d3b/d4f/d65/d69/c71 1082 1 2024-03-12T16:10:45.523 INFO:tasks.workunit.client.1.smithi134.stdout:5/745: chown db/d12/d1d/c4c 111 1 2024-03-12T16:10:45.524 INFO:tasks.workunit.client.0.smithi006.stdout:5/368: truncate d7/d9/d10/d24/f76 71185 0 2024-03-12T16:10:45.527 INFO:tasks.workunit.client.1.smithi134.stdout:3/809: dwrite d1/d63/f114 [0,4194304] 0 2024-03-12T16:10:45.527 INFO:tasks.workunit.client.1.smithi134.stdout:5/746: stat db/d12/l17 0 2024-03-12T16:10:45.528 INFO:tasks.workunit.client.0.smithi006.stdout:5/369: creat d7/d9/f7a x:0 0 0 2024-03-12T16:10:45.533 INFO:tasks.workunit.client.0.smithi006.stdout:5/370: read d7/d9/f30 [1766228,87536] 0 2024-03-12T16:10:45.533 INFO:tasks.workunit.client.1.smithi134.stdout:5/747: truncate db/d7d/f7c 5119399 0 2024-03-12T16:10:45.533 INFO:tasks.workunit.client.1.smithi134.stdout:3/810: link d1/db/d10/d2d/d2e/f78 d1/db/d10/d111/f120 0 2024-03-12T16:10:45.534 INFO:tasks.workunit.client.0.smithi006.stdout:1/487: dread d0/f21 [0,4194304] 0 2024-03-12T16:10:45.534 INFO:tasks.workunit.client.0.smithi006.stdout:5/371: write d7/d41/f55 [707513,58872] 0 2024-03-12T16:10:45.535 INFO:tasks.workunit.client.1.smithi134.stdout:3/811: unlink d1/db/d12/f1e 0 2024-03-12T16:10:45.538 INFO:tasks.workunit.client.0.smithi006.stdout:1/488: mknod d0/d25/d2a/d43/d68/ca3 0 2024-03-12T16:10:45.542 INFO:tasks.workunit.client.1.smithi134.stdout:3/812: symlink d1/db/d14/d5a/d89/dea/l121 0 2024-03-12T16:10:45.548 INFO:tasks.workunit.client.1.smithi134.stdout:5/748: link db/d7d/f7c db/d12/d37/d73/fe8 0 2024-03-12T16:10:45.548 INFO:tasks.workunit.client.0.smithi006.stdout:1/489: dwrite d0/f2f [0,4194304] 0 2024-03-12T16:10:45.549 INFO:tasks.workunit.client.1.smithi134.stdout:3/813: dwrite d1/d63/dc2/ff6 [0,4194304] 0 2024-03-12T16:10:45.550 INFO:tasks.workunit.client.1.smithi134.stdout:5/749: chown db/d12/l17 13635 1 2024-03-12T16:10:45.552 INFO:tasks.workunit.client.1.smithi134.stdout:5/750: chown db/d12/d1d/c20 1586 1 2024-03-12T16:10:45.552 INFO:tasks.workunit.client.0.smithi006.stdout:8/371: dwrite d2/db/d1a/f1c [0,4194304] 0 2024-03-12T16:10:45.555 INFO:tasks.workunit.client.1.smithi134.stdout:3/814: unlink d1/db/d10/d2d/d30/f92 0 2024-03-12T16:10:45.555 INFO:tasks.workunit.client.0.smithi006.stdout:7/564: dread de/d27/d2b/d4a/d6a/f84 [0,4194304] 0 2024-03-12T16:10:45.555 INFO:tasks.workunit.client.0.smithi006.stdout:1/490: symlink d0/d25/d2a/la4 0 2024-03-12T16:10:45.559 INFO:tasks.workunit.client.1.smithi134.stdout:3/815: symlink d1/db/d10/d2a/dc6/ddb/l122 0 2024-03-12T16:10:45.561 INFO:tasks.workunit.client.0.smithi006.stdout:8/372: getdents d2 0 2024-03-12T16:10:45.562 INFO:tasks.workunit.client.0.smithi006.stdout:7/565: symlink de/d2c/d4f/dba/d39/lbd 0 2024-03-12T16:10:45.563 INFO:tasks.workunit.client.0.smithi006.stdout:8/373: chown d2/f63 716 1 2024-03-12T16:10:45.564 INFO:tasks.workunit.client.1.smithi134.stdout:3/816: unlink d1/db/d14/d5a/d89/dea/l121 0 2024-03-12T16:10:45.565 INFO:tasks.workunit.client.0.smithi006.stdout:8/374: symlink d2/d55/l76 0 2024-03-12T16:10:45.566 INFO:tasks.workunit.client.1.smithi134.stdout:3/817: fdatasync d1/db/d12/f7a 0 2024-03-12T16:10:45.568 INFO:tasks.workunit.client.0.smithi006.stdout:1/491: dwrite d0/d25/d2a/f3b [0,4194304] 0 2024-03-12T16:10:45.568 INFO:tasks.workunit.client.0.smithi006.stdout:7/566: rename de/d27/d2b to de/d2c/d93/dbe 0 2024-03-12T16:10:45.569 INFO:tasks.workunit.client.1.smithi134.stdout:5/751: dwrite db/d12/d1d/f23 [0,4194304] 0 2024-03-12T16:10:45.570 INFO:tasks.workunit.client.1.smithi134.stdout:3/818: creat d1/db/d10/daf/f123 x:0 0 0 2024-03-12T16:10:45.571 INFO:tasks.workunit.client.1.smithi134.stdout:5/752: symlink db/d7d/le9 0 2024-03-12T16:10:45.572 INFO:tasks.workunit.client.0.smithi006.stdout:7/567: mkdir de/d2c/d93/dbe/d4a/dbf 0 2024-03-12T16:10:45.574 INFO:tasks.workunit.client.0.smithi006.stdout:7/568: write de/f80 [526249,77889] 0 2024-03-12T16:10:45.575 INFO:tasks.workunit.client.0.smithi006.stdout:8/375: getdents d2/d11/d6e 0 2024-03-12T16:10:45.577 INFO:tasks.workunit.client.0.smithi006.stdout:7/569: creat de/d98/fc0 x:0 0 0 2024-03-12T16:10:45.579 INFO:tasks.workunit.client.0.smithi006.stdout:7/570: write de/d2c/f73 [691865,8476] 0 2024-03-12T16:10:45.580 INFO:tasks.workunit.client.0.smithi006.stdout:1/492: link d0/d25/d2a/d35/c69 d0/d25/d2a/d43/ca5 0 2024-03-12T16:10:45.581 INFO:tasks.workunit.client.1.smithi134.stdout:5/753: rename db/d12/d37/d73/d8c/faa to db/d12/d29/d3d/d79/da5/fea 0 2024-03-12T16:10:45.582 INFO:tasks.workunit.client.1.smithi134.stdout:5/754: write db/d12/d29/f9a [1174204,106149] 0 2024-03-12T16:10:45.583 INFO:tasks.workunit.client.1.smithi134.stdout:5/755: write db/d12/d1d/f23 [636780,2554] 0 2024-03-12T16:10:45.584 INFO:tasks.workunit.client.0.smithi006.stdout:1/493: write d0/d25/d2a/d43/d63/f7b [727669,92199] 0 2024-03-12T16:10:45.585 INFO:tasks.workunit.client.0.smithi006.stdout:8/376: dwrite d2/db/f69 [0,4194304] 0 2024-03-12T16:10:45.585 INFO:tasks.workunit.client.0.smithi006.stdout:5/372: dread d7/d9/f30 [0,4194304] 0 2024-03-12T16:10:45.587 INFO:tasks.workunit.client.0.smithi006.stdout:1/494: truncate d0/d25/f83 44675 0 2024-03-12T16:10:45.589 INFO:tasks.workunit.client.0.smithi006.stdout:5/373: getdents d7/d9/d31/d3b/d61/d78 0 2024-03-12T16:10:45.590 INFO:tasks.workunit.client.0.smithi006.stdout:0/449: sync 2024-03-12T16:10:45.591 INFO:tasks.workunit.client.0.smithi006.stdout:5/374: write d7/d9/d31/f2e [3022431,17237] 0 2024-03-12T16:10:45.592 INFO:tasks.workunit.client.0.smithi006.stdout:1/495: creat d0/d25/d2a/d43/d63/fa6 x:0 0 0 2024-03-12T16:10:45.593 INFO:tasks.workunit.client.0.smithi006.stdout:8/377: getdents d2/db/d1a/d21/d2b 0 2024-03-12T16:10:45.596 INFO:tasks.workunit.client.0.smithi006.stdout:0/450: chown d2/d39/f63 1765104 1 2024-03-12T16:10:45.598 INFO:tasks.workunit.client.0.smithi006.stdout:5/375: write d7/d9/d47/f67 [537079,101562] 0 2024-03-12T16:10:45.599 INFO:tasks.workunit.client.0.smithi006.stdout:1/496: creat d0/d25/d2a/d43/fa7 x:0 0 0 2024-03-12T16:10:45.600 INFO:tasks.workunit.client.1.smithi134.stdout:7/648: sync 2024-03-12T16:10:45.600 INFO:tasks.workunit.client.0.smithi006.stdout:8/378: mknod d2/db/d1a/d21/d4f/c77 0 2024-03-12T16:10:45.601 INFO:tasks.workunit.client.0.smithi006.stdout:0/451: mkdir d2/d39/d42/d82 0 2024-03-12T16:10:45.601 INFO:tasks.workunit.client.0.smithi006.stdout:5/376: symlink d7/d9/d47/d56/l7b 0 2024-03-12T16:10:45.603 INFO:tasks.workunit.client.1.smithi134.stdout:7/649: creat d8/dc/d55/d81/d87/fdf x:0 0 0 2024-03-12T16:10:45.605 INFO:tasks.workunit.client.1.smithi134.stdout:7/650: creat d8/d27/d9d/dc9/fe0 x:0 0 0 2024-03-12T16:10:45.605 INFO:tasks.workunit.client.0.smithi006.stdout:0/452: mknod d2/c83 0 2024-03-12T16:10:45.605 INFO:tasks.workunit.client.0.smithi006.stdout:8/379: write d2/f19 [980327,21777] 0 2024-03-12T16:10:45.608 INFO:tasks.workunit.client.1.smithi134.stdout:7/651: creat d8/d4e/dca/fe1 x:0 0 0 2024-03-12T16:10:45.608 INFO:tasks.workunit.client.1.smithi134.stdout:3/819: rmdir d1/db/d10 39 2024-03-12T16:10:45.608 INFO:tasks.workunit.client.0.smithi006.stdout:0/453: write d2/d39/d42/f64 [1016320,11128] 0 2024-03-12T16:10:45.609 INFO:tasks.workunit.client.0.smithi006.stdout:1/497: symlink d0/d25/d2a/d35/d3f/la8 0 2024-03-12T16:10:45.612 INFO:tasks.workunit.client.1.smithi134.stdout:7/652: symlink d8/dc/d55/d81/le2 0 2024-03-12T16:10:45.614 INFO:tasks.workunit.client.1.smithi134.stdout:3/820: chown d1/db/d10/d2a/l80 6 1 2024-03-12T16:10:45.614 INFO:tasks.workunit.client.1.smithi134.stdout:7/653: read - d8/db4/fc4 zero size 2024-03-12T16:10:45.615 INFO:tasks.workunit.client.1.smithi134.stdout:7/654: readlink d8/d27/d5b/l68 0 2024-03-12T16:10:45.619 INFO:tasks.workunit.client.1.smithi134.stdout:7/655: creat d8/dc/d4b/dd9/fe3 x:0 0 0 2024-03-12T16:10:45.619 INFO:tasks.workunit.client.0.smithi006.stdout:8/380: link d2/fd d2/db/d1a/f78 0 2024-03-12T16:10:45.620 INFO:tasks.workunit.client.0.smithi006.stdout:0/454: creat d2/d6/d10/d11/f84 x:0 0 0 2024-03-12T16:10:45.620 INFO:tasks.workunit.client.0.smithi006.stdout:5/377: dwrite d7/d9/d10/d24/f76 [0,4194304] 0 2024-03-12T16:10:45.621 INFO:tasks.workunit.client.1.smithi134.stdout:3/821: truncate d1/db/d12/fb1 1545354 0 2024-03-12T16:10:45.621 INFO:tasks.workunit.client.1.smithi134.stdout:5/756: dwrite db/f38 [0,4194304] 0 2024-03-12T16:10:45.622 INFO:tasks.workunit.client.0.smithi006.stdout:1/498: dread d0/fc [0,4194304] 0 2024-03-12T16:10:45.623 INFO:tasks.workunit.client.0.smithi006.stdout:5/378: fsync d7/d9/d2c/f3a 0 2024-03-12T16:10:45.625 INFO:tasks.workunit.client.1.smithi134.stdout:3/822: creat d1/d63/dc2/d117/f124 x:0 0 0 2024-03-12T16:10:45.626 INFO:tasks.workunit.client.0.smithi006.stdout:7/571: dread de/d18/d9c/f9d [0,4194304] 0 2024-03-12T16:10:45.626 INFO:tasks.workunit.client.0.smithi006.stdout:5/379: dread - d7/d9/f6a zero size 2024-03-12T16:10:45.629 INFO:tasks.workunit.client.1.smithi134.stdout:7/656: dwrite d8/db4/fd3 [0,4194304] 0 2024-03-12T16:10:45.630 INFO:tasks.workunit.client.0.smithi006.stdout:8/381: unlink d2/db/f72 0 2024-03-12T16:10:45.630 INFO:tasks.workunit.client.0.smithi006.stdout:1/499: creat d0/fa9 x:0 0 0 2024-03-12T16:10:45.632 INFO:tasks.workunit.client.1.smithi134.stdout:3/823: creat d1/db/d14/d5a/d89/dea/f125 x:0 0 0 2024-03-12T16:10:45.632 INFO:tasks.workunit.client.1.smithi134.stdout:3/824: dread - d1/fad zero size 2024-03-12T16:10:45.633 INFO:tasks.workunit.client.1.smithi134.stdout:5/757: getdents db/d12/d1d/d59/de5 0 2024-03-12T16:10:45.633 INFO:tasks.workunit.client.0.smithi006.stdout:0/455: mknod d2/d6/c85 0 2024-03-12T16:10:45.633 INFO:tasks.workunit.client.0.smithi006.stdout:5/380: write d7/d8/f4d [4538823,77043] 0 2024-03-12T16:10:45.634 INFO:tasks.workunit.client.0.smithi006.stdout:0/456: stat d2/d6/d10/f75 0 2024-03-12T16:10:45.635 INFO:tasks.workunit.client.0.smithi006.stdout:8/382: mknod d2/db/c79 0 2024-03-12T16:10:45.635 INFO:tasks.workunit.client.0.smithi006.stdout:7/572: dread de/d27/f2d [0,4194304] 0 2024-03-12T16:10:45.636 INFO:tasks.workunit.client.1.smithi134.stdout:5/758: stat db/d12/d1d/d3a/d4e 0 2024-03-12T16:10:45.636 INFO:tasks.workunit.client.1.smithi134.stdout:7/657: read d8/dc/d7b/f8a [556533,64837] 0 2024-03-12T16:10:45.638 INFO:tasks.workunit.client.0.smithi006.stdout:0/457: stat d2/d6/d37/f45 0 2024-03-12T16:10:45.642 INFO:tasks.workunit.client.0.smithi006.stdout:8/383: mkdir d2/db/d1a/d7a 0 2024-03-12T16:10:45.643 INFO:tasks.workunit.client.1.smithi134.stdout:7/658: dwrite d8/dc/fcf [0,4194304] 0 2024-03-12T16:10:45.645 INFO:tasks.workunit.client.0.smithi006.stdout:5/381: link d7/f58 d7/d9/d31/d3b/d4f/f7c 0 2024-03-12T16:10:45.645 INFO:tasks.workunit.client.0.smithi006.stdout:8/384: fsync d2/db/f6c 0 2024-03-12T16:10:45.648 INFO:tasks.workunit.client.1.smithi134.stdout:7/659: unlink d8/dc/d55/fad 0 2024-03-12T16:10:45.649 INFO:tasks.workunit.client.1.smithi134.stdout:7/660: fsync d8/dc/d7b/dbb/dbd/dd5/fa7 0 2024-03-12T16:10:45.650 INFO:tasks.workunit.client.0.smithi006.stdout:0/458: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:45.650 INFO:tasks.workunit.client.0.smithi006.stdout:7/573: dwrite de/d27/f69 [0,4194304] 0 2024-03-12T16:10:45.651 INFO:tasks.workunit.client.1.smithi134.stdout:7/661: creat d8/dc/d20/d26/d36/fe4 x:0 0 0 2024-03-12T16:10:45.652 INFO:tasks.workunit.client.0.smithi006.stdout:5/382: creat d7/d9/d31/d3b/d4f/d65/f7d x:0 0 0 2024-03-12T16:10:45.655 INFO:tasks.workunit.client.0.smithi006.stdout:1/500: write d0/d25/f75 [261806,24913] 0 2024-03-12T16:10:45.655 INFO:tasks.workunit.client.1.smithi134.stdout:7/662: read d8/dc/d20/d26/d36/f60 [4017689,124757] 0 2024-03-12T16:10:45.655 INFO:tasks.workunit.client.0.smithi006.stdout:0/459: dread - d2/d39/f63 zero size 2024-03-12T16:10:45.657 INFO:tasks.workunit.client.0.smithi006.stdout:1/501: write d0/fb [2680476,57711] 0 2024-03-12T16:10:45.658 INFO:tasks.workunit.client.0.smithi006.stdout:8/385: getdents d2/db/d1a/d21/d4f 0 2024-03-12T16:10:45.658 INFO:tasks.workunit.client.1.smithi134.stdout:7/663: mknod d8/d27/d5b/ce5 0 2024-03-12T16:10:45.661 INFO:tasks.workunit.client.0.smithi006.stdout:5/383: mknod d7/d9/d10/c7e 0 2024-03-12T16:10:45.661 INFO:tasks.workunit.client.0.smithi006.stdout:7/574: rmdir de/d2c/d93/dbe/d4a/d6a 39 2024-03-12T16:10:45.663 INFO:tasks.workunit.client.0.smithi006.stdout:1/502: creat d0/d25/d2a/d43/faa x:0 0 0 2024-03-12T16:10:45.663 INFO:tasks.workunit.client.0.smithi006.stdout:8/386: rmdir d2/db/d1a/d21/d2b 39 2024-03-12T16:10:45.665 INFO:tasks.workunit.client.0.smithi006.stdout:0/460: creat d2/d6/d37/f86 x:0 0 0 2024-03-12T16:10:45.666 INFO:tasks.workunit.client.0.smithi006.stdout:1/503: chown d0/d25/d2a/d43/d63/l8e 74 1 2024-03-12T16:10:45.668 INFO:tasks.workunit.client.0.smithi006.stdout:5/384: write d7/d9/f16 [7431114,32034] 0 2024-03-12T16:10:45.670 INFO:tasks.workunit.client.0.smithi006.stdout:7/575: rmdir de/d1c 39 2024-03-12T16:10:45.675 INFO:tasks.workunit.client.0.smithi006.stdout:5/385: truncate d7/f58 341428 0 2024-03-12T16:10:45.677 INFO:tasks.workunit.client.0.smithi006.stdout:8/387: dwrite d2/db/f6c [0,4194304] 0 2024-03-12T16:10:45.677 INFO:tasks.workunit.client.0.smithi006.stdout:7/576: write de/f9f [1685051,121233] 0 2024-03-12T16:10:45.680 INFO:tasks.workunit.client.1.smithi134.stdout:7/664: dwrite d8/d27/d9d/d31/f98 [0,4194304] 0 2024-03-12T16:10:45.682 INFO:tasks.workunit.client.0.smithi006.stdout:7/577: stat de/d98/fc0 0 2024-03-12T16:10:45.683 INFO:tasks.workunit.client.0.smithi006.stdout:8/388: mkdir d2/d55/d7b 0 2024-03-12T16:10:45.683 INFO:tasks.workunit.client.0.smithi006.stdout:1/504: dwrite d0/fb [4194304,4194304] 0 2024-03-12T16:10:45.686 INFO:tasks.workunit.client.1.smithi134.stdout:7/665: dread d8/dc/d4b/fc3 [0,4194304] 0 2024-03-12T16:10:45.688 INFO:tasks.workunit.client.0.smithi006.stdout:5/386: read d7/d9/d10/f32 [4421518,16205] 0 2024-03-12T16:10:45.693 INFO:tasks.workunit.client.1.smithi134.stdout:7/666: getdents d8/dc/d20/d26/d36 0 2024-03-12T16:10:45.694 INFO:tasks.workunit.client.0.smithi006.stdout:1/505: chown d0/d25/d2a/d35/d3f/f91 4410 1 2024-03-12T16:10:45.695 INFO:tasks.workunit.client.0.smithi006.stdout:0/461: dwrite d2/d6/f3d [4194304,4194304] 0 2024-03-12T16:10:45.696 INFO:tasks.workunit.client.1.smithi134.stdout:7/667: getdents d8/d4e/dca 0 2024-03-12T16:10:45.697 INFO:tasks.workunit.client.1.smithi134.stdout:7/668: dread - d8/dc/d20/d26/d36/f9b zero size 2024-03-12T16:10:45.698 INFO:tasks.workunit.client.1.smithi134.stdout:7/669: readlink d8/d27/d9d/d31/l84 0 2024-03-12T16:10:45.704 INFO:tasks.workunit.client.0.smithi006.stdout:7/578: dwrite de/d18/f1f [0,4194304] 0 2024-03-12T16:10:45.704 INFO:tasks.workunit.client.0.smithi006.stdout:1/506: link d0/c57 d0/d25/d2a/d35/cab 0 2024-03-12T16:10:45.708 INFO:tasks.workunit.client.1.smithi134.stdout:7/670: dwrite d8/d4e/dca/fe1 [0,4194304] 0 2024-03-12T16:10:45.709 INFO:tasks.workunit.client.0.smithi006.stdout:5/387: dwrite d7/d9/d10/f39 [0,4194304] 0 2024-03-12T16:10:45.711 INFO:tasks.workunit.client.1.smithi134.stdout:7/671: dread - d8/d4e/f89 zero size 2024-03-12T16:10:45.711 INFO:tasks.workunit.client.0.smithi006.stdout:5/388: write d7/d9/d10/d24/f76 [1707469,49222] 0 2024-03-12T16:10:45.712 INFO:tasks.workunit.client.0.smithi006.stdout:7/579: creat de/d2c/d93/dbe/fc1 x:0 0 0 2024-03-12T16:10:45.713 INFO:tasks.workunit.client.0.smithi006.stdout:1/507: symlink d0/d25/d2a/d64/lac 0 2024-03-12T16:10:45.714 INFO:tasks.workunit.client.0.smithi006.stdout:7/580: truncate de/d18/f1f 4233390 0 2024-03-12T16:10:45.715 INFO:tasks.workunit.client.0.smithi006.stdout:5/389: write d7/d8/f4d [5056516,28050] 0 2024-03-12T16:10:45.718 INFO:tasks.workunit.client.1.smithi134.stdout:7/672: rmdir d8/d27/d9d/d31/d7c 39 2024-03-12T16:10:45.721 INFO:tasks.workunit.client.0.smithi006.stdout:7/581: write de/d7b/f91 [352124,11151] 0 2024-03-12T16:10:45.722 INFO:tasks.workunit.client.1.smithi134.stdout:7/673: symlink d8/dc/d4b/d97/le6 0 2024-03-12T16:10:45.724 INFO:tasks.workunit.client.0.smithi006.stdout:7/582: chown de/d2c/d93/dbe/f37 15 1 2024-03-12T16:10:45.724 INFO:tasks.workunit.client.0.smithi006.stdout:1/508: rename d0/d25/d2a/d35/cab to d0/d25/d2a/d35/cad 0 2024-03-12T16:10:45.726 INFO:tasks.workunit.client.0.smithi006.stdout:1/509: stat d0/d25/d67/c74 0 2024-03-12T16:10:45.729 INFO:tasks.workunit.client.0.smithi006.stdout:5/390: dwrite d7/d9/d31/f2e [0,4194304] 0 2024-03-12T16:10:45.729 INFO:tasks.workunit.client.0.smithi006.stdout:7/583: fdatasync de/d1c/f33 0 2024-03-12T16:10:45.729 INFO:tasks.workunit.client.1.smithi134.stdout:7/674: dwrite d8/dc/d7b/dbb/dbd/dd5/fce [0,4194304] 0 2024-03-12T16:10:45.731 INFO:tasks.workunit.client.1.smithi134.stdout:7/675: dread - d8/dc/d7b/dbb/dbd/dd5/fa7 zero size 2024-03-12T16:10:45.734 INFO:tasks.workunit.client.1.smithi134.stdout:7/676: rmdir d8/dc/d55 39 2024-03-12T16:10:45.735 INFO:tasks.workunit.client.0.smithi006.stdout:8/389: dread d2/fd [0,4194304] 0 2024-03-12T16:10:45.735 INFO:tasks.workunit.client.1.smithi134.stdout:7/677: fsync d8/dc/f5d 0 2024-03-12T16:10:45.737 INFO:tasks.workunit.client.0.smithi006.stdout:5/391: link d7/d9/d10/d24/f38 d7/d9/d47/d56/d79/f7f 0 2024-03-12T16:10:45.741 INFO:tasks.workunit.client.0.smithi006.stdout:7/584: rename de/d18/d9c to de/dc2 0 2024-03-12T16:10:45.742 INFO:tasks.workunit.client.1.smithi134.stdout:9/691: sync 2024-03-12T16:10:45.742 INFO:tasks.workunit.client.1.smithi134.stdout:1/508: sync 2024-03-12T16:10:45.742 INFO:tasks.workunit.client.1.smithi134.stdout:7/678: mknod d8/dc/d55/ce7 0 2024-03-12T16:10:45.746 INFO:tasks.workunit.client.0.smithi006.stdout:0/462: dread d2/d6/f3d [0,4194304] 0 2024-03-12T16:10:45.747 INFO:tasks.workunit.client.1.smithi134.stdout:7/679: rename d8/d27/l34 to d8/dc/d20/d26/d36/le8 0 2024-03-12T16:10:45.747 INFO:tasks.workunit.client.0.smithi006.stdout:8/390: chown d2/c8 12 1 2024-03-12T16:10:45.747 INFO:tasks.workunit.client.0.smithi006.stdout:7/585: mknod de/d27/d7c/cc3 0 2024-03-12T16:10:45.748 INFO:tasks.workunit.client.1.smithi134.stdout:9/692: dwrite d5/d10/d35/d49/d8d/f84 [0,4194304] 0 2024-03-12T16:10:45.748 INFO:tasks.workunit.client.1.smithi134.stdout:7/680: creat d8/d27/d9d/fe9 x:0 0 0 2024-03-12T16:10:45.749 INFO:tasks.workunit.client.0.smithi006.stdout:0/463: truncate d2/d6/d10/f6d 109365 0 2024-03-12T16:10:45.749 INFO:tasks.workunit.client.0.smithi006.stdout:5/392: dread d7/d9/d10/d24/f38 [0,4194304] 0 2024-03-12T16:10:45.749 INFO:tasks.workunit.client.0.smithi006.stdout:8/391: getdents d2/db/d1a/d23 0 2024-03-12T16:10:45.754 INFO:tasks.workunit.client.1.smithi134.stdout:7/681: mkdir d8/d27/d9d/dc9/dea 0 2024-03-12T16:10:45.754 INFO:tasks.workunit.client.0.smithi006.stdout:0/464: chown d2/d6/d10/d11/d1d/d2e/d77/c7b 22 1 2024-03-12T16:10:45.756 INFO:tasks.workunit.client.0.smithi006.stdout:5/393: truncate d7/d9/d10/d24/f3e 1202393 0 2024-03-12T16:10:45.757 INFO:tasks.workunit.client.1.smithi134.stdout:9/693: rename d5/d10/d35/d49/d54/f9e to d5/d10/d35/d49/d74/fc8 0 2024-03-12T16:10:45.757 INFO:tasks.workunit.client.1.smithi134.stdout:7/682: dread d8/d4e/f82 [0,4194304] 0 2024-03-12T16:10:45.759 INFO:tasks.workunit.client.0.smithi006.stdout:0/465: creat d2/d39/d42/d82/f87 x:0 0 0 2024-03-12T16:10:45.761 INFO:tasks.workunit.client.1.smithi134.stdout:7/683: symlink d8/dc/d20/d26/d36/leb 0 2024-03-12T16:10:45.763 INFO:tasks.workunit.client.1.smithi134.stdout:7/684: mkdir d8/dc/d4b/dd9/dec 0 2024-03-12T16:10:45.763 INFO:tasks.workunit.client.0.smithi006.stdout:0/466: truncate d2/d6/f62 148231 0 2024-03-12T16:10:45.763 INFO:tasks.workunit.client.0.smithi006.stdout:8/392: dread d2/f63 [0,4194304] 0 2024-03-12T16:10:45.764 INFO:tasks.workunit.client.1.smithi134.stdout:7/685: write d8/d27/d9d/f86 [325688,44903] 0 2024-03-12T16:10:45.766 INFO:tasks.workunit.client.1.smithi134.stdout:7/686: creat d8/d4e/d91/fed x:0 0 0 2024-03-12T16:10:45.767 INFO:tasks.workunit.client.0.smithi006.stdout:0/467: rmdir d2/d39 39 2024-03-12T16:10:45.768 INFO:tasks.workunit.client.0.smithi006.stdout:1/510: dwrite d0/d25/d2a/f2d [0,4194304] 0 2024-03-12T16:10:45.769 INFO:tasks.workunit.client.1.smithi134.stdout:7/687: fdatasync d8/db4/fd1 0 2024-03-12T16:10:45.772 INFO:tasks.workunit.client.1.smithi134.stdout:7/688: creat d8/dc/d4b/d97/fee x:0 0 0 2024-03-12T16:10:45.773 INFO:tasks.workunit.client.0.smithi006.stdout:8/393: truncate d2/d11/f27 4296956 0 2024-03-12T16:10:45.773 INFO:tasks.workunit.client.0.smithi006.stdout:5/394: write d7/d9/d2c/f36 [996363,67058] 0 2024-03-12T16:10:45.773 INFO:tasks.workunit.client.1.smithi134.stdout:9/694: dwrite d5/d10/f2d [0,4194304] 0 2024-03-12T16:10:45.775 INFO:tasks.workunit.client.1.smithi134.stdout:7/689: stat d8/dc/d55/d57/f7e 0 2024-03-12T16:10:45.775 INFO:tasks.workunit.client.1.smithi134.stdout:1/509: dread d0/d16/d9/d13/d21/d20/f44 [0,4194304] 0 2024-03-12T16:10:45.777 INFO:tasks.workunit.client.1.smithi134.stdout:9/695: dread - d5/d10/d35/d49/d54/d88/fc0 zero size 2024-03-12T16:10:45.778 INFO:tasks.workunit.client.0.smithi006.stdout:5/395: write f4 [1066413,123677] 0 2024-03-12T16:10:45.779 INFO:tasks.workunit.client.1.smithi134.stdout:1/510: symlink d0/d42/lb2 0 2024-03-12T16:10:45.779 INFO:tasks.workunit.client.0.smithi006.stdout:8/394: dread - d2/d55/f71 zero size 2024-03-12T16:10:45.781 INFO:tasks.workunit.client.1.smithi134.stdout:7/690: mknod d8/d4e/d91/da1/cef 0 2024-03-12T16:10:45.783 INFO:tasks.workunit.client.0.smithi006.stdout:5/396: write d7/d9/d10/f1a [289807,61552] 0 2024-03-12T16:10:45.784 INFO:tasks.workunit.client.1.smithi134.stdout:1/511: mknod d0/d16/d9/d13/d21/dac/cb3 0 2024-03-12T16:10:45.785 INFO:tasks.workunit.client.1.smithi134.stdout:7/691: fdatasync d8/dc/d20/d26/f5e 0 2024-03-12T16:10:45.785 INFO:tasks.workunit.client.1.smithi134.stdout:1/512: write d0/d16/d9/fa4 [198306,55195] 0 2024-03-12T16:10:45.786 INFO:tasks.workunit.client.0.smithi006.stdout:7/586: dread de/d2c/d4f/dba/fad [0,4194304] 0 2024-03-12T16:10:45.788 INFO:tasks.workunit.client.0.smithi006.stdout:0/468: dwrite d2/d6/d10/d11/d1d/d79/f7f [0,4194304] 0 2024-03-12T16:10:45.790 INFO:tasks.workunit.client.0.smithi006.stdout:1/511: dwrite d0/fc [0,4194304] 0 2024-03-12T16:10:45.792 INFO:tasks.workunit.client.1.smithi134.stdout:7/692: getdents d8/d27/d9d 0 2024-03-12T16:10:45.793 INFO:tasks.workunit.client.0.smithi006.stdout:5/397: mkdir d7/d9/d31/d3b/d4f/d80 0 2024-03-12T16:10:45.793 INFO:tasks.workunit.client.0.smithi006.stdout:7/587: fsync de/d27/f56 0 2024-03-12T16:10:45.793 INFO:tasks.workunit.client.1.smithi134.stdout:7/693: chown d8/dc/d55/d57/fc8 7 1 2024-03-12T16:10:45.797 INFO:tasks.workunit.client.0.smithi006.stdout:5/398: symlink d7/d41/l81 0 2024-03-12T16:10:45.797 INFO:tasks.workunit.client.0.smithi006.stdout:7/588: write de/d2c/d4f/dba/d39/f46 [1368968,73317] 0 2024-03-12T16:10:45.797 INFO:tasks.workunit.client.0.smithi006.stdout:8/395: dread d2/db/d1a/f1c [0,4194304] 0 2024-03-12T16:10:45.799 INFO:tasks.workunit.client.0.smithi006.stdout:0/469: mkdir d2/d88 0 2024-03-12T16:10:45.799 INFO:tasks.workunit.client.1.smithi134.stdout:7/694: rename d8/dc/d20/c48 to d8/dc/d55/cf0 0 2024-03-12T16:10:45.801 INFO:tasks.workunit.client.0.smithi006.stdout:0/470: dread - d2/d6/f72 zero size 2024-03-12T16:10:45.801 INFO:tasks.workunit.client.0.smithi006.stdout:5/399: fsync d7/d9/d10/d24/f38 0 2024-03-12T16:10:45.801 INFO:tasks.workunit.client.1.smithi134.stdout:7/695: fsync d8/f2a 0 2024-03-12T16:10:45.803 INFO:tasks.workunit.client.0.smithi006.stdout:7/589: rename de/d2c/d4f/dba/fad to de/d2c/d93/dbe/d66/fc4 0 2024-03-12T16:10:45.805 INFO:tasks.workunit.client.1.smithi134.stdout:7/696: mknod d8/dc/d7b/dbb/dbd/cf1 0 2024-03-12T16:10:45.807 INFO:tasks.workunit.client.0.smithi006.stdout:0/471: truncate d2/d6/d10/d11/d32/f4a 882309 0 2024-03-12T16:10:45.807 INFO:tasks.workunit.client.1.smithi134.stdout:7/697: mkdir d8/dc/d55/df2 0 2024-03-12T16:10:45.809 INFO:tasks.workunit.client.0.smithi006.stdout:7/590: rename de/d2c/d93/lb4 to de/d2c/d93/lc5 0 2024-03-12T16:10:45.810 INFO:tasks.workunit.client.0.smithi006.stdout:5/400: creat d7/d9/d31/d3b/d61/d78/f82 x:0 0 0 2024-03-12T16:10:45.812 INFO:tasks.workunit.client.0.smithi006.stdout:7/591: mkdir de/d7b/dc6 0 2024-03-12T16:10:45.813 INFO:tasks.workunit.client.0.smithi006.stdout:7/592: readlink de/d2c/l30 0 2024-03-12T16:10:45.814 INFO:tasks.workunit.client.0.smithi006.stdout:7/593: chown de/d2c/l2f 2086102 1 2024-03-12T16:10:45.814 INFO:tasks.workunit.client.0.smithi006.stdout:5/401: dread f4 [0,4194304] 0 2024-03-12T16:10:45.815 INFO:tasks.workunit.client.0.smithi006.stdout:0/472: creat d2/d6/d10/d11/d1d/d2e/f89 x:0 0 0 2024-03-12T16:10:45.816 INFO:tasks.workunit.client.0.smithi006.stdout:7/594: write de/d2c/d4f/dba/f67 [4919175,37272] 0 2024-03-12T16:10:45.816 INFO:tasks.workunit.client.1.smithi134.stdout:8/680: sync 2024-03-12T16:10:45.816 INFO:tasks.workunit.client.1.smithi134.stdout:6/694: sync 2024-03-12T16:10:45.816 INFO:tasks.workunit.client.1.smithi134.stdout:4/625: sync 2024-03-12T16:10:45.816 INFO:tasks.workunit.client.1.smithi134.stdout:0/664: sync 2024-03-12T16:10:45.816 INFO:tasks.workunit.client.1.smithi134.stdout:2/635: sync 2024-03-12T16:10:45.817 INFO:tasks.workunit.client.0.smithi006.stdout:5/402: chown d7/d8/f4c 2985 1 2024-03-12T16:10:45.818 INFO:tasks.workunit.client.0.smithi006.stdout:7/595: write de/d2c/d4f/dba/d39/f58 [963959,121160] 0 2024-03-12T16:10:45.818 INFO:tasks.workunit.client.1.smithi134.stdout:4/626: fdatasync d1/d24/d34/d8e/fb4 0 2024-03-12T16:10:45.819 INFO:tasks.workunit.client.0.smithi006.stdout:0/473: getdents d2/d6/d10/d11/d7e 0 2024-03-12T16:10:45.820 INFO:tasks.workunit.client.1.smithi134.stdout:2/636: creat d4/d12/d43/fe1 x:0 0 0 2024-03-12T16:10:45.820 INFO:tasks.workunit.client.0.smithi006.stdout:0/474: dread - d2/d6/d10/d11/d1d/d2e/f89 zero size 2024-03-12T16:10:45.821 INFO:tasks.workunit.client.1.smithi134.stdout:8/681: chown d3/d1b/d17/d25/d33/d15/d95/d4f/l43 444901 1 2024-03-12T16:10:45.822 INFO:tasks.workunit.client.1.smithi134.stdout:0/665: truncate db/d2f/d31/d56/f72 409394 0 2024-03-12T16:10:45.822 INFO:tasks.workunit.client.1.smithi134.stdout:4/627: chown d1/d24/d34/d8e/f98 9 1 2024-03-12T16:10:45.822 INFO:tasks.workunit.client.0.smithi006.stdout:7/596: mkdir de/d2c/d93/dbe/d4a/d6a/dc7 0 2024-03-12T16:10:45.825 INFO:tasks.workunit.client.0.smithi006.stdout:7/597: rename de/d18/c5d to de/d2c/d4f/d83/cc8 0 2024-03-12T16:10:45.825 INFO:tasks.workunit.client.1.smithi134.stdout:8/682: symlink d3/d10/lec 0 2024-03-12T16:10:45.825 INFO:tasks.workunit.client.0.smithi006.stdout:5/403: link d7/d9/d10/l25 d7/d9/l83 0 2024-03-12T16:10:45.826 INFO:tasks.workunit.client.0.smithi006.stdout:7/598: write de/d2c/d93/dbe/fc1 [990198,88055] 0 2024-03-12T16:10:45.827 INFO:tasks.workunit.client.0.smithi006.stdout:8/396: dread d2/db/d1a/d21/d4f/f5c [0,4194304] 0 2024-03-12T16:10:45.828 INFO:tasks.workunit.client.0.smithi006.stdout:5/404: fdatasync d7/d9/d10/f26 0 2024-03-12T16:10:45.828 INFO:tasks.workunit.client.1.smithi134.stdout:6/695: dwrite d1/d89/fd6 [0,4194304] 0 2024-03-12T16:10:45.829 INFO:tasks.workunit.client.0.smithi006.stdout:5/405: readlink d7/d41/l81 0 2024-03-12T16:10:45.830 INFO:tasks.workunit.client.0.smithi006.stdout:7/599: creat de/dc2/fc9 x:0 0 0 2024-03-12T16:10:45.830 INFO:tasks.workunit.client.1.smithi134.stdout:0/666: rename db/d2f/d31/f3b to db/d2f/fd8 0 2024-03-12T16:10:45.831 INFO:tasks.workunit.client.0.smithi006.stdout:5/406: symlink d7/d9/d31/d3b/d4f/l84 0 2024-03-12T16:10:45.832 INFO:tasks.workunit.client.0.smithi006.stdout:7/600: dread - de/d2c/d4f/dba/f76 zero size 2024-03-12T16:10:45.833 INFO:tasks.workunit.client.1.smithi134.stdout:8/683: unlink d3/d1b/d17/d25/d33/d15/d95/d4f/f40 0 2024-03-12T16:10:45.836 INFO:tasks.workunit.client.0.smithi006.stdout:5/407: unlink d7/d9/d47/d56/d79/f7f 0 2024-03-12T16:10:45.836 INFO:tasks.workunit.client.0.smithi006.stdout:8/397: dwrite d2/db/d1a/d21/f33 [0,4194304] 0 2024-03-12T16:10:45.841 INFO:tasks.workunit.client.0.smithi006.stdout:8/398: unlink d2/db/d1a/d21/d2b/f40 0 2024-03-12T16:10:45.842 INFO:tasks.workunit.client.0.smithi006.stdout:7/601: link de/d18/f1f de/d2c/d4f/dba/fca 0 2024-03-12T16:10:45.844 INFO:tasks.workunit.client.0.smithi006.stdout:8/399: mkdir d2/d11/d6e/d7c 0 2024-03-12T16:10:45.844 INFO:tasks.workunit.client.0.smithi006.stdout:3/430: sync 2024-03-12T16:10:45.844 INFO:tasks.workunit.client.0.smithi006.stdout:9/415: sync 2024-03-12T16:10:45.845 INFO:tasks.workunit.client.0.smithi006.stdout:4/561: sync 2024-03-12T16:10:45.850 INFO:tasks.workunit.client.1.smithi134.stdout:2/637: dread d4/d12/d3b/d3f/fac [0,4194304] 0 2024-03-12T16:10:45.851 INFO:tasks.workunit.client.0.smithi006.stdout:4/562: creat d1/db/d39/d42/d61/fb4 x:0 0 0 2024-03-12T16:10:45.851 INFO:tasks.workunit.client.0.smithi006.stdout:7/602: link de/d2c/d4f/ca7 de/d1c/d87/ccb 0 2024-03-12T16:10:45.857 INFO:tasks.workunit.client.0.smithi006.stdout:7/603: mknod de/d2c/d93/dbe/d4a/d6a/ccc 0 2024-03-12T16:10:45.858 INFO:tasks.workunit.client.0.smithi006.stdout:8/400: dwrite d2/f16 [0,4194304] 0 2024-03-12T16:10:45.858 INFO:tasks.workunit.client.1.smithi134.stdout:2/638: dwrite d4/f13 [0,4194304] 0 2024-03-12T16:10:45.860 INFO:tasks.workunit.client.0.smithi006.stdout:4/563: rename d1/db/d1d/d6c to d1/db/d17/d43/db5 0 2024-03-12T16:10:45.860 INFO:tasks.workunit.client.1.smithi134.stdout:8/684: dread d3/d1b/f1d [0,4194304] 0 2024-03-12T16:10:45.861 INFO:tasks.workunit.client.1.smithi134.stdout:8/685: fdatasync d3/d1b/d17/d25/d33/f8b 0 2024-03-12T16:10:45.864 INFO:tasks.workunit.client.1.smithi134.stdout:1/513: write d0/d16/d9/d13/d21/d20/f8e [534427,2275] 0 2024-03-12T16:10:45.865 INFO:tasks.workunit.client.1.smithi134.stdout:7/698: write d8/d27/d9d/f32 [1222057,98042] 0 2024-03-12T16:10:45.866 INFO:tasks.workunit.client.1.smithi134.stdout:3/825: sync 2024-03-12T16:10:45.866 INFO:tasks.workunit.client.1.smithi134.stdout:5/759: sync 2024-03-12T16:10:45.872 INFO:tasks.workunit.client.1.smithi134.stdout:2/639: rename d4/d84/d63/d9d/d3d/d71/c72 to d4/d12/d1d/d34/d47/ce2 0 2024-03-12T16:10:45.873 INFO:tasks.workunit.client.1.smithi134.stdout:7/699: symlink d8/d27/d9d/dc9/lf3 0 2024-03-12T16:10:45.875 INFO:tasks.workunit.client.1.smithi134.stdout:3/826: readlink d1/db/d10/d2a/l61 0 2024-03-12T16:10:45.876 INFO:tasks.workunit.client.1.smithi134.stdout:9/696: dread d5/d20/d72/f7a [0,4194304] 0 2024-03-12T16:10:45.878 INFO:tasks.workunit.client.1.smithi134.stdout:5/760: fsync db/d12/d1d/d3a/d49/fbe 0 2024-03-12T16:10:45.879 INFO:tasks.workunit.client.1.smithi134.stdout:4/628: dwrite d1/d13/d49/f32 [0,4194304] 0 2024-03-12T16:10:45.883 INFO:tasks.workunit.client.1.smithi134.stdout:0/667: write db/d2f/d31/d68/f98 [552079,32216] 0 2024-03-12T16:10:45.883 INFO:tasks.workunit.client.1.smithi134.stdout:3/827: unlink d1/f7e 0 2024-03-12T16:10:45.885 INFO:tasks.workunit.client.1.smithi134.stdout:1/514: creat d0/d30/fb4 x:0 0 0 2024-03-12T16:10:45.885 INFO:tasks.workunit.client.1.smithi134.stdout:5/761: fdatasync db/d12/d1d/d59/de5/fe7 0 2024-03-12T16:10:45.890 INFO:tasks.workunit.client.1.smithi134.stdout:2/640: unlink d4/d12/d3b/cd6 0 2024-03-12T16:10:45.891 INFO:tasks.workunit.client.1.smithi134.stdout:7/700: rename d8/d27/d9d/d31 to d8/dc/d4b/dd9/df4 0 2024-03-12T16:10:45.891 INFO:tasks.workunit.client.1.smithi134.stdout:8/686: dread d3/d1b/d17/d25/d33/f34 [0,4194304] 0 2024-03-12T16:10:45.891 INFO:tasks.workunit.client.1.smithi134.stdout:7/701: chown d8/dc/f54 27727 1 2024-03-12T16:10:45.891 INFO:tasks.workunit.client.1.smithi134.stdout:0/668: unlink db/d2f/d31/f7b 0 2024-03-12T16:10:45.894 INFO:tasks.workunit.client.1.smithi134.stdout:1/515: write d0/d42/fb0 [993229,105922] 0 2024-03-12T16:10:45.894 INFO:tasks.workunit.client.1.smithi134.stdout:5/762: mknod db/d12/d1d/d59/de5/ceb 0 2024-03-12T16:10:45.897 INFO:tasks.workunit.client.1.smithi134.stdout:9/697: truncate d5/d20/f21 2169443 0 2024-03-12T16:10:45.898 INFO:tasks.workunit.client.1.smithi134.stdout:6/696: dread d1/d3/f48 [0,4194304] 0 2024-03-12T16:10:45.903 INFO:tasks.workunit.client.1.smithi134.stdout:6/697: fdatasync d1/d3/d10/fe9 0 2024-03-12T16:10:45.905 INFO:tasks.workunit.client.1.smithi134.stdout:2/641: dwrite d4/d12/d3b/f8f [0,4194304] 0 2024-03-12T16:10:45.905 INFO:tasks.workunit.client.1.smithi134.stdout:7/702: unlink d8/dc/d4b/d97/fbf 0 2024-03-12T16:10:45.907 INFO:tasks.workunit.client.1.smithi134.stdout:8/687: mknod d3/d1b/d17/d25/d33/d15/d95/d6d/ced 0 2024-03-12T16:10:45.914 INFO:tasks.workunit.client.1.smithi134.stdout:1/516: dwrite d0/d30/d86/f27 [0,4194304] 0 2024-03-12T16:10:45.917 INFO:tasks.workunit.client.1.smithi134.stdout:0/669: truncate db/d2f/d61/d7a/f84 135206 0 2024-03-12T16:10:45.917 INFO:tasks.workunit.client.1.smithi134.stdout:1/517: chown d0/d42/f98 3135361 1 2024-03-12T16:10:45.923 INFO:tasks.workunit.client.1.smithi134.stdout:6/698: truncate d1/da6/d55/fdd 930432 0 2024-03-12T16:10:45.923 INFO:tasks.workunit.client.1.smithi134.stdout:7/703: mknod d8/dc/d20/d26/cf5 0 2024-03-12T16:10:45.924 INFO:tasks.workunit.client.1.smithi134.stdout:8/688: mknod d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/cee 0 2024-03-12T16:10:45.927 INFO:tasks.workunit.client.1.smithi134.stdout:9/698: fdatasync d5/d10/d35/d49/d74/fc8 0 2024-03-12T16:10:45.930 INFO:tasks.workunit.client.1.smithi134.stdout:6/699: write d1/d16/d4c/d58/da0/fc1 [1896756,100564] 0 2024-03-12T16:10:45.932 INFO:tasks.workunit.client.1.smithi134.stdout:5/763: dread db/d12/d29/d3d/d79/fd6 [0,4194304] 0 2024-03-12T16:10:45.932 INFO:tasks.workunit.client.1.smithi134.stdout:9/699: fdatasync d5/d10/d6c/f6b 0 2024-03-12T16:10:45.933 INFO:tasks.workunit.client.1.smithi134.stdout:0/670: fsync db/d2f/d31/d76/f93 0 2024-03-12T16:10:45.935 INFO:tasks.workunit.client.1.smithi134.stdout:4/629: dwrite d1/d24/d34/d73/f8d [0,4194304] 0 2024-03-12T16:10:45.935 INFO:tasks.workunit.client.1.smithi134.stdout:2/642: link d4/d12/d43/c9a d4/d12/d1d/d34/d58/ce3 0 2024-03-12T16:10:45.937 INFO:tasks.workunit.client.1.smithi134.stdout:9/700: chown d5/d10/d33/da1 5 1 2024-03-12T16:10:45.937 INFO:tasks.workunit.client.1.smithi134.stdout:5/764: write db/d12/d1d/d59/d94/fae [53578,25054] 0 2024-03-12T16:10:45.940 INFO:tasks.workunit.client.1.smithi134.stdout:8/689: creat d3/d1b/d17/d3f/fef x:0 0 0 2024-03-12T16:10:45.941 INFO:tasks.workunit.client.1.smithi134.stdout:9/701: chown d5/d10/d35/d49/d74/fc8 5 1 2024-03-12T16:10:45.941 INFO:tasks.workunit.client.1.smithi134.stdout:5/765: write db/d12/d1d/d3a/d4e/f4f [856672,56373] 0 2024-03-12T16:10:45.956 INFO:tasks.workunit.client.0.smithi006.stdout:7/604: fsync de/d2c/d4f/dba/f76 0 2024-03-12T16:10:45.956 INFO:tasks.workunit.client.0.smithi006.stdout:8/401: creat d2/f7d x:0 0 0 2024-03-12T16:10:45.961 INFO:tasks.workunit.client.0.smithi006.stdout:8/402: write d2/d11/f1b [3467539,57206] 0 2024-03-12T16:10:45.961 INFO:tasks.workunit.client.0.smithi006.stdout:9/416: dwrite d0/d8/d16/d7d/d20/d37/f57 [0,4194304] 0 2024-03-12T16:10:45.964 INFO:tasks.workunit.client.0.smithi006.stdout:5/408: truncate d7/d9/d10/f1b 5455414 0 2024-03-12T16:10:45.971 INFO:tasks.workunit.client.0.smithi006.stdout:4/564: dwrite d1/db/d1d/d2f/f97 [0,4194304] 0 2024-03-12T16:10:45.973 INFO:tasks.workunit.client.0.smithi006.stdout:5/409: write d7/d9/d10/f39 [4696144,123177] 0 2024-03-12T16:10:45.975 INFO:tasks.workunit.client.0.smithi006.stdout:9/417: read d0/d8/d16/d7d/d20/d37/f39 [796719,92215] 0 2024-03-12T16:10:45.976 INFO:tasks.workunit.client.0.smithi006.stdout:5/410: chown d7/d9/d31/d3b/d61/c73 0 1 2024-03-12T16:10:45.979 INFO:tasks.workunit.client.0.smithi006.stdout:4/565: mkdir d1/d38/db6 0 2024-03-12T16:10:45.981 INFO:tasks.workunit.client.0.smithi006.stdout:8/403: dread d2/db/d1a/d23/f60 [0,4194304] 0 2024-03-12T16:10:45.983 INFO:tasks.workunit.client.0.smithi006.stdout:7/605: dwrite de/f17 [0,4194304] 0 2024-03-12T16:10:45.988 INFO:tasks.workunit.client.0.smithi006.stdout:9/418: link d0/fc d0/d1f/f91 0 2024-03-12T16:10:45.988 INFO:tasks.workunit.client.0.smithi006.stdout:8/404: readlink d2/db/d1a/l22 0 2024-03-12T16:10:45.989 INFO:tasks.workunit.client.0.smithi006.stdout:7/606: symlink de/d2c/d4f/dba/d39/d81/lcd 0 2024-03-12T16:10:45.990 INFO:tasks.workunit.client.0.smithi006.stdout:5/411: getdents d7/d9/d47/d56/d79 0 2024-03-12T16:10:45.992 INFO:tasks.workunit.client.0.smithi006.stdout:4/566: dwrite d1/db/d1d/d2f/f97 [0,4194304] 0 2024-03-12T16:10:45.998 INFO:tasks.workunit.client.1.smithi134.stdout:5/766: stat db/c21 0 2024-03-12T16:10:45.999 INFO:tasks.workunit.client.0.smithi006.stdout:4/567: creat d1/db/d17/d43/db5/fb7 x:0 0 0 2024-03-12T16:10:45.999 INFO:tasks.workunit.client.0.smithi006.stdout:7/607: dread de/d2c/f32 [0,4194304] 0 2024-03-12T16:10:46.000 INFO:tasks.workunit.client.0.smithi006.stdout:9/419: getdents d0/d4/d70 0 2024-03-12T16:10:46.002 INFO:tasks.workunit.client.1.smithi134.stdout:2/643: creat d4/d12/fe4 x:0 0 0 2024-03-12T16:10:46.002 INFO:tasks.workunit.client.1.smithi134.stdout:1/518: dread d0/f6b [0,4194304] 0 2024-03-12T16:10:46.002 INFO:tasks.workunit.client.1.smithi134.stdout:6/700: dwrite d1/da6/d55/d97/f99 [0,4194304] 0 2024-03-12T16:10:46.003 INFO:tasks.workunit.client.0.smithi006.stdout:8/405: dwrite d2/d11/d6e/f74 [0,4194304] 0 2024-03-12T16:10:46.003 INFO:tasks.workunit.client.1.smithi134.stdout:3/828: truncate d1/db/d12/d9d/dc5/dec/f11a 233888 0 2024-03-12T16:10:46.005 INFO:tasks.workunit.client.0.smithi006.stdout:4/568: symlink d1/db/d39/lb8 0 2024-03-12T16:10:46.005 INFO:tasks.workunit.client.0.smithi006.stdout:4/569: fsync d1/f31 0 2024-03-12T16:10:46.006 INFO:tasks.workunit.client.1.smithi134.stdout:5/767: fsync db/d12/d1d/d5c/f65 0 2024-03-12T16:10:46.007 INFO:tasks.workunit.client.1.smithi134.stdout:7/704: truncate d8/d27/d9d/f86 150623 0 2024-03-12T16:10:46.007 INFO:tasks.workunit.client.1.smithi134.stdout:8/690: mknod d3/d1b/d17/d24/cf0 0 2024-03-12T16:10:46.008 INFO:tasks.workunit.client.0.smithi006.stdout:9/420: chown d0/d8/d16/d7d/d20/d37/f47 3 1 2024-03-12T16:10:46.008 INFO:tasks.workunit.client.0.smithi006.stdout:4/570: dread - d1/db/d17/d5a/d60/f7b zero size 2024-03-12T16:10:46.008 INFO:tasks.workunit.client.1.smithi134.stdout:9/702: creat d5/d10/d35/d49/fc9 x:0 0 0 2024-03-12T16:10:46.009 INFO:tasks.workunit.client.0.smithi006.stdout:4/571: dread - d1/db/d39/d42/d61/f9f zero size 2024-03-12T16:10:46.009 INFO:tasks.workunit.client.0.smithi006.stdout:7/608: symlink de/d2c/d93/dbe/d4a/d6a/lce 0 2024-03-12T16:10:46.013 INFO:tasks.workunit.client.0.smithi006.stdout:8/406: creat d2/d11/d6e/d7c/f7e x:0 0 0 2024-03-12T16:10:46.014 INFO:tasks.workunit.client.1.smithi134.stdout:9/703: fsync d5/d10/f5a 0 2024-03-12T16:10:46.014 INFO:tasks.workunit.client.0.smithi006.stdout:7/609: symlink de/d2c/d4f/d83/lcf 0 2024-03-12T16:10:46.014 INFO:tasks.workunit.client.1.smithi134.stdout:5/768: mknod db/d12/d37/db4/cec 0 2024-03-12T16:10:46.015 INFO:tasks.workunit.client.0.smithi006.stdout:8/407: write d2/fd [3842245,80452] 0 2024-03-12T16:10:46.016 INFO:tasks.workunit.client.0.smithi006.stdout:4/572: mknod d1/db/d17/d43/db5/da5/cb9 0 2024-03-12T16:10:46.018 INFO:tasks.workunit.client.0.smithi006.stdout:7/610: symlink de/ld0 0 2024-03-12T16:10:46.018 INFO:tasks.workunit.client.0.smithi006.stdout:7/611: readlink de/d1c/l41 0 2024-03-12T16:10:46.019 INFO:tasks.workunit.client.0.smithi006.stdout:8/408: symlink d2/d55/l7f 0 2024-03-12T16:10:46.020 INFO:tasks.workunit.client.1.smithi134.stdout:1/519: rename d0/d16/d9/d73/fa3 to d0/d30/d86/fb5 0 2024-03-12T16:10:46.020 INFO:tasks.workunit.client.1.smithi134.stdout:7/705: creat d8/dc/d55/db9/ff6 x:0 0 0 2024-03-12T16:10:46.021 INFO:tasks.workunit.client.1.smithi134.stdout:9/704: write d5/d10/f9b [863590,95383] 0 2024-03-12T16:10:46.022 INFO:tasks.workunit.client.0.smithi006.stdout:4/573: rename d1/db/d17/c44 to d1/db/cba 0 2024-03-12T16:10:46.024 INFO:tasks.workunit.client.1.smithi134.stdout:2/644: dwrite d4/f13 [0,4194304] 0 2024-03-12T16:10:46.024 INFO:tasks.workunit.client.0.smithi006.stdout:7/612: mkdir de/d2c/d93/dbe/d4a/dd1 0 2024-03-12T16:10:46.024 INFO:tasks.workunit.client.0.smithi006.stdout:7/613: chown de/d2c/d4f/d83/fab 599 1 2024-03-12T16:10:46.026 INFO:tasks.workunit.client.0.smithi006.stdout:7/614: chown f3 1722 1 2024-03-12T16:10:46.026 INFO:tasks.workunit.client.0.smithi006.stdout:8/409: rename d2/db/fe to d2/d11/d5a/f80 0 2024-03-12T16:10:46.026 INFO:tasks.workunit.client.1.smithi134.stdout:8/691: mknod d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/cf1 0 2024-03-12T16:10:46.026 INFO:tasks.workunit.client.1.smithi134.stdout:2/645: dread - d4/d84/d7d/fb6 zero size 2024-03-12T16:10:46.027 INFO:tasks.workunit.client.1.smithi134.stdout:9/705: chown d5/d10/d33/fb6 433560 1 2024-03-12T16:10:46.028 INFO:tasks.workunit.client.0.smithi006.stdout:8/410: chown d2/d32/c3b 0 1 2024-03-12T16:10:46.028 INFO:tasks.workunit.client.0.smithi006.stdout:2/483: sync 2024-03-12T16:10:46.028 INFO:tasks.workunit.client.0.smithi006.stdout:6/452: sync 2024-03-12T16:10:46.028 INFO:tasks.workunit.client.1.smithi134.stdout:5/769: truncate db/d12/d1d/f66 254685 0 2024-03-12T16:10:46.030 INFO:tasks.workunit.client.1.smithi134.stdout:3/829: dwrite d1/d63/dc2/f110 [0,4194304] 0 2024-03-12T16:10:46.031 INFO:tasks.workunit.client.0.smithi006.stdout:2/484: dread - d0/d13/f27 zero size 2024-03-12T16:10:46.033 INFO:tasks.workunit.client.0.smithi006.stdout:4/574: dwrite d1/db/d39/d42/d61/f9f [0,4194304] 0 2024-03-12T16:10:46.035 INFO:tasks.workunit.client.0.smithi006.stdout:8/411: getdents d2/db/d1a/d23 0 2024-03-12T16:10:46.036 INFO:tasks.workunit.client.1.smithi134.stdout:9/706: chown d5/d10/d35/d49/d54/d88/lae 15654873 1 2024-03-12T16:10:46.039 INFO:tasks.workunit.client.1.smithi134.stdout:7/706: rename d8/c18 to d8/dc/d7b/dbb/dbd/cf7 0 2024-03-12T16:10:46.040 INFO:tasks.workunit.client.0.smithi006.stdout:2/485: creat d0/dc/d64/f9c x:0 0 0 2024-03-12T16:10:46.042 INFO:tasks.workunit.client.1.smithi134.stdout:7/707: chown d8/l6b 180938 1 2024-03-12T16:10:46.042 INFO:tasks.workunit.client.0.smithi006.stdout:4/575: write d1/db/d17/d5a/f8c [5597776,26262] 0 2024-03-12T16:10:46.043 INFO:tasks.workunit.client.0.smithi006.stdout:7/615: dwrite de/f23 [0,4194304] 0 2024-03-12T16:10:46.044 INFO:tasks.workunit.client.1.smithi134.stdout:2/646: mkdir d4/d84/d63/d9d/d3d/de5 0 2024-03-12T16:10:46.045 INFO:tasks.workunit.client.0.smithi006.stdout:2/486: chown d0/dc/d64/f9c 11 1 2024-03-12T16:10:46.046 INFO:tasks.workunit.client.0.smithi006.stdout:6/453: link d3/d11/d3b/f95 d3/d11/d10/d1b/d6e/fa5 0 2024-03-12T16:10:46.048 INFO:tasks.workunit.client.1.smithi134.stdout:9/707: dwrite d5/d20/d47/fa3 [0,4194304] 0 2024-03-12T16:10:46.050 INFO:tasks.workunit.client.1.smithi134.stdout:3/830: creat d1/db/d12/f126 x:0 0 0 2024-03-12T16:10:46.051 INFO:tasks.workunit.client.1.smithi134.stdout:9/708: fsync d5/d20/f2b 0 2024-03-12T16:10:46.054 INFO:tasks.workunit.client.0.smithi006.stdout:5/412: dread d7/d9/d2c/f36 [0,4194304] 0 2024-03-12T16:10:46.055 INFO:tasks.workunit.client.0.smithi006.stdout:7/616: rename de/d2c/l30 to de/d1c/d35/ld2 0 2024-03-12T16:10:46.058 INFO:tasks.workunit.client.0.smithi006.stdout:7/617: rmdir de/d98 39 2024-03-12T16:10:46.062 INFO:tasks.workunit.client.0.smithi006.stdout:2/487: rename d0/d13/d49/d60/d2b/l76 to d0/d13/d49/d60/d2b/d62/d66/d67/l9d 0 2024-03-12T16:10:46.063 INFO:tasks.workunit.client.0.smithi006.stdout:4/576: getdents d1/db/d17/d43 0 2024-03-12T16:10:46.063 INFO:tasks.workunit.client.1.smithi134.stdout:3/831: dwrite d1/db/d14/fd4 [4194304,4194304] 0 2024-03-12T16:10:46.064 INFO:tasks.workunit.client.0.smithi006.stdout:5/413: creat d7/d8/f85 x:0 0 0 2024-03-12T16:10:46.066 INFO:tasks.workunit.client.0.smithi006.stdout:2/488: rmdir d0/d13/d49/d60/d2b/d62/d66/d67 39 2024-03-12T16:10:46.067 INFO:tasks.workunit.client.1.smithi134.stdout:4/630: dwrite d1/d24/d34/f88 [0,4194304] 0 2024-03-12T16:10:46.067 INFO:tasks.workunit.client.0.smithi006.stdout:4/577: mknod d1/d38/cbb 0 2024-03-12T16:10:46.070 INFO:tasks.workunit.client.1.smithi134.stdout:8/692: link d3/d1b/f19 d3/d1b/d17/d25/d33/d15/ff2 0 2024-03-12T16:10:46.071 INFO:tasks.workunit.client.1.smithi134.stdout:6/701: truncate d1/d16/d4c/faa 2864755 0 2024-03-12T16:10:46.071 INFO:tasks.workunit.client.0.smithi006.stdout:4/578: creat d1/db/d39/d42/fbc x:0 0 0 2024-03-12T16:10:46.072 INFO:tasks.workunit.client.1.smithi134.stdout:6/702: stat d1/da6/d55/dcc 0 2024-03-12T16:10:46.072 INFO:tasks.workunit.client.0.smithi006.stdout:5/414: dread d7/d9/d31/d3b/f3f [0,4194304] 0 2024-03-12T16:10:46.073 INFO:tasks.workunit.client.1.smithi134.stdout:3/832: read d1/db/d14/d5f/fbe [1617302,43136] 0 2024-03-12T16:10:46.076 INFO:tasks.workunit.client.1.smithi134.stdout:3/833: write d1/db/d10/d2d/d30/f11d [838802,130180] 0 2024-03-12T16:10:46.076 INFO:tasks.workunit.client.0.smithi006.stdout:5/415: creat d7/d9/d31/d3b/f86 x:0 0 0 2024-03-12T16:10:46.079 INFO:tasks.workunit.client.0.smithi006.stdout:5/416: dread - d7/d9/f7a zero size 2024-03-12T16:10:46.080 INFO:tasks.workunit.client.1.smithi134.stdout:8/693: mkdir d3/d1b/d17/d25/d33/d85/df3 0 2024-03-12T16:10:46.080 INFO:tasks.workunit.client.1.smithi134.stdout:4/631: chown d1/d13/d49/da4/f91 6720 1 2024-03-12T16:10:46.080 INFO:tasks.workunit.client.0.smithi006.stdout:5/417: write d7/d41/f5a [2860389,58405] 0 2024-03-12T16:10:46.081 INFO:tasks.workunit.client.1.smithi134.stdout:6/703: creat d1/d16/d7e/f10a x:0 0 0 2024-03-12T16:10:46.084 INFO:tasks.workunit.client.1.smithi134.stdout:6/704: stat d1/da6/d55/d85/fb0 0 2024-03-12T16:10:46.086 INFO:tasks.workunit.client.0.smithi006.stdout:5/418: fsync d7/d9/d31/d3b/f3f 0 2024-03-12T16:10:46.087 INFO:tasks.workunit.client.0.smithi006.stdout:6/454: truncate d3/d11/f31 595842 0 2024-03-12T16:10:46.087 INFO:tasks.workunit.client.0.smithi006.stdout:8/412: dread d2/db/f39 [0,4194304] 0 2024-03-12T16:10:46.088 INFO:tasks.workunit.client.0.smithi006.stdout:8/413: readlink d2/db/d1a/l29 0 2024-03-12T16:10:46.089 INFO:tasks.workunit.client.1.smithi134.stdout:4/632: creat d1/d24/d34/d73/fca x:0 0 0 2024-03-12T16:10:46.090 INFO:tasks.workunit.client.1.smithi134.stdout:8/694: read d3/d1b/d17/d25/d33/d15/d95/d5b/f8e [2422702,89549] 0 2024-03-12T16:10:46.092 INFO:tasks.workunit.client.0.smithi006.stdout:8/414: symlink d2/d55/l81 0 2024-03-12T16:10:46.092 INFO:tasks.workunit.client.1.smithi134.stdout:5/770: dwrite db/d12/d37/f98 [0,4194304] 0 2024-03-12T16:10:46.095 INFO:tasks.workunit.client.0.smithi006.stdout:5/419: link d7/d9/d10/d35/f3c d7/d41/f87 0 2024-03-12T16:10:46.097 INFO:tasks.workunit.client.1.smithi134.stdout:7/708: dread d8/f1f [0,4194304] 0 2024-03-12T16:10:46.098 INFO:tasks.workunit.client.0.smithi006.stdout:8/415: chown d2/db/d1a/d21/d2b/l6d 117942 1 2024-03-12T16:10:46.100 INFO:tasks.workunit.client.0.smithi006.stdout:6/455: dwrite d3/d11/d10/d1b/d20/f75 [0,4194304] 0 2024-03-12T16:10:46.101 INFO:tasks.workunit.client.1.smithi134.stdout:2/647: write d4/d84/d63/d9d/f4b [680543,88255] 0 2024-03-12T16:10:46.102 INFO:tasks.workunit.client.1.smithi134.stdout:4/633: fdatasync d1/d13/d49/d64/d28/f3b 0 2024-03-12T16:10:46.103 INFO:tasks.workunit.client.1.smithi134.stdout:8/695: mknod d3/d1b/d17/d25/d33/d15/cf4 0 2024-03-12T16:10:46.104 INFO:tasks.workunit.client.0.smithi006.stdout:5/420: unlink d7/d9/d2c/c5c 0 2024-03-12T16:10:46.104 INFO:tasks.workunit.client.1.smithi134.stdout:6/705: dwrite d1/d16/d7e/f10a [0,4194304] 0 2024-03-12T16:10:46.109 INFO:tasks.workunit.client.0.smithi006.stdout:8/416: creat d2/d11/f82 x:0 0 0 2024-03-12T16:10:46.109 INFO:tasks.workunit.client.0.smithi006.stdout:4/579: dread d1/db/d39/f73 [0,4194304] 0 2024-03-12T16:10:46.112 INFO:tasks.workunit.client.1.smithi134.stdout:3/834: write d1/d63/d6c/f85 [253146,13766] 0 2024-03-12T16:10:46.113 INFO:tasks.workunit.client.0.smithi006.stdout:2/489: dwrite d0/d13/f27 [0,4194304] 0 2024-03-12T16:10:46.113 INFO:tasks.workunit.client.1.smithi134.stdout:6/706: symlink d1/d16/d7e/l10b 0 2024-03-12T16:10:46.114 INFO:tasks.workunit.client.0.smithi006.stdout:5/421: unlink d7/d8/l5e 0 2024-03-12T16:10:46.116 INFO:tasks.workunit.client.1.smithi134.stdout:5/771: creat db/d12/d29/d3d/d79/da5/fed x:0 0 0 2024-03-12T16:10:46.117 INFO:tasks.workunit.client.1.smithi134.stdout:9/709: dread d5/d10/d35/d49/d8d/f75 [0,4194304] 0 2024-03-12T16:10:46.117 INFO:tasks.workunit.client.0.smithi006.stdout:6/456: symlink d3/d11/d10/d9a/la6 0 2024-03-12T16:10:46.118 INFO:tasks.workunit.client.1.smithi134.stdout:8/696: unlink d3/d1b/d17/d25/d33/d15/d95/d4f/d65/f48 0 2024-03-12T16:10:46.119 INFO:tasks.workunit.client.0.smithi006.stdout:5/422: chown d7/d9/d2c/f36 939 1 2024-03-12T16:10:46.119 INFO:tasks.workunit.client.0.smithi006.stdout:7/618: dread de/d1c/d35/f7d [0,4194304] 0 2024-03-12T16:10:46.120 INFO:tasks.workunit.client.1.smithi134.stdout:3/835: creat d1/db/d10/dca/f127 x:0 0 0 2024-03-12T16:10:46.123 INFO:tasks.workunit.client.0.smithi006.stdout:6/457: readlink d3/d11/d10/d1b/d20/d5a/d8e/d8b/l98 0 2024-03-12T16:10:46.123 INFO:tasks.workunit.client.0.smithi006.stdout:7/619: dread - de/d2c/d4f/d83/fab zero size 2024-03-12T16:10:46.123 INFO:tasks.workunit.client.0.smithi006.stdout:8/417: truncate d2/d11/f42 296442 0 2024-03-12T16:10:46.123 INFO:tasks.workunit.client.1.smithi134.stdout:6/707: mkdir d1/d3/d19/d32/d4a/d10c 0 2024-03-12T16:10:46.124 INFO:tasks.workunit.client.0.smithi006.stdout:2/490: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f9e x:0 0 0 2024-03-12T16:10:46.126 INFO:tasks.workunit.client.0.smithi006.stdout:5/423: mkdir d7/d9/d31/d3b/d4f/d80/d88 0 2024-03-12T16:10:46.126 INFO:tasks.workunit.client.1.smithi134.stdout:0/671: sync 2024-03-12T16:10:46.127 INFO:tasks.workunit.client.1.smithi134.stdout:5/772: creat db/d7d/fee x:0 0 0 2024-03-12T16:10:46.129 INFO:tasks.workunit.client.1.smithi134.stdout:3/836: creat d1/db/d10/d2d/d2e/d72/d97/f128 x:0 0 0 2024-03-12T16:10:46.131 INFO:tasks.workunit.client.1.smithi134.stdout:3/837: chown d1/db/d10/daf/f123 51 1 2024-03-12T16:10:46.131 INFO:tasks.workunit.client.0.smithi006.stdout:8/418: dread d2/d11/d5a/f5f [0,4194304] 0 2024-03-12T16:10:46.132 INFO:tasks.workunit.client.1.smithi134.stdout:5/773: fdatasync db/d12/d1d/d5c/f65 0 2024-03-12T16:10:46.133 INFO:tasks.workunit.client.0.smithi006.stdout:5/424: truncate d7/d9/d31/d3b/d4f/d65/f74 217625 0 2024-03-12T16:10:46.134 INFO:tasks.workunit.client.1.smithi134.stdout:6/708: unlink d1/d16/d4c/d58/da0/fcd 0 2024-03-12T16:10:46.134 INFO:tasks.workunit.client.0.smithi006.stdout:7/620: truncate de/d27/f69 5129614 0 2024-03-12T16:10:46.135 INFO:tasks.workunit.client.0.smithi006.stdout:4/580: dwrite d1/db/d17/d43/db5/f7a [0,4194304] 0 2024-03-12T16:10:46.135 INFO:tasks.workunit.client.0.smithi006.stdout:8/419: chown d2/db/d1a/l22 2703130 1 2024-03-12T16:10:46.136 INFO:tasks.workunit.client.1.smithi134.stdout:4/634: write d1/d13/d49/d64/d28/f5e [432672,104481] 0 2024-03-12T16:10:46.139 INFO:tasks.workunit.client.0.smithi006.stdout:7/621: chown de/d2c/d93/dbe/d4a/d6a/lb8 3079 1 2024-03-12T16:10:46.140 INFO:tasks.workunit.client.0.smithi006.stdout:7/622: readlink de/d2c/d4f/dba/d39/l92 0 2024-03-12T16:10:46.141 INFO:tasks.workunit.client.1.smithi134.stdout:4/635: write d1/fb6 [77974,123125] 0 2024-03-12T16:10:46.142 INFO:tasks.workunit.client.0.smithi006.stdout:4/581: creat d1/db/d1d/d2f/fbd x:0 0 0 2024-03-12T16:10:46.143 INFO:tasks.workunit.client.0.smithi006.stdout:7/623: truncate de/dc2/fc9 1030316 0 2024-03-12T16:10:46.144 INFO:tasks.workunit.client.1.smithi134.stdout:3/838: unlink d1/db/d14/d5a/c79 0 2024-03-12T16:10:46.147 INFO:tasks.workunit.client.1.smithi134.stdout:2/648: dread d4/d84/d63/d9d/d3d/f64 [0,4194304] 0 2024-03-12T16:10:46.147 INFO:tasks.workunit.client.1.smithi134.stdout:0/672: dwrite db/f6e [0,4194304] 0 2024-03-12T16:10:46.147 INFO:tasks.workunit.client.1.smithi134.stdout:7/709: dwrite d8/dc/d20/d26/d36/f64 [0,4194304] 0 2024-03-12T16:10:46.148 INFO:tasks.workunit.client.0.smithi006.stdout:2/491: write d0/d13/d49/d60/f36 [1377442,20922] 0 2024-03-12T16:10:46.149 INFO:tasks.workunit.client.1.smithi134.stdout:9/710: link d5/d10/d35/d49/d54/d93/l99 d5/d10/d33/da1/lca 0 2024-03-12T16:10:46.149 INFO:tasks.workunit.client.1.smithi134.stdout:4/636: write d1/d24/d34/d8e/fb4 [495470,130052] 0 2024-03-12T16:10:46.150 INFO:tasks.workunit.client.0.smithi006.stdout:4/582: chown d1/db/d17/d5a/d60/ca6 32288 1 2024-03-12T16:10:46.160 INFO:tasks.workunit.client.1.smithi134.stdout:3/839: mknod d1/c129 0 2024-03-12T16:10:46.160 INFO:tasks.workunit.client.1.smithi134.stdout:6/709: creat d1/d16/d4c/d58/da0/f10d x:0 0 0 2024-03-12T16:10:46.161 INFO:tasks.workunit.client.1.smithi134.stdout:7/710: write d8/dc/d20/d26/d36/fe4 [757076,101209] 0 2024-03-12T16:10:46.161 INFO:tasks.workunit.client.0.smithi006.stdout:8/420: dwrite d2/db/d1a/d23/f60 [0,4194304] 0 2024-03-12T16:10:46.161 INFO:tasks.workunit.client.0.smithi006.stdout:8/421: write d2/d55/f71 [555207,125805] 0 2024-03-12T16:10:46.166 INFO:tasks.workunit.client.1.smithi134.stdout:6/710: symlink d1/d4/l10e 0 2024-03-12T16:10:46.167 INFO:tasks.workunit.client.0.smithi006.stdout:2/492: creat d0/d13/d49/d60/d2b/f9f x:0 0 0 2024-03-12T16:10:46.168 INFO:tasks.workunit.client.1.smithi134.stdout:7/711: chown d8/d27/fb6 827 1 2024-03-12T16:10:46.168 INFO:tasks.workunit.client.1.smithi134.stdout:8/697: dwrite d3/d1b/d17/d24/d28/fcb [0,4194304] 0 2024-03-12T16:10:46.169 INFO:tasks.workunit.client.0.smithi006.stdout:8/422: rename d2/db/f18 to d2/d55/d7b/f83 0 2024-03-12T16:10:46.170 INFO:tasks.workunit.client.0.smithi006.stdout:7/624: dwrite de/d1c/f25 [0,4194304] 0 2024-03-12T16:10:46.172 INFO:tasks.workunit.client.0.smithi006.stdout:4/583: creat d1/db/d1d/fbe x:0 0 0 2024-03-12T16:10:46.173 INFO:tasks.workunit.client.1.smithi134.stdout:3/840: chown d1/db/d10/d2a/dc6/ddb/cf4 14808807 1 2024-03-12T16:10:46.176 INFO:tasks.workunit.client.0.smithi006.stdout:6/458: dwrite d3/d11/d10/d1b/d20/f23 [0,4194304] 0 2024-03-12T16:10:46.176 INFO:tasks.workunit.client.0.smithi006.stdout:5/425: rename d7/d9/d2c to d7/d9/d10/d24/d89 0 2024-03-12T16:10:46.178 INFO:tasks.workunit.client.0.smithi006.stdout:7/625: stat de/d2c/d4f/dba/f67 0 2024-03-12T16:10:46.178 INFO:tasks.workunit.client.0.smithi006.stdout:4/584: mkdir d1/db/d39/dbf 0 2024-03-12T16:10:46.179 INFO:tasks.workunit.client.0.smithi006.stdout:8/423: mknod d2/db/d1a/d21/d2b/c84 0 2024-03-12T16:10:46.180 INFO:tasks.workunit.client.0.smithi006.stdout:4/585: chown d1 56949839 1 2024-03-12T16:10:46.181 INFO:tasks.workunit.client.1.smithi134.stdout:9/711: dwrite d5/d10/d35/d49/f4a [0,4194304] 0 2024-03-12T16:10:46.181 INFO:tasks.workunit.client.1.smithi134.stdout:5/774: dwrite db/d12/d1d/d59/de5/fe2 [0,4194304] 0 2024-03-12T16:10:46.181 INFO:tasks.workunit.client.0.smithi006.stdout:2/493: fdatasync d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f8d 0 2024-03-12T16:10:46.187 INFO:tasks.workunit.client.1.smithi134.stdout:4/637: dread d1/d13/d49/f32 [4194304,4194304] 0 2024-03-12T16:10:46.190 INFO:tasks.workunit.client.0.smithi006.stdout:5/426: truncate d7/d9/d47/f5f 1035441 0 2024-03-12T16:10:46.191 INFO:tasks.workunit.client.0.smithi006.stdout:4/586: creat d1/db/d1d/d2f/fc0 x:0 0 0 2024-03-12T16:10:46.191 INFO:tasks.workunit.client.1.smithi134.stdout:4/638: fdatasync d1/d13/d49/d53/fb2 0 2024-03-12T16:10:46.191 INFO:tasks.workunit.client.1.smithi134.stdout:7/712: dwrite d8/dc/d4b/fb5 [0,4194304] 0 2024-03-12T16:10:46.194 INFO:tasks.workunit.client.1.smithi134.stdout:3/841: mknod d1/db/d10/d2a/c12a 0 2024-03-12T16:10:46.195 INFO:tasks.workunit.client.1.smithi134.stdout:5/775: creat db/d12/d37/d71/d90/fef x:0 0 0 2024-03-12T16:10:46.195 INFO:tasks.workunit.client.1.smithi134.stdout:8/698: rename d3/d1b/d17/d25/d33/d15/d95/d4f/d65/l5a to d3/d10/de5/lf5 0 2024-03-12T16:10:46.198 INFO:tasks.workunit.client.0.smithi006.stdout:8/424: truncate d2/d55/d7b/f83 819182 0 2024-03-12T16:10:46.198 INFO:tasks.workunit.client.0.smithi006.stdout:6/459: dread d3/d11/d10/d1b/d6e/f2e [0,4194304] 0 2024-03-12T16:10:46.200 INFO:tasks.workunit.client.0.smithi006.stdout:8/425: chown d2/d11/d5a/f80 1513 1 2024-03-12T16:10:46.200 INFO:tasks.workunit.client.0.smithi006.stdout:2/494: creat d0/d13/d49/d60/d2b/d62/d66/d67/fa0 x:0 0 0 2024-03-12T16:10:46.200 INFO:tasks.workunit.client.0.smithi006.stdout:1/512: sync 2024-03-12T16:10:46.202 INFO:tasks.workunit.client.0.smithi006.stdout:3/431: sync 2024-03-12T16:10:46.202 INFO:tasks.workunit.client.0.smithi006.stdout:0/475: sync 2024-03-12T16:10:46.202 INFO:tasks.workunit.client.0.smithi006.stdout:9/421: sync 2024-03-12T16:10:46.202 INFO:tasks.workunit.client.0.smithi006.stdout:4/587: symlink d1/db/d17/lc1 0 2024-03-12T16:10:46.204 INFO:tasks.workunit.client.0.smithi006.stdout:5/427: mkdir d7/d8/d8a 0 2024-03-12T16:10:46.205 INFO:tasks.workunit.client.0.smithi006.stdout:8/426: mknod d2/c85 0 2024-03-12T16:10:46.206 INFO:tasks.workunit.client.0.smithi006.stdout:7/626: dread de/f17 [0,4194304] 0 2024-03-12T16:10:46.209 INFO:tasks.workunit.client.1.smithi134.stdout:2/649: dread d4/d12/f20 [0,4194304] 0 2024-03-12T16:10:46.209 INFO:tasks.workunit.client.1.smithi134.stdout:1/520: sync 2024-03-12T16:10:46.210 INFO:tasks.workunit.client.0.smithi006.stdout:2/495: creat d0/d13/d49/fa1 x:0 0 0 2024-03-12T16:10:46.211 INFO:tasks.workunit.client.1.smithi134.stdout:8/699: write d3/d1b/d17/d24/f6f [760091,16423] 0 2024-03-12T16:10:46.211 INFO:tasks.workunit.client.1.smithi134.stdout:9/712: chown d5/d10/d35/d49/d8d/la0 8 1 2024-03-12T16:10:46.212 INFO:tasks.workunit.client.1.smithi134.stdout:1/521: read - d0/d30/d86/fb5 zero size 2024-03-12T16:10:46.213 INFO:tasks.workunit.client.0.smithi006.stdout:7/627: mkdir de/d2c/dd3 0 2024-03-12T16:10:46.214 INFO:tasks.workunit.client.1.smithi134.stdout:2/650: dread - d4/d12/d39/fd2 zero size 2024-03-12T16:10:46.215 INFO:tasks.workunit.client.0.smithi006.stdout:5/428: unlink d7/d9/d31/d3b/d4f/l50 0 2024-03-12T16:10:46.216 INFO:tasks.workunit.client.1.smithi134.stdout:9/713: write d5/d20/f87 [4336614,125907] 0 2024-03-12T16:10:46.216 INFO:tasks.workunit.client.1.smithi134.stdout:0/673: dwrite db/f3c [0,4194304] 0 2024-03-12T16:10:46.222 INFO:tasks.workunit.client.0.smithi006.stdout:1/513: creat d0/d25/fae x:0 0 0 2024-03-12T16:10:46.222 INFO:tasks.workunit.client.0.smithi006.stdout:6/460: rename d3/d11/d10/d1b/d20/d5a to d3/d11/d10/da7 0 2024-03-12T16:10:46.223 INFO:tasks.workunit.client.1.smithi134.stdout:2/651: readlink d4/d12/l7b 0 2024-03-12T16:10:46.224 INFO:tasks.workunit.client.0.smithi006.stdout:7/628: creat de/d27/d7c/fd4 x:0 0 0 2024-03-12T16:10:46.224 INFO:tasks.workunit.client.1.smithi134.stdout:7/713: dread d8/d4e/f82 [0,4194304] 0 2024-03-12T16:10:46.228 INFO:tasks.workunit.client.0.smithi006.stdout:5/429: chown d7/d9/d10/d24/f3e 1 1 2024-03-12T16:10:46.228 INFO:tasks.workunit.client.1.smithi134.stdout:9/714: fsync d5/d10/d33/fbe 0 2024-03-12T16:10:46.228 INFO:tasks.workunit.client.0.smithi006.stdout:9/422: dwrite d0/d4/f25 [0,4194304] 0 2024-03-12T16:10:46.230 INFO:tasks.workunit.client.1.smithi134.stdout:4/639: mknod d1/d13/d49/d64/d28/ccb 0 2024-03-12T16:10:46.232 INFO:tasks.workunit.client.0.smithi006.stdout:8/427: dwrite d2/d11/d6e/d7c/f7e [0,4194304] 0 2024-03-12T16:10:46.233 INFO:tasks.workunit.client.1.smithi134.stdout:8/700: mknod d3/d1b/d17/d25/d33/d15/d95/d4f/d65/cf6 0 2024-03-12T16:10:46.234 INFO:tasks.workunit.client.0.smithi006.stdout:3/432: dwrite d8/f17 [0,4194304] 0 2024-03-12T16:10:46.235 INFO:tasks.workunit.client.1.smithi134.stdout:1/522: creat d0/d16/d9/d13/d38/fb6 x:0 0 0 2024-03-12T16:10:46.236 INFO:tasks.workunit.client.1.smithi134.stdout:4/640: write d1/d24/d34/d73/fca [728586,24571] 0 2024-03-12T16:10:46.236 INFO:tasks.workunit.client.1.smithi134.stdout:5/776: mkdir db/d12/d1d/d59/d94/ddb/df0 0 2024-03-12T16:10:46.237 INFO:tasks.workunit.client.0.smithi006.stdout:8/428: chown d2/db/d1a/d21/d4f/f5c 13 1 2024-03-12T16:10:46.237 INFO:tasks.workunit.client.0.smithi006.stdout:9/423: write d0/d8/d16/d2f/f4c [1013897,80622] 0 2024-03-12T16:10:46.243 INFO:tasks.workunit.client.1.smithi134.stdout:6/711: dread d1/d16/d4c/d65/f6b [0,4194304] 0 2024-03-12T16:10:46.243 INFO:tasks.workunit.client.1.smithi134.stdout:0/674: rename db/d2f/d31/f85 to db/d2f/d31/d76/fd9 0 2024-03-12T16:10:46.243 INFO:tasks.workunit.client.1.smithi134.stdout:9/715: unlink d5/d20/d72/c96 0 2024-03-12T16:10:46.244 INFO:tasks.workunit.client.1.smithi134.stdout:3/842: getdents d1/db/d14 0 2024-03-12T16:10:46.248 INFO:tasks.workunit.client.0.smithi006.stdout:0/476: rename d2/d6/d10/l41 to d2/d39/l8a 0 2024-03-12T16:10:46.249 INFO:tasks.workunit.client.0.smithi006.stdout:2/496: truncate d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f96 819623 0 2024-03-12T16:10:46.250 INFO:tasks.workunit.client.1.smithi134.stdout:1/523: mkdir d0/d16/d9/d51/db7 0 2024-03-12T16:10:46.250 INFO:tasks.workunit.client.1.smithi134.stdout:7/714: dwrite d8/d27/d9d/dc9/fd0 [0,4194304] 0 2024-03-12T16:10:46.250 INFO:tasks.workunit.client.0.smithi006.stdout:9/424: fsync d0/d4/d18/f44 0 2024-03-12T16:10:46.253 INFO:tasks.workunit.client.0.smithi006.stdout:1/514: write d0/d25/d2a/f4d [1241463,30329] 0 2024-03-12T16:10:46.254 INFO:tasks.workunit.client.1.smithi134.stdout:8/701: write d3/d1b/d17/d24/db6/dd9/fb7 [789890,68790] 0 2024-03-12T16:10:46.254 INFO:tasks.workunit.client.1.smithi134.stdout:5/777: mknod db/d12/d29/d3d/d79/da5/dc0/cf1 0 2024-03-12T16:10:46.255 INFO:tasks.workunit.client.0.smithi006.stdout:5/430: truncate d7/d9/f16 4737104 0 2024-03-12T16:10:46.256 INFO:tasks.workunit.client.0.smithi006.stdout:1/515: dread - d0/d25/d2a/d43/faa zero size 2024-03-12T16:10:46.260 INFO:tasks.workunit.client.0.smithi006.stdout:9/425: creat d0/d83/f92 x:0 0 0 2024-03-12T16:10:46.261 INFO:tasks.workunit.client.0.smithi006.stdout:8/429: dread d2/db/d1a/d21/d4f/f5c [0,4194304] 0 2024-03-12T16:10:46.262 INFO:tasks.workunit.client.1.smithi134.stdout:2/652: link d4/d12/d3b/d3f/l65 d4/d12/d1d/d34/d47/d8c/le6 0 2024-03-12T16:10:46.263 INFO:tasks.workunit.client.0.smithi006.stdout:9/426: fsync d0/d4/d3b/f4b 0 2024-03-12T16:10:46.264 INFO:tasks.workunit.client.0.smithi006.stdout:9/427: chown d0/d8/d16/d2f 210124 1 2024-03-12T16:10:46.264 INFO:tasks.workunit.client.0.smithi006.stdout:0/477: link d2/d6/d10/d11/f84 d2/d39/d42/d82/f8b 0 2024-03-12T16:10:46.265 INFO:tasks.workunit.client.0.smithi006.stdout:4/588: rename d1/d38/d79/f55 to d1/db/d17/fc2 0 2024-03-12T16:10:46.266 INFO:tasks.workunit.client.1.smithi134.stdout:1/524: dwrite d0/d30/fb4 [0,4194304] 0 2024-03-12T16:10:46.268 INFO:tasks.workunit.client.0.smithi006.stdout:8/430: creat d2/d32/f86 x:0 0 0 2024-03-12T16:10:46.269 INFO:tasks.workunit.client.1.smithi134.stdout:4/641: unlink d1/de/d5a/d70/lbf 0 2024-03-12T16:10:46.270 INFO:tasks.workunit.client.1.smithi134.stdout:5/778: symlink db/d7a/dc4/lf2 0 2024-03-12T16:10:46.271 INFO:tasks.workunit.client.0.smithi006.stdout:0/478: fdatasync d2/d6/d10/d11/d32/f38 0 2024-03-12T16:10:46.272 INFO:tasks.workunit.client.1.smithi134.stdout:6/712: symlink d1/def/l10f 0 2024-03-12T16:10:46.273 INFO:tasks.workunit.client.1.smithi134.stdout:8/702: dread d3/d1b/d17/d25/d33/f8f [0,4194304] 0 2024-03-12T16:10:46.273 INFO:tasks.workunit.client.1.smithi134.stdout:0/675: dwrite db/d2f/d31/d76/d9f/fb8 [0,4194304] 0 2024-03-12T16:10:46.274 INFO:tasks.workunit.client.1.smithi134.stdout:3/843: rename d1/db/d10/d2d/d2e/l53 to d1/db/l12b 0 2024-03-12T16:10:46.275 INFO:tasks.workunit.client.1.smithi134.stdout:4/642: chown d1/d13/d49/d64/d28/ccb 4 1 2024-03-12T16:10:46.276 INFO:tasks.workunit.client.1.smithi134.stdout:2/653: symlink d4/d84/d63/dde/le7 0 2024-03-12T16:10:46.278 INFO:tasks.workunit.client.0.smithi006.stdout:2/497: link d0/d13/d49/d60/d2b/d62/d66/d69/d81/f99 d0/d13/d49/d60/d2b/d62/fa2 0 2024-03-12T16:10:46.278 INFO:tasks.workunit.client.0.smithi006.stdout:4/589: dwrite d1/db/d17/f74 [0,4194304] 0 2024-03-12T16:10:46.279 INFO:tasks.workunit.client.0.smithi006.stdout:6/461: rename d3/d11/d10/f72 to d3/d11/d10/d1b/d20/fa8 0 2024-03-12T16:10:46.280 INFO:tasks.workunit.client.1.smithi134.stdout:4/643: symlink d1/de/d90/lcc 0 2024-03-12T16:10:46.283 INFO:tasks.workunit.client.1.smithi134.stdout:2/654: read d4/d12/d43/da2/f53 [607612,127648] 0 2024-03-12T16:10:46.284 INFO:tasks.workunit.client.1.smithi134.stdout:1/525: creat d0/d30/fb8 x:0 0 0 2024-03-12T16:10:46.285 INFO:tasks.workunit.client.0.smithi006.stdout:1/516: getdents d0/d25 0 2024-03-12T16:10:46.286 INFO:tasks.workunit.client.1.smithi134.stdout:6/713: mkdir d1/d16/d100/d110 0 2024-03-12T16:10:46.288 INFO:tasks.workunit.client.1.smithi134.stdout:7/715: write d8/ff [304864,44582] 0 2024-03-12T16:10:46.289 INFO:tasks.workunit.client.0.smithi006.stdout:9/428: dwrite d0/d1f/f6d [0,4194304] 0 2024-03-12T16:10:46.289 INFO:tasks.workunit.client.1.smithi134.stdout:4/644: fdatasync d1/d13/d49/d64/d28/f3f 0 2024-03-12T16:10:46.290 INFO:tasks.workunit.client.0.smithi006.stdout:7/629: rename de/l5e to de/d2c/d4f/dba/d39/ld5 0 2024-03-12T16:10:46.290 INFO:tasks.workunit.client.0.smithi006.stdout:1/517: dread - d0/d25/f9e zero size 2024-03-12T16:10:46.290 INFO:tasks.workunit.client.1.smithi134.stdout:9/716: dread d5/d10/d35/d49/d8d/fbf [0,4194304] 0 2024-03-12T16:10:46.291 INFO:tasks.workunit.client.1.smithi134.stdout:3/844: mknod d1/db/d10/d2a/dc6/df1/c12c 0 2024-03-12T16:10:46.294 INFO:tasks.workunit.client.1.smithi134.stdout:8/703: dwrite d3/db0/fbe [0,4194304] 0 2024-03-12T16:10:46.298 INFO:tasks.workunit.client.0.smithi006.stdout:6/462: fdatasync d3/d11/d43/f5c 0 2024-03-12T16:10:46.299 INFO:tasks.workunit.client.1.smithi134.stdout:4/645: write d1/d24/d34/d73/f8d [2193927,105568] 0 2024-03-12T16:10:46.299 INFO:tasks.workunit.client.1.smithi134.stdout:5/779: dwrite db/d12/d29/d3d/d79/fd6 [0,4194304] 0 2024-03-12T16:10:46.302 INFO:tasks.workunit.client.0.smithi006.stdout:1/518: symlink d0/d25/d67/d8d/laf 0 2024-03-12T16:10:46.303 INFO:tasks.workunit.client.0.smithi006.stdout:9/429: truncate d0/d4/d18/d4d/f75 395816 0 2024-03-12T16:10:46.305 INFO:tasks.workunit.client.0.smithi006.stdout:0/479: getdents d2/d39 0 2024-03-12T16:10:46.306 INFO:tasks.workunit.client.0.smithi006.stdout:1/519: fdatasync d0/d25/d2a/d43/fa7 0 2024-03-12T16:10:46.308 INFO:tasks.workunit.client.0.smithi006.stdout:4/590: dwrite d1/db/f22 [0,4194304] 0 2024-03-12T16:10:46.311 INFO:tasks.workunit.client.0.smithi006.stdout:6/463: creat d3/d11/d3b/fa9 x:0 0 0 2024-03-12T16:10:46.311 INFO:tasks.workunit.client.0.smithi006.stdout:5/431: rename d7/l45 to d7/d9/d31/d3b/d4f/d80/l8b 0 2024-03-12T16:10:46.311 INFO:tasks.workunit.client.1.smithi134.stdout:7/716: dread d8/dc/d20/d26/d36/f64 [0,4194304] 0 2024-03-12T16:10:46.311 INFO:tasks.workunit.client.1.smithi134.stdout:7/717: readlink d8/d4e/l7a 0 2024-03-12T16:10:46.312 INFO:tasks.workunit.client.1.smithi134.stdout:8/704: creat d3/d10/d31/ff7 x:0 0 0 2024-03-12T16:10:46.312 INFO:tasks.workunit.client.1.smithi134.stdout:3/845: read d1/db/d10/f1f [2246427,49865] 0 2024-03-12T16:10:46.312 INFO:tasks.workunit.client.1.smithi134.stdout:8/705: write d3/d10/d31/d9b/fd0 [4038805,82623] 0 2024-03-12T16:10:46.313 INFO:tasks.workunit.client.1.smithi134.stdout:4/646: creat d1/d13/d49/d6d/d96/fcd x:0 0 0 2024-03-12T16:10:46.313 INFO:tasks.workunit.client.1.smithi134.stdout:5/780: rmdir db/d12/d1d/d3a/d70/d99 39 2024-03-12T16:10:46.314 INFO:tasks.workunit.client.1.smithi134.stdout:6/714: fdatasync d1/d4/fac 0 2024-03-12T16:10:46.317 INFO:tasks.workunit.client.0.smithi006.stdout:2/498: dwrite d0/d13/f1d [4194304,4194304] 0 2024-03-12T16:10:46.317 INFO:tasks.workunit.client.0.smithi006.stdout:6/464: stat d3/d11/d10/f7b 0 2024-03-12T16:10:46.318 INFO:tasks.workunit.client.1.smithi134.stdout:2/655: rename d4/d12/d1d/d8d to d4/de8 0 2024-03-12T16:10:46.318 INFO:tasks.workunit.client.0.smithi006.stdout:7/630: getdents de/d2c/d93/dbe/d4a/dd1 0 2024-03-12T16:10:46.320 INFO:tasks.workunit.client.0.smithi006.stdout:0/480: creat d2/d39/f8c x:0 0 0 2024-03-12T16:10:46.321 INFO:tasks.workunit.client.1.smithi134.stdout:5/781: chown db/d12/d1d/d3a/f88 0 1 2024-03-12T16:10:46.321 INFO:tasks.workunit.client.1.smithi134.stdout:2/656: write d4/d12/d1d/f97 [961599,11824] 0 2024-03-12T16:10:46.321 INFO:tasks.workunit.client.1.smithi134.stdout:8/706: creat d3/d10/de5/ff8 x:0 0 0 2024-03-12T16:10:46.322 INFO:tasks.workunit.client.0.smithi006.stdout:1/520: mkdir d0/d25/d67/db0 0 2024-03-12T16:10:46.323 INFO:tasks.workunit.client.0.smithi006.stdout:2/499: symlink d0/dc/d64/la3 0 2024-03-12T16:10:46.324 INFO:tasks.workunit.client.1.smithi134.stdout:2/657: stat d4/fa 0 2024-03-12T16:10:46.325 INFO:tasks.workunit.client.1.smithi134.stdout:6/715: dread - d1/d16/d4c/d58/da0/db7/f9f zero size 2024-03-12T16:10:46.325 INFO:tasks.workunit.client.1.smithi134.stdout:7/718: dread d8/dc/fcf [0,4194304] 0 2024-03-12T16:10:46.326 INFO:tasks.workunit.client.1.smithi134.stdout:4/647: write d1/d13/d49/d64/d28/d4f/d67/f86 [1725675,63930] 0 2024-03-12T16:10:46.333 INFO:tasks.workunit.client.1.smithi134.stdout:5/782: truncate db/d7d/f7c 5813956 0 2024-03-12T16:10:46.335 INFO:tasks.workunit.client.1.smithi134.stdout:6/716: mknod d1/d3/d19/d32/dd9/c111 0 2024-03-12T16:10:46.337 INFO:tasks.workunit.client.1.smithi134.stdout:7/719: stat d8/d4e/f74 0 2024-03-12T16:10:46.338 INFO:tasks.workunit.client.1.smithi134.stdout:8/707: dwrite d3/d1b/d17/d25/d33/f8f [0,4194304] 0 2024-03-12T16:10:46.338 INFO:tasks.workunit.client.1.smithi134.stdout:3/846: dwrite d1/d63/d6c/fcd [0,4194304] 0 2024-03-12T16:10:46.341 INFO:tasks.workunit.client.1.smithi134.stdout:5/783: creat db/ff3 x:0 0 0 2024-03-12T16:10:46.342 INFO:tasks.workunit.client.1.smithi134.stdout:2/658: dread d4/d12/d1d/f21 [0,4194304] 0 2024-03-12T16:10:46.345 INFO:tasks.workunit.client.1.smithi134.stdout:4/648: link d1/d13/d49/d64/d28/cc4 d1/d24/d34/cce 0 2024-03-12T16:10:46.346 INFO:tasks.workunit.client.1.smithi134.stdout:8/708: dread - d3/d1b/d17/d25/d33/d15/d95/d4f/f70 zero size 2024-03-12T16:10:46.349 INFO:tasks.workunit.client.1.smithi134.stdout:3/847: mknod d1/db/d10/d2a/dc6/ddb/c12d 0 2024-03-12T16:10:46.349 INFO:tasks.workunit.client.1.smithi134.stdout:2/659: creat d4/d12/d3b/fe9 x:0 0 0 2024-03-12T16:10:46.353 INFO:tasks.workunit.client.1.smithi134.stdout:2/660: mkdir d4/de8/dea 0 2024-03-12T16:10:46.353 INFO:tasks.workunit.client.1.smithi134.stdout:7/720: dread d8/d4e/f74 [0,4194304] 0 2024-03-12T16:10:46.354 INFO:tasks.workunit.client.1.smithi134.stdout:3/848: creat d1/db/d12/d9d/dc5/f12e x:0 0 0 2024-03-12T16:10:46.355 INFO:tasks.workunit.client.1.smithi134.stdout:4/649: creat d1/d13/d49/d64/fcf x:0 0 0 2024-03-12T16:10:46.355 INFO:tasks.workunit.client.1.smithi134.stdout:6/717: dread d1/d16/d4c/d58/fad [0,4194304] 0 2024-03-12T16:10:46.356 INFO:tasks.workunit.client.1.smithi134.stdout:8/709: creat d3/d1b/ff9 x:0 0 0 2024-03-12T16:10:46.356 INFO:tasks.workunit.client.1.smithi134.stdout:2/661: truncate d4/d12/d3b/d9b/fcd 1061863 0 2024-03-12T16:10:46.357 INFO:tasks.workunit.client.1.smithi134.stdout:7/721: mkdir d8/dc/d7b/df8 0 2024-03-12T16:10:46.358 INFO:tasks.workunit.client.1.smithi134.stdout:4/650: readlink d1/d13/d49/da4/l72 0 2024-03-12T16:10:46.359 INFO:tasks.workunit.client.1.smithi134.stdout:7/722: chown d8/d27/d9d/lc0 119568297 1 2024-03-12T16:10:46.359 INFO:tasks.workunit.client.1.smithi134.stdout:3/849: unlink d1/db/d10/d2d/ce2 0 2024-03-12T16:10:46.359 INFO:tasks.workunit.client.1.smithi134.stdout:4/651: chown d1/d13/f26 280 1 2024-03-12T16:10:46.362 INFO:tasks.workunit.client.1.smithi134.stdout:2/662: creat d4/d12/d1d/d34/db7/feb x:0 0 0 2024-03-12T16:10:46.363 INFO:tasks.workunit.client.1.smithi134.stdout:3/850: chown d1/db/d10/d2a/l80 488507 1 2024-03-12T16:10:46.365 INFO:tasks.workunit.client.1.smithi134.stdout:2/663: chown d4/d12/d3b/f8f 4716 1 2024-03-12T16:10:46.365 INFO:tasks.workunit.client.1.smithi134.stdout:5/784: read db/d12/d1d/f31 [68140,34501] 0 2024-03-12T16:10:46.365 INFO:tasks.workunit.client.1.smithi134.stdout:4/652: fdatasync d1/d13/f39 0 2024-03-12T16:10:46.365 INFO:tasks.workunit.client.1.smithi134.stdout:8/710: creat d3/d1b/d17/d25/ffa x:0 0 0 2024-03-12T16:10:46.367 INFO:tasks.workunit.client.1.smithi134.stdout:4/653: truncate d1/d13/f26 8908089 0 2024-03-12T16:10:46.368 INFO:tasks.workunit.client.1.smithi134.stdout:3/851: dread - d1/db/d10/d111/f120 zero size 2024-03-12T16:10:46.369 INFO:tasks.workunit.client.0.smithi006.stdout:3/433: dwrite d8/d19/d26/d59/d2c/f13 [0,4194304] 0 2024-03-12T16:10:46.370 INFO:tasks.workunit.client.1.smithi134.stdout:8/711: readlink d3/d1b/d17/l86 0 2024-03-12T16:10:46.372 INFO:tasks.workunit.client.0.smithi006.stdout:7/631: truncate de/d2c/d4f/dba/f76 747469 0 2024-03-12T16:10:46.374 INFO:tasks.workunit.client.1.smithi134.stdout:5/785: dread db/d12/d29/d3d/d79/fd6 [0,4194304] 0 2024-03-12T16:10:46.375 INFO:tasks.workunit.client.0.smithi006.stdout:8/431: rename d2/d11/f27 to d2/db/d1a/d21/f87 0 2024-03-12T16:10:46.376 INFO:tasks.workunit.client.1.smithi134.stdout:2/664: truncate d4/d12/d1d/f8a 548982 0 2024-03-12T16:10:46.377 INFO:tasks.workunit.client.0.smithi006.stdout:1/521: mkdir d0/d25/db1 0 2024-03-12T16:10:46.379 INFO:tasks.workunit.client.1.smithi134.stdout:8/712: fsync d3/d1b/f14 0 2024-03-12T16:10:46.380 INFO:tasks.workunit.client.0.smithi006.stdout:2/500: mknod d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/ca4 0 2024-03-12T16:10:46.381 INFO:tasks.workunit.client.1.smithi134.stdout:4/654: dwrite d1/d13/d49/f32 [0,4194304] 0 2024-03-12T16:10:46.381 INFO:tasks.workunit.client.0.smithi006.stdout:7/632: creat de/d7b/fd6 x:0 0 0 2024-03-12T16:10:46.383 INFO:tasks.workunit.client.0.smithi006.stdout:2/501: write d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f8d [751713,11707] 0 2024-03-12T16:10:46.383 INFO:tasks.workunit.client.1.smithi134.stdout:5/786: rmdir db/d7a/dc4 39 2024-03-12T16:10:46.384 INFO:tasks.workunit.client.1.smithi134.stdout:2/665: mkdir d4/d12/d43/dec 0 2024-03-12T16:10:46.386 INFO:tasks.workunit.client.1.smithi134.stdout:0/676: write db/d2f/d61/d7a/f84 [773258,31144] 0 2024-03-12T16:10:46.388 INFO:tasks.workunit.client.1.smithi134.stdout:4/655: read d1/de/f36 [3232081,115702] 0 2024-03-12T16:10:46.389 INFO:tasks.workunit.client.0.smithi006.stdout:3/434: creat d8/d19/f9b x:0 0 0 2024-03-12T16:10:46.391 INFO:tasks.workunit.client.0.smithi006.stdout:2/502: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/la5 0 2024-03-12T16:10:46.392 INFO:tasks.workunit.client.1.smithi134.stdout:1/526: dwrite d0/d30/d86/f61 [8388608,4194304] 0 2024-03-12T16:10:46.392 INFO:tasks.workunit.client.1.smithi134.stdout:5/787: readlink db/d7a/dc4/ldc 0 2024-03-12T16:10:46.393 INFO:tasks.workunit.client.0.smithi006.stdout:7/633: mkdir de/d2c/d93/dbe/d4a/dbf/dd7 0 2024-03-12T16:10:46.394 INFO:tasks.workunit.client.1.smithi134.stdout:4/656: symlink d1/d13/d49/da4/ld0 0 2024-03-12T16:10:46.395 INFO:tasks.workunit.client.0.smithi006.stdout:9/430: dwrite d0/f28 [0,4194304] 0 2024-03-12T16:10:46.395 INFO:tasks.workunit.client.1.smithi134.stdout:5/788: readlink db/d12/d29/d3d/d79/da5/dc0/ld5 0 2024-03-12T16:10:46.397 INFO:tasks.workunit.client.0.smithi006.stdout:8/432: dread d2/db/d1a/d1f/f3c [0,4194304] 0 2024-03-12T16:10:46.397 INFO:tasks.workunit.client.0.smithi006.stdout:3/435: truncate d8/d52/d6c/f83 1150622 0 2024-03-12T16:10:46.398 INFO:tasks.workunit.client.0.smithi006.stdout:0/481: dread - d2/d39/f63 zero size 2024-03-12T16:10:46.399 INFO:tasks.workunit.client.0.smithi006.stdout:0/482: readlink d2/l20 0 2024-03-12T16:10:46.401 INFO:tasks.workunit.client.1.smithi134.stdout:7/723: dread d8/dc/d20/d26/d36/fc1 [0,4194304] 0 2024-03-12T16:10:46.401 INFO:tasks.workunit.client.1.smithi134.stdout:2/666: dwrite d4/d84/fdf [0,4194304] 0 2024-03-12T16:10:46.401 INFO:tasks.workunit.client.0.smithi006.stdout:2/503: truncate d0/d13/f2e 5612175 0 2024-03-12T16:10:46.402 INFO:tasks.workunit.client.0.smithi006.stdout:0/483: write d2/d6/f72 [245615,103075] 0 2024-03-12T16:10:46.405 INFO:tasks.workunit.client.0.smithi006.stdout:6/465: truncate d3/d11/d10/da7/d8e/f7a 1586366 0 2024-03-12T16:10:46.407 INFO:tasks.workunit.client.1.smithi134.stdout:5/789: unlink db/d12/d1d/d3a/d4e/lbd 0 2024-03-12T16:10:46.408 INFO:tasks.workunit.client.0.smithi006.stdout:9/431: dread d0/d1f/f6d [0,4194304] 0 2024-03-12T16:10:46.412 INFO:tasks.workunit.client.1.smithi134.stdout:1/527: dwrite d0/d16/d9/d13/f7f [0,4194304] 0 2024-03-12T16:10:46.415 INFO:tasks.workunit.client.0.smithi006.stdout:6/466: dread d3/d11/d10/d28/d45/f85 [0,4194304] 0 2024-03-12T16:10:46.416 INFO:tasks.workunit.client.0.smithi006.stdout:3/436: symlink d8/d19/d26/d59/l9c 0 2024-03-12T16:10:46.417 INFO:tasks.workunit.client.1.smithi134.stdout:7/724: fsync d8/dc/d4b/fd2 0 2024-03-12T16:10:46.419 INFO:tasks.workunit.client.0.smithi006.stdout:3/437: chown d8/d19/d26/d59/d2c/dc/d28/d2f/l98 87 1 2024-03-12T16:10:46.420 INFO:tasks.workunit.client.1.smithi134.stdout:6/718: write d1/d4/f47 [316756,65012] 0 2024-03-12T16:10:46.420 INFO:tasks.workunit.client.0.smithi006.stdout:5/432: link d7/d9/d10/l54 d7/d9/d31/d3b/d6b/l8c 0 2024-03-12T16:10:46.420 INFO:tasks.workunit.client.0.smithi006.stdout:3/438: fdatasync d8/d19/d26/d59/d2c/f9a 0 2024-03-12T16:10:46.421 INFO:tasks.workunit.client.0.smithi006.stdout:3/439: readlink d8/l16 0 2024-03-12T16:10:46.423 INFO:tasks.workunit.client.1.smithi134.stdout:1/528: mknod d0/d16/d9/d51/db7/cb9 0 2024-03-12T16:10:46.423 INFO:tasks.workunit.client.0.smithi006.stdout:0/484: symlink d2/d6/d10/d11/d7e/l8d 0 2024-03-12T16:10:46.424 INFO:tasks.workunit.client.1.smithi134.stdout:7/725: dread - d8/d27/d9d/fe9 zero size 2024-03-12T16:10:46.425 INFO:tasks.workunit.client.0.smithi006.stdout:6/467: mkdir d3/d11/d10/da7/d9e/daa 0 2024-03-12T16:10:46.425 INFO:tasks.workunit.client.1.smithi134.stdout:5/790: getdents db/d12/d37/d71/d90 0 2024-03-12T16:10:46.426 INFO:tasks.workunit.client.0.smithi006.stdout:7/634: getdents de/d2c/d4f 0 2024-03-12T16:10:46.427 INFO:tasks.workunit.client.0.smithi006.stdout:3/440: mkdir d8/d19/d26/d59/d2c/dc/d28/d2f/d9d 0 2024-03-12T16:10:46.428 INFO:tasks.workunit.client.1.smithi134.stdout:5/791: chown db/d12/l46 2069903 1 2024-03-12T16:10:46.428 INFO:tasks.workunit.client.1.smithi134.stdout:6/719: mknod d1/d3/d10/c112 0 2024-03-12T16:10:46.429 INFO:tasks.workunit.client.1.smithi134.stdout:2/667: dwrite d4/d12/d1d/d34/d47/d8c/da4/fdb [0,4194304] 0 2024-03-12T16:10:46.429 INFO:tasks.workunit.client.1.smithi134.stdout:7/726: mkdir d8/dc/d20/d26/d36/df9 0 2024-03-12T16:10:46.430 INFO:tasks.workunit.client.0.smithi006.stdout:1/522: read d0/d25/d2a/d43/f8f [3767063,45735] 0 2024-03-12T16:10:46.434 INFO:tasks.workunit.client.1.smithi134.stdout:3/852: dwrite d1/db/d14/f7b [0,4194304] 0 2024-03-12T16:10:46.434 INFO:tasks.workunit.client.0.smithi006.stdout:3/441: dread - d8/d19/d26/d59/d2c/dc/d28/f90 zero size 2024-03-12T16:10:46.434 INFO:tasks.workunit.client.0.smithi006.stdout:0/485: creat d2/d6/d10/d11/d1d/f8e x:0 0 0 2024-03-12T16:10:46.440 INFO:tasks.workunit.client.1.smithi134.stdout:2/668: creat d4/d12/d3b/fed x:0 0 0 2024-03-12T16:10:46.441 INFO:tasks.workunit.client.1.smithi134.stdout:7/727: mknod d8/dc/d20/d26/cfa 0 2024-03-12T16:10:46.442 INFO:tasks.workunit.client.1.smithi134.stdout:3/853: mknod d1/d63/dc2/d117/c12f 0 2024-03-12T16:10:46.442 INFO:tasks.workunit.client.0.smithi006.stdout:6/468: dwrite d3/d11/d10/da7/f74 [0,4194304] 0 2024-03-12T16:10:46.443 INFO:tasks.workunit.client.1.smithi134.stdout:5/792: creat db/d12/d1d/d3a/ff4 x:0 0 0 2024-03-12T16:10:46.446 INFO:tasks.workunit.client.1.smithi134.stdout:6/720: dwrite d1/da6/d55/d94/f6f [0,4194304] 0 2024-03-12T16:10:46.449 INFO:tasks.workunit.client.1.smithi134.stdout:2/669: rename d4/d12/d3b/fdc to d4/d84/d63/dde/fee 0 2024-03-12T16:10:46.449 INFO:tasks.workunit.client.1.smithi134.stdout:5/793: write db/d7a/fce [3897032,55843] 0 2024-03-12T16:10:46.451 INFO:tasks.workunit.client.0.smithi006.stdout:3/442: write d8/d19/d26/d59/d2c/dc/d28/f90 [584708,18219] 0 2024-03-12T16:10:46.451 INFO:tasks.workunit.client.0.smithi006.stdout:7/635: dwrite de/d2c/d4f/fa1 [0,4194304] 0 2024-03-12T16:10:46.451 INFO:tasks.workunit.client.0.smithi006.stdout:3/443: dread - d8/d19/d26/d59/d2c/f9a zero size 2024-03-12T16:10:46.453 INFO:tasks.workunit.client.0.smithi006.stdout:5/433: write d7/d9/d31/d3b/d4f/f7c [1156579,83620] 0 2024-03-12T16:10:46.454 INFO:tasks.workunit.client.0.smithi006.stdout:9/432: fsync d0/d4/d18/d4d/f75 0 2024-03-12T16:10:46.455 INFO:tasks.workunit.client.0.smithi006.stdout:1/523: rename d0/d25/d2a/d43/d68/c6c to d0/d25/d67/d8d/cb2 0 2024-03-12T16:10:46.458 INFO:tasks.workunit.client.0.smithi006.stdout:7/636: mknod de/d7b/d7e/cd8 0 2024-03-12T16:10:46.458 INFO:tasks.workunit.client.0.smithi006.stdout:7/637: chown de/d18 131952079 1 2024-03-12T16:10:46.458 INFO:tasks.workunit.client.0.smithi006.stdout:9/433: readlink d0/d8/d16/d2f/l53 0 2024-03-12T16:10:46.459 INFO:tasks.workunit.client.1.smithi134.stdout:6/721: fdatasync d1/f78 0 2024-03-12T16:10:46.463 INFO:tasks.workunit.client.0.smithi006.stdout:2/504: dread d0/d13/f2e [0,4194304] 0 2024-03-12T16:10:46.465 INFO:tasks.workunit.client.1.smithi134.stdout:3/854: dwrite d1/db/d12/d9d/d9f/ffa [0,4194304] 0 2024-03-12T16:10:46.466 INFO:tasks.workunit.client.1.smithi134.stdout:6/722: write d1/d3/d19/f51 [4082343,37691] 0 2024-03-12T16:10:46.467 INFO:tasks.workunit.client.0.smithi006.stdout:1/524: stat d0/d25/c81 0 2024-03-12T16:10:46.467 INFO:tasks.workunit.client.0.smithi006.stdout:0/486: write d2/d6/d10/d11/f84 [434097,25982] 0 2024-03-12T16:10:46.467 INFO:tasks.workunit.client.0.smithi006.stdout:6/469: dread d3/d11/d10/d1b/d6e/d80/f84 [0,4194304] 0 2024-03-12T16:10:46.470 INFO:tasks.workunit.client.1.smithi134.stdout:6/723: chown d1/d4/f42 417 1 2024-03-12T16:10:46.470 INFO:tasks.workunit.client.0.smithi006.stdout:7/638: mknod de/d7b/d7e/cd9 0 2024-03-12T16:10:46.471 INFO:tasks.workunit.client.0.smithi006.stdout:9/434: mknod d0/d4/d70/c93 0 2024-03-12T16:10:46.471 INFO:tasks.workunit.client.0.smithi006.stdout:1/525: mkdir d0/d25/d2a/d35/db3 0 2024-03-12T16:10:46.472 INFO:tasks.workunit.client.1.smithi134.stdout:3/855: mknod d1/db/d10/c130 0 2024-03-12T16:10:46.472 INFO:tasks.workunit.client.1.smithi134.stdout:6/724: readlink d1/d3/d10/l13 0 2024-03-12T16:10:46.476 INFO:tasks.workunit.client.0.smithi006.stdout:3/444: dwrite d8/f17 [0,4194304] 0 2024-03-12T16:10:46.477 INFO:tasks.workunit.client.1.smithi134.stdout:6/725: chown d1/d16/d4c/d58/da0/db7 255620633 1 2024-03-12T16:10:46.477 INFO:tasks.workunit.client.1.smithi134.stdout:1/529: dread d0/f3a [0,4194304] 0 2024-03-12T16:10:46.478 INFO:tasks.workunit.client.0.smithi006.stdout:2/505: mkdir d0/d13/d49/d60/d2b/d62/d66/da6 0 2024-03-12T16:10:46.479 INFO:tasks.workunit.client.0.smithi006.stdout:7/639: creat de/d2c/d93/dbe/d66/fda x:0 0 0 2024-03-12T16:10:46.480 INFO:tasks.workunit.client.0.smithi006.stdout:6/470: getdents d3/d11 0 2024-03-12T16:10:46.481 INFO:tasks.workunit.client.0.smithi006.stdout:9/435: symlink d0/d8/d16/d7d/d20/l94 0 2024-03-12T16:10:46.481 INFO:tasks.workunit.client.0.smithi006.stdout:3/445: read - d8/d19/d26/d59/d2c/d41/f62 zero size 2024-03-12T16:10:46.481 INFO:tasks.workunit.client.1.smithi134.stdout:3/856: rename d1/db/d12/fb1 to d1/db/d10/d2d/d2e/f131 0 2024-03-12T16:10:46.481 INFO:tasks.workunit.client.1.smithi134.stdout:5/794: dwrite db/d12/d1d/d59/d94/fb0 [4194304,4194304] 0 2024-03-12T16:10:46.483 INFO:tasks.workunit.client.0.smithi006.stdout:6/471: stat d3/d11/d10/d28/f56 0 2024-03-12T16:10:46.484 INFO:tasks.workunit.client.0.smithi006.stdout:1/526: rename d0/d25/d2a/d35/d3f/f8a to d0/d25/d67/db0/fb4 0 2024-03-12T16:10:46.485 INFO:tasks.workunit.client.0.smithi006.stdout:7/640: write de/d2c/f73 [1489768,77220] 0 2024-03-12T16:10:46.485 INFO:tasks.workunit.client.1.smithi134.stdout:1/530: mknod d0/d42/d47/cba 0 2024-03-12T16:10:46.485 INFO:tasks.workunit.client.1.smithi134.stdout:7/728: dwrite d8/d4e/f89 [0,4194304] 0 2024-03-12T16:10:46.486 INFO:tasks.workunit.client.1.smithi134.stdout:5/795: write db/d7d/fde [342264,73047] 0 2024-03-12T16:10:46.491 INFO:tasks.workunit.client.0.smithi006.stdout:9/436: rename d0/d4/d3b/d4a to d0/d4/d3b/d95 0 2024-03-12T16:10:46.494 INFO:tasks.workunit.client.0.smithi006.stdout:1/527: symlink d0/d25/d2a/d35/lb5 0 2024-03-12T16:10:46.495 INFO:tasks.workunit.client.0.smithi006.stdout:2/506: dwrite d0/d13/d49/d60/d2b/f9f [0,4194304] 0 2024-03-12T16:10:46.497 INFO:tasks.workunit.client.0.smithi006.stdout:5/434: write d7/d9/d10/f1b [274714,44372] 0 2024-03-12T16:10:46.503 INFO:tasks.workunit.client.0.smithi006.stdout:6/472: dwrite d3/d47/f7f [0,4194304] 0 2024-03-12T16:10:46.505 INFO:tasks.workunit.client.0.smithi006.stdout:5/435: symlink d7/d9/d31/d3b/d4f/l8d 0 2024-03-12T16:10:46.507 INFO:tasks.workunit.client.0.smithi006.stdout:1/528: dread d0/f1f [0,4194304] 0 2024-03-12T16:10:46.508 INFO:tasks.workunit.client.0.smithi006.stdout:5/436: chown d7/d9/d31/d3b/d4f/l84 424739 1 2024-03-12T16:10:46.511 INFO:tasks.workunit.client.0.smithi006.stdout:9/437: rename d0/d8/d16/d2f/l85 to d0/d4/d3b/d6a/l96 0 2024-03-12T16:10:46.515 INFO:tasks.workunit.client.0.smithi006.stdout:9/438: creat d0/d8/d80/f97 x:0 0 0 2024-03-12T16:10:46.518 INFO:tasks.workunit.client.0.smithi006.stdout:3/446: dread d8/d52/f61 [0,4194304] 0 2024-03-12T16:10:46.520 INFO:tasks.workunit.client.0.smithi006.stdout:9/439: creat d0/d4/d70/d71/f98 x:0 0 0 2024-03-12T16:10:46.522 INFO:tasks.workunit.client.0.smithi006.stdout:5/437: dwrite d7/d9/d10/f1a [4194304,4194304] 0 2024-03-12T16:10:46.522 INFO:tasks.workunit.client.0.smithi006.stdout:2/507: dread d0/f4 [0,4194304] 0 2024-03-12T16:10:46.523 INFO:tasks.workunit.client.0.smithi006.stdout:9/440: write d0/d4/d70/d71/f98 [359696,72324] 0 2024-03-12T16:10:46.526 INFO:tasks.workunit.client.0.smithi006.stdout:9/441: write d0/d4/d18/f44 [732188,87228] 0 2024-03-12T16:10:46.527 INFO:tasks.workunit.client.0.smithi006.stdout:5/438: rename d7/d9/d10/d24/c33 to d7/d9/d31/c8e 0 2024-03-12T16:10:46.531 INFO:tasks.workunit.client.0.smithi006.stdout:9/442: mkdir d0/d4/d18/d4d/d99 0 2024-03-12T16:10:46.536 INFO:tasks.workunit.client.0.smithi006.stdout:7/641: write de/d18/f20 [3045562,59875] 0 2024-03-12T16:10:46.537 INFO:tasks.workunit.client.0.smithi006.stdout:9/443: write d0/d1f/f6d [1497925,104614] 0 2024-03-12T16:10:46.540 INFO:tasks.workunit.client.0.smithi006.stdout:5/439: dwrite d7/d9/d31/f46 [0,4194304] 0 2024-03-12T16:10:46.543 INFO:tasks.workunit.client.0.smithi006.stdout:6/473: write d3/d11/d43/f90 [4506041,114838] 0 2024-03-12T16:10:46.546 INFO:tasks.workunit.client.0.smithi006.stdout:7/642: dread - de/d7b/d7e/fbc zero size 2024-03-12T16:10:46.550 INFO:tasks.workunit.client.0.smithi006.stdout:9/444: truncate d0/d1f/f91 1294233 0 2024-03-12T16:10:46.553 INFO:tasks.workunit.client.0.smithi006.stdout:5/440: dread d7/d9/d10/d24/d89/f3a [0,4194304] 0 2024-03-12T16:10:46.563 INFO:tasks.workunit.client.0.smithi006.stdout:1/529: dwrite d0/d25/f36 [0,4194304] 0 2024-03-12T16:10:46.563 INFO:tasks.workunit.client.0.smithi006.stdout:7/643: rename de/d27 to de/d1c/d87/ddb 0 2024-03-12T16:10:46.563 INFO:tasks.workunit.client.0.smithi006.stdout:6/474: symlink d3/d11/d10/d28/d45/lab 0 2024-03-12T16:10:46.564 INFO:tasks.workunit.client.0.smithi006.stdout:2/508: dwrite d0/d13/d49/d60/d2b/d62/fa2 [0,4194304] 0 2024-03-12T16:10:46.566 INFO:tasks.workunit.client.0.smithi006.stdout:2/509: stat d0/d13/c4c 0 2024-03-12T16:10:46.566 INFO:tasks.workunit.client.0.smithi006.stdout:3/447: dread d8/d19/d26/d59/d2c/dc/d28/f2b [4194304,4194304] 0 2024-03-12T16:10:46.568 INFO:tasks.workunit.client.0.smithi006.stdout:6/475: chown d3/d11/d43 157 1 2024-03-12T16:10:46.569 INFO:tasks.workunit.client.0.smithi006.stdout:9/445: creat d0/d83/d90/f9a x:0 0 0 2024-03-12T16:10:46.573 INFO:tasks.workunit.client.0.smithi006.stdout:9/446: fdatasync d0/d4/d3b/d95/f7e 0 2024-03-12T16:10:46.573 INFO:tasks.workunit.client.0.smithi006.stdout:7/644: link de/d1c/f25 de/d18/fdc 0 2024-03-12T16:10:46.576 INFO:tasks.workunit.client.0.smithi006.stdout:3/448: mkdir d8/d52/d9e 0 2024-03-12T16:10:46.576 INFO:tasks.workunit.client.0.smithi006.stdout:2/510: chown d0/l4a 1030097 1 2024-03-12T16:10:46.576 INFO:tasks.workunit.client.0.smithi006.stdout:9/447: write d0/d8/d16/f43 [4490196,62580] 0 2024-03-12T16:10:46.577 INFO:tasks.workunit.client.0.smithi006.stdout:6/476: mknod d3/d11/cac 0 2024-03-12T16:10:46.577 INFO:tasks.workunit.client.0.smithi006.stdout:7/645: read de/d2c/d93/dbe/d66/fc4 [3856693,37488] 0 2024-03-12T16:10:46.581 INFO:tasks.workunit.client.1.smithi134.stdout:7/729: chown d8/dc/d55/cf0 2 1 2024-03-12T16:10:46.582 INFO:tasks.workunit.client.1.smithi134.stdout:3/857: creat d1/db/d10/d2a/dc6/f132 x:0 0 0 2024-03-12T16:10:46.582 INFO:tasks.workunit.client.0.smithi006.stdout:5/441: write d7/d41/f87 [4679854,73671] 0 2024-03-12T16:10:46.584 INFO:tasks.workunit.client.1.smithi134.stdout:5/796: symlink db/d7a/lf5 0 2024-03-12T16:10:46.585 INFO:tasks.workunit.client.0.smithi006.stdout:3/449: unlink d8/d19/d26/d59/d2c/d41/c5a 0 2024-03-12T16:10:46.585 INFO:tasks.workunit.client.1.smithi134.stdout:7/730: getdents d8/dc/d55/df2 0 2024-03-12T16:10:46.587 INFO:tasks.workunit.client.1.smithi134.stdout:5/797: mkdir db/d12/d37/db4/db9/df6 0 2024-03-12T16:10:46.589 INFO:tasks.workunit.client.1.smithi134.stdout:2/670: dread d4/d12/f22 [0,4194304] 0 2024-03-12T16:10:46.589 INFO:tasks.workunit.client.0.smithi006.stdout:1/530: dread d0/fb [0,4194304] 0 2024-03-12T16:10:46.590 INFO:tasks.workunit.client.1.smithi134.stdout:5/798: mknod db/d12/d7b/cf7 0 2024-03-12T16:10:46.590 INFO:tasks.workunit.client.1.smithi134.stdout:3/858: dread d1/d63/f114 [0,4194304] 0 2024-03-12T16:10:46.591 INFO:tasks.workunit.client.0.smithi006.stdout:3/450: creat d8/d19/d78/f9f x:0 0 0 2024-03-12T16:10:46.593 INFO:tasks.workunit.client.0.smithi006.stdout:9/448: dwrite d0/d83/d90/f9a [0,4194304] 0 2024-03-12T16:10:46.593 INFO:tasks.workunit.client.1.smithi134.stdout:5/799: write db/d12/d1d/f51 [2809120,118037] 0 2024-03-12T16:10:46.593 INFO:tasks.workunit.client.0.smithi006.stdout:7/646: truncate de/d1c/d87/ddb/f2d 967320 0 2024-03-12T16:10:46.595 INFO:tasks.workunit.client.0.smithi006.stdout:9/449: dread - d0/f87 zero size 2024-03-12T16:10:46.595 INFO:tasks.workunit.client.1.smithi134.stdout:2/671: getdents d4/d84/d63/d9d 0 2024-03-12T16:10:46.597 INFO:tasks.workunit.client.1.smithi134.stdout:5/800: write db/d12/d1d/f51 [1161011,120372] 0 2024-03-12T16:10:46.599 INFO:tasks.workunit.client.1.smithi134.stdout:7/731: dwrite d8/dc/d55/d57/fc8 [0,4194304] 0 2024-03-12T16:10:46.609 INFO:tasks.workunit.client.1.smithi134.stdout:7/732: dread - d8/dc/d4b/d97/fee zero size 2024-03-12T16:10:46.609 INFO:tasks.workunit.client.1.smithi134.stdout:7/733: stat d8/d4e/d91/fb0 0 2024-03-12T16:10:46.612 INFO:tasks.workunit.client.1.smithi134.stdout:7/734: mknod d8/d4e/d91/da1/cfb 0 2024-03-12T16:10:46.613 INFO:tasks.workunit.client.1.smithi134.stdout:1/531: dread d0/d16/d9/d13/d21/f23 [0,4194304] 0 2024-03-12T16:10:46.615 INFO:tasks.workunit.client.1.smithi134.stdout:7/735: unlink d8/d4e/d91/da1/cef 0 2024-03-12T16:10:46.615 INFO:tasks.workunit.client.1.smithi134.stdout:7/736: readlink d8/dc/d4b/d97/le6 0 2024-03-12T16:10:46.616 INFO:tasks.workunit.client.1.smithi134.stdout:1/532: mkdir d0/d16/d9/d51/db7/dbb 0 2024-03-12T16:10:46.616 INFO:tasks.workunit.client.1.smithi134.stdout:7/737: readlink d8/l8f 0 2024-03-12T16:10:46.621 INFO:tasks.workunit.client.1.smithi134.stdout:1/533: dwrite d0/d16/d9/d13/d21/f33 [0,4194304] 0 2024-03-12T16:10:46.621 INFO:tasks.workunit.client.1.smithi134.stdout:1/534: read - d0/d30/d86/fb5 zero size 2024-03-12T16:10:46.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/535: chown d0/d16/d9/d13/d21/d2f/d8d 877780 1 2024-03-12T16:10:46.630 INFO:tasks.workunit.client.1.smithi134.stdout:1/536: dwrite d0/d30/fa8 [0,4194304] 0 2024-03-12T16:10:46.631 INFO:tasks.workunit.client.1.smithi134.stdout:1/537: truncate d0/d30/d86/fb5 753653 0 2024-03-12T16:10:46.633 INFO:tasks.workunit.client.1.smithi134.stdout:1/538: getdents d0/d30/d48/dab 0 2024-03-12T16:10:46.641 INFO:tasks.workunit.client.0.smithi006.stdout:2/511: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/f99 [0,4194304] 0 2024-03-12T16:10:46.642 INFO:tasks.workunit.client.0.smithi006.stdout:1/531: chown d0/d25/d67/d8d/cb2 5056 1 2024-03-12T16:10:46.644 INFO:tasks.workunit.client.0.smithi006.stdout:9/450: write d0/d8/d16/f54 [242113,121944] 0 2024-03-12T16:10:46.645 INFO:tasks.workunit.client.0.smithi006.stdout:6/477: mknod d3/d11/d10/d28/d45/cad 0 2024-03-12T16:10:46.647 INFO:tasks.workunit.client.0.smithi006.stdout:7/647: write de/d1c/d35/f7d [535528,45416] 0 2024-03-12T16:10:46.648 INFO:tasks.workunit.client.1.smithi134.stdout:2/672: dwrite d4/d12/d1d/d34/d58/fd5 [0,4194304] 0 2024-03-12T16:10:46.649 INFO:tasks.workunit.client.0.smithi006.stdout:9/451: dread - d0/d8/d80/f82 zero size 2024-03-12T16:10:46.650 INFO:tasks.workunit.client.1.smithi134.stdout:2/673: write d4/d84/d7d/dbe/fc7 [406969,86924] 0 2024-03-12T16:10:46.651 INFO:tasks.workunit.client.0.smithi006.stdout:3/451: creat d8/d19/d26/d59/d2c/d41/d8b/d93/fa0 x:0 0 0 2024-03-12T16:10:46.652 INFO:tasks.workunit.client.1.smithi134.stdout:2/674: chown d4/c99 265975 1 2024-03-12T16:10:46.654 INFO:tasks.workunit.client.0.smithi006.stdout:7/648: getdents de/d2c/d93/dbe/d4a/dd1 0 2024-03-12T16:10:46.656 INFO:tasks.workunit.client.0.smithi006.stdout:2/512: creat d0/d13/d49/d60/fa7 x:0 0 0 2024-03-12T16:10:46.658 INFO:tasks.workunit.client.1.smithi134.stdout:5/801: dwrite db/d7d/f86 [0,4194304] 0 2024-03-12T16:10:46.661 INFO:tasks.workunit.client.0.smithi006.stdout:7/649: fsync de/d2c/f6f 0 2024-03-12T16:10:46.663 INFO:tasks.workunit.client.0.smithi006.stdout:1/532: dread d0/d25/d2a/d43/d63/f7b [0,4194304] 0 2024-03-12T16:10:46.664 INFO:tasks.workunit.client.0.smithi006.stdout:7/650: creat de/d2c/d93/dbe/d66/fdd x:0 0 0 2024-03-12T16:10:46.665 INFO:tasks.workunit.client.1.smithi134.stdout:3/859: dread d1/db/d10/d2d/f5e [0,4194304] 0 2024-03-12T16:10:46.666 INFO:tasks.workunit.client.0.smithi006.stdout:1/533: mkdir d0/d25/d2a/d43/d63/db6 0 2024-03-12T16:10:46.668 INFO:tasks.workunit.client.1.smithi134.stdout:3/860: symlink d1/d63/dc2/l133 0 2024-03-12T16:10:46.674 INFO:tasks.workunit.client.1.smithi134.stdout:3/861: rename d1/f4 to d1/db/d10/d2d/d109/f134 0 2024-03-12T16:10:46.674 INFO:tasks.workunit.client.1.smithi134.stdout:7/738: dread d8/f2a [0,4194304] 0 2024-03-12T16:10:46.675 INFO:tasks.workunit.client.0.smithi006.stdout:7/651: dwrite de/d98/f9b [0,4194304] 0 2024-03-12T16:10:46.676 INFO:tasks.workunit.client.1.smithi134.stdout:3/862: fsync d1/db/d14/d5a/fa1 0 2024-03-12T16:10:46.676 INFO:tasks.workunit.client.1.smithi134.stdout:7/739: readlink d8/dc/d7b/dbb/dbd/ldd 0 2024-03-12T16:10:46.677 INFO:tasks.workunit.client.1.smithi134.stdout:7/740: chown d8/d27/d9d/f70 16 1 2024-03-12T16:10:46.677 INFO:tasks.workunit.client.1.smithi134.stdout:7/741: chown d8/dc/d4b 5 1 2024-03-12T16:10:46.678 INFO:tasks.workunit.client.1.smithi134.stdout:3/863: mkdir d1/db/d10/d2a/dc6/d135 0 2024-03-12T16:10:46.681 INFO:tasks.workunit.client.1.smithi134.stdout:7/742: unlink d8/d27/ccd 0 2024-03-12T16:10:46.683 INFO:tasks.workunit.client.1.smithi134.stdout:3/864: creat d1/db/d10/d2d/f136 x:0 0 0 2024-03-12T16:10:46.685 INFO:tasks.workunit.client.0.smithi006.stdout:7/652: symlink de/d2c/d4f/dba/d40/lde 0 2024-03-12T16:10:46.685 INFO:tasks.workunit.client.0.smithi006.stdout:3/452: truncate f1 4170293 0 2024-03-12T16:10:46.686 INFO:tasks.workunit.client.1.smithi134.stdout:5/802: dread db/d12/d1d/d5c/fc9 [0,4194304] 0 2024-03-12T16:10:46.688 INFO:tasks.workunit.client.1.smithi134.stdout:7/743: link d8/dc/d20/d26/d36/leb d8/dc/d55/db9/lfc 0 2024-03-12T16:10:46.688 INFO:tasks.workunit.client.1.smithi134.stdout:3/865: truncate d1/db/d10/d2a/dc6/f132 695073 0 2024-03-12T16:10:46.690 INFO:tasks.workunit.client.1.smithi134.stdout:5/803: link db/d12/d29/c2f db/d12/d37/d73/d8c/cf8 0 2024-03-12T16:10:46.690 INFO:tasks.workunit.client.0.smithi006.stdout:2/513: dread d0/dc/fd [0,4194304] 0 2024-03-12T16:10:46.690 INFO:tasks.workunit.client.0.smithi006.stdout:7/653: dread de/d2c/d93/dbe/d66/fc4 [0,4194304] 0 2024-03-12T16:10:46.693 INFO:tasks.workunit.client.1.smithi134.stdout:5/804: rename db/d12/d37/d71/ca4 to db/d12/d37/d71/d90/cf9 0 2024-03-12T16:10:46.693 INFO:tasks.workunit.client.0.smithi006.stdout:2/514: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8 0 2024-03-12T16:10:46.695 INFO:tasks.workunit.client.1.smithi134.stdout:5/805: creat db/d12/d1d/d3a/d70/d99/ffa x:0 0 0 2024-03-12T16:10:46.701 INFO:tasks.workunit.client.0.smithi006.stdout:1/534: dwrite d0/d25/d2a/f54 [0,4194304] 0 2024-03-12T16:10:46.704 INFO:tasks.workunit.client.0.smithi006.stdout:2/515: dwrite d0/d13/d49/d60/d2b/d62/d66/d67/fa0 [0,4194304] 0 2024-03-12T16:10:46.709 INFO:tasks.workunit.client.1.smithi134.stdout:5/806: dwrite db/d12/f40 [0,4194304] 0 2024-03-12T16:10:46.712 INFO:tasks.workunit.client.0.smithi006.stdout:2/516: creat d0/d13/d49/d60/d2b/d62/d66/da6/fa9 x:0 0 0 2024-03-12T16:10:46.712 INFO:tasks.workunit.client.0.smithi006.stdout:3/453: dread d8/d19/d26/d59/d2c/dc/d28/d2f/f60 [0,4194304] 0 2024-03-12T16:10:46.715 INFO:tasks.workunit.client.0.smithi006.stdout:3/454: stat d8/d19/d26/d59/d2c/dc/d28/d2f/f3c 0 2024-03-12T16:10:46.716 INFO:tasks.workunit.client.1.smithi134.stdout:5/807: unlink db/fa3 0 2024-03-12T16:10:46.716 INFO:tasks.workunit.client.1.smithi134.stdout:5/808: dread - db/d12/d1d/d59/de5/fc5 zero size 2024-03-12T16:10:46.719 INFO:tasks.workunit.client.1.smithi134.stdout:4/657: sync 2024-03-12T16:10:46.719 INFO:tasks.workunit.client.1.smithi134.stdout:5/809: mkdir db/d7a/da8/dfb 0 2024-03-12T16:10:46.719 INFO:tasks.workunit.client.1.smithi134.stdout:9/717: sync 2024-03-12T16:10:46.719 INFO:tasks.workunit.client.1.smithi134.stdout:8/713: sync 2024-03-12T16:10:46.719 INFO:tasks.workunit.client.1.smithi134.stdout:0/677: sync 2024-03-12T16:10:46.720 INFO:tasks.workunit.client.0.smithi006.stdout:3/455: getdents d8/d52/d9e 0 2024-03-12T16:10:46.720 INFO:tasks.workunit.client.1.smithi134.stdout:4/658: chown d1/d13/d49/d64/da3 2 1 2024-03-12T16:10:46.721 INFO:tasks.workunit.client.1.smithi134.stdout:5/810: chown db/d12/d1d/d3a/f48 12 1 2024-03-12T16:10:46.721 INFO:tasks.workunit.client.1.smithi134.stdout:8/714: stat d3/d1b/d17/d25/f90 0 2024-03-12T16:10:46.721 INFO:tasks.workunit.client.0.smithi006.stdout:2/517: dread d0/d13/d49/d60/d2b/d62/fa2 [0,4194304] 0 2024-03-12T16:10:46.722 INFO:tasks.workunit.client.0.smithi006.stdout:3/456: fsync d8/d19/d26/f8d 0 2024-03-12T16:10:46.723 INFO:tasks.workunit.client.0.smithi006.stdout:2/518: truncate d0/d13/d49/d60/fa7 60636 0 2024-03-12T16:10:46.723 INFO:tasks.workunit.client.1.smithi134.stdout:0/678: unlink db/f24 0 2024-03-12T16:10:46.724 INFO:tasks.workunit.client.0.smithi006.stdout:2/519: chown d0/d13/d49/d60/d2b/f6b 4023 1 2024-03-12T16:10:46.727 INFO:tasks.workunit.client.1.smithi134.stdout:8/715: stat d3/d1b/d17/ca9 0 2024-03-12T16:10:46.731 INFO:tasks.workunit.client.0.smithi006.stdout:3/457: dwrite d8/d19/d26/d59/f42 [4194304,4194304] 0 2024-03-12T16:10:46.733 INFO:tasks.workunit.client.0.smithi006.stdout:3/458: dread - d8/d19/d78/f95 zero size 2024-03-12T16:10:46.733 INFO:tasks.workunit.client.1.smithi134.stdout:8/716: creat d3/d1b/d17/d3f/ffb x:0 0 0 2024-03-12T16:10:46.734 INFO:tasks.workunit.client.1.smithi134.stdout:9/718: dwrite d5/d46/f7f [0,4194304] 0 2024-03-12T16:10:46.734 INFO:tasks.workunit.client.0.smithi006.stdout:1/535: dread d0/f3e [0,4194304] 0 2024-03-12T16:10:46.737 INFO:tasks.workunit.client.1.smithi134.stdout:8/717: chown d3/d1b/d17/l86 309260 1 2024-03-12T16:10:46.737 INFO:tasks.workunit.client.0.smithi006.stdout:3/459: fsync d8/d19/d26/d59/d3b/f80 0 2024-03-12T16:10:46.738 INFO:tasks.workunit.client.0.smithi006.stdout:1/536: mknod d0/d25/db1/cb7 0 2024-03-12T16:10:46.740 INFO:tasks.workunit.client.0.smithi006.stdout:2/520: dread d0/d13/f1d [0,4194304] 0 2024-03-12T16:10:46.741 INFO:tasks.workunit.client.0.smithi006.stdout:3/460: write d8/d19/d26/d59/d2c/d41/d8b/d93/fa0 [274355,24077] 0 2024-03-12T16:10:46.742 INFO:tasks.workunit.client.0.smithi006.stdout:1/537: symlink d0/d25/d2a/d43/lb8 0 2024-03-12T16:10:46.742 INFO:tasks.workunit.client.1.smithi134.stdout:4/659: dwrite d1/d24/d34/d8e/fb4 [0,4194304] 0 2024-03-12T16:10:46.744 INFO:tasks.workunit.client.0.smithi006.stdout:3/461: mkdir d8/d19/d26/d59/d2c/d41/da1 0 2024-03-12T16:10:46.745 INFO:tasks.workunit.client.1.smithi134.stdout:0/679: dwrite db/d2f/d51/daf/fd2 [0,4194304] 0 2024-03-12T16:10:46.745 INFO:tasks.workunit.client.1.smithi134.stdout:4/660: write d1/d24/d34/d8e/fb4 [2873885,6359] 0 2024-03-12T16:10:46.746 INFO:tasks.workunit.client.0.smithi006.stdout:1/538: symlink d0/d25/d2a/d43/lb9 0 2024-03-12T16:10:46.746 INFO:tasks.workunit.client.1.smithi134.stdout:9/719: truncate d5/d20/f27 5540457 0 2024-03-12T16:10:46.747 INFO:tasks.workunit.client.0.smithi006.stdout:1/539: chown d0/d25/f36 64292 1 2024-03-12T16:10:46.748 INFO:tasks.workunit.client.0.smithi006.stdout:3/462: chown d8/d19/d26/d59/d2c/d41/d45/c92 582 1 2024-03-12T16:10:46.749 INFO:tasks.workunit.client.1.smithi134.stdout:4/661: write d1/d13/d49/d53/fa2 [639879,110001] 0 2024-03-12T16:10:46.750 INFO:tasks.workunit.client.0.smithi006.stdout:3/463: stat d8/d19/d26/d59/d2c/dc/d28/d2f/l98 0 2024-03-12T16:10:46.751 INFO:tasks.workunit.client.0.smithi006.stdout:3/464: chown d8/d19/f9b 612 1 2024-03-12T16:10:46.751 INFO:tasks.workunit.client.1.smithi134.stdout:8/718: rename d3/d1b/d17/d45/fcc to d3/d1b/d17/d25/d49/ffc 0 2024-03-12T16:10:46.751 INFO:tasks.workunit.client.0.smithi006.stdout:3/465: chown d8/f88 266 1 2024-03-12T16:10:46.752 INFO:tasks.workunit.client.0.smithi006.stdout:3/466: dread - d8/d19/d26/f8d zero size 2024-03-12T16:10:46.753 INFO:tasks.workunit.client.1.smithi134.stdout:9/720: mknod d5/d10/d35/d49/d54/d5e/ccb 0 2024-03-12T16:10:46.759 INFO:tasks.workunit.client.1.smithi134.stdout:9/721: mkdir d5/dcc 0 2024-03-12T16:10:46.762 INFO:tasks.workunit.client.0.smithi006.stdout:1/540: symlink d0/d25/d2a/lba 0 2024-03-12T16:10:46.763 INFO:tasks.workunit.client.0.smithi006.stdout:2/521: link d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/c7a d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/caa 0 2024-03-12T16:10:46.763 INFO:tasks.workunit.client.0.smithi006.stdout:3/467: readlink d8/d19/d47/l8f 0 2024-03-12T16:10:46.768 INFO:tasks.workunit.client.0.smithi006.stdout:3/468: truncate d8/f76 1137395 0 2024-03-12T16:10:46.768 INFO:tasks.workunit.client.0.smithi006.stdout:3/469: chown d8/d19/d26/d59/c12 7317489 1 2024-03-12T16:10:46.768 INFO:tasks.workunit.client.0.smithi006.stdout:1/541: creat d0/d25/d2a/d35/db3/fbb x:0 0 0 2024-03-12T16:10:46.768 INFO:tasks.workunit.client.0.smithi006.stdout:1/542: fsync d0/f4 0 2024-03-12T16:10:46.768 INFO:tasks.workunit.client.1.smithi134.stdout:9/722: mknod d5/d20/ccd 0 2024-03-12T16:10:46.769 INFO:tasks.workunit.client.1.smithi134.stdout:4/662: dwrite d1/d24/d34/f83 [0,4194304] 0 2024-03-12T16:10:46.769 INFO:tasks.workunit.client.1.smithi134.stdout:8/719: dwrite d3/d1b/f2a [0,4194304] 0 2024-03-12T16:10:46.773 INFO:tasks.workunit.client.1.smithi134.stdout:9/723: truncate d5/d46/f5c 1050281 0 2024-03-12T16:10:46.775 INFO:tasks.workunit.client.1.smithi134.stdout:8/720: write d3/d1b/d17/f47 [2738488,79842] 0 2024-03-12T16:10:46.776 INFO:tasks.workunit.client.0.smithi006.stdout:3/470: dwrite d8/d19/d26/d59/d2c/d41/d45/f89 [0,4194304] 0 2024-03-12T16:10:46.777 INFO:tasks.workunit.client.1.smithi134.stdout:5/811: dwrite db/d12/d37/d73/fe8 [0,4194304] 0 2024-03-12T16:10:46.777 INFO:tasks.workunit.client.0.smithi006.stdout:2/522: dread d0/dc/f5b [0,4194304] 0 2024-03-12T16:10:46.779 INFO:tasks.workunit.client.0.smithi006.stdout:1/543: dwrite d0/d25/d2a/d35/f4b [0,4194304] 0 2024-03-12T16:10:46.780 INFO:tasks.workunit.client.1.smithi134.stdout:9/724: fsync d5/d10/d1f/f79 0 2024-03-12T16:10:46.781 INFO:tasks.workunit.client.1.smithi134.stdout:5/812: mkdir db/d12/d1d/d59/d94/dfc 0 2024-03-12T16:10:46.783 INFO:tasks.workunit.client.1.smithi134.stdout:5/813: chown db/d12/d1d/d59/d94/fe6 1 1 2024-03-12T16:10:46.784 INFO:tasks.workunit.client.0.smithi006.stdout:1/544: write d0/d25/f2b [3118858,82946] 0 2024-03-12T16:10:46.785 INFO:tasks.workunit.client.0.smithi006.stdout:3/471: creat d8/d19/d26/d59/d2c/fa2 x:0 0 0 2024-03-12T16:10:46.787 INFO:tasks.workunit.client.0.smithi006.stdout:1/545: truncate d0/d25/d2a/d35/db3/fbb 262323 0 2024-03-12T16:10:46.788 INFO:tasks.workunit.client.0.smithi006.stdout:3/472: creat d8/d19/fa3 x:0 0 0 2024-03-12T16:10:46.791 INFO:tasks.workunit.client.0.smithi006.stdout:8/433: sync 2024-03-12T16:10:46.791 INFO:tasks.workunit.client.0.smithi006.stdout:4/591: sync 2024-03-12T16:10:46.793 INFO:tasks.workunit.client.0.smithi006.stdout:4/592: chown d1/d38/l6e 492847 1 2024-03-12T16:10:46.798 INFO:tasks.workunit.client.1.smithi134.stdout:0/680: dread db/f2d [4194304,4194304] 0 2024-03-12T16:10:46.798 INFO:tasks.workunit.client.1.smithi134.stdout:9/725: dwrite d5/d10/d35/f61 [0,4194304] 0 2024-03-12T16:10:46.798 INFO:tasks.workunit.client.1.smithi134.stdout:0/681: readlink db/d2f/d31/d75/d88/l96 0 2024-03-12T16:10:46.798 INFO:tasks.workunit.client.1.smithi134.stdout:4/663: write d1/de/f30 [122775,5835] 0 2024-03-12T16:10:46.798 INFO:tasks.workunit.client.0.smithi006.stdout:1/546: dwrite d0/d25/f2b [4194304,4194304] 0 2024-03-12T16:10:46.798 INFO:tasks.workunit.client.0.smithi006.stdout:4/593: read - d1/db/d39/d42/d61/f8a zero size 2024-03-12T16:10:46.798 INFO:tasks.workunit.client.0.smithi006.stdout:8/434: creat d2/db/d1a/d21/d2b/f88 x:0 0 0 2024-03-12T16:10:46.800 INFO:tasks.workunit.client.0.smithi006.stdout:8/435: chown d2/db/c5d 21310049 1 2024-03-12T16:10:46.802 INFO:tasks.workunit.client.1.smithi134.stdout:0/682: truncate db/d2f/d31/d76/f78 763437 0 2024-03-12T16:10:46.802 INFO:tasks.workunit.client.0.smithi006.stdout:3/473: link d8/d19/d26/d97/c6d d8/d19/d26/d59/d2c/d41/da1/ca4 0 2024-03-12T16:10:46.806 INFO:tasks.workunit.client.1.smithi134.stdout:9/726: getdents d5/d10/d35/d49/d54/d5e/d82 0 2024-03-12T16:10:46.807 INFO:tasks.workunit.client.0.smithi006.stdout:8/436: symlink d2/d11/d6e/d7c/l89 0 2024-03-12T16:10:46.807 INFO:tasks.workunit.client.1.smithi134.stdout:8/721: dwrite d3/d1b/d17/d25/fd2 [0,4194304] 0 2024-03-12T16:10:46.809 INFO:tasks.workunit.client.0.smithi006.stdout:4/594: chown d1/db/d17/l10 61915764 1 2024-03-12T16:10:46.812 INFO:tasks.workunit.client.1.smithi134.stdout:4/664: mknod d1/d13/d49/d64/da3/dab/cd1 0 2024-03-12T16:10:46.814 INFO:tasks.workunit.client.1.smithi134.stdout:5/814: dwrite db/d12/d1d/d3a/d4e/f4f [4194304,4194304] 0 2024-03-12T16:10:46.816 INFO:tasks.workunit.client.0.smithi006.stdout:2/523: write d0/d13/d49/d60/f6f [487618,75623] 0 2024-03-12T16:10:46.816 INFO:tasks.workunit.client.1.smithi134.stdout:9/727: mknod d5/d10/d51/cce 0 2024-03-12T16:10:46.821 INFO:tasks.workunit.client.0.smithi006.stdout:4/595: read - d1/d91/f9d zero size 2024-03-12T16:10:46.821 INFO:tasks.workunit.client.0.smithi006.stdout:8/437: dwrite d2/d11/f82 [0,4194304] 0 2024-03-12T16:10:46.821 INFO:tasks.workunit.client.0.smithi006.stdout:2/524: read - d0/d13/d49/d60/d2b/d62/d66/da6/fa9 zero size 2024-03-12T16:10:46.821 INFO:tasks.workunit.client.1.smithi134.stdout:0/683: read db/d2f/d61/d7a/fc1 [986507,95862] 0 2024-03-12T16:10:46.821 INFO:tasks.workunit.client.1.smithi134.stdout:5/815: chown db/d12/d29/d3d/d79/fd6 131629160 1 2024-03-12T16:10:46.822 INFO:tasks.workunit.client.0.smithi006.stdout:2/525: write d0/f12 [317085,124801] 0 2024-03-12T16:10:46.822 INFO:tasks.workunit.client.0.smithi006.stdout:4/596: symlink d1/db/d17/d5a/d60/lc3 0 2024-03-12T16:10:46.822 INFO:tasks.workunit.client.1.smithi134.stdout:8/722: creat d3/d1b/d17/d25/d33/d15/d95/ffd x:0 0 0 2024-03-12T16:10:46.827 INFO:tasks.workunit.client.0.smithi006.stdout:2/526: unlink d0/l4a 0 2024-03-12T16:10:46.828 INFO:tasks.workunit.client.0.smithi006.stdout:8/438: mkdir d2/db/d1a/d21/d8a 0 2024-03-12T16:10:46.828 INFO:tasks.workunit.client.1.smithi134.stdout:4/665: dwrite d1/d13/d49/f32 [0,4194304] 0 2024-03-12T16:10:46.828 INFO:tasks.workunit.client.1.smithi134.stdout:5/816: write f5 [9266991,24706] 0 2024-03-12T16:10:46.828 INFO:tasks.workunit.client.1.smithi134.stdout:0/684: symlink db/d2f/d31/d76/lda 0 2024-03-12T16:10:46.828 INFO:tasks.workunit.client.1.smithi134.stdout:0/685: stat db/dcc 0 2024-03-12T16:10:46.830 INFO:tasks.workunit.client.0.smithi006.stdout:4/597: creat d1/db/d39/dbf/fc4 x:0 0 0 2024-03-12T16:10:46.830 INFO:tasks.workunit.client.0.smithi006.stdout:8/439: write d2/d55/f71 [1129979,96300] 0 2024-03-12T16:10:46.830 INFO:tasks.workunit.client.0.smithi006.stdout:2/527: chown d0/dc/l48 0 1 2024-03-12T16:10:46.832 INFO:tasks.workunit.client.0.smithi006.stdout:4/598: write d1/db/d39/d42/fbc [432111,65191] 0 2024-03-12T16:10:46.833 INFO:tasks.workunit.client.1.smithi134.stdout:5/817: creat db/d12/d1d/ffd x:0 0 0 2024-03-12T16:10:46.834 INFO:tasks.workunit.client.1.smithi134.stdout:0/686: chown db/d2f/d31/d68/d70/f74 34818 1 2024-03-12T16:10:46.835 INFO:tasks.workunit.client.1.smithi134.stdout:9/728: dwrite d5/d20/d72/f9c [0,4194304] 0 2024-03-12T16:10:46.836 INFO:tasks.workunit.client.0.smithi006.stdout:8/440: unlink d2/db/d1a/d21/f33 0 2024-03-12T16:10:46.838 INFO:tasks.workunit.client.1.smithi134.stdout:6/726: sync 2024-03-12T16:10:46.838 INFO:tasks.workunit.client.1.smithi134.stdout:9/729: truncate d5/d10/d33/fb6 768727 0 2024-03-12T16:10:46.839 INFO:tasks.workunit.client.0.smithi006.stdout:4/599: creat d1/db/d39/d42/fc5 x:0 0 0 2024-03-12T16:10:46.841 INFO:tasks.workunit.client.1.smithi134.stdout:8/723: dread d3/d1b/d17/d25/d33/d15/d95/d6d/f80 [0,4194304] 0 2024-03-12T16:10:46.841 INFO:tasks.workunit.client.0.smithi006.stdout:2/528: dwrite d0/d13/d49/d60/d2b/f9f [0,4194304] 0 2024-03-12T16:10:46.844 INFO:tasks.workunit.client.0.smithi006.stdout:4/600: unlink d1/db/d39/d42/d61/c89 0 2024-03-12T16:10:46.844 INFO:tasks.workunit.client.1.smithi134.stdout:4/666: link d1/de/d90/lcc d1/d13/d49/d64/d28/ld2 0 2024-03-12T16:10:46.844 INFO:tasks.workunit.client.1.smithi134.stdout:5/818: mknod db/d12/d7b/cfe 0 2024-03-12T16:10:46.845 INFO:tasks.workunit.client.0.smithi006.stdout:4/601: creat d1/db/d1d/d2f/fc6 x:0 0 0 2024-03-12T16:10:46.846 INFO:tasks.workunit.client.1.smithi134.stdout:4/667: write d1/d13/d49/d64/d28/d4f/d67/f86 [2223373,41882] 0 2024-03-12T16:10:46.846 INFO:tasks.workunit.client.1.smithi134.stdout:9/730: rename d5/d10/d35/f61 to d5/d10/d35/dc1/fcf 0 2024-03-12T16:10:46.849 INFO:tasks.workunit.client.1.smithi134.stdout:0/687: creat db/d2f/d31/d68/d70/dc7/fdb x:0 0 0 2024-03-12T16:10:46.850 INFO:tasks.workunit.client.1.smithi134.stdout:8/724: creat d3/d10/d31/d9b/ffe x:0 0 0 2024-03-12T16:10:46.850 INFO:tasks.workunit.client.1.smithi134.stdout:0/688: fsync db/f38 0 2024-03-12T16:10:46.852 INFO:tasks.workunit.client.1.smithi134.stdout:0/689: truncate db/d2f/d31/d56/f72 768122 0 2024-03-12T16:10:46.854 INFO:tasks.workunit.client.1.smithi134.stdout:5/819: creat db/d12/d37/db4/fff x:0 0 0 2024-03-12T16:10:46.855 INFO:tasks.workunit.client.1.smithi134.stdout:5/820: dread - db/d12/d1d/d59/de5/fc5 zero size 2024-03-12T16:10:46.856 INFO:tasks.workunit.client.1.smithi134.stdout:9/731: unlink d5/d10/d35/d49/d8d/l8a 0 2024-03-12T16:10:46.858 INFO:tasks.workunit.client.1.smithi134.stdout:4/668: symlink d1/de/d5a/ld3 0 2024-03-12T16:10:46.860 INFO:tasks.workunit.client.1.smithi134.stdout:5/821: unlink db/d7a/lf5 0 2024-03-12T16:10:46.860 INFO:tasks.workunit.client.1.smithi134.stdout:1/539: sync 2024-03-12T16:10:46.861 INFO:tasks.workunit.client.1.smithi134.stdout:6/727: getdents d1/d89 0 2024-03-12T16:10:46.863 INFO:tasks.workunit.client.1.smithi134.stdout:4/669: chown d1/de/d90/fa6 0 1 2024-03-12T16:10:46.864 INFO:tasks.workunit.client.1.smithi134.stdout:0/690: getdents db/dcc 0 2024-03-12T16:10:46.866 INFO:tasks.workunit.client.1.smithi134.stdout:1/540: creat d0/d30/d86/fbc x:0 0 0 2024-03-12T16:10:46.869 INFO:tasks.workunit.client.0.smithi006.stdout:3/474: dwrite d8/d19/d26/f43 [0,4194304] 0 2024-03-12T16:10:46.869 INFO:tasks.workunit.client.0.smithi006.stdout:8/441: dread d2/db/f13 [0,4194304] 0 2024-03-12T16:10:46.870 INFO:tasks.workunit.client.1.smithi134.stdout:8/725: dwrite d3/d1b/d17/d3f/f52 [0,4194304] 0 2024-03-12T16:10:46.870 INFO:tasks.workunit.client.1.smithi134.stdout:9/732: dwrite d5/d10/f81 [0,4194304] 0 2024-03-12T16:10:46.870 INFO:tasks.workunit.client.0.smithi006.stdout:8/442: chown d2/db/d1a/d21/d4f 58 1 2024-03-12T16:10:46.874 INFO:tasks.workunit.client.0.smithi006.stdout:3/475: rename f1 to d8/d19/d78/fa5 0 2024-03-12T16:10:46.874 INFO:tasks.workunit.client.1.smithi134.stdout:6/728: dread - d1/d16/d4c/d58/da0/f10d zero size 2024-03-12T16:10:46.874 INFO:tasks.workunit.client.1.smithi134.stdout:9/733: dread - d5/d10/f95 zero size 2024-03-12T16:10:46.874 INFO:tasks.workunit.client.1.smithi134.stdout:0/691: fsync db/d2f/d51/f64 0 2024-03-12T16:10:46.876 INFO:tasks.workunit.client.0.smithi006.stdout:3/476: chown d8/d19/d26/d59/d3b 246 1 2024-03-12T16:10:46.877 INFO:tasks.workunit.client.1.smithi134.stdout:8/726: mkdir d3/d1b/d17/dff 0 2024-03-12T16:10:46.877 INFO:tasks.workunit.client.1.smithi134.stdout:6/729: creat d1/d3/d19/d32/dd9/f113 x:0 0 0 2024-03-12T16:10:46.878 INFO:tasks.workunit.client.0.smithi006.stdout:8/443: dwrite d2/db/f69 [0,4194304] 0 2024-03-12T16:10:46.879 INFO:tasks.workunit.client.1.smithi134.stdout:6/730: readlink d1/da6/d55/d94/d75/led 0 2024-03-12T16:10:46.881 INFO:tasks.workunit.client.1.smithi134.stdout:6/731: chown d1/d3/d10/f15 24 1 2024-03-12T16:10:46.883 INFO:tasks.workunit.client.1.smithi134.stdout:6/732: fsync d1/d3a/db5/deb/ff1 0 2024-03-12T16:10:46.885 INFO:tasks.workunit.client.1.smithi134.stdout:0/692: rename db/c42 to db/d2f/d61/d7a/cdc 0 2024-03-12T16:10:46.887 INFO:tasks.workunit.client.1.smithi134.stdout:6/733: symlink d1/da6/d55/d85/ddf/l114 0 2024-03-12T16:10:46.892 INFO:tasks.workunit.client.1.smithi134.stdout:8/727: dwrite d3/fc7 [0,4194304] 0 2024-03-12T16:10:46.894 INFO:tasks.workunit.client.1.smithi134.stdout:6/734: rmdir d1/d16/d4c/d58/da0/df6 39 2024-03-12T16:10:46.894 INFO:tasks.workunit.client.1.smithi134.stdout:0/693: creat db/d2f/d31/d68/da2/db2/fdd x:0 0 0 2024-03-12T16:10:46.897 INFO:tasks.workunit.client.1.smithi134.stdout:8/728: dread d3/fc7 [0,4194304] 0 2024-03-12T16:10:46.903 INFO:tasks.workunit.client.1.smithi134.stdout:0/694: rename db/d2f/d31/d68/d70/daa to db/d2f/d61/dde 0 2024-03-12T16:10:46.905 INFO:tasks.workunit.client.1.smithi134.stdout:4/670: dread d1/de/f9a [0,4194304] 0 2024-03-12T16:10:46.908 INFO:tasks.workunit.client.1.smithi134.stdout:4/671: mknod d1/d13/d49/d64/da3/dab/cd4 0 2024-03-12T16:10:46.909 INFO:tasks.workunit.client.1.smithi134.stdout:4/672: fsync d1/de/f3c 0 2024-03-12T16:10:46.910 INFO:tasks.workunit.client.1.smithi134.stdout:0/695: dwrite db/d2f/d31/d75/d88/fc2 [0,4194304] 0 2024-03-12T16:10:46.911 INFO:tasks.workunit.client.1.smithi134.stdout:8/729: fdatasync d3/fc7 0 2024-03-12T16:10:46.913 INFO:tasks.workunit.client.1.smithi134.stdout:4/673: symlink d1/ld5 0 2024-03-12T16:10:46.915 INFO:tasks.workunit.client.1.smithi134.stdout:4/674: write d1/d13/d49/d64/da3/fb9 [554434,129996] 0 2024-03-12T16:10:46.916 INFO:tasks.workunit.client.1.smithi134.stdout:8/730: rmdir d3/d1b/d17/d25/d33/d96/dbd 39 2024-03-12T16:10:46.917 INFO:tasks.workunit.client.1.smithi134.stdout:8/731: write d3/d1b/ff9 [916326,61265] 0 2024-03-12T16:10:46.918 INFO:tasks.workunit.client.1.smithi134.stdout:4/675: mkdir d1/d13/d49/d53/dd6 0 2024-03-12T16:10:46.919 INFO:tasks.workunit.client.1.smithi134.stdout:0/696: dwrite db/f1f [0,4194304] 0 2024-03-12T16:10:46.922 INFO:tasks.workunit.client.1.smithi134.stdout:4/676: creat d1/d13/d49/d64/d28/d4f/fd7 x:0 0 0 2024-03-12T16:10:46.924 INFO:tasks.workunit.client.1.smithi134.stdout:4/677: fsync d1/d13/d49/f32 0 2024-03-12T16:10:46.925 INFO:tasks.workunit.client.1.smithi134.stdout:8/732: rename d3/d1b/d17/d25/d33/d15/d95/d4f/cc0 to d3/d10/dbf/c100 0 2024-03-12T16:10:46.928 INFO:tasks.workunit.client.1.smithi134.stdout:0/697: dwrite db/d2f/d61/dde/fbf [0,4194304] 0 2024-03-12T16:10:46.928 INFO:tasks.workunit.client.1.smithi134.stdout:4/678: truncate d1/d13/d49/d64/d28/d4f/d67/f86 3238588 0 2024-03-12T16:10:46.930 INFO:tasks.workunit.client.1.smithi134.stdout:4/679: write d1/d13/d49/da4/f91 [981235,7376] 0 2024-03-12T16:10:46.930 INFO:tasks.workunit.client.1.smithi134.stdout:0/698: fsync db/d2f/d31/d75/d88/f97 0 2024-03-12T16:10:46.931 INFO:tasks.workunit.client.1.smithi134.stdout:0/699: fdatasync db/d2f/d31/d68/da2/db2/fd7 0 2024-03-12T16:10:46.932 INFO:tasks.workunit.client.1.smithi134.stdout:4/680: symlink d1/de/ld8 0 2024-03-12T16:10:46.936 INFO:tasks.workunit.client.1.smithi134.stdout:0/700: unlink db/c53 0 2024-03-12T16:10:46.938 INFO:tasks.workunit.client.1.smithi134.stdout:4/681: rename d1/de/f36 to d1/d24/d34/fd9 0 2024-03-12T16:10:46.945 INFO:tasks.workunit.client.1.smithi134.stdout:4/682: creat d1/d13/fda x:0 0 0 2024-03-12T16:10:46.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:45.499567+0000 mgr.smithi134.gcntfu (mgr.24383) 60 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 91 MiB/s rd, 319 MiB/s wr, 579 op/s 2024-03-12T16:10:46.954 INFO:tasks.workunit.client.0.smithi006.stdout:4/602: write d1/db/f29 [248171,36060] 0 2024-03-12T16:10:46.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:45.499567+0000 mgr.smithi134.gcntfu (mgr.24383) 60 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 91 MiB/s rd, 319 MiB/s wr, 579 op/s 2024-03-12T16:10:46.957 INFO:tasks.workunit.client.0.smithi006.stdout:4/603: link d1/db/d17/f25 d1/db/d39/d42/d61/fc7 0 2024-03-12T16:10:46.980 INFO:tasks.workunit.client.1.smithi134.stdout:1/541: dread d0/d16/d9/d13/d21/d5f/f79 [0,4194304] 0 2024-03-12T16:10:46.988 INFO:tasks.workunit.client.0.smithi006.stdout:0/487: sync 2024-03-12T16:10:46.989 INFO:tasks.workunit.client.0.smithi006.stdout:0/488: chown d2/d6/d10/d11/d32 111165 1 2024-03-12T16:10:46.991 INFO:tasks.workunit.client.0.smithi006.stdout:0/489: creat d2/d6/d10/d11/d1d/d2e/f8f x:0 0 0 2024-03-12T16:10:46.998 INFO:tasks.workunit.client.1.smithi134.stdout:2/675: sync 2024-03-12T16:10:47.000 INFO:tasks.workunit.client.1.smithi134.stdout:1/542: symlink d0/d16/d9/d13/d21/d5f/lbd 0 2024-03-12T16:10:47.003 INFO:tasks.workunit.client.1.smithi134.stdout:2/676: symlink d4/d12/d1d/d34/d47/d8c/da4/lef 0 2024-03-12T16:10:47.004 INFO:tasks.workunit.client.0.smithi006.stdout:8/444: truncate d2/d11/f1b 363066 0 2024-03-12T16:10:47.005 INFO:tasks.workunit.client.1.smithi134.stdout:1/543: unlink d0/d30/d86/f61 0 2024-03-12T16:10:47.006 INFO:tasks.workunit.client.1.smithi134.stdout:2/677: truncate d4/d12/d3b/d3f/f45 1589898 0 2024-03-12T16:10:47.010 INFO:tasks.workunit.client.0.smithi006.stdout:3/477: dwrite d8/d19/d26/d59/f1a [0,4194304] 0 2024-03-12T16:10:47.010 INFO:tasks.workunit.client.1.smithi134.stdout:5/822: write db/d12/d29/d3d/f47 [1452531,103753] 0 2024-03-12T16:10:47.011 INFO:tasks.workunit.client.1.smithi134.stdout:2/678: mkdir d4/d84/d63/dde/df0 0 2024-03-12T16:10:47.013 INFO:tasks.workunit.client.0.smithi006.stdout:8/445: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:47.013 INFO:tasks.workunit.client.0.smithi006.stdout:3/478: fsync d8/d19/d47/f96 0 2024-03-12T16:10:47.014 INFO:tasks.workunit.client.1.smithi134.stdout:9/734: truncate d5/d20/d47/fa3 1861100 0 2024-03-12T16:10:47.016 INFO:tasks.workunit.client.1.smithi134.stdout:5/823: creat db/d7a/d97/f100 x:0 0 0 2024-03-12T16:10:47.016 INFO:tasks.workunit.client.1.smithi134.stdout:1/544: dwrite d0/d30/fa8 [0,4194304] 0 2024-03-12T16:10:47.018 INFO:tasks.workunit.client.1.smithi134.stdout:9/735: dread - d5/d10/d35/d49/d54/d5e/f7e zero size 2024-03-12T16:10:47.020 INFO:tasks.workunit.client.1.smithi134.stdout:9/736: read - d5/d10/d35/d49/d54/d88/fc0 zero size 2024-03-12T16:10:47.027 INFO:tasks.workunit.client.0.smithi006.stdout:8/446: write d2/d11/d5a/f5f [767522,6003] 0 2024-03-12T16:10:47.029 INFO:tasks.workunit.client.0.smithi006.stdout:3/479: truncate d8/d19/d78/fa5 1525546 0 2024-03-12T16:10:47.030 INFO:tasks.workunit.client.1.smithi134.stdout:9/737: symlink d5/d10/d33/da1/ld0 0 2024-03-12T16:10:47.033 INFO:tasks.workunit.client.1.smithi134.stdout:6/735: write d1/d3/d19/d32/d4a/f82 [5144315,18430] 0 2024-03-12T16:10:47.033 INFO:tasks.workunit.client.0.smithi006.stdout:8/447: rename d2/f63 to d2/db/d1a/d21/d8a/f8b 0 2024-03-12T16:10:47.034 INFO:tasks.workunit.client.1.smithi134.stdout:1/545: dwrite d0/d42/f45 [4194304,4194304] 0 2024-03-12T16:10:47.034 INFO:tasks.workunit.client.0.smithi006.stdout:0/490: dread f0 [0,4194304] 0 2024-03-12T16:10:47.035 INFO:tasks.workunit.client.1.smithi134.stdout:0/701: truncate db/f86 1581418 0 2024-03-12T16:10:47.036 INFO:tasks.workunit.client.1.smithi134.stdout:5/824: creat db/d12/d1d/d3a/d49/f101 x:0 0 0 2024-03-12T16:10:47.037 INFO:tasks.workunit.client.0.smithi006.stdout:3/480: creat d8/d4c/fa6 x:0 0 0 2024-03-12T16:10:47.038 INFO:tasks.workunit.client.1.smithi134.stdout:2/679: truncate d4/d84/d63/dde/fee 974584 0 2024-03-12T16:10:47.038 INFO:tasks.workunit.client.1.smithi134.stdout:0/702: fsync db/d2f/d31/d76/f93 0 2024-03-12T16:10:47.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/736: mkdir d1/d16/d4c/d58/d115 0 2024-03-12T16:10:47.041 INFO:tasks.workunit.client.0.smithi006.stdout:3/481: creat d8/d19/fa7 x:0 0 0 2024-03-12T16:10:47.043 INFO:tasks.workunit.client.1.smithi134.stdout:9/738: dwrite d5/d10/f95 [0,4194304] 0 2024-03-12T16:10:47.044 INFO:tasks.workunit.client.0.smithi006.stdout:0/491: dwrite d2/d39/d42/f51 [0,4194304] 0 2024-03-12T16:10:47.048 INFO:tasks.workunit.client.0.smithi006.stdout:0/492: rename d2/f60 to d2/d39/d42/f90 0 2024-03-12T16:10:47.048 INFO:tasks.workunit.client.0.smithi006.stdout:0/493: fsync d2/fd 0 2024-03-12T16:10:47.050 INFO:tasks.workunit.client.1.smithi134.stdout:5/825: creat db/d12/d29/f102 x:0 0 0 2024-03-12T16:10:47.051 INFO:tasks.workunit.client.0.smithi006.stdout:0/494: mknod d2/d39/d42/d67/c91 0 2024-03-12T16:10:47.054 INFO:tasks.workunit.client.1.smithi134.stdout:0/703: mknod db/d2f/d31/d75/d88/dd4/cdf 0 2024-03-12T16:10:47.054 INFO:tasks.workunit.client.1.smithi134.stdout:2/680: getdents d4/d12/d1d/d34 0 2024-03-12T16:10:47.055 INFO:tasks.workunit.client.0.smithi006.stdout:3/482: dread d8/d19/d78/fa5 [0,4194304] 0 2024-03-12T16:10:47.055 INFO:tasks.workunit.client.1.smithi134.stdout:1/546: dwrite d0/f3a [0,4194304] 0 2024-03-12T16:10:47.056 INFO:tasks.workunit.client.1.smithi134.stdout:9/739: symlink d5/d10/d35/d49/d54/dc6/ld1 0 2024-03-12T16:10:47.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/547: stat d0/d16/f31 0 2024-03-12T16:10:47.059 INFO:tasks.workunit.client.1.smithi134.stdout:5/826: dread - db/d12/d37/d71/d90/fa6 zero size 2024-03-12T16:10:47.061 INFO:tasks.workunit.client.0.smithi006.stdout:3/483: unlink d8/d19/c82 0 2024-03-12T16:10:47.061 INFO:tasks.workunit.client.1.smithi134.stdout:1/548: write d0/d16/d9/d13/f7f [782667,101858] 0 2024-03-12T16:10:47.063 INFO:tasks.workunit.client.1.smithi134.stdout:2/681: write d4/d84/d63/d9d/d3d/f64 [492225,45799] 0 2024-03-12T16:10:47.064 INFO:tasks.workunit.client.0.smithi006.stdout:0/495: dread d2/d6/d10/f1a [4194304,4194304] 0 2024-03-12T16:10:47.064 INFO:tasks.workunit.client.1.smithi134.stdout:5/827: truncate db/d12/d37/d73/fe3 362949 0 2024-03-12T16:10:47.065 INFO:tasks.workunit.client.0.smithi006.stdout:8/448: truncate d2/db/d1a/d21/d8a/f8b 250226 0 2024-03-12T16:10:47.068 INFO:tasks.workunit.client.1.smithi134.stdout:2/682: mkdir d4/d12/d1d/d34/d47/df1 0 2024-03-12T16:10:47.069 INFO:tasks.workunit.client.1.smithi134.stdout:9/740: creat d5/d10/d35/d49/d54/fd2 x:0 0 0 2024-03-12T16:10:47.071 INFO:tasks.workunit.client.0.smithi006.stdout:8/449: symlink d2/d11/d5a/l8c 0 2024-03-12T16:10:47.071 INFO:tasks.workunit.client.0.smithi006.stdout:0/496: symlink d2/d39/d42/d67/l92 0 2024-03-12T16:10:47.072 INFO:tasks.workunit.client.0.smithi006.stdout:8/450: readlink d2/db/d1a/l29 0 2024-03-12T16:10:47.074 INFO:tasks.workunit.client.1.smithi134.stdout:2/683: unlink d4/f24 0 2024-03-12T16:10:47.075 INFO:tasks.workunit.client.0.smithi006.stdout:0/497: mknod d2/d6/d10/d11/d1d/d2e/d77/c93 0 2024-03-12T16:10:47.076 INFO:tasks.workunit.client.0.smithi006.stdout:3/484: dwrite d8/d19/d26/d59/d2c/dc/d28/f2b [4194304,4194304] 0 2024-03-12T16:10:47.076 INFO:tasks.workunit.client.0.smithi006.stdout:0/498: stat d2/f2b 0 2024-03-12T16:10:47.077 INFO:tasks.workunit.client.0.smithi006.stdout:3/485: stat d8/d52/c68 0 2024-03-12T16:10:47.077 INFO:tasks.workunit.client.1.smithi134.stdout:9/741: dread d5/d46/f57 [0,4194304] 0 2024-03-12T16:10:47.078 INFO:tasks.workunit.client.0.smithi006.stdout:8/451: symlink d2/db/d1a/d21/l8d 0 2024-03-12T16:10:47.078 INFO:tasks.workunit.client.0.smithi006.stdout:6/478: sync 2024-03-12T16:10:47.078 INFO:tasks.workunit.client.0.smithi006.stdout:5/442: sync 2024-03-12T16:10:47.078 INFO:tasks.workunit.client.0.smithi006.stdout:9/452: sync 2024-03-12T16:10:47.078 INFO:tasks.workunit.client.0.smithi006.stdout:7/654: sync 2024-03-12T16:10:47.079 INFO:tasks.workunit.client.1.smithi134.stdout:1/549: rename d0/d42/lb2 to d0/d16/d9/d13/lbe 0 2024-03-12T16:10:47.082 INFO:tasks.workunit.client.0.smithi006.stdout:5/443: fsync f4 0 2024-03-12T16:10:47.082 INFO:tasks.workunit.client.0.smithi006.stdout:0/499: write d2/f4 [3337360,70200] 0 2024-03-12T16:10:47.083 INFO:tasks.workunit.client.0.smithi006.stdout:8/452: read d2/db/f39 [2171830,28078] 0 2024-03-12T16:10:47.083 INFO:tasks.workunit.client.1.smithi134.stdout:9/742: read d5/d20/f52 [3740478,42795] 0 2024-03-12T16:10:47.086 INFO:tasks.workunit.client.0.smithi006.stdout:6/479: unlink d3/d11/d10/d1b/d20/f75 0 2024-03-12T16:10:47.088 INFO:tasks.workunit.client.0.smithi006.stdout:9/453: rename d0/d8/d16/d8c to d0/d4/d9b 0 2024-03-12T16:10:47.089 INFO:tasks.workunit.client.1.smithi134.stdout:1/550: dread d0/d30/d86/f27 [4194304,4194304] 0 2024-03-12T16:10:47.092 INFO:tasks.workunit.client.0.smithi006.stdout:5/444: mknod d7/d9/d31/d3b/d4f/d65/c8f 0 2024-03-12T16:10:47.092 INFO:tasks.workunit.client.1.smithi134.stdout:2/684: dwrite d4/d12/d39/fd2 [0,4194304] 0 2024-03-12T16:10:47.093 INFO:tasks.workunit.client.1.smithi134.stdout:1/551: write d0/d42/f92 [914652,23496] 0 2024-03-12T16:10:47.094 INFO:tasks.workunit.client.0.smithi006.stdout:4/604: sync 2024-03-12T16:10:47.094 INFO:tasks.workunit.client.1.smithi134.stdout:5/828: dread db/d12/d1d/d3a/d4e/f55 [0,4194304] 0 2024-03-12T16:10:47.095 INFO:tasks.workunit.client.0.smithi006.stdout:6/480: symlink d3/d11/d10/d28/lae 0 2024-03-12T16:10:47.095 INFO:tasks.workunit.client.0.smithi006.stdout:2/529: sync 2024-03-12T16:10:47.095 INFO:tasks.workunit.client.0.smithi006.stdout:1/547: sync 2024-03-12T16:10:47.096 INFO:tasks.workunit.client.1.smithi134.stdout:1/552: stat d0/d16/d9/d13/d21/dac/cb3 0 2024-03-12T16:10:47.098 INFO:tasks.workunit.client.0.smithi006.stdout:7/655: creat de/d2c/d4f/dba/fdf x:0 0 0 2024-03-12T16:10:47.100 INFO:tasks.workunit.client.0.smithi006.stdout:3/486: creat d8/d19/d26/d59/fa8 x:0 0 0 2024-03-12T16:10:47.101 INFO:tasks.workunit.client.0.smithi006.stdout:0/500: dwrite d2/d39/d42/d67/f80 [0,4194304] 0 2024-03-12T16:10:47.102 INFO:tasks.workunit.client.1.smithi134.stdout:0/704: dread db/f50 [0,4194304] 0 2024-03-12T16:10:47.105 INFO:tasks.workunit.client.0.smithi006.stdout:4/605: chown d1/d38/f57 1789685 1 2024-03-12T16:10:47.106 INFO:tasks.workunit.client.0.smithi006.stdout:8/453: dwrite d2/d11/d6e/f74 [4194304,4194304] 0 2024-03-12T16:10:47.106 INFO:tasks.workunit.client.0.smithi006.stdout:5/445: creat d7/d9/d31/d3b/d4f/d65/d69/f90 x:0 0 0 2024-03-12T16:10:47.108 INFO:tasks.workunit.client.0.smithi006.stdout:1/548: unlink d0/d25/d2a/d43/d68/ca3 0 2024-03-12T16:10:47.110 INFO:tasks.workunit.client.0.smithi006.stdout:9/454: dread d0/d8/d16/d7d/f48 [0,4194304] 0 2024-03-12T16:10:47.112 INFO:tasks.workunit.client.0.smithi006.stdout:2/530: symlink d0/d13/d49/d60/d2b/d62/d66/d69/lab 0 2024-03-12T16:10:47.112 INFO:tasks.workunit.client.0.smithi006.stdout:0/501: fsync d2/d39/d42/f64 0 2024-03-12T16:10:47.113 INFO:tasks.workunit.client.1.smithi134.stdout:6/737: dread d1/d4/f67 [0,4194304] 0 2024-03-12T16:10:47.114 INFO:tasks.workunit.client.0.smithi006.stdout:5/446: write d7/d9/d31/f2e [2288706,2708] 0 2024-03-12T16:10:47.117 INFO:tasks.workunit.client.0.smithi006.stdout:2/531: chown d0/d13/d49/d60/f6f 937 1 2024-03-12T16:10:47.119 INFO:tasks.workunit.client.0.smithi006.stdout:5/447: chown d7/d9/d10/c22 123741 1 2024-03-12T16:10:47.121 INFO:tasks.workunit.client.1.smithi134.stdout:7/744: sync 2024-03-12T16:10:47.121 INFO:tasks.workunit.client.1.smithi134.stdout:3/866: sync 2024-03-12T16:10:47.122 INFO:tasks.workunit.client.0.smithi006.stdout:3/487: rename d8/d52/d6c/f83 to d8/d52/d9e/fa9 0 2024-03-12T16:10:47.124 INFO:tasks.workunit.client.0.smithi006.stdout:6/481: symlink d3/d11/d10/d1b/d6e/d80/d9b/laf 0 2024-03-12T16:10:47.125 INFO:tasks.workunit.client.0.smithi006.stdout:8/454: write d2/db/f24 [695694,128170] 0 2024-03-12T16:10:47.130 INFO:tasks.workunit.client.0.smithi006.stdout:3/488: stat d8/d19/d26/d59/d2c/l7a 0 2024-03-12T16:10:47.131 INFO:tasks.workunit.client.0.smithi006.stdout:9/455: dwrite d0/d1f/f8b [0,4194304] 0 2024-03-12T16:10:47.131 INFO:tasks.workunit.client.0.smithi006.stdout:5/448: read d7/d9/d10/d35/f3c [3937714,40317] 0 2024-03-12T16:10:47.133 INFO:tasks.workunit.client.1.smithi134.stdout:2/685: mknod d4/d12/d1d/d34/dcb/cf2 0 2024-03-12T16:10:47.134 INFO:tasks.workunit.client.0.smithi006.stdout:8/455: creat d2/d55/d7b/f8e x:0 0 0 2024-03-12T16:10:47.135 INFO:tasks.workunit.client.1.smithi134.stdout:6/738: mknod d1/d3a/c116 0 2024-03-12T16:10:47.136 INFO:tasks.workunit.client.1.smithi134.stdout:0/705: read db/d2f/d31/d75/fb1 [2946107,8363] 0 2024-03-12T16:10:47.136 INFO:tasks.workunit.client.0.smithi006.stdout:3/489: mknod d8/d19/d47/caa 0 2024-03-12T16:10:47.136 INFO:tasks.workunit.client.0.smithi006.stdout:2/532: mknod d0/d13/d49/d60/cac 0 2024-03-12T16:10:47.136 INFO:tasks.workunit.client.1.smithi134.stdout:3/867: mknod d1/db/d10/d2a/dc6/df1/c137 0 2024-03-12T16:10:47.137 INFO:tasks.workunit.client.1.smithi134.stdout:5/829: mkdir db/d12/d37/db4/db9/ddf/d103 0 2024-03-12T16:10:47.137 INFO:tasks.workunit.client.0.smithi006.stdout:1/549: link d0/d25/d2a/d35/d3f/f61 d0/d25/d2a/d43/fbc 0 2024-03-12T16:10:47.138 INFO:tasks.workunit.client.1.smithi134.stdout:1/553: mkdir d0/d30/d48/da1/dbf 0 2024-03-12T16:10:47.139 INFO:tasks.workunit.client.1.smithi134.stdout:5/830: dread - db/d12/d1d/d59/fbf zero size 2024-03-12T16:10:47.140 INFO:tasks.workunit.client.1.smithi134.stdout:5/831: write db/d12/d1d/d5c/f65 [5929873,97306] 0 2024-03-12T16:10:47.140 INFO:tasks.workunit.client.0.smithi006.stdout:0/502: write d2/d6/d10/d11/d32/f6c [7871721,6144] 0 2024-03-12T16:10:47.141 INFO:tasks.workunit.client.1.smithi134.stdout:7/745: mkdir d8/dc/d7b/df8/dfd 0 2024-03-12T16:10:47.141 INFO:tasks.workunit.client.0.smithi006.stdout:4/606: link d1/db/d1d/d2f/l41 d1/db/d1d/d2f/lc8 0 2024-03-12T16:10:47.142 INFO:tasks.workunit.client.1.smithi134.stdout:0/706: creat db/d2f/d31/d68/da2/db2/fe0 x:0 0 0 2024-03-12T16:10:47.143 INFO:tasks.workunit.client.1.smithi134.stdout:2/686: fsync d4/d12/d43/f4c 0 2024-03-12T16:10:47.143 INFO:tasks.workunit.client.0.smithi006.stdout:8/456: creat d2/d55/f8f x:0 0 0 2024-03-12T16:10:47.144 INFO:tasks.workunit.client.0.smithi006.stdout:6/482: truncate d3/d11/f3c 1593904 0 2024-03-12T16:10:47.145 INFO:tasks.workunit.client.1.smithi134.stdout:7/746: unlink d8/d27/f75 0 2024-03-12T16:10:47.145 INFO:tasks.workunit.client.1.smithi134.stdout:5/832: mknod db/d12/d1d/d3a/d49/c104 0 2024-03-12T16:10:47.146 INFO:tasks.workunit.client.0.smithi006.stdout:1/550: dread - d0/d25/f5d zero size 2024-03-12T16:10:47.146 INFO:tasks.workunit.client.1.smithi134.stdout:7/747: stat d8/dc/d4b/fc7 0 2024-03-12T16:10:47.147 INFO:tasks.workunit.client.0.smithi006.stdout:6/483: dread - d3/d11/d10/d28/d45/d60/f87 zero size 2024-03-12T16:10:47.147 INFO:tasks.workunit.client.0.smithi006.stdout:1/551: stat d0/d25/d2a/d43/f49 0 2024-03-12T16:10:47.149 INFO:tasks.workunit.client.1.smithi134.stdout:0/707: unlink db/f11 0 2024-03-12T16:10:47.150 INFO:tasks.workunit.client.1.smithi134.stdout:2/687: dread d4/d84/d63/d9d/f4b [0,4194304] 0 2024-03-12T16:10:47.150 INFO:tasks.workunit.client.0.smithi006.stdout:8/457: mknod d2/d11/d6e/c90 0 2024-03-12T16:10:47.152 INFO:tasks.workunit.client.1.smithi134.stdout:6/739: creat d1/f117 x:0 0 0 2024-03-12T16:10:47.155 INFO:tasks.workunit.client.0.smithi006.stdout:9/456: truncate d0/d4/d3b/f4b 4560699 0 2024-03-12T16:10:47.156 INFO:tasks.workunit.client.1.smithi134.stdout:5/833: mknod db/d12/d1d/d5c/c105 0 2024-03-12T16:10:47.157 INFO:tasks.workunit.client.1.smithi134.stdout:5/834: readlink db/d12/d1d/d59/d94/lcb 0 2024-03-12T16:10:47.159 INFO:tasks.workunit.client.1.smithi134.stdout:2/688: fsync d4/d12/d43/da2/f69 0 2024-03-12T16:10:47.161 INFO:tasks.workunit.client.0.smithi006.stdout:1/552: creat d0/d25/d2a/d35/fbd x:0 0 0 2024-03-12T16:10:47.163 INFO:tasks.workunit.client.0.smithi006.stdout:0/503: link d2/fd d2/d39/d42/d82/f94 0 2024-03-12T16:10:47.164 INFO:tasks.workunit.client.1.smithi134.stdout:7/748: dread d8/d27/d9d/f93 [0,4194304] 0 2024-03-12T16:10:47.164 INFO:tasks.workunit.client.1.smithi134.stdout:5/835: dwrite db/d12/d1d/f89 [0,4194304] 0 2024-03-12T16:10:47.165 INFO:tasks.workunit.client.0.smithi006.stdout:8/458: fdatasync d2/db/f39 0 2024-03-12T16:10:47.165 INFO:tasks.workunit.client.1.smithi134.stdout:6/740: unlink d1/da6/d55/dcc/fcf 0 2024-03-12T16:10:47.166 INFO:tasks.workunit.client.0.smithi006.stdout:2/533: creat d0/d13/d49/d60/fad x:0 0 0 2024-03-12T16:10:47.167 INFO:tasks.workunit.client.0.smithi006.stdout:6/484: dwrite d3/d11/d43/f5b [0,4194304] 0 2024-03-12T16:10:47.168 INFO:tasks.workunit.client.1.smithi134.stdout:6/741: write d1/d16/d4c/d58/da0/db7/f9f [780350,100190] 0 2024-03-12T16:10:47.168 INFO:tasks.workunit.client.1.smithi134.stdout:3/868: truncate d1/d63/d6c/f6d 587082 0 2024-03-12T16:10:47.169 INFO:tasks.workunit.client.0.smithi006.stdout:4/607: write d1/db/d39/d42/d61/fc7 [755374,68533] 0 2024-03-12T16:10:47.173 INFO:tasks.workunit.client.0.smithi006.stdout:3/490: truncate d8/d19/d47/f72 472947 0 2024-03-12T16:10:47.173 INFO:tasks.workunit.client.1.smithi134.stdout:5/836: symlink db/d7d/l106 0 2024-03-12T16:10:47.174 INFO:tasks.workunit.client.1.smithi134.stdout:5/837: chown db/d12/d37/d73/l8f 60 1 2024-03-12T16:10:47.175 INFO:tasks.workunit.client.1.smithi134.stdout:7/749: fsync d8/dc/d20/f1d 0 2024-03-12T16:10:47.176 INFO:tasks.workunit.client.1.smithi134.stdout:0/708: write db/d2f/d31/d75/d88/f97 [159181,6057] 0 2024-03-12T16:10:47.177 INFO:tasks.workunit.client.0.smithi006.stdout:1/553: creat d0/d25/d2a/d35/d3f/fbe x:0 0 0 2024-03-12T16:10:47.179 INFO:tasks.workunit.client.1.smithi134.stdout:2/689: rename d4/d12/d39/lc3 to d4/d12/d1d/d34/d47/d8c/da4/lf3 0 2024-03-12T16:10:47.183 INFO:tasks.workunit.client.0.smithi006.stdout:5/449: truncate d7/d9/d31/d3b/d4f/d65/f74 177957 0 2024-03-12T16:10:47.184 INFO:tasks.workunit.client.0.smithi006.stdout:8/459: creat d2/db/d1a/d23/f91 x:0 0 0 2024-03-12T16:10:47.185 INFO:tasks.workunit.client.1.smithi134.stdout:7/750: symlink d8/d27/d9d/lfe 0 2024-03-12T16:10:47.187 INFO:tasks.workunit.client.0.smithi006.stdout:8/460: write d2/db/f62 [992409,57819] 0 2024-03-12T16:10:47.187 INFO:tasks.workunit.client.1.smithi134.stdout:6/742: link d1/d16/d4c/d65/d7b/ff8 d1/d16/d4c/d58/d115/f118 0 2024-03-12T16:10:47.188 INFO:tasks.workunit.client.0.smithi006.stdout:5/450: truncate d7/d9/d31/d3b/d4f/d65/f7d 865754 0 2024-03-12T16:10:47.188 INFO:tasks.workunit.client.0.smithi006.stdout:8/461: chown d2/fd 130 1 2024-03-12T16:10:47.189 INFO:tasks.workunit.client.1.smithi134.stdout:2/690: dwrite d4/d12/f32 [0,4194304] 0 2024-03-12T16:10:47.190 INFO:tasks.workunit.client.0.smithi006.stdout:9/457: write d0/d8/d16/f46 [1012748,34642] 0 2024-03-12T16:10:47.192 INFO:tasks.workunit.client.0.smithi006.stdout:1/554: mknod d0/d25/d2a/d43/d63/cbf 0 2024-03-12T16:10:47.193 INFO:tasks.workunit.client.1.smithi134.stdout:6/743: dread d1/d16/d4c/d58/da0/db7/f9f [0,4194304] 0 2024-03-12T16:10:47.197 INFO:tasks.workunit.client.0.smithi006.stdout:8/462: unlink d2/d11/d5a/l8c 0 2024-03-12T16:10:47.198 INFO:tasks.workunit.client.0.smithi006.stdout:8/463: stat d2/d11/d6e/c90 0 2024-03-12T16:10:47.202 INFO:tasks.workunit.client.0.smithi006.stdout:2/534: mknod d0/d13/d49/d60/d2b/d62/d66/cae 0 2024-03-12T16:10:47.204 INFO:tasks.workunit.client.0.smithi006.stdout:6/485: write f1 [616289,78612] 0 2024-03-12T16:10:47.205 INFO:tasks.workunit.client.0.smithi006.stdout:6/486: chown d3/f52 47273455 1 2024-03-12T16:10:47.209 INFO:tasks.workunit.client.0.smithi006.stdout:2/535: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf 0 2024-03-12T16:10:47.212 INFO:tasks.workunit.client.0.smithi006.stdout:9/458: unlink d0/fc 0 2024-03-12T16:10:47.212 INFO:tasks.workunit.client.1.smithi134.stdout:3/869: truncate d1/db/d10/d2d/d2e/f3f 2894259 0 2024-03-12T16:10:47.212 INFO:tasks.workunit.client.0.smithi006.stdout:3/491: link d8/d19/d26/d59/d2c/dc/d28/d2f/l98 d8/d19/d26/d59/d2c/d41/d8b/lab 0 2024-03-12T16:10:47.213 INFO:tasks.workunit.client.0.smithi006.stdout:9/459: read - d0/d83/f92 zero size 2024-03-12T16:10:47.214 INFO:tasks.workunit.client.1.smithi134.stdout:5/838: dread db/d12/d1d/d3a/d4e/f82 [0,4194304] 0 2024-03-12T16:10:47.214 INFO:tasks.workunit.client.0.smithi006.stdout:6/487: mkdir d3/d47/db0 0 2024-03-12T16:10:47.215 INFO:tasks.workunit.client.1.smithi134.stdout:6/744: write d1/da6/d55/fdd [949387,53843] 0 2024-03-12T16:10:47.216 INFO:tasks.workunit.client.0.smithi006.stdout:0/504: getdents d2/d6/d37 0 2024-03-12T16:10:47.217 INFO:tasks.workunit.client.0.smithi006.stdout:2/536: dwrite d0/d13/f7c [0,4194304] 0 2024-03-12T16:10:47.217 INFO:tasks.workunit.client.1.smithi134.stdout:0/709: truncate db/d2f/d31/d68/da2/db2/fe0 1006556 0 2024-03-12T16:10:47.217 INFO:tasks.workunit.client.0.smithi006.stdout:1/555: symlink d0/d25/d2a/d43/d63/db6/lc0 0 2024-03-12T16:10:47.219 INFO:tasks.workunit.client.1.smithi134.stdout:2/691: dwrite d4/d84/d63/dde/fee [0,4194304] 0 2024-03-12T16:10:47.220 INFO:tasks.workunit.client.0.smithi006.stdout:4/608: getdents d1/db/d1d 0 2024-03-12T16:10:47.221 INFO:tasks.workunit.client.1.smithi134.stdout:2/692: write d4/d12/d3b/fed [20591,28266] 0 2024-03-12T16:10:47.221 INFO:tasks.workunit.client.0.smithi006.stdout:8/464: mknod d2/db/d1a/d7a/c92 0 2024-03-12T16:10:47.221 INFO:tasks.workunit.client.0.smithi006.stdout:9/460: write d0/d8/d16/d2f/f4c [814129,119031] 0 2024-03-12T16:10:47.223 INFO:tasks.workunit.client.0.smithi006.stdout:4/609: stat d1/db/d1d/d2f/fc6 0 2024-03-12T16:10:47.223 INFO:tasks.workunit.client.0.smithi006.stdout:8/465: chown d2/db/f24 1872 1 2024-03-12T16:10:47.225 INFO:tasks.workunit.client.0.smithi006.stdout:4/610: read - d1/db/d39/d42/f81 zero size 2024-03-12T16:10:47.226 INFO:tasks.workunit.client.0.smithi006.stdout:4/611: fdatasync d1/db/f3c 0 2024-03-12T16:10:47.230 INFO:tasks.workunit.client.0.smithi006.stdout:6/488: mkdir d3/d11/d10/d1b/d6e/db1 0 2024-03-12T16:10:47.230 INFO:tasks.workunit.client.0.smithi006.stdout:6/489: chown d3/c7d 12 1 2024-03-12T16:10:47.231 INFO:tasks.workunit.client.0.smithi006.stdout:4/612: write d1/db/f29 [1147741,96386] 0 2024-03-12T16:10:47.236 INFO:tasks.workunit.client.0.smithi006.stdout:5/451: getdents d7/d9/d31/d3b/d6b 0 2024-03-12T16:10:47.238 INFO:tasks.workunit.client.0.smithi006.stdout:9/461: creat d0/d4/d70/d71/f9c x:0 0 0 2024-03-12T16:10:47.242 INFO:tasks.workunit.client.0.smithi006.stdout:6/490: symlink d3/d11/d3b/d59/lb2 0 2024-03-12T16:10:47.243 INFO:tasks.workunit.client.0.smithi006.stdout:4/613: creat d1/db/d17/d43/db5/fc9 x:0 0 0 2024-03-12T16:10:47.254 INFO:tasks.workunit.client.0.smithi006.stdout:8/466: dwrite d2/db/d1a/d1f/f3c [0,4194304] 0 2024-03-12T16:10:47.255 INFO:tasks.workunit.client.0.smithi006.stdout:9/462: creat d0/d8/d16/d7d/d20/d37/f9d x:0 0 0 2024-03-12T16:10:47.257 INFO:tasks.workunit.client.0.smithi006.stdout:9/463: stat d0/f28 0 2024-03-12T16:10:47.257 INFO:tasks.workunit.client.0.smithi006.stdout:1/556: getdents d0/d25 0 2024-03-12T16:10:47.263 INFO:tasks.workunit.client.0.smithi006.stdout:2/537: dwrite d0/d13/f44 [0,4194304] 0 2024-03-12T16:10:47.266 INFO:tasks.workunit.client.1.smithi134.stdout:8/733: sync 2024-03-12T16:10:47.266 INFO:tasks.workunit.client.0.smithi006.stdout:6/491: mknod d3/d11/d10/d1b/d6e/d80/d9b/cb3 0 2024-03-12T16:10:47.268 INFO:tasks.workunit.client.0.smithi006.stdout:3/492: getdents d8/d19/d26/d59/d2c/d41/d8b 0 2024-03-12T16:10:47.270 INFO:tasks.workunit.client.0.smithi006.stdout:9/464: dwrite d0/d8/d16/d7d/d20/d37/f9d [0,4194304] 0 2024-03-12T16:10:47.271 INFO:tasks.workunit.client.0.smithi006.stdout:4/614: creat d1/db/d17/d5a/fca x:0 0 0 2024-03-12T16:10:47.275 INFO:tasks.workunit.client.0.smithi006.stdout:0/505: getdents d2/d6/d10/d11/d7e 0 2024-03-12T16:10:47.276 INFO:tasks.workunit.client.0.smithi006.stdout:5/452: mkdir d7/d8/d91 0 2024-03-12T16:10:47.277 INFO:tasks.workunit.client.0.smithi006.stdout:6/492: mkdir d3/d11/d3b/db4 0 2024-03-12T16:10:47.277 INFO:tasks.workunit.client.0.smithi006.stdout:1/557: write d0/d25/d2a/f71 [3083110,119516] 0 2024-03-12T16:10:47.278 INFO:tasks.workunit.client.0.smithi006.stdout:9/465: symlink d0/d4/d3b/d6a/l9e 0 2024-03-12T16:10:47.279 INFO:tasks.workunit.client.0.smithi006.stdout:4/615: mknod d1/d38/db6/ccb 0 2024-03-12T16:10:47.280 INFO:tasks.workunit.client.0.smithi006.stdout:2/538: truncate d0/dc/f15 9415250 0 2024-03-12T16:10:47.283 INFO:tasks.workunit.client.0.smithi006.stdout:3/493: creat d8/d19/d26/d59/d2c/dc/d28/d2f/d99/fac x:0 0 0 2024-03-12T16:10:47.284 INFO:tasks.workunit.client.0.smithi006.stdout:6/493: dread - d3/d11/d10/d28/d45/d60/f87 zero size 2024-03-12T16:10:47.285 INFO:tasks.workunit.client.0.smithi006.stdout:4/616: write d1/db/d1d/f2b [2903151,104950] 0 2024-03-12T16:10:47.287 INFO:tasks.workunit.client.0.smithi006.stdout:8/467: dwrite d2/db/d1a/f1c [0,4194304] 0 2024-03-12T16:10:47.288 INFO:tasks.workunit.client.0.smithi006.stdout:9/466: rename d0/d8/c12 to d0/d8/d16/d7d/d20/c9f 0 2024-03-12T16:10:47.291 INFO:tasks.workunit.client.0.smithi006.stdout:8/468: chown d2/c8 31 1 2024-03-12T16:10:47.296 INFO:tasks.workunit.client.1.smithi134.stdout:3/870: symlink d1/db/d12/d9d/dc5/l138 0 2024-03-12T16:10:47.296 INFO:tasks.workunit.client.1.smithi134.stdout:5/839: mkdir db/d12/d1d/d59/de5/d107 0 2024-03-12T16:10:47.298 INFO:tasks.workunit.client.1.smithi134.stdout:5/840: chown db/d12/d1d/l2a 4019962 1 2024-03-12T16:10:47.300 INFO:tasks.workunit.client.1.smithi134.stdout:8/734: truncate d3/d1b/f14 2391676 0 2024-03-12T16:10:47.302 INFO:tasks.workunit.client.1.smithi134.stdout:6/745: creat d1/da6/d55/d97/dfd/f119 x:0 0 0 2024-03-12T16:10:47.303 INFO:tasks.workunit.client.1.smithi134.stdout:6/746: stat d1/d3/d19/f59 0 2024-03-12T16:10:47.305 INFO:tasks.workunit.client.1.smithi134.stdout:0/710: dwrite db/f1f [0,4194304] 0 2024-03-12T16:10:47.307 INFO:tasks.workunit.client.1.smithi134.stdout:5/841: rename db/d12/d37 to db/d12/d1d/d3a/d4e/d108 0 2024-03-12T16:10:47.307 INFO:tasks.workunit.client.1.smithi134.stdout:3/871: mknod d1/db/d10/d2d/d2e/d72/d116/c139 0 2024-03-12T16:10:47.308 INFO:tasks.workunit.client.1.smithi134.stdout:2/693: link d4/d84/d7d/fd9 d4/d12/daf/ff4 0 2024-03-12T16:10:47.309 INFO:tasks.workunit.client.1.smithi134.stdout:6/747: creat d1/d3a/db5/deb/f11a x:0 0 0 2024-03-12T16:10:47.309 INFO:tasks.workunit.client.1.smithi134.stdout:5/842: dread - db/d12/d1d/d59/fbf zero size 2024-03-12T16:10:47.311 INFO:tasks.workunit.client.1.smithi134.stdout:3/872: rmdir d1/db/d14/d5a/d89 39 2024-03-12T16:10:47.313 INFO:tasks.workunit.client.1.smithi134.stdout:8/735: creat d3/d1b/d17/d25/f101 x:0 0 0 2024-03-12T16:10:47.314 INFO:tasks.workunit.client.1.smithi134.stdout:6/748: rename d1/d16/d4c/d58/d8e/ca2 to d1/def/c11b 0 2024-03-12T16:10:47.316 INFO:tasks.workunit.client.1.smithi134.stdout:2/694: mkdir d4/de8/dea/df5 0 2024-03-12T16:10:47.316 INFO:tasks.workunit.client.1.smithi134.stdout:0/711: dwrite db/f35 [4194304,4194304] 0 2024-03-12T16:10:47.317 INFO:tasks.workunit.client.1.smithi134.stdout:2/695: stat d4/d12/d1d/f37 0 2024-03-12T16:10:47.319 INFO:tasks.workunit.client.1.smithi134.stdout:8/736: fsync d3/d82/fe7 0 2024-03-12T16:10:47.320 INFO:tasks.workunit.client.1.smithi134.stdout:5/843: creat db/d12/d1d/d3a/d4e/d108/db4/db9/df6/f109 x:0 0 0 2024-03-12T16:10:47.321 INFO:tasks.workunit.client.1.smithi134.stdout:6/749: mkdir d1/def/d11c 0 2024-03-12T16:10:47.322 INFO:tasks.workunit.client.1.smithi134.stdout:5/844: chown db/d12/d7b/l83 16 1 2024-03-12T16:10:47.324 INFO:tasks.workunit.client.1.smithi134.stdout:0/712: creat db/d2f/d31/d75/d88/fe1 x:0 0 0 2024-03-12T16:10:47.326 INFO:tasks.workunit.client.1.smithi134.stdout:5/845: fsync db/d12/d29/f102 0 2024-03-12T16:10:47.328 INFO:tasks.workunit.client.1.smithi134.stdout:6/750: chown d1/d16/d4c/d65/d9d/lc9 4262410 1 2024-03-12T16:10:47.330 INFO:tasks.workunit.client.1.smithi134.stdout:8/737: mkdir d3/d1b/d17/d24/d28/d102 0 2024-03-12T16:10:47.331 INFO:tasks.workunit.client.1.smithi134.stdout:3/873: dwrite d1/db/d14/d5a/d89/ffe [0,4194304] 0 2024-03-12T16:10:47.333 INFO:tasks.workunit.client.1.smithi134.stdout:6/751: unlink d1/c12 0 2024-03-12T16:10:47.336 INFO:tasks.workunit.client.1.smithi134.stdout:2/696: dwrite d4/d12/d1d/f97 [0,4194304] 0 2024-03-12T16:10:47.337 INFO:tasks.workunit.client.0.smithi006.stdout:0/506: dread d2/d39/d42/f51 [0,4194304] 0 2024-03-12T16:10:47.339 INFO:tasks.workunit.client.1.smithi134.stdout:5/846: mknod db/d12/d1d/d59/d94/ddb/df0/c10a 0 2024-03-12T16:10:47.339 INFO:tasks.workunit.client.0.smithi006.stdout:3/494: dread - d8/d19/d26/d59/d2c/d41/f6e zero size 2024-03-12T16:10:47.340 INFO:tasks.workunit.client.0.smithi006.stdout:7/656: sync 2024-03-12T16:10:47.341 INFO:tasks.workunit.client.1.smithi134.stdout:8/738: mknod d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/c103 0 2024-03-12T16:10:47.342 INFO:tasks.workunit.client.0.smithi006.stdout:4/617: rmdir d1/db/d39/d42 39 2024-03-12T16:10:47.344 INFO:tasks.workunit.client.1.smithi134.stdout:6/752: read d1/d3/d19/f51 [1728376,14938] 0 2024-03-12T16:10:47.346 INFO:tasks.workunit.client.0.smithi006.stdout:9/467: mknod d0/d8/d16/d7d/d20/ca0 0 2024-03-12T16:10:47.346 INFO:tasks.workunit.client.0.smithi006.stdout:8/469: unlink d2/d11/f14 0 2024-03-12T16:10:47.347 INFO:tasks.workunit.client.0.smithi006.stdout:0/507: dread d2/d39/d42/f58 [0,4194304] 0 2024-03-12T16:10:47.348 INFO:tasks.workunit.client.0.smithi006.stdout:5/453: getdents d7/d9/d31/d3b/d4f 0 2024-03-12T16:10:47.349 INFO:tasks.workunit.client.1.smithi134.stdout:3/874: truncate d1/db/d12/d9d/fc0 1142550 0 2024-03-12T16:10:47.349 INFO:tasks.workunit.client.0.smithi006.stdout:9/468: chown d0/d8/l5 7 1 2024-03-12T16:10:47.350 INFO:tasks.workunit.client.1.smithi134.stdout:0/713: dwrite db/f26 [4194304,4194304] 0 2024-03-12T16:10:47.350 INFO:tasks.workunit.client.0.smithi006.stdout:6/494: creat d3/d11/d10/d1b/d6e/db1/fb5 x:0 0 0 2024-03-12T16:10:47.351 INFO:tasks.workunit.client.0.smithi006.stdout:8/470: write d2/db/d1a/d21/d2b/f88 [553026,84161] 0 2024-03-12T16:10:47.355 INFO:tasks.workunit.client.0.smithi006.stdout:4/618: mkdir d1/db/d17/d43/dcc 0 2024-03-12T16:10:47.356 INFO:tasks.workunit.client.1.smithi134.stdout:8/739: rename d3/d10 to d3/d82/d104 0 2024-03-12T16:10:47.356 INFO:tasks.workunit.client.1.smithi134.stdout:2/697: link d4/d12/d1d/d34/l50 d4/d12/d1d/d34/d47/d8c/da4/lf6 0 2024-03-12T16:10:47.359 INFO:tasks.workunit.client.0.smithi006.stdout:2/539: rename d0/d13/d49/d60/d2b/f63 to d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fb0 0 2024-03-12T16:10:47.361 INFO:tasks.workunit.client.0.smithi006.stdout:2/540: fsync d0/d13/d49/d60/f53 0 2024-03-12T16:10:47.362 INFO:tasks.workunit.client.1.smithi134.stdout:5/847: dwrite db/d12/d1d/d3a/d49/f101 [0,4194304] 0 2024-03-12T16:10:47.362 INFO:tasks.workunit.client.1.smithi134.stdout:2/698: chown d4/d12/d3b/d3f 42 1 2024-03-12T16:10:47.362 INFO:tasks.workunit.client.1.smithi134.stdout:0/714: rmdir db/d2f/d51/db4 39 2024-03-12T16:10:47.362 INFO:tasks.workunit.client.0.smithi006.stdout:8/471: creat d2/d11/d3f/f93 x:0 0 0 2024-03-12T16:10:47.363 INFO:tasks.workunit.client.0.smithi006.stdout:5/454: mkdir d7/d8/d8a/d92 0 2024-03-12T16:10:47.365 INFO:tasks.workunit.client.1.smithi134.stdout:0/715: truncate db/d2f/d31/d76/f9c 950065 0 2024-03-12T16:10:47.365 INFO:tasks.workunit.client.1.smithi134.stdout:8/740: fdatasync d3/d1b/d17/d25/d33/f72 0 2024-03-12T16:10:47.367 INFO:tasks.workunit.client.0.smithi006.stdout:2/541: dread d0/d13/f44 [0,4194304] 0 2024-03-12T16:10:47.369 INFO:tasks.workunit.client.0.smithi006.stdout:2/542: write d0/d13/d49/d60/d2b/d62/f86 [304936,123417] 0 2024-03-12T16:10:47.370 INFO:tasks.workunit.client.0.smithi006.stdout:2/543: chown d0/dc/d64/f9c 4111334 1 2024-03-12T16:10:47.371 INFO:tasks.workunit.client.1.smithi134.stdout:5/848: mkdir db/d12/d1d/d59/d10b 0 2024-03-12T16:10:47.378 INFO:tasks.workunit.client.1.smithi134.stdout:2/699: creat d4/d12/d1d/d34/d58/dbb/ff7 x:0 0 0 2024-03-12T16:10:47.380 INFO:tasks.workunit.client.1.smithi134.stdout:2/700: mknod d4/d12/d1d/d34/d58/d74/cf8 0 2024-03-12T16:10:47.383 INFO:tasks.workunit.client.1.smithi134.stdout:2/701: symlink d4/d84/d7d/dbe/lf9 0 2024-03-12T16:10:47.383 INFO:tasks.workunit.client.1.smithi134.stdout:3/875: dread d1/db/d12/d9d/fe3 [0,4194304] 0 2024-03-12T16:10:47.384 INFO:tasks.workunit.client.1.smithi134.stdout:1/554: sync 2024-03-12T16:10:47.384 INFO:tasks.workunit.client.1.smithi134.stdout:9/743: sync 2024-03-12T16:10:47.384 INFO:tasks.workunit.client.1.smithi134.stdout:4/683: sync 2024-03-12T16:10:47.386 INFO:tasks.workunit.client.1.smithi134.stdout:3/876: unlink d1/db/cf0 0 2024-03-12T16:10:47.387 INFO:tasks.workunit.client.1.smithi134.stdout:9/744: read - d5/d10/d35/d49/d54/d5e/dab/fbd zero size 2024-03-12T16:10:47.389 INFO:tasks.workunit.client.0.smithi006.stdout:4/619: dread d1/db/d1d/f2b [0,4194304] 0 2024-03-12T16:10:47.392 INFO:tasks.workunit.client.1.smithi134.stdout:9/745: chown d5/d10/d33/l4f 1 1 2024-03-12T16:10:47.393 INFO:tasks.workunit.client.1.smithi134.stdout:2/702: dwrite d4/f13 [0,4194304] 0 2024-03-12T16:10:47.393 INFO:tasks.workunit.client.1.smithi134.stdout:3/877: creat d1/db/d10/d2d/d2e/f13a x:0 0 0 2024-03-12T16:10:47.396 INFO:tasks.workunit.client.1.smithi134.stdout:6/753: dread d1/d3/d19/f59 [0,4194304] 0 2024-03-12T16:10:47.397 INFO:tasks.workunit.client.1.smithi134.stdout:3/878: write d1/d63/d6c/fcd [5662728,106188] 0 2024-03-12T16:10:47.405 INFO:tasks.workunit.client.1.smithi134.stdout:2/703: dwrite d4/fa [0,4194304] 0 2024-03-12T16:10:47.411 INFO:tasks.workunit.client.1.smithi134.stdout:2/704: mknod d4/d84/d63/d9d/d3d/cfa 0 2024-03-12T16:10:47.414 INFO:tasks.workunit.client.0.smithi006.stdout:4/620: dread d1/db/d17/d43/db5/f7a [0,4194304] 0 2024-03-12T16:10:47.414 INFO:tasks.workunit.client.1.smithi134.stdout:2/705: rename d4/d12/d3b/d9b/fae to d4/d12/d43/dec/ffb 0 2024-03-12T16:10:47.425 INFO:tasks.workunit.client.1.smithi134.stdout:8/741: write d3/d1b/d17/d25/d33/d15/d95/f32 [1797741,10379] 0 2024-03-12T16:10:47.426 INFO:tasks.workunit.client.1.smithi134.stdout:5/849: truncate db/d12/d1d/d3a/f88 3472123 0 2024-03-12T16:10:47.428 INFO:tasks.workunit.client.1.smithi134.stdout:5/850: write db/d12/d1d/d3a/d70/d99/ffa [531321,96853] 0 2024-03-12T16:10:47.429 INFO:tasks.workunit.client.1.smithi134.stdout:8/742: mknod d3/d1b/d17/d25/d33/d15/d95/d4f/d65/c105 0 2024-03-12T16:10:47.429 INFO:tasks.workunit.client.1.smithi134.stdout:5/851: write db/d7a/fce [3283975,35631] 0 2024-03-12T16:10:47.459 INFO:tasks.workunit.client.0.smithi006.stdout:6/495: creat d3/d11/d10/d28/d45/d60/fb6 x:0 0 0 2024-03-12T16:10:47.508 INFO:tasks.workunit.client.1.smithi134.stdout:5/852: write db/d12/d29/d3d/d79/fd6 [1071280,101893] 0 2024-03-12T16:10:47.508 INFO:tasks.workunit.client.1.smithi134.stdout:1/555: truncate d0/d16/d9/d13/d38/f82 1017732 0 2024-03-12T16:10:47.508 INFO:tasks.workunit.client.1.smithi134.stdout:6/754: truncate d1/d16/d4c/d58/da0/db7/f4e 2835088 0 2024-03-12T16:10:47.508 INFO:tasks.workunit.client.1.smithi134.stdout:3/879: write d1/d63/d6c/f6d [1444206,75634] 0 2024-03-12T16:10:47.510 INFO:tasks.workunit.client.0.smithi006.stdout:6/496: dread - d3/d11/d10/d28/d45/f83 zero size 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:8/472: symlink d2/d11/d6e/d7c/l94 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:8/473: write d2/d55/d7b/f8e [78759,100202] 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:7/657: getdents de/d1c/d35 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:4/621: dread d1/db/d17/f85 [0,4194304] 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:3/495: getdents d8/d52 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:8/474: rename d2/db/d1a/d23/c25 to d2/db/d70/c95 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:2/544: creat d0/d13/d49/d60/d2b/d62/d66/fb1 x:0 0 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:8/475: rmdir d2/d32 39 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:7/658: creat de/d2c/dd3/fe0 x:0 0 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:4/622: readlink d1/db/d39/d42/d61/lae 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:2/545: rename d0/d13/d49/d60/d2b/d62/d66/c88 to d0/d13/d49/d60/d2b/d62/cb2 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:7/659: symlink de/d18/le1 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:2/546: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/db3 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:4/623: dread d1/d38/d79/f84 [0,4194304] 0 2024-03-12T16:10:47.511 INFO:tasks.workunit.client.0.smithi006.stdout:2/547: dread - d0/d13/d49/d60/d2b/f6b zero size 2024-03-12T16:10:47.512 INFO:tasks.workunit.client.0.smithi006.stdout:6/497: write d3/d11/f25 [758102,32274] 0 2024-03-12T16:10:47.512 INFO:tasks.workunit.client.0.smithi006.stdout:8/476: getdents d2/db/d1a 0 2024-03-12T16:10:47.512 INFO:tasks.workunit.client.0.smithi006.stdout:2/548: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/db4 0 2024-03-12T16:10:47.512 INFO:tasks.workunit.client.0.smithi006.stdout:2/549: rmdir d0/d13/d49/d60/d2b/d62/d79 39 2024-03-12T16:10:47.512 INFO:tasks.workunit.client.0.smithi006.stdout:8/477: symlink d2/db/d1a/d21/d4f/l96 0 2024-03-12T16:10:47.512 INFO:tasks.workunit.client.0.smithi006.stdout:6/498: creat d3/d11/d10/d28/fb7 x:0 0 0 2024-03-12T16:10:47.512 INFO:tasks.workunit.client.0.smithi006.stdout:2/550: readlink d0/dc/l47 0 2024-03-12T16:10:47.512 INFO:tasks.workunit.client.0.smithi006.stdout:6/499: read d3/d11/d10/da7/f88 [2779681,69865] 0 2024-03-12T16:10:47.513 INFO:tasks.workunit.client.0.smithi006.stdout:7/660: dread de/d2c/d93/dbe/d4a/d6a/f84 [0,4194304] 0 2024-03-12T16:10:47.520 INFO:tasks.workunit.client.0.smithi006.stdout:2/551: dwrite d0/f40 [0,4194304] 0 2024-03-12T16:10:47.521 INFO:tasks.workunit.client.0.smithi006.stdout:4/624: dread d1/db/f3c [0,4194304] 0 2024-03-12T16:10:47.521 INFO:tasks.workunit.client.0.smithi006.stdout:6/500: link d3/d11/d10/d1b/d6e/f2e d3/d11/d10/d1b/d6e/d96/fb8 0 2024-03-12T16:10:47.522 INFO:tasks.workunit.client.0.smithi006.stdout:4/625: readlink d1/d38/l6e 0 2024-03-12T16:10:47.523 INFO:tasks.workunit.client.0.smithi006.stdout:6/501: chown d3/d11/d10/d9a/la6 5 1 2024-03-12T16:10:47.523 INFO:tasks.workunit.client.0.smithi006.stdout:2/552: stat d0/l38 0 2024-03-12T16:10:47.527 INFO:tasks.workunit.client.1.smithi134.stdout:7/751: sync 2024-03-12T16:10:47.528 INFO:tasks.workunit.client.0.smithi006.stdout:6/502: creat d3/d11/d10/da7/d9e/daa/fb9 x:0 0 0 2024-03-12T16:10:47.532 INFO:tasks.workunit.client.0.smithi006.stdout:6/503: symlink d3/d11/d10/d1b/d6e/d80/lba 0 2024-03-12T16:10:47.532 INFO:tasks.workunit.client.1.smithi134.stdout:6/755: fdatasync d1/d16/d4c/d58/da0/f10d 0 2024-03-12T16:10:47.532 INFO:tasks.workunit.client.1.smithi134.stdout:0/716: write db/d2f/d31/d76/f9c [435217,60571] 0 2024-03-12T16:10:47.536 INFO:tasks.workunit.client.0.smithi006.stdout:2/553: dwrite d0/d13/d49/d60/d2b/d62/fa2 [4194304,4194304] 0 2024-03-12T16:10:47.537 INFO:tasks.workunit.client.1.smithi134.stdout:3/880: read d1/fb0 [266568,41477] 0 2024-03-12T16:10:47.537 INFO:tasks.workunit.client.1.smithi134.stdout:4/684: dwrite d1/d13/d49/fb1 [0,4194304] 0 2024-03-12T16:10:47.542 INFO:tasks.workunit.client.1.smithi134.stdout:9/746: dwrite d5/d46/f57 [0,4194304] 0 2024-03-12T16:10:47.543 INFO:tasks.workunit.client.0.smithi006.stdout:2/554: stat d0/d13/d49/d60/d2b/d62/d66/cae 0 2024-03-12T16:10:47.543 INFO:tasks.workunit.client.0.smithi006.stdout:6/504: dread d3/d11/f25 [0,4194304] 0 2024-03-12T16:10:47.543 INFO:tasks.workunit.client.0.smithi006.stdout:7/661: dread de/d2c/faa [0,4194304] 0 2024-03-12T16:10:47.543 INFO:tasks.workunit.client.0.smithi006.stdout:2/555: fsync d0/dc/f5b 0 2024-03-12T16:10:47.544 INFO:tasks.workunit.client.0.smithi006.stdout:6/505: stat d3/d11/d10/da7/d9e 0 2024-03-12T16:10:47.545 INFO:tasks.workunit.client.0.smithi006.stdout:7/662: dread - de/d2c/dd3/fe0 zero size 2024-03-12T16:10:47.550 INFO:tasks.workunit.client.0.smithi006.stdout:7/663: creat de/d2c/d93/dbe/d4a/dd1/fe2 x:0 0 0 2024-03-12T16:10:47.552 INFO:tasks.workunit.client.0.smithi006.stdout:7/664: readlink de/d2c/d93/dbe/d4a/d6a/lce 0 2024-03-12T16:10:47.553 INFO:tasks.workunit.client.0.smithi006.stdout:7/665: fsync de/f9f 0 2024-03-12T16:10:47.553 INFO:tasks.workunit.client.0.smithi006.stdout:2/556: dwrite d0/f3f [0,4194304] 0 2024-03-12T16:10:47.556 INFO:tasks.workunit.client.1.smithi134.stdout:0/717: dwrite db/d2f/d31/f59 [4194304,4194304] 0 2024-03-12T16:10:47.557 INFO:tasks.workunit.client.0.smithi006.stdout:7/666: truncate de/d18/fdc 1231132 0 2024-03-12T16:10:47.559 INFO:tasks.workunit.client.0.smithi006.stdout:7/667: fsync de/d1c/d87/ddb/d97/fb9 0 2024-03-12T16:10:47.563 INFO:tasks.workunit.client.0.smithi006.stdout:2/557: getdents d0/d13/d49/d60/d2b 0 2024-03-12T16:10:47.563 INFO:tasks.workunit.client.0.smithi006.stdout:6/506: dread d3/f17 [0,4194304] 0 2024-03-12T16:10:47.568 INFO:tasks.workunit.client.0.smithi006.stdout:7/668: rename de/d1c/f33 to de/d2c/d4f/dba/fe3 0 2024-03-12T16:10:47.568 INFO:tasks.workunit.client.0.smithi006.stdout:2/558: truncate d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f96 1247103 0 2024-03-12T16:10:47.573 INFO:tasks.workunit.client.0.smithi006.stdout:6/507: creat d3/d11/d43/fbb x:0 0 0 2024-03-12T16:10:47.573 INFO:tasks.workunit.client.0.smithi006.stdout:4/626: truncate d1/db/d1d/d2f/f4c 2673827 0 2024-03-12T16:10:47.576 INFO:tasks.workunit.client.0.smithi006.stdout:7/669: symlink de/d7b/le4 0 2024-03-12T16:10:47.577 INFO:tasks.workunit.client.0.smithi006.stdout:7/670: read - de/d2c/d4f/fb6 zero size 2024-03-12T16:10:47.577 INFO:tasks.workunit.client.0.smithi006.stdout:6/508: mknod d3/d11/d10/da7/d9e/cbc 0 2024-03-12T16:10:47.578 INFO:tasks.workunit.client.0.smithi006.stdout:4/627: symlink d1/db/d39/d42/lcd 0 2024-03-12T16:10:47.583 INFO:tasks.workunit.client.1.smithi134.stdout:8/743: getdents d3/d82/d104/dbf 0 2024-03-12T16:10:47.583 INFO:tasks.workunit.client.1.smithi134.stdout:7/752: chown d8/l17 1285 1 2024-03-12T16:10:47.583 INFO:tasks.workunit.client.0.smithi006.stdout:6/509: write d3/d11/d10/d19/f67 [85344,79699] 0 2024-03-12T16:10:47.584 INFO:tasks.workunit.client.0.smithi006.stdout:4/628: chown d1/db/d17/d5a/d60 1937 1 2024-03-12T16:10:47.584 INFO:tasks.workunit.client.0.smithi006.stdout:2/559: dread d0/f50 [0,4194304] 0 2024-03-12T16:10:47.584 INFO:tasks.workunit.client.0.smithi006.stdout:6/510: fsync d3/d11/d10/d1b/d6e/f57 0 2024-03-12T16:10:47.584 INFO:tasks.workunit.client.0.smithi006.stdout:4/629: creat d1/db/d1d/d2f/fce x:0 0 0 2024-03-12T16:10:47.584 INFO:tasks.workunit.client.1.smithi134.stdout:5/853: unlink db/d12/d1d/f66 0 2024-03-12T16:10:47.585 INFO:tasks.workunit.client.0.smithi006.stdout:6/511: dread - d3/d11/d10/da7/d8e/f86 zero size 2024-03-12T16:10:47.586 INFO:tasks.workunit.client.1.smithi134.stdout:4/685: fsync d1/d13/d49/d64/f87 0 2024-03-12T16:10:47.587 INFO:tasks.workunit.client.0.smithi006.stdout:6/512: fdatasync d3/d11/d10/d1b/d6e/d80/f94 0 2024-03-12T16:10:47.588 INFO:tasks.workunit.client.0.smithi006.stdout:4/630: symlink d1/db/d1d/lcf 0 2024-03-12T16:10:47.589 INFO:tasks.workunit.client.0.smithi006.stdout:4/631: dread - d1/db/d17/d5a/d60/f7b zero size 2024-03-12T16:10:47.597 INFO:tasks.workunit.client.0.smithi006.stdout:4/632: link d1/d38/d79/f84 d1/d38/fd0 0 2024-03-12T16:10:47.598 INFO:tasks.workunit.client.1.smithi134.stdout:7/753: truncate d8/f24 476094 0 2024-03-12T16:10:47.601 INFO:tasks.workunit.client.1.smithi134.stdout:7/754: readlink d8/dc/d20/d26/d36/la5 0 2024-03-12T16:10:47.601 INFO:tasks.workunit.client.1.smithi134.stdout:9/747: dwrite d5/d10/d35/d49/d8d/fbf [0,4194304] 0 2024-03-12T16:10:47.603 INFO:tasks.workunit.client.1.smithi134.stdout:6/756: symlink d1/d16/d4c/d58/d115/l11d 0 2024-03-12T16:10:47.604 INFO:tasks.workunit.client.0.smithi006.stdout:7/671: dwrite f3 [4194304,4194304] 0 2024-03-12T16:10:47.606 INFO:tasks.workunit.client.1.smithi134.stdout:3/881: creat d1/db/d10/d2a/dc6/d135/f13b x:0 0 0 2024-03-12T16:10:47.606 INFO:tasks.workunit.client.1.smithi134.stdout:3/882: dread - d1/d63/f107 zero size 2024-03-12T16:10:47.607 INFO:tasks.workunit.client.1.smithi134.stdout:5/854: rename db/d12/d1d/d5c/fc9 to db/d12/d1d/d3a/d4e/d108/d71/d90/f10c 0 2024-03-12T16:10:47.609 INFO:tasks.workunit.client.1.smithi134.stdout:5/855: stat db/d12/d1d/d3a/d4e/f82 0 2024-03-12T16:10:47.611 INFO:tasks.workunit.client.1.smithi134.stdout:2/706: sync 2024-03-12T16:10:47.613 INFO:tasks.workunit.client.0.smithi006.stdout:4/633: link d1/db/d1d/l26 d1/db/d39/ld1 0 2024-03-12T16:10:47.613 INFO:tasks.workunit.client.1.smithi134.stdout:2/707: write d4/d84/d7d/dbe/fc7 [1078036,11075] 0 2024-03-12T16:10:47.614 INFO:tasks.workunit.client.1.smithi134.stdout:8/744: mkdir d3/d1b/d17/d25/d33/d96/d106 0 2024-03-12T16:10:47.618 INFO:tasks.workunit.client.0.smithi006.stdout:4/634: symlink d1/d38/ld2 0 2024-03-12T16:10:47.618 INFO:tasks.workunit.client.0.smithi006.stdout:4/635: chown d1/c83 1417 1 2024-03-12T16:10:47.619 INFO:tasks.workunit.client.0.smithi006.stdout:6/513: dread d3/d11/d10/f42 [0,4194304] 0 2024-03-12T16:10:47.619 INFO:tasks.workunit.client.1.smithi134.stdout:7/755: creat d8/d27/d9d/dc9/fff x:0 0 0 2024-03-12T16:10:47.620 INFO:tasks.workunit.client.1.smithi134.stdout:9/748: mknod d5/d10/d33/cd3 0 2024-03-12T16:10:47.620 INFO:tasks.workunit.client.1.smithi134.stdout:7/756: fsync d8/dc/d4b/fd2 0 2024-03-12T16:10:47.620 INFO:tasks.workunit.client.0.smithi006.stdout:6/514: write f1 [94662,108249] 0 2024-03-12T16:10:47.622 INFO:tasks.workunit.client.0.smithi006.stdout:6/515: creat d3/d11/d10/d1b/d6e/db1/fbd x:0 0 0 2024-03-12T16:10:47.623 INFO:tasks.workunit.client.1.smithi134.stdout:7/757: dread d8/dc/d7b/f8a [0,4194304] 0 2024-03-12T16:10:47.625 INFO:tasks.workunit.client.1.smithi134.stdout:0/718: creat db/fe2 x:0 0 0 2024-03-12T16:10:47.626 INFO:tasks.workunit.client.0.smithi006.stdout:6/516: creat d3/d11/d10/d1b/d6e/d80/d9b/fbe x:0 0 0 2024-03-12T16:10:47.627 INFO:tasks.workunit.client.1.smithi134.stdout:2/708: symlink d4/d84/d63/d9d/d3d/d71/lfc 0 2024-03-12T16:10:47.628 INFO:tasks.workunit.client.0.smithi006.stdout:6/517: write d3/d11/d10/d28/d45/f55 [1444471,41009] 0 2024-03-12T16:10:47.630 INFO:tasks.workunit.client.1.smithi134.stdout:9/749: symlink d5/d10/d35/d49/d74/ld4 0 2024-03-12T16:10:47.630 INFO:tasks.workunit.client.1.smithi134.stdout:3/883: symlink d1/d63/d6c/l13c 0 2024-03-12T16:10:47.631 INFO:tasks.workunit.client.0.smithi006.stdout:6/518: mknod d3/d11/d10/d19/cbf 0 2024-03-12T16:10:47.631 INFO:tasks.workunit.client.1.smithi134.stdout:3/884: chown d1/c129 11044 1 2024-03-12T16:10:47.631 INFO:tasks.workunit.client.1.smithi134.stdout:3/885: readlink d1/db/d10/l11c 0 2024-03-12T16:10:47.634 INFO:tasks.workunit.client.1.smithi134.stdout:1/556: creat d0/d16/d39/fc0 x:0 0 0 2024-03-12T16:10:47.635 INFO:tasks.workunit.client.0.smithi006.stdout:7/672: dread de/d2c/d93/dbe/d4a/d6a/f79 [0,4194304] 0 2024-03-12T16:10:47.636 INFO:tasks.workunit.client.0.smithi006.stdout:4/636: dwrite d1/db/d17/d5a/f62 [0,4194304] 0 2024-03-12T16:10:47.637 INFO:tasks.workunit.client.0.smithi006.stdout:4/637: dread - d1/db/d17/d5a/d60/f7b zero size 2024-03-12T16:10:47.638 INFO:tasks.workunit.client.1.smithi134.stdout:4/686: dread d1/f23 [0,4194304] 0 2024-03-12T16:10:47.640 INFO:tasks.workunit.client.0.smithi006.stdout:4/638: write d1/db/d1d/d2f/f63 [3305769,57293] 0 2024-03-12T16:10:47.643 INFO:tasks.workunit.client.0.smithi006.stdout:6/519: dwrite d3/d11/d10/d28/f53 [4194304,4194304] 0 2024-03-12T16:10:47.647 INFO:tasks.workunit.client.0.smithi006.stdout:6/520: symlink d3/d11/d10/d1b/d6e/d80/lc0 0 2024-03-12T16:10:47.648 INFO:tasks.workunit.client.0.smithi006.stdout:6/521: dread - d3/d11/d10/d1b/d6e/f57 zero size 2024-03-12T16:10:47.648 INFO:tasks.workunit.client.0.smithi006.stdout:6/522: chown d3/d11/d10/d1b/d6e/d96 179 1 2024-03-12T16:10:47.651 INFO:tasks.workunit.client.1.smithi134.stdout:8/745: dread d3/fe [0,4194304] 0 2024-03-12T16:10:47.651 INFO:tasks.workunit.client.1.smithi134.stdout:2/709: dread d4/d12/d1d/d34/f54 [0,4194304] 0 2024-03-12T16:10:47.656 INFO:tasks.workunit.client.1.smithi134.stdout:5/856: link db/c14 db/d12/d7b/c10d 0 2024-03-12T16:10:47.659 INFO:tasks.workunit.client.0.smithi006.stdout:4/639: truncate d1/db/d17/f1c 3337418 0 2024-03-12T16:10:47.661 INFO:tasks.workunit.client.0.smithi006.stdout:4/640: chown d1/db/d17/f1a 112704337 1 2024-03-12T16:10:47.662 INFO:tasks.workunit.client.1.smithi134.stdout:0/719: dread db/d2f/f57 [0,4194304] 0 2024-03-12T16:10:47.662 INFO:tasks.workunit.client.1.smithi134.stdout:5/857: write db/f6d [2773575,12937] 0 2024-03-12T16:10:47.662 INFO:tasks.workunit.client.1.smithi134.stdout:7/758: rmdir d8/dc/d20/d26/d36/df9 0 2024-03-12T16:10:47.664 INFO:tasks.workunit.client.1.smithi134.stdout:2/710: symlink d4/d12/d1d/d34/d47/d8c/da4/lfd 0 2024-03-12T16:10:47.666 INFO:tasks.workunit.client.0.smithi006.stdout:6/523: dwrite d3/f17 [0,4194304] 0 2024-03-12T16:10:47.668 INFO:tasks.workunit.client.1.smithi134.stdout:8/746: fdatasync d3/d1b/d17/d24/f2d 0 2024-03-12T16:10:47.669 INFO:tasks.workunit.client.1.smithi134.stdout:2/711: read d4/d12/d1d/d34/d58/f78 [71465,79920] 0 2024-03-12T16:10:47.671 INFO:tasks.workunit.client.1.smithi134.stdout:2/712: readlink d4/l2c 0 2024-03-12T16:10:47.671 INFO:tasks.workunit.client.1.smithi134.stdout:8/747: write d3/d82/f98 [344349,89034] 0 2024-03-12T16:10:47.676 INFO:tasks.workunit.client.1.smithi134.stdout:3/886: dread d1/db/d12/d9d/d9f/ffa [0,4194304] 0 2024-03-12T16:10:47.676 INFO:tasks.workunit.client.1.smithi134.stdout:0/720: symlink db/d2f/d31/le3 0 2024-03-12T16:10:47.678 INFO:tasks.workunit.client.0.smithi006.stdout:6/524: dwrite d3/d11/f15 [0,4194304] 0 2024-03-12T16:10:47.680 INFO:tasks.workunit.client.0.smithi006.stdout:4/641: dwrite d1/d38/d79/f84 [0,4194304] 0 2024-03-12T16:10:47.682 INFO:tasks.workunit.client.1.smithi134.stdout:4/687: creat d1/d24/fdb x:0 0 0 2024-03-12T16:10:47.682 INFO:tasks.workunit.client.1.smithi134.stdout:7/759: read d8/dc/d20/d26/f3a [266378,130882] 0 2024-03-12T16:10:47.685 INFO:tasks.workunit.client.0.smithi006.stdout:6/525: mkdir d3/d47/db0/dc1 0 2024-03-12T16:10:47.687 INFO:tasks.workunit.client.0.smithi006.stdout:6/526: stat d3/d11/d10/d28/d45/d60/f87 0 2024-03-12T16:10:47.688 INFO:tasks.workunit.client.0.smithi006.stdout:4/642: dwrite d1/db/d1d/d2f/f36 [0,4194304] 0 2024-03-12T16:10:47.690 INFO:tasks.workunit.client.0.smithi006.stdout:6/527: creat d3/d11/d10/da7/d9e/daa/fc2 x:0 0 0 2024-03-12T16:10:47.691 INFO:tasks.workunit.client.1.smithi134.stdout:8/748: dread d3/d1b/d17/d25/d33/f72 [0,4194304] 0 2024-03-12T16:10:47.691 INFO:tasks.workunit.client.1.smithi134.stdout:3/887: mkdir d1/db/d14/d5f/d13d 0 2024-03-12T16:10:47.693 INFO:tasks.workunit.client.1.smithi134.stdout:8/749: write d3/fc7 [2862725,38367] 0 2024-03-12T16:10:47.697 INFO:tasks.workunit.client.0.smithi006.stdout:6/528: dread - d3/d11/d10/d28/d45/f83 zero size 2024-03-12T16:10:47.701 INFO:tasks.workunit.client.0.smithi006.stdout:4/643: dwrite d1/db/d17/fb3 [0,4194304] 0 2024-03-12T16:10:47.701 INFO:tasks.workunit.client.1.smithi134.stdout:7/760: symlink d8/dc/l100 0 2024-03-12T16:10:47.702 INFO:tasks.workunit.client.1.smithi134.stdout:5/858: dread db/d12/d1d/d5c/fc8 [0,4194304] 0 2024-03-12T16:10:47.702 INFO:tasks.workunit.client.0.smithi006.stdout:4/644: chown d1/db/d1d/d2f/fc6 7413 1 2024-03-12T16:10:47.702 INFO:tasks.workunit.client.0.smithi006.stdout:6/529: getdents d3/d11/d10/d1b/d6e/db1 0 2024-03-12T16:10:47.704 INFO:tasks.workunit.client.0.smithi006.stdout:4/645: fdatasync d1/db/d1d/d2f/fc0 0 2024-03-12T16:10:47.704 INFO:tasks.workunit.client.0.smithi006.stdout:6/530: write d3/d11/d10/da7/f64 [1083656,80522] 0 2024-03-12T16:10:47.704 INFO:tasks.workunit.client.0.smithi006.stdout:4/646: chown d1/db/d39/d42/fbc 53179018 1 2024-03-12T16:10:47.705 INFO:tasks.workunit.client.1.smithi134.stdout:7/761: mknod d8/dc/d20/c101 0 2024-03-12T16:10:47.707 INFO:tasks.workunit.client.0.smithi006.stdout:4/647: creat d1/db/d17/d5a/d60/fd3 x:0 0 0 2024-03-12T16:10:47.708 INFO:tasks.workunit.client.1.smithi134.stdout:4/688: getdents d1 0 2024-03-12T16:10:47.710 INFO:tasks.workunit.client.0.smithi006.stdout:6/531: dread d3/d11/d10/d28/f53 [4194304,4194304] 0 2024-03-12T16:10:47.710 INFO:tasks.workunit.client.0.smithi006.stdout:4/648: mknod d1/db/d17/d5a/d60/cd4 0 2024-03-12T16:10:47.716 INFO:tasks.workunit.client.0.smithi006.stdout:4/649: mknod d1/d38/d79/cd5 0 2024-03-12T16:10:47.716 INFO:tasks.workunit.client.1.smithi134.stdout:3/888: dread d1/db/d10/d2d/d2e/f131 [0,4194304] 0 2024-03-12T16:10:47.718 INFO:tasks.workunit.client.1.smithi134.stdout:2/713: creat d4/d84/d63/ffe x:0 0 0 2024-03-12T16:10:47.719 INFO:tasks.workunit.client.1.smithi134.stdout:5/859: mknod db/d12/d29/d3d/d79/da5/dc0/c10e 0 2024-03-12T16:10:47.719 INFO:tasks.workunit.client.0.smithi006.stdout:4/650: getdents d1/d38 0 2024-03-12T16:10:47.720 INFO:tasks.workunit.client.1.smithi134.stdout:2/714: fdatasync d4/d12/d3b/d3f/fac 0 2024-03-12T16:10:47.720 INFO:tasks.workunit.client.1.smithi134.stdout:5/860: read - db/d12/d1d/d59/d94/fe6 zero size 2024-03-12T16:10:47.721 INFO:tasks.workunit.client.0.smithi006.stdout:4/651: unlink d1/d38/f57 0 2024-03-12T16:10:47.721 INFO:tasks.workunit.client.1.smithi134.stdout:6/757: write d1/da6/d55/d97/f99 [4979950,85725] 0 2024-03-12T16:10:47.723 INFO:tasks.workunit.client.1.smithi134.stdout:0/721: creat db/d2f/d31/d56/fe4 x:0 0 0 2024-03-12T16:10:47.724 INFO:tasks.workunit.client.1.smithi134.stdout:6/758: chown d1/d3/f48 24 1 2024-03-12T16:10:47.724 INFO:tasks.workunit.client.1.smithi134.stdout:5/861: write db/d12/d29/d3d/d79/da5/fed [161965,25522] 0 2024-03-12T16:10:47.725 INFO:tasks.workunit.client.1.smithi134.stdout:3/889: creat d1/db/d12/d9d/dc5/dec/f13e x:0 0 0 2024-03-12T16:10:47.726 INFO:tasks.workunit.client.1.smithi134.stdout:7/762: getdents d8/dc/d55/df2 0 2024-03-12T16:10:47.728 INFO:tasks.workunit.client.0.smithi006.stdout:4/652: dwrite d1/db/d39/d42/d61/f8a [0,4194304] 0 2024-03-12T16:10:47.730 INFO:tasks.workunit.client.0.smithi006.stdout:6/532: write d3/d11/f31 [606246,39993] 0 2024-03-12T16:10:47.731 INFO:tasks.workunit.client.0.smithi006.stdout:6/533: chown d3/d11/d10/d19/cbf 470099 1 2024-03-12T16:10:47.732 INFO:tasks.workunit.client.0.smithi006.stdout:4/653: fsync d1/db/d1d/f5e 0 2024-03-12T16:10:47.733 INFO:tasks.workunit.client.1.smithi134.stdout:2/715: mkdir d4/d84/d63/d9d/dba/dff 0 2024-03-12T16:10:47.733 INFO:tasks.workunit.client.1.smithi134.stdout:6/759: truncate d1/da6/d55/d97/dfd/f119 145521 0 2024-03-12T16:10:47.734 INFO:tasks.workunit.client.0.smithi006.stdout:6/534: mkdir d3/d11/d3b/db4/dc3 0 2024-03-12T16:10:47.735 INFO:tasks.workunit.client.1.smithi134.stdout:3/890: symlink d1/d63/dc2/d117/l13f 0 2024-03-12T16:10:47.735 INFO:tasks.workunit.client.0.smithi006.stdout:4/654: truncate d1/db/d39/d42/f81 987505 0 2024-03-12T16:10:47.738 INFO:tasks.workunit.client.0.smithi006.stdout:6/535: creat d3/fc4 x:0 0 0 2024-03-12T16:10:47.739 INFO:tasks.workunit.client.1.smithi134.stdout:5/862: dwrite db/d12/d29/d3d/fd3 [0,4194304] 0 2024-03-12T16:10:47.740 INFO:tasks.workunit.client.0.smithi006.stdout:6/536: mknod d3/d47/db0/cc5 0 2024-03-12T16:10:47.742 INFO:tasks.workunit.client.0.smithi006.stdout:6/537: creat d3/d11/d10/d1b/d6e/d80/d9b/fc6 x:0 0 0 2024-03-12T16:10:47.742 INFO:tasks.workunit.client.0.smithi006.stdout:4/655: read d1/db/f22 [6341445,105171] 0 2024-03-12T16:10:47.743 INFO:tasks.workunit.client.0.smithi006.stdout:6/538: chown d3/d11/d43/fbb 320080365 1 2024-03-12T16:10:47.747 INFO:tasks.workunit.client.1.smithi134.stdout:0/722: mkdir db/d2f/d31/d68/da2/dd3/de5 0 2024-03-12T16:10:47.747 INFO:tasks.workunit.client.1.smithi134.stdout:9/750: dwrite d5/d10/d35/f2e [0,4194304] 0 2024-03-12T16:10:47.748 INFO:tasks.workunit.client.0.smithi006.stdout:6/539: unlink d3/d11/d10/d1b/d6e/d80/f94 0 2024-03-12T16:10:47.750 INFO:tasks.workunit.client.0.smithi006.stdout:6/540: fdatasync d3/d11/d43/f5e 0 2024-03-12T16:10:47.751 INFO:tasks.workunit.client.1.smithi134.stdout:4/689: getdents d1/d13/d49/d64/d28/d4f/d67 0 2024-03-12T16:10:47.751 INFO:tasks.workunit.client.1.smithi134.stdout:2/716: dwrite d4/d84/fdf [0,4194304] 0 2024-03-12T16:10:47.751 INFO:tasks.workunit.client.0.smithi006.stdout:6/541: chown d3/d11/d10/d28/f56 456918495 1 2024-03-12T16:10:47.752 INFO:tasks.workunit.client.0.smithi006.stdout:6/542: readlink d3/d11/l12 0 2024-03-12T16:10:47.757 INFO:tasks.workunit.client.0.smithi006.stdout:4/656: dwrite d1/d38/f88 [0,4194304] 0 2024-03-12T16:10:47.758 INFO:tasks.workunit.client.1.smithi134.stdout:3/891: unlink d1/db/d10/d2d/d2e/f13a 0 2024-03-12T16:10:47.760 INFO:tasks.workunit.client.1.smithi134.stdout:9/751: dwrite d5/d10/d35/d49/f8c [0,4194304] 0 2024-03-12T16:10:47.761 INFO:tasks.workunit.client.1.smithi134.stdout:6/760: creat d1/d16/d4c/d65/d9d/f11e x:0 0 0 2024-03-12T16:10:47.762 INFO:tasks.workunit.client.1.smithi134.stdout:5/863: creat db/d12/d7b/f10f x:0 0 0 2024-03-12T16:10:47.763 INFO:tasks.workunit.client.0.smithi006.stdout:6/543: dwrite d3/d11/fd [0,4194304] 0 2024-03-12T16:10:47.765 INFO:tasks.workunit.client.0.smithi006.stdout:4/657: link d1/db/d17/d43/db5/fc9 d1/d91/fd6 0 2024-03-12T16:10:47.765 INFO:tasks.workunit.client.1.smithi134.stdout:1/557: rename d0/d16/d9/d13/f7f to d0/d16/fc1 0 2024-03-12T16:10:47.766 INFO:tasks.workunit.client.0.smithi006.stdout:4/658: write d1/f31 [1701079,5276] 0 2024-03-12T16:10:47.768 INFO:tasks.workunit.client.1.smithi134.stdout:2/717: chown d4/cb 6215349 1 2024-03-12T16:10:47.768 INFO:tasks.workunit.client.0.smithi006.stdout:6/544: unlink d3/d11/d10/d19/f8a 0 2024-03-12T16:10:47.769 INFO:tasks.workunit.client.1.smithi134.stdout:0/723: mknod db/d2f/d31/d75/d88/dd4/ce6 0 2024-03-12T16:10:47.770 INFO:tasks.workunit.client.0.smithi006.stdout:6/545: write d3/d11/d10/f41 [140595,68940] 0 2024-03-12T16:10:47.772 INFO:tasks.workunit.client.1.smithi134.stdout:3/892: stat d1/db/d10/d2a/l91 0 2024-03-12T16:10:47.773 INFO:tasks.workunit.client.0.smithi006.stdout:6/546: symlink d3/d11/d10/d28/lc7 0 2024-03-12T16:10:47.776 INFO:tasks.workunit.client.1.smithi134.stdout:9/752: write d5/d10/d35/d49/d8d/f75 [7769789,60829] 0 2024-03-12T16:10:47.776 INFO:tasks.workunit.client.1.smithi134.stdout:3/893: truncate d1/db/d10/d2d/f105 4626668 0 2024-03-12T16:10:47.776 INFO:tasks.workunit.client.0.smithi006.stdout:6/547: mknod d3/d11/d3b/db4/dc3/cc8 0 2024-03-12T16:10:47.779 INFO:tasks.workunit.client.1.smithi134.stdout:0/724: write db/f38 [1471781,94122] 0 2024-03-12T16:10:47.780 INFO:tasks.workunit.client.1.smithi134.stdout:2/718: read d4/d12/d43/da2/f53 [99988,84609] 0 2024-03-12T16:10:47.780 INFO:tasks.workunit.client.0.smithi006.stdout:6/548: creat d3/d47/db0/dc1/fc9 x:0 0 0 2024-03-12T16:10:47.781 INFO:tasks.workunit.client.1.smithi134.stdout:4/690: symlink d1/de/d5a/ldc 0 2024-03-12T16:10:47.784 INFO:tasks.workunit.client.0.smithi006.stdout:6/549: link d3/d11/d10/d28/f53 d3/fca 0 2024-03-12T16:10:47.785 INFO:tasks.workunit.client.1.smithi134.stdout:5/864: dread db/d12/d29/fc3 [0,4194304] 0 2024-03-12T16:10:47.786 INFO:tasks.workunit.client.0.smithi006.stdout:6/550: readlink d3/d11/d10/da7/d8e/d8b/l98 0 2024-03-12T16:10:47.787 INFO:tasks.workunit.client.1.smithi134.stdout:5/865: dread - db/d12/d29/f102 zero size 2024-03-12T16:10:47.790 INFO:tasks.workunit.client.1.smithi134.stdout:5/866: stat db/d12/d1d/d3a/d4e/d108/d73/c84 0 2024-03-12T16:10:47.790 INFO:tasks.workunit.client.0.smithi006.stdout:6/551: rename d3/d11/d43/f5c to d3/d11/d10/d1b/d6e/d80/d9b/fcb 0 2024-03-12T16:10:47.790 INFO:tasks.workunit.client.1.smithi134.stdout:5/867: chown db/d7a 2 1 2024-03-12T16:10:47.791 INFO:tasks.workunit.client.1.smithi134.stdout:8/750: write d3/d82/d104/f62 [3099163,59348] 0 2024-03-12T16:10:47.793 INFO:tasks.workunit.client.1.smithi134.stdout:2/719: mkdir d4/d12/d1d/d34/d47/d8c/d100 0 2024-03-12T16:10:47.793 INFO:tasks.workunit.client.1.smithi134.stdout:0/725: fdatasync db/f45 0 2024-03-12T16:10:47.794 INFO:tasks.workunit.client.1.smithi134.stdout:3/894: mkdir d1/db/d14/d5a/d140 0 2024-03-12T16:10:47.795 INFO:tasks.workunit.client.1.smithi134.stdout:8/751: readlink d3/d1b/d17/d25/d49/l4d 0 2024-03-12T16:10:47.797 INFO:tasks.workunit.client.1.smithi134.stdout:3/895: read d1/db/d14/d5a/d89/ffe [2287543,4371] 0 2024-03-12T16:10:47.797 INFO:tasks.workunit.client.1.smithi134.stdout:5/868: mkdir db/d12/d1d/d3a/d4e/d110 0 2024-03-12T16:10:47.799 INFO:tasks.workunit.client.1.smithi134.stdout:4/691: mkdir d1/d24/ddd 0 2024-03-12T16:10:47.800 INFO:tasks.workunit.client.0.smithi006.stdout:6/552: dread d3/d11/d10/d28/d45/d60/f61 [0,4194304] 0 2024-03-12T16:10:47.801 INFO:tasks.workunit.client.1.smithi134.stdout:7/763: write d8/dc/d20/d26/f37 [480333,105349] 0 2024-03-12T16:10:47.802 INFO:tasks.workunit.client.0.smithi006.stdout:6/553: write f1 [1685991,9818] 0 2024-03-12T16:10:47.803 INFO:tasks.workunit.client.1.smithi134.stdout:8/752: write d3/d1b/d17/d25/d33/d96/fa4 [114877,81558] 0 2024-03-12T16:10:47.803 INFO:tasks.workunit.client.1.smithi134.stdout:4/692: write d1/d24/d34/d73/fca [1417668,95317] 0 2024-03-12T16:10:47.805 INFO:tasks.workunit.client.1.smithi134.stdout:7/764: chown d8/d4e/l7a 68 1 2024-03-12T16:10:47.805 INFO:tasks.workunit.client.1.smithi134.stdout:8/753: chown d3/d1b/d17/d24 1032696 1 2024-03-12T16:10:47.807 INFO:tasks.workunit.client.1.smithi134.stdout:4/693: read d1/d24/d34/d73/fca [595492,105337] 0 2024-03-12T16:10:47.812 INFO:tasks.workunit.client.0.smithi006.stdout:6/554: write d3/d11/f3c [2196863,66737] 0 2024-03-12T16:10:47.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/694: dwrite d1/d13/f93 [0,4194304] 0 2024-03-12T16:10:47.814 INFO:tasks.workunit.client.0.smithi006.stdout:4/659: dread d1/db/f40 [0,4194304] 0 2024-03-12T16:10:47.814 INFO:tasks.workunit.client.0.smithi006.stdout:6/555: dread - d3/d11/d10/d1b/d6e/f4f zero size 2024-03-12T16:10:47.820 INFO:tasks.workunit.client.0.smithi006.stdout:4/660: dwrite d1/db/d1d/d2f/f63 [0,4194304] 0 2024-03-12T16:10:47.822 INFO:tasks.workunit.client.0.smithi006.stdout:4/661: write d1/db/d39/d42/fc5 [760954,99895] 0 2024-03-12T16:10:47.834 INFO:tasks.workunit.client.0.smithi006.stdout:6/556: mknod d3/d11/d10/d28/ccc 0 2024-03-12T16:10:47.835 INFO:tasks.workunit.client.0.smithi006.stdout:4/662: getdents d1/db/d17/da8 0 2024-03-12T16:10:47.839 INFO:tasks.workunit.client.0.smithi006.stdout:6/557: getdents d3/d11/d10/d9a 0 2024-03-12T16:10:47.841 INFO:tasks.workunit.client.0.smithi006.stdout:6/558: creat d3/fcd x:0 0 0 2024-03-12T16:10:47.844 INFO:tasks.workunit.client.0.smithi006.stdout:1/558: sync 2024-03-12T16:10:47.844 INFO:tasks.workunit.client.0.smithi006.stdout:0/508: sync 2024-03-12T16:10:47.845 INFO:tasks.workunit.client.0.smithi006.stdout:6/559: mknod d3/d11/d3b/cce 0 2024-03-12T16:10:47.848 INFO:tasks.workunit.client.0.smithi006.stdout:0/509: unlink d2/d39/d42/d67/l92 0 2024-03-12T16:10:47.848 INFO:tasks.workunit.client.0.smithi006.stdout:4/663: write d1/db/d39/d42/f78 [2528,97942] 0 2024-03-12T16:10:47.849 INFO:tasks.workunit.client.0.smithi006.stdout:6/560: creat d3/d11/d10/d1b/fcf x:0 0 0 2024-03-12T16:10:47.852 INFO:tasks.workunit.client.1.smithi134.stdout:9/753: getdents d5/d10/d51 0 2024-03-12T16:10:47.853 INFO:tasks.workunit.client.0.smithi006.stdout:0/510: creat d2/d6/d10/d11/d1d/d79/f95 x:0 0 0 2024-03-12T16:10:47.853 INFO:tasks.workunit.client.0.smithi006.stdout:4/664: creat d1/db/d1d/d2f/d6b/fd7 x:0 0 0 2024-03-12T16:10:47.854 INFO:tasks.workunit.client.0.smithi006.stdout:4/665: fsync d1/db/d39/d42/fbc 0 2024-03-12T16:10:47.856 INFO:tasks.workunit.client.0.smithi006.stdout:0/511: fdatasync d2/d6/d10/d11/d1d/f29 0 2024-03-12T16:10:47.857 INFO:tasks.workunit.client.1.smithi134.stdout:3/896: chown d1/db/d10/d2d/d2e/c5b 47149722 1 2024-03-12T16:10:47.858 INFO:tasks.workunit.client.0.smithi006.stdout:6/561: link d3/d11/d10/d1b/d6e/d80/d9b/fbe d3/d11/d10/d19/fd0 0 2024-03-12T16:10:47.858 INFO:tasks.workunit.client.0.smithi006.stdout:6/562: chown d3/d47/db0 1 1 2024-03-12T16:10:47.859 INFO:tasks.workunit.client.1.smithi134.stdout:5/869: chown db/d12/d1d/d3a/d4e/d108/lca 1874189 1 2024-03-12T16:10:47.862 INFO:tasks.workunit.client.1.smithi134.stdout:8/754: fsync d3/d82/fe7 0 2024-03-12T16:10:47.863 INFO:tasks.workunit.client.1.smithi134.stdout:7/765: mknod d8/dc/d7b/dbb/dbd/dd5/c102 0 2024-03-12T16:10:47.864 INFO:tasks.workunit.client.0.smithi006.stdout:1/559: dread d0/f2f [0,4194304] 0 2024-03-12T16:10:47.865 INFO:tasks.workunit.client.1.smithi134.stdout:8/755: chown d3/d1b/d17/d25/d33/d15/d95/f32 393 1 2024-03-12T16:10:47.867 INFO:tasks.workunit.client.1.smithi134.stdout:9/754: mkdir d5/d10/d1f/dd5 0 2024-03-12T16:10:47.868 INFO:tasks.workunit.client.1.smithi134.stdout:1/558: truncate d0/d16/d9/d13/d21/f33 1654013 0 2024-03-12T16:10:47.873 INFO:tasks.workunit.client.1.smithi134.stdout:8/756: truncate d3/d1b/d17/d25/d33/d85/fdd 540049 0 2024-03-12T16:10:47.873 INFO:tasks.workunit.client.1.smithi134.stdout:6/761: dwrite d1/d16/d4c/faa [0,4194304] 0 2024-03-12T16:10:47.875 INFO:tasks.workunit.client.1.smithi134.stdout:7/766: mkdir d8/dc/d55/d103 0 2024-03-12T16:10:47.877 INFO:tasks.workunit.client.1.smithi134.stdout:5/870: dread db/d12/d1d/d59/de5/fe2 [0,4194304] 0 2024-03-12T16:10:47.877 INFO:tasks.workunit.client.1.smithi134.stdout:7/767: dread - d8/dc/d55/d81/d87/fdf zero size 2024-03-12T16:10:47.879 INFO:tasks.workunit.client.1.smithi134.stdout:2/720: rename d4/d12/d1d/d34/d47/d8c/da4/fce to d4/f101 0 2024-03-12T16:10:47.880 INFO:tasks.workunit.client.1.smithi134.stdout:0/726: getdents db/d2f/d31/d75/d88 0 2024-03-12T16:10:47.881 INFO:tasks.workunit.client.1.smithi134.stdout:1/559: creat d0/d42/d47/fc2 x:0 0 0 2024-03-12T16:10:47.883 INFO:tasks.workunit.client.1.smithi134.stdout:9/755: unlink d5/d10/d35/d49/d74/fc8 0 2024-03-12T16:10:47.884 INFO:tasks.workunit.client.1.smithi134.stdout:9/756: write d5/d20/f2b [2812703,47049] 0 2024-03-12T16:10:47.888 INFO:tasks.workunit.client.0.smithi006.stdout:6/563: dread d3/fca [0,4194304] 0 2024-03-12T16:10:47.913 INFO:tasks.workunit.client.1.smithi134.stdout:6/762: mknod d1/d16/d4c/d65/d70/c11f 0 2024-03-12T16:10:47.913 INFO:tasks.workunit.client.1.smithi134.stdout:8/757: fsync d3/d82/d104/f58 0 2024-03-12T16:10:47.916 INFO:tasks.workunit.client.1.smithi134.stdout:2/721: mknod d4/d12/d1d/d34/db7/c102 0 2024-03-12T16:10:47.925 INFO:tasks.workunit.client.1.smithi134.stdout:2/722: dwrite d4/d12/d1d/d34/fcc [0,4194304] 0 2024-03-12T16:10:47.926 INFO:tasks.workunit.client.1.smithi134.stdout:2/723: write d4/d12/d1d/f97 [370332,43599] 0 2024-03-12T16:10:47.954 INFO:tasks.workunit.client.0.smithi006.stdout:5/455: sync 2024-03-12T16:10:47.954 INFO:tasks.workunit.client.0.smithi006.stdout:9/469: sync 2024-03-12T16:10:47.956 INFO:tasks.workunit.client.0.smithi006.stdout:9/470: write d0/d4/d3b/d95/f55 [896190,93095] 0 2024-03-12T16:10:47.969 INFO:tasks.workunit.client.0.smithi006.stdout:5/456: dread d7/d9/f16 [0,4194304] 0 2024-03-12T16:10:47.974 INFO:tasks.workunit.client.0.smithi006.stdout:1/560: mkdir d0/d25/d67/dc1 0 2024-03-12T16:10:47.975 INFO:tasks.workunit.client.0.smithi006.stdout:1/561: dread - d0/d25/f9e zero size 2024-03-12T16:10:47.991 INFO:tasks.workunit.client.0.smithi006.stdout:1/562: dread d0/d25/f40 [0,4194304] 0 2024-03-12T16:10:48.000 INFO:tasks.workunit.client.0.smithi006.stdout:6/564: mkdir d3/d11/d43/dd1 0 2024-03-12T16:10:48.001 INFO:tasks.workunit.client.0.smithi006.stdout:6/565: fdatasync d3/d11/d10/d19/f65 0 2024-03-12T16:10:48.001 INFO:tasks.workunit.client.0.smithi006.stdout:6/566: chown d3/d11/d3b/d59/l73 147108845 1 2024-03-12T16:10:48.002 INFO:tasks.workunit.client.0.smithi006.stdout:4/666: rename d1/db/d1d/f5d to d1/db/d17/d5a/fd8 0 2024-03-12T16:10:48.004 INFO:tasks.workunit.client.0.smithi006.stdout:9/471: symlink d0/d4/d9b/la1 0 2024-03-12T16:10:48.007 INFO:tasks.workunit.client.0.smithi006.stdout:1/563: mknod d0/d25/d2a/d64/cc2 0 2024-03-12T16:10:48.010 INFO:tasks.workunit.client.0.smithi006.stdout:2/560: sync 2024-03-12T16:10:48.011 INFO:tasks.workunit.client.0.smithi006.stdout:7/673: sync 2024-03-12T16:10:48.011 INFO:tasks.workunit.client.0.smithi006.stdout:3/496: sync 2024-03-12T16:10:48.011 INFO:tasks.workunit.client.0.smithi006.stdout:8/478: sync 2024-03-12T16:10:48.014 INFO:tasks.workunit.client.0.smithi006.stdout:3/497: chown d8/d19/d26/d59/d2c/d41/l75 13 1 2024-03-12T16:10:48.014 INFO:tasks.workunit.client.0.smithi006.stdout:5/457: write d7/d41/f87 [2265092,34643] 0 2024-03-12T16:10:48.017 INFO:tasks.workunit.client.0.smithi006.stdout:2/561: stat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f8d 0 2024-03-12T16:10:48.018 INFO:tasks.workunit.client.0.smithi006.stdout:8/479: mknod d2/d55/d7b/c97 0 2024-03-12T16:10:48.019 INFO:tasks.workunit.client.0.smithi006.stdout:9/472: mknod d0/d8/d16/ca2 0 2024-03-12T16:10:48.021 INFO:tasks.workunit.client.0.smithi006.stdout:0/512: getdents d2/d39/d42/d67 0 2024-03-12T16:10:48.022 INFO:tasks.workunit.client.0.smithi006.stdout:8/480: dread d2/d11/f42 [0,4194304] 0 2024-03-12T16:10:48.023 INFO:tasks.workunit.client.0.smithi006.stdout:6/567: rename d3/d11/d10/d28/d45/lab to d3/d11/ld2 0 2024-03-12T16:10:48.023 INFO:tasks.workunit.client.0.smithi006.stdout:1/564: dread d0/f13 [4194304,4194304] 0 2024-03-12T16:10:48.024 INFO:tasks.workunit.client.0.smithi006.stdout:3/498: write d8/d19/d26/d59/d2c/dc/f38 [4523032,17640] 0 2024-03-12T16:10:48.025 INFO:tasks.workunit.client.0.smithi006.stdout:7/674: creat de/d7b/dc6/fe5 x:0 0 0 2024-03-12T16:10:48.025 INFO:tasks.workunit.client.0.smithi006.stdout:4/667: symlink d1/d38/d79/ld9 0 2024-03-12T16:10:48.026 INFO:tasks.workunit.client.0.smithi006.stdout:5/458: truncate d7/d9/d31/d3b/f3f 1257397 0 2024-03-12T16:10:48.028 INFO:tasks.workunit.client.0.smithi006.stdout:1/565: readlink d0/d25/d2a/d43/d63/db6/lc0 0 2024-03-12T16:10:48.028 INFO:tasks.workunit.client.0.smithi006.stdout:9/473: rmdir d0/d4/d3b 39 2024-03-12T16:10:48.032 INFO:tasks.workunit.client.0.smithi006.stdout:1/566: write d0/d25/d2a/d43/f87 [4630597,88352] 0 2024-03-12T16:10:48.032 INFO:tasks.workunit.client.0.smithi006.stdout:1/567: chown d0/d25/d2a/l97 995945341 1 2024-03-12T16:10:48.033 INFO:tasks.workunit.client.0.smithi006.stdout:8/481: truncate d2/db/f20 926566 0 2024-03-12T16:10:48.034 INFO:tasks.workunit.client.0.smithi006.stdout:2/562: mknod d0/d13/d49/d60/d2b/d62/d79/cb5 0 2024-03-12T16:10:48.034 INFO:tasks.workunit.client.0.smithi006.stdout:6/568: creat d3/d11/d3b/d59/fd3 x:0 0 0 2024-03-12T16:10:48.035 INFO:tasks.workunit.client.0.smithi006.stdout:7/675: creat de/d2c/d93/fe6 x:0 0 0 2024-03-12T16:10:48.035 INFO:tasks.workunit.client.0.smithi006.stdout:0/513: mknod d2/d6/d10/d11/c96 0 2024-03-12T16:10:48.036 INFO:tasks.workunit.client.0.smithi006.stdout:8/482: read - d2/d11/d3f/f93 zero size 2024-03-12T16:10:48.037 INFO:tasks.workunit.client.0.smithi006.stdout:3/499: rename d8/l16 to d8/d19/d26/d59/d2c/dc/d28/d2f/lad 0 2024-03-12T16:10:48.038 INFO:tasks.workunit.client.0.smithi006.stdout:0/514: fdatasync d2/d6/d10/d11/d1d/d79/f95 0 2024-03-12T16:10:48.039 INFO:tasks.workunit.client.0.smithi006.stdout:2/563: dread - d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f9e zero size 2024-03-12T16:10:48.040 INFO:tasks.workunit.client.0.smithi006.stdout:9/474: unlink d0/d8/d16/d7d/c77 0 2024-03-12T16:10:48.045 INFO:tasks.workunit.client.0.smithi006.stdout:0/515: mkdir d2/d6/d37/d97 0 2024-03-12T16:10:48.045 INFO:tasks.workunit.client.0.smithi006.stdout:2/564: symlink d0/d13/d49/lb6 0 2024-03-12T16:10:48.048 INFO:tasks.workunit.client.0.smithi006.stdout:2/565: dread - d0/d13/d49/d60/d2b/f94 zero size 2024-03-12T16:10:48.048 INFO:tasks.workunit.client.0.smithi006.stdout:8/483: symlink d2/d32/l98 0 2024-03-12T16:10:48.049 INFO:tasks.workunit.client.0.smithi006.stdout:6/569: rmdir d3/d11/d10/d1b/d6e/db1 39 2024-03-12T16:10:48.052 INFO:tasks.workunit.client.0.smithi006.stdout:5/459: dread d7/d9/f30 [0,4194304] 0 2024-03-12T16:10:48.053 INFO:tasks.workunit.client.0.smithi006.stdout:9/475: creat d0/d4/d3b/d95/fa3 x:0 0 0 2024-03-12T16:10:48.054 INFO:tasks.workunit.client.0.smithi006.stdout:0/516: mkdir d2/d39/d98 0 2024-03-12T16:10:48.055 INFO:tasks.workunit.client.0.smithi006.stdout:4/668: dread d1/db/f22 [0,4194304] 0 2024-03-12T16:10:48.057 INFO:tasks.workunit.client.0.smithi006.stdout:8/484: creat d2/db/d1a/d21/d2b/f99 x:0 0 0 2024-03-12T16:10:48.058 INFO:tasks.workunit.client.0.smithi006.stdout:2/566: creat d0/d13/d49/d60/d2b/d62/d79/fb7 x:0 0 0 2024-03-12T16:10:48.061 INFO:tasks.workunit.client.0.smithi006.stdout:6/570: mknod d3/d11/d3b/db4/dc3/cd4 0 2024-03-12T16:10:48.062 INFO:tasks.workunit.client.0.smithi006.stdout:9/476: fdatasync d0/d8/d16/d7d/d20/d37/f39 0 2024-03-12T16:10:48.063 INFO:tasks.workunit.client.0.smithi006.stdout:5/460: truncate d7/d9/d31/d3b/d61/d78/f82 504946 0 2024-03-12T16:10:48.064 INFO:tasks.workunit.client.0.smithi006.stdout:4/669: fdatasync d1/db/d17/fb3 0 2024-03-12T16:10:48.065 INFO:tasks.workunit.client.0.smithi006.stdout:6/571: write d3/fcd [661759,108392] 0 2024-03-12T16:10:48.067 INFO:tasks.workunit.client.0.smithi006.stdout:4/670: chown d1/db/f3c 1 1 2024-03-12T16:10:48.068 INFO:tasks.workunit.client.0.smithi006.stdout:3/500: dread d8/d19/d26/d59/f42 [0,4194304] 0 2024-03-12T16:10:48.068 INFO:tasks.workunit.client.0.smithi006.stdout:5/461: write d7/d41/f87 [5008747,97345] 0 2024-03-12T16:10:48.070 INFO:tasks.workunit.client.0.smithi006.stdout:9/477: fsync d0/d8/d16/d7d/d20/d37/f9d 0 2024-03-12T16:10:48.070 INFO:tasks.workunit.client.0.smithi006.stdout:0/517: creat d2/d39/f99 x:0 0 0 2024-03-12T16:10:48.072 INFO:tasks.workunit.client.0.smithi006.stdout:9/478: dread - d0/d83/f92 zero size 2024-03-12T16:10:48.073 INFO:tasks.workunit.client.0.smithi006.stdout:6/572: unlink d3/d47/c70 0 2024-03-12T16:10:48.073 INFO:tasks.workunit.client.0.smithi006.stdout:0/518: write d2/f4 [2648332,12131] 0 2024-03-12T16:10:48.073 INFO:tasks.workunit.client.0.smithi006.stdout:5/462: stat d7/d8/l1f 0 2024-03-12T16:10:48.074 INFO:tasks.workunit.client.0.smithi006.stdout:1/568: write d0/d25/d2a/f2c [4158301,72157] 0 2024-03-12T16:10:48.077 INFO:tasks.workunit.client.0.smithi006.stdout:4/671: creat d1/db/d39/dbf/fda x:0 0 0 2024-03-12T16:10:48.078 INFO:tasks.workunit.client.0.smithi006.stdout:2/567: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fb8 x:0 0 0 2024-03-12T16:10:48.080 INFO:tasks.workunit.client.0.smithi006.stdout:3/501: creat d8/d19/d78/fae x:0 0 0 2024-03-12T16:10:48.081 INFO:tasks.workunit.client.0.smithi006.stdout:0/519: write d2/d6/d10/d11/d1d/d2e/f6a [8121419,121159] 0 2024-03-12T16:10:48.083 INFO:tasks.workunit.client.0.smithi006.stdout:5/463: dread d7/d9/d10/d24/d89/f3a [0,4194304] 0 2024-03-12T16:10:48.084 INFO:tasks.workunit.client.0.smithi006.stdout:9/479: creat d0/d8/d16/d7d/d20/fa4 x:0 0 0 2024-03-12T16:10:48.086 INFO:tasks.workunit.client.0.smithi006.stdout:0/520: stat d2/d6/d10/d11/d32/f6c 0 2024-03-12T16:10:48.087 INFO:tasks.workunit.client.0.smithi006.stdout:6/573: chown d3/d11/d10/da7/d8e/f7a 14152 1 2024-03-12T16:10:48.090 INFO:tasks.workunit.client.0.smithi006.stdout:7/676: dwrite de/d18/fdc [0,4194304] 0 2024-03-12T16:10:48.092 INFO:tasks.workunit.client.0.smithi006.stdout:3/502: fdatasync d8/d19/d26/d59/d2c/f13 0 2024-03-12T16:10:48.094 INFO:tasks.workunit.client.0.smithi006.stdout:7/677: write de/d1c/d87/ddb/d7c/fa3 [615558,64793] 0 2024-03-12T16:10:48.096 INFO:tasks.workunit.client.0.smithi006.stdout:3/503: read d8/d19/d26/f91 [105118,638] 0 2024-03-12T16:10:48.099 INFO:tasks.workunit.client.0.smithi006.stdout:5/464: symlink d7/d9/d47/d56/d79/l93 0 2024-03-12T16:10:48.100 INFO:tasks.workunit.client.0.smithi006.stdout:8/485: truncate d2/db/d1a/d1f/f54 108174 0 2024-03-12T16:10:48.100 INFO:tasks.workunit.client.0.smithi006.stdout:7/678: chown de/d1c/d87/ddb/f36 6 1 2024-03-12T16:10:48.101 INFO:tasks.workunit.client.0.smithi006.stdout:9/480: creat d0/d8/d16/d2f/fa5 x:0 0 0 2024-03-12T16:10:48.101 INFO:tasks.workunit.client.0.smithi006.stdout:2/568: dwrite d0/d13/d49/f73 [0,4194304] 0 2024-03-12T16:10:48.102 INFO:tasks.workunit.client.0.smithi006.stdout:6/574: mkdir d3/d11/d10/da7/dd5 0 2024-03-12T16:10:48.106 INFO:tasks.workunit.client.0.smithi006.stdout:1/569: creat d0/d25/d2a/fc3 x:0 0 0 2024-03-12T16:10:48.107 INFO:tasks.workunit.client.0.smithi006.stdout:9/481: dread - d0/d8/d80/f82 zero size 2024-03-12T16:10:48.109 INFO:tasks.workunit.client.0.smithi006.stdout:3/504: unlink d8/la 0 2024-03-12T16:10:48.111 INFO:tasks.workunit.client.0.smithi006.stdout:0/521: fdatasync d2/d39/d42/d82/f94 0 2024-03-12T16:10:48.114 INFO:tasks.workunit.client.0.smithi006.stdout:3/505: dread - d8/d4c/f65 zero size 2024-03-12T16:10:48.115 INFO:tasks.workunit.client.0.smithi006.stdout:4/672: dwrite d1/db/d1d/f87 [0,4194304] 0 2024-03-12T16:10:48.116 INFO:tasks.workunit.client.0.smithi006.stdout:8/486: unlink d2/f3a 0 2024-03-12T16:10:48.117 INFO:tasks.workunit.client.0.smithi006.stdout:1/570: truncate d0/d25/d2a/d43/d63/fa6 1015858 0 2024-03-12T16:10:48.118 INFO:tasks.workunit.client.0.smithi006.stdout:6/575: mkdir d3/d11/d10/d28/dd6 0 2024-03-12T16:10:48.118 INFO:tasks.workunit.client.0.smithi006.stdout:9/482: truncate d0/d4/d3b/d6a/f6b 384630 0 2024-03-12T16:10:48.119 INFO:tasks.workunit.client.0.smithi006.stdout:7/679: truncate de/d2c/f3c 178713 0 2024-03-12T16:10:48.123 INFO:tasks.workunit.client.0.smithi006.stdout:7/680: readlink de/d2c/d4f/dba/d40/lde 0 2024-03-12T16:10:48.127 INFO:tasks.workunit.client.0.smithi006.stdout:8/487: creat d2/db/d1a/d21/d8a/f9a x:0 0 0 2024-03-12T16:10:48.128 INFO:tasks.workunit.client.0.smithi006.stdout:1/571: chown d0/d25/d67/d8d/l9a 3331 1 2024-03-12T16:10:48.130 INFO:tasks.workunit.client.0.smithi006.stdout:1/572: write d0/d25/d2a/d35/fbd [780471,3331] 0 2024-03-12T16:10:48.133 INFO:tasks.workunit.client.0.smithi006.stdout:6/576: unlink d3/d11/d3b/db4/dc3/cc8 0 2024-03-12T16:10:48.136 INFO:tasks.workunit.client.0.smithi006.stdout:3/506: creat d8/d19/d26/d59/d2c/dc/d28/faf x:0 0 0 2024-03-12T16:10:48.136 INFO:tasks.workunit.client.0.smithi006.stdout:2/569: getdents d0/d13/d49/d60/d2b/d62/d66/d69/d81/d95 0 2024-03-12T16:10:48.139 INFO:tasks.workunit.client.0.smithi006.stdout:9/483: dread d0/d8/d16/d7d/d20/d37/f5c [0,4194304] 0 2024-03-12T16:10:48.139 INFO:tasks.workunit.client.0.smithi006.stdout:3/507: stat d8/d52/d6c/f84 0 2024-03-12T16:10:48.143 INFO:tasks.workunit.client.0.smithi006.stdout:1/573: dwrite d0/d25/d2a/f2c [0,4194304] 0 2024-03-12T16:10:48.145 INFO:tasks.workunit.client.0.smithi006.stdout:9/484: fsync d0/d8/d16/d7d/d20/fa4 0 2024-03-12T16:10:48.146 INFO:tasks.workunit.client.1.smithi134.stdout:7/768: link d8/dc/d20/d26/d36/fe4 d8/d27/d5b/f104 0 2024-03-12T16:10:48.147 INFO:tasks.workunit.client.0.smithi006.stdout:2/570: fsync d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/f8a 0 2024-03-12T16:10:48.148 INFO:tasks.workunit.client.1.smithi134.stdout:7/769: dread - d8/dc/d55/d81/d87/fdf zero size 2024-03-12T16:10:48.148 INFO:tasks.workunit.client.0.smithi006.stdout:2/571: dread - d0/d13/d49/fa1 zero size 2024-03-12T16:10:48.149 INFO:tasks.workunit.client.0.smithi006.stdout:9/485: truncate d0/d4/d70/d86/f63 799550 0 2024-03-12T16:10:48.149 INFO:tasks.workunit.client.0.smithi006.stdout:6/577: symlink d3/d47/db0/ld7 0 2024-03-12T16:10:48.149 INFO:tasks.workunit.client.0.smithi006.stdout:0/522: link d2/f2b d2/d39/d42/d67/f9a 0 2024-03-12T16:10:48.150 INFO:tasks.workunit.client.0.smithi006.stdout:7/681: mknod de/d2c/d93/dbe/d4a/d6a/dc7/ce7 0 2024-03-12T16:10:48.151 INFO:tasks.workunit.client.0.smithi006.stdout:2/572: dread - d0/d13/d49/d60/fad zero size 2024-03-12T16:10:48.151 INFO:tasks.workunit.client.1.smithi134.stdout:4/695: rename d1/d13/d49/d64/d28/l55 to d1/de/d90/lde 0 2024-03-12T16:10:48.151 INFO:tasks.workunit.client.1.smithi134.stdout:7/770: read d8/dc/d55/d57/f9e [16524,7571] 0 2024-03-12T16:10:48.152 INFO:tasks.workunit.client.0.smithi006.stdout:4/673: link d1/db/d1d/d2f/d6b/fd7 d1/db/d39/dbf/fdb 0 2024-03-12T16:10:48.153 INFO:tasks.workunit.client.1.smithi134.stdout:7/771: dread - d8/dc/d20/d26/d36/f9b zero size 2024-03-12T16:10:48.154 INFO:tasks.workunit.client.1.smithi134.stdout:0/727: mkdir db/dcc/de7 0 2024-03-12T16:10:48.154 INFO:tasks.workunit.client.0.smithi006.stdout:5/465: dread d7/d41/f5a [0,4194304] 0 2024-03-12T16:10:48.155 INFO:tasks.workunit.client.0.smithi006.stdout:1/574: mknod d0/d25/db1/cc4 0 2024-03-12T16:10:48.155 INFO:tasks.workunit.client.0.smithi006.stdout:4/674: readlink d1/db/d39/lb8 0 2024-03-12T16:10:48.155 INFO:tasks.workunit.client.1.smithi134.stdout:8/758: dread d3/d1b/d17/f47 [0,4194304] 0 2024-03-12T16:10:48.158 INFO:tasks.workunit.client.0.smithi006.stdout:9/486: mkdir d0/d4/d70/da6 0 2024-03-12T16:10:48.158 INFO:tasks.workunit.client.0.smithi006.stdout:7/682: rmdir de/d1c/d87 39 2024-03-12T16:10:48.159 INFO:tasks.workunit.client.0.smithi006.stdout:9/487: chown d0/d83 118684455 1 2024-03-12T16:10:48.160 INFO:tasks.workunit.client.0.smithi006.stdout:0/523: mknod d2/d39/d42/c9b 0 2024-03-12T16:10:48.161 INFO:tasks.workunit.client.0.smithi006.stdout:3/508: symlink d8/d19/d26/d59/d2c/d41/da1/lb0 0 2024-03-12T16:10:48.163 INFO:tasks.workunit.client.0.smithi006.stdout:6/578: creat d3/d11/d10/da7/d8e/d8b/fd8 x:0 0 0 2024-03-12T16:10:48.164 INFO:tasks.workunit.client.1.smithi134.stdout:3/897: rename d1/db/d10/d2a/dc6/fd0 to d1/db/d12/d9d/dc5/dec/f141 0 2024-03-12T16:10:48.166 INFO:tasks.workunit.client.0.smithi006.stdout:0/524: write d2/d6/d37/f86 [602429,42420] 0 2024-03-12T16:10:48.166 INFO:tasks.workunit.client.0.smithi006.stdout:8/488: creat d2/f9b x:0 0 0 2024-03-12T16:10:48.167 INFO:tasks.workunit.client.0.smithi006.stdout:1/575: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:48.170 INFO:tasks.workunit.client.0.smithi006.stdout:5/466: dwrite d7/d41/f87 [0,4194304] 0 2024-03-12T16:10:48.171 INFO:tasks.workunit.client.1.smithi134.stdout:9/757: link d5/d10/d51/lb8 d5/d10/d35/d49/d54/d88/ld6 0 2024-03-12T16:10:48.173 INFO:tasks.workunit.client.0.smithi006.stdout:4/675: write d1/db/d39/f73 [4620317,3256] 0 2024-03-12T16:10:48.173 INFO:tasks.workunit.client.1.smithi134.stdout:4/696: dwrite d1/d24/d34/f97 [0,4194304] 0 2024-03-12T16:10:48.174 INFO:tasks.workunit.client.0.smithi006.stdout:5/467: fsync d7/d9/f7a 0 2024-03-12T16:10:48.174 INFO:tasks.workunit.client.1.smithi134.stdout:9/758: chown d5/d10/d6c/f58 1 1 2024-03-12T16:10:48.176 INFO:tasks.workunit.client.0.smithi006.stdout:7/683: write de/d1c/d87/ddb/d7c/fd4 [415038,10496] 0 2024-03-12T16:10:48.178 INFO:tasks.workunit.client.0.smithi006.stdout:8/489: creat d2/db/d70/f9c x:0 0 0 2024-03-12T16:10:48.179 INFO:tasks.workunit.client.0.smithi006.stdout:3/509: dwrite d8/d19/d31/f35 [0,4194304] 0 2024-03-12T16:10:48.182 INFO:tasks.workunit.client.0.smithi006.stdout:0/525: mknod d2/d6/d10/d11/d1d/d2e/d77/c9c 0 2024-03-12T16:10:48.182 INFO:tasks.workunit.client.1.smithi134.stdout:6/763: fsync d1/d3/d19/d32/f43 0 2024-03-12T16:10:48.183 INFO:tasks.workunit.client.0.smithi006.stdout:7/684: chown de/d2c/d4f/dba/d39/d81/c85 92 1 2024-03-12T16:10:48.186 INFO:tasks.workunit.client.1.smithi134.stdout:4/697: dwrite d1/de/f3c [0,4194304] 0 2024-03-12T16:10:48.188 INFO:tasks.workunit.client.1.smithi134.stdout:6/764: stat d1/d16/d4c/d58/fad 0 2024-03-12T16:10:48.189 INFO:tasks.workunit.client.1.smithi134.stdout:6/765: stat d1/d16/d4c/d58/d115 0 2024-03-12T16:10:48.195 INFO:tasks.workunit.client.0.smithi006.stdout:7/685: write de/d2c/d4f/d83/fab [284170,49659] 0 2024-03-12T16:10:48.207 INFO:tasks.workunit.client.0.smithi006.stdout:7/686: dwrite de/d1c/d87/ddb/d97/fb9 [0,4194304] 0 2024-03-12T16:10:48.209 INFO:tasks.workunit.client.0.smithi006.stdout:7/687: chown de/d2c/d4f/dba/f31 1616 1 2024-03-12T16:10:48.225 INFO:tasks.workunit.client.0.smithi006.stdout:7/688: dwrite de/d18/f19 [0,4194304] 0 2024-03-12T16:10:48.240 INFO:tasks.workunit.client.0.smithi006.stdout:7/689: dwrite de/d2c/d4f/dba/d39/f46 [0,4194304] 0 2024-03-12T16:10:48.317 INFO:tasks.workunit.client.1.smithi134.stdout:5/871: rename db/d7d/f7c to db/d12/d1d/d3a/d4e/d108/d73/d8c/dab/f111 0 2024-03-12T16:10:48.318 INFO:tasks.workunit.client.1.smithi134.stdout:2/724: write d4/d84/d63/d9d/f94 [612264,38205] 0 2024-03-12T16:10:48.320 INFO:tasks.workunit.client.1.smithi134.stdout:1/560: getdents d0/d16/d9/d13/d21/d5f/d6f/d85 0 2024-03-12T16:10:48.324 INFO:tasks.workunit.client.1.smithi134.stdout:8/759: truncate d3/d1b/d17/d25/d33/d15/d95/d5b/fb9 1166722 0 2024-03-12T16:10:48.385 INFO:tasks.workunit.client.0.smithi006.stdout:9/488: mkdir d0/d4/da7 0 2024-03-12T16:10:48.385 INFO:tasks.workunit.client.0.smithi006.stdout:9/489: readlink d0/d4/lf 0 2024-03-12T16:10:48.392 INFO:tasks.workunit.client.0.smithi006.stdout:9/490: dwrite d0/d8/d16/d7d/d20/d37/f9d [4194304,4194304] 0 2024-03-12T16:10:48.393 INFO:tasks.workunit.client.0.smithi006.stdout:9/491: write d0/d8/d80/f97 [193489,27974] 0 2024-03-12T16:10:48.414 INFO:tasks.workunit.client.0.smithi006.stdout:2/573: creat d0/d13/d49/d60/d2b/d62/fb9 x:0 0 0 2024-03-12T16:10:48.414 INFO:tasks.workunit.client.0.smithi006.stdout:6/579: symlink d3/d11/d10/d28/dd6/ld9 0 2024-03-12T16:10:48.415 INFO:tasks.workunit.client.0.smithi006.stdout:4/676: creat d1/db/d17/d43/db5/fdc x:0 0 0 2024-03-12T16:10:48.417 INFO:tasks.workunit.client.0.smithi006.stdout:5/468: rename d7/d9/d31/d3b/d61/c73 to d7/d9/d31/d3b/d4f/d65/d69/c94 0 2024-03-12T16:10:48.418 INFO:tasks.workunit.client.0.smithi006.stdout:0/526: creat d2/d39/d42/d67/f9d x:0 0 0 2024-03-12T16:10:48.420 INFO:tasks.workunit.client.0.smithi006.stdout:3/510: mknod d8/d19/d26/d59/d3b/cb1 0 2024-03-12T16:10:48.423 INFO:tasks.workunit.client.0.smithi006.stdout:7/690: mkdir de/d2c/d93/dbe/d4a/d6a/de8 0 2024-03-12T16:10:48.431 INFO:tasks.workunit.client.0.smithi006.stdout:1/576: write d0/d25/f2e [200571,129000] 0 2024-03-12T16:10:48.443 INFO:tasks.workunit.client.0.smithi006.stdout:9/492: symlink d0/d4/d18/d4d/la8 0 2024-03-12T16:10:48.443 INFO:tasks.workunit.client.0.smithi006.stdout:6/580: mknod d3/d11/d10/da7/d9e/cda 0 2024-03-12T16:10:48.444 INFO:tasks.workunit.client.0.smithi006.stdout:6/581: write d3/d11/d10/d1b/d20/f8f [917064,126177] 0 2024-03-12T16:10:48.446 INFO:tasks.workunit.client.0.smithi006.stdout:0/527: mkdir d2/d39/d42/d67/d9e 0 2024-03-12T16:10:48.449 INFO:tasks.workunit.client.0.smithi006.stdout:1/577: readlink d0/d25/d2a/d35/d3f/l6b 0 2024-03-12T16:10:48.450 INFO:tasks.workunit.client.0.smithi006.stdout:9/493: creat d0/d4/d70/fa9 x:0 0 0 2024-03-12T16:10:48.454 INFO:tasks.workunit.client.0.smithi006.stdout:3/511: mkdir d8/d4c/db2 0 2024-03-12T16:10:48.455 INFO:tasks.workunit.client.0.smithi006.stdout:7/691: mkdir de/d1c/de9 0 2024-03-12T16:10:48.457 INFO:tasks.workunit.client.0.smithi006.stdout:1/578: dwrite d0/f16 [0,4194304] 0 2024-03-12T16:10:48.458 INFO:tasks.workunit.client.0.smithi006.stdout:1/579: readlink d0/d25/d2a/d35/l5b 0 2024-03-12T16:10:48.461 INFO:tasks.workunit.client.0.smithi006.stdout:6/582: mkdir d3/d11/d10/da7/dd5/ddb 0 2024-03-12T16:10:48.463 INFO:tasks.workunit.client.0.smithi006.stdout:3/512: creat d8/d52/d9e/fb3 x:0 0 0 2024-03-12T16:10:48.463 INFO:tasks.workunit.client.0.smithi006.stdout:6/583: dread - d3/d11/d10/da7/d9e/daa/fb9 zero size 2024-03-12T16:10:48.466 INFO:tasks.workunit.client.0.smithi006.stdout:7/692: mkdir de/d2c/dea 0 2024-03-12T16:10:48.467 INFO:tasks.workunit.client.0.smithi006.stdout:9/494: mknod d0/d4/d18/d4d/d99/caa 0 2024-03-12T16:10:48.468 INFO:tasks.workunit.client.0.smithi006.stdout:1/580: mknod d0/d25/d2a/d43/d56/cc5 0 2024-03-12T16:10:48.470 INFO:tasks.workunit.client.0.smithi006.stdout:3/513: write d8/d19/d47/f79 [4247190,73168] 0 2024-03-12T16:10:48.470 INFO:tasks.workunit.client.0.smithi006.stdout:0/528: link d2/d6/d10/d11/d1d/c6f d2/d39/d42/d67/c9f 0 2024-03-12T16:10:48.471 INFO:tasks.workunit.client.0.smithi006.stdout:1/581: read d0/d25/f2b [6332683,98968] 0 2024-03-12T16:10:48.473 INFO:tasks.workunit.client.0.smithi006.stdout:6/584: rename d3/d11/d10/f41 to d3/d11/d10/d1b/fdc 0 2024-03-12T16:10:48.475 INFO:tasks.workunit.client.0.smithi006.stdout:9/495: dread d0/d8/d16/d7d/d20/f51 [0,4194304] 0 2024-03-12T16:10:48.476 INFO:tasks.workunit.client.0.smithi006.stdout:9/496: chown d0/d4/d70/d71/l8d 10012922 1 2024-03-12T16:10:48.479 INFO:tasks.workunit.client.0.smithi006.stdout:4/677: write d1/db/d17/d43/db5/f7a [3519354,103634] 0 2024-03-12T16:10:48.483 INFO:tasks.workunit.client.0.smithi006.stdout:5/469: write d7/d9/d10/d24/f38 [6485180,80213] 0 2024-03-12T16:10:48.485 INFO:tasks.workunit.client.0.smithi006.stdout:4/678: truncate d1/d38/d79/f96 233262 0 2024-03-12T16:10:48.487 INFO:tasks.workunit.client.0.smithi006.stdout:6/585: mkdir d3/d11/d10/d28/d45/d60/ddd 0 2024-03-12T16:10:48.488 INFO:tasks.workunit.client.0.smithi006.stdout:9/497: dwrite d0/d4/d3b/d95/fa3 [0,4194304] 0 2024-03-12T16:10:48.492 INFO:tasks.workunit.client.0.smithi006.stdout:1/582: dread d0/d25/d2a/f71 [0,4194304] 0 2024-03-12T16:10:48.495 INFO:tasks.workunit.client.0.smithi006.stdout:5/470: dread d7/d9/d10/f39 [4194304,4194304] 0 2024-03-12T16:10:48.496 INFO:tasks.workunit.client.0.smithi006.stdout:4/679: creat d1/d91/fdd x:0 0 0 2024-03-12T16:10:48.497 INFO:tasks.workunit.client.0.smithi006.stdout:5/471: chown d7/d41/f87 2250 1 2024-03-12T16:10:48.497 INFO:tasks.workunit.client.0.smithi006.stdout:4/680: chown d1/c9 70 1 2024-03-12T16:10:48.502 INFO:tasks.workunit.client.0.smithi006.stdout:0/529: creat d2/d6/fa0 x:0 0 0 2024-03-12T16:10:48.503 INFO:tasks.workunit.client.0.smithi006.stdout:1/583: mknod d0/d25/d2a/d43/d68/cc6 0 2024-03-12T16:10:48.504 INFO:tasks.workunit.client.0.smithi006.stdout:9/498: chown d0/d4/d3b/d6a/l96 4 1 2024-03-12T16:10:48.504 INFO:tasks.workunit.client.0.smithi006.stdout:7/693: write de/d2c/f3c [570589,26769] 0 2024-03-12T16:10:48.506 INFO:tasks.workunit.client.0.smithi006.stdout:5/472: unlink d7/d9/d10/c49 0 2024-03-12T16:10:48.507 INFO:tasks.workunit.client.0.smithi006.stdout:1/584: write d0/f1b [1066038,28989] 0 2024-03-12T16:10:48.507 INFO:tasks.workunit.client.0.smithi006.stdout:0/530: dread - d2/d39/d42/d82/f87 zero size 2024-03-12T16:10:48.514 INFO:tasks.workunit.client.0.smithi006.stdout:7/694: write de/d98/f9b [4632056,77279] 0 2024-03-12T16:10:48.514 INFO:tasks.workunit.client.0.smithi006.stdout:4/681: dwrite d1/db/d1d/d2f/fc0 [0,4194304] 0 2024-03-12T16:10:48.515 INFO:tasks.workunit.client.0.smithi006.stdout:3/514: dread d8/d19/d26/d59/f1e [0,4194304] 0 2024-03-12T16:10:48.517 INFO:tasks.workunit.client.0.smithi006.stdout:9/499: write d0/d8/d16/d7d/d20/d37/f39 [120134,79632] 0 2024-03-12T16:10:48.520 INFO:tasks.workunit.client.0.smithi006.stdout:5/473: symlink d7/d9/d31/d3b/d6b/l95 0 2024-03-12T16:10:48.521 INFO:tasks.workunit.client.0.smithi006.stdout:1/585: rename d0/l29 to d0/d25/lc7 0 2024-03-12T16:10:48.522 INFO:tasks.workunit.client.0.smithi006.stdout:3/515: symlink d8/d19/d26/d59/d2c/dc/lb4 0 2024-03-12T16:10:48.524 INFO:tasks.workunit.client.0.smithi006.stdout:4/682: readlink d1/db/d1d/l23 0 2024-03-12T16:10:48.525 INFO:tasks.workunit.client.0.smithi006.stdout:5/474: read - d7/d8/f85 zero size 2024-03-12T16:10:48.528 INFO:tasks.workunit.client.0.smithi006.stdout:6/586: dread d3/d11/d10/da7/f74 [0,4194304] 0 2024-03-12T16:10:48.528 INFO:tasks.workunit.client.0.smithi006.stdout:1/586: write d0/fa9 [511371,97886] 0 2024-03-12T16:10:48.530 INFO:tasks.workunit.client.0.smithi006.stdout:0/531: dwrite d2/d6/d10/d11/d1d/d2e/f8f [0,4194304] 0 2024-03-12T16:10:48.531 INFO:tasks.workunit.client.0.smithi006.stdout:3/516: readlink d8/d19/d26/d59/d2c/dc/d28/d2f/lad 0 2024-03-12T16:10:48.534 INFO:tasks.workunit.client.0.smithi006.stdout:4/683: write d1/db/d39/d42/f98 [4186783,91906] 0 2024-03-12T16:10:48.534 INFO:tasks.workunit.client.0.smithi006.stdout:0/532: write d2/d39/f8c [88281,126990] 0 2024-03-12T16:10:48.536 INFO:tasks.workunit.client.0.smithi006.stdout:5/475: symlink d7/d9/d31/l96 0 2024-03-12T16:10:48.539 INFO:tasks.workunit.client.0.smithi006.stdout:1/587: creat d0/d25/d2a/d35/d3f/fc8 x:0 0 0 2024-03-12T16:10:48.540 INFO:tasks.workunit.client.0.smithi006.stdout:7/695: truncate de/d18/fdc 2663124 0 2024-03-12T16:10:48.542 INFO:tasks.workunit.client.0.smithi006.stdout:9/500: write d0/d8/d16/d7d/d20/f36 [603981,79056] 0 2024-03-12T16:10:48.550 INFO:tasks.workunit.client.1.smithi134.stdout:6/766: mkdir d1/d16/d100/d120 0 2024-03-12T16:10:48.552 INFO:tasks.workunit.client.0.smithi006.stdout:5/476: rename d7/d9/d10/d24/l52 to d7/l97 0 2024-03-12T16:10:48.553 INFO:tasks.workunit.client.0.smithi006.stdout:7/696: creat de/d2c/dea/feb x:0 0 0 2024-03-12T16:10:48.558 INFO:tasks.workunit.client.0.smithi006.stdout:6/587: dwrite d3/d11/f31 [0,4194304] 0 2024-03-12T16:10:48.559 INFO:tasks.workunit.client.0.smithi006.stdout:9/501: read d0/d8/d16/f31 [687878,43361] 0 2024-03-12T16:10:48.564 INFO:tasks.workunit.client.1.smithi134.stdout:7/772: dwrite d8/dc/d55/f5f [0,4194304] 0 2024-03-12T16:10:48.565 INFO:tasks.workunit.client.1.smithi134.stdout:7/773: stat d8/c5c 0 2024-03-12T16:10:48.565 INFO:tasks.workunit.client.0.smithi006.stdout:4/684: dread d1/db/d17/d5a/f62 [0,4194304] 0 2024-03-12T16:10:48.569 INFO:tasks.workunit.client.1.smithi134.stdout:4/698: write d1/d13/d49/d64/f87 [1184021,117335] 0 2024-03-12T16:10:48.570 INFO:tasks.workunit.client.0.smithi006.stdout:0/533: dwrite d2/d6/f72 [0,4194304] 0 2024-03-12T16:10:48.570 INFO:tasks.workunit.client.1.smithi134.stdout:4/699: stat d1/de/d90 0 2024-03-12T16:10:48.579 INFO:tasks.workunit.client.1.smithi134.stdout:4/700: read d1/d24/d34/d8e/fb4 [1285404,10235] 0 2024-03-12T16:10:48.580 INFO:tasks.workunit.client.0.smithi006.stdout:7/697: write de/f23 [2622272,115079] 0 2024-03-12T16:10:48.580 INFO:tasks.workunit.client.0.smithi006.stdout:0/534: fsync d2/d6/d37/f86 0 2024-03-12T16:10:48.580 INFO:tasks.workunit.client.0.smithi006.stdout:3/517: dwrite d8/d19/d26/d59/d2c/dc/d28/f74 [0,4194304] 0 2024-03-12T16:10:48.586 INFO:tasks.workunit.client.0.smithi006.stdout:1/588: dwrite d0/fe [0,4194304] 0 2024-03-12T16:10:48.591 INFO:tasks.workunit.client.0.smithi006.stdout:5/477: dwrite d7/d9/d31/f2e [4194304,4194304] 0 2024-03-12T16:10:48.594 INFO:tasks.workunit.client.0.smithi006.stdout:4/685: chown d1/db/d39/c7c 990453 1 2024-03-12T16:10:48.594 INFO:tasks.workunit.client.0.smithi006.stdout:7/698: rename de/d1c/l43 to de/d1c/d87/ddb/d97/lec 0 2024-03-12T16:10:48.596 INFO:tasks.workunit.client.0.smithi006.stdout:9/502: mknod d0/d4/cab 0 2024-03-12T16:10:48.602 INFO:tasks.workunit.client.0.smithi006.stdout:0/535: mkdir d2/d6/d10/d11/da1 0 2024-03-12T16:10:48.604 INFO:tasks.workunit.client.1.smithi134.stdout:9/759: rename d5/c9 to d5/d10/d35/d49/d8d/cd7 0 2024-03-12T16:10:48.604 INFO:tasks.workunit.client.1.smithi134.stdout:0/728: creat db/d2f/d61/fe8 x:0 0 0 2024-03-12T16:10:48.605 INFO:tasks.workunit.client.0.smithi006.stdout:1/589: rename d0/d25/d2a/d64/lac to d0/d25/d2a/d43/d63/db6/lc9 0 2024-03-12T16:10:48.607 INFO:tasks.workunit.client.0.smithi006.stdout:5/478: dread d7/d9/d47/f67 [0,4194304] 0 2024-03-12T16:10:48.609 INFO:tasks.workunit.client.0.smithi006.stdout:0/536: read d2/d6/d37/f86 [328576,30020] 0 2024-03-12T16:10:48.609 INFO:tasks.workunit.client.1.smithi134.stdout:4/701: dread d1/fb6 [0,4194304] 0 2024-03-12T16:10:48.609 INFO:tasks.workunit.client.1.smithi134.stdout:9/760: chown d5/d10/d6c/f58 24 1 2024-03-12T16:10:48.609 INFO:tasks.workunit.client.1.smithi134.stdout:7/774: dread d8/dc/d55/d57/fc8 [0,4194304] 0 2024-03-12T16:10:48.609 INFO:tasks.workunit.client.0.smithi006.stdout:6/588: dwrite d3/d11/f3c [0,4194304] 0 2024-03-12T16:10:48.611 INFO:tasks.workunit.client.0.smithi006.stdout:4/686: creat d1/d38/fde x:0 0 0 2024-03-12T16:10:48.611 INFO:tasks.workunit.client.0.smithi006.stdout:3/518: dread d8/d19/d26/d59/f1e [0,4194304] 0 2024-03-12T16:10:48.611 INFO:tasks.workunit.client.0.smithi006.stdout:1/590: rename d0/d25/d67 to d0/d25/d67/d8d/dca 22 2024-03-12T16:10:48.611 INFO:tasks.workunit.client.1.smithi134.stdout:7/775: read d8/dc/d55/d57/f9e [653811,103155] 0 2024-03-12T16:10:48.613 INFO:tasks.workunit.client.1.smithi134.stdout:4/702: mknod d1/de/d90/cdf 0 2024-03-12T16:10:48.614 INFO:tasks.workunit.client.0.smithi006.stdout:1/591: write d0/f1b [2058409,130874] 0 2024-03-12T16:10:48.615 INFO:tasks.workunit.client.1.smithi134.stdout:4/703: write d1/de/f30 [117071,53484] 0 2024-03-12T16:10:48.619 INFO:tasks.workunit.client.1.smithi134.stdout:9/761: dwrite d5/d10/d35/d49/d8d/f75 [0,4194304] 0 2024-03-12T16:10:48.621 INFO:tasks.workunit.client.1.smithi134.stdout:8/760: creat d3/d1b/d17/d25/d33/d96/f107 x:0 0 0 2024-03-12T16:10:48.627 INFO:tasks.workunit.client.1.smithi134.stdout:2/725: rename d4/d12/daf/ff4 to d4/d12/d1d/d34/d47/d8c/f103 0 2024-03-12T16:10:48.627 INFO:tasks.workunit.client.1.smithi134.stdout:2/726: truncate d4/d12/d3b/d9b/fcd 1973840 0 2024-03-12T16:10:48.627 INFO:tasks.workunit.client.1.smithi134.stdout:7/776: mknod d8/db4/c105 0 2024-03-12T16:10:48.627 INFO:tasks.workunit.client.1.smithi134.stdout:9/762: read d5/d10/d35/d49/d54/d5e/fb5 [2737375,127917] 0 2024-03-12T16:10:48.629 INFO:tasks.workunit.client.1.smithi134.stdout:4/704: creat d1/d24/d34/d73/fe0 x:0 0 0 2024-03-12T16:10:48.629 INFO:tasks.workunit.client.1.smithi134.stdout:9/763: readlink d5/d10/d33/l4f 0 2024-03-12T16:10:48.629 INFO:tasks.workunit.client.0.smithi006.stdout:1/592: dread d0/d25/d2a/d64/f6d [0,4194304] 0 2024-03-12T16:10:48.631 INFO:tasks.workunit.client.0.smithi006.stdout:6/589: dread d3/d11/d10/da7/f64 [0,4194304] 0 2024-03-12T16:10:48.632 INFO:tasks.workunit.client.1.smithi134.stdout:4/705: dread - d1/d13/f7c zero size 2024-03-12T16:10:48.633 INFO:tasks.workunit.client.1.smithi134.stdout:0/729: link db/f8e db/d2f/d31/d68/da2/dd3/de5/fe9 0 2024-03-12T16:10:48.636 INFO:tasks.workunit.client.1.smithi134.stdout:8/761: read d3/d1b/d17/d25/d33/d15/d95/d6d/f92 [726323,117933] 0 2024-03-12T16:10:48.636 INFO:tasks.workunit.client.1.smithi134.stdout:0/730: dread - db/d2f/d31/d56/d9a/fc5 zero size 2024-03-12T16:10:48.637 INFO:tasks.workunit.client.0.smithi006.stdout:7/699: dread de/d7b/f91 [0,4194304] 0 2024-03-12T16:10:48.638 INFO:tasks.workunit.client.0.smithi006.stdout:7/700: chown de/d1c/l24 1 1 2024-03-12T16:10:48.638 INFO:tasks.workunit.client.1.smithi134.stdout:9/764: creat d5/d10/d33/fd8 x:0 0 0 2024-03-12T16:10:48.638 INFO:tasks.workunit.client.0.smithi006.stdout:7/701: fsync de/d1c/f26 0 2024-03-12T16:10:48.639 INFO:tasks.workunit.client.1.smithi134.stdout:2/727: dwrite d4/d12/d1d/d34/d58/d74/fb0 [0,4194304] 0 2024-03-12T16:10:48.640 INFO:tasks.workunit.client.1.smithi134.stdout:0/731: stat db/d2f/d31 0 2024-03-12T16:10:48.643 INFO:tasks.workunit.client.1.smithi134.stdout:9/765: creat d5/d10/d6c/fd9 x:0 0 0 2024-03-12T16:10:48.645 INFO:tasks.workunit.client.1.smithi134.stdout:2/728: creat d4/d12/d1d/d34/dcb/f104 x:0 0 0 2024-03-12T16:10:48.647 INFO:tasks.workunit.client.1.smithi134.stdout:4/706: dwrite d1/d24/d34/d73/f8d [0,4194304] 0 2024-03-12T16:10:48.649 INFO:tasks.workunit.client.1.smithi134.stdout:9/766: creat d5/d10/d35/d49/d54/dc6/fda x:0 0 0 2024-03-12T16:10:48.651 INFO:tasks.workunit.client.1.smithi134.stdout:2/729: mkdir d4/de8/dea/d105 0 2024-03-12T16:10:48.652 INFO:tasks.workunit.client.1.smithi134.stdout:8/762: truncate d3/d1b/d17/d25/d33/d15/d95/d4f/fa1 7294983 0 2024-03-12T16:10:48.658 INFO:tasks.workunit.client.1.smithi134.stdout:9/767: mknod d5/cdb 0 2024-03-12T16:10:48.661 INFO:tasks.workunit.client.1.smithi134.stdout:7/777: dread d8/d4e/dca/fd7 [0,4194304] 0 2024-03-12T16:10:48.661 INFO:tasks.workunit.client.1.smithi134.stdout:4/707: dwrite d1/d13/d49/d64/fcf [0,4194304] 0 2024-03-12T16:10:48.664 INFO:tasks.workunit.client.1.smithi134.stdout:2/730: creat d4/d12/d1d/d34/db7/dc4/f106 x:0 0 0 2024-03-12T16:10:48.665 INFO:tasks.workunit.client.1.smithi134.stdout:4/708: chown d1/d13/d49/d64/da3/fc8 2549 1 2024-03-12T16:10:48.665 INFO:tasks.workunit.client.1.smithi134.stdout:8/763: rmdir d3/d1b/d17/d25/d33/d15/d95/d6d 39 2024-03-12T16:10:48.671 INFO:tasks.workunit.client.1.smithi134.stdout:2/731: mknod d4/d12/d43/dec/c107 0 2024-03-12T16:10:48.674 INFO:tasks.workunit.client.1.smithi134.stdout:9/768: chown d5/d10/d1f/dd5 114551 1 2024-03-12T16:10:48.675 INFO:tasks.workunit.client.1.smithi134.stdout:9/769: dread - d5/d10/d35/d49/d54/d5e/f7e zero size 2024-03-12T16:10:48.677 INFO:tasks.workunit.client.1.smithi134.stdout:9/770: fdatasync d5/d10/d33/fb6 0 2024-03-12T16:10:48.679 INFO:tasks.workunit.client.1.smithi134.stdout:5/872: dwrite db/d12/d29/d3d/f54 [0,4194304] 0 2024-03-12T16:10:48.680 INFO:tasks.workunit.client.1.smithi134.stdout:7/778: rmdir d8/dc/d55/d103 0 2024-03-12T16:10:48.683 INFO:tasks.workunit.client.1.smithi134.stdout:4/709: creat d1/d13/d49/fe1 x:0 0 0 2024-03-12T16:10:48.684 INFO:tasks.workunit.client.1.smithi134.stdout:4/710: read d1/d13/d49/fb1 [1646662,89831] 0 2024-03-12T16:10:48.688 INFO:tasks.workunit.client.1.smithi134.stdout:9/771: symlink d5/d46/ldc 0 2024-03-12T16:10:48.692 INFO:tasks.workunit.client.1.smithi134.stdout:7/779: creat d8/dc/d55/d57/f106 x:0 0 0 2024-03-12T16:10:48.695 INFO:tasks.workunit.client.1.smithi134.stdout:4/711: unlink d1/de/dac/fb7 0 2024-03-12T16:10:48.697 INFO:tasks.workunit.client.1.smithi134.stdout:9/772: chown d5/d10/l77 3 1 2024-03-12T16:10:48.703 INFO:tasks.workunit.client.1.smithi134.stdout:7/780: creat d8/dc/d7b/f107 x:0 0 0 2024-03-12T16:10:48.706 INFO:tasks.workunit.client.1.smithi134.stdout:4/712: unlink d1/de/d5a/d70/l8f 0 2024-03-12T16:10:48.707 INFO:tasks.workunit.client.1.smithi134.stdout:8/764: link d3/d1b/d17/d25/d49/d94/fa2 d3/d1b/d17/d25/d33/d96/dbd/f108 0 2024-03-12T16:10:48.707 INFO:tasks.workunit.client.1.smithi134.stdout:4/713: read d1/dbc/fc0 [2313954,45001] 0 2024-03-12T16:10:48.708 INFO:tasks.workunit.client.1.smithi134.stdout:8/765: chown d3/d1b/d17/d24/d28/l93 1125886 1 2024-03-12T16:10:48.708 INFO:tasks.workunit.client.1.smithi134.stdout:7/781: rmdir d8/dc/d7b/df8 39 2024-03-12T16:10:48.709 INFO:tasks.workunit.client.1.smithi134.stdout:7/782: readlink d8/dc/d55/d81/lcb 0 2024-03-12T16:10:48.711 INFO:tasks.workunit.client.1.smithi134.stdout:2/732: write d4/d12/d3b/d3f/f45 [1167213,123737] 0 2024-03-12T16:10:48.712 INFO:tasks.workunit.client.1.smithi134.stdout:4/714: truncate d1/d24/f56 841551 0 2024-03-12T16:10:48.713 INFO:tasks.workunit.client.1.smithi134.stdout:2/733: chown d4/d12/d43/fda 491377 1 2024-03-12T16:10:48.714 INFO:tasks.workunit.client.1.smithi134.stdout:7/783: getdents d8/d27/d9d 0 2024-03-12T16:10:48.715 INFO:tasks.workunit.client.1.smithi134.stdout:4/715: write d1/d13/f7c [999404,22096] 0 2024-03-12T16:10:48.716 INFO:tasks.workunit.client.1.smithi134.stdout:4/716: chown d1/d24/lb5 0 1 2024-03-12T16:10:48.718 INFO:tasks.workunit.client.1.smithi134.stdout:2/734: rename d4/d12/d43/dec/ffb to d4/d12/daf/f108 0 2024-03-12T16:10:48.719 INFO:tasks.workunit.client.1.smithi134.stdout:2/735: chown d4/d84/d63/dde/df0 13017 1 2024-03-12T16:10:48.720 INFO:tasks.workunit.client.1.smithi134.stdout:5/873: truncate db/f11 570638 0 2024-03-12T16:10:48.721 INFO:tasks.workunit.client.1.smithi134.stdout:5/874: chown db/d12/d29/d3d/fd3 28 1 2024-03-12T16:10:48.722 INFO:tasks.workunit.client.1.smithi134.stdout:4/717: mkdir d1/d13/d49/da4/de2 0 2024-03-12T16:10:48.722 INFO:tasks.workunit.client.1.smithi134.stdout:4/718: chown d1/de/f30 836393858 1 2024-03-12T16:10:48.723 INFO:tasks.workunit.client.1.smithi134.stdout:7/784: mkdir d8/d4e/da2/d108 0 2024-03-12T16:10:48.724 INFO:tasks.workunit.client.1.smithi134.stdout:5/875: creat db/d12/d1d/d3a/d4e/d108/d73/d8c/dab/f112 x:0 0 0 2024-03-12T16:10:48.725 INFO:tasks.workunit.client.1.smithi134.stdout:7/785: chown d8/dc/d20/d26/l6d 11063770 1 2024-03-12T16:10:48.728 INFO:tasks.workunit.client.1.smithi134.stdout:7/786: unlink d8/d27/d9d/fe9 0 2024-03-12T16:10:48.730 INFO:tasks.workunit.client.1.smithi134.stdout:7/787: read - d8/f79 zero size 2024-03-12T16:10:48.731 INFO:tasks.workunit.client.1.smithi134.stdout:5/876: dwrite db/d7a/d97/fe0 [0,4194304] 0 2024-03-12T16:10:48.732 INFO:tasks.workunit.client.1.smithi134.stdout:7/788: chown d8/d4e/f52 10664 1 2024-03-12T16:10:48.733 INFO:tasks.workunit.client.1.smithi134.stdout:5/877: chown db/d12/d1d/d59/de5/le1 19260 1 2024-03-12T16:10:48.741 INFO:tasks.workunit.client.1.smithi134.stdout:5/878: dread - db/ff3 zero size 2024-03-12T16:10:48.747 INFO:tasks.workunit.client.1.smithi134.stdout:5/879: dwrite db/d7d/fde [0,4194304] 0 2024-03-12T16:10:48.748 INFO:tasks.workunit.client.1.smithi134.stdout:5/880: chown db/d12/f40 65 1 2024-03-12T16:10:48.750 INFO:tasks.workunit.client.1.smithi134.stdout:5/881: creat db/d12/d7b/f113 x:0 0 0 2024-03-12T16:10:48.752 INFO:tasks.workunit.client.1.smithi134.stdout:7/789: dread d8/dc/fcf [0,4194304] 0 2024-03-12T16:10:48.755 INFO:tasks.workunit.client.1.smithi134.stdout:7/790: unlink d8/d4e/d91/fb0 0 2024-03-12T16:10:48.756 INFO:tasks.workunit.client.1.smithi134.stdout:7/791: chown d8/d27/d5b/l68 26 1 2024-03-12T16:10:48.759 INFO:tasks.workunit.client.1.smithi134.stdout:7/792: creat d8/dc/d7b/dbb/f109 x:0 0 0 2024-03-12T16:10:48.764 INFO:tasks.workunit.client.1.smithi134.stdout:7/793: link d8/dc/d20/d26/c42 d8/dc/d20/d26/c10a 0 2024-03-12T16:10:48.766 INFO:tasks.workunit.client.1.smithi134.stdout:5/882: dwrite db/d12/d1d/d3a/d4e/d108/d71/d90/fa6 [0,4194304] 0 2024-03-12T16:10:48.768 INFO:tasks.workunit.client.1.smithi134.stdout:7/794: write d8/d27/f59 [2647568,3957] 0 2024-03-12T16:10:48.769 INFO:tasks.workunit.client.1.smithi134.stdout:5/883: readlink db/d12/d1d/d3a/d49/l5e 0 2024-03-12T16:10:48.769 INFO:tasks.workunit.client.1.smithi134.stdout:5/884: chown db/d12/d29/f102 245247828 1 2024-03-12T16:10:48.770 INFO:tasks.workunit.client.1.smithi134.stdout:7/795: fsync d8/dc/d7b/f8a 0 2024-03-12T16:10:48.772 INFO:tasks.workunit.client.1.smithi134.stdout:7/796: fsync d8/db4/fc4 0 2024-03-12T16:10:48.777 INFO:tasks.workunit.client.1.smithi134.stdout:5/885: dwrite db/d12/d29/d3d/f47 [0,4194304] 0 2024-03-12T16:10:48.781 INFO:tasks.workunit.client.1.smithi134.stdout:7/797: dwrite d8/d27/d9d/dc9/fff [0,4194304] 0 2024-03-12T16:10:48.782 INFO:tasks.workunit.client.1.smithi134.stdout:7/798: dread - d8/db4/fc4 zero size 2024-03-12T16:10:48.783 INFO:tasks.workunit.client.1.smithi134.stdout:5/886: symlink db/d12/d1d/d3a/d4e/d108/d71/d90/l114 0 2024-03-12T16:10:48.798 INFO:tasks.workunit.client.1.smithi134.stdout:7/799: truncate d8/d27/d9d/f93 1334153 0 2024-03-12T16:10:48.799 INFO:tasks.workunit.client.1.smithi134.stdout:5/887: truncate db/d12/d1d/d3a/d4e/d108/d73/fe8 3479921 0 2024-03-12T16:10:48.800 INFO:tasks.workunit.client.1.smithi134.stdout:5/888: dread - db/d7a/d97/fd0 zero size 2024-03-12T16:10:48.806 INFO:tasks.workunit.client.1.smithi134.stdout:3/898: sync 2024-03-12T16:10:48.807 INFO:tasks.workunit.client.1.smithi134.stdout:5/889: dwrite db/d12/d29/d3d/f9d [0,4194304] 0 2024-03-12T16:10:48.812 INFO:tasks.workunit.client.1.smithi134.stdout:3/899: creat d1/db/d10/d111/f142 x:0 0 0 2024-03-12T16:10:48.813 INFO:tasks.workunit.client.1.smithi134.stdout:3/900: stat d1/db/d14/d5a/fa1 0 2024-03-12T16:10:48.818 INFO:tasks.workunit.client.1.smithi134.stdout:7/800: dread d8/dc/d20/f67 [0,4194304] 0 2024-03-12T16:10:48.823 INFO:tasks.workunit.client.1.smithi134.stdout:7/801: rename d8/dc/le to d8/dc/d4b/dd9/df4/l10b 0 2024-03-12T16:10:48.825 INFO:tasks.workunit.client.1.smithi134.stdout:3/901: truncate d1/db/d12/d9d/d9f/d103/f10e 1511844 0 2024-03-12T16:10:48.827 INFO:tasks.workunit.client.1.smithi134.stdout:7/802: truncate d8/dc/d20/d26/f3a 335333 0 2024-03-12T16:10:48.828 INFO:tasks.workunit.client.1.smithi134.stdout:5/890: dread db/d12/d1d/d3a/d4e/f55 [0,4194304] 0 2024-03-12T16:10:48.829 INFO:tasks.workunit.client.1.smithi134.stdout:7/803: rmdir d8/d4e/dca 39 2024-03-12T16:10:48.830 INFO:tasks.workunit.client.1.smithi134.stdout:3/902: link d1/fad d1/db/d104/f143 0 2024-03-12T16:10:48.835 INFO:tasks.workunit.client.1.smithi134.stdout:7/804: getdents d8/d27/d9d 0 2024-03-12T16:10:48.835 INFO:tasks.workunit.client.1.smithi134.stdout:7/805: fsync d8/d4e/f52 0 2024-03-12T16:10:48.851 INFO:tasks.workunit.client.1.smithi134.stdout:5/891: dwrite db/d12/f80 [0,4194304] 0 2024-03-12T16:10:48.852 INFO:tasks.workunit.client.1.smithi134.stdout:3/903: dwrite d1/db/d10/fe9 [0,4194304] 0 2024-03-12T16:10:48.859 INFO:tasks.workunit.client.1.smithi134.stdout:7/806: dwrite d8/dc/d20/d26/f5e [0,4194304] 0 2024-03-12T16:10:48.859 INFO:tasks.workunit.client.1.smithi134.stdout:3/904: read d1/db/d12/d9d/d9f/d103/f10e [537841,117987] 0 2024-03-12T16:10:48.861 INFO:tasks.workunit.client.1.smithi134.stdout:3/905: stat d1/db/d10/d2d/d2e/d72/d97/ff5 0 2024-03-12T16:10:48.863 INFO:tasks.workunit.client.1.smithi134.stdout:5/892: link db/d12/d29/d3d/l43 db/d12/l115 0 2024-03-12T16:10:48.864 INFO:tasks.workunit.client.1.smithi134.stdout:5/893: chown db/d12/d1d/d3a/d70/f75 119928256 1 2024-03-12T16:10:48.866 INFO:tasks.workunit.client.1.smithi134.stdout:7/807: write d8/dc/d7b/dbb/dbd/dd5/fa7 [385788,119074] 0 2024-03-12T16:10:48.868 INFO:tasks.workunit.client.1.smithi134.stdout:3/906: mknod d1/db/d12/d9d/dc5/c144 0 2024-03-12T16:10:48.869 INFO:tasks.workunit.client.1.smithi134.stdout:7/808: symlink d8/dc/d7b/dbb/l10c 0 2024-03-12T16:10:48.869 INFO:tasks.workunit.client.0.smithi006.stdout:8/490: sync 2024-03-12T16:10:48.870 INFO:tasks.workunit.client.1.smithi134.stdout:7/809: stat d8/d27/d5b 0 2024-03-12T16:10:48.870 INFO:tasks.workunit.client.1.smithi134.stdout:5/894: mkdir db/d12/d29/d3d/d116 0 2024-03-12T16:10:48.872 INFO:tasks.workunit.client.1.smithi134.stdout:3/907: rmdir d1/db/d12/d9d/dc5/dec 39 2024-03-12T16:10:48.874 INFO:tasks.workunit.client.1.smithi134.stdout:5/895: creat db/d12/d1d/d3a/d4e/d108/db4/db9/ddf/f117 x:0 0 0 2024-03-12T16:10:48.876 INFO:tasks.workunit.client.0.smithi006.stdout:8/491: dwrite d2/db/d1a/d1f/f3c [0,4194304] 0 2024-03-12T16:10:48.876 INFO:tasks.workunit.client.1.smithi134.stdout:3/908: mkdir d1/db/d12/d9d/d9f/d103/d145 0 2024-03-12T16:10:48.877 INFO:tasks.workunit.client.0.smithi006.stdout:8/492: fdatasync d2/d55/f8f 0 2024-03-12T16:10:48.877 INFO:tasks.workunit.client.1.smithi134.stdout:3/909: chown d1/d63/dc2/d117 70398706 1 2024-03-12T16:10:48.878 INFO:tasks.workunit.client.1.smithi134.stdout:5/896: truncate db/d12/d29/d3d/d79/da5/fed 1033977 0 2024-03-12T16:10:48.878 INFO:tasks.workunit.client.1.smithi134.stdout:7/810: rename d8/dc/d55/d57/f6a to d8/dc/d7b/df8/dfd/f10d 0 2024-03-12T16:10:48.882 INFO:tasks.workunit.client.1.smithi134.stdout:3/910: mknod d1/d63/dc2/d117/c146 0 2024-03-12T16:10:48.884 INFO:tasks.workunit.client.1.smithi134.stdout:3/911: readlink d1/db/d12/d9d/dc5/l138 0 2024-03-12T16:10:48.885 INFO:tasks.workunit.client.1.smithi134.stdout:7/811: dwrite d8/db4/fd3 [0,4194304] 0 2024-03-12T16:10:48.887 INFO:tasks.workunit.client.1.smithi134.stdout:5/897: mknod db/d12/d1d/d3a/d4e/d108/d71/c118 0 2024-03-12T16:10:48.887 INFO:tasks.workunit.client.1.smithi134.stdout:3/912: dread - d1/db/d10/daf/f123 zero size 2024-03-12T16:10:48.887 INFO:tasks.workunit.client.1.smithi134.stdout:3/913: fdatasync d1/db/d14/fd4 0 2024-03-12T16:10:48.889 INFO:tasks.workunit.client.1.smithi134.stdout:5/898: mkdir db/d12/d1d/d3a/d4e/d108/db4/d119 0 2024-03-12T16:10:48.891 INFO:tasks.workunit.client.1.smithi134.stdout:3/914: write d1/db/d14/f23 [5570809,91925] 0 2024-03-12T16:10:48.891 INFO:tasks.workunit.client.1.smithi134.stdout:5/899: truncate db/d12/d1d/f89 5044651 0 2024-03-12T16:10:48.894 INFO:tasks.workunit.client.1.smithi134.stdout:3/915: mknod d1/d63/dc2/d117/c147 0 2024-03-12T16:10:48.895 INFO:tasks.workunit.client.1.smithi134.stdout:3/916: fsync d1/d63/d6c/f85 0 2024-03-12T16:10:48.896 INFO:tasks.workunit.client.1.smithi134.stdout:5/900: mkdir db/d7a/d97/d11a 0 2024-03-12T16:10:48.900 INFO:tasks.workunit.client.1.smithi134.stdout:3/917: symlink d1/d63/d6c/l148 0 2024-03-12T16:10:48.901 INFO:tasks.workunit.client.1.smithi134.stdout:7/812: truncate d8/dc/d20/faf 2841542 0 2024-03-12T16:10:48.902 INFO:tasks.workunit.client.1.smithi134.stdout:7/813: chown d8/dc/d20/d26/cb2 5 1 2024-03-12T16:10:48.904 INFO:tasks.workunit.client.1.smithi134.stdout:3/918: getdents d1/d63/d6c/dbf 0 2024-03-12T16:10:48.905 INFO:tasks.workunit.client.1.smithi134.stdout:5/901: write db/f27 [650119,63786] 0 2024-03-12T16:10:48.908 INFO:tasks.workunit.client.1.smithi134.stdout:3/919: symlink d1/db/d12/d9d/d9f/d103/l149 0 2024-03-12T16:10:48.909 INFO:tasks.workunit.client.1.smithi134.stdout:5/902: write db/d12/f80 [1971108,44608] 0 2024-03-12T16:10:48.913 INFO:tasks.workunit.client.1.smithi134.stdout:3/920: dread d1/d63/f9c [0,4194304] 0 2024-03-12T16:10:48.914 INFO:tasks.workunit.client.1.smithi134.stdout:5/903: dread db/d12/d29/d3d/f54 [0,4194304] 0 2024-03-12T16:10:48.915 INFO:tasks.workunit.client.1.smithi134.stdout:3/921: mknod d1/db/d10/d2d/c14a 0 2024-03-12T16:10:48.920 INFO:tasks.workunit.client.1.smithi134.stdout:3/922: dwrite d1/db/d14/fd4 [4194304,4194304] 0 2024-03-12T16:10:48.925 INFO:tasks.workunit.client.1.smithi134.stdout:3/923: write d1/db/d10/d2d/ff9 [122750,79539] 0 2024-03-12T16:10:48.925 INFO:tasks.workunit.client.1.smithi134.stdout:3/924: readlink d1/d63/l86 0 2024-03-12T16:10:48.927 INFO:tasks.workunit.client.1.smithi134.stdout:3/925: symlink d1/db/d12/d9d/d9f/d103/l14b 0 2024-03-12T16:10:48.928 INFO:tasks.workunit.client.1.smithi134.stdout:3/926: stat d1/db/d10/d2a/l80 0 2024-03-12T16:10:48.934 INFO:tasks.workunit.client.1.smithi134.stdout:3/927: write d1/db/d12/d9d/d9f/fa9 [1026515,112300] 0 2024-03-12T16:10:48.937 INFO:tasks.workunit.client.1.smithi134.stdout:3/928: rmdir d1/db/d12/d9d/dc5/dec 39 2024-03-12T16:10:48.942 INFO:tasks.workunit.client.1.smithi134.stdout:3/929: write d1/db/d12/d9d/dc5/dec/f141 [870764,55471] 0 2024-03-12T16:10:48.949 INFO:tasks.workunit.client.1.smithi134.stdout:3/930: dwrite d1/d63/f83 [0,4194304] 0 2024-03-12T16:10:48.952 INFO:tasks.workunit.client.1.smithi134.stdout:3/931: creat d1/db/d12/f14c x:0 0 0 2024-03-12T16:10:48.957 INFO:tasks.workunit.client.1.smithi134.stdout:3/932: write d1/db/d10/d2d/d2e/d72/fc7 [870819,14385] 0 2024-03-12T16:10:49.020 INFO:tasks.workunit.client.0.smithi006.stdout:9/503: truncate d0/d1f/f8b 4236257 0 2024-03-12T16:10:49.025 INFO:tasks.workunit.client.0.smithi006.stdout:4/687: rmdir d1/db/d39/dbf 39 2024-03-12T16:10:49.025 INFO:tasks.workunit.client.0.smithi006.stdout:4/688: read d1/db/f22 [4125688,109398] 0 2024-03-12T16:10:49.028 INFO:tasks.workunit.client.0.smithi006.stdout:3/519: fsync d8/d19/d26/d59/d2c/f13 0 2024-03-12T16:10:49.028 INFO:tasks.workunit.client.0.smithi006.stdout:5/479: dread d7/d9/f16 [0,4194304] 0 2024-03-12T16:10:49.029 INFO:tasks.workunit.client.0.smithi006.stdout:1/593: dread - d0/d25/d2a/d43/f58 zero size 2024-03-12T16:10:49.030 INFO:tasks.workunit.client.0.smithi006.stdout:3/520: fsync d8/d19/d26/d59/d2c/dc/f3a 0 2024-03-12T16:10:49.044 INFO:tasks.workunit.client.0.smithi006.stdout:9/504: truncate d0/d8/d16/d7d/d20/f51 331858 0 2024-03-12T16:10:49.046 INFO:tasks.workunit.client.0.smithi006.stdout:4/689: mknod d1/db/d39/d42/d61/cdf 0 2024-03-12T16:10:49.047 INFO:tasks.workunit.client.0.smithi006.stdout:4/690: chown d1/d91/fdd 5 1 2024-03-12T16:10:49.049 INFO:tasks.workunit.client.0.smithi006.stdout:5/480: rmdir d7/d9/d31/d3b/d4f/d80 39 2024-03-12T16:10:49.051 INFO:tasks.workunit.client.0.smithi006.stdout:8/493: link d2/d11/d6e/f74 d2/d11/f9d 0 2024-03-12T16:10:49.053 INFO:tasks.workunit.client.0.smithi006.stdout:8/494: chown d2/db/d1a/d21/d2b/c84 5 1 2024-03-12T16:10:49.054 INFO:tasks.workunit.client.0.smithi006.stdout:7/702: truncate de/d2c/d4f/dba/f76 1038260 0 2024-03-12T16:10:49.054 INFO:tasks.workunit.client.0.smithi006.stdout:1/594: truncate d0/d25/d2a/d43/f49 485444 0 2024-03-12T16:10:49.055 INFO:tasks.workunit.client.1.smithi134.stdout:1/561: sync 2024-03-12T16:10:49.056 INFO:tasks.workunit.client.0.smithi006.stdout:9/505: chown d0/d1f/l45 744 1 2024-03-12T16:10:49.056 INFO:tasks.workunit.client.0.smithi006.stdout:7/703: dread - de/d2c/dea/feb zero size 2024-03-12T16:10:49.057 INFO:tasks.workunit.client.0.smithi006.stdout:0/537: rename d2/d39/d42/d82/f87 to d2/fa2 0 2024-03-12T16:10:49.057 INFO:tasks.workunit.client.0.smithi006.stdout:1/595: chown d0/d25/d2a/d43/f47 0 1 2024-03-12T16:10:49.058 INFO:tasks.workunit.client.0.smithi006.stdout:9/506: stat d0/d4/d3b/l6c 0 2024-03-12T16:10:49.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/562: truncate d0/d30/fb4 3968936 0 2024-03-12T16:10:49.063 INFO:tasks.workunit.client.0.smithi006.stdout:8/495: link d2/d11/f9d d2/db/d1a/d7a/f9e 0 2024-03-12T16:10:49.065 INFO:tasks.workunit.client.0.smithi006.stdout:7/704: mkdir de/d2c/d4f/dba/d39/d81/ded 0 2024-03-12T16:10:49.066 INFO:tasks.workunit.client.1.smithi134.stdout:1/563: dwrite d0/d30/d86/fbc [0,4194304] 0 2024-03-12T16:10:49.067 INFO:tasks.workunit.client.0.smithi006.stdout:9/507: symlink d0/d8/lac 0 2024-03-12T16:10:49.069 INFO:tasks.workunit.client.0.smithi006.stdout:5/481: dwrite d7/d8/f85 [0,4194304] 0 2024-03-12T16:10:49.070 INFO:tasks.workunit.client.0.smithi006.stdout:0/538: mknod d2/d6/d10/d11/d1d/d2e/d77/ca3 0 2024-03-12T16:10:49.072 INFO:tasks.workunit.client.1.smithi134.stdout:1/564: getdents d0/d42 0 2024-03-12T16:10:49.074 INFO:tasks.workunit.client.0.smithi006.stdout:5/482: truncate d7/d9/d10/d24/f2d 1298680 0 2024-03-12T16:10:49.076 INFO:tasks.workunit.client.1.smithi134.stdout:1/565: getdents d0/d16/d9/d13/d21/d2f 0 2024-03-12T16:10:49.077 INFO:tasks.workunit.client.0.smithi006.stdout:9/508: write d0/d8/d16/d2f/f4c [382213,83068] 0 2024-03-12T16:10:49.078 INFO:tasks.workunit.client.0.smithi006.stdout:8/496: chown d2/db/d1a/c59 241 1 2024-03-12T16:10:49.079 INFO:tasks.workunit.client.0.smithi006.stdout:4/691: dread d1/db/d17/d43/f6f [0,4194304] 0 2024-03-12T16:10:49.089 INFO:tasks.workunit.client.0.smithi006.stdout:0/539: dread d2/d6/d10/d11/d32/f4a [0,4194304] 0 2024-03-12T16:10:49.089 INFO:tasks.workunit.client.1.smithi134.stdout:1/566: dwrite d0/d16/d9/d13/d21/d2f/f56 [0,4194304] 0 2024-03-12T16:10:49.090 INFO:tasks.workunit.client.0.smithi006.stdout:2/574: sync 2024-03-12T16:10:49.090 INFO:tasks.workunit.client.0.smithi006.stdout:1/596: dread d0/d25/f2b [0,4194304] 0 2024-03-12T16:10:49.090 INFO:tasks.workunit.client.1.smithi134.stdout:1/567: rmdir d0 39 2024-03-12T16:10:49.094 INFO:tasks.workunit.client.1.smithi134.stdout:1/568: creat d0/d16/d9/d13/d21/d20/fc3 x:0 0 0 2024-03-12T16:10:49.099 INFO:tasks.workunit.client.1.smithi134.stdout:1/569: creat d0/d16/d9/d13/d21/d2f/d8d/fc4 x:0 0 0 2024-03-12T16:10:49.101 INFO:tasks.workunit.client.0.smithi006.stdout:8/497: dread d2/db/f13 [0,4194304] 0 2024-03-12T16:10:49.119 INFO:tasks.workunit.client.0.smithi006.stdout:8/498: dread d2/db/d1a/f78 [0,4194304] 0 2024-03-12T16:10:49.120 INFO:tasks.workunit.client.0.smithi006.stdout:8/499: write d2/f15 [701890,10159] 0 2024-03-12T16:10:49.188 INFO:tasks.workunit.client.0.smithi006.stdout:7/705: mknod de/d2c/d4f/cee 0 2024-03-12T16:10:49.188 INFO:tasks.workunit.client.0.smithi006.stdout:7/706: dread - de/fb5 zero size 2024-03-12T16:10:49.189 INFO:tasks.workunit.client.0.smithi006.stdout:5/483: mknod d7/d9/d31/c98 0 2024-03-12T16:10:49.190 INFO:tasks.workunit.client.0.smithi006.stdout:5/484: chown d7/d8/d8a 101190 1 2024-03-12T16:10:49.191 INFO:tasks.workunit.client.0.smithi006.stdout:9/509: symlink d0/d83/lad 0 2024-03-12T16:10:49.192 INFO:tasks.workunit.client.0.smithi006.stdout:4/692: creat d1/db/d1d/d2f/d6b/fe0 x:0 0 0 2024-03-12T16:10:49.194 INFO:tasks.workunit.client.0.smithi006.stdout:0/540: rename d2/d6/d10/d11/da1 to d2/d6/d10/d11/d32/da4 0 2024-03-12T16:10:49.195 INFO:tasks.workunit.client.0.smithi006.stdout:1/597: mkdir d0/d25/d2a/d43/d63/db6/dcb 0 2024-03-12T16:10:49.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:47.499866+0000 mgr.smithi134.gcntfu (mgr.24383) 61 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 85 MiB/s rd, 247 MiB/s wr, 474 op/s 2024-03-12T16:10:49.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:47.717372+0000 mon.smithi006 (mon.0) 712 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:10:49.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:47.499866+0000 mgr.smithi134.gcntfu (mgr.24383) 61 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 85 MiB/s rd, 247 MiB/s wr, 474 op/s 2024-03-12T16:10:49.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:47.717372+0000 mon.smithi006 (mon.0) 712 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:10:49.211 INFO:tasks.workunit.client.1.smithi134.stdout:9/773: sync 2024-03-12T16:10:49.213 INFO:tasks.workunit.client.1.smithi134.stdout:8/766: sync 2024-03-12T16:10:49.213 INFO:tasks.workunit.client.1.smithi134.stdout:0/732: sync 2024-03-12T16:10:49.254 INFO:tasks.workunit.client.1.smithi134.stdout:7/814: sync 2024-03-12T16:10:49.254 INFO:tasks.workunit.client.1.smithi134.stdout:4/719: sync 2024-03-12T16:10:49.254 INFO:tasks.workunit.client.1.smithi134.stdout:2/736: sync 2024-03-12T16:10:49.254 INFO:tasks.workunit.client.1.smithi134.stdout:5/904: sync 2024-03-12T16:10:49.254 INFO:tasks.workunit.client.1.smithi134.stdout:3/933: sync 2024-03-12T16:10:49.256 INFO:tasks.workunit.client.1.smithi134.stdout:3/934: fsync d1/db/d12/f7a 0 2024-03-12T16:10:49.257 INFO:tasks.workunit.client.1.smithi134.stdout:4/720: write d1/d13/d49/d64/d28/f9d [664917,22863] 0 2024-03-12T16:10:49.266 INFO:tasks.workunit.client.1.smithi134.stdout:4/721: dwrite d1/d13/d49/d64/d28/d4f/fd7 [0,4194304] 0 2024-03-12T16:10:49.276 INFO:tasks.workunit.client.1.smithi134.stdout:4/722: dwrite d1/d13/d49/d64/d28/f3f [0,4194304] 0 2024-03-12T16:10:49.302 INFO:tasks.workunit.client.1.smithi134.stdout:1/570: sync 2024-03-12T16:10:49.689 INFO:tasks.workunit.client.0.smithi006.stdout:5/485: sync 2024-03-12T16:10:50.249 INFO:tasks.workunit.client.1.smithi134.stdout:0/733: rmdir db/dcc 39 2024-03-12T16:10:50.254 INFO:tasks.workunit.client.1.smithi134.stdout:0/734: dwrite db/d2f/d31/d76/f93 [0,4194304] 0 2024-03-12T16:10:50.272 INFO:tasks.workunit.client.1.smithi134.stdout:9/774: mkdir d5/d20/d47/ddd 0 2024-03-12T16:10:50.302 INFO:tasks.workunit.client.1.smithi134.stdout:2/737: symlink d4/d84/l109 0 2024-03-12T16:10:50.303 INFO:tasks.workunit.client.1.smithi134.stdout:7/815: mkdir d8/dc/d20/d26/d10e 0 2024-03-12T16:10:50.305 INFO:tasks.workunit.client.1.smithi134.stdout:7/816: write d8/d4e/f52 [3353953,79336] 0 2024-03-12T16:10:50.305 INFO:tasks.workunit.client.1.smithi134.stdout:5/905: dread db/d7a/da8/faf [0,4194304] 0 2024-03-12T16:10:50.307 INFO:tasks.workunit.client.1.smithi134.stdout:7/817: chown d8/d4e/d91/fed 71 1 2024-03-12T16:10:50.307 INFO:tasks.workunit.client.1.smithi134.stdout:4/723: creat d1/de/d5a/d84/fe3 x:0 0 0 2024-03-12T16:10:50.311 INFO:tasks.workunit.client.1.smithi134.stdout:7/818: dread d8/db4/fd3 [0,4194304] 0 2024-03-12T16:10:50.334 INFO:tasks.workunit.client.1.smithi134.stdout:1/571: write d0/d16/d9/d13/d38/f41 [588902,12085] 0 2024-03-12T16:10:50.335 INFO:tasks.workunit.client.1.smithi134.stdout:1/572: chown d0/d30/fb8 6999222 1 2024-03-12T16:10:50.341 INFO:tasks.workunit.client.1.smithi134.stdout:1/573: dwrite d0/d16/d9/f70 [0,4194304] 0 2024-03-12T16:10:50.342 INFO:tasks.workunit.client.1.smithi134.stdout:1/574: truncate d0/d30/fb8 194322 0 2024-03-12T16:10:50.355 INFO:tasks.workunit.client.1.smithi134.stdout:2/738: mkdir d4/d12/d3b/d3f/d10a 0 2024-03-12T16:10:50.356 INFO:tasks.workunit.client.1.smithi134.stdout:3/935: getdents d1/db/d14/d5f/d13d 0 2024-03-12T16:10:50.356 INFO:tasks.workunit.client.1.smithi134.stdout:5/906: write db/d12/d1d/d5c/fc8 [1479772,83237] 0 2024-03-12T16:10:50.361 INFO:tasks.workunit.client.1.smithi134.stdout:8/767: creat d3/d1b/d17/d24/db6/f109 x:0 0 0 2024-03-12T16:10:50.374 INFO:tasks.workunit.client.1.smithi134.stdout:4/724: creat d1/de/d5a/fe4 x:0 0 0 2024-03-12T16:10:50.375 INFO:tasks.workunit.client.1.smithi134.stdout:5/907: mknod db/d7a/da8/dfb/c11b 0 2024-03-12T16:10:50.376 INFO:tasks.workunit.client.1.smithi134.stdout:1/575: dread d0/d16/d9/d51/f55 [0,4194304] 0 2024-03-12T16:10:50.382 INFO:tasks.workunit.client.1.smithi134.stdout:3/936: getdents d1/db/d12/d9d 0 2024-03-12T16:10:50.383 INFO:tasks.workunit.client.1.smithi134.stdout:5/908: dwrite db/d12/d7b/f10f [0,4194304] 0 2024-03-12T16:10:50.383 INFO:tasks.workunit.client.1.smithi134.stdout:9/775: dread d5/d10/d1f/f6e [0,4194304] 0 2024-03-12T16:10:50.384 INFO:tasks.workunit.client.1.smithi134.stdout:4/725: creat d1/d13/d49/d53/dd6/fe5 x:0 0 0 2024-03-12T16:10:50.385 INFO:tasks.workunit.client.1.smithi134.stdout:3/937: chown d1/db/d14/cae 96460 1 2024-03-12T16:10:50.387 INFO:tasks.workunit.client.1.smithi134.stdout:4/726: truncate d1/de/f9a 1701689 0 2024-03-12T16:10:50.387 INFO:tasks.workunit.client.1.smithi134.stdout:3/938: chown d1/db/d12/d9d/fc0 24645 1 2024-03-12T16:10:50.387 INFO:tasks.workunit.client.1.smithi134.stdout:8/768: getdents d3/d1b/d17/d24 0 2024-03-12T16:10:50.390 INFO:tasks.workunit.client.1.smithi134.stdout:8/769: truncate d3/d1b/d17/d25/ffa 83778 0 2024-03-12T16:10:50.391 INFO:tasks.workunit.client.1.smithi134.stdout:8/770: fsync d3/db0/fbe 0 2024-03-12T16:10:50.398 INFO:tasks.workunit.client.1.smithi134.stdout:5/909: mknod db/d12/d1d/d3a/d4e/d108/d73/c11c 0 2024-03-12T16:10:50.398 INFO:tasks.workunit.client.1.smithi134.stdout:0/735: write db/d2f/d51/db4/fc3 [142803,8052] 0 2024-03-12T16:10:50.399 INFO:tasks.workunit.client.1.smithi134.stdout:2/739: write d4/d84/f36 [2075471,48102] 0 2024-03-12T16:10:50.400 INFO:tasks.workunit.client.1.smithi134.stdout:4/727: symlink d1/d24/ddd/le6 0 2024-03-12T16:10:50.402 INFO:tasks.workunit.client.1.smithi134.stdout:7/819: dwrite d8/dc/d20/f99 [0,4194304] 0 2024-03-12T16:10:50.403 INFO:tasks.workunit.client.1.smithi134.stdout:8/771: symlink d3/d1b/d17/d25/d33/d15/d95/d5b/da7/l10a 0 2024-03-12T16:10:50.405 INFO:tasks.workunit.client.1.smithi134.stdout:5/910: write db/d12/d1d/d3a/d4e/d108/db4/fff [459782,5921] 0 2024-03-12T16:10:50.410 INFO:tasks.workunit.client.1.smithi134.stdout:7/820: dread d8/dc/d7b/f8a [0,4194304] 0 2024-03-12T16:10:50.412 INFO:tasks.workunit.client.1.smithi134.stdout:8/772: truncate d3/d1b/d17/d25/f101 38744 0 2024-03-12T16:10:50.414 INFO:tasks.workunit.client.1.smithi134.stdout:2/740: creat d4/d12/daf/f10b x:0 0 0 2024-03-12T16:10:50.414 INFO:tasks.workunit.client.1.smithi134.stdout:3/939: getdents d1/db/d12/d9d/d9f/d103 0 2024-03-12T16:10:50.418 INFO:tasks.workunit.client.1.smithi134.stdout:7/821: rmdir d8/dc/d7b 39 2024-03-12T16:10:50.420 INFO:tasks.workunit.client.1.smithi134.stdout:0/736: dwrite db/d2f/d31/d76/d9f/fb8 [0,4194304] 0 2024-03-12T16:10:50.424 INFO:tasks.workunit.client.1.smithi134.stdout:2/741: truncate d4/d12/f22 4541140 0 2024-03-12T16:10:50.429 INFO:tasks.workunit.client.1.smithi134.stdout:9/776: dwrite d5/d10/d35/d49/fb7 [0,4194304] 0 2024-03-12T16:10:50.431 INFO:tasks.workunit.client.1.smithi134.stdout:7/822: mkdir d8/dc/d20/d26/d10e/d10f 0 2024-03-12T16:10:50.433 INFO:tasks.workunit.client.1.smithi134.stdout:2/742: mknod d4/d12/d1d/d34/c10c 0 2024-03-12T16:10:50.434 INFO:tasks.workunit.client.1.smithi134.stdout:4/728: write d1/d13/f4b [865567,107630] 0 2024-03-12T16:10:50.435 INFO:tasks.workunit.client.1.smithi134.stdout:0/737: symlink db/d2f/d31/d75/d88/dd4/lea 0 2024-03-12T16:10:50.442 INFO:tasks.workunit.client.1.smithi134.stdout:3/940: dwrite d1/db/d12/d9d/dc5/f12e [0,4194304] 0 2024-03-12T16:10:50.447 INFO:tasks.workunit.client.1.smithi134.stdout:2/743: mknod d4/d12/d3b/d3f/d10a/c10d 0 2024-03-12T16:10:50.448 INFO:tasks.workunit.client.1.smithi134.stdout:4/729: rename d1/d13/d49/faa to d1/fe7 0 2024-03-12T16:10:50.451 INFO:tasks.workunit.client.1.smithi134.stdout:9/777: truncate d5/d10/d35/d49/d74/f78 1333863 0 2024-03-12T16:10:50.454 INFO:tasks.workunit.client.1.smithi134.stdout:0/738: rename db/d2f/d61/d7a/dce to db/d2f/d51/daf/deb 0 2024-03-12T16:10:50.457 INFO:tasks.workunit.client.1.smithi134.stdout:5/911: dwrite db/d12/d1d/d3a/d4e/d108/f39 [0,4194304] 0 2024-03-12T16:10:50.457 INFO:tasks.workunit.client.1.smithi134.stdout:0/739: read - db/d2f/d31/d56/fe4 zero size 2024-03-12T16:10:50.460 INFO:tasks.workunit.client.1.smithi134.stdout:8/773: dread d3/d1b/d17/d25/d33/d15/d95/d5b/da7/fb5 [0,4194304] 0 2024-03-12T16:10:50.462 INFO:tasks.workunit.client.1.smithi134.stdout:7/823: dwrite d8/dc/d7b/dbb/f109 [0,4194304] 0 2024-03-12T16:10:50.472 INFO:tasks.workunit.client.1.smithi134.stdout:7/824: creat d8/dc/d55/d57/f110 x:0 0 0 2024-03-12T16:10:50.474 INFO:tasks.workunit.client.1.smithi134.stdout:4/730: stat d1/de/fc5 0 2024-03-12T16:10:50.481 INFO:tasks.workunit.client.1.smithi134.stdout:2/744: dwrite d4/d84/d63/d9d/f4b [0,4194304] 0 2024-03-12T16:10:50.485 INFO:tasks.workunit.client.1.smithi134.stdout:0/740: write db/d2f/d31/d75/fb1 [3596199,114805] 0 2024-03-12T16:10:50.487 INFO:tasks.workunit.client.1.smithi134.stdout:7/825: truncate d8/dc/d20/d26/f3a 71472 0 2024-03-12T16:10:50.488 INFO:tasks.workunit.client.1.smithi134.stdout:5/912: truncate db/d12/f40 3155090 0 2024-03-12T16:10:50.488 INFO:tasks.workunit.client.1.smithi134.stdout:8/774: write d3/d1b/d17/d45/fc4 [285606,70149] 0 2024-03-12T16:10:50.489 INFO:tasks.workunit.client.1.smithi134.stdout:3/941: dread d1/db/d12/d9d/fe3 [0,4194304] 0 2024-03-12T16:10:50.492 INFO:tasks.workunit.client.1.smithi134.stdout:7/826: symlink d8/dc/d7b/dbb/l111 0 2024-03-12T16:10:50.492 INFO:tasks.workunit.client.1.smithi134.stdout:0/741: fdatasync db/d2f/d61/d67/f69 0 2024-03-12T16:10:50.496 INFO:tasks.workunit.client.1.smithi134.stdout:8/775: fsync d3/d1b/d17/d25/d33/d96/f107 0 2024-03-12T16:10:50.497 INFO:tasks.workunit.client.1.smithi134.stdout:3/942: fdatasync d1/d63/f83 0 2024-03-12T16:10:50.503 INFO:tasks.workunit.client.1.smithi134.stdout:4/731: dwrite d1/d24/d34/d8e/fb4 [0,4194304] 0 2024-03-12T16:10:50.505 INFO:tasks.workunit.client.1.smithi134.stdout:5/913: truncate db/d12/d1d/d5c/fc8 559910 0 2024-03-12T16:10:50.508 INFO:tasks.workunit.client.1.smithi134.stdout:2/745: dwrite d4/d12/daf/f108 [0,4194304] 0 2024-03-12T16:10:50.510 INFO:tasks.workunit.client.1.smithi134.stdout:0/742: dread db/d2f/d31/d68/f98 [0,4194304] 0 2024-03-12T16:10:50.512 INFO:tasks.workunit.client.1.smithi134.stdout:2/746: chown d4/d12/d3b/d3f/d10a/c10d 1122 1 2024-03-12T16:10:50.515 INFO:tasks.workunit.client.1.smithi134.stdout:5/914: symlink db/d12/d1d/d3a/d4e/d108/l11d 0 2024-03-12T16:10:50.515 INFO:tasks.workunit.client.1.smithi134.stdout:3/943: write d1/db/d10/d2a/f51 [1252864,7445] 0 2024-03-12T16:10:50.521 INFO:tasks.workunit.client.1.smithi134.stdout:5/915: unlink db/d12/l61 0 2024-03-12T16:10:50.526 INFO:tasks.workunit.client.0.smithi006.stdout:9/510: creat d0/d4/d3b/d6a/fae x:0 0 0 2024-03-12T16:10:50.527 INFO:tasks.workunit.client.1.smithi134.stdout:2/747: link d4/d84/f55 d4/d84/f10e 0 2024-03-12T16:10:50.528 INFO:tasks.workunit.client.1.smithi134.stdout:4/732: creat d1/d13/d49/d53/fe8 x:0 0 0 2024-03-12T16:10:50.528 INFO:tasks.workunit.client.0.smithi006.stdout:6/590: truncate d3/d11/d10/f49 2019423 0 2024-03-12T16:10:50.529 INFO:tasks.workunit.client.1.smithi134.stdout:8/776: rename d3/d1b/d17/d25/d33/l4a to d3/d1b/d17/d25/d33/d96/l10b 0 2024-03-12T16:10:50.530 INFO:tasks.workunit.client.0.smithi006.stdout:6/591: readlink d3/d11/d10/da7/d8e/d8b/l98 0 2024-03-12T16:10:50.533 INFO:tasks.workunit.client.1.smithi134.stdout:3/944: write d1/d63/d6c/dbf/fd9 [664891,28643] 0 2024-03-12T16:10:50.535 INFO:tasks.workunit.client.0.smithi006.stdout:0/541: creat d2/d6/d10/d11/d7e/fa5 x:0 0 0 2024-03-12T16:10:50.536 INFO:tasks.workunit.client.0.smithi006.stdout:0/542: chown d2/d39/d42/c76 0 1 2024-03-12T16:10:50.538 INFO:tasks.workunit.client.0.smithi006.stdout:3/521: write d8/d19/d26/d59/f1f [239902,1549] 0 2024-03-12T16:10:50.540 INFO:tasks.workunit.client.1.smithi134.stdout:5/916: truncate db/d12/d29/d3d/f9d 1100678 0 2024-03-12T16:10:50.540 INFO:tasks.workunit.client.1.smithi134.stdout:4/733: write d1/d13/d49/fa0 [502590,54691] 0 2024-03-12T16:10:50.545 INFO:tasks.workunit.client.1.smithi134.stdout:3/945: dwrite d1/d63/d6c/f6d [0,4194304] 0 2024-03-12T16:10:50.546 INFO:tasks.workunit.client.1.smithi134.stdout:0/743: rename db/d2f/d61/d7a/c8f to db/d2f/d51/cec 0 2024-03-12T16:10:50.547 INFO:tasks.workunit.client.1.smithi134.stdout:2/748: link c3 d4/de8/dea/d105/c10f 0 2024-03-12T16:10:50.550 INFO:tasks.workunit.client.1.smithi134.stdout:2/749: write d4/d12/d3b/fed [542645,102723] 0 2024-03-12T16:10:50.550 INFO:tasks.workunit.client.1.smithi134.stdout:5/917: symlink db/d12/d1d/d3a/d4e/d108/d73/d8c/dab/l11e 0 2024-03-12T16:10:50.553 INFO:tasks.workunit.client.1.smithi134.stdout:2/750: stat d4/d12/f20 0 2024-03-12T16:10:50.554 INFO:tasks.workunit.client.1.smithi134.stdout:2/751: write d4/d12/d3b/d3f/f45 [2220684,67300] 0 2024-03-12T16:10:50.557 INFO:tasks.workunit.client.1.smithi134.stdout:8/777: truncate d3/d82/d104/f62 2450083 0 2024-03-12T16:10:50.558 INFO:tasks.workunit.client.1.smithi134.stdout:8/778: write d3/d1b/f1d [218983,103173] 0 2024-03-12T16:10:50.559 INFO:tasks.workunit.client.1.smithi134.stdout:0/744: unlink db/d2f/d61/d6c/c90 0 2024-03-12T16:10:50.562 INFO:tasks.workunit.client.1.smithi134.stdout:2/752: dread d4/d12/d1d/d34/d58/d74/fb0 [0,4194304] 0 2024-03-12T16:10:50.568 INFO:tasks.workunit.client.1.smithi134.stdout:0/745: fsync db/d2f/d31/d68/da2/dd3/de5/fe9 0 2024-03-12T16:10:50.571 INFO:tasks.workunit.client.1.smithi134.stdout:3/946: creat d1/db/d10/f14d x:0 0 0 2024-03-12T16:10:50.573 INFO:tasks.workunit.client.1.smithi134.stdout:4/734: dwrite d1/d13/d49/d64/d28/d4f/f9c [0,4194304] 0 2024-03-12T16:10:50.575 INFO:tasks.workunit.client.1.smithi134.stdout:5/918: fdatasync db/d12/f40 0 2024-03-12T16:10:50.579 INFO:tasks.workunit.client.1.smithi134.stdout:3/947: rename d1/db/d10/d111/f120 to d1/db/d12/de4/f14e 0 2024-03-12T16:10:50.579 INFO:tasks.workunit.client.1.smithi134.stdout:2/753: mkdir d4/d12/d1d/d34/d47/d8c/d100/d110 0 2024-03-12T16:10:50.583 INFO:tasks.workunit.client.1.smithi134.stdout:4/735: symlink d1/d13/le9 0 2024-03-12T16:10:50.583 INFO:tasks.workunit.client.1.smithi134.stdout:4/736: stat d1/d13/d49/d64/fcf 0 2024-03-12T16:10:50.584 INFO:tasks.workunit.client.1.smithi134.stdout:5/919: rmdir db/d12/d1d/d59/d94/ddb/df0 39 2024-03-12T16:10:50.585 INFO:tasks.workunit.client.1.smithi134.stdout:2/754: mkdir d4/d84/d63/d111 0 2024-03-12T16:10:50.586 INFO:tasks.workunit.client.1.smithi134.stdout:3/948: creat d1/db/d10/daf/f14f x:0 0 0 2024-03-12T16:10:50.588 INFO:tasks.workunit.client.1.smithi134.stdout:0/746: link db/d2f/d31/d56/d66/cb7 db/d2f/d31/d56/d66/ced 0 2024-03-12T16:10:50.592 INFO:tasks.workunit.client.1.smithi134.stdout:3/949: chown d1/db/d12/d9d/dc5/dec/f11a 22884 1 2024-03-12T16:10:50.596 INFO:tasks.workunit.client.1.smithi134.stdout:2/755: symlink d4/d12/d1d/d34/d47/d8c/d100/d110/l112 0 2024-03-12T16:10:50.596 INFO:tasks.workunit.client.1.smithi134.stdout:5/920: dwrite db/d12/d29/fc3 [0,4194304] 0 2024-03-12T16:10:50.609 INFO:tasks.workunit.client.1.smithi134.stdout:5/921: readlink db/d12/l115 0 2024-03-12T16:10:50.609 INFO:tasks.workunit.client.1.smithi134.stdout:4/737: dread d1/d13/d49/d64/d28/f3b [0,4194304] 0 2024-03-12T16:10:50.615 INFO:tasks.workunit.client.1.smithi134.stdout:0/747: dread db/fe [0,4194304] 0 2024-03-12T16:10:50.615 INFO:tasks.workunit.client.1.smithi134.stdout:2/756: dwrite d4/d12/d3b/fed [0,4194304] 0 2024-03-12T16:10:50.615 INFO:tasks.workunit.client.1.smithi134.stdout:3/950: write d1/db/f4c [3319007,21966] 0 2024-03-12T16:10:50.619 INFO:tasks.workunit.client.1.smithi134.stdout:4/738: creat d1/d24/d34/d73/fea x:0 0 0 2024-03-12T16:10:50.623 INFO:tasks.workunit.client.1.smithi134.stdout:0/748: write db/f26 [8237642,87252] 0 2024-03-12T16:10:50.623 INFO:tasks.workunit.client.1.smithi134.stdout:3/951: fsync d1/d63/fdc 0 2024-03-12T16:10:50.624 INFO:tasks.workunit.client.1.smithi134.stdout:0/749: stat db/dcc/de7 0 2024-03-12T16:10:50.625 INFO:tasks.workunit.client.1.smithi134.stdout:2/757: read - d4/d12/d1d/d34/d47/fb8 zero size 2024-03-12T16:10:50.625 INFO:tasks.workunit.client.1.smithi134.stdout:3/952: fsync d1/db/d10/d2d/d2e/d72/fce 0 2024-03-12T16:10:50.626 INFO:tasks.workunit.client.1.smithi134.stdout:4/739: rmdir d1/de/d5a/d84 39 2024-03-12T16:10:50.628 INFO:tasks.workunit.client.1.smithi134.stdout:5/922: getdents db/d12/d1d/d3a/d70 0 2024-03-12T16:10:50.632 INFO:tasks.workunit.client.1.smithi134.stdout:2/758: creat d4/d12/d1d/d34/d47/f113 x:0 0 0 2024-03-12T16:10:50.633 INFO:tasks.workunit.client.1.smithi134.stdout:4/740: symlink d1/de/dac/leb 0 2024-03-12T16:10:50.635 INFO:tasks.workunit.client.1.smithi134.stdout:5/923: symlink db/d7a/d97/l11f 0 2024-03-12T16:10:50.637 INFO:tasks.workunit.client.1.smithi134.stdout:0/750: dwrite db/f1f [0,4194304] 0 2024-03-12T16:10:50.642 INFO:tasks.workunit.client.1.smithi134.stdout:0/751: symlink db/d2f/d31/d76/lee 0 2024-03-12T16:10:50.643 INFO:tasks.workunit.client.1.smithi134.stdout:5/924: dread db/d7a/da8/fc2 [0,4194304] 0 2024-03-12T16:10:50.643 INFO:tasks.workunit.client.1.smithi134.stdout:3/953: truncate d1/db/d10/d2a/dc6/f132 172767 0 2024-03-12T16:10:50.646 INFO:tasks.workunit.client.0.smithi006.stdout:3/522: stat d8/d4c/d7c/l7f 0 2024-03-12T16:10:50.646 INFO:tasks.workunit.client.0.smithi006.stdout:6/592: dwrite d3/d11/d10/d19/f1f [0,4194304] 0 2024-03-12T16:10:50.647 INFO:tasks.workunit.client.0.smithi006.stdout:0/543: truncate d2/d6/d10/d11/d32/f38 4750425 0 2024-03-12T16:10:50.647 INFO:tasks.workunit.client.0.smithi006.stdout:3/523: read - d8/d19/fa7 zero size 2024-03-12T16:10:50.649 INFO:tasks.workunit.client.0.smithi006.stdout:0/544: readlink d2/d6/d10/l4f 0 2024-03-12T16:10:50.650 INFO:tasks.workunit.client.0.smithi006.stdout:4/693: mknod d1/db/d39/d42/d61/ce1 0 2024-03-12T16:10:50.654 INFO:tasks.workunit.client.0.smithi006.stdout:1/598: link d0/d25/d2a/d43/d63/f78 d0/d25/d67/db0/fcc 0 2024-03-12T16:10:50.655 INFO:tasks.workunit.client.0.smithi006.stdout:1/599: stat d0/d25/d2a/d43/d63 0 2024-03-12T16:10:50.656 INFO:tasks.workunit.client.1.smithi134.stdout:2/759: dwrite d4/d12/d39/f9f [0,4194304] 0 2024-03-12T16:10:50.660 INFO:tasks.workunit.client.1.smithi134.stdout:5/925: rename db/d12/d1d/d59/d94/ddb to db/d12/d1d/d3a/d4e/d108/db4/db9/ddf/d103/d120 0 2024-03-12T16:10:50.660 INFO:tasks.workunit.client.1.smithi134.stdout:3/954: truncate d1/db/d10/d2d/d30/fee 41613 0 2024-03-12T16:10:50.660 INFO:tasks.workunit.client.0.smithi006.stdout:6/593: write d3/d11/d10/d1b/d6e/db1/fb5 [546887,90508] 0 2024-03-12T16:10:50.662 INFO:tasks.workunit.client.1.smithi134.stdout:3/955: chown d1/db/d10/fcc 19368 1 2024-03-12T16:10:50.662 INFO:tasks.workunit.client.0.smithi006.stdout:5/486: mknod d7/d9/d31/d3b/d4f/d80/d88/c99 0 2024-03-12T16:10:50.665 INFO:tasks.workunit.client.0.smithi006.stdout:8/500: link d2/db/d1a/d21/l8d d2/db/d1a/d1f/l9f 0 2024-03-12T16:10:50.669 INFO:tasks.workunit.client.1.smithi134.stdout:4/741: dread d1/d13/d49/d6d/d96/f9e [0,4194304] 0 2024-03-12T16:10:50.669 INFO:tasks.workunit.client.1.smithi134.stdout:5/926: mkdir db/d12/d1d/d3a/d4e/d108/db4/db9/df6/d121 0 2024-03-12T16:10:50.671 INFO:tasks.workunit.client.0.smithi006.stdout:1/600: write d0/d25/d2a/d35/d3f/f5a [3368934,19582] 0 2024-03-12T16:10:50.673 INFO:tasks.workunit.client.1.smithi134.stdout:5/927: dread - db/d12/d1d/d3a/ff4 zero size 2024-03-12T16:10:50.673 INFO:tasks.workunit.client.1.smithi134.stdout:0/752: truncate db/d2f/d31/d68/da2/db2/fe0 572365 0 2024-03-12T16:10:50.673 INFO:tasks.workunit.client.0.smithi006.stdout:4/694: mknod d1/db/d1d/ce2 0 2024-03-12T16:10:50.674 INFO:tasks.workunit.client.1.smithi134.stdout:4/742: stat d1/l38 0 2024-03-12T16:10:50.677 INFO:tasks.workunit.client.0.smithi006.stdout:6/594: fdatasync d3/d11/d10/d28/d45/f85 0 2024-03-12T16:10:50.678 INFO:tasks.workunit.client.1.smithi134.stdout:3/956: dwrite d1/d63/d6c/dbf/f10d [4194304,4194304] 0 2024-03-12T16:10:50.680 INFO:tasks.workunit.client.1.smithi134.stdout:0/753: read - db/d2f/d31/d68/d70/dc7/fdb zero size 2024-03-12T16:10:50.681 INFO:tasks.workunit.client.1.smithi134.stdout:4/743: chown d1/d24/d34/c4c 26216008 1 2024-03-12T16:10:50.683 INFO:tasks.workunit.client.1.smithi134.stdout:5/928: chown db/d12/d7b/c10d 251830 1 2024-03-12T16:10:50.687 INFO:tasks.workunit.client.0.smithi006.stdout:4/695: dwrite d1/f31 [0,4194304] 0 2024-03-12T16:10:50.688 INFO:tasks.workunit.client.1.smithi134.stdout:5/929: truncate db/d12/d1d/d59/d94/fae 934702 0 2024-03-12T16:10:50.688 INFO:tasks.workunit.client.0.smithi006.stdout:6/595: read d3/d11/d10/d1b/d20/f23 [3943181,80618] 0 2024-03-12T16:10:50.688 INFO:tasks.workunit.client.0.smithi006.stdout:1/601: link d0/d25/f9e d0/d25/d2a/d64/fcd 0 2024-03-12T16:10:50.690 INFO:tasks.workunit.client.0.smithi006.stdout:5/487: dwrite d7/f58 [0,4194304] 0 2024-03-12T16:10:50.693 INFO:tasks.workunit.client.1.smithi134.stdout:3/957: dwrite d1/d63/d6c/dbf/fd5 [0,4194304] 0 2024-03-12T16:10:50.693 INFO:tasks.workunit.client.0.smithi006.stdout:5/488: chown d7/d9/f6a 5 1 2024-03-12T16:10:50.694 INFO:tasks.workunit.client.1.smithi134.stdout:2/760: dread d4/d12/d1d/f21 [0,4194304] 0 2024-03-12T16:10:50.694 INFO:tasks.workunit.client.0.smithi006.stdout:3/524: dread d8/d19/d26/d59/f1a [0,4194304] 0 2024-03-12T16:10:50.694 INFO:tasks.workunit.client.1.smithi134.stdout:5/930: getdents db/d7a 0 2024-03-12T16:10:50.700 INFO:tasks.workunit.client.1.smithi134.stdout:2/761: mkdir d4/d12/d3b/d3f/d114 0 2024-03-12T16:10:50.701 INFO:tasks.workunit.client.0.smithi006.stdout:1/602: chown d0/d25/d2a/l97 57851149 1 2024-03-12T16:10:50.702 INFO:tasks.workunit.client.1.smithi134.stdout:5/931: fsync db/d12/d1d/d59/de5/fe2 0 2024-03-12T16:10:50.704 INFO:tasks.workunit.client.1.smithi134.stdout:3/958: rename d1/db/d10/d2a/dc6/f132 to d1/db/d12/de4/f150 0 2024-03-12T16:10:50.707 INFO:tasks.workunit.client.0.smithi006.stdout:5/489: read d7/d9/d10/d24/f76 [332774,121636] 0 2024-03-12T16:10:50.707 INFO:tasks.workunit.client.0.smithi006.stdout:1/603: write d0/d25/d2a/d35/d3f/fbe [1046996,100088] 0 2024-03-12T16:10:50.710 INFO:tasks.workunit.client.0.smithi006.stdout:3/525: fsync d8/f8e 0 2024-03-12T16:10:50.712 INFO:tasks.workunit.client.0.smithi006.stdout:3/526: write d8/f17 [3649226,86113] 0 2024-03-12T16:10:50.712 INFO:tasks.workunit.client.0.smithi006.stdout:5/490: dread d7/d9/d31/d3b/d4f/f7c [0,4194304] 0 2024-03-12T16:10:50.713 INFO:tasks.workunit.client.1.smithi134.stdout:3/959: fdatasync d1/d63/dc2/fda 0 2024-03-12T16:10:50.713 INFO:tasks.workunit.client.0.smithi006.stdout:3/527: readlink d8/d52/l7b 0 2024-03-12T16:10:50.715 INFO:tasks.workunit.client.1.smithi134.stdout:4/744: dread d1/d13/f93 [0,4194304] 0 2024-03-12T16:10:50.716 INFO:tasks.workunit.client.0.smithi006.stdout:5/491: chown d7/d9/d10/d24/d89/f3a 8132 1 2024-03-12T16:10:50.718 INFO:tasks.workunit.client.1.smithi134.stdout:5/932: symlink db/d12/d1d/d59/d10b/l122 0 2024-03-12T16:10:50.722 INFO:tasks.workunit.client.1.smithi134.stdout:5/933: mknod db/d12/d1d/d3a/d4e/d108/d71/d90/c123 0 2024-03-12T16:10:50.724 INFO:tasks.workunit.client.1.smithi134.stdout:3/960: creat d1/db/d10/d2d/f151 x:0 0 0 2024-03-12T16:10:50.726 INFO:tasks.workunit.client.0.smithi006.stdout:3/528: dwrite d8/d19/d26/d59/f42 [0,4194304] 0 2024-03-12T16:10:50.728 INFO:tasks.workunit.client.1.smithi134.stdout:5/934: creat db/d12/f124 x:0 0 0 2024-03-12T16:10:50.729 INFO:tasks.workunit.client.0.smithi006.stdout:3/529: symlink d8/d19/d47/lb5 0 2024-03-12T16:10:50.731 INFO:tasks.workunit.client.0.smithi006.stdout:6/596: symlink d3/d11/d10/d1b/d6e/lde 0 2024-03-12T16:10:50.731 INFO:tasks.workunit.client.1.smithi134.stdout:5/935: truncate db/d7d/f8d 654029 0 2024-03-12T16:10:50.732 INFO:tasks.workunit.client.0.smithi006.stdout:6/597: chown d3/d11/f25 11 1 2024-03-12T16:10:50.733 INFO:tasks.workunit.client.1.smithi134.stdout:5/936: fdatasync db/d12/d1d/d3a/ff4 0 2024-03-12T16:10:50.737 INFO:tasks.workunit.client.1.smithi134.stdout:2/762: dwrite d4/d12/d1d/d34/d47/d8c/da4/fe0 [0,4194304] 0 2024-03-12T16:10:50.737 INFO:tasks.workunit.client.1.smithi134.stdout:5/937: readlink db/d12/d1d/d3a/d4e/d108/db4/ld7 0 2024-03-12T16:10:50.748 INFO:tasks.workunit.client.1.smithi134.stdout:4/745: dread d1/d13/d49/f32 [0,4194304] 0 2024-03-12T16:10:50.750 INFO:tasks.workunit.client.1.smithi134.stdout:4/746: truncate d1/d13/d49/fe1 236716 0 2024-03-12T16:10:50.754 INFO:tasks.workunit.client.0.smithi006.stdout:6/598: read - d3/d11/d3b/d59/f97 zero size 2024-03-12T16:10:50.767 INFO:tasks.workunit.client.0.smithi006.stdout:4/696: rename d1/l4 to d1/le3 0 2024-03-12T16:10:50.767 INFO:tasks.workunit.client.0.smithi006.stdout:4/697: fdatasync d1/db/d1d/d2f/f97 0 2024-03-12T16:10:50.770 INFO:tasks.workunit.client.1.smithi134.stdout:5/938: read db/d12/d1d/f22 [7916088,35255] 0 2024-03-12T16:10:50.771 INFO:tasks.workunit.client.1.smithi134.stdout:5/939: chown db/d7a/c6f 660942346 1 2024-03-12T16:10:50.773 INFO:tasks.workunit.client.1.smithi134.stdout:3/961: write d1/fad [596686,99680] 0 2024-03-12T16:10:50.775 INFO:tasks.workunit.client.1.smithi134.stdout:5/940: dread db/d12/d1d/f89 [4194304,4194304] 0 2024-03-12T16:10:50.776 INFO:tasks.workunit.client.1.smithi134.stdout:2/763: link d4/d12/d1d/d34/d58/d74/fb0 d4/d12/d3b/f115 0 2024-03-12T16:10:50.777 INFO:tasks.workunit.client.1.smithi134.stdout:5/941: read db/d12/d1d/f69 [263742,31949] 0 2024-03-12T16:10:50.778 INFO:tasks.workunit.client.1.smithi134.stdout:2/764: write d4/d12/d3b/fe9 [518989,24111] 0 2024-03-12T16:10:50.779 INFO:tasks.workunit.client.1.smithi134.stdout:2/765: dread - d4/de8/f81 zero size 2024-03-12T16:10:50.779 INFO:tasks.workunit.client.1.smithi134.stdout:3/962: symlink d1/db/d10/d2a/l152 0 2024-03-12T16:10:50.779 INFO:tasks.workunit.client.1.smithi134.stdout:4/747: link d1/f23 d1/d13/d49/da4/fec 0 2024-03-12T16:10:50.781 INFO:tasks.workunit.client.1.smithi134.stdout:5/942: fsync db/d12/d1d/f89 0 2024-03-12T16:10:50.782 INFO:tasks.workunit.client.1.smithi134.stdout:4/748: write d1/d24/d34/f88 [4468009,115292] 0 2024-03-12T16:10:50.785 INFO:tasks.workunit.client.1.smithi134.stdout:3/963: symlink d1/db/d10/d2a/dc6/l153 0 2024-03-12T16:10:50.785 INFO:tasks.workunit.client.1.smithi134.stdout:2/766: read d4/d12/d1d/d34/d58/d74/fb0 [3526254,118485] 0 2024-03-12T16:10:50.787 INFO:tasks.workunit.client.0.smithi006.stdout:2/575: rename d0/d13/d49/d60/d2b/d62/d66/fb1 to d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/fba 0 2024-03-12T16:10:50.790 INFO:tasks.workunit.client.1.smithi134.stdout:5/943: rename db/d12/d1d/d59/fbf to db/d12/d1d/d3a/d4e/d108/d73/d8c/f125 0 2024-03-12T16:10:50.790 INFO:tasks.workunit.client.0.smithi006.stdout:4/698: getdents d1/d38/db6 0 2024-03-12T16:10:50.790 INFO:tasks.workunit.client.1.smithi134.stdout:5/944: chown db/d12/d1d/d59/de5/fe2 1308 1 2024-03-12T16:10:50.791 INFO:tasks.workunit.client.1.smithi134.stdout:2/767: mkdir d4/d84/d7d/d87/d116 0 2024-03-12T16:10:50.791 INFO:tasks.workunit.client.0.smithi006.stdout:2/576: readlink d0/dc/l71 0 2024-03-12T16:10:50.793 INFO:tasks.workunit.client.1.smithi134.stdout:3/964: creat d1/db/d14/d5a/d89/dea/f154 x:0 0 0 2024-03-12T16:10:50.794 INFO:tasks.workunit.client.0.smithi006.stdout:9/511: rename d0/d8/d16/d7d/f48 to d0/d8/d16/d7d/d20/faf 0 2024-03-12T16:10:50.794 INFO:tasks.workunit.client.1.smithi134.stdout:5/945: mknod db/d12/d1d/d59/d94/c126 0 2024-03-12T16:10:50.796 INFO:tasks.workunit.client.0.smithi006.stdout:4/699: symlink d1/db/d17/d43/db5/da5/le4 0 2024-03-12T16:10:50.796 INFO:tasks.workunit.client.1.smithi134.stdout:5/946: mknod db/d12/d1d/d5c/c127 0 2024-03-12T16:10:50.804 INFO:tasks.workunit.client.0.smithi006.stdout:4/700: getdents d1/db/d17/d43/db5 0 2024-03-12T16:10:50.805 INFO:tasks.workunit.client.1.smithi134.stdout:5/947: rename db/d12/d1d/d3a/d4e/d108 to db/d12/d1d/d128 0 2024-03-12T16:10:50.805 INFO:tasks.workunit.client.1.smithi134.stdout:4/749: dwrite d1/de/f4d [0,4194304] 0 2024-03-12T16:10:50.806 INFO:tasks.workunit.client.0.smithi006.stdout:9/512: truncate d0/d8/d16/d7d/f88 3074 0 2024-03-12T16:10:50.811 INFO:tasks.workunit.client.1.smithi134.stdout:3/965: dread d1/db/d12/f7a [0,4194304] 0 2024-03-12T16:10:50.813 INFO:tasks.workunit.client.1.smithi134.stdout:4/750: mkdir d1/d24/ddd/ded 0 2024-03-12T16:10:50.814 INFO:tasks.workunit.client.1.smithi134.stdout:3/966: chown d1/d63/c10f 4934 1 2024-03-12T16:10:50.815 INFO:tasks.workunit.client.1.smithi134.stdout:4/751: chown d1/d13/d49/d64/d28/d4f/d67/f86 209826321 1 2024-03-12T16:10:50.817 INFO:tasks.workunit.client.0.smithi006.stdout:2/577: dread d0/dc/f1a [0,4194304] 0 2024-03-12T16:10:50.818 INFO:tasks.workunit.client.1.smithi134.stdout:3/967: symlink d1/db/d10/d2d/d2e/d10a/l155 0 2024-03-12T16:10:50.821 INFO:tasks.workunit.client.1.smithi134.stdout:3/968: rename d1/fc to d1/db/d10/dca/f156 0 2024-03-12T16:10:50.822 INFO:tasks.workunit.client.0.smithi006.stdout:2/578: fdatasync d0/d13/d49/d60/f14 0 2024-03-12T16:10:50.822 INFO:tasks.workunit.client.0.smithi006.stdout:7/707: dwrite de/d2c/d4f/dba/f76 [0,4194304] 0 2024-03-12T16:10:50.824 INFO:tasks.workunit.client.0.smithi006.stdout:7/708: write de/d2c/d4f/dba/fdf [859813,92255] 0 2024-03-12T16:10:50.827 INFO:tasks.workunit.client.1.smithi134.stdout:5/948: write db/d12/fb8 [572937,10553] 0 2024-03-12T16:10:50.828 INFO:tasks.workunit.client.0.smithi006.stdout:2/579: unlink d0/dc/l61 0 2024-03-12T16:10:50.828 INFO:tasks.workunit.client.1.smithi134.stdout:3/969: dread d1/d63/f9e [4194304,4194304] 0 2024-03-12T16:10:50.828 INFO:tasks.workunit.client.1.smithi134.stdout:4/752: write d1/de/fc5 [17405,118765] 0 2024-03-12T16:10:50.829 INFO:tasks.workunit.client.1.smithi134.stdout:4/753: chown d1/d13/f7c 98064848 1 2024-03-12T16:10:50.832 INFO:tasks.workunit.client.0.smithi006.stdout:0/545: rename d2/d39/d42/d67 to d2/d6/d10/d11/d7e/da6 0 2024-03-12T16:10:50.833 INFO:tasks.workunit.client.1.smithi134.stdout:3/970: rmdir d1/db/d14/d5f/d13d 0 2024-03-12T16:10:50.834 INFO:tasks.workunit.client.0.smithi006.stdout:9/513: dread d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:50.834 INFO:tasks.workunit.client.0.smithi006.stdout:1/604: unlink d0/d25/d2a/d43/f49 0 2024-03-12T16:10:50.836 INFO:tasks.workunit.client.1.smithi134.stdout:3/971: write d1/db/d12/f71 [4856802,45261] 0 2024-03-12T16:10:50.837 INFO:tasks.workunit.client.1.smithi134.stdout:5/949: dwrite db/d12/d7b/f10f [0,4194304] 0 2024-03-12T16:10:50.837 INFO:tasks.workunit.client.0.smithi006.stdout:2/580: write d0/d13/d49/d60/d2b/d62/f86 [1112753,31939] 0 2024-03-12T16:10:50.837 INFO:tasks.workunit.client.0.smithi006.stdout:8/501: dwrite d2/f36 [0,4194304] 0 2024-03-12T16:10:50.838 INFO:tasks.workunit.client.1.smithi134.stdout:5/950: chown db/d7a/fce 123398 1 2024-03-12T16:10:50.840 INFO:tasks.workunit.client.0.smithi006.stdout:0/546: unlink d2/lb 0 2024-03-12T16:10:50.840 INFO:tasks.workunit.client.1.smithi134.stdout:3/972: symlink d1/db/d10/d2d/d2e/d72/l157 0 2024-03-12T16:10:50.840 INFO:tasks.workunit.client.1.smithi134.stdout:5/951: write db/d12/d29/fc3 [4106977,57876] 0 2024-03-12T16:10:50.842 INFO:tasks.workunit.client.0.smithi006.stdout:0/547: stat d2/d6/d10/d11/d32/f3a 0 2024-03-12T16:10:50.842 INFO:tasks.workunit.client.1.smithi134.stdout:3/973: chown d1/db/d10/d2a/dc6/ddb/cf4 92375439 1 2024-03-12T16:10:50.846 INFO:tasks.workunit.client.0.smithi006.stdout:1/605: mkdir d0/d25/d2a/d35/dce 0 2024-03-12T16:10:50.848 INFO:tasks.workunit.client.0.smithi006.stdout:1/606: stat d0/f2f 0 2024-03-12T16:10:50.849 INFO:tasks.workunit.client.1.smithi134.stdout:3/974: rename d1/f36 to d1/db/d10/d111/f158 0 2024-03-12T16:10:50.851 INFO:tasks.workunit.client.0.smithi006.stdout:2/581: dwrite d0/d13/d49/d60/f36 [0,4194304] 0 2024-03-12T16:10:50.852 INFO:tasks.workunit.client.1.smithi134.stdout:3/975: mkdir d1/db/d14/d5a/d140/d159 0 2024-03-12T16:10:50.854 INFO:tasks.workunit.client.0.smithi006.stdout:7/709: rename de/d98/f9b to de/d2c/d4f/dba/fef 0 2024-03-12T16:10:50.859 INFO:tasks.workunit.client.0.smithi006.stdout:5/492: truncate d7/d9/d31/f46 3536465 0 2024-03-12T16:10:50.860 INFO:tasks.workunit.client.1.smithi134.stdout:3/976: write d1/db/d10/d2d/d2e/f6a [756961,73615] 0 2024-03-12T16:10:50.862 INFO:tasks.workunit.client.0.smithi006.stdout:8/502: rename d2/db/d1a/d23/f50 to d2/db/d1a/d21/d4f/fa0 0 2024-03-12T16:10:50.866 INFO:tasks.workunit.client.0.smithi006.stdout:7/710: rmdir de/d2c/d93/dbe/d4a/d6a 39 2024-03-12T16:10:50.869 INFO:tasks.workunit.client.0.smithi006.stdout:2/582: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/dbb 0 2024-03-12T16:10:50.871 INFO:tasks.workunit.client.1.smithi134.stdout:3/977: dread d1/db/d12/d9d/d9f/d103/f10e [0,4194304] 0 2024-03-12T16:10:50.871 INFO:tasks.workunit.client.0.smithi006.stdout:2/583: read - d0/dc/d64/f9c zero size 2024-03-12T16:10:50.872 INFO:tasks.workunit.client.0.smithi006.stdout:5/493: mkdir d7/d9/d31/d3b/d9a 0 2024-03-12T16:10:50.873 INFO:tasks.workunit.client.1.smithi134.stdout:3/978: read d1/fb0 [34780,59837] 0 2024-03-12T16:10:50.874 INFO:tasks.workunit.client.0.smithi006.stdout:8/503: link d2/f19 d2/db/d1a/d21/d8a/fa1 0 2024-03-12T16:10:50.875 INFO:tasks.workunit.client.1.smithi134.stdout:3/979: rmdir d1/d63 39 2024-03-12T16:10:50.876 INFO:tasks.workunit.client.1.smithi134.stdout:3/980: dread - d1/db/d10/dca/fdf zero size 2024-03-12T16:10:50.877 INFO:tasks.workunit.client.0.smithi006.stdout:3/530: dwrite d8/d19/d26/d59/d2c/f10 [4194304,4194304] 0 2024-03-12T16:10:50.881 INFO:tasks.workunit.client.0.smithi006.stdout:8/504: readlink d2/db/d1a/d1f/l9f 0 2024-03-12T16:10:50.882 INFO:tasks.workunit.client.0.smithi006.stdout:6/599: write d3/d11/d10/d1b/d6e/f2e [1788480,77093] 0 2024-03-12T16:10:50.883 INFO:tasks.workunit.client.0.smithi006.stdout:3/531: fsync d8/d19/d26/d59/d2c/d41/f8c 0 2024-03-12T16:10:50.884 INFO:tasks.workunit.client.1.smithi134.stdout:3/981: dwrite d1/f66 [0,4194304] 0 2024-03-12T16:10:50.885 INFO:tasks.workunit.client.0.smithi006.stdout:3/532: chown d8/d19/l3d 4 1 2024-03-12T16:10:50.886 INFO:tasks.workunit.client.0.smithi006.stdout:8/505: mkdir d2/db/d1a/d21/d2b/da2 0 2024-03-12T16:10:50.887 INFO:tasks.workunit.client.0.smithi006.stdout:3/533: chown d8/d19/d26/d59/d3b/c70 362 1 2024-03-12T16:10:50.890 INFO:tasks.workunit.client.1.smithi134.stdout:3/982: rename d1/db/d10/d2a/dc6/d135/f13b to d1/db/d10/d2a/dc6/ddb/f15a 0 2024-03-12T16:10:50.893 INFO:tasks.workunit.client.0.smithi006.stdout:6/600: getdents d3/d11/d10 0 2024-03-12T16:10:50.893 INFO:tasks.workunit.client.1.smithi134.stdout:3/983: symlink d1/d63/dc2/dff/l15b 0 2024-03-12T16:10:50.895 INFO:tasks.workunit.client.1.smithi134.stdout:3/984: getdents d1/d63/d6c/dbf 0 2024-03-12T16:10:50.896 INFO:tasks.workunit.client.0.smithi006.stdout:5/494: dread d7/d9/d10/d24/d89/f36 [0,4194304] 0 2024-03-12T16:10:50.897 INFO:tasks.workunit.client.0.smithi006.stdout:8/506: dwrite d2/db/f39 [0,4194304] 0 2024-03-12T16:10:50.899 INFO:tasks.workunit.client.0.smithi006.stdout:3/534: rename d8/d19/d26/d59/d2c/d41/f62 to d8/d19/d26/d59/d2c/dc/d28/d2f/fb6 0 2024-03-12T16:10:50.899 INFO:tasks.workunit.client.1.smithi134.stdout:3/985: truncate d1/db/d10/d2d/d30/fee 944520 0 2024-03-12T16:10:50.899 INFO:tasks.workunit.client.0.smithi006.stdout:6/601: creat d3/d47/fdf x:0 0 0 2024-03-12T16:10:50.901 INFO:tasks.workunit.client.1.smithi134.stdout:3/986: creat d1/db/d14/d5a/d89/dea/f15c x:0 0 0 2024-03-12T16:10:50.902 INFO:tasks.workunit.client.0.smithi006.stdout:8/507: read d2/d11/f9d [7757425,58399] 0 2024-03-12T16:10:50.903 INFO:tasks.workunit.client.0.smithi006.stdout:5/495: creat d7/d9/d31/d3b/d61/f9b x:0 0 0 2024-03-12T16:10:50.904 INFO:tasks.workunit.client.1.smithi134.stdout:3/987: unlink d1/db/d12/d9d/d9f/d103/l14b 0 2024-03-12T16:10:50.905 INFO:tasks.workunit.client.1.smithi134.stdout:3/988: write d1/db/d14/fd4 [8923980,4700] 0 2024-03-12T16:10:50.906 INFO:tasks.workunit.client.0.smithi006.stdout:3/535: mkdir d8/d19/d26/d59/d2c/dc/db7 0 2024-03-12T16:10:50.909 INFO:tasks.workunit.client.1.smithi134.stdout:3/989: dread d1/db/d104/f143 [0,4194304] 0 2024-03-12T16:10:50.912 INFO:tasks.workunit.client.0.smithi006.stdout:5/496: truncate d7/f28 1283052 0 2024-03-12T16:10:50.913 INFO:tasks.workunit.client.1.smithi134.stdout:3/990: creat d1/db/d10/d2a/dc6/ddb/f15d x:0 0 0 2024-03-12T16:10:50.916 INFO:tasks.workunit.client.0.smithi006.stdout:0/548: getdents d2/d6/d10/d11/d7e 0 2024-03-12T16:10:50.918 INFO:tasks.workunit.client.1.smithi134.stdout:6/767: dwrite d1/f26 [0,4194304] 0 2024-03-12T16:10:50.918 INFO:tasks.workunit.client.0.smithi006.stdout:5/497: getdents d7/d8/d91 0 2024-03-12T16:10:50.919 INFO:tasks.workunit.client.1.smithi134.stdout:6/768: fsync d1/d3/d10/f2a 0 2024-03-12T16:10:50.920 INFO:tasks.workunit.client.0.smithi006.stdout:5/498: dread - d7/d9/d31/d3b/d4f/d65/d69/f90 zero size 2024-03-12T16:10:50.926 INFO:tasks.workunit.client.1.smithi134.stdout:6/769: creat d1/d3/d10/f121 x:0 0 0 2024-03-12T16:10:50.927 INFO:tasks.workunit.client.0.smithi006.stdout:0/549: truncate d2/d39/d42/f58 1212105 0 2024-03-12T16:10:50.928 INFO:tasks.workunit.client.0.smithi006.stdout:5/499: creat d7/d9/d31/d3b/d61/f9c x:0 0 0 2024-03-12T16:10:50.930 INFO:tasks.workunit.client.1.smithi134.stdout:3/991: dwrite d1/db/d10/d2d/d2e/d72/d97/fcb [0,4194304] 0 2024-03-12T16:10:50.934 INFO:tasks.workunit.client.1.smithi134.stdout:3/992: mkdir d1/db/d12/d9d/d9f/d103/d15e 0 2024-03-12T16:10:50.934 INFO:tasks.workunit.client.0.smithi006.stdout:6/602: dread d3/d11/d43/f9f [4194304,4194304] 0 2024-03-12T16:10:50.936 INFO:tasks.workunit.client.0.smithi006.stdout:5/500: unlink d7/d9/d31/l4b 0 2024-03-12T16:10:50.940 INFO:tasks.workunit.client.1.smithi134.stdout:6/770: mknod d1/d16/d100/d110/c122 0 2024-03-12T16:10:50.940 INFO:tasks.workunit.client.0.smithi006.stdout:9/514: dwrite d0/d8/d16/d7d/d20/d37/f47 [0,4194304] 0 2024-03-12T16:10:50.941 INFO:tasks.workunit.client.0.smithi006.stdout:5/501: write d7/d9/d31/d3b/d61/f9c [1015117,114826] 0 2024-03-12T16:10:50.941 INFO:tasks.workunit.client.1.smithi134.stdout:3/993: rename d1/db/d10 to d1/db/d15f 0 2024-03-12T16:10:50.947 INFO:tasks.workunit.client.0.smithi006.stdout:7/711: write de/d1c/f25 [989922,111089] 0 2024-03-12T16:10:50.948 INFO:tasks.workunit.client.0.smithi006.stdout:9/515: write d0/d8/d16/d7d/d20/d37/f47 [1859517,48413] 0 2024-03-12T16:10:50.948 INFO:tasks.workunit.client.0.smithi006.stdout:5/502: readlink d7/d9/d31/d3b/d4f/d80/l8b 0 2024-03-12T16:10:50.948 INFO:tasks.workunit.client.0.smithi006.stdout:6/603: dwrite d3/d11/d10/d28/d45/f55 [0,4194304] 0 2024-03-12T16:10:50.949 INFO:tasks.workunit.client.1.smithi134.stdout:3/994: dread d1/db/d15f/d2a/f51 [0,4194304] 0 2024-03-12T16:10:50.952 INFO:tasks.workunit.client.1.smithi134.stdout:6/771: getdents d1/d16/d4c/d58/da0 0 2024-03-12T16:10:50.953 INFO:tasks.workunit.client.1.smithi134.stdout:6/772: fdatasync d1/d16/d4c/ff4 0 2024-03-12T16:10:50.956 INFO:tasks.workunit.client.0.smithi006.stdout:6/604: dread - d3/d11/d3b/d59/f97 zero size 2024-03-12T16:10:50.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:49.500247+0000 mgr.smithi134.gcntfu (mgr.24383) 62 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 85 MiB/s rd, 247 MiB/s wr, 474 op/s 2024-03-12T16:10:50.959 INFO:tasks.workunit.client.0.smithi006.stdout:7/712: mknod de/d2c/d4f/dba/d39/d81/cf0 0 2024-03-12T16:10:50.960 INFO:tasks.workunit.client.1.smithi134.stdout:3/995: write d1/db/d14/d5a/d89/ffe [3239951,111142] 0 2024-03-12T16:10:50.960 INFO:tasks.workunit.client.0.smithi006.stdout:2/584: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:50.962 INFO:tasks.workunit.client.1.smithi134.stdout:6/773: read d1/d3/f22 [4635383,105656] 0 2024-03-12T16:10:50.964 INFO:tasks.workunit.client.1.smithi134.stdout:3/996: link d1/d63/dc2/d117/c12f d1/db/d15f/d2d/d2e/d72/c160 0 2024-03-12T16:10:50.965 INFO:tasks.workunit.client.0.smithi006.stdout:6/605: creat d3/d11/d10/fe0 x:0 0 0 2024-03-12T16:10:50.966 INFO:tasks.workunit.client.1.smithi134.stdout:3/997: rmdir d1/db/d14/d5a 39 2024-03-12T16:10:50.969 INFO:tasks.workunit.client.0.smithi006.stdout:3/536: write d8/d4c/d7c/f7e [308606,101473] 0 2024-03-12T16:10:50.970 INFO:tasks.workunit.client.0.smithi006.stdout:2/585: chown d0/d13/c2a 37 1 2024-03-12T16:10:50.971 INFO:tasks.workunit.client.0.smithi006.stdout:7/713: symlink de/d2c/d93/dbe/d4a/dbf/lf1 0 2024-03-12T16:10:50.972 INFO:tasks.workunit.client.1.smithi134.stdout:6/774: creat d1/da6/d55/d85/ddf/f123 x:0 0 0 2024-03-12T16:10:50.972 INFO:tasks.workunit.client.0.smithi006.stdout:7/714: chown de/d1c/f96 5 1 2024-03-12T16:10:50.973 INFO:tasks.workunit.client.1.smithi134.stdout:3/998: dwrite d1/db/d12/d9d/dc5/dec/f13e [0,4194304] 0 2024-03-12T16:10:50.974 INFO:tasks.workunit.client.0.smithi006.stdout:7/715: chown de/d2c/d93/dbe/d66/fda 19502 1 2024-03-12T16:10:50.977 INFO:tasks.workunit.client.1.smithi134.stdout:3/999: creat d1/db/d12/d9d/dc5/dec/f161 x:0 0 0 2024-03-12T16:10:50.980 INFO:tasks.workunit.client.0.smithi006.stdout:3/537: creat d8/d19/d26/d59/d2c/d41/da1/fb8 x:0 0 0 2024-03-12T16:10:50.982 INFO:tasks.workunit.client.0.smithi006.stdout:0/550: dwrite d2/f71 [0,4194304] 0 2024-03-12T16:10:50.988 INFO:tasks.workunit.client.0.smithi006.stdout:3/538: creat d8/d52/fb9 x:0 0 0 2024-03-12T16:10:50.993 INFO:tasks.workunit.client.0.smithi006.stdout:3/539: mkdir d8/d52/d9e/dba 0 2024-03-12T16:10:50.993 INFO:tasks.workunit.client.0.smithi006.stdout:9/516: dwrite d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:50.995 INFO:tasks.workunit.client.0.smithi006.stdout:2/586: link d0/d13/d49/d60/d2b/d62/d79/cb5 d0/d13/d49/d60/d2b/cbc 0 2024-03-12T16:10:50.995 INFO:tasks.workunit.client.0.smithi006.stdout:3/540: write d8/d19/d26/d59/d2c/dc/d28/faf [1001878,80346] 0 2024-03-12T16:10:50.999 INFO:tasks.workunit.client.0.smithi006.stdout:0/551: fdatasync d2/f2b 0 2024-03-12T16:10:51.002 INFO:tasks.workunit.client.0.smithi006.stdout:6/606: stat d3/d11/d10/d1b/d6e/db1/fbd 0 2024-03-12T16:10:51.002 INFO:tasks.workunit.client.0.smithi006.stdout:5/503: truncate d7/d9/d31/d3b/d61/f9c 1083369 0 2024-03-12T16:10:51.005 INFO:tasks.workunit.client.0.smithi006.stdout:7/716: link de/d1c/d35/l74 de/lf2 0 2024-03-12T16:10:51.007 INFO:tasks.workunit.client.0.smithi006.stdout:0/552: creat d2/d6/d10/d11/d32/fa7 x:0 0 0 2024-03-12T16:10:51.009 INFO:tasks.workunit.client.0.smithi006.stdout:9/517: fsync d0/d1f/f91 0 2024-03-12T16:10:51.011 INFO:tasks.workunit.client.0.smithi006.stdout:2/587: link d0/d13/d49/d60/d2b/d62/d66/d69/d81/f99 d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fbd 0 2024-03-12T16:10:51.014 INFO:tasks.workunit.client.0.smithi006.stdout:0/553: dread d2/f4b [0,4194304] 0 2024-03-12T16:10:51.015 INFO:tasks.workunit.client.0.smithi006.stdout:9/518: mknod d0/d8/d16/d2f/cb0 0 2024-03-12T16:10:51.019 INFO:tasks.workunit.client.0.smithi006.stdout:6/607: rename d3/d11/d10/d28/d45 to d3/d11/d10/da7/d8e/de1 0 2024-03-12T16:10:51.021 INFO:tasks.workunit.client.0.smithi006.stdout:7/717: creat de/d2c/d93/dbe/d4a/ff3 x:0 0 0 2024-03-12T16:10:51.023 INFO:tasks.workunit.client.0.smithi006.stdout:7/718: dread - de/fb5 zero size 2024-03-12T16:10:51.023 INFO:tasks.workunit.client.0.smithi006.stdout:2/588: dwrite d0/d13/d49/d60/d2b/d62/d66/da6/fa9 [0,4194304] 0 2024-03-12T16:10:51.026 INFO:tasks.workunit.client.0.smithi006.stdout:0/554: unlink d2/d6/d10/d11/d1d/d2e/f5e 0 2024-03-12T16:10:51.026 INFO:tasks.workunit.client.0.smithi006.stdout:2/589: read d0/d13/d49/d60/d2b/d62/f86 [16552,94788] 0 2024-03-12T16:10:51.027 INFO:tasks.workunit.client.1.smithi134.stdout:6/775: dwrite d1/d16/d4c/d65/d7b/ff8 [0,4194304] 0 2024-03-12T16:10:51.028 INFO:tasks.workunit.client.1.smithi134.stdout:6/776: chown d1/da6/d55/d94/d75/f7f 5659 1 2024-03-12T16:10:51.029 INFO:tasks.workunit.client.1.smithi134.stdout:6/777: fdatasync d1/d3a/db5/deb/ff1 0 2024-03-12T16:10:51.036 INFO:tasks.workunit.client.0.smithi006.stdout:6/608: dwrite d3/d11/d10/d19/f67 [0,4194304] 0 2024-03-12T16:10:51.040 INFO:tasks.workunit.client.0.smithi006.stdout:0/555: mknod d2/d88/ca8 0 2024-03-12T16:10:51.041 INFO:tasks.workunit.client.1.smithi134.stdout:6/778: dwrite d1/da6/f88 [0,4194304] 0 2024-03-12T16:10:51.044 INFO:tasks.workunit.client.0.smithi006.stdout:2/590: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/dbb/lbe 0 2024-03-12T16:10:51.046 INFO:tasks.workunit.client.0.smithi006.stdout:7/719: creat de/d2c/d4f/dba/d40/ff4 x:0 0 0 2024-03-12T16:10:51.048 INFO:tasks.workunit.client.0.smithi006.stdout:5/504: truncate d7/d41/f55 151771 0 2024-03-12T16:10:51.048 INFO:tasks.workunit.client.0.smithi006.stdout:7/720: write de/f80 [1096592,103307] 0 2024-03-12T16:10:51.062 INFO:tasks.workunit.client.0.smithi006.stdout:5/505: dwrite d7/d9/d10/d24/d89/f3a [0,4194304] 0 2024-03-12T16:10:51.066 INFO:tasks.workunit.client.0.smithi006.stdout:0/556: rmdir d2/d39/d98 0 2024-03-12T16:10:51.068 INFO:tasks.workunit.client.0.smithi006.stdout:7/721: read f6 [1222662,124849] 0 2024-03-12T16:10:51.068 INFO:tasks.workunit.client.0.smithi006.stdout:5/506: creat d7/d9/d31/f9d x:0 0 0 2024-03-12T16:10:51.069 INFO:tasks.workunit.client.0.smithi006.stdout:9/519: dwrite d0/d4/d18/d4d/f7c [0,4194304] 0 2024-03-12T16:10:51.073 INFO:tasks.workunit.client.0.smithi006.stdout:7/722: fdatasync de/d2c/d4f/d83/fab 0 2024-03-12T16:10:51.079 INFO:tasks.workunit.client.1.smithi134.stdout:6/779: write d1/f1e [4126264,42332] 0 2024-03-12T16:10:51.082 INFO:tasks.workunit.client.0.smithi006.stdout:5/507: dread d7/d9/d10/d24/d89/f3a [0,4194304] 0 2024-03-12T16:10:51.084 INFO:tasks.workunit.client.0.smithi006.stdout:7/723: fsync de/d2c/d4f/d83/f95 0 2024-03-12T16:10:51.085 INFO:tasks.workunit.client.1.smithi134.stdout:6/780: creat d1/def/f124 x:0 0 0 2024-03-12T16:10:51.087 INFO:tasks.workunit.client.0.smithi006.stdout:6/609: dread d3/d11/d10/f42 [0,4194304] 0 2024-03-12T16:10:51.090 INFO:tasks.workunit.client.0.smithi006.stdout:0/557: dread d2/d6/d10/d11/d1d/d2e/f8f [0,4194304] 0 2024-03-12T16:10:51.092 INFO:tasks.workunit.client.0.smithi006.stdout:5/508: mkdir d7/d9/d31/d3b/d4f/d9e 0 2024-03-12T16:10:51.092 INFO:tasks.workunit.client.0.smithi006.stdout:2/591: dwrite d0/d13/d49/d60/d2b/f56 [0,4194304] 0 2024-03-12T16:10:51.094 INFO:tasks.workunit.client.0.smithi006.stdout:9/520: getdents d0/d1f 0 2024-03-12T16:10:51.097 INFO:tasks.workunit.client.1.smithi134.stdout:6/781: mknod d1/d16/d4c/d65/d70/c125 0 2024-03-12T16:10:51.098 INFO:tasks.workunit.client.0.smithi006.stdout:2/592: write d0/d13/d49/d60/d2b/d62/d79/fb7 [438859,34154] 0 2024-03-12T16:10:51.101 INFO:tasks.workunit.client.1.smithi134.stdout:6/782: truncate d1/d3/d10/f15 1267928 0 2024-03-12T16:10:51.103 INFO:tasks.workunit.client.0.smithi006.stdout:0/558: fdatasync d2/d6/d10/d11/d7e/da6/f9a 0 2024-03-12T16:10:51.105 INFO:tasks.workunit.client.0.smithi006.stdout:5/509: rename d7/d9/d31/d3b/d4f/l70 to d7/d9/d47/d56/l9f 0 2024-03-12T16:10:51.106 INFO:tasks.workunit.client.0.smithi006.stdout:6/610: dwrite d3/d11/d10/d1b/f89 [0,4194304] 0 2024-03-12T16:10:51.109 INFO:tasks.workunit.client.0.smithi006.stdout:5/510: stat d7/d9/c68 0 2024-03-12T16:10:51.112 INFO:tasks.workunit.client.1.smithi134.stdout:6/783: truncate d1/d3/d10/f2a 5171892 0 2024-03-12T16:10:51.116 INFO:tasks.workunit.client.0.smithi006.stdout:2/593: dwrite d0/d13/d49/d60/d2b/f56 [0,4194304] 0 2024-03-12T16:10:51.118 INFO:tasks.workunit.client.0.smithi006.stdout:7/724: getdents de/d2c/d4f/dba/d40 0 2024-03-12T16:10:51.118 INFO:tasks.workunit.client.0.smithi006.stdout:2/594: write d0/d13/d49/d60/d2b/d62/d79/fb7 [139013,105774] 0 2024-03-12T16:10:51.119 INFO:tasks.workunit.client.1.smithi134.stdout:6/784: dread d1/d3/d19/f5e [0,4194304] 0 2024-03-12T16:10:51.120 INFO:tasks.workunit.client.0.smithi006.stdout:6/611: readlink d3/d11/l12 0 2024-03-12T16:10:51.120 INFO:tasks.workunit.client.0.smithi006.stdout:9/521: creat d0/fb1 x:0 0 0 2024-03-12T16:10:51.121 INFO:tasks.workunit.client.0.smithi006.stdout:5/511: creat d7/d9/d47/fa0 x:0 0 0 2024-03-12T16:10:51.122 INFO:tasks.workunit.client.1.smithi134.stdout:6/785: creat d1/d16/d7e/f126 x:0 0 0 2024-03-12T16:10:51.123 INFO:tasks.workunit.client.0.smithi006.stdout:5/512: chown d7/d9/d31/d3b/d9a 111 1 2024-03-12T16:10:51.126 INFO:tasks.workunit.client.0.smithi006.stdout:5/513: write d7/d9/d47/fa0 [106046,87895] 0 2024-03-12T16:10:51.126 INFO:tasks.workunit.client.0.smithi006.stdout:0/559: getdents d2/d6/d10/d11/d1d/d2e 0 2024-03-12T16:10:51.131 INFO:tasks.workunit.client.0.smithi006.stdout:2/595: rename d0/d13/d49/d60/d2b/l30 to d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/lbf 0 2024-03-12T16:10:51.133 INFO:tasks.workunit.client.1.smithi134.stdout:6/786: getdents d1/da6/d55 0 2024-03-12T16:10:51.135 INFO:tasks.workunit.client.0.smithi006.stdout:2/596: write d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f9e [372331,55103] 0 2024-03-12T16:10:51.135 INFO:tasks.workunit.client.0.smithi006.stdout:0/560: rename d2/d6/l31 to d2/d6/d10/d11/d32/da4/la9 0 2024-03-12T16:10:51.135 INFO:tasks.workunit.client.0.smithi006.stdout:7/725: getdents de/d2c/d4f/d8a 0 2024-03-12T16:10:51.139 INFO:tasks.workunit.client.0.smithi006.stdout:2/597: write d0/d13/d49/d60/d2b/d62/d66/d67/fa0 [3302103,10108] 0 2024-03-12T16:10:51.143 INFO:tasks.workunit.client.0.smithi006.stdout:7/726: chown de/d2c/d93/dbe/d4a/l5c 273431 1 2024-03-12T16:10:51.149 INFO:tasks.workunit.client.0.smithi006.stdout:2/598: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/db4/dc0 0 2024-03-12T16:10:51.150 INFO:tasks.workunit.client.1.smithi134.stdout:6/787: rename d1/d3/d19 to d1/da6/d55/d94/d127 0 2024-03-12T16:10:51.152 INFO:tasks.workunit.client.0.smithi006.stdout:9/522: dread d0/d8/d16/d7d/d20/d37/f9d [0,4194304] 0 2024-03-12T16:10:51.155 INFO:tasks.workunit.client.0.smithi006.stdout:5/514: dread d7/d8/f4d [0,4194304] 0 2024-03-12T16:10:51.155 INFO:tasks.workunit.client.1.smithi134.stdout:6/788: creat d1/d16/d4c/d65/dd1/df9/f128 x:0 0 0 2024-03-12T16:10:51.156 INFO:tasks.workunit.client.0.smithi006.stdout:0/561: rmdir d2/d6/d10/d11/d32 39 2024-03-12T16:10:51.156 INFO:tasks.workunit.client.0.smithi006.stdout:9/523: truncate d0/d4/d3b/d6a/f6b 1223708 0 2024-03-12T16:10:51.159 INFO:tasks.workunit.client.1.smithi134.stdout:6/789: mkdir d1/d16/d129 0 2024-03-12T16:10:51.159 INFO:tasks.workunit.client.0.smithi006.stdout:7/727: dread f6 [4194304,4194304] 0 2024-03-12T16:10:51.159 INFO:tasks.workunit.client.1.smithi134.stdout:6/790: write d1/da6/d55/d94/f6f [2278503,63394] 0 2024-03-12T16:10:51.160 INFO:tasks.workunit.client.0.smithi006.stdout:5/515: read d7/d9/d31/d3b/d4f/d65/f7d [772550,124666] 0 2024-03-12T16:10:51.161 INFO:tasks.workunit.client.0.smithi006.stdout:0/562: chown d2/d6/d10/d11/d32 685 1 2024-03-12T16:10:51.164 INFO:tasks.workunit.client.0.smithi006.stdout:9/524: mkdir d0/d4/d3b/d95/db2 0 2024-03-12T16:10:51.165 INFO:tasks.workunit.client.1.smithi134.stdout:6/791: truncate d1/da6/d55/d94/d75/f7f 5465112 0 2024-03-12T16:10:51.165 INFO:tasks.workunit.client.0.smithi006.stdout:2/599: write d0/f50 [1091421,99950] 0 2024-03-12T16:10:51.170 INFO:tasks.workunit.client.1.smithi134.stdout:6/792: rename d1/da6/f88 to d1/d16/d4c/d58/d8e/f12a 0 2024-03-12T16:10:51.172 INFO:tasks.workunit.client.0.smithi006.stdout:2/600: mkdir d0/d13/d49/dc1 0 2024-03-12T16:10:51.174 INFO:tasks.workunit.client.0.smithi006.stdout:7/728: symlink de/d2c/d93/dbe/d4a/lf5 0 2024-03-12T16:10:51.177 INFO:tasks.workunit.client.1.smithi134.stdout:6/793: mknod d1/da6/d55/d94/d127/d32/dd9/c12b 0 2024-03-12T16:10:51.178 INFO:tasks.workunit.client.1.smithi134.stdout:6/794: write d1/d16/d4c/d58/d115/f118 [229827,6590] 0 2024-03-12T16:10:51.180 INFO:tasks.workunit.client.0.smithi006.stdout:7/729: fsync de/d1c/fa2 0 2024-03-12T16:10:51.181 INFO:tasks.workunit.client.0.smithi006.stdout:7/730: readlink de/d18/l53 0 2024-03-12T16:10:51.182 INFO:tasks.workunit.client.0.smithi006.stdout:5/516: creat d7/d9/fa1 x:0 0 0 2024-03-12T16:10:51.183 INFO:tasks.workunit.client.0.smithi006.stdout:0/563: getdents d2/d6/d10/d11/d7e 0 2024-03-12T16:10:51.184 INFO:tasks.workunit.client.0.smithi006.stdout:5/517: read f4 [2424834,107056] 0 2024-03-12T16:10:51.185 INFO:tasks.workunit.client.0.smithi006.stdout:0/564: stat d2/d6/d10/d11/d7e/l8d 0 2024-03-12T16:10:51.189 INFO:tasks.workunit.client.0.smithi006.stdout:2/601: dread d0/d13/d49/d60/f14 [0,4194304] 0 2024-03-12T16:10:51.189 INFO:tasks.workunit.client.0.smithi006.stdout:0/565: rmdir d2 39 2024-03-12T16:10:51.191 INFO:tasks.workunit.client.0.smithi006.stdout:5/518: rmdir d7/d8 39 2024-03-12T16:10:51.192 INFO:tasks.workunit.client.0.smithi006.stdout:5/519: fdatasync d7/d9/fa1 0 2024-03-12T16:10:51.194 INFO:tasks.workunit.client.0.smithi006.stdout:5/520: write f4 [2651552,107749] 0 2024-03-12T16:10:51.194 INFO:tasks.workunit.client.0.smithi006.stdout:7/731: truncate de/f17 2488778 0 2024-03-12T16:10:51.196 INFO:tasks.workunit.client.1.smithi134.stdout:6/795: dread d1/da6/d55/d94/d127/d32/f3c [0,4194304] 0 2024-03-12T16:10:51.197 INFO:tasks.workunit.client.0.smithi006.stdout:7/732: fsync de/d1c/d87/fb3 0 2024-03-12T16:10:51.198 INFO:tasks.workunit.client.1.smithi134.stdout:6/796: symlink d1/d16/d7e/de2/l12c 0 2024-03-12T16:10:51.202 INFO:tasks.workunit.client.0.smithi006.stdout:7/733: creat de/d2c/ff6 x:0 0 0 2024-03-12T16:10:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:49.500247+0000 mgr.smithi134.gcntfu (mgr.24383) 62 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 2.3 GiB data, 8.2 GiB used, 528 GiB / 536 GiB avail; 85 MiB/s rd, 247 MiB/s wr, 474 op/s 2024-03-12T16:10:51.205 INFO:tasks.workunit.client.0.smithi006.stdout:7/734: dread - de/d2c/dd3/fe0 zero size 2024-03-12T16:10:51.205 INFO:tasks.workunit.client.1.smithi134.stdout:6/797: rename d1/d16/d7e/de2 to d1/d16/d7e/d12d 0 2024-03-12T16:10:51.205 INFO:tasks.workunit.client.1.smithi134.stdout:6/798: readlink d1/d89/l98 0 2024-03-12T16:10:51.206 INFO:tasks.workunit.client.1.smithi134.stdout:6/799: stat d1/d16/d4c/d65/d7b/ff8 0 2024-03-12T16:10:51.207 INFO:tasks.workunit.client.0.smithi006.stdout:5/521: rename d7/f28 to d7/d9/d10/d24/d89/fa2 0 2024-03-12T16:10:51.207 INFO:tasks.workunit.client.0.smithi006.stdout:2/602: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f6d [0,4194304] 0 2024-03-12T16:10:51.214 INFO:tasks.workunit.client.0.smithi006.stdout:7/735: dwrite de/d1c/f26 [0,4194304] 0 2024-03-12T16:10:51.216 INFO:tasks.workunit.client.0.smithi006.stdout:5/522: symlink d7/d9/d10/la3 0 2024-03-12T16:10:51.217 INFO:tasks.workunit.client.1.smithi134.stdout:6/800: rmdir d1/da6 39 2024-03-12T16:10:51.218 INFO:tasks.workunit.client.0.smithi006.stdout:5/523: write d7/d9/d31/d3b/d61/d78/f82 [1195463,106962] 0 2024-03-12T16:10:51.222 INFO:tasks.workunit.client.0.smithi006.stdout:2/603: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/fc2 x:0 0 0 2024-03-12T16:10:51.222 INFO:tasks.workunit.client.0.smithi006.stdout:7/736: read de/d2c/d4f/dba/d40/f7f [3244970,17810] 0 2024-03-12T16:10:51.222 INFO:tasks.workunit.client.1.smithi134.stdout:6/801: stat d1/da6/d55/d94/d75/cde 0 2024-03-12T16:10:51.223 INFO:tasks.workunit.client.1.smithi134.stdout:6/802: chown d1/da6/f84 4109369 1 2024-03-12T16:10:51.223 INFO:tasks.workunit.client.0.smithi006.stdout:0/566: dread d2/f2b [0,4194304] 0 2024-03-12T16:10:51.224 INFO:tasks.workunit.client.0.smithi006.stdout:7/737: write de/dc2/f9d [3037340,84856] 0 2024-03-12T16:10:51.226 INFO:tasks.workunit.client.1.smithi134.stdout:6/803: dread - d1/d16/d4c/ff4 zero size 2024-03-12T16:10:51.226 INFO:tasks.workunit.client.0.smithi006.stdout:0/567: rmdir d2/d39/d42/d82 39 2024-03-12T16:10:51.228 INFO:tasks.workunit.client.0.smithi006.stdout:0/568: mknod d2/d6/d10/d11/d1d/d79/caa 0 2024-03-12T16:10:51.229 INFO:tasks.workunit.client.0.smithi006.stdout:7/738: creat de/d2c/d4f/dba/d39/d81/ded/ff7 x:0 0 0 2024-03-12T16:10:51.233 INFO:tasks.workunit.client.0.smithi006.stdout:7/739: creat de/d1c/d87/ff8 x:0 0 0 2024-03-12T16:10:51.241 INFO:tasks.workunit.client.0.smithi006.stdout:0/569: write d2/d39/f40 [789423,110823] 0 2024-03-12T16:10:51.243 INFO:tasks.workunit.client.0.smithi006.stdout:7/740: dwrite de/d7b/fd6 [0,4194304] 0 2024-03-12T16:10:51.244 INFO:tasks.workunit.client.0.smithi006.stdout:0/570: chown d2/d6/d10/f4c 1083454 1 2024-03-12T16:10:51.246 INFO:tasks.workunit.client.0.smithi006.stdout:2/604: dwrite d0/d13/d49/d60/d2b/f8e [0,4194304] 0 2024-03-12T16:10:51.263 INFO:tasks.workunit.client.1.smithi134.stdout:6/804: rename d1/c2 to d1/d16/d100/d110/c12e 0 2024-03-12T16:10:51.293 INFO:tasks.workunit.client.0.smithi006.stdout:5/524: dread d7/d9/d31/f2e [0,4194304] 0 2024-03-12T16:10:51.294 INFO:tasks.workunit.client.0.smithi006.stdout:2/605: write d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f8d [1618078,95955] 0 2024-03-12T16:10:51.332 INFO:tasks.workunit.client.1.smithi134.stdout:6/805: truncate d1/d3/dcb/f105 84560 0 2024-03-12T16:10:51.339 INFO:tasks.workunit.client.1.smithi134.stdout:6/806: symlink d1/l12f 0 2024-03-12T16:10:51.346 INFO:tasks.workunit.client.1.smithi134.stdout:6/807: dwrite d1/d16/d4c/ff4 [0,4194304] 0 2024-03-12T16:10:51.356 INFO:tasks.workunit.client.1.smithi134.stdout:6/808: truncate d1/d16/d4c/d58/da0/db7/f4e 703623 0 2024-03-12T16:10:51.376 INFO:tasks.workunit.client.0.smithi006.stdout:2/606: truncate d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fbd 4844551 0 2024-03-12T16:10:51.386 INFO:tasks.workunit.client.1.smithi134.stdout:6/809: dwrite d1/d89/fd6 [4194304,4194304] 0 2024-03-12T16:10:51.387 INFO:tasks.workunit.client.0.smithi006.stdout:5/525: write d7/d9/d10/f1b [512595,47103] 0 2024-03-12T16:10:51.394 INFO:tasks.workunit.client.0.smithi006.stdout:0/571: dwrite d2/d39/d42/f68 [4194304,4194304] 0 2024-03-12T16:10:51.396 INFO:tasks.workunit.client.0.smithi006.stdout:2/607: dread d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/f8a [0,4194304] 0 2024-03-12T16:10:51.400 INFO:tasks.workunit.client.0.smithi006.stdout:2/608: mkdir d0/dc/d64/dc3 0 2024-03-12T16:10:51.402 INFO:tasks.workunit.client.0.smithi006.stdout:0/572: creat d2/d6/d10/d11/d1d/fab x:0 0 0 2024-03-12T16:10:51.405 INFO:tasks.workunit.client.0.smithi006.stdout:0/573: symlink d2/d6/d10/d11/d1d/d2e/d77/lac 0 2024-03-12T16:10:51.408 INFO:tasks.workunit.client.0.smithi006.stdout:0/574: truncate d2/d6/d10/d11/d7e/da6/f9a 4591148 0 2024-03-12T16:10:51.411 INFO:tasks.workunit.client.0.smithi006.stdout:5/526: dread d7/d9/d10/d24/d89/fa2 [0,4194304] 0 2024-03-12T16:10:51.415 INFO:tasks.workunit.client.0.smithi006.stdout:0/575: write d2/d6/d10/f1a [4872588,33930] 0 2024-03-12T16:10:51.417 INFO:tasks.workunit.client.0.smithi006.stdout:5/527: rename d7/d9/d10/d35/c59 to d7/d9/d31/d3b/d4f/ca4 0 2024-03-12T16:10:51.417 INFO:tasks.workunit.client.0.smithi006.stdout:0/576: fdatasync f0 0 2024-03-12T16:10:51.418 INFO:tasks.workunit.client.0.smithi006.stdout:5/528: write d7/d9/d10/d35/f3c [3408192,45493] 0 2024-03-12T16:10:51.421 INFO:tasks.workunit.client.0.smithi006.stdout:2/609: dread d0/dc/f15 [4194304,4194304] 0 2024-03-12T16:10:51.421 INFO:tasks.workunit.client.0.smithi006.stdout:5/529: creat d7/d9/d31/fa5 x:0 0 0 2024-03-12T16:10:51.423 INFO:tasks.workunit.client.0.smithi006.stdout:0/577: dread d2/f71 [0,4194304] 0 2024-03-12T16:10:51.423 INFO:tasks.workunit.client.0.smithi006.stdout:2/610: chown d0/c52 7293503 1 2024-03-12T16:10:51.430 INFO:tasks.workunit.client.0.smithi006.stdout:2/611: rename d0/d13/d49/d60/f6f to d0/d13/d49/d60/fc4 0 2024-03-12T16:10:51.431 INFO:tasks.workunit.client.0.smithi006.stdout:5/530: write d7/d41/f55 [94639,49803] 0 2024-03-12T16:10:51.435 INFO:tasks.workunit.client.0.smithi006.stdout:2/612: rename d0/l38 to d0/d13/d49/d60/d2b/d62/d79/lc5 0 2024-03-12T16:10:51.436 INFO:tasks.workunit.client.0.smithi006.stdout:5/531: symlink d7/d9/d31/d3b/d6b/la6 0 2024-03-12T16:10:51.439 INFO:tasks.workunit.client.0.smithi006.stdout:0/578: dwrite d2/d6/d10/f4c [0,4194304] 0 2024-03-12T16:10:51.445 INFO:tasks.workunit.client.0.smithi006.stdout:0/579: creat d2/d6/d10/d11/d7e/da6/fad x:0 0 0 2024-03-12T16:10:51.448 INFO:tasks.workunit.client.0.smithi006.stdout:2/613: dwrite d0/f4 [0,4194304] 0 2024-03-12T16:10:51.451 INFO:tasks.workunit.client.0.smithi006.stdout:5/532: dwrite d7/d9/d10/d24/d89/f3a [4194304,4194304] 0 2024-03-12T16:10:51.455 INFO:tasks.workunit.client.0.smithi006.stdout:2/614: fsync d0/f1f 0 2024-03-12T16:10:51.456 INFO:tasks.workunit.client.0.smithi006.stdout:5/533: read d7/d9/d31/f46 [535643,117030] 0 2024-03-12T16:10:51.459 INFO:tasks.workunit.client.0.smithi006.stdout:5/534: write d7/d9/d31/f2e [6611365,55716] 0 2024-03-12T16:10:51.464 INFO:tasks.workunit.client.0.smithi006.stdout:5/535: link d7/d9/d10/d24/f3e d7/d9/d10/d24/fa7 0 2024-03-12T16:10:51.466 INFO:tasks.workunit.client.0.smithi006.stdout:0/580: write d2/d6/d10/f75 [386770,96439] 0 2024-03-12T16:10:51.469 INFO:tasks.workunit.client.0.smithi006.stdout:0/581: getdents d2/d6/d10/d11/d1d/d79 0 2024-03-12T16:10:51.471 INFO:tasks.workunit.client.0.smithi006.stdout:0/582: creat d2/d88/fae x:0 0 0 2024-03-12T16:10:51.472 INFO:tasks.workunit.client.0.smithi006.stdout:0/583: readlink d2/d6/d10/l5b 0 2024-03-12T16:10:51.472 INFO:tasks.workunit.client.0.smithi006.stdout:2/615: truncate d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fb0 564787 0 2024-03-12T16:10:51.474 INFO:tasks.workunit.client.0.smithi006.stdout:0/584: truncate d2/d6/d37/f45 655581 0 2024-03-12T16:10:51.476 INFO:tasks.workunit.client.0.smithi006.stdout:2/616: getdents d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf 0 2024-03-12T16:10:51.480 INFO:tasks.workunit.client.0.smithi006.stdout:2/617: symlink d0/d13/d49/d60/d2b/d62/lc6 0 2024-03-12T16:10:51.480 INFO:tasks.workunit.client.0.smithi006.stdout:0/585: dwrite d2/d6/d10/d11/d32/fa7 [0,4194304] 0 2024-03-12T16:10:51.504 INFO:tasks.workunit.client.0.smithi006.stdout:2/618: write d0/d13/d49/d60/d2b/f9f [4376487,40676] 0 2024-03-12T16:10:51.507 INFO:tasks.workunit.client.0.smithi006.stdout:0/586: rename d2/f4 to d2/d6/d37/d97/faf 0 2024-03-12T16:10:51.531 INFO:tasks.workunit.client.0.smithi006.stdout:2/619: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fc7 x:0 0 0 2024-03-12T16:10:51.531 INFO:tasks.workunit.client.0.smithi006.stdout:2/620: stat d0/l7f 0 2024-03-12T16:10:51.532 INFO:tasks.workunit.client.0.smithi006.stdout:0/587: mknod d2/d6/d10/d11/d7e/da6/d9e/cb0 0 2024-03-12T16:10:51.533 INFO:tasks.workunit.client.0.smithi006.stdout:2/621: read - d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fb8 zero size 2024-03-12T16:10:51.533 INFO:tasks.workunit.client.0.smithi006.stdout:0/588: fdatasync d2/f74 0 2024-03-12T16:10:51.535 INFO:tasks.workunit.client.0.smithi006.stdout:2/622: creat d0/d13/d49/fc8 x:0 0 0 2024-03-12T16:10:51.536 INFO:tasks.workunit.client.0.smithi006.stdout:0/589: stat d2/d39/d42/c4e 0 2024-03-12T16:10:51.537 INFO:tasks.workunit.client.0.smithi006.stdout:2/623: chown d0/d13/d49/d60/c33 17 1 2024-03-12T16:10:51.540 INFO:tasks.workunit.client.0.smithi006.stdout:2/624: unlink d0/d13/d49/d60/d2b/d62/d66/d69/lab 0 2024-03-12T16:10:51.542 INFO:tasks.workunit.client.0.smithi006.stdout:2/625: write d0/d13/d49/d60/f32 [1704796,21858] 0 2024-03-12T16:10:51.551 INFO:tasks.workunit.client.0.smithi006.stdout:0/590: dread d2/d6/d10/d11/d1d/d2e/f6a [0,4194304] 0 2024-03-12T16:10:51.554 INFO:tasks.workunit.client.0.smithi006.stdout:0/591: symlink d2/d39/d42/d82/lb1 0 2024-03-12T16:10:51.555 INFO:tasks.workunit.client.0.smithi006.stdout:2/626: dread d0/f1f [0,4194304] 0 2024-03-12T16:10:51.557 INFO:tasks.workunit.client.0.smithi006.stdout:0/592: symlink d2/d6/d10/d11/d32/da4/lb2 0 2024-03-12T16:10:51.564 INFO:tasks.workunit.client.0.smithi006.stdout:2/627: write d0/f1f [4066324,108115] 0 2024-03-12T16:10:51.565 INFO:tasks.workunit.client.0.smithi006.stdout:0/593: dwrite d2/d39/d42/f64 [0,4194304] 0 2024-03-12T16:10:51.568 INFO:tasks.workunit.client.0.smithi006.stdout:0/594: write d2/d6/d10/d11/d1d/f8e [856649,20575] 0 2024-03-12T16:10:51.570 INFO:tasks.workunit.client.0.smithi006.stdout:2/628: creat d0/d13/d49/d60/d2b/d62/d66/d67/fc9 x:0 0 0 2024-03-12T16:10:51.572 INFO:tasks.workunit.client.0.smithi006.stdout:2/629: readlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/l92 0 2024-03-12T16:10:51.575 INFO:tasks.workunit.client.0.smithi006.stdout:0/595: rename d2/d6/d10/d11/d7e/da6/fad to d2/d6/fb3 0 2024-03-12T16:10:51.577 INFO:tasks.workunit.client.0.smithi006.stdout:0/596: mkdir d2/d6/d37/db4 0 2024-03-12T16:10:51.581 INFO:tasks.workunit.client.0.smithi006.stdout:2/630: write d0/d13/d49/f74 [2660910,23865] 0 2024-03-12T16:10:51.585 INFO:tasks.workunit.client.0.smithi006.stdout:2/631: rename d0/f40 to d0/dc/d64/dc3/fca 0 2024-03-12T16:10:51.587 INFO:tasks.workunit.client.0.smithi006.stdout:0/597: dwrite d2/d6/f3d [4194304,4194304] 0 2024-03-12T16:10:51.588 INFO:tasks.workunit.client.0.smithi006.stdout:2/632: chown d0/d13/d49/d60/d2b/d62/d66/da6 22861060 1 2024-03-12T16:10:51.589 INFO:tasks.workunit.client.0.smithi006.stdout:2/633: write d0/f4 [2214124,84374] 0 2024-03-12T16:10:51.591 INFO:tasks.workunit.client.0.smithi006.stdout:0/598: mkdir d2/d6/d10/d11/d32/da4/db5 0 2024-03-12T16:10:51.592 INFO:tasks.workunit.client.0.smithi006.stdout:2/634: creat d0/d13/d49/d60/d2b/d62/d66/da6/fcb x:0 0 0 2024-03-12T16:10:51.595 INFO:tasks.workunit.client.0.smithi006.stdout:2/635: mkdir d0/d13/d49/d60/d2b/dcc 0 2024-03-12T16:10:51.602 INFO:tasks.workunit.client.0.smithi006.stdout:0/599: dwrite d2/f4b [0,4194304] 0 2024-03-12T16:10:51.607 INFO:tasks.workunit.client.0.smithi006.stdout:2/636: truncate d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f8d 1717949 0 2024-03-12T16:10:51.614 INFO:tasks.workunit.client.0.smithi006.stdout:2/637: dwrite d0/d13/d49/d60/d2b/f6b [0,4194304] 0 2024-03-12T16:10:51.619 INFO:tasks.workunit.client.0.smithi006.stdout:2/638: creat d0/d13/d49/d60/d2b/d62/d66/fcd x:0 0 0 2024-03-12T16:10:51.624 INFO:tasks.workunit.client.0.smithi006.stdout:2/639: mkdir d0/d13/d49/d60/d2b/d62/dce 0 2024-03-12T16:10:51.625 INFO:tasks.workunit.client.0.smithi006.stdout:2/640: readlink d0/d13/l59 0 2024-03-12T16:10:51.629 INFO:tasks.workunit.client.0.smithi006.stdout:0/600: dread d2/d6/d10/f1a [0,4194304] 0 2024-03-12T16:10:51.630 INFO:tasks.workunit.client.0.smithi006.stdout:2/641: dread d0/d13/d49/d60/d2b/d62/d66/da6/fa9 [0,4194304] 0 2024-03-12T16:10:51.632 INFO:tasks.workunit.client.0.smithi006.stdout:2/642: readlink d0/d13/d49/d60/d2b/d62/d66/d69/l7d 0 2024-03-12T16:10:51.635 INFO:tasks.workunit.client.0.smithi006.stdout:0/601: dread d2/d6/d10/d11/d1d/d2e/f8f [0,4194304] 0 2024-03-12T16:10:51.637 INFO:tasks.workunit.client.0.smithi006.stdout:2/643: getdents d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83 0 2024-03-12T16:10:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:9/778: sync 2024-03-12T16:10:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:7/827: sync 2024-03-12T16:10:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:5/952: sync 2024-03-12T16:10:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:8/779: sync 2024-03-12T16:10:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:1/576: sync 2024-03-12T16:10:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:4/754: sync 2024-03-12T16:10:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:6/810: sync 2024-03-12T16:10:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:0/754: sync 2024-03-12T16:10:51.638 INFO:tasks.workunit.client.1.smithi134.stdout:2/768: sync 2024-03-12T16:10:51.639 INFO:tasks.workunit.client.0.smithi006.stdout:2/644: chown d0/d13/d49/d60/f32 33882232 1 2024-03-12T16:10:51.641 INFO:tasks.workunit.client.1.smithi134.stdout:8/780: write d3/d1b/d17/d24/db6/f109 [343612,81264] 0 2024-03-12T16:10:51.642 INFO:tasks.workunit.client.1.smithi134.stdout:9/779: read d5/d20/f23 [1166322,32602] 0 2024-03-12T16:10:51.644 INFO:tasks.workunit.client.0.smithi006.stdout:2/645: stat d0/d13/d49/d60/d2b/d62/d79/lc5 0 2024-03-12T16:10:51.644 INFO:tasks.workunit.client.1.smithi134.stdout:6/811: symlink d1/d16/d4c/d58/da0/l130 0 2024-03-12T16:10:51.644 INFO:tasks.workunit.client.0.smithi006.stdout:0/602: dwrite d2/d6/d10/d11/d7e/da6/f9d [0,4194304] 0 2024-03-12T16:10:51.645 INFO:tasks.workunit.client.0.smithi006.stdout:2/646: dread - d0/d13/d49/d60/fad zero size 2024-03-12T16:10:51.648 INFO:tasks.workunit.client.1.smithi134.stdout:5/953: rename db/d12/d1d/d59/de5/ceb to db/d12/d1d/c129 0 2024-03-12T16:10:51.648 INFO:tasks.workunit.client.1.smithi134.stdout:6/812: stat d1/da6/d55/d85/ddf/l114 0 2024-03-12T16:10:51.650 INFO:tasks.workunit.client.0.smithi006.stdout:0/603: dread d2/d6/f62 [0,4194304] 0 2024-03-12T16:10:51.653 INFO:tasks.workunit.client.1.smithi134.stdout:1/577: rename d0/d16/d9/d13/d21/d2f/f56 to d0/d30/d86/fc5 0 2024-03-12T16:10:51.653 INFO:tasks.workunit.client.1.smithi134.stdout:6/813: unlink d1/d16/d4c/d58/d8e/c8f 0 2024-03-12T16:10:51.654 INFO:tasks.workunit.client.0.smithi006.stdout:2/647: truncate d0/d13/d49/d60/d2b/f6b 3294877 0 2024-03-12T16:10:51.654 INFO:tasks.workunit.client.1.smithi134.stdout:8/781: mknod d3/d1b/d17/d24/d28/d102/c10c 0 2024-03-12T16:10:51.657 INFO:tasks.workunit.client.1.smithi134.stdout:6/814: mkdir d1/d4/df2/d131 0 2024-03-12T16:10:51.658 INFO:tasks.workunit.client.0.smithi006.stdout:2/648: dread d0/d13/d49/d60/f36 [0,4194304] 0 2024-03-12T16:10:51.659 INFO:tasks.workunit.client.1.smithi134.stdout:0/755: dread db/d2f/d31/f47 [0,4194304] 0 2024-03-12T16:10:51.660 INFO:tasks.workunit.client.1.smithi134.stdout:5/954: dread - db/d12/d1d/d3a/d49/fd4 zero size 2024-03-12T16:10:51.663 INFO:tasks.workunit.client.1.smithi134.stdout:9/780: rename d5/d10/d6c/f60 to d5/d10/d35/d49/d74/fde 0 2024-03-12T16:10:51.663 INFO:tasks.workunit.client.1.smithi134.stdout:6/815: mknod d1/d3a/db5/c132 0 2024-03-12T16:10:51.664 INFO:tasks.workunit.client.1.smithi134.stdout:1/578: mknod d0/d30/d48/da1/cc6 0 2024-03-12T16:10:51.664 INFO:tasks.workunit.client.1.smithi134.stdout:9/781: write d5/d10/d33/fb6 [33934,66183] 0 2024-03-12T16:10:51.665 INFO:tasks.workunit.client.0.smithi006.stdout:2/649: link d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/f8a d0/d13/d49/d60/d2b/d62/dce/fcf 0 2024-03-12T16:10:51.667 INFO:tasks.workunit.client.1.smithi134.stdout:0/756: read - db/d2f/d31/d56/d66/da5/fb9 zero size 2024-03-12T16:10:51.669 INFO:tasks.workunit.client.1.smithi134.stdout:8/782: mkdir d3/d1b/d17/d25/d33/d15/d95/d10d 0 2024-03-12T16:10:51.670 INFO:tasks.workunit.client.1.smithi134.stdout:9/782: write d5/d10/d6c/fd9 [665416,86551] 0 2024-03-12T16:10:51.674 INFO:tasks.workunit.client.1.smithi134.stdout:5/955: dwrite db/d12/d1d/d59/d94/fae [0,4194304] 0 2024-03-12T16:10:51.674 INFO:tasks.workunit.client.1.smithi134.stdout:1/579: fdatasync d0/d16/d9/d13/d21/d20/f44 0 2024-03-12T16:10:51.674 INFO:tasks.workunit.client.1.smithi134.stdout:6/816: dread d1/fb2 [0,4194304] 0 2024-03-12T16:10:51.675 INFO:tasks.workunit.client.0.smithi006.stdout:0/604: dread d2/d6/d10/f75 [0,4194304] 0 2024-03-12T16:10:51.677 INFO:tasks.workunit.client.1.smithi134.stdout:8/783: unlink d3/d1b/d17/d25/ffa 0 2024-03-12T16:10:51.679 INFO:tasks.workunit.client.1.smithi134.stdout:0/757: creat db/d2f/d31/d56/d66/fef x:0 0 0 2024-03-12T16:10:51.680 INFO:tasks.workunit.client.1.smithi134.stdout:0/758: chown db/d2f/fd8 1858212 1 2024-03-12T16:10:51.681 INFO:tasks.workunit.client.0.smithi006.stdout:0/605: dwrite d2/d39/f40 [0,4194304] 0 2024-03-12T16:10:51.686 INFO:tasks.workunit.client.0.smithi006.stdout:0/606: creat d2/d6/fb6 x:0 0 0 2024-03-12T16:10:51.687 INFO:tasks.workunit.client.1.smithi134.stdout:1/580: mknod d0/d16/d9/d13/d21/d5f/d6f/cc7 0 2024-03-12T16:10:51.687 INFO:tasks.workunit.client.1.smithi134.stdout:8/784: read - d3/db0/fe3 zero size 2024-03-12T16:10:51.688 INFO:tasks.workunit.client.0.smithi006.stdout:0/607: rename d2/f65 to d2/d39/d42/d82/fb7 0 2024-03-12T16:10:51.689 INFO:tasks.workunit.client.0.smithi006.stdout:0/608: readlink d2/d6/d10/l5b 0 2024-03-12T16:10:51.689 INFO:tasks.workunit.client.1.smithi134.stdout:0/759: creat db/d2f/d31/d56/dbc/ff0 x:0 0 0 2024-03-12T16:10:51.699 INFO:tasks.workunit.client.0.smithi006.stdout:0/609: truncate d2/d6/f72 572882 0 2024-03-12T16:10:51.699 INFO:tasks.workunit.client.0.smithi006.stdout:0/610: write f0 [972715,11132] 0 2024-03-12T16:10:51.702 INFO:tasks.workunit.client.0.smithi006.stdout:0/611: mknod d2/d6/d10/d11/d32/cb8 0 2024-03-12T16:10:51.704 INFO:tasks.workunit.client.0.smithi006.stdout:0/612: creat d2/d6/d10/d11/d7e/da6/d9e/fb9 x:0 0 0 2024-03-12T16:10:51.706 INFO:tasks.workunit.client.0.smithi006.stdout:0/613: rmdir d2/d6/d10/d11/d1d 39 2024-03-12T16:10:51.712 INFO:tasks.workunit.client.0.smithi006.stdout:0/614: write d2/d6/d10/d11/d7e/da6/f9a [406472,51229] 0 2024-03-12T16:10:51.714 INFO:tasks.workunit.client.0.smithi006.stdout:0/615: mknod d2/d6/d10/d11/d7e/da6/d9e/cba 0 2024-03-12T16:10:51.715 INFO:tasks.workunit.client.0.smithi006.stdout:0/616: truncate d2/d6/d10/d11/f84 869780 0 2024-03-12T16:10:51.722 INFO:tasks.workunit.client.1.smithi134.stdout:1/581: symlink d0/d16/d9/d51/db7/dbb/lc8 0 2024-03-12T16:10:51.723 INFO:tasks.workunit.client.0.smithi006.stdout:0/617: dwrite d2/d6/d10/d11/d32/f3a [4194304,4194304] 0 2024-03-12T16:10:51.725 INFO:tasks.workunit.client.1.smithi134.stdout:4/755: write d1/d13/d49/d64/f7d [5934134,1879] 0 2024-03-12T16:10:51.726 INFO:tasks.workunit.client.0.smithi006.stdout:0/618: write d2/d39/d42/f68 [3407763,115598] 0 2024-03-12T16:10:51.726 INFO:tasks.workunit.client.1.smithi134.stdout:9/783: write d5/f28 [3855211,119528] 0 2024-03-12T16:10:51.729 INFO:tasks.workunit.client.1.smithi134.stdout:0/760: mkdir db/d2f/d51/db4/df1 0 2024-03-12T16:10:51.731 INFO:tasks.workunit.client.0.smithi006.stdout:0/619: rename d2/d6/d37/db4 to d2/d6/d37/d97/dbb 0 2024-03-12T16:10:51.732 INFO:tasks.workunit.client.0.smithi006.stdout:0/620: write d2/d6/d10/d11/d32/f3a [211996,129497] 0 2024-03-12T16:10:51.736 INFO:tasks.workunit.client.0.smithi006.stdout:0/621: creat d2/d6/d10/d11/d32/da4/db5/fbc x:0 0 0 2024-03-12T16:10:51.736 INFO:tasks.workunit.client.1.smithi134.stdout:1/582: fsync d0/d16/d9/d13/d38/f75 0 2024-03-12T16:10:51.736 INFO:tasks.workunit.client.1.smithi134.stdout:4/756: chown d1/d13/d49/d64/d28/f5e 537728 1 2024-03-12T16:10:51.736 INFO:tasks.workunit.client.1.smithi134.stdout:9/784: fsync d5/d20/f52 0 2024-03-12T16:10:51.736 INFO:tasks.workunit.client.1.smithi134.stdout:0/761: chown db/d2f/d61/d6c/l91 14862 1 2024-03-12T16:10:51.737 INFO:tasks.workunit.client.1.smithi134.stdout:7/828: dwrite d8/dc/f54 [0,4194304] 0 2024-03-12T16:10:51.737 INFO:tasks.workunit.client.1.smithi134.stdout:9/785: stat d5/d10/d33/da1 0 2024-03-12T16:10:51.738 INFO:tasks.workunit.client.0.smithi006.stdout:0/622: symlink d2/d6/d10/d11/d1d/d2e/lbd 0 2024-03-12T16:10:51.741 INFO:tasks.workunit.client.0.smithi006.stdout:0/623: mkdir d2/d6/d10/d11/d7e/dbe 0 2024-03-12T16:10:51.742 INFO:tasks.workunit.client.1.smithi134.stdout:5/956: dread db/d12/d1d/d59/d94/fb0 [4194304,4194304] 0 2024-03-12T16:10:51.743 INFO:tasks.workunit.client.1.smithi134.stdout:7/829: write d8/d4e/f89 [2686046,102963] 0 2024-03-12T16:10:51.745 INFO:tasks.workunit.client.1.smithi134.stdout:0/762: symlink db/d2f/d31/d68/d70/lf2 0 2024-03-12T16:10:51.746 INFO:tasks.workunit.client.1.smithi134.stdout:8/785: dwrite d3/d1b/f19 [0,4194304] 0 2024-03-12T16:10:51.750 INFO:tasks.workunit.client.0.smithi006.stdout:0/624: chown d2/d6/d10/d11/d1d/d2e/l61 8 1 2024-03-12T16:10:51.752 INFO:tasks.workunit.client.0.smithi006.stdout:0/625: fsync d2/d6/d10/d11/d32/f4a 0 2024-03-12T16:10:51.753 INFO:tasks.workunit.client.1.smithi134.stdout:4/757: dread d1/d13/d49/d64/d28/d4f/f9c [0,4194304] 0 2024-03-12T16:10:51.754 INFO:tasks.workunit.client.0.smithi006.stdout:0/626: fsync d2/d6/d10/d11/d1d/d79/f95 0 2024-03-12T16:10:51.754 INFO:tasks.workunit.client.1.smithi134.stdout:4/758: readlink d1/d13/l46 0 2024-03-12T16:10:51.754 INFO:tasks.workunit.client.1.smithi134.stdout:7/830: fdatasync d8/dc/d4b/fb5 0 2024-03-12T16:10:51.755 INFO:tasks.workunit.client.0.smithi006.stdout:0/627: truncate d2/d6/fb3 244159 0 2024-03-12T16:10:51.755 INFO:tasks.workunit.client.1.smithi134.stdout:0/763: mkdir db/d2f/d31/d56/dbc/df3 0 2024-03-12T16:10:51.756 INFO:tasks.workunit.client.1.smithi134.stdout:8/786: rename d3/d1b/ff9 to d3/d82/d104/f10e 0 2024-03-12T16:10:51.756 INFO:tasks.workunit.client.1.smithi134.stdout:4/759: stat d1/d13/d49/d64/da3/dab/cd4 0 2024-03-12T16:10:51.759 INFO:tasks.workunit.client.0.smithi006.stdout:0/628: getdents d2/d6/d10/d11/d32 0 2024-03-12T16:10:51.761 INFO:tasks.workunit.client.1.smithi134.stdout:7/831: creat d8/d27/d5b/f112 x:0 0 0 2024-03-12T16:10:51.762 INFO:tasks.workunit.client.0.smithi006.stdout:0/629: creat d2/d6/d10/d11/d7e/dbe/fbf x:0 0 0 2024-03-12T16:10:51.763 INFO:tasks.workunit.client.1.smithi134.stdout:0/764: mkdir db/d2f/d31/df4 0 2024-03-12T16:10:51.763 INFO:tasks.workunit.client.1.smithi134.stdout:9/786: dwrite d5/d10/d35/d49/d54/d5e/d82/f8e [4194304,4194304] 0 2024-03-12T16:10:51.764 INFO:tasks.workunit.client.0.smithi006.stdout:0/630: truncate d2/f74 290907 0 2024-03-12T16:10:51.764 INFO:tasks.workunit.client.1.smithi134.stdout:5/957: getdents db/d12/d1d/d128/d73 0 2024-03-12T16:10:51.766 INFO:tasks.workunit.client.1.smithi134.stdout:0/765: fdatasync db/d2f/d61/fe8 0 2024-03-12T16:10:51.768 INFO:tasks.workunit.client.1.smithi134.stdout:7/832: creat d8/dc/d20/d26/d10e/f113 x:0 0 0 2024-03-12T16:10:51.769 INFO:tasks.workunit.client.1.smithi134.stdout:4/760: rmdir d1/de/d90/dc9 0 2024-03-12T16:10:51.770 INFO:tasks.workunit.client.1.smithi134.stdout:0/766: readlink db/d2f/d31/d56/d66/l8d 0 2024-03-12T16:10:51.772 INFO:tasks.workunit.client.1.smithi134.stdout:7/833: write d8/ff [1370225,87470] 0 2024-03-12T16:10:51.774 INFO:tasks.workunit.client.0.smithi006.stdout:0/631: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:51.775 INFO:tasks.workunit.client.1.smithi134.stdout:8/787: dwrite d3/d1b/d17/d3f/ffb [0,4194304] 0 2024-03-12T16:10:51.775 INFO:tasks.workunit.client.1.smithi134.stdout:9/787: creat d5/d10/d51/dad/fdf x:0 0 0 2024-03-12T16:10:51.777 INFO:tasks.workunit.client.0.smithi006.stdout:0/632: symlink d2/d6/d37/d97/lc0 0 2024-03-12T16:10:51.777 INFO:tasks.workunit.client.1.smithi134.stdout:4/761: fsync d1/d24/d34/d8e/f98 0 2024-03-12T16:10:51.778 INFO:tasks.workunit.client.0.smithi006.stdout:0/633: dread - d2/d39/f63 zero size 2024-03-12T16:10:51.780 INFO:tasks.workunit.client.0.smithi006.stdout:0/634: write d2/d39/f99 [155017,106470] 0 2024-03-12T16:10:51.780 INFO:tasks.workunit.client.1.smithi134.stdout:7/834: creat d8/dc/d20/d26/d36/f114 x:0 0 0 2024-03-12T16:10:51.783 INFO:tasks.workunit.client.1.smithi134.stdout:5/958: dread db/d12/d1d/d5c/fc8 [0,4194304] 0 2024-03-12T16:10:51.785 INFO:tasks.workunit.client.1.smithi134.stdout:0/767: rename db/d2f/d31/d68/d70/dc7/fdb to db/d2f/d31/d68/d70/dc7/ff5 0 2024-03-12T16:10:51.787 INFO:tasks.workunit.client.0.smithi006.stdout:0/635: fsync d2/d6/d10/d11/d1d/d2e/f33 0 2024-03-12T16:10:51.789 INFO:tasks.workunit.client.1.smithi134.stdout:9/788: rmdir d5/d10/d35/d49/d54/d5e/dab 39 2024-03-12T16:10:51.790 INFO:tasks.workunit.client.0.smithi006.stdout:0/636: getdents d2/d6/d10/d11/d1d/d79 0 2024-03-12T16:10:51.791 INFO:tasks.workunit.client.0.smithi006.stdout:0/637: symlink d2/d39/lc1 0 2024-03-12T16:10:51.792 INFO:tasks.workunit.client.0.smithi006.stdout:0/638: dread - d2/d6/fb6 zero size 2024-03-12T16:10:51.794 INFO:tasks.workunit.client.0.smithi006.stdout:0/639: creat d2/d6/d10/d11/d32/fc2 x:0 0 0 2024-03-12T16:10:51.795 INFO:tasks.workunit.client.1.smithi134.stdout:7/835: read d8/dc/d20/f56 [323380,7591] 0 2024-03-12T16:10:51.796 INFO:tasks.workunit.client.0.smithi006.stdout:0/640: creat d2/d6/d10/d11/d7e/dbe/fc3 x:0 0 0 2024-03-12T16:10:51.797 INFO:tasks.workunit.client.1.smithi134.stdout:5/959: dwrite db/d7a/d97/fd0 [0,4194304] 0 2024-03-12T16:10:51.797 INFO:tasks.workunit.client.1.smithi134.stdout:9/789: creat d5/d10/d35/fe0 x:0 0 0 2024-03-12T16:10:51.798 INFO:tasks.workunit.client.0.smithi006.stdout:0/641: creat d2/fc4 x:0 0 0 2024-03-12T16:10:51.799 INFO:tasks.workunit.client.1.smithi134.stdout:0/768: mknod db/d2f/d61/d67/cf6 0 2024-03-12T16:10:51.802 INFO:tasks.workunit.client.0.smithi006.stdout:0/642: link d2/d6/d10/d11/d32/f38 d2/d6/d10/d11/d7e/da6/d9e/fc5 0 2024-03-12T16:10:51.802 INFO:tasks.workunit.client.1.smithi134.stdout:7/836: creat d8/dc/d20/d26/f115 x:0 0 0 2024-03-12T16:10:51.803 INFO:tasks.workunit.client.1.smithi134.stdout:4/762: dread d1/d13/f1d [0,4194304] 0 2024-03-12T16:10:51.803 INFO:tasks.workunit.client.1.smithi134.stdout:7/837: readlink d8/dc/l6e 0 2024-03-12T16:10:51.803 INFO:tasks.workunit.client.0.smithi006.stdout:0/643: fsync d2/d6/d10/d11/d32/fa7 0 2024-03-12T16:10:51.804 INFO:tasks.workunit.client.1.smithi134.stdout:7/838: chown d8/d4e/d91/ca8 0 1 2024-03-12T16:10:51.805 INFO:tasks.workunit.client.0.smithi006.stdout:0/644: symlink d2/d6/d10/d11/d7e/dbe/lc6 0 2024-03-12T16:10:51.805 INFO:tasks.workunit.client.1.smithi134.stdout:5/960: creat db/d12/d1d/d59/de5/f12a x:0 0 0 2024-03-12T16:10:51.806 INFO:tasks.workunit.client.1.smithi134.stdout:0/769: mknod db/d2f/d61/d94/cf7 0 2024-03-12T16:10:51.807 INFO:tasks.workunit.client.0.smithi006.stdout:0/645: creat d2/d6/d10/d11/d32/da4/fc7 x:0 0 0 2024-03-12T16:10:51.808 INFO:tasks.workunit.client.1.smithi134.stdout:5/961: chown db/d12/d1d/d3a/d49/fbe 254297 1 2024-03-12T16:10:51.809 INFO:tasks.workunit.client.1.smithi134.stdout:7/839: fsync d8/dc/d4b/dd9/df4/f35 0 2024-03-12T16:10:51.809 INFO:tasks.workunit.client.0.smithi006.stdout:0/646: write d2/d6/d10/d11/d1d/d2e/f33 [1435679,120166] 0 2024-03-12T16:10:51.811 INFO:tasks.workunit.client.0.smithi006.stdout:0/647: chown d2/d6/d10/d11/d7e/da6/f80 16305549 1 2024-03-12T16:10:51.812 INFO:tasks.workunit.client.1.smithi134.stdout:4/763: symlink d1/dbc/lee 0 2024-03-12T16:10:51.814 INFO:tasks.workunit.client.1.smithi134.stdout:8/788: dwrite d3/d1b/d17/d24/db6/dd9/fcd [0,4194304] 0 2024-03-12T16:10:51.815 INFO:tasks.workunit.client.1.smithi134.stdout:4/764: readlink d1/de/d5a/d70/l9b 0 2024-03-12T16:10:51.815 INFO:tasks.workunit.client.1.smithi134.stdout:9/790: creat d5/d10/d35/d49/d54/d5e/fe1 x:0 0 0 2024-03-12T16:10:51.817 INFO:tasks.workunit.client.1.smithi134.stdout:4/765: readlink d1/d24/ddd/le6 0 2024-03-12T16:10:51.818 INFO:tasks.workunit.client.1.smithi134.stdout:9/791: fdatasync d5/d10/d33/fbe 0 2024-03-12T16:10:51.819 INFO:tasks.workunit.client.1.smithi134.stdout:0/770: getdents db/d2f/d71 0 2024-03-12T16:10:51.820 INFO:tasks.workunit.client.1.smithi134.stdout:0/771: chown db/d2f/d31/d76 1 1 2024-03-12T16:10:51.821 INFO:tasks.workunit.client.0.smithi006.stdout:0/648: truncate d2/fd 2380223 0 2024-03-12T16:10:51.822 INFO:tasks.workunit.client.1.smithi134.stdout:8/789: truncate d3/d1b/d17/d25/d33/d85/fdd 1002181 0 2024-03-12T16:10:51.824 INFO:tasks.workunit.client.0.smithi006.stdout:0/649: creat d2/d39/fc8 x:0 0 0 2024-03-12T16:10:51.825 INFO:tasks.workunit.client.0.smithi006.stdout:0/650: readlink d2/d6/d10/d11/d1d/l5a 0 2024-03-12T16:10:51.827 INFO:tasks.workunit.client.1.smithi134.stdout:9/792: truncate d5/d10/d51/fc3 60379 0 2024-03-12T16:10:51.829 INFO:tasks.workunit.client.1.smithi134.stdout:7/840: truncate d8/dc/d7b/dbb/f109 3453741 0 2024-03-12T16:10:51.832 INFO:tasks.workunit.client.1.smithi134.stdout:5/962: dread db/d12/d1d/d3a/d4e/f55 [0,4194304] 0 2024-03-12T16:10:51.833 INFO:tasks.workunit.client.1.smithi134.stdout:0/772: rmdir db/d2f/d31/d56/dbc/df3 0 2024-03-12T16:10:51.835 INFO:tasks.workunit.client.1.smithi134.stdout:4/766: rename d1/ld5 to d1/d24/lef 0 2024-03-12T16:10:51.836 INFO:tasks.workunit.client.1.smithi134.stdout:8/790: dwrite d3/d1b/d17/d45/fc4 [0,4194304] 0 2024-03-12T16:10:51.839 INFO:tasks.workunit.client.0.smithi006.stdout:0/651: dwrite d2/d6/d10/d11/d32/f4a [0,4194304] 0 2024-03-12T16:10:51.842 INFO:tasks.workunit.client.0.smithi006.stdout:0/652: mkdir d2/d88/dc9 0 2024-03-12T16:10:51.847 INFO:tasks.workunit.client.0.smithi006.stdout:0/653: write d2/d6/d10/d11/d1d/d2e/f33 [1850747,71771] 0 2024-03-12T16:10:51.847 INFO:tasks.workunit.client.1.smithi134.stdout:7/841: link d8/d4e/d91/ca8 d8/dc/d4b/c116 0 2024-03-12T16:10:51.850 INFO:tasks.workunit.client.1.smithi134.stdout:0/773: creat db/d2f/d31/d75/ff8 x:0 0 0 2024-03-12T16:10:51.852 INFO:tasks.workunit.client.1.smithi134.stdout:8/791: write d3/d1b/d17/d25/d49/f75 [459384,65789] 0 2024-03-12T16:10:51.852 INFO:tasks.workunit.client.1.smithi134.stdout:9/793: dread d5/d10/d35/d49/d74/fde [0,4194304] 0 2024-03-12T16:10:51.854 INFO:tasks.workunit.client.1.smithi134.stdout:4/767: mkdir d1/d13/df0 0 2024-03-12T16:10:51.858 INFO:tasks.workunit.client.1.smithi134.stdout:8/792: rename d3/d1b/l36 to d3/d1b/d17/d25/d49/d94/l10f 0 2024-03-12T16:10:51.859 INFO:tasks.workunit.client.1.smithi134.stdout:4/768: fdatasync d1/d13/d49/d64/d28/d4f/f9c 0 2024-03-12T16:10:51.860 INFO:tasks.workunit.client.1.smithi134.stdout:8/793: fsync d3/d1b/d17/d25/d33/d85/fdd 0 2024-03-12T16:10:51.860 INFO:tasks.workunit.client.1.smithi134.stdout:9/794: mkdir d5/d10/d35/d49/d54/de2 0 2024-03-12T16:10:51.864 INFO:tasks.workunit.client.1.smithi134.stdout:9/795: creat d5/d20/d47/fe3 x:0 0 0 2024-03-12T16:10:51.867 INFO:tasks.workunit.client.1.smithi134.stdout:8/794: rmdir d3/d1b/d17/d25/d33/d15/d95/d5b 39 2024-03-12T16:10:51.867 INFO:tasks.workunit.client.1.smithi134.stdout:0/774: dwrite db/d2f/d31/d68/da2/db2/fd7 [0,4194304] 0 2024-03-12T16:10:51.870 INFO:tasks.workunit.client.1.smithi134.stdout:5/963: dread db/d12/d1d/d5c/f65 [0,4194304] 0 2024-03-12T16:10:51.873 INFO:tasks.workunit.client.1.smithi134.stdout:5/964: stat db/d12/d1d/d128/d73/fe3 0 2024-03-12T16:10:51.873 INFO:tasks.workunit.client.1.smithi134.stdout:7/842: dwrite d8/d4e/dca/fe1 [0,4194304] 0 2024-03-12T16:10:51.875 INFO:tasks.workunit.client.1.smithi134.stdout:7/843: stat d8/dc/d7b 0 2024-03-12T16:10:51.880 INFO:tasks.workunit.client.1.smithi134.stdout:9/796: dwrite d5/d20/f2b [4194304,4194304] 0 2024-03-12T16:10:51.890 INFO:tasks.workunit.client.1.smithi134.stdout:0/775: unlink db/d2f/fd8 0 2024-03-12T16:10:51.948 INFO:tasks.workunit.client.1.smithi134.stdout:2/769: sync 2024-03-12T16:10:51.962 INFO:tasks.workunit.client.1.smithi134.stdout:7/844: truncate d8/dc/d55/d57/f9a 564953 0 2024-03-12T16:10:51.963 INFO:tasks.workunit.client.1.smithi134.stdout:9/797: chown d5/d10/d1f/l30 181372856 1 2024-03-12T16:10:51.964 INFO:tasks.workunit.client.1.smithi134.stdout:0/776: mkdir db/d2f/d31/d76/df9 0 2024-03-12T16:10:51.967 INFO:tasks.workunit.client.1.smithi134.stdout:5/965: mkdir db/d12/d1d/d128/db4/db9/ddf/d103/d120/df0/d12b 0 2024-03-12T16:10:51.969 INFO:tasks.workunit.client.1.smithi134.stdout:7/845: rmdir d8/dc/d20/d26 39 2024-03-12T16:10:51.970 INFO:tasks.workunit.client.1.smithi134.stdout:8/795: dwrite d3/d1b/d17/d25/d33/f6b [0,4194304] 0 2024-03-12T16:10:51.973 INFO:tasks.workunit.client.1.smithi134.stdout:0/777: creat db/d2f/d51/db4/ffa x:0 0 0 2024-03-12T16:10:51.974 INFO:tasks.workunit.client.1.smithi134.stdout:2/770: mkdir d4/d12/d3b/d3f/d114/d117 0 2024-03-12T16:10:51.975 INFO:tasks.workunit.client.1.smithi134.stdout:2/771: chown d4/d12/d3b/d3f/d10a 463845 1 2024-03-12T16:10:51.980 INFO:tasks.workunit.client.1.smithi134.stdout:9/798: rename d5/d10/d51/lb8 to d5/d20/le4 0 2024-03-12T16:10:51.983 INFO:tasks.workunit.client.1.smithi134.stdout:2/772: creat d4/d12/d3b/d3f/d114/d117/f118 x:0 0 0 2024-03-12T16:10:51.985 INFO:tasks.workunit.client.1.smithi134.stdout:8/796: link d3/d1b/d17/d25/d33/d15/d95/f32 d3/d1b/d17/d25/d33/d15/f110 0 2024-03-12T16:10:51.987 INFO:tasks.workunit.client.1.smithi134.stdout:9/799: symlink d5/d20/d47/ddd/le5 0 2024-03-12T16:10:51.989 INFO:tasks.workunit.client.1.smithi134.stdout:0/778: getdents db/d2f/d31/d76/d9f 0 2024-03-12T16:10:51.992 INFO:tasks.workunit.client.1.smithi134.stdout:7/846: write d8/d27/d9d/f86 [1059016,71433] 0 2024-03-12T16:10:51.993 INFO:tasks.workunit.client.1.smithi134.stdout:0/779: dread - db/d2f/d31/d75/d88/fe1 zero size 2024-03-12T16:10:51.996 INFO:tasks.workunit.client.1.smithi134.stdout:8/797: dwrite d3/d1b/f14 [0,4194304] 0 2024-03-12T16:10:51.996 INFO:tasks.workunit.client.1.smithi134.stdout:9/800: truncate d5/d10/d1f/fbc 257865 0 2024-03-12T16:10:51.996 INFO:tasks.workunit.client.1.smithi134.stdout:2/773: write d4/d12/d3b/d3f/f5d [3157693,67553] 0 2024-03-12T16:10:52.006 INFO:tasks.workunit.client.1.smithi134.stdout:9/801: mkdir d5/d10/d35/d49/d54/d5e/dab/de6 0 2024-03-12T16:10:52.007 INFO:tasks.workunit.client.1.smithi134.stdout:7/847: rename d8/d27/d5b/ce5 to d8/dc/d7b/c117 0 2024-03-12T16:10:52.008 INFO:tasks.workunit.client.1.smithi134.stdout:8/798: truncate d3/d1b/d17/d25/d33/d96/dbd/f108 833768 0 2024-03-12T16:10:52.009 INFO:tasks.workunit.client.1.smithi134.stdout:2/774: dwrite d4/d12/d3b/d3f/f45 [0,4194304] 0 2024-03-12T16:10:52.011 INFO:tasks.workunit.client.1.smithi134.stdout:9/802: chown d5/d10/d1f/c38 1845086 1 2024-03-12T16:10:52.011 INFO:tasks.workunit.client.1.smithi134.stdout:7/848: fsync d8/d27/f46 0 2024-03-12T16:10:52.012 INFO:tasks.workunit.client.1.smithi134.stdout:9/803: rmdir d5/d20/d47 39 2024-03-12T16:10:52.017 INFO:tasks.workunit.client.1.smithi134.stdout:8/799: dread d3/d1b/d17/d25/f101 [0,4194304] 0 2024-03-12T16:10:52.019 INFO:tasks.workunit.client.1.smithi134.stdout:0/780: dwrite db/f6e [0,4194304] 0 2024-03-12T16:10:52.021 INFO:tasks.workunit.client.1.smithi134.stdout:2/775: unlink d4/d12/d1d/d34/d47/f7e 0 2024-03-12T16:10:52.025 INFO:tasks.workunit.client.1.smithi134.stdout:0/781: mkdir db/d2f/d31/d56/dbc/dfb 0 2024-03-12T16:10:52.031 INFO:tasks.workunit.client.1.smithi134.stdout:8/800: creat d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/f111 x:0 0 0 2024-03-12T16:10:52.034 INFO:tasks.workunit.client.1.smithi134.stdout:9/804: getdents d5/d10/d33/da1 0 2024-03-12T16:10:52.035 INFO:tasks.workunit.client.1.smithi134.stdout:7/849: write d8/dc/d20/d26/f3a [142911,54706] 0 2024-03-12T16:10:52.035 INFO:tasks.workunit.client.1.smithi134.stdout:7/850: chown d8/dc/d4b/dd9 989 1 2024-03-12T16:10:52.036 INFO:tasks.workunit.client.1.smithi134.stdout:2/776: write d4/d84/d63/d9d/dba/fc2 [2033143,24673] 0 2024-03-12T16:10:52.037 INFO:tasks.workunit.client.1.smithi134.stdout:7/851: stat d8/dc/d55/d81/d87/ld8 0 2024-03-12T16:10:52.038 INFO:tasks.workunit.client.1.smithi134.stdout:8/801: rename d3/d82/d104/de5 to d3/d1b/d17/d25/d33/d96/dbd/d112 0 2024-03-12T16:10:52.041 INFO:tasks.workunit.client.1.smithi134.stdout:2/777: symlink d4/d12/daf/l119 0 2024-03-12T16:10:52.042 INFO:tasks.workunit.client.1.smithi134.stdout:2/778: write d4/d84/d63/d9d/f4b [3693512,73755] 0 2024-03-12T16:10:52.042 INFO:tasks.workunit.client.1.smithi134.stdout:0/782: link db/d2f/l7e db/d2f/d61/lfc 0 2024-03-12T16:10:52.044 INFO:tasks.workunit.client.1.smithi134.stdout:9/805: mknod d5/d10/d1f/dd5/ce7 0 2024-03-12T16:10:52.049 INFO:tasks.workunit.client.1.smithi134.stdout:8/802: creat d3/d1b/d17/d25/d33/d15/d95/d10d/f113 x:0 0 0 2024-03-12T16:10:52.052 INFO:tasks.workunit.client.1.smithi134.stdout:9/806: mknod d5/d10/d35/d49/ce8 0 2024-03-12T16:10:52.056 INFO:tasks.workunit.client.1.smithi134.stdout:8/803: dread d3/d1b/d17/d25/d33/f6b [0,4194304] 0 2024-03-12T16:10:52.057 INFO:tasks.workunit.client.1.smithi134.stdout:2/779: write d4/d84/d63/d9d/f94 [341534,19918] 0 2024-03-12T16:10:52.058 INFO:tasks.workunit.client.1.smithi134.stdout:0/783: write db/f14 [1518529,69071] 0 2024-03-12T16:10:52.060 INFO:tasks.workunit.client.1.smithi134.stdout:9/807: write d5/d10/d35/d49/d54/d5e/dab/fbd [854137,60552] 0 2024-03-12T16:10:52.063 INFO:tasks.workunit.client.1.smithi134.stdout:7/852: dwrite d8/dc/d4b/dd9/fe3 [0,4194304] 0 2024-03-12T16:10:52.063 INFO:tasks.workunit.client.1.smithi134.stdout:2/780: symlink d4/de8/dea/l11a 0 2024-03-12T16:10:52.065 INFO:tasks.workunit.client.1.smithi134.stdout:0/784: mknod db/dcc/cfd 0 2024-03-12T16:10:52.070 INFO:tasks.workunit.client.1.smithi134.stdout:9/808: mknod d5/d10/d35/d49/d54/d88/ce9 0 2024-03-12T16:10:52.070 INFO:tasks.workunit.client.1.smithi134.stdout:8/804: mkdir d3/d1b/d17/d25/d33/d15/d114 0 2024-03-12T16:10:52.070 INFO:tasks.workunit.client.1.smithi134.stdout:9/809: write d5/d10/f81 [5207764,45494] 0 2024-03-12T16:10:52.071 INFO:tasks.workunit.client.1.smithi134.stdout:7/853: dread - d8/d4e/f8b zero size 2024-03-12T16:10:52.071 INFO:tasks.workunit.client.1.smithi134.stdout:8/805: chown d3/d82/d104 13717 1 2024-03-12T16:10:52.071 INFO:tasks.workunit.client.1.smithi134.stdout:8/806: chown d3/d1b/d17/d24/d28 326 1 2024-03-12T16:10:52.071 INFO:tasks.workunit.client.1.smithi134.stdout:2/781: creat d4/de8/dea/d105/f11b x:0 0 0 2024-03-12T16:10:52.073 INFO:tasks.workunit.client.1.smithi134.stdout:0/785: mknod db/d2f/d31/d56/dbc/dfb/cfe 0 2024-03-12T16:10:52.073 INFO:tasks.workunit.client.1.smithi134.stdout:7/854: symlink d8/dc/d4b/dd9/l118 0 2024-03-12T16:10:52.074 INFO:tasks.workunit.client.1.smithi134.stdout:8/807: rmdir d3/d1b/d17 39 2024-03-12T16:10:52.075 INFO:tasks.workunit.client.1.smithi134.stdout:6/817: sync 2024-03-12T16:10:52.075 INFO:tasks.workunit.client.1.smithi134.stdout:2/782: mknod d4/d12/c11c 0 2024-03-12T16:10:52.076 INFO:tasks.workunit.client.1.smithi134.stdout:1/583: sync 2024-03-12T16:10:52.076 INFO:tasks.workunit.client.1.smithi134.stdout:9/810: creat d5/fea x:0 0 0 2024-03-12T16:10:52.077 INFO:tasks.workunit.client.1.smithi134.stdout:6/818: fdatasync d1/da6/f84 0 2024-03-12T16:10:52.078 INFO:tasks.workunit.client.1.smithi134.stdout:9/811: chown d5/d10/d35/f73 1226 1 2024-03-12T16:10:52.080 INFO:tasks.workunit.client.1.smithi134.stdout:9/812: write d5/d10/d6c/fd9 [1349797,39175] 0 2024-03-12T16:10:52.081 INFO:tasks.workunit.client.1.smithi134.stdout:2/783: mkdir d4/d84/d7d/d87/d11d 0 2024-03-12T16:10:52.082 INFO:tasks.workunit.client.1.smithi134.stdout:6/819: creat d1/da6/d55/d94/d127/d32/f133 x:0 0 0 2024-03-12T16:10:52.083 INFO:tasks.workunit.client.1.smithi134.stdout:0/786: creat db/d2f/d31/d68/da2/dd3/de5/fff x:0 0 0 2024-03-12T16:10:52.084 INFO:tasks.workunit.client.1.smithi134.stdout:1/584: mkdir d0/d42/d47/dc9 0 2024-03-12T16:10:52.084 INFO:tasks.workunit.client.1.smithi134.stdout:7/855: getdents d8/d4e/da2/d108 0 2024-03-12T16:10:52.085 INFO:tasks.workunit.client.1.smithi134.stdout:6/820: rmdir d1/d16/d100 39 2024-03-12T16:10:52.088 INFO:tasks.workunit.client.1.smithi134.stdout:1/585: write d0/d16/d9/d13/d38/f41 [839622,4320] 0 2024-03-12T16:10:52.088 INFO:tasks.workunit.client.1.smithi134.stdout:9/813: creat d5/d10/d35/d49/d54/dc6/feb x:0 0 0 2024-03-12T16:10:52.090 INFO:tasks.workunit.client.1.smithi134.stdout:2/784: creat d4/d84/d63/d9d/d3d/f11e x:0 0 0 2024-03-12T16:10:52.092 INFO:tasks.workunit.client.1.smithi134.stdout:6/821: creat d1/da6/d55/d97/dfd/f134 x:0 0 0 2024-03-12T16:10:52.092 INFO:tasks.workunit.client.1.smithi134.stdout:7/856: stat d8/dc/d20/d26/d36/leb 0 2024-03-12T16:10:52.094 INFO:tasks.workunit.client.1.smithi134.stdout:7/857: readlink d8/dc/d4b/dd9/df4/l6f 0 2024-03-12T16:10:52.095 INFO:tasks.workunit.client.1.smithi134.stdout:7/858: readlink d8/dc/d7b/dbb/dbd/ldd 0 2024-03-12T16:10:52.100 INFO:tasks.workunit.client.1.smithi134.stdout:6/822: dread d1/d16/d4c/ff4 [0,4194304] 0 2024-03-12T16:10:52.100 INFO:tasks.workunit.client.1.smithi134.stdout:8/808: write d3/d1b/d17/d25/d33/d15/d95/d5b/f8e [3945219,68918] 0 2024-03-12T16:10:52.103 INFO:tasks.workunit.client.1.smithi134.stdout:8/809: fsync d3/d1b/d17/d25/d33/d96/fa4 0 2024-03-12T16:10:52.104 INFO:tasks.workunit.client.1.smithi134.stdout:0/787: dread db/d2f/d31/d76/f93 [0,4194304] 0 2024-03-12T16:10:52.104 INFO:tasks.workunit.client.1.smithi134.stdout:9/814: link d5/d10/d35/d49/d54/d5e/ccb d5/d10/d1f/dd5/cec 0 2024-03-12T16:10:52.104 INFO:tasks.workunit.client.1.smithi134.stdout:6/823: write d1/d4/f42 [3234626,127886] 0 2024-03-12T16:10:52.105 INFO:tasks.workunit.client.1.smithi134.stdout:7/859: mkdir d8/dc/d7b/d119 0 2024-03-12T16:10:52.107 INFO:tasks.workunit.client.1.smithi134.stdout:7/860: stat d8/dc/d20/d26/d36/f64 0 2024-03-12T16:10:52.108 INFO:tasks.workunit.client.1.smithi134.stdout:9/815: mknod d5/d10/d51/ced 0 2024-03-12T16:10:52.109 INFO:tasks.workunit.client.1.smithi134.stdout:2/785: truncate d4/f90 1147024 0 2024-03-12T16:10:52.110 INFO:tasks.workunit.client.1.smithi134.stdout:0/788: mknod db/d2f/d71/c100 0 2024-03-12T16:10:52.111 INFO:tasks.workunit.client.1.smithi134.stdout:8/810: read - d3/d1b/d17/d25/d33/d96/fca zero size 2024-03-12T16:10:52.111 INFO:tasks.workunit.client.1.smithi134.stdout:9/816: write d5/d10/f81 [5755910,13427] 0 2024-03-12T16:10:52.112 INFO:tasks.workunit.client.1.smithi134.stdout:6/824: write d1/da6/d55/d94/d127/f51 [1160600,119537] 0 2024-03-12T16:10:52.116 INFO:tasks.workunit.client.1.smithi134.stdout:2/786: chown d4/d84/d63/d9d/d3d/f11e 2126373105 1 2024-03-12T16:10:52.116 INFO:tasks.workunit.client.1.smithi134.stdout:1/586: dwrite d0/d16/d39/f9b [0,4194304] 0 2024-03-12T16:10:52.119 INFO:tasks.workunit.client.1.smithi134.stdout:6/825: creat d1/d16/d4c/d58/d115/f135 x:0 0 0 2024-03-12T16:10:52.119 INFO:tasks.workunit.client.1.smithi134.stdout:6/826: readlink d1/l12f 0 2024-03-12T16:10:52.121 INFO:tasks.workunit.client.1.smithi134.stdout:7/861: creat d8/dc/d20/d26/d10e/f11a x:0 0 0 2024-03-12T16:10:52.122 INFO:tasks.workunit.client.1.smithi134.stdout:9/817: mkdir d5/d46/dee 0 2024-03-12T16:10:52.123 INFO:tasks.workunit.client.1.smithi134.stdout:8/811: creat d3/d1b/d17/d25/d33/d96/dbd/f115 x:0 0 0 2024-03-12T16:10:52.124 INFO:tasks.workunit.client.1.smithi134.stdout:8/812: fsync d3/d1b/f1d 0 2024-03-12T16:10:52.125 INFO:tasks.workunit.client.1.smithi134.stdout:2/787: creat d4/d12/d3b/d9b/f11f x:0 0 0 2024-03-12T16:10:52.144 INFO:tasks.workunit.client.1.smithi134.stdout:8/813: dread d3/d1b/d17/d25/fd2 [0,4194304] 0 2024-03-12T16:10:52.166 INFO:tasks.workunit.client.1.smithi134.stdout:0/789: rmdir db 39 2024-03-12T16:10:52.167 INFO:tasks.workunit.client.1.smithi134.stdout:7/862: rmdir d8/dc/d55/d57 39 2024-03-12T16:10:52.168 INFO:tasks.workunit.client.1.smithi134.stdout:9/818: mkdir d5/d10/d35/d49/d8d/def 0 2024-03-12T16:10:52.170 INFO:tasks.workunit.client.1.smithi134.stdout:9/819: truncate d5/d10/d33/fb6 1226443 0 2024-03-12T16:10:52.178 INFO:tasks.workunit.client.1.smithi134.stdout:1/587: dread d0/d16/f29 [0,4194304] 0 2024-03-12T16:10:52.193 INFO:tasks.workunit.client.1.smithi134.stdout:1/588: dread d0/d16/d9/d13/d21/f23 [4194304,4194304] 0 2024-03-12T16:10:52.193 INFO:tasks.workunit.client.1.smithi134.stdout:1/589: readlink d0/l19 0 2024-03-12T16:10:52.215 INFO:tasks.workunit.client.1.smithi134.stdout:4/769: sync 2024-03-12T16:10:52.244 INFO:tasks.workunit.client.1.smithi134.stdout:9/820: creat d5/d10/d35/d49/d8d/ff0 x:0 0 0 2024-03-12T16:10:52.245 INFO:tasks.workunit.client.1.smithi134.stdout:1/590: read - d0/d30/d48/f80 zero size 2024-03-12T16:10:52.245 INFO:tasks.workunit.client.1.smithi134.stdout:4/770: rmdir d1/d13/d49/d64 39 2024-03-12T16:10:52.250 INFO:tasks.workunit.client.1.smithi134.stdout:0/790: dwrite db/d2f/d31/d56/d66/fef [0,4194304] 0 2024-03-12T16:10:52.255 INFO:tasks.workunit.client.1.smithi134.stdout:0/791: read db/f14 [5532267,107069] 0 2024-03-12T16:10:52.257 INFO:tasks.workunit.client.1.smithi134.stdout:7/863: dwrite d8/d4e/dca/fd7 [4194304,4194304] 0 2024-03-12T16:10:52.261 INFO:tasks.workunit.client.1.smithi134.stdout:8/814: dwrite d3/d1b/d17/d25/d33/d15/d95/d5b/fb9 [0,4194304] 0 2024-03-12T16:10:52.267 INFO:tasks.workunit.client.1.smithi134.stdout:0/792: dwrite db/f38 [0,4194304] 0 2024-03-12T16:10:52.278 INFO:tasks.workunit.client.1.smithi134.stdout:8/815: dread d3/d1b/d17/d25/d33/f34 [0,4194304] 0 2024-03-12T16:10:52.279 INFO:tasks.workunit.client.1.smithi134.stdout:8/816: stat d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6 0 2024-03-12T16:10:52.294 INFO:tasks.workunit.client.1.smithi134.stdout:4/771: unlink d1/d13/d49/fe1 0 2024-03-12T16:10:52.295 INFO:tasks.workunit.client.1.smithi134.stdout:1/591: dread - d0/d16/d9/d13/d21/d5f/d6f/f87 zero size 2024-03-12T16:10:52.301 INFO:tasks.workunit.client.1.smithi134.stdout:0/793: creat db/d2f/d61/d94/f101 x:0 0 0 2024-03-12T16:10:52.303 INFO:tasks.workunit.client.1.smithi134.stdout:2/788: getdents d4/d12/d1d/d34/d47/d8c/d100/d110 0 2024-03-12T16:10:52.303 INFO:tasks.workunit.client.1.smithi134.stdout:9/821: getdents d5/d46/dee 0 2024-03-12T16:10:52.309 INFO:tasks.workunit.client.1.smithi134.stdout:8/817: dwrite d3/d1b/d17/d25/d49/ffc [0,4194304] 0 2024-03-12T16:10:52.311 INFO:tasks.workunit.client.1.smithi134.stdout:5/966: sync 2024-03-12T16:10:52.315 INFO:tasks.workunit.client.1.smithi134.stdout:5/967: chown db/d12/d1d/d3a/f48 38 1 2024-03-12T16:10:52.315 INFO:tasks.workunit.client.1.smithi134.stdout:4/772: dread - d1/d13/d49/d64/da3/fc8 zero size 2024-03-12T16:10:52.320 INFO:tasks.workunit.client.1.smithi134.stdout:9/822: fsync d5/d46/f5c 0 2024-03-12T16:10:52.321 INFO:tasks.workunit.client.1.smithi134.stdout:4/773: write d1/d13/d49/d64/f7d [5285507,96235] 0 2024-03-12T16:10:52.324 INFO:tasks.workunit.client.1.smithi134.stdout:0/794: dwrite db/f14 [4194304,4194304] 0 2024-03-12T16:10:52.324 INFO:tasks.workunit.client.1.smithi134.stdout:5/968: read db/d12/d29/f9a [955759,31442] 0 2024-03-12T16:10:52.326 INFO:tasks.workunit.client.1.smithi134.stdout:5/969: readlink db/d7a/dc4/ldc 0 2024-03-12T16:10:52.327 INFO:tasks.workunit.client.1.smithi134.stdout:9/823: mknod d5/d10/d6c/cf1 0 2024-03-12T16:10:52.328 INFO:tasks.workunit.client.1.smithi134.stdout:9/824: chown d5/d10/d1f/f6e 2082767 1 2024-03-12T16:10:52.329 INFO:tasks.workunit.client.1.smithi134.stdout:4/774: creat d1/d13/d49/d6d/ff1 x:0 0 0 2024-03-12T16:10:52.331 INFO:tasks.workunit.client.1.smithi134.stdout:0/795: dread db/f38 [0,4194304] 0 2024-03-12T16:10:52.334 INFO:tasks.workunit.client.1.smithi134.stdout:9/825: creat d5/d10/d33/da1/ff2 x:0 0 0 2024-03-12T16:10:52.337 INFO:tasks.workunit.client.1.smithi134.stdout:4/775: fsync d1/d24/d34/fd9 0 2024-03-12T16:10:52.337 INFO:tasks.workunit.client.1.smithi134.stdout:9/826: dread - d5/d10/d35/d49/d54/d5e/fe1 zero size 2024-03-12T16:10:52.343 INFO:tasks.workunit.client.1.smithi134.stdout:9/827: dread d5/d20/f2b [4194304,4194304] 0 2024-03-12T16:10:52.345 INFO:tasks.workunit.client.1.smithi134.stdout:4/776: rename d1/d13/l77 to d1/de/d5a/d70/lf2 0 2024-03-12T16:10:52.347 INFO:tasks.workunit.client.1.smithi134.stdout:9/828: unlink d5/d10/d6c/c3f 0 2024-03-12T16:10:52.351 INFO:tasks.workunit.client.1.smithi134.stdout:4/777: dread d1/d13/d49/d64/d28/f5e [0,4194304] 0 2024-03-12T16:10:52.356 INFO:tasks.workunit.client.1.smithi134.stdout:9/829: dwrite d5/d10/d35/f2e [4194304,4194304] 0 2024-03-12T16:10:52.356 INFO:tasks.workunit.client.1.smithi134.stdout:4/778: creat d1/d13/d49/d64/d28/d4f/ff3 x:0 0 0 2024-03-12T16:10:52.360 INFO:tasks.workunit.client.1.smithi134.stdout:4/779: mkdir d1/d13/d49/d64/da3/df4 0 2024-03-12T16:10:52.361 INFO:tasks.workunit.client.1.smithi134.stdout:9/830: unlink d5/d10/f56 0 2024-03-12T16:10:52.362 INFO:tasks.workunit.client.1.smithi134.stdout:4/780: write d1/d13/f93 [1817943,93393] 0 2024-03-12T16:10:52.363 INFO:tasks.workunit.client.1.smithi134.stdout:7/864: write d8/d27/d9d/dc9/fd0 [4348084,30834] 0 2024-03-12T16:10:52.366 INFO:tasks.workunit.client.1.smithi134.stdout:9/831: rename d5/d10/d33/fc5 to d5/d10/d35/d49/d54/d93/ff3 0 2024-03-12T16:10:52.369 INFO:tasks.workunit.client.1.smithi134.stdout:4/781: rename d1/de/d5a/fe4 to d1/d13/d49/d6d/d96/ff5 0 2024-03-12T16:10:52.374 INFO:tasks.workunit.client.1.smithi134.stdout:1/592: dwrite d0/d30/fb4 [0,4194304] 0 2024-03-12T16:10:52.375 INFO:tasks.workunit.client.1.smithi134.stdout:4/782: mknod d1/d24/ddd/cf6 0 2024-03-12T16:10:52.378 INFO:tasks.workunit.client.1.smithi134.stdout:9/832: creat d5/d20/ff4 x:0 0 0 2024-03-12T16:10:52.378 INFO:tasks.workunit.client.1.smithi134.stdout:4/783: readlink d1/d13/d49/d64/l94 0 2024-03-12T16:10:52.380 INFO:tasks.workunit.client.1.smithi134.stdout:0/796: write db/f5d [853222,28480] 0 2024-03-12T16:10:52.382 INFO:tasks.workunit.client.1.smithi134.stdout:8/818: dwrite d3/d1b/d17/d25/d33/d96/dbd/f108 [0,4194304] 0 2024-03-12T16:10:52.384 INFO:tasks.workunit.client.1.smithi134.stdout:4/784: chown d1/d13/d49/d64/d28/ccb 827151 1 2024-03-12T16:10:52.389 INFO:tasks.workunit.client.1.smithi134.stdout:1/593: truncate d0/d16/d9/d13/d21/f33 157545 0 2024-03-12T16:10:52.389 INFO:tasks.workunit.client.1.smithi134.stdout:5/970: dwrite db/d12/d1d/d128/d71/d90/fef [0,4194304] 0 2024-03-12T16:10:52.392 INFO:tasks.workunit.client.1.smithi134.stdout:0/797: dread - db/d2f/d31/d68/f99 zero size 2024-03-12T16:10:52.393 INFO:tasks.workunit.client.1.smithi134.stdout:8/819: creat d3/d1b/d17/d45/f116 x:0 0 0 2024-03-12T16:10:52.393 INFO:tasks.workunit.client.1.smithi134.stdout:0/798: readlink db/dcc/ld0 0 2024-03-12T16:10:52.400 INFO:tasks.workunit.client.1.smithi134.stdout:4/785: creat d1/d13/d49/d64/d28/d4f/dbe/ff7 x:0 0 0 2024-03-12T16:10:52.400 INFO:tasks.workunit.client.1.smithi134.stdout:1/594: symlink d0/d16/d9/d13/d21/d2f/lca 0 2024-03-12T16:10:52.400 INFO:tasks.workunit.client.1.smithi134.stdout:4/786: chown d1/de 1 1 2024-03-12T16:10:52.400 INFO:tasks.workunit.client.1.smithi134.stdout:4/787: stat d1/d24/d34/c4c 0 2024-03-12T16:10:52.401 INFO:tasks.workunit.client.1.smithi134.stdout:8/820: symlink d3/d1b/d17/d25/d33/d15/d95/l117 0 2024-03-12T16:10:52.403 INFO:tasks.workunit.client.1.smithi134.stdout:1/595: creat d0/d42/fcb x:0 0 0 2024-03-12T16:10:52.404 INFO:tasks.workunit.client.1.smithi134.stdout:7/865: dwrite d8/dc/d20/faf [0,4194304] 0 2024-03-12T16:10:52.405 INFO:tasks.workunit.client.1.smithi134.stdout:5/971: rename db/d12/d1d/d128/db4/db9/ddf/f117 to db/d12/d1d/d59/f12c 0 2024-03-12T16:10:52.406 INFO:tasks.workunit.client.1.smithi134.stdout:4/788: creat d1/d13/d49/d6d/ff8 x:0 0 0 2024-03-12T16:10:52.409 INFO:tasks.workunit.client.1.smithi134.stdout:7/866: mkdir d8/dc/d7b/dbb/d11b 0 2024-03-12T16:10:52.410 INFO:tasks.workunit.client.1.smithi134.stdout:4/789: dread d1/d13/f39 [0,4194304] 0 2024-03-12T16:10:52.416 INFO:tasks.workunit.client.1.smithi134.stdout:0/799: dread db/d2f/d71/f9e [0,4194304] 0 2024-03-12T16:10:52.417 INFO:tasks.workunit.client.1.smithi134.stdout:8/821: creat d3/d1b/d17/d25/d33/d15/d95/d6d/dc5/f118 x:0 0 0 2024-03-12T16:10:52.418 INFO:tasks.workunit.client.1.smithi134.stdout:7/867: truncate d8/dc/d55/d57/f7e 807713 0 2024-03-12T16:10:52.419 INFO:tasks.workunit.client.1.smithi134.stdout:7/868: readlink d8/dc/d20/l47 0 2024-03-12T16:10:52.419 INFO:tasks.workunit.client.1.smithi134.stdout:4/790: mkdir d1/d13/d49/d64/df9 0 2024-03-12T16:10:52.421 INFO:tasks.workunit.client.1.smithi134.stdout:7/869: write d8/dc/d20/d26/d36/f114 [67376,53089] 0 2024-03-12T16:10:52.425 INFO:tasks.workunit.client.1.smithi134.stdout:1/596: write d0/d30/d86/f1d [908331,118326] 0 2024-03-12T16:10:52.426 INFO:tasks.workunit.client.1.smithi134.stdout:5/972: write db/d12/d1d/d3a/d70/d99/fb3 [824439,15528] 0 2024-03-12T16:10:52.429 INFO:tasks.workunit.client.0.smithi006.stdout:3/541: sync 2024-03-12T16:10:52.429 INFO:tasks.workunit.client.0.smithi006.stdout:8/508: sync 2024-03-12T16:10:52.429 INFO:tasks.workunit.client.0.smithi006.stdout:0/654: sync 2024-03-12T16:10:52.429 INFO:tasks.workunit.client.0.smithi006.stdout:1/607: sync 2024-03-12T16:10:52.430 INFO:tasks.workunit.client.0.smithi006.stdout:7/741: sync 2024-03-12T16:10:52.430 INFO:tasks.workunit.client.0.smithi006.stdout:9/525: sync 2024-03-12T16:10:52.430 INFO:tasks.workunit.client.0.smithi006.stdout:4/701: sync 2024-03-12T16:10:52.430 INFO:tasks.workunit.client.0.smithi006.stdout:2/650: sync 2024-03-12T16:10:52.430 INFO:tasks.workunit.client.0.smithi006.stdout:6/612: sync 2024-03-12T16:10:52.430 INFO:tasks.workunit.client.0.smithi006.stdout:5/536: sync 2024-03-12T16:10:52.431 INFO:tasks.workunit.client.1.smithi134.stdout:8/822: dread d3/d1b/d17/d24/f6f [0,4194304] 0 2024-03-12T16:10:52.431 INFO:tasks.workunit.client.1.smithi134.stdout:1/597: read d0/d16/d9/fa4 [19344,24892] 0 2024-03-12T16:10:52.431 INFO:tasks.workunit.client.1.smithi134.stdout:5/973: read - db/d12/d1d/ffd zero size 2024-03-12T16:10:52.432 INFO:tasks.workunit.client.0.smithi006.stdout:1/608: chown d0/fa9 2 1 2024-03-12T16:10:52.432 INFO:tasks.workunit.client.1.smithi134.stdout:0/800: write db/d2f/d51/fb6 [991140,34705] 0 2024-03-12T16:10:52.433 INFO:tasks.workunit.client.1.smithi134.stdout:7/870: write d8/dc/f5d [1601090,4065] 0 2024-03-12T16:10:52.433 INFO:tasks.workunit.client.0.smithi006.stdout:8/509: readlink d2/db/d1a/d21/d4f/l96 0 2024-03-12T16:10:52.435 INFO:tasks.workunit.client.0.smithi006.stdout:0/655: truncate d2/d6/fb6 429227 0 2024-03-12T16:10:52.435 INFO:tasks.workunit.client.1.smithi134.stdout:8/823: stat d3/d1b/d17/d25/d33/d15/d95/d5b/c9d 0 2024-03-12T16:10:52.435 INFO:tasks.workunit.client.1.smithi134.stdout:7/871: chown d8/d4e/d91/da1/cfb 7888 1 2024-03-12T16:10:52.436 INFO:tasks.workunit.client.0.smithi006.stdout:6/613: mknod d3/d11/d10/d28/ce2 0 2024-03-12T16:10:52.437 INFO:tasks.workunit.client.1.smithi134.stdout:8/824: chown d3/d82/d104/d31 1295 1 2024-03-12T16:10:52.437 INFO:tasks.workunit.client.0.smithi006.stdout:1/609: rmdir d0/d25/d2a 39 2024-03-12T16:10:52.438 INFO:tasks.workunit.client.1.smithi134.stdout:7/872: chown d8/db4/c105 13946275 1 2024-03-12T16:10:52.438 INFO:tasks.workunit.client.1.smithi134.stdout:5/974: mkdir db/d12/d1d/d5c/d12d 0 2024-03-12T16:10:52.440 INFO:tasks.workunit.client.1.smithi134.stdout:0/801: rename db/d2f/d31/d68/l6d to db/d2f/d31/d68/d70/l102 0 2024-03-12T16:10:52.441 INFO:tasks.workunit.client.1.smithi134.stdout:1/598: write d0/d16/d9/d13/d38/f8b [677149,16900] 0 2024-03-12T16:10:52.441 INFO:tasks.workunit.client.1.smithi134.stdout:8/825: dread - d3/d1b/d17/d24/d28/f9f zero size 2024-03-12T16:10:52.442 INFO:tasks.workunit.client.1.smithi134.stdout:0/802: chown db/d2f/d61/d94/f101 240734241 1 2024-03-12T16:10:52.446 INFO:tasks.workunit.client.1.smithi134.stdout:7/873: getdents d8/dc/d20 0 2024-03-12T16:10:52.449 INFO:tasks.workunit.client.1.smithi134.stdout:0/803: write db/d2f/d31/d68/da2/db2/fd7 [805068,55227] 0 2024-03-12T16:10:52.453 INFO:tasks.workunit.client.0.smithi006.stdout:5/537: mknod d7/d8/d8a/d92/ca8 0 2024-03-12T16:10:52.454 INFO:tasks.workunit.client.1.smithi134.stdout:7/874: creat d8/dc/d20/d26/f11c x:0 0 0 2024-03-12T16:10:52.457 INFO:tasks.workunit.client.0.smithi006.stdout:7/742: getdents de 0 2024-03-12T16:10:52.458 INFO:tasks.workunit.client.1.smithi134.stdout:0/804: creat db/d2f/d61/dde/f103 x:0 0 0 2024-03-12T16:10:52.458 INFO:tasks.workunit.client.1.smithi134.stdout:7/875: dread - d8/db4/fd1 zero size 2024-03-12T16:10:52.459 INFO:tasks.workunit.client.0.smithi006.stdout:5/538: truncate d7/d9/d47/f5f 1627940 0 2024-03-12T16:10:52.460 INFO:tasks.workunit.client.0.smithi006.stdout:6/614: dread d3/d11/d10/d1b/f3f [0,4194304] 0 2024-03-12T16:10:52.460 INFO:tasks.workunit.client.1.smithi134.stdout:0/805: creat db/d2f/d31/d56/dbc/f104 x:0 0 0 2024-03-12T16:10:52.461 INFO:tasks.workunit.client.0.smithi006.stdout:5/539: chown d7/d9/d31/d3b/d6b 1498 1 2024-03-12T16:10:52.461 INFO:tasks.workunit.client.1.smithi134.stdout:5/975: dread db/d12/d29/d3d/d79/fd6 [0,4194304] 0 2024-03-12T16:10:52.462 INFO:tasks.workunit.client.0.smithi006.stdout:1/610: fdatasync d0/d25/d2a/d43/f58 0 2024-03-12T16:10:52.464 INFO:tasks.workunit.client.1.smithi134.stdout:7/876: dwrite d8/dc/d20/f99 [0,4194304] 0 2024-03-12T16:10:52.464 INFO:tasks.workunit.client.0.smithi006.stdout:4/702: dread d1/db/d39/d42/d61/f8a [0,4194304] 0 2024-03-12T16:10:52.465 INFO:tasks.workunit.client.0.smithi006.stdout:9/526: dread d0/d8/d16/d7d/d20/f34 [0,4194304] 0 2024-03-12T16:10:52.466 INFO:tasks.workunit.client.0.smithi006.stdout:5/540: chown d7/d9/d10/c60 132223 1 2024-03-12T16:10:52.467 INFO:tasks.workunit.client.1.smithi134.stdout:8/826: truncate d3/d82/d104/f10e 809468 0 2024-03-12T16:10:52.467 INFO:tasks.workunit.client.1.smithi134.stdout:5/976: unlink db/d12/d1d/f69 0 2024-03-12T16:10:52.469 INFO:tasks.workunit.client.1.smithi134.stdout:0/806: rmdir db/d2f/d31/d56/dbc 39 2024-03-12T16:10:52.470 INFO:tasks.workunit.client.1.smithi134.stdout:7/877: write d8/dc/d55/d57/fc8 [967251,67536] 0 2024-03-12T16:10:52.471 INFO:tasks.workunit.client.0.smithi006.stdout:8/510: dread d2/fd [0,4194304] 0 2024-03-12T16:10:52.472 INFO:tasks.workunit.client.0.smithi006.stdout:4/703: creat d1/db/d17/d5a/fe5 x:0 0 0 2024-03-12T16:10:52.473 INFO:tasks.workunit.client.0.smithi006.stdout:8/511: chown d2/db/d1a/d21/l8d 1655 1 2024-03-12T16:10:52.473 INFO:tasks.workunit.client.0.smithi006.stdout:8/512: readlink d2/lc 0 2024-03-12T16:10:52.474 INFO:tasks.workunit.client.1.smithi134.stdout:7/878: dread - d8/dc/d20/d26/d36/f9b zero size 2024-03-12T16:10:52.474 INFO:tasks.workunit.client.1.smithi134.stdout:5/977: mkdir db/d12/d1d/d59/d94/dfc/d12e 0 2024-03-12T16:10:52.475 INFO:tasks.workunit.client.1.smithi134.stdout:1/599: dwrite d0/d16/d9/d13/d21/d5f/f79 [0,4194304] 0 2024-03-12T16:10:52.475 INFO:tasks.workunit.client.0.smithi006.stdout:7/743: getdents de/d1c/d87 0 2024-03-12T16:10:52.478 INFO:tasks.workunit.client.1.smithi134.stdout:8/827: read d3/d1b/d17/d25/d33/f8f [226613,77386] 0 2024-03-12T16:10:52.479 INFO:tasks.workunit.client.1.smithi134.stdout:1/600: dread - d0/d30/d86/f9e zero size 2024-03-12T16:10:52.479 INFO:tasks.workunit.client.0.smithi006.stdout:1/611: creat d0/d25/d67/dc1/fcf x:0 0 0 2024-03-12T16:10:52.480 INFO:tasks.workunit.client.1.smithi134.stdout:0/807: creat db/d2f/d31/d56/dbc/f105 x:0 0 0 2024-03-12T16:10:52.481 INFO:tasks.workunit.client.0.smithi006.stdout:4/704: creat d1/d38/db6/fe6 x:0 0 0 2024-03-12T16:10:52.481 INFO:tasks.workunit.client.1.smithi134.stdout:7/879: fdatasync d8/dc/d20/f21 0 2024-03-12T16:10:52.483 INFO:tasks.workunit.client.0.smithi006.stdout:9/527: fdatasync d0/d8/d16/d7d/f88 0 2024-03-12T16:10:52.485 INFO:tasks.workunit.client.0.smithi006.stdout:9/528: write d0/d4/f29 [424020,99231] 0 2024-03-12T16:10:52.487 INFO:tasks.workunit.client.0.smithi006.stdout:9/529: read d0/d8/d16/d7d/d20/d37/f9d [7842538,21517] 0 2024-03-12T16:10:52.488 INFO:tasks.workunit.client.0.smithi006.stdout:1/612: mkdir d0/d25/db1/dd0 0 2024-03-12T16:10:52.488 INFO:tasks.workunit.client.1.smithi134.stdout:8/828: creat d3/d1b/d17/d25/d33/d15/d114/f119 x:0 0 0 2024-03-12T16:10:52.491 INFO:tasks.workunit.client.1.smithi134.stdout:0/808: dread db/d2f/d31/d75/f7f [0,4194304] 0 2024-03-12T16:10:52.492 INFO:tasks.workunit.client.1.smithi134.stdout:0/809: chown db/d2f/d31/d68 39 1 2024-03-12T16:10:52.493 INFO:tasks.workunit.client.0.smithi006.stdout:7/744: mknod de/d2c/d93/dbe/d4a/d6a/cf9 0 2024-03-12T16:10:52.494 INFO:tasks.workunit.client.1.smithi134.stdout:7/880: dwrite d8/dc/d55/d57/fc8 [4194304,4194304] 0 2024-03-12T16:10:52.495 INFO:tasks.workunit.client.0.smithi006.stdout:4/705: mkdir d1/db/de7 0 2024-03-12T16:10:52.496 INFO:tasks.workunit.client.1.smithi134.stdout:1/601: write d0/d42/fb0 [357500,40966] 0 2024-03-12T16:10:52.496 INFO:tasks.workunit.client.0.smithi006.stdout:9/530: dwrite d0/d4/d70/fa9 [0,4194304] 0 2024-03-12T16:10:52.500 INFO:tasks.workunit.client.0.smithi006.stdout:7/745: rmdir de/d2c/d93/dbe/d4a/dbf 39 2024-03-12T16:10:52.501 INFO:tasks.workunit.client.0.smithi006.stdout:1/613: mkdir d0/d25/d2a/d43/dd1 0 2024-03-12T16:10:52.505 INFO:tasks.workunit.client.1.smithi134.stdout:5/978: dwrite db/d12/d1d/f19 [0,4194304] 0 2024-03-12T16:10:52.505 INFO:tasks.workunit.client.0.smithi006.stdout:8/513: getdents d2/db/d1a/d1f 0 2024-03-12T16:10:52.507 INFO:tasks.workunit.client.0.smithi006.stdout:8/514: stat d2/db/d1a/l29 0 2024-03-12T16:10:52.509 INFO:tasks.workunit.client.1.smithi134.stdout:6/827: sync 2024-03-12T16:10:52.509 INFO:tasks.workunit.client.1.smithi134.stdout:0/810: rename db/d2f/d51/db4/ffa to db/d2f/d31/d75/f106 0 2024-03-12T16:10:52.512 INFO:tasks.workunit.client.1.smithi134.stdout:0/811: chown db/d2f/d31/d75/f8a 456 1 2024-03-12T16:10:52.513 INFO:tasks.workunit.client.0.smithi006.stdout:9/531: dwrite d0/d4/d3b/d95/fa3 [0,4194304] 0 2024-03-12T16:10:52.514 INFO:tasks.workunit.client.1.smithi134.stdout:7/881: dwrite d8/dc/d4b/dd9/fe3 [4194304,4194304] 0 2024-03-12T16:10:52.521 INFO:tasks.workunit.client.0.smithi006.stdout:4/706: rename d1/db/d17/f74 to d1/d38/d79/fe8 0 2024-03-12T16:10:52.523 INFO:tasks.workunit.client.0.smithi006.stdout:4/707: dread - d1/db/d17/d43/db5/f72 zero size 2024-03-12T16:10:52.526 INFO:tasks.workunit.client.0.smithi006.stdout:8/515: getdents d2/d11/d5a 0 2024-03-12T16:10:52.527 INFO:tasks.workunit.client.0.smithi006.stdout:4/708: truncate d1/f86 1249968 0 2024-03-12T16:10:52.529 INFO:tasks.workunit.client.0.smithi006.stdout:8/516: fdatasync d2/db/d1a/f1c 0 2024-03-12T16:10:52.534 INFO:tasks.workunit.client.0.smithi006.stdout:4/709: rename d1/db/d17/c15 to d1/db/de7/ce9 0 2024-03-12T16:10:52.538 INFO:tasks.workunit.client.0.smithi006.stdout:4/710: mknod d1/db/d39/d42/cea 0 2024-03-12T16:10:52.543 INFO:tasks.workunit.client.0.smithi006.stdout:4/711: truncate d1/db/d1d/f2b 654797 0 2024-03-12T16:10:52.547 INFO:tasks.workunit.client.0.smithi006.stdout:6/615: write d3/d11/d10/d1b/d6e/fa5 [976903,46829] 0 2024-03-12T16:10:52.550 INFO:tasks.workunit.client.0.smithi006.stdout:5/541: write d7/d8/f2b [546919,109597] 0 2024-03-12T16:10:52.551 INFO:tasks.workunit.client.0.smithi006.stdout:9/532: dread d0/d8/d16/f46 [0,4194304] 0 2024-03-12T16:10:52.557 INFO:tasks.workunit.client.0.smithi006.stdout:3/542: dwrite d8/fe [0,4194304] 0 2024-03-12T16:10:52.558 INFO:tasks.workunit.client.0.smithi006.stdout:7/746: write de/d2c/f73 [2599143,101132] 0 2024-03-12T16:10:52.559 INFO:tasks.workunit.client.0.smithi006.stdout:5/542: rmdir d7/d9/d31 39 2024-03-12T16:10:52.560 INFO:tasks.workunit.client.0.smithi006.stdout:0/656: dwrite d2/d6/d10/d11/d1d/f29 [0,4194304] 0 2024-03-12T16:10:52.560 INFO:tasks.workunit.client.0.smithi006.stdout:2/651: dwrite d0/f45 [0,4194304] 0 2024-03-12T16:10:52.563 INFO:tasks.workunit.client.0.smithi006.stdout:9/533: write d0/d8/d16/d2f/f4c [805400,27735] 0 2024-03-12T16:10:52.563 INFO:tasks.workunit.client.0.smithi006.stdout:4/712: link d1/db/f22 d1/feb 0 2024-03-12T16:10:52.564 INFO:tasks.workunit.client.0.smithi006.stdout:7/747: fdatasync de/d2c/dd3/fe0 0 2024-03-12T16:10:52.567 INFO:tasks.workunit.client.1.smithi134.stdout:8/829: truncate d3/d1b/d17/d3f/ffb 3919562 0 2024-03-12T16:10:52.576 INFO:tasks.workunit.client.0.smithi006.stdout:6/616: creat d3/d11/d10/d9a/fe3 x:0 0 0 2024-03-12T16:10:52.579 INFO:tasks.workunit.client.0.smithi006.stdout:0/657: rmdir d2/d6/d10 39 2024-03-12T16:10:52.579 INFO:tasks.workunit.client.0.smithi006.stdout:4/713: dread - d1/db/d17/d5a/fca zero size 2024-03-12T16:10:52.580 INFO:tasks.workunit.client.0.smithi006.stdout:8/517: dread d2/db/f62 [0,4194304] 0 2024-03-12T16:10:52.582 INFO:tasks.workunit.client.0.smithi006.stdout:2/652: dread - d0/d13/d49/d60/d2b/d62/d66/d69/d81/fc2 zero size 2024-03-12T16:10:52.583 INFO:tasks.workunit.client.0.smithi006.stdout:1/614: dwrite d0/d25/d2a/f2d [4194304,4194304] 0 2024-03-12T16:10:52.586 INFO:tasks.workunit.client.1.smithi134.stdout:7/882: creat d8/dc/d7b/d119/f11d x:0 0 0 2024-03-12T16:10:52.592 INFO:tasks.workunit.client.0.smithi006.stdout:9/534: link d0/d4/d3b/l6c d0/d8/d16/d2f/lb3 0 2024-03-12T16:10:52.593 INFO:tasks.workunit.client.0.smithi006.stdout:5/543: rename d7/d9/d10/l57 to d7/d9/d31/d3b/d61/la9 0 2024-03-12T16:10:52.596 INFO:tasks.workunit.client.0.smithi006.stdout:5/544: chown d7/d9/d31/d3b/d4f/d65/c8f 1943 1 2024-03-12T16:10:52.599 INFO:tasks.workunit.client.0.smithi006.stdout:7/748: mknod de/d2c/d93/dbe/d4a/d6a/de8/cfa 0 2024-03-12T16:10:52.600 INFO:tasks.workunit.client.1.smithi134.stdout:8/830: read d3/d1b/d17/d24/db6/dd9/fb7 [778223,99589] 0 2024-03-12T16:10:52.600 INFO:tasks.workunit.client.1.smithi134.stdout:6/828: dwrite d1/d16/d4c/d58/da0/db7/f9f [0,4194304] 0 2024-03-12T16:10:52.600 INFO:tasks.workunit.client.1.smithi134.stdout:5/979: dwrite db/d12/d1d/d5c/f65 [0,4194304] 0 2024-03-12T16:10:52.600 INFO:tasks.workunit.client.0.smithi006.stdout:7/749: readlink l8 0 2024-03-12T16:10:52.602 INFO:tasks.workunit.client.1.smithi134.stdout:7/883: truncate d8/dc/d55/d57/f106 480120 0 2024-03-12T16:10:52.603 INFO:tasks.workunit.client.1.smithi134.stdout:1/602: dwrite d0/d42/f92 [0,4194304] 0 2024-03-12T16:10:52.603 INFO:tasks.workunit.client.0.smithi006.stdout:9/535: mknod d0/d8/d80/cb4 0 2024-03-12T16:10:52.604 INFO:tasks.workunit.client.0.smithi006.stdout:6/617: write d3/f1c [2754971,71097] 0 2024-03-12T16:10:52.605 INFO:tasks.workunit.client.1.smithi134.stdout:1/603: dread - d0/d30/d48/f80 zero size 2024-03-12T16:10:52.605 INFO:tasks.workunit.client.1.smithi134.stdout:6/829: symlink d1/d16/d4c/d65/d61/l136 0 2024-03-12T16:10:52.606 INFO:tasks.workunit.client.1.smithi134.stdout:7/884: chown d8/dc/d4b/dd9/df4/f35 870432 1 2024-03-12T16:10:52.607 INFO:tasks.workunit.client.0.smithi006.stdout:6/618: write d3/d11/d10/da7/d8e/f86 [757102,67779] 0 2024-03-12T16:10:52.607 INFO:tasks.workunit.client.1.smithi134.stdout:2/789: sync 2024-03-12T16:10:52.607 INFO:tasks.workunit.client.1.smithi134.stdout:6/830: read - d1/da6/f84 zero size 2024-03-12T16:10:52.609 INFO:tasks.workunit.client.0.smithi006.stdout:6/619: chown d3/d11/d3b/d59/fd3 57660167 1 2024-03-12T16:10:52.610 INFO:tasks.workunit.client.1.smithi134.stdout:7/885: dread - d8/dc/d55/d81/d87/fdf zero size 2024-03-12T16:10:52.613 INFO:tasks.workunit.client.1.smithi134.stdout:2/790: chown d4/de8 37 1 2024-03-12T16:10:52.616 INFO:tasks.workunit.client.0.smithi006.stdout:4/714: rename d1/db/d17 to d1/db/d39/dbf/dec 0 2024-03-12T16:10:52.618 INFO:tasks.workunit.client.0.smithi006.stdout:8/518: write d2/d11/f4e [79438,110510] 0 2024-03-12T16:10:52.619 INFO:tasks.workunit.client.0.smithi006.stdout:7/750: creat de/d7b/d7e/ffb x:0 0 0 2024-03-12T16:10:52.621 INFO:tasks.workunit.client.0.smithi006.stdout:1/615: mkdir d0/d25/d2a/d43/d68/dd2 0 2024-03-12T16:10:52.621 INFO:tasks.workunit.client.0.smithi006.stdout:3/543: dread d8/d19/d26/d59/d2c/dc/f38 [0,4194304] 0 2024-03-12T16:10:52.622 INFO:tasks.workunit.client.1.smithi134.stdout:6/831: read d1/d16/d4c/d65/f6b [1891316,10165] 0 2024-03-12T16:10:52.623 INFO:tasks.workunit.client.0.smithi006.stdout:0/658: write d2/d6/d10/d11/f35 [877803,107786] 0 2024-03-12T16:10:52.623 INFO:tasks.workunit.client.1.smithi134.stdout:2/791: creat d4/de8/dea/df5/f120 x:0 0 0 2024-03-12T16:10:52.624 INFO:tasks.workunit.client.1.smithi134.stdout:2/792: chown d4/d84/d7d/dbe 0 1 2024-03-12T16:10:52.624 INFO:tasks.workunit.client.1.smithi134.stdout:6/832: chown d1/d16/d4c/d65/d9d/cb4 2473894 1 2024-03-12T16:10:52.624 INFO:tasks.workunit.client.1.smithi134.stdout:2/793: readlink d4/de8/l60 0 2024-03-12T16:10:52.629 INFO:tasks.workunit.client.0.smithi006.stdout:6/620: rename d3/d11/d10/d19/c76 to d3/d11/d10/d1b/d6e/db1/ce4 0 2024-03-12T16:10:52.631 INFO:tasks.workunit.client.0.smithi006.stdout:7/751: mkdir de/d7b/dfc 0 2024-03-12T16:10:52.633 INFO:tasks.workunit.client.0.smithi006.stdout:8/519: mknod d2/d55/ca3 0 2024-03-12T16:10:52.634 INFO:tasks.workunit.client.0.smithi006.stdout:1/616: symlink d0/d25/d67/ld3 0 2024-03-12T16:10:52.635 INFO:tasks.workunit.client.1.smithi134.stdout:6/833: dread d1/d89/fd6 [4194304,4194304] 0 2024-03-12T16:10:52.635 INFO:tasks.workunit.client.1.smithi134.stdout:2/794: dwrite d4/fa [0,4194304] 0 2024-03-12T16:10:52.637 INFO:tasks.workunit.client.0.smithi006.stdout:4/715: mknod d1/ced 0 2024-03-12T16:10:52.638 INFO:tasks.workunit.client.0.smithi006.stdout:8/520: fsync d2/db/d1a/d1f/f31 0 2024-03-12T16:10:52.639 INFO:tasks.workunit.client.0.smithi006.stdout:2/653: dread d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fbd [0,4194304] 0 2024-03-12T16:10:52.639 INFO:tasks.workunit.client.1.smithi134.stdout:8/831: symlink d3/d1b/d17/d24/db6/l11a 0 2024-03-12T16:10:52.642 INFO:tasks.workunit.client.1.smithi134.stdout:8/832: mkdir d3/d1b/d17/d24/d28/d102/d11b 0 2024-03-12T16:10:52.643 INFO:tasks.workunit.client.1.smithi134.stdout:8/833: readlink d3/d1b/d17/d25/d49/l5e 0 2024-03-12T16:10:52.646 INFO:tasks.workunit.client.1.smithi134.stdout:9/833: sync 2024-03-12T16:10:52.646 INFO:tasks.workunit.client.1.smithi134.stdout:4/791: sync 2024-03-12T16:10:52.649 INFO:tasks.workunit.client.1.smithi134.stdout:8/834: creat d3/d1b/d17/d24/d28/d102/d11b/f11c x:0 0 0 2024-03-12T16:10:52.650 INFO:tasks.workunit.client.1.smithi134.stdout:4/792: rmdir d1/d24/d34 39 2024-03-12T16:10:52.651 INFO:tasks.workunit.client.0.smithi006.stdout:7/752: dread de/f80 [0,4194304] 0 2024-03-12T16:10:52.652 INFO:tasks.workunit.client.1.smithi134.stdout:9/834: symlink d5/d10/d1f/dd5/lf5 0 2024-03-12T16:10:52.652 INFO:tasks.workunit.client.0.smithi006.stdout:4/716: rmdir d1/db/d1d/d2f 39 2024-03-12T16:10:52.654 INFO:tasks.workunit.client.1.smithi134.stdout:9/835: dread - d5/d10/d35/d49/d54/d5e/fe1 zero size 2024-03-12T16:10:52.654 INFO:tasks.workunit.client.1.smithi134.stdout:6/834: rename d1/da6/d55/d85/fb0 to d1/d3/d10/f137 0 2024-03-12T16:10:52.654 INFO:tasks.workunit.client.0.smithi006.stdout:6/621: dread d3/d11/d10/d1b/d6e/d80/d9b/fcb [0,4194304] 0 2024-03-12T16:10:52.654 INFO:tasks.workunit.client.0.smithi006.stdout:2/654: readlink d0/l7 0 2024-03-12T16:10:52.655 INFO:tasks.workunit.client.0.smithi006.stdout:5/545: dread d7/d9/d10/d24/f38 [0,4194304] 0 2024-03-12T16:10:52.658 INFO:tasks.workunit.client.1.smithi134.stdout:8/835: creat d3/d1b/d17/d25/d33/f11d x:0 0 0 2024-03-12T16:10:52.659 INFO:tasks.workunit.client.0.smithi006.stdout:3/544: write d8/d19/d47/f77 [398504,17937] 0 2024-03-12T16:10:52.660 INFO:tasks.workunit.client.1.smithi134.stdout:4/793: fsync d1/de/d5a/d84/f85 0 2024-03-12T16:10:52.662 INFO:tasks.workunit.client.0.smithi006.stdout:5/546: read d7/d9/f20 [3597021,116610] 0 2024-03-12T16:10:52.663 INFO:tasks.workunit.client.1.smithi134.stdout:0/812: dwrite db/d2f/d31/d56/d66/da5/fb9 [0,4194304] 0 2024-03-12T16:10:52.664 INFO:tasks.workunit.client.1.smithi134.stdout:9/836: creat d5/d10/d35/d49/d54/d88/ff6 x:0 0 0 2024-03-12T16:10:52.665 INFO:tasks.workunit.client.0.smithi006.stdout:4/717: readlink d1/db/d1d/l8b 0 2024-03-12T16:10:52.666 INFO:tasks.workunit.client.1.smithi134.stdout:0/813: dread - db/d2f/d31/d56/dbc/f104 zero size 2024-03-12T16:10:52.667 INFO:tasks.workunit.client.1.smithi134.stdout:4/794: symlink d1/dbc/lfa 0 2024-03-12T16:10:52.670 INFO:tasks.workunit.client.0.smithi006.stdout:3/545: fsync d8/d19/d26/d59/d2c/d41/da1/fb8 0 2024-03-12T16:10:52.671 INFO:tasks.workunit.client.1.smithi134.stdout:9/837: dread d5/d10/d35/d49/d54/d5e/dab/fbd [0,4194304] 0 2024-03-12T16:10:52.672 INFO:tasks.workunit.client.1.smithi134.stdout:8/836: symlink d3/d1b/d17/d24/d28/d102/l11e 0 2024-03-12T16:10:52.674 INFO:tasks.workunit.client.1.smithi134.stdout:4/795: unlink d1/d13/d49/d53/la5 0 2024-03-12T16:10:52.675 INFO:tasks.workunit.client.0.smithi006.stdout:9/536: dwrite d0/d4/d3b/d95/f55 [0,4194304] 0 2024-03-12T16:10:52.681 INFO:tasks.workunit.client.1.smithi134.stdout:6/835: dwrite d1/da6/d55/d94/d127/d32/f3c [0,4194304] 0 2024-03-12T16:10:52.682 INFO:tasks.workunit.client.0.smithi006.stdout:5/547: creat d7/d9/d47/faa x:0 0 0 2024-03-12T16:10:52.682 INFO:tasks.workunit.client.0.smithi006.stdout:9/537: stat d0/d8 0 2024-03-12T16:10:52.682 INFO:tasks.workunit.client.0.smithi006.stdout:6/622: symlink d3/d11/d10/da7/dd5/ddb/le5 0 2024-03-12T16:10:52.686 INFO:tasks.workunit.client.1.smithi134.stdout:0/814: getdents db/d2f/d31/d56/d9a 0 2024-03-12T16:10:52.688 INFO:tasks.workunit.client.1.smithi134.stdout:1/604: write d0/d16/f31 [850231,71278] 0 2024-03-12T16:10:52.690 INFO:tasks.workunit.client.0.smithi006.stdout:7/753: rmdir de/d2c/d93/dbe/d4a/dbf/dd7 0 2024-03-12T16:10:52.690 INFO:tasks.workunit.client.0.smithi006.stdout:8/521: dread d2/d11/f9d [4194304,4194304] 0 2024-03-12T16:10:52.690 INFO:tasks.workunit.client.1.smithi134.stdout:7/886: truncate d8/dc/d55/f5f 2342570 0 2024-03-12T16:10:52.692 INFO:tasks.workunit.client.1.smithi134.stdout:8/837: creat d3/d1b/d17/d6c/f11f x:0 0 0 2024-03-12T16:10:52.693 INFO:tasks.workunit.client.1.smithi134.stdout:2/795: mknod d4/d12/c121 0 2024-03-12T16:10:52.694 INFO:tasks.workunit.client.0.smithi006.stdout:5/548: chown d7/d9/d31/d3b/d4f/d65 1433 1 2024-03-12T16:10:52.695 INFO:tasks.workunit.client.0.smithi006.stdout:3/546: fsync d8/d19/d26/d59/d3b/f80 0 2024-03-12T16:10:52.696 INFO:tasks.workunit.client.1.smithi134.stdout:1/605: creat d0/d16/d9/d13/d21/dac/fcc x:0 0 0 2024-03-12T16:10:52.697 INFO:tasks.workunit.client.1.smithi134.stdout:7/887: unlink d8/dc/d20/lb8 0 2024-03-12T16:10:52.699 INFO:tasks.workunit.client.1.smithi134.stdout:5/980: dwrite db/d12/d7b/f93 [0,4194304] 0 2024-03-12T16:10:52.703 INFO:tasks.workunit.client.0.smithi006.stdout:6/623: read - d3/f52 zero size 2024-03-12T16:10:52.703 INFO:tasks.workunit.client.0.smithi006.stdout:2/655: dwrite d0/d13/d49/fa1 [0,4194304] 0 2024-03-12T16:10:52.703 INFO:tasks.workunit.client.0.smithi006.stdout:0/659: dwrite d2/d39/d42/f90 [0,4194304] 0 2024-03-12T16:10:52.704 INFO:tasks.workunit.client.1.smithi134.stdout:1/606: read d0/d16/d9/d13/d38/f8b [8078561,5328] 0 2024-03-12T16:10:52.707 INFO:tasks.workunit.client.1.smithi134.stdout:8/838: creat d3/d82/d104/f120 x:0 0 0 2024-03-12T16:10:52.713 INFO:tasks.workunit.client.0.smithi006.stdout:8/522: read d2/d55/d7b/f8e [166151,122299] 0 2024-03-12T16:10:52.715 INFO:tasks.workunit.client.0.smithi006.stdout:4/718: dwrite d1/db/d39/dbf/dec/d43/db5/fdc [0,4194304] 0 2024-03-12T16:10:52.716 INFO:tasks.workunit.client.0.smithi006.stdout:9/538: rename d0/d4/d3b/d95 to d0/d8/d16/d7d/db5 0 2024-03-12T16:10:52.717 INFO:tasks.workunit.client.0.smithi006.stdout:5/549: link d7/d9/d10/c22 d7/d8/d91/cab 0 2024-03-12T16:10:52.720 INFO:tasks.workunit.client.0.smithi006.stdout:1/617: dwrite d0/d25/d2a/d35/d3f/f61 [4194304,4194304] 0 2024-03-12T16:10:52.721 INFO:tasks.workunit.client.0.smithi006.stdout:8/523: mkdir d2/d11/d6e/da4 0 2024-03-12T16:10:52.727 INFO:tasks.workunit.client.0.smithi006.stdout:9/539: dread - d0/d83/f92 zero size 2024-03-12T16:10:52.727 INFO:tasks.workunit.client.0.smithi006.stdout:3/547: chown d8/d19/d47/f79 278644 1 2024-03-12T16:10:52.727 INFO:tasks.workunit.client.0.smithi006.stdout:7/754: rename de/d2c/d93/fe6 to de/d1c/d87/ffd 0 2024-03-12T16:10:52.728 INFO:tasks.workunit.client.0.smithi006.stdout:2/656: dwrite d0/f3f [0,4194304] 0 2024-03-12T16:10:52.733 INFO:tasks.workunit.client.0.smithi006.stdout:9/540: truncate d0/d8/d80/f97 257927 0 2024-03-12T16:10:52.737 INFO:tasks.workunit.client.0.smithi006.stdout:0/660: dwrite d2/d6/d37/f86 [0,4194304] 0 2024-03-12T16:10:52.739 INFO:tasks.workunit.client.0.smithi006.stdout:1/618: symlink d0/d25/d67/d8d/ld4 0 2024-03-12T16:10:52.739 INFO:tasks.workunit.client.0.smithi006.stdout:4/719: truncate d1/d38/d79/f96 680334 0 2024-03-12T16:10:52.740 INFO:tasks.workunit.client.0.smithi006.stdout:8/524: symlink d2/db/d1a/d21/d8a/la5 0 2024-03-12T16:10:52.743 INFO:tasks.workunit.client.0.smithi006.stdout:0/661: symlink d2/d6/d10/d11/d1d/d2e/d77/lca 0 2024-03-12T16:10:52.744 INFO:tasks.workunit.client.0.smithi006.stdout:7/755: truncate de/d2c/d4f/d83/f95 1989024 0 2024-03-12T16:10:52.745 INFO:tasks.workunit.client.0.smithi006.stdout:7/756: dread - de/d2c/dea/feb zero size 2024-03-12T16:10:52.747 INFO:tasks.workunit.client.0.smithi006.stdout:4/720: creat d1/d91/fee x:0 0 0 2024-03-12T16:10:52.748 INFO:tasks.workunit.client.0.smithi006.stdout:7/757: chown de/d2c/d4f/d83/fab 300490 1 2024-03-12T16:10:52.749 INFO:tasks.workunit.client.0.smithi006.stdout:8/525: creat d2/d55/fa6 x:0 0 0 2024-03-12T16:10:52.753 INFO:tasks.workunit.client.0.smithi006.stdout:8/526: read - d2/db/d70/f9c zero size 2024-03-12T16:10:52.762 INFO:tasks.workunit.client.1.smithi134.stdout:4/796: truncate d1/d13/d49/fa0 506179 0 2024-03-12T16:10:52.763 INFO:tasks.workunit.client.1.smithi134.stdout:9/838: dread d5/d10/d35/d49/d54/d93/ff3 [0,4194304] 0 2024-03-12T16:10:52.763 INFO:tasks.workunit.client.0.smithi006.stdout:4/721: symlink d1/d91/lef 0 2024-03-12T16:10:52.765 INFO:tasks.workunit.client.0.smithi006.stdout:1/619: symlink d0/d25/d2a/d43/d56/ld5 0 2024-03-12T16:10:52.766 INFO:tasks.workunit.client.1.smithi134.stdout:0/815: link db/d2f/d51/cec db/d2f/d61/d6c/c107 0 2024-03-12T16:10:52.766 INFO:tasks.workunit.client.1.smithi134.stdout:8/839: symlink d3/d1b/d17/d25/d33/d15/l121 0 2024-03-12T16:10:52.767 INFO:tasks.workunit.client.0.smithi006.stdout:6/624: dread d3/f1c [0,4194304] 0 2024-03-12T16:10:52.767 INFO:tasks.workunit.client.0.smithi006.stdout:2/657: getdents d0/d13/d49/d60/d2b 0 2024-03-12T16:10:52.769 INFO:tasks.workunit.client.0.smithi006.stdout:7/758: rename f6 to de/d2c/d93/dbe/d4a/dbf/ffe 0 2024-03-12T16:10:52.769 INFO:tasks.workunit.client.1.smithi134.stdout:6/836: dwrite d1/d16/d4c/d58/fba [0,4194304] 0 2024-03-12T16:10:52.769 INFO:tasks.workunit.client.1.smithi134.stdout:4/797: creat d1/d13/d49/d64/d28/d4f/dbe/ffb x:0 0 0 2024-03-12T16:10:52.770 INFO:tasks.workunit.client.1.smithi134.stdout:9/839: truncate d5/d10/d35/d49/d54/d88/ff6 410961 0 2024-03-12T16:10:52.770 INFO:tasks.workunit.client.1.smithi134.stdout:5/981: link db/d12/d1d/d3a/cc7 db/d12/d7b/c12f 0 2024-03-12T16:10:52.770 INFO:tasks.workunit.client.1.smithi134.stdout:8/840: dread - d3/d1b/d17/d25/d33/d96/fca zero size 2024-03-12T16:10:52.771 INFO:tasks.workunit.client.1.smithi134.stdout:0/816: mkdir db/d2f/d108 0 2024-03-12T16:10:52.774 INFO:tasks.workunit.client.0.smithi006.stdout:8/527: mkdir d2/db/d1a/d21/d4f/da7 0 2024-03-12T16:10:52.774 INFO:tasks.workunit.client.1.smithi134.stdout:0/817: fsync db/d2f/f57 0 2024-03-12T16:10:52.778 INFO:tasks.workunit.client.1.smithi134.stdout:4/798: fdatasync d1/d13/d49/d64/d28/f5e 0 2024-03-12T16:10:52.778 INFO:tasks.workunit.client.0.smithi006.stdout:9/541: dread d0/d8/d16/d7d/d20/d37/f57 [0,4194304] 0 2024-03-12T16:10:52.782 INFO:tasks.workunit.client.1.smithi134.stdout:4/799: write d1/d13/d49/d64/d28/f3f [4225930,53963] 0 2024-03-12T16:10:52.783 INFO:tasks.workunit.client.1.smithi134.stdout:5/982: symlink db/d12/d1d/d3a/d4e/d110/l130 0 2024-03-12T16:10:52.784 INFO:tasks.workunit.client.1.smithi134.stdout:6/837: dread d1/fb2 [0,4194304] 0 2024-03-12T16:10:52.785 INFO:tasks.workunit.client.0.smithi006.stdout:6/625: readlink d3/d11/ld2 0 2024-03-12T16:10:52.785 INFO:tasks.workunit.client.1.smithi134.stdout:8/841: mkdir d3/d1b/d17/d25/d49/d122 0 2024-03-12T16:10:52.786 INFO:tasks.workunit.client.0.smithi006.stdout:9/542: write d0/d8/d16/d7d/db5/f55 [4440640,56707] 0 2024-03-12T16:10:52.786 INFO:tasks.workunit.client.0.smithi006.stdout:8/528: dread d2/d11/f4e [0,4194304] 0 2024-03-12T16:10:52.787 INFO:tasks.workunit.client.1.smithi134.stdout:6/838: truncate d1/d16/d4c/d65/d61/fe5 915538 0 2024-03-12T16:10:52.788 INFO:tasks.workunit.client.1.smithi134.stdout:8/842: chown d3/d1b/d17/d25/d33/d15/d95/d5b/c8d 86797 1 2024-03-12T16:10:52.789 INFO:tasks.workunit.client.1.smithi134.stdout:4/800: chown d1/d24/d34/d8e/ca7 5 1 2024-03-12T16:10:52.790 INFO:tasks.workunit.client.1.smithi134.stdout:5/983: read db/d12/d1d/f31 [2749147,6317] 0 2024-03-12T16:10:52.791 INFO:tasks.workunit.client.1.smithi134.stdout:6/839: stat d1/d16/d4c/d65/d70/dca 0 2024-03-12T16:10:52.791 INFO:tasks.workunit.client.1.smithi134.stdout:9/840: rename d5/d10/d1f/dd5 to d5/d10/d35/d49/d54/df7 0 2024-03-12T16:10:52.792 INFO:tasks.workunit.client.0.smithi006.stdout:2/658: fdatasync d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/fba 0 2024-03-12T16:10:52.793 INFO:tasks.workunit.client.0.smithi006.stdout:5/550: dwrite d7/d9/d31/d3b/f86 [0,4194304] 0 2024-03-12T16:10:52.794 INFO:tasks.workunit.client.1.smithi134.stdout:4/801: fdatasync d1/d13/d49/f65 0 2024-03-12T16:10:52.795 INFO:tasks.workunit.client.1.smithi134.stdout:5/984: chown db/d12/d29/fc3 240 1 2024-03-12T16:10:52.800 INFO:tasks.workunit.client.1.smithi134.stdout:5/985: chown db/d12/d1d/f89 14 1 2024-03-12T16:10:52.801 INFO:tasks.workunit.client.0.smithi006.stdout:0/662: dread d2/f2c [0,4194304] 0 2024-03-12T16:10:52.801 INFO:tasks.workunit.client.1.smithi134.stdout:0/818: write db/d2f/f4f [324886,69829] 0 2024-03-12T16:10:52.802 INFO:tasks.workunit.client.1.smithi134.stdout:1/607: dread d0/f6b [0,4194304] 0 2024-03-12T16:10:52.803 INFO:tasks.workunit.client.0.smithi006.stdout:1/620: creat d0/d25/fd6 x:0 0 0 2024-03-12T16:10:52.803 INFO:tasks.workunit.client.0.smithi006.stdout:8/529: readlink d2/db/d1a/d21/d8a/la5 0 2024-03-12T16:10:52.804 INFO:tasks.workunit.client.1.smithi134.stdout:8/843: dwrite d3/d82/fe7 [0,4194304] 0 2024-03-12T16:10:52.804 INFO:tasks.workunit.client.0.smithi006.stdout:9/543: dread - d0/d8/d16/d7d/d20/d37/f5f zero size 2024-03-12T16:10:52.804 INFO:tasks.workunit.client.0.smithi006.stdout:6/626: read d3/d11/d43/f46 [2485555,82134] 0 2024-03-12T16:10:52.806 INFO:tasks.workunit.client.0.smithi006.stdout:7/759: dread de/d1c/d87/ddb/f36 [0,4194304] 0 2024-03-12T16:10:52.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/608: readlink d0/d16/d9/lb 0 2024-03-12T16:10:52.807 INFO:tasks.workunit.client.0.smithi006.stdout:3/548: dwrite d8/d19/d26/d59/d2c/d41/f8c [0,4194304] 0 2024-03-12T16:10:52.807 INFO:tasks.workunit.client.1.smithi134.stdout:0/819: creat db/d2f/d61/d94/f109 x:0 0 0 2024-03-12T16:10:52.814 INFO:tasks.workunit.client.1.smithi134.stdout:9/841: dwrite d5/d10/f81 [0,4194304] 0 2024-03-12T16:10:52.814 INFO:tasks.workunit.client.0.smithi006.stdout:6/627: readlink d3/d11/d10/d1b/d20/l50 0 2024-03-12T16:10:52.817 INFO:tasks.workunit.client.0.smithi006.stdout:4/722: getdents d1/db/d39/dbf/dec/d5a 0 2024-03-12T16:10:52.819 INFO:tasks.workunit.client.1.smithi134.stdout:1/609: rename d0/d16/d9/d13/d38/c3c to d0/d16/d9/d51/db7/dbb/ccd 0 2024-03-12T16:10:52.820 INFO:tasks.workunit.client.1.smithi134.stdout:4/802: dwrite d1/d24/d34/f88 [4194304,4194304] 0 2024-03-12T16:10:52.822 INFO:tasks.workunit.client.0.smithi006.stdout:0/663: symlink d2/d6/d37/d97/dbb/lcb 0 2024-03-12T16:10:52.822 INFO:tasks.workunit.client.0.smithi006.stdout:6/628: write d3/d47/fdf [314073,7893] 0 2024-03-12T16:10:52.824 INFO:tasks.workunit.client.1.smithi134.stdout:6/840: link d1/c6e d1/d16/d4c/d65/d9d/c138 0 2024-03-12T16:10:52.825 INFO:tasks.workunit.client.0.smithi006.stdout:5/551: rename d7/c62 to d7/d9/d31/d3b/d4f/d65/cac 0 2024-03-12T16:10:52.825 INFO:tasks.workunit.client.1.smithi134.stdout:0/820: creat db/d2f/d31/d68/da2/dd3/f10a x:0 0 0 2024-03-12T16:10:52.826 INFO:tasks.workunit.client.1.smithi134.stdout:4/803: readlink d1/d24/lef 0 2024-03-12T16:10:52.827 INFO:tasks.workunit.client.0.smithi006.stdout:5/552: fsync f4 0 2024-03-12T16:10:52.829 INFO:tasks.workunit.client.0.smithi006.stdout:2/659: write d0/f5d [2718556,103077] 0 2024-03-12T16:10:52.829 INFO:tasks.workunit.client.0.smithi006.stdout:7/760: truncate de/d2c/d4f/d83/fae 92011 0 2024-03-12T16:10:52.831 INFO:tasks.workunit.client.1.smithi134.stdout:1/610: symlink d0/d42/d47/dc9/lce 0 2024-03-12T16:10:52.833 INFO:tasks.workunit.client.0.smithi006.stdout:9/544: dwrite d0/fb1 [0,4194304] 0 2024-03-12T16:10:52.834 INFO:tasks.workunit.client.1.smithi134.stdout:5/986: dwrite db/d12/d1d/d128/d73/d8c/f125 [0,4194304] 0 2024-03-12T16:10:52.835 INFO:tasks.workunit.client.1.smithi134.stdout:9/842: symlink d5/d10/d35/d49/d54/dc6/lf8 0 2024-03-12T16:10:52.835 INFO:tasks.workunit.client.1.smithi134.stdout:8/844: dread d3/d1b/d17/d24/db6/dd9/fcd [0,4194304] 0 2024-03-12T16:10:52.836 INFO:tasks.workunit.client.1.smithi134.stdout:1/611: write d0/d16/d9/d13/d21/d20/f8e [996633,125039] 0 2024-03-12T16:10:52.840 INFO:tasks.workunit.client.1.smithi134.stdout:5/987: mkdir db/d12/d29/d3d/d116/d131 0 2024-03-12T16:10:52.841 INFO:tasks.workunit.client.1.smithi134.stdout:9/843: symlink d5/d10/d35/d49/d54/dc6/lf9 0 2024-03-12T16:10:52.844 INFO:tasks.workunit.client.1.smithi134.stdout:6/841: dread d1/da6/d55/d94/d127/f5e [0,4194304] 0 2024-03-12T16:10:52.845 INFO:tasks.workunit.client.1.smithi134.stdout:0/821: getdents db/d2f/d61/d6c 0 2024-03-12T16:10:52.846 INFO:tasks.workunit.client.0.smithi006.stdout:5/553: unlink d7/d8/c6f 0 2024-03-12T16:10:52.853 INFO:tasks.workunit.client.1.smithi134.stdout:6/842: chown d1/da6/d55/d94/d127/l3f 383026899 1 2024-03-12T16:10:52.856 INFO:tasks.workunit.client.0.smithi006.stdout:8/530: rename d2/f36 to d2/db/d1a/d21/fa8 0 2024-03-12T16:10:52.856 INFO:tasks.workunit.client.1.smithi134.stdout:8/845: dwrite d3/d1b/d17/d25/d33/d15/ff2 [0,4194304] 0 2024-03-12T16:10:52.857 INFO:tasks.workunit.client.0.smithi006.stdout:6/629: dwrite d3/d11/d10/da7/d9e/daa/fb9 [0,4194304] 0 2024-03-12T16:10:52.857 INFO:tasks.workunit.client.0.smithi006.stdout:7/761: symlink de/d1c/d87/ddb/lff 0 2024-03-12T16:10:52.859 INFO:tasks.workunit.client.0.smithi006.stdout:0/664: write d2/d39/d42/f58 [1036910,125349] 0 2024-03-12T16:10:52.861 INFO:tasks.workunit.client.0.smithi006.stdout:1/621: dwrite d0/d25/d2a/d35/f4b [0,4194304] 0 2024-03-12T16:10:52.862 INFO:tasks.workunit.client.0.smithi006.stdout:4/723: dwrite d1/db/d39/dbf/dec/f1c [0,4194304] 0 2024-03-12T16:10:52.863 INFO:tasks.workunit.client.1.smithi134.stdout:1/612: dwrite d0/d16/d9/d13/d21/f33 [0,4194304] 0 2024-03-12T16:10:52.864 INFO:tasks.workunit.client.1.smithi134.stdout:4/804: truncate d1/de/fc5 130503 0 2024-03-12T16:10:52.864 INFO:tasks.workunit.client.0.smithi006.stdout:0/665: read - d2/d6/d10/d11/d7e/fa5 zero size 2024-03-12T16:10:52.866 INFO:tasks.workunit.client.0.smithi006.stdout:0/666: chown d2/l13 2298017 1 2024-03-12T16:10:52.868 INFO:tasks.workunit.client.0.smithi006.stdout:2/660: creat d0/d13/d49/d60/fd0 x:0 0 0 2024-03-12T16:10:52.868 INFO:tasks.workunit.client.0.smithi006.stdout:3/549: dread d8/d19/d47/f79 [0,4194304] 0 2024-03-12T16:10:52.869 INFO:tasks.workunit.client.0.smithi006.stdout:5/554: link d7/d9/d31/d3b/f86 d7/d8/d8a/fad 0 2024-03-12T16:10:52.869 INFO:tasks.workunit.client.1.smithi134.stdout:5/988: rename db/d12/d1d/d128/d73 to db/d12/d1d/d128/db4/db9/ddf/d103/d132 0 2024-03-12T16:10:52.869 INFO:tasks.workunit.client.1.smithi134.stdout:6/843: write d1/d16/d4c/d58/da0/f10d [452195,127770] 0 2024-03-12T16:10:52.869 INFO:tasks.workunit.client.1.smithi134.stdout:8/846: rmdir d3/d82/d104/d31 39 2024-03-12T16:10:52.869 INFO:tasks.workunit.client.1.smithi134.stdout:9/844: write d5/d46/f64 [866512,64035] 0 2024-03-12T16:10:52.871 INFO:tasks.workunit.client.1.smithi134.stdout:8/847: fdatasync d3/fe 0 2024-03-12T16:10:52.876 INFO:tasks.workunit.client.1.smithi134.stdout:1/613: read d0/d16/fc1 [3951022,72830] 0 2024-03-12T16:10:52.878 INFO:tasks.workunit.client.0.smithi006.stdout:4/724: mknod d1/cf0 0 2024-03-12T16:10:52.880 INFO:tasks.workunit.client.0.smithi006.stdout:5/555: rmdir d7/d9/d47/d56/d79 39 2024-03-12T16:10:52.883 INFO:tasks.workunit.client.0.smithi006.stdout:3/550: truncate d8/d19/d78/fa5 270232 0 2024-03-12T16:10:52.884 INFO:tasks.workunit.client.1.smithi134.stdout:0/822: dwrite db/d2f/d31/d56/f65 [0,4194304] 0 2024-03-12T16:10:52.885 INFO:tasks.workunit.client.0.smithi006.stdout:5/556: truncate d7/d9/d31/d3b/d4f/d65/d69/f90 41961 0 2024-03-12T16:10:52.885 INFO:tasks.workunit.client.0.smithi006.stdout:9/545: rename d0/d8/d16/d7d/db5/f55 to d0/d4/fb6 0 2024-03-12T16:10:52.887 INFO:tasks.workunit.client.1.smithi134.stdout:8/848: mkdir d3/d1b/d17/d25/d33/d123 0 2024-03-12T16:10:52.888 INFO:tasks.workunit.client.1.smithi134.stdout:5/989: rmdir db/d12/d1d/d59/d94/dfc/d12e 0 2024-03-12T16:10:52.890 INFO:tasks.workunit.client.1.smithi134.stdout:1/614: dread - d0/d42/d47/fc2 zero size 2024-03-12T16:10:52.890 INFO:tasks.workunit.client.1.smithi134.stdout:5/990: mknod db/d7d/c133 0 2024-03-12T16:10:52.892 INFO:tasks.workunit.client.1.smithi134.stdout:8/849: dread - d3/d1b/d17/d25/d33/d15/d95/d4f/d65/f6e zero size 2024-03-12T16:10:52.893 INFO:tasks.workunit.client.1.smithi134.stdout:8/850: chown d3/d1b/d17/d24/cf0 154 1 2024-03-12T16:10:52.893 INFO:tasks.workunit.client.1.smithi134.stdout:8/851: stat d3/d82/d104 0 2024-03-12T16:10:52.893 INFO:tasks.workunit.client.1.smithi134.stdout:5/991: fdatasync db/d7d/fee 0 2024-03-12T16:10:52.895 INFO:tasks.workunit.client.1.smithi134.stdout:1/615: symlink d0/d30/lcf 0 2024-03-12T16:10:52.897 INFO:tasks.workunit.client.0.smithi006.stdout:3/551: rename d8/d19/d47/l8f to d8/d19/d26/d59/d2c/d41/d45/lbb 0 2024-03-12T16:10:52.899 INFO:tasks.workunit.client.0.smithi006.stdout:8/531: write d2/db/d1a/d23/f60 [1303195,129261] 0 2024-03-12T16:10:52.900 INFO:tasks.workunit.client.1.smithi134.stdout:1/616: creat d0/d16/d9/d13/d21/d2f/fd0 x:0 0 0 2024-03-12T16:10:52.903 INFO:tasks.workunit.client.0.smithi006.stdout:9/546: creat d0/d8/d16/d7d/db5/fb7 x:0 0 0 2024-03-12T16:10:52.904 INFO:tasks.workunit.client.0.smithi006.stdout:8/532: creat d2/d11/fa9 x:0 0 0 2024-03-12T16:10:52.906 INFO:tasks.workunit.client.1.smithi134.stdout:5/992: dwrite db/d12/d1d/d128/db4/db9/df6/f109 [0,4194304] 0 2024-03-12T16:10:52.909 INFO:tasks.workunit.client.1.smithi134.stdout:4/805: write d1/de/d5a/d70/faf [141028,78389] 0 2024-03-12T16:10:52.909 INFO:tasks.workunit.client.1.smithi134.stdout:6/844: write d1/d4/f47 [557602,80740] 0 2024-03-12T16:10:52.912 INFO:tasks.workunit.client.0.smithi006.stdout:3/552: dread - d8/d19/d26/d59/d2c/dc/d28/d2f/d99/fac zero size 2024-03-12T16:10:52.913 INFO:tasks.workunit.client.1.smithi134.stdout:0/823: write db/d2f/d61/d67/f69 [677682,77083] 0 2024-03-12T16:10:52.915 INFO:tasks.workunit.client.1.smithi134.stdout:6/845: mknod d1/da6/d55/d97/dfd/c139 0 2024-03-12T16:10:52.916 INFO:tasks.workunit.client.0.smithi006.stdout:4/725: write d1/db/d39/dbf/fdb [300321,86809] 0 2024-03-12T16:10:52.917 INFO:tasks.workunit.client.1.smithi134.stdout:8/852: write d3/d1b/d17/d25/fd2 [5028487,102315] 0 2024-03-12T16:10:52.919 INFO:tasks.workunit.client.1.smithi134.stdout:8/853: fdatasync d3/d1b/d17/d25/d49/ffc 0 2024-03-12T16:10:52.920 INFO:tasks.workunit.client.0.smithi006.stdout:6/630: dwrite d3/d11/d10/f7b [0,4194304] 0 2024-03-12T16:10:52.922 INFO:tasks.workunit.client.1.smithi134.stdout:6/846: creat d1/d16/d4c/d65/d9d/f13a x:0 0 0 2024-03-12T16:10:52.923 INFO:tasks.workunit.client.0.smithi006.stdout:8/533: truncate d2/db/d1a/f1c 1580295 0 2024-03-12T16:10:52.923 INFO:tasks.workunit.client.0.smithi006.stdout:3/553: readlink d8/d19/d26/d59/d2c/dc/lb4 0 2024-03-12T16:10:52.924 INFO:tasks.workunit.client.1.smithi134.stdout:8/854: mknod d3/d1b/d17/d25/d33/d15/d95/d5b/c124 0 2024-03-12T16:10:52.930 INFO:tasks.workunit.client.1.smithi134.stdout:1/617: dwrite d0/f12 [0,4194304] 0 2024-03-12T16:10:52.930 INFO:tasks.workunit.client.0.smithi006.stdout:9/547: creat d0/d4/fb8 x:0 0 0 2024-03-12T16:10:52.936 INFO:tasks.workunit.client.1.smithi134.stdout:6/847: getdents d1/d16/d4c 0 2024-03-12T16:10:52.938 INFO:tasks.workunit.client.1.smithi134.stdout:8/855: mkdir d3/d1b/d17/d25/d33/d15/d95/d5b/d125 0 2024-03-12T16:10:52.939 INFO:tasks.workunit.client.0.smithi006.stdout:3/554: rename d8/d19/d26/d59/d3b to d8/d19/dbc 0 2024-03-12T16:10:52.940 INFO:tasks.workunit.client.1.smithi134.stdout:4/806: dwrite d1/d13/d49/f32 [4194304,4194304] 0 2024-03-12T16:10:52.940 INFO:tasks.workunit.client.1.smithi134.stdout:4/807: stat d1/d13/d49/d53/fba 0 2024-03-12T16:10:52.941 INFO:tasks.workunit.client.1.smithi134.stdout:1/618: rename d0/d16/d9/d13/ca2 to d0/d42/d47/dc9/cd1 0 2024-03-12T16:10:52.942 INFO:tasks.workunit.client.1.smithi134.stdout:5/993: dread db/d12/d1d/d128/db4/db9/ddf/d103/d132/d8c/dab/f111 [0,4194304] 0 2024-03-12T16:10:52.945 INFO:tasks.workunit.client.0.smithi006.stdout:9/548: fdatasync d0/d83/d90/f9a 0 2024-03-12T16:10:52.945 INFO:tasks.workunit.client.1.smithi134.stdout:8/856: fdatasync d3/d1b/d17/d25/d33/d15/d95/d6d/dc5/f118 0 2024-03-12T16:10:52.947 INFO:tasks.workunit.client.1.smithi134.stdout:4/808: rmdir d1/d13/d49/d64/df9 0 2024-03-12T16:10:52.951 INFO:tasks.workunit.client.1.smithi134.stdout:8/857: creat d3/d1b/d17/d25/d49/d122/f126 x:0 0 0 2024-03-12T16:10:52.951 INFO:tasks.workunit.client.1.smithi134.stdout:1/619: write d0/d16/d9/d13/f8a [2843105,95686] 0 2024-03-12T16:10:52.954 INFO:tasks.workunit.client.0.smithi006.stdout:1/622: dwrite d0/d25/d2a/d43/f92 [0,4194304] 0 2024-03-12T16:10:52.954 INFO:tasks.workunit.client.1.smithi134.stdout:1/620: symlink d0/d16/d9/d13/d21/dac/ld2 0 2024-03-12T16:10:52.955 INFO:tasks.workunit.client.0.smithi006.stdout:8/534: dwrite d2/f9b [0,4194304] 0 2024-03-12T16:10:52.955 INFO:tasks.workunit.client.0.smithi006.stdout:6/631: getdents d3/d11/d10/da7/d8e/d8b 0 2024-03-12T16:10:52.958 INFO:tasks.workunit.client.1.smithi134.stdout:1/621: rmdir d0/d16/d9/d13/d38 39 2024-03-12T16:10:52.960 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:51.500648+0000 mgr.smithi134.gcntfu (mgr.24383) 63 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 130 MiB/s rd, 350 MiB/s wr, 688 op/s 2024-03-12T16:10:52.961 INFO:tasks.workunit.client.0.smithi006.stdout:8/535: mkdir d2/db/d70/daa 0 2024-03-12T16:10:52.962 INFO:tasks.workunit.client.1.smithi134.stdout:5/994: truncate db/d7a/d97/fe0 4141630 0 2024-03-12T16:10:52.963 INFO:tasks.workunit.client.0.smithi006.stdout:2/661: dread d0/d13/f27 [0,4194304] 0 2024-03-12T16:10:52.965 INFO:tasks.workunit.client.0.smithi006.stdout:4/726: dwrite d1/db/d39/dbf/fdb [0,4194304] 0 2024-03-12T16:10:52.966 INFO:tasks.workunit.client.0.smithi006.stdout:3/555: creat d8/d19/d47/fbd x:0 0 0 2024-03-12T16:10:52.968 INFO:tasks.workunit.client.1.smithi134.stdout:5/995: fsync db/f11 0 2024-03-12T16:10:52.970 INFO:tasks.workunit.client.1.smithi134.stdout:8/858: dwrite d3/d1b/d17/d25/d33/d15/d95/d10d/f113 [0,4194304] 0 2024-03-12T16:10:52.970 INFO:tasks.workunit.client.0.smithi006.stdout:5/557: dwrite d7/d9/d10/d24/f76 [0,4194304] 0 2024-03-12T16:10:52.973 INFO:tasks.workunit.client.1.smithi134.stdout:1/622: dwrite d0/d16/d9/d13/d21/d5f/f79 [0,4194304] 0 2024-03-12T16:10:52.976 INFO:tasks.workunit.client.1.smithi134.stdout:8/859: rmdir d3/d1b/d17/d25/d33/d15/d95/d4f/d65 39 2024-03-12T16:10:52.985 INFO:tasks.workunit.client.1.smithi134.stdout:5/996: truncate db/d12/d1d/d3a/d4e/f55 555146 0 2024-03-12T16:10:52.986 INFO:tasks.workunit.client.1.smithi134.stdout:8/860: dwrite d3/d1b/d17/d25/d49/d122/f126 [0,4194304] 0 2024-03-12T16:10:52.987 INFO:tasks.workunit.client.0.smithi006.stdout:6/632: dwrite d3/d11/d10/d1b/d6e/db1/fb5 [0,4194304] 0 2024-03-12T16:10:52.988 INFO:tasks.workunit.client.1.smithi134.stdout:1/623: link d0/d16/d9/d13/d21/c8f d0/d16/d9/d51/cd3 0 2024-03-12T16:10:52.995 INFO:tasks.workunit.client.0.smithi006.stdout:4/727: unlink d1/db/d39/dbf/dec/c7f 0 2024-03-12T16:10:52.997 INFO:tasks.workunit.client.0.smithi006.stdout:6/633: mkdir d3/d11/d10/da7/dd5/ddb/de6 0 2024-03-12T16:10:52.999 INFO:tasks.workunit.client.0.smithi006.stdout:5/558: rename d7/d8/f2b to d7/d9/d10/fae 0 2024-03-12T16:10:53.000 INFO:tasks.workunit.client.1.smithi134.stdout:5/997: rename db/d12/d1d/d128/db4/db9/ddf/d103/d132 to db/d12/d1d/d128/db4/db9/ddf/d103/d134 0 2024-03-12T16:10:53.000 INFO:tasks.workunit.client.1.smithi134.stdout:6/848: dread d1/da6/d55/d94/d75/f7f [0,4194304] 0 2024-03-12T16:10:53.000 INFO:tasks.workunit.client.0.smithi006.stdout:9/549: dwrite d0/d8/d16/d7d/d20/d37/f47 [4194304,4194304] 0 2024-03-12T16:10:53.001 INFO:tasks.workunit.client.1.smithi134.stdout:6/849: readlink d1/d3/d10/lb9 0 2024-03-12T16:10:53.002 INFO:tasks.workunit.client.0.smithi006.stdout:2/662: dwrite d0/d13/d49/d60/d2b/d62/d66/da6/fa9 [4194304,4194304] 0 2024-03-12T16:10:53.005 INFO:tasks.workunit.client.1.smithi134.stdout:5/998: mknod db/d12/d1d/d128/d71/c135 0 2024-03-12T16:10:53.006 INFO:tasks.workunit.client.0.smithi006.stdout:2/663: write d0/f1f [5013222,49974] 0 2024-03-12T16:10:53.007 INFO:tasks.workunit.client.1.smithi134.stdout:6/850: mkdir d1/d16/d7e/d13b 0 2024-03-12T16:10:53.008 INFO:tasks.workunit.client.1.smithi134.stdout:5/999: mknod db/d12/d1d/d3a/d4e/c136 0 2024-03-12T16:10:53.008 INFO:tasks.workunit.client.1.smithi134.stdout:6/851: chown d1/da6/d55/d85/fd0 5 1 2024-03-12T16:10:53.009 INFO:tasks.workunit.client.0.smithi006.stdout:9/550: dread - d0/d8/d16/d7d/db5/f65 zero size 2024-03-12T16:10:53.010 INFO:tasks.workunit.client.0.smithi006.stdout:2/664: chown d0/dc/c51 1534 1 2024-03-12T16:10:53.012 INFO:tasks.workunit.client.0.smithi006.stdout:4/728: creat d1/d38/ff1 x:0 0 0 2024-03-12T16:10:53.018 INFO:tasks.workunit.client.0.smithi006.stdout:1/623: dwrite d0/d25/d2a/d35/d3f/f91 [0,4194304] 0 2024-03-12T16:10:53.019 INFO:tasks.workunit.client.0.smithi006.stdout:9/551: symlink d0/d8/d16/d2f/lb9 0 2024-03-12T16:10:53.022 INFO:tasks.workunit.client.0.smithi006.stdout:4/729: truncate d1/db/d1d/d2f/d6b/fa7 872291 0 2024-03-12T16:10:53.024 INFO:tasks.workunit.client.0.smithi006.stdout:9/552: symlink d0/d8/d16/d7d/d20/lba 0 2024-03-12T16:10:53.026 INFO:tasks.workunit.client.0.smithi006.stdout:1/624: truncate d0/d25/d2a/d43/f96 765752 0 2024-03-12T16:10:53.028 INFO:tasks.workunit.client.1.smithi134.stdout:1/624: write d0/d30/f8c [488141,19035] 0 2024-03-12T16:10:53.030 INFO:tasks.workunit.client.1.smithi134.stdout:1/625: creat d0/d42/d47/dc9/fd4 x:0 0 0 2024-03-12T16:10:53.033 INFO:tasks.workunit.client.0.smithi006.stdout:3/556: write d8/d52/d6c/f84 [117673,120080] 0 2024-03-12T16:10:53.033 INFO:tasks.workunit.client.0.smithi006.stdout:9/553: symlink d0/d8/d16/d7d/d20/d37/lbb 0 2024-03-12T16:10:53.034 INFO:tasks.workunit.client.1.smithi134.stdout:1/626: link d0/d16/d9/d13/d38/f72 d0/fd5 0 2024-03-12T16:10:53.037 INFO:tasks.workunit.client.1.smithi134.stdout:1/627: truncate d0/d16/d9/d13/d38/f69 1393437 0 2024-03-12T16:10:53.040 INFO:tasks.workunit.client.1.smithi134.stdout:2/796: sync 2024-03-12T16:10:53.040 INFO:tasks.workunit.client.1.smithi134.stdout:6/852: dwrite d1/d16/d4c/d58/d8e/faf [0,4194304] 0 2024-03-12T16:10:53.044 INFO:tasks.workunit.client.0.smithi006.stdout:4/730: dread d1/db/d39/dbf/dec/f32 [0,4194304] 0 2024-03-12T16:10:53.045 INFO:tasks.workunit.client.0.smithi006.stdout:9/554: rmdir d0/d8/d16/d7d/db5/db2 0 2024-03-12T16:10:53.047 INFO:tasks.workunit.client.1.smithi134.stdout:2/797: link d4/d12/d43/dec/c107 d4/d12/d1d/d34/d47/d8c/c122 0 2024-03-12T16:10:53.049 INFO:tasks.workunit.client.1.smithi134.stdout:2/798: write d4/d84/d63/d9d/dba/fc2 [2352587,95634] 0 2024-03-12T16:10:53.051 INFO:tasks.workunit.client.1.smithi134.stdout:2/799: write d4/d84/d63/ffe [522999,61260] 0 2024-03-12T16:10:53.051 INFO:tasks.workunit.client.0.smithi006.stdout:6/634: dwrite d3/d11/d10/da7/f81 [0,4194304] 0 2024-03-12T16:10:53.051 INFO:tasks.workunit.client.0.smithi006.stdout:8/536: dread d2/db/d1a/d1f/f52 [0,4194304] 0 2024-03-12T16:10:53.052 INFO:tasks.workunit.client.1.smithi134.stdout:2/800: fdatasync d4/d84/fdf 0 2024-03-12T16:10:53.054 INFO:tasks.workunit.client.0.smithi006.stdout:1/625: dwrite d0/d25/d2a/d43/f92 [0,4194304] 0 2024-03-12T16:10:53.059 INFO:tasks.workunit.client.0.smithi006.stdout:9/555: write d0/d4/d70/d86/f63 [1251560,32048] 0 2024-03-12T16:10:53.064 INFO:tasks.workunit.client.0.smithi006.stdout:4/731: mkdir d1/db/d39/d42/df2 0 2024-03-12T16:10:53.064 INFO:tasks.workunit.client.0.smithi006.stdout:8/537: mkdir d2/dab 0 2024-03-12T16:10:53.065 INFO:tasks.workunit.client.0.smithi006.stdout:5/559: dread d7/d9/d10/f1a [0,4194304] 0 2024-03-12T16:10:53.066 INFO:tasks.workunit.client.0.smithi006.stdout:2/665: dread d0/d13/f44 [0,4194304] 0 2024-03-12T16:10:53.066 INFO:tasks.workunit.client.0.smithi006.stdout:6/635: unlink d3/d11/d10/d1b/d6e/f4e 0 2024-03-12T16:10:53.068 INFO:tasks.workunit.client.1.smithi134.stdout:2/801: dwrite d4/d12/f48 [0,4194304] 0 2024-03-12T16:10:53.070 INFO:tasks.workunit.client.1.smithi134.stdout:6/853: dread d1/da6/d55/d94/d127/f1f [0,4194304] 0 2024-03-12T16:10:53.077 INFO:tasks.workunit.client.1.smithi134.stdout:2/802: dwrite d4/d84/d63/d9d/f94 [0,4194304] 0 2024-03-12T16:10:53.080 INFO:tasks.workunit.client.1.smithi134.stdout:2/803: mknod d4/d84/d63/d9d/dba/c123 0 2024-03-12T16:10:53.091 INFO:tasks.workunit.client.1.smithi134.stdout:2/804: dwrite d4/d84/f10e [4194304,4194304] 0 2024-03-12T16:10:53.094 INFO:tasks.workunit.client.1.smithi134.stdout:6/854: readlink d1/l109 0 2024-03-12T16:10:53.096 INFO:tasks.workunit.client.1.smithi134.stdout:2/805: mknod d4/d84/d63/d9d/d3d/d71/c124 0 2024-03-12T16:10:53.096 INFO:tasks.workunit.client.0.smithi006.stdout:5/560: creat d7/d9/d31/d3b/d4f/d65/faf x:0 0 0 2024-03-12T16:10:53.097 INFO:tasks.workunit.client.0.smithi006.stdout:6/636: mkdir d3/d11/d10/da7/d8e/d8b/de7 0 2024-03-12T16:10:53.101 INFO:tasks.workunit.client.1.smithi134.stdout:2/806: fsync d4/d12/d1d/d34/d58/f78 0 2024-03-12T16:10:53.103 INFO:tasks.workunit.client.0.smithi006.stdout:4/732: link d1/db/d1d/f2b d1/d38/d79/ff3 0 2024-03-12T16:10:53.103 INFO:tasks.workunit.client.1.smithi134.stdout:6/855: dread - d1/d3/d10/fe9 zero size 2024-03-12T16:10:53.104 INFO:tasks.workunit.client.1.smithi134.stdout:2/807: fdatasync d4/d12/d39/f57 0 2024-03-12T16:10:53.105 INFO:tasks.workunit.client.0.smithi006.stdout:5/561: creat d7/d9/d10/d35/fb0 x:0 0 0 2024-03-12T16:10:53.107 INFO:tasks.workunit.client.1.smithi134.stdout:2/808: chown d4/d12/d3b/d3f/l65 1298665 1 2024-03-12T16:10:53.107 INFO:tasks.workunit.client.0.smithi006.stdout:2/666: dwrite d0/dc/d64/dc3/fca [4194304,4194304] 0 2024-03-12T16:10:53.107 INFO:tasks.workunit.client.0.smithi006.stdout:1/626: dread d0/d25/d2a/d43/f8f [0,4194304] 0 2024-03-12T16:10:53.108 INFO:tasks.workunit.client.0.smithi006.stdout:4/733: symlink d1/db/d39/dbf/dec/d5a/lf4 0 2024-03-12T16:10:53.109 INFO:tasks.workunit.client.1.smithi134.stdout:2/809: rename d4/d12/l7b to d4/d12/d1d/d34/db7/l125 0 2024-03-12T16:10:53.112 INFO:tasks.workunit.client.0.smithi006.stdout:3/557: dread d8/d19/d26/d59/d2c/f10 [4194304,4194304] 0 2024-03-12T16:10:53.112 INFO:tasks.workunit.client.0.smithi006.stdout:2/667: rmdir d0/dc/d64/dc3 39 2024-03-12T16:10:53.114 INFO:tasks.workunit.client.0.smithi006.stdout:5/562: creat d7/d9/d10/d35/fb1 x:0 0 0 2024-03-12T16:10:53.116 INFO:tasks.workunit.client.0.smithi006.stdout:1/627: truncate d0/f1f 536086 0 2024-03-12T16:10:53.116 INFO:tasks.workunit.client.0.smithi006.stdout:9/556: write d0/d83/d90/f9a [338406,127306] 0 2024-03-12T16:10:53.121 INFO:tasks.workunit.client.0.smithi006.stdout:9/557: read d0/d4/d70/d86/f63 [1118998,6386] 0 2024-03-12T16:10:53.122 INFO:tasks.workunit.client.0.smithi006.stdout:1/628: fdatasync d0/d25/f75 0 2024-03-12T16:10:53.123 INFO:tasks.workunit.client.0.smithi006.stdout:6/637: write d3/f14 [2243297,51891] 0 2024-03-12T16:10:53.124 INFO:tasks.workunit.client.0.smithi006.stdout:5/563: fsync d7/d9/d10/d35/fb0 0 2024-03-12T16:10:53.128 INFO:tasks.workunit.client.1.smithi134.stdout:6/856: dwrite d1/d16/d4c/d65/f6b [0,4194304] 0 2024-03-12T16:10:53.129 INFO:tasks.workunit.client.0.smithi006.stdout:2/668: dwrite d0/d13/d49/d60/d2b/d62/d66/d67/fa0 [0,4194304] 0 2024-03-12T16:10:53.130 INFO:tasks.workunit.client.0.smithi006.stdout:8/538: dwrite d2/d11/f82 [0,4194304] 0 2024-03-12T16:10:53.132 INFO:tasks.workunit.client.0.smithi006.stdout:4/734: getdents d1/db/de7 0 2024-03-12T16:10:53.135 INFO:tasks.workunit.client.1.smithi134.stdout:2/810: dread d4/d12/d39/fd2 [0,4194304] 0 2024-03-12T16:10:53.135 INFO:tasks.workunit.client.0.smithi006.stdout:4/735: chown d1 1872404364 1 2024-03-12T16:10:53.136 INFO:tasks.workunit.client.0.smithi006.stdout:4/736: chown d1/db/d39/dbf/dec/d5a/fca 820 1 2024-03-12T16:10:53.136 INFO:tasks.workunit.client.0.smithi006.stdout:3/558: link d8/d19/d26/c3e d8/d19/d26/d59/cbe 0 2024-03-12T16:10:53.140 INFO:tasks.workunit.client.0.smithi006.stdout:6/638: creat d3/d11/d10/da7/d8e/d8b/fe8 x:0 0 0 2024-03-12T16:10:53.140 INFO:tasks.workunit.client.0.smithi006.stdout:5/564: write d7/d9/d10/d24/f2d [2260520,55526] 0 2024-03-12T16:10:53.143 INFO:tasks.workunit.client.0.smithi006.stdout:6/639: readlink d3/d11/d3b/d59/lb2 0 2024-03-12T16:10:53.144 INFO:tasks.workunit.client.0.smithi006.stdout:2/669: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/db4/ld1 0 2024-03-12T16:10:53.146 INFO:tasks.workunit.client.1.smithi134.stdout:6/857: rename d1/l73 to d1/da6/d55/d94/d127/d32/d4a/d10c/l13c 0 2024-03-12T16:10:53.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:51.500648+0000 mgr.smithi134.gcntfu (mgr.24383) 63 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 130 MiB/s rd, 350 MiB/s wr, 688 op/s 2024-03-12T16:10:53.148 INFO:tasks.workunit.client.1.smithi134.stdout:6/858: chown d1/d16/d4c/d58/d8e/l93 326 1 2024-03-12T16:10:53.148 INFO:tasks.workunit.client.0.smithi006.stdout:4/737: mknod d1/db/d39/dbf/dec/d43/cf5 0 2024-03-12T16:10:53.149 INFO:tasks.workunit.client.1.smithi134.stdout:2/811: rename d4/d12/d1d/l6e to d4/d12/d1d/d34/d47/df1/l126 0 2024-03-12T16:10:53.150 INFO:tasks.workunit.client.0.smithi006.stdout:1/629: symlink d0/d25/d2a/d43/d63/db6/ld7 0 2024-03-12T16:10:53.150 INFO:tasks.workunit.client.0.smithi006.stdout:9/558: write d0/d8/d16/f43 [6334450,55549] 0 2024-03-12T16:10:53.150 INFO:tasks.workunit.client.1.smithi134.stdout:2/812: chown d4/d12/d1d/d34/l50 656 1 2024-03-12T16:10:53.151 INFO:tasks.workunit.client.0.smithi006.stdout:5/565: dwrite d7/d41/f55 [0,4194304] 0 2024-03-12T16:10:53.152 INFO:tasks.workunit.client.1.smithi134.stdout:2/813: fdatasync d4/fc 0 2024-03-12T16:10:53.153 INFO:tasks.workunit.client.1.smithi134.stdout:2/814: readlink d4/d12/d1d/d34/d47/d8c/da4/lef 0 2024-03-12T16:10:53.154 INFO:tasks.workunit.client.0.smithi006.stdout:2/670: fdatasync d0/d13/f7c 0 2024-03-12T16:10:53.154 INFO:tasks.workunit.client.0.smithi006.stdout:9/559: chown d0/d4/d3b 268 1 2024-03-12T16:10:53.155 INFO:tasks.workunit.client.0.smithi006.stdout:1/630: chown d0/d25/d2a/la4 11064 1 2024-03-12T16:10:53.159 INFO:tasks.workunit.client.1.smithi134.stdout:2/815: rename d4/d12/d1d/d34/d58/dbb/ff7 to d4/d12/d1d/d34/dcb/f127 0 2024-03-12T16:10:53.160 INFO:tasks.workunit.client.0.smithi006.stdout:5/566: chown d7/d9/d10/d24/f3e 1159621271 1 2024-03-12T16:10:53.160 INFO:tasks.workunit.client.0.smithi006.stdout:1/631: mkdir d0/d25/d2a/d43/d56/dd8 0 2024-03-12T16:10:53.161 INFO:tasks.workunit.client.1.smithi134.stdout:2/816: readlink d4/d12/d1d/d34/d47/df1/l126 0 2024-03-12T16:10:53.162 INFO:tasks.workunit.client.1.smithi134.stdout:2/817: read d4/d12/d1d/d34/d58/d74/fb0 [230481,51561] 0 2024-03-12T16:10:53.163 INFO:tasks.workunit.client.0.smithi006.stdout:6/640: getdents d3/d11/d10/d1b/d20/d7c 0 2024-03-12T16:10:53.164 INFO:tasks.workunit.client.1.smithi134.stdout:2/818: creat d4/d84/f128 x:0 0 0 2024-03-12T16:10:53.165 INFO:tasks.workunit.client.1.smithi134.stdout:2/819: chown d4/d12/daf/f108 48740640 1 2024-03-12T16:10:53.166 INFO:tasks.workunit.client.0.smithi006.stdout:5/567: creat d7/d9/d10/d24/fb2 x:0 0 0 2024-03-12T16:10:53.167 INFO:tasks.workunit.client.0.smithi006.stdout:1/632: mkdir d0/d25/db1/dd9 0 2024-03-12T16:10:53.167 INFO:tasks.workunit.client.1.smithi134.stdout:2/820: creat d4/d12/d3b/d3f/d114/d117/f129 x:0 0 0 2024-03-12T16:10:53.171 INFO:tasks.workunit.client.0.smithi006.stdout:4/738: getdents d1/db/d1d 0 2024-03-12T16:10:53.174 INFO:tasks.workunit.client.1.smithi134.stdout:6/859: dread d1/d16/d7e/f9a [0,4194304] 0 2024-03-12T16:10:53.174 INFO:tasks.workunit.client.0.smithi006.stdout:2/671: dwrite d0/d13/d49/d60/f53 [0,4194304] 0 2024-03-12T16:10:53.175 INFO:tasks.workunit.client.0.smithi006.stdout:1/633: chown d0/d25/d2a/d43/d68/l8c 6994 1 2024-03-12T16:10:53.175 INFO:tasks.workunit.client.0.smithi006.stdout:8/539: dwrite d2/d11/d5a/f5f [0,4194304] 0 2024-03-12T16:10:53.176 INFO:tasks.workunit.client.1.smithi134.stdout:2/821: truncate d4/d84/d7d/f3a 3555700 0 2024-03-12T16:10:53.177 INFO:tasks.workunit.client.1.smithi134.stdout:2/822: dread - d4/d12/d1d/d34/d58/fcf zero size 2024-03-12T16:10:53.180 INFO:tasks.workunit.client.0.smithi006.stdout:5/568: rename d7/d9/f6a to d7/d9/d31/d3b/d9a/fb3 0 2024-03-12T16:10:53.181 INFO:tasks.workunit.client.0.smithi006.stdout:4/739: creat d1/db/d1d/d2f/ff6 x:0 0 0 2024-03-12T16:10:53.182 INFO:tasks.workunit.client.1.smithi134.stdout:2/823: dwrite d4/d84/fdf [0,4194304] 0 2024-03-12T16:10:53.183 INFO:tasks.workunit.client.0.smithi006.stdout:1/634: unlink d0/l86 0 2024-03-12T16:10:53.187 INFO:tasks.workunit.client.0.smithi006.stdout:2/672: mknod d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/cd2 0 2024-03-12T16:10:53.190 INFO:tasks.workunit.client.0.smithi006.stdout:1/635: creat d0/d25/d67/fda x:0 0 0 2024-03-12T16:10:53.194 INFO:tasks.workunit.client.0.smithi006.stdout:9/560: dwrite d0/d4/d3b/f4b [4194304,4194304] 0 2024-03-12T16:10:53.195 INFO:tasks.workunit.client.1.smithi134.stdout:6/860: dwrite d1/d16/d7e/f9a [0,4194304] 0 2024-03-12T16:10:53.195 INFO:tasks.workunit.client.1.smithi134.stdout:2/824: write d4/f90 [1292049,121518] 0 2024-03-12T16:10:53.197 INFO:tasks.workunit.client.1.smithi134.stdout:6/861: read - d1/d16/d4c/d65/dd1/df9/f128 zero size 2024-03-12T16:10:53.198 INFO:tasks.workunit.client.0.smithi006.stdout:1/636: write d0/f4 [5209388,99935] 0 2024-03-12T16:10:53.198 INFO:tasks.workunit.client.0.smithi006.stdout:2/673: fsync d0/d13/d49/d60/f32 0 2024-03-12T16:10:53.201 INFO:tasks.workunit.client.0.smithi006.stdout:6/641: dwrite d3/d11/d10/d28/f56 [0,4194304] 0 2024-03-12T16:10:53.201 INFO:tasks.workunit.client.0.smithi006.stdout:5/569: truncate d7/d9/d31/d3b/d61/d78/f82 1378773 0 2024-03-12T16:10:53.201 INFO:tasks.workunit.client.0.smithi006.stdout:8/540: link d2/db/f62 d2/d11/d5a/fac 0 2024-03-12T16:10:53.203 INFO:tasks.workunit.client.0.smithi006.stdout:1/637: chown d0/d25/d2a/d43/f92 3 1 2024-03-12T16:10:53.209 INFO:tasks.workunit.client.1.smithi134.stdout:6/862: dread d1/da6/d55/d97/dfd/f119 [0,4194304] 0 2024-03-12T16:10:53.210 INFO:tasks.workunit.client.0.smithi006.stdout:6/642: write d3/d11/d10/da7/d8e/de1/f85 [486442,86016] 0 2024-03-12T16:10:53.210 INFO:tasks.workunit.client.0.smithi006.stdout:8/541: chown d2/d11/d5a/f80 0 1 2024-03-12T16:10:53.211 INFO:tasks.workunit.client.0.smithi006.stdout:6/643: chown d3/d11/d10/d28 4001158 1 2024-03-12T16:10:53.212 INFO:tasks.workunit.client.0.smithi006.stdout:9/561: rename d0/d8/d16/l76 to d0/lbc 0 2024-03-12T16:10:53.213 INFO:tasks.workunit.client.0.smithi006.stdout:6/644: write d3/d11/d10/f7b [4131172,9726] 0 2024-03-12T16:10:53.214 INFO:tasks.workunit.client.0.smithi006.stdout:5/570: symlink d7/d8/lb4 0 2024-03-12T16:10:53.214 INFO:tasks.workunit.client.1.smithi134.stdout:2/825: dwrite d4/d12/f22 [0,4194304] 0 2024-03-12T16:10:53.216 INFO:tasks.workunit.client.0.smithi006.stdout:6/645: stat d3/d11/d10/da7/d8e/de1/f85 0 2024-03-12T16:10:53.216 INFO:tasks.workunit.client.1.smithi134.stdout:6/863: truncate d1/d4/f67 5470416 0 2024-03-12T16:10:53.217 INFO:tasks.workunit.client.1.smithi134.stdout:2/826: mknod d4/d84/d63/d111/c12a 0 2024-03-12T16:10:53.218 INFO:tasks.workunit.client.0.smithi006.stdout:4/740: write d1/db/f64 [3071434,26346] 0 2024-03-12T16:10:53.218 INFO:tasks.workunit.client.1.smithi134.stdout:2/827: truncate d4/d12/d1d/d34/d47/f113 160827 0 2024-03-12T16:10:53.219 INFO:tasks.workunit.client.1.smithi134.stdout:2/828: write d4/d12/d1d/d34/dcb/f104 [342643,88515] 0 2024-03-12T16:10:53.220 INFO:tasks.workunit.client.1.smithi134.stdout:2/829: fsync d4/d84/f55 0 2024-03-12T16:10:53.220 INFO:tasks.workunit.client.0.smithi006.stdout:1/638: rename d0/d25/d67/c74 to d0/d25/d2a/d43/d68/cdb 0 2024-03-12T16:10:53.222 INFO:tasks.workunit.client.0.smithi006.stdout:9/562: symlink d0/d4/d70/lbd 0 2024-03-12T16:10:53.223 INFO:tasks.workunit.client.1.smithi134.stdout:2/830: getdents d4/d12/d3b/d3f/d10a 0 2024-03-12T16:10:53.223 INFO:tasks.workunit.client.1.smithi134.stdout:6/864: fsync d1/da6/d55/fdd 0 2024-03-12T16:10:53.225 INFO:tasks.workunit.client.0.smithi006.stdout:2/674: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f8d 57834 1 2024-03-12T16:10:53.228 INFO:tasks.workunit.client.1.smithi134.stdout:7/888: sync 2024-03-12T16:10:53.230 INFO:tasks.workunit.client.1.smithi134.stdout:6/865: creat d1/da6/d55/d85/ddf/f13d x:0 0 0 2024-03-12T16:10:53.230 INFO:tasks.workunit.client.1.smithi134.stdout:2/831: getdents d4/d12/d1d/d34/d47/d8c/da4 0 2024-03-12T16:10:53.231 INFO:tasks.workunit.client.0.smithi006.stdout:1/639: creat d0/d25/d2a/d43/d63/db6/fdc x:0 0 0 2024-03-12T16:10:53.231 INFO:tasks.workunit.client.1.smithi134.stdout:7/889: symlink d8/dc/d7b/df8/dfd/l11e 0 2024-03-12T16:10:53.232 INFO:tasks.workunit.client.1.smithi134.stdout:6/866: write d1/d4/f47 [1185624,13488] 0 2024-03-12T16:10:53.233 INFO:tasks.workunit.client.1.smithi134.stdout:6/867: chown d1/d3/dcb 7125742 1 2024-03-12T16:10:53.234 INFO:tasks.workunit.client.0.smithi006.stdout:4/741: mkdir d1/db/d39/d42/df2/df7 0 2024-03-12T16:10:53.234 INFO:tasks.workunit.client.1.smithi134.stdout:2/832: creat d4/d84/d63/d111/f12b x:0 0 0 2024-03-12T16:10:53.235 INFO:tasks.workunit.client.1.smithi134.stdout:2/833: write d4/d84/d63/d9d/d3d/f11e [150517,101818] 0 2024-03-12T16:10:53.235 INFO:tasks.workunit.client.1.smithi134.stdout:7/890: symlink d8/dc/d7b/d119/l11f 0 2024-03-12T16:10:53.236 INFO:tasks.workunit.client.0.smithi006.stdout:2/675: dwrite d0/d13/d49/d60/d2b/f56 [4194304,4194304] 0 2024-03-12T16:10:53.240 INFO:tasks.workunit.client.0.smithi006.stdout:1/640: fsync d0/d25/d2a/d43/d56/f7e 0 2024-03-12T16:10:53.241 INFO:tasks.workunit.client.1.smithi134.stdout:6/868: mkdir d1/da6/d55/d94/d127/d32/dd9/d13e 0 2024-03-12T16:10:53.242 INFO:tasks.workunit.client.1.smithi134.stdout:2/834: getdents d4/de8/dea/d105 0 2024-03-12T16:10:53.243 INFO:tasks.workunit.client.1.smithi134.stdout:7/891: creat d8/dc/d20/f120 x:0 0 0 2024-03-12T16:10:53.244 INFO:tasks.workunit.client.0.smithi006.stdout:8/542: rename d2/d11/d6e to d2/db/d1a/d21/dad 0 2024-03-12T16:10:53.246 INFO:tasks.workunit.client.0.smithi006.stdout:4/742: symlink d1/db/d1d/d2f/d6b/lf8 0 2024-03-12T16:10:53.247 INFO:tasks.workunit.client.0.smithi006.stdout:6/646: write d3/d11/d10/da7/d8e/f7a [232531,6878] 0 2024-03-12T16:10:53.248 INFO:tasks.workunit.client.0.smithi006.stdout:4/743: fsync d1/d38/d79/f84 0 2024-03-12T16:10:53.248 INFO:tasks.workunit.client.1.smithi134.stdout:0/824: sync 2024-03-12T16:10:53.248 INFO:tasks.workunit.client.1.smithi134.stdout:1/628: sync 2024-03-12T16:10:53.248 INFO:tasks.workunit.client.1.smithi134.stdout:4/809: sync 2024-03-12T16:10:53.249 INFO:tasks.workunit.client.1.smithi134.stdout:9/845: sync 2024-03-12T16:10:53.249 INFO:tasks.workunit.client.1.smithi134.stdout:8/861: sync 2024-03-12T16:10:53.251 INFO:tasks.workunit.client.1.smithi134.stdout:2/835: unlink d4/d12/d1d/d34/l79 0 2024-03-12T16:10:53.254 INFO:tasks.workunit.client.1.smithi134.stdout:2/836: readlink d4/de8/dea/l11a 0 2024-03-12T16:10:53.254 INFO:tasks.workunit.client.1.smithi134.stdout:1/629: stat d0/d30/d86/f1d 0 2024-03-12T16:10:53.254 INFO:tasks.workunit.client.1.smithi134.stdout:8/862: chown d3/d82/l9c 23 1 2024-03-12T16:10:53.255 INFO:tasks.workunit.client.0.smithi006.stdout:9/563: dread d0/d8/d16/d7d/d20/f34 [0,4194304] 0 2024-03-12T16:10:53.256 INFO:tasks.workunit.client.0.smithi006.stdout:9/564: chown d0/d1f/l68 207 1 2024-03-12T16:10:53.256 INFO:tasks.workunit.client.0.smithi006.stdout:9/565: chown d0/d1f/c49 330525 1 2024-03-12T16:10:53.257 INFO:tasks.workunit.client.1.smithi134.stdout:1/630: dread - d0/d16/d9/d13/d21/d5f/d6f/f87 zero size 2024-03-12T16:10:53.258 INFO:tasks.workunit.client.1.smithi134.stdout:2/837: dread d4/d84/d63/d9d/d3d/f11e [0,4194304] 0 2024-03-12T16:10:53.271 INFO:tasks.workunit.client.1.smithi134.stdout:7/892: truncate d8/dc/d20/d26/f115 737527 0 2024-03-12T16:10:53.272 INFO:tasks.workunit.client.1.smithi134.stdout:7/893: readlink d8/d27/d9d/lc0 0 2024-03-12T16:10:53.274 INFO:tasks.workunit.client.1.smithi134.stdout:9/846: truncate d5/d10/d35/d49/d54/f80 3610468 0 2024-03-12T16:10:53.275 INFO:tasks.workunit.client.1.smithi134.stdout:1/631: truncate d0/d30/d86/f27 1894310 0 2024-03-12T16:10:53.278 INFO:tasks.workunit.client.1.smithi134.stdout:8/863: symlink d3/d82/d104/d31/l127 0 2024-03-12T16:10:53.278 INFO:tasks.workunit.client.1.smithi134.stdout:0/825: dwrite db/d2f/d31/d68/f98 [0,4194304] 0 2024-03-12T16:10:53.283 INFO:tasks.workunit.client.1.smithi134.stdout:4/810: rename d1/d13/le9 to d1/de/d5a/lfc 0 2024-03-12T16:10:53.285 INFO:tasks.workunit.client.1.smithi134.stdout:9/847: mknod d5/d10/d35/d49/d54/df7/cfa 0 2024-03-12T16:10:53.287 INFO:tasks.workunit.client.1.smithi134.stdout:4/811: dread - d1/d13/d49/d64/d28/d4f/ff3 zero size 2024-03-12T16:10:53.289 INFO:tasks.workunit.client.1.smithi134.stdout:8/864: creat d3/d1b/d17/d25/d33/d85/f128 x:0 0 0 2024-03-12T16:10:53.289 INFO:tasks.workunit.client.1.smithi134.stdout:2/838: link d4/d84/d7d/c31 d4/d12/d1d/d34/db7/dc4/c12c 0 2024-03-12T16:10:53.293 INFO:tasks.workunit.client.1.smithi134.stdout:9/848: write d5/d10/d35/dc1/fcf [4445522,31751] 0 2024-03-12T16:10:53.295 INFO:tasks.workunit.client.1.smithi134.stdout:0/826: creat db/d2f/d31/d76/d9f/dcf/f10b x:0 0 0 2024-03-12T16:10:53.299 INFO:tasks.workunit.client.1.smithi134.stdout:8/865: mknod d3/d1b/d17/d24/db6/c129 0 2024-03-12T16:10:53.301 INFO:tasks.workunit.client.1.smithi134.stdout:7/894: getdents d8/dc/d4b/dd9/df4/d7c 0 2024-03-12T16:10:53.305 INFO:tasks.workunit.client.1.smithi134.stdout:8/866: link d3/d82/d104/c76 d3/d1b/d17/d25/d33/d15/d114/c12a 0 2024-03-12T16:10:53.312 INFO:tasks.workunit.client.1.smithi134.stdout:7/895: dread d8/f1a [0,4194304] 0 2024-03-12T16:10:53.312 INFO:tasks.workunit.client.1.smithi134.stdout:2/839: dread d4/d12/d39/f9f [0,4194304] 0 2024-03-12T16:10:53.319 INFO:tasks.workunit.client.1.smithi134.stdout:2/840: rename d4/d12/d3b/d3f/fb5 to d4/d12/f12d 0 2024-03-12T16:10:53.321 INFO:tasks.workunit.client.1.smithi134.stdout:2/841: creat d4/de8/dea/f12e x:0 0 0 2024-03-12T16:10:53.323 INFO:tasks.workunit.client.1.smithi134.stdout:2/842: fsync d4/d84/d7d/fb6 0 2024-03-12T16:10:53.327 INFO:tasks.workunit.client.1.smithi134.stdout:2/843: creat d4/d12/d3b/d3f/d10a/f12f x:0 0 0 2024-03-12T16:10:53.328 INFO:tasks.workunit.client.1.smithi134.stdout:0/827: write db/d2f/d31/d75/fa3 [278593,15873] 0 2024-03-12T16:10:53.328 INFO:tasks.workunit.client.1.smithi134.stdout:1/632: dwrite d0/d16/d9/d13/d21/d2f/f9d [0,4194304] 0 2024-03-12T16:10:53.331 INFO:tasks.workunit.client.1.smithi134.stdout:8/867: write d3/d1b/d17/d25/f101 [100855,6022] 0 2024-03-12T16:10:53.338 INFO:tasks.workunit.client.1.smithi134.stdout:7/896: dwrite d8/dc/d20/d26/d36/f64 [0,4194304] 0 2024-03-12T16:10:53.342 INFO:tasks.workunit.client.1.smithi134.stdout:0/828: creat db/d2f/d51/db4/df1/f10c x:0 0 0 2024-03-12T16:10:53.344 INFO:tasks.workunit.client.1.smithi134.stdout:7/897: fsync d8/dc/d20/f56 0 2024-03-12T16:10:53.347 INFO:tasks.workunit.client.1.smithi134.stdout:8/868: rename d3/d1b/d17/d25/d33/d15/d95/d4f/d65/cab to d3/db0/c12b 0 2024-03-12T16:10:53.350 INFO:tasks.workunit.client.1.smithi134.stdout:0/829: creat db/d2f/d31/d76/df9/f10d x:0 0 0 2024-03-12T16:10:53.351 INFO:tasks.workunit.client.1.smithi134.stdout:7/898: fdatasync d8/dc/d20/f21 0 2024-03-12T16:10:53.354 INFO:tasks.workunit.client.1.smithi134.stdout:0/830: mknod db/dcc/de7/c10e 0 2024-03-12T16:10:53.355 INFO:tasks.workunit.client.0.smithi006.stdout:9/566: fdatasync d0/d4/d18/f44 0 2024-03-12T16:10:53.357 INFO:tasks.workunit.client.1.smithi134.stdout:7/899: truncate d8/dc/d20/d26/d10e/f11a 127187 0 2024-03-12T16:10:53.358 INFO:tasks.workunit.client.1.smithi134.stdout:0/831: symlink db/d2f/d31/d68/da2/dd3/l10f 0 2024-03-12T16:10:53.359 INFO:tasks.workunit.client.1.smithi134.stdout:8/869: dwrite d3/d82/fe7 [0,4194304] 0 2024-03-12T16:10:53.362 INFO:tasks.workunit.client.1.smithi134.stdout:2/844: dread d4/f13 [0,4194304] 0 2024-03-12T16:10:53.364 INFO:tasks.workunit.client.1.smithi134.stdout:8/870: unlink d3/d82/d104/f120 0 2024-03-12T16:10:53.365 INFO:tasks.workunit.client.1.smithi134.stdout:0/832: mknod db/d2f/d31/d56/dbc/c110 0 2024-03-12T16:10:53.366 INFO:tasks.workunit.client.1.smithi134.stdout:6/869: truncate d1/d16/d4c/d58/da0/db7/f9f 3171837 0 2024-03-12T16:10:53.368 INFO:tasks.workunit.client.1.smithi134.stdout:2/845: fsync d4/d12/d1d/d34/d47/d8c/da4/fc0 0 2024-03-12T16:10:53.369 INFO:tasks.workunit.client.1.smithi134.stdout:8/871: read d3/d1b/d17/d25/f90 [1786788,119103] 0 2024-03-12T16:10:53.370 INFO:tasks.workunit.client.1.smithi134.stdout:2/846: fsync d4/d12/d1d/d34/d47/f113 0 2024-03-12T16:10:53.373 INFO:tasks.workunit.client.1.smithi134.stdout:6/870: rmdir d1/d16/d4c/d58/da0 39 2024-03-12T16:10:53.374 INFO:tasks.workunit.client.0.smithi006.stdout:4/744: dwrite d1/db/d1d/d2f/fbd [0,4194304] 0 2024-03-12T16:10:53.374 INFO:tasks.workunit.client.0.smithi006.stdout:1/641: dread d0/f21 [0,4194304] 0 2024-03-12T16:10:53.376 INFO:tasks.workunit.client.1.smithi134.stdout:7/900: write d8/d27/fb6 [362088,65591] 0 2024-03-12T16:10:53.376 INFO:tasks.workunit.client.1.smithi134.stdout:2/847: symlink d4/d12/d1d/d34/d47/d8c/d100/l130 0 2024-03-12T16:10:53.377 INFO:tasks.workunit.client.0.smithi006.stdout:4/745: dread - d1/db/d1d/d2f/ff6 zero size 2024-03-12T16:10:53.377 INFO:tasks.workunit.client.1.smithi134.stdout:7/901: chown d8/db4 6 1 2024-03-12T16:10:53.378 INFO:tasks.workunit.client.1.smithi134.stdout:7/902: chown d8/dc/d20/d26/f3a 2006775117 1 2024-03-12T16:10:53.379 INFO:tasks.workunit.client.1.smithi134.stdout:2/848: mknod d4/d12/d1d/d34/d47/df1/c131 0 2024-03-12T16:10:53.381 INFO:tasks.workunit.client.1.smithi134.stdout:7/903: rmdir d8/dc/d20/d26/d36 39 2024-03-12T16:10:53.382 INFO:tasks.workunit.client.1.smithi134.stdout:2/849: write d4/d12/d3b/d9b/f11f [29527,14756] 0 2024-03-12T16:10:53.385 INFO:tasks.workunit.client.1.smithi134.stdout:8/872: dwrite d3/d82/d104/d31/f53 [0,4194304] 0 2024-03-12T16:10:53.385 INFO:tasks.workunit.client.0.smithi006.stdout:1/642: dwrite d0/d25/d67/fda [0,4194304] 0 2024-03-12T16:10:53.387 INFO:tasks.workunit.client.1.smithi134.stdout:2/850: rmdir d4/d12/d43/da2 39 2024-03-12T16:10:53.388 INFO:tasks.workunit.client.1.smithi134.stdout:8/873: fdatasync d3/d82/d104/f58 0 2024-03-12T16:10:53.398 INFO:tasks.workunit.client.1.smithi134.stdout:8/874: link d3/d1b/d17/d25/d33/d85/cdf d3/d1b/d17/d25/d33/d15/d95/d4f/c12c 0 2024-03-12T16:10:53.401 INFO:tasks.workunit.client.1.smithi134.stdout:8/875: mknod d3/d1b/d17/d25/d33/d85/c12d 0 2024-03-12T16:10:53.405 INFO:tasks.workunit.client.1.smithi134.stdout:7/904: dwrite d8/f1f [0,4194304] 0 2024-03-12T16:10:53.405 INFO:tasks.workunit.client.1.smithi134.stdout:8/876: creat d3/d1b/d17/dff/f12e x:0 0 0 2024-03-12T16:10:53.406 INFO:tasks.workunit.client.1.smithi134.stdout:6/871: dwrite d1/fb2 [0,4194304] 0 2024-03-12T16:10:53.408 INFO:tasks.workunit.client.1.smithi134.stdout:6/872: fsync d1/d16/d4c/d58/f108 0 2024-03-12T16:10:53.413 INFO:tasks.workunit.client.1.smithi134.stdout:8/877: mknod d3/d82/d104/dbf/c12f 0 2024-03-12T16:10:53.415 INFO:tasks.workunit.client.1.smithi134.stdout:6/873: creat d1/d16/d7e/d13b/f13f x:0 0 0 2024-03-12T16:10:53.415 INFO:tasks.workunit.client.1.smithi134.stdout:7/905: dread d8/dc/f5d [0,4194304] 0 2024-03-12T16:10:53.416 INFO:tasks.workunit.client.1.smithi134.stdout:7/906: stat d8/l71 0 2024-03-12T16:10:53.416 INFO:tasks.workunit.client.1.smithi134.stdout:8/878: symlink d3/d1b/d17/l130 0 2024-03-12T16:10:53.420 INFO:tasks.workunit.client.0.smithi006.stdout:2/676: link d0/d13/d49/d60/fd0 d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fd3 0 2024-03-12T16:10:53.421 INFO:tasks.workunit.client.1.smithi134.stdout:6/874: creat d1/d16/d7e/f140 x:0 0 0 2024-03-12T16:10:53.422 INFO:tasks.workunit.client.1.smithi134.stdout:7/907: dread d8/f24 [0,4194304] 0 2024-03-12T16:10:53.424 INFO:tasks.workunit.client.0.smithi006.stdout:9/567: rmdir d0/d4/d70 39 2024-03-12T16:10:53.425 INFO:tasks.workunit.client.1.smithi134.stdout:7/908: truncate d8/dc/d20/d26/f37 1574121 0 2024-03-12T16:10:53.428 INFO:tasks.workunit.client.0.smithi006.stdout:4/746: fsync d1/db/d1d/d2f/d6b/fa4 0 2024-03-12T16:10:53.428 INFO:tasks.workunit.client.1.smithi134.stdout:7/909: rename d8/d27/d9d/dc9/lf3 to d8/dc/d4b/d97/l121 0 2024-03-12T16:10:53.429 INFO:tasks.workunit.client.1.smithi134.stdout:6/875: creat d1/da6/d55/d94/d127/d32/dd9/d13e/f141 x:0 0 0 2024-03-12T16:10:53.430 INFO:tasks.workunit.client.1.smithi134.stdout:7/910: fsync d8/dc/d7b/dbb/dbd/dd5/fce 0 2024-03-12T16:10:53.431 INFO:tasks.workunit.client.1.smithi134.stdout:7/911: readlink d8/dc/d55/db9/lfc 0 2024-03-12T16:10:53.432 INFO:tasks.workunit.client.0.smithi006.stdout:5/571: rename d7/d9/d31/d3b/d61/d78 to d7/d9/d31/d3b/d4f/db5 0 2024-03-12T16:10:53.432 INFO:tasks.workunit.client.1.smithi134.stdout:7/912: fsync d8/d27/d5b/f112 0 2024-03-12T16:10:53.434 INFO:tasks.workunit.client.0.smithi006.stdout:6/647: link d3/d11/d3b/cce d3/d11/d10/d1b/d20/d78/ce9 0 2024-03-12T16:10:53.434 INFO:tasks.workunit.client.1.smithi134.stdout:7/913: mknod d8/d4e/d91/c122 0 2024-03-12T16:10:53.435 INFO:tasks.workunit.client.0.smithi006.stdout:6/648: readlink d3/l63 0 2024-03-12T16:10:53.436 INFO:tasks.workunit.client.0.smithi006.stdout:6/649: truncate d3/d11/d43/f46 3003701 0 2024-03-12T16:10:53.438 INFO:tasks.workunit.client.1.smithi134.stdout:7/914: mkdir d8/dc/d7b/df8/d123 0 2024-03-12T16:10:53.439 INFO:tasks.workunit.client.0.smithi006.stdout:4/747: unlink d1/db/d39/d42/d61/cdf 0 2024-03-12T16:10:53.440 INFO:tasks.workunit.client.1.smithi134.stdout:6/876: dwrite d1/da6/d55/d94/d127/d32/f102 [0,4194304] 0 2024-03-12T16:10:53.440 INFO:tasks.workunit.client.1.smithi134.stdout:8/879: truncate d3/d82/d104/d31/f53 39847 0 2024-03-12T16:10:53.442 INFO:tasks.workunit.client.1.smithi134.stdout:8/880: dread - d3/d82/d104/fba zero size 2024-03-12T16:10:53.442 INFO:tasks.workunit.client.1.smithi134.stdout:7/915: symlink d8/dc/d7b/dbb/l124 0 2024-03-12T16:10:53.443 INFO:tasks.workunit.client.0.smithi006.stdout:1/643: rename d0/d25/d2a/d64/fcd to d0/d25/d67/dc1/fdd 0 2024-03-12T16:10:53.444 INFO:tasks.workunit.client.0.smithi006.stdout:9/568: dwrite d0/d8/d16/d7d/d20/f51 [4194304,4194304] 0 2024-03-12T16:10:53.444 INFO:tasks.workunit.client.1.smithi134.stdout:7/916: truncate d8/dc/d20/d26/f11c 384913 0 2024-03-12T16:10:53.449 INFO:tasks.workunit.client.1.smithi134.stdout:7/917: mknod d8/dc/d7b/d119/c125 0 2024-03-12T16:10:53.450 INFO:tasks.workunit.client.0.smithi006.stdout:5/572: creat d7/d9/d31/d3b/d4f/d80/d88/fb6 x:0 0 0 2024-03-12T16:10:53.452 INFO:tasks.workunit.client.0.smithi006.stdout:4/748: dread d1/db/d39/dbf/dec/d43/db5/fdc [0,4194304] 0 2024-03-12T16:10:53.452 INFO:tasks.workunit.client.0.smithi006.stdout:0/667: sync 2024-03-12T16:10:53.452 INFO:tasks.workunit.client.0.smithi006.stdout:7/762: sync 2024-03-12T16:10:53.452 INFO:tasks.workunit.client.0.smithi006.stdout:2/677: mknod d0/d13/d49/d60/d2b/d82/cd4 0 2024-03-12T16:10:53.454 INFO:tasks.workunit.client.0.smithi006.stdout:6/650: creat d3/d11/d10/da7/d8e/d8b/fea x:0 0 0 2024-03-12T16:10:53.460 INFO:tasks.workunit.client.1.smithi134.stdout:7/918: dwrite d8/dc/fcf [4194304,4194304] 0 2024-03-12T16:10:53.461 INFO:tasks.workunit.client.0.smithi006.stdout:1/644: mknod d0/d25/d2a/d43/d63/cde 0 2024-03-12T16:10:53.464 INFO:tasks.workunit.client.1.smithi134.stdout:7/919: mknod d8/dc/d7b/dbb/d11b/c126 0 2024-03-12T16:10:53.465 INFO:tasks.workunit.client.0.smithi006.stdout:4/749: dwrite d1/db/d1d/d2f/fc0 [0,4194304] 0 2024-03-12T16:10:53.466 INFO:tasks.workunit.client.0.smithi006.stdout:0/668: mknod d2/d39/d42/d82/ccc 0 2024-03-12T16:10:53.468 INFO:tasks.workunit.client.1.smithi134.stdout:7/920: getdents d8/db4 0 2024-03-12T16:10:53.471 INFO:tasks.workunit.client.0.smithi006.stdout:6/651: creat d3/d11/d10/d1b/d20/d7c/feb x:0 0 0 2024-03-12T16:10:53.471 INFO:tasks.workunit.client.0.smithi006.stdout:9/569: truncate d0/d4/d70/f8e 718802 0 2024-03-12T16:10:53.472 INFO:tasks.workunit.client.0.smithi006.stdout:6/652: chown d3/d11/d10/da7/dd5/ddb/le5 651791356 1 2024-03-12T16:10:53.477 INFO:tasks.workunit.client.1.smithi134.stdout:7/921: write d8/dc/d4b/fb5 [2998987,34265] 0 2024-03-12T16:10:53.478 INFO:tasks.workunit.client.0.smithi006.stdout:1/645: symlink d0/d25/d2a/d43/ldf 0 2024-03-12T16:10:53.481 INFO:tasks.workunit.client.0.smithi006.stdout:6/653: dread d3/d11/d3b/f95 [0,4194304] 0 2024-03-12T16:10:53.482 INFO:tasks.workunit.client.1.smithi134.stdout:8/881: dread d3/d1b/d17/d25/d33/d15/d95/d5b/fb9 [0,4194304] 0 2024-03-12T16:10:53.486 INFO:tasks.workunit.client.1.smithi134.stdout:8/882: creat d3/d1b/d17/d25/d33/d15/f131 x:0 0 0 2024-03-12T16:10:53.486 INFO:tasks.workunit.client.0.smithi006.stdout:5/573: rename d7/d9/d31/d3b/d4f/d65/faf to d7/d9/d31/d3b/d4f/fb7 0 2024-03-12T16:10:53.489 INFO:tasks.workunit.client.1.smithi134.stdout:8/883: dread d3/d1b/d17/d25/d33/d15/d95/d5b/fb9 [0,4194304] 0 2024-03-12T16:10:53.491 INFO:tasks.workunit.client.0.smithi006.stdout:6/654: creat d3/d11/d10/d19/fec x:0 0 0 2024-03-12T16:10:53.494 INFO:tasks.workunit.client.0.smithi006.stdout:8/543: dwrite d2/db/f20 [0,4194304] 0 2024-03-12T16:10:53.496 INFO:tasks.workunit.client.0.smithi006.stdout:4/750: dread d1/db/d39/d42/d61/fc7 [0,4194304] 0 2024-03-12T16:10:53.496 INFO:tasks.workunit.client.0.smithi006.stdout:1/646: getdents d0/d25/d2a/d43/dd1 0 2024-03-12T16:10:53.497 INFO:tasks.workunit.client.0.smithi006.stdout:2/678: link d0/dc/c70 d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/db3/cd5 0 2024-03-12T16:10:53.498 INFO:tasks.workunit.client.0.smithi006.stdout:4/751: chown d1/db/d39/dbf/dec/f1c 5 1 2024-03-12T16:10:53.501 INFO:tasks.workunit.client.0.smithi006.stdout:6/655: creat d3/d11/d3b/fed x:0 0 0 2024-03-12T16:10:53.503 INFO:tasks.workunit.client.0.smithi006.stdout:5/574: mknod d7/d9/cb8 0 2024-03-12T16:10:53.504 INFO:tasks.workunit.client.0.smithi006.stdout:5/575: chown d7/d9/d31/fa5 88654409 1 2024-03-12T16:10:53.507 INFO:tasks.workunit.client.0.smithi006.stdout:8/544: creat d2/dab/fae x:0 0 0 2024-03-12T16:10:53.508 INFO:tasks.workunit.client.0.smithi006.stdout:8/545: stat d2/db/d1a/d21/d4f/f56 0 2024-03-12T16:10:53.509 INFO:tasks.workunit.client.0.smithi006.stdout:6/656: symlink d3/d11/d10/da7/d8e/d8b/lee 0 2024-03-12T16:10:53.510 INFO:tasks.workunit.client.0.smithi006.stdout:1/647: mkdir d0/d25/d2a/d43/de0 0 2024-03-12T16:10:53.513 INFO:tasks.workunit.client.0.smithi006.stdout:6/657: chown d3/d11/d10/da7/d8e/d8b/l98 31165 1 2024-03-12T16:10:53.514 INFO:tasks.workunit.client.0.smithi006.stdout:8/546: creat d2/db/d1a/d7a/faf x:0 0 0 2024-03-12T16:10:53.516 INFO:tasks.workunit.client.1.smithi134.stdout:6/877: dwrite d1/d3a/db5/deb/f11a [0,4194304] 0 2024-03-12T16:10:53.518 INFO:tasks.workunit.client.0.smithi006.stdout:1/648: chown d0/d25/d2a/d43/f87 160 1 2024-03-12T16:10:53.520 INFO:tasks.workunit.client.0.smithi006.stdout:8/547: creat d2/db/d1a/d1f/fb0 x:0 0 0 2024-03-12T16:10:53.521 INFO:tasks.workunit.client.0.smithi006.stdout:7/763: write de/d7b/d7e/f94 [1060164,8803] 0 2024-03-12T16:10:53.525 INFO:tasks.workunit.client.0.smithi006.stdout:1/649: fsync d0/fc 0 2024-03-12T16:10:53.528 INFO:tasks.workunit.client.1.smithi134.stdout:6/878: creat d1/d16/d100/f142 x:0 0 0 2024-03-12T16:10:53.529 INFO:tasks.workunit.client.0.smithi006.stdout:4/752: dread d1/db/d39/dbf/dec/f53 [0,4194304] 0 2024-03-12T16:10:53.529 INFO:tasks.workunit.client.0.smithi006.stdout:2/679: dread d0/d13/d49/d60/f32 [0,4194304] 0 2024-03-12T16:10:53.539 INFO:tasks.workunit.client.0.smithi006.stdout:4/753: creat d1/db/d1d/d2f/d6b/ff9 x:0 0 0 2024-03-12T16:10:53.541 INFO:tasks.workunit.client.0.smithi006.stdout:1/650: rename d0/d25/d67/ld3 to d0/d25/d2a/d43/d63/db6/le1 0 2024-03-12T16:10:53.541 INFO:tasks.workunit.client.0.smithi006.stdout:9/570: dwrite d0/d4/d18/d4d/f75 [0,4194304] 0 2024-03-12T16:10:53.546 INFO:tasks.workunit.client.1.smithi134.stdout:6/879: dread d1/d4/f42 [0,4194304] 0 2024-03-12T16:10:53.548 INFO:tasks.workunit.client.0.smithi006.stdout:9/571: write d0/d4/d3b/f4b [5004778,115740] 0 2024-03-12T16:10:53.548 INFO:tasks.workunit.client.1.smithi134.stdout:6/880: read d1/da6/d55/d94/f6f [1209840,32132] 0 2024-03-12T16:10:53.549 INFO:tasks.workunit.client.0.smithi006.stdout:4/754: write d1/db/d1d/d2f/d6b/fe0 [708585,26465] 0 2024-03-12T16:10:53.549 INFO:tasks.workunit.client.0.smithi006.stdout:0/669: dwrite d2/d39/d42/f56 [0,4194304] 0 2024-03-12T16:10:53.550 INFO:tasks.workunit.client.0.smithi006.stdout:5/576: write d7/d9/d31/d3b/d61/f9c [1741125,114232] 0 2024-03-12T16:10:53.556 INFO:tasks.workunit.client.0.smithi006.stdout:8/548: dread d2/db/f6c [0,4194304] 0 2024-03-12T16:10:53.556 INFO:tasks.workunit.client.0.smithi006.stdout:1/651: mknod d0/d25/d2a/d35/dce/ce2 0 2024-03-12T16:10:53.556 INFO:tasks.workunit.client.0.smithi006.stdout:6/658: truncate d3/d11/d10/da7/d9e/daa/fb9 3288157 0 2024-03-12T16:10:53.558 INFO:tasks.workunit.client.0.smithi006.stdout:6/659: fsync d3/d47/fdf 0 2024-03-12T16:10:53.558 INFO:tasks.workunit.client.0.smithi006.stdout:5/577: unlink d7/d9/d47/d56/l7b 0 2024-03-12T16:10:53.559 INFO:tasks.workunit.client.0.smithi006.stdout:6/660: readlink d3/d11/d43/l51 0 2024-03-12T16:10:53.561 INFO:tasks.workunit.client.0.smithi006.stdout:6/661: fsync d3/d11/d3b/fed 0 2024-03-12T16:10:53.564 INFO:tasks.workunit.client.0.smithi006.stdout:9/572: creat d0/d8/d16/d7d/db5/fbe x:0 0 0 2024-03-12T16:10:53.568 INFO:tasks.workunit.client.0.smithi006.stdout:9/573: chown d0/d8/d16/d2f/lb9 135 1 2024-03-12T16:10:53.570 INFO:tasks.workunit.client.0.smithi006.stdout:7/764: dwrite de/d1c/d87/ddb/f69 [0,4194304] 0 2024-03-12T16:10:53.570 INFO:tasks.workunit.client.0.smithi006.stdout:5/578: mkdir d7/d9/d31/d3b/d6b/db9 0 2024-03-12T16:10:53.573 INFO:tasks.workunit.client.1.smithi134.stdout:6/881: write d1/da6/d55/d94/d127/d32/d4a/f7a [1738770,123789] 0 2024-03-12T16:10:53.575 INFO:tasks.workunit.client.0.smithi006.stdout:1/652: dread d0/d25/d2a/d35/db3/fbb [0,4194304] 0 2024-03-12T16:10:53.578 INFO:tasks.workunit.client.1.smithi134.stdout:6/882: mknod d1/d3a/db5/c143 0 2024-03-12T16:10:53.579 INFO:tasks.workunit.client.0.smithi006.stdout:5/579: dread d7/d8/d8a/fad [0,4194304] 0 2024-03-12T16:10:53.580 INFO:tasks.workunit.client.0.smithi006.stdout:9/574: symlink d0/d4/d70/d71/lbf 0 2024-03-12T16:10:53.581 INFO:tasks.workunit.client.0.smithi006.stdout:0/670: truncate d2/f4b 2109357 0 2024-03-12T16:10:53.584 INFO:tasks.workunit.client.0.smithi006.stdout:0/671: chown d2/d39/d42/f68 6428176 1 2024-03-12T16:10:53.585 INFO:tasks.workunit.client.0.smithi006.stdout:4/755: dwrite d1/db/d1d/d2f/f9b [0,4194304] 0 2024-03-12T16:10:53.586 INFO:tasks.workunit.client.0.smithi006.stdout:8/549: creat d2/db/fb1 x:0 0 0 2024-03-12T16:10:53.587 INFO:tasks.workunit.client.0.smithi006.stdout:0/672: write d2/d88/fae [71871,56023] 0 2024-03-12T16:10:53.588 INFO:tasks.workunit.client.0.smithi006.stdout:1/653: write d0/f2f [2314996,46992] 0 2024-03-12T16:10:53.591 INFO:tasks.workunit.client.0.smithi006.stdout:7/765: mkdir de/d2c/d93/dbe/d4a/d100 0 2024-03-12T16:10:53.594 INFO:tasks.workunit.client.0.smithi006.stdout:6/662: rmdir d3/d11/d10/da7/d8e/de1/d71 0 2024-03-12T16:10:53.600 INFO:tasks.workunit.client.0.smithi006.stdout:8/550: mknod d2/db/d1a/d21/dad/cb2 0 2024-03-12T16:10:53.601 INFO:tasks.workunit.client.1.smithi134.stdout:6/883: rename d1/d16/d4c/d65/d70 to d1/da6/d55/d94/d127/d32/dd9/d13e/d144 0 2024-03-12T16:10:53.602 INFO:tasks.workunit.client.0.smithi006.stdout:1/654: symlink d0/d25/d2a/d35/d3f/le3 0 2024-03-12T16:10:53.603 INFO:tasks.workunit.client.0.smithi006.stdout:7/766: mknod de/dc2/c101 0 2024-03-12T16:10:53.604 INFO:tasks.workunit.client.0.smithi006.stdout:5/580: dread d7/d8/f4c [0,4194304] 0 2024-03-12T16:10:53.606 INFO:tasks.workunit.client.0.smithi006.stdout:6/663: rmdir d3/d11/d10/d9a 39 2024-03-12T16:10:53.607 INFO:tasks.workunit.client.1.smithi134.stdout:4/812: sync 2024-03-12T16:10:53.608 INFO:tasks.workunit.client.0.smithi006.stdout:0/673: dwrite d2/f2c [0,4194304] 0 2024-03-12T16:10:53.608 INFO:tasks.workunit.client.1.smithi134.stdout:4/813: write d1/d13/d49/d53/dd6/fe5 [768914,51605] 0 2024-03-12T16:10:53.610 INFO:tasks.workunit.client.1.smithi134.stdout:4/814: mknod d1/d13/cfd 0 2024-03-12T16:10:53.612 INFO:tasks.workunit.client.0.smithi006.stdout:9/575: write d0/d8/d16/d7d/d20/fa4 [77485,110506] 0 2024-03-12T16:10:53.614 INFO:tasks.workunit.client.1.smithi134.stdout:6/884: link d1/d16/d7e/ca3 d1/d3a/c145 0 2024-03-12T16:10:53.617 INFO:tasks.workunit.client.1.smithi134.stdout:4/815: write d1/d13/d49/f66 [264148,92270] 0 2024-03-12T16:10:53.617 INFO:tasks.workunit.client.0.smithi006.stdout:7/767: creat de/d1c/d87/ddb/d97/f102 x:0 0 0 2024-03-12T16:10:53.619 INFO:tasks.workunit.client.1.smithi134.stdout:4/816: chown d1/d13/d49/d64/da3/df4 11201737 1 2024-03-12T16:10:53.620 INFO:tasks.workunit.client.0.smithi006.stdout:7/768: write de/d2c/d93/dbe/d4a/ff3 [801335,107248] 0 2024-03-12T16:10:53.621 INFO:tasks.workunit.client.1.smithi134.stdout:4/817: creat d1/d24/d34/ffe x:0 0 0 2024-03-12T16:10:53.621 INFO:tasks.workunit.client.0.smithi006.stdout:8/551: symlink d2/lb3 0 2024-03-12T16:10:53.623 INFO:tasks.workunit.client.1.smithi134.stdout:4/818: creat d1/de/d5a/d70/fff x:0 0 0 2024-03-12T16:10:53.624 INFO:tasks.workunit.client.0.smithi006.stdout:7/769: write de/d7b/d7e/f94 [4965825,119619] 0 2024-03-12T16:10:53.625 INFO:tasks.workunit.client.1.smithi134.stdout:4/819: symlink d1/d13/d49/d64/da3/l100 0 2024-03-12T16:10:53.626 INFO:tasks.workunit.client.0.smithi006.stdout:1/655: mknod d0/d25/d2a/d43/ce4 0 2024-03-12T16:10:53.627 INFO:tasks.workunit.client.1.smithi134.stdout:6/885: rename d1/l77 to d1/d16/d4c/d65/dd1/l146 0 2024-03-12T16:10:53.627 INFO:tasks.workunit.client.1.smithi134.stdout:4/820: dread - d1/d13/d49/d64/d28/d4f/dbe/fc6 zero size 2024-03-12T16:10:53.629 INFO:tasks.workunit.client.0.smithi006.stdout:9/576: rename d0/d4/d18/d4d/d99 to d0/d83/d90/dc0 0 2024-03-12T16:10:53.629 INFO:tasks.workunit.client.1.smithi134.stdout:4/821: creat d1/d13/d49/f101 x:0 0 0 2024-03-12T16:10:53.630 INFO:tasks.workunit.client.1.smithi134.stdout:6/886: mkdir d1/d16/d4c/d65/d61/d147 0 2024-03-12T16:10:53.631 INFO:tasks.workunit.client.1.smithi134.stdout:4/822: truncate d1/d13/d49/d64/f92 1001655 0 2024-03-12T16:10:53.632 INFO:tasks.workunit.client.1.smithi134.stdout:4/823: truncate d1/de/d5a/d84/fe3 1043381 0 2024-03-12T16:10:53.633 INFO:tasks.workunit.client.0.smithi006.stdout:8/552: truncate d2/db/d1a/d23/f91 68960 0 2024-03-12T16:10:53.634 INFO:tasks.workunit.client.1.smithi134.stdout:4/824: creat d1/d13/d49/da4/f102 x:0 0 0 2024-03-12T16:10:53.636 INFO:tasks.workunit.client.1.smithi134.stdout:6/887: unlink d1/d16/d7e/ca3 0 2024-03-12T16:10:53.637 INFO:tasks.workunit.client.0.smithi006.stdout:5/581: dread d7/d9/d10/f39 [0,4194304] 0 2024-03-12T16:10:53.637 INFO:tasks.workunit.client.0.smithi006.stdout:1/656: dwrite d0/d25/d2a/f54 [0,4194304] 0 2024-03-12T16:10:53.639 INFO:tasks.workunit.client.0.smithi006.stdout:6/664: symlink d3/d11/d10/lef 0 2024-03-12T16:10:53.640 INFO:tasks.workunit.client.0.smithi006.stdout:1/657: fdatasync d0/fe 0 2024-03-12T16:10:53.641 INFO:tasks.workunit.client.1.smithi134.stdout:4/825: dwrite d1/d24/d34/d73/fe0 [0,4194304] 0 2024-03-12T16:10:53.643 INFO:tasks.workunit.client.0.smithi006.stdout:8/553: creat d2/db/d1a/fb4 x:0 0 0 2024-03-12T16:10:53.645 INFO:tasks.workunit.client.1.smithi134.stdout:4/826: truncate d1/d24/d34/d8e/f98 439094 0 2024-03-12T16:10:53.646 INFO:tasks.workunit.client.1.smithi134.stdout:4/827: chown d1/d24/ddd 489354230 1 2024-03-12T16:10:53.646 INFO:tasks.workunit.client.1.smithi134.stdout:4/828: rmdir d1 39 2024-03-12T16:10:53.650 INFO:tasks.workunit.client.0.smithi006.stdout:0/674: truncate d2/d6/d10/f75 1861014 0 2024-03-12T16:10:53.654 INFO:tasks.workunit.client.1.smithi134.stdout:4/829: dwrite d1/d24/d34/fd9 [4194304,4194304] 0 2024-03-12T16:10:53.655 INFO:tasks.workunit.client.0.smithi006.stdout:5/582: mkdir d7/d9/d31/d3b/dba 0 2024-03-12T16:10:53.655 INFO:tasks.workunit.client.0.smithi006.stdout:7/770: write de/d2c/d93/dbe/f57 [578189,10581] 0 2024-03-12T16:10:53.657 INFO:tasks.workunit.client.1.smithi134.stdout:4/830: rmdir d1/de/d90 39 2024-03-12T16:10:53.657 INFO:tasks.workunit.client.0.smithi006.stdout:8/554: link d2/db/d1a/fb4 d2/db/d1a/d21/d4f/fb5 0 2024-03-12T16:10:53.659 INFO:tasks.workunit.client.0.smithi006.stdout:0/675: mknod d2/d6/d10/d11/d32/da4/ccd 0 2024-03-12T16:10:53.660 INFO:tasks.workunit.client.0.smithi006.stdout:9/577: dread d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:53.660 INFO:tasks.workunit.client.1.smithi134.stdout:4/831: truncate d1/d13/d49/d53/fba 1336453 0 2024-03-12T16:10:53.663 INFO:tasks.workunit.client.1.smithi134.stdout:4/832: symlink d1/d24/d34/d73/l103 0 2024-03-12T16:10:53.664 INFO:tasks.workunit.client.1.smithi134.stdout:4/833: readlink d1/de/d5a/lfc 0 2024-03-12T16:10:53.665 INFO:tasks.workunit.client.1.smithi134.stdout:4/834: chown d1/d13/d49/d64/d28/d4f/f9c 506579 1 2024-03-12T16:10:53.666 INFO:tasks.workunit.client.1.smithi134.stdout:4/835: chown d1/d13/d49/f78 28210251 1 2024-03-12T16:10:53.666 INFO:tasks.workunit.client.0.smithi006.stdout:7/771: truncate de/d2c/d93/dbe/f65 534544 0 2024-03-12T16:10:53.669 INFO:tasks.workunit.client.1.smithi134.stdout:4/836: creat d1/d13/d49/f104 x:0 0 0 2024-03-12T16:10:53.671 INFO:tasks.workunit.client.0.smithi006.stdout:6/665: chown d3/d11/d10/d28/f53 16755 1 2024-03-12T16:10:53.674 INFO:tasks.workunit.client.0.smithi006.stdout:0/676: mknod d2/d6/d10/d11/d7e/cce 0 2024-03-12T16:10:53.675 INFO:tasks.workunit.client.0.smithi006.stdout:0/677: fsync d2/d6/fb6 0 2024-03-12T16:10:53.676 INFO:tasks.workunit.client.0.smithi006.stdout:5/583: mknod d7/d9/d47/d56/cbb 0 2024-03-12T16:10:53.676 INFO:tasks.workunit.client.1.smithi134.stdout:4/837: getdents d1/d13/d49/d64/d28/d4f/dbe 0 2024-03-12T16:10:53.676 INFO:tasks.workunit.client.0.smithi006.stdout:0/678: chown d2/d6/d10/d11/d32/cb8 1114903 1 2024-03-12T16:10:53.677 INFO:tasks.workunit.client.0.smithi006.stdout:7/772: creat de/d2c/d4f/dba/d40/f103 x:0 0 0 2024-03-12T16:10:53.679 INFO:tasks.workunit.client.1.smithi134.stdout:4/838: read d1/d13/d49/da4/fec [3693956,97936] 0 2024-03-12T16:10:53.680 INFO:tasks.workunit.client.0.smithi006.stdout:8/555: write d2/d11/f9d [6105763,127156] 0 2024-03-12T16:10:53.680 INFO:tasks.workunit.client.0.smithi006.stdout:7/773: read de/dc2/f9d [1563107,44436] 0 2024-03-12T16:10:53.682 INFO:tasks.workunit.client.1.smithi134.stdout:4/839: mkdir d1/d13/d49/d64/d28/d4f/d105 0 2024-03-12T16:10:53.682 INFO:tasks.workunit.client.1.smithi134.stdout:4/840: fdatasync d1/d24/d34/fd9 0 2024-03-12T16:10:53.685 INFO:tasks.workunit.client.0.smithi006.stdout:9/578: write d0/d8/d16/d7d/d20/faf [512945,39430] 0 2024-03-12T16:10:53.686 INFO:tasks.workunit.client.0.smithi006.stdout:1/658: link d0/d25/d2a/d43/l6f d0/d25/d2a/d43/le5 0 2024-03-12T16:10:53.687 INFO:tasks.workunit.client.1.smithi134.stdout:4/841: truncate d1/d13/f80 841650 0 2024-03-12T16:10:53.688 INFO:tasks.workunit.client.1.smithi134.stdout:4/842: readlink d1/l38 0 2024-03-12T16:10:53.690 INFO:tasks.workunit.client.0.smithi006.stdout:6/666: rename d3/d11/d10/f7b to d3/d11/d3b/db4/dc3/ff0 0 2024-03-12T16:10:53.691 INFO:tasks.workunit.client.1.smithi134.stdout:4/843: link d1/d13/d49/d64/da3/fc8 d1/d24/ddd/ded/f106 0 2024-03-12T16:10:53.693 INFO:tasks.workunit.client.1.smithi134.stdout:4/844: creat d1/d13/d49/d64/d28/d4f/d67/f107 x:0 0 0 2024-03-12T16:10:53.694 INFO:tasks.workunit.client.0.smithi006.stdout:0/679: symlink d2/d6/lcf 0 2024-03-12T16:10:53.695 INFO:tasks.workunit.client.1.smithi134.stdout:4/845: truncate d1/d13/d49/d64/da3/fb9 138572 0 2024-03-12T16:10:53.696 INFO:tasks.workunit.client.0.smithi006.stdout:3/559: sync 2024-03-12T16:10:53.697 INFO:tasks.workunit.client.1.smithi134.stdout:4/846: unlink d1/d13/d49/d6d/c5d 0 2024-03-12T16:10:53.697 INFO:tasks.workunit.client.0.smithi006.stdout:9/579: creat d0/d83/d90/dc0/fc1 x:0 0 0 2024-03-12T16:10:53.702 INFO:tasks.workunit.client.1.smithi134.stdout:0/833: sync 2024-03-12T16:10:53.702 INFO:tasks.workunit.client.1.smithi134.stdout:2/851: sync 2024-03-12T16:10:53.702 INFO:tasks.workunit.client.1.smithi134.stdout:9/849: sync 2024-03-12T16:10:53.702 INFO:tasks.workunit.client.1.smithi134.stdout:1/633: sync 2024-03-12T16:10:53.703 INFO:tasks.workunit.client.1.smithi134.stdout:1/634: creat d0/d42/d47/fd6 x:0 0 0 2024-03-12T16:10:53.703 INFO:tasks.workunit.client.0.smithi006.stdout:8/556: dwrite d2/db/d1a/d1f/f64 [0,4194304] 0 2024-03-12T16:10:53.705 INFO:tasks.workunit.client.0.smithi006.stdout:0/680: mkdir d2/d6/d10/d11/d1d/d79/dd0 0 2024-03-12T16:10:53.706 INFO:tasks.workunit.client.1.smithi134.stdout:4/847: dwrite d1/d13/d49/d64/d28/d4f/dbe/ff7 [0,4194304] 0 2024-03-12T16:10:53.706 INFO:tasks.workunit.client.1.smithi134.stdout:9/850: fsync d5/d10/d1f/fbc 0 2024-03-12T16:10:53.708 INFO:tasks.workunit.client.1.smithi134.stdout:2/852: rename d4/d84/d63/d9d/dba/c123 to d4/d12/daf/c132 0 2024-03-12T16:10:53.709 INFO:tasks.workunit.client.1.smithi134.stdout:1/635: chown d0/d16/d9/d13/d21/d20/c50 48602852 1 2024-03-12T16:10:53.710 INFO:tasks.workunit.client.0.smithi006.stdout:9/580: rmdir d0/d4/d3b 39 2024-03-12T16:10:53.712 INFO:tasks.workunit.client.1.smithi134.stdout:9/851: symlink d5/d10/d6c/lfb 0 2024-03-12T16:10:53.712 INFO:tasks.workunit.client.0.smithi006.stdout:7/774: creat de/d2c/d93/dbe/d4a/f104 x:0 0 0 2024-03-12T16:10:53.713 INFO:tasks.workunit.client.0.smithi006.stdout:0/681: dwrite d2/f1f [0,4194304] 0 2024-03-12T16:10:53.714 INFO:tasks.workunit.client.0.smithi006.stdout:5/584: link d7/d9/d31/d3b/d4f/ca4 d7/d9/d31/d3b/d4f/d9e/cbc 0 2024-03-12T16:10:53.715 INFO:tasks.workunit.client.1.smithi134.stdout:0/834: link db/d2f/d61/d7a/c9b db/dcc/c111 0 2024-03-12T16:10:53.717 INFO:tasks.workunit.client.1.smithi134.stdout:0/835: fsync db/d2f/d31/d75/fb1 0 2024-03-12T16:10:53.718 INFO:tasks.workunit.client.0.smithi006.stdout:3/560: creat d8/d4c/db2/fbf x:0 0 0 2024-03-12T16:10:53.720 INFO:tasks.workunit.client.0.smithi006.stdout:1/659: rename d0/d25/d2a/la4 to d0/d25/le6 0 2024-03-12T16:10:53.722 INFO:tasks.workunit.client.0.smithi006.stdout:0/682: unlink d2/d6/d10/l16 0 2024-03-12T16:10:53.723 INFO:tasks.workunit.client.0.smithi006.stdout:7/775: dwrite de/d7b/d7e/ffb [0,4194304] 0 2024-03-12T16:10:53.725 INFO:tasks.workunit.client.0.smithi006.stdout:9/581: creat d0/d4/da7/fc2 x:0 0 0 2024-03-12T16:10:53.726 INFO:tasks.workunit.client.1.smithi134.stdout:9/852: mkdir d5/d10/d1f/dfc 0 2024-03-12T16:10:53.726 INFO:tasks.workunit.client.0.smithi006.stdout:1/660: symlink d0/le7 0 2024-03-12T16:10:53.726 INFO:tasks.workunit.client.0.smithi006.stdout:0/683: truncate d2/d6/d10/d11/f35 4835989 0 2024-03-12T16:10:53.726 INFO:tasks.workunit.client.1.smithi134.stdout:9/853: fsync d5/d46/f64 0 2024-03-12T16:10:53.727 INFO:tasks.workunit.client.0.smithi006.stdout:3/561: creat d8/d19/d26/d59/d2c/dc/d28/d2f/d99/fc0 x:0 0 0 2024-03-12T16:10:53.728 INFO:tasks.workunit.client.1.smithi134.stdout:0/836: dread db/d2f/d31/d76/fd9 [0,4194304] 0 2024-03-12T16:10:53.731 INFO:tasks.workunit.client.1.smithi134.stdout:4/848: link d1/d13/d49/da4/ld0 d1/de/l108 0 2024-03-12T16:10:53.734 INFO:tasks.workunit.client.0.smithi006.stdout:5/585: creat d7/d9/d31/d3b/dba/fbd x:0 0 0 2024-03-12T16:10:53.735 INFO:tasks.workunit.client.0.smithi006.stdout:0/684: mknod d2/d6/d10/d11/d7e/da6/cd1 0 2024-03-12T16:10:53.735 INFO:tasks.workunit.client.0.smithi006.stdout:3/562: symlink d8/d19/d26/d59/d2c/d41/lc1 0 2024-03-12T16:10:53.735 INFO:tasks.workunit.client.1.smithi134.stdout:1/636: truncate d0/d30/d86/f1d 265223 0 2024-03-12T16:10:53.735 INFO:tasks.workunit.client.0.smithi006.stdout:1/661: rename d0/d25/db1/cb7 to d0/d25/d67/ce8 0 2024-03-12T16:10:53.736 INFO:tasks.workunit.client.1.smithi134.stdout:9/854: mknod d5/d10/d35/d49/d8d/def/cfd 0 2024-03-12T16:10:53.736 INFO:tasks.workunit.client.1.smithi134.stdout:2/853: truncate d4/d12/f48 697217 0 2024-03-12T16:10:53.738 INFO:tasks.workunit.client.1.smithi134.stdout:4/849: creat d1/dbc/f109 x:0 0 0 2024-03-12T16:10:53.738 INFO:tasks.workunit.client.0.smithi006.stdout:6/667: getdents d3/d11/d10/d19 0 2024-03-12T16:10:53.738 INFO:tasks.workunit.client.0.smithi006.stdout:3/563: chown d8/d52/d9e/fb3 67788 1 2024-03-12T16:10:53.739 INFO:tasks.workunit.client.0.smithi006.stdout:3/564: fsync d8/f8e 0 2024-03-12T16:10:53.739 INFO:tasks.workunit.client.1.smithi134.stdout:0/837: mknod db/d2f/d31/d56/d66/dc0/c112 0 2024-03-12T16:10:53.740 INFO:tasks.workunit.client.0.smithi006.stdout:1/662: write d0/d25/d2a/d43/f87 [922900,48726] 0 2024-03-12T16:10:53.741 INFO:tasks.workunit.client.1.smithi134.stdout:9/855: write d5/d10/d35/d49/f4a [1072423,17853] 0 2024-03-12T16:10:53.742 INFO:tasks.workunit.client.0.smithi006.stdout:1/663: read d0/f16 [1266700,39643] 0 2024-03-12T16:10:53.743 INFO:tasks.workunit.client.0.smithi006.stdout:0/685: mknod d2/d6/d10/d11/d7e/da6/cd2 0 2024-03-12T16:10:53.743 INFO:tasks.workunit.client.1.smithi134.stdout:0/838: mkdir db/d2f/d31/d68/d70/d113 0 2024-03-12T16:10:53.744 INFO:tasks.workunit.client.1.smithi134.stdout:4/850: symlink d1/d13/d49/d64/d28/l10a 0 2024-03-12T16:10:53.746 INFO:tasks.workunit.client.1.smithi134.stdout:9/856: write d5/d10/d35/d49/f4a [161964,98532] 0 2024-03-12T16:10:53.747 INFO:tasks.workunit.client.1.smithi134.stdout:0/839: fdatasync db/d2f/d71/f9e 0 2024-03-12T16:10:53.751 INFO:tasks.workunit.client.0.smithi006.stdout:7/776: rename de/d2c/d4f/dba/d40/ff4 to de/d2c/d93/f105 0 2024-03-12T16:10:53.753 INFO:tasks.workunit.client.1.smithi134.stdout:2/854: dread d4/d84/f35 [0,4194304] 0 2024-03-12T16:10:53.753 INFO:tasks.workunit.client.0.smithi006.stdout:0/686: creat d2/d6/d10/d11/d32/fd3 x:0 0 0 2024-03-12T16:10:53.755 INFO:tasks.workunit.client.0.smithi006.stdout:8/557: dwrite d2/f16 [0,4194304] 0 2024-03-12T16:10:53.755 INFO:tasks.workunit.client.0.smithi006.stdout:6/668: creat d3/d11/d10/d1b/d20/d7c/ff1 x:0 0 0 2024-03-12T16:10:53.756 INFO:tasks.workunit.client.0.smithi006.stdout:8/558: stat d2/db/c67 0 2024-03-12T16:10:53.757 INFO:tasks.workunit.client.1.smithi134.stdout:4/851: rename d1/d24/f56 to d1/d13/d49/da4/f10b 0 2024-03-12T16:10:53.760 INFO:tasks.workunit.client.0.smithi006.stdout:7/777: mknod de/d2c/d4f/c106 0 2024-03-12T16:10:53.761 INFO:tasks.workunit.client.1.smithi134.stdout:2/855: getdents d4/d84/d63/d9d/dba/dff 0 2024-03-12T16:10:53.763 INFO:tasks.workunit.client.0.smithi006.stdout:1/664: rename d0/d25/f5d to d0/d25/db1/dd0/fe9 0 2024-03-12T16:10:53.765 INFO:tasks.workunit.client.0.smithi006.stdout:0/687: creat d2/d6/d10/d11/d7e/da6/d9e/fd4 x:0 0 0 2024-03-12T16:10:53.766 INFO:tasks.workunit.client.0.smithi006.stdout:9/582: truncate d0/d8/d16/d7d/d20/d37/f9d 5497125 0 2024-03-12T16:10:53.767 INFO:tasks.workunit.client.1.smithi134.stdout:1/637: dwrite d0/d16/d9/d73/f94 [0,4194304] 0 2024-03-12T16:10:53.768 INFO:tasks.workunit.client.1.smithi134.stdout:4/852: dwrite d1/d24/d34/d73/f8d [0,4194304] 0 2024-03-12T16:10:53.769 INFO:tasks.workunit.client.0.smithi006.stdout:7/778: dwrite de/d1c/f25 [0,4194304] 0 2024-03-12T16:10:53.769 INFO:tasks.workunit.client.0.smithi006.stdout:5/586: truncate d7/d9/d10/d24/f2d 992354 0 2024-03-12T16:10:53.771 INFO:tasks.workunit.client.0.smithi006.stdout:6/669: mknod d3/d11/d10/da7/d9e/daa/cf2 0 2024-03-12T16:10:53.771 INFO:tasks.workunit.client.0.smithi006.stdout:9/583: chown d0/d8/d16/d7d/d20/d37/lbb 20607 1 2024-03-12T16:10:53.773 INFO:tasks.workunit.client.1.smithi134.stdout:4/853: rmdir d1 39 2024-03-12T16:10:53.776 INFO:tasks.workunit.client.1.smithi134.stdout:0/840: dwrite db/d2f/d31/d68/d70/f74 [0,4194304] 0 2024-03-12T16:10:53.776 INFO:tasks.workunit.client.0.smithi006.stdout:7/779: mknod de/d2c/c107 0 2024-03-12T16:10:53.777 INFO:tasks.workunit.client.0.smithi006.stdout:6/670: chown d3/d11/d3b/d59/l73 59411701 1 2024-03-12T16:10:53.777 INFO:tasks.workunit.client.1.smithi134.stdout:2/856: getdents d4/d12 0 2024-03-12T16:10:53.777 INFO:tasks.workunit.client.0.smithi006.stdout:0/688: symlink d2/d39/d42/ld5 0 2024-03-12T16:10:53.778 INFO:tasks.workunit.client.0.smithi006.stdout:8/559: link d2/db/d1a/d21/d8a/la5 d2/db/d1a/d21/d2b/da2/lb6 0 2024-03-12T16:10:53.779 INFO:tasks.workunit.client.1.smithi134.stdout:1/638: creat d0/fd7 x:0 0 0 2024-03-12T16:10:53.780 INFO:tasks.workunit.client.0.smithi006.stdout:5/587: creat d7/d9/d31/d3b/d6b/db9/fbe x:0 0 0 2024-03-12T16:10:53.781 INFO:tasks.workunit.client.1.smithi134.stdout:0/841: creat db/d2f/d31/d68/f114 x:0 0 0 2024-03-12T16:10:53.782 INFO:tasks.workunit.client.1.smithi134.stdout:0/842: chown db/d2f/d31/d56/f5e 5 1 2024-03-12T16:10:53.783 INFO:tasks.workunit.client.0.smithi006.stdout:7/780: creat de/d2c/dd3/f108 x:0 0 0 2024-03-12T16:10:53.784 INFO:tasks.workunit.client.1.smithi134.stdout:1/639: creat d0/d16/d9/d13/d21/d20/fd8 x:0 0 0 2024-03-12T16:10:53.785 INFO:tasks.workunit.client.1.smithi134.stdout:2/857: mknod d4/d84/d7d/d87/d11d/c133 0 2024-03-12T16:10:53.787 INFO:tasks.workunit.client.1.smithi134.stdout:0/843: creat db/d2f/d31/d76/df9/f115 x:0 0 0 2024-03-12T16:10:53.789 INFO:tasks.workunit.client.0.smithi006.stdout:8/560: creat d2/d32/fb7 x:0 0 0 2024-03-12T16:10:53.789 INFO:tasks.workunit.client.1.smithi134.stdout:1/640: mknod d0/d30/cd9 0 2024-03-12T16:10:53.790 INFO:tasks.workunit.client.0.smithi006.stdout:0/689: mkdir d2/d6/d37/dd6 0 2024-03-12T16:10:53.790 INFO:tasks.workunit.client.0.smithi006.stdout:9/584: dwrite d0/d83/d90/dc0/fc1 [0,4194304] 0 2024-03-12T16:10:53.792 INFO:tasks.workunit.client.1.smithi134.stdout:0/844: mkdir db/d2f/d61/d67/d116 0 2024-03-12T16:10:53.792 INFO:tasks.workunit.client.1.smithi134.stdout:1/641: rmdir d0/d16/d9/d13/d21/d5f/d6f 39 2024-03-12T16:10:53.795 INFO:tasks.workunit.client.0.smithi006.stdout:5/588: mkdir d7/d9/dbf 0 2024-03-12T16:10:53.796 INFO:tasks.workunit.client.0.smithi006.stdout:5/589: readlink d7/d41/l81 0 2024-03-12T16:10:53.797 INFO:tasks.workunit.client.1.smithi134.stdout:2/858: write d4/d12/d39/fd2 [3303730,66265] 0 2024-03-12T16:10:53.802 INFO:tasks.workunit.client.1.smithi134.stdout:4/854: dread d1/d13/d49/da4/f10b [0,4194304] 0 2024-03-12T16:10:53.803 INFO:tasks.workunit.client.1.smithi134.stdout:2/859: link d4/de8/dea/d105/f11b d4/d12/d1d/d34/d58/dbb/f134 0 2024-03-12T16:10:53.803 INFO:tasks.workunit.client.0.smithi006.stdout:8/561: truncate d2/db/d1a/d21/dad/d7c/f7e 1822492 0 2024-03-12T16:10:53.804 INFO:tasks.workunit.client.0.smithi006.stdout:7/781: rename de/d7b/d7e/cd9 to de/d2c/dea/c109 0 2024-03-12T16:10:53.807 INFO:tasks.workunit.client.1.smithi134.stdout:4/855: rename d1/d13/d49/d64/d28/ccb to d1/d13/d49/d64/da3/c10c 0 2024-03-12T16:10:53.808 INFO:tasks.workunit.client.0.smithi006.stdout:6/671: link d3/d11/d10/d1b/f89 d3/d11/d10/d1b/d6e/ff3 0 2024-03-12T16:10:53.809 INFO:tasks.workunit.client.1.smithi134.stdout:4/856: rmdir d1/d24 39 2024-03-12T16:10:53.809 INFO:tasks.workunit.client.0.smithi006.stdout:7/782: stat de/d2c/d93/dbe/d4a/dbf/lf1 0 2024-03-12T16:10:53.810 INFO:tasks.workunit.client.0.smithi006.stdout:5/590: unlink d7/d9/d10/d24/c42 0 2024-03-12T16:10:53.810 INFO:tasks.workunit.client.1.smithi134.stdout:2/860: dread d4/d84/f55 [4194304,4194304] 0 2024-03-12T16:10:53.812 INFO:tasks.workunit.client.0.smithi006.stdout:0/690: dwrite d2/d6/d37/f86 [4194304,4194304] 0 2024-03-12T16:10:53.812 INFO:tasks.workunit.client.1.smithi134.stdout:4/857: dread d1/d13/d49/f66 [0,4194304] 0 2024-03-12T16:10:53.813 INFO:tasks.workunit.client.0.smithi006.stdout:9/585: creat d0/d8/fc3 x:0 0 0 2024-03-12T16:10:53.813 INFO:tasks.workunit.client.1.smithi134.stdout:0/845: write db/d2f/d61/d6c/fc9 [674787,12095] 0 2024-03-12T16:10:53.813 INFO:tasks.workunit.client.1.smithi134.stdout:2/861: chown d4/d12/d1d/d34/d47/ce2 62754572 1 2024-03-12T16:10:53.814 INFO:tasks.workunit.client.1.smithi134.stdout:4/858: readlink d1/de/l108 0 2024-03-12T16:10:53.816 INFO:tasks.workunit.client.0.smithi006.stdout:7/783: symlink de/d2c/d93/dbe/l10a 0 2024-03-12T16:10:53.816 INFO:tasks.workunit.client.0.smithi006.stdout:1/665: dwrite d0/fb [4194304,4194304] 0 2024-03-12T16:10:53.819 INFO:tasks.workunit.client.0.smithi006.stdout:5/591: creat d7/d9/d31/d3b/d4f/db5/fc0 x:0 0 0 2024-03-12T16:10:53.821 INFO:tasks.workunit.client.0.smithi006.stdout:0/691: creat d2/d6/d10/d11/d7e/fd7 x:0 0 0 2024-03-12T16:10:53.823 INFO:tasks.workunit.client.1.smithi134.stdout:2/862: rename d4/d12/d39 to d4/d12/d43/da2/d135 0 2024-03-12T16:10:53.823 INFO:tasks.workunit.client.1.smithi134.stdout:0/846: creat db/d2f/d31/d56/d66/f117 x:0 0 0 2024-03-12T16:10:53.824 INFO:tasks.workunit.client.1.smithi134.stdout:2/863: read d4/f13 [3723106,70494] 0 2024-03-12T16:10:53.825 INFO:tasks.workunit.client.0.smithi006.stdout:6/672: creat d3/d11/d10/da7/d8e/d8b/de7/ff4 x:0 0 0 2024-03-12T16:10:53.826 INFO:tasks.workunit.client.1.smithi134.stdout:4/859: rename d1/d13/d49/d64/da3/df4 to d1/d13/d49/d64/d28/d4f/d67/d10d 0 2024-03-12T16:10:53.826 INFO:tasks.workunit.client.0.smithi006.stdout:1/666: unlink d0/l1c 0 2024-03-12T16:10:53.827 INFO:tasks.workunit.client.0.smithi006.stdout:7/784: mknod de/d2c/d93/dbe/d4a/d6a/dc7/c10b 0 2024-03-12T16:10:53.830 INFO:tasks.workunit.client.1.smithi134.stdout:2/864: creat d4/d84/d63/dde/df0/f136 x:0 0 0 2024-03-12T16:10:53.832 INFO:tasks.workunit.client.0.smithi006.stdout:9/586: dread d0/d8/d16/d7d/d20/d37/f5c [0,4194304] 0 2024-03-12T16:10:53.832 INFO:tasks.workunit.client.0.smithi006.stdout:6/673: unlink d3/d11/d10/d1b/d6e/d80/lc0 0 2024-03-12T16:10:53.833 INFO:tasks.workunit.client.0.smithi006.stdout:7/785: chown de/d2c/d4f/d83/f95 201385144 1 2024-03-12T16:10:53.834 INFO:tasks.workunit.client.0.smithi006.stdout:7/786: stat de/d1c/d87/fb3 0 2024-03-12T16:10:53.834 INFO:tasks.workunit.client.0.smithi006.stdout:1/667: truncate d0/d25/d2a/d43/d63/fa6 260086 0 2024-03-12T16:10:53.835 INFO:tasks.workunit.client.1.smithi134.stdout:2/865: rename d4/d84/d63/d9d/d3d/cfa to d4/d84/d7d/c137 0 2024-03-12T16:10:53.836 INFO:tasks.workunit.client.0.smithi006.stdout:0/692: getdents d2/d6/d10/d11/d1d/d79/dd0 0 2024-03-12T16:10:53.836 INFO:tasks.workunit.client.1.smithi134.stdout:4/860: link d1/d13/d49/d64/d28/l6f d1/de/d5a/l10e 0 2024-03-12T16:10:53.837 INFO:tasks.workunit.client.1.smithi134.stdout:2/866: read d4/d84/f10e [539071,57957] 0 2024-03-12T16:10:53.838 INFO:tasks.workunit.client.1.smithi134.stdout:2/867: readlink d4/d12/d3b/d3f/l65 0 2024-03-12T16:10:53.841 INFO:tasks.workunit.client.1.smithi134.stdout:4/861: mkdir d1/d24/d34/d73/d10f 0 2024-03-12T16:10:53.841 INFO:tasks.workunit.client.1.smithi134.stdout:7/922: sync 2024-03-12T16:10:53.841 INFO:tasks.workunit.client.1.smithi134.stdout:8/884: sync 2024-03-12T16:10:53.842 INFO:tasks.workunit.client.1.smithi134.stdout:0/847: write db/d2f/d31/f47 [4347297,70082] 0 2024-03-12T16:10:53.843 INFO:tasks.workunit.client.1.smithi134.stdout:4/862: write d1/d13/d49/d64/d28/f9d [3721896,44124] 0 2024-03-12T16:10:53.844 INFO:tasks.workunit.client.1.smithi134.stdout:0/848: chown db/d2f/d31/d56/dbc 1299367469 1 2024-03-12T16:10:53.844 INFO:tasks.workunit.client.1.smithi134.stdout:4/863: stat d1/d24/d34/d73/d10f 0 2024-03-12T16:10:53.845 INFO:tasks.workunit.client.0.smithi006.stdout:0/693: symlink d2/d6/d37/d97/dbb/ld8 0 2024-03-12T16:10:53.845 INFO:tasks.workunit.client.0.smithi006.stdout:0/694: fdatasync d2/d39/f63 0 2024-03-12T16:10:53.846 INFO:tasks.workunit.client.1.smithi134.stdout:8/885: mkdir d3/d1b/d17/d25/d33/d132 0 2024-03-12T16:10:53.850 INFO:tasks.workunit.client.1.smithi134.stdout:8/886: stat d3/d1b/d17/d25/d49/f75 0 2024-03-12T16:10:53.851 INFO:tasks.workunit.client.1.smithi134.stdout:0/849: mkdir db/d2f/d61/d118 0 2024-03-12T16:10:53.852 INFO:tasks.workunit.client.1.smithi134.stdout:0/850: readlink db/d2f/d51/l92 0 2024-03-12T16:10:53.853 INFO:tasks.workunit.client.1.smithi134.stdout:4/864: rename d1/de/fc5 to d1/d13/d49/d64/d28/d4f/d67/f110 0 2024-03-12T16:10:53.855 INFO:tasks.workunit.client.0.smithi006.stdout:8/562: dwrite d2/db/d1a/d21/d4f/f56 [0,4194304] 0 2024-03-12T16:10:53.858 INFO:tasks.workunit.client.0.smithi006.stdout:8/563: dread - d2/db/d1a/d1f/fb0 zero size 2024-03-12T16:10:53.859 INFO:tasks.workunit.client.1.smithi134.stdout:8/887: creat d3/d1b/d17/d25/d33/d123/f133 x:0 0 0 2024-03-12T16:10:53.860 INFO:tasks.workunit.client.1.smithi134.stdout:7/923: dwrite d8/dc/f51 [0,4194304] 0 2024-03-12T16:10:53.862 INFO:tasks.workunit.client.1.smithi134.stdout:0/851: rmdir db/d2f/d108 0 2024-03-12T16:10:53.865 INFO:tasks.workunit.client.1.smithi134.stdout:4/865: mknod d1/d13/d49/d64/d28/d4f/d105/c111 0 2024-03-12T16:10:53.870 INFO:tasks.workunit.client.0.smithi006.stdout:5/592: dwrite d7/d41/f5a [0,4194304] 0 2024-03-12T16:10:53.872 INFO:tasks.workunit.client.1.smithi134.stdout:4/866: mknod d1/d13/d49/d64/d28/d4f/c112 0 2024-03-12T16:10:53.873 INFO:tasks.workunit.client.1.smithi134.stdout:2/868: dread d4/f1b [0,4194304] 0 2024-03-12T16:10:53.877 INFO:tasks.workunit.client.0.smithi006.stdout:6/674: dwrite d3/d47/f4c [0,4194304] 0 2024-03-12T16:10:53.877 INFO:tasks.workunit.client.0.smithi006.stdout:5/593: creat d7/d9/d47/fc1 x:0 0 0 2024-03-12T16:10:53.878 INFO:tasks.workunit.client.1.smithi134.stdout:4/867: mknod d1/d24/d34/c113 0 2024-03-12T16:10:53.878 INFO:tasks.workunit.client.1.smithi134.stdout:2/869: creat d4/de8/dea/df5/f138 x:0 0 0 2024-03-12T16:10:53.879 INFO:tasks.workunit.client.0.smithi006.stdout:1/668: dwrite d0/d25/f2b [4194304,4194304] 0 2024-03-12T16:10:53.879 INFO:tasks.workunit.client.0.smithi006.stdout:0/695: dread d2/d6/d37/d97/faf [0,4194304] 0 2024-03-12T16:10:53.879 INFO:tasks.workunit.client.0.smithi006.stdout:7/787: dwrite de/d2c/d93/dbe/f65 [0,4194304] 0 2024-03-12T16:10:53.879 INFO:tasks.workunit.client.1.smithi134.stdout:4/868: chown d1/d13/f4b 376800 1 2024-03-12T16:10:53.880 INFO:tasks.workunit.client.1.smithi134.stdout:2/870: stat d4/d12/c11c 0 2024-03-12T16:10:53.882 INFO:tasks.workunit.client.0.smithi006.stdout:8/564: dread d2/db/f6c [0,4194304] 0 2024-03-12T16:10:53.885 INFO:tasks.workunit.client.0.smithi006.stdout:7/788: write de/d2c/d4f/d83/fab [135272,99571] 0 2024-03-12T16:10:53.885 INFO:tasks.workunit.client.1.smithi134.stdout:2/871: unlink d4/d12/d43/da2/d135/fd2 0 2024-03-12T16:10:53.889 INFO:tasks.workunit.client.0.smithi006.stdout:1/669: symlink d0/d25/d2a/d43/d56/dd8/lea 0 2024-03-12T16:10:53.889 INFO:tasks.workunit.client.0.smithi006.stdout:6/675: rename d3/d11/d10/da7/d8e/d8b/lee to d3/d11/d10/d19/lf5 0 2024-03-12T16:10:53.896 INFO:tasks.workunit.client.0.smithi006.stdout:1/670: fsync d0/d25/d2a/f71 0 2024-03-12T16:10:53.899 INFO:tasks.workunit.client.0.smithi006.stdout:7/789: chown de/d2c/d4f/dba/d40/c77 21568737 1 2024-03-12T16:10:53.900 INFO:tasks.workunit.client.0.smithi006.stdout:5/594: dwrite d7/d9/d31/d3b/d6b/db9/fbe [0,4194304] 0 2024-03-12T16:10:53.900 INFO:tasks.workunit.client.1.smithi134.stdout:0/852: write db/d2f/f57 [920394,7648] 0 2024-03-12T16:10:53.902 INFO:tasks.workunit.client.0.smithi006.stdout:1/671: write d0/d25/d2a/d35/f4b [4307113,24307] 0 2024-03-12T16:10:53.902 INFO:tasks.workunit.client.0.smithi006.stdout:0/696: rename d2/d6/d10/d11/d1d/d2e/l61 to d2/d6/d10/d11/d7e/da6/d9e/ld9 0 2024-03-12T16:10:53.906 INFO:tasks.workunit.client.0.smithi006.stdout:8/565: rmdir d2/db/d1a/d21/dad/da4 0 2024-03-12T16:10:53.906 INFO:tasks.workunit.client.1.smithi134.stdout:0/853: fdatasync db/f8e 0 2024-03-12T16:10:53.908 INFO:tasks.workunit.client.0.smithi006.stdout:8/566: mkdir d2/d55/d7b/db8 0 2024-03-12T16:10:53.909 INFO:tasks.workunit.client.0.smithi006.stdout:5/595: symlink d7/d9/d31/d3b/d4f/d9e/lc2 0 2024-03-12T16:10:53.911 INFO:tasks.workunit.client.0.smithi006.stdout:8/567: mknod d2/db/d70/daa/cb9 0 2024-03-12T16:10:53.912 INFO:tasks.workunit.client.1.smithi134.stdout:7/924: dwrite d8/d27/f59 [0,4194304] 0 2024-03-12T16:10:53.912 INFO:tasks.workunit.client.1.smithi134.stdout:8/888: dwrite d3/d1b/d17/d24/d28/fc3 [0,4194304] 0 2024-03-12T16:10:53.913 INFO:tasks.workunit.client.0.smithi006.stdout:8/568: read - d2/d55/f8f zero size 2024-03-12T16:10:53.913 INFO:tasks.workunit.client.0.smithi006.stdout:5/596: mknod d7/d9/d31/d3b/d4f/d65/d69/cc3 0 2024-03-12T16:10:53.916 INFO:tasks.workunit.client.0.smithi006.stdout:8/569: read d2/f19 [1096721,44115] 0 2024-03-12T16:10:53.918 INFO:tasks.workunit.client.0.smithi006.stdout:5/597: chown d7/d9/d10/f32 1295049 1 2024-03-12T16:10:53.919 INFO:tasks.workunit.client.0.smithi006.stdout:5/598: readlink d7/d9/d10/d24/l63 0 2024-03-12T16:10:53.919 INFO:tasks.workunit.client.1.smithi134.stdout:4/869: dwrite d1/d13/d49/d64/d28/f5e [0,4194304] 0 2024-03-12T16:10:53.921 INFO:tasks.workunit.client.0.smithi006.stdout:8/570: symlink d2/db/d1a/d21/d8a/lba 0 2024-03-12T16:10:53.923 INFO:tasks.workunit.client.0.smithi006.stdout:5/599: write d7/d9/d10/d35/fb1 [938204,73732] 0 2024-03-12T16:10:53.923 INFO:tasks.workunit.client.1.smithi134.stdout:7/925: getdents d8/dc/d7b/dbb 0 2024-03-12T16:10:53.924 INFO:tasks.workunit.client.1.smithi134.stdout:4/870: write d1/de/f4d [2961894,68876] 0 2024-03-12T16:10:53.928 INFO:tasks.workunit.client.1.smithi134.stdout:8/889: read d3/d82/f98 [398816,67393] 0 2024-03-12T16:10:53.929 INFO:tasks.workunit.client.1.smithi134.stdout:0/854: write db/d2f/d31/f59 [4697915,29606] 0 2024-03-12T16:10:53.929 INFO:tasks.workunit.client.0.smithi006.stdout:7/790: dread de/d18/f19 [0,4194304] 0 2024-03-12T16:10:53.930 INFO:tasks.workunit.client.1.smithi134.stdout:4/871: mkdir d1/d24/d34/d73/d10f/d114 0 2024-03-12T16:10:53.934 INFO:tasks.workunit.client.1.smithi134.stdout:4/872: readlink d1/l4e 0 2024-03-12T16:10:53.935 INFO:tasks.workunit.client.0.smithi006.stdout:7/791: mknod de/d2c/d93/c10c 0 2024-03-12T16:10:53.935 INFO:tasks.workunit.client.0.smithi006.stdout:1/672: write d0/d25/d67/db0/fcc [459107,116675] 0 2024-03-12T16:10:53.935 INFO:tasks.workunit.client.0.smithi006.stdout:5/600: mkdir d7/d9/d47/d56/dc4 0 2024-03-12T16:10:53.937 INFO:tasks.workunit.client.0.smithi006.stdout:7/792: truncate de/d2c/f3c 598000 0 2024-03-12T16:10:53.939 INFO:tasks.workunit.client.1.smithi134.stdout:7/926: dwrite d8/dc/d20/d26/d36/f9b [0,4194304] 0 2024-03-12T16:10:53.939 INFO:tasks.workunit.client.0.smithi006.stdout:5/601: creat d7/d9/d31/d3b/d4f/d65/fc5 x:0 0 0 2024-03-12T16:10:53.941 INFO:tasks.workunit.client.1.smithi134.stdout:8/890: dread d3/d1b/f14 [0,4194304] 0 2024-03-12T16:10:53.942 INFO:tasks.workunit.client.0.smithi006.stdout:5/602: creat d7/d41/fc6 x:0 0 0 2024-03-12T16:10:53.943 INFO:tasks.workunit.client.0.smithi006.stdout:8/571: dread d2/d55/f71 [0,4194304] 0 2024-03-12T16:10:53.944 INFO:tasks.workunit.client.0.smithi006.stdout:8/572: chown d2/d55/d7b/db8 15 1 2024-03-12T16:10:53.945 INFO:tasks.workunit.client.1.smithi134.stdout:8/891: unlink d3/fc7 0 2024-03-12T16:10:53.945 INFO:tasks.workunit.client.0.smithi006.stdout:5/603: symlink d7/d9/d31/d3b/dba/lc7 0 2024-03-12T16:10:53.945 INFO:tasks.workunit.client.0.smithi006.stdout:6/676: dread d3/d11/d10/da7/d8e/de1/d60/f61 [0,4194304] 0 2024-03-12T16:10:53.946 INFO:tasks.workunit.client.1.smithi134.stdout:4/873: dwrite d1/d13/d49/d64/fcf [4194304,4194304] 0 2024-03-12T16:10:53.952 INFO:tasks.workunit.client.0.smithi006.stdout:5/604: unlink d7/d9/d10/l25 0 2024-03-12T16:10:53.953 INFO:tasks.workunit.client.0.smithi006.stdout:6/677: truncate d3/d11/d10/f42 4420888 0 2024-03-12T16:10:53.954 INFO:tasks.workunit.client.1.smithi134.stdout:4/874: write d1/d13/d49/f32 [2926237,65308] 0 2024-03-12T16:10:53.954 INFO:tasks.workunit.client.1.smithi134.stdout:8/892: chown d3/d1b/d17/d25/d33/d96/dbd/fdc 2684 1 2024-03-12T16:10:53.954 INFO:tasks.workunit.client.1.smithi134.stdout:4/875: chown d1/d13/fda 12938 1 2024-03-12T16:10:53.955 INFO:tasks.workunit.client.0.smithi006.stdout:6/678: write d3/d11/d10/da7/d8e/de1/f85 [977416,16586] 0 2024-03-12T16:10:53.956 INFO:tasks.workunit.client.1.smithi134.stdout:4/876: unlink d1/d24/lef 0 2024-03-12T16:10:53.958 INFO:tasks.workunit.client.0.smithi006.stdout:5/605: rename d7/d9/d31/d3b/d4f/d65/f7d to d7/d9/d31/d3b/fc8 0 2024-03-12T16:10:53.958 INFO:tasks.workunit.client.1.smithi134.stdout:4/877: write d1/d24/d34/d73/fe0 [3038782,48151] 0 2024-03-12T16:10:53.962 INFO:tasks.workunit.client.1.smithi134.stdout:8/893: creat d3/d1b/d17/d24/d28/d102/f134 x:0 0 0 2024-03-12T16:10:53.962 INFO:tasks.workunit.client.1.smithi134.stdout:0/855: dwrite db/d2f/d31/d75/d88/fc2 [0,4194304] 0 2024-03-12T16:10:53.966 INFO:tasks.workunit.client.0.smithi006.stdout:1/673: dread d0/d25/d2a/d64/f6d [0,4194304] 0 2024-03-12T16:10:53.968 INFO:tasks.workunit.client.1.smithi134.stdout:0/856: creat db/d2f/d31/d68/da2/f119 x:0 0 0 2024-03-12T16:10:53.968 INFO:tasks.workunit.client.1.smithi134.stdout:4/878: dwrite d1/d24/d34/d73/fe0 [0,4194304] 0 2024-03-12T16:10:53.970 INFO:tasks.workunit.client.1.smithi134.stdout:4/879: read - d1/d13/d49/d64/da3/fc8 zero size 2024-03-12T16:10:53.970 INFO:tasks.workunit.client.0.smithi006.stdout:1/674: creat d0/d25/d67/feb x:0 0 0 2024-03-12T16:10:53.972 INFO:tasks.workunit.client.1.smithi134.stdout:0/857: creat db/d2f/d51/daf/deb/f11a x:0 0 0 2024-03-12T16:10:53.975 INFO:tasks.workunit.client.1.smithi134.stdout:0/858: rmdir db/d2f/d31/d75/d88/dd4 39 2024-03-12T16:10:53.977 INFO:tasks.workunit.client.0.smithi006.stdout:6/679: write d3/d11/d10/d1b/d6e/d80/f84 [1130118,74577] 0 2024-03-12T16:10:53.977 INFO:tasks.workunit.client.1.smithi134.stdout:4/880: dwrite d1/d13/d49/d64/d28/f3b [0,4194304] 0 2024-03-12T16:10:53.979 INFO:tasks.workunit.client.0.smithi006.stdout:7/793: dwrite de/d2c/d93/dbe/d66/fc4 [0,4194304] 0 2024-03-12T16:10:53.981 INFO:tasks.workunit.client.1.smithi134.stdout:4/881: truncate d1/f23 5010605 0 2024-03-12T16:10:53.983 INFO:tasks.workunit.client.0.smithi006.stdout:1/675: dread d0/d25/d2a/d43/d63/fa6 [0,4194304] 0 2024-03-12T16:10:53.983 INFO:tasks.workunit.client.0.smithi006.stdout:7/794: chown de/d1c/d35/lac 44125 1 2024-03-12T16:10:53.984 INFO:tasks.workunit.client.1.smithi134.stdout:4/882: fdatasync d1/d24/d34/d73/fca 0 2024-03-12T16:10:53.985 INFO:tasks.workunit.client.0.smithi006.stdout:6/680: write d3/d11/d10/d1b/fdc [123098,13347] 0 2024-03-12T16:10:53.985 INFO:tasks.workunit.client.1.smithi134.stdout:0/859: read db/f50 [2425022,58349] 0 2024-03-12T16:10:53.987 INFO:tasks.workunit.client.0.smithi006.stdout:8/573: dwrite d2/db/f2e [0,4194304] 0 2024-03-12T16:10:53.987 INFO:tasks.workunit.client.0.smithi006.stdout:1/676: symlink d0/lec 0 2024-03-12T16:10:53.989 INFO:tasks.workunit.client.1.smithi134.stdout:0/860: unlink db/f38 0 2024-03-12T16:10:53.991 INFO:tasks.workunit.client.0.smithi006.stdout:6/681: mkdir d3/d11/d10/d19/df6 0 2024-03-12T16:10:53.992 INFO:tasks.workunit.client.0.smithi006.stdout:8/574: mknod d2/d11/d5a/cbb 0 2024-03-12T16:10:53.994 INFO:tasks.workunit.client.1.smithi134.stdout:0/861: getdents db/d2f/d31/d68/d70/dc7 0 2024-03-12T16:10:53.997 INFO:tasks.workunit.client.1.smithi134.stdout:0/862: rmdir db/d2f/d31/d56/dbc 39 2024-03-12T16:10:53.998 INFO:tasks.workunit.client.0.smithi006.stdout:5/606: dwrite d7/d9/d10/d24/f3e [0,4194304] 0 2024-03-12T16:10:53.999 INFO:tasks.workunit.client.1.smithi134.stdout:0/863: dread - db/d2f/d31/d68/da2/dd3/f10a zero size 2024-03-12T16:10:54.001 INFO:tasks.workunit.client.1.smithi134.stdout:0/864: creat db/d2f/d31/d56/d66/da5/f11b x:0 0 0 2024-03-12T16:10:54.001 INFO:tasks.workunit.client.0.smithi006.stdout:6/682: fsync d3/d11/d10/d1b/d6e/d80/d9b/fbe 0 2024-03-12T16:10:54.004 INFO:tasks.workunit.client.0.smithi006.stdout:1/677: rename d0/d25/d2a/d35/dce/ce2 to d0/d25/d2a/d43/ced 0 2024-03-12T16:10:54.011 INFO:tasks.workunit.client.1.smithi134.stdout:0/865: link db/d2f/d61/d67/lac db/d2f/d31/d68/da2/l11c 0 2024-03-12T16:10:54.012 INFO:tasks.workunit.client.1.smithi134.stdout:4/883: fsync d1/de/f9a 0 2024-03-12T16:10:54.015 INFO:tasks.workunit.client.1.smithi134.stdout:0/866: unlink db/d2f/d31/d56/d9a/f9d 0 2024-03-12T16:10:54.015 INFO:tasks.workunit.client.0.smithi006.stdout:7/795: truncate de/d2c/d4f/dba/fdf 692396 0 2024-03-12T16:10:54.017 INFO:tasks.workunit.client.0.smithi006.stdout:6/683: write d3/d11/d3b/d59/fd3 [615094,48699] 0 2024-03-12T16:10:54.017 INFO:tasks.workunit.client.0.smithi006.stdout:7/796: chown de/d7b/dc6/fe5 64924407 1 2024-03-12T16:10:54.018 INFO:tasks.workunit.client.0.smithi006.stdout:7/797: readlink de/d2c/d93/dbe/d4a/d6a/lb8 0 2024-03-12T16:10:54.019 INFO:tasks.workunit.client.0.smithi006.stdout:6/684: mknod d3/d11/d43/cf7 0 2024-03-12T16:10:54.020 INFO:tasks.workunit.client.0.smithi006.stdout:7/798: read - de/d1c/d87/ffd zero size 2024-03-12T16:10:54.021 INFO:tasks.workunit.client.0.smithi006.stdout:7/799: fsync de/d7b/f91 0 2024-03-12T16:10:54.021 INFO:tasks.workunit.client.0.smithi006.stdout:6/685: symlink d3/d11/d10/d19/lf8 0 2024-03-12T16:10:54.022 INFO:tasks.workunit.client.1.smithi134.stdout:0/867: dwrite db/d2f/d61/d6c/fc9 [0,4194304] 0 2024-03-12T16:10:54.024 INFO:tasks.workunit.client.0.smithi006.stdout:6/686: symlink d3/d47/db0/dc1/lf9 0 2024-03-12T16:10:54.024 INFO:tasks.workunit.client.1.smithi134.stdout:0/868: truncate db/d2f/d31/d75/f8a 676157 0 2024-03-12T16:10:54.025 INFO:tasks.workunit.client.0.smithi006.stdout:6/687: chown d3/d11/d10/fe0 0 1 2024-03-12T16:10:54.028 INFO:tasks.workunit.client.0.smithi006.stdout:8/575: dread d2/db/f24 [0,4194304] 0 2024-03-12T16:10:54.028 INFO:tasks.workunit.client.1.smithi134.stdout:0/869: symlink db/d2f/d31/d56/d66/l11d 0 2024-03-12T16:10:54.028 INFO:tasks.workunit.client.0.smithi006.stdout:6/688: symlink d3/d11/d10/da7/d9e/daa/lfa 0 2024-03-12T16:10:54.029 INFO:tasks.workunit.client.1.smithi134.stdout:0/870: fsync db/d2f/d31/d68/da2/dd3/de5/fff 0 2024-03-12T16:10:54.029 INFO:tasks.workunit.client.0.smithi006.stdout:1/678: truncate d0/d25/d2a/f2d 2278487 0 2024-03-12T16:10:54.034 INFO:tasks.workunit.client.0.smithi006.stdout:8/576: stat d2/db/d1a/d21/d2b 0 2024-03-12T16:10:54.034 INFO:tasks.workunit.client.0.smithi006.stdout:5/607: write d7/d9/d10/d24/d89/fa2 [114211,43798] 0 2024-03-12T16:10:54.036 INFO:tasks.workunit.client.0.smithi006.stdout:7/800: write de/d2c/d4f/fb6 [513676,89663] 0 2024-03-12T16:10:54.038 INFO:tasks.workunit.client.0.smithi006.stdout:6/689: creat d3/d11/d10/ffb x:0 0 0 2024-03-12T16:10:54.039 INFO:tasks.workunit.client.1.smithi134.stdout:4/884: dwrite d1/d13/d49/d64/d28/f99 [4194304,4194304] 0 2024-03-12T16:10:54.045 INFO:tasks.workunit.client.1.smithi134.stdout:4/885: mkdir d1/d13/d49/d64/d28/d4f/d105/d115 0 2024-03-12T16:10:54.048 INFO:tasks.workunit.client.1.smithi134.stdout:4/886: creat d1/d13/d49/d64/da3/dab/f116 x:0 0 0 2024-03-12T16:10:54.048 INFO:tasks.workunit.client.0.smithi006.stdout:5/608: creat d7/d9/d31/d3b/d6b/db9/fc9 x:0 0 0 2024-03-12T16:10:54.048 INFO:tasks.workunit.client.0.smithi006.stdout:1/679: write d0/d25/f83 [586733,50795] 0 2024-03-12T16:10:54.048 INFO:tasks.workunit.client.1.smithi134.stdout:0/871: stat db/d2f/d31/d75/f8a 0 2024-03-12T16:10:54.049 INFO:tasks.workunit.client.0.smithi006.stdout:1/680: stat d0/f30 0 2024-03-12T16:10:54.050 INFO:tasks.workunit.client.0.smithi006.stdout:7/801: creat de/d7b/dfc/f10d x:0 0 0 2024-03-12T16:10:54.052 INFO:tasks.workunit.client.0.smithi006.stdout:5/609: truncate d7/d41/fc6 551898 0 2024-03-12T16:10:54.052 INFO:tasks.workunit.client.1.smithi134.stdout:6/888: sync 2024-03-12T16:10:54.052 INFO:tasks.workunit.client.1.smithi134.stdout:4/887: creat d1/de/dac/f117 x:0 0 0 2024-03-12T16:10:54.054 INFO:tasks.workunit.client.0.smithi006.stdout:8/577: write d2/d55/d7b/f83 [180037,44518] 0 2024-03-12T16:10:54.055 INFO:tasks.workunit.client.0.smithi006.stdout:7/802: dread - de/d2c/d93/dbe/d66/fda zero size 2024-03-12T16:10:54.056 INFO:tasks.workunit.client.0.smithi006.stdout:8/578: write d2/f16 [129872,92156] 0 2024-03-12T16:10:54.058 INFO:tasks.workunit.client.1.smithi134.stdout:6/889: dwrite d1/fb2 [0,4194304] 0 2024-03-12T16:10:54.059 INFO:tasks.workunit.client.1.smithi134.stdout:4/888: dread d1/de/d90/fa6 [0,4194304] 0 2024-03-12T16:10:54.060 INFO:tasks.workunit.client.0.smithi006.stdout:7/803: chown de/dc2/c101 7 1 2024-03-12T16:10:54.067 INFO:tasks.workunit.client.1.smithi134.stdout:0/872: dread db/f86 [0,4194304] 0 2024-03-12T16:10:54.068 INFO:tasks.workunit.client.0.smithi006.stdout:5/610: dwrite d7/d9/d31/d3b/d6b/db9/fbe [4194304,4194304] 0 2024-03-12T16:10:54.069 INFO:tasks.workunit.client.0.smithi006.stdout:7/804: read de/d2c/d4f/fa1 [3948899,93702] 0 2024-03-12T16:10:54.070 INFO:tasks.workunit.client.1.smithi134.stdout:0/873: mknod db/d2f/d51/c11e 0 2024-03-12T16:10:54.075 INFO:tasks.workunit.client.0.smithi006.stdout:6/690: dread d3/d11/d10/da7/d9e/daa/fb9 [0,4194304] 0 2024-03-12T16:10:54.080 INFO:tasks.workunit.client.0.smithi006.stdout:6/691: chown d3/d11/d10/d1b 0 1 2024-03-12T16:10:54.080 INFO:tasks.workunit.client.0.smithi006.stdout:1/681: dwrite d0/d25/d2a/f2d [0,4194304] 0 2024-03-12T16:10:54.083 INFO:tasks.workunit.client.0.smithi006.stdout:8/579: dwrite d2/db/d1a/fb4 [0,4194304] 0 2024-03-12T16:10:54.084 INFO:tasks.workunit.client.1.smithi134.stdout:0/874: write db/d2f/f63 [666970,75382] 0 2024-03-12T16:10:54.086 INFO:tasks.workunit.client.0.smithi006.stdout:1/682: creat d0/d25/d2a/d35/db3/fee x:0 0 0 2024-03-12T16:10:54.087 INFO:tasks.workunit.client.0.smithi006.stdout:7/805: link de/d1c/d87/ddb/f2d de/d2c/dea/f10e 0 2024-03-12T16:10:54.088 INFO:tasks.workunit.client.1.smithi134.stdout:0/875: unlink db/d2f/d31/d56/f65 0 2024-03-12T16:10:54.088 INFO:tasks.workunit.client.1.smithi134.stdout:4/889: dread d1/d13/d49/d64/d28/f99 [0,4194304] 0 2024-03-12T16:10:54.089 INFO:tasks.workunit.client.0.smithi006.stdout:8/580: chown d2/d55/d7b/f83 13 1 2024-03-12T16:10:54.089 INFO:tasks.workunit.client.0.smithi006.stdout:6/692: creat d3/d11/d10/d28/dd6/ffc x:0 0 0 2024-03-12T16:10:54.090 INFO:tasks.workunit.client.0.smithi006.stdout:8/581: readlink d2/db/d1a/d23/l61 0 2024-03-12T16:10:54.092 INFO:tasks.workunit.client.1.smithi134.stdout:4/890: symlink d1/d13/d49/d64/l118 0 2024-03-12T16:10:54.094 INFO:tasks.workunit.client.0.smithi006.stdout:5/611: write d7/d9/d10/f1a [3685420,9999] 0 2024-03-12T16:10:54.094 INFO:tasks.workunit.client.0.smithi006.stdout:7/806: link de/d1c/d35/lac de/d7b/d7e/l10f 0 2024-03-12T16:10:54.095 INFO:tasks.workunit.client.0.smithi006.stdout:6/693: truncate d3/d11/d3b/d59/f97 814946 0 2024-03-12T16:10:54.096 INFO:tasks.workunit.client.0.smithi006.stdout:8/582: mkdir d2/db/d1a/d21/d2b/da2/dbc 0 2024-03-12T16:10:54.097 INFO:tasks.workunit.client.0.smithi006.stdout:5/612: creat d7/d9/d10/d24/fca x:0 0 0 2024-03-12T16:10:54.098 INFO:tasks.workunit.client.0.smithi006.stdout:8/583: read d2/d55/f71 [839352,113872] 0 2024-03-12T16:10:54.109 INFO:tasks.workunit.client.0.smithi006.stdout:2/680: sync 2024-03-12T16:10:54.110 INFO:tasks.workunit.client.0.smithi006.stdout:2/681: dread - d0/dc/d64/f9c zero size 2024-03-12T16:10:54.115 INFO:tasks.workunit.client.1.smithi134.stdout:4/891: dwrite d1/d13/fda [0,4194304] 0 2024-03-12T16:10:54.116 INFO:tasks.workunit.client.0.smithi006.stdout:7/807: write de/dc2/fc9 [727147,40124] 0 2024-03-12T16:10:54.116 INFO:tasks.workunit.client.0.smithi006.stdout:6/694: write d3/d11/d10/da7/d9e/daa/fb9 [2133010,90280] 0 2024-03-12T16:10:54.117 INFO:tasks.workunit.client.1.smithi134.stdout:0/876: dread db/d2f/d31/d56/d66/da5/fb9 [0,4194304] 0 2024-03-12T16:10:54.120 INFO:tasks.workunit.client.1.smithi134.stdout:0/877: write db/d2f/d61/d94/f109 [354373,80436] 0 2024-03-12T16:10:54.120 INFO:tasks.workunit.client.1.smithi134.stdout:4/892: dread d1/d13/f80 [0,4194304] 0 2024-03-12T16:10:54.123 INFO:tasks.workunit.client.0.smithi006.stdout:2/682: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/fc2 [0,4194304] 0 2024-03-12T16:10:54.125 INFO:tasks.workunit.client.0.smithi006.stdout:1/683: dread d0/d25/d2a/d43/f44 [0,4194304] 0 2024-03-12T16:10:54.127 INFO:tasks.workunit.client.0.smithi006.stdout:6/695: write d3/d11/d3b/f99 [2930096,130926] 0 2024-03-12T16:10:54.129 INFO:tasks.workunit.client.0.smithi006.stdout:8/584: dwrite d2/db/d1a/d21/d4f/f5c [0,4194304] 0 2024-03-12T16:10:54.131 INFO:tasks.workunit.client.0.smithi006.stdout:5/613: dread d7/d9/d31/f46 [0,4194304] 0 2024-03-12T16:10:54.133 INFO:tasks.workunit.client.0.smithi006.stdout:8/585: chown d2/db/d1a/l57 2096434 1 2024-03-12T16:10:54.135 INFO:tasks.workunit.client.0.smithi006.stdout:2/683: mknod d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/cd6 0 2024-03-12T16:10:54.136 INFO:tasks.workunit.client.0.smithi006.stdout:6/696: creat d3/ffd x:0 0 0 2024-03-12T16:10:54.136 INFO:tasks.workunit.client.0.smithi006.stdout:1/684: write d0/d25/f9e [909804,102792] 0 2024-03-12T16:10:54.136 INFO:tasks.workunit.client.0.smithi006.stdout:8/586: dread - d2/f7d zero size 2024-03-12T16:10:54.137 INFO:tasks.workunit.client.1.smithi134.stdout:0/878: write db/fe [2432198,91585] 0 2024-03-12T16:10:54.138 INFO:tasks.workunit.client.0.smithi006.stdout:1/685: chown d0/d25/d2a/d64 122851 1 2024-03-12T16:10:54.140 INFO:tasks.workunit.client.0.smithi006.stdout:5/614: dread d7/d9/d47/fa0 [0,4194304] 0 2024-03-12T16:10:54.141 INFO:tasks.workunit.client.0.smithi006.stdout:1/686: readlink d0/d25/d2a/d43/d56/l4c 0 2024-03-12T16:10:54.144 INFO:tasks.workunit.client.0.smithi006.stdout:8/587: rename d2/d32/c3b to d2/db/d1a/d21/dad/d7c/cbd 0 2024-03-12T16:10:54.144 INFO:tasks.workunit.client.1.smithi134.stdout:4/893: dwrite d1/d13/d49/f65 [0,4194304] 0 2024-03-12T16:10:54.147 INFO:tasks.workunit.client.0.smithi006.stdout:1/687: fsync d0/d25/d2a/f4d 0 2024-03-12T16:10:54.147 INFO:tasks.workunit.client.0.smithi006.stdout:8/588: write d2/f16 [3093715,29325] 0 2024-03-12T16:10:54.148 INFO:tasks.workunit.client.1.smithi134.stdout:0/879: rename db/d2f/d61/d67/l7d to db/d2f/d31/d68/d70/l11f 0 2024-03-12T16:10:54.150 INFO:tasks.workunit.client.1.smithi134.stdout:4/894: link d1/d13/d49/d64/d28/d4f/dbe/ff7 d1/de/d90/f119 0 2024-03-12T16:10:54.151 INFO:tasks.workunit.client.0.smithi006.stdout:6/697: dwrite d3/d11/d10/da7/f81 [0,4194304] 0 2024-03-12T16:10:54.152 INFO:tasks.workunit.client.1.smithi134.stdout:4/895: rmdir d1/d13/d49/d6d 39 2024-03-12T16:10:54.152 INFO:tasks.workunit.client.0.smithi006.stdout:8/589: creat d2/d32/fbe x:0 0 0 2024-03-12T16:10:54.159 INFO:tasks.workunit.client.1.smithi134.stdout:4/896: dwrite d1/d24/d34/f88 [0,4194304] 0 2024-03-12T16:10:54.160 INFO:tasks.workunit.client.0.smithi006.stdout:5/615: dwrite d7/d9/d31/d3b/d4f/d80/d88/fb6 [0,4194304] 0 2024-03-12T16:10:54.165 INFO:tasks.workunit.client.1.smithi134.stdout:4/897: creat d1/d13/d49/d64/d28/f11a x:0 0 0 2024-03-12T16:10:54.168 INFO:tasks.workunit.client.0.smithi006.stdout:7/808: dread de/d2c/faa [0,4194304] 0 2024-03-12T16:10:54.169 INFO:tasks.workunit.client.1.smithi134.stdout:4/898: mkdir d1/d13/d49/da4/d11b 0 2024-03-12T16:10:54.169 INFO:tasks.workunit.client.1.smithi134.stdout:4/899: dread - d1/d13/d49/d64/d28/d4f/dbe/ffb zero size 2024-03-12T16:10:54.170 INFO:tasks.workunit.client.0.smithi006.stdout:1/688: dwrite d0/d25/f9e [0,4194304] 0 2024-03-12T16:10:54.172 INFO:tasks.workunit.client.1.smithi134.stdout:4/900: dread - d1/d24/d34/ffe zero size 2024-03-12T16:10:54.172 INFO:tasks.workunit.client.0.smithi006.stdout:8/590: rename d2/db/d1a/d21/dad/d7c/l89 to d2/db/d1a/d21/d8a/lbf 0 2024-03-12T16:10:54.173 INFO:tasks.workunit.client.1.smithi134.stdout:0/880: dwrite db/f2c [0,4194304] 0 2024-03-12T16:10:54.174 INFO:tasks.workunit.client.0.smithi006.stdout:6/698: mkdir d3/d11/d10/da7/d8e/de1/dfe 0 2024-03-12T16:10:54.174 INFO:tasks.workunit.client.0.smithi006.stdout:5/616: symlink d7/d8/d91/lcb 0 2024-03-12T16:10:54.174 INFO:tasks.workunit.client.0.smithi006.stdout:7/809: mkdir de/d1c/d35/d110 0 2024-03-12T16:10:54.175 INFO:tasks.workunit.client.1.smithi134.stdout:0/881: fdatasync db/d2f/d31/d75/d88/fe1 0 2024-03-12T16:10:54.176 INFO:tasks.workunit.client.0.smithi006.stdout:1/689: creat d0/d25/d2a/d43/d56/fef x:0 0 0 2024-03-12T16:10:54.177 INFO:tasks.workunit.client.0.smithi006.stdout:8/591: creat d2/d55/d7b/fc0 x:0 0 0 2024-03-12T16:10:54.178 INFO:tasks.workunit.client.0.smithi006.stdout:1/690: fdatasync d0/d25/d2a/d35/f5c 0 2024-03-12T16:10:54.179 INFO:tasks.workunit.client.0.smithi006.stdout:8/592: fdatasync d2/f9b 0 2024-03-12T16:10:54.182 INFO:tasks.workunit.client.1.smithi134.stdout:4/901: dwrite d1/d24/d34/d73/fea [0,4194304] 0 2024-03-12T16:10:54.183 INFO:tasks.workunit.client.0.smithi006.stdout:5/617: unlink d7/d9/l83 0 2024-03-12T16:10:54.190 INFO:tasks.workunit.client.0.smithi006.stdout:7/810: unlink de/d1c/ca8 0 2024-03-12T16:10:54.192 INFO:tasks.workunit.client.0.smithi006.stdout:1/691: dread d0/d25/d2a/d35/fbd [0,4194304] 0 2024-03-12T16:10:54.199 INFO:tasks.workunit.client.0.smithi006.stdout:1/692: mknod d0/d25/d2a/d43/d68/dd2/cf0 0 2024-03-12T16:10:54.200 INFO:tasks.workunit.client.0.smithi006.stdout:8/593: dwrite d2/db/d1a/d21/d8a/f8b [0,4194304] 0 2024-03-12T16:10:54.203 INFO:tasks.workunit.client.0.smithi006.stdout:1/693: mkdir d0/d25/d2a/d43/d63/df1 0 2024-03-12T16:10:54.208 INFO:tasks.workunit.client.0.smithi006.stdout:8/594: read d2/db/d1a/d21/d4f/f68 [3319719,34775] 0 2024-03-12T16:10:54.213 INFO:tasks.workunit.client.0.smithi006.stdout:6/699: dwrite d3/d11/f25 [0,4194304] 0 2024-03-12T16:10:54.214 INFO:tasks.workunit.client.0.smithi006.stdout:6/700: fsync d3/d11/d10/d28/dd6/ffc 0 2024-03-12T16:10:54.218 INFO:tasks.workunit.client.0.smithi006.stdout:8/595: creat d2/db/d1a/d21/d2b/da2/fc1 x:0 0 0 2024-03-12T16:10:54.222 INFO:tasks.workunit.client.0.smithi006.stdout:6/701: mknod d3/cff 0 2024-03-12T16:10:54.222 INFO:tasks.workunit.client.0.smithi006.stdout:5/618: write d7/d41/f87 [3988496,37666] 0 2024-03-12T16:10:54.227 INFO:tasks.workunit.client.0.smithi006.stdout:6/702: chown d3/d11/d10/d28/ccc 61859450 1 2024-03-12T16:10:54.233 INFO:tasks.workunit.client.0.smithi006.stdout:8/596: dwrite d2/d11/fa9 [0,4194304] 0 2024-03-12T16:10:54.238 INFO:tasks.workunit.client.0.smithi006.stdout:7/811: dwrite de/d2c/d4f/dba/d39/f58 [0,4194304] 0 2024-03-12T16:10:54.238 INFO:tasks.workunit.client.0.smithi006.stdout:6/703: write d3/d11/d10/d19/f1f [4528395,62910] 0 2024-03-12T16:10:54.242 INFO:tasks.workunit.client.0.smithi006.stdout:1/694: dwrite d0/d25/d2a/d43/d56/f7e [0,4194304] 0 2024-03-12T16:10:54.246 INFO:tasks.workunit.client.0.smithi006.stdout:1/695: write d0/fb [4890910,92629] 0 2024-03-12T16:10:54.248 INFO:tasks.workunit.client.0.smithi006.stdout:5/619: dwrite d7/d9/d31/d3b/d4f/d65/d69/f90 [0,4194304] 0 2024-03-12T16:10:54.249 INFO:tasks.workunit.client.0.smithi006.stdout:1/696: read - d0/d25/fd6 zero size 2024-03-12T16:10:54.249 INFO:tasks.workunit.client.0.smithi006.stdout:8/597: rename d2/d11/f1b to d2/d11/d5a/fc2 0 2024-03-12T16:10:54.253 INFO:tasks.workunit.client.0.smithi006.stdout:8/598: fdatasync d2/db/d1a/d1f/fb0 0 2024-03-12T16:10:54.254 INFO:tasks.workunit.client.0.smithi006.stdout:1/697: fsync d0/d25/d2a/d43/f92 0 2024-03-12T16:10:54.255 INFO:tasks.workunit.client.0.smithi006.stdout:7/812: mknod de/d2c/d93/dbe/d4a/dbf/c111 0 2024-03-12T16:10:54.255 INFO:tasks.workunit.client.0.smithi006.stdout:6/704: truncate d3/d11/d10/d19/f65 200771 0 2024-03-12T16:10:54.258 INFO:tasks.workunit.client.0.smithi006.stdout:5/620: creat d7/d9/d47/fcc x:0 0 0 2024-03-12T16:10:54.258 INFO:tasks.workunit.client.0.smithi006.stdout:7/813: chown de/d2c/d93/dbe/d4a/l52 64416618 1 2024-03-12T16:10:54.258 INFO:tasks.workunit.client.0.smithi006.stdout:6/705: read - d3/d11/d10/d19/fa4 zero size 2024-03-12T16:10:54.260 INFO:tasks.workunit.client.0.smithi006.stdout:8/599: creat d2/fc3 x:0 0 0 2024-03-12T16:10:54.264 INFO:tasks.workunit.client.0.smithi006.stdout:5/621: write d7/d9/d10/d24/f3e [3111146,121361] 0 2024-03-12T16:10:54.264 INFO:tasks.workunit.client.0.smithi006.stdout:1/698: mkdir d0/d25/d2a/d43/dd1/df2 0 2024-03-12T16:10:54.268 INFO:tasks.workunit.client.0.smithi006.stdout:1/699: creat d0/d25/d2a/d43/d63/ff3 x:0 0 0 2024-03-12T16:10:54.270 INFO:tasks.workunit.client.0.smithi006.stdout:1/700: chown d0/d25/d2a/d43/d56/fef 5830040 1 2024-03-12T16:10:54.273 INFO:tasks.workunit.client.0.smithi006.stdout:1/701: mknod d0/d25/db1/dd9/cf4 0 2024-03-12T16:10:54.277 INFO:tasks.workunit.client.0.smithi006.stdout:4/756: sync 2024-03-12T16:10:54.277 INFO:tasks.workunit.client.0.smithi006.stdout:1/702: dread - d0/d25/db1/dd0/fe9 zero size 2024-03-12T16:10:54.280 INFO:tasks.workunit.client.1.smithi134.stdout:9/857: sync 2024-03-12T16:10:54.283 INFO:tasks.workunit.client.1.smithi134.stdout:9/858: symlink d5/d10/d33/lfe 0 2024-03-12T16:10:54.285 INFO:tasks.workunit.client.1.smithi134.stdout:9/859: mknod d5/d10/d33/da1/cff 0 2024-03-12T16:10:54.286 INFO:tasks.workunit.client.1.smithi134.stdout:9/860: chown d5/d10/d35/dc1 25 1 2024-03-12T16:10:54.286 INFO:tasks.workunit.client.0.smithi006.stdout:8/600: dwrite d2/db/d1a/d1f/f54 [0,4194304] 0 2024-03-12T16:10:54.289 INFO:tasks.workunit.client.1.smithi134.stdout:9/861: truncate d5/f14 924713 0 2024-03-12T16:10:54.292 INFO:tasks.workunit.client.1.smithi134.stdout:9/862: truncate d5/d20/d72/f9c 2905227 0 2024-03-12T16:10:54.292 INFO:tasks.workunit.client.0.smithi006.stdout:8/601: symlink d2/db/d70/daa/lc4 0 2024-03-12T16:10:54.293 INFO:tasks.workunit.client.0.smithi006.stdout:6/706: dread d3/d11/fd [0,4194304] 0 2024-03-12T16:10:54.294 INFO:tasks.workunit.client.0.smithi006.stdout:7/814: dread de/d2c/d93/dbe/d4a/dbf/ffe [4194304,4194304] 0 2024-03-12T16:10:54.294 INFO:tasks.workunit.client.0.smithi006.stdout:4/757: rename d1/db/d39/dbf/dec/d5a/d60/cd4 to d1/db/d1d/d2f/d6b/cfa 0 2024-03-12T16:10:54.295 INFO:tasks.workunit.client.1.smithi134.stdout:9/863: mkdir d5/d20/d100 0 2024-03-12T16:10:54.295 INFO:tasks.workunit.client.0.smithi006.stdout:5/622: dread d7/d8/f85 [0,4194304] 0 2024-03-12T16:10:54.296 INFO:tasks.workunit.client.0.smithi006.stdout:1/703: getdents d0/d25/d67/d8d 0 2024-03-12T16:10:54.297 INFO:tasks.workunit.client.0.smithi006.stdout:5/623: stat d7/d9/d10/d24/c51 0 2024-03-12T16:10:54.299 INFO:tasks.workunit.client.1.smithi134.stdout:9/864: symlink d5/d10/d35/d49/d54/l101 0 2024-03-12T16:10:54.299 INFO:tasks.workunit.client.1.smithi134.stdout:9/865: readlink d5/d10/d6c/l94 0 2024-03-12T16:10:54.299 INFO:tasks.workunit.client.0.smithi006.stdout:5/624: fdatasync d7/d9/d31/f2e 0 2024-03-12T16:10:54.299 INFO:tasks.workunit.client.0.smithi006.stdout:7/815: chown de/f17 462747797 1 2024-03-12T16:10:54.299 INFO:tasks.workunit.client.1.smithi134.stdout:9/866: creat d5/d10/d51/dad/f102 x:0 0 0 2024-03-12T16:10:54.301 INFO:tasks.workunit.client.0.smithi006.stdout:4/758: write d1/db/d39/dbf/dec/d5a/f8c [1294428,14481] 0 2024-03-12T16:10:54.313 INFO:tasks.workunit.client.0.smithi006.stdout:7/816: rename de/d2c/f73 to de/f112 0 2024-03-12T16:10:54.314 INFO:tasks.workunit.client.0.smithi006.stdout:6/707: mknod d3/d11/d10/da7/dd5/ddb/c100 0 2024-03-12T16:10:54.316 INFO:tasks.workunit.client.0.smithi006.stdout:4/759: symlink d1/db/d39/dbf/lfb 0 2024-03-12T16:10:54.318 INFO:tasks.workunit.client.0.smithi006.stdout:8/602: truncate d2/d11/f9d 4890271 0 2024-03-12T16:10:54.319 INFO:tasks.workunit.client.0.smithi006.stdout:1/704: write d0/d25/d2a/f54 [1397434,90565] 0 2024-03-12T16:10:54.331 INFO:tasks.workunit.client.0.smithi006.stdout:6/708: dread d3/fca [0,4194304] 0 2024-03-12T16:10:54.333 INFO:tasks.workunit.client.0.smithi006.stdout:6/709: chown d3/d11/d10/d1b/d6e 2355908 1 2024-03-12T16:10:54.335 INFO:tasks.workunit.client.0.smithi006.stdout:2/684: sync 2024-03-12T16:10:54.335 INFO:tasks.workunit.client.0.smithi006.stdout:0/697: sync 2024-03-12T16:10:54.335 INFO:tasks.workunit.client.0.smithi006.stdout:3/565: sync 2024-03-12T16:10:54.335 INFO:tasks.workunit.client.0.smithi006.stdout:9/587: sync 2024-03-12T16:10:54.336 INFO:tasks.workunit.client.1.smithi134.stdout:9/867: dwrite d5/d20/f23 [0,4194304] 0 2024-03-12T16:10:54.336 INFO:tasks.workunit.client.0.smithi006.stdout:5/625: rename d7/d9/d47/d56/l9f to d7/d9/d31/d3b/d61/lcd 0 2024-03-12T16:10:54.337 INFO:tasks.workunit.client.0.smithi006.stdout:6/710: truncate d3/d11/d10/d28/dd6/ffc 650156 0 2024-03-12T16:10:54.338 INFO:tasks.workunit.client.1.smithi134.stdout:9/868: chown d5/f28 108109521 1 2024-03-12T16:10:54.339 INFO:tasks.workunit.client.0.smithi006.stdout:3/566: fsync d8/f88 0 2024-03-12T16:10:54.339 INFO:tasks.workunit.client.1.smithi134.stdout:9/869: readlink d5/d10/d35/d49/d54/d5e/d82/l89 0 2024-03-12T16:10:54.341 INFO:tasks.workunit.client.1.smithi134.stdout:9/870: fdatasync d5/d10/d51/fa7 0 2024-03-12T16:10:54.343 INFO:tasks.workunit.client.0.smithi006.stdout:0/698: fdatasync d2/d6/d10/f6d 0 2024-03-12T16:10:54.347 INFO:tasks.workunit.client.1.smithi134.stdout:9/871: dread d5/d10/d1f/f50 [0,4194304] 0 2024-03-12T16:10:54.348 INFO:tasks.workunit.client.0.smithi006.stdout:2/685: creat d0/d13/d49/d60/d2b/d62/d66/d67/fd7 x:0 0 0 2024-03-12T16:10:54.350 INFO:tasks.workunit.client.0.smithi006.stdout:5/626: mknod d7/d9/d31/d3b/d4f/d80/cce 0 2024-03-12T16:10:54.350 INFO:tasks.workunit.client.1.smithi134.stdout:9/872: read d5/d20/d72/f9c [1446148,29254] 0 2024-03-12T16:10:54.351 INFO:tasks.workunit.client.1.smithi134.stdout:9/873: chown d5/d10/d35/d49/d54/d88/lb3 25953622 1 2024-03-12T16:10:54.352 INFO:tasks.workunit.client.0.smithi006.stdout:3/567: mknod d8/d19/dbc/cc2 0 2024-03-12T16:10:54.354 INFO:tasks.workunit.client.1.smithi134.stdout:9/874: mkdir d5/d20/d47/d103 0 2024-03-12T16:10:54.355 INFO:tasks.workunit.client.0.smithi006.stdout:0/699: dwrite d2/d6/d10/d11/f35 [0,4194304] 0 2024-03-12T16:10:54.356 INFO:tasks.workunit.client.1.smithi134.stdout:9/875: chown d5/d10/d35/d49/d54/d5e/dab/fc4 5794990 1 2024-03-12T16:10:54.356 INFO:tasks.workunit.client.1.smithi134.stdout:9/876: chown d5/d10/c41 0 1 2024-03-12T16:10:54.358 INFO:tasks.workunit.client.0.smithi006.stdout:3/568: write d8/d19/fa7 [215704,97437] 0 2024-03-12T16:10:54.360 INFO:tasks.workunit.client.1.smithi134.stdout:9/877: rename d5/d10/d35/d49/d8d/fbf to d5/d10/d6c/f104 0 2024-03-12T16:10:54.361 INFO:tasks.workunit.client.0.smithi006.stdout:8/603: getdents d2/db/d1a/d21/d4f 0 2024-03-12T16:10:54.361 INFO:tasks.workunit.client.0.smithi006.stdout:9/588: rename d0/d4/d3b/d6a/f6b to d0/d4/da7/fc4 0 2024-03-12T16:10:54.365 INFO:tasks.workunit.client.0.smithi006.stdout:7/817: mkdir de/d1c/d87/ddb/d7c/d113 0 2024-03-12T16:10:54.369 INFO:tasks.workunit.client.0.smithi006.stdout:8/604: dread d2/db/d1a/d1f/f54 [0,4194304] 0 2024-03-12T16:10:54.370 INFO:tasks.workunit.client.0.smithi006.stdout:0/700: unlink d2/d6/d10/d11/d7e/da6/d9e/fb9 0 2024-03-12T16:10:54.374 INFO:tasks.workunit.client.0.smithi006.stdout:9/589: mkdir d0/d8/d16/d7d/d20/d37/dc5 0 2024-03-12T16:10:54.377 INFO:tasks.workunit.client.0.smithi006.stdout:2/686: rmdir d0/dc/d64/dc3 39 2024-03-12T16:10:54.379 INFO:tasks.workunit.client.0.smithi006.stdout:3/569: dread d8/d19/d26/d59/d2c/dc/d28/f90 [0,4194304] 0 2024-03-12T16:10:54.382 INFO:tasks.workunit.client.0.smithi006.stdout:3/570: write d8/d19/d47/f96 [6275642,20694] 0 2024-03-12T16:10:54.382 INFO:tasks.workunit.client.0.smithi006.stdout:0/701: creat d2/d6/d37/d97/fda x:0 0 0 2024-03-12T16:10:54.382 INFO:tasks.workunit.client.0.smithi006.stdout:4/760: write d1/db/d39/fa9 [1621067,110860] 0 2024-03-12T16:10:54.385 INFO:tasks.workunit.client.0.smithi006.stdout:7/818: mknod de/d2c/d93/dbe/d4a/d6a/dc7/c114 0 2024-03-12T16:10:54.385 INFO:tasks.workunit.client.1.smithi134.stdout:9/878: dread d5/d10/d35/d49/d8d/f75 [4194304,4194304] 0 2024-03-12T16:10:54.388 INFO:tasks.workunit.client.0.smithi006.stdout:2/687: dread - d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f85 zero size 2024-03-12T16:10:54.388 INFO:tasks.workunit.client.1.smithi134.stdout:9/879: symlink d5/d10/d35/dc1/l105 0 2024-03-12T16:10:54.389 INFO:tasks.workunit.client.0.smithi006.stdout:5/627: rename d7/d9/d10/d24/d89/fa2 to d7/d9/d31/d3b/fcf 0 2024-03-12T16:10:54.390 INFO:tasks.workunit.client.0.smithi006.stdout:9/590: dread d0/d4/d70/d71/f98 [0,4194304] 0 2024-03-12T16:10:54.392 INFO:tasks.workunit.client.0.smithi006.stdout:2/688: write d0/d13/d49/d60/d2b/d62/d66/da6/fa9 [3577611,50982] 0 2024-03-12T16:10:54.395 INFO:tasks.workunit.client.1.smithi134.stdout:9/880: write d5/d10/d6c/f58 [4133061,104430] 0 2024-03-12T16:10:54.398 INFO:tasks.workunit.client.1.smithi134.stdout:9/881: creat d5/d10/d35/d49/d8d/def/f106 x:0 0 0 2024-03-12T16:10:54.398 INFO:tasks.workunit.client.0.smithi006.stdout:5/628: chown d7/d9/d31/d3b/d6b/db9/fc9 231649172 1 2024-03-12T16:10:54.399 INFO:tasks.workunit.client.0.smithi006.stdout:3/571: dread d8/d19/d47/f72 [0,4194304] 0 2024-03-12T16:10:54.401 INFO:tasks.workunit.client.0.smithi006.stdout:8/605: dread d2/db/f69 [0,4194304] 0 2024-03-12T16:10:54.404 INFO:tasks.workunit.client.0.smithi006.stdout:2/689: dread - d0/d13/d49/d60/d2b/d62/fb9 zero size 2024-03-12T16:10:54.406 INFO:tasks.workunit.client.0.smithi006.stdout:9/591: mkdir d0/d8f/dc6 0 2024-03-12T16:10:54.406 INFO:tasks.workunit.client.0.smithi006.stdout:6/711: dwrite d3/d11/d10/d1b/d6e/d80/d9b/fc6 [0,4194304] 0 2024-03-12T16:10:54.413 INFO:tasks.workunit.client.0.smithi006.stdout:4/761: write d1/db/d39/dbf/dec/d5a/d60/f7b [541508,82919] 0 2024-03-12T16:10:54.414 INFO:tasks.workunit.client.0.smithi006.stdout:5/629: dread d7/d9/d10/d24/f3d [0,4194304] 0 2024-03-12T16:10:54.416 INFO:tasks.workunit.client.0.smithi006.stdout:6/712: symlink d3/d11/d10/d1b/d20/d7c/l101 0 2024-03-12T16:10:54.418 INFO:tasks.workunit.client.0.smithi006.stdout:3/572: getdents d8/d19/d26/d59/d2c/dc/d28/d2f/d9d 0 2024-03-12T16:10:54.419 INFO:tasks.workunit.client.0.smithi006.stdout:7/819: write de/d7b/dc6/fe5 [849261,40675] 0 2024-03-12T16:10:54.419 INFO:tasks.workunit.client.0.smithi006.stdout:3/573: chown d8/c22 2899450 1 2024-03-12T16:10:54.422 INFO:tasks.workunit.client.0.smithi006.stdout:5/630: chown d7/d9/d31/d3b/d4f/d65/cac 4 1 2024-03-12T16:10:54.422 INFO:tasks.workunit.client.0.smithi006.stdout:9/592: write d0/d8/d16/d7d/d20/d37/f39 [3631171,75981] 0 2024-03-12T16:10:54.426 INFO:tasks.workunit.client.1.smithi134.stdout:4/902: sync 2024-03-12T16:10:54.426 INFO:tasks.workunit.client.1.smithi134.stdout:2/872: sync 2024-03-12T16:10:54.426 INFO:tasks.workunit.client.1.smithi134.stdout:6/890: sync 2024-03-12T16:10:54.426 INFO:tasks.workunit.client.1.smithi134.stdout:0/882: sync 2024-03-12T16:10:54.427 INFO:tasks.workunit.client.1.smithi134.stdout:7/927: sync 2024-03-12T16:10:54.427 INFO:tasks.workunit.client.1.smithi134.stdout:8/894: sync 2024-03-12T16:10:54.427 INFO:tasks.workunit.client.1.smithi134.stdout:1/642: sync 2024-03-12T16:10:54.427 INFO:tasks.workunit.client.0.smithi006.stdout:0/702: rename d2/d6/d10/d11/d1d/d2e/d77 to d2/d6/d10/ddb 0 2024-03-12T16:10:54.428 INFO:tasks.workunit.client.0.smithi006.stdout:4/762: mkdir d1/db/d39/dfc 0 2024-03-12T16:10:54.429 INFO:tasks.workunit.client.0.smithi006.stdout:3/574: dread - d8/d19/d78/fae zero size 2024-03-12T16:10:54.430 INFO:tasks.workunit.client.0.smithi006.stdout:2/690: write d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fb0 [93082,109856] 0 2024-03-12T16:10:54.431 INFO:tasks.workunit.client.0.smithi006.stdout:3/575: chown d8/d4c 8343749 1 2024-03-12T16:10:54.432 INFO:tasks.workunit.client.0.smithi006.stdout:7/820: creat de/d1c/d87/f115 x:0 0 0 2024-03-12T16:10:54.433 INFO:tasks.workunit.client.0.smithi006.stdout:5/631: mkdir d7/d9/d31/d3b/d4f/d80/dd0 0 2024-03-12T16:10:54.434 INFO:tasks.workunit.client.1.smithi134.stdout:4/903: unlink d1/d13/d49/d64/d28/d4f/dbe/fc6 0 2024-03-12T16:10:54.434 INFO:tasks.workunit.client.1.smithi134.stdout:0/883: mknod db/d2f/d61/c120 0 2024-03-12T16:10:54.437 INFO:tasks.workunit.client.1.smithi134.stdout:2/873: truncate d4/d84/d7d/f3a 3044513 0 2024-03-12T16:10:54.438 INFO:tasks.workunit.client.0.smithi006.stdout:9/593: fsync d0/d8/d16/d2f/fa5 0 2024-03-12T16:10:54.438 INFO:tasks.workunit.client.1.smithi134.stdout:8/895: mkdir d3/d1b/d17/d25/d33/d132/d135 0 2024-03-12T16:10:54.438 INFO:tasks.workunit.client.0.smithi006.stdout:8/606: dread d2/db/d1a/d7a/f9e [0,4194304] 0 2024-03-12T16:10:54.439 INFO:tasks.workunit.client.1.smithi134.stdout:4/904: creat d1/d24/ddd/f11c x:0 0 0 2024-03-12T16:10:54.440 INFO:tasks.workunit.client.1.smithi134.stdout:0/884: creat db/d2f/d31/d68/d70/f121 x:0 0 0 2024-03-12T16:10:54.442 INFO:tasks.workunit.client.1.smithi134.stdout:2/874: mkdir d4/d84/d63/dde/df0/d139 0 2024-03-12T16:10:54.442 INFO:tasks.workunit.client.0.smithi006.stdout:6/713: dwrite d3/d11/fd [4194304,4194304] 0 2024-03-12T16:10:54.443 INFO:tasks.workunit.client.1.smithi134.stdout:8/896: write d3/d1b/d17/d25/f101 [1128771,13324] 0 2024-03-12T16:10:54.444 INFO:tasks.workunit.client.0.smithi006.stdout:4/763: mknod d1/d38/d79/cfd 0 2024-03-12T16:10:54.448 INFO:tasks.workunit.client.0.smithi006.stdout:5/632: truncate d7/d9/d47/fc1 653658 0 2024-03-12T16:10:54.448 INFO:tasks.workunit.client.1.smithi134.stdout:7/928: dwrite d8/f1a [0,4194304] 0 2024-03-12T16:10:54.449 INFO:tasks.workunit.client.0.smithi006.stdout:0/703: creat d2/d39/fdc x:0 0 0 2024-03-12T16:10:54.451 INFO:tasks.workunit.client.1.smithi134.stdout:1/643: dwrite d0/d30/d86/fb5 [0,4194304] 0 2024-03-12T16:10:54.453 INFO:tasks.workunit.client.0.smithi006.stdout:8/607: creat d2/dab/fc5 x:0 0 0 2024-03-12T16:10:54.454 INFO:tasks.workunit.client.0.smithi006.stdout:2/691: dwrite d0/f4 [4194304,4194304] 0 2024-03-12T16:10:54.454 INFO:tasks.workunit.client.0.smithi006.stdout:6/714: write d3/d11/d10/da7/d8e/de1/f85 [131582,45724] 0 2024-03-12T16:10:54.458 INFO:tasks.workunit.client.0.smithi006.stdout:9/594: write d0/d8/d16/f54 [362094,8991] 0 2024-03-12T16:10:54.461 INFO:tasks.workunit.client.1.smithi134.stdout:8/897: creat d3/d1b/d17/d25/d33/d15/d95/d6d/dc5/f136 x:0 0 0 2024-03-12T16:10:54.461 INFO:tasks.workunit.client.1.smithi134.stdout:2/875: mknod d4/d12/d1d/d34/db7/c13a 0 2024-03-12T16:10:54.463 INFO:tasks.workunit.client.1.smithi134.stdout:7/929: dread - d8/dc/d7b/d119/f11d zero size 2024-03-12T16:10:54.466 INFO:tasks.workunit.client.0.smithi006.stdout:0/704: mkdir d2/d6/d10/ddd 0 2024-03-12T16:10:54.466 INFO:tasks.workunit.client.0.smithi006.stdout:6/715: creat d3/d11/d10/d28/f102 x:0 0 0 2024-03-12T16:10:54.466 INFO:tasks.workunit.client.0.smithi006.stdout:4/764: read d1/db/d39/d42/f78 [70301,95866] 0 2024-03-12T16:10:54.466 INFO:tasks.workunit.client.0.smithi006.stdout:8/608: chown d2/db/d1a/d21/d4f/f56 200039659 1 2024-03-12T16:10:54.470 INFO:tasks.workunit.client.0.smithi006.stdout:7/821: dwrite de/d2c/d4f/dba/f31 [0,4194304] 0 2024-03-12T16:10:54.470 INFO:tasks.workunit.client.1.smithi134.stdout:7/930: truncate d8/dc/d20/d26/f115 1296628 0 2024-03-12T16:10:54.470 INFO:tasks.workunit.client.1.smithi134.stdout:6/891: dwrite d1/d16/d4c/d58/d8e/ff7 [0,4194304] 0 2024-03-12T16:10:54.471 INFO:tasks.workunit.client.0.smithi006.stdout:4/765: fsync d1/db/d1d/fbe 0 2024-03-12T16:10:54.474 INFO:tasks.workunit.client.1.smithi134.stdout:4/905: write d1/d13/d49/d53/fba [278447,10699] 0 2024-03-12T16:10:54.475 INFO:tasks.workunit.client.1.smithi134.stdout:0/885: dwrite db/d2f/d31/d68/da2/dd3/de5/fff [0,4194304] 0 2024-03-12T16:10:54.475 INFO:tasks.workunit.client.1.smithi134.stdout:7/931: dread - d8/dc/d55/d81/d87/fdf zero size 2024-03-12T16:10:54.476 INFO:tasks.workunit.client.0.smithi006.stdout:2/692: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/dbb/fd8 x:0 0 0 2024-03-12T16:10:54.477 INFO:tasks.workunit.client.0.smithi006.stdout:0/705: mknod d2/d39/d42/cde 0 2024-03-12T16:10:54.479 INFO:tasks.workunit.client.0.smithi006.stdout:3/576: write d8/d19/d26/d59/d2c/d41/d45/f89 [236937,62980] 0 2024-03-12T16:10:54.480 INFO:tasks.workunit.client.0.smithi006.stdout:0/706: readlink d2/d6/d37/d97/dbb/lcb 0 2024-03-12T16:10:54.480 INFO:tasks.workunit.client.0.smithi006.stdout:3/577: readlink d8/d19/l25 0 2024-03-12T16:10:54.485 INFO:tasks.workunit.client.0.smithi006.stdout:4/766: truncate d1/db/d39/dbf/dec/f85 1038644 0 2024-03-12T16:10:54.485 INFO:tasks.workunit.client.1.smithi134.stdout:6/892: stat d1/da6/d55/d85/fd0 0 2024-03-12T16:10:54.485 INFO:tasks.workunit.client.1.smithi134.stdout:0/886: rmdir db/d2f/d61/d94 39 2024-03-12T16:10:54.487 INFO:tasks.workunit.client.0.smithi006.stdout:4/767: fdatasync d1/db/d1d/d2f/ff6 0 2024-03-12T16:10:54.487 INFO:tasks.workunit.client.0.smithi006.stdout:0/707: mkdir d2/d6/d37/d97/dbb/ddf 0 2024-03-12T16:10:54.487 INFO:tasks.workunit.client.1.smithi134.stdout:8/898: link d3/d82/d104/cac d3/d1b/d17/d25/d33/d15/d95/d4f/d65/c137 0 2024-03-12T16:10:54.488 INFO:tasks.workunit.client.1.smithi134.stdout:6/893: truncate d1/d16/d4c/d65/f6b 4964182 0 2024-03-12T16:10:54.490 INFO:tasks.workunit.client.0.smithi006.stdout:5/633: write d7/d9/d31/f46 [3409225,99562] 0 2024-03-12T16:10:54.491 INFO:tasks.workunit.client.0.smithi006.stdout:4/768: stat d1/db/d39/dbf/dec/d43/f8e 0 2024-03-12T16:10:54.493 INFO:tasks.workunit.client.0.smithi006.stdout:7/822: getdents de/d2c/d93/dbe 0 2024-03-12T16:10:54.493 INFO:tasks.workunit.client.1.smithi134.stdout:2/876: truncate d4/d12/d1d/d34/d58/d74/fb0 2162505 0 2024-03-12T16:10:54.493 INFO:tasks.workunit.client.1.smithi134.stdout:6/894: symlink d1/d4/df2/l148 0 2024-03-12T16:10:54.495 INFO:tasks.workunit.client.0.smithi006.stdout:5/634: read d7/d9/d10/d35/fb1 [516026,116084] 0 2024-03-12T16:10:54.496 INFO:tasks.workunit.client.0.smithi006.stdout:2/693: rename d0/d13/d49/d60/d2b/d62/d66/d69/d81/db4/ld1 to d0/d13/d49/d60/d2b/d62/d66/da6/ld9 0 2024-03-12T16:10:54.496 INFO:tasks.workunit.client.0.smithi006.stdout:9/595: truncate d0/d4/f29 2265539 0 2024-03-12T16:10:54.497 INFO:tasks.workunit.client.1.smithi134.stdout:6/895: read - d1/d16/f103 zero size 2024-03-12T16:10:54.498 INFO:tasks.workunit.client.0.smithi006.stdout:9/596: write d0/fb1 [1365669,28707] 0 2024-03-12T16:10:54.498 INFO:tasks.workunit.client.1.smithi134.stdout:0/887: creat db/d2f/d31/d56/dbc/f122 x:0 0 0 2024-03-12T16:10:54.499 INFO:tasks.workunit.client.0.smithi006.stdout:0/708: unlink d2/d6/d10/d11/d32/fd3 0 2024-03-12T16:10:54.499 INFO:tasks.workunit.client.1.smithi134.stdout:8/899: getdents d3/d1b/d17/d3f 0 2024-03-12T16:10:54.500 INFO:tasks.workunit.client.0.smithi006.stdout:4/769: read - d1/db/d39/dbf/fda zero size 2024-03-12T16:10:54.500 INFO:tasks.workunit.client.1.smithi134.stdout:2/877: mknod d4/d84/d63/d111/c13b 0 2024-03-12T16:10:54.502 INFO:tasks.workunit.client.0.smithi006.stdout:7/823: mkdir de/d2c/d93/dbe/d4a/d6a/de8/d116 0 2024-03-12T16:10:54.503 INFO:tasks.workunit.client.0.smithi006.stdout:9/597: read d0/d83/d90/f9a [1523900,1375] 0 2024-03-12T16:10:54.505 INFO:tasks.workunit.client.1.smithi134.stdout:1/644: dwrite d0/d42/f98 [0,4194304] 0 2024-03-12T16:10:54.507 INFO:tasks.workunit.client.1.smithi134.stdout:6/896: mkdir d1/d4/df2/d131/d149 0 2024-03-12T16:10:54.508 INFO:tasks.workunit.client.0.smithi006.stdout:0/709: mkdir d2/d6/d10/d11/d32/de0 0 2024-03-12T16:10:54.510 INFO:tasks.workunit.client.1.smithi134.stdout:2/878: dread d4/d12/d1d/d34/dcb/f104 [0,4194304] 0 2024-03-12T16:10:54.510 INFO:tasks.workunit.client.0.smithi006.stdout:2/694: fsync d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/dbb/fd8 0 2024-03-12T16:10:54.510 INFO:tasks.workunit.client.1.smithi134.stdout:1/645: creat d0/d30/d48/fda x:0 0 0 2024-03-12T16:10:54.510 INFO:tasks.workunit.client.1.smithi134.stdout:7/932: dread d8/dc/d20/f67 [4194304,4194304] 0 2024-03-12T16:10:54.513 INFO:tasks.workunit.client.1.smithi134.stdout:8/900: rename d3/d1b/d17/d45/f116 to d3/d1b/d17/d25/d33/d15/d95/d6d/f138 0 2024-03-12T16:10:54.513 INFO:tasks.workunit.client.0.smithi006.stdout:0/710: truncate d2/d39/f63 519871 0 2024-03-12T16:10:54.513 INFO:tasks.workunit.client.1.smithi134.stdout:1/646: write d0/d16/d9/d13/d21/dac/fcc [955847,123933] 0 2024-03-12T16:10:54.514 INFO:tasks.workunit.client.0.smithi006.stdout:9/598: read - d0/d4/d18/d4d/f4e zero size 2024-03-12T16:10:54.516 INFO:tasks.workunit.client.0.smithi006.stdout:3/578: write d8/d19/d26/d59/d2c/f9a [668291,72679] 0 2024-03-12T16:10:54.517 INFO:tasks.workunit.client.0.smithi006.stdout:4/770: truncate d1/d38/f4f 9092266 0 2024-03-12T16:10:54.519 INFO:tasks.workunit.client.1.smithi134.stdout:1/647: creat d0/d30/d48/da1/fdb x:0 0 0 2024-03-12T16:10:54.521 INFO:tasks.workunit.client.0.smithi006.stdout:8/609: dwrite d2/db/f24 [0,4194304] 0 2024-03-12T16:10:54.521 INFO:tasks.workunit.client.0.smithi006.stdout:5/635: rmdir d7/d9/d31/d3b/d4f/d80/dd0 0 2024-03-12T16:10:54.522 INFO:tasks.workunit.client.1.smithi134.stdout:6/897: dwrite d1/d16/d4c/ff4 [0,4194304] 0 2024-03-12T16:10:54.523 INFO:tasks.workunit.client.1.smithi134.stdout:8/901: rename d3/d1b/d17/d24/db6/l11a to d3/d1b/d17/d24/l139 0 2024-03-12T16:10:54.527 INFO:tasks.workunit.client.1.smithi134.stdout:0/888: write db/fc [59671,30680] 0 2024-03-12T16:10:54.530 INFO:tasks.workunit.client.1.smithi134.stdout:4/906: dwrite d1/d13/d49/da4/fec [0,4194304] 0 2024-03-12T16:10:54.532 INFO:tasks.workunit.client.1.smithi134.stdout:1/648: symlink d0/d16/ldc 0 2024-03-12T16:10:54.533 INFO:tasks.workunit.client.1.smithi134.stdout:6/898: mkdir d1/d16/d4c/d58/d115/d14a 0 2024-03-12T16:10:54.536 INFO:tasks.workunit.client.1.smithi134.stdout:9/882: sync 2024-03-12T16:10:54.538 INFO:tasks.workunit.client.0.smithi006.stdout:7/824: rename de/l61 to de/d98/l117 0 2024-03-12T16:10:54.538 INFO:tasks.workunit.client.0.smithi006.stdout:4/771: fsync d1/db/d39/dbf/dec/d43/db5/fdc 0 2024-03-12T16:10:54.540 INFO:tasks.workunit.client.0.smithi006.stdout:5/636: rmdir d7/d9/d31/d3b/d4f/db5 39 2024-03-12T16:10:54.550 INFO:tasks.workunit.client.1.smithi134.stdout:7/933: dwrite d8/db4/fc4 [0,4194304] 0 2024-03-12T16:10:54.551 INFO:tasks.workunit.client.1.smithi134.stdout:9/883: mknod d5/d20/c107 0 2024-03-12T16:10:54.551 INFO:tasks.workunit.client.0.smithi006.stdout:5/637: rmdir d7/d9/d10/d35 39 2024-03-12T16:10:54.553 INFO:tasks.workunit.client.0.smithi006.stdout:5/638: fsync d7/d41/fc6 0 2024-03-12T16:10:54.553 INFO:tasks.workunit.client.0.smithi006.stdout:3/579: creat d8/fc3 x:0 0 0 2024-03-12T16:10:54.555 INFO:tasks.workunit.client.1.smithi134.stdout:6/899: mknod d1/da6/d55/d94/d127/d32/d4a/c14b 0 2024-03-12T16:10:54.555 INFO:tasks.workunit.client.1.smithi134.stdout:2/879: dwrite d4/d12/d43/da2/f69 [0,4194304] 0 2024-03-12T16:10:54.558 INFO:tasks.workunit.client.0.smithi006.stdout:5/639: fsync d7/d9/d47/fcc 0 2024-03-12T16:10:54.558 INFO:tasks.workunit.client.1.smithi134.stdout:4/907: truncate d1/d13/d49/f32 3263829 0 2024-03-12T16:10:54.559 INFO:tasks.workunit.client.0.smithi006.stdout:2/695: dwrite d0/d13/d49/d60/d2b/d62/f86 [0,4194304] 0 2024-03-12T16:10:54.560 INFO:tasks.workunit.client.0.smithi006.stdout:4/772: creat d1/db/d39/dbf/dec/d43/dcc/ffe x:0 0 0 2024-03-12T16:10:54.560 INFO:tasks.workunit.client.1.smithi134.stdout:8/902: dwrite d3/d1b/d17/d25/d33/f6b [0,4194304] 0 2024-03-12T16:10:54.562 INFO:tasks.workunit.client.1.smithi134.stdout:2/880: fsync d4/d84/f55 0 2024-03-12T16:10:54.562 INFO:tasks.workunit.client.0.smithi006.stdout:2/696: write d0/d13/d49/d60/fad [695197,33360] 0 2024-03-12T16:10:54.563 INFO:tasks.workunit.client.0.smithi006.stdout:0/711: rename d2/d39/d42/f56 to d2/d6/d10/d11/d1d/d2e/fe1 0 2024-03-12T16:10:54.567 INFO:tasks.workunit.client.0.smithi006.stdout:3/580: mkdir d8/d19/d31/dc4 0 2024-03-12T16:10:54.570 INFO:tasks.workunit.client.0.smithi006.stdout:7/825: chown de/d2c/faa 2760 1 2024-03-12T16:10:54.571 INFO:tasks.workunit.client.1.smithi134.stdout:4/908: mknod d1/d24/ddd/c11d 0 2024-03-12T16:10:54.571 INFO:tasks.workunit.client.1.smithi134.stdout:0/889: dwrite db/d2f/d31/d75/f7f [0,4194304] 0 2024-03-12T16:10:54.571 INFO:tasks.workunit.client.1.smithi134.stdout:8/903: creat d3/d82/f13a x:0 0 0 2024-03-12T16:10:54.571 INFO:tasks.workunit.client.1.smithi134.stdout:6/900: mknod d1/da6/d55/d94/d127/d32/d4a/c14c 0 2024-03-12T16:10:54.571 INFO:tasks.workunit.client.0.smithi006.stdout:2/697: fdatasync d0/d13/d49/d60/d2b/f94 0 2024-03-12T16:10:54.575 INFO:tasks.workunit.client.0.smithi006.stdout:2/698: fsync d0/d13/d49/d60/f36 0 2024-03-12T16:10:54.578 INFO:tasks.workunit.client.1.smithi134.stdout:4/909: dread - d1/d13/d49/d64/da3/fc8 zero size 2024-03-12T16:10:54.578 INFO:tasks.workunit.client.1.smithi134.stdout:1/649: rename d0/d42/d47/dc9 to d0/d16/d9/d13/ddd 0 2024-03-12T16:10:54.578 INFO:tasks.workunit.client.0.smithi006.stdout:7/826: rename de/d2c/d4f/dba/d39/d81/ded to de/d2c/d93/dbe/d4a/dd1/d118 0 2024-03-12T16:10:54.582 INFO:tasks.workunit.client.0.smithi006.stdout:3/581: creat d8/d19/d26/d59/d2c/dc/db7/fc5 x:0 0 0 2024-03-12T16:10:54.584 INFO:tasks.workunit.client.1.smithi134.stdout:2/881: mkdir d4/d12/d1d/d34/d58/d13c 0 2024-03-12T16:10:54.585 INFO:tasks.workunit.client.0.smithi006.stdout:0/712: link d2/d6/d10/d11/d1d/d2e/f8f d2/d6/d37/fe2 0 2024-03-12T16:10:54.586 INFO:tasks.workunit.client.1.smithi134.stdout:0/890: symlink db/d2f/d31/d56/dbc/l123 0 2024-03-12T16:10:54.587 INFO:tasks.workunit.client.0.smithi006.stdout:0/713: chown d2/d39/d42/c4e 1166108 1 2024-03-12T16:10:54.587 INFO:tasks.workunit.client.0.smithi006.stdout:9/599: dread d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:54.587 INFO:tasks.workunit.client.0.smithi006.stdout:3/582: unlink d8/d19/f5f 0 2024-03-12T16:10:54.587 INFO:tasks.workunit.client.1.smithi134.stdout:2/882: stat d4/d12/d3b/d3f 0 2024-03-12T16:10:54.590 INFO:tasks.workunit.client.1.smithi134.stdout:7/934: rename d8/dc/d20/l78 to d8/d4e/l127 0 2024-03-12T16:10:54.590 INFO:tasks.workunit.client.0.smithi006.stdout:9/600: rmdir d0/d8/d80 39 2024-03-12T16:10:54.591 INFO:tasks.workunit.client.0.smithi006.stdout:0/714: creat d2/d6/d37/d97/dbb/fe3 x:0 0 0 2024-03-12T16:10:54.593 INFO:tasks.workunit.client.1.smithi134.stdout:9/884: dwrite d5/d10/f2d [0,4194304] 0 2024-03-12T16:10:54.594 INFO:tasks.workunit.client.1.smithi134.stdout:7/935: symlink d8/d27/l128 0 2024-03-12T16:10:54.596 INFO:tasks.workunit.client.1.smithi134.stdout:0/891: getdents db/d2f/d61/d6c 0 2024-03-12T16:10:54.597 INFO:tasks.workunit.client.0.smithi006.stdout:3/583: rename d8/d19/d26/d59/d2c/f13 to d8/d19/d26/d59/d2c/dc/d28/d2f/d9d/fc6 0 2024-03-12T16:10:54.598 INFO:tasks.workunit.client.1.smithi134.stdout:6/901: link d1/d3a/db5/c132 d1/da6/d55/d97/c14d 0 2024-03-12T16:10:54.598 INFO:tasks.workunit.client.1.smithi134.stdout:2/883: rmdir d4/d84/d7d/d87/d116 0 2024-03-12T16:10:54.599 INFO:tasks.workunit.client.1.smithi134.stdout:9/885: mknod d5/d10/d35/d49/d54/de2/c108 0 2024-03-12T16:10:54.599 INFO:tasks.workunit.client.0.smithi006.stdout:2/699: dread d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fbd [0,4194304] 0 2024-03-12T16:10:54.600 INFO:tasks.workunit.client.1.smithi134.stdout:0/892: chown db/d2f/d31/cab 3 1 2024-03-12T16:10:54.601 INFO:tasks.workunit.client.0.smithi006.stdout:0/715: rename d2/d39/d42/d82 to d2/d6/d10/d11/d7e/da6/de4 0 2024-03-12T16:10:54.602 INFO:tasks.workunit.client.1.smithi134.stdout:4/910: rename d1/de/d5a/d70/lf2 to d1/d13/l11e 0 2024-03-12T16:10:54.602 INFO:tasks.workunit.client.1.smithi134.stdout:0/893: fdatasync db/d2f/d31/d56/d66/fef 0 2024-03-12T16:10:54.605 INFO:tasks.workunit.client.0.smithi006.stdout:0/716: write d2/d6/d37/d97/faf [1046931,50177] 0 2024-03-12T16:10:54.608 INFO:tasks.workunit.client.1.smithi134.stdout:4/911: write d1/d13/d49/d64/d28/f99 [1077580,110473] 0 2024-03-12T16:10:54.609 INFO:tasks.workunit.client.1.smithi134.stdout:0/894: creat db/d2f/d31/d68/f124 x:0 0 0 2024-03-12T16:10:54.609 INFO:tasks.workunit.client.1.smithi134.stdout:2/884: link d4/c1a d4/de8/dea/df5/c13d 0 2024-03-12T16:10:54.611 INFO:tasks.workunit.client.1.smithi134.stdout:0/895: write db/d2f/d31/d56/dbc/f104 [486848,31662] 0 2024-03-12T16:10:54.612 INFO:tasks.workunit.client.0.smithi006.stdout:0/717: rename d2/d6/d37/dd6 to d2/d39/d42/de5 0 2024-03-12T16:10:54.614 INFO:tasks.workunit.client.0.smithi006.stdout:4/773: write d1/db/d1d/d2f/f36 [3663933,36262] 0 2024-03-12T16:10:54.614 INFO:tasks.workunit.client.1.smithi134.stdout:4/912: dread - d1/d13/d49/d53/fb2 zero size 2024-03-12T16:10:54.618 INFO:tasks.workunit.client.1.smithi134.stdout:0/896: creat db/d2f/d31/d68/da2/dd3/f125 x:0 0 0 2024-03-12T16:10:54.618 INFO:tasks.workunit.client.1.smithi134.stdout:7/936: dread d8/ff [0,4194304] 0 2024-03-12T16:10:54.619 INFO:tasks.workunit.client.1.smithi134.stdout:1/650: write d0/d16/d9/d13/d38/f8b [2211970,111418] 0 2024-03-12T16:10:54.619 INFO:tasks.workunit.client.0.smithi006.stdout:0/718: mknod d2/d6/d10/d11/d1d/d2e/ce6 0 2024-03-12T16:10:54.620 INFO:tasks.workunit.client.0.smithi006.stdout:4/774: mknod d1/db/d39/dbf/dec/cff 0 2024-03-12T16:10:54.622 INFO:tasks.workunit.client.1.smithi134.stdout:8/904: dwrite d3/d1b/d17/d25/d33/d15/f110 [0,4194304] 0 2024-03-12T16:10:54.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/651: fsync d0/d16/d9/d13/f8a 0 2024-03-12T16:10:54.622 INFO:tasks.workunit.client.1.smithi134.stdout:0/897: chown db/d2f/d51/c54 5 1 2024-03-12T16:10:54.624 INFO:tasks.workunit.client.0.smithi006.stdout:0/719: unlink d2/d6/l69 0 2024-03-12T16:10:54.625 INFO:tasks.workunit.client.1.smithi134.stdout:4/913: getdents d1/d24/ddd/ded 0 2024-03-12T16:10:54.626 INFO:tasks.workunit.client.1.smithi134.stdout:8/905: chown d3/d1b/d17/c3a 2 1 2024-03-12T16:10:54.626 INFO:tasks.workunit.client.0.smithi006.stdout:7/827: dwrite de/d7b/d7e/fbc [0,4194304] 0 2024-03-12T16:10:54.626 INFO:tasks.workunit.client.1.smithi134.stdout:9/886: truncate d5/d10/d35/d49/d54/d93/ff3 3577463 0 2024-03-12T16:10:54.627 INFO:tasks.workunit.client.1.smithi134.stdout:0/898: rmdir db/d2f/d31/d75/d88 39 2024-03-12T16:10:54.627 INFO:tasks.workunit.client.1.smithi134.stdout:8/906: dread - d3/d1b/d17/d25/d33/d96/f107 zero size 2024-03-12T16:10:54.629 INFO:tasks.workunit.client.1.smithi134.stdout:2/885: write d4/d84/d63/fbf [712263,120680] 0 2024-03-12T16:10:54.630 INFO:tasks.workunit.client.0.smithi006.stdout:9/601: dwrite d0/d8/d16/d7d/d20/f34 [0,4194304] 0 2024-03-12T16:10:54.630 INFO:tasks.workunit.client.0.smithi006.stdout:4/775: creat d1/db/d39/d42/f100 x:0 0 0 2024-03-12T16:10:54.632 INFO:tasks.workunit.client.0.smithi006.stdout:2/700: write d0/d13/d49/d60/f3b [4859665,113511] 0 2024-03-12T16:10:54.633 INFO:tasks.workunit.client.0.smithi006.stdout:0/720: mkdir d2/d6/d10/d11/d32/da4/db5/de7 0 2024-03-12T16:10:54.635 INFO:tasks.workunit.client.0.smithi006.stdout:7/828: write de/d18/fdc [2131286,18924] 0 2024-03-12T16:10:54.635 INFO:tasks.workunit.client.0.smithi006.stdout:9/602: unlink d0/d8/d16/d7d/db5/f7e 0 2024-03-12T16:10:54.638 INFO:tasks.workunit.client.1.smithi134.stdout:4/914: mknod d1/d13/d49/d64/d28/d4f/d105/c11f 0 2024-03-12T16:10:54.638 INFO:tasks.workunit.client.1.smithi134.stdout:4/915: fdatasync d1/d13/d49/da4/f102 0 2024-03-12T16:10:54.638 INFO:tasks.workunit.client.1.smithi134.stdout:1/652: read d0/d30/d86/fbc [1028347,34549] 0 2024-03-12T16:10:54.638 INFO:tasks.workunit.client.1.smithi134.stdout:7/937: truncate d8/dc/d4b/d97/fee 50205 0 2024-03-12T16:10:54.640 INFO:tasks.workunit.client.1.smithi134.stdout:2/886: chown d4/d12/d1d/d34/db7/l125 530372272 1 2024-03-12T16:10:54.640 INFO:tasks.workunit.client.1.smithi134.stdout:4/916: chown d1/de/d90/lde 44648571 1 2024-03-12T16:10:54.641 INFO:tasks.workunit.client.1.smithi134.stdout:9/887: symlink d5/d20/d100/l109 0 2024-03-12T16:10:54.642 INFO:tasks.workunit.client.0.smithi006.stdout:2/701: write d0/f4 [691316,85245] 0 2024-03-12T16:10:54.642 INFO:tasks.workunit.client.1.smithi134.stdout:1/653: stat d0/d16/d9/d13/d21/d5f/d6f/dad 0 2024-03-12T16:10:54.643 INFO:tasks.workunit.client.0.smithi006.stdout:3/584: dwrite d8/d19/d26/d59/f1e [4194304,4194304] 0 2024-03-12T16:10:54.644 INFO:tasks.workunit.client.1.smithi134.stdout:2/887: write d4/d84/d63/d9d/f4b [2843391,124951] 0 2024-03-12T16:10:54.644 INFO:tasks.workunit.client.0.smithi006.stdout:7/829: stat de/d2c/d4f/dba/d39/ld5 0 2024-03-12T16:10:54.647 INFO:tasks.workunit.client.0.smithi006.stdout:3/585: dread - d8/d19/fa3 zero size 2024-03-12T16:10:54.649 INFO:tasks.workunit.client.1.smithi134.stdout:1/654: read d0/d16/d9/d13/d21/f23 [5191637,35190] 0 2024-03-12T16:10:54.649 INFO:tasks.workunit.client.1.smithi134.stdout:4/917: mknod d1/d24/c120 0 2024-03-12T16:10:54.650 INFO:tasks.workunit.client.0.smithi006.stdout:7/830: fdatasync de/d2c/d4f/fa1 0 2024-03-12T16:10:54.650 INFO:tasks.workunit.client.0.smithi006.stdout:9/603: dwrite d0/d4/fb6 [4194304,4194304] 0 2024-03-12T16:10:54.654 INFO:tasks.workunit.client.1.smithi134.stdout:2/888: write d4/f90 [895332,46382] 0 2024-03-12T16:10:54.654 INFO:tasks.workunit.client.1.smithi134.stdout:1/655: write d0/d30/d86/fb5 [3962319,40615] 0 2024-03-12T16:10:54.655 INFO:tasks.workunit.client.1.smithi134.stdout:6/902: dwrite d1/da6/fc4 [0,4194304] 0 2024-03-12T16:10:54.658 INFO:tasks.workunit.client.1.smithi134.stdout:2/889: fdatasync d4/d12/fe4 0 2024-03-12T16:10:54.660 INFO:tasks.workunit.client.0.smithi006.stdout:2/702: rmdir d0/d13/d49/d60/d2b/d62/d66/da6 39 2024-03-12T16:10:54.660 INFO:tasks.workunit.client.0.smithi006.stdout:9/604: rmdir d0/d8/d16/d2f 39 2024-03-12T16:10:54.662 INFO:tasks.workunit.client.0.smithi006.stdout:7/831: truncate de/d2c/d4f/dba/f67 2320990 0 2024-03-12T16:10:54.668 INFO:tasks.workunit.client.1.smithi134.stdout:4/918: read d1/d13/d49/d64/f92 [801428,86430] 0 2024-03-12T16:10:54.668 INFO:tasks.workunit.client.1.smithi134.stdout:2/890: creat d4/de8/dea/d105/f13e x:0 0 0 2024-03-12T16:10:54.669 INFO:tasks.workunit.client.0.smithi006.stdout:9/605: chown d0/d8/d16/l7a 70984 1 2024-03-12T16:10:54.669 INFO:tasks.workunit.client.0.smithi006.stdout:2/703: fsync d0/d13/d49/d60/d2b/f90 0 2024-03-12T16:10:54.669 INFO:tasks.workunit.client.0.smithi006.stdout:7/832: creat de/d18/f119 x:0 0 0 2024-03-12T16:10:54.669 INFO:tasks.workunit.client.0.smithi006.stdout:7/833: fsync de/d2c/d4f/fb6 0 2024-03-12T16:10:54.673 INFO:tasks.workunit.client.0.smithi006.stdout:2/704: rmdir d0/d13/d49/d60 39 2024-03-12T16:10:54.678 INFO:tasks.workunit.client.0.smithi006.stdout:7/834: creat de/d18/f11a x:0 0 0 2024-03-12T16:10:54.679 INFO:tasks.workunit.client.1.smithi134.stdout:0/899: dwrite db/d2f/d61/d6c/fc9 [4194304,4194304] 0 2024-03-12T16:10:54.683 INFO:tasks.workunit.client.1.smithi134.stdout:4/919: chown d1/de/d90/fa6 61939 1 2024-03-12T16:10:54.685 INFO:tasks.workunit.client.1.smithi134.stdout:8/907: dwrite d3/db0/fe3 [0,4194304] 0 2024-03-12T16:10:54.685 INFO:tasks.workunit.client.1.smithi134.stdout:7/938: dwrite d8/db4/fd3 [0,4194304] 0 2024-03-12T16:10:54.685 INFO:tasks.workunit.client.0.smithi006.stdout:3/586: dwrite d8/d19/f4f [0,4194304] 0 2024-03-12T16:10:54.688 INFO:tasks.workunit.client.0.smithi006.stdout:3/587: chown d8/d19/d26/d59/d2c/dc/db7 84982 1 2024-03-12T16:10:54.688 INFO:tasks.workunit.client.0.smithi006.stdout:0/721: dread d2/d6/d10/d11/d1d/d79/f7f [0,4194304] 0 2024-03-12T16:10:54.690 INFO:tasks.workunit.client.0.smithi006.stdout:2/705: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/db4/dc0/fda x:0 0 0 2024-03-12T16:10:54.692 INFO:tasks.workunit.client.1.smithi134.stdout:8/908: write d3/fe [4324094,67110] 0 2024-03-12T16:10:54.692 INFO:tasks.workunit.client.0.smithi006.stdout:7/835: read de/d18/f1b [2118066,60139] 0 2024-03-12T16:10:54.692 INFO:tasks.workunit.client.1.smithi134.stdout:7/939: symlink d8/d27/d9d/l129 0 2024-03-12T16:10:54.692 INFO:tasks.workunit.client.1.smithi134.stdout:1/656: getdents d0/d16/d9/d13/d21/d2f/d8d 0 2024-03-12T16:10:54.694 INFO:tasks.workunit.client.1.smithi134.stdout:7/940: read d8/ff [453427,70879] 0 2024-03-12T16:10:54.695 INFO:tasks.workunit.client.1.smithi134.stdout:9/888: dread d5/d10/f95 [0,4194304] 0 2024-03-12T16:10:54.695 INFO:tasks.workunit.client.0.smithi006.stdout:7/836: truncate de/d2c/d4f/dba/d40/f103 819879 0 2024-03-12T16:10:54.695 INFO:tasks.workunit.client.1.smithi134.stdout:8/909: stat d3/d1b/d17/d25/d33/d15/d95/d4f/d65 0 2024-03-12T16:10:54.696 INFO:tasks.workunit.client.1.smithi134.stdout:1/657: mkdir d0/dde 0 2024-03-12T16:10:54.696 INFO:tasks.workunit.client.1.smithi134.stdout:7/941: chown d8/dc/d55/d81/c9c 120 1 2024-03-12T16:10:54.700 INFO:tasks.workunit.client.0.smithi006.stdout:3/588: mkdir d8/d19/d31/dc4/dc7 0 2024-03-12T16:10:54.701 INFO:tasks.workunit.client.1.smithi134.stdout:8/910: chown d3/d1b/d17/d25/d33/d96/dbd/lb2 226375483 1 2024-03-12T16:10:54.702 INFO:tasks.workunit.client.1.smithi134.stdout:9/889: read d5/d10/d35/d49/d54/fb1 [3941842,54791] 0 2024-03-12T16:10:54.702 INFO:tasks.workunit.client.1.smithi134.stdout:7/942: symlink d8/dc/d7b/df8/dfd/l12a 0 2024-03-12T16:10:54.703 INFO:tasks.workunit.client.0.smithi006.stdout:0/722: mkdir d2/d6/d10/ddd/de8 0 2024-03-12T16:10:54.704 INFO:tasks.workunit.client.0.smithi006.stdout:3/589: chown d8/f17 53915 1 2024-03-12T16:10:54.704 INFO:tasks.workunit.client.1.smithi134.stdout:1/658: symlink d0/d16/d9/d13/d21/d20/ldf 0 2024-03-12T16:10:54.705 INFO:tasks.workunit.client.0.smithi006.stdout:7/837: symlink de/d1c/d87/ddb/d7c/l11b 0 2024-03-12T16:10:54.706 INFO:tasks.workunit.client.1.smithi134.stdout:8/911: chown d3/d1b/lc8 286 1 2024-03-12T16:10:54.706 INFO:tasks.workunit.client.0.smithi006.stdout:3/590: write d8/d19/d26/d59/f1f [775967,66570] 0 2024-03-12T16:10:54.709 INFO:tasks.workunit.client.1.smithi134.stdout:6/903: dwrite d1/da6/d55/d94/d127/f59 [0,4194304] 0 2024-03-12T16:10:54.710 INFO:tasks.workunit.client.0.smithi006.stdout:0/723: rename d2/d6/d10/ddb/l7d to d2/d6/d10/ddd/de8/le9 0 2024-03-12T16:10:54.710 INFO:tasks.workunit.client.0.smithi006.stdout:7/838: rmdir de/d1c/d87/ddb/d7c 39 2024-03-12T16:10:54.713 INFO:tasks.workunit.client.0.smithi006.stdout:7/839: dread - de/d2c/d93/dbe/d66/fda zero size 2024-03-12T16:10:54.714 INFO:tasks.workunit.client.0.smithi006.stdout:0/724: rmdir d2/d6/d10/ddb 39 2024-03-12T16:10:54.715 INFO:tasks.workunit.client.1.smithi134.stdout:2/891: write d4/d12/d3b/f115 [1815731,59323] 0 2024-03-12T16:10:54.716 INFO:tasks.workunit.client.1.smithi134.stdout:0/900: write db/d2f/d31/d68/da2/db2/fdd [383788,45018] 0 2024-03-12T16:10:54.716 INFO:tasks.workunit.client.0.smithi006.stdout:7/840: mkdir de/d7b/dc6/d11c 0 2024-03-12T16:10:54.716 INFO:tasks.workunit.client.0.smithi006.stdout:7/841: chown de/d18/l21 66 1 2024-03-12T16:10:54.718 INFO:tasks.workunit.client.1.smithi134.stdout:1/659: fdatasync d0/d16/d39/fc0 0 2024-03-12T16:10:54.719 INFO:tasks.workunit.client.0.smithi006.stdout:3/591: mkdir d8/d4c/dc8 0 2024-03-12T16:10:54.722 INFO:tasks.workunit.client.1.smithi134.stdout:9/890: rename d5/d20/ccd to d5/d10/d35/d49/d54/c10a 0 2024-03-12T16:10:54.723 INFO:tasks.workunit.client.0.smithi006.stdout:0/725: mkdir d2/d6/d10/ddb/dea 0 2024-03-12T16:10:54.723 INFO:tasks.workunit.client.0.smithi006.stdout:7/842: mkdir de/d1c/d87/ddb/d7c/d11d 0 2024-03-12T16:10:54.724 INFO:tasks.workunit.client.1.smithi134.stdout:0/901: chown db/d2f/d31/d56/f72 4 1 2024-03-12T16:10:54.725 INFO:tasks.workunit.client.1.smithi134.stdout:7/943: dwrite d8/dc/d20/d26/f2b [4194304,4194304] 0 2024-03-12T16:10:54.725 INFO:tasks.workunit.client.0.smithi006.stdout:3/592: mkdir d8/d19/d26/d59/d2c/dc/dc9 0 2024-03-12T16:10:54.727 INFO:tasks.workunit.client.0.smithi006.stdout:3/593: read d8/d19/dbc/f80 [817902,35008] 0 2024-03-12T16:10:54.728 INFO:tasks.workunit.client.1.smithi134.stdout:6/904: link d1/d16/d4c/d65/f6b d1/d16/d4c/d58/d115/f14e 0 2024-03-12T16:10:54.729 INFO:tasks.workunit.client.0.smithi006.stdout:3/594: dread - d8/d19/d26/d59/d2c/dc/d28/d2f/d99/fac zero size 2024-03-12T16:10:54.731 INFO:tasks.workunit.client.0.smithi006.stdout:2/706: dread d0/f4 [0,4194304] 0 2024-03-12T16:10:54.736 INFO:tasks.workunit.client.1.smithi134.stdout:6/905: creat d1/d3a/db5/deb/f14f x:0 0 0 2024-03-12T16:10:54.736 INFO:tasks.workunit.client.1.smithi134.stdout:8/912: write d3/d1b/d17/d25/d33/d96/dbd/fdc [719513,90112] 0 2024-03-12T16:10:54.736 INFO:tasks.workunit.client.0.smithi006.stdout:3/595: link d8/d19/d26/d59/d2c/dc/f38 d8/d19/d31/fca 0 2024-03-12T16:10:54.736 INFO:tasks.workunit.client.1.smithi134.stdout:4/920: dwrite d1/de/f30 [0,4194304] 0 2024-03-12T16:10:54.739 INFO:tasks.workunit.client.1.smithi134.stdout:0/902: mkdir db/d2f/d31/d68/d70/d113/d126 0 2024-03-12T16:10:54.740 INFO:tasks.workunit.client.1.smithi134.stdout:4/921: fsync d1/d13/d49/d64/d28/f3b 0 2024-03-12T16:10:54.740 INFO:tasks.workunit.client.1.smithi134.stdout:2/892: getdents d4/d12/d1d/d34 0 2024-03-12T16:10:54.741 INFO:tasks.workunit.client.0.smithi006.stdout:3/596: link d8/d19/f4f d8/d19/d26/d97/fcb 0 2024-03-12T16:10:54.741 INFO:tasks.workunit.client.1.smithi134.stdout:9/891: dread d5/f14 [0,4194304] 0 2024-03-12T16:10:54.743 INFO:tasks.workunit.client.0.smithi006.stdout:3/597: symlink d8/d4c/d7c/lcc 0 2024-03-12T16:10:54.744 INFO:tasks.workunit.client.1.smithi134.stdout:2/893: chown d4/d12/fe4 5206551 1 2024-03-12T16:10:54.747 INFO:tasks.workunit.client.1.smithi134.stdout:0/903: creat db/d2f/d31/d56/d9a/f127 x:0 0 0 2024-03-12T16:10:54.748 INFO:tasks.workunit.client.1.smithi134.stdout:2/894: truncate d4/d12/f32 2357973 0 2024-03-12T16:10:54.749 INFO:tasks.workunit.client.0.smithi006.stdout:7/843: write de/d2c/d4f/dba/d40/f63 [2093960,98466] 0 2024-03-12T16:10:54.750 INFO:tasks.workunit.client.1.smithi134.stdout:0/904: fdatasync db/d2f/d31/d68/da2/dd3/f10a 0 2024-03-12T16:10:54.751 INFO:tasks.workunit.client.1.smithi134.stdout:0/905: dread - db/d2f/d31/d75/f106 zero size 2024-03-12T16:10:54.752 INFO:tasks.workunit.client.1.smithi134.stdout:4/922: link d1/d13/d49/d64/d28/f5e d1/d13/d49/d64/d28/d4f/d105/f121 0 2024-03-12T16:10:54.753 INFO:tasks.workunit.client.1.smithi134.stdout:8/913: getdents d3/d1b/d17/d25/d33/d15/d95/d6d 0 2024-03-12T16:10:54.754 INFO:tasks.workunit.client.1.smithi134.stdout:2/895: mknod d4/d12/d43/da2/c13f 0 2024-03-12T16:10:54.754 INFO:tasks.workunit.client.1.smithi134.stdout:9/892: read d5/d10/d1f/f79 [28637,119788] 0 2024-03-12T16:10:54.755 INFO:tasks.workunit.client.0.smithi006.stdout:2/707: truncate d0/f3f 3619110 0 2024-03-12T16:10:54.757 INFO:tasks.workunit.client.0.smithi006.stdout:0/726: dwrite d2/d6/d10/d11/d1d/d2e/f8f [4194304,4194304] 0 2024-03-12T16:10:54.758 INFO:tasks.workunit.client.1.smithi134.stdout:8/914: fsync d3/d82/d104/d31/d9b/ffe 0 2024-03-12T16:10:54.760 INFO:tasks.workunit.client.0.smithi006.stdout:7/844: read de/d1c/d87/ddb/d7c/fa3 [169070,95633] 0 2024-03-12T16:10:54.761 INFO:tasks.workunit.client.1.smithi134.stdout:2/896: creat d4/d12/d1d/d34/d47/d8c/da4/f140 x:0 0 0 2024-03-12T16:10:54.761 INFO:tasks.workunit.client.0.smithi006.stdout:2/708: write d0/d13/d49/d60/d2b/d62/d66/d67/fd7 [139567,49972] 0 2024-03-12T16:10:54.762 INFO:tasks.workunit.client.0.smithi006.stdout:1/705: sync 2024-03-12T16:10:54.766 INFO:tasks.workunit.client.1.smithi134.stdout:8/915: creat d3/d1b/d17/d3f/f13b x:0 0 0 2024-03-12T16:10:54.766 INFO:tasks.workunit.client.0.smithi006.stdout:7/845: creat de/d2c/d4f/d83/f11e x:0 0 0 2024-03-12T16:10:54.767 INFO:tasks.workunit.client.0.smithi006.stdout:7/846: chown de/d7b/dc6/d11c 118 1 2024-03-12T16:10:54.769 INFO:tasks.workunit.client.0.smithi006.stdout:2/709: stat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fb8 0 2024-03-12T16:10:54.770 INFO:tasks.workunit.client.1.smithi134.stdout:2/897: creat d4/d84/d63/d9d/d3d/d71/f141 x:0 0 0 2024-03-12T16:10:54.771 INFO:tasks.workunit.client.0.smithi006.stdout:1/706: read d0/d25/d2a/d35/f55 [363560,54210] 0 2024-03-12T16:10:54.771 INFO:tasks.workunit.client.0.smithi006.stdout:7/847: creat de/d1c/d35/f11f x:0 0 0 2024-03-12T16:10:54.773 INFO:tasks.workunit.client.1.smithi134.stdout:4/923: write d1/d13/d49/d64/f92 [923661,586] 0 2024-03-12T16:10:54.774 INFO:tasks.workunit.client.1.smithi134.stdout:0/906: dread db/d2f/d31/d68/da2/db2/fd7 [0,4194304] 0 2024-03-12T16:10:54.774 INFO:tasks.workunit.client.0.smithi006.stdout:7/848: chown de/d18/f47 510759 1 2024-03-12T16:10:54.774 INFO:tasks.workunit.client.0.smithi006.stdout:0/727: getdents d2/d39 0 2024-03-12T16:10:54.775 INFO:tasks.workunit.client.1.smithi134.stdout:2/898: dread d4/d12/d1d/f8a [0,4194304] 0 2024-03-12T16:10:54.776 INFO:tasks.workunit.client.1.smithi134.stdout:9/893: write d5/d10/d35/d49/d54/fb1 [856537,124228] 0 2024-03-12T16:10:54.777 INFO:tasks.workunit.client.0.smithi006.stdout:1/707: symlink d0/d25/d2a/d35/dce/lf5 0 2024-03-12T16:10:54.777 INFO:tasks.workunit.client.1.smithi134.stdout:0/907: dread - db/d2f/d31/d68/da2/f119 zero size 2024-03-12T16:10:54.777 INFO:tasks.workunit.client.0.smithi006.stdout:3/598: dread d8/d19/d31/fca [0,4194304] 0 2024-03-12T16:10:54.778 INFO:tasks.workunit.client.0.smithi006.stdout:0/728: creat d2/d6/d37/d97/feb x:0 0 0 2024-03-12T16:10:54.780 INFO:tasks.workunit.client.1.smithi134.stdout:9/894: fsync d5/d10/d33/fb6 0 2024-03-12T16:10:54.781 INFO:tasks.workunit.client.1.smithi134.stdout:4/924: creat d1/d13/d49/d64/d28/d4f/dbe/f122 x:0 0 0 2024-03-12T16:10:54.782 INFO:tasks.workunit.client.1.smithi134.stdout:6/906: dread d1/d16/d4c/d58/da0/db7/f71 [0,4194304] 0 2024-03-12T16:10:54.783 INFO:tasks.workunit.client.1.smithi134.stdout:2/899: read d4/d12/d3b/f8f [272914,111495] 0 2024-03-12T16:10:54.787 INFO:tasks.workunit.client.1.smithi134.stdout:6/907: mknod d1/da6/d55/dcc/c150 0 2024-03-12T16:10:54.787 INFO:tasks.workunit.client.1.smithi134.stdout:4/925: dread d1/d13/d49/d53/fba [0,4194304] 0 2024-03-12T16:10:54.788 INFO:tasks.workunit.client.0.smithi006.stdout:2/710: dwrite d0/d13/f35 [0,4194304] 0 2024-03-12T16:10:54.788 INFO:tasks.workunit.client.1.smithi134.stdout:0/908: rename db/d2f/d31/f5c to db/d2f/d31/d75/f128 0 2024-03-12T16:10:54.789 INFO:tasks.workunit.client.1.smithi134.stdout:6/908: chown d1/d3a/db5/deb/f14f 227948751 1 2024-03-12T16:10:54.789 INFO:tasks.workunit.client.1.smithi134.stdout:4/926: dread - d1/d13/d49/f104 zero size 2024-03-12T16:10:54.790 INFO:tasks.workunit.client.0.smithi006.stdout:3/599: creat d8/d19/d26/d59/d2c/fcd x:0 0 0 2024-03-12T16:10:54.793 INFO:tasks.workunit.client.1.smithi134.stdout:9/895: rename d5/d20/le4 to d5/d10/d35/d49/d8d/l10b 0 2024-03-12T16:10:54.794 INFO:tasks.workunit.client.0.smithi006.stdout:0/729: truncate d2/d39/d42/f58 1182995 0 2024-03-12T16:10:54.794 INFO:tasks.workunit.client.1.smithi134.stdout:6/909: mkdir d1/d16/d4c/d65/d61/d147/d151 0 2024-03-12T16:10:54.796 INFO:tasks.workunit.client.1.smithi134.stdout:4/927: creat d1/d13/d49/d64/f123 x:0 0 0 2024-03-12T16:10:54.797 INFO:tasks.workunit.client.0.smithi006.stdout:0/730: fsync d2/d6/d10/f4c 0 2024-03-12T16:10:54.799 INFO:tasks.workunit.client.0.smithi006.stdout:1/708: dread d0/f16 [0,4194304] 0 2024-03-12T16:10:54.800 INFO:tasks.workunit.client.0.smithi006.stdout:7/849: dwrite de/d2c/dea/f10e [0,4194304] 0 2024-03-12T16:10:54.801 INFO:tasks.workunit.client.1.smithi134.stdout:9/896: rename d5/d10/c1e to d5/d10/d35/d49/d54/d5e/d82/c10c 0 2024-03-12T16:10:54.801 INFO:tasks.workunit.client.1.smithi134.stdout:6/910: dread d1/da6/d55/d94/d127/f59 [0,4194304] 0 2024-03-12T16:10:54.802 INFO:tasks.workunit.client.0.smithi006.stdout:0/731: chown d2/d6/d10/d11/d32/da4/fc7 20 1 2024-03-12T16:10:54.802 INFO:tasks.workunit.client.1.smithi134.stdout:2/900: write d4/d12/d1d/d34/d47/d8c/da4/fe0 [118841,41544] 0 2024-03-12T16:10:54.804 INFO:tasks.workunit.client.0.smithi006.stdout:7/850: read - de/d2c/d93/dbe/d4a/dd1/d118/ff7 zero size 2024-03-12T16:10:54.805 INFO:tasks.workunit.client.1.smithi134.stdout:0/909: write db/d2f/d31/d56/d66/f117 [555204,58532] 0 2024-03-12T16:10:54.805 INFO:tasks.workunit.client.0.smithi006.stdout:3/600: rename d8/d19/d26/d59/d2c/dc/d28/d2f/d99 to d8/d19/d26/d97/dce 0 2024-03-12T16:10:54.808 INFO:tasks.workunit.client.0.smithi006.stdout:1/709: unlink d0/d25/d2a/d43/fbc 0 2024-03-12T16:10:54.809 INFO:tasks.workunit.client.0.smithi006.stdout:1/710: write d0/f4 [4593178,110910] 0 2024-03-12T16:10:54.809 INFO:tasks.workunit.client.1.smithi134.stdout:2/901: rmdir d4/d12/d3b 39 2024-03-12T16:10:54.812 INFO:tasks.workunit.client.1.smithi134.stdout:6/911: chown d1/da6/d55/d94/d127/d32/lae 7350570 1 2024-03-12T16:10:54.814 INFO:tasks.workunit.client.1.smithi134.stdout:2/902: unlink d4/d12/d1d/d34/d58/c6f 0 2024-03-12T16:10:54.814 INFO:tasks.workunit.client.0.smithi006.stdout:2/711: dread d0/dc/f1a [0,4194304] 0 2024-03-12T16:10:54.815 INFO:tasks.workunit.client.0.smithi006.stdout:3/601: mkdir d8/d52/dcf 0 2024-03-12T16:10:54.818 INFO:tasks.workunit.client.0.smithi006.stdout:1/711: unlink d0/d25/d2a/d43/d68/l8c 0 2024-03-12T16:10:54.821 INFO:tasks.workunit.client.1.smithi134.stdout:6/912: dwrite d1/da6/fc4 [0,4194304] 0 2024-03-12T16:10:54.821 INFO:tasks.workunit.client.0.smithi006.stdout:7/851: mknod de/d7b/dc6/d11c/c120 0 2024-03-12T16:10:54.824 INFO:tasks.workunit.client.0.smithi006.stdout:7/852: write de/d2c/d93/dbe/d4a/f104 [942996,122576] 0 2024-03-12T16:10:54.824 INFO:tasks.workunit.client.0.smithi006.stdout:1/712: dread d0/d25/d2a/d35/f55 [0,4194304] 0 2024-03-12T16:10:54.825 INFO:tasks.workunit.client.1.smithi134.stdout:0/910: rename db/d2f/d31/d68/d70/l11f to db/d2f/d31/d75/d88/l129 0 2024-03-12T16:10:54.825 INFO:tasks.workunit.client.1.smithi134.stdout:2/903: link d4/d12/d1d/d34/d47/fb8 d4/d84/d63/d9d/d3d/d71/f142 0 2024-03-12T16:10:54.829 INFO:tasks.workunit.client.0.smithi006.stdout:1/713: fsync d0/d25/d2a/d43/d63/db6/fdc 0 2024-03-12T16:10:54.829 INFO:tasks.workunit.client.1.smithi134.stdout:2/904: mkdir d4/d84/d63/d9d/d3d/de5/d143 0 2024-03-12T16:10:54.829 INFO:tasks.workunit.client.0.smithi006.stdout:2/712: rename d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/lbf to d0/d13/d49/d60/d2b/d62/d66/d69/d81/ldb 0 2024-03-12T16:10:54.830 INFO:tasks.workunit.client.1.smithi134.stdout:9/897: dread d5/d10/d35/d49/d54/d5e/d82/f8e [0,4194304] 0 2024-03-12T16:10:54.831 INFO:tasks.workunit.client.1.smithi134.stdout:4/928: dread d1/d24/d34/d73/f8d [0,4194304] 0 2024-03-12T16:10:54.832 INFO:tasks.workunit.client.1.smithi134.stdout:2/905: mknod d4/d84/d7d/d87/c144 0 2024-03-12T16:10:54.832 INFO:tasks.workunit.client.1.smithi134.stdout:6/913: truncate d1/d16/d4c/d58/da0/db7/f4e 824645 0 2024-03-12T16:10:54.833 INFO:tasks.workunit.client.0.smithi006.stdout:1/714: creat d0/d25/d2a/d43/d56/dd8/ff6 x:0 0 0 2024-03-12T16:10:54.834 INFO:tasks.workunit.client.1.smithi134.stdout:9/898: write d5/d20/f2b [7362993,64954] 0 2024-03-12T16:10:54.835 INFO:tasks.workunit.client.0.smithi006.stdout:2/713: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/ldc 0 2024-03-12T16:10:54.837 INFO:tasks.workunit.client.0.smithi006.stdout:1/715: truncate d0/d25/d2a/d35/d3f/fc8 576259 0 2024-03-12T16:10:54.838 INFO:tasks.workunit.client.0.smithi006.stdout:2/714: dread - d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fc7 zero size 2024-03-12T16:10:54.839 INFO:tasks.workunit.client.1.smithi134.stdout:2/906: chown d4/d84/d7d/l96 1520599140 1 2024-03-12T16:10:54.841 INFO:tasks.workunit.client.0.smithi006.stdout:1/716: creat d0/d25/d2a/d43/d56/ff7 x:0 0 0 2024-03-12T16:10:54.842 INFO:tasks.workunit.client.0.smithi006.stdout:2/715: chown d0/d13/d49/d60/d2b/d62/fb9 1407 1 2024-03-12T16:10:54.843 INFO:tasks.workunit.client.1.smithi134.stdout:6/914: dwrite d1/da6/d55/d97/dfd/f134 [0,4194304] 0 2024-03-12T16:10:54.846 INFO:tasks.workunit.client.0.smithi006.stdout:3/602: dwrite d8/d19/d26/f43 [0,4194304] 0 2024-03-12T16:10:54.848 INFO:tasks.workunit.client.1.smithi134.stdout:9/899: symlink d5/d10/d35/d49/d54/d5e/l10d 0 2024-03-12T16:10:54.848 INFO:tasks.workunit.client.1.smithi134.stdout:6/915: write d1/d16/d4c/d58/d115/f118 [5171098,120232] 0 2024-03-12T16:10:54.849 INFO:tasks.workunit.client.0.smithi006.stdout:3/603: stat d8/d19/d26/d59/d2c/dc/d28/d2f/f60 0 2024-03-12T16:10:54.850 INFO:tasks.workunit.client.0.smithi006.stdout:3/604: dread - d8/d19/d26/d59/d2c/fcd zero size 2024-03-12T16:10:54.854 INFO:tasks.workunit.client.1.smithi134.stdout:4/929: creat d1/d13/d49/f124 x:0 0 0 2024-03-12T16:10:54.855 INFO:tasks.workunit.client.0.smithi006.stdout:1/717: getdents d0/d25/d2a/d43/d68 0 2024-03-12T16:10:54.857 INFO:tasks.workunit.client.1.smithi134.stdout:4/930: creat d1/d13/d49/d64/da3/f125 x:0 0 0 2024-03-12T16:10:54.858 INFO:tasks.workunit.client.1.smithi134.stdout:6/916: dread d1/da6/d55/d97/dfd/f119 [0,4194304] 0 2024-03-12T16:10:54.858 INFO:tasks.workunit.client.0.smithi006.stdout:3/605: mkdir d8/d52/d6c/dd0 0 2024-03-12T16:10:54.859 INFO:tasks.workunit.client.1.smithi134.stdout:4/931: write d1/d13/d49/d64/d28/f3b [1610512,94023] 0 2024-03-12T16:10:54.863 INFO:tasks.workunit.client.0.smithi006.stdout:3/606: truncate d8/d19/d26/d59/d2c/f67 417103 0 2024-03-12T16:10:54.865 INFO:tasks.workunit.client.0.smithi006.stdout:3/607: write d8/d19/d26/d59/d2c/dc/d28/d2f/fb6 [882774,40006] 0 2024-03-12T16:10:54.866 INFO:tasks.workunit.client.0.smithi006.stdout:1/718: write d0/d25/d2a/d43/f58 [607669,998] 0 2024-03-12T16:10:54.867 INFO:tasks.workunit.client.1.smithi134.stdout:6/917: write d1/d16/d4c/d58/da0/df6/f106 [735829,123780] 0 2024-03-12T16:10:54.869 INFO:tasks.workunit.client.0.smithi006.stdout:3/608: dread d8/d19/d26/d59/d2c/dc/d28/f90 [0,4194304] 0 2024-03-12T16:10:54.869 INFO:tasks.workunit.client.0.smithi006.stdout:3/609: chown d8/d19/dbc/cc2 2766835 1 2024-03-12T16:10:54.871 INFO:tasks.workunit.client.1.smithi134.stdout:6/918: write d1/d16/d4c/d58/d8e/faf [3465309,9395] 0 2024-03-12T16:10:54.873 INFO:tasks.workunit.client.1.smithi134.stdout:0/911: dread db/d2f/d31/d68/f98 [0,4194304] 0 2024-03-12T16:10:54.873 INFO:tasks.workunit.client.1.smithi134.stdout:4/932: dread d1/d13/d49/d53/dd6/fe5 [0,4194304] 0 2024-03-12T16:10:54.874 INFO:tasks.workunit.client.0.smithi006.stdout:2/716: dread d0/d13/d49/d60/f14 [0,4194304] 0 2024-03-12T16:10:54.875 INFO:tasks.workunit.client.1.smithi134.stdout:2/907: dwrite d4/d12/d1d/d34/d58/fa3 [0,4194304] 0 2024-03-12T16:10:54.878 INFO:tasks.workunit.client.1.smithi134.stdout:6/919: unlink d1/d16/d4c/d65/d61/l136 0 2024-03-12T16:10:54.878 INFO:tasks.workunit.client.1.smithi134.stdout:4/933: stat d1/d13/d49/d64/d28/d4f/d67 0 2024-03-12T16:10:54.880 INFO:tasks.workunit.client.1.smithi134.stdout:9/900: dwrite d5/d10/d33/fd8 [0,4194304] 0 2024-03-12T16:10:54.886 INFO:tasks.workunit.client.1.smithi134.stdout:6/920: mknod d1/d89/c152 0 2024-03-12T16:10:54.887 INFO:tasks.workunit.client.0.smithi006.stdout:3/610: dread d8/d19/d47/f79 [0,4194304] 0 2024-03-12T16:10:54.887 INFO:tasks.workunit.client.1.smithi134.stdout:0/912: creat db/d2f/d31/d76/d9f/f12a x:0 0 0 2024-03-12T16:10:54.888 INFO:tasks.workunit.client.0.smithi006.stdout:3/611: stat d8/f17 0 2024-03-12T16:10:54.889 INFO:tasks.workunit.client.1.smithi134.stdout:4/934: read d1/d24/d34/f57 [42748,105919] 0 2024-03-12T16:10:54.891 INFO:tasks.workunit.client.1.smithi134.stdout:0/913: mknod db/d2f/d31/d68/da2/c12b 0 2024-03-12T16:10:54.891 INFO:tasks.workunit.client.0.smithi006.stdout:2/717: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/f99 [0,4194304] 0 2024-03-12T16:10:54.892 INFO:tasks.workunit.client.1.smithi134.stdout:6/921: write d1/da6/d55/d94/d127/f59 [2582245,93440] 0 2024-03-12T16:10:54.894 INFO:tasks.workunit.client.1.smithi134.stdout:9/901: dwrite d5/d10/d6c/f58 [0,4194304] 0 2024-03-12T16:10:54.895 INFO:tasks.workunit.client.1.smithi134.stdout:2/908: rename d4/d12/d1d/d34/d47/d8c/da4/lfd to d4/d84/d63/d9d/dba/dff/l145 0 2024-03-12T16:10:54.895 INFO:tasks.workunit.client.0.smithi006.stdout:3/612: mknod d8/d19/d26/d59/d2c/dc/d28/d2f/d9d/cd1 0 2024-03-12T16:10:54.895 INFO:tasks.workunit.client.0.smithi006.stdout:2/718: chown d0/dc/d64/dc3 128111804 1 2024-03-12T16:10:54.895 INFO:tasks.workunit.client.0.smithi006.stdout:3/613: chown d8/d19/d31/dc4/dc7 0 1 2024-03-12T16:10:54.895 INFO:tasks.workunit.client.1.smithi134.stdout:4/935: creat d1/d13/df0/f126 x:0 0 0 2024-03-12T16:10:54.897 INFO:tasks.workunit.client.1.smithi134.stdout:6/922: mkdir d1/d16/d4c/d58/d8e/d153 0 2024-03-12T16:10:54.897 INFO:tasks.workunit.client.1.smithi134.stdout:0/914: fsync db/d2f/f52 0 2024-03-12T16:10:54.899 INFO:tasks.workunit.client.0.smithi006.stdout:2/719: mknod d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/cdd 0 2024-03-12T16:10:54.902 INFO:tasks.workunit.client.1.smithi134.stdout:2/909: rmdir d4/d12/d3b 39 2024-03-12T16:10:54.903 INFO:tasks.workunit.client.1.smithi134.stdout:9/902: getdents d5/d10/d51 0 2024-03-12T16:10:54.904 INFO:tasks.workunit.client.0.smithi006.stdout:2/720: creat d0/d13/d49/d60/fde x:0 0 0 2024-03-12T16:10:54.909 INFO:tasks.workunit.client.1.smithi134.stdout:6/923: dwrite d1/fd3 [0,4194304] 0 2024-03-12T16:10:54.911 INFO:tasks.workunit.client.1.smithi134.stdout:6/924: stat d1/d16/d4c/d65/dd1/df9/f128 0 2024-03-12T16:10:54.912 INFO:tasks.workunit.client.1.smithi134.stdout:2/910: rename d4/d12/d43/da2/d135/c66 to d4/d12/d1d/d34/d58/d74/c146 0 2024-03-12T16:10:54.913 INFO:tasks.workunit.client.0.smithi006.stdout:2/721: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f6d [4194304,4194304] 0 2024-03-12T16:10:54.914 INFO:tasks.workunit.client.1.smithi134.stdout:6/925: mknod d1/da6/d55/d94/d75/c154 0 2024-03-12T16:10:54.915 INFO:tasks.workunit.client.1.smithi134.stdout:6/926: dread - d1/d3a/db5/deb/f14f zero size 2024-03-12T16:10:54.922 INFO:tasks.workunit.client.1.smithi134.stdout:4/936: dread d1/d13/d49/d64/d28/d4f/d105/f121 [0,4194304] 0 2024-03-12T16:10:54.923 INFO:tasks.workunit.client.0.smithi006.stdout:3/614: truncate d8/d52/d6c/f84 177576 0 2024-03-12T16:10:54.923 INFO:tasks.workunit.client.1.smithi134.stdout:2/911: write d4/d12/d1d/d34/d58/f82 [1510278,23836] 0 2024-03-12T16:10:54.926 INFO:tasks.workunit.client.1.smithi134.stdout:6/927: rename d1/d3/l41 to d1/def/d11c/l155 0 2024-03-12T16:10:54.926 INFO:tasks.workunit.client.1.smithi134.stdout:2/912: symlink d4/de8/l147 0 2024-03-12T16:10:54.926 INFO:tasks.workunit.client.1.smithi134.stdout:4/937: dread - d1/d13/d49/d6d/d96/ff5 zero size 2024-03-12T16:10:54.929 INFO:tasks.workunit.client.1.smithi134.stdout:6/928: truncate d1/d4/f80 4585656 0 2024-03-12T16:10:54.929 INFO:tasks.workunit.client.1.smithi134.stdout:4/938: fdatasync d1/d13/d49/d64/d28/d4f/dbe/ffb 0 2024-03-12T16:10:54.932 INFO:tasks.workunit.client.1.smithi134.stdout:2/913: getdents d4/d84 0 2024-03-12T16:10:54.935 INFO:tasks.workunit.client.1.smithi134.stdout:4/939: rename d1/d13/d49/d53/fa2 to d1/d24/d34/d73/f127 0 2024-03-12T16:10:54.936 INFO:tasks.workunit.client.0.smithi006.stdout:2/722: truncate d0/d13/d49/fa1 374260 0 2024-03-12T16:10:54.936 INFO:tasks.workunit.client.0.smithi006.stdout:6/716: sync 2024-03-12T16:10:54.936 INFO:tasks.workunit.client.0.smithi006.stdout:8/610: sync 2024-03-12T16:10:54.937 INFO:tasks.workunit.client.1.smithi134.stdout:4/940: readlink d1/de/d90/lc1 0 2024-03-12T16:10:54.938 INFO:tasks.workunit.client.0.smithi006.stdout:2/723: chown d0/d13/d49/d60/d2b/d62/dce/fcf 19 1 2024-03-12T16:10:54.938 INFO:tasks.workunit.client.1.smithi134.stdout:6/929: write d1/d3/f22 [6573329,71956] 0 2024-03-12T16:10:54.939 INFO:tasks.workunit.client.0.smithi006.stdout:8/611: mkdir d2/d32/dc6 0 2024-03-12T16:10:54.942 INFO:tasks.workunit.client.1.smithi134.stdout:4/941: creat d1/d13/d49/da4/de2/f128 x:0 0 0 2024-03-12T16:10:54.942 INFO:tasks.workunit.client.1.smithi134.stdout:2/914: write d4/d12/f32 [1203968,95096] 0 2024-03-12T16:10:54.943 INFO:tasks.workunit.client.0.smithi006.stdout:3/615: write d8/d52/d6c/f84 [983348,113620] 0 2024-03-12T16:10:54.944 INFO:tasks.workunit.client.1.smithi134.stdout:4/942: write d1/d13/d49/d6d/d96/ff5 [729750,30183] 0 2024-03-12T16:10:54.945 INFO:tasks.workunit.client.1.smithi134.stdout:9/903: dread d5/d10/d35/f2e [4194304,4194304] 0 2024-03-12T16:10:54.946 INFO:tasks.workunit.client.0.smithi006.stdout:2/724: symlink d0/dc/d64/ldf 0 2024-03-12T16:10:54.950 INFO:tasks.workunit.client.0.smithi006.stdout:6/717: link d3/d11/d3b/db4/dc3/ff0 d3/d11/d10/da7/d8e/de1/d60/f103 0 2024-03-12T16:10:54.951 INFO:tasks.workunit.client.0.smithi006.stdout:3/616: read - d8/d19/d78/f95 zero size 2024-03-12T16:10:54.951 INFO:tasks.workunit.client.0.smithi006.stdout:6/718: chown d3/d11/d10/d1b/d20/l50 159 1 2024-03-12T16:10:54.952 INFO:tasks.workunit.client.1.smithi134.stdout:6/930: write d1/d3/d10/f2a [958712,14167] 0 2024-03-12T16:10:54.952 INFO:tasks.workunit.client.1.smithi134.stdout:4/943: write d1/d13/f7f [3474525,119781] 0 2024-03-12T16:10:54.952 INFO:tasks.workunit.client.0.smithi006.stdout:2/725: stat d0/d13/d49/d60/d2b/d62/d66/da6/fa9 0 2024-03-12T16:10:54.954 INFO:tasks.workunit.client.1.smithi134.stdout:2/915: link d4/d12/d1d/d34/d58/f78 d4/d12/d43/f148 0 2024-03-12T16:10:54.957 INFO:tasks.workunit.client.1.smithi134.stdout:9/904: dwrite d5/d20/ff4 [0,4194304] 0 2024-03-12T16:10:54.957 INFO:tasks.workunit.client.0.smithi006.stdout:3/617: symlink d8/ld2 0 2024-03-12T16:10:54.960 INFO:tasks.workunit.client.1.smithi134.stdout:9/905: write d5/d10/d35/fe0 [335748,105565] 0 2024-03-12T16:10:54.960 INFO:tasks.workunit.client.1.smithi134.stdout:4/944: truncate d1/d13/d49/d53/fb2 8284 0 2024-03-12T16:10:54.962 INFO:tasks.workunit.client.0.smithi006.stdout:6/719: rename d3/d11/d10/d19/f39 to d3/d11/d10/da7/d8e/de1/d60/f104 0 2024-03-12T16:10:54.963 INFO:tasks.workunit.client.1.smithi134.stdout:6/931: dwrite d1/da6/d55/d94/d127/d32/f3c [0,4194304] 0 2024-03-12T16:10:54.967 INFO:tasks.workunit.client.0.smithi006.stdout:3/618: symlink d8/d19/d26/d59/d2c/d41/ld3 0 2024-03-12T16:10:54.967 INFO:tasks.workunit.client.1.smithi134.stdout:4/945: getdents d1/d13 0 2024-03-12T16:10:54.969 INFO:tasks.workunit.client.1.smithi134.stdout:4/946: symlink d1/d24/l129 0 2024-03-12T16:10:54.970 INFO:tasks.workunit.client.0.smithi006.stdout:8/612: dwrite d2/db/d1a/d21/dad/d7c/f7e [0,4194304] 0 2024-03-12T16:10:54.971 INFO:tasks.workunit.client.1.smithi134.stdout:6/932: mkdir d1/d3/d156 0 2024-03-12T16:10:54.973 INFO:tasks.workunit.client.0.smithi006.stdout:3/619: mknod d8/d4c/dc8/cd4 0 2024-03-12T16:10:54.974 INFO:tasks.workunit.client.0.smithi006.stdout:6/720: creat d3/d11/d10/da7/d8e/de1/dfe/f105 x:0 0 0 2024-03-12T16:10:54.976 INFO:tasks.workunit.client.1.smithi134.stdout:6/933: mkdir d1/da6/d157 0 2024-03-12T16:10:54.978 INFO:tasks.workunit.client.1.smithi134.stdout:4/947: dwrite d1/d24/ddd/f11c [0,4194304] 0 2024-03-12T16:10:54.979 INFO:tasks.workunit.client.1.smithi134.stdout:6/934: dread - d1/da6/d55/d85/ddf/f123 zero size 2024-03-12T16:10:54.980 INFO:tasks.workunit.client.0.smithi006.stdout:6/721: symlink d3/d11/d10/da7/d8e/d8b/l106 0 2024-03-12T16:10:54.980 INFO:tasks.workunit.client.0.smithi006.stdout:3/620: getdents d8/d52/d6c/dd0 0 2024-03-12T16:10:54.981 INFO:tasks.workunit.client.0.smithi006.stdout:6/722: write d3/d11/d10/d28/f56 [771500,8] 0 2024-03-12T16:10:54.983 INFO:tasks.workunit.client.1.smithi134.stdout:4/948: mknod d1/d24/d34/d8e/c12a 0 2024-03-12T16:10:54.984 INFO:tasks.workunit.client.0.smithi006.stdout:3/621: creat d8/d19/d26/d59/d2c/fd5 x:0 0 0 2024-03-12T16:10:54.987 INFO:tasks.workunit.client.0.smithi006.stdout:3/622: fdatasync d8/d19/d47/f79 0 2024-03-12T16:10:54.988 INFO:tasks.workunit.client.1.smithi134.stdout:9/906: truncate d5/d10/f2d 2337485 0 2024-03-12T16:10:54.990 INFO:tasks.workunit.client.1.smithi134.stdout:4/949: symlink d1/d24/d34/d8e/l12b 0 2024-03-12T16:10:54.992 INFO:tasks.workunit.client.0.smithi006.stdout:2/726: dread d0/d13/d49/d60/f3b [0,4194304] 0 2024-03-12T16:10:54.993 INFO:tasks.workunit.client.1.smithi134.stdout:9/907: rename d5/d10/d6c/cb4 to d5/d10/d35/d49/d54/d88/c10e 0 2024-03-12T16:10:54.993 INFO:tasks.workunit.client.1.smithi134.stdout:6/935: link d1/da6/d55/d94/d127/d32/dd9/d13e/d144/dca/f101 d1/d16/d4c/d65/d61/de4/f158 0 2024-03-12T16:10:54.994 INFO:tasks.workunit.client.0.smithi006.stdout:3/623: read d8/d19/d26/d59/d2c/dc/d28/f2b [2192947,124027] 0 2024-03-12T16:10:54.994 INFO:tasks.workunit.client.0.smithi006.stdout:2/727: mkdir d0/dc/de0 0 2024-03-12T16:10:54.995 INFO:tasks.workunit.client.0.smithi006.stdout:3/624: chown d8/d19/dbc/c4b 11 1 2024-03-12T16:10:54.995 INFO:tasks.workunit.client.1.smithi134.stdout:9/908: rmdir d5/d10/d35/d49/d54/df7 39 2024-03-12T16:10:54.996 INFO:tasks.workunit.client.1.smithi134.stdout:6/936: truncate d1/d16/d4c/d58/fea 647794 0 2024-03-12T16:10:54.996 INFO:tasks.workunit.client.0.smithi006.stdout:3/625: fdatasync d8/d19/d26/d59/f1f 0 2024-03-12T16:10:54.996 INFO:tasks.workunit.client.1.smithi134.stdout:9/909: chown d5/d20 56103 1 2024-03-12T16:10:54.997 INFO:tasks.workunit.client.0.smithi006.stdout:2/728: read - d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fd3 zero size 2024-03-12T16:10:54.998 INFO:tasks.workunit.client.0.smithi006.stdout:2/729: chown d0/d13/d49/d60/d2b/d62/fb9 18672909 1 2024-03-12T16:10:54.999 INFO:tasks.workunit.client.0.smithi006.stdout:3/626: creat d8/d19/d78/fd6 x:0 0 0 2024-03-12T16:10:55.000 INFO:tasks.workunit.client.0.smithi006.stdout:2/730: fdatasync d0/d13/d49/d60/f3b 0 2024-03-12T16:10:55.001 INFO:tasks.workunit.client.1.smithi134.stdout:9/910: link d5/d10/d35/d49/d54/d5e/fe1 d5/d10/d35/d49/d8d/def/f10f 0 2024-03-12T16:10:55.001 INFO:tasks.workunit.client.0.smithi006.stdout:3/627: readlink d8/d4c/d7c/l7f 0 2024-03-12T16:10:55.002 INFO:tasks.workunit.client.0.smithi006.stdout:3/628: chown d8/d19/dbc/f80 246 1 2024-03-12T16:10:55.002 INFO:tasks.workunit.client.1.smithi134.stdout:9/911: fdatasync d5/d10/f95 0 2024-03-12T16:10:55.003 INFO:tasks.workunit.client.0.smithi006.stdout:2/731: fdatasync d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f6d 0 2024-03-12T16:10:55.008 INFO:tasks.workunit.client.1.smithi134.stdout:4/950: write d1/d24/d34/d73/f127 [1206577,20743] 0 2024-03-12T16:10:55.010 INFO:tasks.workunit.client.0.smithi006.stdout:2/732: rename d0/d13/d49/d60/d2b/d62/fb9 to d0/dc/de0/fe1 0 2024-03-12T16:10:55.012 INFO:tasks.workunit.client.0.smithi006.stdout:6/723: truncate d3/d11/d10/da7/d8e/de1/f55 3108973 0 2024-03-12T16:10:55.013 INFO:tasks.workunit.client.0.smithi006.stdout:8/613: dwrite d2/db/d1a/f73 [0,4194304] 0 2024-03-12T16:10:55.018 INFO:tasks.workunit.client.1.smithi134.stdout:4/951: dwrite d1/d13/d49/d64/da3/fc8 [0,4194304] 0 2024-03-12T16:10:55.019 INFO:tasks.workunit.client.0.smithi006.stdout:6/724: unlink d3/d11/d10/d28/f102 0 2024-03-12T16:10:55.021 INFO:tasks.workunit.client.1.smithi134.stdout:4/952: readlink d1/de/d90/lc1 0 2024-03-12T16:10:55.024 INFO:tasks.workunit.client.0.smithi006.stdout:8/614: creat d2/db/d1a/d21/d4f/da7/fc7 x:0 0 0 2024-03-12T16:10:55.026 INFO:tasks.workunit.client.1.smithi134.stdout:4/953: write d1/d13/d49/d64/da3/fc8 [4564208,128920] 0 2024-03-12T16:10:55.026 INFO:tasks.workunit.client.0.smithi006.stdout:3/629: truncate d8/d19/d26/d59/f42 4239663 0 2024-03-12T16:10:55.026 INFO:tasks.workunit.client.0.smithi006.stdout:2/733: dread d0/d13/f27 [0,4194304] 0 2024-03-12T16:10:55.027 INFO:tasks.workunit.client.1.smithi134.stdout:6/937: rename d1/da6/d55/d94/d127/d32/dd9/d13e/d144 to d1/d16/d129/d159 0 2024-03-12T16:10:55.032 INFO:tasks.workunit.client.0.smithi006.stdout:8/615: creat d2/db/d1a/d21/dad/d7c/fc8 x:0 0 0 2024-03-12T16:10:55.032 INFO:tasks.workunit.client.1.smithi134.stdout:9/912: rename d5/d10/d35/f1a to d5/d10/d1f/f110 0 2024-03-12T16:10:55.033 INFO:tasks.workunit.client.0.smithi006.stdout:2/734: truncate d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fc7 737355 0 2024-03-12T16:10:55.033 INFO:tasks.workunit.client.0.smithi006.stdout:3/630: read d8/d52/f61 [291960,10879] 0 2024-03-12T16:10:55.034 INFO:tasks.workunit.client.1.smithi134.stdout:9/913: write d5/fea [684216,62049] 0 2024-03-12T16:10:55.035 INFO:tasks.workunit.client.0.smithi006.stdout:8/616: mknod d2/db/d1a/d21/d8a/cc9 0 2024-03-12T16:10:55.035 INFO:tasks.workunit.client.1.smithi134.stdout:6/938: dwrite d1/da6/d55/d94/d127/d32/f3c [0,4194304] 0 2024-03-12T16:10:55.037 INFO:tasks.workunit.client.1.smithi134.stdout:6/939: chown d1/da6/d55/d85/ddf/f123 30 1 2024-03-12T16:10:55.039 INFO:tasks.workunit.client.1.smithi134.stdout:4/954: truncate d1/de/f30 548549 0 2024-03-12T16:10:55.041 INFO:tasks.workunit.client.1.smithi134.stdout:6/940: write d1/da6/d55/d94/d127/d32/d4a/ffc [198360,127694] 0 2024-03-12T16:10:55.044 INFO:tasks.workunit.client.0.smithi006.stdout:8/617: dread d2/db/d1a/d21/fa8 [0,4194304] 0 2024-03-12T16:10:55.045 INFO:tasks.workunit.client.0.smithi006.stdout:8/618: chown d2/db/d70/daa 3 1 2024-03-12T16:10:55.047 INFO:tasks.workunit.client.0.smithi006.stdout:8/619: stat d2/db/d1a/d21/dad 0 2024-03-12T16:10:55.048 INFO:tasks.workunit.client.1.smithi134.stdout:6/941: rename d1/d3a/db5/deb/f14f to d1/d16/d4c/d65/d61/de4/f15a 0 2024-03-12T16:10:55.050 INFO:tasks.workunit.client.1.smithi134.stdout:4/955: link d1/de/d5a/d84/f85 d1/de/dac/f12c 0 2024-03-12T16:10:55.052 INFO:tasks.workunit.client.0.smithi006.stdout:6/725: dread d3/d11/d10/da7/d8e/de1/d60/f103 [0,4194304] 0 2024-03-12T16:10:55.053 INFO:tasks.workunit.client.0.smithi006.stdout:6/726: chown d3/d11/d10/d1b/d20/l50 0 1 2024-03-12T16:10:55.054 INFO:tasks.workunit.client.0.smithi006.stdout:2/735: write d0/d13/d49/d60/d2b/d62/dce/fcf [1029246,26943] 0 2024-03-12T16:10:55.055 INFO:tasks.workunit.client.1.smithi134.stdout:9/914: dwrite d5/d10/f1c [4194304,4194304] 0 2024-03-12T16:10:55.056 INFO:tasks.workunit.client.1.smithi134.stdout:9/915: stat d5/d20/f27 0 2024-03-12T16:10:55.059 INFO:tasks.workunit.client.1.smithi134.stdout:4/956: dread d1/d13/d49/d64/d28/d4f/d67/f110 [0,4194304] 0 2024-03-12T16:10:55.060 INFO:tasks.workunit.client.1.smithi134.stdout:9/916: fsync d5/d10/d1f/f110 0 2024-03-12T16:10:55.062 INFO:tasks.workunit.client.0.smithi006.stdout:6/727: mknod d3/d11/d10/d19/c107 0 2024-03-12T16:10:55.064 INFO:tasks.workunit.client.0.smithi006.stdout:8/620: link d2/db/d1a/d21/dad/f74 d2/db/d1a/d21/d4f/fca 0 2024-03-12T16:10:55.064 INFO:tasks.workunit.client.1.smithi134.stdout:4/957: symlink d1/de/d5a/d70/l12d 0 2024-03-12T16:10:55.065 INFO:tasks.workunit.client.1.smithi134.stdout:9/917: creat d5/d10/d35/d49/d8d/f111 x:0 0 0 2024-03-12T16:10:55.065 INFO:tasks.workunit.client.0.smithi006.stdout:2/736: truncate d0/dc/f5b 931202 0 2024-03-12T16:10:55.067 INFO:tasks.workunit.client.0.smithi006.stdout:6/728: mkdir d3/d11/d10/da7/d8e/de1/d60/d108 0 2024-03-12T16:10:55.067 INFO:tasks.workunit.client.0.smithi006.stdout:3/631: dread d8/d19/d26/d59/d2c/f34 [0,4194304] 0 2024-03-12T16:10:55.067 INFO:tasks.workunit.client.0.smithi006.stdout:2/737: read d0/d13/f7c [1988211,42224] 0 2024-03-12T16:10:55.069 INFO:tasks.workunit.client.0.smithi006.stdout:3/632: readlink d8/d19/d47/lb5 0 2024-03-12T16:10:55.069 INFO:tasks.workunit.client.1.smithi134.stdout:4/958: getdents d1/d13/d49/d53/dd6 0 2024-03-12T16:10:55.069 INFO:tasks.workunit.client.1.smithi134.stdout:6/942: truncate d1/d3/f22 4514627 0 2024-03-12T16:10:55.071 INFO:tasks.workunit.client.1.smithi134.stdout:6/943: write d1/d16/d4c/d65/d9d/f13a [915128,103368] 0 2024-03-12T16:10:55.072 INFO:tasks.workunit.client.1.smithi134.stdout:9/918: rename d5/d10/d1f/lba to d5/d20/d72/l112 0 2024-03-12T16:10:55.072 INFO:tasks.workunit.client.0.smithi006.stdout:8/621: getdents d2/d32 0 2024-03-12T16:10:55.073 INFO:tasks.workunit.client.0.smithi006.stdout:3/633: creat d8/d19/d26/d59/d2c/d41/d8b/d93/fd7 x:0 0 0 2024-03-12T16:10:55.074 INFO:tasks.workunit.client.1.smithi134.stdout:6/944: write d1/d3/d10/f2a [3715567,111702] 0 2024-03-12T16:10:55.074 INFO:tasks.workunit.client.0.smithi006.stdout:8/622: chown d2/db/d1a/d21/d4f/fb5 1999303 1 2024-03-12T16:10:55.076 INFO:tasks.workunit.client.0.smithi006.stdout:3/634: read d8/d19/d26/d59/d2c/dc/d28/d2f/f60 [2957594,68480] 0 2024-03-12T16:10:55.077 INFO:tasks.workunit.client.1.smithi134.stdout:6/945: fdatasync d1/d16/d4c/d58/d8e/ff7 0 2024-03-12T16:10:55.079 INFO:tasks.workunit.client.1.smithi134.stdout:9/919: rename d5/d10/d33/fb6 to d5/d10/d35/d49/d54/d5e/dab/f113 0 2024-03-12T16:10:55.081 INFO:tasks.workunit.client.0.smithi006.stdout:2/738: write d0/d13/f1d [375588,73265] 0 2024-03-12T16:10:55.082 INFO:tasks.workunit.client.0.smithi006.stdout:2/739: fdatasync d0/d13/d49/d60/fde 0 2024-03-12T16:10:55.082 INFO:tasks.workunit.client.1.smithi134.stdout:9/920: chown d5/d10/d35/d49/d54/dc6/lf9 10043 1 2024-03-12T16:10:55.083 INFO:tasks.workunit.client.0.smithi006.stdout:6/729: getdents d3/d11/d10/d1b/d6e/d80/d9b 0 2024-03-12T16:10:55.086 INFO:tasks.workunit.client.0.smithi006.stdout:3/635: rename d8/d19/d78 to d8/d4c/dd8 0 2024-03-12T16:10:55.086 INFO:tasks.workunit.client.0.smithi006.stdout:8/623: write d2/d11/f4e [514805,36352] 0 2024-03-12T16:10:55.088 INFO:tasks.workunit.client.0.smithi006.stdout:8/624: readlink d2/d32/l98 0 2024-03-12T16:10:55.088 INFO:tasks.workunit.client.1.smithi134.stdout:4/959: dwrite d1/d13/d49/fb1 [4194304,4194304] 0 2024-03-12T16:10:55.090 INFO:tasks.workunit.client.0.smithi006.stdout:6/730: creat d3/d11/d3b/db4/f109 x:0 0 0 2024-03-12T16:10:55.090 INFO:tasks.workunit.client.1.smithi134.stdout:4/960: chown d1/d13/d49/da4/c40 694955704 1 2024-03-12T16:10:55.090 INFO:tasks.workunit.client.1.smithi134.stdout:6/946: creat d1/d16/d4c/d58/f15b x:0 0 0 2024-03-12T16:10:55.091 INFO:tasks.workunit.client.0.smithi006.stdout:2/740: symlink d0/dc/d64/le2 0 2024-03-12T16:10:55.091 INFO:tasks.workunit.client.0.smithi006.stdout:6/731: stat d3/d11/d10/d19/c77 0 2024-03-12T16:10:55.091 INFO:tasks.workunit.client.0.smithi006.stdout:3/636: fdatasync d8/d19/d26/d59/d2c/fa2 0 2024-03-12T16:10:55.095 INFO:tasks.workunit.client.0.smithi006.stdout:3/637: chown d8/d4c/d7c/f7e 315 1 2024-03-12T16:10:55.097 INFO:tasks.workunit.client.1.smithi134.stdout:6/947: fdatasync d1/da6/d55/d94/d127/f5e 0 2024-03-12T16:10:55.098 INFO:tasks.workunit.client.0.smithi006.stdout:8/625: truncate d2/db/d1a/d7a/f9e 3310833 0 2024-03-12T16:10:55.100 INFO:tasks.workunit.client.1.smithi134.stdout:9/921: dwrite d5/d10/d35/d49/d54/d5e/fe1 [0,4194304] 0 2024-03-12T16:10:55.100 INFO:tasks.workunit.client.0.smithi006.stdout:2/741: dwrite d0/f5d [0,4194304] 0 2024-03-12T16:10:55.102 INFO:tasks.workunit.client.0.smithi006.stdout:6/732: rename d3/d11/d10/da7/d8e/de1/d60/f87 to d3/d11/d10/da7/d8e/de1/dfe/f10a 0 2024-03-12T16:10:55.102 INFO:tasks.workunit.client.0.smithi006.stdout:2/742: chown d0/d13/d49/d60/d2b/d62/c87 95 1 2024-03-12T16:10:55.103 INFO:tasks.workunit.client.0.smithi006.stdout:2/743: fdatasync d0/f50 0 2024-03-12T16:10:55.104 INFO:tasks.workunit.client.0.smithi006.stdout:8/626: rmdir d2/d11 39 2024-03-12T16:10:55.105 INFO:tasks.workunit.client.0.smithi006.stdout:8/627: dread - d2/f7d zero size 2024-03-12T16:10:55.106 INFO:tasks.workunit.client.1.smithi134.stdout:4/961: dwrite d1/d13/d49/d64/f123 [0,4194304] 0 2024-03-12T16:10:55.109 INFO:tasks.workunit.client.1.smithi134.stdout:9/922: mkdir d5/d10/d114 0 2024-03-12T16:10:55.109 INFO:tasks.workunit.client.1.smithi134.stdout:4/962: fsync d1/d13/d49/f66 0 2024-03-12T16:10:55.112 INFO:tasks.workunit.client.0.smithi006.stdout:6/733: dwrite d3/d11/d10/da7/d8e/f86 [0,4194304] 0 2024-03-12T16:10:55.113 INFO:tasks.workunit.client.1.smithi134.stdout:4/963: chown d1/d13/d49/d64/d28/l6f 1066 1 2024-03-12T16:10:55.114 INFO:tasks.workunit.client.1.smithi134.stdout:9/923: rename d5/d10/d35/d49/d8d/cc2 to d5/d20/d100/c115 0 2024-03-12T16:10:55.118 INFO:tasks.workunit.client.1.smithi134.stdout:4/964: rename d1/d24/d34/d73/fea to d1/d24/f12e 0 2024-03-12T16:10:55.120 INFO:tasks.workunit.client.0.smithi006.stdout:3/638: rename d8/d19/d26/d59/d2c/dc/lb4 to d8/d19/ld9 0 2024-03-12T16:10:55.120 INFO:tasks.workunit.client.0.smithi006.stdout:2/744: mknod d0/d13/d49/d60/d2b/d62/d66/d69/d81/d95/ce3 0 2024-03-12T16:10:55.120 INFO:tasks.workunit.client.1.smithi134.stdout:1/660: sync 2024-03-12T16:10:55.121 INFO:tasks.workunit.client.0.smithi006.stdout:6/734: mknod d3/d11/d10/da7/d9e/c10b 0 2024-03-12T16:10:55.122 INFO:tasks.workunit.client.1.smithi134.stdout:9/924: rename d5/d10/d1f/dfc to d5/d10/d35/d49/d54/d88/d116 0 2024-03-12T16:10:55.123 INFO:tasks.workunit.client.0.smithi006.stdout:2/745: read d0/d13/d49/d60/f3b [1035895,38091] 0 2024-03-12T16:10:55.123 INFO:tasks.workunit.client.0.smithi006.stdout:3/639: write d8/d4c/d7c/f7e [550324,96785] 0 2024-03-12T16:10:55.123 INFO:tasks.workunit.client.1.smithi134.stdout:4/965: mkdir d1/d13/d49/d64/d28/d4f/d12f 0 2024-03-12T16:10:55.124 INFO:tasks.workunit.client.0.smithi006.stdout:8/628: rename d2/d11/d3f/c6f to d2/db/d1a/d23/ccb 0 2024-03-12T16:10:55.125 INFO:tasks.workunit.client.1.smithi134.stdout:1/661: creat d0/d16/d9/fe0 x:0 0 0 2024-03-12T16:10:55.127 INFO:tasks.workunit.client.0.smithi006.stdout:6/735: rename d3/d47/db0/cc5 to d3/d47/db0/c10c 0 2024-03-12T16:10:55.127 INFO:tasks.workunit.client.1.smithi134.stdout:4/966: mkdir d1/de/d5a/d130 0 2024-03-12T16:10:55.128 INFO:tasks.workunit.client.1.smithi134.stdout:1/662: truncate d0/d16/f6d 1391199 0 2024-03-12T16:10:55.130 INFO:tasks.workunit.client.0.smithi006.stdout:8/629: rmdir d2/d11/d3f 39 2024-03-12T16:10:55.130 INFO:tasks.workunit.client.1.smithi134.stdout:4/967: symlink d1/d13/d49/da4/de2/l131 0 2024-03-12T16:10:55.132 INFO:tasks.workunit.client.1.smithi134.stdout:6/948: write d1/d16/d4c/d65/f5c [2382218,48991] 0 2024-03-12T16:10:55.132 INFO:tasks.workunit.client.1.smithi134.stdout:4/968: mkdir d1/de/d5a/d70/d132 0 2024-03-12T16:10:55.134 INFO:tasks.workunit.client.0.smithi006.stdout:8/630: write d2/db/d1a/d21/d8a/f8b [2508936,40966] 0 2024-03-12T16:10:55.134 INFO:tasks.workunit.client.1.smithi134.stdout:6/949: chown d1/da6/d55/d94/d127/d32/f102 556 1 2024-03-12T16:10:55.135 INFO:tasks.workunit.client.0.smithi006.stdout:6/736: creat d3/d11/d10/da7/d8e/de1/d60/ddd/f10d x:0 0 0 2024-03-12T16:10:55.135 INFO:tasks.workunit.client.1.smithi134.stdout:4/969: creat d1/d13/d49/d64/d28/d4f/d12f/f133 x:0 0 0 2024-03-12T16:10:55.137 INFO:tasks.workunit.client.0.smithi006.stdout:8/631: mkdir d2/db/d1a/d7a/dcc 0 2024-03-12T16:10:55.139 INFO:tasks.workunit.client.0.smithi006.stdout:6/737: rmdir d3/d11/d10/d1b/d20/d7c 39 2024-03-12T16:10:55.141 INFO:tasks.workunit.client.0.smithi006.stdout:6/738: fdatasync d3/d11/d3b/d59/fd3 0 2024-03-12T16:10:55.141 INFO:tasks.workunit.client.0.smithi006.stdout:8/632: truncate d2/d55/f71 1312475 0 2024-03-12T16:10:55.142 INFO:tasks.workunit.client.0.smithi006.stdout:2/746: dread d0/d13/d49/d60/f53 [0,4194304] 0 2024-03-12T16:10:55.143 INFO:tasks.workunit.client.0.smithi006.stdout:8/633: truncate d2/d55/fa6 867454 0 2024-03-12T16:10:55.145 INFO:tasks.workunit.client.0.smithi006.stdout:6/739: creat d3/d11/d10/da7/d8e/f10e x:0 0 0 2024-03-12T16:10:55.151 INFO:tasks.workunit.client.0.smithi006.stdout:6/740: dwrite d3/d11/f25 [0,4194304] 0 2024-03-12T16:10:55.154 INFO:tasks.workunit.client.0.smithi006.stdout:8/634: mknod d2/db/d1a/d7a/dcc/ccd 0 2024-03-12T16:10:55.157 INFO:tasks.workunit.client.0.smithi006.stdout:6/741: rmdir d3/d11/d3b/db4/dc3 39 2024-03-12T16:10:55.157 INFO:tasks.workunit.client.0.smithi006.stdout:3/640: truncate d8/d19/d26/d59/d2c/dc/f38 178122 0 2024-03-12T16:10:55.160 INFO:tasks.workunit.client.0.smithi006.stdout:8/635: creat d2/db/d1a/d7a/dcc/fce x:0 0 0 2024-03-12T16:10:55.161 INFO:tasks.workunit.client.1.smithi134.stdout:6/950: truncate d1/da6/d55/d94/d127/d32/f102 2443766 0 2024-03-12T16:10:55.162 INFO:tasks.workunit.client.1.smithi134.stdout:4/970: write d1/d24/d34/d8e/f98 [907319,55005] 0 2024-03-12T16:10:55.163 INFO:tasks.workunit.client.0.smithi006.stdout:3/641: rename d8/d4c/fa6 to d8/d19/d26/d59/d2c/d41/d45/fda 0 2024-03-12T16:10:55.165 INFO:tasks.workunit.client.1.smithi134.stdout:4/971: truncate d1/d24/fdb 856755 0 2024-03-12T16:10:55.166 INFO:tasks.workunit.client.0.smithi006.stdout:8/636: unlink d2/c28 0 2024-03-12T16:10:55.166 INFO:tasks.workunit.client.1.smithi134.stdout:4/972: write d1/d13/d49/da4/de2/f128 [305762,119075] 0 2024-03-12T16:10:55.167 INFO:tasks.workunit.client.1.smithi134.stdout:6/951: creat d1/d3/d156/f15c x:0 0 0 2024-03-12T16:10:55.168 INFO:tasks.workunit.client.0.smithi006.stdout:2/747: write d0/d13/d49/fa1 [817568,11368] 0 2024-03-12T16:10:55.169 INFO:tasks.workunit.client.1.smithi134.stdout:4/973: creat d1/d24/d34/d73/d10f/f134 x:0 0 0 2024-03-12T16:10:55.169 INFO:tasks.workunit.client.0.smithi006.stdout:8/637: mkdir d2/db/d1a/d1f/dcf 0 2024-03-12T16:10:55.173 INFO:tasks.workunit.client.0.smithi006.stdout:8/638: rename d2/d32/l6b to d2/d55/ld0 0 2024-03-12T16:10:55.173 INFO:tasks.workunit.client.0.smithi006.stdout:8/639: chown d2/fc3 5 1 2024-03-12T16:10:55.174 INFO:tasks.workunit.client.1.smithi134.stdout:4/974: link d1/d24/d34/d73/f127 d1/de/d5a/d130/f135 0 2024-03-12T16:10:55.177 INFO:tasks.workunit.client.0.smithi006.stdout:8/640: mknod d2/d55/cd1 0 2024-03-12T16:10:55.177 INFO:tasks.workunit.client.1.smithi134.stdout:6/952: dwrite d1/d16/d4c/d65/dd1/df9/f128 [0,4194304] 0 2024-03-12T16:10:55.178 INFO:tasks.workunit.client.1.smithi134.stdout:6/953: dread - d1/d16/d4c/d58/f15b zero size 2024-03-12T16:10:55.179 INFO:tasks.workunit.client.1.smithi134.stdout:4/975: mknod d1/d13/d49/d64/c136 0 2024-03-12T16:10:55.179 INFO:tasks.workunit.client.0.smithi006.stdout:8/641: write d2/db/f13 [4791033,52351] 0 2024-03-12T16:10:55.182 INFO:tasks.workunit.client.0.smithi006.stdout:8/642: creat d2/db/d1a/d7a/dcc/fd2 x:0 0 0 2024-03-12T16:10:55.184 INFO:tasks.workunit.client.0.smithi006.stdout:6/742: dread d3/f1c [0,4194304] 0 2024-03-12T16:10:55.184 INFO:tasks.workunit.client.0.smithi006.stdout:8/643: chown d2/db/d1a/d23/c46 1609 1 2024-03-12T16:10:55.185 INFO:tasks.workunit.client.1.smithi134.stdout:6/954: mkdir d1/d16/d4c/d65/d61/d147/d15d 0 2024-03-12T16:10:55.185 INFO:tasks.workunit.client.0.smithi006.stdout:8/644: readlink d2/db/d1a/l29 0 2024-03-12T16:10:55.187 INFO:tasks.workunit.client.1.smithi134.stdout:4/976: write d1/d13/d49/d64/da3/fae [474981,112621] 0 2024-03-12T16:10:55.189 INFO:tasks.workunit.client.0.smithi006.stdout:8/645: creat d2/db/d1a/d21/dad/d7c/fd3 x:0 0 0 2024-03-12T16:10:55.190 INFO:tasks.workunit.client.1.smithi134.stdout:4/977: mknod d1/d13/d49/da4/d11b/c137 0 2024-03-12T16:10:55.192 INFO:tasks.workunit.client.0.smithi006.stdout:8/646: mkdir d2/d11/d5a/dd4 0 2024-03-12T16:10:55.193 INFO:tasks.workunit.client.1.smithi134.stdout:4/978: mkdir d1/d13/d49/d53/dd6/d138 0 2024-03-12T16:10:55.194 INFO:tasks.workunit.client.1.smithi134.stdout:4/979: mknod d1/d13/d49/d64/da3/dab/c139 0 2024-03-12T16:10:55.195 INFO:tasks.workunit.client.1.smithi134.stdout:6/955: truncate d1/da6/d55/d97/dfd/f134 2941294 0 2024-03-12T16:10:55.196 INFO:tasks.workunit.client.1.smithi134.stdout:4/980: mknod d1/d13/d49/d53/dd6/c13a 0 2024-03-12T16:10:55.197 INFO:tasks.workunit.client.1.smithi134.stdout:4/981: symlink d1/d13/d49/d6d/l13b 0 2024-03-12T16:10:55.198 INFO:tasks.workunit.client.1.smithi134.stdout:4/982: chown d1/d24/d34/d73/fe0 10 1 2024-03-12T16:10:55.201 INFO:tasks.workunit.client.0.smithi006.stdout:8/647: dwrite d2/dab/fae [0,4194304] 0 2024-03-12T16:10:55.202 INFO:tasks.workunit.client.0.smithi006.stdout:6/743: dwrite d3/fcd [0,4194304] 0 2024-03-12T16:10:55.203 INFO:tasks.workunit.client.1.smithi134.stdout:4/983: getdents d1/d24/d34/d73/d10f 0 2024-03-12T16:10:55.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:53.500966+0000 mgr.smithi134.gcntfu (mgr.24383) 64 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 99 MiB/s rd, 244 MiB/s wr, 492 op/s 2024-03-12T16:10:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:53.500966+0000 mgr.smithi134.gcntfu (mgr.24383) 64 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 2.8 GiB data, 9.9 GiB used, 527 GiB / 536 GiB avail; 99 MiB/s rd, 244 MiB/s wr, 492 op/s 2024-03-12T16:10:55.208 INFO:tasks.workunit.client.0.smithi006.stdout:6/744: dread - d3/d11/d10/da7/d8e/d8b/fd8 zero size 2024-03-12T16:10:55.209 INFO:tasks.workunit.client.1.smithi134.stdout:6/956: write d1/da6/d55/d94/d127/d32/f102 [1797421,91009] 0 2024-03-12T16:10:55.209 INFO:tasks.workunit.client.0.smithi006.stdout:6/745: stat d3/d11/d10/da7/d8e/d8b/fe8 0 2024-03-12T16:10:55.210 INFO:tasks.workunit.client.1.smithi134.stdout:4/984: dwrite d1/d13/d49/d64/f123 [0,4194304] 0 2024-03-12T16:10:55.211 INFO:tasks.workunit.client.0.smithi006.stdout:6/746: write d3/d11/d10/d19/f67 [2959046,52397] 0 2024-03-12T16:10:55.211 INFO:tasks.workunit.client.0.smithi006.stdout:8/648: mknod d2/d11/d3f/cd5 0 2024-03-12T16:10:55.214 INFO:tasks.workunit.client.0.smithi006.stdout:6/747: read - d3/fc4 zero size 2024-03-12T16:10:55.215 INFO:tasks.workunit.client.0.smithi006.stdout:8/649: creat d2/db/d1a/d21/d2b/da2/fd6 x:0 0 0 2024-03-12T16:10:55.216 INFO:tasks.workunit.client.0.smithi006.stdout:8/650: write d2/f16 [2560425,68481] 0 2024-03-12T16:10:55.218 INFO:tasks.workunit.client.1.smithi134.stdout:4/985: getdents d1/d13/d49/d64/d28/d4f 0 2024-03-12T16:10:55.219 INFO:tasks.workunit.client.1.smithi134.stdout:4/986: write d1/d13/d49/d64/da3/fae [361244,100625] 0 2024-03-12T16:10:55.222 INFO:tasks.workunit.client.1.smithi134.stdout:6/957: getdents d1 0 2024-03-12T16:10:55.223 INFO:tasks.workunit.client.1.smithi134.stdout:4/987: write d1/d13/d49/fb1 [1635928,91972] 0 2024-03-12T16:10:55.224 INFO:tasks.workunit.client.0.smithi006.stdout:6/748: symlink d3/d11/d10/da7/d8e/de1/d60/d108/l10f 0 2024-03-12T16:10:55.225 INFO:tasks.workunit.client.1.smithi134.stdout:6/958: fsync d1/da6/d55/d94/d127/d32/f102 0 2024-03-12T16:10:55.225 INFO:tasks.workunit.client.1.smithi134.stdout:4/988: symlink d1/d13/l13c 0 2024-03-12T16:10:55.227 INFO:tasks.workunit.client.0.smithi006.stdout:8/651: rename d2/f9b to d2/d11/fd7 0 2024-03-12T16:10:55.228 INFO:tasks.workunit.client.1.smithi134.stdout:6/959: creat d1/d3/d10/f15e x:0 0 0 2024-03-12T16:10:55.229 INFO:tasks.workunit.client.0.smithi006.stdout:6/749: symlink d3/d11/d10/d19/df6/l110 0 2024-03-12T16:10:55.230 INFO:tasks.workunit.client.1.smithi134.stdout:6/960: write d1/d16/d4c/d58/fea [1156589,15616] 0 2024-03-12T16:10:55.230 INFO:tasks.workunit.client.0.smithi006.stdout:8/652: mkdir d2/db/d1a/d21/d2b/da2/dd8 0 2024-03-12T16:10:55.231 INFO:tasks.workunit.client.1.smithi134.stdout:7/944: sync 2024-03-12T16:10:55.231 INFO:tasks.workunit.client.1.smithi134.stdout:2/916: sync 2024-03-12T16:10:55.231 INFO:tasks.workunit.client.1.smithi134.stdout:8/916: sync 2024-03-12T16:10:55.232 INFO:tasks.workunit.client.1.smithi134.stdout:0/915: sync 2024-03-12T16:10:55.232 INFO:tasks.workunit.client.0.smithi006.stdout:8/653: readlink d2/db/d70/daa/lc4 0 2024-03-12T16:10:55.232 INFO:tasks.workunit.client.0.smithi006.stdout:6/750: symlink d3/d11/d10/da7/d8e/de1/d60/l111 0 2024-03-12T16:10:55.232 INFO:tasks.workunit.client.1.smithi134.stdout:7/945: fsync d8/dc/d20/d26/f11c 0 2024-03-12T16:10:55.233 INFO:tasks.workunit.client.1.smithi134.stdout:8/917: chown d3/d1b/d17/d25/d33/f11d 444414 1 2024-03-12T16:10:55.234 INFO:tasks.workunit.client.1.smithi134.stdout:7/946: readlink d8/d27/d9d/l129 0 2024-03-12T16:10:55.234 INFO:tasks.workunit.client.0.smithi006.stdout:8/654: symlink d2/db/d1a/ld9 0 2024-03-12T16:10:55.235 INFO:tasks.workunit.client.0.smithi006.stdout:6/751: read - d3/d11/d10/da7/d9e/daa/fc2 zero size 2024-03-12T16:10:55.235 INFO:tasks.workunit.client.1.smithi134.stdout:0/916: truncate db/d2f/d31/d68/d70/dc7/ff5 559235 0 2024-03-12T16:10:55.236 INFO:tasks.workunit.client.1.smithi134.stdout:8/918: chown d3/d1b/d17/d25/d33/d96/dbd/f108 100254 1 2024-03-12T16:10:55.237 INFO:tasks.workunit.client.1.smithi134.stdout:7/947: mknod d8/d4e/d91/da1/c12b 0 2024-03-12T16:10:55.238 INFO:tasks.workunit.client.0.smithi006.stdout:6/752: unlink d3/f52 0 2024-03-12T16:10:55.239 INFO:tasks.workunit.client.1.smithi134.stdout:0/917: mknod db/d2f/d31/d76/df9/c12c 0 2024-03-12T16:10:55.241 INFO:tasks.workunit.client.1.smithi134.stdout:6/961: rename d1/da6/d55/d85/lb8 to d1/d16/d100/d120/l15f 0 2024-03-12T16:10:55.241 INFO:tasks.workunit.client.1.smithi134.stdout:0/918: creat db/d2f/d31/d76/d9f/dcf/f12d x:0 0 0 2024-03-12T16:10:55.244 INFO:tasks.workunit.client.0.smithi006.stdout:6/753: dwrite d3/fcd [0,4194304] 0 2024-03-12T16:10:55.244 INFO:tasks.workunit.client.1.smithi134.stdout:8/919: rename d3/d82/d104/lec to d3/d1b/d17/d25/d33/d132/l13c 0 2024-03-12T16:10:55.246 INFO:tasks.workunit.client.1.smithi134.stdout:6/962: symlink d1/d16/d4c/d65/d7b/l160 0 2024-03-12T16:10:55.246 INFO:tasks.workunit.client.1.smithi134.stdout:4/989: dwrite d1/d13/d49/d6d/d96/ff5 [0,4194304] 0 2024-03-12T16:10:55.247 INFO:tasks.workunit.client.0.smithi006.stdout:6/754: mkdir d3/d11/d10/da7/dd5/ddb/d112 0 2024-03-12T16:10:55.248 INFO:tasks.workunit.client.1.smithi134.stdout:6/963: write d1/d3/d10/f121 [1013375,103949] 0 2024-03-12T16:10:55.250 INFO:tasks.workunit.client.1.smithi134.stdout:6/964: write d1/d16/d4c/d58/fba [1356665,89311] 0 2024-03-12T16:10:55.253 INFO:tasks.workunit.client.0.smithi006.stdout:8/655: dwrite d2/f7d [0,4194304] 0 2024-03-12T16:10:55.263 INFO:tasks.workunit.client.0.smithi006.stdout:8/656: dwrite d2/d11/d5a/f5f [0,4194304] 0 2024-03-12T16:10:55.265 INFO:tasks.workunit.client.0.smithi006.stdout:8/657: mknod d2/d55/cda 0 2024-03-12T16:10:55.269 INFO:tasks.workunit.client.1.smithi134.stdout:6/965: dwrite d1/d16/d4c/d58/da0/f10d [0,4194304] 0 2024-03-12T16:10:55.270 INFO:tasks.workunit.client.0.smithi006.stdout:8/658: dread - d2/d32/f86 zero size 2024-03-12T16:10:55.279 INFO:tasks.workunit.client.1.smithi134.stdout:8/920: dwrite d3/d82/d104/d31/d9b/fd0 [0,4194304] 0 2024-03-12T16:10:55.280 INFO:tasks.workunit.client.1.smithi134.stdout:4/990: dwrite d1/d24/fad [0,4194304] 0 2024-03-12T16:10:55.283 INFO:tasks.workunit.client.1.smithi134.stdout:4/991: write d1/d13/d49/d64/f123 [4141667,4636] 0 2024-03-12T16:10:55.290 INFO:tasks.workunit.client.1.smithi134.stdout:8/921: mknod d3/d1b/d17/d25/d33/d132/d135/c13d 0 2024-03-12T16:10:55.291 INFO:tasks.workunit.client.1.smithi134.stdout:8/922: dread - d3/d82/d104/fba zero size 2024-03-12T16:10:55.293 INFO:tasks.workunit.client.1.smithi134.stdout:8/923: fsync d3/d1b/d17/d25/d33/f11d 0 2024-03-12T16:10:55.296 INFO:tasks.workunit.client.1.smithi134.stdout:4/992: rename d1/d13/d49/d64/d28/d4f/d67/f107 to d1/d24/d34/f13d 0 2024-03-12T16:10:55.299 INFO:tasks.workunit.client.1.smithi134.stdout:0/919: dread db/f35 [0,4194304] 0 2024-03-12T16:10:55.300 INFO:tasks.workunit.client.1.smithi134.stdout:8/924: mkdir d3/d82/d13e 0 2024-03-12T16:10:55.303 INFO:tasks.workunit.client.1.smithi134.stdout:4/993: mknod d1/c13e 0 2024-03-12T16:10:55.304 INFO:tasks.workunit.client.1.smithi134.stdout:0/920: fdatasync db/d2f/d61/d7a/fcd 0 2024-03-12T16:10:55.304 INFO:tasks.workunit.client.0.smithi006.stdout:8/659: creat d2/db/d70/daa/fdb x:0 0 0 2024-03-12T16:10:55.305 INFO:tasks.workunit.client.1.smithi134.stdout:0/921: readlink db/d2f/d31/d75/d88/l96 0 2024-03-12T16:10:55.306 INFO:tasks.workunit.client.1.smithi134.stdout:6/966: fdatasync d1/d16/d4c/d58/fe3 0 2024-03-12T16:10:55.310 INFO:tasks.workunit.client.1.smithi134.stdout:8/925: creat d3/d1b/d17/d25/d33/d96/dbd/d112/f13f x:0 0 0 2024-03-12T16:10:55.310 INFO:tasks.workunit.client.1.smithi134.stdout:4/994: symlink d1/d13/d49/da4/l13f 0 2024-03-12T16:10:55.310 INFO:tasks.workunit.client.1.smithi134.stdout:0/922: chown db/d2f/d31/d76 47 1 2024-03-12T16:10:55.318 INFO:tasks.workunit.client.1.smithi134.stdout:4/995: rename d1/de/c22 to d1/de/d5a/d70/c140 0 2024-03-12T16:10:55.321 INFO:tasks.workunit.client.1.smithi134.stdout:6/967: creat d1/da6/d55/dcc/f161 x:0 0 0 2024-03-12T16:10:55.323 INFO:tasks.workunit.client.1.smithi134.stdout:0/923: creat db/d2f/d61/d7a/f12e x:0 0 0 2024-03-12T16:10:55.323 INFO:tasks.workunit.client.1.smithi134.stdout:8/926: dwrite d3/d1b/d17/d25/d33/d85/fdd [0,4194304] 0 2024-03-12T16:10:55.325 INFO:tasks.workunit.client.0.smithi006.stdout:5/640: sync 2024-03-12T16:10:55.325 INFO:tasks.workunit.client.0.smithi006.stdout:4/776: sync 2024-03-12T16:10:55.326 INFO:tasks.workunit.client.0.smithi006.stdout:8/660: rmdir d2/db/d1a/d1f/dcf 0 2024-03-12T16:10:55.327 INFO:tasks.workunit.client.0.smithi006.stdout:8/661: write d2/f16 [1565589,51852] 0 2024-03-12T16:10:55.328 INFO:tasks.workunit.client.0.smithi006.stdout:5/641: symlink d7/d9/d31/d3b/d4f/d80/ld1 0 2024-03-12T16:10:55.330 INFO:tasks.workunit.client.1.smithi134.stdout:4/996: dread d1/d13/d49/d64/d28/d4f/d105/f121 [0,4194304] 0 2024-03-12T16:10:55.330 INFO:tasks.workunit.client.0.smithi006.stdout:4/777: mknod d1/db/d39/dbf/dec/d43/db5/c101 0 2024-03-12T16:10:55.330 INFO:tasks.workunit.client.0.smithi006.stdout:5/642: dread - d7/d9/d31/d3b/d4f/d65/fc5 zero size 2024-03-12T16:10:55.331 INFO:tasks.workunit.client.1.smithi134.stdout:0/924: fsync db/d2f/d31/d68/da2/db2/fe0 0 2024-03-12T16:10:55.332 INFO:tasks.workunit.client.1.smithi134.stdout:4/997: chown d1/d13/d49/f101 103853 1 2024-03-12T16:10:55.335 INFO:tasks.workunit.client.1.smithi134.stdout:0/925: mknod db/d2f/d31/d56/c12f 0 2024-03-12T16:10:55.336 INFO:tasks.workunit.client.0.smithi006.stdout:8/662: dwrite d2/db/f13 [0,4194304] 0 2024-03-12T16:10:55.338 INFO:tasks.workunit.client.1.smithi134.stdout:8/927: rename d3/d1b/d17/d24/d28/d102/d11b/f11c to d3/d1b/d17/d25/d33/d96/f140 0 2024-03-12T16:10:55.341 INFO:tasks.workunit.client.1.smithi134.stdout:0/926: mkdir db/d2f/d31/d56/d9a/d130 0 2024-03-12T16:10:55.342 INFO:tasks.workunit.client.0.smithi006.stdout:8/663: unlink d2/db/d1a/d21/dad/d7c/l94 0 2024-03-12T16:10:55.342 INFO:tasks.workunit.client.1.smithi134.stdout:4/998: getdents d1/d13/d49/d64/da3 0 2024-03-12T16:10:55.343 INFO:tasks.workunit.client.1.smithi134.stdout:8/928: fdatasync d3/d1b/d17/d24/f6f 0 2024-03-12T16:10:55.346 INFO:tasks.workunit.client.0.smithi006.stdout:5/643: symlink d7/d9/d47/d56/dc4/ld2 0 2024-03-12T16:10:55.348 INFO:tasks.workunit.client.1.smithi134.stdout:8/929: symlink d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/l141 0 2024-03-12T16:10:55.349 INFO:tasks.workunit.client.1.smithi134.stdout:4/999: mknod d1/de/d5a/c141 0 2024-03-12T16:10:55.351 INFO:tasks.workunit.client.0.smithi006.stdout:8/664: dwrite d2/db/f24 [0,4194304] 0 2024-03-12T16:10:55.351 INFO:tasks.workunit.client.1.smithi134.stdout:8/930: creat d3/d1b/d17/d25/d33/d132/d135/f142 x:0 0 0 2024-03-12T16:10:55.352 INFO:tasks.workunit.client.0.smithi006.stdout:8/665: chown d2/db/f69 15 1 2024-03-12T16:10:55.353 INFO:tasks.workunit.client.0.smithi006.stdout:8/666: write d2/db/f39 [4462840,35186] 0 2024-03-12T16:10:55.354 INFO:tasks.workunit.client.1.smithi134.stdout:8/931: fsync d3/d1b/d17/fe1 0 2024-03-12T16:10:55.355 INFO:tasks.workunit.client.1.smithi134.stdout:8/932: fdatasync d3/d1b/d17/d25/f101 0 2024-03-12T16:10:55.357 INFO:tasks.workunit.client.0.smithi006.stdout:8/667: symlink d2/d55/d7b/db8/ldc 0 2024-03-12T16:10:55.359 INFO:tasks.workunit.client.0.smithi006.stdout:8/668: dread - d2/db/d1a/d7a/dcc/fd2 zero size 2024-03-12T16:10:55.361 INFO:tasks.workunit.client.1.smithi134.stdout:0/927: getdents db/d2f/d31/d56/d9a 0 2024-03-12T16:10:55.362 INFO:tasks.workunit.client.1.smithi134.stdout:0/928: chown db/d2f/d51/c54 70678207 1 2024-03-12T16:10:55.362 INFO:tasks.workunit.client.1.smithi134.stdout:0/929: fdatasync db/f1f 0 2024-03-12T16:10:55.363 INFO:tasks.workunit.client.1.smithi134.stdout:8/933: rename d3/d1b/d17/d45/l64 to d3/d1b/d17/d24/db6/dd9/dd6/l143 0 2024-03-12T16:10:55.366 INFO:tasks.workunit.client.0.smithi006.stdout:8/669: rename d2/d11/f9d to d2/d55/d7b/db8/fdd 0 2024-03-12T16:10:55.370 INFO:tasks.workunit.client.1.smithi134.stdout:6/968: link d1/d16/d4c/d58/fe3 d1/d3a/db5/f162 0 2024-03-12T16:10:55.371 INFO:tasks.workunit.client.1.smithi134.stdout:9/925: sync 2024-03-12T16:10:55.371 INFO:tasks.workunit.client.1.smithi134.stdout:0/930: readlink db/l12 0 2024-03-12T16:10:55.373 INFO:tasks.workunit.client.0.smithi006.stdout:4/778: rmdir d1/db/d39/dbf/dec/d43/dcc 39 2024-03-12T16:10:55.374 INFO:tasks.workunit.client.0.smithi006.stdout:8/670: dwrite d2/d55/d7b/f83 [0,4194304] 0 2024-03-12T16:10:55.377 INFO:tasks.workunit.client.1.smithi134.stdout:9/926: truncate d5/d10/d35/d49/d8d/ff0 838383 0 2024-03-12T16:10:55.380 INFO:tasks.workunit.client.1.smithi134.stdout:9/927: getdents d5/d10/d114 0 2024-03-12T16:10:55.381 INFO:tasks.workunit.client.1.smithi134.stdout:8/934: dwrite d3/d1b/d17/d25/d33/d15/d95/d6d/f138 [0,4194304] 0 2024-03-12T16:10:55.381 INFO:tasks.workunit.client.0.smithi006.stdout:4/779: mknod d1/db/d1d/c102 0 2024-03-12T16:10:55.382 INFO:tasks.workunit.client.0.smithi006.stdout:8/671: creat d2/db/d1a/d7a/fde x:0 0 0 2024-03-12T16:10:55.386 INFO:tasks.workunit.client.1.smithi134.stdout:8/935: unlink d3/d1b/d17/d25/d33/d15/d95/d5b/fb9 0 2024-03-12T16:10:55.388 INFO:tasks.workunit.client.0.smithi006.stdout:8/672: dread d2/db/d1a/d21/fa8 [0,4194304] 0 2024-03-12T16:10:55.390 INFO:tasks.workunit.client.0.smithi006.stdout:5/644: dread d7/d41/f87 [0,4194304] 0 2024-03-12T16:10:55.392 INFO:tasks.workunit.client.1.smithi134.stdout:0/931: dwrite db/d2f/f52 [0,4194304] 0 2024-03-12T16:10:55.392 INFO:tasks.workunit.client.0.smithi006.stdout:5/645: truncate d7/d9/fa1 715988 0 2024-03-12T16:10:55.399 INFO:tasks.workunit.client.0.smithi006.stdout:8/673: dwrite d2/db/d1a/d23/f60 [0,4194304] 0 2024-03-12T16:10:55.399 INFO:tasks.workunit.client.0.smithi006.stdout:4/780: mknod d1/db/d1d/c103 0 2024-03-12T16:10:55.400 INFO:tasks.workunit.client.0.smithi006.stdout:8/674: dread - d2/fc3 zero size 2024-03-12T16:10:55.400 INFO:tasks.workunit.client.0.smithi006.stdout:4/781: dread - d1/d91/fee zero size 2024-03-12T16:10:55.402 INFO:tasks.workunit.client.0.smithi006.stdout:8/675: write d2/d11/d5a/f5f [2126372,32335] 0 2024-03-12T16:10:55.404 INFO:tasks.workunit.client.1.smithi134.stdout:9/928: dread d5/d20/f52 [0,4194304] 0 2024-03-12T16:10:55.405 INFO:tasks.workunit.client.1.smithi134.stdout:6/969: dwrite d1/d4/f80 [0,4194304] 0 2024-03-12T16:10:55.406 INFO:tasks.workunit.client.1.smithi134.stdout:0/932: dwrite db/d2f/d31/d75/ff8 [0,4194304] 0 2024-03-12T16:10:55.406 INFO:tasks.workunit.client.0.smithi006.stdout:5/646: truncate d7/d9/d31/d3b/fcf 1016830 0 2024-03-12T16:10:55.409 INFO:tasks.workunit.client.0.smithi006.stdout:5/647: mkdir d7/d9/d31/d3b/d61/dd3 0 2024-03-12T16:10:55.412 INFO:tasks.workunit.client.1.smithi134.stdout:9/929: truncate d5/d46/f57 1273249 0 2024-03-12T16:10:55.412 INFO:tasks.workunit.client.1.smithi134.stdout:0/933: read db/f1d [4122259,103798] 0 2024-03-12T16:10:55.413 INFO:tasks.workunit.client.0.smithi006.stdout:5/648: symlink d7/d9/d31/d3b/d61/dd3/ld4 0 2024-03-12T16:10:55.415 INFO:tasks.workunit.client.1.smithi134.stdout:6/970: rmdir d1/d3a/db5 39 2024-03-12T16:10:55.415 INFO:tasks.workunit.client.0.smithi006.stdout:5/649: write d7/d9/d31/d3b/d4f/d65/d69/f90 [1946042,53844] 0 2024-03-12T16:10:55.419 INFO:tasks.workunit.client.0.smithi006.stdout:8/676: read d2/db/d1a/d21/f87 [2657231,121451] 0 2024-03-12T16:10:55.420 INFO:tasks.workunit.client.0.smithi006.stdout:4/782: dread d1/db/d1d/f2b [0,4194304] 0 2024-03-12T16:10:55.421 INFO:tasks.workunit.client.1.smithi134.stdout:0/934: rename db/d2f/d31/d68/d70/d113/d126 to db/d2f/d131 0 2024-03-12T16:10:55.421 INFO:tasks.workunit.client.1.smithi134.stdout:9/930: getdents d5/d10/d35/d49/d8d 0 2024-03-12T16:10:55.421 INFO:tasks.workunit.client.0.smithi006.stdout:5/650: creat d7/d9/dbf/fd5 x:0 0 0 2024-03-12T16:10:55.422 INFO:tasks.workunit.client.1.smithi134.stdout:0/935: read - db/d2f/d31/d76/d9f/f12a zero size 2024-03-12T16:10:55.422 INFO:tasks.workunit.client.0.smithi006.stdout:8/677: fsync d2/db/d1a/d21/dad/f75 0 2024-03-12T16:10:55.424 INFO:tasks.workunit.client.1.smithi134.stdout:0/936: mknod db/d2f/d31/d56/d9a/c132 0 2024-03-12T16:10:55.426 INFO:tasks.workunit.client.1.smithi134.stdout:0/937: truncate db/d2f/d31/d68/f114 22301 0 2024-03-12T16:10:55.426 INFO:tasks.workunit.client.0.smithi006.stdout:4/783: mkdir d1/db/d39/dbf/dec/d43/dcc/d104 0 2024-03-12T16:10:55.428 INFO:tasks.workunit.client.1.smithi134.stdout:6/971: rename d1/da6/d55/d94/lf5 to d1/d16/d129/d159/l163 0 2024-03-12T16:10:55.428 INFO:tasks.workunit.client.1.smithi134.stdout:0/938: creat db/dcc/f133 x:0 0 0 2024-03-12T16:10:55.429 INFO:tasks.workunit.client.1.smithi134.stdout:9/931: link d5/d20/d100/c115 d5/d10/d1f/c117 0 2024-03-12T16:10:55.429 INFO:tasks.workunit.client.1.smithi134.stdout:0/939: stat db/d2f/d51/c54 0 2024-03-12T16:10:55.429 INFO:tasks.workunit.client.1.smithi134.stdout:6/972: read - d1/f117 zero size 2024-03-12T16:10:55.429 INFO:tasks.workunit.client.0.smithi006.stdout:5/651: dwrite d7/d9/fa1 [0,4194304] 0 2024-03-12T16:10:55.430 INFO:tasks.workunit.client.1.smithi134.stdout:6/973: fsync d1/d16/d4c/d65/d7b/ff8 0 2024-03-12T16:10:55.431 INFO:tasks.workunit.client.1.smithi134.stdout:9/932: mkdir d5/d46/d118 0 2024-03-12T16:10:55.431 INFO:tasks.workunit.client.0.smithi006.stdout:4/784: creat d1/db/d39/dbf/dec/d5a/d60/f105 x:0 0 0 2024-03-12T16:10:55.433 INFO:tasks.workunit.client.0.smithi006.stdout:4/785: write d1/db/d39/d42/f100 [72410,127878] 0 2024-03-12T16:10:55.434 INFO:tasks.workunit.client.1.smithi134.stdout:9/933: creat d5/d10/d35/d49/f119 x:0 0 0 2024-03-12T16:10:55.435 INFO:tasks.workunit.client.0.smithi006.stdout:5/652: symlink d7/d9/d31/d3b/d4f/ld6 0 2024-03-12T16:10:55.435 INFO:tasks.workunit.client.0.smithi006.stdout:4/786: fdatasync d1/d38/d79/f84 0 2024-03-12T16:10:55.435 INFO:tasks.workunit.client.1.smithi134.stdout:9/934: stat d5/d20/d100/l109 0 2024-03-12T16:10:55.438 INFO:tasks.workunit.client.1.smithi134.stdout:9/935: truncate d5/d20/f52 4295931 0 2024-03-12T16:10:55.441 INFO:tasks.workunit.client.1.smithi134.stdout:0/940: write db/d2f/d51/daf/fd2 [526541,94015] 0 2024-03-12T16:10:55.442 INFO:tasks.workunit.client.0.smithi006.stdout:5/653: symlink d7/d9/ld7 0 2024-03-12T16:10:55.443 INFO:tasks.workunit.client.1.smithi134.stdout:9/936: symlink d5/d10/d35/d49/d54/d93/l11a 0 2024-03-12T16:10:55.443 INFO:tasks.workunit.client.0.smithi006.stdout:5/654: read - d7/d9/d31/f9d zero size 2024-03-12T16:10:55.444 INFO:tasks.workunit.client.1.smithi134.stdout:6/974: rename d1/d4/f67 to d1/d3a/db5/f164 0 2024-03-12T16:10:55.446 INFO:tasks.workunit.client.0.smithi006.stdout:5/655: fsync d7/d9/d31/d3b/d4f/fb7 0 2024-03-12T16:10:55.446 INFO:tasks.workunit.client.1.smithi134.stdout:0/941: creat db/d2f/d31/d68/da2/f134 x:0 0 0 2024-03-12T16:10:55.447 INFO:tasks.workunit.client.1.smithi134.stdout:6/975: write d1/d16/d4c/d65/dd1/df9/f128 [5233525,69130] 0 2024-03-12T16:10:55.447 INFO:tasks.workunit.client.0.smithi006.stdout:5/656: rmdir d7/d8/d91 39 2024-03-12T16:10:55.451 INFO:tasks.workunit.client.1.smithi134.stdout:6/976: dread - d1/da6/d55/d94/d127/d32/ffa zero size 2024-03-12T16:10:55.456 INFO:tasks.workunit.client.0.smithi006.stdout:5/657: link d7/d9/d10/d24/f3d d7/d9/d47/fd8 0 2024-03-12T16:10:55.460 INFO:tasks.workunit.client.1.smithi134.stdout:6/977: creat d1/da6/f165 x:0 0 0 2024-03-12T16:10:55.460 INFO:tasks.workunit.client.1.smithi134.stdout:0/942: dwrite db/d2f/d61/d67/f8b [4194304,4194304] 0 2024-03-12T16:10:55.463 INFO:tasks.workunit.client.0.smithi006.stdout:5/658: rename d7/d9/d10/d24/f2d to d7/d41/fd9 0 2024-03-12T16:10:55.465 INFO:tasks.workunit.client.1.smithi134.stdout:9/937: dread d5/d10/f81 [0,4194304] 0 2024-03-12T16:10:55.465 INFO:tasks.workunit.client.0.smithi006.stdout:4/787: dread d1/db/f22 [0,4194304] 0 2024-03-12T16:10:55.466 INFO:tasks.workunit.client.0.smithi006.stdout:5/659: mknod d7/d9/d47/d56/cda 0 2024-03-12T16:10:55.470 INFO:tasks.workunit.client.0.smithi006.stdout:5/660: mkdir d7/d9/d31/d3b/d4f/d9e/ddb 0 2024-03-12T16:10:55.471 INFO:tasks.workunit.client.1.smithi134.stdout:0/943: dread db/d2f/d31/d56/dbc/f104 [0,4194304] 0 2024-03-12T16:10:55.473 INFO:tasks.workunit.client.1.smithi134.stdout:6/978: write d1/d16/d129/d159/dca/fdc [1611910,93043] 0 2024-03-12T16:10:55.474 INFO:tasks.workunit.client.0.smithi006.stdout:5/661: chown d7/d9/d31/d3b/d4f/f7c 180 1 2024-03-12T16:10:55.475 INFO:tasks.workunit.client.0.smithi006.stdout:5/662: write d7/d41/fc6 [556150,96845] 0 2024-03-12T16:10:55.475 INFO:tasks.workunit.client.1.smithi134.stdout:6/979: mkdir d1/d16/d4c/d166 0 2024-03-12T16:10:55.476 INFO:tasks.workunit.client.1.smithi134.stdout:6/980: readlink d1/d16/d4c/d58/l5d 0 2024-03-12T16:10:55.477 INFO:tasks.workunit.client.1.smithi134.stdout:6/981: chown d1/da6/d55/d97/dfd/c139 250854439 1 2024-03-12T16:10:55.478 INFO:tasks.workunit.client.1.smithi134.stdout:6/982: write d1/d3/d10/f15e [460145,15412] 0 2024-03-12T16:10:55.481 INFO:tasks.workunit.client.1.smithi134.stdout:6/983: mknod d1/d16/d129/d159/dca/c167 0 2024-03-12T16:10:55.481 INFO:tasks.workunit.client.0.smithi006.stdout:5/663: getdents d7/d9/d31/d3b/d4f/d80/d88 0 2024-03-12T16:10:55.483 INFO:tasks.workunit.client.0.smithi006.stdout:5/664: symlink d7/d9/d31/d3b/ldc 0 2024-03-12T16:10:55.485 INFO:tasks.workunit.client.0.smithi006.stdout:5/665: symlink d7/d41/ldd 0 2024-03-12T16:10:55.486 INFO:tasks.workunit.client.1.smithi134.stdout:6/984: dwrite d1/def/f124 [0,4194304] 0 2024-03-12T16:10:55.487 INFO:tasks.workunit.client.0.smithi006.stdout:5/666: creat d7/d9/d31/d3b/d61/dd3/fde x:0 0 0 2024-03-12T16:10:55.489 INFO:tasks.workunit.client.0.smithi006.stdout:5/667: creat d7/d8/d8a/d92/fdf x:0 0 0 2024-03-12T16:10:55.494 INFO:tasks.workunit.client.1.smithi134.stdout:0/944: dread db/f6e [0,4194304] 0 2024-03-12T16:10:55.495 INFO:tasks.workunit.client.1.smithi134.stdout:0/945: dread - db/d2f/d61/d7a/fcd zero size 2024-03-12T16:10:55.496 INFO:tasks.workunit.client.1.smithi134.stdout:0/946: chown db/d2f/d31/d56/d9a/fc5 288274 1 2024-03-12T16:10:55.499 INFO:tasks.workunit.client.1.smithi134.stdout:0/947: getdents db/d2f/d31/d68/da2/dd3 0 2024-03-12T16:10:55.501 INFO:tasks.workunit.client.1.smithi134.stdout:0/948: mknod db/d2f/d51/daf/c135 0 2024-03-12T16:10:55.502 INFO:tasks.workunit.client.1.smithi134.stdout:0/949: write db/d2f/d31/d68/da2/db2/fdd [801367,1448] 0 2024-03-12T16:10:55.505 INFO:tasks.workunit.client.1.smithi134.stdout:0/950: unlink db/c2b 0 2024-03-12T16:10:55.516 INFO:tasks.workunit.client.1.smithi134.stdout:0/951: dread db/d2f/d51/daf/fd2 [0,4194304] 0 2024-03-12T16:10:55.518 INFO:tasks.workunit.client.1.smithi134.stdout:0/952: unlink db/d2f/l6f 0 2024-03-12T16:10:55.519 INFO:tasks.workunit.client.1.smithi134.stdout:0/953: creat db/d2f/d31/d56/d66/da5/f136 x:0 0 0 2024-03-12T16:10:55.525 INFO:tasks.workunit.client.1.smithi134.stdout:0/954: dwrite db/f14 [4194304,4194304] 0 2024-03-12T16:10:55.528 INFO:tasks.workunit.client.0.smithi006.stdout:9/606: sync 2024-03-12T16:10:55.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/732: sync 2024-03-12T16:10:55.529 INFO:tasks.workunit.client.0.smithi006.stdout:0/733: write f0 [2145222,99059] 0 2024-03-12T16:10:55.534 INFO:tasks.workunit.client.1.smithi134.stdout:0/955: rename db/d2f/d61/d67/lac to db/d2f/d61/d94/l137 0 2024-03-12T16:10:55.535 INFO:tasks.workunit.client.0.smithi006.stdout:0/734: mkdir d2/d39/dec 0 2024-03-12T16:10:55.535 INFO:tasks.workunit.client.0.smithi006.stdout:0/735: dread - d2/fa2 zero size 2024-03-12T16:10:55.536 INFO:tasks.workunit.client.0.smithi006.stdout:9/607: truncate d0/d8/d80/f97 1301374 0 2024-03-12T16:10:55.536 INFO:tasks.workunit.client.0.smithi006.stdout:4/788: write d1/d38/f88 [1563427,95648] 0 2024-03-12T16:10:55.538 INFO:tasks.workunit.client.1.smithi134.stdout:0/956: creat db/d2f/d31/d56/d66/f138 x:0 0 0 2024-03-12T16:10:55.539 INFO:tasks.workunit.client.0.smithi006.stdout:0/736: truncate d2/d6/d10/d11/d1d/fab 521713 0 2024-03-12T16:10:55.542 INFO:tasks.workunit.client.0.smithi006.stdout:9/608: creat d0/d8/d16/d7d/d20/fc7 x:0 0 0 2024-03-12T16:10:55.543 INFO:tasks.workunit.client.1.smithi134.stdout:6/985: write d1/d16/d4c/d58/fe3 [4845348,5161] 0 2024-03-12T16:10:55.543 INFO:tasks.workunit.client.0.smithi006.stdout:5/668: write d7/d41/fd9 [1229785,39353] 0 2024-03-12T16:10:55.548 INFO:tasks.workunit.client.1.smithi134.stdout:0/957: dwrite db/d2f/d31/d76/d9f/dcf/f10b [0,4194304] 0 2024-03-12T16:10:55.549 INFO:tasks.workunit.client.0.smithi006.stdout:4/789: write d1/db/d39/f47 [1735767,57351] 0 2024-03-12T16:10:55.551 INFO:tasks.workunit.client.1.smithi134.stdout:0/958: mknod db/d2f/d31/d56/d66/dc0/c139 0 2024-03-12T16:10:55.555 INFO:tasks.workunit.client.0.smithi006.stdout:0/737: link d2/d6/d10/d11/d7e/da6/cd1 d2/d39/d42/de5/ced 0 2024-03-12T16:10:55.559 INFO:tasks.workunit.client.0.smithi006.stdout:9/609: dread d0/d8/d16/f43 [0,4194304] 0 2024-03-12T16:10:55.559 INFO:tasks.workunit.client.1.smithi134.stdout:6/986: rename d1/d16/d129/d159/c11f to d1/d16/d7e/d12d/c168 0 2024-03-12T16:10:55.572 INFO:tasks.workunit.client.0.smithi006.stdout:5/669: dread d7/d9/d10/d24/d89/f3a [0,4194304] 0 2024-03-12T16:10:55.574 INFO:tasks.workunit.client.0.smithi006.stdout:5/670: read d7/d9/d47/fc1 [650151,84908] 0 2024-03-12T16:10:55.578 INFO:tasks.workunit.client.1.smithi134.stdout:0/959: dread db/d2f/d31/f59 [0,4194304] 0 2024-03-12T16:10:55.578 INFO:tasks.workunit.client.0.smithi006.stdout:5/671: truncate d7/d9/d31/d3b/d4f/db5/fc0 736458 0 2024-03-12T16:10:55.579 INFO:tasks.workunit.client.1.smithi134.stdout:0/960: chown db/d2f/d51/c55 11279 1 2024-03-12T16:10:55.581 INFO:tasks.workunit.client.0.smithi006.stdout:5/672: creat d7/d41/fe0 x:0 0 0 2024-03-12T16:10:55.582 INFO:tasks.workunit.client.1.smithi134.stdout:0/961: creat db/d2f/d51/f13a x:0 0 0 2024-03-12T16:10:55.584 INFO:tasks.workunit.client.1.smithi134.stdout:6/987: dread d1/d3/d10/f9e [0,4194304] 0 2024-03-12T16:10:55.586 INFO:tasks.workunit.client.0.smithi006.stdout:9/610: dread d0/d4/d70/fa9 [0,4194304] 0 2024-03-12T16:10:55.586 INFO:tasks.workunit.client.1.smithi134.stdout:0/962: unlink db/d2f/d31/f47 0 2024-03-12T16:10:55.589 INFO:tasks.workunit.client.1.smithi134.stdout:6/988: mkdir d1/d16/d129/d159/d169 0 2024-03-12T16:10:55.589 INFO:tasks.workunit.client.1.smithi134.stdout:0/963: mkdir db/d2f/d31/d76/d13b 0 2024-03-12T16:10:55.589 INFO:tasks.workunit.client.1.smithi134.stdout:6/989: fsync d1/da6/fc4 0 2024-03-12T16:10:55.590 INFO:tasks.workunit.client.0.smithi006.stdout:0/738: dread d2/d6/d10/d11/d32/f38 [0,4194304] 0 2024-03-12T16:10:55.590 INFO:tasks.workunit.client.0.smithi006.stdout:9/611: truncate d0/d8/d16/f46 2410406 0 2024-03-12T16:10:55.590 INFO:tasks.workunit.client.1.smithi134.stdout:6/990: write d1/da6/d55/d94/d127/d32/dd9/d13e/f141 [795138,120162] 0 2024-03-12T16:10:55.593 INFO:tasks.workunit.client.0.smithi006.stdout:5/673: write d7/d9/d47/f5f [304372,20346] 0 2024-03-12T16:10:55.596 INFO:tasks.workunit.client.1.smithi134.stdout:6/991: rename d1/da6/d55/d85/ddf/f123 to d1/da6/d55/dcc/f16a 0 2024-03-12T16:10:55.596 INFO:tasks.workunit.client.1.smithi134.stdout:0/964: dread db/d2f/d71/f89 [0,4194304] 0 2024-03-12T16:10:55.596 INFO:tasks.workunit.client.1.smithi134.stdout:6/992: fdatasync d1/da6/d55/dcc/f161 0 2024-03-12T16:10:55.599 INFO:tasks.workunit.client.0.smithi006.stdout:0/739: write d2/d6/f62 [1126493,32180] 0 2024-03-12T16:10:55.599 INFO:tasks.workunit.client.0.smithi006.stdout:9/612: write d0/d8/d16/d7d/d20/d37/f5f [454744,24336] 0 2024-03-12T16:10:55.599 INFO:tasks.workunit.client.1.smithi134.stdout:1/663: sync 2024-03-12T16:10:55.601 INFO:tasks.workunit.client.1.smithi134.stdout:0/965: dread db/d2f/d51/daf/fd2 [0,4194304] 0 2024-03-12T16:10:55.602 INFO:tasks.workunit.client.1.smithi134.stdout:1/664: mkdir d0/d16/d9/d51/de1 0 2024-03-12T16:10:55.603 INFO:tasks.workunit.client.1.smithi134.stdout:0/966: creat db/d2f/d61/dde/f13c x:0 0 0 2024-03-12T16:10:55.603 INFO:tasks.workunit.client.1.smithi134.stdout:6/993: creat d1/da6/d55/d94/d127/d32/f16b x:0 0 0 2024-03-12T16:10:55.607 INFO:tasks.workunit.client.1.smithi134.stdout:0/967: truncate db/d2f/d61/dde/fbf 4501042 0 2024-03-12T16:10:55.607 INFO:tasks.workunit.client.1.smithi134.stdout:0/968: fsync db/fe 0 2024-03-12T16:10:55.608 INFO:tasks.workunit.client.1.smithi134.stdout:6/994: unlink d1/da6/d55/d97/c14d 0 2024-03-12T16:10:55.610 INFO:tasks.workunit.client.0.smithi006.stdout:0/740: write d2/d6/f72 [385514,41303] 0 2024-03-12T16:10:55.610 INFO:tasks.workunit.client.1.smithi134.stdout:0/969: write db/d2f/d31/d76/f93 [5189217,22345] 0 2024-03-12T16:10:55.611 INFO:tasks.workunit.client.0.smithi006.stdout:5/674: dread d7/d9/d10/f32 [0,4194304] 0 2024-03-12T16:10:55.611 INFO:tasks.workunit.client.1.smithi134.stdout:6/995: symlink d1/da6/d55/l16c 0 2024-03-12T16:10:55.613 INFO:tasks.workunit.client.0.smithi006.stdout:5/675: rmdir d7/d8/d8a 39 2024-03-12T16:10:55.614 INFO:tasks.workunit.client.0.smithi006.stdout:0/741: mknod d2/d6/d10/d11/d1d/d79/dd0/cee 0 2024-03-12T16:10:55.614 INFO:tasks.workunit.client.0.smithi006.stdout:0/742: fsync d2/d39/f63 0 2024-03-12T16:10:55.615 INFO:tasks.workunit.client.1.smithi134.stdout:0/970: mknod db/d2f/d31/c13d 0 2024-03-12T16:10:55.616 INFO:tasks.workunit.client.0.smithi006.stdout:9/613: write d0/d8/d16/f46 [323364,130292] 0 2024-03-12T16:10:55.616 INFO:tasks.workunit.client.0.smithi006.stdout:5/676: readlink d7/l97 0 2024-03-12T16:10:55.618 INFO:tasks.workunit.client.0.smithi006.stdout:5/677: chown d7/d9/d31/d3b/d4f/d9e/ddb 9391 1 2024-03-12T16:10:55.619 INFO:tasks.workunit.client.1.smithi134.stdout:1/665: dwrite d0/d16/d9/d13/d38/f82 [0,4194304] 0 2024-03-12T16:10:55.621 INFO:tasks.workunit.client.1.smithi134.stdout:1/666: chown d0/d16/d9/lb 15860492 1 2024-03-12T16:10:55.622 INFO:tasks.workunit.client.0.smithi006.stdout:0/743: symlink d2/d6/d10/lef 0 2024-03-12T16:10:55.624 INFO:tasks.workunit.client.1.smithi134.stdout:6/996: getdents d1/da6/d55/d94/d127/d32 0 2024-03-12T16:10:55.624 INFO:tasks.workunit.client.1.smithi134.stdout:1/667: chown d0/d42/d47/cba 882218091 1 2024-03-12T16:10:55.626 INFO:tasks.workunit.client.1.smithi134.stdout:0/971: dwrite db/d2f/d31/d56/dbc/f122 [0,4194304] 0 2024-03-12T16:10:55.627 INFO:tasks.workunit.client.0.smithi006.stdout:5/678: dwrite d7/d9/d31/f46 [0,4194304] 0 2024-03-12T16:10:55.629 INFO:tasks.workunit.client.0.smithi006.stdout:0/744: rename d2/d6/d10/d11/d7e/dbe/fbf to d2/d39/d42/de5/ff0 0 2024-03-12T16:10:55.631 INFO:tasks.workunit.client.0.smithi006.stdout:0/745: dread - d2/d6/d10/d11/d7e/dbe/fc3 zero size 2024-03-12T16:10:55.631 INFO:tasks.workunit.client.1.smithi134.stdout:6/997: mkdir d1/d16/d4c/d65/dd1/d16d 0 2024-03-12T16:10:55.633 INFO:tasks.workunit.client.0.smithi006.stdout:5/679: mkdir d7/d9/d31/d3b/d4f/d65/de1 0 2024-03-12T16:10:55.633 INFO:tasks.workunit.client.1.smithi134.stdout:7/948: sync 2024-03-12T16:10:55.634 INFO:tasks.workunit.client.1.smithi134.stdout:2/917: sync 2024-03-12T16:10:55.634 INFO:tasks.workunit.client.1.smithi134.stdout:8/936: sync 2024-03-12T16:10:55.634 INFO:tasks.workunit.client.0.smithi006.stdout:0/746: creat d2/d6/d37/d97/ff1 x:0 0 0 2024-03-12T16:10:55.638 INFO:tasks.workunit.client.1.smithi134.stdout:0/972: dwrite db/d2f/d61/d67/f69 [0,4194304] 0 2024-03-12T16:10:55.639 INFO:tasks.workunit.client.0.smithi006.stdout:9/614: dwrite d0/d8/d16/d7d/d20/d37/f5c [0,4194304] 0 2024-03-12T16:10:55.640 INFO:tasks.workunit.client.1.smithi134.stdout:7/949: stat d8/dc/d20/d26/f3a 0 2024-03-12T16:10:55.642 INFO:tasks.workunit.client.1.smithi134.stdout:1/668: dwrite d0/d16/d9/d51/f55 [0,4194304] 0 2024-03-12T16:10:55.643 INFO:tasks.workunit.client.1.smithi134.stdout:8/937: fsync d3/d82/d104/f58 0 2024-03-12T16:10:55.646 INFO:tasks.workunit.client.0.smithi006.stdout:9/615: getdents d0/d8/d16/d7d/db5 0 2024-03-12T16:10:55.647 INFO:tasks.workunit.client.1.smithi134.stdout:6/998: rename d1/d3/d10/f121 to d1/d16/d4c/d65/d61/d147/f16e 0 2024-03-12T16:10:55.647 INFO:tasks.workunit.client.1.smithi134.stdout:2/918: unlink d4/d12/d1d/d34/db7/l125 0 2024-03-12T16:10:55.648 INFO:tasks.workunit.client.0.smithi006.stdout:9/616: stat d0/d4/c2d 0 2024-03-12T16:10:55.650 INFO:tasks.workunit.client.1.smithi134.stdout:1/669: creat d0/d30/d48/dab/fe2 x:0 0 0 2024-03-12T16:10:55.653 INFO:tasks.workunit.client.1.smithi134.stdout:7/950: truncate d8/dc/d7b/df8/dfd/f10d 1022378 0 2024-03-12T16:10:55.653 INFO:tasks.workunit.client.1.smithi134.stdout:2/919: creat d4/d84/d63/dde/df0/f149 x:0 0 0 2024-03-12T16:10:55.654 INFO:tasks.workunit.client.0.smithi006.stdout:9/617: unlink d0/d1f/l26 0 2024-03-12T16:10:55.655 INFO:tasks.workunit.client.1.smithi134.stdout:8/938: creat d3/d82/d104/d31/d9b/f144 x:0 0 0 2024-03-12T16:10:55.655 INFO:tasks.workunit.client.1.smithi134.stdout:7/951: chown d8/dc/d7b/dbb/dbd/dd5/fce 23132859 1 2024-03-12T16:10:55.655 INFO:tasks.workunit.client.1.smithi134.stdout:2/920: read - d4/d84/d63/dde/df0/f136 zero size 2024-03-12T16:10:55.656 INFO:tasks.workunit.client.1.smithi134.stdout:1/670: rename d0/d16/d9/d13/f8a to d0/d16/d9/fe3 0 2024-03-12T16:10:55.659 INFO:tasks.workunit.client.0.smithi006.stdout:5/680: dread d7/f58 [0,4194304] 0 2024-03-12T16:10:55.659 INFO:tasks.workunit.client.1.smithi134.stdout:7/952: mknod d8/d4e/dca/c12c 0 2024-03-12T16:10:55.662 INFO:tasks.workunit.client.0.smithi006.stdout:5/681: dread - d7/d9/d31/d3b/d6b/db9/fc9 zero size 2024-03-12T16:10:55.663 INFO:tasks.workunit.client.1.smithi134.stdout:7/953: mkdir d8/d4e/d91/da1/d12d 0 2024-03-12T16:10:55.665 INFO:tasks.workunit.client.0.smithi006.stdout:5/682: mkdir d7/d9/d10/d24/de2 0 2024-03-12T16:10:55.666 INFO:tasks.workunit.client.1.smithi134.stdout:2/921: rename d4/d84/d63/d9d/d3d/d71/lad to d4/d12/d1d/l14a 0 2024-03-12T16:10:55.667 INFO:tasks.workunit.client.1.smithi134.stdout:2/922: readlink d4/d12/d1d/d34/l50 0 2024-03-12T16:10:55.670 INFO:tasks.workunit.client.1.smithi134.stdout:7/954: mknod d8/dc/d20/c12e 0 2024-03-12T16:10:55.676 INFO:tasks.workunit.client.1.smithi134.stdout:2/923: dwrite d4/d84/fdf [4194304,4194304] 0 2024-03-12T16:10:55.678 INFO:tasks.workunit.client.0.smithi006.stdout:9/618: truncate d0/d4/d18/d4d/f75 955459 0 2024-03-12T16:10:55.679 INFO:tasks.workunit.client.0.smithi006.stdout:5/683: write d7/d8/d8a/fad [1490762,65317] 0 2024-03-12T16:10:55.679 INFO:tasks.workunit.client.0.smithi006.stdout:9/619: chown d0/d4/d70/da6 47934855 1 2024-03-12T16:10:55.680 INFO:tasks.workunit.client.1.smithi134.stdout:7/955: dwrite d8/dc/d4b/fc7 [4194304,4194304] 0 2024-03-12T16:10:55.683 INFO:tasks.workunit.client.0.smithi006.stdout:5/684: rmdir d7/d9/d31/d3b/d4f 39 2024-03-12T16:10:55.687 INFO:tasks.workunit.client.1.smithi134.stdout:2/924: mkdir d4/d12/d3b/d9b/d14b 0 2024-03-12T16:10:55.690 INFO:tasks.workunit.client.0.smithi006.stdout:5/685: dwrite d7/d9/d31/f2e [4194304,4194304] 0 2024-03-12T16:10:55.690 INFO:tasks.workunit.client.1.smithi134.stdout:7/956: rename d8/d4e/d91/c122 to d8/dc/d55/c12f 0 2024-03-12T16:10:55.692 INFO:tasks.workunit.client.1.smithi134.stdout:2/925: symlink d4/d84/d63/d9d/d3d/d71/l14c 0 2024-03-12T16:10:55.694 INFO:tasks.workunit.client.1.smithi134.stdout:7/957: readlink d8/l29 0 2024-03-12T16:10:55.694 INFO:tasks.workunit.client.0.smithi006.stdout:5/686: write d7/f58 [454285,56206] 0 2024-03-12T16:10:55.695 INFO:tasks.workunit.client.1.smithi134.stdout:6/999: dread d1/d16/d4c/faa [0,4194304] 0 2024-03-12T16:10:55.695 INFO:tasks.workunit.client.0.smithi006.stdout:9/620: write d0/d8/d16/d7d/db5/f65 [351707,97531] 0 2024-03-12T16:10:55.696 INFO:tasks.workunit.client.1.smithi134.stdout:2/926: unlink d4/d12/fe4 0 2024-03-12T16:10:55.698 INFO:tasks.workunit.client.1.smithi134.stdout:1/671: dread d0/d16/d9/fe3 [0,4194304] 0 2024-03-12T16:10:55.699 INFO:tasks.workunit.client.1.smithi134.stdout:7/958: creat d8/dc/d7b/d119/f130 x:0 0 0 2024-03-12T16:10:55.700 INFO:tasks.workunit.client.0.smithi006.stdout:9/621: chown d0/d1f/l45 602 1 2024-03-12T16:10:55.700 INFO:tasks.workunit.client.0.smithi006.stdout:9/622: read - d0/d4/d3b/d6a/fae zero size 2024-03-12T16:10:55.701 INFO:tasks.workunit.client.0.smithi006.stdout:5/687: creat d7/d9/d31/d3b/d4f/db5/fe3 x:0 0 0 2024-03-12T16:10:55.701 INFO:tasks.workunit.client.1.smithi134.stdout:1/672: dread - d0/d16/d9/d13/d21/d20/fd8 zero size 2024-03-12T16:10:55.702 INFO:tasks.workunit.client.0.smithi006.stdout:9/623: chown d0/d83/d90/dc0/caa 2658284 1 2024-03-12T16:10:55.705 INFO:tasks.workunit.client.0.smithi006.stdout:9/624: fsync d0/d8/d16/f31 0 2024-03-12T16:10:55.705 INFO:tasks.workunit.client.1.smithi134.stdout:7/959: unlink d8/dc/d7b/cbe 0 2024-03-12T16:10:55.705 INFO:tasks.workunit.client.0.smithi006.stdout:9/625: chown d0/d8/lac 166 1 2024-03-12T16:10:55.708 INFO:tasks.workunit.client.1.smithi134.stdout:7/960: creat d8/dc/d55/d81/f131 x:0 0 0 2024-03-12T16:10:55.708 INFO:tasks.workunit.client.0.smithi006.stdout:5/688: dwrite d7/d9/d47/f5f [0,4194304] 0 2024-03-12T16:10:55.710 INFO:tasks.workunit.client.1.smithi134.stdout:8/939: write d3/d1b/d17/d25/d33/d15/d95/ffd [1023006,24834] 0 2024-03-12T16:10:55.710 INFO:tasks.workunit.client.0.smithi006.stdout:5/689: chown d7/d9/fa1 339 1 2024-03-12T16:10:55.711 INFO:tasks.workunit.client.1.smithi134.stdout:2/927: dwrite d4/d12/d3b/d3f/f5d [0,4194304] 0 2024-03-12T16:10:55.712 INFO:tasks.workunit.client.0.smithi006.stdout:5/690: chown d7/d9/d47/fcc 33181741 1 2024-03-12T16:10:55.712 INFO:tasks.workunit.client.1.smithi134.stdout:7/961: readlink d8/dc/d4b/d97/l121 0 2024-03-12T16:10:55.718 INFO:tasks.workunit.client.0.smithi006.stdout:9/626: dwrite d0/d4/d3b/f4b [4194304,4194304] 0 2024-03-12T16:10:55.718 INFO:tasks.workunit.client.0.smithi006.stdout:5/691: read d7/d9/d10/f39 [2481750,113552] 0 2024-03-12T16:10:55.719 INFO:tasks.workunit.client.1.smithi134.stdout:2/928: rename d4/d84/d63/dde/fee to d4/d12/d3b/d3f/d114/f14d 0 2024-03-12T16:10:55.722 INFO:tasks.workunit.client.0.smithi006.stdout:5/692: mknod d7/d9/ce4 0 2024-03-12T16:10:55.723 INFO:tasks.workunit.client.1.smithi134.stdout:2/929: mknod d4/d84/d63/c14e 0 2024-03-12T16:10:55.726 INFO:tasks.workunit.client.0.smithi006.stdout:5/693: creat d7/d9/d31/d3b/d4f/d80/fe5 x:0 0 0 2024-03-12T16:10:55.727 INFO:tasks.workunit.client.0.smithi006.stdout:9/627: dwrite d0/d8/d16/d7d/db5/fb7 [0,4194304] 0 2024-03-12T16:10:55.731 INFO:tasks.workunit.client.1.smithi134.stdout:2/930: dread d4/d12/d1d/d34/d58/f75 [0,4194304] 0 2024-03-12T16:10:55.732 INFO:tasks.workunit.client.0.smithi006.stdout:5/694: rename d7/d9/fa1 to d7/d9/dbf/fe6 0 2024-03-12T16:10:55.735 INFO:tasks.workunit.client.1.smithi134.stdout:2/931: creat d4/d84/d63/d9d/d3d/de5/d143/f14f x:0 0 0 2024-03-12T16:10:55.738 INFO:tasks.workunit.client.1.smithi134.stdout:2/932: mkdir d4/d12/d43/da2/d150 0 2024-03-12T16:10:55.739 INFO:tasks.workunit.client.0.smithi006.stdout:7/853: sync 2024-03-12T16:10:55.740 INFO:tasks.workunit.client.1.smithi134.stdout:2/933: write d4/d12/d43/da2/d135/f9f [3651010,54682] 0 2024-03-12T16:10:55.741 INFO:tasks.workunit.client.0.smithi006.stdout:1/719: sync 2024-03-12T16:10:55.744 INFO:tasks.workunit.client.0.smithi006.stdout:9/628: write d0/f28 [1537257,74004] 0 2024-03-12T16:10:55.746 INFO:tasks.workunit.client.1.smithi134.stdout:7/962: truncate d8/dc/f54 2079795 0 2024-03-12T16:10:55.747 INFO:tasks.workunit.client.0.smithi006.stdout:9/629: symlink d0/d4/d70/d86/lc8 0 2024-03-12T16:10:55.748 INFO:tasks.workunit.client.1.smithi134.stdout:2/934: getdents d4/d12/d3b/d3f/d114 0 2024-03-12T16:10:55.748 INFO:tasks.workunit.client.0.smithi006.stdout:1/720: rename d0/d25/d2a/d35/dce to d0/d25/d2a/df8 0 2024-03-12T16:10:55.749 INFO:tasks.workunit.client.1.smithi134.stdout:7/963: rename d8/dc to d8/dc/d7b/dbb/d11b/d132 22 2024-03-12T16:10:55.752 INFO:tasks.workunit.client.0.smithi006.stdout:1/721: creat d0/d25/d67/dc1/ff9 x:0 0 0 2024-03-12T16:10:55.752 INFO:tasks.workunit.client.1.smithi134.stdout:8/940: dwrite d3/d1b/d17/d25/d33/f8b [0,4194304] 0 2024-03-12T16:10:55.756 INFO:tasks.workunit.client.0.smithi006.stdout:7/854: dwrite de/d1c/d87/fb3 [0,4194304] 0 2024-03-12T16:10:55.756 INFO:tasks.workunit.client.0.smithi006.stdout:1/722: unlink d0/d25/c81 0 2024-03-12T16:10:55.757 INFO:tasks.workunit.client.1.smithi134.stdout:2/935: getdents d4/d12 0 2024-03-12T16:10:55.757 INFO:tasks.workunit.client.1.smithi134.stdout:8/941: rmdir d3/d1b/d17/d24/db6/dd9/dd6 39 2024-03-12T16:10:55.757 INFO:tasks.workunit.client.1.smithi134.stdout:9/938: sync 2024-03-12T16:10:55.758 INFO:tasks.workunit.client.0.smithi006.stdout:9/630: write d0/d1f/f6d [4310331,129684] 0 2024-03-12T16:10:55.760 INFO:tasks.workunit.client.1.smithi134.stdout:9/939: readlink d5/d20/d72/l7d 0 2024-03-12T16:10:55.760 INFO:tasks.workunit.client.0.smithi006.stdout:1/723: fdatasync d0/d25/d2a/d35/f5c 0 2024-03-12T16:10:55.761 INFO:tasks.workunit.client.1.smithi134.stdout:2/936: creat d4/d84/d7d/d87/f151 x:0 0 0 2024-03-12T16:10:55.761 INFO:tasks.workunit.client.1.smithi134.stdout:8/942: mknod d3/d82/d13e/c145 0 2024-03-12T16:10:55.764 INFO:tasks.workunit.client.0.smithi006.stdout:9/631: creat d0/d8/d16/d7d/d20/d37/fc9 x:0 0 0 2024-03-12T16:10:55.766 INFO:tasks.workunit.client.0.smithi006.stdout:9/632: mkdir d0/d4/d3b/dca 0 2024-03-12T16:10:55.768 INFO:tasks.workunit.client.0.smithi006.stdout:9/633: chown d0/d4/d18/d4d/la8 16208496 1 2024-03-12T16:10:55.768 INFO:tasks.workunit.client.1.smithi134.stdout:2/937: creat d4/d84/d63/d9d/d3d/de5/d143/f152 x:0 0 0 2024-03-12T16:10:55.769 INFO:tasks.workunit.client.0.smithi006.stdout:1/724: chown d0/d25/d2a/d43/d63/db6/lc9 9448 1 2024-03-12T16:10:55.769 INFO:tasks.workunit.client.1.smithi134.stdout:8/943: truncate d3/db0/fbe 2409007 0 2024-03-12T16:10:55.771 INFO:tasks.workunit.client.0.smithi006.stdout:5/695: dread d7/d9/d10/d24/fa7 [0,4194304] 0 2024-03-12T16:10:55.772 INFO:tasks.workunit.client.1.smithi134.stdout:9/940: link d5/d10/d35/d49/d54/c68 d5/d10/d35/d49/d54/df7/c11b 0 2024-03-12T16:10:55.772 INFO:tasks.workunit.client.1.smithi134.stdout:2/938: creat d4/d84/d63/d9d/dba/f153 x:0 0 0 2024-03-12T16:10:55.774 INFO:tasks.workunit.client.1.smithi134.stdout:9/941: unlink d5/d10/d51/dad/f102 0 2024-03-12T16:10:55.774 INFO:tasks.workunit.client.0.smithi006.stdout:5/696: symlink d7/d9/d31/d3b/d4f/d80/le7 0 2024-03-12T16:10:55.776 INFO:tasks.workunit.client.0.smithi006.stdout:1/725: dread d0/d25/d2a/d35/f94 [0,4194304] 0 2024-03-12T16:10:55.777 INFO:tasks.workunit.client.0.smithi006.stdout:9/634: dwrite d0/d4/f29 [0,4194304] 0 2024-03-12T16:10:55.778 INFO:tasks.workunit.client.1.smithi134.stdout:7/964: write d8/dc/d20/f67 [9321472,64888] 0 2024-03-12T16:10:55.778 INFO:tasks.workunit.client.0.smithi006.stdout:5/697: symlink d7/d9/d31/d3b/dba/le8 0 2024-03-12T16:10:55.779 INFO:tasks.workunit.client.0.smithi006.stdout:9/635: chown d0/d4/d3b/dca 1334 1 2024-03-12T16:10:55.781 INFO:tasks.workunit.client.0.smithi006.stdout:5/698: truncate d7/d9/d47/faa 639353 0 2024-03-12T16:10:55.781 INFO:tasks.workunit.client.1.smithi134.stdout:9/942: rename d5/d10/d6c/fd9 to d5/d10/d35/d49/d54/de2/f11c 0 2024-03-12T16:10:55.782 INFO:tasks.workunit.client.0.smithi006.stdout:9/636: readlink d0/d8/d16/d7d/l60 0 2024-03-12T16:10:55.784 INFO:tasks.workunit.client.0.smithi006.stdout:5/699: creat d7/d9/d31/fe9 x:0 0 0 2024-03-12T16:10:55.784 INFO:tasks.workunit.client.1.smithi134.stdout:2/939: dread d4/d84/d7d/dbe/fc7 [0,4194304] 0 2024-03-12T16:10:55.787 INFO:tasks.workunit.client.0.smithi006.stdout:9/637: mkdir d0/d8/d16/d7d/d20/dcb 0 2024-03-12T16:10:55.787 INFO:tasks.workunit.client.1.smithi134.stdout:7/965: dwrite d8/dc/d55/d57/fc8 [4194304,4194304] 0 2024-03-12T16:10:55.788 INFO:tasks.workunit.client.1.smithi134.stdout:2/940: write d4/d12/d3b/d3f/f45 [2723008,51409] 0 2024-03-12T16:10:55.789 INFO:tasks.workunit.client.0.smithi006.stdout:1/726: rename d0/d25/d2a/d43/d63/l6a to d0/d25/d2a/d43/de0/lfa 0 2024-03-12T16:10:55.790 INFO:tasks.workunit.client.0.smithi006.stdout:5/700: mkdir d7/d9/d31/d3b/d4f/d80/dea 0 2024-03-12T16:10:55.795 INFO:tasks.workunit.client.1.smithi134.stdout:2/941: truncate d4/d12/d43/f8b 1721379 0 2024-03-12T16:10:55.796 INFO:tasks.workunit.client.1.smithi134.stdout:7/966: link d8/dc/d7b/dbb/d11b/c126 d8/dc/d55/df2/c133 0 2024-03-12T16:10:55.796 INFO:tasks.workunit.client.1.smithi134.stdout:2/942: readlink d4/d12/d1d/l2f 0 2024-03-12T16:10:55.797 INFO:tasks.workunit.client.1.smithi134.stdout:2/943: fsync d4/d84/f128 0 2024-03-12T16:10:55.797 INFO:tasks.workunit.client.0.smithi006.stdout:7/855: dwrite de/d2c/d4f/d83/fae [0,4194304] 0 2024-03-12T16:10:55.801 INFO:tasks.workunit.client.1.smithi134.stdout:9/943: write d5/d10/d35/d49/d54/d5e/f7e [654462,112459] 0 2024-03-12T16:10:55.803 INFO:tasks.workunit.client.0.smithi006.stdout:9/638: dwrite d0/d8/d16/f43 [0,4194304] 0 2024-03-12T16:10:55.804 INFO:tasks.workunit.client.1.smithi134.stdout:8/944: dread d3/d1b/d17/d25/d33/d96/dbd/f108 [0,4194304] 0 2024-03-12T16:10:55.806 INFO:tasks.workunit.client.0.smithi006.stdout:1/727: dwrite d0/d25/d2a/d43/d56/f7e [0,4194304] 0 2024-03-12T16:10:55.807 INFO:tasks.workunit.client.0.smithi006.stdout:5/701: rename d7/d9/d10/c60 to d7/d9/d31/d3b/d4f/ceb 0 2024-03-12T16:10:55.808 INFO:tasks.workunit.client.1.smithi134.stdout:2/944: dwrite d4/d84/d63/d9d/f4b [4194304,4194304] 0 2024-03-12T16:10:55.809 INFO:tasks.workunit.client.1.smithi134.stdout:9/944: rename d5/d20/d47 to d5/d10/d35/d49/d8d/d11d 0 2024-03-12T16:10:55.812 INFO:tasks.workunit.client.1.smithi134.stdout:8/945: creat d3/d82/d104/f146 x:0 0 0 2024-03-12T16:10:55.812 INFO:tasks.workunit.client.1.smithi134.stdout:2/945: chown d4/d12/d43/da2/d135 9 1 2024-03-12T16:10:55.812 INFO:tasks.workunit.client.0.smithi006.stdout:5/702: write d7/d9/d31/fa5 [46558,8331] 0 2024-03-12T16:10:55.812 INFO:tasks.workunit.client.0.smithi006.stdout:9/639: symlink d0/d4/da7/lcc 0 2024-03-12T16:10:55.812 INFO:tasks.workunit.client.0.smithi006.stdout:5/703: chown d7/d41/fc6 2 1 2024-03-12T16:10:55.814 INFO:tasks.workunit.client.0.smithi006.stdout:1/728: symlink d0/d25/d2a/lfb 0 2024-03-12T16:10:55.814 INFO:tasks.workunit.client.1.smithi134.stdout:9/945: chown d5/d10/d35/d49/d8d/d11d/fe3 25 1 2024-03-12T16:10:55.816 INFO:tasks.workunit.client.1.smithi134.stdout:2/946: readlink d4/d12/d43/da2/d135/l68 0 2024-03-12T16:10:55.818 INFO:tasks.workunit.client.1.smithi134.stdout:8/946: fsync d3/d82/d104/d31/ff7 0 2024-03-12T16:10:55.818 INFO:tasks.workunit.client.1.smithi134.stdout:9/946: mkdir d5/d10/d35/d49/d74/d11e 0 2024-03-12T16:10:55.819 INFO:tasks.workunit.client.1.smithi134.stdout:2/947: truncate d4/f1f 2706672 0 2024-03-12T16:10:55.822 INFO:tasks.workunit.client.1.smithi134.stdout:8/947: mknod d3/d82/d104/c147 0 2024-03-12T16:10:55.824 INFO:tasks.workunit.client.1.smithi134.stdout:9/947: mkdir d5/d10/d35/d49/d8d/d11d/d103/d11f 0 2024-03-12T16:10:55.827 INFO:tasks.workunit.client.1.smithi134.stdout:2/948: dwrite d4/f90 [0,4194304] 0 2024-03-12T16:10:55.827 INFO:tasks.workunit.client.1.smithi134.stdout:7/967: dread d8/dc/d20/d26/d36/f60 [0,4194304] 0 2024-03-12T16:10:55.829 INFO:tasks.workunit.client.1.smithi134.stdout:8/948: mkdir d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/d148 0 2024-03-12T16:10:55.829 INFO:tasks.workunit.client.1.smithi134.stdout:2/949: read - d4/d84/d63/d9d/d3d/de5/d143/f152 zero size 2024-03-12T16:10:55.832 INFO:tasks.workunit.client.1.smithi134.stdout:7/968: creat d8/d4e/d91/f134 x:0 0 0 2024-03-12T16:10:55.832 INFO:tasks.workunit.client.1.smithi134.stdout:2/950: creat d4/d84/d63/dde/df0/f154 x:0 0 0 2024-03-12T16:10:55.835 INFO:tasks.workunit.client.1.smithi134.stdout:8/949: truncate d3/d1b/d17/d3f/fef 342777 0 2024-03-12T16:10:55.838 INFO:tasks.workunit.client.1.smithi134.stdout:7/969: link d8/dc/d20/l23 d8/dc/l135 0 2024-03-12T16:10:55.841 INFO:tasks.workunit.client.1.smithi134.stdout:7/970: creat d8/dc/d7b/dbb/dbd/dd5/f136 x:0 0 0 2024-03-12T16:10:55.842 INFO:tasks.workunit.client.1.smithi134.stdout:7/971: rename d8/d27/d9d to d8/d27/d9d/dc9/d137 22 2024-03-12T16:10:55.869 INFO:tasks.workunit.client.0.smithi006.stdout:3/642: sync 2024-03-12T16:10:55.869 INFO:tasks.workunit.client.0.smithi006.stdout:6/755: sync 2024-03-12T16:10:55.869 INFO:tasks.workunit.client.0.smithi006.stdout:2/748: sync 2024-03-12T16:10:55.872 INFO:tasks.workunit.client.0.smithi006.stdout:5/704: read d7/d9/f30 [2642105,15784] 0 2024-03-12T16:10:55.875 INFO:tasks.workunit.client.1.smithi134.stdout:2/951: read d4/d12/d1d/d34/d58/d74/fb0 [1282150,12304] 0 2024-03-12T16:10:55.877 INFO:tasks.workunit.client.1.smithi134.stdout:2/952: rmdir d4/d12/d3b/d3f/d114/d117 39 2024-03-12T16:10:55.877 INFO:tasks.workunit.client.1.smithi134.stdout:2/953: dread - d4/de8/dea/d105/f11b zero size 2024-03-12T16:10:55.879 INFO:tasks.workunit.client.0.smithi006.stdout:5/705: chown d7/d9/d31/d3b/d4f/d65/fc5 19727010 1 2024-03-12T16:10:55.879 INFO:tasks.workunit.client.0.smithi006.stdout:2/749: unlink d0/d13/l57 0 2024-03-12T16:10:55.882 INFO:tasks.workunit.client.0.smithi006.stdout:9/640: getdents d0/d8/d16/d7d 0 2024-03-12T16:10:55.882 INFO:tasks.workunit.client.0.smithi006.stdout:6/756: link d3/c7d d3/d11/d10/d1b/d6e/d96/c113 0 2024-03-12T16:10:55.882 INFO:tasks.workunit.client.0.smithi006.stdout:5/706: fdatasync d7/d9/d10/d24/fca 0 2024-03-12T16:10:55.882 INFO:tasks.workunit.client.0.smithi006.stdout:1/729: dwrite d0/d25/d2a/d43/f92 [0,4194304] 0 2024-03-12T16:10:55.883 INFO:tasks.workunit.client.0.smithi006.stdout:3/643: getdents d8/d4c 0 2024-03-12T16:10:55.885 INFO:tasks.workunit.client.0.smithi006.stdout:2/750: fsync d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fc7 0 2024-03-12T16:10:55.894 INFO:tasks.workunit.client.0.smithi006.stdout:1/730: mkdir d0/d25/d2a/d35/d3f/dfc 0 2024-03-12T16:10:55.894 INFO:tasks.workunit.client.0.smithi006.stdout:3/644: creat d8/d19/d26/d97/dce/fdb x:0 0 0 2024-03-12T16:10:55.897 INFO:tasks.workunit.client.0.smithi006.stdout:1/731: readlink d0/d25/d2a/d43/d63/l8e 0 2024-03-12T16:10:55.897 INFO:tasks.workunit.client.0.smithi006.stdout:5/707: dwrite d7/d9/d31/d3b/d61/f9c [0,4194304] 0 2024-03-12T16:10:55.902 INFO:tasks.workunit.client.0.smithi006.stdout:5/708: unlink d7/d9/d31/d3b/d4f/l84 0 2024-03-12T16:10:55.905 INFO:tasks.workunit.client.0.smithi006.stdout:5/709: read d7/d9/d47/fd8 [266270,17206] 0 2024-03-12T16:10:55.906 INFO:tasks.workunit.client.0.smithi006.stdout:1/732: getdents d0/d25/d2a/d43/d63 0 2024-03-12T16:10:55.910 INFO:tasks.workunit.client.0.smithi006.stdout:1/733: creat d0/d25/d2a/d35/ffd x:0 0 0 2024-03-12T16:10:55.914 INFO:tasks.workunit.client.1.smithi134.stdout:8/950: truncate d3/d1b/d17/d25/d33/d15/d95/d5b/f8e 977015 0 2024-03-12T16:10:55.917 INFO:tasks.workunit.client.0.smithi006.stdout:1/734: truncate d0/d25/d2a/d35/d3f/f61 8178487 0 2024-03-12T16:10:55.919 INFO:tasks.workunit.client.0.smithi006.stdout:5/710: rename d7/d41/f55 to d7/d9/d31/d3b/d4f/fec 0 2024-03-12T16:10:55.920 INFO:tasks.workunit.client.1.smithi134.stdout:7/972: dwrite d8/dc/d20/f56 [0,4194304] 0 2024-03-12T16:10:55.921 INFO:tasks.workunit.client.0.smithi006.stdout:2/751: write d0/d13/d49/f73 [520619,120184] 0 2024-03-12T16:10:55.922 INFO:tasks.workunit.client.0.smithi006.stdout:1/735: symlink d0/d25/d2a/d43/d63/db6/lfe 0 2024-03-12T16:10:55.922 INFO:tasks.workunit.client.1.smithi134.stdout:8/951: dread d3/d1b/d17/d25/d33/f34 [0,4194304] 0 2024-03-12T16:10:55.923 INFO:tasks.workunit.client.0.smithi006.stdout:5/711: fsync d7/d9/d10/fae 0 2024-03-12T16:10:55.923 INFO:tasks.workunit.client.1.smithi134.stdout:2/954: dwrite d4/d12/d43/fda [0,4194304] 0 2024-03-12T16:10:55.924 INFO:tasks.workunit.client.0.smithi006.stdout:5/712: fsync d7/d9/d10/d24/fb2 0 2024-03-12T16:10:55.925 INFO:tasks.workunit.client.0.smithi006.stdout:2/752: creat d0/d13/d49/d60/d2b/d62/d79/fe4 x:0 0 0 2024-03-12T16:10:55.926 INFO:tasks.workunit.client.0.smithi006.stdout:6/757: truncate d3/d11/d10/da7/d8e/de1/d60/f61 1702043 0 2024-03-12T16:10:55.928 INFO:tasks.workunit.client.1.smithi134.stdout:7/973: mkdir d8/d4e/d91/da1/d138 0 2024-03-12T16:10:55.928 INFO:tasks.workunit.client.0.smithi006.stdout:9/641: truncate d0/d8/d16/d7d/d20/d37/f5c 3469748 0 2024-03-12T16:10:55.930 INFO:tasks.workunit.client.0.smithi006.stdout:5/713: rename d7/d9/dbf to d7/d9/d31/ded 0 2024-03-12T16:10:55.931 INFO:tasks.workunit.client.1.smithi134.stdout:8/952: creat d3/d1b/d17/d25/d33/d15/d95/d4f/d65/f149 x:0 0 0 2024-03-12T16:10:55.932 INFO:tasks.workunit.client.1.smithi134.stdout:2/955: creat d4/d12/d1d/d34/d47/f155 x:0 0 0 2024-03-12T16:10:55.932 INFO:tasks.workunit.client.0.smithi006.stdout:1/736: creat d0/d25/d2a/fff x:0 0 0 2024-03-12T16:10:55.934 INFO:tasks.workunit.client.0.smithi006.stdout:9/642: fsync d0/d4/da7/fc4 0 2024-03-12T16:10:55.935 INFO:tasks.workunit.client.1.smithi134.stdout:8/953: symlink d3/d1b/d17/d24/d28/l14a 0 2024-03-12T16:10:55.936 INFO:tasks.workunit.client.1.smithi134.stdout:2/956: truncate d4/d12/d3b/d3f/d10a/f12f 185396 0 2024-03-12T16:10:55.936 INFO:tasks.workunit.client.0.smithi006.stdout:2/753: symlink d0/dc/d64/le5 0 2024-03-12T16:10:55.937 INFO:tasks.workunit.client.0.smithi006.stdout:1/737: chown d0/d25/d2a/d43/d63/f7b 133137 1 2024-03-12T16:10:55.938 INFO:tasks.workunit.client.1.smithi134.stdout:8/954: chown d3/d1b/d17/d25/d33/d96/dbd/d112/lf5 821165 1 2024-03-12T16:10:55.938 INFO:tasks.workunit.client.0.smithi006.stdout:6/758: symlink d3/d11/d10/l114 0 2024-03-12T16:10:55.939 INFO:tasks.workunit.client.1.smithi134.stdout:2/957: chown d4/d84/d63/d9d/d3d/d71/lc9 0 1 2024-03-12T16:10:55.939 INFO:tasks.workunit.client.1.smithi134.stdout:8/955: chown d3/d1b/d17/d25/d33/f11d 1340 1 2024-03-12T16:10:55.940 INFO:tasks.workunit.client.1.smithi134.stdout:8/956: readlink d3/d1b/d17/l130 0 2024-03-12T16:10:55.942 INFO:tasks.workunit.client.1.smithi134.stdout:2/958: symlink d4/d12/d1d/d34/d58/d74/l156 0 2024-03-12T16:10:55.944 INFO:tasks.workunit.client.1.smithi134.stdout:8/957: chown d3/d1b/d17/d25/d33/d15/d95/d4f/c12c 2002227627 1 2024-03-12T16:10:55.945 INFO:tasks.workunit.client.0.smithi006.stdout:5/714: dread d7/d9/d31/d3b/f3f [0,4194304] 0 2024-03-12T16:10:55.945 INFO:tasks.workunit.client.0.smithi006.stdout:3/645: dwrite d8/d19/f4f [4194304,4194304] 0 2024-03-12T16:10:55.947 INFO:tasks.workunit.client.0.smithi006.stdout:9/643: rename d0/d8/d16/d7d/d20/f51 to d0/d8/d16/d7d/d20/d37/fcd 0 2024-03-12T16:10:55.949 INFO:tasks.workunit.client.1.smithi134.stdout:7/974: dwrite d8/dc/d55/fa6 [0,4194304] 0 2024-03-12T16:10:55.950 INFO:tasks.workunit.client.1.smithi134.stdout:8/958: symlink d3/d1b/d17/d25/d33/d15/d95/d5b/d125/l14b 0 2024-03-12T16:10:55.951 INFO:tasks.workunit.client.1.smithi134.stdout:8/959: readlink d3/d1b/d17/d24/d28/d102/l11e 0 2024-03-12T16:10:55.953 INFO:tasks.workunit.client.0.smithi006.stdout:6/759: creat d3/d11/d10/d1b/d6e/f115 x:0 0 0 2024-03-12T16:10:55.953 INFO:tasks.workunit.client.0.smithi006.stdout:2/754: dwrite d0/d13/d49/d60/d2b/f8e [0,4194304] 0 2024-03-12T16:10:55.955 INFO:tasks.workunit.client.1.smithi134.stdout:7/975: fdatasync d8/dc/d55/d57/f7e 0 2024-03-12T16:10:55.956 INFO:tasks.workunit.client.1.smithi134.stdout:7/976: stat d8/d4e/dca 0 2024-03-12T16:10:55.956 INFO:tasks.workunit.client.0.smithi006.stdout:5/715: mkdir d7/d9/d47/d56/d79/dee 0 2024-03-12T16:10:55.961 INFO:tasks.workunit.client.0.smithi006.stdout:3/646: truncate d8/d19/d26/d59/d2c/dc/f3a 2134959 0 2024-03-12T16:10:55.964 INFO:tasks.workunit.client.0.smithi006.stdout:2/755: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/db4/fe6 x:0 0 0 2024-03-12T16:10:55.966 INFO:tasks.workunit.client.0.smithi006.stdout:2/756: chown d0/d13/d49/d60/d2b/d62/d66/cae 54294618 1 2024-03-12T16:10:55.966 INFO:tasks.workunit.client.0.smithi006.stdout:2/757: readlink d0/d13/d49/d60/l37 0 2024-03-12T16:10:55.968 INFO:tasks.workunit.client.1.smithi134.stdout:2/959: dwrite d4/d12/d1d/d34/d58/f7c [0,4194304] 0 2024-03-12T16:10:55.972 INFO:tasks.workunit.client.0.smithi006.stdout:0/747: sync 2024-03-12T16:10:55.972 INFO:tasks.workunit.client.0.smithi006.stdout:8/678: sync 2024-03-12T16:10:55.972 INFO:tasks.workunit.client.0.smithi006.stdout:4/790: sync 2024-03-12T16:10:55.973 INFO:tasks.workunit.client.0.smithi006.stdout:5/716: fsync d7/d9/d10/d35/fb1 0 2024-03-12T16:10:55.974 INFO:tasks.workunit.client.1.smithi134.stdout:2/960: truncate d4/d84/d63/d9d/d3d/f64 4856362 0 2024-03-12T16:10:55.974 INFO:tasks.workunit.client.0.smithi006.stdout:9/644: link d0/d4/d18/d4d/l78 d0/d8/d16/d7d/db5/lce 0 2024-03-12T16:10:55.975 INFO:tasks.workunit.client.1.smithi134.stdout:2/961: symlink d4/d84/d63/d9d/dba/l157 0 2024-03-12T16:10:55.975 INFO:tasks.workunit.client.1.smithi134.stdout:2/962: stat d4/d12/daf 0 2024-03-12T16:10:55.976 INFO:tasks.workunit.client.1.smithi134.stdout:2/963: write d4/d84/f36 [4845480,9796] 0 2024-03-12T16:10:55.977 INFO:tasks.workunit.client.0.smithi006.stdout:3/647: mkdir d8/ddc 0 2024-03-12T16:10:55.979 INFO:tasks.workunit.client.0.smithi006.stdout:1/738: write d0/d25/d2a/d35/db3/fbb [315805,125071] 0 2024-03-12T16:10:55.980 INFO:tasks.workunit.client.0.smithi006.stdout:5/717: write d7/d9/d31/d3b/d61/f9b [1981,88152] 0 2024-03-12T16:10:55.980 INFO:tasks.workunit.client.1.smithi134.stdout:0/973: sync 2024-03-12T16:10:55.981 INFO:tasks.workunit.client.1.smithi134.stdout:2/964: read d4/d12/d3b/f115 [1023628,107689] 0 2024-03-12T16:10:55.983 INFO:tasks.workunit.client.1.smithi134.stdout:2/965: readlink d4/d84/l109 0 2024-03-12T16:10:55.984 INFO:tasks.workunit.client.0.smithi006.stdout:3/648: dread - d8/d19/d26/d59/d2c/d41/d8b/d93/fd7 zero size 2024-03-12T16:10:55.985 INFO:tasks.workunit.client.1.smithi134.stdout:0/974: unlink db/d2f/d71/f9e 0 2024-03-12T16:10:55.985 INFO:tasks.workunit.client.1.smithi134.stdout:2/966: chown d4/d12/d1d/d34/fa0 54767907 1 2024-03-12T16:10:55.986 INFO:tasks.workunit.client.0.smithi006.stdout:0/748: dwrite f0 [0,4194304] 0 2024-03-12T16:10:55.989 INFO:tasks.workunit.client.1.smithi134.stdout:2/967: rename d4/d12/d1d/f97 to d4/d12/d1d/d34/d47/d8c/da4/f158 0 2024-03-12T16:10:55.989 INFO:tasks.workunit.client.0.smithi006.stdout:4/791: mknod d1/db/d39/d42/df2/df7/c106 0 2024-03-12T16:10:55.990 INFO:tasks.workunit.client.0.smithi006.stdout:5/718: rmdir d7/d9/d31/d3b/d4f/d9e 39 2024-03-12T16:10:55.992 INFO:tasks.workunit.client.1.smithi134.stdout:8/960: dread d3/d1b/d17/d3f/faf [0,4194304] 0 2024-03-12T16:10:55.992 INFO:tasks.workunit.client.0.smithi006.stdout:1/739: creat d0/d25/d2a/d35/d3f/f100 x:0 0 0 2024-03-12T16:10:55.994 INFO:tasks.workunit.client.0.smithi006.stdout:1/740: chown d0/d25/d2a/d43/d68/l95 1 1 2024-03-12T16:10:55.994 INFO:tasks.workunit.client.0.smithi006.stdout:1/741: chown d0/d25/d2a/d35 2364573 1 2024-03-12T16:10:55.995 INFO:tasks.workunit.client.0.smithi006.stdout:8/679: creat d2/d11/fdf x:0 0 0 2024-03-12T16:10:55.996 INFO:tasks.workunit.client.0.smithi006.stdout:8/680: stat d2/db/d1a/d7a 0 2024-03-12T16:10:55.997 INFO:tasks.workunit.client.0.smithi006.stdout:3/649: mknod d8/d19/d26/d59/d2c/dc/cdd 0 2024-03-12T16:10:56.000 INFO:tasks.workunit.client.0.smithi006.stdout:4/792: mknod d1/db/d39/dbf/c107 0 2024-03-12T16:10:56.002 INFO:tasks.workunit.client.1.smithi134.stdout:8/961: write d3/d82/d104/d31/d9b/ffe [206768,25159] 0 2024-03-12T16:10:56.002 INFO:tasks.workunit.client.0.smithi006.stdout:6/760: truncate d3/fcd 881761 0 2024-03-12T16:10:56.006 INFO:tasks.workunit.client.1.smithi134.stdout:2/968: dwrite d4/d12/d1d/d34/db7/feb [0,4194304] 0 2024-03-12T16:10:56.006 INFO:tasks.workunit.client.1.smithi134.stdout:8/962: write d3/d1b/d17/d25/d33/d15/d95/d6d/dc5/f118 [276986,38542] 0 2024-03-12T16:10:56.008 INFO:tasks.workunit.client.1.smithi134.stdout:2/969: write d4/d12/daf/f10b [392889,14778] 0 2024-03-12T16:10:56.009 INFO:tasks.workunit.client.0.smithi006.stdout:1/742: mknod d0/d25/d2a/d35/c101 0 2024-03-12T16:10:56.009 INFO:tasks.workunit.client.0.smithi006.stdout:8/681: rmdir d2/db/d1a/d21/d2b/da2 39 2024-03-12T16:10:56.009 INFO:tasks.workunit.client.0.smithi006.stdout:8/682: write d2/db/fb1 [1013003,831] 0 2024-03-12T16:10:56.010 INFO:tasks.workunit.client.1.smithi134.stdout:8/963: mknod d3/d1b/d17/d25/c14c 0 2024-03-12T16:10:56.014 INFO:tasks.workunit.client.1.smithi134.stdout:8/964: truncate d3/d1b/d17/d25/d33/d15/d95/d6d/dc5/f136 251760 0 2024-03-12T16:10:56.015 INFO:tasks.workunit.client.1.smithi134.stdout:2/970: dread d4/d84/f35 [0,4194304] 0 2024-03-12T16:10:56.016 INFO:tasks.workunit.client.1.smithi134.stdout:2/971: readlink d4/d84/d63/d9d/d3d/d71/l14c 0 2024-03-12T16:10:56.019 INFO:tasks.workunit.client.1.smithi134.stdout:2/972: write d4/d12/d1d/f21 [3345608,113217] 0 2024-03-12T16:10:56.020 INFO:tasks.workunit.client.0.smithi006.stdout:1/743: fdatasync d0/f3e 0 2024-03-12T16:10:56.020 INFO:tasks.workunit.client.0.smithi006.stdout:1/744: readlink d0/d25/d67/d8d/laf 0 2024-03-12T16:10:56.020 INFO:tasks.workunit.client.0.smithi006.stdout:2/758: truncate d0/f45 2897963 0 2024-03-12T16:10:56.021 INFO:tasks.workunit.client.0.smithi006.stdout:9/645: dwrite d0/d4/d18/f44 [0,4194304] 0 2024-03-12T16:10:56.021 INFO:tasks.workunit.client.0.smithi006.stdout:3/650: link d8/d19/d26/d59/d2c/d41/lc1 d8/d19/d47/lde 0 2024-03-12T16:10:56.022 INFO:tasks.workunit.client.1.smithi134.stdout:8/965: dwrite d3/d1b/d17/d24/db6/f109 [0,4194304] 0 2024-03-12T16:10:56.024 INFO:tasks.workunit.client.1.smithi134.stdout:2/973: mkdir d4/d84/d63/d9d/d3d/de5/d159 0 2024-03-12T16:10:56.025 INFO:tasks.workunit.client.1.smithi134.stdout:8/966: symlink d3/d1b/d17/d25/d33/d132/d135/l14d 0 2024-03-12T16:10:56.026 INFO:tasks.workunit.client.0.smithi006.stdout:4/793: getdents d1/db/d39/dbf/dec/d43/db5/da5 0 2024-03-12T16:10:56.027 INFO:tasks.workunit.client.0.smithi006.stdout:2/759: stat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/cd6 0 2024-03-12T16:10:56.028 INFO:tasks.workunit.client.0.smithi006.stdout:0/749: write d2/d6/d10/d11/d1d/d79/f7f [4684403,26128] 0 2024-03-12T16:10:56.030 INFO:tasks.workunit.client.1.smithi134.stdout:2/974: mkdir d4/d12/d3b/d9b/d14b/d15a 0 2024-03-12T16:10:56.031 INFO:tasks.workunit.client.1.smithi134.stdout:8/967: creat d3/d82/d13e/f14e x:0 0 0 2024-03-12T16:10:56.031 INFO:tasks.workunit.client.0.smithi006.stdout:2/760: readlink d0/dc/d64/ldf 0 2024-03-12T16:10:56.036 INFO:tasks.workunit.client.0.smithi006.stdout:1/745: dwrite d0/d25/d2a/d43/d63/db6/fdc [0,4194304] 0 2024-03-12T16:10:56.037 INFO:tasks.workunit.client.1.smithi134.stdout:2/975: read d4/d12/d1d/d34/d47/d8c/da4/fdb [1759846,67] 0 2024-03-12T16:10:56.038 INFO:tasks.workunit.client.0.smithi006.stdout:4/794: creat d1/db/d1d/d2f/f108 x:0 0 0 2024-03-12T16:10:56.038 INFO:tasks.workunit.client.0.smithi006.stdout:0/750: write d2/d39/f40 [1677357,25544] 0 2024-03-12T16:10:56.040 INFO:tasks.workunit.client.0.smithi006.stdout:2/761: mkdir d0/de7 0 2024-03-12T16:10:56.044 INFO:tasks.workunit.client.0.smithi006.stdout:8/683: dread d2/db/d1a/d1f/f31 [0,4194304] 0 2024-03-12T16:10:56.045 INFO:tasks.workunit.client.0.smithi006.stdout:3/651: dwrite d8/d19/d26/d97/dce/fc0 [0,4194304] 0 2024-03-12T16:10:56.045 INFO:tasks.workunit.client.1.smithi134.stdout:2/976: dwrite d4/de8/dea/df5/f138 [0,4194304] 0 2024-03-12T16:10:56.047 INFO:tasks.workunit.client.0.smithi006.stdout:1/746: truncate d0/d25/f36 4748300 0 2024-03-12T16:10:56.049 INFO:tasks.workunit.client.1.smithi134.stdout:2/977: write d4/d84/d63/d9d/f94 [930258,129784] 0 2024-03-12T16:10:56.050 INFO:tasks.workunit.client.0.smithi006.stdout:9/646: dread d0/d8/d16/d7d/d20/f61 [0,4194304] 0 2024-03-12T16:10:56.052 INFO:tasks.workunit.client.0.smithi006.stdout:3/652: mknod d8/d52/d9e/dba/cdf 0 2024-03-12T16:10:56.055 INFO:tasks.workunit.client.1.smithi134.stdout:2/978: getdents d4/d84/d63/dde/df0 0 2024-03-12T16:10:56.055 INFO:tasks.workunit.client.0.smithi006.stdout:0/751: creat d2/d6/d10/d11/d1d/ff2 x:0 0 0 2024-03-12T16:10:56.058 INFO:tasks.workunit.client.0.smithi006.stdout:8/684: rename d2/d11/l53 to d2/db/le0 0 2024-03-12T16:10:56.060 INFO:tasks.workunit.client.1.smithi134.stdout:2/979: link d4/c9 d4/d12/d1d/d34/d58/dbb/c15b 0 2024-03-12T16:10:56.061 INFO:tasks.workunit.client.0.smithi006.stdout:9/647: mkdir d0/d8/d16/d7d/d20/d37/dc5/dcf 0 2024-03-12T16:10:56.063 INFO:tasks.workunit.client.0.smithi006.stdout:0/752: mknod d2/d6/d10/ddd/cf3 0 2024-03-12T16:10:56.063 INFO:tasks.workunit.client.1.smithi134.stdout:2/980: creat d4/d12/f15c x:0 0 0 2024-03-12T16:10:56.066 INFO:tasks.workunit.client.1.smithi134.stdout:2/981: unlink d4/d84/c33 0 2024-03-12T16:10:56.067 INFO:tasks.workunit.client.0.smithi006.stdout:6/761: truncate d3/d11/d3b/db4/dc3/ff0 2663085 0 2024-03-12T16:10:56.067 INFO:tasks.workunit.client.0.smithi006.stdout:0/753: readlink d2/d6/d10/d11/d32/l47 0 2024-03-12T16:10:56.068 INFO:tasks.workunit.client.1.smithi134.stdout:2/982: write d4/d84/d63/d9d/dba/f153 [282230,103362] 0 2024-03-12T16:10:56.070 INFO:tasks.workunit.client.0.smithi006.stdout:9/648: rename d0/d83/d90/dc0/fc1 to d0/d4/d18/d4d/fd0 0 2024-03-12T16:10:56.073 INFO:tasks.workunit.client.0.smithi006.stdout:3/653: getdents d8/d19/d26/d59/d2c/dc/d28 0 2024-03-12T16:10:56.074 INFO:tasks.workunit.client.0.smithi006.stdout:6/762: truncate d3/d11/d10/da7/d9e/fa0 63336 0 2024-03-12T16:10:56.077 INFO:tasks.workunit.client.0.smithi006.stdout:9/649: dread - d0/d8/d16/d2f/fa5 zero size 2024-03-12T16:10:56.078 INFO:tasks.workunit.client.0.smithi006.stdout:1/747: write d0/d25/d2a/d35/d3f/f45 [579562,14445] 0 2024-03-12T16:10:56.078 INFO:tasks.workunit.client.1.smithi134.stdout:2/983: link d4/de8/dea/l11a d4/d12/d1d/d34/d47/df1/l15d 0 2024-03-12T16:10:56.080 INFO:tasks.workunit.client.0.smithi006.stdout:1/748: readlink d0/d25/l66 0 2024-03-12T16:10:56.081 INFO:tasks.workunit.client.0.smithi006.stdout:8/685: readlink d2/db/le0 0 2024-03-12T16:10:56.082 INFO:tasks.workunit.client.1.smithi134.stdout:2/984: dread d4/d84/d63/d9d/d3d/f64 [4194304,4194304] 0 2024-03-12T16:10:56.083 INFO:tasks.workunit.client.0.smithi006.stdout:0/754: dwrite d2/d6/d37/d97/ff1 [0,4194304] 0 2024-03-12T16:10:56.085 INFO:tasks.workunit.client.0.smithi006.stdout:4/795: dread d1/db/f3c [0,4194304] 0 2024-03-12T16:10:56.085 INFO:tasks.workunit.client.1.smithi134.stdout:2/985: symlink d4/d84/d63/d9d/d3d/de5/d159/l15e 0 2024-03-12T16:10:56.089 INFO:tasks.workunit.client.0.smithi006.stdout:9/650: unlink d0/d4/d70/d71/f9c 0 2024-03-12T16:10:56.090 INFO:tasks.workunit.client.1.smithi134.stdout:2/986: getdents d4/d12/d3b/d9b 0 2024-03-12T16:10:56.094 INFO:tasks.workunit.client.0.smithi006.stdout:1/749: mkdir d0/d25/d2a/d43/d63/d102 0 2024-03-12T16:10:56.095 INFO:tasks.workunit.client.1.smithi134.stdout:2/987: unlink d4/d84/d7d/d87/f151 0 2024-03-12T16:10:56.097 INFO:tasks.workunit.client.0.smithi006.stdout:3/654: write d8/d19/d31/fca [813416,44686] 0 2024-03-12T16:10:56.097 INFO:tasks.workunit.client.1.smithi134.stdout:2/988: mknod d4/de8/dea/d105/c15f 0 2024-03-12T16:10:56.100 INFO:tasks.workunit.client.0.smithi006.stdout:0/755: mkdir d2/d39/d42/df4 0 2024-03-12T16:10:56.100 INFO:tasks.workunit.client.0.smithi006.stdout:1/750: truncate d0/d25/f32 515858 0 2024-03-12T16:10:56.100 INFO:tasks.workunit.client.1.smithi134.stdout:2/989: creat d4/d12/d1d/d34/db7/dc4/f160 x:0 0 0 2024-03-12T16:10:56.102 INFO:tasks.workunit.client.0.smithi006.stdout:9/651: rename d0/d4/c1b to d0/d4/d18/d4d/cd1 0 2024-03-12T16:10:56.103 INFO:tasks.workunit.client.1.smithi134.stdout:2/990: creat d4/d12/d43/dec/f161 x:0 0 0 2024-03-12T16:10:56.104 INFO:tasks.workunit.client.0.smithi006.stdout:0/756: mknod d2/d6/d10/d11/d7e/da6/d9e/cf5 0 2024-03-12T16:10:56.104 INFO:tasks.workunit.client.1.smithi134.stdout:2/991: symlink d4/d12/d1d/d34/d47/d8c/l162 0 2024-03-12T16:10:56.106 INFO:tasks.workunit.client.0.smithi006.stdout:3/655: rename d8/d19/d26/d59/d2c/dc/d28/f74 to d8/d19/d31/dc4/fe0 0 2024-03-12T16:10:56.106 INFO:tasks.workunit.client.1.smithi134.stdout:2/992: rename d4/c17 to d4/d84/d7d/d87/c163 0 2024-03-12T16:10:56.108 INFO:tasks.workunit.client.0.smithi006.stdout:9/652: symlink d0/d8/d16/d2f/ld2 0 2024-03-12T16:10:56.109 INFO:tasks.workunit.client.1.smithi134.stdout:2/993: unlink d4/d12/d1d/d34/d58/l6a 0 2024-03-12T16:10:56.109 INFO:tasks.workunit.client.0.smithi006.stdout:8/686: write d2/db/d1a/d21/d8a/f9a [978367,27056] 0 2024-03-12T16:10:56.110 INFO:tasks.workunit.client.1.smithi134.stdout:2/994: rmdir d4/d12/d43/da2 39 2024-03-12T16:10:56.110 INFO:tasks.workunit.client.1.smithi134.stdout:1/673: sync 2024-03-12T16:10:56.112 INFO:tasks.workunit.client.0.smithi006.stdout:7/856: sync 2024-03-12T16:10:56.112 INFO:tasks.workunit.client.0.smithi006.stdout:4/796: write d1/d38/f4f [796307,27218] 0 2024-03-12T16:10:56.113 INFO:tasks.workunit.client.0.smithi006.stdout:0/757: unlink d2/d6/d10/d11/d7e/fa5 0 2024-03-12T16:10:56.113 INFO:tasks.workunit.client.0.smithi006.stdout:9/653: fsync d0/d8/d16/d7d/db5/fa3 0 2024-03-12T16:10:56.114 INFO:tasks.workunit.client.1.smithi134.stdout:2/995: link d4/f90 d4/d12/d1d/d34/d47/f164 0 2024-03-12T16:10:56.115 INFO:tasks.workunit.client.0.smithi006.stdout:6/763: dwrite d3/d11/d10/d1b/d20/f68 [0,4194304] 0 2024-03-12T16:10:56.116 INFO:tasks.workunit.client.0.smithi006.stdout:1/751: dwrite d0/d25/d2a/d35/db3/fee [0,4194304] 0 2024-03-12T16:10:56.117 INFO:tasks.workunit.client.1.smithi134.stdout:2/996: rmdir d4/d84/d63/d9d/d3d/de5 39 2024-03-12T16:10:56.121 INFO:tasks.workunit.client.0.smithi006.stdout:8/687: truncate d2/d55/d7b/fc0 496219 0 2024-03-12T16:10:56.123 INFO:tasks.workunit.client.0.smithi006.stdout:6/764: write d3/d11/d10/da7/f88 [1911279,93460] 0 2024-03-12T16:10:56.123 INFO:tasks.workunit.client.0.smithi006.stdout:3/656: dread d8/d19/fa7 [0,4194304] 0 2024-03-12T16:10:56.124 INFO:tasks.workunit.client.0.smithi006.stdout:4/797: mknod d1/db/d39/d42/df2/df7/c109 0 2024-03-12T16:10:56.125 INFO:tasks.workunit.client.0.smithi006.stdout:3/657: chown d8/d4c/f65 2 1 2024-03-12T16:10:56.125 INFO:tasks.workunit.client.0.smithi006.stdout:7/857: symlink de/d1c/de9/l121 0 2024-03-12T16:10:56.126 INFO:tasks.workunit.client.0.smithi006.stdout:6/765: fsync d3/d11/d10/d1b/d6e/db1/fb5 0 2024-03-12T16:10:56.127 INFO:tasks.workunit.client.0.smithi006.stdout:3/658: readlink d8/d52/l7b 0 2024-03-12T16:10:56.128 INFO:tasks.workunit.client.0.smithi006.stdout:6/766: write d3/d11/d3b/fed [837078,117162] 0 2024-03-12T16:10:56.129 INFO:tasks.workunit.client.1.smithi134.stdout:2/997: link d4/d12/d1d/d34/d47/d8c/d100/l130 d4/d12/daf/l165 0 2024-03-12T16:10:56.131 INFO:tasks.workunit.client.0.smithi006.stdout:9/654: symlink d0/d4/ld3 0 2024-03-12T16:10:56.131 INFO:tasks.workunit.client.0.smithi006.stdout:3/659: fdatasync d8/d19/d26/d59/d2c/d41/f8c 0 2024-03-12T16:10:56.131 INFO:tasks.workunit.client.0.smithi006.stdout:3/660: stat d8/fc3 0 2024-03-12T16:10:56.134 INFO:tasks.workunit.client.0.smithi006.stdout:7/858: creat de/d2c/d93/dbe/f122 x:0 0 0 2024-03-12T16:10:56.135 INFO:tasks.workunit.client.0.smithi006.stdout:8/688: chown d2/db/d1a/d21/d2b/da2/fc1 51313 1 2024-03-12T16:10:56.135 INFO:tasks.workunit.client.1.smithi134.stdout:1/674: truncate d0/d42/f92 1597084 0 2024-03-12T16:10:56.136 INFO:tasks.workunit.client.1.smithi134.stdout:1/675: read - d0/d16/d9/d13/d38/fb6 zero size 2024-03-12T16:10:56.137 INFO:tasks.workunit.client.0.smithi006.stdout:1/752: dread d0/d25/d2a/d35/f55 [0,4194304] 0 2024-03-12T16:10:56.137 INFO:tasks.workunit.client.0.smithi006.stdout:6/767: unlink d3/d11/d10/da7/d8e/f86 0 2024-03-12T16:10:56.140 INFO:tasks.workunit.client.0.smithi006.stdout:0/758: rename d2/f53 to d2/d6/d10/ff6 0 2024-03-12T16:10:56.140 INFO:tasks.workunit.client.0.smithi006.stdout:6/768: write d3/d11/d10/d1b/d6e/d80/d9b/fc6 [2266799,123211] 0 2024-03-12T16:10:56.143 INFO:tasks.workunit.client.1.smithi134.stdout:2/998: write d4/d12/d1d/d34/db7/dc4/f106 [936090,79448] 0 2024-03-12T16:10:56.147 INFO:tasks.workunit.client.0.smithi006.stdout:1/753: symlink d0/d25/d2a/d43/d63/db6/l103 0 2024-03-12T16:10:56.150 INFO:tasks.workunit.client.1.smithi134.stdout:1/676: dwrite d0/d16/d9/d13/d38/f69 [0,4194304] 0 2024-03-12T16:10:56.151 INFO:tasks.workunit.client.0.smithi006.stdout:0/759: creat d2/d6/d10/d11/d7e/da6/de4/ff7 x:0 0 0 2024-03-12T16:10:56.152 INFO:tasks.workunit.client.0.smithi006.stdout:0/760: chown d2/f2c 3087905 1 2024-03-12T16:10:56.153 INFO:tasks.workunit.client.1.smithi134.stdout:1/677: creat d0/d16/d9/d13/d21/dac/fe4 x:0 0 0 2024-03-12T16:10:56.153 INFO:tasks.workunit.client.1.smithi134.stdout:2/999: write d4/d12/d3b/d3f/d114/f14d [3722268,67282] 0 2024-03-12T16:10:56.155 INFO:tasks.workunit.client.1.smithi134.stdout:1/678: symlink d0/d16/d9/d73/le5 0 2024-03-12T16:10:56.155 INFO:tasks.workunit.client.0.smithi006.stdout:8/689: fdatasync d2/d11/d5a/fc2 0 2024-03-12T16:10:56.157 INFO:tasks.workunit.client.0.smithi006.stdout:7/859: write de/d1c/d87/ddb/d7c/fd4 [45999,798] 0 2024-03-12T16:10:56.162 INFO:tasks.workunit.client.0.smithi006.stdout:1/754: rmdir d0 39 2024-03-12T16:10:56.165 INFO:tasks.workunit.client.1.smithi134.stdout:1/679: dwrite d0/d16/d9/d73/f91 [0,4194304] 0 2024-03-12T16:10:56.166 INFO:tasks.workunit.client.0.smithi006.stdout:4/798: rename d1/d38/c5b to d1/db/d39/dbf/dec/d43/db5/da5/c10a 0 2024-03-12T16:10:56.168 INFO:tasks.workunit.client.1.smithi134.stdout:1/680: mknod d0/d16/d9/d13/d21/dac/ce6 0 2024-03-12T16:10:56.168 INFO:tasks.workunit.client.0.smithi006.stdout:6/769: link d3/d11/d10/d1b/d6e/d80/d9b/fc6 d3/d47/db0/f116 0 2024-03-12T16:10:56.170 INFO:tasks.workunit.client.0.smithi006.stdout:0/761: write d2/d6/fb3 [1016762,83034] 0 2024-03-12T16:10:56.170 INFO:tasks.workunit.client.0.smithi006.stdout:3/661: truncate d8/d19/d26/d59/d2c/dc/f38 240574 0 2024-03-12T16:10:56.170 INFO:tasks.workunit.client.1.smithi134.stdout:1/681: mkdir d0/d30/d86/de7 0 2024-03-12T16:10:56.171 INFO:tasks.workunit.client.1.smithi134.stdout:1/682: write d0/d30/fb8 [67050,90846] 0 2024-03-12T16:10:56.172 INFO:tasks.workunit.client.0.smithi006.stdout:8/690: creat d2/d11/d5a/fe1 x:0 0 0 2024-03-12T16:10:56.173 INFO:tasks.workunit.client.1.smithi134.stdout:1/683: dread - d0/d30/d48/f80 zero size 2024-03-12T16:10:56.173 INFO:tasks.workunit.client.1.smithi134.stdout:1/684: chown d0/d30/fa8 21 1 2024-03-12T16:10:56.175 INFO:tasks.workunit.client.1.smithi134.stdout:1/685: symlink d0/d16/d9/d13/d21/d2f/le8 0 2024-03-12T16:10:56.176 INFO:tasks.workunit.client.1.smithi134.stdout:1/686: mknod d0/d30/d48/da1/ce9 0 2024-03-12T16:10:56.177 INFO:tasks.workunit.client.0.smithi006.stdout:8/691: dread - d2/db/d1a/d7a/dcc/fd2 zero size 2024-03-12T16:10:56.179 INFO:tasks.workunit.client.1.smithi134.stdout:1/687: mknod d0/d16/d9/d51/db7/dbb/cea 0 2024-03-12T16:10:56.179 INFO:tasks.workunit.client.1.smithi134.stdout:1/688: fsync d0/d42/fcb 0 2024-03-12T16:10:56.179 INFO:tasks.workunit.client.0.smithi006.stdout:0/762: creat d2/d6/d10/d11/d7e/dbe/ff8 x:0 0 0 2024-03-12T16:10:56.181 INFO:tasks.workunit.client.1.smithi134.stdout:1/689: creat d0/d16/d9/d51/feb x:0 0 0 2024-03-12T16:10:56.181 INFO:tasks.workunit.client.0.smithi006.stdout:4/799: mkdir d1/db/d1d/d10b 0 2024-03-12T16:10:56.182 INFO:tasks.workunit.client.1.smithi134.stdout:1/690: chown d0/d16/d9/fa4 32 1 2024-03-12T16:10:56.182 INFO:tasks.workunit.client.1.smithi134.stdout:1/691: fdatasync d0/d42/d47/fc2 0 2024-03-12T16:10:56.182 INFO:tasks.workunit.client.0.smithi006.stdout:1/755: chown d0/d25/d2a/d43/f72 92 1 2024-03-12T16:10:56.183 INFO:tasks.workunit.client.1.smithi134.stdout:1/692: fsync d0/fd 0 2024-03-12T16:10:56.184 INFO:tasks.workunit.client.0.smithi006.stdout:1/756: read d0/f16 [615020,87486] 0 2024-03-12T16:10:56.186 INFO:tasks.workunit.client.1.smithi134.stdout:1/693: mknod d0/d16/cec 0 2024-03-12T16:10:56.188 INFO:tasks.workunit.client.0.smithi006.stdout:9/655: rename d0/d8/d16/d7d/d20/fa4 to d0/d4/fd4 0 2024-03-12T16:10:56.188 INFO:tasks.workunit.client.0.smithi006.stdout:7/860: write de/d2c/d93/dbe/d66/fda [483147,27893] 0 2024-03-12T16:10:56.191 INFO:tasks.workunit.client.1.smithi134.stdout:1/694: dread d0/d16/d9/d13/d38/f41 [0,4194304] 0 2024-03-12T16:10:56.191 INFO:tasks.workunit.client.0.smithi006.stdout:4/800: truncate d1/db/d39/dbf/dec/d43/f6f 96926 0 2024-03-12T16:10:56.193 INFO:tasks.workunit.client.1.smithi134.stdout:9/948: sync 2024-03-12T16:10:56.193 INFO:tasks.workunit.client.1.smithi134.stdout:7/977: sync 2024-03-12T16:10:56.193 INFO:tasks.workunit.client.1.smithi134.stdout:0/975: sync 2024-03-12T16:10:56.195 INFO:tasks.workunit.client.1.smithi134.stdout:9/949: chown d5/d10/d35/d49/f119 2856485 1 2024-03-12T16:10:56.196 INFO:tasks.workunit.client.0.smithi006.stdout:6/770: dwrite d3/d47/db0/dc1/fc9 [0,4194304] 0 2024-03-12T16:10:56.196 INFO:tasks.workunit.client.1.smithi134.stdout:0/976: creat db/d2f/d71/f13e x:0 0 0 2024-03-12T16:10:56.197 INFO:tasks.workunit.client.0.smithi006.stdout:0/763: mknod d2/d6/d10/cf9 0 2024-03-12T16:10:56.198 INFO:tasks.workunit.client.1.smithi134.stdout:7/978: symlink d8/dc/d7b/df8/dfd/l139 0 2024-03-12T16:10:56.198 INFO:tasks.workunit.client.1.smithi134.stdout:0/977: write db/d2f/f4f [631398,7067] 0 2024-03-12T16:10:56.199 INFO:tasks.workunit.client.1.smithi134.stdout:0/978: chown db/d2f/d51/daf 1 1 2024-03-12T16:10:56.201 INFO:tasks.workunit.client.1.smithi134.stdout:7/979: write d8/dc/d20/d26/f3a [587829,95338] 0 2024-03-12T16:10:56.202 INFO:tasks.workunit.client.0.smithi006.stdout:3/662: getdents d8 0 2024-03-12T16:10:56.204 INFO:tasks.workunit.client.0.smithi006.stdout:6/771: mknod d3/d47/db0/dc1/c117 0 2024-03-12T16:10:56.204 INFO:tasks.workunit.client.0.smithi006.stdout:7/861: readlink de/d98/l117 0 2024-03-12T16:10:56.206 INFO:tasks.workunit.client.0.smithi006.stdout:8/692: link d2/db/d1a/d21/d4f/f68 d2/db/fe2 0 2024-03-12T16:10:56.207 INFO:tasks.workunit.client.0.smithi006.stdout:4/801: mknod d1/db/d39/dbf/dec/c10c 0 2024-03-12T16:10:56.207 INFO:tasks.workunit.client.0.smithi006.stdout:9/656: dwrite d0/d4/d18/d4d/fd0 [0,4194304] 0 2024-03-12T16:10:56.208 INFO:tasks.workunit.client.1.smithi134.stdout:7/980: dread d8/dc/d4b/fc7 [4194304,4194304] 0 2024-03-12T16:10:56.210 INFO:tasks.workunit.client.1.smithi134.stdout:1/695: dread d0/d16/d9/f70 [0,4194304] 0 2024-03-12T16:10:56.212 INFO:tasks.workunit.client.1.smithi134.stdout:7/981: rmdir d8/d27/d9d/dc9 39 2024-03-12T16:10:56.214 INFO:tasks.workunit.client.1.smithi134.stdout:9/950: dwrite d5/d10/d6c/f6b [0,4194304] 0 2024-03-12T16:10:56.214 INFO:tasks.workunit.client.1.smithi134.stdout:7/982: chown d8/dc/d7b/dbb/l111 40839 1 2024-03-12T16:10:56.215 INFO:tasks.workunit.client.1.smithi134.stdout:7/983: read - d8/f79 zero size 2024-03-12T16:10:56.215 INFO:tasks.workunit.client.0.smithi006.stdout:0/764: creat d2/d88/dc9/ffa x:0 0 0 2024-03-12T16:10:56.215 INFO:tasks.workunit.client.0.smithi006.stdout:8/693: write d2/db/d1a/d21/d8a/f9a [1341421,112525] 0 2024-03-12T16:10:56.216 INFO:tasks.workunit.client.0.smithi006.stdout:6/772: creat d3/d11/d10/d1b/d6e/d80/f118 x:0 0 0 2024-03-12T16:10:56.217 INFO:tasks.workunit.client.1.smithi134.stdout:1/696: stat d0/d30/d48/fda 0 2024-03-12T16:10:56.218 INFO:tasks.workunit.client.0.smithi006.stdout:0/765: write d2/d6/d10/d11/d1d/f29 [159141,96422] 0 2024-03-12T16:10:56.219 INFO:tasks.workunit.client.0.smithi006.stdout:9/657: unlink d0/d4/d9b/la1 0 2024-03-12T16:10:56.219 INFO:tasks.workunit.client.0.smithi006.stdout:1/757: write d0/d25/d2a/d43/fa7 [537437,87813] 0 2024-03-12T16:10:56.219 INFO:tasks.workunit.client.0.smithi006.stdout:8/694: write d2/d55/d7b/f83 [4098214,13992] 0 2024-03-12T16:10:56.221 INFO:tasks.workunit.client.1.smithi134.stdout:1/697: chown d0/d42/d47 2176 1 2024-03-12T16:10:56.224 INFO:tasks.workunit.client.1.smithi134.stdout:1/698: rmdir d0/d42 39 2024-03-12T16:10:56.225 INFO:tasks.workunit.client.0.smithi006.stdout:9/658: rmdir d0/d8/d80 39 2024-03-12T16:10:56.226 INFO:tasks.workunit.client.0.smithi006.stdout:9/659: dread - d0/d8/fc3 zero size 2024-03-12T16:10:56.226 INFO:tasks.workunit.client.1.smithi134.stdout:7/984: dwrite d8/dc/d20/d26/d36/f64 [4194304,4194304] 0 2024-03-12T16:10:56.227 INFO:tasks.workunit.client.0.smithi006.stdout:6/773: truncate d3/d11/d10/d1b/d20/f8f 1066622 0 2024-03-12T16:10:56.227 INFO:tasks.workunit.client.0.smithi006.stdout:4/802: getdents d1/db/d39/dbf/dec/d43/dcc/d104 0 2024-03-12T16:10:56.228 INFO:tasks.workunit.client.1.smithi134.stdout:1/699: chown d0/d30/d86/f27 34 1 2024-03-12T16:10:56.230 INFO:tasks.workunit.client.0.smithi006.stdout:3/663: rename d8/d19/d26/d59/d2c/d41/d8b/lab to d8/d19/d26/d59/d2c/le1 0 2024-03-12T16:10:56.232 INFO:tasks.workunit.client.1.smithi134.stdout:1/700: creat d0/d16/d9/fed x:0 0 0 2024-03-12T16:10:56.233 INFO:tasks.workunit.client.0.smithi006.stdout:9/660: mkdir d0/d8/d16/d2f/dd5 0 2024-03-12T16:10:56.234 INFO:tasks.workunit.client.1.smithi134.stdout:7/985: fsync d8/d27/d9d/dc9/fe0 0 2024-03-12T16:10:56.234 INFO:tasks.workunit.client.1.smithi134.stdout:1/701: read d0/d30/d86/fbc [673062,35528] 0 2024-03-12T16:10:56.234 INFO:tasks.workunit.client.1.smithi134.stdout:7/986: readlink d8/dc/d7b/d119/l11f 0 2024-03-12T16:10:56.234 INFO:tasks.workunit.client.1.smithi134.stdout:0/979: dread db/d2f/d51/f64 [0,4194304] 0 2024-03-12T16:10:56.235 INFO:tasks.workunit.client.1.smithi134.stdout:1/702: dread - d0/d30/d48/da1/fdb zero size 2024-03-12T16:10:56.236 INFO:tasks.workunit.client.1.smithi134.stdout:7/987: mknod d8/dc/c13a 0 2024-03-12T16:10:56.236 INFO:tasks.workunit.client.1.smithi134.stdout:1/703: chown d0/d16/d9/d13/d21/d2f/lca 1170 1 2024-03-12T16:10:56.238 INFO:tasks.workunit.client.1.smithi134.stdout:0/980: chown db/d2f/d31/d68/da2/f119 33115 1 2024-03-12T16:10:56.238 INFO:tasks.workunit.client.1.smithi134.stdout:0/981: chown db/d2f 61376093 1 2024-03-12T16:10:56.239 INFO:tasks.workunit.client.1.smithi134.stdout:8/968: sync 2024-03-12T16:10:56.240 INFO:tasks.workunit.client.1.smithi134.stdout:0/982: write db/d2f/d61/d67/f69 [788257,79536] 0 2024-03-12T16:10:56.243 INFO:tasks.workunit.client.1.smithi134.stdout:0/983: write db/d2f/d31/d76/fd9 [481749,25832] 0 2024-03-12T16:10:56.245 INFO:tasks.workunit.client.1.smithi134.stdout:0/984: readlink db/d2f/d31/d76/d9f/la1 0 2024-03-12T16:10:56.252 INFO:tasks.workunit.client.1.smithi134.stdout:9/951: dwrite d5/d46/f57 [0,4194304] 0 2024-03-12T16:10:56.254 INFO:tasks.workunit.client.1.smithi134.stdout:0/985: write db/d2f/d71/fad [360732,66041] 0 2024-03-12T16:10:56.255 INFO:tasks.workunit.client.1.smithi134.stdout:1/704: dwrite d0/d16/d9/d13/d21/d20/fc3 [0,4194304] 0 2024-03-12T16:10:56.263 INFO:tasks.workunit.client.1.smithi134.stdout:1/705: write d0/d16/d9/d13/d21/d2f/fd0 [52681,26297] 0 2024-03-12T16:10:56.263 INFO:tasks.workunit.client.1.smithi134.stdout:9/952: mkdir d5/d10/d35/d49/d8d/d120 0 2024-03-12T16:10:56.265 INFO:tasks.workunit.client.1.smithi134.stdout:0/986: dwrite db/d2f/d31/d76/f93 [0,4194304] 0 2024-03-12T16:10:56.276 INFO:tasks.workunit.client.1.smithi134.stdout:1/706: rmdir d0/d30/d48/da1/dbf 0 2024-03-12T16:10:56.277 INFO:tasks.workunit.client.1.smithi134.stdout:8/969: dread d3/db0/fbe [0,4194304] 0 2024-03-12T16:10:56.285 INFO:tasks.workunit.client.1.smithi134.stdout:0/987: dread db/d2f/f57 [0,4194304] 0 2024-03-12T16:10:56.285 INFO:tasks.workunit.client.1.smithi134.stdout:0/988: readlink db/dcc/ld0 0 2024-03-12T16:10:56.293 INFO:tasks.workunit.client.1.smithi134.stdout:9/953: dread d5/d10/f5a [0,4194304] 0 2024-03-12T16:10:56.294 INFO:tasks.workunit.client.1.smithi134.stdout:9/954: fsync d5/d20/f2b 0 2024-03-12T16:10:56.302 INFO:tasks.workunit.client.1.smithi134.stdout:8/970: fdatasync d3/d1b/d17/d25/f79 0 2024-03-12T16:10:56.302 INFO:tasks.workunit.client.0.smithi006.stdout:0/766: creat d2/ffb x:0 0 0 2024-03-12T16:10:56.303 INFO:tasks.workunit.client.1.smithi134.stdout:9/955: read d5/f28 [3121014,26444] 0 2024-03-12T16:10:56.303 INFO:tasks.workunit.client.1.smithi134.stdout:1/707: rmdir d0/d16/d9/d13/d21/d5f/d6f/d85 39 2024-03-12T16:10:56.304 INFO:tasks.workunit.client.0.smithi006.stdout:1/758: creat d0/d25/f104 x:0 0 0 2024-03-12T16:10:56.304 INFO:tasks.workunit.client.1.smithi134.stdout:1/708: chown d0/d16/f29 5 1 2024-03-12T16:10:56.305 INFO:tasks.workunit.client.1.smithi134.stdout:0/989: symlink db/d2f/d31/d68/da2/db2/l13f 0 2024-03-12T16:10:56.306 INFO:tasks.workunit.client.1.smithi134.stdout:8/971: dread - d3/d1b/d17/dff/f12e zero size 2024-03-12T16:10:56.309 INFO:tasks.workunit.client.1.smithi134.stdout:9/956: symlink d5/d20/d100/l121 0 2024-03-12T16:10:56.312 INFO:tasks.workunit.client.1.smithi134.stdout:0/990: rmdir db/d2f/d31/d76/d9f 39 2024-03-12T16:10:56.314 INFO:tasks.workunit.client.0.smithi006.stdout:1/759: mknod d0/d25/d2a/d43/d56/c105 0 2024-03-12T16:10:56.315 INFO:tasks.workunit.client.0.smithi006.stdout:7/862: dwrite de/d2c/d93/dbe/fc1 [0,4194304] 0 2024-03-12T16:10:56.316 INFO:tasks.workunit.client.1.smithi134.stdout:9/957: mknod d5/d10/d35/c122 0 2024-03-12T16:10:56.317 INFO:tasks.workunit.client.1.smithi134.stdout:9/958: readlink d5/d10/d33/da1/ld0 0 2024-03-12T16:10:56.320 INFO:tasks.workunit.client.1.smithi134.stdout:9/959: creat d5/d10/d6c/f123 x:0 0 0 2024-03-12T16:10:56.321 INFO:tasks.workunit.client.1.smithi134.stdout:9/960: dread - d5/d10/d35/d49/d8d/d11d/fe3 zero size 2024-03-12T16:10:56.322 INFO:tasks.workunit.client.1.smithi134.stdout:8/972: rename d3/d82/d104/d31/ld3 to d3/d1b/d17/d25/d33/d15/d95/d4f/l14f 0 2024-03-12T16:10:56.324 INFO:tasks.workunit.client.1.smithi134.stdout:8/973: write d3/d1b/d17/d25/d33/f11d [732775,129386] 0 2024-03-12T16:10:56.325 INFO:tasks.workunit.client.0.smithi006.stdout:4/803: getdents d1/d38/d79 0 2024-03-12T16:10:56.325 INFO:tasks.workunit.client.1.smithi134.stdout:9/961: rename d5/d10/d35/d49/d74/ld4 to d5/d10/d35/d49/d8d/d11d/d103/d11f/l124 0 2024-03-12T16:10:56.328 INFO:tasks.workunit.client.1.smithi134.stdout:9/962: readlink d5/d10/d33/da1/la6 0 2024-03-12T16:10:56.328 INFO:tasks.workunit.client.1.smithi134.stdout:8/974: rmdir d3/d1b/d17/d25/d33/d15/d114 39 2024-03-12T16:10:56.328 INFO:tasks.workunit.client.0.smithi006.stdout:0/767: creat d2/d6/d10/ffc x:0 0 0 2024-03-12T16:10:56.328 INFO:tasks.workunit.client.0.smithi006.stdout:7/863: rmdir de/d2c/d93/dbe/d4a/d6a/de8 39 2024-03-12T16:10:56.328 INFO:tasks.workunit.client.0.smithi006.stdout:9/661: dwrite d0/fb1 [0,4194304] 0 2024-03-12T16:10:56.331 INFO:tasks.workunit.client.0.smithi006.stdout:7/864: write de/d2c/dd3/f108 [457644,21796] 0 2024-03-12T16:10:56.331 INFO:tasks.workunit.client.1.smithi134.stdout:8/975: creat d3/d82/d104/d31/f150 x:0 0 0 2024-03-12T16:10:56.333 INFO:tasks.workunit.client.1.smithi134.stdout:8/976: rmdir d3/d1b/d17 39 2024-03-12T16:10:56.335 INFO:tasks.workunit.client.1.smithi134.stdout:9/963: link d5/d10/d1f/f6e d5/d10/d35/d49/d8d/def/f125 0 2024-03-12T16:10:56.338 INFO:tasks.workunit.client.1.smithi134.stdout:8/977: write d3/d1b/d17/d25/d33/d15/d95/d6d/dc5/f118 [452394,29007] 0 2024-03-12T16:10:56.341 INFO:tasks.workunit.client.0.smithi006.stdout:1/760: symlink d0/d25/d2a/d35/l106 0 2024-03-12T16:10:56.342 INFO:tasks.workunit.client.0.smithi006.stdout:1/761: write d0/d25/d2a/d43/f96 [1406507,87221] 0 2024-03-12T16:10:56.342 INFO:tasks.workunit.client.0.smithi006.stdout:0/768: creat d2/d6/d37/ffd x:0 0 0 2024-03-12T16:10:56.344 INFO:tasks.workunit.client.1.smithi134.stdout:9/964: link d5/d10/d35/d49/d54/d5e/dab/fc7 d5/d10/d35/d49/d8d/d120/f126 0 2024-03-12T16:10:56.351 INFO:tasks.workunit.client.0.smithi006.stdout:3/664: dwrite d8/d19/d26/d59/f42 [4194304,4194304] 0 2024-03-12T16:10:56.351 INFO:tasks.workunit.client.1.smithi134.stdout:0/991: write db/d2f/f43 [3997903,79843] 0 2024-03-12T16:10:56.352 INFO:tasks.workunit.client.0.smithi006.stdout:1/762: creat d0/d25/d2a/d43/d63/f107 x:0 0 0 2024-03-12T16:10:56.354 INFO:tasks.workunit.client.0.smithi006.stdout:3/665: write d8/d4c/dd8/fd6 [784595,107800] 0 2024-03-12T16:10:56.355 INFO:tasks.workunit.client.1.smithi134.stdout:0/992: write db/d2f/d31/d56/d66/f138 [1044578,25002] 0 2024-03-12T16:10:56.355 INFO:tasks.workunit.client.1.smithi134.stdout:8/978: rmdir d3/d82 39 2024-03-12T16:10:56.355 INFO:tasks.workunit.client.0.smithi006.stdout:3/666: stat d8/d19/d26/d59 0 2024-03-12T16:10:56.357 INFO:tasks.workunit.client.1.smithi134.stdout:0/993: readlink db/d2f/d51/l92 0 2024-03-12T16:10:56.358 INFO:tasks.workunit.client.0.smithi006.stdout:7/865: mkdir de/dc2/d123 0 2024-03-12T16:10:56.359 INFO:tasks.workunit.client.1.smithi134.stdout:1/709: dwrite d0/d16/d9/fa4 [0,4194304] 0 2024-03-12T16:10:56.360 INFO:tasks.workunit.client.0.smithi006.stdout:1/763: rename d0/d25/fae to d0/d25/d2a/d43/d63/d102/f108 0 2024-03-12T16:10:56.363 INFO:tasks.workunit.client.1.smithi134.stdout:1/710: fsync d0/d16/d39/f46 0 2024-03-12T16:10:56.365 INFO:tasks.workunit.client.0.smithi006.stdout:7/866: creat de/d2c/d4f/dba/d39/f124 x:0 0 0 2024-03-12T16:10:56.366 INFO:tasks.workunit.client.1.smithi134.stdout:8/979: truncate d3/d82/d104/d31/fc2 913364 0 2024-03-12T16:10:56.373 INFO:tasks.workunit.client.1.smithi134.stdout:8/980: unlink d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/ce4 0 2024-03-12T16:10:56.373 INFO:tasks.workunit.client.0.smithi006.stdout:7/867: symlink de/d7b/dc6/d11c/l125 0 2024-03-12T16:10:56.373 INFO:tasks.workunit.client.0.smithi006.stdout:7/868: stat de/d2c/d4f/dba/f9e 0 2024-03-12T16:10:56.374 INFO:tasks.workunit.client.1.smithi134.stdout:0/994: write db/f26 [7673709,7072] 0 2024-03-12T16:10:56.374 INFO:tasks.workunit.client.1.smithi134.stdout:1/711: write d0/d16/d9/d13/f17 [1860333,119332] 0 2024-03-12T16:10:56.374 INFO:tasks.workunit.client.0.smithi006.stdout:1/764: getdents d0/d25/d2a/d43/d56/dd8 0 2024-03-12T16:10:56.374 INFO:tasks.workunit.client.0.smithi006.stdout:7/869: dread - de/d2c/d93/f105 zero size 2024-03-12T16:10:56.377 INFO:tasks.workunit.client.0.smithi006.stdout:4/804: write d1/db/d39/dbf/dec/f59 [170919,59232] 0 2024-03-12T16:10:56.378 INFO:tasks.workunit.client.1.smithi134.stdout:9/965: dread d5/d20/f87 [0,4194304] 0 2024-03-12T16:10:56.378 INFO:tasks.workunit.client.1.smithi134.stdout:8/981: creat d3/d1b/d17/d24/d28/f151 x:0 0 0 2024-03-12T16:10:56.378 INFO:tasks.workunit.client.0.smithi006.stdout:9/662: write d0/d8/d16/d7d/f88 [18266,36561] 0 2024-03-12T16:10:56.378 INFO:tasks.workunit.client.0.smithi006.stdout:7/870: stat de/f112 0 2024-03-12T16:10:56.379 INFO:tasks.workunit.client.1.smithi134.stdout:8/982: chown d3/d1b/d17/d25/d49/f75 241855587 1 2024-03-12T16:10:56.380 INFO:tasks.workunit.client.1.smithi134.stdout:0/995: rename db/d2f/d31/l3e to db/dcc/l140 0 2024-03-12T16:10:56.382 INFO:tasks.workunit.client.0.smithi006.stdout:7/871: chown de/d1c/f96 41 1 2024-03-12T16:10:56.382 INFO:tasks.workunit.client.0.smithi006.stdout:9/663: write d0/d4/d3b/f4b [6770364,70356] 0 2024-03-12T16:10:56.382 INFO:tasks.workunit.client.0.smithi006.stdout:7/872: chown de/d1c/d87/ddb/l5f 513736401 1 2024-03-12T16:10:56.383 INFO:tasks.workunit.client.1.smithi134.stdout:0/996: stat db/d2f/d31/d56/c12f 0 2024-03-12T16:10:56.384 INFO:tasks.workunit.client.0.smithi006.stdout:9/664: stat d0/d1f/f8b 0 2024-03-12T16:10:56.384 INFO:tasks.workunit.client.1.smithi134.stdout:1/712: mkdir d0/d16/d9/d13/d21/d5f/d6f/d85/dee 0 2024-03-12T16:10:56.386 INFO:tasks.workunit.client.0.smithi006.stdout:1/765: creat d0/d25/d2a/d43/d63/db6/f109 x:0 0 0 2024-03-12T16:10:56.386 INFO:tasks.workunit.client.0.smithi006.stdout:5/719: sync 2024-03-12T16:10:56.387 INFO:tasks.workunit.client.0.smithi006.stdout:2/762: sync 2024-03-12T16:10:56.387 INFO:tasks.workunit.client.1.smithi134.stdout:9/966: symlink d5/d10/d35/d49/d8d/d11d/d103/l127 0 2024-03-12T16:10:56.387 INFO:tasks.workunit.client.0.smithi006.stdout:7/873: rmdir de/d1c 39 2024-03-12T16:10:56.391 INFO:tasks.workunit.client.0.smithi006.stdout:5/720: fsync d7/d9/d47/fcc 0 2024-03-12T16:10:56.392 INFO:tasks.workunit.client.0.smithi006.stdout:1/766: write d0/d25/f9e [2133455,103921] 0 2024-03-12T16:10:56.393 INFO:tasks.workunit.client.0.smithi006.stdout:3/667: dread d8/fe [0,4194304] 0 2024-03-12T16:10:56.394 INFO:tasks.workunit.client.1.smithi134.stdout:8/983: dwrite d3/d1b/d17/d25/d49/d94/fa2 [4194304,4194304] 0 2024-03-12T16:10:56.394 INFO:tasks.workunit.client.0.smithi006.stdout:4/805: dwrite d1/db/f22 [0,4194304] 0 2024-03-12T16:10:56.394 INFO:tasks.workunit.client.0.smithi006.stdout:9/665: rename d0/d8/d16/d7d/d20/f36 to d0/d4/d18/fd6 0 2024-03-12T16:10:56.395 INFO:tasks.workunit.client.1.smithi134.stdout:8/984: dread - d3/d1b/d17/d24/d28/f9f zero size 2024-03-12T16:10:56.396 INFO:tasks.workunit.client.1.smithi134.stdout:9/967: rename d5/d10/d35/d49/d54/d5e/fb5 to d5/d10/d33/da1/f128 0 2024-03-12T16:10:56.398 INFO:tasks.workunit.client.1.smithi134.stdout:9/968: stat d5/d10/d35/d49/d54/d5e/dab/f113 0 2024-03-12T16:10:56.399 INFO:tasks.workunit.client.0.smithi006.stdout:5/721: mkdir d7/d9/d31/d3b/d4f/db5/def 0 2024-03-12T16:10:56.399 INFO:tasks.workunit.client.0.smithi006.stdout:7/874: write de/f80 [1159220,79047] 0 2024-03-12T16:10:56.400 INFO:tasks.workunit.client.1.smithi134.stdout:8/985: truncate d3/d1b/d17/d25/d33/d15/d95/d10d/f113 4218551 0 2024-03-12T16:10:56.407 INFO:tasks.workunit.client.0.smithi006.stdout:1/767: dwrite d0/d25/fd6 [0,4194304] 0 2024-03-12T16:10:56.408 INFO:tasks.workunit.client.0.smithi006.stdout:3/668: rename d8/d52/c68 to d8/d19/d26/d59/d2c/dc/dc9/ce2 0 2024-03-12T16:10:56.409 INFO:tasks.workunit.client.1.smithi134.stdout:0/997: dwrite db/d2f/d51/f7c [0,4194304] 0 2024-03-12T16:10:56.410 INFO:tasks.workunit.client.0.smithi006.stdout:2/763: getdents d0/d13/d49/d60/d2b/d62/d66 0 2024-03-12T16:10:56.411 INFO:tasks.workunit.client.1.smithi134.stdout:9/969: rename d5/d10/d35/d49/d8d/def/f125 to d5/d10/d35/d49/d8d/d11d/d103/f129 0 2024-03-12T16:10:56.411 INFO:tasks.workunit.client.0.smithi006.stdout:5/722: fdatasync d7/d9/d10/d24/f3d 0 2024-03-12T16:10:56.413 INFO:tasks.workunit.client.1.smithi134.stdout:8/986: truncate d3/d1b/d17/d25/d33/d15/d95/d6d/f92 729149 0 2024-03-12T16:10:56.415 INFO:tasks.workunit.client.1.smithi134.stdout:0/998: mkdir db/d2f/d61/d94/d141 0 2024-03-12T16:10:56.416 INFO:tasks.workunit.client.1.smithi134.stdout:9/970: mknod d5/d10/d35/c12a 0 2024-03-12T16:10:56.417 INFO:tasks.workunit.client.1.smithi134.stdout:8/987: fsync d3/d1b/d17/d25/fb3 0 2024-03-12T16:10:56.417 INFO:tasks.workunit.client.1.smithi134.stdout:0/999: write db/d2f/d51/daf/deb/f11a [7723,7050] 0 2024-03-12T16:10:56.419 INFO:tasks.workunit.client.1.smithi134.stdout:9/971: truncate d5/d20/f70 3997768 0 2024-03-12T16:10:56.421 INFO:tasks.workunit.client.1.smithi134.stdout:8/988: symlink d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/l152 0 2024-03-12T16:10:56.422 INFO:tasks.workunit.client.1.smithi134.stdout:8/989: fdatasync d3/d1b/d17/d45/fc4 0 2024-03-12T16:10:56.423 INFO:tasks.workunit.client.0.smithi006.stdout:1/768: mkdir d0/d25/d67/d10a 0 2024-03-12T16:10:56.424 INFO:tasks.workunit.client.1.smithi134.stdout:9/972: truncate d5/d20/f2b 8184824 0 2024-03-12T16:10:56.424 INFO:tasks.workunit.client.0.smithi006.stdout:7/875: creat de/d2c/d93/dbe/d4a/dd1/d118/f126 x:0 0 0 2024-03-12T16:10:56.426 INFO:tasks.workunit.client.0.smithi006.stdout:3/669: creat d8/d19/d26/d59/d2c/d41/d45/fe3 x:0 0 0 2024-03-12T16:10:56.427 INFO:tasks.workunit.client.0.smithi006.stdout:5/723: dread d7/d9/d31/d3b/d61/f9c [0,4194304] 0 2024-03-12T16:10:56.429 INFO:tasks.workunit.client.0.smithi006.stdout:2/764: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/f99 [0,4194304] 0 2024-03-12T16:10:56.431 INFO:tasks.workunit.client.0.smithi006.stdout:1/769: truncate d0/d25/db1/dd0/fe9 429852 0 2024-03-12T16:10:56.434 INFO:tasks.workunit.client.1.smithi134.stdout:9/973: dread d5/d20/f27 [4194304,4194304] 0 2024-03-12T16:10:56.437 INFO:tasks.workunit.client.1.smithi134.stdout:9/974: fsync d5/d10/d35/d49/d8d/d11d/fa3 0 2024-03-12T16:10:56.439 INFO:tasks.workunit.client.0.smithi006.stdout:5/724: creat d7/d9/d31/d3b/d4f/d65/de1/ff0 x:0 0 0 2024-03-12T16:10:56.439 INFO:tasks.workunit.client.0.smithi006.stdout:1/770: mkdir d0/d25/db1/dd0/d10b 0 2024-03-12T16:10:56.443 INFO:tasks.workunit.client.0.smithi006.stdout:5/725: dread - d7/d9/d31/d3b/d61/dd3/fde zero size 2024-03-12T16:10:56.443 INFO:tasks.workunit.client.0.smithi006.stdout:7/876: dwrite de/d2c/dea/feb [0,4194304] 0 2024-03-12T16:10:56.443 INFO:tasks.workunit.client.0.smithi006.stdout:4/806: truncate d1/db/d1d/d2f/d6b/fe0 132018 0 2024-03-12T16:10:56.446 INFO:tasks.workunit.client.0.smithi006.stdout:2/765: creat d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fe8 x:0 0 0 2024-03-12T16:10:56.448 INFO:tasks.workunit.client.0.smithi006.stdout:7/877: chown de/d18/le1 0 1 2024-03-12T16:10:56.449 INFO:tasks.workunit.client.1.smithi134.stdout:8/990: truncate d3/d1b/d17/d25/fd2 1198088 0 2024-03-12T16:10:56.450 INFO:tasks.workunit.client.1.smithi134.stdout:8/991: chown d3/d1b/d17/d25/d33/d15/d95/d5b/da7 3048 1 2024-03-12T16:10:56.452 INFO:tasks.workunit.client.0.smithi006.stdout:1/771: getdents d0/d25/d67/d8d 0 2024-03-12T16:10:56.455 INFO:tasks.workunit.client.0.smithi006.stdout:5/726: rename d7/d41/fc6 to d7/d8/d91/ff1 0 2024-03-12T16:10:56.458 INFO:tasks.workunit.client.1.smithi134.stdout:9/975: dread d5/d10/d35/d49/f4a [0,4194304] 0 2024-03-12T16:10:56.458 INFO:tasks.workunit.client.1.smithi134.stdout:8/992: link d3/d1b/d17/d25/d33/d85/cdf d3/d1b/d17/d25/d33/d15/d95/c153 0 2024-03-12T16:10:56.460 INFO:tasks.workunit.client.0.smithi006.stdout:2/766: dwrite d0/d13/d49/d60/f14 [4194304,4194304] 0 2024-03-12T16:10:56.460 INFO:tasks.workunit.client.1.smithi134.stdout:8/993: truncate d3/d1b/d17/d25/f101 1163006 0 2024-03-12T16:10:56.461 INFO:tasks.workunit.client.0.smithi006.stdout:1/772: fsync d0/d25/d2a/d43/f47 0 2024-03-12T16:10:56.465 INFO:tasks.workunit.client.0.smithi006.stdout:5/727: creat d7/d9/d31/d3b/d6b/db9/ff2 x:0 0 0 2024-03-12T16:10:56.466 INFO:tasks.workunit.client.1.smithi134.stdout:9/976: link d5/d10/d35/d49/d8d/d11d/d103/f129 d5/d10/d114/f12b 0 2024-03-12T16:10:56.467 INFO:tasks.workunit.client.0.smithi006.stdout:5/728: read d7/d8/d8a/fad [2467181,106530] 0 2024-03-12T16:10:56.468 INFO:tasks.workunit.client.0.smithi006.stdout:7/878: write de/d2c/f32 [165946,113215] 0 2024-03-12T16:10:56.470 INFO:tasks.workunit.client.0.smithi006.stdout:9/666: dwrite d0/d4/d18/fd6 [0,4194304] 0 2024-03-12T16:10:56.471 INFO:tasks.workunit.client.0.smithi006.stdout:1/773: fdatasync d0/f16 0 2024-03-12T16:10:56.474 INFO:tasks.workunit.client.1.smithi134.stdout:7/988: sync 2024-03-12T16:10:56.475 INFO:tasks.workunit.client.1.smithi134.stdout:7/989: stat d8/dc/d4b/dd9/cda 0 2024-03-12T16:10:56.476 INFO:tasks.workunit.client.1.smithi134.stdout:7/990: read - d8/dc/d7b/dbb/dbd/dd5/f136 zero size 2024-03-12T16:10:56.478 INFO:tasks.workunit.client.0.smithi006.stdout:2/767: creat d0/fe9 x:0 0 0 2024-03-12T16:10:56.480 INFO:tasks.workunit.client.1.smithi134.stdout:7/991: link d8/dc/d7b/f107 d8/dc/d4b/d97/f13b 0 2024-03-12T16:10:56.481 INFO:tasks.workunit.client.0.smithi006.stdout:9/667: symlink d0/d4/d70/d86/ld7 0 2024-03-12T16:10:56.481 INFO:tasks.workunit.client.1.smithi134.stdout:9/977: write d5/d10/d35/d49/d54/d93/ff3 [3897462,93855] 0 2024-03-12T16:10:56.486 INFO:tasks.workunit.client.1.smithi134.stdout:9/978: write d5/d10/d35/d49/d8d/f111 [110525,67316] 0 2024-03-12T16:10:56.489 INFO:tasks.workunit.client.0.smithi006.stdout:4/807: dwrite d1/db/d39/f73 [4194304,4194304] 0 2024-03-12T16:10:56.489 INFO:tasks.workunit.client.1.smithi134.stdout:8/994: dwrite d3/d1b/d17/d25/fd2 [0,4194304] 0 2024-03-12T16:10:56.490 INFO:tasks.workunit.client.1.smithi134.stdout:9/979: mknod d5/d10/d35/d49/d74/d11e/c12c 0 2024-03-12T16:10:56.491 INFO:tasks.workunit.client.0.smithi006.stdout:2/768: dread d0/d13/d49/d60/fad [0,4194304] 0 2024-03-12T16:10:56.493 INFO:tasks.workunit.client.1.smithi134.stdout:8/995: mknod d3/d1b/d17/d25/d33/d15/d95/d5b/da7/dc6/c154 0 2024-03-12T16:10:56.493 INFO:tasks.workunit.client.1.smithi134.stdout:7/992: truncate d8/dc/d55/fa6 106296 0 2024-03-12T16:10:56.495 INFO:tasks.workunit.client.1.smithi134.stdout:9/980: creat d5/d10/d35/d49/d8d/d11d/ddd/f12d x:0 0 0 2024-03-12T16:10:56.495 INFO:tasks.workunit.client.1.smithi134.stdout:7/993: write d8/f1a [4524735,5054] 0 2024-03-12T16:10:56.497 INFO:tasks.workunit.client.1.smithi134.stdout:7/994: dread - d8/d27/d9d/dc9/fe0 zero size 2024-03-12T16:10:56.497 INFO:tasks.workunit.client.0.smithi006.stdout:1/774: dwrite d0/d25/d2a/d35/f51 [8388608,4194304] 0 2024-03-12T16:10:56.498 INFO:tasks.workunit.client.1.smithi134.stdout:8/996: mkdir d3/d1b/d17/d25/d33/d15/d95/d10d/d155 0 2024-03-12T16:10:56.499 INFO:tasks.workunit.client.1.smithi134.stdout:9/981: fsync d5/d10/d35/d49/d54/d5e/dab/fbd 0 2024-03-12T16:10:56.503 INFO:tasks.workunit.client.0.smithi006.stdout:7/879: dwrite de/d2c/d93/dbe/d4a/d6a/f79 [4194304,4194304] 0 2024-03-12T16:10:56.506 INFO:tasks.workunit.client.0.smithi006.stdout:9/668: truncate d0/d8/d16/d7d/d20/f61 137695 0 2024-03-12T16:10:56.509 INFO:tasks.workunit.client.0.smithi006.stdout:9/669: write d0/d4/d3b/d6a/fae [937398,128576] 0 2024-03-12T16:10:56.511 INFO:tasks.workunit.client.0.smithi006.stdout:4/808: getdents d1/db/d39/d42/df2 0 2024-03-12T16:10:56.514 INFO:tasks.workunit.client.0.smithi006.stdout:4/809: write d1/d38/f88 [3893072,129820] 0 2024-03-12T16:10:56.516 INFO:tasks.workunit.client.0.smithi006.stdout:5/729: dread d7/d9/f16 [0,4194304] 0 2024-03-12T16:10:56.518 INFO:tasks.workunit.client.0.smithi006.stdout:4/810: truncate d1/db/d39/dbf/dec/d5a/f62 4833352 0 2024-03-12T16:10:56.519 INFO:tasks.workunit.client.0.smithi006.stdout:9/670: creat d0/d8/d80/fd8 x:0 0 0 2024-03-12T16:10:56.520 INFO:tasks.workunit.client.0.smithi006.stdout:5/730: read d7/d9/d31/d3b/d61/f9c [2206494,44743] 0 2024-03-12T16:10:56.521 INFO:tasks.workunit.client.0.smithi006.stdout:9/671: fsync d0/d8/f52 0 2024-03-12T16:10:56.523 INFO:tasks.workunit.client.0.smithi006.stdout:5/731: write d7/d9/d31/fe9 [948596,397] 0 2024-03-12T16:10:56.526 INFO:tasks.workunit.client.1.smithi134.stdout:8/997: write d3/d82/d104/d31/f53 [396698,36093] 0 2024-03-12T16:10:56.527 INFO:tasks.workunit.client.1.smithi134.stdout:9/982: write d5/d10/d35/d49/d54/d5e/d82/f92 [1300053,29292] 0 2024-03-12T16:10:56.527 INFO:tasks.workunit.client.0.smithi006.stdout:7/880: write de/d1c/d87/ddb/f56 [4854093,55436] 0 2024-03-12T16:10:56.527 INFO:tasks.workunit.client.0.smithi006.stdout:5/732: chown d7/d8/d8a 7888 1 2024-03-12T16:10:56.528 INFO:tasks.workunit.client.0.smithi006.stdout:4/811: write d1/db/d39/dbf/dec/f32 [1229006,88509] 0 2024-03-12T16:10:56.531 INFO:tasks.workunit.client.1.smithi134.stdout:8/998: dread d3/d1b/d17/d25/d33/d15/d95/d6d/dc5/f136 [0,4194304] 0 2024-03-12T16:10:56.533 INFO:tasks.workunit.client.1.smithi134.stdout:9/983: dread d5/d10/d35/d49/d74/fde [0,4194304] 0 2024-03-12T16:10:56.534 INFO:tasks.workunit.client.1.smithi134.stdout:7/995: dread d8/dc/d7b/dbb/f109 [0,4194304] 0 2024-03-12T16:10:56.535 INFO:tasks.workunit.client.1.smithi134.stdout:8/999: truncate d3/d82/d104/f10e 533974 0 2024-03-12T16:10:56.536 INFO:tasks.workunit.client.0.smithi006.stdout:2/769: dwrite d0/d13/d49/d60/fa7 [0,4194304] 0 2024-03-12T16:10:56.538 INFO:tasks.workunit.client.1.smithi134.stdout:9/984: rename d5/d10/d35/d49/d54/d5e/d82/c10c to d5/d10/d35/d49/d54/df7/c12e 0 2024-03-12T16:10:56.539 INFO:tasks.workunit.client.0.smithi006.stdout:1/775: dwrite d0/d25/d2a/d35/d3f/f61 [4194304,4194304] 0 2024-03-12T16:10:56.539 INFO:tasks.workunit.client.0.smithi006.stdout:4/812: creat d1/db/d39/d42/d61/f10d x:0 0 0 2024-03-12T16:10:56.540 INFO:tasks.workunit.client.1.smithi134.stdout:7/996: creat d8/dc/d20/d26/f13c x:0 0 0 2024-03-12T16:10:56.540 INFO:tasks.workunit.client.0.smithi006.stdout:7/881: creat de/d2c/d4f/dba/d39/d81/f127 x:0 0 0 2024-03-12T16:10:56.540 INFO:tasks.workunit.client.1.smithi134.stdout:9/985: creat d5/d46/f12f x:0 0 0 2024-03-12T16:10:56.544 INFO:tasks.workunit.client.1.smithi134.stdout:9/986: mkdir d5/d10/d35/d49/d74/d11e/d130 0 2024-03-12T16:10:56.545 INFO:tasks.workunit.client.0.smithi006.stdout:5/733: truncate d7/d9/d10/d35/fb1 110064 0 2024-03-12T16:10:56.545 INFO:tasks.workunit.client.0.smithi006.stdout:1/776: chown d0/d25/d2a/lba 13373805 1 2024-03-12T16:10:56.546 INFO:tasks.workunit.client.0.smithi006.stdout:9/672: dwrite d0/d4/fb8 [0,4194304] 0 2024-03-12T16:10:56.546 INFO:tasks.workunit.client.0.smithi006.stdout:7/882: mknod de/d2c/c128 0 2024-03-12T16:10:56.548 INFO:tasks.workunit.client.0.smithi006.stdout:2/770: write d0/d13/d49/d60/d2b/d62/d66/d69/d81/fc2 [1621156,94977] 0 2024-03-12T16:10:56.550 INFO:tasks.workunit.client.0.smithi006.stdout:7/883: rmdir de/d1c 39 2024-03-12T16:10:56.552 INFO:tasks.workunit.client.0.smithi006.stdout:4/813: dread d1/db/d39/dbf/dec/d5a/d60/f7b [0,4194304] 0 2024-03-12T16:10:56.553 INFO:tasks.workunit.client.0.smithi006.stdout:2/771: symlink d0/d13/d49/d60/lea 0 2024-03-12T16:10:56.554 INFO:tasks.workunit.client.1.smithi134.stdout:9/987: dwrite d5/d46/f12f [0,4194304] 0 2024-03-12T16:10:56.556 INFO:tasks.workunit.client.0.smithi006.stdout:9/673: truncate d0/d83/d90/f9a 1786655 0 2024-03-12T16:10:56.559 INFO:tasks.workunit.client.1.smithi134.stdout:9/988: unlink d5/d10/f95 0 2024-03-12T16:10:56.559 INFO:tasks.workunit.client.0.smithi006.stdout:4/814: unlink d1/db/f64 0 2024-03-12T16:10:56.562 INFO:tasks.workunit.client.1.smithi134.stdout:1/713: sync 2024-03-12T16:10:56.562 INFO:tasks.workunit.client.1.smithi134.stdout:9/989: symlink d5/d10/d35/d49/d8d/def/l131 0 2024-03-12T16:10:56.562 INFO:tasks.workunit.client.0.smithi006.stdout:1/777: dwrite d0/d25/d67/dc1/fcf [0,4194304] 0 2024-03-12T16:10:56.565 INFO:tasks.workunit.client.1.smithi134.stdout:9/990: write d5/d20/f23 [4357612,44752] 0 2024-03-12T16:10:56.566 INFO:tasks.workunit.client.1.smithi134.stdout:7/997: dread d8/dc/d4b/fc3 [0,4194304] 0 2024-03-12T16:10:56.568 INFO:tasks.workunit.client.1.smithi134.stdout:9/991: fsync d5/d10/d35/f73 0 2024-03-12T16:10:56.570 INFO:tasks.workunit.client.0.smithi006.stdout:4/815: stat d1/db/d39/f47 0 2024-03-12T16:10:56.570 INFO:tasks.workunit.client.0.smithi006.stdout:5/734: fdatasync d7/d9/d10/f26 0 2024-03-12T16:10:56.570 INFO:tasks.workunit.client.0.smithi006.stdout:7/884: readlink de/d2c/d4f/dba/d39/d81/l8b 0 2024-03-12T16:10:56.572 INFO:tasks.workunit.client.0.smithi006.stdout:2/772: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/c7e 7417 1 2024-03-12T16:10:56.573 INFO:tasks.workunit.client.0.smithi006.stdout:9/674: rmdir d0/d83/d90 39 2024-03-12T16:10:56.575 INFO:tasks.workunit.client.0.smithi006.stdout:9/675: read d0/d4/da7/fc4 [317763,113402] 0 2024-03-12T16:10:56.577 INFO:tasks.workunit.client.0.smithi006.stdout:2/773: fsync d0/f4 0 2024-03-12T16:10:56.581 INFO:tasks.workunit.client.0.smithi006.stdout:1/778: link d0/fb d0/d25/d2a/d35/db3/f10c 0 2024-03-12T16:10:56.581 INFO:tasks.workunit.client.1.smithi134.stdout:7/998: dwrite d8/d27/f59 [4194304,4194304] 0 2024-03-12T16:10:56.585 INFO:tasks.workunit.client.1.smithi134.stdout:9/992: link d5/d10/d35/d49/fc9 d5/d10/d35/d49/d8d/def/f132 0 2024-03-12T16:10:56.586 INFO:tasks.workunit.client.0.smithi006.stdout:7/885: rename l9 to de/d2c/d4f/dba/l129 0 2024-03-12T16:10:56.586 INFO:tasks.workunit.client.1.smithi134.stdout:9/993: chown d5/d10/d35/d49/d8d/cd7 557 1 2024-03-12T16:10:56.587 INFO:tasks.workunit.client.0.smithi006.stdout:2/774: dwrite d0/d13/d49/fc8 [0,4194304] 0 2024-03-12T16:10:56.591 INFO:tasks.workunit.client.0.smithi006.stdout:9/676: rmdir d0/d8/d16/d7d/d20/dcb 0 2024-03-12T16:10:56.593 INFO:tasks.workunit.client.0.smithi006.stdout:2/775: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/leb 0 2024-03-12T16:10:56.597 INFO:tasks.workunit.client.0.smithi006.stdout:2/776: mkdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/dec 0 2024-03-12T16:10:56.598 INFO:tasks.workunit.client.1.smithi134.stdout:1/714: dwrite d0/fd5 [0,4194304] 0 2024-03-12T16:10:56.599 INFO:tasks.workunit.client.0.smithi006.stdout:9/677: getdents d0/d83/d90/dc0 0 2024-03-12T16:10:56.599 INFO:tasks.workunit.client.0.smithi006.stdout:4/816: write d1/db/d39/f3b [1193221,59849] 0 2024-03-12T16:10:56.601 INFO:tasks.workunit.client.0.smithi006.stdout:2/777: write d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/f8a [3131329,115592] 0 2024-03-12T16:10:56.603 INFO:tasks.workunit.client.1.smithi134.stdout:1/715: dread d0/d16/d9/d13/d21/d5f/d6f/d85/f83 [0,4194304] 0 2024-03-12T16:10:56.606 INFO:tasks.workunit.client.0.smithi006.stdout:9/678: mknod d0/d8/d16/cd9 0 2024-03-12T16:10:56.607 INFO:tasks.workunit.client.0.smithi006.stdout:2/778: chown d0/dc/l3d 19333 1 2024-03-12T16:10:56.607 INFO:tasks.workunit.client.0.smithi006.stdout:5/735: truncate d7/d9/d31/d3b/d4f/d65/d69/f90 124885 0 2024-03-12T16:10:56.609 INFO:tasks.workunit.client.0.smithi006.stdout:5/736: write d7/d9/d47/faa [412753,87418] 0 2024-03-12T16:10:56.611 INFO:tasks.workunit.client.0.smithi006.stdout:9/679: creat d0/d8/d16/d2f/fda x:0 0 0 2024-03-12T16:10:56.611 INFO:tasks.workunit.client.0.smithi006.stdout:1/779: write d0/d25/d2a/d43/f47 [1545132,18024] 0 2024-03-12T16:10:56.613 INFO:tasks.workunit.client.0.smithi006.stdout:2/779: unlink d0/d13/d49/d60/d2b/d62/d66/d69/c8f 0 2024-03-12T16:10:56.615 INFO:tasks.workunit.client.0.smithi006.stdout:7/886: write de/d2c/d4f/dba/f76 [1563312,15512] 0 2024-03-12T16:10:56.615 INFO:tasks.workunit.client.0.smithi006.stdout:1/780: mkdir d0/d10d 0 2024-03-12T16:10:56.617 INFO:tasks.workunit.client.1.smithi134.stdout:9/994: getdents d5/d10/d35/d49/d54/d5e/dab 0 2024-03-12T16:10:56.617 INFO:tasks.workunit.client.0.smithi006.stdout:2/780: fdatasync d0/d13/d49/d60/fc4 0 2024-03-12T16:10:56.620 INFO:tasks.workunit.client.0.smithi006.stdout:8/695: sync 2024-03-12T16:10:56.620 INFO:tasks.workunit.client.0.smithi006.stdout:6/774: sync 2024-03-12T16:10:56.620 INFO:tasks.workunit.client.0.smithi006.stdout:0/769: sync 2024-03-12T16:10:56.621 INFO:tasks.workunit.client.0.smithi006.stdout:0/770: readlink d2/l13 0 2024-03-12T16:10:56.621 INFO:tasks.workunit.client.0.smithi006.stdout:1/781: truncate d0/d25/d2a/d64/f6d 4035678 0 2024-03-12T16:10:56.623 INFO:tasks.workunit.client.0.smithi006.stdout:2/781: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/led 0 2024-03-12T16:10:56.625 INFO:tasks.workunit.client.1.smithi134.stdout:9/995: truncate d5/d10/d35/d49/d54/d93/ff3 2907061 0 2024-03-12T16:10:56.626 INFO:tasks.workunit.client.0.smithi006.stdout:7/887: symlink de/d7b/dc6/l12a 0 2024-03-12T16:10:56.627 INFO:tasks.workunit.client.0.smithi006.stdout:9/680: link d0/d4/l21 d0/d8/d16/d2f/dd5/ldb 0 2024-03-12T16:10:56.630 INFO:tasks.workunit.client.1.smithi134.stdout:9/996: getdents d5/d10/d35/d49/d8d/d11d/d103 0 2024-03-12T16:10:56.630 INFO:tasks.workunit.client.1.smithi134.stdout:1/716: dwrite d0/d16/f29 [0,4194304] 0 2024-03-12T16:10:56.631 INFO:tasks.workunit.client.0.smithi006.stdout:4/817: dwrite d1/d38/d79/ff3 [0,4194304] 0 2024-03-12T16:10:56.631 INFO:tasks.workunit.client.0.smithi006.stdout:1/782: creat d0/d25/d2a/d43/d68/f10e x:0 0 0 2024-03-12T16:10:56.631 INFO:tasks.workunit.client.1.smithi134.stdout:1/717: chown d0/d16/d9/d51/db7/dbb 71354 1 2024-03-12T16:10:56.632 INFO:tasks.workunit.client.1.smithi134.stdout:9/997: write d5/d10/d35/d49/d54/d5e/f7e [1456477,27568] 0 2024-03-12T16:10:56.633 INFO:tasks.workunit.client.0.smithi006.stdout:0/771: truncate d2/d6/d10/d11/d7e/da6/de4/ff7 461396 0 2024-03-12T16:10:56.634 INFO:tasks.workunit.client.0.smithi006.stdout:2/782: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/dec 13392 1 2024-03-12T16:10:56.634 INFO:tasks.workunit.client.1.smithi134.stdout:1/718: truncate d0/d30/d86/f27 2551679 0 2024-03-12T16:10:56.636 INFO:tasks.workunit.client.0.smithi006.stdout:4/818: stat d1/db/d39/dbf/dec/d43/db5/fb7 0 2024-03-12T16:10:56.636 INFO:tasks.workunit.client.1.smithi134.stdout:1/719: mkdir d0/d16/d9/d13/d38/def 0 2024-03-12T16:10:56.637 INFO:tasks.workunit.client.0.smithi006.stdout:5/737: write d7/d9/d31/d3b/fc8 [1789874,95920] 0 2024-03-12T16:10:56.637 INFO:tasks.workunit.client.0.smithi006.stdout:7/888: fsync de/d2c/f6f 0 2024-03-12T16:10:56.638 INFO:tasks.workunit.client.0.smithi006.stdout:9/681: mknod d0/d8/d80/cdc 0 2024-03-12T16:10:56.638 INFO:tasks.workunit.client.1.smithi134.stdout:9/998: link d5/d20/d72/la9 d5/d10/d35/d49/d54/d5e/d82/l133 0 2024-03-12T16:10:56.640 INFO:tasks.workunit.client.0.smithi006.stdout:6/775: truncate d3/d11/d10/da7/d8e/de1/d60/fb6 826523 0 2024-03-12T16:10:56.641 INFO:tasks.workunit.client.1.smithi134.stdout:9/999: write d5/d10/d35/d49/f4a [4894375,5597] 0 2024-03-12T16:10:56.641 INFO:tasks.workunit.client.1.smithi134.stdout:1/720: dread d0/d16/d9/d13/d21/d20/f8e [0,4194304] 0 2024-03-12T16:10:56.644 INFO:tasks.workunit.client.1.smithi134.stdout:1/721: mkdir d0/d16/d9/d13/d21/df0 0 2024-03-12T16:10:56.645 INFO:tasks.workunit.client.1.smithi134.stdout:1/722: fdatasync d0/d16/f14 0 2024-03-12T16:10:56.646 INFO:tasks.workunit.client.0.smithi006.stdout:8/696: rename d2/db/f62 to d2/db/d1a/d21/dad/fe3 0 2024-03-12T16:10:56.648 INFO:tasks.workunit.client.0.smithi006.stdout:1/783: symlink d0/d25/d2a/d35/db3/l10f 0 2024-03-12T16:10:56.651 INFO:tasks.workunit.client.0.smithi006.stdout:1/784: fdatasync d0/d25/d2a/f3b 0 2024-03-12T16:10:56.654 INFO:tasks.workunit.client.0.smithi006.stdout:9/682: creat d0/d83/d90/fdd x:0 0 0 2024-03-12T16:10:56.655 INFO:tasks.workunit.client.0.smithi006.stdout:4/819: read - d1/db/d39/dbf/dec/d5a/d60/fd3 zero size 2024-03-12T16:10:56.657 INFO:tasks.workunit.client.0.smithi006.stdout:6/776: dwrite d3/d11/d10/d1b/d6e/d80/f118 [0,4194304] 0 2024-03-12T16:10:56.658 INFO:tasks.workunit.client.0.smithi006.stdout:7/889: symlink de/dc2/l12b 0 2024-03-12T16:10:56.659 INFO:tasks.workunit.client.0.smithi006.stdout:0/772: rmdir d2/d6/d10/ddb/dea 0 2024-03-12T16:10:56.667 INFO:tasks.workunit.client.1.smithi134.stdout:1/723: dread d0/f2a [0,4194304] 0 2024-03-12T16:10:56.668 INFO:tasks.workunit.client.1.smithi134.stdout:1/724: readlink d0/l19 0 2024-03-12T16:10:56.669 INFO:tasks.workunit.client.0.smithi006.stdout:8/697: dwrite d2/db/d1a/d7a/dcc/fce [0,4194304] 0 2024-03-12T16:10:56.672 INFO:tasks.workunit.client.0.smithi006.stdout:5/738: getdents d7/d9/d31/d3b/d4f/d65/d69 0 2024-03-12T16:10:56.675 INFO:tasks.workunit.client.0.smithi006.stdout:0/773: mknod d2/d6/d10/d11/d7e/dbe/cfe 0 2024-03-12T16:10:56.677 INFO:tasks.workunit.client.0.smithi006.stdout:8/698: chown d2/db/c67 8018435 1 2024-03-12T16:10:56.677 INFO:tasks.workunit.client.0.smithi006.stdout:4/820: mkdir d1/db/d39/dbf/dec/d10e 0 2024-03-12T16:10:56.679 INFO:tasks.workunit.client.0.smithi006.stdout:9/683: dread d0/d8/d16/d2f/f4c [0,4194304] 0 2024-03-12T16:10:56.680 INFO:tasks.workunit.client.1.smithi134.stdout:1/725: dwrite d0/d30/d86/f9e [0,4194304] 0 2024-03-12T16:10:56.681 INFO:tasks.workunit.client.0.smithi006.stdout:1/785: dwrite d0/d25/d2a/d43/d63/db6/fdc [0,4194304] 0 2024-03-12T16:10:56.681 INFO:tasks.workunit.client.0.smithi006.stdout:5/739: creat d7/d8/d8a/d92/ff3 x:0 0 0 2024-03-12T16:10:56.682 INFO:tasks.workunit.client.0.smithi006.stdout:8/699: chown d2/db/d1a/d23/l58 6904238 1 2024-03-12T16:10:56.683 INFO:tasks.workunit.client.1.smithi134.stdout:1/726: mkdir d0/d16/d9/d51/db7/dbb/df1 0 2024-03-12T16:10:56.689 INFO:tasks.workunit.client.1.smithi134.stdout:1/727: dwrite d0/d30/fb4 [0,4194304] 0 2024-03-12T16:10:56.690 INFO:tasks.workunit.client.0.smithi006.stdout:9/684: readlink d0/d4/d70/lbd 0 2024-03-12T16:10:56.693 INFO:tasks.workunit.client.1.smithi134.stdout:1/728: creat d0/d42/ff2 x:0 0 0 2024-03-12T16:10:56.693 INFO:tasks.workunit.client.0.smithi006.stdout:9/685: truncate d0/d8/fc3 647724 0 2024-03-12T16:10:56.694 INFO:tasks.workunit.client.0.smithi006.stdout:1/786: stat d0/d25/d2a/d43/le5 0 2024-03-12T16:10:56.695 INFO:tasks.workunit.client.1.smithi134.stdout:1/729: mknod d0/d16/d9/d13/cf3 0 2024-03-12T16:10:56.696 INFO:tasks.workunit.client.0.smithi006.stdout:7/890: dwrite de/d2c/d4f/dba/d40/f63 [4194304,4194304] 0 2024-03-12T16:10:56.696 INFO:tasks.workunit.client.1.smithi134.stdout:1/730: readlink d0/d42/la6 0 2024-03-12T16:10:56.696 INFO:tasks.workunit.client.1.smithi134.stdout:1/731: chown d0/d16/d9/c43 14329772 1 2024-03-12T16:10:56.697 INFO:tasks.workunit.client.1.smithi134.stdout:1/732: chown d0/d42/d47/l7b 0 1 2024-03-12T16:10:56.700 INFO:tasks.workunit.client.0.smithi006.stdout:4/821: unlink d1/db/d39/dbf/dec/d5a/d60/f105 0 2024-03-12T16:10:56.700 INFO:tasks.workunit.client.0.smithi006.stdout:4/822: chown d1/db/f3c 865419 1 2024-03-12T16:10:56.701 INFO:tasks.workunit.client.0.smithi006.stdout:5/740: symlink d7/d9/d31/d3b/dba/lf4 0 2024-03-12T16:10:56.701 INFO:tasks.workunit.client.0.smithi006.stdout:0/774: write d2/d6/d37/f45 [483283,129746] 0 2024-03-12T16:10:56.701 INFO:tasks.workunit.client.0.smithi006.stdout:9/686: mkdir d0/d4/d70/d71/dde 0 2024-03-12T16:10:56.704 INFO:tasks.workunit.client.0.smithi006.stdout:8/700: truncate d2/db/d1a/d21/d4f/fa0 3550734 0 2024-03-12T16:10:56.706 INFO:tasks.workunit.client.0.smithi006.stdout:9/687: fsync d0/d8/d16/d7d/db5/fb7 0 2024-03-12T16:10:56.706 INFO:tasks.workunit.client.0.smithi006.stdout:6/777: dread d3/d11/d3b/f99 [0,4194304] 0 2024-03-12T16:10:56.707 INFO:tasks.workunit.client.0.smithi006.stdout:4/823: mknod d1/db/d39/dbf/c10f 0 2024-03-12T16:10:56.707 INFO:tasks.workunit.client.0.smithi006.stdout:0/775: chown d2/d6/d10/d11/d1d/ff2 32606 1 2024-03-12T16:10:56.708 INFO:tasks.workunit.client.0.smithi006.stdout:1/787: symlink d0/d25/db1/dd9/l110 0 2024-03-12T16:10:56.708 INFO:tasks.workunit.client.0.smithi006.stdout:8/701: chown d2/db/f39 334833386 1 2024-03-12T16:10:56.709 INFO:tasks.workunit.client.0.smithi006.stdout:0/776: readlink d2/d6/l46 0 2024-03-12T16:10:56.710 INFO:tasks.workunit.client.1.smithi134.stdout:7/999: sync 2024-03-12T16:10:56.710 INFO:tasks.workunit.client.0.smithi006.stdout:4/824: chown d1/db/d39/dbf/dec/l10 105287052 1 2024-03-12T16:10:56.711 INFO:tasks.workunit.client.0.smithi006.stdout:8/702: dread - d2/db/d1a/d21/dad/d7c/fc8 zero size 2024-03-12T16:10:56.712 INFO:tasks.workunit.client.0.smithi006.stdout:9/688: creat d0/d4/d9b/fdf x:0 0 0 2024-03-12T16:10:56.713 INFO:tasks.workunit.client.0.smithi006.stdout:7/891: link de/d2c/d93/dbe/la6 de/d2c/d93/dbe/d4a/d6a/dc7/l12c 0 2024-03-12T16:10:56.714 INFO:tasks.workunit.client.0.smithi006.stdout:6/778: mkdir d3/d11/d10/d19/d119 0 2024-03-12T16:10:56.715 INFO:tasks.workunit.client.0.smithi006.stdout:9/689: fsync d0/d4/d70/d86/f63 0 2024-03-12T16:10:56.716 INFO:tasks.workunit.client.0.smithi006.stdout:8/703: truncate d2/db/d1a/d7a/faf 126471 0 2024-03-12T16:10:56.716 INFO:tasks.workunit.client.0.smithi006.stdout:4/825: mknod d1/db/d1d/c110 0 2024-03-12T16:10:56.717 INFO:tasks.workunit.client.0.smithi006.stdout:8/704: stat d2/d11/l2f 0 2024-03-12T16:10:56.717 INFO:tasks.workunit.client.0.smithi006.stdout:0/777: getdents d2/d6/d10/d11/d32/de0 0 2024-03-12T16:10:56.718 INFO:tasks.workunit.client.0.smithi006.stdout:9/690: chown d0/d8/d16/d2f/lb9 29920 1 2024-03-12T16:10:56.721 INFO:tasks.workunit.client.0.smithi006.stdout:0/778: write d2/d6/d10/d11/d7e/da6/de4/ff7 [172539,112647] 0 2024-03-12T16:10:56.723 INFO:tasks.workunit.client.0.smithi006.stdout:0/779: read d2/d6/d10/d11/d7e/da6/f9a [704961,35038] 0 2024-03-12T16:10:56.723 INFO:tasks.workunit.client.0.smithi006.stdout:6/779: symlink d3/d11/d10/da7/dd5/ddb/d112/l11a 0 2024-03-12T16:10:56.725 INFO:tasks.workunit.client.0.smithi006.stdout:0/780: stat d2/d6/d10/d11/d32/f4a 0 2024-03-12T16:10:56.726 INFO:tasks.workunit.client.1.smithi134.stdout:1/733: dread d0/d16/d9/d13/d21/d2f/f68 [0,4194304] 0 2024-03-12T16:10:56.727 INFO:tasks.workunit.client.0.smithi006.stdout:9/691: creat d0/d4/d70/fe0 x:0 0 0 2024-03-12T16:10:56.727 INFO:tasks.workunit.client.0.smithi006.stdout:0/781: read - d2/d88/dc9/ffa zero size 2024-03-12T16:10:56.727 INFO:tasks.workunit.client.0.smithi006.stdout:0/782: stat d2 0 2024-03-12T16:10:56.728 INFO:tasks.workunit.client.0.smithi006.stdout:8/705: fsync d2/db/d1a/d21/dad/f75 0 2024-03-12T16:10:56.728 INFO:tasks.workunit.client.0.smithi006.stdout:0/783: chown d2/f2b 3922741 1 2024-03-12T16:10:56.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/734: rename d0/d16/ca to d0/d16/d9/d13/d21/df0/cf4 0 2024-03-12T16:10:56.730 INFO:tasks.workunit.client.0.smithi006.stdout:4/826: mknod d1/db/c111 0 2024-03-12T16:10:56.730 INFO:tasks.workunit.client.1.smithi134.stdout:1/735: stat d0/d16/d9/d13/d21/d20/fd8 0 2024-03-12T16:10:56.731 INFO:tasks.workunit.client.1.smithi134.stdout:1/736: chown d0/l1f 2026 1 2024-03-12T16:10:56.733 INFO:tasks.workunit.client.0.smithi006.stdout:9/692: fdatasync d0/d8/d16/d2f/f4c 0 2024-03-12T16:10:56.736 INFO:tasks.workunit.client.0.smithi006.stdout:0/784: creat d2/d6/d10/d11/d1d/d79/fff x:0 0 0 2024-03-12T16:10:56.737 INFO:tasks.workunit.client.1.smithi134.stdout:1/737: dwrite d0/f12 [4194304,4194304] 0 2024-03-12T16:10:56.737 INFO:tasks.workunit.client.0.smithi006.stdout:1/788: write d0/fc [3954142,37048] 0 2024-03-12T16:10:56.738 INFO:tasks.workunit.client.0.smithi006.stdout:4/827: symlink d1/db/d39/d42/l112 0 2024-03-12T16:10:56.740 INFO:tasks.workunit.client.0.smithi006.stdout:0/785: dread - d2/d6/d10/d11/d1d/ff2 zero size 2024-03-12T16:10:56.741 INFO:tasks.workunit.client.0.smithi006.stdout:7/892: write de/dc2/f9d [4306719,70963] 0 2024-03-12T16:10:56.741 INFO:tasks.workunit.client.1.smithi134.stdout:1/738: mknod d0/d16/d9/d13/d38/cf5 0 2024-03-12T16:10:56.744 INFO:tasks.workunit.client.1.smithi134.stdout:1/739: mknod d0/d16/d9/d13/d38/def/cf6 0 2024-03-12T16:10:56.745 INFO:tasks.workunit.client.1.smithi134.stdout:1/740: chown d0/d30/d48/da1/fdb 463929 1 2024-03-12T16:10:56.746 INFO:tasks.workunit.client.0.smithi006.stdout:4/828: mknod d1/db/d1d/d10b/c113 0 2024-03-12T16:10:56.747 INFO:tasks.workunit.client.0.smithi006.stdout:9/693: dwrite d0/d8/d16/d2f/fda [0,4194304] 0 2024-03-12T16:10:56.748 INFO:tasks.workunit.client.0.smithi006.stdout:0/786: mkdir d2/d6/d37/d100 0 2024-03-12T16:10:56.749 INFO:tasks.workunit.client.1.smithi134.stdout:1/741: dread d0/d16/d9/d73/f91 [0,4194304] 0 2024-03-12T16:10:56.750 INFO:tasks.workunit.client.1.smithi134.stdout:1/742: stat d0/d16/d9/d13/d21/d20/c50 0 2024-03-12T16:10:56.751 INFO:tasks.workunit.client.1.smithi134.stdout:1/743: dread - d0/d30/d48/dab/fe2 zero size 2024-03-12T16:10:56.753 INFO:tasks.workunit.client.1.smithi134.stdout:1/744: creat d0/d42/d47/ff7 x:0 0 0 2024-03-12T16:10:56.753 INFO:tasks.workunit.client.0.smithi006.stdout:9/694: read d0/d8/d16/f43 [329127,19625] 0 2024-03-12T16:10:56.753 INFO:tasks.workunit.client.0.smithi006.stdout:1/789: mkdir d0/d25/d2a/d43/d68/d111 0 2024-03-12T16:10:56.756 INFO:tasks.workunit.client.0.smithi006.stdout:1/790: write d0/d25/d67/db0/fb4 [2030840,17202] 0 2024-03-12T16:10:56.757 INFO:tasks.workunit.client.1.smithi134.stdout:1/745: dread d0/d16/d9/d13/d38/f69 [0,4194304] 0 2024-03-12T16:10:56.758 INFO:tasks.workunit.client.0.smithi006.stdout:7/893: dread de/d2c/d4f/dba/fdf [0,4194304] 0 2024-03-12T16:10:56.759 INFO:tasks.workunit.client.0.smithi006.stdout:9/695: mknod d0/d8f/ce1 0 2024-03-12T16:10:56.759 INFO:tasks.workunit.client.0.smithi006.stdout:6/780: dwrite d3/d47/db0/f116 [0,4194304] 0 2024-03-12T16:10:56.761 INFO:tasks.workunit.client.0.smithi006.stdout:0/787: mknod d2/d39/c101 0 2024-03-12T16:10:56.764 INFO:tasks.workunit.client.0.smithi006.stdout:4/829: truncate d1/d38/d79/f84 859298 0 2024-03-12T16:10:56.764 INFO:tasks.workunit.client.1.smithi134.stdout:1/746: dwrite d0/d16/d9/fa4 [0,4194304] 0 2024-03-12T16:10:56.765 INFO:tasks.workunit.client.0.smithi006.stdout:9/696: chown d0/d4/d3b/c79 364906239 1 2024-03-12T16:10:56.765 INFO:tasks.workunit.client.0.smithi006.stdout:0/788: chown d2/d6/d10/d11/d1d/d79/f95 44 1 2024-03-12T16:10:56.767 INFO:tasks.workunit.client.0.smithi006.stdout:6/781: write d3/d11/d3b/db4/f109 [955723,79131] 0 2024-03-12T16:10:56.767 INFO:tasks.workunit.client.1.smithi134.stdout:1/747: creat d0/d16/d9/d51/de1/ff8 x:0 0 0 2024-03-12T16:10:56.768 INFO:tasks.workunit.client.1.smithi134.stdout:1/748: chown d0/fd 190088892 1 2024-03-12T16:10:56.769 INFO:tasks.workunit.client.0.smithi006.stdout:9/697: mkdir d0/d83/d90/dc0/de2 0 2024-03-12T16:10:56.770 INFO:tasks.workunit.client.1.smithi134.stdout:1/749: write d0/d42/f98 [4797157,79758] 0 2024-03-12T16:10:56.773 INFO:tasks.workunit.client.0.smithi006.stdout:7/894: mknod de/d1c/d87/ddb/c12d 0 2024-03-12T16:10:56.776 INFO:tasks.workunit.client.1.smithi134.stdout:1/750: creat d0/d16/d9/d13/d21/d5f/d6f/dad/ff9 x:0 0 0 2024-03-12T16:10:56.777 INFO:tasks.workunit.client.1.smithi134.stdout:1/751: dread - d0/d16/d9/d13/d38/fb6 zero size 2024-03-12T16:10:56.778 INFO:tasks.workunit.client.0.smithi006.stdout:9/698: rmdir d0/d4/d18/d4d 39 2024-03-12T16:10:56.779 INFO:tasks.workunit.client.1.smithi134.stdout:1/752: truncate d0/d16/d9/d13/d38/f41 1226221 0 2024-03-12T16:10:56.781 INFO:tasks.workunit.client.0.smithi006.stdout:7/895: fdatasync de/d1c/d87/ddb/d7c/fa3 0 2024-03-12T16:10:56.781 INFO:tasks.workunit.client.1.smithi134.stdout:1/753: mkdir d0/d16/d9/d51/dfa 0 2024-03-12T16:10:56.784 INFO:tasks.workunit.client.0.smithi006.stdout:0/789: dwrite d2/d39/fdc [0,4194304] 0 2024-03-12T16:10:56.785 INFO:tasks.workunit.client.1.smithi134.stdout:1/754: link d0/l19 d0/d16/d9/lfb 0 2024-03-12T16:10:56.786 INFO:tasks.workunit.client.0.smithi006.stdout:9/699: creat d0/d83/fe3 x:0 0 0 2024-03-12T16:10:56.787 INFO:tasks.workunit.client.0.smithi006.stdout:6/782: link d3/d11/d10/da7/d8e/de1/f55 d3/d47/db0/f11b 0 2024-03-12T16:10:56.788 INFO:tasks.workunit.client.0.smithi006.stdout:7/896: fdatasync de/d1c/d87/ff8 0 2024-03-12T16:10:56.788 INFO:tasks.workunit.client.1.smithi134.stdout:1/755: rename d0/d30/d86/de7 to d0/d16/d9/d13/d21/d2f/d8d/dfc 0 2024-03-12T16:10:56.791 INFO:tasks.workunit.client.1.smithi134.stdout:1/756: getdents d0/d16/d9/d73 0 2024-03-12T16:10:56.792 INFO:tasks.workunit.client.0.smithi006.stdout:0/790: rmdir d2/d6/d10 39 2024-03-12T16:10:56.793 INFO:tasks.workunit.client.0.smithi006.stdout:1/791: dread d0/fe [0,4194304] 0 2024-03-12T16:10:56.796 INFO:tasks.workunit.client.0.smithi006.stdout:6/783: write d3/d11/d10/d1b/d6e/fa5 [786119,11308] 0 2024-03-12T16:10:56.798 INFO:tasks.workunit.client.1.smithi134.stdout:1/757: dwrite d0/d16/d9/fed [0,4194304] 0 2024-03-12T16:10:56.799 INFO:tasks.workunit.client.1.smithi134.stdout:1/758: chown d0/d16/d9/d13/d21/d2f/f9d 446317 1 2024-03-12T16:10:56.804 INFO:tasks.workunit.client.1.smithi134.stdout:1/759: rename d0/f3a to d0/d16/d9/d51/db7/dbb/ffd 0 2024-03-12T16:10:56.805 INFO:tasks.workunit.client.1.smithi134.stdout:1/760: mkdir d0/d16/d9/d51/db7/dbb/df1/dfe 0 2024-03-12T16:10:56.807 INFO:tasks.workunit.client.1.smithi134.stdout:1/761: creat d0/d16/d9/d51/fff x:0 0 0 2024-03-12T16:10:56.809 INFO:tasks.workunit.client.1.smithi134.stdout:1/762: rmdir d0/d16/d9/d13/d21/d5f 39 2024-03-12T16:10:56.810 INFO:tasks.workunit.client.1.smithi134.stdout:1/763: write d0/d16/d9/d13/f17 [4163848,89185] 0 2024-03-12T16:10:56.812 INFO:tasks.workunit.client.1.smithi134.stdout:1/764: fdatasync d0/d16/d9/d13/d38/f69 0 2024-03-12T16:10:56.812 INFO:tasks.workunit.client.1.smithi134.stdout:1/765: stat d0/d16/d9/d13/d38/def 0 2024-03-12T16:10:56.813 INFO:tasks.workunit.client.1.smithi134.stdout:1/766: chown d0/d16/d9/d13/d21/c89 390 1 2024-03-12T16:10:56.816 INFO:tasks.workunit.client.1.smithi134.stdout:1/767: getdents d0/d16/d9/d13/d21/d20 0 2024-03-12T16:10:56.857 INFO:tasks.workunit.client.0.smithi006.stdout:3/670: sync 2024-03-12T16:10:56.859 INFO:tasks.workunit.client.0.smithi006.stdout:4/830: dwrite d1/db/d39/dbf/dec/d5a/d60/fd3 [0,4194304] 0 2024-03-12T16:10:56.860 INFO:tasks.workunit.client.0.smithi006.stdout:7/897: rename de/d2c/dea/f10e to de/d7b/dc6/d11c/f12e 0 2024-03-12T16:10:56.862 INFO:tasks.workunit.client.0.smithi006.stdout:9/700: mknod d0/d4/d70/da6/ce4 0 2024-03-12T16:10:56.866 INFO:tasks.workunit.client.1.smithi134.stdout:1/768: write d0/d30/d48/f80 [255445,61485] 0 2024-03-12T16:10:56.868 INFO:tasks.workunit.client.0.smithi006.stdout:6/784: read d3/d11/d10/da7/d8e/de1/d60/fb6 [289540,85288] 0 2024-03-12T16:10:56.869 INFO:tasks.workunit.client.1.smithi134.stdout:1/769: creat d0/d16/d9/d51/db7/f100 x:0 0 0 2024-03-12T16:10:56.870 INFO:tasks.workunit.client.1.smithi134.stdout:1/770: creat d0/d16/d9/d51/de1/f101 x:0 0 0 2024-03-12T16:10:56.871 INFO:tasks.workunit.client.0.smithi006.stdout:4/831: symlink d1/db/de7/l114 0 2024-03-12T16:10:56.871 INFO:tasks.workunit.client.0.smithi006.stdout:7/898: dwrite de/d2c/d4f/dba/f76 [0,4194304] 0 2024-03-12T16:10:56.872 INFO:tasks.workunit.client.1.smithi134.stdout:1/771: readlink d0/d16/d9/d51/l9c 0 2024-03-12T16:10:56.872 INFO:tasks.workunit.client.0.smithi006.stdout:6/785: read d3/d11/d10/d28/f53 [7983259,16352] 0 2024-03-12T16:10:56.873 INFO:tasks.workunit.client.1.smithi134.stdout:1/772: creat d0/d30/d86/f102 x:0 0 0 2024-03-12T16:10:56.873 INFO:tasks.workunit.client.0.smithi006.stdout:7/899: fsync de/d7b/d7e/f94 0 2024-03-12T16:10:56.874 INFO:tasks.workunit.client.0.smithi006.stdout:3/671: getdents d8/d52/dcf 0 2024-03-12T16:10:56.875 INFO:tasks.workunit.client.1.smithi134.stdout:1/773: mkdir d0/d16/d9/d13/d38/d103 0 2024-03-12T16:10:56.876 INFO:tasks.workunit.client.0.smithi006.stdout:6/786: chown d3/d11/d10/d1b/d6e/d80/f118 2817864 1 2024-03-12T16:10:56.877 INFO:tasks.workunit.client.0.smithi006.stdout:9/701: symlink d0/d1f/le5 0 2024-03-12T16:10:56.880 INFO:tasks.workunit.client.0.smithi006.stdout:3/672: creat d8/d19/d26/d59/d2c/dc/d28/fe4 x:0 0 0 2024-03-12T16:10:56.880 INFO:tasks.workunit.client.0.smithi006.stdout:9/702: write d0/d83/d90/fdd [813714,117209] 0 2024-03-12T16:10:56.881 INFO:tasks.workunit.client.1.smithi134.stdout:1/774: dwrite d0/d16/d9/d13/d21/f4c [0,4194304] 0 2024-03-12T16:10:56.882 INFO:tasks.workunit.client.0.smithi006.stdout:6/787: read d3/d11/d10/da7/d9e/fa0 [39761,119498] 0 2024-03-12T16:10:56.886 INFO:tasks.workunit.client.1.smithi134.stdout:1/775: getdents d0/d16/d9/d13/d21/d20 0 2024-03-12T16:10:56.888 INFO:tasks.workunit.client.0.smithi006.stdout:7/900: dwrite de/d1c/d87/ddb/d97/f102 [0,4194304] 0 2024-03-12T16:10:56.890 INFO:tasks.workunit.client.0.smithi006.stdout:6/788: unlink d3/d11/d10/da7/f64 0 2024-03-12T16:10:56.891 INFO:tasks.workunit.client.0.smithi006.stdout:6/789: readlink d3/d11/l12 0 2024-03-12T16:10:56.892 INFO:tasks.workunit.client.0.smithi006.stdout:6/790: chown d3/d11/d10/d1b/c9d 301 1 2024-03-12T16:10:56.894 INFO:tasks.workunit.client.0.smithi006.stdout:0/791: truncate d2/d39/fdc 2502091 0 2024-03-12T16:10:56.897 INFO:tasks.workunit.client.0.smithi006.stdout:3/673: rename d8/d19/d26/d59/d2c/dc/d28/c2d to d8/d19/d26/d97/ce5 0 2024-03-12T16:10:56.898 INFO:tasks.workunit.client.0.smithi006.stdout:7/901: getdents de/dc2/d123 0 2024-03-12T16:10:56.898 INFO:tasks.workunit.client.1.smithi134.stdout:1/776: dwrite d0/d30/d86/f27 [0,4194304] 0 2024-03-12T16:10:56.900 INFO:tasks.workunit.client.1.smithi134.stdout:1/777: fdatasync d0/d16/d9/d13/d21/dac/fcc 0 2024-03-12T16:10:56.901 INFO:tasks.workunit.client.0.smithi006.stdout:3/674: write d8/d19/d26/d59/d2c/dc/db7/fc5 [964942,77921] 0 2024-03-12T16:10:56.901 INFO:tasks.workunit.client.0.smithi006.stdout:4/832: truncate d1/db/d39/dbf/dec/f1c 4626179 0 2024-03-12T16:10:56.903 INFO:tasks.workunit.client.0.smithi006.stdout:9/703: getdents d0/d1f 0 2024-03-12T16:10:56.903 INFO:tasks.workunit.client.0.smithi006.stdout:7/902: rmdir de/d2c/d93/dbe/d4a/d6a/dc7 39 2024-03-12T16:10:56.904 INFO:tasks.workunit.client.0.smithi006.stdout:4/833: stat d1/db/d1d/ce2 0 2024-03-12T16:10:56.905 INFO:tasks.workunit.client.0.smithi006.stdout:6/791: rename d3/cf to d3/d11/d10/da7/d8e/de1/c11c 0 2024-03-12T16:10:56.908 INFO:tasks.workunit.client.0.smithi006.stdout:7/903: unlink de/d2c/d4f/c106 0 2024-03-12T16:10:56.908 INFO:tasks.workunit.client.1.smithi134.stdout:1/778: creat d0/d16/d9/d13/d21/d5f/d6f/d85/dee/f104 x:0 0 0 2024-03-12T16:10:56.910 INFO:tasks.workunit.client.0.smithi006.stdout:4/834: symlink d1/db/d1d/d10b/l115 0 2024-03-12T16:10:56.912 INFO:tasks.workunit.client.1.smithi134.stdout:1/779: link d0/d16/f6d d0/d16/d9/d13/d21/f105 0 2024-03-12T16:10:56.913 INFO:tasks.workunit.client.1.smithi134.stdout:1/780: dread - d0/fd7 zero size 2024-03-12T16:10:56.913 INFO:tasks.workunit.client.0.smithi006.stdout:3/675: rename d8/d52/f61 to d8/d19/d26/d59/d2c/dc/d28/fe6 0 2024-03-12T16:10:56.913 INFO:tasks.workunit.client.1.smithi134.stdout:1/781: read - d0/d16/d9/d51/fff zero size 2024-03-12T16:10:56.914 INFO:tasks.workunit.client.0.smithi006.stdout:9/704: dwrite d0/d8/d16/d7d/db5/fb7 [4194304,4194304] 0 2024-03-12T16:10:56.915 INFO:tasks.workunit.client.0.smithi006.stdout:0/792: dread d2/d39/fdc [0,4194304] 0 2024-03-12T16:10:56.916 INFO:tasks.workunit.client.0.smithi006.stdout:4/835: creat d1/d91/f116 x:0 0 0 2024-03-12T16:10:56.917 INFO:tasks.workunit.client.0.smithi006.stdout:7/904: creat de/d7b/dc6/d11c/f12f x:0 0 0 2024-03-12T16:10:56.919 INFO:tasks.workunit.client.0.smithi006.stdout:3/676: truncate d8/d52/d9e/fa9 1275264 0 2024-03-12T16:10:56.928 INFO:tasks.workunit.client.0.smithi006.stdout:9/705: creat d0/d8/d16/d7d/d20/d37/dc5/dcf/fe6 x:0 0 0 2024-03-12T16:10:56.928 INFO:tasks.workunit.client.1.smithi134.stdout:1/782: dwrite d0/d16/d39/f46 [0,4194304] 0 2024-03-12T16:10:56.929 INFO:tasks.workunit.client.0.smithi006.stdout:6/792: dread d3/d11/d10/d1b/d6e/ff3 [0,4194304] 0 2024-03-12T16:10:56.929 INFO:tasks.workunit.client.0.smithi006.stdout:4/836: dwrite d1/db/d39/f73 [4194304,4194304] 0 2024-03-12T16:10:56.930 INFO:tasks.workunit.client.1.smithi134.stdout:1/783: read d0/d16/d9/d13/d21/dac/fcc [904493,610] 0 2024-03-12T16:10:56.931 INFO:tasks.workunit.client.0.smithi006.stdout:7/905: creat de/d2c/d4f/dba/d40/f130 x:0 0 0 2024-03-12T16:10:56.931 INFO:tasks.workunit.client.0.smithi006.stdout:9/706: write d0/d8/fc3 [867804,119283] 0 2024-03-12T16:10:56.932 INFO:tasks.workunit.client.0.smithi006.stdout:3/677: symlink d8/d19/d26/d59/d2c/dc/d28/d2f/le7 0 2024-03-12T16:10:56.934 INFO:tasks.workunit.client.1.smithi134.stdout:1/784: fdatasync d0/d16/f14 0 2024-03-12T16:10:56.935 INFO:tasks.workunit.client.0.smithi006.stdout:3/678: read d8/d19/fa7 [72634,42700] 0 2024-03-12T16:10:56.937 INFO:tasks.workunit.client.0.smithi006.stdout:6/793: creat d3/d11/d3b/db4/dc3/f11d x:0 0 0 2024-03-12T16:10:56.938 INFO:tasks.workunit.client.1.smithi134.stdout:1/785: truncate d0/d16/d9/d13/d21/d5f/d6f/d85/f83 1974163 0 2024-03-12T16:10:56.938 INFO:tasks.workunit.client.0.smithi006.stdout:0/793: rename d2/d6/d10/d11/d7e/da6/de4/fb7 to d2/d6/d10/d11/d7e/da6/d9e/f102 0 2024-03-12T16:10:56.941 INFO:tasks.workunit.client.0.smithi006.stdout:7/906: truncate de/d2c/d93/dbe/d4a/dd1/fe2 938258 0 2024-03-12T16:10:56.942 INFO:tasks.workunit.client.1.smithi134.stdout:1/786: getdents d0/d42/d47 0 2024-03-12T16:10:56.943 INFO:tasks.workunit.client.0.smithi006.stdout:9/707: creat d0/d8f/dc6/fe7 x:0 0 0 2024-03-12T16:10:56.944 INFO:tasks.workunit.client.0.smithi006.stdout:0/794: mkdir d2/d88/d103 0 2024-03-12T16:10:56.944 INFO:tasks.workunit.client.1.smithi134.stdout:1/787: mknod d0/d16/d9/d51/de1/c106 0 2024-03-12T16:10:56.945 INFO:tasks.workunit.client.0.smithi006.stdout:7/907: fsync de/d1c/d87/ddb/d7c/fd4 0 2024-03-12T16:10:56.945 INFO:tasks.workunit.client.1.smithi134.stdout:1/788: readlink d0/d16/d9/l9a 0 2024-03-12T16:10:56.945 INFO:tasks.workunit.client.1.smithi134.stdout:1/789: dread - d0/d30/d86/f102 zero size 2024-03-12T16:10:56.948 INFO:tasks.workunit.client.0.smithi006.stdout:6/794: rename d3/d11/d10/d1b/d6e/l92 to d3/d11/d3b/d59/l11e 0 2024-03-12T16:10:56.949 INFO:tasks.workunit.client.0.smithi006.stdout:3/679: dwrite d8/d19/d26/d59/d2c/d41/d8b/d93/fd7 [0,4194304] 0 2024-03-12T16:10:56.950 INFO:tasks.workunit.client.0.smithi006.stdout:3/680: readlink d8/ld2 0 2024-03-12T16:10:56.952 INFO:tasks.workunit.client.0.smithi006.stdout:0/795: creat d2/d6/d10/d11/d7e/da6/de4/f104 x:0 0 0 2024-03-12T16:10:56.954 INFO:tasks.workunit.client.0.smithi006.stdout:9/708: mknod d0/d8/d16/ce8 0 2024-03-12T16:10:56.955 INFO:tasks.workunit.client.0.smithi006.stdout:6/795: creat d3/d11/d10/d28/f11f x:0 0 0 2024-03-12T16:10:56.956 INFO:tasks.workunit.client.0.smithi006.stdout:3/681: creat d8/d19/d26/d97/dce/fe8 x:0 0 0 2024-03-12T16:10:56.959 INFO:tasks.workunit.client.0.smithi006.stdout:7/908: rename de/d1c/d35/lac to de/d2c/d4f/dba/d39/d81/l131 0 2024-03-12T16:10:56.961 INFO:tasks.workunit.client.1.smithi134.stdout:1/790: dread d0/d42/f98 [0,4194304] 0 2024-03-12T16:10:56.962 INFO:tasks.workunit.client.0.smithi006.stdout:6/796: write f1 [616130,63725] 0 2024-03-12T16:10:56.966 INFO:tasks.workunit.client.0.smithi006.stdout:9/709: symlink d0/d4/d18/d4d/le9 0 2024-03-12T16:10:56.967 INFO:tasks.workunit.client.0.smithi006.stdout:9/710: chown d0/d4/d70/fa9 41456 1 2024-03-12T16:10:56.967 INFO:tasks.workunit.client.0.smithi006.stdout:9/711: chown d0 1695 1 2024-03-12T16:10:56.967 INFO:tasks.workunit.client.0.smithi006.stdout:4/837: truncate d1/d38/d79/f96 367758 0 2024-03-12T16:10:56.968 INFO:tasks.workunit.client.1.smithi134.stdout:1/791: dwrite d0/d16/d9/d51/db7/f100 [0,4194304] 0 2024-03-12T16:10:56.969 INFO:tasks.workunit.client.0.smithi006.stdout:7/909: rename de/d1c/d87/ddb/d7c/d11d to de/d1c/d87/ddb/d7c/d113/d132 0 2024-03-12T16:10:56.972 INFO:tasks.workunit.client.1.smithi134.stdout:1/792: write d0/d42/f98 [3490765,11670] 0 2024-03-12T16:10:56.980 INFO:tasks.workunit.client.0.smithi006.stdout:3/682: getdents d8/d19/d26/d59 0 2024-03-12T16:10:56.981 INFO:tasks.workunit.client.0.smithi006.stdout:0/796: truncate d2/d6/d10/d11/f35 3488340 0 2024-03-12T16:10:56.982 INFO:tasks.workunit.client.0.smithi006.stdout:3/683: chown d8/d19/d26/d97/dce/fdb 581268027 1 2024-03-12T16:10:56.984 INFO:tasks.workunit.client.0.smithi006.stdout:9/712: getdents d0/d4/d70/da6 0 2024-03-12T16:10:56.987 INFO:tasks.workunit.client.0.smithi006.stdout:6/797: write d3/d11/d10/da7/d8e/d8b/fd8 [890659,21683] 0 2024-03-12T16:10:56.989 INFO:tasks.workunit.client.0.smithi006.stdout:3/684: creat d8/d52/d6c/fe9 x:0 0 0 2024-03-12T16:10:56.990 INFO:tasks.workunit.client.0.smithi006.stdout:4/838: write d1/db/d1d/d2f/d6b/fe0 [751549,1704] 0 2024-03-12T16:10:56.994 INFO:tasks.workunit.client.0.smithi006.stdout:0/797: creat d2/d6/d10/d11/d1d/f105 x:0 0 0 2024-03-12T16:10:56.994 INFO:tasks.workunit.client.0.smithi006.stdout:4/839: unlink d1/db/c111 0 2024-03-12T16:10:56.996 INFO:tasks.workunit.client.0.smithi006.stdout:7/910: dread de/d2c/d93/dbe/f37 [0,4194304] 0 2024-03-12T16:10:56.997 INFO:tasks.workunit.client.0.smithi006.stdout:4/840: chown d1/db/d39/c7c 435090 1 2024-03-12T16:10:56.998 INFO:tasks.workunit.client.0.smithi006.stdout:9/713: dwrite d0/d4/fb8 [0,4194304] 0 2024-03-12T16:10:57.001 INFO:tasks.workunit.client.0.smithi006.stdout:0/798: mkdir d2/d106 0 2024-03-12T16:10:57.002 INFO:tasks.workunit.client.0.smithi006.stdout:3/685: link d8/d52/d6c/fe9 d8/d19/d26/d59/d2c/d41/d45/fea 0 2024-03-12T16:10:57.003 INFO:tasks.workunit.client.0.smithi006.stdout:7/911: mkdir de/d2c/d4f/dba/d39/d81/d133 0 2024-03-12T16:10:57.004 INFO:tasks.workunit.client.0.smithi006.stdout:3/686: chown d8/d19/d26/d59/d2c/d41/ld3 8019 1 2024-03-12T16:10:57.006 INFO:tasks.workunit.client.0.smithi006.stdout:9/714: creat d0/d4/d70/fea x:0 0 0 2024-03-12T16:10:57.007 INFO:tasks.workunit.client.0.smithi006.stdout:9/715: fsync d0/d8/d16/d7d/d20/d37/f5f 0 2024-03-12T16:10:57.008 INFO:tasks.workunit.client.0.smithi006.stdout:6/798: truncate d3/d11/d10/d1b/fdc 810 0 2024-03-12T16:10:57.009 INFO:tasks.workunit.client.0.smithi006.stdout:0/799: symlink d2/d88/dc9/l107 0 2024-03-12T16:10:57.011 INFO:tasks.workunit.client.0.smithi006.stdout:7/912: unlink de/d2c/d4f/dba/d39/ld5 0 2024-03-12T16:10:57.015 INFO:tasks.workunit.client.0.smithi006.stdout:7/913: mkdir de/d2c/d93/dbe/d4a/dd1/d118/d134 0 2024-03-12T16:10:57.018 INFO:tasks.workunit.client.0.smithi006.stdout:0/800: dwrite d2/d88/dc9/ffa [0,4194304] 0 2024-03-12T16:10:57.019 INFO:tasks.workunit.client.0.smithi006.stdout:9/716: dread d0/d8/d16/d7d/d20/faf [0,4194304] 0 2024-03-12T16:10:57.023 INFO:tasks.workunit.client.0.smithi006.stdout:9/717: chown d0/d4/d70/f8e 4461328 1 2024-03-12T16:10:57.027 INFO:tasks.workunit.client.0.smithi006.stdout:7/914: dwrite de/d7b/d7e/ffb [4194304,4194304] 0 2024-03-12T16:10:57.032 INFO:tasks.workunit.client.0.smithi006.stdout:4/841: dread d1/db/d39/d42/f98 [0,4194304] 0 2024-03-12T16:10:57.034 INFO:tasks.workunit.client.0.smithi006.stdout:4/842: stat d1/ld 0 2024-03-12T16:10:57.036 INFO:tasks.workunit.client.0.smithi006.stdout:4/843: mknod d1/db/d39/dbf/dec/c117 0 2024-03-12T16:10:57.037 INFO:tasks.workunit.client.0.smithi006.stdout:0/801: write d2/d6/fa0 [323147,87977] 0 2024-03-12T16:10:57.038 INFO:tasks.workunit.client.0.smithi006.stdout:4/844: dread - d1/db/d39/dbf/dec/d5a/fca zero size 2024-03-12T16:10:57.042 INFO:tasks.workunit.client.0.smithi006.stdout:4/845: symlink d1/db/d1d/l118 0 2024-03-12T16:10:57.045 INFO:tasks.workunit.client.0.smithi006.stdout:9/718: truncate d0/d8/fc3 819613 0 2024-03-12T16:10:57.046 INFO:tasks.workunit.client.0.smithi006.stdout:4/846: mknod d1/db/d1d/d2f/d6b/c119 0 2024-03-12T16:10:57.046 INFO:tasks.workunit.client.0.smithi006.stdout:0/802: dwrite d2/d6/d37/d97/ff1 [0,4194304] 0 2024-03-12T16:10:57.047 INFO:tasks.workunit.client.0.smithi006.stdout:9/719: read d0/d4/fb8 [1482923,31901] 0 2024-03-12T16:10:57.050 INFO:tasks.workunit.client.0.smithi006.stdout:9/720: creat d0/d4/d9b/feb x:0 0 0 2024-03-12T16:10:57.052 INFO:tasks.workunit.client.0.smithi006.stdout:0/803: mkdir d2/d6/d108 0 2024-03-12T16:10:57.054 INFO:tasks.workunit.client.0.smithi006.stdout:4/847: getdents d1/db/d39/dbf/dec/d10e 0 2024-03-12T16:10:57.056 INFO:tasks.workunit.client.0.smithi006.stdout:9/721: creat d0/d8/d16/d7d/d20/d37/dc5/fec x:0 0 0 2024-03-12T16:10:57.056 INFO:tasks.workunit.client.0.smithi006.stdout:7/915: dwrite de/d2c/faa [0,4194304] 0 2024-03-12T16:10:57.058 INFO:tasks.workunit.client.0.smithi006.stdout:0/804: creat d2/d6/d10/d11/d7e/da6/de4/f109 x:0 0 0 2024-03-12T16:10:57.060 INFO:tasks.workunit.client.0.smithi006.stdout:9/722: mknod d0/d8f/dc6/ced 0 2024-03-12T16:10:57.061 INFO:tasks.workunit.client.0.smithi006.stdout:7/916: symlink de/d2c/l135 0 2024-03-12T16:10:57.068 INFO:tasks.workunit.client.0.smithi006.stdout:7/917: getdents de/d2c/d4f/dba/d39/d81 0 2024-03-12T16:10:57.070 INFO:tasks.workunit.client.0.smithi006.stdout:0/805: dwrite d2/d6/d10/d11/d1d/d2e/f33 [0,4194304] 0 2024-03-12T16:10:57.071 INFO:tasks.workunit.client.0.smithi006.stdout:0/806: fsync d2/f1f 0 2024-03-12T16:10:57.083 INFO:tasks.workunit.client.0.smithi006.stdout:4/848: dread d1/db/d39/dbf/dec/d5a/f8d [0,4194304] 0 2024-03-12T16:10:57.087 INFO:tasks.workunit.client.0.smithi006.stdout:4/849: read d1/db/d1d/d2f/fbd [2189277,104868] 0 2024-03-12T16:10:57.089 INFO:tasks.workunit.client.0.smithi006.stdout:0/807: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:57.090 INFO:tasks.workunit.client.0.smithi006.stdout:4/850: fsync d1/db/d1d/d2f/d6b/fe0 0 2024-03-12T16:10:57.095 INFO:tasks.workunit.client.0.smithi006.stdout:0/808: dread d2/d6/d37/f45 [0,4194304] 0 2024-03-12T16:10:57.097 INFO:tasks.workunit.client.0.smithi006.stdout:7/918: dread de/d18/fa0 [0,4194304] 0 2024-03-12T16:10:57.097 INFO:tasks.workunit.client.0.smithi006.stdout:0/809: chown d2/d6 3583 1 2024-03-12T16:10:57.097 INFO:tasks.workunit.client.0.smithi006.stdout:9/723: dread d0/d4/f25 [0,4194304] 0 2024-03-12T16:10:57.097 INFO:tasks.workunit.client.0.smithi006.stdout:0/810: fsync d2/d6/f72 0 2024-03-12T16:10:57.099 INFO:tasks.workunit.client.0.smithi006.stdout:4/851: link d1/db/d39/d42/fbc d1/db/d39/dbf/dec/da8/f11a 0 2024-03-12T16:10:57.100 INFO:tasks.workunit.client.0.smithi006.stdout:9/724: mkdir d0/d8/d16/dee 0 2024-03-12T16:10:57.101 INFO:tasks.workunit.client.0.smithi006.stdout:4/852: read d1/db/d1d/d2f/d6b/fe0 [77527,30428] 0 2024-03-12T16:10:57.103 INFO:tasks.workunit.client.0.smithi006.stdout:4/853: stat d1/d38/d79/fe8 0 2024-03-12T16:10:57.103 INFO:tasks.workunit.client.0.smithi006.stdout:9/725: readlink d0/d4/d3b/d6a/l9e 0 2024-03-12T16:10:57.104 INFO:tasks.workunit.client.0.smithi006.stdout:0/811: rename d2/d88/dc9/ffa to d2/d6/d10/d11/d1d/f10a 0 2024-03-12T16:10:57.107 INFO:tasks.workunit.client.0.smithi006.stdout:7/919: dwrite de/d1c/d87/ddb/f2d [0,4194304] 0 2024-03-12T16:10:57.107 INFO:tasks.workunit.client.0.smithi006.stdout:9/726: chown d0/d8/d16/d7d/db5/fa3 88211236 1 2024-03-12T16:10:57.109 INFO:tasks.workunit.client.0.smithi006.stdout:7/920: dread - de/d2c/ff6 zero size 2024-03-12T16:10:57.110 INFO:tasks.workunit.client.0.smithi006.stdout:9/727: read d0/d8/d16/f31 [204902,58387] 0 2024-03-12T16:10:57.111 INFO:tasks.workunit.client.0.smithi006.stdout:9/728: dread - d0/d4/d70/fea zero size 2024-03-12T16:10:57.112 INFO:tasks.workunit.client.0.smithi006.stdout:9/729: write d0/d8/d80/f97 [349605,7846] 0 2024-03-12T16:10:57.118 INFO:tasks.workunit.client.0.smithi006.stdout:9/730: symlink d0/d83/d90/lef 0 2024-03-12T16:10:57.123 INFO:tasks.workunit.client.0.smithi006.stdout:0/812: link d2/d6/d10/d11/d32/da4/la9 d2/d6/d10/d11/d32/da4/db5/de7/l10b 0 2024-03-12T16:10:57.125 INFO:tasks.workunit.client.0.smithi006.stdout:9/731: dread d0/d8/d16/d7d/db5/f65 [0,4194304] 0 2024-03-12T16:10:57.125 INFO:tasks.workunit.client.0.smithi006.stdout:4/854: dwrite d1/d38/d79/fe8 [0,4194304] 0 2024-03-12T16:10:57.127 INFO:tasks.workunit.client.0.smithi006.stdout:9/732: readlink d0/d1f/l5b 0 2024-03-12T16:10:57.134 INFO:tasks.workunit.client.0.smithi006.stdout:4/855: chown d1/db/d39/dbf/dec/d5a/d60/lc3 0 1 2024-03-12T16:10:57.134 INFO:tasks.workunit.client.0.smithi006.stdout:9/733: rmdir d0/d4/da7 39 2024-03-12T16:10:57.134 INFO:tasks.workunit.client.0.smithi006.stdout:4/856: chown d1/f31 0 1 2024-03-12T16:10:57.134 INFO:tasks.workunit.client.0.smithi006.stdout:0/813: dwrite d2/d6/fb6 [0,4194304] 0 2024-03-12T16:10:57.136 INFO:tasks.workunit.client.0.smithi006.stdout:7/921: dread de/d18/f1b [0,4194304] 0 2024-03-12T16:10:57.137 INFO:tasks.workunit.client.0.smithi006.stdout:4/857: write d1/db/d1d/d2f/fc0 [3413329,75923] 0 2024-03-12T16:10:57.141 INFO:tasks.workunit.client.0.smithi006.stdout:4/858: dread - d1/db/d1d/d2f/d6b/ff9 zero size 2024-03-12T16:10:57.142 INFO:tasks.workunit.client.0.smithi006.stdout:0/814: read d2/d39/d42/f68 [3822129,19194] 0 2024-03-12T16:10:57.147 INFO:tasks.workunit.client.0.smithi006.stdout:9/734: dwrite d0/d8/d16/f43 [4194304,4194304] 0 2024-03-12T16:10:57.147 INFO:tasks.workunit.client.0.smithi006.stdout:0/815: write d2/d6/d10/d11/d7e/da6/de4/f104 [343136,111161] 0 2024-03-12T16:10:57.149 INFO:tasks.workunit.client.0.smithi006.stdout:0/816: chown d2/d6/d37/f45 166 1 2024-03-12T16:10:57.153 INFO:tasks.workunit.client.0.smithi006.stdout:7/922: write de/d2c/d93/dbe/d4a/d6a/f84 [4002615,95021] 0 2024-03-12T16:10:57.153 INFO:tasks.workunit.client.0.smithi006.stdout:0/817: mkdir d2/d6/d10/d11/d32/da4/db5/d10c 0 2024-03-12T16:10:57.155 INFO:tasks.workunit.client.0.smithi006.stdout:9/735: getdents d0/d8/d16 0 2024-03-12T16:10:57.158 INFO:tasks.workunit.client.0.smithi006.stdout:7/923: dread de/d2c/d4f/dba/fca [4194304,4194304] 0 2024-03-12T16:10:57.159 INFO:tasks.workunit.client.0.smithi006.stdout:9/736: unlink d0/d4/d18/d4d/le9 0 2024-03-12T16:10:57.160 INFO:tasks.workunit.client.0.smithi006.stdout:7/924: mknod de/d2c/d93/dbe/c136 0 2024-03-12T16:10:57.162 INFO:tasks.workunit.client.0.smithi006.stdout:9/737: mknod d0/d8/d16/d7d/db5/cf0 0 2024-03-12T16:10:57.164 INFO:tasks.workunit.client.1.smithi134.stdout:1/793: sync 2024-03-12T16:10:57.164 INFO:tasks.workunit.client.0.smithi006.stdout:9/738: creat d0/d4/d70/da6/ff1 x:0 0 0 2024-03-12T16:10:57.165 INFO:tasks.workunit.client.0.smithi006.stdout:9/739: fsync d0/d8/d16/d7d/d20/f34 0 2024-03-12T16:10:57.166 INFO:tasks.workunit.client.0.smithi006.stdout:9/740: chown d0/d4/d18/d4d/c62 159713 1 2024-03-12T16:10:57.167 INFO:tasks.workunit.client.1.smithi134.stdout:1/794: truncate d0/d42/f92 263903 0 2024-03-12T16:10:57.169 INFO:tasks.workunit.client.1.smithi134.stdout:1/795: truncate d0/d16/d9/d13/d21/d20/f7e 4953559 0 2024-03-12T16:10:57.170 INFO:tasks.workunit.client.0.smithi006.stdout:9/741: creat d0/d8/ff2 x:0 0 0 2024-03-12T16:10:57.170 INFO:tasks.workunit.client.0.smithi006.stdout:4/859: dread d1/db/d1d/d2f/f36 [0,4194304] 0 2024-03-12T16:10:57.171 INFO:tasks.workunit.client.0.smithi006.stdout:9/742: fdatasync d0/d8/d16/d7d/db5/fb7 0 2024-03-12T16:10:57.172 INFO:tasks.workunit.client.0.smithi006.stdout:4/860: creat d1/db/d1d/d2f/d6b/f11b x:0 0 0 2024-03-12T16:10:57.174 INFO:tasks.workunit.client.0.smithi006.stdout:9/743: unlink d0/d4/d3b/c79 0 2024-03-12T16:10:57.175 INFO:tasks.workunit.client.0.smithi006.stdout:4/861: read - d1/db/d1d/d2f/d6b/f7d zero size 2024-03-12T16:10:57.177 INFO:tasks.workunit.client.1.smithi134.stdout:1/796: truncate d0/d16/d9/fa4 155624 0 2024-03-12T16:10:57.178 INFO:tasks.workunit.client.0.smithi006.stdout:9/744: mkdir d0/d4/da7/df3 0 2024-03-12T16:10:57.179 INFO:tasks.workunit.client.0.smithi006.stdout:9/745: chown d0/d83 45439126 1 2024-03-12T16:10:57.180 INFO:tasks.workunit.client.0.smithi006.stdout:4/862: mknod d1/db/d39/c11c 0 2024-03-12T16:10:57.180 INFO:tasks.workunit.client.0.smithi006.stdout:0/818: dread d2/d6/d10/d11/d1d/d2e/f6a [4194304,4194304] 0 2024-03-12T16:10:57.181 INFO:tasks.workunit.client.1.smithi134.stdout:1/797: dread d0/d16/d9/d13/d21/d5f/d6f/d85/f83 [0,4194304] 0 2024-03-12T16:10:57.181 INFO:tasks.workunit.client.1.smithi134.stdout:1/798: read d0/d16/d9/fed [3509657,44866] 0 2024-03-12T16:10:57.182 INFO:tasks.workunit.client.0.smithi006.stdout:9/746: symlink d0/d83/d90/lf4 0 2024-03-12T16:10:57.183 INFO:tasks.workunit.client.0.smithi006.stdout:7/925: dread de/d18/f1f [0,4194304] 0 2024-03-12T16:10:57.184 INFO:tasks.workunit.client.0.smithi006.stdout:0/819: symlink d2/d6/d10/d11/d7e/da6/de4/l10d 0 2024-03-12T16:10:57.185 INFO:tasks.workunit.client.1.smithi134.stdout:1/799: creat d0/d16/d9/d13/f107 x:0 0 0 2024-03-12T16:10:57.186 INFO:tasks.workunit.client.0.smithi006.stdout:7/926: mkdir de/d7b/dfc/d137 0 2024-03-12T16:10:57.186 INFO:tasks.workunit.client.0.smithi006.stdout:0/820: chown d2/d6/d10/c7c 58135190 1 2024-03-12T16:10:57.187 INFO:tasks.workunit.client.1.smithi134.stdout:1/800: truncate d0/d42/d47/fd6 258178 0 2024-03-12T16:10:57.188 INFO:tasks.workunit.client.0.smithi006.stdout:0/821: chown d2/d39/d42/c9b 3961 1 2024-03-12T16:10:57.189 INFO:tasks.workunit.client.0.smithi006.stdout:7/927: read de/d18/f20 [5028099,66361] 0 2024-03-12T16:10:57.190 INFO:tasks.workunit.client.1.smithi134.stdout:1/801: mknod d0/d16/d9/d13/d21/d5f/d6f/c108 0 2024-03-12T16:10:57.191 INFO:tasks.workunit.client.0.smithi006.stdout:0/822: mknod d2/d6/d10/d11/d7e/dbe/c10e 0 2024-03-12T16:10:57.194 INFO:tasks.workunit.client.1.smithi134.stdout:1/802: rename d0/d16/d9/d51/db7/dbb/df1/dfe to d0/d42/d109 0 2024-03-12T16:10:57.194 INFO:tasks.workunit.client.1.smithi134.stdout:1/803: chown d0/d16/d9/f70 1426 1 2024-03-12T16:10:57.196 INFO:tasks.workunit.client.0.smithi006.stdout:4/863: dread d1/db/d1d/d2f/fc0 [0,4194304] 0 2024-03-12T16:10:57.197 INFO:tasks.workunit.client.0.smithi006.stdout:0/823: rename d2/d6/d10/d11/d1d/d79/fff to d2/d39/d42/de5/f10f 0 2024-03-12T16:10:57.199 INFO:tasks.workunit.client.0.smithi006.stdout:4/864: mknod d1/db/d39/dbf/dec/d43/db5/c11d 0 2024-03-12T16:10:57.199 INFO:tasks.workunit.client.0.smithi006.stdout:5/741: sync 2024-03-12T16:10:57.200 INFO:tasks.workunit.client.0.smithi006.stdout:2/783: sync 2024-03-12T16:10:57.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:56 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:55.501382+0000 mgr.smithi134.gcntfu (mgr.24383) 65 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 137 MiB/s rd, 332 MiB/s wr, 699 op/s 2024-03-12T16:10:57.203 INFO:tasks.workunit.client.0.smithi006.stdout:2/784: read d0/d13/d49/d60/d2b/d62/fa2 [3307102,49082] 0 2024-03-12T16:10:57.205 INFO:tasks.workunit.client.0.smithi006.stdout:5/742: mknod d7/d9/d10/d24/d89/cf5 0 2024-03-12T16:10:57.206 INFO:tasks.workunit.client.1.smithi134.stdout:1/804: dwrite d0/d16/d9/d13/d21/d2f/d8d/fc4 [0,4194304] 0 2024-03-12T16:10:57.206 INFO:tasks.workunit.client.0.smithi006.stdout:2/785: chown d0/d13/d49/d60/f16 130 1 2024-03-12T16:10:57.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:55.501382+0000 mgr.smithi134.gcntfu (mgr.24383) 65 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 137 MiB/s rd, 332 MiB/s wr, 699 op/s 2024-03-12T16:10:57.208 INFO:tasks.workunit.client.0.smithi006.stdout:4/865: dwrite d1/db/d39/fa9 [0,4194304] 0 2024-03-12T16:10:57.209 INFO:tasks.workunit.client.1.smithi134.stdout:1/805: creat d0/f10a x:0 0 0 2024-03-12T16:10:57.210 INFO:tasks.workunit.client.0.smithi006.stdout:5/743: unlink d7/d8/l1f 0 2024-03-12T16:10:57.210 INFO:tasks.workunit.client.0.smithi006.stdout:2/786: chown d0/d13/d49/d60/d2b/d62/d79/lc5 19178 1 2024-03-12T16:10:57.211 INFO:tasks.workunit.client.0.smithi006.stdout:9/747: truncate d0/d4/f29 2413713 0 2024-03-12T16:10:57.213 INFO:tasks.workunit.client.0.smithi006.stdout:2/787: write d0/d13/d49/f73 [2438467,103113] 0 2024-03-12T16:10:57.213 INFO:tasks.workunit.client.1.smithi134.stdout:1/806: creat d0/d16/d9/d13/d21/d5f/d6f/f10b x:0 0 0 2024-03-12T16:10:57.217 INFO:tasks.workunit.client.0.smithi006.stdout:0/824: unlink d2/d39/d42/de5/f10f 0 2024-03-12T16:10:57.218 INFO:tasks.workunit.client.1.smithi134.stdout:1/807: dread d0/d16/d9/d13/d38/f75 [0,4194304] 0 2024-03-12T16:10:57.222 INFO:tasks.workunit.client.0.smithi006.stdout:4/866: creat d1/db/d39/dbf/dec/d43/f11e x:0 0 0 2024-03-12T16:10:57.224 INFO:tasks.workunit.client.0.smithi006.stdout:5/744: rename d7/d9/d31/d3b/dba/fbd to d7/d9/d10/d24/ff6 0 2024-03-12T16:10:57.225 INFO:tasks.workunit.client.0.smithi006.stdout:2/788: creat d0/d13/d49/d60/d2b/d62/d66/da6/fee x:0 0 0 2024-03-12T16:10:57.226 INFO:tasks.workunit.client.0.smithi006.stdout:7/928: dwrite de/d98/fc0 [0,4194304] 0 2024-03-12T16:10:57.234 INFO:tasks.workunit.client.0.smithi006.stdout:8/706: sync 2024-03-12T16:10:57.234 INFO:tasks.workunit.client.0.smithi006.stdout:1/792: sync 2024-03-12T16:10:57.234 INFO:tasks.workunit.client.0.smithi006.stdout:3/687: sync 2024-03-12T16:10:57.234 INFO:tasks.workunit.client.0.smithi006.stdout:6/799: sync 2024-03-12T16:10:57.235 INFO:tasks.workunit.client.1.smithi134.stdout:1/808: truncate d0/d16/d9/d13/d21/d2f/f9d 854301 0 2024-03-12T16:10:57.235 INFO:tasks.workunit.client.0.smithi006.stdout:7/929: creat de/d7b/dc6/d11c/f138 x:0 0 0 2024-03-12T16:10:57.236 INFO:tasks.workunit.client.1.smithi134.stdout:1/809: mkdir d0/d42/d109/d10c 0 2024-03-12T16:10:57.237 INFO:tasks.workunit.client.0.smithi006.stdout:4/867: creat d1/db/d39/dbf/dec/d43/dcc/d104/f11f x:0 0 0 2024-03-12T16:10:57.238 INFO:tasks.workunit.client.1.smithi134.stdout:1/810: creat d0/d30/d86/f10d x:0 0 0 2024-03-12T16:10:57.243 INFO:tasks.workunit.client.0.smithi006.stdout:0/825: dwrite d2/d6/f62 [0,4194304] 0 2024-03-12T16:10:57.244 INFO:tasks.workunit.client.0.smithi006.stdout:9/748: dwrite d0/d4/fd4 [0,4194304] 0 2024-03-12T16:10:57.248 INFO:tasks.workunit.client.1.smithi134.stdout:1/811: dwrite d0/d30/d86/f102 [0,4194304] 0 2024-03-12T16:10:57.248 INFO:tasks.workunit.client.1.smithi134.stdout:1/812: chown d0/d30/fa8 13 1 2024-03-12T16:10:57.250 INFO:tasks.workunit.client.0.smithi006.stdout:3/688: creat d8/d19/d26/feb x:0 0 0 2024-03-12T16:10:57.251 INFO:tasks.workunit.client.0.smithi006.stdout:5/745: dwrite d7/d41/f87 [0,4194304] 0 2024-03-12T16:10:57.254 INFO:tasks.workunit.client.1.smithi134.stdout:1/813: unlink d0/fd7 0 2024-03-12T16:10:57.254 INFO:tasks.workunit.client.1.smithi134.stdout:1/814: write d0/d16/d9/d13/d21/dac/fcc [1903196,89872] 0 2024-03-12T16:10:57.254 INFO:tasks.workunit.client.0.smithi006.stdout:1/793: truncate d0/d25/d2a/f3b 3128036 0 2024-03-12T16:10:57.255 INFO:tasks.workunit.client.0.smithi006.stdout:3/689: dread - d8/d19/d26/d59/d2c/fd5 zero size 2024-03-12T16:10:57.258 INFO:tasks.workunit.client.0.smithi006.stdout:9/749: mknod d0/d8f/dc6/cf5 0 2024-03-12T16:10:57.260 INFO:tasks.workunit.client.1.smithi134.stdout:1/815: dread - d0/d16/d9/d13/ddd/fd4 zero size 2024-03-12T16:10:57.261 INFO:tasks.workunit.client.0.smithi006.stdout:4/868: symlink d1/db/d1d/l120 0 2024-03-12T16:10:57.261 INFO:tasks.workunit.client.1.smithi134.stdout:1/816: dread - d0/d42/fcb zero size 2024-03-12T16:10:57.261 INFO:tasks.workunit.client.0.smithi006.stdout:2/789: dwrite d0/d13/f44 [0,4194304] 0 2024-03-12T16:10:57.262 INFO:tasks.workunit.client.0.smithi006.stdout:0/826: mkdir d2/d6/d10/d110 0 2024-03-12T16:10:57.263 INFO:tasks.workunit.client.0.smithi006.stdout:3/690: chown d8/d19/d26/d59/d2c/dc/d28/faf 11 1 2024-03-12T16:10:57.265 INFO:tasks.workunit.client.0.smithi006.stdout:5/746: symlink d7/d8/d91/lf7 0 2024-03-12T16:10:57.265 INFO:tasks.workunit.client.0.smithi006.stdout:9/750: symlink d0/d83/d90/lf6 0 2024-03-12T16:10:57.268 INFO:tasks.workunit.client.0.smithi006.stdout:4/869: read d1/db/d1d/d2f/d6b/fe0 [223449,90276] 0 2024-03-12T16:10:57.270 INFO:tasks.workunit.client.0.smithi006.stdout:2/790: write d0/d13/d49/d60/d2b/d62/d66/d69/d81/fc2 [2517670,29382] 0 2024-03-12T16:10:57.273 INFO:tasks.workunit.client.0.smithi006.stdout:9/751: symlink d0/lf7 0 2024-03-12T16:10:57.274 INFO:tasks.workunit.client.0.smithi006.stdout:2/791: write d0/d13/d49/d60/d2b/d62/dce/fcf [3781652,56852] 0 2024-03-12T16:10:57.274 INFO:tasks.workunit.client.1.smithi134.stdout:1/817: dwrite d0/d16/d9/d13/d21/d2f/d8d/fc4 [0,4194304] 0 2024-03-12T16:10:57.275 INFO:tasks.workunit.client.0.smithi006.stdout:9/752: chown d0/c41 373750 1 2024-03-12T16:10:57.279 INFO:tasks.workunit.client.0.smithi006.stdout:1/794: rename d0/d25/d2a/d35/d3f/f91 to d0/d25/d2a/d43/f112 0 2024-03-12T16:10:57.280 INFO:tasks.workunit.client.0.smithi006.stdout:0/827: symlink d2/d39/dec/l111 0 2024-03-12T16:10:57.281 INFO:tasks.workunit.client.0.smithi006.stdout:5/747: creat d7/d9/d10/d24/de2/ff8 x:0 0 0 2024-03-12T16:10:57.286 INFO:tasks.workunit.client.0.smithi006.stdout:7/930: write de/d1c/f96 [734320,9509] 0 2024-03-12T16:10:57.291 INFO:tasks.workunit.client.0.smithi006.stdout:5/748: truncate d7/d9/d31/d3b/d4f/db5/fe3 480626 0 2024-03-12T16:10:57.291 INFO:tasks.workunit.client.0.smithi006.stdout:9/753: unlink d0/d4/da7/fc4 0 2024-03-12T16:10:57.291 INFO:tasks.workunit.client.0.smithi006.stdout:6/800: write d3/d11/d10/da7/f74 [3446890,86387] 0 2024-03-12T16:10:57.295 INFO:tasks.workunit.client.0.smithi006.stdout:4/870: link d1/db/d1d/d2f/fc0 d1/db/d39/dbf/dec/d43/f121 0 2024-03-12T16:10:57.295 INFO:tasks.workunit.client.0.smithi006.stdout:0/828: symlink d2/d6/d10/ddb/l112 0 2024-03-12T16:10:57.299 INFO:tasks.workunit.client.0.smithi006.stdout:8/707: write d2/db/d1a/f1c [178842,46181] 0 2024-03-12T16:10:57.305 INFO:tasks.workunit.client.0.smithi006.stdout:0/829: dread - d2/d6/d37/ffd zero size 2024-03-12T16:10:57.307 INFO:tasks.workunit.client.0.smithi006.stdout:6/801: dread d3/d11/d10/d1b/d6e/fa5 [0,4194304] 0 2024-03-12T16:10:57.311 INFO:tasks.workunit.client.0.smithi006.stdout:0/830: write d2/d6/d10/d11/d7e/da6/de4/f104 [1084155,3673] 0 2024-03-12T16:10:57.313 INFO:tasks.workunit.client.0.smithi006.stdout:0/831: stat d2/d88 0 2024-03-12T16:10:57.314 INFO:tasks.workunit.client.0.smithi006.stdout:3/691: dread d8/d19/d26/d59/d2c/dc/d28/d2f/f94 [0,4194304] 0 2024-03-12T16:10:57.315 INFO:tasks.workunit.client.0.smithi006.stdout:9/754: mknod d0/d4/d18/cf8 0 2024-03-12T16:10:57.321 INFO:tasks.workunit.client.0.smithi006.stdout:8/708: mknod d2/db/d1a/d21/d2b/da2/dbc/ce4 0 2024-03-12T16:10:57.322 INFO:tasks.workunit.client.0.smithi006.stdout:4/871: symlink d1/l122 0 2024-03-12T16:10:57.324 INFO:tasks.workunit.client.0.smithi006.stdout:2/792: write d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f9e [1093084,125939] 0 2024-03-12T16:10:57.325 INFO:tasks.workunit.client.0.smithi006.stdout:5/749: link d7/d8/d91/lcb d7/d9/d31/d3b/d4f/db5/lf9 0 2024-03-12T16:10:57.334 INFO:tasks.workunit.client.0.smithi006.stdout:5/750: dread - d7/d9/d10/d24/de2/ff8 zero size 2024-03-12T16:10:57.335 INFO:tasks.workunit.client.0.smithi006.stdout:3/692: write d8/d19/fa7 [401573,69756] 0 2024-03-12T16:10:57.336 INFO:tasks.workunit.client.0.smithi006.stdout:8/709: creat d2/dab/fe5 x:0 0 0 2024-03-12T16:10:57.339 INFO:tasks.workunit.client.0.smithi006.stdout:7/931: write de/d1c/d87/ddb/d97/fb9 [4106210,4331] 0 2024-03-12T16:10:57.344 INFO:tasks.workunit.client.0.smithi006.stdout:8/710: read - d2/db/d1a/d21/d2b/da2/fc1 zero size 2024-03-12T16:10:57.345 INFO:tasks.workunit.client.0.smithi006.stdout:0/832: write d2/d6/d10/ff6 [188676,17098] 0 2024-03-12T16:10:57.348 INFO:tasks.workunit.client.0.smithi006.stdout:7/932: stat de/d2c/d93/dbe/d66/fdd 0 2024-03-12T16:10:57.349 INFO:tasks.workunit.client.0.smithi006.stdout:1/795: dwrite d0/d25/d2a/d43/f8f [0,4194304] 0 2024-03-12T16:10:57.356 INFO:tasks.workunit.client.0.smithi006.stdout:2/793: truncate d0/d13/d49/d60/d2b/f94 888704 0 2024-03-12T16:10:57.357 INFO:tasks.workunit.client.0.smithi006.stdout:5/751: dwrite d7/d8/d8a/d92/fdf [0,4194304] 0 2024-03-12T16:10:57.359 INFO:tasks.workunit.client.0.smithi006.stdout:3/693: mknod d8/d19/d26/d59/d2c/dc/dc9/cec 0 2024-03-12T16:10:57.359 INFO:tasks.workunit.client.0.smithi006.stdout:5/752: chown f4 5906802 1 2024-03-12T16:10:57.359 INFO:tasks.workunit.client.0.smithi006.stdout:6/802: dwrite d3/d11/d10/da7/d8e/de1/f83 [0,4194304] 0 2024-03-12T16:10:57.365 INFO:tasks.workunit.client.0.smithi006.stdout:8/711: mkdir d2/db/d1a/d1f/de6 0 2024-03-12T16:10:57.371 INFO:tasks.workunit.client.0.smithi006.stdout:9/755: creat d0/d4/ff9 x:0 0 0 2024-03-12T16:10:57.372 INFO:tasks.workunit.client.0.smithi006.stdout:2/794: mkdir d0/dc/de0/def 0 2024-03-12T16:10:57.377 INFO:tasks.workunit.client.0.smithi006.stdout:1/796: symlink d0/d25/d2a/d43/d68/d111/l113 0 2024-03-12T16:10:57.381 INFO:tasks.workunit.client.0.smithi006.stdout:6/803: fsync d3/fcd 0 2024-03-12T16:10:57.381 INFO:tasks.workunit.client.0.smithi006.stdout:0/833: dwrite d2/d39/d42/de5/ff0 [0,4194304] 0 2024-03-12T16:10:57.384 INFO:tasks.workunit.client.0.smithi006.stdout:8/712: dwrite d2/dab/fae [0,4194304] 0 2024-03-12T16:10:57.384 INFO:tasks.workunit.client.0.smithi006.stdout:9/756: symlink d0/d4/d18/d4d/lfa 0 2024-03-12T16:10:57.385 INFO:tasks.workunit.client.0.smithi006.stdout:5/753: getdents d7/d9/d47/d56/d79/dee 0 2024-03-12T16:10:57.386 INFO:tasks.workunit.client.1.smithi134.stdout:1/818: sync 2024-03-12T16:10:57.388 INFO:tasks.workunit.client.0.smithi006.stdout:7/933: creat de/d2c/d4f/dba/d40/f139 x:0 0 0 2024-03-12T16:10:57.389 INFO:tasks.workunit.client.0.smithi006.stdout:8/713: fsync d2/db/d1a/d7a/fde 0 2024-03-12T16:10:57.390 INFO:tasks.workunit.client.1.smithi134.stdout:1/819: truncate d0/d16/d9/d13/d21/f23 573697 0 2024-03-12T16:10:57.392 INFO:tasks.workunit.client.1.smithi134.stdout:1/820: mkdir d0/d30/d48/d10e 0 2024-03-12T16:10:57.393 INFO:tasks.workunit.client.0.smithi006.stdout:6/804: read - d3/d11/d10/d28/fb7 zero size 2024-03-12T16:10:57.394 INFO:tasks.workunit.client.1.smithi134.stdout:1/821: getdents d0/d16/d9/d13/d38/d103 0 2024-03-12T16:10:57.397 INFO:tasks.workunit.client.0.smithi006.stdout:4/872: truncate d1/db/d39/f47 568753 0 2024-03-12T16:10:57.397 INFO:tasks.workunit.client.0.smithi006.stdout:6/805: chown d3/d11/d10/d1b/f89 287 1 2024-03-12T16:10:57.397 INFO:tasks.workunit.client.0.smithi006.stdout:8/714: creat d2/d11/d5a/fe7 x:0 0 0 2024-03-12T16:10:57.398 INFO:tasks.workunit.client.1.smithi134.stdout:1/822: getdents d0/d30/d86 0 2024-03-12T16:10:57.400 INFO:tasks.workunit.client.0.smithi006.stdout:7/934: write de/d2c/d4f/dba/d40/f63 [5456033,87426] 0 2024-03-12T16:10:57.400 INFO:tasks.workunit.client.0.smithi006.stdout:3/694: link l4 d8/d19/d31/led 0 2024-03-12T16:10:57.401 INFO:tasks.workunit.client.1.smithi134.stdout:1/823: link d0/f10a d0/d16/d9/d13/d21/dac/f10f 0 2024-03-12T16:10:57.402 INFO:tasks.workunit.client.0.smithi006.stdout:3/695: fdatasync d8/fc3 0 2024-03-12T16:10:57.404 INFO:tasks.workunit.client.0.smithi006.stdout:9/757: dwrite d0/d8/d16/d7d/d20/fc7 [0,4194304] 0 2024-03-12T16:10:57.404 INFO:tasks.workunit.client.0.smithi006.stdout:2/795: rename d0/d13/d49/d60/d2b/f8e to d0/dc/ff0 0 2024-03-12T16:10:57.406 INFO:tasks.workunit.client.0.smithi006.stdout:4/873: fdatasync d1/db/d39/dbf/fc4 0 2024-03-12T16:10:57.408 INFO:tasks.workunit.client.0.smithi006.stdout:0/834: rmdir d2/d6/d10/d11/d32/de0 0 2024-03-12T16:10:57.410 INFO:tasks.workunit.client.1.smithi134.stdout:1/824: dwrite d0/d16/d9/fe3 [0,4194304] 0 2024-03-12T16:10:57.410 INFO:tasks.workunit.client.0.smithi006.stdout:9/758: truncate d0/d8/d16/d7d/db5/fbe 453488 0 2024-03-12T16:10:57.414 INFO:tasks.workunit.client.0.smithi006.stdout:8/715: chown d2/db/d1a/d21/d4f/fca 682139 1 2024-03-12T16:10:57.415 INFO:tasks.workunit.client.1.smithi134.stdout:1/825: dread d0/d42/f98 [0,4194304] 0 2024-03-12T16:10:57.418 INFO:tasks.workunit.client.1.smithi134.stdout:1/826: creat d0/d16/d9/d13/d21/d5f/d6f/dad/f110 x:0 0 0 2024-03-12T16:10:57.422 INFO:tasks.workunit.client.1.smithi134.stdout:1/827: rename d0/d30/l7a to d0/d16/d9/d73/l111 0 2024-03-12T16:10:57.423 INFO:tasks.workunit.client.1.smithi134.stdout:1/828: chown d0/d16/d9/d13/d21/d2f/lb1 32051 1 2024-03-12T16:10:57.426 INFO:tasks.workunit.client.1.smithi134.stdout:1/829: symlink d0/d16/d9/d51/db7/dbb/l112 0 2024-03-12T16:10:57.432 INFO:tasks.workunit.client.0.smithi006.stdout:6/806: creat d3/d11/d43/dd1/f120 x:0 0 0 2024-03-12T16:10:57.432 INFO:tasks.workunit.client.1.smithi134.stdout:1/830: dwrite d0/d42/fb0 [0,4194304] 0 2024-03-12T16:10:57.434 INFO:tasks.workunit.client.0.smithi006.stdout:4/874: unlink d1/db/d39/d42/l112 0 2024-03-12T16:10:57.434 INFO:tasks.workunit.client.0.smithi006.stdout:9/759: mknod d0/d83/d90/dc0/cfb 0 2024-03-12T16:10:57.435 INFO:tasks.workunit.client.1.smithi134.stdout:1/831: write d0/d16/d9/d13/d38/f8b [2561218,101478] 0 2024-03-12T16:10:57.438 INFO:tasks.workunit.client.0.smithi006.stdout:7/935: mknod de/d2c/d93/dbe/d4a/d6a/de8/c13a 0 2024-03-12T16:10:57.439 INFO:tasks.workunit.client.0.smithi006.stdout:1/797: rename d0/d25/d2a/d35/d3f/dfc to d0/d25/d2a/d114 0 2024-03-12T16:10:57.441 INFO:tasks.workunit.client.0.smithi006.stdout:6/807: mknod d3/d11/d10/da7/d8e/de1/d60/ddd/c121 0 2024-03-12T16:10:57.444 INFO:tasks.workunit.client.0.smithi006.stdout:3/696: write d8/d52/fb9 [229492,99803] 0 2024-03-12T16:10:57.445 INFO:tasks.workunit.client.0.smithi006.stdout:2/796: link d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/l92 d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/lf1 0 2024-03-12T16:10:57.448 INFO:tasks.workunit.client.1.smithi134.stdout:1/832: rmdir d0/d16/d9/d51 39 2024-03-12T16:10:57.448 INFO:tasks.workunit.client.1.smithi134.stdout:1/833: chown d0/f6b 277 1 2024-03-12T16:10:57.451 INFO:tasks.workunit.client.1.smithi134.stdout:1/834: truncate d0/d16/d9/d13/f3f 3195257 0 2024-03-12T16:10:57.452 INFO:tasks.workunit.client.1.smithi134.stdout:1/835: mkdir d0/d42/d113 0 2024-03-12T16:10:57.452 INFO:tasks.workunit.client.0.smithi006.stdout:8/716: write d2/d11/f42 [806524,41544] 0 2024-03-12T16:10:57.454 INFO:tasks.workunit.client.1.smithi134.stdout:1/836: readlink d0/d16/d9/d13/l1a 0 2024-03-12T16:10:57.454 INFO:tasks.workunit.client.0.smithi006.stdout:0/835: write d2/f74 [240906,26512] 0 2024-03-12T16:10:57.455 INFO:tasks.workunit.client.0.smithi006.stdout:9/760: rmdir d0/d4/da7/df3 0 2024-03-12T16:10:57.456 INFO:tasks.workunit.client.0.smithi006.stdout:8/717: readlink d2/db/d1a/d21/d2b/l6d 0 2024-03-12T16:10:57.457 INFO:tasks.workunit.client.0.smithi006.stdout:5/754: rename d7/c19 to d7/d9/d31/d3b/d4f/d65/cfa 0 2024-03-12T16:10:57.460 INFO:tasks.workunit.client.1.smithi134.stdout:1/837: dwrite d0/d42/fcb [0,4194304] 0 2024-03-12T16:10:57.461 INFO:tasks.workunit.client.0.smithi006.stdout:2/797: dread d0/d13/d49/d60/fc4 [0,4194304] 0 2024-03-12T16:10:57.464 INFO:tasks.workunit.client.0.smithi006.stdout:9/761: creat d0/d4/d9b/ffc x:0 0 0 2024-03-12T16:10:57.465 INFO:tasks.workunit.client.0.smithi006.stdout:1/798: rename d0/d25/d2a/d64/f7a to d0/d25/d2a/d43/de0/f115 0 2024-03-12T16:10:57.466 INFO:tasks.workunit.client.0.smithi006.stdout:5/755: mkdir d7/d9/d47/d56/d79/dfb 0 2024-03-12T16:10:57.466 INFO:tasks.workunit.client.1.smithi134.stdout:1/838: getdents d0/d16/d9/d13/d21/d5f/d6f 0 2024-03-12T16:10:57.469 INFO:tasks.workunit.client.0.smithi006.stdout:8/718: dread d2/d55/d7b/fc0 [0,4194304] 0 2024-03-12T16:10:57.470 INFO:tasks.workunit.client.0.smithi006.stdout:0/836: truncate d2/d39/d42/f59 383428 0 2024-03-12T16:10:57.472 INFO:tasks.workunit.client.1.smithi134.stdout:1/839: dwrite d0/d30/d86/f10d [0,4194304] 0 2024-03-12T16:10:57.473 INFO:tasks.workunit.client.1.smithi134.stdout:1/840: readlink d0/d16/d9/d13/d21/d5f/lbd 0 2024-03-12T16:10:57.474 INFO:tasks.workunit.client.0.smithi006.stdout:9/762: mkdir d0/d8/d80/dfd 0 2024-03-12T16:10:57.474 INFO:tasks.workunit.client.0.smithi006.stdout:7/936: dread de/d1c/d87/ddb/f56 [0,4194304] 0 2024-03-12T16:10:57.475 INFO:tasks.workunit.client.0.smithi006.stdout:1/799: creat d0/d25/d2a/d43/d68/dd2/f116 x:0 0 0 2024-03-12T16:10:57.475 INFO:tasks.workunit.client.0.smithi006.stdout:4/875: dread d1/db/d1d/d2f/fbd [0,4194304] 0 2024-03-12T16:10:57.476 INFO:tasks.workunit.client.0.smithi006.stdout:2/798: mknod d0/dc/de0/def/cf2 0 2024-03-12T16:10:57.477 INFO:tasks.workunit.client.0.smithi006.stdout:8/719: write d2/d11/f4e [1486713,70229] 0 2024-03-12T16:10:57.480 INFO:tasks.workunit.client.0.smithi006.stdout:0/837: unlink d2/d6/c28 0 2024-03-12T16:10:57.485 INFO:tasks.workunit.client.0.smithi006.stdout:7/937: rmdir de/d2c/d93/dbe/d4a/dd1/d118 39 2024-03-12T16:10:57.488 INFO:tasks.workunit.client.0.smithi006.stdout:5/756: dwrite d7/d9/f16 [4194304,4194304] 0 2024-03-12T16:10:57.488 INFO:tasks.workunit.client.0.smithi006.stdout:3/697: write d8/d19/d26/d59/d2c/f67 [10262,15153] 0 2024-03-12T16:10:57.490 INFO:tasks.workunit.client.0.smithi006.stdout:1/800: symlink d0/d25/db1/dd0/d10b/l117 0 2024-03-12T16:10:57.492 INFO:tasks.workunit.client.0.smithi006.stdout:9/763: dread d0/d8/d16/f54 [0,4194304] 0 2024-03-12T16:10:57.492 INFO:tasks.workunit.client.0.smithi006.stdout:8/720: read d2/db/d1a/d21/d4f/f68 [2987005,103511] 0 2024-03-12T16:10:57.493 INFO:tasks.workunit.client.0.smithi006.stdout:5/757: stat d7/d9/d47/c6e 0 2024-03-12T16:10:57.496 INFO:tasks.workunit.client.0.smithi006.stdout:9/764: chown d0/d4 8020634 1 2024-03-12T16:10:57.498 INFO:tasks.workunit.client.0.smithi006.stdout:4/876: dread d1/db/d39/f47 [0,4194304] 0 2024-03-12T16:10:57.499 INFO:tasks.workunit.client.0.smithi006.stdout:6/808: dread d3/f14 [0,4194304] 0 2024-03-12T16:10:57.500 INFO:tasks.workunit.client.0.smithi006.stdout:2/799: readlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/lf1 0 2024-03-12T16:10:57.501 INFO:tasks.workunit.client.0.smithi006.stdout:9/765: write d0/d8/d16/d7d/d20/fc7 [3826696,91603] 0 2024-03-12T16:10:57.501 INFO:tasks.workunit.client.0.smithi006.stdout:6/809: fsync d3/d11/d10/d28/f11f 0 2024-03-12T16:10:57.502 INFO:tasks.workunit.client.0.smithi006.stdout:7/938: mknod de/d2c/d93/dbe/d66/c13b 0 2024-03-12T16:10:57.502 INFO:tasks.workunit.client.1.smithi134.stdout:1/841: dread d0/d30/d86/fbc [0,4194304] 0 2024-03-12T16:10:57.504 INFO:tasks.workunit.client.1.smithi134.stdout:1/842: write d0/d16/d9/d13/d21/d5f/f79 [3861065,81316] 0 2024-03-12T16:10:57.504 INFO:tasks.workunit.client.0.smithi006.stdout:0/838: symlink d2/d6/d10/d11/d1d/d2e/l113 0 2024-03-12T16:10:57.506 INFO:tasks.workunit.client.0.smithi006.stdout:1/801: creat d0/d25/d2a/d43/d63/df1/f118 x:0 0 0 2024-03-12T16:10:57.507 INFO:tasks.workunit.client.1.smithi134.stdout:1/843: mkdir d0/d16/d9/d13/d21/d114 0 2024-03-12T16:10:57.508 INFO:tasks.workunit.client.0.smithi006.stdout:9/766: rmdir d0/d8/d80 39 2024-03-12T16:10:57.510 INFO:tasks.workunit.client.0.smithi006.stdout:7/939: read de/d2c/d93/dbe/fc1 [3153913,127693] 0 2024-03-12T16:10:57.513 INFO:tasks.workunit.client.0.smithi006.stdout:5/758: creat d7/d9/d31/d3b/ffc x:0 0 0 2024-03-12T16:10:57.514 INFO:tasks.workunit.client.0.smithi006.stdout:6/810: read d3/d11/d10/d1b/d20/f8f [412336,81984] 0 2024-03-12T16:10:57.515 INFO:tasks.workunit.client.0.smithi006.stdout:0/839: rmdir d2/d6/d10 39 2024-03-12T16:10:57.515 INFO:tasks.workunit.client.0.smithi006.stdout:9/767: truncate d0/d4/d70/fe0 355291 0 2024-03-12T16:10:57.521 INFO:tasks.workunit.client.0.smithi006.stdout:6/811: dread - d3/d11/d10/d1b/d6e/f57 zero size 2024-03-12T16:10:57.521 INFO:tasks.workunit.client.0.smithi006.stdout:5/759: chown d7/d9/d31/d3b/d4f/f7c 49125 1 2024-03-12T16:10:57.522 INFO:tasks.workunit.client.0.smithi006.stdout:9/768: chown d0/d8/d16/d7d/db5/f65 5964 1 2024-03-12T16:10:57.523 INFO:tasks.workunit.client.0.smithi006.stdout:1/802: rename d0/d25/d2a/d114 to d0/d25/d2a/d43/d68/d111/d119 0 2024-03-12T16:10:57.525 INFO:tasks.workunit.client.0.smithi006.stdout:3/698: dwrite d8/d19/d26/f8d [0,4194304] 0 2024-03-12T16:10:57.526 INFO:tasks.workunit.client.0.smithi006.stdout:4/877: truncate d1/db/d39/d42/f100 60769 0 2024-03-12T16:10:57.533 INFO:tasks.workunit.client.0.smithi006.stdout:3/699: write d8/d4c/db2/fbf [294927,9961] 0 2024-03-12T16:10:57.534 INFO:tasks.workunit.client.0.smithi006.stdout:9/769: unlink d0/d8/d16/d7d/d20/ca0 0 2024-03-12T16:10:57.541 INFO:tasks.workunit.client.0.smithi006.stdout:0/840: dwrite d2/fd [0,4194304] 0 2024-03-12T16:10:57.541 INFO:tasks.workunit.client.0.smithi006.stdout:7/940: rename de/d2c/d93/dbe/d66 to de/d2c/d93/dbe/d4a/d13c 0 2024-03-12T16:10:57.546 INFO:tasks.workunit.client.0.smithi006.stdout:4/878: truncate d1/db/d39/dbf/dec/f1a 2294055 0 2024-03-12T16:10:57.551 INFO:tasks.workunit.client.0.smithi006.stdout:5/760: dwrite d7/d9/d31/ded/fe6 [4194304,4194304] 0 2024-03-12T16:10:57.551 INFO:tasks.workunit.client.0.smithi006.stdout:7/941: truncate de/d18/f119 162890 0 2024-03-12T16:10:57.551 INFO:tasks.workunit.client.0.smithi006.stdout:2/800: truncate d0/d13/d49/d60/d2b/d62/d66/d69/d81/f99 4761137 0 2024-03-12T16:10:57.559 INFO:tasks.workunit.client.0.smithi006.stdout:7/942: rmdir de/d2c/dd3 39 2024-03-12T16:10:57.559 INFO:tasks.workunit.client.0.smithi006.stdout:5/761: truncate d7/d9/d10/d24/ff6 919071 0 2024-03-12T16:10:57.561 INFO:tasks.workunit.client.0.smithi006.stdout:2/801: creat d0/d13/d49/d60/d2b/d62/d66/da6/ff3 x:0 0 0 2024-03-12T16:10:57.562 INFO:tasks.workunit.client.1.smithi134.stdout:1/844: creat d0/d16/d9/d13/d38/f115 x:0 0 0 2024-03-12T16:10:57.563 INFO:tasks.workunit.client.0.smithi006.stdout:0/841: creat d2/d39/f114 x:0 0 0 2024-03-12T16:10:57.565 INFO:tasks.workunit.client.0.smithi006.stdout:4/879: creat d1/db/f123 x:0 0 0 2024-03-12T16:10:57.568 INFO:tasks.workunit.client.0.smithi006.stdout:3/700: dread d8/d4c/dd8/fd6 [0,4194304] 0 2024-03-12T16:10:57.570 INFO:tasks.workunit.client.0.smithi006.stdout:5/762: mknod d7/d9/d47/d56/dc4/cfd 0 2024-03-12T16:10:57.570 INFO:tasks.workunit.client.0.smithi006.stdout:9/770: dwrite d0/d4/d9b/feb [0,4194304] 0 2024-03-12T16:10:57.570 INFO:tasks.workunit.client.0.smithi006.stdout:7/943: chown de/d2c/d93/dbe/d4a/dd1/fe2 3951 1 2024-03-12T16:10:57.577 INFO:tasks.workunit.client.0.smithi006.stdout:0/842: write d2/d39/fdc [1486228,129118] 0 2024-03-12T16:10:57.581 INFO:tasks.workunit.client.0.smithi006.stdout:6/812: dread d3/d11/d10/d1b/d6e/d80/d9b/fcb [0,4194304] 0 2024-03-12T16:10:57.581 INFO:tasks.workunit.client.0.smithi006.stdout:7/944: write de/d1c/d87/ddb/d97/fb9 [1549985,123584] 0 2024-03-12T16:10:57.583 INFO:tasks.workunit.client.0.smithi006.stdout:5/763: symlink d7/d9/d31/d3b/d4f/lfe 0 2024-03-12T16:10:57.589 INFO:tasks.workunit.client.0.smithi006.stdout:1/803: dread d0/d25/d2a/d43/f92 [0,4194304] 0 2024-03-12T16:10:57.590 INFO:tasks.workunit.client.0.smithi006.stdout:0/843: creat d2/d88/d103/f115 x:0 0 0 2024-03-12T16:10:57.590 INFO:tasks.workunit.client.0.smithi006.stdout:2/802: dwrite d0/d13/d49/d60/d2b/d62/d66/da6/fa9 [8388608,4194304] 0 2024-03-12T16:10:57.592 INFO:tasks.workunit.client.1.smithi134.stdout:1/845: rename d0/d16/d9/d13/d38/def/cf6 to d0/d30/c116 0 2024-03-12T16:10:57.593 INFO:tasks.workunit.client.0.smithi006.stdout:9/771: getdents d0/d8/d16/d7d/d20 0 2024-03-12T16:10:57.594 INFO:tasks.workunit.client.1.smithi134.stdout:1/846: chown d0/d42/d47/l7b 2 1 2024-03-12T16:10:57.595 INFO:tasks.workunit.client.0.smithi006.stdout:9/772: chown d0/d4/d18/f44 25962 1 2024-03-12T16:10:57.596 INFO:tasks.workunit.client.0.smithi006.stdout:7/945: truncate de/d1c/d35/f7d 4243317 0 2024-03-12T16:10:57.598 INFO:tasks.workunit.client.0.smithi006.stdout:7/946: stat de/d7b/d7e/ffb 0 2024-03-12T16:10:57.601 INFO:tasks.workunit.client.0.smithi006.stdout:7/947: write de/d18/fdc [1531203,37586] 0 2024-03-12T16:10:57.602 INFO:tasks.workunit.client.0.smithi006.stdout:1/804: rename d0/d25/d2a/d43/ldf to d0/d25/d2a/d43/d68/d111/d119/l11a 0 2024-03-12T16:10:57.603 INFO:tasks.workunit.client.0.smithi006.stdout:7/948: read de/d2c/d93/dbe/f37 [3612768,65860] 0 2024-03-12T16:10:57.606 INFO:tasks.workunit.client.0.smithi006.stdout:3/701: truncate d8/d19/d26/d59/d2c/f9a 679821 0 2024-03-12T16:10:57.606 INFO:tasks.workunit.client.0.smithi006.stdout:7/949: chown de/d7b/dc6/d11c/c120 50017 1 2024-03-12T16:10:57.606 INFO:tasks.workunit.client.0.smithi006.stdout:9/773: mknod d0/d8/d16/d7d/d20/d37/cfe 0 2024-03-12T16:10:57.607 INFO:tasks.workunit.client.0.smithi006.stdout:5/764: dread d7/d9/d10/f32 [0,4194304] 0 2024-03-12T16:10:57.607 INFO:tasks.workunit.client.0.smithi006.stdout:6/813: write d3/d11/d10/d1b/d6e/fa5 [1860443,37307] 0 2024-03-12T16:10:57.607 INFO:tasks.workunit.client.0.smithi006.stdout:1/805: chown d0/d25/d2a/d43/d63/l98 454989 1 2024-03-12T16:10:57.609 INFO:tasks.workunit.client.1.smithi134.stdout:1/847: dwrite d0/d30/fb8 [0,4194304] 0 2024-03-12T16:10:57.609 INFO:tasks.workunit.client.0.smithi006.stdout:0/844: link d2/d6/d10/d11/d1d/d79/f7f d2/d6/f116 0 2024-03-12T16:10:57.612 INFO:tasks.workunit.client.0.smithi006.stdout:5/765: readlink d7/d9/d31/d3b/d4f/d80/l8b 0 2024-03-12T16:10:57.612 INFO:tasks.workunit.client.0.smithi006.stdout:9/774: rmdir d0/d4/d3b 39 2024-03-12T16:10:57.617 INFO:tasks.workunit.client.0.smithi006.stdout:0/845: mknod d2/d88/dc9/c117 0 2024-03-12T16:10:57.617 INFO:tasks.workunit.client.0.smithi006.stdout:5/766: read d7/f58 [17699,80505] 0 2024-03-12T16:10:57.618 INFO:tasks.workunit.client.1.smithi134.stdout:1/848: truncate d0/d16/d9/d13/d21/d5f/d6f/f87 185683 0 2024-03-12T16:10:57.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/849: fdatasync d0/d16/d9/d13/d21/d20/f44 0 2024-03-12T16:10:57.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/850: chown d0/d16/d9/d13/d21/d5f/d6f/d85/dee 102 1 2024-03-12T16:10:57.624 INFO:tasks.workunit.client.0.smithi006.stdout:6/814: creat d3/d11/d10/d1b/d20/d7c/f122 x:0 0 0 2024-03-12T16:10:57.625 INFO:tasks.workunit.client.0.smithi006.stdout:1/806: dwrite d0/d25/f2e [0,4194304] 0 2024-03-12T16:10:57.627 INFO:tasks.workunit.client.1.smithi134.stdout:1/851: dread d0/d30/d86/f1d [0,4194304] 0 2024-03-12T16:10:57.628 INFO:tasks.workunit.client.0.smithi006.stdout:9/775: mkdir d0/d4/d3b/dff 0 2024-03-12T16:10:57.633 INFO:tasks.workunit.client.0.smithi006.stdout:2/803: dread d0/dc/f1a [0,4194304] 0 2024-03-12T16:10:57.635 INFO:tasks.workunit.client.0.smithi006.stdout:6/815: mknod d3/d11/d10/d28/c123 0 2024-03-12T16:10:57.636 INFO:tasks.workunit.client.0.smithi006.stdout:0/846: dwrite d2/d6/d10/d11/d7e/da6/d9e/fd4 [0,4194304] 0 2024-03-12T16:10:57.638 INFO:tasks.workunit.client.0.smithi006.stdout:2/804: read d0/d13/d49/d60/d2b/d62/d66/da6/fa9 [12402601,28358] 0 2024-03-12T16:10:57.643 INFO:tasks.workunit.client.0.smithi006.stdout:3/702: write d8/d19/d26/d59/d2c/dc/d28/faf [370250,17328] 0 2024-03-12T16:10:57.643 INFO:tasks.workunit.client.0.smithi006.stdout:7/950: getdents de/d2c/d93/dbe/d4a/dd1/d118 0 2024-03-12T16:10:57.648 INFO:tasks.workunit.client.0.smithi006.stdout:3/703: chown d8/d19/d26/d59/f1f 122 1 2024-03-12T16:10:57.648 INFO:tasks.workunit.client.0.smithi006.stdout:3/704: dread - d8/d4c/f65 zero size 2024-03-12T16:10:57.651 INFO:tasks.workunit.client.0.smithi006.stdout:0/847: creat d2/d6/d10/d11/d7e/dbe/f118 x:0 0 0 2024-03-12T16:10:57.651 INFO:tasks.workunit.client.0.smithi006.stdout:3/705: symlink d8/d19/d26/d97/dce/lee 0 2024-03-12T16:10:57.715 INFO:tasks.workunit.client.0.smithi006.stdout:1/807: link d0/d25/d2a/fc3 d0/d10d/f11b 0 2024-03-12T16:10:57.717 INFO:tasks.workunit.client.0.smithi006.stdout:6/816: mknod d3/d11/d10/da7/dd5/ddb/de6/c124 0 2024-03-12T16:10:57.722 INFO:tasks.workunit.client.0.smithi006.stdout:5/767: truncate d7/d41/f87 1099677 0 2024-03-12T16:10:57.722 INFO:tasks.workunit.client.0.smithi006.stdout:0/848: creat d2/d88/f119 x:0 0 0 2024-03-12T16:10:57.723 INFO:tasks.workunit.client.0.smithi006.stdout:1/808: mkdir d0/d25/d2a/d35/d11c 0 2024-03-12T16:10:57.725 INFO:tasks.workunit.client.0.smithi006.stdout:1/809: chown d0/d25/d2a/f2d 481555370 1 2024-03-12T16:10:57.727 INFO:tasks.workunit.client.0.smithi006.stdout:9/776: getdents d0/d8/d16/d7d 0 2024-03-12T16:10:57.729 INFO:tasks.workunit.client.0.smithi006.stdout:6/817: mknod d3/d11/d10/d1b/c125 0 2024-03-12T16:10:57.730 INFO:tasks.workunit.client.0.smithi006.stdout:0/849: dwrite d2/d6/d37/f86 [0,4194304] 0 2024-03-12T16:10:57.732 INFO:tasks.workunit.client.0.smithi006.stdout:2/805: rename d0/d13/d49/d60/d2b/f9f to d0/d13/d49/d60/ff4 0 2024-03-12T16:10:57.736 INFO:tasks.workunit.client.0.smithi006.stdout:9/777: mkdir d0/d8/d16/d7d/d20/d100 0 2024-03-12T16:10:57.738 INFO:tasks.workunit.client.0.smithi006.stdout:6/818: symlink d3/d47/l126 0 2024-03-12T16:10:57.742 INFO:tasks.workunit.client.0.smithi006.stdout:0/850: symlink d2/d6/d37/l11a 0 2024-03-12T16:10:57.743 INFO:tasks.workunit.client.0.smithi006.stdout:7/951: dwrite de/d2c/d4f/dba/f67 [0,4194304] 0 2024-03-12T16:10:57.745 INFO:tasks.workunit.client.0.smithi006.stdout:2/806: unlink d0/d13/d49/d60/f16 0 2024-03-12T16:10:57.750 INFO:tasks.workunit.client.0.smithi006.stdout:1/810: creat d0/d25/d67/d10a/f11d x:0 0 0 2024-03-12T16:10:57.750 INFO:tasks.workunit.client.0.smithi006.stdout:9/778: unlink d0/d83/d90/dc0/cfb 0 2024-03-12T16:10:57.750 INFO:tasks.workunit.client.0.smithi006.stdout:6/819: fsync d3/d11/d10/d1b/d20/fa8 0 2024-03-12T16:10:57.755 INFO:tasks.workunit.client.0.smithi006.stdout:0/851: unlink d2/d6/d10/d11/d7e/dbe/cfe 0 2024-03-12T16:10:57.756 INFO:tasks.workunit.client.0.smithi006.stdout:7/952: mkdir de/d2c/d93/dbe/d4a/dbf/d13d 0 2024-03-12T16:10:57.761 INFO:tasks.workunit.client.0.smithi006.stdout:5/768: getdents d7/d9/d31/d3b/d6b/db9 0 2024-03-12T16:10:57.765 INFO:tasks.workunit.client.0.smithi006.stdout:7/953: creat de/d2c/d4f/dba/d39/f13e x:0 0 0 2024-03-12T16:10:57.770 INFO:tasks.workunit.client.0.smithi006.stdout:0/852: creat d2/d6/d108/f11b x:0 0 0 2024-03-12T16:10:57.771 INFO:tasks.workunit.client.0.smithi006.stdout:9/779: dread d0/d83/d90/f9a [0,4194304] 0 2024-03-12T16:10:57.773 INFO:tasks.workunit.client.0.smithi006.stdout:5/769: mknod d7/d9/d31/d3b/d4f/d65/de1/cff 0 2024-03-12T16:10:57.773 INFO:tasks.workunit.client.0.smithi006.stdout:6/820: dwrite d3/d11/d10/da7/d9e/fa0 [0,4194304] 0 2024-03-12T16:10:57.778 INFO:tasks.workunit.client.0.smithi006.stdout:2/807: dread d0/f45 [0,4194304] 0 2024-03-12T16:10:57.779 INFO:tasks.workunit.client.0.smithi006.stdout:0/853: rmdir d2/d6/d10/d11/d1d/d79/dd0 39 2024-03-12T16:10:57.840 INFO:tasks.workunit.client.1.smithi134.stdout:1/852: sync 2024-03-12T16:10:57.841 INFO:tasks.workunit.client.1.smithi134.stdout:1/853: mkdir d0/d117 0 2024-03-12T16:10:57.896 INFO:tasks.workunit.client.0.smithi006.stdout:9/780: rename d0/d4/d18/c74 to d0/d8/c101 0 2024-03-12T16:10:57.897 INFO:tasks.workunit.client.0.smithi006.stdout:1/811: dwrite d0/d25/f59 [4194304,4194304] 0 2024-03-12T16:10:57.900 INFO:tasks.workunit.client.0.smithi006.stdout:5/770: link d7/d9/d10/d24/fca d7/d9/d31/d3b/d4f/d80/dea/f100 0 2024-03-12T16:10:57.902 INFO:tasks.workunit.client.0.smithi006.stdout:7/954: dwrite de/d1c/d87/ddb/f69 [0,4194304] 0 2024-03-12T16:10:57.903 INFO:tasks.workunit.client.0.smithi006.stdout:7/955: fdatasync de/d2c/f3c 0 2024-03-12T16:10:57.908 INFO:tasks.workunit.client.0.smithi006.stdout:1/812: chown d0/d25/d2a/d43/lb8 40210415 1 2024-03-12T16:10:57.909 INFO:tasks.workunit.client.0.smithi006.stdout:5/771: chown d7/d9/d10/c7e 843458 1 2024-03-12T16:10:57.909 INFO:tasks.workunit.client.0.smithi006.stdout:7/956: truncate de/d2c/d4f/d83/fab 887672 0 2024-03-12T16:10:57.911 INFO:tasks.workunit.client.0.smithi006.stdout:9/781: rename d0/c1a to d0/d83/d90/dc0/c102 0 2024-03-12T16:10:57.913 INFO:tasks.workunit.client.0.smithi006.stdout:0/854: rmdir d2/d6/d37/d97/dbb/ddf 0 2024-03-12T16:10:57.920 INFO:tasks.workunit.client.0.smithi006.stdout:5/772: mknod d7/d9/d31/d3b/d4f/d80/c101 0 2024-03-12T16:10:57.921 INFO:tasks.workunit.client.0.smithi006.stdout:7/957: dread de/d1c/f96 [0,4194304] 0 2024-03-12T16:10:57.923 INFO:tasks.workunit.client.0.smithi006.stdout:5/773: mkdir d7/d41/d102 0 2024-03-12T16:10:57.926 INFO:tasks.workunit.client.0.smithi006.stdout:7/958: unlink de/d1c/d35/c8d 0 2024-03-12T16:10:57.927 INFO:tasks.workunit.client.0.smithi006.stdout:5/774: write d7/d9/d31/d3b/d4f/d65/fc5 [457050,118503] 0 2024-03-12T16:10:57.928 INFO:tasks.workunit.client.0.smithi006.stdout:2/808: getdents d0/d13/d49/d60/d2b/d62/d66 0 2024-03-12T16:10:57.930 INFO:tasks.workunit.client.0.smithi006.stdout:0/855: dwrite d2/d6/d10/f1a [4194304,4194304] 0 2024-03-12T16:10:57.933 INFO:tasks.workunit.client.0.smithi006.stdout:5/775: dread - d7/d9/d10/d24/de2/ff8 zero size 2024-03-12T16:10:57.933 INFO:tasks.workunit.client.0.smithi006.stdout:9/782: dread d0/d4/d18/d4d/fd0 [0,4194304] 0 2024-03-12T16:10:57.934 INFO:tasks.workunit.client.0.smithi006.stdout:2/809: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/cd6 144267 1 2024-03-12T16:10:57.937 INFO:tasks.workunit.client.0.smithi006.stdout:0/856: write d2/d6/d10/d11/d7e/da6/de4/ff7 [1384599,17513] 0 2024-03-12T16:10:57.937 INFO:tasks.workunit.client.0.smithi006.stdout:9/783: chown d0/d4/d18/cf8 261105 1 2024-03-12T16:10:57.938 INFO:tasks.workunit.client.0.smithi006.stdout:5/776: readlink d7/d9/d31/d3b/d61/la9 0 2024-03-12T16:10:57.940 INFO:tasks.workunit.client.0.smithi006.stdout:0/857: rmdir d2/d39/dec 39 2024-03-12T16:10:57.942 INFO:tasks.workunit.client.0.smithi006.stdout:2/810: creat d0/dc/d97/ff5 x:0 0 0 2024-03-12T16:10:57.943 INFO:tasks.workunit.client.0.smithi006.stdout:9/784: write d0/d4/d18/fd6 [1736478,88574] 0 2024-03-12T16:10:57.943 INFO:tasks.workunit.client.0.smithi006.stdout:1/813: dwrite d0/d25/d2a/d35/d3f/f5a [0,4194304] 0 2024-03-12T16:10:57.944 INFO:tasks.workunit.client.1.smithi134.stdout:1/854: sync 2024-03-12T16:10:57.946 INFO:tasks.workunit.client.1.smithi134.stdout:1/855: getdents d0/d42/d113 0 2024-03-12T16:10:57.947 INFO:tasks.workunit.client.0.smithi006.stdout:5/777: mkdir d7/d9/d31/d3b/d4f/d9e/d103 0 2024-03-12T16:10:57.948 INFO:tasks.workunit.client.0.smithi006.stdout:0/858: mknod d2/d6/c11c 0 2024-03-12T16:10:57.948 INFO:tasks.workunit.client.1.smithi134.stdout:1/856: chown d0/d16/d9/d13/d21/d20/f7e 1 1 2024-03-12T16:10:57.950 INFO:tasks.workunit.client.0.smithi006.stdout:9/785: fdatasync d0/d4/d70/f8e 0 2024-03-12T16:10:57.952 INFO:tasks.workunit.client.1.smithi134.stdout:1/857: mknod d0/d16/d9/d13/d21/d5f/c118 0 2024-03-12T16:10:57.952 INFO:tasks.workunit.client.0.smithi006.stdout:7/959: dwrite de/d2c/d93/dbe/d4a/d6a/f6d [0,4194304] 0 2024-03-12T16:10:57.953 INFO:tasks.workunit.client.0.smithi006.stdout:0/859: chown d2/d6/d10/d11/d32/fc2 27059013 1 2024-03-12T16:10:57.953 INFO:tasks.workunit.client.0.smithi006.stdout:1/814: mknod d0/d25/d67/c11e 0 2024-03-12T16:10:57.955 INFO:tasks.workunit.client.0.smithi006.stdout:7/960: read de/d2c/d4f/dba/fca [4527103,7322] 0 2024-03-12T16:10:57.957 INFO:tasks.workunit.client.0.smithi006.stdout:5/778: rmdir d7/d9/d31/ded 39 2024-03-12T16:10:57.957 INFO:tasks.workunit.client.0.smithi006.stdout:1/815: fsync d0/d25/d2a/d35/ffd 0 2024-03-12T16:10:57.958 INFO:tasks.workunit.client.0.smithi006.stdout:9/786: dread d0/d4/d70/f8e [0,4194304] 0 2024-03-12T16:10:57.958 INFO:tasks.workunit.client.0.smithi006.stdout:2/811: mknod d0/d13/d49/d60/d2b/cf6 0 2024-03-12T16:10:57.959 INFO:tasks.workunit.client.0.smithi006.stdout:9/787: readlink d0/d4/ld3 0 2024-03-12T16:10:57.961 INFO:tasks.workunit.client.0.smithi006.stdout:7/961: truncate de/d2c/d4f/dba/d40/f139 745965 0 2024-03-12T16:10:57.962 INFO:tasks.workunit.client.0.smithi006.stdout:0/860: rename d2/d6/d10/d11/d7e/da6/cd2 to d2/d6/d37/d97/dbb/c11d 0 2024-03-12T16:10:57.963 INFO:tasks.workunit.client.0.smithi006.stdout:7/962: chown de/d1c/f96 1879279 1 2024-03-12T16:10:57.964 INFO:tasks.workunit.client.0.smithi006.stdout:1/816: symlink d0/d25/d2a/d43/de0/l11f 0 2024-03-12T16:10:57.966 INFO:tasks.workunit.client.0.smithi006.stdout:9/788: creat d0/d8/d16/d7d/db5/f103 x:0 0 0 2024-03-12T16:10:57.968 INFO:tasks.workunit.client.0.smithi006.stdout:5/779: dwrite d7/d9/d10/fae [0,4194304] 0 2024-03-12T16:10:57.972 INFO:tasks.workunit.client.0.smithi006.stdout:2/812: getdents d0/d13/d49/d60/d2b/d62/d79 0 2024-03-12T16:10:57.973 INFO:tasks.workunit.client.0.smithi006.stdout:0/861: link d2/d39/f114 d2/d6/d10/f11e 0 2024-03-12T16:10:57.975 INFO:tasks.workunit.client.0.smithi006.stdout:9/789: mknod d0/d4/d18/c104 0 2024-03-12T16:10:57.977 INFO:tasks.workunit.client.0.smithi006.stdout:5/780: mkdir d7/d9/d31/d3b/d4f/d9e/ddb/d104 0 2024-03-12T16:10:57.977 INFO:tasks.workunit.client.0.smithi006.stdout:7/963: dwrite de/d1c/d87/f115 [0,4194304] 0 2024-03-12T16:10:57.981 INFO:tasks.workunit.client.0.smithi006.stdout:9/790: truncate d0/d4/d18/f44 4228596 0 2024-03-12T16:10:57.982 INFO:tasks.workunit.client.0.smithi006.stdout:2/813: mknod d0/d13/d49/d60/d2b/d62/d66/da6/cf7 0 2024-03-12T16:10:57.986 INFO:tasks.workunit.client.0.smithi006.stdout:7/964: symlink de/d2c/d93/dbe/d4a/dd1/d118/l13f 0 2024-03-12T16:10:57.990 INFO:tasks.workunit.client.0.smithi006.stdout:9/791: creat d0/d4/d70/da6/f105 x:0 0 0 2024-03-12T16:10:57.991 INFO:tasks.workunit.client.0.smithi006.stdout:5/781: dwrite d7/d9/d31/d3b/fc8 [0,4194304] 0 2024-03-12T16:10:57.992 INFO:tasks.workunit.client.0.smithi006.stdout:5/782: chown d7/d9/d31/d3b/d4f/db5 1156076 1 2024-03-12T16:10:57.994 INFO:tasks.workunit.client.0.smithi006.stdout:9/792: chown d0/d4/d70/da6/ff1 1 1 2024-03-12T16:10:57.994 INFO:tasks.workunit.client.0.smithi006.stdout:1/817: truncate d0/d25/fd6 964441 0 2024-03-12T16:10:57.995 INFO:tasks.workunit.client.0.smithi006.stdout:5/783: dread - d7/d9/d10/d24/fb2 zero size 2024-03-12T16:10:57.997 INFO:tasks.workunit.client.0.smithi006.stdout:0/862: getdents d2/d6/d10/d11/d7e/dbe 0 2024-03-12T16:10:57.999 INFO:tasks.workunit.client.0.smithi006.stdout:9/793: creat d0/d1f/f106 x:0 0 0 2024-03-12T16:10:58.000 INFO:tasks.workunit.client.0.smithi006.stdout:7/965: dwrite de/d7b/d7e/fbc [0,4194304] 0 2024-03-12T16:10:58.002 INFO:tasks.workunit.client.0.smithi006.stdout:0/863: write d2/d88/f119 [797713,77433] 0 2024-03-12T16:10:58.002 INFO:tasks.workunit.client.0.smithi006.stdout:1/818: symlink d0/d25/d2a/d43/d63/db6/l120 0 2024-03-12T16:10:58.003 INFO:tasks.workunit.client.0.smithi006.stdout:5/784: mkdir d7/d9/d47/d56/d105 0 2024-03-12T16:10:58.005 INFO:tasks.workunit.client.0.smithi006.stdout:9/794: symlink d0/d4/da7/l107 0 2024-03-12T16:10:58.006 INFO:tasks.workunit.client.0.smithi006.stdout:9/795: chown d0/d8f/ce1 0 1 2024-03-12T16:10:58.009 INFO:tasks.workunit.client.0.smithi006.stdout:0/864: creat d2/d6/d10/ddd/de8/f11f x:0 0 0 2024-03-12T16:10:58.020 INFO:tasks.workunit.client.0.smithi006.stdout:5/785: rename d7/d9/d47/fd8 to d7/d9/d47/d56/dc4/f106 0 2024-03-12T16:10:58.024 INFO:tasks.workunit.client.0.smithi006.stdout:9/796: creat d0/d8/d16/d7d/f108 x:0 0 0 2024-03-12T16:10:58.024 INFO:tasks.workunit.client.0.smithi006.stdout:1/819: symlink d0/d25/d2a/l121 0 2024-03-12T16:10:58.024 INFO:tasks.workunit.client.0.smithi006.stdout:5/786: mknod d7/d8/d8a/c107 0 2024-03-12T16:10:58.024 INFO:tasks.workunit.client.0.smithi006.stdout:9/797: mknod d0/d4/d3b/d6a/c109 0 2024-03-12T16:10:58.024 INFO:tasks.workunit.client.0.smithi006.stdout:2/814: dwrite d0/d13/d49/d60/d2b/d62/d66/fcd [0,4194304] 0 2024-03-12T16:10:58.025 INFO:tasks.workunit.client.0.smithi006.stdout:9/798: write d0/d8/d16/f46 [1363936,127603] 0 2024-03-12T16:10:58.026 INFO:tasks.workunit.client.0.smithi006.stdout:1/820: creat d0/d25/d2a/d43/d68/d111/d119/f122 x:0 0 0 2024-03-12T16:10:58.028 INFO:tasks.workunit.client.0.smithi006.stdout:0/865: creat d2/d39/d42/f120 x:0 0 0 2024-03-12T16:10:58.032 INFO:tasks.workunit.client.0.smithi006.stdout:5/787: rename d7/d9/d10/d24/f76 to d7/d9/d31/d3b/d6b/f108 0 2024-03-12T16:10:58.033 INFO:tasks.workunit.client.0.smithi006.stdout:2/815: symlink d0/dc/d64/dc3/lf8 0 2024-03-12T16:10:58.034 INFO:tasks.workunit.client.0.smithi006.stdout:7/966: dwrite de/d18/f19 [0,4194304] 0 2024-03-12T16:10:58.035 INFO:tasks.workunit.client.0.smithi006.stdout:9/799: creat d0/d8/d16/d7d/d20/f10a x:0 0 0 2024-03-12T16:10:58.037 INFO:tasks.workunit.client.1.smithi134.stdout:1/858: sync 2024-03-12T16:10:58.041 INFO:tasks.workunit.client.1.smithi134.stdout:1/859: write d0/d16/d9/d13/d21/d20/f44 [8923608,66358] 0 2024-03-12T16:10:58.041 INFO:tasks.workunit.client.1.smithi134.stdout:1/860: chown d0/d42/d47/cba 3102 1 2024-03-12T16:10:58.041 INFO:tasks.workunit.client.0.smithi006.stdout:7/967: read - de/d2c/dd3/fe0 zero size 2024-03-12T16:10:58.041 INFO:tasks.workunit.client.1.smithi134.stdout:1/861: write d0/d16/d9/d73/f94 [2119906,84922] 0 2024-03-12T16:10:58.043 INFO:tasks.workunit.client.0.smithi006.stdout:0/866: symlink d2/d6/d10/d11/d1d/d2e/l121 0 2024-03-12T16:10:58.044 INFO:tasks.workunit.client.1.smithi134.stdout:1/862: creat d0/f119 x:0 0 0 2024-03-12T16:10:58.044 INFO:tasks.workunit.client.0.smithi006.stdout:9/800: creat d0/d8/d16/d7d/d20/d37/dc5/dcf/f10b x:0 0 0 2024-03-12T16:10:58.057 INFO:tasks.workunit.client.0.smithi006.stdout:7/968: unlink de/d2c/d4f/d83/fae 0 2024-03-12T16:10:58.057 INFO:tasks.workunit.client.1.smithi134.stdout:1/863: truncate d0/d42/f92 210585 0 2024-03-12T16:10:58.057 INFO:tasks.workunit.client.0.smithi006.stdout:2/816: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/dec/lf9 0 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/864: mknod d0/d16/d9/d13/d21/dac/c11a 0 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/865: write d0/d16/d9/d13/ddd/fd4 [105876,74046] 0 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/866: chown d0/d16/d9/d13/d21/d5f/d6f/d85/f83 254634 1 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/867: write d0/d16/d9/d13/f17 [4869572,40699] 0 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.1.smithi134.stdout:1/868: write d0/d30/d86/fc5 [4714980,38892] 0 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.0.smithi006.stdout:5/788: creat d7/d9/d31/d3b/d4f/f109 x:0 0 0 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.0.smithi006.stdout:0/867: creat d2/d6/d10/d11/d7e/da6/de4/f122 x:0 0 0 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.0.smithi006.stdout:9/801: truncate d0/d4/d70/d86/f63 2003366 0 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.0.smithi006.stdout:0/868: truncate d2/fc4 268351 0 2024-03-12T16:10:58.059 INFO:tasks.workunit.client.0.smithi006.stdout:2/817: getdents d0/d13/d49/dc1 0 2024-03-12T16:10:58.060 INFO:tasks.workunit.client.1.smithi134.stdout:1/869: dread d0/d16/d9/d13/ddd/fd4 [0,4194304] 0 2024-03-12T16:10:58.060 INFO:tasks.workunit.client.0.smithi006.stdout:7/969: dread de/d18/f1f [0,4194304] 0 2024-03-12T16:10:58.060 INFO:tasks.workunit.client.0.smithi006.stdout:2/818: fdatasync d0/d13/f7c 0 2024-03-12T16:10:58.061 INFO:tasks.workunit.client.1.smithi134.stdout:1/870: write d0/d30/d48/fda [298219,81248] 0 2024-03-12T16:10:58.062 INFO:tasks.workunit.client.0.smithi006.stdout:9/802: creat d0/d4/d18/f10c x:0 0 0 2024-03-12T16:10:58.062 INFO:tasks.workunit.client.0.smithi006.stdout:7/970: mknod de/d2c/d4f/d8a/c140 0 2024-03-12T16:10:58.064 INFO:tasks.workunit.client.1.smithi134.stdout:1/871: rename d0/l1f to d0/d16/d9/d13/d21/l11b 0 2024-03-12T16:10:58.075 INFO:tasks.workunit.client.0.smithi006.stdout:7/971: mkdir de/d2c/d141 0 2024-03-12T16:10:58.076 INFO:tasks.workunit.client.0.smithi006.stdout:9/803: symlink d0/d4/d3b/dff/l10d 0 2024-03-12T16:10:58.077 INFO:tasks.workunit.client.0.smithi006.stdout:7/972: rename de/d2c/d4f/dba/f9e to de/d1c/d87/ddb/d97/f142 0 2024-03-12T16:10:58.077 INFO:tasks.workunit.client.0.smithi006.stdout:7/973: read de/d1c/d87/ddb/f69 [3644418,1373] 0 2024-03-12T16:10:58.078 INFO:tasks.workunit.client.0.smithi006.stdout:7/974: chown de/d2c/d93/dbe 11 1 2024-03-12T16:10:58.078 INFO:tasks.workunit.client.0.smithi006.stdout:9/804: rename d0/d4/d70/c93 to d0/d8/c10e 0 2024-03-12T16:10:58.078 INFO:tasks.workunit.client.0.smithi006.stdout:2/819: dread d0/d13/d49/d60/d2b/d62/d66/d67/fa0 [0,4194304] 0 2024-03-12T16:10:58.079 INFO:tasks.workunit.client.1.smithi134.stdout:1/872: write d0/f10a [962718,65549] 0 2024-03-12T16:10:58.079 INFO:tasks.workunit.client.1.smithi134.stdout:1/873: unlink d0/d16/d9/d13/ddd/cd1 0 2024-03-12T16:10:58.080 INFO:tasks.workunit.client.1.smithi134.stdout:1/874: rmdir d0/d117 0 2024-03-12T16:10:58.080 INFO:tasks.workunit.client.1.smithi134.stdout:1/875: chown d0/d16/d9/d13/d21 251 1 2024-03-12T16:10:58.081 INFO:tasks.workunit.client.0.smithi006.stdout:9/805: creat d0/d4/d3b/dca/f10f x:0 0 0 2024-03-12T16:10:58.081 INFO:tasks.workunit.client.1.smithi134.stdout:1/876: mkdir d0/d30/d86/d11c 0 2024-03-12T16:10:58.082 INFO:tasks.workunit.client.1.smithi134.stdout:1/877: unlink d0/d30/d86/fbc 0 2024-03-12T16:10:58.083 INFO:tasks.workunit.client.0.smithi006.stdout:7/975: getdents de/d7b/dfc 0 2024-03-12T16:10:58.086 INFO:tasks.workunit.client.0.smithi006.stdout:2/820: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/caa 3153147 1 2024-03-12T16:10:58.086 INFO:tasks.workunit.client.0.smithi006.stdout:0/869: dwrite d2/d6/d10/d11/f84 [0,4194304] 0 2024-03-12T16:10:58.086 INFO:tasks.workunit.client.0.smithi006.stdout:9/806: fdatasync d0/d8/d16/d7d/db5/fb7 0 2024-03-12T16:10:58.087 INFO:tasks.workunit.client.1.smithi134.stdout:1/878: rename d0/d42/d109 to d0/d30/d48/d11d 0 2024-03-12T16:10:58.088 INFO:tasks.workunit.client.1.smithi134.stdout:1/879: truncate d0/d16/d9/d13/d21/d20/fd8 87184 0 2024-03-12T16:10:58.088 INFO:tasks.workunit.client.0.smithi006.stdout:0/870: creat d2/d88/d103/f123 x:0 0 0 2024-03-12T16:10:58.089 INFO:tasks.workunit.client.1.smithi134.stdout:1/880: dread d0/d16/d9/d13/d21/f4c [0,4194304] 0 2024-03-12T16:10:58.093 INFO:tasks.workunit.client.0.smithi006.stdout:2/821: chown d0/d13/d49/d60/d2b/dcc 262 1 2024-03-12T16:10:58.095 INFO:tasks.workunit.client.1.smithi134.stdout:1/881: chown d0/d16/d9/d51/dfa 199 1 2024-03-12T16:10:58.095 INFO:tasks.workunit.client.0.smithi006.stdout:2/822: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/dec 181322357 1 2024-03-12T16:10:58.096 INFO:tasks.workunit.client.0.smithi006.stdout:7/976: symlink de/d2c/d93/dbe/d4a/dd1/d118/d134/l143 0 2024-03-12T16:10:58.096 INFO:tasks.workunit.client.0.smithi006.stdout:9/807: mkdir d0/d8/d16/d2f/dd5/d110 0 2024-03-12T16:10:58.097 INFO:tasks.workunit.client.1.smithi134.stdout:1/882: mkdir d0/d16/d9/d13/d38/def/d11e 0 2024-03-12T16:10:58.098 INFO:tasks.workunit.client.1.smithi134.stdout:1/883: dread - d0/d30/d48/da1/fdb zero size 2024-03-12T16:10:58.098 INFO:tasks.workunit.client.1.smithi134.stdout:1/884: rename d0/d16/d9/d13/d21/dac/fe4 to d0/dde/f11f 0 2024-03-12T16:10:58.100 INFO:tasks.workunit.client.0.smithi006.stdout:2/823: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f8d 64858 1 2024-03-12T16:10:58.100 INFO:tasks.workunit.client.0.smithi006.stdout:9/808: chown d0/d4/d18/f10c 1356 1 2024-03-12T16:10:58.100 INFO:tasks.workunit.client.0.smithi006.stdout:0/871: creat d2/d6/d10/f124 x:0 0 0 2024-03-12T16:10:58.100 INFO:tasks.workunit.client.0.smithi006.stdout:7/977: mknod de/d2c/d93/dbe/d4a/dd1/d118/d134/c144 0 2024-03-12T16:10:58.101 INFO:tasks.workunit.client.1.smithi134.stdout:1/885: getdents d0/d30 0 2024-03-12T16:10:58.104 INFO:tasks.workunit.client.0.smithi006.stdout:0/872: fdatasync d2/fc4 0 2024-03-12T16:10:58.104 INFO:tasks.workunit.client.0.smithi006.stdout:0/873: stat d2/d6/c11c 0 2024-03-12T16:10:58.105 INFO:tasks.workunit.client.0.smithi006.stdout:9/809: dwrite d0/d4/d9b/fdf [0,4194304] 0 2024-03-12T16:10:58.105 INFO:tasks.workunit.client.1.smithi134.stdout:1/886: readlink d0/d16/d9/d13/d21/d2f/le8 0 2024-03-12T16:10:58.107 INFO:tasks.workunit.client.0.smithi006.stdout:9/810: write d0/fb1 [3734942,31208] 0 2024-03-12T16:10:58.108 INFO:tasks.workunit.client.1.smithi134.stdout:1/887: mkdir d0/d16/d9/d13/d21/d2f/d8d/dfc/d120 0 2024-03-12T16:10:58.109 INFO:tasks.workunit.client.1.smithi134.stdout:1/888: truncate d0/d42/ff2 25061 0 2024-03-12T16:10:58.109 INFO:tasks.workunit.client.1.smithi134.stdout:1/889: chown d0/d16/d9/d13/d21/d2f/f77 26307201 1 2024-03-12T16:10:58.109 INFO:tasks.workunit.client.1.smithi134.stdout:1/890: stat d0/f6b 0 2024-03-12T16:10:58.109 INFO:tasks.workunit.client.1.smithi134.stdout:1/891: creat d0/d16/d9/f121 x:0 0 0 2024-03-12T16:10:58.121 INFO:tasks.workunit.client.0.smithi006.stdout:9/811: stat d0/d83/d90/lf6 0 2024-03-12T16:10:58.123 INFO:tasks.workunit.client.1.smithi134.stdout:1/892: rename d0/d30/d48 to d0/d30/d48/d122 22 2024-03-12T16:10:58.123 INFO:tasks.workunit.client.0.smithi006.stdout:9/812: fdatasync d0/d8/d16/d7d/db5/fbe 0 2024-03-12T16:10:58.125 INFO:tasks.workunit.client.1.smithi134.stdout:1/893: mknod d0/c123 0 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.0.smithi006.stdout:2/824: dwrite d0/d13/d49/d60/d2b/d62/d79/fb7 [0,4194304] 0 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.0.smithi006.stdout:2/825: chown d0/f45 42684829 1 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.0.smithi006.stdout:9/813: link d0/d4/d3b/dca/f10f d0/d4/d3b/dff/f111 0 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.0.smithi006.stdout:0/874: dwrite d2/d6/d10/d11/d32/f3a [4194304,4194304] 0 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.0.smithi006.stdout:0/875: write d2/d6/d10/d11/d32/f3a [8558769,40870] 0 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/894: symlink d0/d30/d48/l124 0 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/895: chown d0/d16/d9/d13/l2b 91 1 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/896: dread - d0/dde/f11f zero size 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/897: readlink d0/d16/d9/d73/l111 0 2024-03-12T16:10:58.127 INFO:tasks.workunit.client.1.smithi134.stdout:1/898: creat d0/dde/f125 x:0 0 0 2024-03-12T16:10:58.128 INFO:tasks.workunit.client.0.smithi006.stdout:0/876: rmdir d2/d6/d10/d11/d1d/d2e 39 2024-03-12T16:10:58.132 INFO:tasks.workunit.client.0.smithi006.stdout:0/877: readlink d2/d6/d10/d11/d32/da4/la9 0 2024-03-12T16:10:58.132 INFO:tasks.workunit.client.0.smithi006.stdout:9/814: dwrite d0/d83/fe3 [0,4194304] 0 2024-03-12T16:10:58.132 INFO:tasks.workunit.client.0.smithi006.stdout:0/878: readlink d2/d88/dc9/l107 0 2024-03-12T16:10:58.139 INFO:tasks.workunit.client.0.smithi006.stdout:9/815: creat d0/d8/d16/d7d/d20/f112 x:0 0 0 2024-03-12T16:10:58.141 INFO:tasks.workunit.client.0.smithi006.stdout:0/879: mkdir d2/d6/d10/d110/d125 0 2024-03-12T16:10:58.141 INFO:tasks.workunit.client.0.smithi006.stdout:9/816: dread d0/d4/d9b/fdf [0,4194304] 0 2024-03-12T16:10:58.144 INFO:tasks.workunit.client.0.smithi006.stdout:9/817: creat d0/d4/f113 x:0 0 0 2024-03-12T16:10:58.144 INFO:tasks.workunit.client.0.smithi006.stdout:9/818: chown d0/d4/d70 133687861 1 2024-03-12T16:10:58.147 INFO:tasks.workunit.client.0.smithi006.stdout:9/819: creat d0/d8/d16/d2f/dd5/f114 x:0 0 0 2024-03-12T16:10:58.149 INFO:tasks.workunit.client.0.smithi006.stdout:9/820: symlink d0/d4/d9b/l115 0 2024-03-12T16:10:58.153 INFO:tasks.workunit.client.0.smithi006.stdout:9/821: getdents d0/d8/d16/d2f 0 2024-03-12T16:10:58.155 INFO:tasks.workunit.client.0.smithi006.stdout:9/822: creat d0/d8/d16/f116 x:0 0 0 2024-03-12T16:10:58.164 INFO:tasks.workunit.client.0.smithi006.stdout:2/826: write d0/d13/d49/d60/d2b/d62/d66/d67/fc9 [769893,110070] 0 2024-03-12T16:10:58.165 INFO:tasks.workunit.client.0.smithi006.stdout:0/880: dread d2/f1f [0,4194304] 0 2024-03-12T16:10:58.166 INFO:tasks.workunit.client.0.smithi006.stdout:0/881: chown d2/f74 2580326 1 2024-03-12T16:10:58.166 INFO:tasks.workunit.client.0.smithi006.stdout:2/827: getdents d0/dc/de0 0 2024-03-12T16:10:58.168 INFO:tasks.workunit.client.0.smithi006.stdout:2/828: chown d0/dc/d64/dc3 525578825 1 2024-03-12T16:10:58.168 INFO:tasks.workunit.client.0.smithi006.stdout:9/823: dwrite d0/d4/ff9 [0,4194304] 0 2024-03-12T16:10:58.168 INFO:tasks.workunit.client.0.smithi006.stdout:9/824: write d0/d4/d70/fea [1021234,98364] 0 2024-03-12T16:10:58.168 INFO:tasks.workunit.client.0.smithi006.stdout:0/882: creat d2/d6/d10/d11/d7e/da6/f126 x:0 0 0 2024-03-12T16:10:58.168 INFO:tasks.workunit.client.0.smithi006.stdout:2/829: chown d0/d13/d49/d60/d2b/l31 6 1 2024-03-12T16:10:58.173 INFO:tasks.workunit.client.0.smithi006.stdout:2/830: readlink d0/dc/l71 0 2024-03-12T16:10:58.174 INFO:tasks.workunit.client.0.smithi006.stdout:0/883: chown d2/d39/d42/l5f 2928939 1 2024-03-12T16:10:58.176 INFO:tasks.workunit.client.0.smithi006.stdout:0/884: readlink d2/d6/d37/d97/dbb/ld8 0 2024-03-12T16:10:58.177 INFO:tasks.workunit.client.0.smithi006.stdout:2/831: creat d0/d13/d49/ffa x:0 0 0 2024-03-12T16:10:58.177 INFO:tasks.workunit.client.0.smithi006.stdout:9/825: dwrite d0/d8/d80/f97 [0,4194304] 0 2024-03-12T16:10:58.177 INFO:tasks.workunit.client.0.smithi006.stdout:2/832: read - d0/d13/d49/d60/d2b/d62/d79/fe4 zero size 2024-03-12T16:10:58.181 INFO:tasks.workunit.client.0.smithi006.stdout:0/885: rename d2/c14 to d2/d6/d10/d11/d7e/da6/d9e/c127 0 2024-03-12T16:10:58.184 INFO:tasks.workunit.client.0.smithi006.stdout:9/826: creat d0/d8/d80/dfd/f117 x:0 0 0 2024-03-12T16:10:58.184 INFO:tasks.workunit.client.0.smithi006.stdout:2/833: creat d0/d13/d49/d60/d2b/d62/d66/d67/ffb x:0 0 0 2024-03-12T16:10:58.187 INFO:tasks.workunit.client.0.smithi006.stdout:9/827: creat d0/d4/d3b/d6a/f118 x:0 0 0 2024-03-12T16:10:58.187 INFO:tasks.workunit.client.0.smithi006.stdout:0/886: mkdir d2/d6/d10/d11/d1d/d79/dd0/d128 0 2024-03-12T16:10:58.188 INFO:tasks.workunit.client.0.smithi006.stdout:2/834: dread - d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/dbb/fd8 zero size 2024-03-12T16:10:58.188 INFO:tasks.workunit.client.0.smithi006.stdout:0/887: chown d2/d6/lcf 411731 1 2024-03-12T16:10:58.188 INFO:tasks.workunit.client.0.smithi006.stdout:9/828: creat d0/d8f/dc6/f119 x:0 0 0 2024-03-12T16:10:58.189 INFO:tasks.workunit.client.0.smithi006.stdout:8/721: sync 2024-03-12T16:10:58.192 INFO:tasks.workunit.client.0.smithi006.stdout:2/835: fsync d0/dc/de0/fe1 0 2024-03-12T16:10:58.192 INFO:tasks.workunit.client.0.smithi006.stdout:2/836: chown d0/d13/d49/c5c 353294 1 2024-03-12T16:10:58.193 INFO:tasks.workunit.client.0.smithi006.stdout:9/829: creat d0/d8/d16/d7d/d20/d100/f11a x:0 0 0 2024-03-12T16:10:58.194 INFO:tasks.workunit.client.0.smithi006.stdout:8/722: creat d2/db/d1a/d23/fe8 x:0 0 0 2024-03-12T16:10:58.197 INFO:tasks.workunit.client.0.smithi006.stdout:9/830: getdents d0/d8/d16/dee 0 2024-03-12T16:10:58.211 INFO:tasks.workunit.client.1.smithi134.stdout:1/899: sync 2024-03-12T16:10:58.213 INFO:tasks.workunit.client.1.smithi134.stdout:1/900: chown d0/d42/fb0 4003 1 2024-03-12T16:10:58.213 INFO:tasks.workunit.client.1.smithi134.stdout:1/901: stat d0/d16/d9/d13/d21/c8f 0 2024-03-12T16:10:58.216 INFO:tasks.workunit.client.1.smithi134.stdout:1/902: rmdir d0/d42/d113 0 2024-03-12T16:10:58.218 INFO:tasks.workunit.client.1.smithi134.stdout:1/903: symlink d0/d16/d9/d13/d38/d103/l126 0 2024-03-12T16:10:58.219 INFO:tasks.workunit.client.1.smithi134.stdout:1/904: creat d0/d30/d48/da1/f127 x:0 0 0 2024-03-12T16:10:58.219 INFO:tasks.workunit.client.1.smithi134.stdout:1/905: stat d0/f2a 0 2024-03-12T16:10:58.220 INFO:tasks.workunit.client.1.smithi134.stdout:1/906: chown d0/d42/d47/fc2 461070 1 2024-03-12T16:10:58.224 INFO:tasks.workunit.client.1.smithi134.stdout:1/907: dread d0/d30/d86/f102 [0,4194304] 0 2024-03-12T16:10:58.225 INFO:tasks.workunit.client.1.smithi134.stdout:1/908: read d0/d16/d9/fed [1195237,51573] 0 2024-03-12T16:10:58.227 INFO:tasks.workunit.client.1.smithi134.stdout:1/909: mknod d0/d42/d47/c128 0 2024-03-12T16:10:58.230 INFO:tasks.workunit.client.1.smithi134.stdout:1/910: symlink d0/d16/l129 0 2024-03-12T16:10:58.232 INFO:tasks.workunit.client.1.smithi134.stdout:1/911: mknod d0/d16/d9/d13/d38/d103/c12a 0 2024-03-12T16:10:58.233 INFO:tasks.workunit.client.1.smithi134.stdout:1/912: read - d0/d16/d9/d51/feb zero size 2024-03-12T16:10:58.240 INFO:tasks.workunit.client.1.smithi134.stdout:1/913: dread d0/d16/d9/d13/d21/d2f/f9d [0,4194304] 0 2024-03-12T16:10:58.242 INFO:tasks.workunit.client.1.smithi134.stdout:1/914: dread d0/d16/d9/d13/d21/d2f/f9d [0,4194304] 0 2024-03-12T16:10:58.277 INFO:tasks.workunit.client.0.smithi006.stdout:8/723: creat d2/db/d1a/d21/dad/fe9 x:0 0 0 2024-03-12T16:10:58.278 INFO:tasks.workunit.client.0.smithi006.stdout:0/888: dwrite d2/d6/d10/d11/d1d/d2e/f6a [4194304,4194304] 0 2024-03-12T16:10:58.278 INFO:tasks.workunit.client.0.smithi006.stdout:9/831: chown d0/d1f 5518308 1 2024-03-12T16:10:58.280 INFO:tasks.workunit.client.0.smithi006.stdout:8/724: truncate d2/d11/f42 1460789 0 2024-03-12T16:10:58.282 INFO:tasks.workunit.client.0.smithi006.stdout:8/725: stat d2/db/d1a/ld9 0 2024-03-12T16:10:58.316 INFO:tasks.workunit.client.1.smithi134.stdout:1/915: sync 2024-03-12T16:10:58.319 INFO:tasks.workunit.client.1.smithi134.stdout:1/916: dread - d0/f119 zero size 2024-03-12T16:10:58.320 INFO:tasks.workunit.client.1.smithi134.stdout:1/917: symlink d0/d16/d9/d13/d21/d5f/d6f/l12b 0 2024-03-12T16:10:58.326 INFO:tasks.workunit.client.1.smithi134.stdout:1/918: dwrite d0/d30/d48/da1/fdb [0,4194304] 0 2024-03-12T16:10:58.347 INFO:tasks.workunit.client.1.smithi134.stdout:1/919: dwrite d0/d16/d9/d13/d21/d5f/d6f/d85/dee/f104 [0,4194304] 0 2024-03-12T16:10:58.351 INFO:tasks.workunit.client.1.smithi134.stdout:1/920: write d0/d16/d9/d13/d21/d5f/d6f/dad/ff9 [491623,90927] 0 2024-03-12T16:10:58.353 INFO:tasks.workunit.client.1.smithi134.stdout:1/921: dread d0/d16/d9/d13/d38/f75 [0,4194304] 0 2024-03-12T16:10:58.357 INFO:tasks.workunit.client.1.smithi134.stdout:1/922: rename d0/d16/d9/d13/d21/dac to d0/d16/d39/d12c 0 2024-03-12T16:10:58.360 INFO:tasks.workunit.client.0.smithi006.stdout:0/889: rename d2/d6/d37 to d2/d88/d129 0 2024-03-12T16:10:58.361 INFO:tasks.workunit.client.0.smithi006.stdout:4/880: sync 2024-03-12T16:10:58.361 INFO:tasks.workunit.client.1.smithi134.stdout:1/923: rename d0/l19 to d0/d30/l12d 0 2024-03-12T16:10:58.364 INFO:tasks.workunit.client.1.smithi134.stdout:1/924: unlink d0/d16/d9/d51/l9c 0 2024-03-12T16:10:58.368 INFO:tasks.workunit.client.0.smithi006.stdout:2/837: dwrite d0/d13/d49/d60/d2b/d62/d66/d67/ffb [0,4194304] 0 2024-03-12T16:10:58.369 INFO:tasks.workunit.client.0.smithi006.stdout:0/890: chown d2/d6/d10/d11/d32/da4 0 1 2024-03-12T16:10:58.369 INFO:tasks.workunit.client.0.smithi006.stdout:8/726: write d2/d11/d5a/f5f [3379939,29182] 0 2024-03-12T16:10:58.371 INFO:tasks.workunit.client.0.smithi006.stdout:8/727: dread - d2/d11/fdf zero size 2024-03-12T16:10:58.371 INFO:tasks.workunit.client.0.smithi006.stdout:9/832: dread d0/d4/d9b/fdf [0,4194304] 0 2024-03-12T16:10:58.372 INFO:tasks.workunit.client.0.smithi006.stdout:8/728: readlink d2/db/d1a/d1f/l9f 0 2024-03-12T16:10:58.373 INFO:tasks.workunit.client.1.smithi134.stdout:1/925: truncate d0/d16/d9/fe3 5233372 0 2024-03-12T16:10:58.374 INFO:tasks.workunit.client.0.smithi006.stdout:2/838: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89 4104568 1 2024-03-12T16:10:58.374 INFO:tasks.workunit.client.1.smithi134.stdout:1/926: chown d0/d42/d47/ff7 442672552 1 2024-03-12T16:10:58.376 INFO:tasks.workunit.client.0.smithi006.stdout:4/881: read - d1/d38/fde zero size 2024-03-12T16:10:58.377 INFO:tasks.workunit.client.1.smithi134.stdout:1/927: symlink d0/d16/l12e 0 2024-03-12T16:10:58.378 INFO:tasks.workunit.client.0.smithi006.stdout:9/833: symlink d0/d4/da7/l11b 0 2024-03-12T16:10:58.379 INFO:tasks.workunit.client.1.smithi134.stdout:1/928: unlink d0/d16/d9/d13/ddd/fd4 0 2024-03-12T16:10:58.379 INFO:tasks.workunit.client.0.smithi006.stdout:8/729: rmdir d2/db/d1a/d21/d4f/da7 39 2024-03-12T16:10:58.379 INFO:tasks.workunit.client.0.smithi006.stdout:9/834: chown d0/d8/d16/d7d/d20/d37/f57 2834513 1 2024-03-12T16:10:58.381 INFO:tasks.workunit.client.0.smithi006.stdout:9/835: truncate d0/d8/d16/f116 396214 0 2024-03-12T16:10:58.382 INFO:tasks.workunit.client.0.smithi006.stdout:0/891: getdents d2/d6/d10/d110/d125 0 2024-03-12T16:10:58.385 INFO:tasks.workunit.client.0.smithi006.stdout:8/730: fdatasync d2/db/d1a/f78 0 2024-03-12T16:10:58.386 INFO:tasks.workunit.client.0.smithi006.stdout:2/839: unlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fbd 0 2024-03-12T16:10:58.387 INFO:tasks.workunit.client.0.smithi006.stdout:9/836: creat d0/d8/d16/d7d/d20/d100/f11c x:0 0 0 2024-03-12T16:10:58.388 INFO:tasks.workunit.client.0.smithi006.stdout:9/837: readlink d0/d4/da7/l11b 0 2024-03-12T16:10:58.389 INFO:tasks.workunit.client.0.smithi006.stdout:0/892: rename d2/d6/d10/d11/d1d/c55 to d2/d88/d129/d100/c12a 0 2024-03-12T16:10:58.395 INFO:tasks.workunit.client.0.smithi006.stdout:0/893: mkdir d2/d6/d10/d11/d7e/d12b 0 2024-03-12T16:10:58.395 INFO:tasks.workunit.client.0.smithi006.stdout:9/838: dwrite d0/d4/d18/f10c [0,4194304] 0 2024-03-12T16:10:58.397 INFO:tasks.workunit.client.0.smithi006.stdout:2/840: mkdir d0/d13/d49/d60/dfc 0 2024-03-12T16:10:58.405 INFO:tasks.workunit.client.0.smithi006.stdout:2/841: fdatasync d0/d13/d49/f73 0 2024-03-12T16:10:58.405 INFO:tasks.workunit.client.0.smithi006.stdout:8/731: getdents d2/d55/d7b 0 2024-03-12T16:10:58.406 INFO:tasks.workunit.client.0.smithi006.stdout:0/894: rename d2/d6/d10/d11/d7e/da6/de4/f122 to d2/d6/d10/ddd/f12c 0 2024-03-12T16:10:58.407 INFO:tasks.workunit.client.0.smithi006.stdout:0/895: chown d2/d6/d10/d11/d32/da4/fc7 766 1 2024-03-12T16:10:58.407 INFO:tasks.workunit.client.0.smithi006.stdout:8/732: creat d2/db/d70/daa/fea x:0 0 0 2024-03-12T16:10:58.408 INFO:tasks.workunit.client.0.smithi006.stdout:9/839: dwrite d0/d1f/f6d [0,4194304] 0 2024-03-12T16:10:58.410 INFO:tasks.workunit.client.0.smithi006.stdout:9/840: chown d0/d4/d70/da6/ce4 2384603 1 2024-03-12T16:10:58.412 INFO:tasks.workunit.client.0.smithi006.stdout:8/733: mkdir d2/db/d1a/d1f/deb 0 2024-03-12T16:10:58.414 INFO:tasks.workunit.client.0.smithi006.stdout:9/841: chown d0/d4/d70/fa9 833206 1 2024-03-12T16:10:58.422 INFO:tasks.workunit.client.0.smithi006.stdout:0/896: dwrite d2/d6/d10/d11/d32/f3a [4194304,4194304] 0 2024-03-12T16:10:58.422 INFO:tasks.workunit.client.0.smithi006.stdout:2/842: rmdir d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83 39 2024-03-12T16:10:58.426 INFO:tasks.workunit.client.0.smithi006.stdout:8/734: dwrite d2/f16 [0,4194304] 0 2024-03-12T16:10:58.434 INFO:tasks.workunit.client.0.smithi006.stdout:9/842: dwrite d0/d8/ff2 [0,4194304] 0 2024-03-12T16:10:58.436 INFO:tasks.workunit.client.0.smithi006.stdout:0/897: creat d2/d6/d10/d11/d1d/d79/dd0/f12d x:0 0 0 2024-03-12T16:10:58.437 INFO:tasks.workunit.client.0.smithi006.stdout:4/882: dwrite d1/d91/fd6 [0,4194304] 0 2024-03-12T16:10:58.439 INFO:tasks.workunit.client.0.smithi006.stdout:9/843: dread - d0/d8/d16/d7d/d20/d100/f11a zero size 2024-03-12T16:10:58.444 INFO:tasks.workunit.client.0.smithi006.stdout:0/898: creat d2/d6/d10/d11/d32/da4/db5/d10c/f12e x:0 0 0 2024-03-12T16:10:58.445 INFO:tasks.workunit.client.0.smithi006.stdout:4/883: mknod d1/db/d39/dbf/c124 0 2024-03-12T16:10:58.446 INFO:tasks.workunit.client.0.smithi006.stdout:2/843: link d0/d13/d49/d60/cac d0/d13/d49/d60/d2b/d62/d66/cfd 0 2024-03-12T16:10:58.446 INFO:tasks.workunit.client.0.smithi006.stdout:0/899: fdatasync d2/d6/fb6 0 2024-03-12T16:10:58.451 INFO:tasks.workunit.client.0.smithi006.stdout:9/844: dwrite d0/d4/d9b/ffc [0,4194304] 0 2024-03-12T16:10:58.454 INFO:tasks.workunit.client.0.smithi006.stdout:9/845: chown d0/d1f/f6d 109939361 1 2024-03-12T16:10:58.455 INFO:tasks.workunit.client.0.smithi006.stdout:9/846: read - d0/d8/d16/d7d/d20/f10a zero size 2024-03-12T16:10:58.457 INFO:tasks.workunit.client.0.smithi006.stdout:0/900: read d2/d6/d10/d11/d7e/da6/f80 [3600762,74886] 0 2024-03-12T16:10:58.457 INFO:tasks.workunit.client.0.smithi006.stdout:9/847: dread - d0/d8/d16/d7d/d20/f112 zero size 2024-03-12T16:10:58.458 INFO:tasks.workunit.client.0.smithi006.stdout:0/901: chown d2/d39/d42/c9b 683061051 1 2024-03-12T16:10:58.460 INFO:tasks.workunit.client.0.smithi006.stdout:9/848: fdatasync d0/d8/d16/d2f/fda 0 2024-03-12T16:10:58.460 INFO:tasks.workunit.client.0.smithi006.stdout:2/844: rename d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/dbb/lbe to d0/d13/d49/d60/d2b/d62/d66/d69/d81/lfe 0 2024-03-12T16:10:58.461 INFO:tasks.workunit.client.0.smithi006.stdout:9/849: read d0/d4/d70/fe0 [29291,8971] 0 2024-03-12T16:10:58.462 INFO:tasks.workunit.client.0.smithi006.stdout:2/845: write d0/dc/d97/ff5 [319477,106792] 0 2024-03-12T16:10:58.464 INFO:tasks.workunit.client.0.smithi006.stdout:0/902: symlink d2/d6/d10/d11/d7e/d12b/l12f 0 2024-03-12T16:10:58.465 INFO:tasks.workunit.client.0.smithi006.stdout:0/903: fdatasync d2/d6/fb3 0 2024-03-12T16:10:58.466 INFO:tasks.workunit.client.0.smithi006.stdout:9/850: unlink d0/fb1 0 2024-03-12T16:10:58.472 INFO:tasks.workunit.client.0.smithi006.stdout:0/904: creat d2/d6/d10/ddd/de8/f130 x:0 0 0 2024-03-12T16:10:58.476 INFO:tasks.workunit.client.0.smithi006.stdout:9/851: link d0/d8/d80/cb4 d0/d8/d80/c11d 0 2024-03-12T16:10:58.477 INFO:tasks.workunit.client.0.smithi006.stdout:2/846: getdents d0/dc/d97 0 2024-03-12T16:10:58.477 INFO:tasks.workunit.client.1.smithi134.stdout:1/929: sync 2024-03-12T16:10:58.480 INFO:tasks.workunit.client.0.smithi006.stdout:0/905: getdents d2/d6/d10/d11/d7e/da6/d9e 0 2024-03-12T16:10:58.480 INFO:tasks.workunit.client.0.smithi006.stdout:8/735: dread d2/db/d1a/d21/d8a/f8b [0,4194304] 0 2024-03-12T16:10:58.481 INFO:tasks.workunit.client.0.smithi006.stdout:0/906: write d2/d39/d42/f51 [469696,38376] 0 2024-03-12T16:10:58.483 INFO:tasks.workunit.client.0.smithi006.stdout:4/884: dread d1/db/d39/dbf/dec/d43/db5/f7a [0,4194304] 0 2024-03-12T16:10:58.484 INFO:tasks.workunit.client.0.smithi006.stdout:9/852: rename d0/d83/d90/lf4 to d0/d4/d3b/d6a/l11e 0 2024-03-12T16:10:58.486 INFO:tasks.workunit.client.0.smithi006.stdout:2/847: symlink d0/d13/d49/lff 0 2024-03-12T16:10:58.490 INFO:tasks.workunit.client.0.smithi006.stdout:4/885: creat d1/db/d39/d42/d61/f125 x:0 0 0 2024-03-12T16:10:58.491 INFO:tasks.workunit.client.1.smithi134.stdout:1/930: dwrite d0/d16/d9/d13/d21/d20/f44 [0,4194304] 0 2024-03-12T16:10:58.492 INFO:tasks.workunit.client.0.smithi006.stdout:9/853: rename d0/d4/lf to d0/d8f/l11f 0 2024-03-12T16:10:58.493 INFO:tasks.workunit.client.0.smithi006.stdout:8/736: symlink d2/db/d1a/d21/d2b/lec 0 2024-03-12T16:10:58.494 INFO:tasks.workunit.client.1.smithi134.stdout:1/931: rmdir d0/d30/d86 39 2024-03-12T16:10:58.495 INFO:tasks.workunit.client.0.smithi006.stdout:8/737: stat d2/db/c67 0 2024-03-12T16:10:58.496 INFO:tasks.workunit.client.1.smithi134.stdout:1/932: creat d0/d16/d9/d13/d21/d2f/f12f x:0 0 0 2024-03-12T16:10:58.500 INFO:tasks.workunit.client.0.smithi006.stdout:9/854: symlink d0/d4/da7/l120 0 2024-03-12T16:10:58.500 INFO:tasks.workunit.client.1.smithi134.stdout:1/933: link d0/f2a d0/d16/f130 0 2024-03-12T16:10:58.501 INFO:tasks.workunit.client.1.smithi134.stdout:1/934: chown d0/d16/d9/d13/d21/d20/f8e 3 1 2024-03-12T16:10:58.501 INFO:tasks.workunit.client.0.smithi006.stdout:4/886: mknod d1/db/d39/dbf/dec/d43/c126 0 2024-03-12T16:10:58.502 INFO:tasks.workunit.client.0.smithi006.stdout:0/907: getdents d2/d6/d10/ddd/de8 0 2024-03-12T16:10:58.503 INFO:tasks.workunit.client.1.smithi134.stdout:1/935: mknod d0/d30/d48/da1/c131 0 2024-03-12T16:10:58.504 INFO:tasks.workunit.client.0.smithi006.stdout:4/887: chown d1/d38/db6 206 1 2024-03-12T16:10:58.504 INFO:tasks.workunit.client.0.smithi006.stdout:9/855: write d0/d8/d80/fd8 [263359,104745] 0 2024-03-12T16:10:58.504 INFO:tasks.workunit.client.0.smithi006.stdout:8/738: dwrite d2/d55/d7b/f83 [0,4194304] 0 2024-03-12T16:10:58.505 INFO:tasks.workunit.client.1.smithi134.stdout:1/936: creat d0/d42/d47/f132 x:0 0 0 2024-03-12T16:10:58.507 INFO:tasks.workunit.client.1.smithi134.stdout:1/937: getdents d0/d16/d9/d13/d38/def/d11e 0 2024-03-12T16:10:58.508 INFO:tasks.workunit.client.1.smithi134.stdout:1/938: write d0/d30/d86/f27 [395303,35669] 0 2024-03-12T16:10:58.509 INFO:tasks.workunit.client.0.smithi006.stdout:4/888: creat d1/db/d39/dbf/dec/d5a/d60/f127 x:0 0 0 2024-03-12T16:10:58.510 INFO:tasks.workunit.client.0.smithi006.stdout:8/739: mkdir d2/db/d1a/d1f/ded 0 2024-03-12T16:10:58.510 INFO:tasks.workunit.client.0.smithi006.stdout:9/856: write d0/d8/d16/d7d/d20/d100/f11c [649237,1232] 0 2024-03-12T16:10:58.511 INFO:tasks.workunit.client.1.smithi134.stdout:1/939: write d0/d30/d86/fc5 [2420515,434] 0 2024-03-12T16:10:58.515 INFO:tasks.workunit.client.1.smithi134.stdout:1/940: mkdir d0/d16/d9/d51/db7/d133 0 2024-03-12T16:10:58.515 INFO:tasks.workunit.client.0.smithi006.stdout:9/857: dread - d0/d4/da7/fc2 zero size 2024-03-12T16:10:58.516 INFO:tasks.workunit.client.0.smithi006.stdout:4/889: write d1/db/d1d/d2f/d6b/f11b [813751,29287] 0 2024-03-12T16:10:58.517 INFO:tasks.workunit.client.1.smithi134.stdout:1/941: creat d0/d30/d86/f134 x:0 0 0 2024-03-12T16:10:58.519 INFO:tasks.workunit.client.0.smithi006.stdout:9/858: readlink d0/d83/lad 0 2024-03-12T16:10:58.521 INFO:tasks.workunit.client.0.smithi006.stdout:0/908: dwrite d2/d6/d10/d11/d32/da4/db5/d10c/f12e [0,4194304] 0 2024-03-12T16:10:58.523 INFO:tasks.workunit.client.0.smithi006.stdout:2/848: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f96 [0,4194304] 0 2024-03-12T16:10:58.524 INFO:tasks.workunit.client.0.smithi006.stdout:8/740: rename d2/db/d1a/d21/d2b/da2/fd6 to d2/d11/d5a/dd4/fee 0 2024-03-12T16:10:58.526 INFO:tasks.workunit.client.1.smithi134.stdout:1/942: write d0/d16/fc1 [2298846,27693] 0 2024-03-12T16:10:58.526 INFO:tasks.workunit.client.0.smithi006.stdout:4/890: fsync d1/db/d1d/d2f/fc0 0 2024-03-12T16:10:58.528 INFO:tasks.workunit.client.0.smithi006.stdout:9/859: creat d0/d8/d16/d7d/d20/d37/dc5/f121 x:0 0 0 2024-03-12T16:10:58.530 INFO:tasks.workunit.client.0.smithi006.stdout:8/741: creat d2/db/d1a/d23/fef x:0 0 0 2024-03-12T16:10:58.530 INFO:tasks.workunit.client.1.smithi134.stdout:1/943: getdents d0/d16/d9/d51/db7/d133 0 2024-03-12T16:10:58.531 INFO:tasks.workunit.client.0.smithi006.stdout:2/849: write d0/d13/d49/d60/d2b/d62/d66/da6/ff3 [868251,129455] 0 2024-03-12T16:10:58.531 INFO:tasks.workunit.client.1.smithi134.stdout:1/944: chown d0/d16/d9/d51/db7/cb9 3884282 1 2024-03-12T16:10:58.533 INFO:tasks.workunit.client.1.smithi134.stdout:1/945: fsync d0/d16/d9/d13/d38/f72 0 2024-03-12T16:10:58.536 INFO:tasks.workunit.client.0.smithi006.stdout:0/909: dwrite d2/d6/d10/f124 [0,4194304] 0 2024-03-12T16:10:58.537 INFO:tasks.workunit.client.1.smithi134.stdout:1/946: creat d0/d42/d47/f135 x:0 0 0 2024-03-12T16:10:58.538 INFO:tasks.workunit.client.0.smithi006.stdout:0/910: dread - d2/d6/d10/f11e zero size 2024-03-12T16:10:58.539 INFO:tasks.workunit.client.0.smithi006.stdout:8/742: read - d2/d11/d3f/f93 zero size 2024-03-12T16:10:58.541 INFO:tasks.workunit.client.1.smithi134.stdout:1/947: rename d0/d16/d39/d12c/c11a to d0/d30/d48/d11d/d10c/c136 0 2024-03-12T16:10:58.543 INFO:tasks.workunit.client.0.smithi006.stdout:2/850: symlink d0/d13/d49/d60/dfc/l100 0 2024-03-12T16:10:58.543 INFO:tasks.workunit.client.0.smithi006.stdout:8/743: truncate d2/dab/fe5 821064 0 2024-03-12T16:10:58.543 INFO:tasks.workunit.client.1.smithi134.stdout:1/948: mkdir d0/d16/d9/d13/d21/d2f/d137 0 2024-03-12T16:10:58.545 INFO:tasks.workunit.client.1.smithi134.stdout:1/949: write d0/d42/d47/f135 [784951,87038] 0 2024-03-12T16:10:58.545 INFO:tasks.workunit.client.0.smithi006.stdout:9/860: getdents d0/d4/da7 0 2024-03-12T16:10:58.546 INFO:tasks.workunit.client.0.smithi006.stdout:0/911: fsync d2/d39/d42/f59 0 2024-03-12T16:10:58.548 INFO:tasks.workunit.client.0.smithi006.stdout:0/912: fsync d2/d88/d129/f86 0 2024-03-12T16:10:58.549 INFO:tasks.workunit.client.1.smithi134.stdout:1/950: creat d0/d16/d9/d13/d21/d5f/f138 x:0 0 0 2024-03-12T16:10:58.553 INFO:tasks.workunit.client.0.smithi006.stdout:0/913: creat d2/d88/f131 x:0 0 0 2024-03-12T16:10:58.553 INFO:tasks.workunit.client.1.smithi134.stdout:1/951: dread d0/f2a [0,4194304] 0 2024-03-12T16:10:58.555 INFO:tasks.workunit.client.0.smithi006.stdout:4/891: dwrite d1/db/d39/d42/f78 [0,4194304] 0 2024-03-12T16:10:58.557 INFO:tasks.workunit.client.1.smithi134.stdout:1/952: getdents d0/d16 0 2024-03-12T16:10:58.559 INFO:tasks.workunit.client.1.smithi134.stdout:1/953: symlink d0/d16/d9/d51/dfa/l139 0 2024-03-12T16:10:58.571 INFO:tasks.workunit.client.1.smithi134.stdout:1/954: write d0/d16/d39/f9b [4273681,74834] 0 2024-03-12T16:10:58.573 INFO:tasks.workunit.client.1.smithi134.stdout:1/955: mknod d0/d16/d9/d51/db7/dbb/df1/c13a 0 2024-03-12T16:10:58.576 INFO:tasks.workunit.client.1.smithi134.stdout:1/956: rename d0/d16/d9/d13/d21/l11b to d0/d16/d9/d51/de1/l13b 0 2024-03-12T16:10:58.578 INFO:tasks.workunit.client.1.smithi134.stdout:1/957: creat d0/d16/d9/d13/d21/d2f/d137/f13c x:0 0 0 2024-03-12T16:10:58.584 INFO:tasks.workunit.client.1.smithi134.stdout:1/958: dwrite d0/d16/f29 [4194304,4194304] 0 2024-03-12T16:10:58.586 INFO:tasks.workunit.client.0.smithi006.stdout:2/851: getdents d0/d13/d49/d60/d2b/d62/d66/d69 0 2024-03-12T16:10:58.587 INFO:tasks.workunit.client.1.smithi134.stdout:1/959: truncate d0/f6b 5077499 0 2024-03-12T16:10:58.589 INFO:tasks.workunit.client.0.smithi006.stdout:4/892: fdatasync d1/db/d39/d42/f51 0 2024-03-12T16:10:58.590 INFO:tasks.workunit.client.1.smithi134.stdout:1/960: creat d0/d16/d9/d13/d38/d103/f13d x:0 0 0 2024-03-12T16:10:58.591 INFO:tasks.workunit.client.1.smithi134.stdout:1/961: write d0/d42/fcb [1782889,58525] 0 2024-03-12T16:10:58.593 INFO:tasks.workunit.client.0.smithi006.stdout:0/914: dwrite d2/d88/d129/d97/fda [0,4194304] 0 2024-03-12T16:10:58.593 INFO:tasks.workunit.client.0.smithi006.stdout:4/893: chown d1/db/d39/dbf/dec/d5a/fd8 399429 1 2024-03-12T16:10:58.595 INFO:tasks.workunit.client.0.smithi006.stdout:2/852: mknod d0/d13/c101 0 2024-03-12T16:10:58.597 INFO:tasks.workunit.client.0.smithi006.stdout:3/706: sync 2024-03-12T16:10:58.598 INFO:tasks.workunit.client.0.smithi006.stdout:6/821: sync 2024-03-12T16:10:58.598 INFO:tasks.workunit.client.0.smithi006.stdout:1/821: sync 2024-03-12T16:10:58.599 INFO:tasks.workunit.client.0.smithi006.stdout:2/853: fsync d0/f12 0 2024-03-12T16:10:58.600 INFO:tasks.workunit.client.1.smithi134.stdout:1/962: dwrite d0/d16/d9/d51/de1/f101 [0,4194304] 0 2024-03-12T16:10:58.600 INFO:tasks.workunit.client.0.smithi006.stdout:9/861: dwrite d0/d8/d16/d7d/d20/d37/f9d [0,4194304] 0 2024-03-12T16:10:58.601 INFO:tasks.workunit.client.1.smithi134.stdout:1/963: chown d0/d16/d9/d13/d38/fb6 15710 1 2024-03-12T16:10:58.602 INFO:tasks.workunit.client.1.smithi134.stdout:1/964: chown d0/d16/d39/cae 4875128 1 2024-03-12T16:10:58.604 INFO:tasks.workunit.client.0.smithi006.stdout:6/822: read d3/d11/d10/da7/d8e/de1/d60/fb6 [432252,9491] 0 2024-03-12T16:10:58.604 INFO:tasks.workunit.client.0.smithi006.stdout:0/915: rename d2/d39/d42/cde to d2/d6/d10/d110/c132 0 2024-03-12T16:10:58.606 INFO:tasks.workunit.client.0.smithi006.stdout:1/822: mknod d0/d25/d2a/d43/d63/d102/c123 0 2024-03-12T16:10:58.609 INFO:tasks.workunit.client.1.smithi134.stdout:1/965: link d0/d30/d86/f27 d0/d30/d48/d11d/f13e 0 2024-03-12T16:10:58.612 INFO:tasks.workunit.client.0.smithi006.stdout:3/707: rename d8/d4c/f54 to d8/d52/d6c/fef 0 2024-03-12T16:10:58.614 INFO:tasks.workunit.client.0.smithi006.stdout:1/823: symlink d0/l124 0 2024-03-12T16:10:58.614 INFO:tasks.workunit.client.0.smithi006.stdout:0/916: creat d2/d6/d10/d11/d7e/dbe/f133 x:0 0 0 2024-03-12T16:10:58.615 INFO:tasks.workunit.client.0.smithi006.stdout:4/894: truncate d1/db/d39/dbf/dec/d43/db5/f72 612771 0 2024-03-12T16:10:58.616 INFO:tasks.workunit.client.0.smithi006.stdout:3/708: rmdir d8/d4c/dc8 39 2024-03-12T16:10:58.616 INFO:tasks.workunit.client.1.smithi134.stdout:1/966: dwrite d0/d16/d9/d13/d38/f82 [0,4194304] 0 2024-03-12T16:10:58.618 INFO:tasks.workunit.client.0.smithi006.stdout:0/917: readlink d2/d6/d10/d11/d1d/d2e/l113 0 2024-03-12T16:10:58.618 INFO:tasks.workunit.client.0.smithi006.stdout:1/824: truncate d0/d25/d2a/f54 4962541 0 2024-03-12T16:10:58.619 INFO:tasks.workunit.client.0.smithi006.stdout:9/862: getdents d0/d4/d3b 0 2024-03-12T16:10:58.619 INFO:tasks.workunit.client.1.smithi134.stdout:1/967: fsync d0/d42/f45 0 2024-03-12T16:10:58.622 INFO:tasks.workunit.client.1.smithi134.stdout:1/968: creat d0/d42/d47/f13f x:0 0 0 2024-03-12T16:10:58.624 INFO:tasks.workunit.client.0.smithi006.stdout:3/709: symlink d8/d4c/lf0 0 2024-03-12T16:10:58.624 INFO:tasks.workunit.client.0.smithi006.stdout:4/895: truncate d1/d38/db6/fe6 633242 0 2024-03-12T16:10:58.624 INFO:tasks.workunit.client.0.smithi006.stdout:1/825: creat d0/d25/d2a/d43/d63/db6/f125 x:0 0 0 2024-03-12T16:10:58.624 INFO:tasks.workunit.client.0.smithi006.stdout:6/823: link d3/d11/d10/da7/dd5/ddb/d112/l11a d3/d11/d10/da7/d9e/daa/l127 0 2024-03-12T16:10:58.625 INFO:tasks.workunit.client.0.smithi006.stdout:0/918: chown d2/d6/d10/d11/d32/da4/fc7 929 1 2024-03-12T16:10:58.627 INFO:tasks.workunit.client.0.smithi006.stdout:9/863: rename d0/d8/d16/d7d/d20/d37/f57 to d0/d8/d16/d2f/f122 0 2024-03-12T16:10:58.628 INFO:tasks.workunit.client.0.smithi006.stdout:3/710: truncate d8/d19/f9b 862248 0 2024-03-12T16:10:58.629 INFO:tasks.workunit.client.0.smithi006.stdout:1/826: mkdir d0/d25/d2a/df8/d126 0 2024-03-12T16:10:58.630 INFO:tasks.workunit.client.0.smithi006.stdout:4/896: creat d1/db/d39/dbf/dec/d43/dcc/d104/f128 x:0 0 0 2024-03-12T16:10:58.630 INFO:tasks.workunit.client.0.smithi006.stdout:1/827: dread - d0/d25/d2a/d43/f72 zero size 2024-03-12T16:10:58.632 INFO:tasks.workunit.client.0.smithi006.stdout:6/824: creat d3/d11/d10/d1b/d6e/db1/f128 x:0 0 0 2024-03-12T16:10:58.634 INFO:tasks.workunit.client.0.smithi006.stdout:4/897: chown d1/db/d39/dbf/dec/d43/dcc 344 1 2024-03-12T16:10:58.634 INFO:tasks.workunit.client.0.smithi006.stdout:6/825: write d3/f1c [1877495,43756] 0 2024-03-12T16:10:58.636 INFO:tasks.workunit.client.0.smithi006.stdout:3/711: creat d8/d4c/dc8/ff1 x:0 0 0 2024-03-12T16:10:58.638 INFO:tasks.workunit.client.0.smithi006.stdout:0/919: link d2/d6/d10/d11/d1d/d79/dd0/cee d2/d6/d10/ddb/c134 0 2024-03-12T16:10:58.639 INFO:tasks.workunit.client.0.smithi006.stdout:6/826: write d3/d11/d3b/fed [525426,75850] 0 2024-03-12T16:10:58.642 INFO:tasks.workunit.client.0.smithi006.stdout:2/854: dread d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f6d [4194304,4194304] 0 2024-03-12T16:10:58.644 INFO:tasks.workunit.client.1.smithi134.stdout:1/969: dread d0/d16/d9/d13/d21/d5f/f79 [0,4194304] 0 2024-03-12T16:10:58.645 INFO:tasks.workunit.client.0.smithi006.stdout:1/828: rename d0/fe to d0/d25/d2a/d43/d63/d102/f127 0 2024-03-12T16:10:58.645 INFO:tasks.workunit.client.0.smithi006.stdout:2/855: write d0/d13/d49/d60/d2b/d62/d66/da6/ff3 [1652583,52092] 0 2024-03-12T16:10:58.646 INFO:tasks.workunit.client.1.smithi134.stdout:1/970: rmdir d0/dde 39 2024-03-12T16:10:58.649 INFO:tasks.workunit.client.1.smithi134.stdout:1/971: truncate d0/d16/d9/d13/d21/d20/f7e 5343563 0 2024-03-12T16:10:58.650 INFO:tasks.workunit.client.1.smithi134.stdout:1/972: write d0/d16/d9/d13/d21/d2f/d137/f13c [173401,42811] 0 2024-03-12T16:10:58.654 INFO:tasks.workunit.client.0.smithi006.stdout:2/856: unlink d0/d13/d49/d60/f3b 0 2024-03-12T16:10:58.655 INFO:tasks.workunit.client.1.smithi134.stdout:1/973: getdents d0/d16/d9/d13/d21/d5f/d6f/dad 0 2024-03-12T16:10:58.655 INFO:tasks.workunit.client.1.smithi134.stdout:1/974: chown d0/d42 9 1 2024-03-12T16:10:58.655 INFO:tasks.workunit.client.0.smithi006.stdout:0/920: mknod d2/d39/d42/df4/c135 0 2024-03-12T16:10:58.656 INFO:tasks.workunit.client.1.smithi134.stdout:1/975: stat d0/d42/f92 0 2024-03-12T16:10:58.658 INFO:tasks.workunit.client.1.smithi134.stdout:1/976: creat d0/d16/d9/d13/d38/def/f140 x:0 0 0 2024-03-12T16:10:58.659 INFO:tasks.workunit.client.0.smithi006.stdout:6/827: dread d3/d11/d10/d1b/d20/f23 [0,4194304] 0 2024-03-12T16:10:58.659 INFO:tasks.workunit.client.0.smithi006.stdout:2/857: dread d0/d13/d49/d60/fad [0,4194304] 0 2024-03-12T16:10:58.659 INFO:tasks.workunit.client.0.smithi006.stdout:4/898: link d1/db/d39/dbf/dec/d43/db5/c11d d1/db/d39/dfc/c129 0 2024-03-12T16:10:58.660 INFO:tasks.workunit.client.1.smithi134.stdout:1/977: write d0/d16/d39/d12c/f10f [1680082,71344] 0 2024-03-12T16:10:58.661 INFO:tasks.workunit.client.1.smithi134.stdout:1/978: truncate d0/d16/d9/d51/feb 97149 0 2024-03-12T16:10:58.662 INFO:tasks.workunit.client.0.smithi006.stdout:6/828: write d3/d11/d10/da7/d8e/de1/f85 [98982,119529] 0 2024-03-12T16:10:58.664 INFO:tasks.workunit.client.0.smithi006.stdout:6/829: chown d3/d11/d10/d1b/c2b 1530 1 2024-03-12T16:10:58.665 INFO:tasks.workunit.client.1.smithi134.stdout:1/979: creat d0/d16/d9/d13/d21/d5f/d6f/d85/dee/f141 x:0 0 0 2024-03-12T16:10:58.666 INFO:tasks.workunit.client.0.smithi006.stdout:9/864: fsync d0/d8/d16/d2f/f122 0 2024-03-12T16:10:58.670 INFO:tasks.workunit.client.0.smithi006.stdout:2/858: mkdir d0/dc/de0/d102 0 2024-03-12T16:10:58.671 INFO:tasks.workunit.client.1.smithi134.stdout:1/980: dwrite d0/d16/d9/d13/d38/f115 [0,4194304] 0 2024-03-12T16:10:58.672 INFO:tasks.workunit.client.0.smithi006.stdout:4/899: dread - d1/db/d39/dbf/dec/d43/db5/fb7 zero size 2024-03-12T16:10:58.674 INFO:tasks.workunit.client.0.smithi006.stdout:0/921: dread d2/d6/f62 [0,4194304] 0 2024-03-12T16:10:58.676 INFO:tasks.workunit.client.0.smithi006.stdout:1/829: rename d0/d25/d2a/d43/de0/l11f to d0/d25/d2a/d43/l128 0 2024-03-12T16:10:58.677 INFO:tasks.workunit.client.1.smithi134.stdout:1/981: dwrite d0/d16/fc1 [0,4194304] 0 2024-03-12T16:10:58.680 INFO:tasks.workunit.client.0.smithi006.stdout:2/859: dwrite d0/d13/d49/d60/fa7 [0,4194304] 0 2024-03-12T16:10:58.682 INFO:tasks.workunit.client.1.smithi134.stdout:1/982: mkdir d0/d142 0 2024-03-12T16:10:58.682 INFO:tasks.workunit.client.0.smithi006.stdout:9/865: mkdir d0/d8/d16/d2f/d123 0 2024-03-12T16:10:58.683 INFO:tasks.workunit.client.0.smithi006.stdout:3/712: write d8/d19/f9b [1105520,125839] 0 2024-03-12T16:10:58.685 INFO:tasks.workunit.client.0.smithi006.stdout:9/866: fsync d0/d4/da7/fc2 0 2024-03-12T16:10:58.687 INFO:tasks.workunit.client.1.smithi134.stdout:1/983: dread d0/d16/d9/d13/d21/d5f/d6f/d85/dee/f104 [0,4194304] 0 2024-03-12T16:10:58.689 INFO:tasks.workunit.client.0.smithi006.stdout:1/830: creat d0/d25/d2a/d43/d63/d102/f129 x:0 0 0 2024-03-12T16:10:58.691 INFO:tasks.workunit.client.0.smithi006.stdout:0/922: symlink d2/d6/l136 0 2024-03-12T16:10:58.693 INFO:tasks.workunit.client.0.smithi006.stdout:0/923: read - d2/d88/d103/f123 zero size 2024-03-12T16:10:58.693 INFO:tasks.workunit.client.0.smithi006.stdout:1/831: stat d0/d25/d2a/d43/d56/c105 0 2024-03-12T16:10:58.694 INFO:tasks.workunit.client.1.smithi134.stdout:1/984: rename d0/d30/d48/d11d/f13e to d0/dde/f143 0 2024-03-12T16:10:58.694 INFO:tasks.workunit.client.0.smithi006.stdout:0/924: readlink d2/d6/d10/d11/d1d/l5a 0 2024-03-12T16:10:58.694 INFO:tasks.workunit.client.0.smithi006.stdout:1/832: fdatasync d0/d25/f59 0 2024-03-12T16:10:58.695 INFO:tasks.workunit.client.0.smithi006.stdout:2/860: rename d0/d13/d49/d60/d2b/d62/d66/da6/fa9 to d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/f103 0 2024-03-12T16:10:58.697 INFO:tasks.workunit.client.0.smithi006.stdout:9/867: mknod d0/d1f/c124 0 2024-03-12T16:10:58.698 INFO:tasks.workunit.client.1.smithi134.stdout:1/985: rename d0/d16/d9/c1b to d0/d16/d9/d51/db7/dbb/c144 0 2024-03-12T16:10:58.700 INFO:tasks.workunit.client.0.smithi006.stdout:1/833: symlink d0/d25/d2a/d43/l12a 0 2024-03-12T16:10:58.701 INFO:tasks.workunit.client.0.smithi006.stdout:9/868: dread - d0/d8/d16/d7d/d20/d37/dc5/dcf/f10b zero size 2024-03-12T16:10:58.704 INFO:tasks.workunit.client.1.smithi134.stdout:1/986: link d0/d30/l12d d0/d16/d9/d13/d38/def/l145 0 2024-03-12T16:10:58.704 INFO:tasks.workunit.client.0.smithi006.stdout:0/925: dwrite d2/d6/d10/d11/f84 [0,4194304] 0 2024-03-12T16:10:58.704 INFO:tasks.workunit.client.1.smithi134.stdout:1/987: chown d0/d30/d48/da1/f127 1636 1 2024-03-12T16:10:58.705 INFO:tasks.workunit.client.0.smithi006.stdout:1/834: creat d0/d25/d67/f12b x:0 0 0 2024-03-12T16:10:58.705 INFO:tasks.workunit.client.1.smithi134.stdout:1/988: chown d0/d16/d9/d13/d21/d5f/d6f/dad/f110 1777439821 1 2024-03-12T16:10:58.706 INFO:tasks.workunit.client.0.smithi006.stdout:1/835: stat d0/d25/d2a/d43/f112 0 2024-03-12T16:10:58.707 INFO:tasks.workunit.client.0.smithi006.stdout:9/869: creat d0/d4/da7/f125 x:0 0 0 2024-03-12T16:10:58.708 INFO:tasks.workunit.client.1.smithi134.stdout:1/989: creat d0/d16/d9/d13/d21/d2f/d8d/dfc/f146 x:0 0 0 2024-03-12T16:10:58.708 INFO:tasks.workunit.client.0.smithi006.stdout:9/870: fdatasync d0/d8/d16/f116 0 2024-03-12T16:10:58.710 INFO:tasks.workunit.client.0.smithi006.stdout:6/830: write d3/d11/d10/d9a/fe3 [72754,48518] 0 2024-03-12T16:10:58.712 INFO:tasks.workunit.client.1.smithi134.stdout:1/990: creat d0/d16/d9/d13/ddd/f147 x:0 0 0 2024-03-12T16:10:58.713 INFO:tasks.workunit.client.0.smithi006.stdout:5/789: sync 2024-03-12T16:10:58.713 INFO:tasks.workunit.client.0.smithi006.stdout:7/978: sync 2024-03-12T16:10:58.715 INFO:tasks.workunit.client.0.smithi006.stdout:9/871: fsync d0/d8/d16/d2f/fa5 0 2024-03-12T16:10:58.716 INFO:tasks.workunit.client.0.smithi006.stdout:3/713: write d8/d19/d26/d59/d2c/dc/d28/f2b [4894747,17637] 0 2024-03-12T16:10:58.720 INFO:tasks.workunit.client.0.smithi006.stdout:7/979: fsync de/d1c/d87/ddb/f36 0 2024-03-12T16:10:58.721 INFO:tasks.workunit.client.1.smithi134.stdout:1/991: dwrite d0/d16/d9/d13/d21/d20/f8e [4194304,4194304] 0 2024-03-12T16:10:58.723 INFO:tasks.workunit.client.0.smithi006.stdout:9/872: fdatasync d0/d8f/dc6/f119 0 2024-03-12T16:10:58.723 INFO:tasks.workunit.client.0.smithi006.stdout:6/831: symlink d3/d11/d10/d1b/d20/l129 0 2024-03-12T16:10:58.725 INFO:tasks.workunit.client.1.smithi134.stdout:1/992: rmdir d0/d30/d86 39 2024-03-12T16:10:58.728 INFO:tasks.workunit.client.0.smithi006.stdout:4/900: dwrite d1/db/d39/dbf/dec/da8/f11a [0,4194304] 0 2024-03-12T16:10:58.729 INFO:tasks.workunit.client.1.smithi134.stdout:1/993: rmdir d0/d16/d9/d13/d21/d5f/d6f 39 2024-03-12T16:10:58.729 INFO:tasks.workunit.client.1.smithi134.stdout:1/994: chown d0/d42/d47/cba 60 1 2024-03-12T16:10:58.733 INFO:tasks.workunit.client.1.smithi134.stdout:1/995: symlink d0/d16/d9/d13/d21/df0/l148 0 2024-03-12T16:10:58.733 INFO:tasks.workunit.client.0.smithi006.stdout:2/861: dread d0/d13/d49/d60/d2b/d62/f86 [0,4194304] 0 2024-03-12T16:10:58.734 INFO:tasks.workunit.client.1.smithi134.stdout:1/996: write d0/d30/d86/f10d [2917852,83230] 0 2024-03-12T16:10:58.735 INFO:tasks.workunit.client.0.smithi006.stdout:5/790: getdents d7/d9/d31/d3b/d4f/db5/def 0 2024-03-12T16:10:58.736 INFO:tasks.workunit.client.0.smithi006.stdout:0/926: truncate d2/d6/d10/f124 2530626 0 2024-03-12T16:10:58.736 INFO:tasks.workunit.client.0.smithi006.stdout:2/862: read d0/d13/d49/d60/d2b/d62/d66/fcd [4160262,29287] 0 2024-03-12T16:10:58.736 INFO:tasks.workunit.client.1.smithi134.stdout:1/997: chown d0/d16/d9/d13/d21/d20/fd8 23150 1 2024-03-12T16:10:58.738 INFO:tasks.workunit.client.0.smithi006.stdout:7/980: truncate de/d2c/d4f/dba/d40/f63 9005852 0 2024-03-12T16:10:58.740 INFO:tasks.workunit.client.0.smithi006.stdout:2/863: readlink d0/l23 0 2024-03-12T16:10:58.740 INFO:tasks.workunit.client.0.smithi006.stdout:6/832: link d3/d11/c3d d3/d11/d10/da7/dd5/ddb/de6/c12a 0 2024-03-12T16:10:58.742 INFO:tasks.workunit.client.1.smithi134.stdout:1/998: mkdir d0/d42/d47/d149 0 2024-03-12T16:10:58.742 INFO:tasks.workunit.client.1.smithi134.stdout:1/999: chown d0/d42/f98 37 1 2024-03-12T16:10:58.743 INFO:tasks.workunit.client.0.smithi006.stdout:5/791: truncate d7/d9/d10/d35/fb0 297471 0 2024-03-12T16:10:58.750 INFO:tasks.workunit.client.0.smithi006.stdout:0/927: truncate d2/d6/f3d 8953092 0 2024-03-12T16:10:58.751 INFO:tasks.workunit.client.0.smithi006.stdout:1/836: dread d0/d25/d67/dc1/fcf [0,4194304] 0 2024-03-12T16:10:58.751 INFO:tasks.workunit.client.0.smithi006.stdout:9/873: dwrite d0/d8/d16/d7d/d20/d37/dc5/fec [0,4194304] 0 2024-03-12T16:10:58.751 INFO:tasks.workunit.client.0.smithi006.stdout:7/981: mknod de/dc2/d123/c145 0 2024-03-12T16:10:58.752 INFO:tasks.workunit.client.1.smithi134.stderr:+ rm -rf -- ./tmp.goKFlkvstn 2024-03-12T16:10:58.759 INFO:tasks.workunit.client.0.smithi006.stdout:0/928: read d2/d6/d10/ff6 [222807,30325] 0 2024-03-12T16:10:58.764 INFO:tasks.workunit.client.0.smithi006.stdout:8/744: sync 2024-03-12T16:10:58.764 INFO:tasks.workunit.client.0.smithi006.stdout:9/874: symlink d0/d4/d70/da6/l126 0 2024-03-12T16:10:58.764 INFO:tasks.workunit.client.0.smithi006.stdout:1/837: mknod d0/d25/d2a/d43/d68/c12c 0 2024-03-12T16:10:58.769 INFO:tasks.workunit.client.0.smithi006.stdout:5/792: dwrite d7/d9/d47/faa [0,4194304] 0 2024-03-12T16:10:58.776 INFO:tasks.workunit.client.0.smithi006.stdout:6/833: dwrite d3/d11/d10/d1b/d20/d7c/ff1 [0,4194304] 0 2024-03-12T16:10:58.776 INFO:tasks.workunit.client.0.smithi006.stdout:5/793: write d7/d41/f5a [1311230,108312] 0 2024-03-12T16:10:58.776 INFO:tasks.workunit.client.0.smithi006.stdout:3/714: dread d8/d19/dbc/f80 [0,4194304] 0 2024-03-12T16:10:58.778 INFO:tasks.workunit.client.0.smithi006.stdout:8/745: unlink d2/d32/f86 0 2024-03-12T16:10:58.779 INFO:tasks.workunit.client.0.smithi006.stdout:6/834: write d3/d47/db0/dc1/fc9 [3612531,95190] 0 2024-03-12T16:10:58.780 INFO:tasks.workunit.client.0.smithi006.stdout:2/864: dwrite d0/d13/d49/d60/ff4 [0,4194304] 0 2024-03-12T16:10:58.780 INFO:tasks.workunit.client.0.smithi006.stdout:9/875: dread - d0/f87 zero size 2024-03-12T16:10:58.782 INFO:tasks.workunit.client.0.smithi006.stdout:4/901: dread d1/db/d39/dbf/dec/d5a/f8c [0,4194304] 0 2024-03-12T16:10:58.783 INFO:tasks.workunit.client.0.smithi006.stdout:3/715: mkdir d8/df2 0 2024-03-12T16:10:58.787 INFO:tasks.workunit.client.0.smithi006.stdout:1/838: mkdir d0/d25/d2a/d35/d11c/d12d 0 2024-03-12T16:10:58.788 INFO:tasks.workunit.client.0.smithi006.stdout:5/794: creat d7/d9/d47/d56/d79/dee/f10a x:0 0 0 2024-03-12T16:10:58.793 INFO:tasks.workunit.client.0.smithi006.stdout:8/746: creat d2/db/d1a/d7a/ff0 x:0 0 0 2024-03-12T16:10:58.794 INFO:tasks.workunit.client.0.smithi006.stdout:4/902: unlink d1/db/d1d/d2f/ff6 0 2024-03-12T16:10:58.795 INFO:tasks.workunit.client.0.smithi006.stdout:1/839: symlink d0/d25/d2a/d35/l12e 0 2024-03-12T16:10:58.796 INFO:tasks.workunit.client.0.smithi006.stdout:7/982: dwrite de/d1c/d87/ddb/d7c/fa3 [0,4194304] 0 2024-03-12T16:10:58.801 INFO:tasks.workunit.client.0.smithi006.stdout:7/983: write de/d18/fdc [102324,22697] 0 2024-03-12T16:10:58.802 INFO:tasks.workunit.client.0.smithi006.stdout:4/903: unlink d1/db/f22 0 2024-03-12T16:10:58.802 INFO:tasks.workunit.client.0.smithi006.stdout:0/929: dwrite d2/f71 [0,4194304] 0 2024-03-12T16:10:58.803 INFO:tasks.workunit.client.0.smithi006.stdout:5/795: dread d7/d9/d47/faa [0,4194304] 0 2024-03-12T16:10:58.804 INFO:tasks.workunit.client.0.smithi006.stdout:1/840: creat d0/d25/d2a/d64/f12f x:0 0 0 2024-03-12T16:10:58.806 INFO:tasks.workunit.client.0.smithi006.stdout:1/841: readlink d0/d25/l4f 0 2024-03-12T16:10:58.808 INFO:tasks.workunit.client.0.smithi006.stdout:7/984: truncate de/d7b/dc6/d11c/f12f 272755 0 2024-03-12T16:10:58.808 INFO:tasks.workunit.client.0.smithi006.stdout:4/904: mknod d1/db/de7/c12a 0 2024-03-12T16:10:58.808 INFO:tasks.workunit.client.0.smithi006.stdout:0/930: write d2/d6/fb6 [4825422,16435] 0 2024-03-12T16:10:58.810 INFO:tasks.workunit.client.0.smithi006.stdout:5/796: dread - d7/d9/d31/d3b/d6b/db9/ff2 zero size 2024-03-12T16:10:58.811 INFO:tasks.workunit.client.0.smithi006.stdout:1/842: chown d0/d25/d2a/d43/d63/db6/l103 225685 1 2024-03-12T16:10:58.815 INFO:tasks.workunit.client.0.smithi006.stdout:5/797: chown d7/d9/d31/l43 159 1 2024-03-12T16:10:58.816 INFO:tasks.workunit.client.0.smithi006.stdout:1/843: mknod d0/d25/d2a/d43/d68/d111/d119/c130 0 2024-03-12T16:10:58.819 INFO:tasks.workunit.client.0.smithi006.stdout:0/931: rename d2/d39/lc1 to d2/d6/d10/ddd/l137 0 2024-03-12T16:10:58.819 INFO:tasks.workunit.client.0.smithi006.stdout:7/985: dwrite de/d2c/d4f/dba/d39/f124 [0,4194304] 0 2024-03-12T16:10:58.826 INFO:tasks.workunit.client.0.smithi006.stdout:0/932: write d2/d6/d10/d11/d7e/da6/de4/f8b [5005105,40600] 0 2024-03-12T16:10:58.826 INFO:tasks.workunit.client.0.smithi006.stdout:1/844: symlink d0/d25/db1/dd0/l131 0 2024-03-12T16:10:58.826 INFO:tasks.workunit.client.0.smithi006.stdout:6/835: dread d3/d11/d10/f49 [0,4194304] 0 2024-03-12T16:10:58.831 INFO:tasks.workunit.client.0.smithi006.stdout:7/986: mknod de/d1c/d87/ddb/d7c/d113/c146 0 2024-03-12T16:10:58.834 INFO:tasks.workunit.client.0.smithi006.stdout:2/865: dwrite d0/f1f [4194304,4194304] 0 2024-03-12T16:10:58.834 INFO:tasks.workunit.client.0.smithi006.stdout:4/905: rename d1/d38/c3e to d1/db/d39/d42/d61/c12b 0 2024-03-12T16:10:58.834 INFO:tasks.workunit.client.0.smithi006.stdout:3/716: truncate d8/d19/d26/d59/d2c/dc/d28/fe4 645844 0 2024-03-12T16:10:58.838 INFO:tasks.workunit.client.0.smithi006.stdout:9/876: truncate d0/d4/d70/fa9 376210 0 2024-03-12T16:10:58.841 INFO:tasks.workunit.client.0.smithi006.stdout:7/987: rmdir de 39 2024-03-12T16:10:58.841 INFO:tasks.workunit.client.0.smithi006.stdout:9/877: read - d0/d8f/dc6/fe7 zero size 2024-03-12T16:10:58.844 INFO:tasks.workunit.client.0.smithi006.stdout:8/747: write d2/d11/d5a/fac [4001477,110408] 0 2024-03-12T16:10:58.846 INFO:tasks.workunit.client.0.smithi006.stdout:3/717: dread d8/d19/d26/d59/d2c/dc/d28/d2f/fb6 [0,4194304] 0 2024-03-12T16:10:58.851 INFO:tasks.workunit.client.0.smithi006.stdout:7/988: stat de/d1c/d87/ddb/d7c/fd4 0 2024-03-12T16:10:58.852 INFO:tasks.workunit.client.0.smithi006.stdout:2/866: mknod d0/d13/d49/d60/d2b/dcc/c104 0 2024-03-12T16:10:58.854 INFO:tasks.workunit.client.0.smithi006.stdout:4/906: dwrite d1/db/d39/dbf/dec/da8/f11a [0,4194304] 0 2024-03-12T16:10:58.858 INFO:tasks.workunit.client.0.smithi006.stdout:0/933: rename d2/d39/fdc to d2/f138 0 2024-03-12T16:10:58.859 INFO:tasks.workunit.client.0.smithi006.stdout:1/845: getdents d0/d25/d2a/d43/d68/d111 0 2024-03-12T16:10:58.865 INFO:tasks.workunit.client.0.smithi006.stdout:3/718: dread d8/d19/d26/d59/d2c/dc/f38 [0,4194304] 0 2024-03-12T16:10:58.868 INFO:tasks.workunit.client.0.smithi006.stdout:9/878: dwrite d0/d4/d70/da6/f105 [0,4194304] 0 2024-03-12T16:10:58.871 INFO:tasks.workunit.client.0.smithi006.stdout:8/748: creat d2/db/d1a/d21/ff1 x:0 0 0 2024-03-12T16:10:58.871 INFO:tasks.workunit.client.0.smithi006.stdout:1/846: write d0/d25/d2a/d43/d68/d111/d119/f122 [689015,115079] 0 2024-03-12T16:10:58.874 INFO:tasks.workunit.client.0.smithi006.stdout:6/836: dwrite d3/d11/d10/d28/f5f [0,4194304] 0 2024-03-12T16:10:58.876 INFO:tasks.workunit.client.0.smithi006.stdout:9/879: read - d0/d4/d70/da6/ff1 zero size 2024-03-12T16:10:58.880 INFO:tasks.workunit.client.0.smithi006.stdout:7/989: dread de/d2c/d4f/dba/d39/f124 [0,4194304] 0 2024-03-12T16:10:58.883 INFO:tasks.workunit.client.0.smithi006.stdout:6/837: write d3/d11/d10/d19/f67 [1067144,10199] 0 2024-03-12T16:10:58.885 INFO:tasks.workunit.client.0.smithi006.stdout:3/719: mknod d8/d52/dcf/cf3 0 2024-03-12T16:10:58.889 INFO:tasks.workunit.client.0.smithi006.stdout:9/880: unlink d0/d8/c10e 0 2024-03-12T16:10:58.889 INFO:tasks.workunit.client.0.smithi006.stdout:2/867: dwrite d0/d13/d49/d60/d2b/f6b [0,4194304] 0 2024-03-12T16:10:58.891 INFO:tasks.workunit.client.0.smithi006.stdout:6/838: chown d3/d11/d10/d1b/fdc 1489295 1 2024-03-12T16:10:58.892 INFO:tasks.workunit.client.0.smithi006.stdout:7/990: rename de/d7b/dc6/l12a to de/d1c/d87/ddb/d7c/d113/l147 0 2024-03-12T16:10:58.896 INFO:tasks.workunit.client.0.smithi006.stdout:8/749: dwrite d2/d11/f82 [0,4194304] 0 2024-03-12T16:10:58.902 INFO:tasks.workunit.client.0.smithi006.stdout:9/881: creat d0/d83/d90/dc0/de2/f127 x:0 0 0 2024-03-12T16:10:58.902 INFO:tasks.workunit.client.0.smithi006.stdout:6/839: creat d3/d11/d10/d1b/d6e/db1/f12b x:0 0 0 2024-03-12T16:10:58.903 INFO:tasks.workunit.client.0.smithi006.stdout:7/991: symlink de/d1c/d87/ddb/l148 0 2024-03-12T16:10:58.904 INFO:tasks.workunit.client.0.smithi006.stdout:9/882: creat d0/d8/d80/dfd/f128 x:0 0 0 2024-03-12T16:10:58.904 INFO:tasks.workunit.client.0.smithi006.stdout:2/868: dread - d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f85 zero size 2024-03-12T16:10:58.910 INFO:tasks.workunit.client.0.smithi006.stdout:3/720: dwrite d8/d19/d26/d59/d2c/dc/d28/d2f/f60 [0,4194304] 0 2024-03-12T16:10:58.910 INFO:tasks.workunit.client.0.smithi006.stdout:4/907: dread d1/db/d39/dbf/dec/fb3 [0,4194304] 0 2024-03-12T16:10:58.910 INFO:tasks.workunit.client.0.smithi006.stdout:8/750: rename d2/db/d1a/d23/l58 to d2/db/d1a/d1f/lf2 0 2024-03-12T16:10:58.915 INFO:tasks.workunit.client.0.smithi006.stdout:9/883: chown d0/d8/d16/d7d/d20/d37 605 1 2024-03-12T16:10:58.916 INFO:tasks.workunit.client.0.smithi006.stdout:6/840: read d3/d47/f7f [2058736,33628] 0 2024-03-12T16:10:58.918 INFO:tasks.workunit.client.0.smithi006.stdout:4/908: mknod d1/db/d39/d42/c12c 0 2024-03-12T16:10:58.919 INFO:tasks.workunit.client.0.smithi006.stdout:7/992: symlink de/d1c/d35/d110/l149 0 2024-03-12T16:10:58.920 INFO:tasks.workunit.client.0.smithi006.stdout:2/869: mkdir d0/d13/d49/d60/d105 0 2024-03-12T16:10:58.926 INFO:tasks.workunit.client.0.smithi006.stdout:6/841: mkdir d3/d11/d10/da7/d12c 0 2024-03-12T16:10:58.928 INFO:tasks.workunit.client.0.smithi006.stdout:1/847: dread d0/d25/d2a/f2c [0,4194304] 0 2024-03-12T16:10:58.930 INFO:tasks.workunit.client.0.smithi006.stdout:3/721: creat d8/ff4 x:0 0 0 2024-03-12T16:10:58.934 INFO:tasks.workunit.client.0.smithi006.stdout:2/870: fdatasync d0/d13/d49/d60/d2b/d62/d66/d67/fc9 0 2024-03-12T16:10:58.938 INFO:tasks.workunit.client.0.smithi006.stdout:9/884: dwrite d0/d8f/dc6/fe7 [0,4194304] 0 2024-03-12T16:10:58.940 INFO:tasks.workunit.client.0.smithi006.stdout:4/909: write d1/db/f29 [2093148,22930] 0 2024-03-12T16:10:58.944 INFO:tasks.workunit.client.0.smithi006.stdout:6/842: truncate d3/d11/d10/d28/dd6/ffc 1624645 0 2024-03-12T16:10:58.945 INFO:tasks.workunit.client.0.smithi006.stdout:9/885: unlink d0/d1f/f106 0 2024-03-12T16:10:58.946 INFO:tasks.workunit.client.0.smithi006.stdout:7/993: dread de/d18/fa0 [0,4194304] 0 2024-03-12T16:10:58.947 INFO:tasks.workunit.client.0.smithi006.stdout:6/843: readlink d3/d11/d10/lef 0 2024-03-12T16:10:58.949 INFO:tasks.workunit.client.0.smithi006.stdout:4/910: truncate d1/db/f3c 3949491 0 2024-03-12T16:10:58.952 INFO:tasks.workunit.client.0.smithi006.stdout:7/994: chown de/d1c/d87/lb1 15 1 2024-03-12T16:10:58.954 INFO:tasks.workunit.client.0.smithi006.stdout:1/848: dwrite d0/f23 [0,4194304] 0 2024-03-12T16:10:58.954 INFO:tasks.workunit.client.0.smithi006.stdout:4/911: chown d1/d38/d79/cfd 10661833 1 2024-03-12T16:10:58.954 INFO:tasks.workunit.client.0.smithi006.stdout:6/844: read - d3/d11/d10/d19/fa4 zero size 2024-03-12T16:10:58.955 INFO:tasks.workunit.client.0.smithi006.stdout:8/751: dwrite d2/db/d1a/d1f/f31 [4194304,4194304] 0 2024-03-12T16:10:58.956 INFO:tasks.workunit.client.0.smithi006.stdout:9/886: rename d0/d4/d9b/fdf to d0/d4/d70/da6/f129 0 2024-03-12T16:10:58.963 INFO:tasks.workunit.client.0.smithi006.stdout:7/995: mkdir de/d2c/d4f/d8a/d14a 0 2024-03-12T16:10:58.965 INFO:tasks.workunit.client.0.smithi006.stdout:8/752: stat d2/db/d1a/d7a/dcc/ccd 0 2024-03-12T16:10:58.970 INFO:tasks.workunit.client.0.smithi006.stdout:7/996: mknod de/d1c/d87/ddb/d7c/c14b 0 2024-03-12T16:10:58.971 INFO:tasks.workunit.client.0.smithi006.stdout:1/849: truncate d0/d25/d2a/d43/d63/db6/f109 607581 0 2024-03-12T16:10:58.975 INFO:tasks.workunit.client.0.smithi006.stdout:8/753: truncate d2/d11/fdf 129239 0 2024-03-12T16:10:58.976 INFO:tasks.workunit.client.0.smithi006.stdout:2/871: dread d0/f3f [0,4194304] 0 2024-03-12T16:10:58.976 INFO:tasks.workunit.client.0.smithi006.stdout:6/845: dwrite d3/d11/d10/d28/f11f [0,4194304] 0 2024-03-12T16:10:58.979 INFO:tasks.workunit.client.0.smithi006.stdout:9/887: dwrite d0/d8/d16/f116 [0,4194304] 0 2024-03-12T16:10:58.980 INFO:tasks.workunit.client.0.smithi006.stdout:1/850: mkdir d0/d25/d2a/d43/d63/db6/d132 0 2024-03-12T16:10:58.983 INFO:tasks.workunit.client.0.smithi006.stdout:7/997: mknod de/d2c/d93/dbe/d4a/dbf/d13d/c14c 0 2024-03-12T16:10:59.000 INFO:tasks.workunit.client.0.smithi006.stdout:2/872: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/f8a [4194304,4194304] 0 2024-03-12T16:10:59.002 INFO:tasks.workunit.client.0.smithi006.stdout:1/851: dwrite d0/d25/d2a/f54 [4194304,4194304] 0 2024-03-12T16:10:59.014 INFO:tasks.workunit.client.0.smithi006.stdout:4/912: dread d1/db/d1d/d2f/f36 [0,4194304] 0 2024-03-12T16:10:59.014 INFO:tasks.workunit.client.0.smithi006.stdout:9/888: dwrite d0/d8/d16/f54 [0,4194304] 0 2024-03-12T16:10:59.014 INFO:tasks.workunit.client.0.smithi006.stdout:2/873: rename d0/dc/d64/la3 to d0/dc/de0/d102/l106 0 2024-03-12T16:10:59.017 INFO:tasks.workunit.client.0.smithi006.stdout:1/852: mkdir d0/d25/d2a/d43/d63/db6/d133 0 2024-03-12T16:10:59.019 INFO:tasks.workunit.client.0.smithi006.stdout:9/889: dread - d0/d4/d3b/dca/f10f zero size 2024-03-12T16:10:59.019 INFO:tasks.workunit.client.0.smithi006.stdout:2/874: stat d0/d13/l59 0 2024-03-12T16:10:59.019 INFO:tasks.workunit.client.0.smithi006.stdout:8/754: dwrite d2/db/fe2 [0,4194304] 0 2024-03-12T16:10:59.023 INFO:tasks.workunit.client.0.smithi006.stdout:4/913: creat d1/db/d39/d42/df2/df7/f12d x:0 0 0 2024-03-12T16:10:59.025 INFO:tasks.workunit.client.0.smithi006.stdout:2/875: symlink d0/d13/d49/d60/d2b/d62/d66/l107 0 2024-03-12T16:10:59.027 INFO:tasks.workunit.client.0.smithi006.stdout:7/998: dread de/f9f [0,4194304] 0 2024-03-12T16:10:59.027 INFO:tasks.workunit.client.0.smithi006.stdout:4/914: unlink d1/db/d1d/l120 0 2024-03-12T16:10:59.035 INFO:tasks.workunit.client.0.smithi006.stdout:8/755: dwrite d2/db/d1a/d21/d4f/f56 [0,4194304] 0 2024-03-12T16:10:59.035 INFO:tasks.workunit.client.0.smithi006.stdout:9/890: dread d0/d8/d16/f54 [0,4194304] 0 2024-03-12T16:10:59.038 INFO:tasks.workunit.client.0.smithi006.stdout:1/853: getdents d0/d25/d2a/d43/d63/df1 0 2024-03-12T16:10:59.044 INFO:tasks.workunit.client.0.smithi006.stdout:4/915: write d1/db/d1d/d2f/f97 [1149602,58090] 0 2024-03-12T16:10:59.049 INFO:tasks.workunit.client.0.smithi006.stdout:7/999: creat de/d2c/d93/dbe/d4a/d6a/dc7/f14d x:0 0 0 2024-03-12T16:10:59.050 INFO:tasks.workunit.client.0.smithi006.stdout:9/891: read d0/d8/d16/d7d/f88 [34086,109906] 0 2024-03-12T16:10:59.052 INFO:tasks.workunit.client.0.smithi006.stdout:2/876: dwrite d0/dc/f1a [0,4194304] 0 2024-03-12T16:10:59.054 INFO:tasks.workunit.client.0.smithi006.stdout:4/916: mkdir d1/d12e 0 2024-03-12T16:10:59.056 INFO:tasks.workunit.client.0.smithi006.stdout:2/877: chown d0/dc/l71 1704429812 1 2024-03-12T16:10:59.056 INFO:tasks.workunit.client.0.smithi006.stdout:8/756: dwrite d2/db/d1a/d7a/fde [0,4194304] 0 2024-03-12T16:10:59.058 INFO:tasks.workunit.client.0.smithi006.stdout:4/917: read d1/db/d39/d42/fbc [2808649,98620] 0 2024-03-12T16:10:59.059 INFO:tasks.workunit.client.0.smithi006.stdout:9/892: rmdir d0/d83/d90/dc0 39 2024-03-12T16:10:59.068 INFO:tasks.workunit.client.0.smithi006.stdout:1/854: dwrite d0/d25/d2a/d43/faa [0,4194304] 0 2024-03-12T16:10:59.070 INFO:tasks.workunit.client.0.smithi006.stdout:2/878: rmdir d0/d13/d49/d60/d2b/d62/d66/d67 39 2024-03-12T16:10:59.070 INFO:tasks.workunit.client.0.smithi006.stdout:8/757: creat d2/d11/d5a/dd4/ff3 x:0 0 0 2024-03-12T16:10:59.079 INFO:tasks.workunit.client.0.smithi006.stdout:9/893: mknod d0/d8/d16/d7d/d20/c12a 0 2024-03-12T16:10:59.083 INFO:tasks.workunit.client.0.smithi006.stdout:4/918: dwrite d1/db/d39/dbf/dec/d43/f11e [0,4194304] 0 2024-03-12T16:10:59.084 INFO:tasks.workunit.client.0.smithi006.stdout:2/879: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/l108 0 2024-03-12T16:10:59.086 INFO:tasks.workunit.client.0.smithi006.stdout:1/855: link d0/d25/d2a/d43/d68/c12c d0/d25/d2a/d43/d63/df1/c134 0 2024-03-12T16:10:59.089 INFO:tasks.workunit.client.0.smithi006.stdout:9/894: link d0/d83/d90/lf6 d0/d4/d70/d71/dde/l12b 0 2024-03-12T16:10:59.094 INFO:tasks.workunit.client.0.smithi006.stdout:2/880: link d0/d13/c4c d0/d13/d49/c109 0 2024-03-12T16:10:59.097 INFO:tasks.workunit.client.0.smithi006.stdout:1/856: mknod d0/d25/d2a/d43/d63/db6/dcb/c135 0 2024-03-12T16:10:59.098 INFO:tasks.workunit.client.0.smithi006.stdout:2/881: fdatasync d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f9e 0 2024-03-12T16:10:59.099 INFO:tasks.workunit.client.0.smithi006.stdout:9/895: creat d0/d8/f12c x:0 0 0 2024-03-12T16:10:59.100 INFO:tasks.workunit.client.0.smithi006.stdout:2/882: read d0/f45 [961004,38022] 0 2024-03-12T16:10:59.101 INFO:tasks.workunit.client.0.smithi006.stdout:9/896: stat d0/d4/d70/lbd 0 2024-03-12T16:10:59.102 INFO:tasks.workunit.client.0.smithi006.stdout:8/758: dread d2/db/d1a/d23/f60 [0,4194304] 0 2024-03-12T16:10:59.106 INFO:tasks.workunit.client.0.smithi006.stdout:4/919: write d1/db/d39/d42/f81 [97500,105822] 0 2024-03-12T16:10:59.114 INFO:tasks.workunit.client.0.smithi006.stdout:4/920: mknod d1/db/d39/dbf/dec/da8/c12f 0 2024-03-12T16:10:59.114 INFO:tasks.workunit.client.0.smithi006.stdout:5/798: sync 2024-03-12T16:10:59.115 INFO:tasks.workunit.client.0.smithi006.stdout:1/857: write d0/d25/f32 [1059214,62224] 0 2024-03-12T16:10:59.117 INFO:tasks.workunit.client.0.smithi006.stdout:4/921: stat d1/db/d39/dbf/lfb 0 2024-03-12T16:10:59.117 INFO:tasks.workunit.client.0.smithi006.stdout:8/759: truncate d2/d11/d5a/f5f 2601556 0 2024-03-12T16:10:59.126 INFO:tasks.workunit.client.0.smithi006.stdout:5/799: truncate d7/d9/d10/f39 2801971 0 2024-03-12T16:10:59.128 INFO:tasks.workunit.client.0.smithi006.stdout:4/922: write d1/feb [3031000,46193] 0 2024-03-12T16:10:59.129 INFO:tasks.workunit.client.0.smithi006.stdout:2/883: dwrite d0/dc/f5b [0,4194304] 0 2024-03-12T16:10:59.132 INFO:tasks.workunit.client.0.smithi006.stdout:1/858: dwrite d0/f16 [4194304,4194304] 0 2024-03-12T16:10:59.132 INFO:tasks.workunit.client.0.smithi006.stdout:4/923: fdatasync d1/db/d39/dbf/dec/f59 0 2024-03-12T16:10:59.133 INFO:tasks.workunit.client.0.smithi006.stdout:4/924: stat d1/db/d39/d42/d61/fc7 0 2024-03-12T16:10:59.140 INFO:tasks.workunit.client.0.smithi006.stdout:4/925: read d1/db/d39/f3b [614542,61977] 0 2024-03-12T16:10:59.142 INFO:tasks.workunit.client.0.smithi006.stdout:5/800: mknod d7/d9/d31/d3b/d4f/d65/de1/c10b 0 2024-03-12T16:10:59.143 INFO:tasks.workunit.client.0.smithi006.stdout:1/859: rename d0/d25/f59 to d0/d25/d2a/d35/d11c/f136 0 2024-03-12T16:10:59.143 INFO:tasks.workunit.client.0.smithi006.stdout:2/884: dread - d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fb8 zero size 2024-03-12T16:10:59.146 INFO:tasks.workunit.client.0.smithi006.stdout:5/801: truncate d7/d8/d8a/d92/fdf 4462789 0 2024-03-12T16:10:59.146 INFO:tasks.workunit.client.0.smithi006.stdout:4/926: symlink d1/db/d1d/d2f/d6b/l130 0 2024-03-12T16:10:59.149 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:57.501689+0000 mgr.smithi134.gcntfu (mgr.24383) 66 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 84 MiB/s rd, 192 MiB/s wr, 420 op/s 2024-03-12T16:10:59.149 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:10:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:10:58.723581+0000 mon.smithi006 (mon.0) 713 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:10:59.154 INFO:tasks.workunit.client.0.smithi006.stdout:4/927: symlink d1/db/d39/dbf/dec/d5a/l131 0 2024-03-12T16:10:59.156 INFO:tasks.workunit.client.0.smithi006.stdout:1/860: dwrite d0/d25/d2a/d43/d68/f10e [0,4194304] 0 2024-03-12T16:10:59.157 INFO:tasks.workunit.client.0.smithi006.stdout:5/802: dread d7/d9/d47/fc1 [0,4194304] 0 2024-03-12T16:10:59.164 INFO:tasks.workunit.client.0.smithi006.stdout:8/760: dread d2/db/d1a/d21/d4f/fca [0,4194304] 0 2024-03-12T16:10:59.169 INFO:tasks.workunit.client.0.smithi006.stdout:2/885: dwrite d0/d13/d49/d60/d2b/d62/d66/fcd [0,4194304] 0 2024-03-12T16:10:59.169 INFO:tasks.workunit.client.0.smithi006.stdout:1/861: truncate d0/d25/d2a/d43/d56/fef 679071 0 2024-03-12T16:10:59.172 INFO:tasks.workunit.client.0.smithi006.stdout:2/886: dread - d0/dc/d64/f9c zero size 2024-03-12T16:10:59.172 INFO:tasks.workunit.client.0.smithi006.stdout:5/803: readlink d7/d9/d31/d3b/d6b/la6 0 2024-03-12T16:10:59.174 INFO:tasks.workunit.client.0.smithi006.stdout:1/862: write d0/d25/d2a/d35/ffd [958213,15570] 0 2024-03-12T16:10:59.178 INFO:tasks.workunit.client.0.smithi006.stdout:5/804: getdents d7/d9/d31/d3b/d4f/d80/d88 0 2024-03-12T16:10:59.182 INFO:tasks.workunit.client.0.smithi006.stdout:8/761: dwrite d2/db/f39 [0,4194304] 0 2024-03-12T16:10:59.182 INFO:tasks.workunit.client.0.smithi006.stdout:1/863: readlink d0/d25/d2a/l97 0 2024-03-12T16:10:59.183 INFO:tasks.workunit.client.0.smithi006.stdout:4/928: write d1/db/d1d/d2f/f4c [1290915,56727] 0 2024-03-12T16:10:59.190 INFO:tasks.workunit.client.0.smithi006.stdout:2/887: dwrite d0/d13/f2e [4194304,4194304] 0 2024-03-12T16:10:59.190 INFO:tasks.workunit.client.0.smithi006.stdout:1/864: getdents d0/d25/d2a/d43/dd1/df2 0 2024-03-12T16:10:59.190 INFO:tasks.workunit.client.0.smithi006.stdout:5/805: write d7/d9/d10/d35/fb0 [151925,114990] 0 2024-03-12T16:10:59.193 INFO:tasks.workunit.client.0.smithi006.stdout:2/888: dread - d0/d13/d49/d60/fd0 zero size 2024-03-12T16:10:59.193 INFO:tasks.workunit.client.0.smithi006.stdout:5/806: chown d7/d9/d47/f67 8108 1 2024-03-12T16:10:59.194 INFO:tasks.workunit.client.0.smithi006.stdout:1/865: dread - d0/d25/d2a/fc3 zero size 2024-03-12T16:10:59.196 INFO:tasks.workunit.client.0.smithi006.stdout:2/889: readlink d0/dc/l47 0 2024-03-12T16:10:59.202 INFO:tasks.workunit.client.0.smithi006.stdout:4/929: rename d1/db/d39/dfc to d1/db/d39/dbf/dec/d43/d132 0 2024-03-12T16:10:59.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:57.501689+0000 mgr.smithi134.gcntfu (mgr.24383) 66 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 84 MiB/s rd, 192 MiB/s wr, 420 op/s 2024-03-12T16:10:59.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:10:58 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:10:58.723581+0000 mon.smithi006 (mon.0) 713 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:10:59.204 INFO:tasks.workunit.client.0.smithi006.stdout:1/866: mknod d0/d25/d2a/df8/d126/c137 0 2024-03-12T16:10:59.206 INFO:tasks.workunit.client.0.smithi006.stdout:4/930: fsync d1/db/d39/d42/d61/fb4 0 2024-03-12T16:10:59.206 INFO:tasks.workunit.client.0.smithi006.stdout:8/762: write d2/db/d1a/d1f/f54 [3127698,106721] 0 2024-03-12T16:10:59.208 INFO:tasks.workunit.client.0.smithi006.stdout:2/890: link d0/d13/d49/d60/fad d0/d13/d49/d60/d2b/d62/d66/d69/d81/d95/f10a 0 2024-03-12T16:10:59.209 INFO:tasks.workunit.client.0.smithi006.stdout:8/763: dread d2/d55/d7b/fc0 [0,4194304] 0 2024-03-12T16:10:59.210 INFO:tasks.workunit.client.0.smithi006.stdout:8/764: dread - d2/d11/d5a/fe7 zero size 2024-03-12T16:10:59.212 INFO:tasks.workunit.client.0.smithi006.stdout:1/867: mkdir d0/d25/db1/dd0/d10b/d138 0 2024-03-12T16:10:59.213 INFO:tasks.workunit.client.0.smithi006.stdout:4/931: creat d1/db/d39/dbf/dec/d43/d132/f133 x:0 0 0 2024-03-12T16:10:59.214 INFO:tasks.workunit.client.0.smithi006.stdout:5/807: getdents d7/d9/d31/d3b/d4f/d80 0 2024-03-12T16:10:59.215 INFO:tasks.workunit.client.0.smithi006.stdout:8/765: symlink d2/dab/lf4 0 2024-03-12T16:10:59.215 INFO:tasks.workunit.client.0.smithi006.stdout:4/932: dread - d1/db/f123 zero size 2024-03-12T16:10:59.220 INFO:tasks.workunit.client.0.smithi006.stdout:1/868: creat d0/d25/d2a/d43/de0/f139 x:0 0 0 2024-03-12T16:10:59.220 INFO:tasks.workunit.client.0.smithi006.stdout:5/808: truncate d7/d8/d8a/fad 1593008 0 2024-03-12T16:10:59.225 INFO:tasks.workunit.client.0.smithi006.stdout:1/869: write d0/d25/d2a/d35/d3f/f100 [389273,29060] 0 2024-03-12T16:10:59.226 INFO:tasks.workunit.client.0.smithi006.stdout:8/766: dwrite d2/fc3 [0,4194304] 0 2024-03-12T16:10:59.229 INFO:tasks.workunit.client.0.smithi006.stdout:5/809: truncate d7/d9/d31/d3b/d61/dd3/fde 1024051 0 2024-03-12T16:10:59.234 INFO:tasks.workunit.client.0.smithi006.stdout:4/933: write d1/db/d39/dbf/dec/d5a/fca [759066,98677] 0 2024-03-12T16:10:59.239 INFO:tasks.workunit.client.0.smithi006.stdout:8/767: rmdir d2/db/d1a/d1f/deb 0 2024-03-12T16:10:59.241 INFO:tasks.workunit.client.0.smithi006.stdout:1/870: dwrite d0/d25/f2e [0,4194304] 0 2024-03-12T16:10:59.242 INFO:tasks.workunit.client.0.smithi006.stdout:4/934: write d1/db/d1d/d2f/f36 [4502730,18051] 0 2024-03-12T16:10:59.247 INFO:tasks.workunit.client.0.smithi006.stdout:5/810: dwrite d7/d9/d10/d24/d89/f3a [0,4194304] 0 2024-03-12T16:10:59.247 INFO:tasks.workunit.client.0.smithi006.stdout:4/935: mknod d1/d38/d79/c134 0 2024-03-12T16:10:59.252 INFO:tasks.workunit.client.0.smithi006.stdout:1/871: write d0/d25/d67/f12b [855831,8015] 0 2024-03-12T16:10:59.255 INFO:tasks.workunit.client.0.smithi006.stdout:8/768: dwrite d2/db/d70/daa/fdb [0,4194304] 0 2024-03-12T16:10:59.260 INFO:tasks.workunit.client.0.smithi006.stdout:8/769: creat d2/d32/ff5 x:0 0 0 2024-03-12T16:10:59.339 INFO:tasks.workunit.client.0.smithi006.stdout:0/934: sync 2024-03-12T16:10:59.343 INFO:tasks.workunit.client.0.smithi006.stdout:5/811: dwrite d7/d8/d91/ff1 [0,4194304] 0 2024-03-12T16:10:59.345 INFO:tasks.workunit.client.0.smithi006.stdout:0/935: chown d2/d6/d10/d11/d7e/da6/f9d 7148 1 2024-03-12T16:10:59.347 INFO:tasks.workunit.client.0.smithi006.stdout:8/770: creat d2/db/d1a/d23/ff6 x:0 0 0 2024-03-12T16:10:59.351 INFO:tasks.workunit.client.0.smithi006.stdout:5/812: creat d7/d8/f10c x:0 0 0 2024-03-12T16:10:59.354 INFO:tasks.workunit.client.0.smithi006.stdout:5/813: stat d7/d9/d31/c8e 0 2024-03-12T16:10:59.358 INFO:tasks.workunit.client.0.smithi006.stdout:8/771: creat d2/db/d1a/d21/ff7 x:0 0 0 2024-03-12T16:10:59.360 INFO:tasks.workunit.client.0.smithi006.stdout:5/814: readlink d7/d9/d10/l54 0 2024-03-12T16:10:59.361 INFO:tasks.workunit.client.0.smithi006.stdout:1/872: dread d0/d25/d2a/d43/f87 [0,4194304] 0 2024-03-12T16:10:59.361 INFO:tasks.workunit.client.0.smithi006.stdout:8/772: mkdir d2/d55/d7b/df8 0 2024-03-12T16:10:59.364 INFO:tasks.workunit.client.0.smithi006.stdout:5/815: mknod d7/d9/c10d 0 2024-03-12T16:10:59.372 INFO:tasks.workunit.client.0.smithi006.stdout:8/773: mknod d2/db/d1a/d21/d4f/cf9 0 2024-03-12T16:10:59.373 INFO:tasks.workunit.client.0.smithi006.stdout:0/936: write d2/d39/d42/f90 [2070670,88712] 0 2024-03-12T16:10:59.373 INFO:tasks.workunit.client.0.smithi006.stdout:1/873: mkdir d0/d25/d2a/d43/d63/db6/d133/d13a 0 2024-03-12T16:10:59.373 INFO:tasks.workunit.client.0.smithi006.stdout:0/937: stat d2/d6/f62 0 2024-03-12T16:10:59.375 INFO:tasks.workunit.client.0.smithi006.stdout:1/874: fdatasync d0/d25/d2a/d43/f96 0 2024-03-12T16:10:59.376 INFO:tasks.workunit.client.0.smithi006.stdout:0/938: write d2/d6/d10/d11/d1d/d2e/f33 [3944025,23002] 0 2024-03-12T16:10:59.376 INFO:tasks.workunit.client.0.smithi006.stdout:1/875: chown d0/f23 0 1 2024-03-12T16:10:59.377 INFO:tasks.workunit.client.0.smithi006.stdout:0/939: readlink d2/d88/d129/d97/dbb/lcb 0 2024-03-12T16:10:59.385 INFO:tasks.workunit.client.0.smithi006.stdout:1/876: dwrite d0/d25/d2a/d35/db3/fbb [0,4194304] 0 2024-03-12T16:10:59.405 INFO:tasks.workunit.client.0.smithi006.stdout:1/877: mkdir d0/d25/d67/dc1/d13b 0 2024-03-12T16:10:59.406 INFO:tasks.workunit.client.0.smithi006.stdout:5/816: creat d7/d9/d47/d56/d79/dfb/f10e x:0 0 0 2024-03-12T16:10:59.408 INFO:tasks.workunit.client.0.smithi006.stdout:1/878: mknod d0/d25/d2a/d43/d63/db6/dcb/c13c 0 2024-03-12T16:10:59.410 INFO:tasks.workunit.client.0.smithi006.stdout:5/817: symlink d7/d9/d31/d3b/d4f/d65/de1/l10f 0 2024-03-12T16:10:59.411 INFO:tasks.workunit.client.0.smithi006.stdout:5/818: read d7/d9/d10/f26 [617244,31296] 0 2024-03-12T16:10:59.414 INFO:tasks.workunit.client.0.smithi006.stdout:5/819: creat d7/d8/d91/f110 x:0 0 0 2024-03-12T16:10:59.415 INFO:tasks.workunit.client.0.smithi006.stdout:1/879: dread d0/d25/d2a/d43/d63/f78 [0,4194304] 0 2024-03-12T16:10:59.415 INFO:tasks.workunit.client.0.smithi006.stdout:5/820: stat d7/d9/d10 0 2024-03-12T16:10:59.417 INFO:tasks.workunit.client.0.smithi006.stdout:1/880: chown d0/d25/d2a/f3b 123 1 2024-03-12T16:10:59.419 INFO:tasks.workunit.client.0.smithi006.stdout:5/821: symlink d7/d9/d47/d56/dc4/l111 0 2024-03-12T16:10:59.430 INFO:tasks.workunit.client.0.smithi006.stdout:0/940: write d2/fc4 [798404,87565] 0 2024-03-12T16:10:59.437 INFO:tasks.workunit.client.0.smithi006.stdout:0/941: link d2/d6/d10/d11/d32/fa7 d2/d6/d10/d11/d1d/f139 0 2024-03-12T16:10:59.439 INFO:tasks.workunit.client.0.smithi006.stdout:5/822: dwrite f4 [0,4194304] 0 2024-03-12T16:10:59.440 INFO:tasks.workunit.client.0.smithi006.stdout:1/881: dwrite d0/d25/f36 [0,4194304] 0 2024-03-12T16:10:59.441 INFO:tasks.workunit.client.0.smithi006.stdout:0/942: truncate d2/d88/d129/ffd 968168 0 2024-03-12T16:10:59.444 INFO:tasks.workunit.client.0.smithi006.stdout:5/823: unlink d7/d9/d47/d56/dc4/l111 0 2024-03-12T16:10:59.445 INFO:tasks.workunit.client.0.smithi006.stdout:1/882: rmdir d0/d25/d2a/d43/d68/d111 39 2024-03-12T16:10:59.445 INFO:tasks.workunit.client.0.smithi006.stdout:5/824: dread - d7/d41/fe0 zero size 2024-03-12T16:10:59.446 INFO:tasks.workunit.client.0.smithi006.stdout:0/943: write d2/d6/d10/d11/d32/da4/db5/d10c/f12e [1837341,38650] 0 2024-03-12T16:10:59.449 INFO:tasks.workunit.client.0.smithi006.stdout:0/944: rmdir d2/d39 39 2024-03-12T16:10:59.453 INFO:tasks.workunit.client.0.smithi006.stdout:0/945: symlink d2/d6/d10/d11/d7e/l13a 0 2024-03-12T16:10:59.456 INFO:tasks.workunit.client.0.smithi006.stdout:1/883: link d0/d25/db1/dd0/l131 d0/d25/d2a/d64/l13d 0 2024-03-12T16:10:59.457 INFO:tasks.workunit.client.0.smithi006.stdout:0/946: mkdir d2/d39/d42/df4/d13b 0 2024-03-12T16:10:59.459 INFO:tasks.workunit.client.0.smithi006.stdout:1/884: creat d0/d25/d2a/d43/d68/dd2/f13e x:0 0 0 2024-03-12T16:10:59.460 INFO:tasks.workunit.client.0.smithi006.stdout:1/885: stat d0/d25/d2a/d43/d63/df1 0 2024-03-12T16:10:59.462 INFO:tasks.workunit.client.0.smithi006.stdout:1/886: mkdir d0/d25/d2a/d43/d63/db6/d133/d13f 0 2024-03-12T16:10:59.463 INFO:tasks.workunit.client.0.smithi006.stdout:1/887: fdatasync d0/d25/f75 0 2024-03-12T16:10:59.466 INFO:tasks.workunit.client.0.smithi006.stdout:1/888: mkdir d0/d25/d67/dc1/d140 0 2024-03-12T16:10:59.468 INFO:tasks.workunit.client.0.smithi006.stdout:1/889: creat d0/d25/d2a/d35/db3/f141 x:0 0 0 2024-03-12T16:10:59.468 INFO:tasks.workunit.client.0.smithi006.stdout:5/825: write d7/d9/d31/d3b/d4f/d65/d69/f90 [141364,56212] 0 2024-03-12T16:10:59.470 INFO:tasks.workunit.client.0.smithi006.stdout:5/826: fsync d7/d9/d31/fe9 0 2024-03-12T16:10:59.470 INFO:tasks.workunit.client.0.smithi006.stdout:0/947: write d2/d6/d10/d11/d7e/da6/f9d [172171,41415] 0 2024-03-12T16:10:59.471 INFO:tasks.workunit.client.0.smithi006.stdout:1/890: symlink d0/d25/d2a/d43/dd1/l142 0 2024-03-12T16:10:59.471 INFO:tasks.workunit.client.0.smithi006.stdout:5/827: fdatasync d7/d9/d31/fe9 0 2024-03-12T16:10:59.478 INFO:tasks.workunit.client.0.smithi006.stdout:0/948: mkdir d2/d6/d10/d110/d13c 0 2024-03-12T16:10:59.478 INFO:tasks.workunit.client.0.smithi006.stdout:6/846: sync 2024-03-12T16:10:59.478 INFO:tasks.workunit.client.0.smithi006.stdout:3/722: sync 2024-03-12T16:10:59.479 INFO:tasks.workunit.client.0.smithi006.stdout:1/891: fsync d0/d25/d2a/d43/f44 0 2024-03-12T16:10:59.479 INFO:tasks.workunit.client.0.smithi006.stdout:0/949: chown d2/d88/d129/f86 2 1 2024-03-12T16:10:59.480 INFO:tasks.workunit.client.0.smithi006.stdout:5/828: rmdir d7/d9/d47/d56/d79 39 2024-03-12T16:10:59.480 INFO:tasks.workunit.client.0.smithi006.stdout:6/847: chown d3/d11/ld2 68 1 2024-03-12T16:10:59.482 INFO:tasks.workunit.client.0.smithi006.stdout:3/723: write d8/d19/fa7 [933763,7609] 0 2024-03-12T16:10:59.483 INFO:tasks.workunit.client.0.smithi006.stdout:6/848: dread - d3/d11/d10/da7/d8e/de1/dfe/f105 zero size 2024-03-12T16:10:59.483 INFO:tasks.workunit.client.0.smithi006.stdout:0/950: chown d2/d39/f40 7 1 2024-03-12T16:10:59.485 INFO:tasks.workunit.client.0.smithi006.stdout:0/951: chown d2/d6/d10/d11/d7e/dbe/f133 189760 1 2024-03-12T16:10:59.487 INFO:tasks.workunit.client.0.smithi006.stdout:6/849: read d3/d11/d10/d1b/d6e/d80/d9b/fcb [285072,94067] 0 2024-03-12T16:10:59.488 INFO:tasks.workunit.client.0.smithi006.stdout:5/829: unlink d7/d9/d47/faa 0 2024-03-12T16:10:59.490 INFO:tasks.workunit.client.0.smithi006.stdout:0/952: mknod d2/d39/d42/de5/c13d 0 2024-03-12T16:10:59.491 INFO:tasks.workunit.client.0.smithi006.stdout:6/850: unlink d3/d11/d10/da7/d9e/cbc 0 2024-03-12T16:10:59.493 INFO:tasks.workunit.client.0.smithi006.stdout:3/724: fsync d8/f17 0 2024-03-12T16:10:59.495 INFO:tasks.workunit.client.0.smithi006.stdout:5/830: dread - d7/d9/d47/d56/d79/dfb/f10e zero size 2024-03-12T16:10:59.496 INFO:tasks.workunit.client.0.smithi006.stdout:6/851: chown d3/d11/d3b/d59/l11e 1447 1 2024-03-12T16:10:59.497 INFO:tasks.workunit.client.0.smithi006.stdout:1/892: dwrite d0/d25/d2a/f4d [0,4194304] 0 2024-03-12T16:10:59.503 INFO:tasks.workunit.client.0.smithi006.stdout:5/831: truncate d7/d8/f4c 1612217 0 2024-03-12T16:10:59.504 INFO:tasks.workunit.client.0.smithi006.stdout:1/893: dread d0/d25/d2a/d35/d3f/f45 [0,4194304] 0 2024-03-12T16:10:59.505 INFO:tasks.workunit.client.0.smithi006.stdout:0/953: creat d2/f13e x:0 0 0 2024-03-12T16:10:59.508 INFO:tasks.workunit.client.0.smithi006.stdout:5/832: creat d7/d9/d31/d3b/dba/f112 x:0 0 0 2024-03-12T16:10:59.509 INFO:tasks.workunit.client.0.smithi006.stdout:6/852: truncate d3/d11/d3b/db4/dc3/ff0 1637600 0 2024-03-12T16:10:59.510 INFO:tasks.workunit.client.0.smithi006.stdout:3/725: mkdir d8/ddc/df5 0 2024-03-12T16:10:59.510 INFO:tasks.workunit.client.0.smithi006.stdout:6/853: write d3/d11/d10/da7/d8e/f10e [231739,85325] 0 2024-03-12T16:10:59.511 INFO:tasks.workunit.client.0.smithi006.stdout:3/726: readlink d8/d19/d26/d59/l4a 0 2024-03-12T16:10:59.511 INFO:tasks.workunit.client.0.smithi006.stdout:6/854: stat d3/d11/d10/da7/d8e/d8b 0 2024-03-12T16:10:59.512 INFO:tasks.workunit.client.0.smithi006.stdout:5/833: mknod d7/d9/d31/ded/c113 0 2024-03-12T16:10:59.513 INFO:tasks.workunit.client.0.smithi006.stdout:6/855: chown d3/d11/d10/d1b/d6e/f4f 70 1 2024-03-12T16:10:59.513 INFO:tasks.workunit.client.0.smithi006.stdout:3/727: dread - d8/d19/d26/d59/d2c/d41/d45/fe3 zero size 2024-03-12T16:10:59.514 INFO:tasks.workunit.client.0.smithi006.stdout:6/856: fdatasync d3/f17 0 2024-03-12T16:10:59.592 INFO:tasks.workunit.client.0.smithi006.stdout:3/728: read d8/d4c/dd8/fd6 [794271,55854] 0 2024-03-12T16:10:59.593 INFO:tasks.workunit.client.0.smithi006.stdout:3/729: dread - d8/d19/d26/d59/d2c/dc/f2a zero size 2024-03-12T16:10:59.594 INFO:tasks.workunit.client.0.smithi006.stdout:6/857: dread d3/d11/d10/d9a/fe3 [0,4194304] 0 2024-03-12T16:10:59.595 INFO:tasks.workunit.client.0.smithi006.stdout:3/730: readlink d8/d52/l55 0 2024-03-12T16:10:59.596 INFO:tasks.workunit.client.0.smithi006.stdout:3/731: chown d8/d52/d9e/dba/cdf 663508 1 2024-03-12T16:10:59.599 INFO:tasks.workunit.client.0.smithi006.stdout:6/858: rename d3/d47 to d3/d11/d10/da7/d8e/de1/d60/d108/d12d 0 2024-03-12T16:10:59.602 INFO:tasks.workunit.client.0.smithi006.stdout:3/732: unlink d8/d19/d26/d59/d2c/dc/d28/f90 0 2024-03-12T16:10:59.607 INFO:tasks.workunit.client.0.smithi006.stdout:3/733: rename d8/d19/d47 to d8/d19/d26/d59/d2c/dc/d28/d2f/df6 0 2024-03-12T16:10:59.607 INFO:tasks.workunit.client.0.smithi006.stdout:3/734: readlink d8/d19/d26/d59/d2c/d41/ld3 0 2024-03-12T16:10:59.609 INFO:tasks.workunit.client.0.smithi006.stdout:3/735: truncate d8/d4c/db2/fbf 387512 0 2024-03-12T16:10:59.611 INFO:tasks.workunit.client.0.smithi006.stdout:3/736: unlink d8/d19/l25 0 2024-03-12T16:10:59.617 INFO:tasks.workunit.client.0.smithi006.stdout:6/859: dwrite d3/d11/d10/da7/d8e/de1/d60/d108/d12d/fdf [0,4194304] 0 2024-03-12T16:10:59.622 INFO:tasks.workunit.client.0.smithi006.stdout:6/860: creat d3/d11/d10/da7/dd5/ddb/f12e x:0 0 0 2024-03-12T16:10:59.625 INFO:tasks.workunit.client.0.smithi006.stdout:6/861: rmdir d3/d11/d43 39 2024-03-12T16:10:59.629 INFO:tasks.workunit.client.0.smithi006.stdout:6/862: rename d3/d11/f25 to d3/d11/d43/f12f 0 2024-03-12T16:10:59.630 INFO:tasks.workunit.client.0.smithi006.stdout:6/863: dread - d3/d11/d10/da7/d8e/de1/dfe/f105 zero size 2024-03-12T16:10:59.632 INFO:tasks.workunit.client.0.smithi006.stdout:3/737: dread d8/d19/d26/d59/f1a [0,4194304] 0 2024-03-12T16:10:59.633 INFO:tasks.workunit.client.0.smithi006.stdout:3/738: chown d8/d19/d26/d59/d2c/f10 6935 1 2024-03-12T16:10:59.634 INFO:tasks.workunit.client.0.smithi006.stdout:3/739: stat d8/d19/d26/d59/d2c/dc/d28/d2f/d9d/cd1 0 2024-03-12T16:10:59.635 INFO:tasks.workunit.client.0.smithi006.stdout:6/864: read f1 [34272,88737] 0 2024-03-12T16:10:59.636 INFO:tasks.workunit.client.0.smithi006.stdout:6/865: dread - d3/d11/d3b/db4/dc3/f11d zero size 2024-03-12T16:10:59.638 INFO:tasks.workunit.client.0.smithi006.stdout:6/866: read - d3/d11/d10/d19/fec zero size 2024-03-12T16:10:59.640 INFO:tasks.workunit.client.0.smithi006.stdout:6/867: fsync d3/d11/d10/d19/fd0 0 2024-03-12T16:10:59.646 INFO:tasks.workunit.client.0.smithi006.stdout:6/868: truncate d3/ffd 395772 0 2024-03-12T16:10:59.646 INFO:tasks.workunit.client.0.smithi006.stdout:3/740: dwrite d8/d19/d26/d59/d2c/dc/d28/d2f/df6/f63 [0,4194304] 0 2024-03-12T16:10:59.647 INFO:tasks.workunit.client.0.smithi006.stdout:6/869: symlink d3/d11/d10/da7/dd5/l130 0 2024-03-12T16:10:59.648 INFO:tasks.workunit.client.0.smithi006.stdout:3/741: fdatasync d8/d4c/dd8/f95 0 2024-03-12T16:10:59.652 INFO:tasks.workunit.client.0.smithi006.stdout:6/870: rmdir d3/d11/d10/d1b/d6e/d80 39 2024-03-12T16:10:59.659 INFO:tasks.workunit.client.0.smithi006.stdout:3/742: write d8/d19/d26/d59/d2c/dc/f3a [1217567,108906] 0 2024-03-12T16:10:59.660 INFO:tasks.workunit.client.0.smithi006.stdout:3/743: chown d8/d19/d26/d59/d2c/d41/d45 25629 1 2024-03-12T16:10:59.662 INFO:tasks.workunit.client.0.smithi006.stdout:3/744: mknod d8/d4c/cf7 0 2024-03-12T16:10:59.664 INFO:tasks.workunit.client.0.smithi006.stdout:3/745: creat d8/d19/d26/d59/d2c/d41/d45/ff8 x:0 0 0 2024-03-12T16:10:59.665 INFO:tasks.workunit.client.0.smithi006.stdout:3/746: dread - d8/d4c/dd8/f95 zero size 2024-03-12T16:10:59.665 INFO:tasks.workunit.client.0.smithi006.stdout:6/871: write d3/d11/d10/d19/f65 [59045,105768] 0 2024-03-12T16:10:59.668 INFO:tasks.workunit.client.0.smithi006.stdout:3/747: symlink d8/d19/d26/d59/d2c/d41/lf9 0 2024-03-12T16:10:59.671 INFO:tasks.workunit.client.0.smithi006.stdout:6/872: rename d3/d11/d10/da7/d9e to d3/d11/d10/da7/d8e/de1/d60/d7e/d131 0 2024-03-12T16:10:59.673 INFO:tasks.workunit.client.0.smithi006.stdout:3/748: mkdir d8/ddc/df5/dfa 0 2024-03-12T16:10:59.673 INFO:tasks.workunit.client.0.smithi006.stdout:6/873: rmdir d3/d11/d10/da7/d8e/de1/d60/d7e 39 2024-03-12T16:10:59.679 INFO:tasks.workunit.client.0.smithi006.stdout:6/874: write d3/d11/d10/da7/d8e/de1/d60/fb6 [1013444,74562] 0 2024-03-12T16:10:59.680 INFO:tasks.workunit.client.0.smithi006.stdout:6/875: chown d3/cff 1341243 1 2024-03-12T16:10:59.683 INFO:tasks.workunit.client.0.smithi006.stdout:6/876: rmdir d3/d11/d10/da7/dd5 39 2024-03-12T16:10:59.684 INFO:tasks.workunit.client.0.smithi006.stdout:3/749: dwrite d8/d19/f64 [4194304,4194304] 0 2024-03-12T16:10:59.685 INFO:tasks.workunit.client.0.smithi006.stdout:6/877: chown d3/d11/d10/d1b/d20/d7c/l101 20 1 2024-03-12T16:10:59.685 INFO:tasks.workunit.client.0.smithi006.stdout:3/750: dread - d8/d4c/dd8/f95 zero size 2024-03-12T16:10:59.687 INFO:tasks.workunit.client.0.smithi006.stdout:3/751: creat d8/d19/d26/d59/d2c/d41/ffb x:0 0 0 2024-03-12T16:10:59.689 INFO:tasks.workunit.client.0.smithi006.stdout:3/752: write d8/d19/d26/d59/d2c/dc/d28/faf [782729,100697] 0 2024-03-12T16:10:59.691 INFO:tasks.workunit.client.0.smithi006.stdout:3/753: symlink d8/d19/lfc 0 2024-03-12T16:10:59.694 INFO:tasks.workunit.client.0.smithi006.stdout:3/754: link d8/d19/d26/d59/d2c/dc/d28/d2f/l5e d8/d4c/db2/lfd 0 2024-03-12T16:10:59.697 INFO:tasks.workunit.client.0.smithi006.stdout:3/755: symlink d8/d19/d26/d59/d2c/lfe 0 2024-03-12T16:10:59.703 INFO:tasks.workunit.client.0.smithi006.stdout:2/891: sync 2024-03-12T16:10:59.703 INFO:tasks.workunit.client.0.smithi006.stdout:9/897: sync 2024-03-12T16:10:59.703 INFO:tasks.workunit.client.0.smithi006.stdout:4/936: sync 2024-03-12T16:10:59.704 INFO:tasks.workunit.client.0.smithi006.stdout:3/756: dwrite d8/d19/d26/feb [0,4194304] 0 2024-03-12T16:10:59.705 INFO:tasks.workunit.client.0.smithi006.stdout:2/892: chown d0/d13/c101 22723 1 2024-03-12T16:10:59.707 INFO:tasks.workunit.client.0.smithi006.stdout:3/757: dread d8/d19/d31/f35 [0,4194304] 0 2024-03-12T16:10:59.709 INFO:tasks.workunit.client.0.smithi006.stdout:9/898: symlink d0/d8/d16/d7d/db5/l12d 0 2024-03-12T16:10:59.711 INFO:tasks.workunit.client.0.smithi006.stdout:4/937: rename d1/db/d39/dbf/dec/d43/c70 to d1/db/d39/d42/d61/c135 0 2024-03-12T16:10:59.713 INFO:tasks.workunit.client.0.smithi006.stdout:3/758: creat d8/d4c/d7c/fff x:0 0 0 2024-03-12T16:10:59.713 INFO:tasks.workunit.client.0.smithi006.stdout:2/893: readlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/lfe 0 2024-03-12T16:10:59.714 INFO:tasks.workunit.client.0.smithi006.stdout:9/899: chown d0/d1f/c49 80537555 1 2024-03-12T16:10:59.716 INFO:tasks.workunit.client.0.smithi006.stdout:2/894: write d0/d13/d49/d60/fa7 [3744852,101121] 0 2024-03-12T16:10:59.718 INFO:tasks.workunit.client.0.smithi006.stdout:2/895: write d0/f4 [4061550,4113] 0 2024-03-12T16:10:59.719 INFO:tasks.workunit.client.0.smithi006.stdout:9/900: unlink d0/d4/c2d 0 2024-03-12T16:10:59.720 INFO:tasks.workunit.client.0.smithi006.stdout:2/896: write d0/d13/d49/d60/fc4 [502287,7669] 0 2024-03-12T16:10:59.721 INFO:tasks.workunit.client.0.smithi006.stdout:9/901: symlink d0/d4/d70/da6/l12e 0 2024-03-12T16:10:59.726 INFO:tasks.workunit.client.0.smithi006.stdout:9/902: symlink d0/d4/da7/l12f 0 2024-03-12T16:10:59.729 INFO:tasks.workunit.client.0.smithi006.stdout:9/903: read - d0/d83/f92 zero size 2024-03-12T16:10:59.732 INFO:tasks.workunit.client.0.smithi006.stdout:2/897: dwrite d0/d13/d49/d60/d2b/d62/d66/da6/ff3 [0,4194304] 0 2024-03-12T16:10:59.735 INFO:tasks.workunit.client.0.smithi006.stdout:9/904: symlink d0/d8/d16/l130 0 2024-03-12T16:10:59.738 INFO:tasks.workunit.client.0.smithi006.stdout:2/898: chown d0/d13/d49/d60/d2b/d62/f86 4 1 2024-03-12T16:10:59.738 INFO:tasks.workunit.client.0.smithi006.stdout:3/759: dread d8/d4c/dd8/fa5 [0,4194304] 0 2024-03-12T16:10:59.738 INFO:tasks.workunit.client.0.smithi006.stdout:2/899: chown d0/de7 3324 1 2024-03-12T16:10:59.739 INFO:tasks.workunit.client.0.smithi006.stdout:4/938: dwrite d1/db/d1d/d2f/d6b/f7d [0,4194304] 0 2024-03-12T16:10:59.743 INFO:tasks.workunit.client.0.smithi006.stdout:3/760: mknod d8/d52/d9e/c100 0 2024-03-12T16:10:59.744 INFO:tasks.workunit.client.0.smithi006.stdout:2/900: rmdir d0/d13/d49/d60/d2b/d62/d66/d69/d81 39 2024-03-12T16:10:59.748 INFO:tasks.workunit.client.0.smithi006.stdout:3/761: creat d8/d19/d26/d97/f101 x:0 0 0 2024-03-12T16:10:59.749 INFO:tasks.workunit.client.0.smithi006.stdout:9/905: dwrite d0/d8/d16/d7d/d20/d37/dc5/fec [0,4194304] 0 2024-03-12T16:10:59.754 INFO:tasks.workunit.client.0.smithi006.stdout:9/906: creat d0/d4/d70/d71/f131 x:0 0 0 2024-03-12T16:10:59.756 INFO:tasks.workunit.client.0.smithi006.stdout:3/762: rename d8/d19/d26/d59/d2c/dc/d28/c57 to d8/d4c/db2/c102 0 2024-03-12T16:10:59.756 INFO:tasks.workunit.client.0.smithi006.stdout:2/901: dwrite d0/d13/d49/d60/fa7 [0,4194304] 0 2024-03-12T16:10:59.757 INFO:tasks.workunit.client.0.smithi006.stdout:4/939: write d1/d38/d79/fb1 [523758,114568] 0 2024-03-12T16:10:59.766 INFO:tasks.workunit.client.0.smithi006.stdout:4/940: rename d1/db/de7/c12a to d1/db/d39/dbf/dec/da8/c136 0 2024-03-12T16:10:59.767 INFO:tasks.workunit.client.0.smithi006.stdout:3/763: dread d8/d19/d26/d59/d2c/dc/d28/d2f/df6/f63 [0,4194304] 0 2024-03-12T16:10:59.767 INFO:tasks.workunit.client.0.smithi006.stdout:4/941: dread - d1/d91/fdd zero size 2024-03-12T16:10:59.771 INFO:tasks.workunit.client.0.smithi006.stdout:2/902: link d0/d13/d49/d60/f53 d0/d13/d49/d60/d2b/d62/d66/d69/d81/db4/dc0/f10b 0 2024-03-12T16:10:59.772 INFO:tasks.workunit.client.0.smithi006.stdout:2/903: chown d0/d13/d49/d60/d2b/d62/f86 2938 1 2024-03-12T16:10:59.773 INFO:tasks.workunit.client.0.smithi006.stdout:2/904: truncate d0/d13/f35 4793698 0 2024-03-12T16:10:59.775 INFO:tasks.workunit.client.0.smithi006.stdout:3/764: dread d8/d19/f9b [0,4194304] 0 2024-03-12T16:10:59.776 INFO:tasks.workunit.client.0.smithi006.stdout:2/905: mknod d0/dc/de0/def/c10c 0 2024-03-12T16:10:59.777 INFO:tasks.workunit.client.0.smithi006.stdout:2/906: chown d0/d13/f44 16 1 2024-03-12T16:10:59.777 INFO:tasks.workunit.client.0.smithi006.stdout:3/765: readlink d8/d19/d26/d59/d2c/dc/d28/d2f/df6/lb5 0 2024-03-12T16:10:59.779 INFO:tasks.workunit.client.0.smithi006.stdout:3/766: rmdir d8/d52/d9e 39 2024-03-12T16:10:59.780 INFO:tasks.workunit.client.0.smithi006.stdout:3/767: fsync d8/d19/d26/d59/d2c/d41/ffb 0 2024-03-12T16:10:59.781 INFO:tasks.workunit.client.0.smithi006.stdout:3/768: chown d8/d4c/d7c/fff 1803657660 1 2024-03-12T16:10:59.784 INFO:tasks.workunit.client.0.smithi006.stdout:4/942: write d1/db/d39/dbf/dec/f53 [4310741,83911] 0 2024-03-12T16:10:59.784 INFO:tasks.workunit.client.0.smithi006.stdout:3/769: read d8/d19/d26/d59/d2c/dc/d28/d2f/d9d/fc6 [3418149,47093] 0 2024-03-12T16:10:59.787 INFO:tasks.workunit.client.0.smithi006.stdout:2/907: rename d0/d13/d49/d60/d2b/d62/d66/d67/fd7 to d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/db3/f10d 0 2024-03-12T16:10:59.789 INFO:tasks.workunit.client.0.smithi006.stdout:2/908: fsync d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fb0 0 2024-03-12T16:10:59.790 INFO:tasks.workunit.client.0.smithi006.stdout:2/909: dread - d0/d13/d49/d60/fde zero size 2024-03-12T16:10:59.795 INFO:tasks.workunit.client.0.smithi006.stdout:2/910: mkdir d0/d13/d49/d60/d2b/d62/dce/d10e 0 2024-03-12T16:10:59.795 INFO:tasks.workunit.client.0.smithi006.stdout:2/911: stat d0/d13/d49/f74 0 2024-03-12T16:10:59.800 INFO:tasks.workunit.client.0.smithi006.stdout:3/770: dwrite d8/d19/d26/d59/d2c/dc/d28/d2f/f3c [4194304,4194304] 0 2024-03-12T16:10:59.804 INFO:tasks.workunit.client.0.smithi006.stdout:4/943: dread d1/db/d1d/d2f/f97 [0,4194304] 0 2024-03-12T16:10:59.808 INFO:tasks.workunit.client.0.smithi006.stdout:3/771: read d8/d19/d31/dc4/fe0 [2764018,102646] 0 2024-03-12T16:10:59.808 INFO:tasks.workunit.client.0.smithi006.stdout:2/912: dwrite d0/d13/d49/d60/d2b/d62/d66/da6/fee [0,4194304] 0 2024-03-12T16:10:59.810 INFO:tasks.workunit.client.0.smithi006.stdout:4/944: creat d1/db/d39/dbf/dec/d5a/d60/f137 x:0 0 0 2024-03-12T16:10:59.811 INFO:tasks.workunit.client.0.smithi006.stdout:3/772: fsync d8/d19/d26/d59/d2c/dc/d28/d2f/f60 0 2024-03-12T16:10:59.812 INFO:tasks.workunit.client.0.smithi006.stdout:2/913: fdatasync d0/d13/d49/d60/d2b/d62/dce/fcf 0 2024-03-12T16:10:59.815 INFO:tasks.workunit.client.0.smithi006.stdout:4/945: creat d1/db/d39/d42/df2/f138 x:0 0 0 2024-03-12T16:10:59.816 INFO:tasks.workunit.client.0.smithi006.stdout:2/914: mknod d0/d13/d49/d60/d105/c10f 0 2024-03-12T16:10:59.817 INFO:tasks.workunit.client.0.smithi006.stdout:4/946: creat d1/d38/db6/f139 x:0 0 0 2024-03-12T16:10:59.819 INFO:tasks.workunit.client.0.smithi006.stdout:4/947: dread - d1/db/d39/d42/df2/f138 zero size 2024-03-12T16:10:59.820 INFO:tasks.workunit.client.0.smithi006.stdout:2/915: mknod d0/d13/d49/d60/d2b/d62/c110 0 2024-03-12T16:10:59.821 INFO:tasks.workunit.client.0.smithi006.stdout:2/916: creat d0/dc/d97/f111 x:0 0 0 2024-03-12T16:10:59.825 INFO:tasks.workunit.client.0.smithi006.stdout:3/773: dread d8/d19/d26/d59/d2c/dc/d28/d2f/df6/f77 [0,4194304] 0 2024-03-12T16:10:59.828 INFO:tasks.workunit.client.0.smithi006.stdout:2/917: dwrite d0/d13/d49/d60/d2b/d62/d66/fcd [4194304,4194304] 0 2024-03-12T16:10:59.831 INFO:tasks.workunit.client.0.smithi006.stdout:2/918: unlink d0/d13/d49/d60/c91 0 2024-03-12T16:10:59.832 INFO:tasks.workunit.client.0.smithi006.stdout:2/919: chown d0/dc/f1a 1085747842 1 2024-03-12T16:10:59.833 INFO:tasks.workunit.client.0.smithi006.stdout:2/920: fsync d0/dc/d64/f9c 0 2024-03-12T16:10:59.833 INFO:tasks.workunit.client.0.smithi006.stdout:3/774: link d8/f76 d8/d19/d26/d59/d2c/dc/d28/d2f/df6/f103 0 2024-03-12T16:10:59.836 INFO:tasks.workunit.client.0.smithi006.stdout:3/775: read - d8/d52/d9e/fb3 zero size 2024-03-12T16:10:59.837 INFO:tasks.workunit.client.0.smithi006.stdout:3/776: chown d8/d19/d26/d97/c87 48 1 2024-03-12T16:10:59.839 INFO:tasks.workunit.client.0.smithi006.stdout:3/777: creat d8/ddc/df5/dfa/f104 x:0 0 0 2024-03-12T16:10:59.840 INFO:tasks.workunit.client.0.smithi006.stdout:3/778: symlink d8/d4c/dc8/l105 0 2024-03-12T16:10:59.842 INFO:tasks.workunit.client.0.smithi006.stdout:3/779: symlink d8/d19/d26/d59/d2c/d41/d8b/d93/l106 0 2024-03-12T16:10:59.846 INFO:tasks.workunit.client.0.smithi006.stdout:3/780: link d8/d19/d26/d59/d2c/d41/d45/fe3 d8/d19/d26/f107 0 2024-03-12T16:10:59.849 INFO:tasks.workunit.client.0.smithi006.stdout:3/781: creat d8/d19/d26/d97/dce/f108 x:0 0 0 2024-03-12T16:10:59.849 INFO:tasks.workunit.client.0.smithi006.stdout:3/782: creat d8/d4c/db2/f109 x:0 0 0 2024-03-12T16:10:59.855 INFO:tasks.workunit.client.0.smithi006.stdout:3/783: dwrite d8/d52/d9e/fa9 [0,4194304] 0 2024-03-12T16:10:59.863 INFO:tasks.workunit.client.0.smithi006.stdout:3/784: dwrite d8/d19/d26/d59/d2c/dc/db7/fc5 [0,4194304] 0 2024-03-12T16:10:59.866 INFO:tasks.workunit.client.0.smithi006.stdout:3/785: mknod d8/d19/dbc/c10a 0 2024-03-12T16:10:59.960 INFO:tasks.workunit.client.0.smithi006.stdout:2/921: write d0/d13/f27 [3440958,32418] 0 2024-03-12T16:10:59.962 INFO:tasks.workunit.client.0.smithi006.stdout:2/922: symlink d0/dc/de0/l112 0 2024-03-12T16:10:59.964 INFO:tasks.workunit.client.0.smithi006.stdout:2/923: mknod d0/d13/d49/c113 0 2024-03-12T16:10:59.966 INFO:tasks.workunit.client.0.smithi006.stdout:2/924: mkdir d0/d13/d49/d60/d114 0 2024-03-12T16:10:59.969 INFO:tasks.workunit.client.0.smithi006.stdout:2/925: fsync d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/db3/f10d 0 2024-03-12T16:10:59.971 INFO:tasks.workunit.client.0.smithi006.stdout:2/926: fsync d0/d13/d49/d60/d2b/d62/d66/da6/fee 0 2024-03-12T16:10:59.972 INFO:tasks.workunit.client.0.smithi006.stdout:3/786: write d8/d52/d6c/fef [814431,111189] 0 2024-03-12T16:10:59.975 INFO:tasks.workunit.client.0.smithi006.stdout:2/927: chown d0/d13/d49/d60/d2b/d62/d66/da6/ld9 3243 1 2024-03-12T16:10:59.975 INFO:tasks.workunit.client.0.smithi006.stdout:2/928: fdatasync d0/d13/d49/fa1 0 2024-03-12T16:10:59.976 INFO:tasks.workunit.client.0.smithi006.stdout:3/787: symlink d8/d19/d26/d59/d2c/dc/d28/d2f/df6/l10b 0 2024-03-12T16:10:59.978 INFO:tasks.workunit.client.0.smithi006.stdout:3/788: fdatasync d8/d4c/dd8/fd6 0 2024-03-12T16:10:59.979 INFO:tasks.workunit.client.0.smithi006.stdout:3/789: fsync d8/d19/d26/d59/d2c/dc/d28/fe4 0 2024-03-12T16:10:59.981 INFO:tasks.workunit.client.0.smithi006.stdout:2/929: dread d0/d13/d49/d60/d2b/d62/dce/fcf [4194304,4194304] 0 2024-03-12T16:10:59.981 INFO:tasks.workunit.client.0.smithi006.stdout:3/790: creat d8/d19/d31/f10c x:0 0 0 2024-03-12T16:10:59.988 INFO:tasks.workunit.client.0.smithi006.stdout:3/791: write d8/f8e [155615,498] 0 2024-03-12T16:10:59.989 INFO:tasks.workunit.client.0.smithi006.stdout:2/930: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f96 [0,4194304] 0 2024-03-12T16:10:59.989 INFO:tasks.workunit.client.0.smithi006.stdout:3/792: readlink d8/d4c/d7c/lcc 0 2024-03-12T16:10:59.990 INFO:tasks.workunit.client.0.smithi006.stdout:2/931: readlink d0/d13/d49/d60/d2b/d62/d66/d67/l98 0 2024-03-12T16:10:59.991 INFO:tasks.workunit.client.0.smithi006.stdout:3/793: creat d8/d4c/d7c/f10d x:0 0 0 2024-03-12T16:10:59.992 INFO:tasks.workunit.client.0.smithi006.stdout:3/794: chown d8/d19/d26/d59/d2c/lfe 198 1 2024-03-12T16:10:59.994 INFO:tasks.workunit.client.0.smithi006.stdout:2/932: rmdir d0/d13/d49 39 2024-03-12T16:11:00.037 INFO:tasks.workunit.client.0.smithi006.stdout:1/894: sync 2024-03-12T16:11:00.037 INFO:tasks.workunit.client.0.smithi006.stdout:8/774: sync 2024-03-12T16:11:00.037 INFO:tasks.workunit.client.0.smithi006.stdout:3/795: getdents d8/d19/d26/d59/d2c/d41/d8b 0 2024-03-12T16:11:00.039 INFO:tasks.workunit.client.0.smithi006.stdout:1/895: chown d0/d25/d2a/d43/d68/cdb 9 1 2024-03-12T16:11:00.039 INFO:tasks.workunit.client.0.smithi006.stdout:8/775: dread - d2/db/d70/f9c zero size 2024-03-12T16:11:00.043 INFO:tasks.workunit.client.0.smithi006.stdout:8/776: write d2/db/d1a/d21/fa8 [4847744,14996] 0 2024-03-12T16:11:00.044 INFO:tasks.workunit.client.0.smithi006.stdout:2/933: getdents d0/d13/d49/d60/d2b/d62/d66/d69/d81 0 2024-03-12T16:11:00.045 INFO:tasks.workunit.client.0.smithi006.stdout:1/896: symlink d0/d25/d2a/d43/d63/db6/d132/l143 0 2024-03-12T16:11:00.045 INFO:tasks.workunit.client.0.smithi006.stdout:8/777: chown d2/d11/d5a 112769215 1 2024-03-12T16:11:00.048 INFO:tasks.workunit.client.0.smithi006.stdout:3/796: dwrite d8/d19/dbc/f80 [0,4194304] 0 2024-03-12T16:11:00.050 INFO:tasks.workunit.client.0.smithi006.stdout:2/934: write d0/d13/d49/d60/d2b/d62/f86 [2931090,122241] 0 2024-03-12T16:11:00.050 INFO:tasks.workunit.client.0.smithi006.stdout:1/897: chown d0/d25/d2a/d43/d68/d111/d119 6207 1 2024-03-12T16:11:00.052 INFO:tasks.workunit.client.0.smithi006.stdout:8/778: write d2/db/f2e [4874182,36723] 0 2024-03-12T16:11:00.052 INFO:tasks.workunit.client.0.smithi006.stdout:2/935: stat d0/dc/l3d 0 2024-03-12T16:11:00.056 INFO:tasks.workunit.client.0.smithi006.stdout:8/779: mkdir d2/db/d1a/d1f/dfa 0 2024-03-12T16:11:00.059 INFO:tasks.workunit.client.0.smithi006.stdout:8/780: creat d2/db/d1a/d21/d8a/ffb x:0 0 0 2024-03-12T16:11:00.062 INFO:tasks.workunit.client.0.smithi006.stdout:2/936: dwrite d0/d13/d49/d60/d2b/d62/d66/da6/fee [0,4194304] 0 2024-03-12T16:11:00.068 INFO:tasks.workunit.client.0.smithi006.stdout:2/937: readlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/ldc 0 2024-03-12T16:11:00.070 INFO:tasks.workunit.client.0.smithi006.stdout:3/797: dwrite d8/d19/d26/f107 [0,4194304] 0 2024-03-12T16:11:00.073 INFO:tasks.workunit.client.0.smithi006.stdout:1/898: dwrite d0/d25/d2a/d35/fbd [0,4194304] 0 2024-03-12T16:11:00.074 INFO:tasks.workunit.client.0.smithi006.stdout:1/899: readlink d0/l76 0 2024-03-12T16:11:00.075 INFO:tasks.workunit.client.0.smithi006.stdout:3/798: fdatasync d8/d19/d31/f35 0 2024-03-12T16:11:00.077 INFO:tasks.workunit.client.0.smithi006.stdout:3/799: write d8/d52/d6c/f84 [840315,40029] 0 2024-03-12T16:11:00.078 INFO:tasks.workunit.client.0.smithi006.stdout:3/800: read - d8/d19/d26/d97/dce/fac zero size 2024-03-12T16:11:00.081 INFO:tasks.workunit.client.0.smithi006.stdout:2/938: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/l115 0 2024-03-12T16:11:00.083 INFO:tasks.workunit.client.0.smithi006.stdout:3/801: creat d8/d19/d26/d97/dce/f10e x:0 0 0 2024-03-12T16:11:00.084 INFO:tasks.workunit.client.0.smithi006.stdout:2/939: symlink d0/d13/d49/d60/d2b/dcc/l116 0 2024-03-12T16:11:00.085 INFO:tasks.workunit.client.0.smithi006.stdout:8/781: truncate d2/db/fb1 608461 0 2024-03-12T16:11:00.087 INFO:tasks.workunit.client.0.smithi006.stdout:3/802: rename d8/d4c/dd8/f9f to d8/d19/d26/d59/d2c/dc/f10f 0 2024-03-12T16:11:00.089 INFO:tasks.workunit.client.0.smithi006.stdout:2/940: symlink d0/dc/de0/l117 0 2024-03-12T16:11:00.090 INFO:tasks.workunit.client.0.smithi006.stdout:3/803: write d8/d19/d26/d97/dce/fc0 [3168929,122989] 0 2024-03-12T16:11:00.091 INFO:tasks.workunit.client.0.smithi006.stdout:3/804: stat d8/d4c/dd8/f95 0 2024-03-12T16:11:00.091 INFO:tasks.workunit.client.0.smithi006.stdout:8/782: stat d2/db/fb1 0 2024-03-12T16:11:00.093 INFO:tasks.workunit.client.0.smithi006.stdout:2/941: rmdir d0/d13/d49/d60/d2b/d82 39 2024-03-12T16:11:00.094 INFO:tasks.workunit.client.0.smithi006.stdout:8/783: truncate d2/db/d1a/d7a/faf 761347 0 2024-03-12T16:11:00.094 INFO:tasks.workunit.client.0.smithi006.stdout:3/805: mkdir d8/d19/d26/d59/d2c/d41/d45/d110 0 2024-03-12T16:11:00.097 INFO:tasks.workunit.client.0.smithi006.stdout:3/806: mkdir d8/d52/d6c/d111 0 2024-03-12T16:11:00.097 INFO:tasks.workunit.client.0.smithi006.stdout:8/784: rmdir d2/db/d1a/d21/d4f 39 2024-03-12T16:11:00.100 INFO:tasks.workunit.client.0.smithi006.stdout:3/807: mknod d8/d52/d6c/c112 0 2024-03-12T16:11:00.103 INFO:tasks.workunit.client.0.smithi006.stdout:2/942: dwrite d0/d13/d49/d60/d2b/d62/d79/fb7 [0,4194304] 0 2024-03-12T16:11:00.108 INFO:tasks.workunit.client.0.smithi006.stdout:2/943: unlink d0/fe9 0 2024-03-12T16:11:00.114 INFO:tasks.workunit.client.0.smithi006.stdout:8/785: dwrite d2/db/d1a/d21/dad/d7c/fd3 [0,4194304] 0 2024-03-12T16:11:00.116 INFO:tasks.workunit.client.0.smithi006.stdout:3/808: dwrite d8/d19/d26/d97/dce/fdb [0,4194304] 0 2024-03-12T16:11:00.117 INFO:tasks.workunit.client.0.smithi006.stdout:2/944: mknod d0/d13/d49/d60/d2b/d62/dce/c118 0 2024-03-12T16:11:00.120 INFO:tasks.workunit.client.0.smithi006.stdout:3/809: write d8/d4c/d7c/f7e [1452750,58789] 0 2024-03-12T16:11:00.124 INFO:tasks.workunit.client.0.smithi006.stdout:8/786: rmdir d2/db/d1a/d1f/de6 0 2024-03-12T16:11:00.125 INFO:tasks.workunit.client.0.smithi006.stdout:2/945: chown d0/d13/d49/d60/d2b/c5a 14529807 1 2024-03-12T16:11:00.127 INFO:tasks.workunit.client.0.smithi006.stdout:3/810: rename d8/d19/d26/d59/d2c/fd5 to d8/d19/d26/d59/d2c/d41/f113 0 2024-03-12T16:11:00.128 INFO:tasks.workunit.client.0.smithi006.stdout:2/946: fsync d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/fe8 0 2024-03-12T16:11:00.131 INFO:tasks.workunit.client.0.smithi006.stdout:3/811: symlink d8/ddc/df5/l114 0 2024-03-12T16:11:00.134 INFO:tasks.workunit.client.0.smithi006.stdout:2/947: creat d0/d13/d49/d60/d2b/dcc/f119 x:0 0 0 2024-03-12T16:11:00.135 INFO:tasks.workunit.client.0.smithi006.stdout:8/787: dwrite d2/db/d1a/d21/d2b/da2/fc1 [0,4194304] 0 2024-03-12T16:11:00.141 INFO:tasks.workunit.client.0.smithi006.stdout:2/948: read d0/d13/d49/d60/d2b/f94 [315584,110161] 0 2024-03-12T16:11:00.144 INFO:tasks.workunit.client.0.smithi006.stdout:3/812: truncate d8/d19/d26/d59/d2c/dc/d28/d2f/df6/f79 314549 0 2024-03-12T16:11:00.145 INFO:tasks.workunit.client.0.smithi006.stdout:2/949: rmdir d0/dc 39 2024-03-12T16:11:00.146 INFO:tasks.workunit.client.0.smithi006.stdout:8/788: dwrite d2/db/d1a/d21/dad/fe3 [0,4194304] 0 2024-03-12T16:11:00.147 INFO:tasks.workunit.client.0.smithi006.stdout:2/950: chown d0/d13/d49/dc1 4173 1 2024-03-12T16:11:00.149 INFO:tasks.workunit.client.0.smithi006.stdout:2/951: chown d0/d13/d49/d60/d2b 4 1 2024-03-12T16:11:00.150 INFO:tasks.workunit.client.0.smithi006.stdout:3/813: rmdir d8/d19/d26/d97 39 2024-03-12T16:11:00.155 INFO:tasks.workunit.client.0.smithi006.stdout:8/789: dread d2/d11/d5a/fac [0,4194304] 0 2024-03-12T16:11:00.158 INFO:tasks.workunit.client.0.smithi006.stdout:3/814: truncate d8/d19/d26/d59/d2c/d41/f113 466774 0 2024-03-12T16:11:00.160 INFO:tasks.workunit.client.0.smithi006.stdout:8/790: creat d2/db/d1a/d21/d2b/da2/dbc/ffc x:0 0 0 2024-03-12T16:11:00.161 INFO:tasks.workunit.client.0.smithi006.stdout:2/952: dwrite d0/d13/f35 [4194304,4194304] 0 2024-03-12T16:11:00.162 INFO:tasks.workunit.client.0.smithi006.stdout:3/815: creat d8/d19/d26/d59/f115 x:0 0 0 2024-03-12T16:11:00.165 INFO:tasks.workunit.client.0.smithi006.stdout:2/953: dread - d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/dbb/fd8 zero size 2024-03-12T16:11:00.172 INFO:tasks.workunit.client.0.smithi006.stdout:2/954: rename d0/dc/d64/dc3/fca to d0/d13/d49/d60/d2b/d62/d66/d69/d81/db4/f11a 0 2024-03-12T16:11:00.179 INFO:tasks.workunit.client.0.smithi006.stdout:3/816: mkdir d8/d19/d26/d59/d2c/d41/da1/d116 0 2024-03-12T16:11:00.182 INFO:tasks.workunit.client.0.smithi006.stdout:3/817: mkdir d8/d19/d26/d59/d2c/dc/d28/d2f/d117 0 2024-03-12T16:11:00.184 INFO:tasks.workunit.client.0.smithi006.stdout:3/818: symlink d8/ddc/df5/l118 0 2024-03-12T16:11:00.185 INFO:tasks.workunit.client.0.smithi006.stdout:2/955: dwrite d0/dc/de0/fe1 [0,4194304] 0 2024-03-12T16:11:00.187 INFO:tasks.workunit.client.0.smithi006.stdout:2/956: chown d0/d13/d49/d60/d2b/d62/c87 1712787 1 2024-03-12T16:11:00.191 INFO:tasks.workunit.client.0.smithi006.stdout:3/819: creat d8/d19/d26/d59/d2c/d41/d45/d110/f119 x:0 0 0 2024-03-12T16:11:00.195 INFO:tasks.workunit.client.0.smithi006.stdout:3/820: chown d8/d19/d26/d59/d2c/c24 126657 1 2024-03-12T16:11:00.195 INFO:tasks.workunit.client.0.smithi006.stdout:2/957: dwrite d0/d13/d49/ffa [0,4194304] 0 2024-03-12T16:11:00.196 INFO:tasks.workunit.client.0.smithi006.stdout:6/878: sync 2024-03-12T16:11:00.196 INFO:tasks.workunit.client.0.smithi006.stdout:5/834: sync 2024-03-12T16:11:00.197 INFO:tasks.workunit.client.0.smithi006.stdout:0/954: sync 2024-03-12T16:11:00.200 INFO:tasks.workunit.client.0.smithi006.stdout:2/958: creat d0/d13/d49/d60/d105/f11b x:0 0 0 2024-03-12T16:11:00.201 INFO:tasks.workunit.client.0.smithi006.stdout:6/879: mknod d3/d11/d10/d9a/c132 0 2024-03-12T16:11:00.202 INFO:tasks.workunit.client.0.smithi006.stdout:5/835: truncate d7/d9/d31/d3b/d4f/d80/dea/f100 433879 0 2024-03-12T16:11:00.203 INFO:tasks.workunit.client.0.smithi006.stdout:0/955: rename d2/d6/l136 to d2/d106/l13f 0 2024-03-12T16:11:00.207 INFO:tasks.workunit.client.0.smithi006.stdout:0/956: stat d2/d6/f3d 0 2024-03-12T16:11:00.208 INFO:tasks.workunit.client.0.smithi006.stdout:3/821: dread d8/d19/d26/d59/d2c/dc/d28/d2f/df6/f63 [0,4194304] 0 2024-03-12T16:11:00.208 INFO:tasks.workunit.client.0.smithi006.stdout:6/880: creat d3/d11/d10/da7/d8e/de1/d60/d108/d12d/db0/f133 x:0 0 0 2024-03-12T16:11:00.209 INFO:tasks.workunit.client.0.smithi006.stdout:5/836: symlink d7/d9/d31/l114 0 2024-03-12T16:11:00.210 INFO:tasks.workunit.client.0.smithi006.stdout:0/957: dread - d2/d6/d10/d11/d7e/dbe/fc3 zero size 2024-03-12T16:11:00.211 INFO:tasks.workunit.client.0.smithi006.stdout:6/881: write d3/d11/d10/d19/f67 [4776889,86451] 0 2024-03-12T16:11:00.211 INFO:tasks.workunit.client.0.smithi006.stdout:5/837: chown d7/d9/d10/f1a 432 1 2024-03-12T16:11:00.212 INFO:tasks.workunit.client.0.smithi006.stdout:6/882: stat d3/d11/d3b/db4 0 2024-03-12T16:11:00.218 INFO:tasks.workunit.client.0.smithi006.stdout:3/822: link d8/d19/d26/d59/d2c/d41/ffb d8/d19/d26/d59/d2c/dc/d28/f11a 0 2024-03-12T16:11:00.219 INFO:tasks.workunit.client.0.smithi006.stdout:5/838: creat d7/d9/d47/d56/f115 x:0 0 0 2024-03-12T16:11:00.220 INFO:tasks.workunit.client.0.smithi006.stdout:2/959: dwrite d0/d13/d49/f74 [0,4194304] 0 2024-03-12T16:11:00.222 INFO:tasks.workunit.client.0.smithi006.stdout:0/958: truncate d2/d88/f119 264501 0 2024-03-12T16:11:00.223 INFO:tasks.workunit.client.0.smithi006.stdout:2/960: write d0/d13/d49/d60/d2b/d62/f86 [3192771,3690] 0 2024-03-12T16:11:00.224 INFO:tasks.workunit.client.0.smithi006.stdout:5/839: creat d7/d9/d31/d3b/dba/f116 x:0 0 0 2024-03-12T16:11:00.226 INFO:tasks.workunit.client.0.smithi006.stdout:0/959: readlink d2/d6/d10/d11/d32/da4/la9 0 2024-03-12T16:11:00.226 INFO:tasks.workunit.client.0.smithi006.stdout:6/883: getdents d3/d11/d10/d1b/d6e/d96 0 2024-03-12T16:11:00.226 INFO:tasks.workunit.client.0.smithi006.stdout:2/961: chown d0/dc/ff0 460 1 2024-03-12T16:11:00.229 INFO:tasks.workunit.client.0.smithi006.stdout:5/840: creat d7/d9/d31/d3b/dba/f117 x:0 0 0 2024-03-12T16:11:00.231 INFO:tasks.workunit.client.0.smithi006.stdout:3/823: dwrite d8/d19/d26/d97/fcb [0,4194304] 0 2024-03-12T16:11:00.233 INFO:tasks.workunit.client.0.smithi006.stdout:3/824: stat d8/d19/fa7 0 2024-03-12T16:11:00.236 INFO:tasks.workunit.client.0.smithi006.stdout:0/960: rename f0 to d2/d6/d10/d11/d7e/dbe/f140 0 2024-03-12T16:11:00.238 INFO:tasks.workunit.client.0.smithi006.stdout:2/962: symlink d0/d13/d49/d60/d2b/d62/dce/l11c 0 2024-03-12T16:11:00.239 INFO:tasks.workunit.client.0.smithi006.stdout:6/884: creat d3/d11/d10/da7/dd5/ddb/f134 x:0 0 0 2024-03-12T16:11:00.241 INFO:tasks.workunit.client.0.smithi006.stdout:3/825: creat d8/d19/d26/d59/d2c/dc/d28/d2f/d9d/f11b x:0 0 0 2024-03-12T16:11:00.242 INFO:tasks.workunit.client.0.smithi006.stdout:0/961: creat d2/d6/d10/d11/d7e/dbe/f141 x:0 0 0 2024-03-12T16:11:00.248 INFO:tasks.workunit.client.0.smithi006.stdout:6/885: fsync d3/d11/d10/da7/d8e/f7a 0 2024-03-12T16:11:00.251 INFO:tasks.workunit.client.0.smithi006.stdout:6/886: chown d3/d11/d10/d19/c8d 11573 1 2024-03-12T16:11:00.253 INFO:tasks.workunit.client.0.smithi006.stdout:0/962: dwrite d2/d6/d10/d11/d1d/d2e/f6a [4194304,4194304] 0 2024-03-12T16:11:00.257 INFO:tasks.workunit.client.0.smithi006.stdout:6/887: stat d3/d11/d10/d28/c4b 0 2024-03-12T16:11:00.259 INFO:tasks.workunit.client.0.smithi006.stdout:2/963: link d0/d13/d49/d60/cac d0/d13/d49/d60/d2b/d62/d79/c11d 0 2024-03-12T16:11:00.262 INFO:tasks.workunit.client.0.smithi006.stdout:5/841: dwrite d7/d8/f14 [0,4194304] 0 2024-03-12T16:11:00.264 INFO:tasks.workunit.client.0.smithi006.stdout:5/842: chown d7/d9/d10/d24/d89/c72 451 1 2024-03-12T16:11:00.275 INFO:tasks.workunit.client.0.smithi006.stdout:3/826: dwrite d8/d19/d31/f35 [0,4194304] 0 2024-03-12T16:11:00.292 INFO:tasks.workunit.client.0.smithi006.stdout:2/964: dread d0/d13/f44 [0,4194304] 0 2024-03-12T16:11:00.325 INFO:tasks.workunit.client.0.smithi006.stdout:4/948: sync 2024-03-12T16:11:00.326 INFO:tasks.workunit.client.0.smithi006.stdout:9/907: sync 2024-03-12T16:11:00.334 INFO:tasks.workunit.client.0.smithi006.stdout:6/888: rename d3/d11/d10/da7/dd5/ddb/d112/l11a to d3/d11/d10/d1b/d6e/d80/d9b/l135 0 2024-03-12T16:11:00.339 INFO:tasks.workunit.client.0.smithi006.stdout:0/963: write d2/d6/d10/d11/d32/fa7 [1129516,69568] 0 2024-03-12T16:11:00.343 INFO:tasks.workunit.client.0.smithi006.stdout:3/827: creat d8/d19/d26/d59/d2c/d41/d8b/f11c x:0 0 0 2024-03-12T16:11:00.350 INFO:tasks.workunit.client.0.smithi006.stdout:2/965: creat d0/d13/d49/d60/d2b/d62/d79/f11e x:0 0 0 2024-03-12T16:11:00.352 INFO:tasks.workunit.client.0.smithi006.stdout:5/843: dwrite d7/d9/d47/fc1 [0,4194304] 0 2024-03-12T16:11:00.352 INFO:tasks.workunit.client.0.smithi006.stdout:0/964: dread d2/f1f [0,4194304] 0 2024-03-12T16:11:00.364 INFO:tasks.workunit.client.0.smithi006.stdout:4/949: mkdir d1/db/d39/dbf/dec/da8/d13a 0 2024-03-12T16:11:00.386 INFO:tasks.workunit.client.0.smithi006.stdout:2/966: write d0/d13/f44 [4105292,68125] 0 2024-03-12T16:11:00.392 INFO:tasks.workunit.client.0.smithi006.stdout:2/967: fdatasync d0/d13/f44 0 2024-03-12T16:11:00.397 INFO:tasks.workunit.client.0.smithi006.stdout:4/950: creat d1/db/d39/d42/df2/df7/f13b x:0 0 0 2024-03-12T16:11:00.450 INFO:tasks.workunit.client.0.smithi006.stdout:4/951: readlink d1/db/d1d/lad 0 2024-03-12T16:11:00.452 INFO:tasks.workunit.client.0.smithi006.stdout:4/952: chown d1/db/d1d/fbe 106730 1 2024-03-12T16:11:00.457 INFO:tasks.workunit.client.0.smithi006.stdout:4/953: rmdir d1/db/d39/dbf/dec/d10e 0 2024-03-12T16:11:00.475 INFO:tasks.workunit.client.0.smithi006.stdout:9/908: dwrite d0/d4/d3b/f3d [0,4194304] 0 2024-03-12T16:11:00.478 INFO:tasks.workunit.client.0.smithi006.stdout:6/889: write d3/d11/d10/f49 [1139087,94026] 0 2024-03-12T16:11:00.480 INFO:tasks.workunit.client.0.smithi006.stdout:6/890: symlink d3/d11/d10/d19/df6/l136 0 2024-03-12T16:11:00.485 INFO:tasks.workunit.client.0.smithi006.stdout:6/891: rename d3/c8 to d3/d11/d10/da7/dd5/ddb/de6/c137 0 2024-03-12T16:11:00.486 INFO:tasks.workunit.client.0.smithi006.stdout:6/892: stat d3/d11/d3b/db4/dc3 0 2024-03-12T16:11:00.487 INFO:tasks.workunit.client.0.smithi006.stdout:1/900: sync 2024-03-12T16:11:00.487 INFO:tasks.workunit.client.0.smithi006.stdout:6/893: readlink d3/d11/d3b/d59/lb2 0 2024-03-12T16:11:00.487 INFO:tasks.workunit.client.0.smithi006.stdout:8/791: sync 2024-03-12T16:11:00.490 INFO:tasks.workunit.client.0.smithi006.stdout:6/894: readlink d3/d11/d10/da7/d8e/de1/d60/l111 0 2024-03-12T16:11:00.491 INFO:tasks.workunit.client.0.smithi006.stdout:8/792: write d2/db/f24 [785647,36574] 0 2024-03-12T16:11:00.493 INFO:tasks.workunit.client.0.smithi006.stdout:1/901: symlink d0/d25/d67/dc1/d13b/l144 0 2024-03-12T16:11:00.495 INFO:tasks.workunit.client.0.smithi006.stdout:8/793: creat d2/db/d1a/d21/d2b/da2/dbc/ffd x:0 0 0 2024-03-12T16:11:00.496 INFO:tasks.workunit.client.0.smithi006.stdout:6/895: mknod d3/d11/d10/da7/d12c/c138 0 2024-03-12T16:11:00.498 INFO:tasks.workunit.client.0.smithi006.stdout:8/794: truncate d2/d11/f42 1569515 0 2024-03-12T16:11:00.498 INFO:tasks.workunit.client.0.smithi006.stdout:1/902: readlink d0/d25/db1/dd0/l131 0 2024-03-12T16:11:00.499 INFO:tasks.workunit.client.0.smithi006.stdout:0/965: write d2/d6/d10/d11/d32/f38 [3980472,120324] 0 2024-03-12T16:11:00.500 INFO:tasks.workunit.client.0.smithi006.stdout:8/795: chown d2/db/d1a/d7a/c92 565747 1 2024-03-12T16:11:00.502 INFO:tasks.workunit.client.0.smithi006.stdout:1/903: fsync d0/f3e 0 2024-03-12T16:11:00.504 INFO:tasks.workunit.client.0.smithi006.stdout:6/896: truncate d3/d11/d10/da7/d8e/d8b/de7/ff4 964963 0 2024-03-12T16:11:00.507 INFO:tasks.workunit.client.0.smithi006.stdout:1/904: mkdir d0/d25/d67/d145 0 2024-03-12T16:11:00.509 INFO:tasks.workunit.client.0.smithi006.stdout:0/966: dwrite d2/f74 [0,4194304] 0 2024-03-12T16:11:00.509 INFO:tasks.workunit.client.0.smithi006.stdout:0/967: chown d2 1793 1 2024-03-12T16:11:00.509 INFO:tasks.workunit.client.0.smithi006.stdout:0/968: stat d2/f1f 0 2024-03-12T16:11:00.512 INFO:tasks.workunit.client.0.smithi006.stdout:1/905: unlink d0/l20 0 2024-03-12T16:11:00.517 INFO:tasks.workunit.client.0.smithi006.stdout:8/796: getdents d2/db 0 2024-03-12T16:11:00.517 INFO:tasks.workunit.client.0.smithi006.stdout:0/969: mknod d2/d88/d129/d97/dbb/c142 0 2024-03-12T16:11:00.518 INFO:tasks.workunit.client.0.smithi006.stdout:0/970: stat d2/d6/d10/f1a 0 2024-03-12T16:11:00.520 INFO:tasks.workunit.client.0.smithi006.stdout:9/909: creat d0/d4/d3b/f132 x:0 0 0 2024-03-12T16:11:00.522 INFO:tasks.workunit.client.0.smithi006.stdout:0/971: readlink d2/d6/d10/d11/l1e 0 2024-03-12T16:11:00.524 INFO:tasks.workunit.client.0.smithi006.stdout:1/906: dwrite d0/d25/f2e [4194304,4194304] 0 2024-03-12T16:11:00.524 INFO:tasks.workunit.client.0.smithi006.stdout:4/954: creat d1/db/d39/dbf/f13c x:0 0 0 2024-03-12T16:11:00.528 INFO:tasks.workunit.client.0.smithi006.stdout:0/972: readlink d2/d6/d10/d11/d7e/da6/d9e/ld9 0 2024-03-12T16:11:00.529 INFO:tasks.workunit.client.0.smithi006.stdout:4/955: mknod d1/db/d39/d42/c13d 0 2024-03-12T16:11:00.532 INFO:tasks.workunit.client.0.smithi006.stdout:0/973: write d2/d39/f63 [113456,25492] 0 2024-03-12T16:11:00.535 INFO:tasks.workunit.client.0.smithi006.stdout:1/907: dwrite d0/d25/d67/dc1/ff9 [0,4194304] 0 2024-03-12T16:11:00.537 INFO:tasks.workunit.client.0.smithi006.stdout:3/828: mkdir d8/d19/d26/d11d 0 2024-03-12T16:11:00.540 INFO:tasks.workunit.client.0.smithi006.stdout:0/974: symlink d2/d39/dec/l143 0 2024-03-12T16:11:00.542 INFO:tasks.workunit.client.0.smithi006.stdout:8/797: rename d2/d11/d3f to d2/db/dfe 0 2024-03-12T16:11:00.544 INFO:tasks.workunit.client.0.smithi006.stdout:0/975: creat d2/d6/d10/d11/d7e/da6/f144 x:0 0 0 2024-03-12T16:11:00.549 INFO:tasks.workunit.client.0.smithi006.stdout:9/910: rename d0/d8/d16/d2f/lb3 to d0/d4/d18/d4d/l133 0 2024-03-12T16:11:00.556 INFO:tasks.workunit.client.0.smithi006.stdout:4/956: rename d1/ced to d1/db/d39/d42/df2/df7/c13e 0 2024-03-12T16:11:00.563 INFO:tasks.workunit.client.0.smithi006.stdout:6/897: mkdir d3/d11/d10/da7/d8e/d139 0 2024-03-12T16:11:00.564 INFO:tasks.workunit.client.0.smithi006.stdout:4/957: dwrite d1/db/d39/dbf/dec/d43/d132/f133 [0,4194304] 0 2024-03-12T16:11:00.567 INFO:tasks.workunit.client.0.smithi006.stdout:2/968: unlink d0/d13/d49/d60/fc4 0 2024-03-12T16:11:00.568 INFO:tasks.workunit.client.0.smithi006.stdout:2/969: dread - d0/d13/d49/d60/fde zero size 2024-03-12T16:11:00.570 INFO:tasks.workunit.client.0.smithi006.stdout:4/958: fsync d1/f31 0 2024-03-12T16:11:00.572 INFO:tasks.workunit.client.0.smithi006.stdout:6/898: mknod d3/d11/d10/da7/d8e/de1/d60/d7e/d131/c13a 0 2024-03-12T16:11:00.575 INFO:tasks.workunit.client.0.smithi006.stdout:1/908: rename d0/d25/l66 to d0/d25/d2a/d43/d63/d102/l146 0 2024-03-12T16:11:00.576 INFO:tasks.workunit.client.0.smithi006.stdout:2/970: chown d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/f103 332102 1 2024-03-12T16:11:00.578 INFO:tasks.workunit.client.0.smithi006.stdout:4/959: unlink d1/db/d39/dbf/dec/d5a/fe5 0 2024-03-12T16:11:00.583 INFO:tasks.workunit.client.0.smithi006.stdout:1/909: rename d0/d25/d2a/d43/d68/cc6 to d0/d25/d2a/d35/d11c/d12d/c147 0 2024-03-12T16:11:00.587 INFO:tasks.workunit.client.0.smithi006.stdout:6/899: creat d3/d11/d10/da7/d8e/de1/f13b x:0 0 0 2024-03-12T16:11:00.588 INFO:tasks.workunit.client.0.smithi006.stdout:6/900: stat d3/d11/d10/d1b/d6e/db1 0 2024-03-12T16:11:00.591 INFO:tasks.workunit.client.0.smithi006.stdout:4/960: link d1/db/d39/d42/fa1 d1/db/d39/dbf/dec/d43/dcc/f13f 0 2024-03-12T16:11:00.593 INFO:tasks.workunit.client.0.smithi006.stdout:6/901: truncate d3/d11/d10/d28/fb7 405839 0 2024-03-12T16:11:00.595 INFO:tasks.workunit.client.0.smithi006.stdout:2/971: dread d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/f103 [8388608,4194304] 0 2024-03-12T16:11:00.595 INFO:tasks.workunit.client.0.smithi006.stdout:2/972: stat d0/dc/d64/c6e 0 2024-03-12T16:11:00.598 INFO:tasks.workunit.client.0.smithi006.stdout:2/973: truncate d0/dc/fd 54484 0 2024-03-12T16:11:00.599 INFO:tasks.workunit.client.0.smithi006.stdout:3/829: write d8/f17 [250975,125687] 0 2024-03-12T16:11:00.605 INFO:tasks.workunit.client.0.smithi006.stdout:8/798: dread - d2/db/d1a/d21/d8a/ffb zero size 2024-03-12T16:11:00.605 INFO:tasks.workunit.client.0.smithi006.stdout:3/830: mkdir d8/ddc/df5/d11e 0 2024-03-12T16:11:00.607 INFO:tasks.workunit.client.0.smithi006.stdout:2/974: dwrite d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/f96 [0,4194304] 0 2024-03-12T16:11:00.608 INFO:tasks.workunit.client.0.smithi006.stdout:9/911: write d0/d8/fc3 [1476177,73295] 0 2024-03-12T16:11:00.609 INFO:tasks.workunit.client.0.smithi006.stdout:3/831: write d8/d19/dbc/f80 [1624016,3578] 0 2024-03-12T16:11:00.610 INFO:tasks.workunit.client.0.smithi006.stdout:8/799: unlink d2/db/d1a/c59 0 2024-03-12T16:11:00.613 INFO:tasks.workunit.client.0.smithi006.stdout:3/832: write d8/f8e [68548,98463] 0 2024-03-12T16:11:00.617 INFO:tasks.workunit.client.0.smithi006.stdout:9/912: dread d0/d8/d80/fd8 [0,4194304] 0 2024-03-12T16:11:00.620 INFO:tasks.workunit.client.0.smithi006.stdout:8/800: creat d2/db/d1a/d21/d2b/da2/fff x:0 0 0 2024-03-12T16:11:00.621 INFO:tasks.workunit.client.0.smithi006.stdout:2/975: fdatasync d0/d13/d49/d60/d2b/d62/d66/d69/d81/f99 0 2024-03-12T16:11:00.622 INFO:tasks.workunit.client.0.smithi006.stdout:2/976: write d0/dc/f1a [4722185,952] 0 2024-03-12T16:11:00.624 INFO:tasks.workunit.client.0.smithi006.stdout:9/913: symlink d0/d8/d80/l134 0 2024-03-12T16:11:00.625 INFO:tasks.workunit.client.0.smithi006.stdout:1/910: write d0/d25/d2a/d35/db3/f10c [2463291,117797] 0 2024-03-12T16:11:00.628 INFO:tasks.workunit.client.0.smithi006.stdout:4/961: write d1/db/d39/dbf/dec/d43/db5/f7a [534223,124355] 0 2024-03-12T16:11:00.631 INFO:tasks.workunit.client.0.smithi006.stdout:4/962: write d1/db/d39/d42/df2/df7/f12d [490026,103484] 0 2024-03-12T16:11:00.632 INFO:tasks.workunit.client.0.smithi006.stdout:2/977: truncate d0/f50 1896899 0 2024-03-12T16:11:00.632 INFO:tasks.workunit.client.0.smithi006.stdout:8/801: getdents d2/d55/d7b/df8 0 2024-03-12T16:11:00.634 INFO:tasks.workunit.client.0.smithi006.stdout:2/978: write d0/d13/d49/f73 [2073357,22166] 0 2024-03-12T16:11:00.635 INFO:tasks.workunit.client.0.smithi006.stdout:4/963: chown d1/db/d39/d42/d61/fc7 4 1 2024-03-12T16:11:00.636 INFO:tasks.workunit.client.0.smithi006.stdout:1/911: creat d0/d25/d2a/d43/d63/db6/dcb/f148 x:0 0 0 2024-03-12T16:11:00.637 INFO:tasks.workunit.client.0.smithi006.stdout:2/979: write d0/f4 [1381291,117957] 0 2024-03-12T16:11:00.640 INFO:tasks.workunit.client.0.smithi006.stdout:3/833: link d8/d4c/dd8/fd6 d8/d19/f11f 0 2024-03-12T16:11:00.641 INFO:tasks.workunit.client.0.smithi006.stdout:3/834: readlink d8/d19/d26/d59/d2c/d41/ld3 0 2024-03-12T16:11:00.650 INFO:tasks.workunit.client.0.smithi006.stdout:1/912: dwrite d0/d25/d2a/d43/f92 [0,4194304] 0 2024-03-12T16:11:00.652 INFO:tasks.workunit.client.0.smithi006.stdout:3/835: rmdir d8/d19/d26/d59/d2c/dc/d28/d2f/df6 39 2024-03-12T16:11:00.655 INFO:tasks.workunit.client.0.smithi006.stdout:4/964: mkdir d1/d38/d79/d140 0 2024-03-12T16:11:00.656 INFO:tasks.workunit.client.0.smithi006.stdout:2/980: creat d0/de7/f11f x:0 0 0 2024-03-12T16:11:00.657 INFO:tasks.workunit.client.0.smithi006.stdout:2/981: write d0/d13/d49/d60/fde [262823,90801] 0 2024-03-12T16:11:00.659 INFO:tasks.workunit.client.0.smithi006.stdout:8/802: creat d2/db/f100 x:0 0 0 2024-03-12T16:11:00.662 INFO:tasks.workunit.client.0.smithi006.stdout:3/836: creat d8/d52/dcf/f120 x:0 0 0 2024-03-12T16:11:00.663 INFO:tasks.workunit.client.0.smithi006.stdout:4/965: unlink d1/db/d39/dbf/dec/f25 0 2024-03-12T16:11:00.666 INFO:tasks.workunit.client.0.smithi006.stdout:9/914: getdents d0/d83/d90/dc0 0 2024-03-12T16:11:00.668 INFO:tasks.workunit.client.0.smithi006.stdout:2/982: dwrite d0/d13/d49/fc8 [0,4194304] 0 2024-03-12T16:11:00.668 INFO:tasks.workunit.client.0.smithi006.stdout:4/966: dread - d1/db/d39/dbf/dec/d5a/d60/f137 zero size 2024-03-12T16:11:00.669 INFO:tasks.workunit.client.0.smithi006.stdout:3/837: unlink d8/d19/d26/d97/c6d 0 2024-03-12T16:11:00.672 INFO:tasks.workunit.client.0.smithi006.stdout:8/803: fdatasync d2/db/d1a/d23/f91 0 2024-03-12T16:11:00.673 INFO:tasks.workunit.client.0.smithi006.stdout:4/967: mknod d1/c141 0 2024-03-12T16:11:00.676 INFO:tasks.workunit.client.0.smithi006.stdout:2/983: dread d0/d13/d49/fc8 [0,4194304] 0 2024-03-12T16:11:00.677 INFO:tasks.workunit.client.0.smithi006.stdout:3/838: mknod d8/d19/d26/d59/d2c/d41/d8b/d93/c121 0 2024-03-12T16:11:00.678 INFO:tasks.workunit.client.0.smithi006.stdout:2/984: write d0/d13/d49/d60/fa7 [18695,89571] 0 2024-03-12T16:11:00.688 INFO:tasks.workunit.client.0.smithi006.stdout:4/968: symlink d1/db/d39/dbf/dec/d5a/d60/l142 0 2024-03-12T16:11:00.688 INFO:tasks.workunit.client.0.smithi006.stdout:1/913: dwrite d0/d25/d2a/d43/d63/fa6 [0,4194304] 0 2024-03-12T16:11:00.688 INFO:tasks.workunit.client.0.smithi006.stdout:3/839: dread - d8/d19/d26/d59/d2c/fcd zero size 2024-03-12T16:11:00.689 INFO:tasks.workunit.client.0.smithi006.stdout:9/915: link d0/d8/d16/d7d/d20/f112 d0/d8/d16/d7d/d20/d37/dc5/dcf/f135 0 2024-03-12T16:11:00.691 INFO:tasks.workunit.client.0.smithi006.stdout:2/985: read d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/f103 [805427,112297] 0 2024-03-12T16:11:00.691 INFO:tasks.workunit.client.0.smithi006.stdout:9/916: write d0/d4/d70/da6/ff1 [401535,17302] 0 2024-03-12T16:11:00.695 INFO:tasks.workunit.client.0.smithi006.stdout:2/986: fdatasync d0/d13/d49/d60/d2b/d62/d66/d67/ffb 0 2024-03-12T16:11:00.699 INFO:tasks.workunit.client.0.smithi006.stdout:4/969: creat d1/db/d39/dbf/dec/da8/f143 x:0 0 0 2024-03-12T16:11:00.704 INFO:tasks.workunit.client.0.smithi006.stdout:3/840: mknod d8/d19/d26/d59/d2c/dc/d28/d2f/d9d/c122 0 2024-03-12T16:11:00.704 INFO:tasks.workunit.client.0.smithi006.stdout:1/914: creat d0/d25/d2a/d43/d68/d111/f149 x:0 0 0 2024-03-12T16:11:00.705 INFO:tasks.workunit.client.0.smithi006.stdout:9/917: creat d0/d8/d16/d2f/dd5/f136 x:0 0 0 2024-03-12T16:11:00.706 INFO:tasks.workunit.client.0.smithi006.stdout:2/987: mknod d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/dec/c120 0 2024-03-12T16:11:00.708 INFO:tasks.workunit.client.0.smithi006.stdout:9/918: fdatasync d0/d4/d18/f10c 0 2024-03-12T16:11:00.708 INFO:tasks.workunit.client.0.smithi006.stdout:8/804: dwrite d2/db/d1a/d1f/f3c [0,4194304] 0 2024-03-12T16:11:00.710 INFO:tasks.workunit.client.0.smithi006.stdout:9/919: write d0/d4/da7/fc2 [937677,13311] 0 2024-03-12T16:11:00.710 INFO:tasks.workunit.client.0.smithi006.stdout:8/805: chown d2/db/d1a/f78 1841 1 2024-03-12T16:11:00.718 INFO:tasks.workunit.client.0.smithi006.stdout:1/915: write d0/d25/d2a/d43/f44 [4973969,109941] 0 2024-03-12T16:11:00.719 INFO:tasks.workunit.client.0.smithi006.stdout:9/920: mkdir d0/d8/d16/d7d/d20/d37/dc5/dcf/d137 0 2024-03-12T16:11:00.720 INFO:tasks.workunit.client.0.smithi006.stdout:8/806: dread - d2/dab/fc5 zero size 2024-03-12T16:11:00.721 INFO:tasks.workunit.client.0.smithi006.stdout:1/916: write d0/d25/d2a/d43/d63/df1/f118 [1038077,98772] 0 2024-03-12T16:11:00.724 INFO:tasks.workunit.client.0.smithi006.stdout:9/921: read d0/d8/d16/f116 [85863,54012] 0 2024-03-12T16:11:00.724 INFO:tasks.workunit.client.0.smithi006.stdout:3/841: getdents d8/d4c 0 2024-03-12T16:11:00.725 INFO:tasks.workunit.client.0.smithi006.stdout:2/988: link d0/d13/d49/d60/d105/c10f d0/dc/de0/def/c121 0 2024-03-12T16:11:00.726 INFO:tasks.workunit.client.0.smithi006.stdout:8/807: symlink d2/db/d1a/d1f/l101 0 2024-03-12T16:11:00.729 INFO:tasks.workunit.client.0.smithi006.stdout:1/917: creat d0/d25/d2a/d43/d56/f14a x:0 0 0 2024-03-12T16:11:00.729 INFO:tasks.workunit.client.0.smithi006.stdout:3/842: chown d8/d19/d26/d59/d2c/f10 7092 1 2024-03-12T16:11:00.731 INFO:tasks.workunit.client.0.smithi006.stdout:4/970: dwrite d1/db/d39/dbf/dec/f85 [0,4194304] 0 2024-03-12T16:11:00.731 INFO:tasks.workunit.client.0.smithi006.stdout:9/922: symlink d0/d4/d70/da6/l138 0 2024-03-12T16:11:00.731 INFO:tasks.workunit.client.0.smithi006.stdout:1/918: chown d0/d25/d2a/d43/f112 668387248 1 2024-03-12T16:11:00.736 INFO:tasks.workunit.client.0.smithi006.stdout:2/989: symlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/da8/dbb/l122 0 2024-03-12T16:11:00.737 INFO:tasks.workunit.client.0.smithi006.stdout:9/923: fdatasync d0/d4/d18/d4d/fd0 0 2024-03-12T16:11:00.739 INFO:tasks.workunit.client.0.smithi006.stdout:9/924: chown d0/d4/d70/fe0 0 1 2024-03-12T16:11:00.740 INFO:tasks.workunit.client.0.smithi006.stdout:9/925: chown d0/d8/fc3 29 1 2024-03-12T16:11:00.741 INFO:tasks.workunit.client.0.smithi006.stdout:1/919: creat d0/d25/d2a/d43/dd1/df2/f14b x:0 0 0 2024-03-12T16:11:00.742 INFO:tasks.workunit.client.0.smithi006.stdout:1/920: chown d0/d10d 424 1 2024-03-12T16:11:00.743 INFO:tasks.workunit.client.0.smithi006.stdout:4/971: creat d1/db/d39/f144 x:0 0 0 2024-03-12T16:11:00.745 INFO:tasks.workunit.client.0.smithi006.stdout:2/990: unlink d0/d13/d49/d60/d2b/d62/d66/d69/d81/d83/d84/d77/fb8 0 2024-03-12T16:11:00.745 INFO:tasks.workunit.client.0.smithi006.stdout:8/808: dread d2/d55/f71 [0,4194304] 0 2024-03-12T16:11:00.746 INFO:tasks.workunit.client.0.smithi006.stdout:9/926: rmdir d0/d4/d3b/d6a 39 2024-03-12T16:11:00.750 INFO:tasks.workunit.client.0.smithi006.stdout:1/921: truncate d0/d25/f40 3660627 0 2024-03-12T16:11:00.753 INFO:tasks.workunit.client.0.smithi006.stdout:8/809: creat d2/d55/d7b/f102 x:0 0 0 2024-03-12T16:11:00.755 INFO:tasks.workunit.client.0.smithi006.stdout:8/810: readlink d2/db/d1a/l22 0 2024-03-12T16:11:00.755 INFO:tasks.workunit.client.0.smithi006.stdout:3/843: creat d8/d19/d26/d59/d2c/d41/da1/d116/f123 x:0 0 0 2024-03-12T16:11:00.757 INFO:tasks.workunit.client.0.smithi006.stdout:9/927: unlink d0/d8/d16/ce8 0 2024-03-12T16:11:00.757 INFO:tasks.workunit.client.0.smithi006.stdout:1/922: dwrite d0/d25/d67/db0/fcc [0,4194304] 0 2024-03-12T16:11:00.759 INFO:tasks.workunit.client.0.smithi006.stdout:1/923: write d0/fb [8918439,9106] 0 2024-03-12T16:11:00.760 INFO:tasks.workunit.client.0.smithi006.stdout:2/991: mknod d0/d13/d49/c123 0 2024-03-12T16:11:00.761 INFO:tasks.workunit.client.0.smithi006.stdout:1/924: chown d0/l76 2312 1 2024-03-12T16:11:00.764 INFO:tasks.workunit.client.0.smithi006.stdout:8/811: fdatasync d2/db/fb1 0 2024-03-12T16:11:00.765 INFO:tasks.workunit.client.0.smithi006.stdout:8/812: chown d2/fc3 7655 1 2024-03-12T16:11:00.765 INFO:tasks.workunit.client.0.smithi006.stdout:9/928: link d0/f28 d0/d4/d9b/f139 0 2024-03-12T16:11:00.771 INFO:tasks.workunit.client.0.smithi006.stdout:8/813: mkdir d2/d11/d5a/d103 0 2024-03-12T16:11:00.773 INFO:tasks.workunit.client.0.smithi006.stdout:1/925: creat d0/d25/db1/dd0/d10b/d138/f14c x:0 0 0 2024-03-12T16:11:00.779 INFO:tasks.workunit.client.0.smithi006.stdout:8/814: chown d2/db/dfe/cd5 3633184 1 2024-03-12T16:11:00.779 INFO:tasks.workunit.client.0.smithi006.stdout:4/972: dwrite d1/db/d39/dbf/dec/d43/dcc/f13f [0,4194304] 0 2024-03-12T16:11:00.779 INFO:tasks.workunit.client.0.smithi006.stdout:1/926: mkdir d0/d25/d2a/d35/db3/d14d 0 2024-03-12T16:11:00.782 INFO:tasks.workunit.client.0.smithi006.stdout:1/927: chown d0/d25/d2a/d43/d68/dd2 6141 1 2024-03-12T16:11:00.785 INFO:tasks.workunit.client.0.smithi006.stdout:2/992: link d0/d13/d49/d60/d105/c10f d0/d13/d49/d60/c124 0 2024-03-12T16:11:00.785 INFO:tasks.workunit.client.0.smithi006.stdout:9/929: dread d0/d83/d90/f9a [0,4194304] 0 2024-03-12T16:11:00.790 INFO:tasks.workunit.client.0.smithi006.stdout:8/815: dwrite d2/fc3 [0,4194304] 0 2024-03-12T16:11:00.792 INFO:tasks.workunit.client.0.smithi006.stdout:9/930: readlink d0/d4/d18/d4d/l78 0 2024-03-12T16:11:00.795 INFO:tasks.workunit.client.0.smithi006.stdout:8/816: stat d2/db/d1a/d21/d4f/fca 0 2024-03-12T16:11:00.795 INFO:tasks.workunit.client.0.smithi006.stdout:9/931: write d0/d8/d16/d7d/d20/d37/dc5/fec [346263,130394] 0 2024-03-12T16:11:00.797 INFO:tasks.workunit.client.0.smithi006.stdout:1/928: link d0/d25/d2a/d43/d63/db6/dcb/f148 d0/d25/db1/dd0/f14e 0 2024-03-12T16:11:00.797 INFO:tasks.workunit.client.0.smithi006.stdout:9/932: readlink d0/d8/d16/d2f/lb9 0 2024-03-12T16:11:00.797 INFO:tasks.workunit.client.0.smithi006.stdout:4/973: getdents d1/db/d1d/d10b 0 2024-03-12T16:11:00.798 INFO:tasks.workunit.client.0.smithi006.stdout:2/993: write d0/d13/d49/d60/fd0 [711942,36052] 0 2024-03-12T16:11:00.802 INFO:tasks.workunit.client.0.smithi006.stdout:1/929: mkdir d0/d25/d67/dc1/d13b/d14f 0 2024-03-12T16:11:00.804 INFO:tasks.workunit.client.0.smithi006.stdout:8/817: link d2/f16 d2/db/d1a/d7a/dcc/f104 0 2024-03-12T16:11:00.805 INFO:tasks.workunit.client.0.smithi006.stdout:9/933: creat d0/d8/d16/dee/f13a x:0 0 0 2024-03-12T16:11:00.808 INFO:tasks.workunit.client.0.smithi006.stdout:9/934: readlink d0/d4/d3b/d6a/l9e 0 2024-03-12T16:11:00.813 INFO:tasks.workunit.client.0.smithi006.stdout:8/818: rename d2/d55/fa6 to d2/db/d1a/d1f/f105 0 2024-03-12T16:11:00.814 INFO:tasks.workunit.client.0.smithi006.stdout:8/819: write d2/db/d1a/d7a/fde [2552013,63308] 0 2024-03-12T16:11:00.816 INFO:tasks.workunit.client.0.smithi006.stdout:9/935: mkdir d0/d4/d3b/dff/d13b 0 2024-03-12T16:11:00.818 INFO:tasks.workunit.client.0.smithi006.stdout:4/974: link d1/d38/d79/cd5 d1/db/d39/dbf/dec/d43/dcc/c145 0 2024-03-12T16:11:00.818 INFO:tasks.workunit.client.0.smithi006.stdout:2/994: write d0/d13/d49/d60/d2b/d62/d66/d69/d81/f99 [2978426,77380] 0 2024-03-12T16:11:00.820 INFO:tasks.workunit.client.0.smithi006.stdout:1/930: truncate d0/d25/f36 3785977 0 2024-03-12T16:11:00.825 INFO:tasks.workunit.client.0.smithi006.stdout:2/995: write d0/d13/d49/d60/fde [1301368,8719] 0 2024-03-12T16:11:00.827 INFO:tasks.workunit.client.0.smithi006.stdout:8/820: dwrite d2/db/d1a/d21/dad/d7c/fc8 [0,4194304] 0 2024-03-12T16:11:00.829 INFO:tasks.workunit.client.0.smithi006.stdout:1/931: write d0/f3e [4041837,58343] 0 2024-03-12T16:11:00.834 INFO:tasks.workunit.client.0.smithi006.stdout:4/975: rename d1/db/d39/d42/d61/l71 to d1/db/d39/dbf/dec/d43/dcc/l146 0 2024-03-12T16:11:00.835 INFO:tasks.workunit.client.0.smithi006.stdout:9/936: dread d0/d4/d18/d4d/f75 [0,4194304] 0 2024-03-12T16:11:00.836 INFO:tasks.workunit.client.0.smithi006.stdout:2/996: creat d0/d13/f125 x:0 0 0 2024-03-12T16:11:00.837 INFO:tasks.workunit.client.0.smithi006.stdout:9/937: dread - d0/d8/d16/d7d/f108 zero size 2024-03-12T16:11:00.839 INFO:tasks.workunit.client.0.smithi006.stdout:1/932: rmdir d0/d25/d2a/d43/d63 39 2024-03-12T16:11:00.841 INFO:tasks.workunit.client.0.smithi006.stdout:2/997: dread - d0/d13/d49/d60/d2b/d62/d66/d69/d81/d89/daf/fba zero size 2024-03-12T16:11:00.841 INFO:tasks.workunit.client.0.smithi006.stdout:4/976: mknod d1/db/d39/d42/d61/c147 0 2024-03-12T16:11:00.842 INFO:tasks.workunit.client.0.smithi006.stdout:1/933: creat d0/d25/d67/d10a/f150 x:0 0 0 2024-03-12T16:11:00.843 INFO:tasks.workunit.client.0.smithi006.stdout:4/977: chown d1/db/d1d/d2f/d6b/fa7 6667658 1 2024-03-12T16:11:00.844 INFO:tasks.workunit.client.0.smithi006.stdout:1/934: write d0/d25/f2e [4525860,54131] 0 2024-03-12T16:11:00.846 INFO:tasks.workunit.client.0.smithi006.stdout:4/978: chown d1/db/d1d/d2f/d6b 175685279 1 2024-03-12T16:11:00.848 INFO:tasks.workunit.client.0.smithi006.stdout:2/998: rename d0/d13/d49/d60/d2b/d62/d66/d69/l7d to d0/d13/d49/d60/d105/l126 0 2024-03-12T16:11:00.848 INFO:tasks.workunit.client.0.smithi006.stdout:4/979: fsync d1/db/d39/dbf/dec/d5a/fca 0 2024-03-12T16:11:00.850 INFO:tasks.workunit.client.0.smithi006.stdout:1/935: readlink d0/d25/d2a/d43/d63/db6/lc9 0 2024-03-12T16:11:00.852 INFO:tasks.workunit.client.0.smithi006.stdout:2/999: mknod d0/d13/d49/dc1/c127 0 2024-03-12T16:11:00.853 INFO:tasks.workunit.client.0.smithi006.stdout:1/936: mknod d0/d25/d2a/d43/de0/c151 0 2024-03-12T16:11:00.856 INFO:tasks.workunit.client.0.smithi006.stdout:4/980: link d1/db/d39/dbf/dec/c90 d1/db/d39/d42/c148 0 2024-03-12T16:11:00.857 INFO:tasks.workunit.client.0.smithi006.stdout:8/821: dread d2/db/d1a/d21/dad/d7c/f7e [0,4194304] 0 2024-03-12T16:11:00.860 INFO:tasks.workunit.client.0.smithi006.stdout:1/937: getdents d0/d25/d2a 0 2024-03-12T16:11:00.860 INFO:tasks.workunit.client.0.smithi006.stdout:4/981: symlink d1/db/d39/d42/l149 0 2024-03-12T16:11:00.861 INFO:tasks.workunit.client.0.smithi006.stdout:1/938: chown d0/l7f 1630235 1 2024-03-12T16:11:00.862 INFO:tasks.workunit.client.0.smithi006.stdout:9/938: dread d0/d8/d16/d7d/d20/f34 [0,4194304] 0 2024-03-12T16:11:00.862 INFO:tasks.workunit.client.0.smithi006.stdout:4/982: creat d1/d91/f14a x:0 0 0 2024-03-12T16:11:00.864 INFO:tasks.workunit.client.0.smithi006.stdout:8/822: rmdir d2/d55/d7b/df8 0 2024-03-12T16:11:00.866 INFO:tasks.workunit.client.0.smithi006.stdout:9/939: mkdir d0/d4/d70/d71/dde/d13c 0 2024-03-12T16:11:00.866 INFO:tasks.workunit.client.0.smithi006.stdout:8/823: dread - d2/d11/d5a/fe7 zero size 2024-03-12T16:11:00.866 INFO:tasks.workunit.client.0.smithi006.stdout:4/983: symlink d1/db/d39/dbf/dec/da8/d13a/l14b 0 2024-03-12T16:11:00.869 INFO:tasks.workunit.client.0.smithi006.stdout:9/940: fsync d0/d4/d70/d71/f131 0 2024-03-12T16:11:00.869 INFO:tasks.workunit.client.0.smithi006.stdout:8/824: write d2/d11/fdf [585036,101902] 0 2024-03-12T16:11:00.870 INFO:tasks.workunit.client.0.smithi006.stdout:9/941: chown d0/d4/da7 72438 1 2024-03-12T16:11:00.871 INFO:tasks.workunit.client.0.smithi006.stdout:4/984: write d1/db/d1d/d2f/f36 [985760,70668] 0 2024-03-12T16:11:00.871 INFO:tasks.workunit.client.0.smithi006.stdout:1/939: dwrite d0/d25/d2a/d35/db3/f141 [0,4194304] 0 2024-03-12T16:11:00.873 INFO:tasks.workunit.client.0.smithi006.stdout:8/825: fsync d2/db/d1a/d21/d2b/da2/fc1 0 2024-03-12T16:11:00.878 INFO:tasks.workunit.client.0.smithi006.stdout:5/844: sync 2024-03-12T16:11:00.879 INFO:tasks.workunit.client.0.smithi006.stdout:4/985: truncate d1/db/d39/dbf/fdb 5133181 0 2024-03-12T16:11:00.885 INFO:tasks.workunit.client.0.smithi006.stdout:9/942: link d0/d4/f113 d0/d83/d90/dc0/f13d 0 2024-03-12T16:11:00.886 INFO:tasks.workunit.client.0.smithi006.stdout:8/826: mknod d2/db/d1a/d23/c106 0 2024-03-12T16:11:00.890 INFO:tasks.workunit.client.0.smithi006.stdout:9/943: creat d0/d4/d70/d71/dde/f13e x:0 0 0 2024-03-12T16:11:00.891 INFO:tasks.workunit.client.0.smithi006.stdout:1/940: rmdir d0/d25/d2a/d43/d63/db6/d133/d13a 0 2024-03-12T16:11:00.892 INFO:tasks.workunit.client.0.smithi006.stdout:1/941: fdatasync d0/d25/d2a/d43/d63/f107 0 2024-03-12T16:11:00.895 INFO:tasks.workunit.client.0.smithi006.stdout:8/827: mkdir d2/d107 0 2024-03-12T16:11:00.895 INFO:tasks.workunit.client.0.smithi006.stdout:4/986: write d1/db/d1d/f87 [3650469,75001] 0 2024-03-12T16:11:00.897 INFO:tasks.workunit.client.0.smithi006.stdout:9/944: truncate d0/d83/f92 9811 0 2024-03-12T16:11:00.899 INFO:tasks.workunit.client.0.smithi006.stdout:5/845: getdents d7/d9/d31/d3b/dba 0 2024-03-12T16:11:00.900 INFO:tasks.workunit.client.0.smithi006.stdout:1/942: symlink d0/d25/d2a/d43/d56/dd8/l152 0 2024-03-12T16:11:00.902 INFO:tasks.workunit.client.0.smithi006.stdout:9/945: unlink d0/d4/d70/lbd 0 2024-03-12T16:11:00.904 INFO:tasks.workunit.client.0.smithi006.stdout:8/828: rename d2/db/d1a/d1f/l44 to d2/d55/d7b/db8/l108 0 2024-03-12T16:11:00.909 INFO:tasks.workunit.client.0.smithi006.stdout:4/987: dwrite d1/db/d39/d42/d61/f125 [0,4194304] 0 2024-03-12T16:11:00.909 INFO:tasks.workunit.client.0.smithi006.stdout:8/829: fdatasync d2/d11/d5a/fc2 0 2024-03-12T16:11:00.912 INFO:tasks.workunit.client.0.smithi006.stdout:5/846: creat d7/f118 x:0 0 0 2024-03-12T16:11:00.913 INFO:tasks.workunit.client.0.smithi006.stdout:5/847: fdatasync d7/d8/d8a/d92/fdf 0 2024-03-12T16:11:00.923 INFO:tasks.workunit.client.0.smithi006.stdout:9/946: truncate d0/d4/d3b/f3d 6802828 0 2024-03-12T16:11:00.923 INFO:tasks.workunit.client.0.smithi006.stdout:8/830: symlink d2/db/d1a/d23/l109 0 2024-03-12T16:11:00.923 INFO:tasks.workunit.client.0.smithi006.stdout:1/943: dread d0/d25/d2a/f71 [0,4194304] 0 2024-03-12T16:11:00.924 INFO:tasks.workunit.client.0.smithi006.stdout:4/988: creat d1/db/d39/d42/d61/f14c x:0 0 0 2024-03-12T16:11:00.925 INFO:tasks.workunit.client.0.smithi006.stdout:9/947: creat d0/d8f/dc6/f13f x:0 0 0 2024-03-12T16:11:00.928 INFO:tasks.workunit.client.0.smithi006.stdout:1/944: unlink d0/d25/d2a/d35/d3f/le3 0 2024-03-12T16:11:00.929 INFO:tasks.workunit.client.0.smithi006.stdout:5/848: getdents d7/d9/d31/d3b/d6b 0 2024-03-12T16:11:00.930 INFO:tasks.workunit.client.0.smithi006.stdout:5/849: read - d7/d8/d91/f110 zero size 2024-03-12T16:11:00.936 INFO:tasks.workunit.client.0.smithi006.stdout:8/831: creat d2/db/f10a x:0 0 0 2024-03-12T16:11:00.938 INFO:tasks.workunit.client.0.smithi006.stdout:5/850: dread d7/d41/fd9 [0,4194304] 0 2024-03-12T16:11:00.939 INFO:tasks.workunit.client.0.smithi006.stdout:8/832: read d2/db/d1a/d21/d8a/fa1 [3642239,68033] 0 2024-03-12T16:11:00.942 INFO:tasks.workunit.client.0.smithi006.stdout:5/851: creat d7/d9/d10/d24/d89/f119 x:0 0 0 2024-03-12T16:11:00.949 INFO:tasks.workunit.client.0.smithi006.stdout:9/948: dwrite d0/d8/d16/f31 [0,4194304] 0 2024-03-12T16:11:00.950 INFO:tasks.workunit.client.0.smithi006.stdout:8/833: write d2/db/d1a/d1f/fb0 [215938,25426] 0 2024-03-12T16:11:00.953 INFO:tasks.workunit.client.0.smithi006.stdout:1/945: dwrite d0/d25/d67/feb [0,4194304] 0 2024-03-12T16:11:00.956 INFO:tasks.workunit.client.0.smithi006.stdout:8/834: dread - d2/db/d1a/d21/dad/fe9 zero size 2024-03-12T16:11:00.959 INFO:tasks.workunit.client.0.smithi006.stdout:5/852: unlink d7/d9/d31/d3b/d4f/d65/f74 0 2024-03-12T16:11:00.962 INFO:tasks.workunit.client.0.smithi006.stdout:1/946: dread - d0/d25/d2a/d43/d56/dd8/ff6 zero size 2024-03-12T16:11:00.962 INFO:tasks.workunit.client.0.smithi006.stdout:8/835: fsync d2/d55/d7b/f83 0 2024-03-12T16:11:00.965 INFO:tasks.workunit.client.0.smithi006.stdout:4/989: dwrite d1/db/d39/dbf/dec/d43/db5/f72 [0,4194304] 0 2024-03-12T16:11:00.966 INFO:tasks.workunit.client.0.smithi006.stdout:8/836: readlink d2/d55/l81 0 2024-03-12T16:11:00.969 INFO:tasks.workunit.client.0.smithi006.stdout:9/949: dwrite d0/d4/d3b/d6a/f118 [0,4194304] 0 2024-03-12T16:11:00.970 INFO:tasks.workunit.client.0.smithi006.stdout:1/947: mknod d0/d25/d2a/d43/d56/c153 0 2024-03-12T16:11:00.972 INFO:tasks.workunit.client.0.smithi006.stdout:9/950: chown d0/d4/d3b/dff/f111 178182 1 2024-03-12T16:11:00.973 INFO:tasks.workunit.client.0.smithi006.stdout:1/948: write d0/f13 [1672065,53357] 0 2024-03-12T16:11:00.974 INFO:tasks.workunit.client.0.smithi006.stdout:1/949: stat d0/f13 0 2024-03-12T16:11:00.974 INFO:tasks.workunit.client.0.smithi006.stdout:8/837: rename d2/d32/fb7 to d2/db/dfe/f10b 0 2024-03-12T16:11:00.977 INFO:tasks.workunit.client.0.smithi006.stdout:4/990: chown d1/db/d39/dbf/dec/d43/d132/c129 0 1 2024-03-12T16:11:00.978 INFO:tasks.workunit.client.0.smithi006.stdout:4/991: stat d1/db/d1d/c103 0 2024-03-12T16:11:00.980 INFO:tasks.workunit.client.0.smithi006.stdout:0/976: sync 2024-03-12T16:11:00.980 INFO:tasks.workunit.client.0.smithi006.stdout:6/902: sync 2024-03-12T16:11:00.982 INFO:tasks.workunit.client.0.smithi006.stdout:9/951: rename d0/d4/d70/d71/l8d to d0/d4/d3b/dff/d13b/l140 0 2024-03-12T16:11:00.983 INFO:tasks.workunit.client.0.smithi006.stdout:8/838: creat d2/db/d1a/d21/dad/d7c/f10c x:0 0 0 2024-03-12T16:11:00.985 INFO:tasks.workunit.client.0.smithi006.stdout:4/992: rmdir d1/db/d39/d42/d61 39 2024-03-12T16:11:00.986 INFO:tasks.workunit.client.0.smithi006.stdout:1/950: mknod d0/d25/d67/d145/c154 0 2024-03-12T16:11:00.992 INFO:tasks.workunit.client.0.smithi006.stdout:6/903: link d3/d11/d43/dd1/f120 d3/d11/d10/da7/dd5/ddb/de6/f13c 0 2024-03-12T16:11:00.993 INFO:tasks.workunit.client.0.smithi006.stdout:6/904: readlink d3/d11/d10/da7/d8e/de1/d60/l111 0 2024-03-12T16:11:00.995 INFO:tasks.workunit.client.0.smithi006.stdout:1/951: mkdir d0/d10d/d155 0 2024-03-12T16:11:00.997 INFO:tasks.workunit.client.0.smithi006.stdout:0/977: creat d2/d6/d10/f145 x:0 0 0 2024-03-12T16:11:00.998 INFO:tasks.workunit.client.0.smithi006.stdout:5/853: dread d7/d9/d10/fae [0,4194304] 0 2024-03-12T16:11:00.998 INFO:tasks.workunit.client.0.smithi006.stdout:9/952: link d0/lf7 d0/d8/d16/d7d/d20/d37/dc5/l141 0 2024-03-12T16:11:01.000 INFO:tasks.workunit.client.0.smithi006.stdout:6/905: rmdir d3/d11/d3b/db4/dc3 39 2024-03-12T16:11:01.002 INFO:tasks.workunit.client.0.smithi006.stdout:5/854: dread - d7/d9/d31/d3b/dba/f112 zero size 2024-03-12T16:11:01.003 INFO:tasks.workunit.client.0.smithi006.stdout:6/906: stat d3/d11/d10/da7/d8e/de1/d60/d108/d12d/f4c 0 2024-03-12T16:11:01.006 INFO:tasks.workunit.client.0.smithi006.stdout:1/952: creat d0/d25/d2a/d43/d63/db6/dcb/f156 x:0 0 0 2024-03-12T16:11:01.010 INFO:tasks.workunit.client.0.smithi006.stdout:9/953: creat d0/d8/d80/f142 x:0 0 0 2024-03-12T16:11:01.012 INFO:tasks.workunit.client.0.smithi006.stdout:5/855: symlink d7/d9/d31/d3b/d4f/d9e/l11a 0 2024-03-12T16:11:01.014 INFO:tasks.workunit.client.0.smithi006.stdout:6/907: unlink d3/d11/d10/da7/c93 0 2024-03-12T16:11:01.016 INFO:tasks.workunit.client.0.smithi006.stdout:1/953: dread d0/d25/d2a/d35/ffd [0,4194304] 0 2024-03-12T16:11:01.017 INFO:tasks.workunit.client.0.smithi006.stdout:0/978: dread d2/d6/d10/d11/d7e/da6/f9d [0,4194304] 0 2024-03-12T16:11:01.017 INFO:tasks.workunit.client.0.smithi006.stdout:4/993: truncate d1/d38/d79/fe8 3057356 0 2024-03-12T16:11:01.017 INFO:tasks.workunit.client.0.smithi006.stdout:5/856: dread - d7/d9/d31/d3b/d4f/d65/de1/ff0 zero size 2024-03-12T16:11:01.019 INFO:tasks.workunit.client.0.smithi006.stdout:8/839: dwrite d2/db/f13 [4194304,4194304] 0 2024-03-12T16:11:01.019 INFO:tasks.workunit.client.0.smithi006.stdout:9/954: chown d0/d4/d70/d86/f63 1808522 1 2024-03-12T16:11:01.020 INFO:tasks.workunit.client.0.smithi006.stdout:1/954: mkdir d0/d157 0 2024-03-12T16:11:01.022 INFO:tasks.workunit.client.0.smithi006.stdout:5/857: write d7/d9/d31/fe9 [621925,69704] 0 2024-03-12T16:11:01.022 INFO:tasks.workunit.client.0.smithi006.stdout:0/979: chown d2/d6/d10/d11/d1d/d2e/f33 2 1 2024-03-12T16:11:01.024 INFO:tasks.workunit.client.0.smithi006.stdout:0/980: stat d2/d88/d103 0 2024-03-12T16:11:01.024 INFO:tasks.workunit.client.0.smithi006.stdout:6/908: fsync d3/d11/d10/d28/fb7 0 2024-03-12T16:11:01.025 INFO:tasks.workunit.client.0.smithi006.stdout:9/955: mkdir d0/d8/d16/d2f/dd5/d143 0 2024-03-12T16:11:01.028 INFO:tasks.workunit.client.0.smithi006.stdout:4/994: rename d1/ld to d1/db/d39/dbf/dec/d5a/d60/l14d 0 2024-03-12T16:11:01.031 INFO:tasks.workunit.client.0.smithi006.stdout:8/840: chown d2/db/fb1 1918919 1 2024-03-12T16:11:01.031 INFO:tasks.workunit.client.0.smithi006.stdout:5/858: creat d7/d9/d10/d35/f11b x:0 0 0 2024-03-12T16:11:01.031 INFO:tasks.workunit.client.0.smithi006.stdout:1/955: dread - d0/d25/d2a/d43/de0/f115 zero size 2024-03-12T16:11:01.032 INFO:tasks.workunit.client.0.smithi006.stdout:0/981: mkdir d2/d88/d129/d100/d146 0 2024-03-12T16:11:01.033 INFO:tasks.workunit.client.0.smithi006.stdout:5/859: fsync d7/d8/f14 0 2024-03-12T16:11:01.036 INFO:tasks.workunit.client.0.smithi006.stdout:9/956: rename d0/d83/d90/dc0/f13d to d0/d8/d16/d7d/f144 0 2024-03-12T16:11:01.038 INFO:tasks.workunit.client.0.smithi006.stdout:9/957: stat d0/d83/d90/lef 0 2024-03-12T16:11:01.038 INFO:tasks.workunit.client.0.smithi006.stdout:6/909: dwrite d3/d11/d10/d1b/d6e/db1/fb5 [0,4194304] 0 2024-03-12T16:11:01.039 INFO:tasks.workunit.client.0.smithi006.stdout:9/958: chown d0/d83/d90 252629612 1 2024-03-12T16:11:01.042 INFO:tasks.workunit.client.0.smithi006.stdout:4/995: chown d1/db/d39/d42/d61/ce1 20620 1 2024-03-12T16:11:01.042 INFO:tasks.workunit.client.0.smithi006.stdout:6/910: read d3/d11/d10/f49 [375778,44079] 0 2024-03-12T16:11:01.044 INFO:tasks.workunit.client.0.smithi006.stdout:0/982: mknod d2/d88/d129/c147 0 2024-03-12T16:11:01.045 INFO:tasks.workunit.client.0.smithi006.stdout:1/956: symlink d0/d25/d67/dc1/d13b/l158 0 2024-03-12T16:11:01.047 INFO:tasks.workunit.client.0.smithi006.stdout:1/957: dread - d0/d25/d2a/d43/de0/f115 zero size 2024-03-12T16:11:01.052 INFO:tasks.workunit.client.0.smithi006.stdout:1/958: dread d0/d25/d2a/d43/f92 [0,4194304] 0 2024-03-12T16:11:01.054 INFO:tasks.workunit.client.0.smithi006.stdout:9/959: dread d0/d8/d16/f43 [4194304,4194304] 0 2024-03-12T16:11:01.097 INFO:tasks.workunit.client.0.smithi006.stdout:8/841: write d2/db/d1a/d21/d4f/fca [3691502,93924] 0 2024-03-12T16:11:01.100 INFO:tasks.workunit.client.0.smithi006.stdout:1/959: mkdir d0/d25/d67/d159 0 2024-03-12T16:11:01.101 INFO:tasks.workunit.client.0.smithi006.stdout:6/911: symlink d3/d11/d10/d19/d119/l13d 0 2024-03-12T16:11:01.103 INFO:tasks.workunit.client.0.smithi006.stdout:1/960: stat d0/d25/d2a/d43/d68/dd2/f116 0 2024-03-12T16:11:01.104 INFO:tasks.workunit.client.0.smithi006.stdout:9/960: mkdir d0/d4/d145 0 2024-03-12T16:11:01.106 INFO:tasks.workunit.client.0.smithi006.stdout:5/860: getdents d7/d9/d31/d3b/d4f/d80/dea 0 2024-03-12T16:11:01.107 INFO:tasks.workunit.client.0.smithi006.stdout:1/961: write d0/d25/d2a/d43/dd1/df2/f14b [308897,83570] 0 2024-03-12T16:11:01.108 INFO:tasks.workunit.client.0.smithi006.stdout:8/842: dwrite d2/db/d1a/d21/dad/d7c/fc8 [0,4194304] 0 2024-03-12T16:11:01.111 INFO:tasks.workunit.client.0.smithi006.stdout:8/843: dread - d2/d11/d5a/fe1 zero size 2024-03-12T16:11:01.111 INFO:tasks.workunit.client.0.smithi006.stdout:0/983: getdents d2 0 2024-03-12T16:11:01.113 INFO:tasks.workunit.client.0.smithi006.stdout:9/961: creat d0/d4/d70/d86/f146 x:0 0 0 2024-03-12T16:11:01.113 INFO:tasks.workunit.client.0.smithi006.stdout:1/962: readlink d0/d25/d67/d8d/l9a 0 2024-03-12T16:11:01.114 INFO:tasks.workunit.client.0.smithi006.stdout:5/861: creat d7/d9/d47/f11c x:0 0 0 2024-03-12T16:11:01.114 INFO:tasks.workunit.client.0.smithi006.stdout:3/844: sync 2024-03-12T16:11:01.118 INFO:tasks.workunit.client.0.smithi006.stdout:8/844: chown d2/db/d70/daa/fdb 33 1 2024-03-12T16:11:01.120 INFO:tasks.workunit.client.0.smithi006.stdout:8/845: readlink d2/db/d1a/d23/l109 0 2024-03-12T16:11:01.120 INFO:tasks.workunit.client.0.smithi006.stdout:3/845: chown d8/d19/d26/c3e 6 1 2024-03-12T16:11:01.122 INFO:tasks.workunit.client.0.smithi006.stdout:5/862: dwrite d7/d9/d31/fe9 [0,4194304] 0 2024-03-12T16:11:01.123 INFO:tasks.workunit.client.0.smithi006.stdout:6/912: rename d3/d11/d3b/db4/dc3/ff0 to d3/d11/d10/da7/d8e/d8b/f13e 0 2024-03-12T16:11:01.124 INFO:tasks.workunit.client.0.smithi006.stdout:5/863: readlink d7/d9/d31/d3b/d61/dd3/ld4 0 2024-03-12T16:11:01.125 INFO:tasks.workunit.client.0.smithi006.stdout:3/846: rmdir d8/d19/d26/d59 39 2024-03-12T16:11:01.126 INFO:tasks.workunit.client.0.smithi006.stdout:1/963: link d0/ca1 d0/d157/c15a 0 2024-03-12T16:11:01.128 INFO:tasks.workunit.client.0.smithi006.stdout:1/964: fsync d0/d25/d2a/d43/d63/db6/f125 0 2024-03-12T16:11:01.130 INFO:tasks.workunit.client.0.smithi006.stdout:3/847: mknod d8/d4c/dc8/c124 0 2024-03-12T16:11:01.134 INFO:tasks.workunit.client.0.smithi006.stdout:8/846: dwrite d2/db/f39 [0,4194304] 0 2024-03-12T16:11:01.138 INFO:tasks.workunit.client.0.smithi006.stdout:6/913: getdents d3/d11/d10/da7/d8e/de1/d60/d108/d12d 0 2024-03-12T16:11:01.144 INFO:tasks.workunit.client.0.smithi006.stdout:8/847: creat d2/db/d1a/d21/f10d x:0 0 0 2024-03-12T16:11:01.145 INFO:tasks.workunit.client.0.smithi006.stdout:1/965: write d0/d25/d2a/f2c [1494521,3758] 0 2024-03-12T16:11:01.147 INFO:tasks.workunit.client.0.smithi006.stdout:6/914: getdents d3/d11/d10/da7/d8e/de1/dfe 0 2024-03-12T16:11:01.148 INFO:tasks.workunit.client.0.smithi006.stdout:8/848: mkdir d2/d32/d10e 0 2024-03-12T16:11:01.150 INFO:tasks.workunit.client.0.smithi006.stdout:1/966: link d0/fc d0/d25/db1/dd0/d10b/f15b 0 2024-03-12T16:11:01.154 INFO:tasks.workunit.client.0.smithi006.stdout:3/848: dwrite d8/d4c/dd8/fae [0,4194304] 0 2024-03-12T16:11:01.160 INFO:tasks.workunit.client.0.smithi006.stdout:6/915: rename d3/d11/d10/da7/d8e/de1/d60/ddd/f10d to d3/d11/d10/d28/dd6/f13f 0 2024-03-12T16:11:01.164 INFO:tasks.workunit.client.0.smithi006.stdout:5/864: dread d7/d9/d31/d3b/d4f/f7c [0,4194304] 0 2024-03-12T16:11:01.166 INFO:tasks.workunit.client.0.smithi006.stdout:8/849: dwrite d2/db/d1a/d21/d2b/da2/dbc/ffc [0,4194304] 0 2024-03-12T16:11:01.166 INFO:tasks.workunit.client.0.smithi006.stdout:3/849: readlink d8/d19/d26/d59/d2c/dc/d28/d2f/df6/lb5 0 2024-03-12T16:11:01.167 INFO:tasks.workunit.client.0.smithi006.stdout:1/967: rmdir d0/d25/d67/dc1/d140 0 2024-03-12T16:11:01.167 INFO:tasks.workunit.client.0.smithi006.stdout:5/865: truncate d7/f118 118339 0 2024-03-12T16:11:01.171 INFO:tasks.workunit.client.0.smithi006.stdout:8/850: dread - d2/d32/fbe zero size 2024-03-12T16:11:01.179 INFO:tasks.workunit.client.0.smithi006.stdout:1/968: link d0/d25/d2a/f54 d0/d25/d2a/d64/f15c 0 2024-03-12T16:11:01.182 INFO:tasks.workunit.client.0.smithi006.stdout:8/851: symlink d2/db/d1a/d1f/ded/l10f 0 2024-03-12T16:11:01.182 INFO:tasks.workunit.client.0.smithi006.stdout:3/850: write d8/d52/d6c/fe9 [725435,1004] 0 2024-03-12T16:11:01.184 INFO:tasks.workunit.client.0.smithi006.stdout:5/866: link d7/d8/f85 d7/d9/d31/d3b/d6b/f11d 0 2024-03-12T16:11:01.186 INFO:tasks.workunit.client.0.smithi006.stdout:8/852: mkdir d2/db/dfe/d110 0 2024-03-12T16:11:01.188 INFO:tasks.workunit.client.0.smithi006.stdout:6/916: dwrite d3/d11/d10/d28/f56 [0,4194304] 0 2024-03-12T16:11:01.191 INFO:tasks.workunit.client.0.smithi006.stdout:8/853: write d2/db/d1a/d21/d8a/f8b [2123468,41297] 0 2024-03-12T16:11:01.195 INFO:tasks.workunit.client.0.smithi006.stdout:1/969: dwrite d0/d25/d2a/d35/d11c/f136 [4194304,4194304] 0 2024-03-12T16:11:01.197 INFO:tasks.workunit.client.0.smithi006.stdout:1/970: chown d0/d25/d67/dc1 5733 1 2024-03-12T16:11:01.198 INFO:tasks.workunit.client.0.smithi006.stdout:1/971: fdatasync d0/d25/d2a/d43/d56/fef 0 2024-03-12T16:11:01.199 INFO:tasks.workunit.client.0.smithi006.stdout:5/867: rename d7/d9/d31/l96 to d7/d9/d10/l11e 0 2024-03-12T16:11:01.201 INFO:tasks.workunit.client.0.smithi006.stdout:8/854: chown d2/db/le0 24185721 1 2024-03-12T16:11:01.202 INFO:tasks.workunit.client.0.smithi006.stdout:8/855: write d2/db/d1a/d21/f10d [285762,6364] 0 2024-03-12T16:11:01.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:10:59.502295+0000 mgr.smithi134.gcntfu (mgr.24383) 67 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 84 MiB/s rd, 192 MiB/s wr, 420 op/s 2024-03-12T16:11:01.206 INFO:tasks.workunit.client.0.smithi006.stdout:8/856: stat d2/db/d1a/d23/fe8 0 2024-03-12T16:11:01.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:10:59.502295+0000 mgr.smithi134.gcntfu (mgr.24383) 67 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 3.4 GiB data, 11 GiB used, 525 GiB / 536 GiB avail; 84 MiB/s rd, 192 MiB/s wr, 420 op/s 2024-03-12T16:11:01.210 INFO:tasks.workunit.client.0.smithi006.stdout:8/857: mknod d2/db/d1a/d7a/c111 0 2024-03-12T16:11:01.211 INFO:tasks.workunit.client.0.smithi006.stdout:1/972: dwrite d0/d25/d2a/d43/d68/d111/f149 [0,4194304] 0 2024-03-12T16:11:01.211 INFO:tasks.workunit.client.0.smithi006.stdout:3/851: dread d8/d19/d26/d59/d2c/d41/d45/fe3 [0,4194304] 0 2024-03-12T16:11:01.217 INFO:tasks.workunit.client.0.smithi006.stdout:1/973: chown d0/d25/d2a/d43/d63/db6/dcb/f148 493632 1 2024-03-12T16:11:01.223 INFO:tasks.workunit.client.0.smithi006.stdout:1/974: write d0/d25/d2a/d35/f51 [4765642,35235] 0 2024-03-12T16:11:01.224 INFO:tasks.workunit.client.0.smithi006.stdout:5/868: dwrite d7/d9/d47/f67 [0,4194304] 0 2024-03-12T16:11:01.227 INFO:tasks.workunit.client.0.smithi006.stdout:8/858: dwrite d2/db/f100 [0,4194304] 0 2024-03-12T16:11:01.230 INFO:tasks.workunit.client.0.smithi006.stdout:1/975: dread - d0/d25/d2a/d43/d63/f107 zero size 2024-03-12T16:11:01.233 INFO:tasks.workunit.client.0.smithi006.stdout:5/869: mkdir d7/d9/d31/d3b/d4f/d11f 0 2024-03-12T16:11:01.235 INFO:tasks.workunit.client.0.smithi006.stdout:3/852: dwrite d8/d19/d26/d97/dce/fe8 [0,4194304] 0 2024-03-12T16:11:01.236 INFO:tasks.workunit.client.0.smithi006.stdout:1/976: write d0/d25/d2a/d35/db3/f10c [8900407,76144] 0 2024-03-12T16:11:01.237 INFO:tasks.workunit.client.0.smithi006.stdout:3/853: fdatasync d8/d19/d31/f32 0 2024-03-12T16:11:01.237 INFO:tasks.workunit.client.0.smithi006.stdout:1/977: stat d0/d25/d2a/d35/d11c 0 2024-03-12T16:11:01.239 INFO:tasks.workunit.client.0.smithi006.stdout:1/978: chown d0/le7 3878 1 2024-03-12T16:11:01.244 INFO:tasks.workunit.client.0.smithi006.stdout:1/979: dread d0/d25/d67/db0/fcc [0,4194304] 0 2024-03-12T16:11:01.246 INFO:tasks.workunit.client.0.smithi006.stdout:5/870: creat d7/d9/d31/d3b/d4f/d80/f120 x:0 0 0 2024-03-12T16:11:01.248 INFO:tasks.workunit.client.0.smithi006.stdout:8/859: rename d2/db/d1a/d21/d8a/f9a to d2/db/d1a/d21/f112 0 2024-03-12T16:11:01.249 INFO:tasks.workunit.client.0.smithi006.stdout:1/980: mkdir d0/d25/d2a/d35/d3f/d15d 0 2024-03-12T16:11:01.251 INFO:tasks.workunit.client.0.smithi006.stdout:5/871: creat d7/d9/d47/d56/d79/dfb/f121 x:0 0 0 2024-03-12T16:11:01.254 INFO:tasks.workunit.client.0.smithi006.stdout:3/854: creat d8/d19/d26/d59/f125 x:0 0 0 2024-03-12T16:11:01.255 INFO:tasks.workunit.client.0.smithi006.stdout:1/981: symlink d0/d25/db1/dd0/l15e 0 2024-03-12T16:11:01.256 INFO:tasks.workunit.client.0.smithi006.stdout:1/982: chown d0/d25/d2a/d35/l12e 1 1 2024-03-12T16:11:01.256 INFO:tasks.workunit.client.0.smithi006.stdout:1/983: chown d0/d25/f83 7596 1 2024-03-12T16:11:01.258 INFO:tasks.workunit.client.0.smithi006.stdout:5/872: rename d7/d9/d10/d35/fb0 to d7/d9/d31/d3b/d4f/d65/f122 0 2024-03-12T16:11:01.258 INFO:tasks.workunit.client.0.smithi006.stdout:1/984: chown d0/d25/d67/d8d/c90 91 1 2024-03-12T16:11:01.259 INFO:tasks.workunit.client.0.smithi006.stdout:5/873: chown d7/d9/d47/d56/dc4 27556514 1 2024-03-12T16:11:01.263 INFO:tasks.workunit.client.0.smithi006.stdout:1/985: symlink d0/d25/d2a/d35/d11c/d12d/l15f 0 2024-03-12T16:11:01.264 INFO:tasks.workunit.client.0.smithi006.stdout:8/860: getdents d2/d32 0 2024-03-12T16:11:01.265 INFO:tasks.workunit.client.0.smithi006.stdout:8/861: chown d2/db/d1a/d1f/c5b 172 1 2024-03-12T16:11:01.267 INFO:tasks.workunit.client.0.smithi006.stdout:5/874: creat d7/f123 x:0 0 0 2024-03-12T16:11:01.271 INFO:tasks.workunit.client.0.smithi006.stdout:8/862: rename d2/db/d1a/fb4 to d2/d11/d5a/f113 0 2024-03-12T16:11:01.272 INFO:tasks.workunit.client.0.smithi006.stdout:8/863: dread - d2/db/d70/f9c zero size 2024-03-12T16:11:01.273 INFO:tasks.workunit.client.0.smithi006.stdout:3/855: stat d8/d19/d26/d59/d2c/d41/l75 0 2024-03-12T16:11:01.275 INFO:tasks.workunit.client.0.smithi006.stdout:5/875: mknod d7/d9/d31/d3b/d4f/d80/dea/c124 0 2024-03-12T16:11:01.275 INFO:tasks.workunit.client.0.smithi006.stdout:8/864: fsync d2/db/d1a/d21/d4f/f56 0 2024-03-12T16:11:01.277 INFO:tasks.workunit.client.0.smithi006.stdout:1/986: dread d0/d25/d2a/d43/f87 [0,4194304] 0 2024-03-12T16:11:01.278 INFO:tasks.workunit.client.0.smithi006.stdout:8/865: creat d2/db/d70/f114 x:0 0 0 2024-03-12T16:11:01.278 INFO:tasks.workunit.client.0.smithi006.stdout:1/987: write d0/d25/d2a/d43/de0/f139 [480027,18079] 0 2024-03-12T16:11:01.279 INFO:tasks.workunit.client.0.smithi006.stdout:5/876: fdatasync d7/d41/f87 0 2024-03-12T16:11:01.282 INFO:tasks.workunit.client.0.smithi006.stdout:3/856: creat d8/d19/d26/d59/d2c/dc/dc9/f126 x:0 0 0 2024-03-12T16:11:01.282 INFO:tasks.workunit.client.0.smithi006.stdout:8/866: chown d2/db/d1a/d23/ff6 2603 1 2024-03-12T16:11:01.283 INFO:tasks.workunit.client.0.smithi006.stdout:8/867: chown d2/d11/l2f 1179649 1 2024-03-12T16:11:01.283 INFO:tasks.workunit.client.0.smithi006.stdout:8/868: stat d2/d11/d5a 0 2024-03-12T16:11:01.284 INFO:tasks.workunit.client.0.smithi006.stdout:8/869: readlink d2/db/d1a/d1f/ded/l10f 0 2024-03-12T16:11:01.285 INFO:tasks.workunit.client.0.smithi006.stdout:8/870: chown d2/db/d1a/f73 4249679 1 2024-03-12T16:11:01.286 INFO:tasks.workunit.client.0.smithi006.stdout:1/988: rename d0/d25/d2a/d43/d63/db6/dcb/f156 to d0/d25/db1/dd0/d10b/d138/f160 0 2024-03-12T16:11:01.287 INFO:tasks.workunit.client.0.smithi006.stdout:8/871: fsync d2/db/d1a/d21/d2b/da2/dbc/ffc 0 2024-03-12T16:11:01.287 INFO:tasks.workunit.client.0.smithi006.stdout:3/857: mknod d8/d19/d31/c127 0 2024-03-12T16:11:01.296 INFO:tasks.workunit.client.0.smithi006.stdout:3/858: dread d8/d19/d26/d59/d2c/dc/d28/d2f/f60 [0,4194304] 0 2024-03-12T16:11:01.297 INFO:tasks.workunit.client.0.smithi006.stdout:1/989: link d0/d25/d2a/d43/d56/ff7 d0/d25/d2a/d43/d63/db6/f161 0 2024-03-12T16:11:01.297 INFO:tasks.workunit.client.0.smithi006.stdout:8/872: dwrite d2/db/d1a/d21/dad/fe9 [0,4194304] 0 2024-03-12T16:11:01.305 INFO:tasks.workunit.client.0.smithi006.stdout:8/873: mknod d2/db/d1a/d7a/c115 0 2024-03-12T16:11:01.314 INFO:tasks.workunit.client.0.smithi006.stdout:3/859: getdents d8/d19/d26/d59/d2c/dc/d28 0 2024-03-12T16:11:01.317 INFO:tasks.workunit.client.0.smithi006.stdout:8/874: dwrite d2/db/d1a/d1f/f3c [0,4194304] 0 2024-03-12T16:11:01.319 INFO:tasks.workunit.client.0.smithi006.stdout:3/860: creat d8/d4c/dc8/f128 x:0 0 0 2024-03-12T16:11:01.319 INFO:tasks.workunit.client.0.smithi006.stdout:1/990: dread d0/f1b [0,4194304] 0 2024-03-12T16:11:01.321 INFO:tasks.workunit.client.0.smithi006.stdout:8/875: mkdir d2/db/d70/d116 0 2024-03-12T16:11:01.322 INFO:tasks.workunit.client.0.smithi006.stdout:1/991: mknod d0/d25/db1/dd0/d10b/d138/c162 0 2024-03-12T16:11:01.325 INFO:tasks.workunit.client.0.smithi006.stdout:3/861: mkdir d8/d19/d26/d59/d2c/d41/d45/d129 0 2024-03-12T16:11:01.326 INFO:tasks.workunit.client.0.smithi006.stdout:8/876: stat d2/db/d1a/d23/l61 0 2024-03-12T16:11:01.330 INFO:tasks.workunit.client.0.smithi006.stdout:3/862: creat d8/d19/d26/d59/d2c/f12a x:0 0 0 2024-03-12T16:11:01.332 INFO:tasks.workunit.client.0.smithi006.stdout:8/877: getdents d2/db/d70/daa 0 2024-03-12T16:11:01.333 INFO:tasks.workunit.client.0.smithi006.stdout:3/863: symlink d8/df2/l12b 0 2024-03-12T16:11:01.337 INFO:tasks.workunit.client.0.smithi006.stdout:8/878: dread - d2/db/d1a/d21/d4f/da7/fc7 zero size 2024-03-12T16:11:01.338 INFO:tasks.workunit.client.0.smithi006.stdout:3/864: creat d8/d52/d6c/f12c x:0 0 0 2024-03-12T16:11:01.340 INFO:tasks.workunit.client.0.smithi006.stdout:8/879: fdatasync d2/db/dfe/f93 0 2024-03-12T16:11:01.343 INFO:tasks.workunit.client.0.smithi006.stdout:3/865: read d8/f17 [40407,69509] 0 2024-03-12T16:11:01.348 INFO:tasks.workunit.client.0.smithi006.stdout:8/880: truncate d2/db/d1a/d21/d4f/fb5 413695 0 2024-03-12T16:11:01.357 INFO:tasks.workunit.client.0.smithi006.stdout:8/881: rmdir d2/db/d70/d116 0 2024-03-12T16:11:01.359 INFO:tasks.workunit.client.0.smithi006.stdout:3/866: dwrite d8/d19/d26/d59/d2c/f67 [0,4194304] 0 2024-03-12T16:11:01.363 INFO:tasks.workunit.client.0.smithi006.stdout:3/867: write d8/d4c/d7c/f10d [880338,129794] 0 2024-03-12T16:11:01.363 INFO:tasks.workunit.client.0.smithi006.stdout:8/882: write d2/d11/d5a/dd4/ff3 [591076,124417] 0 2024-03-12T16:11:01.366 INFO:tasks.workunit.client.0.smithi006.stdout:8/883: chown d2/d11/l5e 15643 1 2024-03-12T16:11:01.369 INFO:tasks.workunit.client.0.smithi006.stdout:3/868: rmdir d8/d19/d26/d59/d2c 39 2024-03-12T16:11:01.374 INFO:tasks.workunit.client.0.smithi006.stdout:8/884: rename d2/d11/f82 to d2/d11/f117 0 2024-03-12T16:11:01.375 INFO:tasks.workunit.client.0.smithi006.stdout:3/869: truncate d8/d19/d26/d59/d2c/fa2 616609 0 2024-03-12T16:11:01.389 INFO:tasks.workunit.client.0.smithi006.stdout:3/870: symlink d8/d19/d26/l12d 0 2024-03-12T16:11:01.391 INFO:tasks.workunit.client.0.smithi006.stdout:8/885: dwrite d2/fc3 [0,4194304] 0 2024-03-12T16:11:01.391 INFO:tasks.workunit.client.0.smithi006.stdout:3/871: write d8/d19/f4f [4043548,39862] 0 2024-03-12T16:11:01.406 INFO:tasks.workunit.client.0.smithi006.stdout:8/886: dread d2/db/d1a/d21/dad/fe3 [0,4194304] 0 2024-03-12T16:11:01.408 INFO:tasks.workunit.client.0.smithi006.stdout:8/887: read d2/dab/fe5 [274093,102236] 0 2024-03-12T16:11:01.422 INFO:tasks.workunit.client.0.smithi006.stdout:8/888: dread d2/dab/fae [0,4194304] 0 2024-03-12T16:11:01.427 INFO:tasks.workunit.client.0.smithi006.stdout:8/889: dwrite d2/db/d1a/d7a/ff0 [0,4194304] 0 2024-03-12T16:11:01.463 INFO:tasks.workunit.client.0.smithi006.stdout:8/890: unlink d2/db/d1a/d21/fa8 0 2024-03-12T16:11:01.467 INFO:tasks.workunit.client.0.smithi006.stdout:8/891: rmdir d2/db/d1a/d1f/dfa 0 2024-03-12T16:11:01.469 INFO:tasks.workunit.client.0.smithi006.stdout:8/892: creat d2/db/f118 x:0 0 0 2024-03-12T16:11:01.472 INFO:tasks.workunit.client.0.smithi006.stdout:8/893: mkdir d2/d32/dc6/d119 0 2024-03-12T16:11:01.475 INFO:tasks.workunit.client.0.smithi006.stdout:8/894: symlink d2/db/dfe/d110/l11a 0 2024-03-12T16:11:01.476 INFO:tasks.workunit.client.0.smithi006.stdout:8/895: stat d2/db/d1a/l22 0 2024-03-12T16:11:01.482 INFO:tasks.workunit.client.0.smithi006.stdout:3/872: dwrite d8/d19/d26/d59/d2c/dc/d28/d2f/df6/f77 [0,4194304] 0 2024-03-12T16:11:01.484 INFO:tasks.workunit.client.0.smithi006.stdout:8/896: rmdir d2/db/d1a/d21/d2b/da2/dd8 0 2024-03-12T16:11:01.484 INFO:tasks.workunit.client.0.smithi006.stdout:8/897: chown d2/db/d1a/d23/l109 303593177 1 2024-03-12T16:11:01.492 INFO:tasks.workunit.client.0.smithi006.stdout:8/898: getdents d2/d32 0 2024-03-12T16:11:01.492 INFO:tasks.workunit.client.0.smithi006.stdout:3/873: dread d8/d19/d26/d59/d2c/dc/d28/d2f/df6/f103 [0,4194304] 0 2024-03-12T16:11:01.495 INFO:tasks.workunit.client.0.smithi006.stdout:8/899: mkdir d2/d32/dc6/d11b 0 2024-03-12T16:11:01.496 INFO:tasks.workunit.client.0.smithi006.stdout:3/874: dread d8/d19/d26/d59/d2c/dc/d28/d2f/df6/f103 [0,4194304] 0 2024-03-12T16:11:01.497 INFO:tasks.workunit.client.0.smithi006.stdout:8/900: fdatasync d2/f7d 0 2024-03-12T16:11:01.498 INFO:tasks.workunit.client.0.smithi006.stdout:8/901: readlink d2/d55/l7f 0 2024-03-12T16:11:01.506 INFO:tasks.workunit.client.0.smithi006.stdout:3/875: dwrite d8/d19/d26/d59/d2c/dc/dc9/f126 [0,4194304] 0 2024-03-12T16:11:01.510 INFO:tasks.workunit.client.0.smithi006.stdout:8/902: dwrite d2/db/fb1 [0,4194304] 0 2024-03-12T16:11:01.511 INFO:tasks.workunit.client.0.smithi006.stdout:3/876: creat d8/d19/f12e x:0 0 0 2024-03-12T16:11:01.512 INFO:tasks.workunit.client.0.smithi006.stdout:3/877: rmdir d8/d52 39 2024-03-12T16:11:01.513 INFO:tasks.workunit.client.0.smithi006.stdout:3/878: chown d8/d19/l3d 0 1 2024-03-12T16:11:01.514 INFO:tasks.workunit.client.0.smithi006.stdout:8/903: truncate d2/d55/f8f 979411 0 2024-03-12T16:11:01.518 INFO:tasks.workunit.client.0.smithi006.stdout:3/879: stat d8/d19/d26/d59/d2c/dc/d28/d2f/l66 0 2024-03-12T16:11:01.520 INFO:tasks.workunit.client.0.smithi006.stdout:3/880: getdents d8/d19/d26/d11d 0 2024-03-12T16:11:01.521 INFO:tasks.workunit.client.0.smithi006.stdout:8/904: write d2/db/d1a/d21/d4f/f5c [4689580,105118] 0 2024-03-12T16:11:01.524 INFO:tasks.workunit.client.0.smithi006.stdout:8/905: write d2/db/d70/f114 [119708,128053] 0 2024-03-12T16:11:01.528 INFO:tasks.workunit.client.0.smithi006.stdout:3/881: dwrite d8/ddc/df5/dfa/f104 [0,4194304] 0 2024-03-12T16:11:01.529 INFO:tasks.workunit.client.0.smithi006.stdout:8/906: creat d2/db/d1a/d23/f11c x:0 0 0 2024-03-12T16:11:01.532 INFO:tasks.workunit.client.0.smithi006.stdout:8/907: write d2/d11/fd7 [2781505,73579] 0 2024-03-12T16:11:01.534 INFO:tasks.workunit.client.0.smithi006.stdout:8/908: stat d2/db/d1a/d21/d2b/da2/fff 0 2024-03-12T16:11:01.536 INFO:tasks.workunit.client.0.smithi006.stdout:8/909: truncate d2/db/f118 816820 0 2024-03-12T16:11:01.539 INFO:tasks.workunit.client.0.smithi006.stdout:8/910: rmdir d2/db/d1a/d21/d2b 39 2024-03-12T16:11:01.540 INFO:tasks.workunit.client.0.smithi006.stdout:8/911: readlink d2/lb3 0 2024-03-12T16:11:01.544 INFO:tasks.workunit.client.0.smithi006.stdout:3/882: dwrite d8/d19/d26/d59/d2c/d41/ffb [0,4194304] 0 2024-03-12T16:11:01.546 INFO:tasks.workunit.client.0.smithi006.stdout:8/912: rename d2/d55/d7b/f8e to d2/d55/f11d 0 2024-03-12T16:11:01.551 INFO:tasks.workunit.client.0.smithi006.stdout:3/883: creat d8/d4c/dd8/f12f x:0 0 0 2024-03-12T16:11:01.553 INFO:tasks.workunit.client.0.smithi006.stdout:3/884: stat d8/d19/d26/d59/d2c/f12a 0 2024-03-12T16:11:01.555 INFO:tasks.workunit.client.0.smithi006.stdout:3/885: unlink d8/d19/l3d 0 2024-03-12T16:11:01.558 INFO:tasks.workunit.client.0.smithi006.stdout:3/886: symlink d8/d52/d6c/l130 0 2024-03-12T16:11:01.562 INFO:tasks.workunit.client.0.smithi006.stdout:8/913: dwrite d2/db/d1a/d1f/f105 [0,4194304] 0 2024-03-12T16:11:01.564 INFO:tasks.workunit.client.0.smithi006.stdout:3/887: rename d8/d19/d26/d59/d2c to d8/d131 0 2024-03-12T16:11:01.567 INFO:tasks.workunit.client.0.smithi006.stdout:3/888: read d8/d19/d26/f43 [3288696,28473] 0 2024-03-12T16:11:01.568 INFO:tasks.workunit.client.0.smithi006.stdout:3/889: stat d8/d4c/d7c/f7e 0 2024-03-12T16:11:01.570 INFO:tasks.workunit.client.0.smithi006.stdout:8/914: truncate d2/db/d1a/d21/d2b/f88 368419 0 2024-03-12T16:11:01.576 INFO:tasks.workunit.client.0.smithi006.stdout:3/890: dwrite d8/d19/d26/d59/f4e [0,4194304] 0 2024-03-12T16:11:01.579 INFO:tasks.workunit.client.0.smithi006.stdout:8/915: write d2/db/d70/f9c [245162,97091] 0 2024-03-12T16:11:01.585 INFO:tasks.workunit.client.0.smithi006.stdout:8/916: rename d2/db/d1a/d21/d2b/c84 to d2/db/d1a/d21/c11e 0 2024-03-12T16:11:01.587 INFO:tasks.workunit.client.0.smithi006.stdout:8/917: mknod d2/d32/dc6/c11f 0 2024-03-12T16:11:01.589 INFO:tasks.workunit.client.0.smithi006.stdout:8/918: symlink d2/d11/d5a/dd4/l120 0 2024-03-12T16:11:01.591 INFO:tasks.workunit.client.0.smithi006.stdout:8/919: creat d2/d32/d10e/f121 x:0 0 0 2024-03-12T16:11:01.594 INFO:tasks.workunit.client.0.smithi006.stdout:8/920: readlink d2/db/d1a/d21/d8a/lbf 0 2024-03-12T16:11:01.595 INFO:tasks.workunit.client.0.smithi006.stdout:8/921: write d2/db/d1a/d23/ff6 [741251,36160] 0 2024-03-12T16:11:01.596 INFO:tasks.workunit.client.0.smithi006.stdout:8/922: fdatasync d2/d55/d7b/f102 0 2024-03-12T16:11:01.604 INFO:tasks.workunit.client.0.smithi006.stdout:3/891: dread d8/d131/d41/f8c [0,4194304] 0 2024-03-12T16:11:01.610 INFO:tasks.workunit.client.0.smithi006.stdout:8/923: dread d2/db/d1a/d1f/f52 [0,4194304] 0 2024-03-12T16:11:01.611 INFO:tasks.workunit.client.0.smithi006.stdout:3/892: dwrite d8/d4c/dc8/f128 [0,4194304] 0 2024-03-12T16:11:01.614 INFO:tasks.workunit.client.0.smithi006.stdout:8/924: mkdir d2/db/d122 0 2024-03-12T16:11:01.616 INFO:tasks.workunit.client.0.smithi006.stdout:3/893: creat d8/d131/d41/d45/f132 x:0 0 0 2024-03-12T16:11:01.618 INFO:tasks.workunit.client.0.smithi006.stdout:8/925: fsync d2/db/d1a/d21/dad/f75 0 2024-03-12T16:11:01.620 INFO:tasks.workunit.client.0.smithi006.stdout:8/926: rmdir d2/db/d70/daa 39 2024-03-12T16:11:01.622 INFO:tasks.workunit.client.0.smithi006.stdout:8/927: dread - d2/db/d1a/d21/d8a/ffb zero size 2024-03-12T16:11:01.626 INFO:tasks.workunit.client.0.smithi006.stdout:4/996: sync 2024-03-12T16:11:01.626 INFO:tasks.workunit.client.0.smithi006.stdout:0/984: sync 2024-03-12T16:11:01.627 INFO:tasks.workunit.client.0.smithi006.stdout:0/985: readlink d2/d106/l13f 0 2024-03-12T16:11:01.632 INFO:tasks.workunit.client.0.smithi006.stdout:8/928: truncate d2/db/d1a/d21/d4f/f5c 1614689 0 2024-03-12T16:11:01.634 INFO:tasks.workunit.client.0.smithi006.stdout:0/986: rename d2/d39/d42/c4e to d2/d6/d10/d11/c148 0 2024-03-12T16:11:01.635 INFO:tasks.workunit.client.0.smithi006.stdout:4/997: write d1/db/d39/dbf/fdb [4855704,119207] 0 2024-03-12T16:11:01.637 INFO:tasks.workunit.client.0.smithi006.stdout:8/929: dread d2/db/d1a/d21/dad/d7c/fc8 [0,4194304] 0 2024-03-12T16:11:01.639 INFO:tasks.workunit.client.0.smithi006.stdout:8/930: write d2/db/d1a/d21/d2b/da2/fff [834398,34210] 0 2024-03-12T16:11:01.645 INFO:tasks.workunit.client.0.smithi006.stdout:0/987: link d2/d6/d10/ff6 d2/d6/d10/d11/d1d/d2e/f149 0 2024-03-12T16:11:01.648 INFO:tasks.workunit.client.0.smithi006.stdout:4/998: link d1/db/d1d/d2f/d6b/fa4 d1/db/d39/dbf/dec/da8/d13a/f14e 0 2024-03-12T16:11:01.656 INFO:tasks.workunit.client.0.smithi006.stdout:4/999: write d1/db/d1d/d2f/fc0 [4548856,94599] 0 2024-03-12T16:11:01.656 INFO:tasks.workunit.client.0.smithi006.stdout:8/931: dwrite d2/d11/fa9 [0,4194304] 0 2024-03-12T16:11:01.662 INFO:tasks.workunit.client.0.smithi006.stdout:8/932: mknod d2/db/d1a/d21/d2b/da2/c123 0 2024-03-12T16:11:01.665 INFO:tasks.workunit.client.0.smithi006.stdout:0/988: dread d2/d6/d10/d11/d1d/d2e/f33 [0,4194304] 0 2024-03-12T16:11:01.665 INFO:tasks.workunit.client.0.smithi006.stdout:8/933: creat d2/db/d1a/d7a/f124 x:0 0 0 2024-03-12T16:11:01.671 INFO:tasks.workunit.client.0.smithi006.stdout:0/989: rename d2/d6/d10/d110/d13c to d2/d88/d103/d14a 0 2024-03-12T16:11:01.674 INFO:tasks.workunit.client.0.smithi006.stdout:0/990: creat d2/d6/d10/ddd/de8/f14b x:0 0 0 2024-03-12T16:11:01.678 INFO:tasks.workunit.client.0.smithi006.stdout:0/991: mkdir d2/d6/d10/d11/d7e/da6/de4/d14c 0 2024-03-12T16:11:01.680 INFO:tasks.workunit.client.0.smithi006.stdout:0/992: rmdir d2 39 2024-03-12T16:11:01.683 INFO:tasks.workunit.client.0.smithi006.stdout:8/934: dread d2/db/d1a/d21/d8a/fa1 [0,4194304] 0 2024-03-12T16:11:01.689 INFO:tasks.workunit.client.0.smithi006.stdout:8/935: rename d2/fd to d2/d11/d5a/d103/f125 0 2024-03-12T16:11:01.693 INFO:tasks.workunit.client.0.smithi006.stdout:8/936: mkdir d2/dab/d126 0 2024-03-12T16:11:01.697 INFO:tasks.workunit.client.0.smithi006.stdout:0/993: write d2/d39/f8c [131453,96409] 0 2024-03-12T16:11:01.699 INFO:tasks.workunit.client.0.smithi006.stdout:8/937: rename d2/db/d1a/d23/l109 to d2/db/d1a/d21/d2b/da2/dbc/l127 0 2024-03-12T16:11:01.699 INFO:tasks.workunit.client.0.smithi006.stdout:8/938: fsync d2/d11/fa9 0 2024-03-12T16:11:01.702 INFO:tasks.workunit.client.0.smithi006.stdout:8/939: mknod d2/d55/d7b/db8/c128 0 2024-03-12T16:11:01.710 INFO:tasks.workunit.client.0.smithi006.stdout:8/940: dwrite d2/db/d1a/d1f/fb0 [0,4194304] 0 2024-03-12T16:11:01.713 INFO:tasks.workunit.client.0.smithi006.stdout:0/994: dread d2/d6/d10/f4c [0,4194304] 0 2024-03-12T16:11:01.713 INFO:tasks.workunit.client.0.smithi006.stdout:8/941: mkdir d2/db/d122/d129 0 2024-03-12T16:11:01.715 INFO:tasks.workunit.client.0.smithi006.stdout:0/995: mknod d2/d88/d129/d97/dbb/c14d 0 2024-03-12T16:11:01.719 INFO:tasks.workunit.client.0.smithi006.stdout:8/942: creat d2/db/d70/f12a x:0 0 0 2024-03-12T16:11:01.720 INFO:tasks.workunit.client.0.smithi006.stdout:0/996: creat d2/d6/d10/d11/d1d/d79/f14e x:0 0 0 2024-03-12T16:11:01.725 INFO:tasks.workunit.client.0.smithi006.stdout:0/997: creat d2/d6/d10/d11/d1d/d79/dd0/d128/f14f x:0 0 0 2024-03-12T16:11:01.726 INFO:tasks.workunit.client.0.smithi006.stdout:0/998: fsync d2/d88/d129/d97/fda 0 2024-03-12T16:11:01.727 INFO:tasks.workunit.client.0.smithi006.stdout:8/943: rmdir d2/dab/d126 0 2024-03-12T16:11:01.729 INFO:tasks.workunit.client.0.smithi006.stdout:8/944: creat d2/d11/d5a/f12b x:0 0 0 2024-03-12T16:11:01.733 INFO:tasks.workunit.client.0.smithi006.stdout:0/999: dread d2/d88/d129/f45 [0,4194304] 0 2024-03-12T16:11:01.739 INFO:tasks.workunit.client.0.smithi006.stdout:8/945: link d2/db/d1a/d1f/l101 d2/db/l12c 0 2024-03-12T16:11:01.742 INFO:tasks.workunit.client.0.smithi006.stdout:8/946: fdatasync d2/db/d1a/d23/f60 0 2024-03-12T16:11:01.746 INFO:tasks.workunit.client.0.smithi006.stdout:8/947: getdents d2/d11/d5a/dd4 0 2024-03-12T16:11:01.747 INFO:tasks.workunit.client.0.smithi006.stdout:8/948: chown d2/db/d1a/d7a/dcc 163271160 1 2024-03-12T16:11:01.753 INFO:tasks.workunit.client.0.smithi006.stdout:8/949: creat d2/d11/f12d x:0 0 0 2024-03-12T16:11:01.756 INFO:tasks.workunit.client.0.smithi006.stdout:8/950: creat d2/db/d1a/d21/dad/f12e x:0 0 0 2024-03-12T16:11:01.758 INFO:tasks.workunit.client.0.smithi006.stdout:8/951: write d2/db/d1a/d21/d2b/da2/dbc/ffc [4587520,44920] 0 2024-03-12T16:11:01.760 INFO:tasks.workunit.client.0.smithi006.stdout:8/952: truncate d2/d11/f12d 159466 0 2024-03-12T16:11:01.765 INFO:tasks.workunit.client.0.smithi006.stdout:8/953: rename d2/db/d70/daa to d2/db/d1a/d7a/dcc/d12f 0 2024-03-12T16:11:01.776 INFO:tasks.workunit.client.0.smithi006.stdout:8/954: dwrite d2/d11/d5a/d103/f125 [0,4194304] 0 2024-03-12T16:11:01.783 INFO:tasks.workunit.client.0.smithi006.stdout:8/955: mkdir d2/db/d1a/d21/dad/d130 0 2024-03-12T16:11:01.784 INFO:tasks.workunit.client.0.smithi006.stdout:8/956: chown d2/db/d1a/d21/d2b/da2/dbc 1768 1 2024-03-12T16:11:01.787 INFO:tasks.workunit.client.0.smithi006.stdout:8/957: fdatasync d2/f7d 0 2024-03-12T16:11:01.812 INFO:tasks.workunit.client.0.smithi006.stdout:8/958: truncate d2/d55/d7b/db8/fdd 3386738 0 2024-03-12T16:11:01.814 INFO:tasks.workunit.client.0.smithi006.stdout:8/959: symlink d2/d11/l131 0 2024-03-12T16:11:01.815 INFO:tasks.workunit.client.0.smithi006.stdout:8/960: fsync d2/d11/d5a/dd4/ff3 0 2024-03-12T16:11:01.828 INFO:tasks.workunit.client.0.smithi006.stdout:8/961: link d2/db/d1a/d21/d2b/da2/lb6 d2/d32/d10e/l132 0 2024-03-12T16:11:01.828 INFO:tasks.workunit.client.0.smithi006.stdout:8/962: stat d2/d32/l98 0 2024-03-12T16:11:01.836 INFO:tasks.workunit.client.0.smithi006.stdout:8/963: write d2/db/d1a/d21/d8a/fa1 [4529552,31707] 0 2024-03-12T16:11:01.840 INFO:tasks.workunit.client.0.smithi006.stdout:8/964: symlink d2/db/d70/l133 0 2024-03-12T16:11:01.840 INFO:tasks.workunit.client.0.smithi006.stdout:9/962: sync 2024-03-12T16:11:01.840 INFO:tasks.workunit.client.0.smithi006.stdout:6/917: sync 2024-03-12T16:11:01.841 INFO:tasks.workunit.client.0.smithi006.stdout:9/963: chown d0/d4/d145 4 1 2024-03-12T16:11:01.846 INFO:tasks.workunit.client.0.smithi006.stdout:6/918: chown d3/d11/d10/d1b/d6e/d96/c9c 184694558 1 2024-03-12T16:11:01.846 INFO:tasks.workunit.client.0.smithi006.stdout:8/965: rmdir d2/db/d1a/d21/dad 39 2024-03-12T16:11:01.847 INFO:tasks.workunit.client.0.smithi006.stdout:8/966: write d2/db/d1a/f78 [3534705,34269] 0 2024-03-12T16:11:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.844+0000 7fc2aeb34700 1 -- 172.21.15.6:0/3431668847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a80faba0 msgr2=0x7fc2a80fcff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:01.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.844+0000 7fc2aeb34700 1 --2- 172.21.15.6:0/3431668847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a80faba0 0x7fc2a80fcff0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7fc2940047f0 tx=0x7fc294009cb0).stop 2024-03-12T16:11:01.847 INFO:tasks.workunit.client.0.smithi006.stdout:6/919: mkdir d3/d11/d10/d140 0 2024-03-12T16:11:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.846+0000 7fc2aeb34700 1 -- 172.21.15.6:0/3431668847 shutdown_connections 2024-03-12T16:11:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.846+0000 7fc2aeb34700 1 --2- 172.21.15.6:0/3431668847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a80faba0 0x7fc2a80fcff0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.846+0000 7fc2aeb34700 1 --2- 172.21.15.6:0/3431668847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2a8061260 0x7fc2a80fa6b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:11:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.846+0000 7fc2aeb34700 1 -- 172.21.15.6:0/3431668847 >> 172.21.15.6:0/3431668847 conn(0x7fc2a80f2070 msgr2=0x7fc2a80f44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:01.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.846+0000 7fc2aeb34700 1 -- 172.21.15.6:0/3431668847 shutdown_connections 2024-03-12T16:11:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.846+0000 7fc2aeb34700 1 -- 172.21.15.6:0/3431668847 wait complete. 2024-03-12T16:11:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.847+0000 7fc2aeb34700 1 Processor -- start 2024-03-12T16:11:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.847+0000 7fc2aeb34700 1 -- start start 2024-03-12T16:11:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.847+0000 7fc2aeb34700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2a8061260 0x7fc2a8105fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:01.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.847+0000 7fc2aeb34700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a80faba0 0x7fc2a81064c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.847+0000 7fc2aeb34700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8106b00 con 0x7fc2a80faba0 2024-03-12T16:11:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.847+0000 7fc2aeb34700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2a8106c40 con 0x7fc2a8061260 2024-03-12T16:11:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.848+0000 7fc2ac8d0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2a8061260 0x7fc2a8105fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.848+0000 7fc2ac8d0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2a8061260 0x7fc2a8105fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:33532/0 (socket says 172.21.15.6:33532) 2024-03-12T16:11:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.848+0000 7fc2ac8d0700 1 -- 172.21.15.6:0/1678627627 learned_addr learned my addr 172.21.15.6:0/1678627627 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:01.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.848+0000 7fc2a7fff700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a80faba0 0x7fc2a81064c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.849+0000 7fc2ac8d0700 1 -- 172.21.15.6:0/1678627627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a80faba0 msgr2=0x7fc2a81064c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.849+0000 7fc2ac8d0700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a80faba0 0x7fc2a81064c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.849+0000 7fc2ac8d0700 1 -- 172.21.15.6:0/1678627627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc294005040 con 0x7fc2a8061260 2024-03-12T16:11:01.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.849+0000 7fc2ac8d0700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2a8061260 0x7fc2a8105fd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc29c00b4b0 tx=0x7fc29c0090f0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:01.852 INFO:tasks.workunit.client.0.smithi006.stdout:9/964: mkdir d0/d8/d80/dfd/d147 0 2024-03-12T16:11:01.852 INFO:tasks.workunit.client.0.smithi006.stdout:8/967: read d2/db/fe2 [1039654,6894] 0 2024-03-12T16:11:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.849+0000 7fc2a5ffb700 1 -- 172.21.15.6:0/1678627627 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc29c002500 con 0x7fc2a8061260 2024-03-12T16:11:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.849+0000 7fc2a5ffb700 1 -- 172.21.15.6:0/1678627627 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc29c002b10 con 0x7fc2a8061260 2024-03-12T16:11:01.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.849+0000 7fc2a5ffb700 1 -- 172.21.15.6:0/1678627627 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc29c012c20 con 0x7fc2a8061260 2024-03-12T16:11:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.849+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2a810b680 con 0x7fc2a8061260 2024-03-12T16:11:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.850+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc2a810bbc0 con 0x7fc2a8061260 2024-03-12T16:11:01.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.851+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc2a805fb50 con 0x7fc2a8061260 2024-03-12T16:11:01.853 INFO:tasks.workunit.client.0.smithi006.stdout:9/965: readlink d0/d83/d90/lf6 0 2024-03-12T16:11:01.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.852+0000 7fc2a5ffb700 1 -- 172.21.15.6:0/1678627627 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fc29c002660 con 0x7fc2a8061260 2024-03-12T16:11:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.852+0000 7fc2a5ffb700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc298066e10 0x7fc2980692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.852+0000 7fc2a5ffb700 1 -- 172.21.15.6:0/1678627627 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fc29c0842d0 con 0x7fc2a8061260 2024-03-12T16:11:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.853+0000 7fc2a7fff700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc298066e10 0x7fc2980692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:01.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.853+0000 7fc2a7fff700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc298066e10 0x7fc2980692d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc294004f10 tx=0x7fc294009cb0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:01.856 INFO:tasks.workunit.client.0.smithi006.stdout:6/920: rename d3/d11/d10/da7/d8e/d8b/fea to d3/d11/d10/d1b/d6e/d80/d9b/f141 0 2024-03-12T16:11:01.857 INFO:tasks.workunit.client.0.smithi006.stdout:8/968: creat d2/db/d1a/d21/d2b/da2/dbc/f134 x:0 0 0 2024-03-12T16:11:01.859 INFO:tasks.workunit.client.0.smithi006.stdout:8/969: fdatasync d2/db/d1a/d23/f60 0 2024-03-12T16:11:01.861 INFO:tasks.workunit.client.0.smithi006.stdout:6/921: creat d3/d11/d10/d1b/d6e/db1/f142 x:0 0 0 2024-03-12T16:11:01.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:01.859+0000 7fc2a5ffb700 1 -- 172.21.15.6:0/1678627627 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fc29c052500 con 0x7fc2a8061260 2024-03-12T16:11:01.864 INFO:tasks.workunit.client.0.smithi006.stdout:9/966: rename d0/d8f to d0/d83/d90/d148 0 2024-03-12T16:11:01.865 INFO:tasks.workunit.client.0.smithi006.stdout:8/970: dread d2/dab/fe5 [0,4194304] 0 2024-03-12T16:11:01.866 INFO:tasks.workunit.client.0.smithi006.stdout:6/922: chown d3/d11/d10/da7/dd5/ddb/de6/c137 3536674 1 2024-03-12T16:11:01.868 INFO:tasks.workunit.client.0.smithi006.stdout:9/967: chown d0/d8/d80/l134 6741534 1 2024-03-12T16:11:01.868 INFO:tasks.workunit.client.0.smithi006.stdout:6/923: rmdir d3/d11/d10/da7/dd5/ddb/de6 39 2024-03-12T16:11:01.873 INFO:tasks.workunit.client.0.smithi006.stdout:6/924: truncate d3/d11/d10/d1b/d20/d7c/feb 609921 0 2024-03-12T16:11:01.874 INFO:tasks.workunit.client.0.smithi006.stdout:9/968: link d0/d8/l59 d0/d4/d3b/dff/d13b/l149 0 2024-03-12T16:11:01.875 INFO:tasks.workunit.client.0.smithi006.stdout:9/969: chown d0/d83/d90/dc0/de2/f127 724715 1 2024-03-12T16:11:01.876 INFO:tasks.workunit.client.0.smithi006.stdout:6/925: mkdir d3/d11/d10/d143 0 2024-03-12T16:11:01.879 INFO:tasks.workunit.client.0.smithi006.stdout:5/877: sync 2024-03-12T16:11:01.879 INFO:tasks.workunit.client.0.smithi006.stdout:3/894: sync 2024-03-12T16:11:01.879 INFO:tasks.workunit.client.0.smithi006.stdout:1/992: sync 2024-03-12T16:11:01.880 INFO:tasks.workunit.client.0.smithi006.stdout:6/926: mkdir d3/d11/d3b/d144 0 2024-03-12T16:11:01.882 INFO:tasks.workunit.client.0.smithi006.stdout:1/993: stat d0/d25/d67/l93 0 2024-03-12T16:11:01.884 INFO:tasks.workunit.client.0.smithi006.stdout:1/994: fdatasync d0/f3e 0 2024-03-12T16:11:01.884 INFO:tasks.workunit.client.0.smithi006.stdout:6/927: chown d3/d11/d10/d9a/la6 11676635 1 2024-03-12T16:11:01.885 INFO:tasks.workunit.client.0.smithi006.stdout:5/878: rmdir d7/d9 39 2024-03-12T16:11:01.888 INFO:tasks.workunit.client.0.smithi006.stdout:8/971: write d2/f16 [3491075,19913] 0 2024-03-12T16:11:01.895 INFO:tasks.workunit.client.0.smithi006.stdout:9/970: dread d0/d4/d9b/feb [0,4194304] 0 2024-03-12T16:11:01.897 INFO:tasks.workunit.client.0.smithi006.stdout:3/895: dread d8/d19/d26/d59/f1f [0,4194304] 0 2024-03-12T16:11:01.899 INFO:tasks.workunit.client.0.smithi006.stdout:3/896: truncate d8/d4c/db2/f109 217386 0 2024-03-12T16:11:01.902 INFO:tasks.workunit.client.0.smithi006.stdout:8/972: chown d2/d11/d5a/f5f 7 1 2024-03-12T16:11:01.908 INFO:tasks.workunit.client.0.smithi006.stdout:6/928: dwrite d3/d11/d10/d28/fb7 [0,4194304] 0 2024-03-12T16:11:01.911 INFO:tasks.workunit.client.0.smithi006.stdout:9/971: truncate d0/d8/f52 7287994 0 2024-03-12T16:11:01.911 INFO:tasks.workunit.client.0.smithi006.stdout:1/995: dread d0/d25/f40 [0,4194304] 0 2024-03-12T16:11:01.912 INFO:tasks.workunit.client.0.smithi006.stdout:5/879: mkdir d7/d9/d31/d3b/d4f/d9e/ddb/d104/d125 0 2024-03-12T16:11:01.971 INFO:tasks.workunit.client.0.smithi006.stdout:9/972: creat d0/d4/d70/d71/f14a x:0 0 0 2024-03-12T16:11:01.972 INFO:tasks.workunit.client.0.smithi006.stdout:5/880: chown d7/d9/d31/d3b/d4f/d80 770 1 2024-03-12T16:11:01.974 INFO:tasks.workunit.client.0.smithi006.stdout:1/996: truncate d0/d25/d2a/fc3 680377 0 2024-03-12T16:11:01.980 INFO:tasks.workunit.client.0.smithi006.stdout:3/897: dwrite d8/d4c/dd8/f95 [0,4194304] 0 2024-03-12T16:11:01.986 INFO:tasks.workunit.client.0.smithi006.stdout:3/898: creat d8/d19/d31/dc4/f133 x:0 0 0 2024-03-12T16:11:01.987 INFO:tasks.workunit.client.0.smithi006.stdout:1/997: dread d0/d25/d67/db0/fb4 [0,4194304] 0 2024-03-12T16:11:01.995 INFO:tasks.workunit.client.0.smithi006.stdout:3/899: dwrite d8/d4c/db2/f109 [0,4194304] 0 2024-03-12T16:11:01.996 INFO:tasks.workunit.client.0.smithi006.stdout:5/881: dread d7/d8/d91/ff1 [0,4194304] 0 2024-03-12T16:11:01.997 INFO:tasks.workunit.client.0.smithi006.stdout:1/998: creat d0/d25/d2a/d43/d63/d102/f163 x:0 0 0 2024-03-12T16:11:02.000 INFO:tasks.workunit.client.0.smithi006.stdout:5/882: symlink d7/d9/d10/d24/l126 0 2024-03-12T16:11:02.001 INFO:tasks.workunit.client.0.smithi006.stdout:3/900: truncate d8/d19/d31/dc4/f133 1033936 0 2024-03-12T16:11:02.003 INFO:tasks.workunit.client.0.smithi006.stdout:1/999: truncate d0/d25/d2a/f2d 3528451 0 2024-03-12T16:11:02.005 INFO:tasks.workunit.client.0.smithi006.stdout:5/883: fsync d7/d9/d31/d3b/d4f/fb7 0 2024-03-12T16:11:02.006 INFO:tasks.workunit.client.0.smithi006.stdout:3/901: mkdir d8/d19/d26/d97/d134 0 2024-03-12T16:11:02.011 INFO:tasks.workunit.client.0.smithi006.stdout:9/973: write d0/f87 [921205,73265] 0 2024-03-12T16:11:02.018 INFO:tasks.workunit.client.0.smithi006.stdout:5/884: rmdir d7/d9/d31/d3b/d4f/d11f 0 2024-03-12T16:11:02.023 INFO:tasks.workunit.client.0.smithi006.stdout:9/974: mknod d0/d8/c14b 0 2024-03-12T16:11:02.026 INFO:tasks.workunit.client.0.smithi006.stdout:5/885: dwrite d7/d9/d10/d35/f11b [0,4194304] 0 2024-03-12T16:11:02.028 INFO:tasks.workunit.client.0.smithi006.stdout:9/975: mkdir d0/d4/d3b/dff/d13b/d14c 0 2024-03-12T16:11:02.032 INFO:tasks.workunit.client.0.smithi006.stdout:5/886: fsync d7/d9/d31/d3b/d6b/db9/fbe 0 2024-03-12T16:11:02.036 INFO:tasks.workunit.client.0.smithi006.stdout:9/976: write d0/d8/d16/d7d/db5/f65 [403865,120886] 0 2024-03-12T16:11:02.040 INFO:tasks.workunit.client.0.smithi006.stdout:3/902: dwrite d8/d19/d26/d97/dce/fac [0,4194304] 0 2024-03-12T16:11:02.041 INFO:tasks.workunit.client.0.smithi006.stdout:5/887: rmdir d7/d9/d31/d3b/d4f/d80/d88 39 2024-03-12T16:11:02.044 INFO:tasks.workunit.client.0.smithi006.stdout:9/977: creat d0/d8/d16/dee/f14d x:0 0 0 2024-03-12T16:11:02.051 INFO:tasks.workunit.client.0.smithi006.stdout:3/903: getdents d8/d4c/db2 0 2024-03-12T16:11:02.055 INFO:tasks.workunit.client.0.smithi006.stdout:3/904: fsync d8/d131/dc/f10f 0 2024-03-12T16:11:02.064 INFO:tasks.workunit.client.0.smithi006.stdout:9/978: dread d0/d4/f25 [0,4194304] 0 2024-03-12T16:11:02.065 INFO:tasks.workunit.client.0.smithi006.stdout:9/979: truncate d0/d8/d16/d7d/d20/d100/f11c 1050154 0 2024-03-12T16:11:02.068 INFO:tasks.workunit.client.0.smithi006.stdout:9/980: creat d0/f14e x:0 0 0 2024-03-12T16:11:02.074 INFO:tasks.workunit.client.0.smithi006.stdout:9/981: dwrite d0/f14e [0,4194304] 0 2024-03-12T16:11:02.077 INFO:tasks.workunit.client.0.smithi006.stdout:9/982: rmdir d0/d4/d9b 39 2024-03-12T16:11:02.079 INFO:tasks.workunit.client.0.smithi006.stdout:9/983: mkdir d0/d4/d70/d86/d14f 0 2024-03-12T16:11:02.080 INFO:tasks.workunit.client.0.smithi006.stdout:9/984: chown d0/d8/d16/d7d/d20/d37 1 1 2024-03-12T16:11:02.083 INFO:tasks.workunit.client.0.smithi006.stdout:9/985: dread d0/d8/d16/d7d/d20/f61 [0,4194304] 0 2024-03-12T16:11:02.085 INFO:tasks.workunit.client.0.smithi006.stdout:9/986: read - d0/d8/d16/d7d/d20/d37/dc5/dcf/fe6 zero size 2024-03-12T16:11:02.088 INFO:tasks.workunit.client.0.smithi006.stdout:9/987: creat d0/d8/d80/dfd/d147/f150 x:0 0 0 2024-03-12T16:11:02.095 INFO:tasks.workunit.client.0.smithi006.stdout:9/988: dwrite d0/d8/d16/d2f/f4c [0,4194304] 0 2024-03-12T16:11:02.144 INFO:tasks.workunit.client.0.smithi006.stdout:5/888: fsync d7/d9/d31/d3b/d4f/d80/dea/f100 0 2024-03-12T16:11:02.144 INFO:tasks.workunit.client.0.smithi006.stdout:5/889: fdatasync d7/f123 0 2024-03-12T16:11:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.149+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2a810b810 con 0x7fc298066e10 2024-03-12T16:11:02.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.150+0000 7fc2a5ffb700 1 -- 172.21.15.6:0/1678627627 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fc2a810b810 con 0x7fc298066e10 2024-03-12T16:11:02.153 INFO:tasks.workunit.client.0.smithi006.stdout:9/989: write d0/d8/d16/d2f/f122 [2195950,7412] 0 2024-03-12T16:11:02.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.153+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc298066e10 msgr2=0x7fc2980692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:02.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.153+0000 7fc2aeb34700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc298066e10 0x7fc2980692d0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc294004f10 tx=0x7fc294009cb0).stop 2024-03-12T16:11:02.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.153+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2a8061260 msgr2=0x7fc2a8105fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:02.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.153+0000 7fc2aeb34700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2a8061260 0x7fc2a8105fd0 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fc29c00b4b0 tx=0x7fc29c0090f0).stop 2024-03-12T16:11:02.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.153+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 shutdown_connections 2024-03-12T16:11:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.153+0000 7fc2aeb34700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fc298066e10 0x7fc2980692d0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.153+0000 7fc2aeb34700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2a8061260 0x7fc2a8105fd0 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.153+0000 7fc2aeb34700 1 --2- 172.21.15.6:0/1678627627 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2a80faba0 0x7fc2a81064c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.153+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 >> 172.21.15.6:0/1678627627 conn(0x7fc2a80f2070 msgr2=0x7fc2a80f64e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.154+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 shutdown_connections 2024-03-12T16:11:02.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.154+0000 7fc2aeb34700 1 -- 172.21.15.6:0/1678627627 wait complete. 2024-03-12T16:11:02.167 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:11:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.276+0000 7f336486b700 1 -- 172.21.15.6:0/1145006082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33600fa950 msgr2=0x7f33600fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.276+0000 7f336486b700 1 --2- 172.21.15.6:0/1145006082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33600fa950 0x7f33600fcda0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f33540047f0 tx=0x7f3354009cb0).stop 2024-03-12T16:11:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.277+0000 7f336486b700 1 -- 172.21.15.6:0/1145006082 shutdown_connections 2024-03-12T16:11:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.277+0000 7f336486b700 1 --2- 172.21.15.6:0/1145006082 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33600fa950 0x7f33600fcda0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.277+0000 7f336486b700 1 --2- 172.21.15.6:0/1145006082 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3360061280 0x7f33600fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.277+0000 7f336486b700 1 -- 172.21.15.6:0/1145006082 >> 172.21.15.6:0/1145006082 conn(0x7f33600f1e50 msgr2=0x7f33600f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.277+0000 7f336486b700 1 -- 172.21.15.6:0/1145006082 shutdown_connections 2024-03-12T16:11:02.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.277+0000 7f336486b700 1 -- 172.21.15.6:0/1145006082 wait complete. 2024-03-12T16:11:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.277+0000 7f336486b700 1 Processor -- start 2024-03-12T16:11:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.277+0000 7f336486b700 1 -- start start 2024-03-12T16:11:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f336486b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3360061280 0x7f33600f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f336486b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33600fa950 0x7f33600f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f336486b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33600f8220 con 0x7f3360061280 2024-03-12T16:11:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f336486b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33600f67c0 con 0x7f33600fa950 2024-03-12T16:11:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f335e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3360061280 0x7f33600f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:02.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f335e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3360061280 0x7f33600f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41378/0 (socket says 172.21.15.6:41378) 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f335e59c700 1 -- 172.21.15.6:0/2579766988 learned_addr learned my addr 172.21.15.6:0/2579766988 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f335dd9b700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33600fa950 0x7f33600f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f335e59c700 1 -- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33600fa950 msgr2=0x7f33600f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f335e59c700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33600fa950 0x7f33600f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f335e59c700 1 -- 172.21.15.6:0/2579766988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3354005040 con 0x7f3360061280 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f335dd9b700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33600fa950 0x7f33600f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f335e59c700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3360061280 0x7f33600f7c70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f335000e8f0 tx=0x7f335000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f334f7fe700 1 -- 172.21.15.6:0/2579766988 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3350007b40 con 0x7f3360061280 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f334f7fe700 1 -- 172.21.15.6:0/2579766988 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f335000f040 con 0x7f3360061280 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33600f6a40 con 0x7f3360061280 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.278+0000 7f334f7fe700 1 -- 172.21.15.6:0/2579766988 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3350014880 con 0x7f3360061280 2024-03-12T16:11:02.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.279+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33600f7000 con 0x7f3360061280 2024-03-12T16:11:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.279+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33600fffb0 con 0x7f3360061280 2024-03-12T16:11:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.280+0000 7f334f7fe700 1 -- 172.21.15.6:0/2579766988 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f3350009090 con 0x7f3360061280 2024-03-12T16:11:02.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.281+0000 7f334f7fe700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3348066dc0 0x7f3348069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.281+0000 7f334f7fe700 1 -- 172.21.15.6:0/2579766988 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f33500846a0 con 0x7f3360061280 2024-03-12T16:11:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.281+0000 7f335dd9b700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3348066dc0 0x7f3348069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:02.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.281+0000 7f335dd9b700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3348066dc0 0x7f3348069280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f33540047c0 tx=0x7f3354009cb0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:02.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.285+0000 7f334f7fe700 1 -- 172.21.15.6:0/2579766988 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f33500527c0 con 0x7f3360061280 2024-03-12T16:11:02.380 INFO:tasks.workunit.client.0.smithi006.stdout:8/973: sync 2024-03-12T16:11:02.381 INFO:tasks.workunit.client.0.smithi006.stdout:8/974: fdatasync d2/d11/fa9 0 2024-03-12T16:11:02.461 INFO:tasks.workunit.client.0.smithi006.stdout:8/975: truncate d2/db/d1a/d21/dad/f74 3030741 0 2024-03-12T16:11:02.462 INFO:tasks.workunit.client.0.smithi006.stdout:8/976: write d2/db/d1a/d23/fe8 [8433,88646] 0 2024-03-12T16:11:02.465 INFO:tasks.workunit.client.0.smithi006.stdout:8/977: mkdir d2/db/d1a/d21/dad/d130/d135 0 2024-03-12T16:11:02.468 INFO:tasks.workunit.client.0.smithi006.stdout:8/978: creat d2/db/dfe/f136 x:0 0 0 2024-03-12T16:11:02.469 INFO:tasks.workunit.client.0.smithi006.stdout:8/979: mknod d2/d55/c137 0 2024-03-12T16:11:02.472 INFO:tasks.workunit.client.0.smithi006.stdout:8/980: dread d2/db/d70/f114 [0,4194304] 0 2024-03-12T16:11:02.476 INFO:tasks.workunit.client.0.smithi006.stdout:8/981: dread d2/db/f100 [0,4194304] 0 2024-03-12T16:11:02.479 INFO:tasks.workunit.client.0.smithi006.stdout:8/982: creat d2/db/d1a/d21/d2b/da2/dbc/f138 x:0 0 0 2024-03-12T16:11:02.481 INFO:tasks.workunit.client.0.smithi006.stdout:8/983: creat d2/db/d1a/d21/d4f/da7/f139 x:0 0 0 2024-03-12T16:11:02.483 INFO:tasks.workunit.client.0.smithi006.stdout:8/984: symlink d2/d11/d5a/l13a 0 2024-03-12T16:11:02.485 INFO:tasks.workunit.client.0.smithi006.stdout:8/985: chown d2/db/d1a/d21/d2b/da2/dbc/f138 99709 1 2024-03-12T16:11:02.486 INFO:tasks.workunit.client.0.smithi006.stdout:8/986: chown d2/db/d1a/d21/d2b/da2/dbc/ffc 288994 1 2024-03-12T16:11:02.487 INFO:tasks.workunit.client.0.smithi006.stdout:8/987: write d2/db/d1a/d23/f11c [404241,70070] 0 2024-03-12T16:11:02.489 INFO:tasks.workunit.client.0.smithi006.stdout:8/988: rename d2/db to d2/db/d122/d129/d13b 22 2024-03-12T16:11:02.490 INFO:tasks.workunit.client.0.smithi006.stdout:8/989: write d2/db/f24 [382867,127266] 0 2024-03-12T16:11:02.495 INFO:tasks.workunit.client.0.smithi006.stdout:8/990: link d2/dab/fe5 d2/db/dfe/d110/f13c 0 2024-03-12T16:11:02.505 INFO:tasks.workunit.client.0.smithi006.stdout:8/991: dwrite d2/db/d70/f9c [0,4194304] 0 2024-03-12T16:11:02.522 INFO:tasks.workunit.client.0.smithi006.stdout:8/992: write d2/d32/fbe [332769,114347] 0 2024-03-12T16:11:02.538 INFO:tasks.workunit.client.0.smithi006.stdout:6/929: sync 2024-03-12T16:11:02.538 INFO:tasks.workunit.client.0.smithi006.stdout:3/905: sync 2024-03-12T16:11:02.541 INFO:tasks.workunit.client.0.smithi006.stdout:6/930: mkdir d3/d11/d3b/db4/d145 0 2024-03-12T16:11:02.546 INFO:tasks.workunit.client.0.smithi006.stdout:6/931: creat d3/d11/d10/da7/d8e/f146 x:0 0 0 2024-03-12T16:11:02.547 INFO:tasks.workunit.client.0.smithi006.stdout:3/906: getdents d8/ddc/df5 0 2024-03-12T16:11:02.548 INFO:tasks.workunit.client.0.smithi006.stdout:6/932: dread - d3/d11/d3b/db4/dc3/f11d zero size 2024-03-12T16:11:02.549 INFO:tasks.workunit.client.0.smithi006.stdout:3/907: write d8/d19/fa7 [1121709,32757] 0 2024-03-12T16:11:02.552 INFO:tasks.workunit.client.0.smithi006.stdout:6/933: mknod d3/d11/d3b/d59/c147 0 2024-03-12T16:11:02.554 INFO:tasks.workunit.client.0.smithi006.stdout:3/908: creat d8/d131/dc/d28/d2f/df6/f135 x:0 0 0 2024-03-12T16:11:02.556 INFO:tasks.workunit.client.0.smithi006.stdout:6/934: truncate d3/d11/d10/da7/f81 4417542 0 2024-03-12T16:11:02.558 INFO:tasks.workunit.client.0.smithi006.stdout:6/935: truncate d3/d11/d43/dd1/f120 750199 0 2024-03-12T16:11:02.560 INFO:tasks.workunit.client.0.smithi006.stdout:3/909: truncate d8/d4c/dd8/fd6 454685 0 2024-03-12T16:11:02.567 INFO:tasks.workunit.client.0.smithi006.stdout:3/910: rename d8/d52/d6c to d8/d131/d41/da1/d116/d136 0 2024-03-12T16:11:02.577 INFO:tasks.workunit.client.0.smithi006.stdout:6/936: dread d3/d11/d10/da7/d8e/d8b/f13e [0,4194304] 0 2024-03-12T16:11:02.580 INFO:tasks.workunit.client.0.smithi006.stdout:6/937: dread - d3/d11/d10/da7/d8e/de1/dfe/f105 zero size 2024-03-12T16:11:02.598 INFO:tasks.workunit.client.0.smithi006.stdout:3/911: dread d8/d19/d26/d97/dce/fdb [0,4194304] 0 2024-03-12T16:11:02.601 INFO:tasks.workunit.client.0.smithi006.stdout:3/912: rmdir d8/d19/d26 39 2024-03-12T16:11:02.605 INFO:tasks.workunit.client.0.smithi006.stdout:3/913: rmdir d8/d19/d26 39 2024-03-12T16:11:02.607 INFO:tasks.workunit.client.0.smithi006.stdout:6/938: dread d3/d11/d10/d1b/d20/f68 [0,4194304] 0 2024-03-12T16:11:02.609 INFO:tasks.workunit.client.0.smithi006.stdout:3/914: fsync d8/d131/dc/d28/d2f/df6/f103 0 2024-03-12T16:11:02.611 INFO:tasks.workunit.client.0.smithi006.stdout:3/915: write d8/d4c/db2/fbf [847401,69489] 0 2024-03-12T16:11:02.618 INFO:tasks.workunit.client.0.smithi006.stdout:6/939: rename d3/d11/d3b/d59 to d3/d11/d10/da7/dd5/ddb/de6/d148 0 2024-03-12T16:11:02.621 INFO:tasks.workunit.client.0.smithi006.stdout:6/940: creat d3/d11/d10/d28/f149 x:0 0 0 2024-03-12T16:11:02.625 INFO:tasks.workunit.client.0.smithi006.stdout:6/941: mkdir d3/d11/d10/d1b/d20/d14a 0 2024-03-12T16:11:02.628 INFO:tasks.workunit.client.0.smithi006.stdout:3/916: dread d8/d131/dc/d28/d2f/f94 [0,4194304] 0 2024-03-12T16:11:02.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.628+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3360059120 con 0x7f3348066dc0 2024-03-12T16:11:02.631 INFO:tasks.workunit.client.0.smithi006.stdout:3/917: creat d8/ddc/df5/f137 x:0 0 0 2024-03-12T16:11:02.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.629+0000 7f334f7fe700 1 -- 172.21.15.6:0/2579766988 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7f3360059120 con 0x7f3348066dc0 2024-03-12T16:11:02.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.631+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3348066dc0 msgr2=0x7f3348069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.631+0000 7f336486b700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3348066dc0 0x7f3348069280 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7f33540047c0 tx=0x7f3354009cb0).stop 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.631+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3360061280 msgr2=0x7f33600f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.631+0000 7f336486b700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3360061280 0x7f33600f7c70 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f335000e8f0 tx=0x7f335000b040).stop 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.631+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 shutdown_connections 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.631+0000 7f336486b700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3348066dc0 0x7f3348069280 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.631+0000 7f336486b700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3360061280 0x7f33600f7c70 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.632+0000 7f336486b700 1 --2- 172.21.15.6:0/2579766988 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33600fa950 0x7f33600f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.632+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 >> 172.21.15.6:0/2579766988 conn(0x7f33600f1e50 msgr2=0x7f33600f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.632+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 shutdown_connections 2024-03-12T16:11:02.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.632+0000 7f336486b700 1 -- 172.21.15.6:0/2579766988 wait complete. 2024-03-12T16:11:02.635 INFO:tasks.workunit.client.0.smithi006.stdout:3/918: mkdir d8/d131/d41/d8b/d93/d138 0 2024-03-12T16:11:02.638 INFO:tasks.workunit.client.0.smithi006.stdout:3/919: mkdir d8/ddc/df5/dfa/d139 0 2024-03-12T16:11:02.639 INFO:tasks.workunit.client.0.smithi006.stdout:6/942: write d3/d11/d10/d1b/d6e/d80/d9b/f141 [757875,39399] 0 2024-03-12T16:11:02.642 INFO:tasks.workunit.client.0.smithi006.stdout:3/920: mkdir d8/d131/d41/d45/d13a 0 2024-03-12T16:11:02.643 INFO:tasks.workunit.client.0.smithi006.stdout:6/943: creat d3/d11/d10/d28/f14b x:0 0 0 2024-03-12T16:11:02.643 INFO:tasks.workunit.client.0.smithi006.stdout:3/921: read - d8/d19/fa3 zero size 2024-03-12T16:11:02.646 INFO:tasks.workunit.client.0.smithi006.stdout:3/922: creat d8/d4c/f13b x:0 0 0 2024-03-12T16:11:02.647 INFO:tasks.workunit.client.0.smithi006.stdout:6/944: fdatasync d3/d11/d10/da7/d8e/de1/d60/d108/d12d/db0/f116 0 2024-03-12T16:11:02.651 INFO:tasks.workunit.client.0.smithi006.stdout:3/923: truncate d8/d131/fcd 68912 0 2024-03-12T16:11:02.655 INFO:tasks.workunit.client.0.smithi006.stdout:6/945: creat d3/d11/d10/da7/d8e/d8b/f14c x:0 0 0 2024-03-12T16:11:02.656 INFO:tasks.workunit.client.0.smithi006.stdout:9/990: sync 2024-03-12T16:11:02.656 INFO:tasks.workunit.client.0.smithi006.stdout:5/890: sync 2024-03-12T16:11:02.657 INFO:tasks.workunit.client.0.smithi006.stdout:3/924: mknod d8/d131/dc/d28/d2f/df6/c13c 0 2024-03-12T16:11:02.658 INFO:tasks.workunit.client.0.smithi006.stdout:3/925: chown d8/d131/d41/ffb 78351 1 2024-03-12T16:11:02.658 INFO:tasks.workunit.client.0.smithi006.stdout:5/891: rmdir d7/d41 39 2024-03-12T16:11:02.661 INFO:tasks.workunit.client.0.smithi006.stdout:5/892: truncate d7/d9/d31/d3b/d4f/d65/de1/ff0 885289 0 2024-03-12T16:11:02.662 INFO:tasks.workunit.client.0.smithi006.stdout:6/946: creat d3/d11/d10/da7/d8e/de1/d60/d7e/d131/f14d x:0 0 0 2024-03-12T16:11:02.664 INFO:tasks.workunit.client.0.smithi006.stdout:9/991: symlink d0/d1f/l151 0 2024-03-12T16:11:02.665 INFO:tasks.workunit.client.0.smithi006.stdout:3/926: mknod d8/d131/d41/da1/d116/d136/c13d 0 2024-03-12T16:11:02.667 INFO:tasks.workunit.client.0.smithi006.stdout:3/927: write d8/d52/fb9 [1183599,17882] 0 2024-03-12T16:11:02.667 INFO:tasks.workunit.client.0.smithi006.stdout:5/893: truncate d7/d9/d10/d24/fa7 867232 0 2024-03-12T16:11:02.670 INFO:tasks.workunit.client.0.smithi006.stdout:6/947: creat d3/d11/d10/da7/d8e/f14e x:0 0 0 2024-03-12T16:11:02.673 INFO:tasks.workunit.client.0.smithi006.stdout:3/928: symlink d8/d4c/d7c/l13e 0 2024-03-12T16:11:02.674 INFO:tasks.workunit.client.0.smithi006.stdout:5/894: mknod d7/d9/d31/d3b/d4f/d65/c127 0 2024-03-12T16:11:02.674 INFO:tasks.workunit.client.0.smithi006.stdout:6/948: write d3/d11/d10/da7/d8e/de1/d60/d7e/d131/fa0 [4529233,39212] 0 2024-03-12T16:11:02.681 INFO:tasks.workunit.client.0.smithi006.stdout:9/992: dread d0/d4/ff9 [0,4194304] 0 2024-03-12T16:11:02.682 INFO:tasks.workunit.client.0.smithi006.stdout:3/929: symlink d8/df2/l13f 0 2024-03-12T16:11:02.690 INFO:tasks.workunit.client.0.smithi006.stdout:5/895: symlink d7/d9/d31/d3b/d4f/d80/l128 0 2024-03-12T16:11:02.691 INFO:tasks.workunit.client.0.smithi006.stdout:5/896: write d7/d9/d47/f11c [398259,120544] 0 2024-03-12T16:11:02.692 INFO:tasks.workunit.client.0.smithi006.stdout:9/993: creat d0/d8/d16/d7d/f152 x:0 0 0 2024-03-12T16:11:02.699 INFO:tasks.workunit.client.0.smithi006.stdout:3/930: chown d8/d19/d26/d59/cbe 362219 1 2024-03-12T16:11:02.710 INFO:tasks.workunit.client.0.smithi006.stdout:9/994: rename d0/d8/d16/d7d/d20/f112 to d0/d8/d16/d7d/d20/d37/dc5/dcf/f153 0 2024-03-12T16:11:02.710 INFO:tasks.workunit.client.0.smithi006.stdout:9/995: stat d0/d8/d80/dfd 0 2024-03-12T16:11:02.710 INFO:tasks.workunit.client.0.smithi006.stdout:6/949: truncate d3/f1c 846266 0 2024-03-12T16:11:02.711 INFO:tasks.workunit.client.0.smithi006.stdout:3/931: fsync d8/d131/dc/d28/d2f/df6/f72 0 2024-03-12T16:11:02.713 INFO:tasks.workunit.client.0.smithi006.stdout:8/993: sync 2024-03-12T16:11:02.713 INFO:tasks.workunit.client.0.smithi006.stdout:5/897: creat d7/d9/d31/d3b/d4f/d9e/ddb/d104/d125/f129 x:0 0 0 2024-03-12T16:11:02.714 INFO:tasks.workunit.client.0.smithi006.stdout:8/994: fdatasync d2/db/d1a/d7a/faf 0 2024-03-12T16:11:02.715 INFO:tasks.workunit.client.0.smithi006.stdout:5/898: fdatasync d7/d8/d8a/d92/fdf 0 2024-03-12T16:11:02.715 INFO:tasks.workunit.client.0.smithi006.stdout:9/996: readlink d0/d8/l5 0 2024-03-12T16:11:02.717 INFO:tasks.workunit.client.0.smithi006.stdout:5/899: readlink d7/d9/d47/d56/d79/l93 0 2024-03-12T16:11:02.720 INFO:tasks.workunit.client.0.smithi006.stdout:6/950: mknod d3/d11/d10/da7/d8e/de1/d60/d108/c14f 0 2024-03-12T16:11:02.722 INFO:tasks.workunit.client.0.smithi006.stdout:3/932: symlink d8/d19/d26/d97/dce/l140 0 2024-03-12T16:11:02.727 INFO:tasks.workunit.client.0.smithi006.stdout:8/995: fsync d2/db/d1a/d7a/dcc/fce 0 2024-03-12T16:11:02.728 INFO:tasks.workunit.client.0.smithi006.stdout:9/997: mkdir d0/d4/d70/d86/d154 0 2024-03-12T16:11:02.729 INFO:tasks.workunit.client.0.smithi006.stdout:3/933: dwrite d8/d19/d31/f10c [0,4194304] 0 2024-03-12T16:11:02.730 INFO:tasks.workunit.client.0.smithi006.stdout:8/996: chown d2/d55/d7b/db8/c128 18810690 1 2024-03-12T16:11:02.730 INFO:tasks.workunit.client.0.smithi006.stdout:6/951: creat d3/d11/d10/d9a/f150 x:0 0 0 2024-03-12T16:11:02.733 INFO:tasks.workunit.client.0.smithi006.stdout:9/998: write d0/d8/d16/d7d/db5/f65 [222121,34786] 0 2024-03-12T16:11:02.741 INFO:tasks.workunit.client.0.smithi006.stdout:3/934: creat d8/d131/d41/d45/f141 x:0 0 0 2024-03-12T16:11:02.741 INFO:tasks.workunit.client.0.smithi006.stdout:3/935: truncate d8/d131/dc/d28/d2f/d9d/f11b 391159 0 2024-03-12T16:11:02.742 INFO:tasks.workunit.client.0.smithi006.stdout:6/952: mkdir d3/d11/d10/d1b/d6e/d80/d9b/d151 0 2024-03-12T16:11:02.744 INFO:tasks.workunit.client.0.smithi006.stdout:9/999: truncate d0/d8/d16/d2f/fa5 22340 0 2024-03-12T16:11:02.747 INFO:tasks.workunit.client.0.smithi006.stdout:8/997: link d2/db/d1a/d21/d4f/f56 d2/db/d122/d129/f13d 0 2024-03-12T16:11:02.748 INFO:tasks.workunit.client.0.smithi006.stdout:3/936: mkdir d8/d131/d41/da1/d116/d142 0 2024-03-12T16:11:02.751 INFO:tasks.workunit.client.0.smithi006.stdout:6/953: creat d3/d11/d10/da7/dd5/f152 x:0 0 0 2024-03-12T16:11:02.754 INFO:tasks.workunit.client.0.smithi006.stdout:8/998: dread d2/d55/f71 [0,4194304] 0 2024-03-12T16:11:02.755 INFO:tasks.workunit.client.0.smithi006.stdout:6/954: readlink d3/d11/d10/da7/d8e/de1/d60/d108/d12d/l126 0 2024-03-12T16:11:02.756 INFO:tasks.workunit.client.0.smithi006.stdout:8/999: chown d2/db/d1a/d7a/f124 1 1 2024-03-12T16:11:02.763 INFO:tasks.workunit.client.0.smithi006.stdout:6/955: getdents d3/d11 0 2024-03-12T16:11:02.765 INFO:tasks.workunit.client.0.smithi006.stdout:3/937: dread d8/d19/d26/feb [0,4194304] 0 2024-03-12T16:11:02.766 INFO:tasks.workunit.client.0.smithi006.stdout:6/956: creat d3/d11/d10/da7/d12c/f153 x:0 0 0 2024-03-12T16:11:02.768 INFO:tasks.workunit.client.0.smithi006.stdout:3/938: creat d8/df2/f143 x:0 0 0 2024-03-12T16:11:02.770 INFO:tasks.workunit.client.0.smithi006.stdout:3/939: symlink d8/d52/d9e/l144 0 2024-03-12T16:11:02.772 INFO:tasks.workunit.client.0.smithi006.stdout:3/940: truncate d8/d4c/dd8/f12f 775462 0 2024-03-12T16:11:02.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.775+0000 7fb044152700 1 -- 172.21.15.6:0/3468229023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f66f0 msgr2=0x7fb03c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:02.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.775+0000 7fb044152700 1 --2- 172.21.15.6:0/3468229023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f66f0 0x7fb03c0f6b10 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7fb0380047f0 tx=0x7fb038009cb0).stop 2024-03-12T16:11:02.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.775+0000 7fb044152700 1 -- 172.21.15.6:0/3468229023 shutdown_connections 2024-03-12T16:11:02.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.775+0000 7fb044152700 1 --2- 172.21.15.6:0/3468229023 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb03c0f7000 0x7fb03c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.775+0000 7fb044152700 1 --2- 172.21.15.6:0/3468229023 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f66f0 0x7fb03c0f6b10 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.775+0000 7fb044152700 1 -- 172.21.15.6:0/3468229023 >> 172.21.15.6:0/3468229023 conn(0x7fb03c0f1ef0 msgr2=0x7fb03c0f4310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:02.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.775+0000 7fb044152700 1 -- 172.21.15.6:0/3468229023 shutdown_connections 2024-03-12T16:11:02.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.775+0000 7fb044152700 1 -- 172.21.15.6:0/3468229023 wait complete. 2024-03-12T16:11:02.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb044152700 1 Processor -- start 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb044152700 1 -- start start 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb044152700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb03c0f66f0 0x7fb03c10e900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb044152700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f7000 0x7fb03c10edf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb044152700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c10f3a0 con 0x7fb03c0f7000 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb044152700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb03c10f4e0 con 0x7fb03c0f66f0 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb0416ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f7000 0x7fb03c10edf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb0416ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f7000 0x7fb03c10edf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50254/0 (socket says 172.21.15.6:50254) 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb041eee700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb03c0f66f0 0x7fb03c10e900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.776+0000 7fb0416ed700 1 -- 172.21.15.6:0/1796259211 learned_addr learned my addr 172.21.15.6:0/1796259211 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.777+0000 7fb0416ed700 1 -- 172.21.15.6:0/1796259211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb03c0f66f0 msgr2=0x7fb03c10e900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.777+0000 7fb0416ed700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb03c0f66f0 0x7fb03c10e900 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.777+0000 7fb0416ed700 1 -- 172.21.15.6:0/1796259211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb038005040 con 0x7fb03c0f7000 2024-03-12T16:11:02.779 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.777+0000 7fb0416ed700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f7000 0x7fb03c10edf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fb02c0041d0 tx=0x7fb02c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.779+0000 7fb032ffd700 1 -- 172.21.15.6:0/1796259211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb02c007b40 con 0x7fb03c0f7000 2024-03-12T16:11:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.779+0000 7fb032ffd700 1 -- 172.21.15.6:0/1796259211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb02c00f040 con 0x7fb03c0f7000 2024-03-12T16:11:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.779+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb03c113f80 con 0x7fb03c0f7000 2024-03-12T16:11:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.779+0000 7fb032ffd700 1 -- 172.21.15.6:0/1796259211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb02c0147b0 con 0x7fb03c0f7000 2024-03-12T16:11:02.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.779+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb03c1144b0 con 0x7fb03c0f7000 2024-03-12T16:11:02.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.780+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb03c0607e0 con 0x7fb03c0f7000 2024-03-12T16:11:02.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.781+0000 7fb032ffd700 1 -- 172.21.15.6:0/1796259211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fb02c009110 con 0x7fb03c0f7000 2024-03-12T16:11:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.782+0000 7fb032ffd700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb028066dc0 0x7fb028069280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.782+0000 7fb032ffd700 1 -- 172.21.15.6:0/1796259211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fb02c084360 con 0x7fb03c0f7000 2024-03-12T16:11:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.782+0000 7fb041eee700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb028066dc0 0x7fb028069280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:02.784 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.783+0000 7fb041eee700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb028066dc0 0x7fb028069280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb038004f10 tx=0x7fb03800b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:02.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:02.787+0000 7fb032ffd700 1 -- 172.21.15.6:0/1796259211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fb02c052400 con 0x7fb03c0f7000 2024-03-12T16:11:03.030 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:02 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:01.502756+0000 mgr.smithi134.gcntfu (mgr.24383) 68 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 124 MiB/s rd, 294 MiB/s wr, 638 op/s 2024-03-12T16:11:03.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.038+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb03c103fa0 con 0x7fb028066dc0 2024-03-12T16:11:03.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.050+0000 7fb032ffd700 1 -- 172.21.15.6:0/1796259211 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7fb03c103fa0 con 0x7fb028066dc0 2024-03-12T16:11:03.052 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:11:03.052 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 starting - - - - 2024-03-12T16:11:03.052 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (8m) 70s ago 8m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:11:03.052 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (8m) 72s ago 8m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:11:03.052 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (6m) 70s ago 8m 53.7M - 8.3.5 dad864ee21e9 7deda4319993 2024-03-12T16:11:03.052 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (3m) 70s ago 3m 86.1M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:11:03.052 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (3m) 70s ago 3m 12.7M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (3m) 72s ago 3m 56.5M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (3m) 72s ago 3m 15.3M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:9283 running (10m) 70s ago 10m 358M - 16.2.15-1-g8963e9de 727f386679cb f09ce35a51f8 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283 running (88s) 72s ago 8m 477M - 18.2.2-797-g49e4a679 72a574b3d6f5 4b7738c64f1d 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (10m) 70s ago 10m 47.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (8m) 72s ago 8m 40.3M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (8m) 70s ago 8m 21.5M - 1.3.1 1dbe0e931976 ef9d95e31974 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 72s ago 7m 23.0M - 1.3.1 1dbe0e931976 ee7621f16bde 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (7m) 70s ago 7m 81.0M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (7m) 70s ago 7m 87.9M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (6m) 70s ago 6m 74.3M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (6m) 72s ago 6m 84.5M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:11:03.053 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (5m) 72s ago 5m 83.7M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:11:03.054 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (5m) 72s ago 5m 78.8M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:11:03.054 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (7m) 72s ago 7m 66.2M - 2.33.4 514e6a882f6e 344ddc812ba0 2024-03-12T16:11:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb028066dc0 msgr2=0x7fb028069280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb028066dc0 0x7fb028069280 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fb038004f10 tx=0x7fb03800b040).stop 2024-03-12T16:11:03.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f7000 msgr2=0x7fb03c10edf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:03.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f7000 0x7fb03c10edf0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fb02c0041d0 tx=0x7fb02c009f60).stop 2024-03-12T16:11:03.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 shutdown_connections 2024-03-12T16:11:03.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb028066dc0 0x7fb028069280 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb03c0f66f0 0x7fb03c10e900 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 --2- 172.21.15.6:0/1796259211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb03c0f7000 0x7fb03c10edf0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 >> 172.21.15.6:0/1796259211 conn(0x7fb03c0f1ef0 msgr2=0x7fb03c102880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:03.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 shutdown_connections 2024-03-12T16:11:03.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.053+0000 7fb044152700 1 -- 172.21.15.6:0/1796259211 wait complete. 2024-03-12T16:11:03.057 INFO:tasks.workunit.client.0.smithi006.stdout:5/900: sync 2024-03-12T16:11:03.061 INFO:tasks.workunit.client.0.smithi006.stdout:5/901: mkdir d7/d9/d31/d3b/d6b/db9/d12a 0 2024-03-12T16:11:03.063 INFO:tasks.workunit.client.0.smithi006.stdout:5/902: write d7/f118 [916979,3774] 0 2024-03-12T16:11:03.069 INFO:tasks.workunit.client.0.smithi006.stdout:5/903: rename d7/d9/d31/d3b/dba/f116 to d7/d9/d31/d3b/d4f/d9e/ddb/d104/d125/f12b 0 2024-03-12T16:11:03.073 INFO:tasks.workunit.client.0.smithi006.stdout:5/904: symlink d7/d9/d47/d56/l12c 0 2024-03-12T16:11:03.079 INFO:tasks.workunit.client.0.smithi006.stdout:5/905: dwrite d7/d9/d31/ded/fe6 [0,4194304] 0 2024-03-12T16:11:03.083 INFO:tasks.workunit.client.0.smithi006.stdout:5/906: mknod d7/d9/d31/d3b/d6b/c12d 0 2024-03-12T16:11:03.086 INFO:tasks.workunit.client.0.smithi006.stdout:5/907: write d7/d8/f10c [329507,111315] 0 2024-03-12T16:11:03.097 INFO:tasks.workunit.client.0.smithi006.stdout:5/908: getdents d7/d9/d31/d3b/d4f/d65/de1 0 2024-03-12T16:11:03.101 INFO:tasks.workunit.client.0.smithi006.stdout:5/909: mknod d7/d9/c12e 0 2024-03-12T16:11:03.104 INFO:tasks.workunit.client.0.smithi006.stdout:5/910: mkdir d7/d9/d31/d3b/d61/dd3/d12f 0 2024-03-12T16:11:03.111 INFO:tasks.workunit.client.0.smithi006.stdout:5/911: link d7/d9/d47/fc1 d7/d9/d31/d3b/d6b/f130 0 2024-03-12T16:11:03.118 INFO:tasks.workunit.client.0.smithi006.stdout:5/912: rename d7/d9/d31/fe9 to d7/d9/d31/d3b/d4f/d9e/ddb/d104/f131 0 2024-03-12T16:11:03.120 INFO:tasks.workunit.client.0.smithi006.stdout:5/913: creat d7/d8/d91/f132 x:0 0 0 2024-03-12T16:11:03.120 INFO:tasks.workunit.client.0.smithi006.stdout:5/914: chown d7/d9 37089 1 2024-03-12T16:11:03.129 INFO:tasks.workunit.client.0.smithi006.stdout:5/915: mknod d7/d9/d31/d3b/d4f/d9e/d103/c133 0 2024-03-12T16:11:03.137 INFO:tasks.workunit.client.0.smithi006.stdout:5/916: link d7/d8/c40 d7/d9/d31/d3b/d4f/d9e/d103/c134 0 2024-03-12T16:11:03.141 INFO:tasks.workunit.client.0.smithi006.stdout:5/917: mknod d7/d9/d31/d3b/d61/dd3/d12f/c135 0 2024-03-12T16:11:03.144 INFO:tasks.workunit.client.0.smithi006.stdout:5/918: read d7/d41/f5a [2462464,20552] 0 2024-03-12T16:11:03.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:02 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:01.502756+0000 mgr.smithi134.gcntfu (mgr.24383) 68 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 124 MiB/s rd, 294 MiB/s wr, 638 op/s 2024-03-12T16:11:03.149 INFO:tasks.workunit.client.0.smithi006.stdout:5/919: link d7/d9/d31/d3b/d4f/l8d d7/d8/d8a/d92/l136 0 2024-03-12T16:11:03.152 INFO:tasks.workunit.client.0.smithi006.stdout:5/920: symlink d7/d9/d31/d3b/d4f/d80/d88/l137 0 2024-03-12T16:11:03.156 INFO:tasks.workunit.client.0.smithi006.stdout:5/921: mkdir d7/d9/d31/d3b/d4f/d65/de1/d138 0 2024-03-12T16:11:03.159 INFO:tasks.workunit.client.0.smithi006.stdout:5/922: symlink d7/d41/l139 0 2024-03-12T16:11:03.161 INFO:tasks.workunit.client.0.smithi006.stdout:5/923: rmdir d7/d9/d31/ded 39 2024-03-12T16:11:03.162 INFO:tasks.workunit.client.0.smithi006.stdout:5/924: write d7/f118 [877109,31840] 0 2024-03-12T16:11:03.163 INFO:tasks.workunit.client.0.smithi006.stdout:5/925: chown d7/d9/d10/d24 1213 1 2024-03-12T16:11:03.168 INFO:tasks.workunit.client.0.smithi006.stdout:5/926: creat d7/d9/d31/d3b/d6b/f13a x:0 0 0 2024-03-12T16:11:03.172 INFO:tasks.workunit.client.0.smithi006.stdout:5/927: symlink d7/d9/d47/d56/dc4/l13b 0 2024-03-12T16:11:03.187 INFO:tasks.workunit.client.0.smithi006.stdout:3/941: sync 2024-03-12T16:11:03.187 INFO:tasks.workunit.client.0.smithi006.stdout:6/957: sync 2024-03-12T16:11:03.189 INFO:tasks.workunit.client.0.smithi006.stdout:5/928: write d7/d9/d31/f46 [955821,37384] 0 2024-03-12T16:11:03.194 INFO:tasks.workunit.client.0.smithi006.stdout:3/942: rename d8/d131/d41/da1/ca4 to d8/d131/d41/d45/d110/c145 0 2024-03-12T16:11:03.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.192+0000 7f3b9a57b700 1 -- 172.21.15.6:0/2213069510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b940f8e50 msgr2=0x7f3b940f9270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:03.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.192+0000 7f3b9a57b700 1 --2- 172.21.15.6:0/2213069510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b940f8e50 0x7f3b940f9270 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f3b7c0047f0 tx=0x7f3b7c009cb0).stop 2024-03-12T16:11:03.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.192+0000 7f3b9a57b700 1 -- 172.21.15.6:0/2213069510 shutdown_connections 2024-03-12T16:11:03.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.192+0000 7f3b9a57b700 1 --2- 172.21.15.6:0/2213069510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940f97f0 0x7f3b940f5970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:11:03.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.192+0000 7f3b9a57b700 1 --2- 172.21.15.6:0/2213069510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b940f8e50 0x7f3b940f9270 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.192+0000 7f3b9a57b700 1 -- 172.21.15.6:0/2213069510 >> 172.21.15.6:0/2213069510 conn(0x7f3b940f15d0 msgr2=0x7f3b940f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.192+0000 7f3b9a57b700 1 -- 172.21.15.6:0/2213069510 shutdown_connections 2024-03-12T16:11:03.195 INFO:tasks.workunit.client.0.smithi006.stdout:6/958: link d3/d11/d10/d28/f14b d3/d11/d10/d1b/d6e/d96/f154 0 2024-03-12T16:11:03.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.194+0000 7f3b9a57b700 1 -- 172.21.15.6:0/2213069510 wait complete. 2024-03-12T16:11:03.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.194+0000 7f3b9a57b700 1 Processor -- start 2024-03-12T16:11:03.196 INFO:tasks.workunit.client.0.smithi006.stdout:5/929: rmdir d7/d9/d47/d56/d79 39 2024-03-12T16:11:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.195+0000 7f3b9a57b700 1 -- start start 2024-03-12T16:11:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.195+0000 7f3b9a57b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b940f8e50 0x7f3b940f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.195+0000 7f3b9a57b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940f97f0 0x7f3b940f6ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.195+0000 7f3b9a57b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9410bd30 con 0x7f3b940f97f0 2024-03-12T16:11:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.195+0000 7f3b9a57b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3b9410be70 con 0x7f3b940f8e50 2024-03-12T16:11:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.195+0000 7f3b8b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940f97f0 0x7f3b940f6ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:03.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.195+0000 7f3b8b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940f97f0 0x7f3b940f6ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50270/0 (socket says 172.21.15.6:50270) 2024-03-12T16:11:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.195+0000 7f3b8b7fe700 1 -- 172.21.15.6:0/115683132 learned_addr learned my addr 172.21.15.6:0/115683132 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.195+0000 7f3b93fff700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b940f8e50 0x7f3b940f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:03.198 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.196+0000 7f3b93fff700 1 -- 172.21.15.6:0/115683132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940f97f0 msgr2=0x7f3b940f6ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.196+0000 7f3b93fff700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940f97f0 0x7f3b940f6ba0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.196+0000 7f3b93fff700 1 -- 172.21.15.6:0/115683132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3b7c005040 con 0x7f3b940f8e50 2024-03-12T16:11:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.196+0000 7f3b8b7fe700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940f97f0 0x7f3b940f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:11:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.196+0000 7f3b93fff700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b940f8e50 0x7f3b940f8540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3b7c000c00 tx=0x7f3b7c009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.197+0000 7f3b91ffb700 1 -- 172.21.15.6:0/115683132 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b7c00e030 con 0x7f3b940f8e50 2024-03-12T16:11:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.197+0000 7f3b91ffb700 1 -- 172.21.15.6:0/115683132 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3b7c007e90 con 0x7f3b940f8e50 2024-03-12T16:11:03.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.197+0000 7f3b91ffb700 1 -- 172.21.15.6:0/115683132 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3b7c018070 con 0x7f3b940f8e50 2024-03-12T16:11:03.199 INFO:tasks.workunit.client.0.smithi006.stdout:3/943: mknod d8/d131/dc/d28/d2f/df6/c146 0 2024-03-12T16:11:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.197+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3b940f7090 con 0x7f3b940f8e50 2024-03-12T16:11:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.197+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3b940f7540 con 0x7f3b940f8e50 2024-03-12T16:11:03.200 INFO:tasks.workunit.client.0.smithi006.stdout:6/959: truncate d3/d11/d10/da7/d8e/de1/f85 1487928 0 2024-03-12T16:11:03.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.198+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3b94100040 con 0x7f3b940f8e50 2024-03-12T16:11:03.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.199+0000 7f3b91ffb700 1 -- 172.21.15.6:0/115683132 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7f3b7c03e9c0 con 0x7f3b940f8e50 2024-03-12T16:11:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.200+0000 7f3b91ffb700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3b80066ee0 0x7f3b800693a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:03.202 INFO:tasks.workunit.client.0.smithi006.stdout:5/930: symlink d7/d9/d31/d3b/d4f/db5/l13c 0 2024-03-12T16:11:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.200+0000 7f3b91ffb700 1 -- 172.21.15.6:0/115683132 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f3b7c085850 con 0x7f3b940f8e50 2024-03-12T16:11:03.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.200+0000 7f3b8b7fe700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3b80066ee0 0x7f3b800693a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:03.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.201+0000 7f3b8b7fe700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3b80066ee0 0x7f3b800693a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3b840076a0 tx=0x7f3b84009840).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:03.205 INFO:tasks.workunit.client.0.smithi006.stdout:6/960: creat d3/d11/d10/da7/d8e/f155 x:0 0 0 2024-03-12T16:11:03.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.204+0000 7f3b91ffb700 1 -- 172.21.15.6:0/115683132 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f3b7c053930 con 0x7f3b940f8e50 2024-03-12T16:11:03.211 INFO:tasks.workunit.client.0.smithi006.stdout:3/944: dwrite d8/ff4 [0,4194304] 0 2024-03-12T16:11:03.211 INFO:tasks.workunit.client.0.smithi006.stdout:3/945: chown d8/d19/d26/d11d 4345468 1 2024-03-12T16:11:03.212 INFO:tasks.workunit.client.0.smithi006.stdout:5/931: dread d7/f118 [0,4194304] 0 2024-03-12T16:11:03.215 INFO:tasks.workunit.client.0.smithi006.stdout:3/946: symlink d8/d131/d41/da1/d116/d136/l147 0 2024-03-12T16:11:03.219 INFO:tasks.workunit.client.0.smithi006.stdout:3/947: mkdir d8/d131/d41/d45/d148 0 2024-03-12T16:11:03.221 INFO:tasks.workunit.client.0.smithi006.stdout:3/948: chown d8/l50 0 1 2024-03-12T16:11:03.225 INFO:tasks.workunit.client.0.smithi006.stdout:3/949: creat d8/d131/d41/d8b/f149 x:0 0 0 2024-03-12T16:11:03.233 INFO:tasks.workunit.client.0.smithi006.stdout:3/950: dwrite d8/d131/d41/d45/ff8 [0,4194304] 0 2024-03-12T16:11:03.238 INFO:tasks.workunit.client.0.smithi006.stdout:6/961: dread d3/d11/d10/da7/d8e/de1/f83 [0,4194304] 0 2024-03-12T16:11:03.243 INFO:tasks.workunit.client.0.smithi006.stdout:6/962: creat d3/d11/d10/d1b/d6e/d80/d9b/f156 x:0 0 0 2024-03-12T16:11:03.249 INFO:tasks.workunit.client.0.smithi006.stdout:6/963: dread d3/d11/d10/d19/f65 [0,4194304] 0 2024-03-12T16:11:03.256 INFO:tasks.workunit.client.0.smithi006.stdout:5/932: dwrite d7/d9/d31/ded/fd5 [0,4194304] 0 2024-03-12T16:11:03.258 INFO:tasks.workunit.client.0.smithi006.stdout:3/951: dread d8/d19/d26/f8d [0,4194304] 0 2024-03-12T16:11:03.262 INFO:tasks.workunit.client.0.smithi006.stdout:5/933: rmdir d7/d9/d47 39 2024-03-12T16:11:03.267 INFO:tasks.workunit.client.0.smithi006.stdout:3/952: creat d8/d4c/db2/f14a x:0 0 0 2024-03-12T16:11:03.270 INFO:tasks.workunit.client.0.smithi006.stdout:3/953: truncate d8/d131/d41/d8b/f149 453081 0 2024-03-12T16:11:03.270 INFO:tasks.workunit.client.0.smithi006.stdout:5/934: chown d7/d9/d47/d56/dc4/cfd 2793759 1 2024-03-12T16:11:03.273 INFO:tasks.workunit.client.0.smithi006.stdout:3/954: fdatasync d8/d131/d41/d8b/d93/fd7 0 2024-03-12T16:11:03.274 INFO:tasks.workunit.client.0.smithi006.stdout:3/955: write d8/d4c/f13b [698496,1122] 0 2024-03-12T16:11:03.275 INFO:tasks.workunit.client.0.smithi006.stdout:5/935: mkdir d7/d9/d31/d3b/d61/dd3/d13d 0 2024-03-12T16:11:03.279 INFO:tasks.workunit.client.0.smithi006.stdout:3/956: read - d8/d131/dc/f2a zero size 2024-03-12T16:11:03.279 INFO:tasks.workunit.client.0.smithi006.stdout:5/936: write d7/d9/d10/d24/fb2 [928576,65010] 0 2024-03-12T16:11:03.280 INFO:tasks.workunit.client.0.smithi006.stdout:5/937: chown d7/d9/d31/d3b/d4f/d80/d88/fb6 248 1 2024-03-12T16:11:03.280 INFO:tasks.workunit.client.0.smithi006.stdout:6/964: truncate d3/d11/d10/da7/dd5/ddb/de6/f13c 134602 0 2024-03-12T16:11:03.284 INFO:tasks.workunit.client.0.smithi006.stdout:3/957: readlink d8/d19/ld9 0 2024-03-12T16:11:03.292 INFO:tasks.workunit.client.0.smithi006.stdout:6/965: dwrite d3/f17 [4194304,4194304] 0 2024-03-12T16:11:03.294 INFO:tasks.workunit.client.0.smithi006.stdout:5/938: dwrite d7/d9/f16 [8388608,4194304] 0 2024-03-12T16:11:03.300 INFO:tasks.workunit.client.0.smithi006.stdout:3/958: symlink d8/d131/dc/d28/d2f/d117/l14b 0 2024-03-12T16:11:03.305 INFO:tasks.workunit.client.0.smithi006.stdout:3/959: mkdir d8/d19/d26/d11d/d14c 0 2024-03-12T16:11:03.307 INFO:tasks.workunit.client.0.smithi006.stdout:3/960: symlink d8/d131/dc/l14d 0 2024-03-12T16:11:03.318 INFO:tasks.workunit.client.0.smithi006.stdout:5/939: write d7/d9/d10/d35/f3c [408931,45658] 0 2024-03-12T16:11:03.321 INFO:tasks.workunit.client.0.smithi006.stdout:5/940: chown d7/d8/f4c 29 1 2024-03-12T16:11:03.322 INFO:tasks.workunit.client.0.smithi006.stdout:5/941: chown d7/d8/d8a 254674737 1 2024-03-12T16:11:03.323 INFO:tasks.workunit.client.0.smithi006.stdout:3/961: write d8/d52/d9e/fb3 [288722,106054] 0 2024-03-12T16:11:03.325 INFO:tasks.workunit.client.0.smithi006.stdout:6/966: dwrite d3/d11/d3b/db4/f109 [0,4194304] 0 2024-03-12T16:11:03.328 INFO:tasks.workunit.client.0.smithi006.stdout:5/942: symlink d7/d9/d10/d24/l13e 0 2024-03-12T16:11:03.334 INFO:tasks.workunit.client.0.smithi006.stdout:6/967: link d3/d11/d10/da7/dd5/l130 d3/d11/d10/d19/df6/l157 0 2024-03-12T16:11:03.338 INFO:tasks.workunit.client.0.smithi006.stdout:5/943: rename d7/d9/d10/f26 to d7/d9/d47/d56/f13f 0 2024-03-12T16:11:03.341 INFO:tasks.workunit.client.0.smithi006.stdout:5/944: truncate d7/d41/fe0 519588 0 2024-03-12T16:11:03.355 INFO:tasks.workunit.client.0.smithi006.stdout:5/945: dread d7/d9/d31/d3b/d4f/d65/fc5 [0,4194304] 0 2024-03-12T16:11:03.358 INFO:tasks.workunit.client.0.smithi006.stdout:3/962: dread d8/d131/d41/d45/fe3 [0,4194304] 0 2024-03-12T16:11:03.370 INFO:tasks.workunit.client.0.smithi006.stdout:5/946: mknod d7/d9/d31/d3b/d4f/c140 0 2024-03-12T16:11:03.373 INFO:tasks.workunit.client.0.smithi006.stdout:5/947: chown d7/d9/d31/d3b/d4f/d9e/l11a 313 1 2024-03-12T16:11:03.376 INFO:tasks.workunit.client.0.smithi006.stdout:6/968: dread d3/d11/d43/f46 [0,4194304] 0 2024-03-12T16:11:03.385 INFO:tasks.workunit.client.0.smithi006.stdout:6/969: stat d3/d11/d10/f49 0 2024-03-12T16:11:03.390 INFO:tasks.workunit.client.0.smithi006.stdout:5/948: dread d7/d9/d10/d35/fb1 [0,4194304] 0 2024-03-12T16:11:03.411 INFO:tasks.workunit.client.0.smithi006.stdout:3/963: write d8/d19/d26/d59/fa8 [665011,102895] 0 2024-03-12T16:11:03.485 INFO:tasks.workunit.client.0.smithi006.stdout:3/964: symlink d8/d131/d41/d45/d148/l14e 0 2024-03-12T16:11:03.495 INFO:tasks.workunit.client.0.smithi006.stdout:5/949: dwrite d7/d9/d31/f2e [0,4194304] 0 2024-03-12T16:11:03.497 INFO:tasks.workunit.client.0.smithi006.stdout:3/965: dwrite d8/d52/dcf/f120 [0,4194304] 0 2024-03-12T16:11:03.499 INFO:tasks.workunit.client.0.smithi006.stdout:5/950: truncate d7/d9/d47/d56/f115 796465 0 2024-03-12T16:11:03.506 INFO:tasks.workunit.client.0.smithi006.stdout:3/966: dwrite d8/d19/d26/d97/dce/f108 [0,4194304] 0 2024-03-12T16:11:03.548 INFO:tasks.workunit.client.0.smithi006.stdout:3/967: getdents d8/ddc/df5 0 2024-03-12T16:11:03.561 INFO:tasks.workunit.client.0.smithi006.stdout:3/968: truncate d8/d4c/dd8/fa5 1977465 0 2024-03-12T16:11:03.568 INFO:tasks.workunit.client.0.smithi006.stdout:3/969: dwrite d8/d4c/dd8/fae [0,4194304] 0 2024-03-12T16:11:03.580 INFO:tasks.workunit.client.0.smithi006.stdout:3/970: rename d8/d19/d26/d97/dce/fe8 to d8/d131/d41/da1/d116/d136/dd0/f14f 0 2024-03-12T16:11:03.584 INFO:tasks.workunit.client.0.smithi006.stdout:3/971: readlink d8/d19/d31/led 0 2024-03-12T16:11:03.586 INFO:tasks.workunit.client.0.smithi006.stdout:3/972: rmdir d8/d4c/db2 39 2024-03-12T16:11:03.589 INFO:tasks.workunit.client.0.smithi006.stdout:3/973: symlink d8/d131/d41/d8b/d93/l150 0 2024-03-12T16:11:03.596 INFO:tasks.workunit.client.0.smithi006.stdout:3/974: creat d8/d4c/db2/f151 x:0 0 0 2024-03-12T16:11:03.607 INFO:tasks.workunit.client.0.smithi006.stdout:3/975: getdents d8/d52/dcf 0 2024-03-12T16:11:03.615 INFO:tasks.workunit.client.0.smithi006.stdout:3/976: write d8/d19/f11f [951811,34444] 0 2024-03-12T16:11:03.616 INFO:tasks.workunit.client.0.smithi006.stdout:3/977: dread - d8/d4c/f65 zero size 2024-03-12T16:11:03.617 INFO:tasks.workunit.client.0.smithi006.stdout:3/978: chown d8/d131/dc/d28 1116 1 2024-03-12T16:11:03.621 INFO:tasks.workunit.client.0.smithi006.stdout:3/979: mknod d8/d131/dc/d28/d2f/d9d/c152 0 2024-03-12T16:11:03.623 INFO:tasks.workunit.client.0.smithi006.stdout:3/980: readlink d8/d131/d41/da1/lb0 0 2024-03-12T16:11:03.636 INFO:tasks.workunit.client.0.smithi006.stdout:3/981: dwrite d8/d4c/dd8/fa5 [0,4194304] 0 2024-03-12T16:11:03.655 INFO:tasks.workunit.client.0.smithi006.stdout:3/982: dread d8/d19/d31/dc4/fe0 [0,4194304] 0 2024-03-12T16:11:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.693+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3b94101eb0 con 0x7f3b940f8e50 2024-03-12T16:11:03.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.694+0000 7f3b91ffb700 1 -- 172.21.15.6:0/115683132 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+848 (secure 0 0 0) 0x7f3b7c013410 con 0x7f3b940f8e50 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:11:03.696 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:11:03.697 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:11:03.697 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:11:03.697 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:11:03.697 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-03-12T16:11:03.697 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:11:03.697 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:11:03.697 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:11:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.698+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3b80066ee0 msgr2=0x7f3b800693a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.698+0000 7f3b9a57b700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3b80066ee0 0x7f3b800693a0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f3b840076a0 tx=0x7f3b84009840).stop 2024-03-12T16:11:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.698+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b940f8e50 msgr2=0x7f3b940f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:03.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.698+0000 7f3b9a57b700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b940f8e50 0x7f3b940f8540 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7f3b7c000c00 tx=0x7f3b7c009cb0).stop 2024-03-12T16:11:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.700+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 shutdown_connections 2024-03-12T16:11:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.700+0000 7f3b9a57b700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3b80066ee0 0x7f3b800693a0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.701 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.700+0000 7f3b9a57b700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3b940f8e50 0x7f3b940f8540 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.700+0000 7f3b9a57b700 1 --2- 172.21.15.6:0/115683132 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3b940f97f0 0x7f3b940f6ba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.700+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 >> 172.21.15.6:0/115683132 conn(0x7f3b940f15d0 msgr2=0x7f3b940fc6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.700+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 shutdown_connections 2024-03-12T16:11:03.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.700+0000 7f3b9a57b700 1 -- 172.21.15.6:0/115683132 wait complete. 2024-03-12T16:11:03.801 INFO:tasks.workunit.client.0.smithi006.stdout:6/970: sync 2024-03-12T16:11:03.802 INFO:tasks.workunit.client.0.smithi006.stdout:6/971: chown d3/d11/d10/d28/lc7 16835 1 2024-03-12T16:11:03.803 INFO:tasks.workunit.client.0.smithi006.stdout:6/972: write d3/d11/d10/d9a/f150 [154592,92490] 0 2024-03-12T16:11:03.821 INFO:tasks.workunit.client.0.smithi006.stdout:6/973: dwrite d3/d11/d10/d1b/d6e/d96/fb8 [0,4194304] 0 2024-03-12T16:11:03.830 INFO:tasks.workunit.client.0.smithi006.stdout:6/974: mkdir d3/d11/d10/d28/dd6/d158 0 2024-03-12T16:11:03.831 INFO:tasks.workunit.client.0.smithi006.stdout:6/975: dread - d3/d11/d10/d19/fa4 zero size 2024-03-12T16:11:03.833 INFO:tasks.workunit.client.0.smithi006.stdout:6/976: readlink d3/d11/d10/da7/d8e/de1/d60/d108/d12d/l126 0 2024-03-12T16:11:03.835 INFO:tasks.workunit.client.0.smithi006.stdout:6/977: write d3/d11/d10/d1b/d6e/d80/d9b/f156 [27450,113718] 0 2024-03-12T16:11:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.841+0000 7fb6c6c84700 1 -- 172.21.15.6:0/409296219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6c00f6710 msgr2=0x7fb6c00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.841+0000 7fb6c6c84700 1 --2- 172.21.15.6:0/409296219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6c00f6710 0x7fb6c00f6b30 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fb6b40047f0 tx=0x7fb6b4009cb0).stop 2024-03-12T16:11:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.841+0000 7fb6c6c84700 1 -- 172.21.15.6:0/409296219 shutdown_connections 2024-03-12T16:11:03.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.841+0000 7fb6c6c84700 1 --2- 172.21.15.6:0/409296219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6c00f79b0 0x7fb6c00f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.841+0000 7fb6c6c84700 1 --2- 172.21.15.6:0/409296219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6c00f6710 0x7fb6c00f6b30 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.841+0000 7fb6c6c84700 1 -- 172.21.15.6:0/409296219 >> 172.21.15.6:0/409296219 conn(0x7fb6c00f1e70 msgr2=0x7fb6c00f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.841+0000 7fb6c6c84700 1 -- 172.21.15.6:0/409296219 shutdown_connections 2024-03-12T16:11:03.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.841+0000 7fb6c6c84700 1 -- 172.21.15.6:0/409296219 wait complete. 2024-03-12T16:11:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6c6c84700 1 Processor -- start 2024-03-12T16:11:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6c6c84700 1 -- start start 2024-03-12T16:11:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6c6c84700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6c00f6710 0x7fb6c010e7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6c6c84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6c00f79b0 0x7fb6c010ecb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6c6c84700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c010f260 con 0x7fb6c00f79b0 2024-03-12T16:11:03.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6c6c84700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6c010f3a0 con 0x7fb6c00f6710 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6c4a20700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6c00f6710 0x7fb6c010e7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6c4a20700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6c00f6710 0x7fb6c010e7c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:54118/0 (socket says 172.21.15.6:54118) 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6c4a20700 1 -- 172.21.15.6:0/1449763121 learned_addr learned my addr 172.21.15.6:0/1449763121 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.842+0000 7fb6bffff700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6c00f79b0 0x7fb6c010ecb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.843+0000 7fb6c4a20700 1 -- 172.21.15.6:0/1449763121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6c00f79b0 msgr2=0x7fb6c010ecb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.843+0000 7fb6c4a20700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6c00f79b0 0x7fb6c010ecb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.843+0000 7fb6c4a20700 1 -- 172.21.15.6:0/1449763121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb6b4005040 con 0x7fb6c00f6710 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.843+0000 7fb6c4a20700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6c00f6710 0x7fb6c010e7c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb6b4004e60 tx=0x7fb6b4009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.843+0000 7fb6bdffb700 1 -- 172.21.15.6:0/1449763121 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b400e070 con 0x7fb6c00f6710 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.843+0000 7fb6bdffb700 1 -- 172.21.15.6:0/1449763121 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb6b40094c0 con 0x7fb6c00f6710 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.843+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6c0101380 con 0x7fb6c00f6710 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.843+0000 7fb6bdffb700 1 -- 172.21.15.6:0/1449763121 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb6b400f410 con 0x7fb6c00f6710 2024-03-12T16:11:03.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.843+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6c0101940 con 0x7fb6c00f6710 2024-03-12T16:11:03.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.845+0000 7fb6bdffb700 1 -- 172.21.15.6:0/1449763121 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 24) v1 ==== 84062+0+0 (secure 0 0 0) 0x7fb6b4018040 con 0x7fb6c00f6710 2024-03-12T16:11:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.845+0000 7fb6bdffb700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb6b0066e10 0x7fb6b00692d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.845+0000 7fb6bdffb700 1 -- 172.21.15.6:0/1449763121 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fb6b4084f00 con 0x7fb6c00f6710 2024-03-12T16:11:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.846+0000 7fb6bffff700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb6b0066e10 0x7fb6b00692d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.846+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6c00fdad0 con 0x7fb6c00f6710 2024-03-12T16:11:03.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.846+0000 7fb6bffff700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb6b0066e10 0x7fb6b00692d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb6ac0048b0 tx=0x7fb6ac00b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:03.847 INFO:tasks.workunit.client.0.smithi006.stdout:6/978: link d3/d11/d43/l51 d3/d11/d10/d1b/d20/l159 0 2024-03-12T16:11:03.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:03.851+0000 7fb6bdffb700 1 -- 172.21.15.6:0/1449763121 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fb6b4052f60 con 0x7fb6c00f6710 2024-03-12T16:11:03.855 INFO:tasks.workunit.client.0.smithi006.stdout:6/979: dwrite d3/d11/d10/d28/f11f [4194304,4194304] 0 2024-03-12T16:11:03.861 INFO:tasks.workunit.client.0.smithi006.stdout:6/980: dread - d3/d11/d10/d1b/fcf zero size 2024-03-12T16:11:03.869 INFO:tasks.workunit.client.0.smithi006.stdout:6/981: mknod d3/d11/d10/da7/dd5/ddb/c15a 0 2024-03-12T16:11:03.874 INFO:tasks.workunit.client.0.smithi006.stdout:6/982: rename d3/d11/d10/da7/d8e/de1/d60/l111 to d3/d11/d10/d1b/d6e/db1/l15b 0 2024-03-12T16:11:03.875 INFO:tasks.workunit.client.0.smithi006.stdout:6/983: chown d3/d11/d10/d1b/d20/f23 308697 1 2024-03-12T16:11:03.876 INFO:tasks.workunit.client.0.smithi006.stdout:6/984: chown d3/d11/d10/ffb 116169 1 2024-03-12T16:11:03.880 INFO:tasks.workunit.client.0.smithi006.stdout:6/985: creat d3/d11/d3b/db4/dc3/f15c x:0 0 0 2024-03-12T16:11:03.888 INFO:tasks.workunit.client.0.smithi006.stdout:6/986: link d3/d11/d10/da7/d8e/de1/d60/d7e/d131/c13a d3/d11/d10/d143/c15d 0 2024-03-12T16:11:03.891 INFO:tasks.workunit.client.0.smithi006.stdout:6/987: dread d3/d11/d10/d9a/f150 [0,4194304] 0 2024-03-12T16:11:03.895 INFO:tasks.workunit.client.0.smithi006.stdout:6/988: symlink d3/d11/d10/d1b/d6e/db1/l15e 0 2024-03-12T16:11:03.897 INFO:tasks.workunit.client.0.smithi006.stdout:6/989: readlink d3/d11/d10/da7/d8e/de1/d60/d108/d12d/db0/ld7 0 2024-03-12T16:11:03.899 INFO:tasks.workunit.client.0.smithi006.stdout:6/990: creat d3/d11/d10/d1b/d20/d14a/f15f x:0 0 0 2024-03-12T16:11:03.901 INFO:tasks.workunit.client.0.smithi006.stdout:6/991: chown d3/d11/d10/da7/d8e/de1/d60/d7e/d131/daa/cf2 236174400 1 2024-03-12T16:11:03.903 INFO:tasks.workunit.client.0.smithi006.stdout:6/992: truncate d3/d11/d10/da7/d8e/de1/d60/d7e/d131/f14d 576446 0 2024-03-12T16:11:03.914 INFO:tasks.workunit.client.0.smithi006.stdout:6/993: write d3/d11/d10/d1b/fdc [62115,83733] 0 2024-03-12T16:11:03.921 INFO:tasks.workunit.client.0.smithi006.stdout:6/994: link d3/d11/d10/da7/d8e/de1/d60/d7e/d131/daa/fc2 d3/d11/d3b/db4/dc3/f160 0 2024-03-12T16:11:03.931 INFO:tasks.workunit.client.0.smithi006.stdout:6/995: write d3/d11/f3c [1058552,129880] 0 2024-03-12T16:11:03.934 INFO:tasks.workunit.client.0.smithi006.stdout:6/996: chown d3/d11/d10/da7/d8e/de1/d60/d108/d12d/fdf 893997826 1 2024-03-12T16:11:03.948 INFO:tasks.workunit.client.0.smithi006.stdout:6/997: dwrite d3/d11/d10/d19/fa4 [0,4194304] 0 2024-03-12T16:11:03.951 INFO:tasks.workunit.client.0.smithi006.stdout:6/998: stat d3/d11/d3b/db4/dc3/cd4 0 2024-03-12T16:11:03.954 INFO:tasks.workunit.client.0.smithi006.stdout:6/999: mkdir d3/d11/d10/da7/d8e/d161 0 2024-03-12T16:11:04.027 INFO:tasks.workunit.client.0.smithi006.stdout:5/951: sync 2024-03-12T16:11:04.027 INFO:tasks.workunit.client.0.smithi006.stdout:5/952: chown d7/d8/d8a/d92/ff3 24 1 2024-03-12T16:11:04.029 INFO:tasks.workunit.client.0.smithi006.stdout:5/953: stat d7/d8/d91/lcb 0 2024-03-12T16:11:04.035 INFO:tasks.workunit.client.0.smithi006.stdout:5/954: dwrite d7/d8/f4d [4194304,4194304] 0 2024-03-12T16:11:04.038 INFO:tasks.workunit.client.0.smithi006.stdout:5/955: symlink d7/d9/d31/d3b/d4f/d65/de1/l141 0 2024-03-12T16:11:04.045 INFO:tasks.workunit.client.0.smithi006.stdout:5/956: dread d7/d9/d10/f1b [8388608,4194304] 0 2024-03-12T16:11:04.054 INFO:tasks.workunit.client.0.smithi006.stdout:5/957: dread d7/d9/d31/d3b/d4f/db5/f82 [0,4194304] 0 2024-03-12T16:11:04.061 INFO:tasks.workunit.client.0.smithi006.stdout:5/958: dwrite d7/d9/d31/d3b/d4f/d65/fc5 [0,4194304] 0 2024-03-12T16:11:04.063 INFO:tasks.workunit.client.0.smithi006.stdout:5/959: chown d7/d41/ldd 1773 1 2024-03-12T16:11:04.067 INFO:tasks.workunit.client.0.smithi006.stdout:5/960: mknod d7/d9/d31/d3b/d4f/d9e/ddb/c142 0 2024-03-12T16:11:04.083 INFO:tasks.workunit.client.0.smithi006.stdout:5/961: dread d7/d41/f87 [0,4194304] 0 2024-03-12T16:11:04.087 INFO:tasks.workunit.client.0.smithi006.stdout:5/962: rename d7/d9/d47/d56/cda to d7/d9/d31/d3b/d61/c143 0 2024-03-12T16:11:04.090 INFO:tasks.workunit.client.0.smithi006.stdout:5/963: creat d7/d9/d31/d3b/d4f/d9e/ddb/f144 x:0 0 0 2024-03-12T16:11:04.091 INFO:tasks.workunit.client.0.smithi006.stdout:5/964: dread d7/d9/d10/d35/fb1 [0,4194304] 0 2024-03-12T16:11:04.095 INFO:tasks.workunit.client.0.smithi006.stdout:5/965: fsync d7/d9/d31/d3b/d6b/f130 0 2024-03-12T16:11:04.172 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [], 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "1/2 daemons upgraded", 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.151+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb6c00fba70 con 0x7fb6b0066e10 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.152+0000 7fb6bdffb700 1 -- 172.21.15.6:0/1449763121 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+310 (secure 0 0 0) 0x7fb6c00fba70 con 0x7fb6b0066e10 2024-03-12T16:11:04.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.154+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb6b0066e10 msgr2=0x7fb6b00692d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.154+0000 7fb6c6c84700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb6b0066e10 0x7fb6b00692d0 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7fb6ac0048b0 tx=0x7fb6ac00b040).stop 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.154+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6c00f6710 msgr2=0x7fb6c010e7c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.154+0000 7fb6c6c84700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6c00f6710 0x7fb6c010e7c0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fb6b4004e60 tx=0x7fb6b4009cb0).stop 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.155+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 shutdown_connections 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.155+0000 7fb6c6c84700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fb6b0066e10 0x7fb6b00692d0 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.155+0000 7fb6c6c84700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6c00f6710 0x7fb6c010e7c0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.155+0000 7fb6c6c84700 1 --2- 172.21.15.6:0/1449763121 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6c00f79b0 0x7fb6c010ecb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.155+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 >> 172.21.15.6:0/1449763121 conn(0x7fb6c00f1e70 msgr2=0x7fb6c00f8bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.155+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 shutdown_connections 2024-03-12T16:11:04.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:04.155+0000 7fb6c6c84700 1 -- 172.21.15.6:0/1449763121 wait complete. 2024-03-12T16:11:04.193 INFO:tasks.workunit.client.0.smithi006.stdout:3/983: sync 2024-03-12T16:11:04.195 INFO:tasks.workunit.client.0.smithi006.stdout:3/984: creat d8/d4c/dc8/f153 x:0 0 0 2024-03-12T16:11:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:02.151334+0000 mgr.smithi134.gcntfu (mgr.24383) 69 : audit [DBG] from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:02.630686+0000 mgr.smithi134.gcntfu (mgr.24383) 70 : audit [DBG] from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:03.310907+0000 mon.smithi006 (mon.0) 714 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:03.318942+0000 mon.smithi006 (mon.0) 715 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:03.694996+0000 mon.smithi134 (mon.1) 19 : audit [DBG] from='client.? 172.21.15.6:0/115683132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:11:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:02.151334+0000 mgr.smithi134.gcntfu (mgr.24383) 69 : audit [DBG] from='client.24451 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:02.630686+0000 mgr.smithi134.gcntfu (mgr.24383) 70 : audit [DBG] from='client.14630 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:03.310907+0000 mon.smithi006 (mon.0) 714 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:03.318942+0000 mon.smithi006 (mon.0) 715 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:03.694996+0000 mon.smithi134 (mon.1) 19 : audit [DBG] from='client.? 172.21.15.6:0/115683132' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:11:04.208 INFO:tasks.workunit.client.0.smithi006.stdout:3/985: dwrite d8/d131/d41/d45/fda [0,4194304] 0 2024-03-12T16:11:04.211 INFO:tasks.workunit.client.0.smithi006.stdout:3/986: creat d8/d131/d41/d45/d13a/f154 x:0 0 0 2024-03-12T16:11:04.279 INFO:tasks.workunit.client.0.smithi006.stdout:3/987: readlink d8/d131/dc/d28/l49 0 2024-03-12T16:11:04.286 INFO:tasks.workunit.client.0.smithi006.stdout:3/988: dwrite d8/f88 [4194304,4194304] 0 2024-03-12T16:11:04.290 INFO:tasks.workunit.client.0.smithi006.stdout:3/989: symlink d8/l155 0 2024-03-12T16:11:04.292 INFO:tasks.workunit.client.0.smithi006.stdout:3/990: symlink d8/d52/dcf/l156 0 2024-03-12T16:11:04.293 INFO:tasks.workunit.client.0.smithi006.stdout:3/991: chown d8/d19/d26/d97/c87 0 1 2024-03-12T16:11:04.293 INFO:tasks.workunit.client.0.smithi006.stdout:3/992: dread - d8/d131/d41/d45/d110/f119 zero size 2024-03-12T16:11:04.295 INFO:tasks.workunit.client.0.smithi006.stdout:3/993: mknod d8/c157 0 2024-03-12T16:11:04.296 INFO:tasks.workunit.client.0.smithi006.stdout:3/994: dread - d8/d19/d26/d59/f115 zero size 2024-03-12T16:11:04.297 INFO:tasks.workunit.client.0.smithi006.stdout:3/995: mkdir d8/d19/d26/d97/d158 0 2024-03-12T16:11:04.298 INFO:tasks.workunit.client.0.smithi006.stdout:3/996: fdatasync d8/d131/d41/d45/f141 0 2024-03-12T16:11:04.300 INFO:tasks.workunit.client.0.smithi006.stdout:3/997: rmdir d8/d4c/d7c 39 2024-03-12T16:11:04.302 INFO:tasks.workunit.client.0.smithi006.stdout:3/998: symlink d8/d131/d41/da1/d116/l159 0 2024-03-12T16:11:04.302 INFO:tasks.workunit.client.0.smithi006.stdout:3/999: fdatasync d8/d19/d31/dc4/f133 0 2024-03-12T16:11:04.428 INFO:tasks.workunit.client.0.smithi006.stdout:5/966: sync 2024-03-12T16:11:04.442 INFO:tasks.workunit.client.0.smithi006.stdout:5/967: dread d7/d9/f30 [0,4194304] 0 2024-03-12T16:11:04.452 INFO:tasks.workunit.client.0.smithi006.stdout:5/968: dread d7/f58 [0,4194304] 0 2024-03-12T16:11:04.533 INFO:tasks.workunit.client.0.smithi006.stdout:5/969: write d7/d9/d31/d3b/d6b/db9/fc9 [894316,21741] 0 2024-03-12T16:11:04.536 INFO:tasks.workunit.client.0.smithi006.stdout:5/970: write d7/d9/d47/d56/d79/dfb/f10e [58364,118088] 0 2024-03-12T16:11:04.543 INFO:tasks.workunit.client.0.smithi006.stdout:5/971: link d7/d41/fd9 d7/d9/d10/d35/f145 0 2024-03-12T16:11:04.565 INFO:tasks.workunit.client.0.smithi006.stdout:5/972: dwrite d7/d9/d47/fc1 [4194304,4194304] 0 2024-03-12T16:11:04.575 INFO:tasks.workunit.client.0.smithi006.stdout:5/973: dwrite d7/d9/d10/d24/f38 [4194304,4194304] 0 2024-03-12T16:11:04.576 INFO:tasks.workunit.client.0.smithi006.stdout:5/974: chown d7/d9/d10/f1b 115016684 1 2024-03-12T16:11:04.579 INFO:tasks.workunit.client.0.smithi006.stdout:5/975: mkdir d7/d9/d31/d3b/d6b/db9/d12a/d146 0 2024-03-12T16:11:04.583 INFO:tasks.workunit.client.0.smithi006.stdout:5/976: dread d7/d9/d10/f1b [8388608,4194304] 0 2024-03-12T16:11:04.584 INFO:tasks.workunit.client.0.smithi006.stdout:5/977: fsync d7/f123 0 2024-03-12T16:11:04.586 INFO:tasks.workunit.client.0.smithi006.stdout:5/978: symlink d7/d9/d47/d56/d79/l147 0 2024-03-12T16:11:04.588 INFO:tasks.workunit.client.0.smithi006.stdout:5/979: mkdir d7/d9/d31/d3b/d4f/db5/d148 0 2024-03-12T16:11:04.590 INFO:tasks.workunit.client.0.smithi006.stdout:5/980: mknod d7/d9/d10/d35/c149 0 2024-03-12T16:11:04.597 INFO:tasks.workunit.client.0.smithi006.stdout:5/981: rmdir d7/d9/d10/d35 39 2024-03-12T16:11:04.599 INFO:tasks.workunit.client.0.smithi006.stdout:5/982: creat d7/d9/d47/d56/d105/f14a x:0 0 0 2024-03-12T16:11:04.600 INFO:tasks.workunit.client.0.smithi006.stdout:5/983: chown d7/d9/d10/f1b 86958 1 2024-03-12T16:11:04.602 INFO:tasks.workunit.client.0.smithi006.stdout:5/984: write d7/d9/d10/d35/f3c [1961510,103613] 0 2024-03-12T16:11:04.604 INFO:tasks.workunit.client.0.smithi006.stdout:5/985: dread - d7/d9/d31/d3b/d4f/d9e/ddb/d104/d125/f12b zero size 2024-03-12T16:11:04.605 INFO:tasks.workunit.client.0.smithi006.stdout:5/986: write d7/d9/d31/d3b/dba/f112 [658112,44856] 0 2024-03-12T16:11:04.607 INFO:tasks.workunit.client.0.smithi006.stdout:5/987: write d7/d9/d31/d3b/d4f/d9e/ddb/d104/d125/f129 [134070,119480] 0 2024-03-12T16:11:04.611 INFO:tasks.workunit.client.0.smithi006.stdout:5/988: getdents d7/d8/d8a/d92 0 2024-03-12T16:11:04.612 INFO:tasks.workunit.client.0.smithi006.stdout:5/989: chown d7/d9/c68 15083192 1 2024-03-12T16:11:04.613 INFO:tasks.workunit.client.0.smithi006.stdout:5/990: fsync d7/d9/d31/d3b/d4f/d9e/ddb/d104/d125/f129 0 2024-03-12T16:11:04.614 INFO:tasks.workunit.client.0.smithi006.stdout:5/991: chown d7/d9/d47/d56/d105 37611565 1 2024-03-12T16:11:04.616 INFO:tasks.workunit.client.0.smithi006.stdout:5/992: creat d7/d9/d47/d56/f14b x:0 0 0 2024-03-12T16:11:04.618 INFO:tasks.workunit.client.0.smithi006.stdout:5/993: write d7/d9/d31/d3b/d4f/fec [4601466,53719] 0 2024-03-12T16:11:04.620 INFO:tasks.workunit.client.0.smithi006.stdout:5/994: mkdir d7/d9/d31/d14c 0 2024-03-12T16:11:04.622 INFO:tasks.workunit.client.0.smithi006.stdout:5/995: symlink d7/d9/d31/d3b/d61/dd3/d12f/l14d 0 2024-03-12T16:11:04.623 INFO:tasks.workunit.client.0.smithi006.stdout:5/996: rmdir d7/d9/d47/d56/d79/dfb 39 2024-03-12T16:11:04.625 INFO:tasks.workunit.client.0.smithi006.stdout:5/997: mkdir d7/d9/d10/d35/d14e 0 2024-03-12T16:11:04.627 INFO:tasks.workunit.client.0.smithi006.stdout:5/998: mknod d7/d9/d31/d3b/d61/dd3/d13d/c14f 0 2024-03-12T16:11:04.627 INFO:tasks.workunit.client.0.smithi006.stdout:5/999: chown d7/d9/d31/d3b/d9a 4954237 1 2024-03-12T16:11:04.631 INFO:tasks.workunit.client.0.smithi006.stderr:+ rm -rf -- ./tmp.WO8IEPd7Zv 2024-03-12T16:11:05.071 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:03.040895+0000 mgr.smithi134.gcntfu (mgr.24383) 71 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:05.072 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:03.325785+0000 mgr.smithi134.gcntfu (mgr.24383) 72 : cephadm [INF] Reconfiguring node-exporter.smithi006 (dependencies changed)... 2024-03-12T16:11:05.072 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:03.326442+0000 mgr.smithi134.gcntfu (mgr.24383) 73 : cephadm [INF] Reconfiguring daemon node-exporter.smithi006 on smithi006 2024-03-12T16:11:05.072 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:04 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:03.503116+0000 mgr.smithi134.gcntfu (mgr.24383) 74 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 79 MiB/s rd, 190 MiB/s wr, 424 op/s 2024-03-12T16:11:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:03.040895+0000 mgr.smithi134.gcntfu (mgr.24383) 71 : audit [DBG] from='client.14634 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:03.325785+0000 mgr.smithi134.gcntfu (mgr.24383) 72 : cephadm [INF] Reconfiguring node-exporter.smithi006 (dependencies changed)... 2024-03-12T16:11:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:03.326442+0000 mgr.smithi134.gcntfu (mgr.24383) 73 : cephadm [INF] Reconfiguring daemon node-exporter.smithi006 on smithi006 2024-03-12T16:11:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:04 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:03.503116+0000 mgr.smithi134.gcntfu (mgr.24383) 74 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 4.0 GiB data, 13 GiB used, 523 GiB / 536 GiB avail; 79 MiB/s rd, 190 MiB/s wr, 424 op/s 2024-03-12T16:11:06.053 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:04.152751+0000 mgr.smithi134.gcntfu (mgr.24383) 75 : audit [DBG] from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:06.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:04.152751+0000 mgr.smithi134.gcntfu (mgr.24383) 75 : audit [DBG] from='client.24467 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:07.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:05.503575+0000 mgr.smithi134.gcntfu (mgr.24383) 76 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 93 MiB/s rd, 228 MiB/s wr, 563 op/s 2024-03-12T16:11:07.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:06.168223+0000 mon.smithi006 (mon.0) 716 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:07.190 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:06.172465+0000 mon.smithi006 (mon.0) 717 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:07.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:05.503575+0000 mgr.smithi134.gcntfu (mgr.24383) 76 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 93 MiB/s rd, 228 MiB/s wr, 563 op/s 2024-03-12T16:11:07.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:06.168223+0000 mon.smithi006 (mon.0) 716 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:07.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:06.172465+0000 mon.smithi006 (mon.0) 717 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:07.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:06.195152+0000 mgr.smithi134.gcntfu (mgr.24383) 77 : cephadm [INF] Reconfiguring node-exporter.smithi134 (dependencies changed)... 2024-03-12T16:11:07.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:06.195502+0000 mgr.smithi134.gcntfu (mgr.24383) 78 : cephadm [INF] Reconfiguring daemon node-exporter.smithi134 on smithi134 2024-03-12T16:11:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:06.195152+0000 mgr.smithi134.gcntfu (mgr.24383) 77 : cephadm [INF] Reconfiguring node-exporter.smithi134 (dependencies changed)... 2024-03-12T16:11:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:06.195502+0000 mgr.smithi134.gcntfu (mgr.24383) 78 : cephadm [INF] Reconfiguring daemon node-exporter.smithi134 on smithi134 2024-03-12T16:11:09.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:07.504206+0000 mgr.smithi134.gcntfu (mgr.24383) 79 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 55 MiB/s rd, 140 MiB/s wr, 357 op/s 2024-03-12T16:11:09.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:08.556530+0000 mon.smithi006 (mon.0) 718 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:09.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:08.560254+0000 mon.smithi006 (mon.0) 719 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:09.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:07.504206+0000 mgr.smithi134.gcntfu (mgr.24383) 79 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 55 MiB/s rd, 140 MiB/s wr, 357 op/s 2024-03-12T16:11:09.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:08.556530+0000 mon.smithi006 (mon.0) 718 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:09.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:08.560254+0000 mon.smithi006 (mon.0) 719 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:10.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:08.563754+0000 mgr.smithi134.gcntfu (mgr.24383) 80 : cephadm [INF] Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-12T16:11:10.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:08.799200+0000 mgr.smithi134.gcntfu (mgr.24383) 81 : cephadm [INF] Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-12T16:11:10.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:08.563754+0000 mgr.smithi134.gcntfu (mgr.24383) 80 : cephadm [INF] Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-12T16:11:10.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:08.799200+0000 mgr.smithi134.gcntfu (mgr.24383) 81 : cephadm [INF] Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-12T16:11:11.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:10 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:09.504618+0000 mgr.smithi134.gcntfu (mgr.24383) 82 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 55 MiB/s rd, 140 MiB/s wr, 357 op/s 2024-03-12T16:11:11.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:10 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:09.504618+0000 mgr.smithi134.gcntfu (mgr.24383) 82 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 3.7 GiB data, 13 GiB used, 524 GiB / 536 GiB avail; 55 MiB/s rd, 140 MiB/s wr, 357 op/s 2024-03-12T16:11:11.949 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-12T16:11:11.949 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1/tmp 2024-03-12T16:11:13.147 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:12 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:11.505070+0000 mgr.smithi134.gcntfu (mgr.24383) 83 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 55 MiB/s rd, 142 MiB/s wr, 449 op/s 2024-03-12T16:11:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:11.505070+0000 mgr.smithi134.gcntfu (mgr.24383) 83 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 55 MiB/s rd, 142 MiB/s wr, 449 op/s 2024-03-12T16:11:14.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:13.723630+0000 mon.smithi006 (mon.0) 720 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:11:14.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:13.723630+0000 mon.smithi006 (mon.0) 720 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:11:15.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:13.505433+0000 mgr.smithi134.gcntfu (mgr.24383) 84 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 14 MiB/s rd, 39 MiB/s wr, 231 op/s 2024-03-12T16:11:15.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:14 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:13.505433+0000 mgr.smithi134.gcntfu (mgr.24383) 84 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 2.7 GiB data, 10 GiB used, 526 GiB / 536 GiB avail; 14 MiB/s rd, 39 MiB/s wr, 231 op/s 2024-03-12T16:11:16.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:14.820621+0000 mon.smithi006 (mon.0) 721 : cluster [DBG] mgrmap e25: smithi134.gcntfu(active, since 91s), standbys: smithi006.kskdce 2024-03-12T16:11:16.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:14.820621+0000 mon.smithi006 (mon.0) 721 : cluster [DBG] mgrmap e25: smithi134.gcntfu(active, since 91s), standbys: smithi006.kskdce 2024-03-12T16:11:17.188 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:15.505862+0000 mgr.smithi134.gcntfu (mgr.24383) 85 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 14 MiB/s rd, 40 MiB/s wr, 330 op/s 2024-03-12T16:11:17.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:15.505862+0000 mgr.smithi134.gcntfu (mgr.24383) 85 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 14 MiB/s rd, 40 MiB/s wr, 330 op/s 2024-03-12T16:11:19.046 INFO:teuthology.orchestra.run:Running command with timeout 3600 2024-03-12T16:11:19.046 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0/tmp 2024-03-12T16:11:19.116 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:17.506358+0000 mgr.smithi134.gcntfu (mgr.24383) 86 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 29 KiB/s rd, 2.2 MiB/s wr, 191 op/s 2024-03-12T16:11:19.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:17.506358+0000 mgr.smithi134.gcntfu (mgr.24383) 86 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 29 KiB/s rd, 2.2 MiB/s wr, 191 op/s 2024-03-12T16:11:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:19.506631+0000 mgr.smithi134.gcntfu (mgr.24383) 87 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 29 KiB/s rd, 2.2 MiB/s wr, 191 op/s 2024-03-12T16:11:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:19.506631+0000 mgr.smithi134.gcntfu (mgr.24383) 87 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 1.2 GiB data, 5.4 GiB used, 531 GiB / 536 GiB avail; 29 KiB/s rd, 2.2 MiB/s wr, 191 op/s 2024-03-12T16:11:23.102 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:22 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:21.507123+0000 mgr.smithi134.gcntfu (mgr.24383) 88 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 428 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 41 KiB/s rd, 2.8 MiB/s wr, 293 op/s 2024-03-12T16:11:23.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:22 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:21.507123+0000 mgr.smithi134.gcntfu (mgr.24383) 88 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 428 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 41 KiB/s rd, 2.8 MiB/s wr, 293 op/s 2024-03-12T16:11:25.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:23.508624+0000 mgr.smithi134.gcntfu (mgr.24383) 89 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 428 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 202 op/s 2024-03-12T16:11:25.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:23.508624+0000 mgr.smithi134.gcntfu (mgr.24383) 89 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 428 MiB data, 3.3 GiB used, 533 GiB / 536 GiB avail; 29 KiB/s rd, 1.2 MiB/s wr, 202 op/s 2024-03-12T16:11:27.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:25.509164+0000 mgr.smithi134.gcntfu (mgr.24383) 90 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.0 MiB/s wr, 350 op/s 2024-03-12T16:11:27.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:25.509164+0000 mgr.smithi134.gcntfu (mgr.24383) 90 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 44 KiB/s rd, 2.0 MiB/s wr, 350 op/s 2024-03-12T16:11:29.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:27.509487+0000 mgr.smithi134.gcntfu (mgr.24383) 91 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 251 op/s 2024-03-12T16:11:29.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:28.723984+0000 mon.smithi006 (mon.0) 722 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:11:29.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:27.509487+0000 mgr.smithi134.gcntfu (mgr.24383) 91 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 251 op/s 2024-03-12T16:11:29.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:28.723984+0000 mon.smithi006 (mon.0) 722 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:11:31.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:29.509852+0000 mgr.smithi134.gcntfu (mgr.24383) 92 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 251 op/s 2024-03-12T16:11:31.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:29.509852+0000 mgr.smithi134.gcntfu (mgr.24383) 92 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 292 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 27 KiB/s rd, 1.3 MiB/s wr, 251 op/s 2024-03-12T16:11:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:31.016837+0000 mon.smithi006 (mon.0) 723 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:31.021218+0000 mon.smithi006 (mon.0) 724 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:31.046156+0000 mon.smithi006 (mon.0) 725 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:31.046494+0000 mgr.smithi134.gcntfu (mgr.24383) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:31.049850+0000 mon.smithi006 (mon.0) 726 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:31.050277+0000 mgr.smithi134.gcntfu (mgr.24383) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:31.053262+0000 mon.smithi006 (mon.0) 727 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:31.053496+0000 mgr.smithi134.gcntfu (mgr.24383) 95 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:31.059329+0000 mon.smithi006 (mon.0) 728 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:31.061348+0000 mgr.smithi134.gcntfu (mgr.24383) 96 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi134.gcntfu) 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:31.061823+0000 mgr.smithi134.gcntfu (mgr.24383) 97 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi134.gcntfu) 2024-03-12T16:11:32.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:31.510418+0000 mgr.smithi134.gcntfu (mgr.24383) 98 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.1 MiB/s wr, 493 op/s 2024-03-12T16:11:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:31.016837+0000 mon.smithi006 (mon.0) 723 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:31.021218+0000 mon.smithi006 (mon.0) 724 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:31.046156+0000 mon.smithi006 (mon.0) 725 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:11:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:31.046494+0000 mgr.smithi134.gcntfu (mgr.24383) 93 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:11:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:31.049850+0000 mon.smithi006 (mon.0) 726 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:11:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:31.050277+0000 mgr.smithi134.gcntfu (mgr.24383) 94 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:11:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:31.053262+0000 mon.smithi006 (mon.0) 727 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:11:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:31.053496+0000 mgr.smithi134.gcntfu (mgr.24383) 95 : audit [DBG] from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:11:32.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:31.059329+0000 mon.smithi006 (mon.0) 728 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:32.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:31.061348+0000 mgr.smithi134.gcntfu (mgr.24383) 96 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi134.gcntfu) 2024-03-12T16:11:32.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:31.061823+0000 mgr.smithi134.gcntfu (mgr.24383) 97 : cephadm [INF] Upgrade: Need to upgrade myself (mgr.smithi134.gcntfu) 2024-03-12T16:11:32.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:31.510418+0000 mgr.smithi134.gcntfu (mgr.24383) 98 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 52 KiB/s rd, 2.1 MiB/s wr, 493 op/s 2024-03-12T16:11:34.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.261+0000 7f6a815e6700 1 -- 172.21.15.6:0/3603679256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f80f0 msgr2=0x7f6a7c0f8b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.261+0000 7f6a815e6700 1 --2- 172.21.15.6:0/3603679256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f80f0 0x7f6a7c0f8b20 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f6a700047f0 tx=0x7f6a70009cb0).stop 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.261+0000 7f6a815e6700 1 -- 172.21.15.6:0/3603679256 shutdown_connections 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.261+0000 7f6a815e6700 1 --2- 172.21.15.6:0/3603679256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f80f0 0x7f6a7c0f8b20 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.261+0000 7f6a815e6700 1 --2- 172.21.15.6:0/3603679256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a7c0f77e0 0x7f6a7c0f7c00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.261+0000 7f6a815e6700 1 -- 172.21.15.6:0/3603679256 >> 172.21.15.6:0/3603679256 conn(0x7f6a7c0f2fc0 msgr2=0x7f6a7c0f5400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.261+0000 7f6a815e6700 1 -- 172.21.15.6:0/3603679256 shutdown_connections 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.261+0000 7f6a815e6700 1 -- 172.21.15.6:0/3603679256 wait complete. 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.262+0000 7f6a815e6700 1 Processor -- start 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.262+0000 7f6a815e6700 1 -- start start 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.262+0000 7f6a815e6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f77e0 0x7f6a7c107f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:34.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.262+0000 7f6a815e6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a7c0f80f0 0x7f6a7c108420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.262+0000 7f6a815e6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c1089d0 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.262+0000 7f6a815e6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6a7c108b10 con 0x7f6a7c0f80f0 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.262+0000 7f6a7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f77e0 0x7f6a7c107f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.262+0000 7f6a7affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f77e0 0x7f6a7c107f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48602/0 (socket says 172.21.15.6:48602) 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.262+0000 7f6a7affd700 1 -- 172.21.15.6:0/3751982042 learned_addr learned my addr 172.21.15.6:0/3751982042 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a7a7fc700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a7c0f80f0 0x7f6a7c108420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a7affd700 1 -- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a7c0f80f0 msgr2=0x7f6a7c108420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a7affd700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a7c0f80f0 0x7f6a7c108420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a7affd700 1 -- 172.21.15.6:0/3751982042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6a70005040 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a7affd700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f77e0 0x7f6a7c107f30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f6a6c0027a0 tx=0x7f6a6c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a63fff700 1 -- 172.21.15.6:0/3751982042 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a6c007b40 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a63fff700 1 -- 172.21.15.6:0/3751982042 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6a6c00f040 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6a7c10d5b0 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a63fff700 1 -- 172.21.15.6:0/3751982042 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6a6c014830 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.263+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6a7c10db70 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.264+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6a7c0fffe0 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.265+0000 7f6a63fff700 1 -- 172.21.15.6:0/3751982042 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f6a6c007ca0 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.265+0000 7f6a63fff700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f6a64066ca0 0x7f6a64069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.265+0000 7f6a63fff700 1 -- 172.21.15.6:0/3751982042 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f6a6c083f30 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.266+0000 7f6a7a7fc700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f6a64066ca0 0x7f6a64069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:34.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.266+0000 7f6a7a7fc700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f6a64066ca0 0x7f6a64069160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6a70004f10 tx=0x7f6a7000b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:34.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.269+0000 7f6a63fff700 1 -- 172.21.15.6:0/3751982042 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f6a6c0521b0 con 0x7f6a7c0f77e0 2024-03-12T16:11:34.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.489+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6a7c059120 con 0x7f6a64066ca0 2024-03-12T16:11:34.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.491+0000 7f6a63fff700 1 -- 172.21.15.6:0/3751982042 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f6a7c059120 con 0x7f6a64066ca0 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f6a64066ca0 msgr2=0x7f6a64069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f6a64066ca0 0x7f6a64069160 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f6a70004f10 tx=0x7f6a7000b040).stop 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f77e0 msgr2=0x7f6a7c107f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f77e0 0x7f6a7c107f30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7f6a6c0027a0 tx=0x7f6a6c009f60).stop 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 shutdown_connections 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f6a64066ca0 0x7f6a64069160 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6a7c0f77e0 0x7f6a7c107f30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 --2- 172.21.15.6:0/3751982042 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6a7c0f80f0 0x7f6a7c108420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 >> 172.21.15.6:0/3751982042 conn(0x7f6a7c0f2fc0 msgr2=0x7f6a7c0fc570 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:34.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 shutdown_connections 2024-03-12T16:11:34.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.493+0000 7f6a815e6700 1 -- 172.21.15.6:0/3751982042 wait complete. 2024-03-12T16:11:34.504 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:11:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.595+0000 7fd8cf489700 1 -- 172.21.15.6:0/3297803666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 msgr2=0x7fd8c80f9110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.595+0000 7fd8cf489700 1 --2- 172.21.15.6:0/3297803666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 0x7fd8c80f9110 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7fd8b80047f0 tx=0x7fd8b8009cb0).stop 2024-03-12T16:11:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.595+0000 7fd8cf489700 1 -- 172.21.15.6:0/3297803666 shutdown_connections 2024-03-12T16:11:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.595+0000 7fd8cf489700 1 --2- 172.21.15.6:0/3297803666 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 0x7fd8c80f9110 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.595+0000 7fd8cf489700 1 --2- 172.21.15.6:0/3297803666 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c80f7a10 0x7fd8c80f7e30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.595+0000 7fd8cf489700 1 -- 172.21.15.6:0/3297803666 >> 172.21.15.6:0/3297803666 conn(0x7fd8c80f3150 msgr2=0x7fd8c80f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cf489700 1 -- 172.21.15.6:0/3297803666 shutdown_connections 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cf489700 1 -- 172.21.15.6:0/3297803666 wait complete. 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cf489700 1 Processor -- start 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cf489700 1 -- start start 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cf489700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c80f7a10 0x7fd8c810a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cf489700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 0x7fd8c810a920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cf489700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c810af60 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cf489700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd8c810b0a0 con 0x7fd8c80f7a10 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cca24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 0x7fd8c810a920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cca24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 0x7fd8c810a920 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48612/0 (socket says 172.21.15.6:48612) 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.596+0000 7fd8cca24700 1 -- 172.21.15.6:0/2207266428 learned_addr learned my addr 172.21.15.6:0/2207266428 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:34.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8cd225700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c80f7a10 0x7fd8c810a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8cca24700 1 -- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c80f7a10 msgr2=0x7fd8c810a430 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8cca24700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c80f7a10 0x7fd8c810a430 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8cca24700 1 -- 172.21.15.6:0/2207266428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd8b8005040 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8cd225700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c80f7a10 0x7fd8c810a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8cca24700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 0x7fd8c810a920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fd8b800b120 tx=0x7fd8b8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8be7fc700 1 -- 172.21.15.6:0/2207266428 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b800e030 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8be7fc700 1 -- 172.21.15.6:0/2207266428 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd8b8007e90 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8be7fc700 1 -- 172.21.15.6:0/2207266428 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd8b8018070 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd8c810fae0 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.597+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd8c810ffc0 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.598+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd8c805fb50 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.598+0000 7fd8be7fc700 1 -- 172.21.15.6:0/2207266428 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7fd8b801d960 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.599+0000 7fd8be7fc700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fd8b4066c80 0x7fd8b4069140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.599+0000 7fd8be7fc700 1 -- 172.21.15.6:0/2207266428 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7fd8b80856b0 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.599+0000 7fd8cd225700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fd8b4066c80 0x7fd8b4069140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:34.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.600+0000 7fd8cd225700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fd8b4066c80 0x7fd8b4069140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd8c80f8b10 tx=0x7fd8c4008040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:34.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.604+0000 7fd8be7fc700 1 -- 172.21.15.6:0/2207266428 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fd8b80539f0 con 0x7fd8c80f8cb0 2024-03-12T16:11:34.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:33.510823+0000 mgr.smithi134.gcntfu (mgr.24383) 99 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.5 MiB/s wr, 390 op/s 2024-03-12T16:11:34.819 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.818+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd8c80008d0 con 0x7fd8b4066c80 2024-03-12T16:11:34.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.820+0000 7fd8be7fc700 1 -- 172.21.15.6:0/2207266428 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7fd8c80008d0 con 0x7fd8b4066c80 2024-03-12T16:11:34.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fd8b4066c80 msgr2=0x7fd8b4069140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fd8b4066c80 0x7fd8b4069140 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fd8c80f8b10 tx=0x7fd8c4008040).stop 2024-03-12T16:11:34.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 msgr2=0x7fd8c810a920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 0x7fd8c810a920 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7fd8b800b120 tx=0x7fd8b8009cb0).stop 2024-03-12T16:11:34.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 shutdown_connections 2024-03-12T16:11:34.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7fd8b4066c80 0x7fd8b4069140 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd8c80f7a10 0x7fd8c810a430 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 --2- 172.21.15.6:0/2207266428 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd8c80f8cb0 0x7fd8c810a920 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 >> 172.21.15.6:0/2207266428 conn(0x7fd8c80f3150 msgr2=0x7fd8c806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:34.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 shutdown_connections 2024-03-12T16:11:34.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.822+0000 7fd8cf489700 1 -- 172.21.15.6:0/2207266428 wait complete. 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.926+0000 7f2f4843a700 1 -- 172.21.15.6:0/2253197000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400fa920 msgr2=0x7f2f400fcd70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.926+0000 7f2f4843a700 1 --2- 172.21.15.6:0/2253197000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400fa920 0x7f2f400fcd70 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f2f300047f0 tx=0x7f2f30009cb0).stop 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.926+0000 7f2f4843a700 1 -- 172.21.15.6:0/2253197000 shutdown_connections 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.926+0000 7f2f4843a700 1 --2- 172.21.15.6:0/2253197000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f400fa920 0x7f2f400fcd70 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.926+0000 7f2f4843a700 1 --2- 172.21.15.6:0/2253197000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f40061280 0x7f2f400fa3a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.926+0000 7f2f4843a700 1 -- 172.21.15.6:0/2253197000 >> 172.21.15.6:0/2253197000 conn(0x7f2f400f1e20 msgr2=0x7f2f400f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.926+0000 7f2f4843a700 1 -- 172.21.15.6:0/2253197000 shutdown_connections 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.926+0000 7f2f4843a700 1 -- 172.21.15.6:0/2253197000 wait complete. 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f4843a700 1 Processor -- start 2024-03-12T16:11:34.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f4843a700 1 -- start start 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f4843a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f40061280 0x7f2f40107f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f4843a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f400fa920 0x7f2f40108450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f4843a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40108a00 con 0x7f2f40061280 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f4843a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f40108b40 con 0x7f2f400fa920 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f461d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f40061280 0x7f2f40107f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f461d6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f40061280 0x7f2f40107f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48642/0 (socket says 172.21.15.6:48642) 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f461d6700 1 -- 172.21.15.6:0/2204482726 learned_addr learned my addr 172.21.15.6:0/2204482726 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.927+0000 7f2f459d5700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f400fa920 0x7f2f40108450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.928+0000 7f2f461d6700 1 -- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f400fa920 msgr2=0x7f2f40108450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.928+0000 7f2f461d6700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f400fa920 0x7f2f40108450 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:34.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.928+0000 7f2f461d6700 1 -- 172.21.15.6:0/2204482726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f30005040 con 0x7f2f40061280 2024-03-12T16:11:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.928+0000 7f2f461d6700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f40061280 0x7f2f40107f60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f2f3c00c790 tx=0x7f2f3c004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.928+0000 7f2f377fe700 1 -- 172.21.15.6:0/2204482726 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c00e680 con 0x7f2f40061280 2024-03-12T16:11:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.928+0000 7f2f377fe700 1 -- 172.21.15.6:0/2204482726 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f3c00ec90 con 0x7f2f40061280 2024-03-12T16:11:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.928+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f401094e0 con 0x7f2f40061280 2024-03-12T16:11:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.928+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f40109aa0 con 0x7f2f40061280 2024-03-12T16:11:34.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.928+0000 7f2f377fe700 1 -- 172.21.15.6:0/2204482726 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f3c012d60 con 0x7f2f40061280 2024-03-12T16:11:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.930+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f24005150 con 0x7f2f40061280 2024-03-12T16:11:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.930+0000 7f2f377fe700 1 -- 172.21.15.6:0/2204482726 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f2f3c01a360 con 0x7f2f40061280 2024-03-12T16:11:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.930+0000 7f2f377fe700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2f2c066cf0 0x7f2f2c0691b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.930+0000 7f2f377fe700 1 -- 172.21.15.6:0/2204482726 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f2f3c0839a0 con 0x7f2f40061280 2024-03-12T16:11:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.931+0000 7f2f459d5700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2f2c066cf0 0x7f2f2c0691b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:34.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.931+0000 7f2f459d5700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2f2c066cf0 0x7f2f2c0691b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2f30004f10 tx=0x7f2f3000b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:34.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:34.935+0000 7f2f377fe700 1 -- 172.21.15.6:0/2204482726 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f2f3c04c320 con 0x7f2f40061280 2024-03-12T16:11:34.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:34 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:33.510823+0000 mgr.smithi134.gcntfu (mgr.24383) 99 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 40 KiB/s rd, 1.5 MiB/s wr, 390 op/s 2024-03-12T16:11:35.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.157+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f24000bf0 con 0x7f2f2c066cf0 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.168+0000 7f2f377fe700 1 -- 172.21.15.6:0/2204482726 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3366 (secure 0 0 0) 0x7f2f24000bf0 con 0x7f2f2c066cf0 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 starting - - - - 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (9m) 102s ago 9m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (8m) 104s ago 8m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 starting - - - - 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (4m) 102s ago 4m 86.1M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (4m) 102s ago 4m 12.7M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (4m) 104s ago 4m 56.5M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (4m) 104s ago 4m 15.3M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:11:35.169 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:9283 running (10m) 102s ago 10m 358M - 16.2.15-1-g8963e9de 727f386679cb f09ce35a51f8 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283 running (2m) 104s ago 8m 477M - 18.2.2-797-g49e4a679 72a574b3d6f5 4b7738c64f1d 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (10m) 102s ago 10m 47.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (8m) 104s ago 8m 40.3M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 starting - - - - 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 starting - - - - 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (8m) 102s ago 8m 81.0M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (7m) 102s ago 7m 87.9M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (7m) 102s ago 7m 74.3M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (6m) 104s ago 6m 84.5M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (6m) 104s ago 6m 83.7M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (5m) 104s ago 5m 78.8M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:11:35.170 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 starting - - - - 2024-03-12T16:11:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2f2c066cf0 msgr2=0x7f2f2c0691b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2f2c066cf0 0x7f2f2c0691b0 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f2f30004f10 tx=0x7f2f3000b040).stop 2024-03-12T16:11:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f40061280 msgr2=0x7f2f40107f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f40061280 0x7f2f40107f60 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f2f3c00c790 tx=0x7f2f3c004330).stop 2024-03-12T16:11:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 shutdown_connections 2024-03-12T16:11:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2f2c066cf0 0x7f2f2c0691b0 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f40061280 0x7f2f40107f60 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 --2- 172.21.15.6:0/2204482726 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f400fa920 0x7f2f40108450 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 >> 172.21.15.6:0/2204482726 conn(0x7f2f400f1e20 msgr2=0x7f2f400f4210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:35.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 shutdown_connections 2024-03-12T16:11:35.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.170+0000 7f2f4843a700 1 -- 172.21.15.6:0/2204482726 wait complete. 2024-03-12T16:11:35.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.270+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/128062265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f7800 msgr2=0x7f2ecc0f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.270+0000 7f2ed2e6c700 1 --2- 172.21.15.6:0/128062265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f7800 0x7f2ecc0f7c20 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f2ec00047f0 tx=0x7f2ec0009cb0).stop 2024-03-12T16:11:35.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.272+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/128062265 shutdown_connections 2024-03-12T16:11:35.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.272+0000 7f2ed2e6c700 1 --2- 172.21.15.6:0/128062265 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ecc0f8aa0 0x7f2ecc0f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.272+0000 7f2ed2e6c700 1 --2- 172.21.15.6:0/128062265 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f7800 0x7f2ecc0f7c20 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.272+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/128062265 >> 172.21.15.6:0/128062265 conn(0x7f2ecc0f2f80 msgr2=0x7f2ecc0f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:35.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.272+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/128062265 shutdown_connections 2024-03-12T16:11:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.272+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/128062265 wait complete. 2024-03-12T16:11:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ed2e6c700 1 Processor -- start 2024-03-12T16:11:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ed2e6c700 1 -- start start 2024-03-12T16:11:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ed2e6c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ecc0f7800 0x7f2ecc069f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ed2e6c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f8aa0 0x7f2ecc06a410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ed2e6c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc06a9c0 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ed2e6c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ecc06ab00 con 0x7f2ecc0f7800 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ecbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f8aa0 0x7f2ecc06a410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ecbfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f8aa0 0x7f2ecc06a410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48668/0 (socket says 172.21.15.6:48668) 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ecbfff700 1 -- 172.21.15.6:0/3162639529 learned_addr learned my addr 172.21.15.6:0/3162639529 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ecbfff700 1 -- 172.21.15.6:0/3162639529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ecc0f7800 msgr2=0x7f2ecc069f20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.273+0000 7f2ecbfff700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ecc0f7800 0x7f2ecc069f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.274+0000 7f2ecbfff700 1 -- 172.21.15.6:0/3162639529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec0005040 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.274+0000 7f2ecbfff700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f8aa0 0x7f2ecc06a410 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f2eb800e8f0 tx=0x7f2eb800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.274+0000 7f2ec9ffb700 1 -- 172.21.15.6:0/3162639529 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb800ee90 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.274+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ecc115ef0 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.274+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ecc116420 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.274+0000 7f2ec9ffb700 1 -- 172.21.15.6:0/3162639529 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2eb800f040 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.275+0000 7f2ec9ffb700 1 -- 172.21.15.6:0/3162639529 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2eb800c810 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.276+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2eb0005150 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.276+0000 7f2ec9ffb700 1 -- 172.21.15.6:0/3162639529 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f2eb8007b40 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.277+0000 7f2ec9ffb700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ebc066ca0 0x7f2ebc069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:35.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.277+0000 7f2ec9ffb700 1 -- 172.21.15.6:0/3162639529 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f2eb8083c30 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.277+0000 7f2ed0c08700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ebc066ca0 0x7f2ebc069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:35.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.278+0000 7f2ed0c08700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ebc066ca0 0x7f2ebc069160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2ec0013560 tx=0x7f2ec0009cb0).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:35.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.282+0000 7f2ec9ffb700 1 -- 172.21.15.6:0/3162639529 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f2eb8051f70 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.593+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2eb0006030 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.594+0000 7f2ec9ffb700 1 -- 172.21.15.6:0/3162639529 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+848 (secure 0 0 0) 0x7f2eb8051b60 con 0x7f2ecc0f8aa0 2024-03-12T16:11:35.595 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:11:35.595 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:11:35.595 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:11:35.595 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:11:35.595 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 13, 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:11:35.596 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.596+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ebc066ca0 msgr2=0x7f2ebc069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.596+0000 7f2ed2e6c700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ebc066ca0 0x7f2ebc069160 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f2ec0013560 tx=0x7f2ec0009cb0).stop 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.596+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f8aa0 msgr2=0x7f2ecc06a410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.596+0000 7f2ed2e6c700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f8aa0 0x7f2ecc06a410 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f2eb800e8f0 tx=0x7f2eb800b040).stop 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.596+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 shutdown_connections 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.596+0000 7f2ed2e6c700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f2ebc066ca0 0x7f2ebc069160 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.596+0000 7f2ed2e6c700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ecc0f7800 0x7f2ecc069f20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.596+0000 7f2ed2e6c700 1 --2- 172.21.15.6:0/3162639529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ecc0f8aa0 0x7f2ecc06a410 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.596+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 >> 172.21.15.6:0/3162639529 conn(0x7f2ecc0f2f80 msgr2=0x7f2ecc0fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.597+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 shutdown_connections 2024-03-12T16:11:35.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.597+0000 7f2ed2e6c700 1 -- 172.21.15.6:0/3162639529 wait complete. 2024-03-12T16:11:35.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.711+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/4260321929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3adc0fab90 msgr2=0x7f3adc0fcfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.711+0000 7f3ae0bf5700 1 --2- 172.21.15.6:0/4260321929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3adc0fab90 0x7f3adc0fcfe0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f3ad00047f0 tx=0x7f3ad0009cb0).stop 2024-03-12T16:11:35.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.711+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/4260321929 shutdown_connections 2024-03-12T16:11:35.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.711+0000 7f3ae0bf5700 1 --2- 172.21.15.6:0/4260321929 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3adc0fab90 0x7f3adc0fcfe0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.711+0000 7f3ae0bf5700 1 --2- 172.21.15.6:0/4260321929 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3adc061300 0x7f3adc0fa610 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.711+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/4260321929 >> 172.21.15.6:0/4260321929 conn(0x7f3adc0f2070 msgr2=0x7f3adc0f44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:35.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.711+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/4260321929 shutdown_connections 2024-03-12T16:11:35.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.711+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/4260321929 wait complete. 2024-03-12T16:11:35.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.712+0000 7f3ae0bf5700 1 Processor -- start 2024-03-12T16:11:35.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.712+0000 7f3ae0bf5700 1 -- start start 2024-03-12T16:11:35.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ae0bf5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3adc061300 0x7f3adc108170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:35.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ae0bf5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3adc0fab90 0x7f3adc108660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:35.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ae0bf5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc108c10 con 0x7f3adc0fab90 2024-03-12T16:11:35.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ae0bf5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3adc108d50 con 0x7f3adc061300 2024-03-12T16:11:35.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ada59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3adc061300 0x7f3adc108170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ada59c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3adc061300 0x7f3adc108170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:53952/0 (socket says 172.21.15.6:53952) 2024-03-12T16:11:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ada59c700 1 -- 172.21.15.6:0/3183710308 learned_addr learned my addr 172.21.15.6:0/3183710308 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:11:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ad9d9b700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3adc0fab90 0x7f3adc108660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:11:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ada59c700 1 -- 172.21.15.6:0/3183710308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3adc0fab90 msgr2=0x7f3adc108660 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ada59c700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3adc0fab90 0x7f3adc108660 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ada59c700 1 -- 172.21.15.6:0/3183710308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ad0005040 con 0x7f3adc061300 2024-03-12T16:11:35.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.713+0000 7f3ada59c700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3adc061300 0x7f3adc108170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3acc0041d0 tx=0x7f3acc009f60).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.714+0000 7f3acb7fe700 1 -- 172.21.15.6:0/3183710308 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc007b40 con 0x7f3adc061300 2024-03-12T16:11:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.714+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3adc10d7f0 con 0x7f3adc061300 2024-03-12T16:11:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.714+0000 7f3acb7fe700 1 -- 172.21.15.6:0/3183710308 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3acc00f040 con 0x7f3adc061300 2024-03-12T16:11:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.714+0000 7f3acb7fe700 1 -- 172.21.15.6:0/3183710308 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3acc0147b0 con 0x7f3adc061300 2024-03-12T16:11:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.714+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3adc10ddb0 con 0x7f3adc061300 2024-03-12T16:11:35.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.715+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3adc05fb50 con 0x7f3adc061300 2024-03-12T16:11:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.715+0000 7f3acb7fe700 1 -- 172.21.15.6:0/3183710308 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 25) v1 ==== 83960+0+0 (secure 0 0 0) 0x7f3acc009110 con 0x7f3adc061300 2024-03-12T16:11:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.715+0000 7f3acb7fe700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3ac4066ca0 0x7f3ac4069160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:11:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.716+0000 7f3acb7fe700 1 -- 172.21.15.6:0/3183710308 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(47..47 src has 1..47) v4 ==== 5531+0+0 (secure 0 0 0) 0x7f3acc084180 con 0x7f3adc061300 2024-03-12T16:11:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.716+0000 7f3ad9d9b700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3ac4066ca0 0x7f3ac4069160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:11:35.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.716+0000 7f3ad9d9b700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3ac4066ca0 0x7f3ac4069160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3ad0004f10 tx=0x7f3ad000b040).ready entity=mgr.24383 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:11:35.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.721+0000 7f3acb7fe700 1 -- 172.21.15.6:0/3183710308 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f3acc052440 con 0x7f3adc061300 2024-03-12T16:11:35.896 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:34.490726+0000 mgr.smithi134.gcntfu (mgr.24383) 100 : audit [DBG] from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:35.896 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:34.820032+0000 mgr.smithi134.gcntfu (mgr.24383) 101 : audit [DBG] from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:35.896 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:34.884753+0000 mgr.smithi134.gcntfu (mgr.24383) 102 : cephadm [INF] Upgrade: Updating mgr.smithi006.kskdce 2024-03-12T16:11:35.896 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:34.891329+0000 mon.smithi006 (mon.0) 729 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:35.896 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:34.892456+0000 mon.smithi006 (mon.0) 730 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi006.kskdce", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:11:35.897 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:34.893471+0000 mon.smithi006 (mon.0) 731 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:11:35.897 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:34.894496+0000 mon.smithi006 (mon.0) 732 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:11:35.897 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:34.895498+0000 mgr.smithi134.gcntfu (mgr.24383) 103 : cephadm [INF] Deploying daemon mgr.smithi006.kskdce on smithi006 2024-03-12T16:11:35.897 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:35.594515+0000 mon.smithi006 (mon.0) 733 : audit [DBG] from='client.? 172.21.15.6:0/3162639529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:11:35.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.989+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 --> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3adc1021e0 con 0x7f3ac4066ca0 2024-03-12T16:11:35.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.991+0000 7f3acb7fe700 1 -- 172.21.15.6:0/3183710308 <== mgr.24383 v2:172.21.15.134:6828/3354806786 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+341 (secure 0 0 0) 0x7f3adc1021e0 con 0x7f3ac4066ca0 2024-03-12T16:11:35.992 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:11:35.992 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:11:35.992 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:11:35.992 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-12T16:11:35.992 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [], 2024-03-12T16:11:35.992 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "1/2 daemons upgraded", 2024-03-12T16:11:35.992 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mgr daemons", 2024-03-12T16:11:35.992 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:11:35.992 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:11:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3ac4066ca0 msgr2=0x7f3ac4069160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3ac4066ca0 0x7f3ac4069160 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f3ad0004f10 tx=0x7f3ad000b040).stop 2024-03-12T16:11:35.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3adc061300 msgr2=0x7f3adc108170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:11:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3adc061300 0x7f3adc108170 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7f3acc0041d0 tx=0x7f3acc009f60).stop 2024-03-12T16:11:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 shutdown_connections 2024-03-12T16:11:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:6828/3354806786,v1:172.21.15.134:6829/3354806786] conn(0x7f3ac4066ca0 0x7f3ac4069160 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3adc061300 0x7f3adc108170 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 --2- 172.21.15.6:0/3183710308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3adc0fab90 0x7f3adc108660 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:11:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 >> 172.21.15.6:0/3183710308 conn(0x7f3adc0f2070 msgr2=0x7f3adc0f44b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:11:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 shutdown_connections 2024-03-12T16:11:35.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:11:35.994+0000 7f3ae0bf5700 1 -- 172.21.15.6:0/3183710308 wait complete. 2024-03-12T16:11:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:34.490726+0000 mgr.smithi134.gcntfu (mgr.24383) 100 : audit [DBG] from='client.14644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:34.820032+0000 mgr.smithi134.gcntfu (mgr.24383) 101 : audit [DBG] from='client.14648 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:34.884753+0000 mgr.smithi134.gcntfu (mgr.24383) 102 : cephadm [INF] Upgrade: Updating mgr.smithi006.kskdce 2024-03-12T16:11:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:34.891329+0000 mon.smithi006 (mon.0) 729 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:34.892456+0000 mon.smithi006 (mon.0) 730 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi006.kskdce", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:11:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:34.893471+0000 mon.smithi006 (mon.0) 731 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:11:36.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:34.894496+0000 mon.smithi006 (mon.0) 732 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:11:36.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:34.895498+0000 mgr.smithi134.gcntfu (mgr.24383) 103 : cephadm [INF] Deploying daemon mgr.smithi006.kskdce on smithi006 2024-03-12T16:11:36.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:35.594515+0000 mon.smithi006 (mon.0) 733 : audit [DBG] from='client.? 172.21.15.6:0/3162639529' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:11:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:35.159256+0000 mgr.smithi134.gcntfu (mgr.24383) 104 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:35.511436+0000 mgr.smithi134.gcntfu (mgr.24383) 105 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.6 MiB/s wr, 466 op/s 2024-03-12T16:11:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:35.159256+0000 mgr.smithi134.gcntfu (mgr.24383) 104 : audit [DBG] from='client.14652 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:35.511436+0000 mgr.smithi134.gcntfu (mgr.24383) 105 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 47 KiB/s rd, 1.6 MiB/s wr, 466 op/s 2024-03-12T16:11:38.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:35.990815+0000 mgr.smithi134.gcntfu (mgr.24383) 106 : audit [DBG] from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:38.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:35.990815+0000 mgr.smithi134.gcntfu (mgr.24383) 106 : audit [DBG] from='client.24481 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:11:38.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:37.511841+0000 mgr.smithi134.gcntfu (mgr.24383) 107 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 895 KiB/s wr, 317 op/s 2024-03-12T16:11:39.075 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:38 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:37.511841+0000 mgr.smithi134.gcntfu (mgr.24383) 107 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 895 KiB/s wr, 317 op/s 2024-03-12T16:11:40.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:39.213997+0000 mon.smithi006 (mon.0) 734 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:40.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:39.221525+0000 mon.smithi006 (mon.0) 735 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:40.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:39.265683+0000 mon.smithi006 (mon.0) 736 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:40.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:39.512223+0000 mgr.smithi134.gcntfu (mgr.24383) 108 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 895 KiB/s wr, 317 op/s 2024-03-12T16:11:40.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:39.635216+0000 mon.smithi006 (mon.0) 737 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:40.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:39.641550+0000 mon.smithi006 (mon.0) 738 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:40.588 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:39.213997+0000 mon.smithi006 (mon.0) 734 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:40.588 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:39.221525+0000 mon.smithi006 (mon.0) 735 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:40.588 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:39.265683+0000 mon.smithi006 (mon.0) 736 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:40.588 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:39.512223+0000 mgr.smithi134.gcntfu (mgr.24383) 108 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 295 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 32 KiB/s rd, 895 KiB/s wr, 317 op/s 2024-03-12T16:11:40.589 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:39.635216+0000 mon.smithi006 (mon.0) 737 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:40.589 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:39.641550+0000 mon.smithi006 (mon.0) 738 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:42.663 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:41.512760+0000 mgr.smithi134.gcntfu (mgr.24383) 109 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.8 MiB/s wr, 357 op/s 2024-03-12T16:11:42.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:41.512760+0000 mgr.smithi134.gcntfu (mgr.24383) 109 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 35 KiB/s rd, 1.8 MiB/s wr, 357 op/s 2024-03-12T16:11:44.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:43.345907+0000 mon.smithi006 (mon.0) 739 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:44.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:43.350673+0000 mon.smithi006 (mon.0) 740 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:44.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:43.513144+0000 mgr.smithi134.gcntfu (mgr.24383) 110 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-03-12T16:11:44.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:44 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:43.728078+0000 mon.smithi006 (mon.0) 741 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:11:44.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:43.345907+0000 mon.smithi006 (mon.0) 739 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:44.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:43.350673+0000 mon.smithi006 (mon.0) 740 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:44.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:43.513144+0000 mgr.smithi134.gcntfu (mgr.24383) 110 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 305 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 10 KiB/s rd, 1.0 MiB/s wr, 114 op/s 2024-03-12T16:11:44.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:43.728078+0000 mon.smithi006 (mon.0) 741 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:11:46.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:45.035789+0000 mon.smithi006 (mon.0) 742 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:46.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:45.040518+0000 mon.smithi006 (mon.0) 743 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:46.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:45.513568+0000 mgr.smithi134.gcntfu (mgr.24383) 111 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.9 MiB/s wr, 372 op/s 2024-03-12T16:11:46.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:45.877416+0000 mon.smithi006 (mon.0) 744 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:46.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:45.887497+0000 mon.smithi006 (mon.0) 745 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:45.035789+0000 mon.smithi006 (mon.0) 742 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:45.040518+0000 mon.smithi006 (mon.0) 743 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:45.513568+0000 mgr.smithi134.gcntfu (mgr.24383) 111 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 37 KiB/s rd, 1.9 MiB/s wr, 372 op/s 2024-03-12T16:11:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:45.877416+0000 mon.smithi006 (mon.0) 744 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:45.887497+0000 mon.smithi006 (mon.0) 745 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:48.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:47.513890+0000 mgr.smithi134.gcntfu (mgr.24383) 112 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 297 op/s 2024-03-12T16:11:48.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:48.452412+0000 mon.smithi006 (mon.0) 746 : cluster [DBG] Standby manager daemon smithi006.kskdce restarted 2024-03-12T16:11:48.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:48.452540+0000 mon.smithi006 (mon.0) 747 : cluster [DBG] Standby manager daemon smithi006.kskdce started 2024-03-12T16:11:48.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:48.456448+0000 mon.smithi006 (mon.0) 748 : audit [DBG] from='mgr.? 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi006.kskdce/crt"}]: dispatch 2024-03-12T16:11:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:48.457156+0000 mon.smithi006 (mon.0) 749 : audit [DBG] from='mgr.? 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:11:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:48.459928+0000 mon.smithi006 (mon.0) 750 : audit [DBG] from='mgr.? 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi006.kskdce/key"}]: dispatch 2024-03-12T16:11:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:48.460507+0000 mon.smithi006 (mon.0) 751 : audit [DBG] from='mgr.? 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:11:48.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:47.513890+0000 mgr.smithi134.gcntfu (mgr.24383) 112 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 297 op/s 2024-03-12T16:11:48.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:48.452412+0000 mon.smithi006 (mon.0) 746 : cluster [DBG] Standby manager daemon smithi006.kskdce restarted 2024-03-12T16:11:48.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:48.452540+0000 mon.smithi006 (mon.0) 747 : cluster [DBG] Standby manager daemon smithi006.kskdce started 2024-03-12T16:11:48.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:48.456448+0000 mon.smithi006 (mon.0) 748 : audit [DBG] from='mgr.? 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi006.kskdce/crt"}]: dispatch 2024-03-12T16:11:48.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:48.457156+0000 mon.smithi006 (mon.0) 749 : audit [DBG] from='mgr.? 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:11:48.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:48.459928+0000 mon.smithi006 (mon.0) 750 : audit [DBG] from='mgr.? 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi006.kskdce/key"}]: dispatch 2024-03-12T16:11:48.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:48.460507+0000 mon.smithi006 (mon.0) 751 : audit [DBG] from='mgr.? 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:11:49.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:48.576607+0000 mon.smithi006 (mon.0) 752 : cluster [DBG] mgrmap e26: smithi134.gcntfu(active, since 2m), standbys: smithi006.kskdce 2024-03-12T16:11:49.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:48.576607+0000 mon.smithi006 (mon.0) 752 : cluster [DBG] mgrmap e26: smithi134.gcntfu(active, since 2m), standbys: smithi006.kskdce 2024-03-12T16:11:50.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:50 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:49.514198+0000 mgr.smithi134.gcntfu (mgr.24383) 113 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 297 op/s 2024-03-12T16:11:50.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:49.514198+0000 mgr.smithi134.gcntfu (mgr.24383) 113 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 296 MiB data, 2.7 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 1.8 MiB/s wr, 297 op/s 2024-03-12T16:11:51.821 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:50.818639+0000 mon.smithi006 (mon.0) 753 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:50.831728+0000 mon.smithi006 (mon.0) 754 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:50.833193+0000 mon.smithi006 (mon.0) 755 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:50.834203+0000 mon.smithi006 (mon.0) 756 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:50.843011+0000 mon.smithi006 (mon.0) 757 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.038742+0000 mon.smithi006 (mon.0) 758 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.047661+0000 mon.smithi006 (mon.0) 759 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mgr fail", "who": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:51.056395+0000 mon.smithi006 (mon.0) 760 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.058802+0000 mon.smithi006 (mon.0) 761 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd='[{"prefix": "mgr fail", "who": "smithi134.gcntfu"}]': finished 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:51.058875+0000 mon.smithi006 (mon.0) 762 : cluster [DBG] mgrmap e27: smithi006.kskdce(active, starting, since 0.0108335s) 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.063748+0000 mon.smithi134 (mon.1) 20 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.063989+0000 mon.smithi134 (mon.1) 21 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:11:51.822 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.064129+0000 mon.smithi134 (mon.1) 22 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.064382+0000 mon.smithi134 (mon.1) 23 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.064574+0000 mon.smithi134 (mon.1) 24 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.064759+0000 mon.smithi134 (mon.1) 25 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.065432+0000 mon.smithi134 (mon.1) 26 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.065629+0000 mon.smithi134 (mon.1) 27 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.065965+0000 mon.smithi134 (mon.1) 28 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.066174+0000 mon.smithi134 (mon.1) 29 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.066388+0000 mon.smithi134 (mon.1) 30 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.066576+0000 mon.smithi134 (mon.1) 31 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.066791+0000 mon.smithi134 (mon.1) 32 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.067023+0000 mon.smithi134 (mon.1) 33 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.067367+0000 mon.smithi134 (mon.1) 34 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.067763+0000 mon.smithi134 (mon.1) 35 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:11:51.823 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:51.109746+0000 mon.smithi006 (mon.0) 763 : cluster [INF] Manager daemon smithi006.kskdce is now available 2024-03-12T16:11:51.824 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.146327+0000 mon.smithi134 (mon.1) 36 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:51.824 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.160926+0000 mon.smithi134 (mon.1) 37 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:51.824 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.173584+0000 mon.smithi134 (mon.1) 38 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:11:51.824 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.198221+0000 mon.smithi134 (mon.1) 39 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:11:51.824 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.199177+0000 mon.smithi006 (mon.0) 764 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:11:51.824 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.229927+0000 mon.smithi134 (mon.1) 40 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:11:51.824 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:51.230714+0000 mon.smithi006 (mon.0) 765 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:50.818639+0000 mon.smithi006 (mon.0) 753 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:50.831728+0000 mon.smithi006 (mon.0) 754 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:50.833193+0000 mon.smithi006 (mon.0) 755 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:50.834203+0000 mon.smithi006 (mon.0) 756 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:50.843011+0000 mon.smithi006 (mon.0) 757 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.038742+0000 mon.smithi006 (mon.0) 758 : audit [DBG] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.047661+0000 mon.smithi006 (mon.0) 759 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "mgr fail", "who": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:51.056395+0000 mon.smithi006 (mon.0) 760 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.058802+0000 mon.smithi006 (mon.0) 761 : audit [INF] from='mgr.24383 172.21.15.134:0/3986904622' entity='mgr.smithi134.gcntfu' cmd='[{"prefix": "mgr fail", "who": "smithi134.gcntfu"}]': finished 2024-03-12T16:11:51.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:51.058875+0000 mon.smithi006 (mon.0) 762 : cluster [DBG] mgrmap e27: smithi006.kskdce(active, starting, since 0.0108335s) 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.063748+0000 mon.smithi134 (mon.1) 20 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.063989+0000 mon.smithi134 (mon.1) 21 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.064129+0000 mon.smithi134 (mon.1) 22 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.064382+0000 mon.smithi134 (mon.1) 23 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.064574+0000 mon.smithi134 (mon.1) 24 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.064759+0000 mon.smithi134 (mon.1) 25 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.065432+0000 mon.smithi134 (mon.1) 26 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.065629+0000 mon.smithi134 (mon.1) 27 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.065965+0000 mon.smithi134 (mon.1) 28 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.066174+0000 mon.smithi134 (mon.1) 29 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.066388+0000 mon.smithi134 (mon.1) 30 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.066576+0000 mon.smithi134 (mon.1) 31 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.066791+0000 mon.smithi134 (mon.1) 32 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.067023+0000 mon.smithi134 (mon.1) 33 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.067367+0000 mon.smithi134 (mon.1) 34 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:11:51.956 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.067763+0000 mon.smithi134 (mon.1) 35 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:11:51.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:51.109746+0000 mon.smithi006 (mon.0) 763 : cluster [INF] Manager daemon smithi006.kskdce is now available 2024-03-12T16:11:51.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.146327+0000 mon.smithi134 (mon.1) 36 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:51.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.160926+0000 mon.smithi134 (mon.1) 37 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:11:51.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.173584+0000 mon.smithi134 (mon.1) 38 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:11:51.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.198221+0000 mon.smithi134 (mon.1) 39 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:11:51.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.199177+0000 mon.smithi006 (mon.0) 764 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:11:51.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.229927+0000 mon.smithi134 (mon.1) 40 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:11:51.957 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:51.230714+0000 mon.smithi006 (mon.0) 765 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:11:53.440 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:51.667843+0000 mgr.smithi006.kskdce (mgr.14664) 1 : cephadm [INF] [12/Mar/2024:16:11:51] ENGINE Bus STARTING 2024-03-12T16:11:53.440 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:51.770225+0000 mgr.smithi006.kskdce (mgr.14664) 2 : cephadm [INF] [12/Mar/2024:16:11:51] ENGINE Serving on http://172.21.15.6:8765 2024-03-12T16:11:53.441 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:51.893945+0000 mgr.smithi006.kskdce (mgr.14664) 3 : cephadm [INF] [12/Mar/2024:16:11:51] ENGINE Serving on https://172.21.15.6:7150 2024-03-12T16:11:53.441 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:11:51.894167+0000 mgr.smithi006.kskdce (mgr.14664) 4 : cephadm [INF] [12/Mar/2024:16:11:51] ENGINE Bus STARTED 2024-03-12T16:11:53.441 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:52.068430+0000 mon.smithi006 (mon.0) 766 : cluster [DBG] mgrmap e28: smithi006.kskdce(active, since 1.02039s) 2024-03-12T16:11:53.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:51.667843+0000 mgr.smithi006.kskdce (mgr.14664) 1 : cephadm [INF] [12/Mar/2024:16:11:51] ENGINE Bus STARTING 2024-03-12T16:11:53.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:51.770225+0000 mgr.smithi006.kskdce (mgr.14664) 2 : cephadm [INF] [12/Mar/2024:16:11:51] ENGINE Serving on http://172.21.15.6:8765 2024-03-12T16:11:53.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:51.893945+0000 mgr.smithi006.kskdce (mgr.14664) 3 : cephadm [INF] [12/Mar/2024:16:11:51] ENGINE Serving on https://172.21.15.6:7150 2024-03-12T16:11:53.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:11:51.894167+0000 mgr.smithi006.kskdce (mgr.14664) 4 : cephadm [INF] [12/Mar/2024:16:11:51] ENGINE Bus STARTED 2024-03-12T16:11:53.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:52.068430+0000 mon.smithi006 (mon.0) 766 : cluster [DBG] mgrmap e28: smithi006.kskdce(active, since 1.02039s) 2024-03-12T16:11:54.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:52.087561+0000 mgr.smithi006.kskdce (mgr.14664) 5 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:11:54.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:53.066599+0000 mgr.smithi006.kskdce (mgr.14664) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:11:54.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:53.081457+0000 mon.smithi006 (mon.0) 767 : cluster [DBG] mgrmap e29: smithi006.kskdce(active, since 2s) 2024-03-12T16:11:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:52.087561+0000 mgr.smithi006.kskdce (mgr.14664) 5 : cluster [DBG] pgmap v3: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:11:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:53.066599+0000 mgr.smithi006.kskdce (mgr.14664) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:11:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:53.081457+0000 mon.smithi006 (mon.0) 767 : cluster [DBG] mgrmap e29: smithi006.kskdce(active, since 2s) 2024-03-12T16:11:55.384 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:55.067008+0000 mgr.smithi006.kskdce (mgr.14664) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:11:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:55.067008+0000 mgr.smithi006.kskdce (mgr.14664) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:11:56.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:56 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:55.087860+0000 mon.smithi006 (mon.0) 768 : cluster [DBG] mgrmap e30: smithi006.kskdce(active, since 4s) 2024-03-12T16:11:56.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:55.087860+0000 mon.smithi006 (mon.0) 768 : cluster [DBG] mgrmap e30: smithi006.kskdce(active, since 4s) 2024-03-12T16:11:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:56.207727+0000 mon.smithi006 (mon.0) 769 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:11:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:56.216136+0000 mon.smithi006 (mon.0) 770 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:11:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:57.067386+0000 mgr.smithi006.kskdce (mgr.14664) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:11:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:57.107083+0000 mon.smithi006 (mon.0) 771 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:11:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:57.116973+0000 mon.smithi006 (mon.0) 772 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:11:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:56.207727+0000 mon.smithi006 (mon.0) 769 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:11:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:56.216136+0000 mon.smithi006 (mon.0) 770 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:11:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:57.067386+0000 mgr.smithi006.kskdce (mgr.14664) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 286 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:11:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:57.107083+0000 mon.smithi006 (mon.0) 771 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:11:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:57.116973+0000 mon.smithi006 (mon.0) 772 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:00.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:58.903797+0000 mon.smithi006 (mon.0) 773 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:00.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:58.910309+0000 mon.smithi006 (mon.0) 774 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:00.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:11:59.067971+0000 mgr.smithi006.kskdce (mgr.14664) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 1.1 MiB/s wr, 347 op/s 2024-03-12T16:12:00.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:59.803949+0000 mon.smithi006 (mon.0) 775 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:00.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:11:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:11:59.812797+0000 mon.smithi006 (mon.0) 776 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:00.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:58.903797+0000 mon.smithi006 (mon.0) 773 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:00.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:58.910309+0000 mon.smithi006 (mon.0) 774 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:00.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:11:59.067971+0000 mgr.smithi006.kskdce (mgr.14664) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 62 KiB/s rd, 1.1 MiB/s wr, 347 op/s 2024-03-12T16:12:00.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:59.803949+0000 mon.smithi006 (mon.0) 775 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:00.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:11:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:11:59.812797+0000 mon.smithi006 (mon.0) 776 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:01.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:00.122964+0000 mon.smithi006 (mon.0) 777 : cluster [DBG] Standby manager daemon smithi134.gcntfu started 2024-03-12T16:12:01.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:00.125280+0000 mon.smithi006 (mon.0) 778 : audit [DBG] from='mgr.? 172.21.15.134:0/965051688' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:12:01.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:00.131986+0000 mon.smithi006 (mon.0) 779 : audit [DBG] from='mgr.? 172.21.15.134:0/965051688' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:12:01.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:00.134174+0000 mon.smithi006 (mon.0) 780 : audit [DBG] from='mgr.? 172.21.15.134:0/965051688' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:12:01.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:00.135213+0000 mon.smithi006 (mon.0) 781 : audit [DBG] from='mgr.? 172.21.15.134:0/965051688' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:12:01.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:00.122964+0000 mon.smithi006 (mon.0) 777 : cluster [DBG] Standby manager daemon smithi134.gcntfu started 2024-03-12T16:12:01.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:00.125280+0000 mon.smithi006 (mon.0) 778 : audit [DBG] from='mgr.? 172.21.15.134:0/965051688' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:12:01.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:00.131986+0000 mon.smithi006 (mon.0) 779 : audit [DBG] from='mgr.? 172.21.15.134:0/965051688' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:12:01.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:00.134174+0000 mon.smithi006 (mon.0) 780 : audit [DBG] from='mgr.? 172.21.15.134:0/965051688' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:12:01.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:00.135213+0000 mon.smithi006 (mon.0) 781 : audit [DBG] from='mgr.? 172.21.15.134:0/965051688' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:12:02.090 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:00.920851+0000 mon.smithi006 (mon.0) 782 : cluster [DBG] mgrmap e31: smithi006.kskdce(active, since 9s), standbys: smithi134.gcntfu 2024-03-12T16:12:02.090 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:00.924088+0000 mon.smithi134 (mon.1) 41 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi134.gcntfu", "id": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:12:02.091 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:01.068584+0000 mgr.smithi006.kskdce (mgr.14664) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 896 KiB/s wr, 270 op/s 2024-03-12T16:12:02.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:00.920851+0000 mon.smithi006 (mon.0) 782 : cluster [DBG] mgrmap e31: smithi006.kskdce(active, since 9s), standbys: smithi134.gcntfu 2024-03-12T16:12:02.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:00.924088+0000 mon.smithi134 (mon.1) 41 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi134.gcntfu", "id": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:12:02.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:01.068584+0000 mgr.smithi006.kskdce (mgr.14664) 10 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 48 KiB/s rd, 896 KiB/s wr, 270 op/s 2024-03-12T16:12:03.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:03.069058+0000 mgr.smithi006.kskdce (mgr.14664) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-03-12T16:12:03.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:03.069058+0000 mgr.smithi006.kskdce (mgr.14664) 11 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 61 KiB/s rd, 1.5 MiB/s wr, 426 op/s 2024-03-12T16:12:06.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.162+0000 7efe2289a700 1 -- 172.21.15.6:0/4126790361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c1008e0 msgr2=0x7efe1c101310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:06.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.162+0000 7efe2289a700 1 --2- 172.21.15.6:0/4126790361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c1008e0 0x7efe1c101310 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7efe100047f0 tx=0x7efe10009cb0).stop 2024-03-12T16:12:06.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.164+0000 7efe2289a700 1 -- 172.21.15.6:0/4126790361 shutdown_connections 2024-03-12T16:12:06.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.164+0000 7efe2289a700 1 --2- 172.21.15.6:0/4126790361 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c1008e0 0x7efe1c101310 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:06.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.164+0000 7efe2289a700 1 --2- 172.21.15.6:0/4126790361 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe1c0fffd0 0x7efe1c1003f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:12:06.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.164+0000 7efe2289a700 1 -- 172.21.15.6:0/4126790361 >> 172.21.15.6:0/4126790361 conn(0x7efe1c066a00 msgr2=0x7efe1c068e20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:06.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.165+0000 7efe2289a700 1 -- 172.21.15.6:0/4126790361 shutdown_connections 2024-03-12T16:12:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.169+0000 7efe2289a700 1 -- 172.21.15.6:0/4126790361 wait complete. 2024-03-12T16:12:06.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.169+0000 7efe2289a700 1 Processor -- start 2024-03-12T16:12:06.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.174+0000 7efe2289a700 1 -- start start 2024-03-12T16:12:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.174+0000 7efe2289a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c0fffd0 0x7efe1c110850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.174+0000 7efe2289a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe1c1008e0 0x7efe1c110d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.174+0000 7efe2289a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c111380 con 0x7efe1c0fffd0 2024-03-12T16:12:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.174+0000 7efe2289a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe1c1114c0 con 0x7efe1c1008e0 2024-03-12T16:12:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.175+0000 7efe1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c0fffd0 0x7efe1c110850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:06.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.175+0000 7efe1bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c0fffd0 0x7efe1c110850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60176/0 (socket says 172.21.15.6:60176) 2024-03-12T16:12:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.175+0000 7efe1bfff700 1 -- 172.21.15.6:0/188863718 learned_addr learned my addr 172.21.15.6:0/188863718 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.176+0000 7efe1bfff700 1 -- 172.21.15.6:0/188863718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe1c1008e0 msgr2=0x7efe1c110d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.176+0000 7efe1bfff700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe1c1008e0 0x7efe1c110d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:12:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.176+0000 7efe1bfff700 1 -- 172.21.15.6:0/188863718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe10005040 con 0x7efe1c0fffd0 2024-03-12T16:12:06.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.176+0000 7efe1bfff700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c0fffd0 0x7efe1c110850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7efe0c00b410 tx=0x7efe0c009060).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.177+0000 7efe197fa700 1 -- 172.21.15.6:0/188863718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0c0125f0 con 0x7efe1c0fffd0 2024-03-12T16:12:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.177+0000 7efe197fa700 1 -- 172.21.15.6:0/188863718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe0c012c00 con 0x7efe1c0fffd0 2024-03-12T16:12:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.177+0000 7efe197fa700 1 -- 172.21.15.6:0/188863718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe0c00dbd0 con 0x7efe1c0fffd0 2024-03-12T16:12:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.177+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe1c115f60 con 0x7efe1c0fffd0 2024-03-12T16:12:06.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.178+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe1c116490 con 0x7efe1c0fffd0 2024-03-12T16:12:06.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.179+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe1c108860 con 0x7efe1c0fffd0 2024-03-12T16:12:06.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.180+0000 7efe197fa700 1 -- 172.21.15.6:0/188863718 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 31) v1 ==== 90777+0+0 (secure 0 0 0) 0x7efe0c00dd30 con 0x7efe1c0fffd0 2024-03-12T16:12:06.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.180+0000 7efe197fa700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7efe0406c810 0x7efe0406ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:06.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.180+0000 7efe197fa700 1 -- 172.21.15.6:0/188863718 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7efe0c08b270 con 0x7efe1c0fffd0 2024-03-12T16:12:06.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.183+0000 7efe1b7fe700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7efe0406c810 0x7efe0406ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.183+0000 7efe1b7fe700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7efe0406c810 0x7efe0406ecd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7efe100047f0 tx=0x7efe10009cb0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:06.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.188+0000 7efe197fa700 1 -- 172.21.15.6:0/188863718 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7efe0c059260 con 0x7efe1c0fffd0 2024-03-12T16:12:06.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:04.799991+0000 mon.smithi006 (mon.0) 783 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:06.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:04.808392+0000 mon.smithi006 (mon.0) 784 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:06.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:04.810403+0000 mon.smithi134 (mon.1) 42 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:12:06.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:04.811141+0000 mon.smithi134 (mon.1) 43 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:12:06.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:04.812438+0000 mgr.smithi006.kskdce (mgr.14664) 12 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:12:06.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:04.812614+0000 mgr.smithi006.kskdce (mgr.14664) 13 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:12:06.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:05.069495+0000 mgr.smithi006.kskdce (mgr.14664) 14 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-03-12T16:12:06.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:04.799991+0000 mon.smithi006 (mon.0) 783 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:06.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:04.808392+0000 mon.smithi006 (mon.0) 784 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:06.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:04.810403+0000 mon.smithi134 (mon.1) 42 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:12:06.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:04.811141+0000 mon.smithi134 (mon.1) 43 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:12:06.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:04.812438+0000 mgr.smithi006.kskdce (mgr.14664) 12 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:12:06.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:04.812614+0000 mgr.smithi006.kskdce (mgr.14664) 13 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:12:06.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:05.069495+0000 mgr.smithi006.kskdce (mgr.14664) 14 : cluster [DBG] pgmap v10: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-03-12T16:12:06.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.524+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efe1c059120 con 0x7efe0406c810 2024-03-12T16:12:06.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.526+0000 7efe197fa700 1 -- 172.21.15.6:0/188863718 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7efe1c059120 con 0x7efe0406c810 2024-03-12T16:12:06.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.528+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7efe0406c810 msgr2=0x7efe0406ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.528+0000 7efe2289a700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7efe0406c810 0x7efe0406ecd0 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7efe100047f0 tx=0x7efe10009cb0).stop 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.528+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c0fffd0 msgr2=0x7efe1c110850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.528+0000 7efe2289a700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c0fffd0 0x7efe1c110850 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7efe0c00b410 tx=0x7efe0c009060).stop 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.528+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 shutdown_connections 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.528+0000 7efe2289a700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7efe0406c810 0x7efe0406ecd0 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.529+0000 7efe2289a700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe1c0fffd0 0x7efe1c110850 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.529+0000 7efe2289a700 1 --2- 172.21.15.6:0/188863718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe1c1008e0 0x7efe1c110d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.529+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 >> 172.21.15.6:0/188863718 conn(0x7efe1c066a00 msgr2=0x7efe1c104d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.529+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 shutdown_connections 2024-03-12T16:12:06.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.529+0000 7efe2289a700 1 -- 172.21.15.6:0/188863718 wait complete. 2024-03-12T16:12:06.542 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:12:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.654+0000 7f1d3448a700 1 -- 172.21.15.6:0/3605132996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 msgr2=0x7f1d2c0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.654+0000 7f1d3448a700 1 --2- 172.21.15.6:0/3605132996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 0x7f1d2c0f7a50 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f1d1c0047f0 tx=0x7f1d1c009cb0).stop 2024-03-12T16:12:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.654+0000 7f1d3448a700 1 -- 172.21.15.6:0/3605132996 shutdown_connections 2024-03-12T16:12:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.654+0000 7f1d3448a700 1 --2- 172.21.15.6:0/3605132996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 0x7f1d2c0f7a50 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:06.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.654+0000 7f1d3448a700 1 --2- 172.21.15.6:0/3605132996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d2c0f6710 0x7f1d2c0f6b30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:06.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.654+0000 7f1d3448a700 1 -- 172.21.15.6:0/3605132996 >> 172.21.15.6:0/3605132996 conn(0x7f1d2c0f1f10 msgr2=0x7f1d2c0f4330 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:06.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.655+0000 7f1d3448a700 1 -- 172.21.15.6:0/3605132996 shutdown_connections 2024-03-12T16:12:06.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.655+0000 7f1d3448a700 1 -- 172.21.15.6:0/3605132996 wait complete. 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.655+0000 7f1d3448a700 1 Processor -- start 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.655+0000 7f1d3448a700 1 -- start start 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d3448a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d2c0f6710 0x7f1d2c0fe750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d3448a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 0x7f1d2c0fcdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d3448a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c0fed00 con 0x7f1d2c0f7020 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d3448a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1d2c10bde0 con 0x7f1d2c0f6710 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d31a25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 0x7f1d2c0fcdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d31a25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 0x7f1d2c0fcdb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60192/0 (socket says 172.21.15.6:60192) 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d31a25700 1 -- 172.21.15.6:0/3622519074 learned_addr learned my addr 172.21.15.6:0/3622519074 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:06.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d32226700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d2c0f6710 0x7f1d2c0fe750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:06.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d31a25700 1 -- 172.21.15.6:0/3622519074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d2c0f6710 msgr2=0x7f1d2c0fe750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:06.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d31a25700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d2c0f6710 0x7f1d2c0fe750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:06.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d31a25700 1 -- 172.21.15.6:0/3622519074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1d1c005040 con 0x7f1d2c0f7020 2024-03-12T16:12:06.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.656+0000 7f1d31a25700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 0x7f1d2c0fcdb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f1d1c009380 tx=0x7f1d1c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:06.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.657+0000 7f1d237fe700 1 -- 172.21.15.6:0/3622519074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d1c018070 con 0x7f1d2c0f7020 2024-03-12T16:12:06.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.657+0000 7f1d237fe700 1 -- 172.21.15.6:0/3622519074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1d1c007e90 con 0x7f1d2c0f7020 2024-03-12T16:12:06.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.657+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1d2c10c000 con 0x7f1d2c0f7020 2024-03-12T16:12:06.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.657+0000 7f1d237fe700 1 -- 172.21.15.6:0/3622519074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1d1c0123c0 con 0x7f1d2c0f7020 2024-03-12T16:12:06.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.657+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1d2c10c560 con 0x7f1d2c0f7020 2024-03-12T16:12:06.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.658+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1d2c100000 con 0x7f1d2c0f7020 2024-03-12T16:12:06.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.659+0000 7f1d237fe700 1 -- 172.21.15.6:0/3622519074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 31) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f1d1c01d420 con 0x7f1d2c0f7020 2024-03-12T16:12:06.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.660+0000 7f1d237fe700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1d1806c890 0x7f1d1806ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:06.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.660+0000 7f1d237fe700 1 -- 172.21.15.6:0/3622519074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f1d1c08c630 con 0x7f1d2c0f7020 2024-03-12T16:12:06.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.660+0000 7f1d32226700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1d1806c890 0x7f1d1806ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:06.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.660+0000 7f1d32226700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1d1806c890 0x7f1d1806ed50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f1d280048b0 tx=0x7f1d2800b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:06.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.665+0000 7f1d237fe700 1 -- 172.21.15.6:0/3622519074 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f1d1c05a450 con 0x7f1d2c0f7020 2024-03-12T16:12:06.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.941+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1d2c101f40 con 0x7f1d1806c890 2024-03-12T16:12:06.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.942+0000 7f1d237fe700 1 -- 172.21.15.6:0/3622519074 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f1d2c101f40 con 0x7f1d1806c890 2024-03-12T16:12:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1d1806c890 msgr2=0x7f1d1806ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:06.946 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1d1806c890 0x7f1d1806ed50 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7f1d280048b0 tx=0x7f1d2800b040).stop 2024-03-12T16:12:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 msgr2=0x7f1d2c0fcdb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 0x7f1d2c0fcdb0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f1d1c009380 tx=0x7f1d1c009cb0).stop 2024-03-12T16:12:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 shutdown_connections 2024-03-12T16:12:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1d1806c890 0x7f1d1806ed50 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1d2c0f6710 0x7f1d2c0fe750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 --2- 172.21.15.6:0/3622519074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1d2c0f7020 0x7f1d2c0fcdb0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 >> 172.21.15.6:0/3622519074 conn(0x7f1d2c0f1f10 msgr2=0x7f1d2c0fb4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 shutdown_connections 2024-03-12T16:12:06.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:06.944+0000 7f1d3448a700 1 -- 172.21.15.6:0/3622519074 wait complete. 2024-03-12T16:12:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.067+0000 7f44fd607700 1 -- 172.21.15.6:0/3771247767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f80f82b0 msgr2=0x7f44f80fa740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.067+0000 7f44fd607700 1 --2- 172.21.15.6:0/3771247767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f80f82b0 0x7f44f80fa740 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f44ec0047f0 tx=0x7f44ec009cb0).stop 2024-03-12T16:12:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.067+0000 7f44fd607700 1 -- 172.21.15.6:0/3771247767 shutdown_connections 2024-03-12T16:12:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.067+0000 7f44fd607700 1 --2- 172.21.15.6:0/3771247767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f80f82b0 0x7f44f80fa740 secure :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0x7f44ec0047f0 tx=0x7f44ec009cb0).stop 2024-03-12T16:12:07.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.067+0000 7f44fd607700 1 --2- 172.21.15.6:0/3771247767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f8061220 0x7f44f80fc830 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.067+0000 7f44fd607700 1 -- 172.21.15.6:0/3771247767 >> 172.21.15.6:0/3771247767 conn(0x7f44f80f1e50 msgr2=0x7f44f80f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.068+0000 7f44fd607700 1 -- 172.21.15.6:0/3771247767 shutdown_connections 2024-03-12T16:12:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.068+0000 7f44fd607700 1 -- 172.21.15.6:0/3771247767 wait complete. 2024-03-12T16:12:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.069+0000 7f44fd607700 1 Processor -- start 2024-03-12T16:12:07.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.069+0000 7f44fd607700 1 -- start start 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.069+0000 7f44fd607700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f8061220 0x7f44f810e6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.069+0000 7f44fd607700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f810ebc0 0x7f44f8113c90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.069+0000 7f44fd607700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f810f090 con 0x7f44f8061220 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.069+0000 7f44fd607700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44f810f1d0 con 0x7f44f810ebc0 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.070+0000 7f44f67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f810ebc0 0x7f44f8113c90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.070+0000 7f44f67fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f810ebc0 0x7f44f8113c90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:35732/0 (socket says 172.21.15.6:35732) 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.070+0000 7f44f67fc700 1 -- 172.21.15.6:0/1036934152 learned_addr learned my addr 172.21.15.6:0/1036934152 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.070+0000 7f44f67fc700 1 -- 172.21.15.6:0/1036934152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f8061220 msgr2=0x7f44f810e6d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.070+0000 7f44f67fc700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f8061220 0x7f44f810e6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.070+0000 7f44f67fc700 1 -- 172.21.15.6:0/1036934152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44ec005040 con 0x7f44f810ebc0 2024-03-12T16:12:07.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.071+0000 7f44f67fc700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f810ebc0 0x7f44f8113c90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f44ec000c00 tx=0x7f44ec00b040).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.071+0000 7f44dffff700 1 -- 172.21.15.6:0/1036934152 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44ec00e030 con 0x7f44f810ebc0 2024-03-12T16:12:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.071+0000 7f44dffff700 1 -- 172.21.15.6:0/1036934152 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f44ec013410 con 0x7f44f810ebc0 2024-03-12T16:12:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.071+0000 7f44dffff700 1 -- 172.21.15.6:0/1036934152 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44ec019070 con 0x7f44f810ebc0 2024-03-12T16:12:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.071+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44f8114180 con 0x7f44f810ebc0 2024-03-12T16:12:07.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.071+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44f8114660 con 0x7f44f810ebc0 2024-03-12T16:12:07.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.073+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44f81065b0 con 0x7f44f810ebc0 2024-03-12T16:12:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.073+0000 7f44dffff700 1 -- 172.21.15.6:0/1036934152 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 31) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f44ec01e420 con 0x7f44f810ebc0 2024-03-12T16:12:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.074+0000 7f44dffff700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f44e006c890 0x7f44e006ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.074+0000 7f44dffff700 1 -- 172.21.15.6:0/1036934152 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f44ec08ce50 con 0x7f44f810ebc0 2024-03-12T16:12:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.074+0000 7f44f6ffd700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f44e006c890 0x7f44e006ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:07.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.074+0000 7f44f6ffd700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f44e006c890 0x7f44e006ed50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f44e8004a90 tx=0x7f44e8007b40).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:07.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.079+0000 7f44dffff700 1 -- 172.21.15.6:0/1036934152 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f44ec05ad30 con 0x7f44f810ebc0 2024-03-12T16:12:07.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:05.128248+0000 mgr.smithi006.kskdce (mgr.14664) 15 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:12:07.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:05.329284+0000 mgr.smithi006.kskdce (mgr.14664) 16 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:05.494783+0000 mgr.smithi006.kskdce (mgr.14664) 17 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:05.693935+0000 mgr.smithi006.kskdce (mgr.14664) 18 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:05.809016+0000 mgr.smithi006.kskdce (mgr.14664) 19 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:06.008217+0000 mgr.smithi006.kskdce (mgr.14664) 20 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:06.132390+0000 mon.smithi006 (mon.0) 785 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:06.142581+0000 mon.smithi006 (mon.0) 786 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:06.174297+0000 mon.smithi134 (mon.1) 44 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:06.430718+0000 mon.smithi006 (mon.0) 787 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:06.437681+0000 mon.smithi006 (mon.0) 788 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:06.444151+0000 mon.smithi006 (mon.0) 789 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:05.128248+0000 mgr.smithi006.kskdce (mgr.14664) 15 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:12:07.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:05.329284+0000 mgr.smithi006.kskdce (mgr.14664) 16 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:12:07.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:05.494783+0000 mgr.smithi006.kskdce (mgr.14664) 17 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:12:07.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:05.693935+0000 mgr.smithi006.kskdce (mgr.14664) 18 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:12:07.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:05.809016+0000 mgr.smithi006.kskdce (mgr.14664) 19 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:12:07.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:06.008217+0000 mgr.smithi006.kskdce (mgr.14664) 20 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:12:07.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:06.132390+0000 mon.smithi006 (mon.0) 785 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:06.142581+0000 mon.smithi006 (mon.0) 786 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:06.174297+0000 mon.smithi134 (mon.1) 44 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:12:07.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:06.430718+0000 mon.smithi006 (mon.0) 787 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:06.437681+0000 mon.smithi006 (mon.0) 788 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:06.444151+0000 mon.smithi006 (mon.0) 789 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:07.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.391+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f44f8059120 con 0x7f44e006c890 2024-03-12T16:12:07.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.403+0000 7f44dffff700 1 -- 172.21.15.6:0/1036934152 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f44f8059120 con 0x7f44e006c890 2024-03-12T16:12:07.405 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:12:07.405 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (115s) 8s ago 9m 17.0M - 0.23.0 ba2b418f427c 1cba788dfc1b 2024-03-12T16:12:07.405 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (9m) 8s ago 9m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (9m) 11s ago 9m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (68s) 8s ago 9m 46.7M - 8.3.5 dad864ee21e9 9e2a73f49bcc 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (4m) 8s ago 4m 162M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (4m) 8s ago 4m 13.8M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (4m) 11s ago 4m 129M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (4m) 11s ago 4m 16.5M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (28s) 8s ago 11m 473M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283 running (2m) 11s ago 9m 66.1M - 18.2.2-797-g49e4a679 72a574b3d6f5 4b7738c64f1d 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (11m) 8s ago 11m 52.8M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (9m) 11s ago 9m 45.6M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (61s) 8s ago 9m 11.4M - 1.3.1 1dbe0e931976 ba4dbac99ceb 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (59s) 11s ago 8m 18.4M - 1.3.1 1dbe0e931976 6f6977dcc53d 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (8m) 8s ago 8m 202M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:12:07.406 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (8m) 8s ago 8m 220M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:12:07.407 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (7m) 8s ago 7m 182M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:12:07.407 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (7m) 11s ago 7m 249M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:12:07.407 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (6m) 11s ago 6m 222M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:12:07.407 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (6m) 11s ago 6m 218M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:12:07.407 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (36s) 11s ago 8m 48.9M - 2.33.4 514e6a882f6e 150690b083a5 2024-03-12T16:12:07.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f44e006c890 msgr2=0x7f44e006ed50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:07.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f44e006c890 0x7f44e006ed50 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7f44e8004a90 tx=0x7f44e8007b40).stop 2024-03-12T16:12:07.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f810ebc0 msgr2=0x7f44f8113c90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:07.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f810ebc0 0x7f44f8113c90 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f44ec000c00 tx=0x7f44ec00b040).stop 2024-03-12T16:12:07.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 shutdown_connections 2024-03-12T16:12:07.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f44e006c890 0x7f44e006ed50 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:07.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44f8061220 0x7f44f810e6d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:12:07.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 --2- 172.21.15.6:0/1036934152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44f810ebc0 0x7f44f8113c90 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:07.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 >> 172.21.15.6:0/1036934152 conn(0x7f44f80f1e50 msgr2=0x7f44f80f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:07.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 shutdown_connections 2024-03-12T16:12:07.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.406+0000 7f44fd607700 1 -- 172.21.15.6:0/1036934152 wait complete. 2024-03-12T16:12:07.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.537+0000 7fd3b57ea700 1 -- 172.21.15.6:0/3798116621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 msgr2=0x7fd3b00f6b30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.537+0000 7fd3b57ea700 1 --2- 172.21.15.6:0/3798116621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 0x7fd3b00f6b30 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd3a00047f0 tx=0x7fd3a0009cb0).stop 2024-03-12T16:12:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.537+0000 7fd3b57ea700 1 -- 172.21.15.6:0/3798116621 shutdown_connections 2024-03-12T16:12:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.537+0000 7fd3b57ea700 1 --2- 172.21.15.6:0/3798116621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3b00f79b0 0x7fd3b00f7e10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.537+0000 7fd3b57ea700 1 --2- 172.21.15.6:0/3798116621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 0x7fd3b00f6b30 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.537+0000 7fd3b57ea700 1 -- 172.21.15.6:0/3798116621 >> 172.21.15.6:0/3798116621 conn(0x7fd3b00f1e70 msgr2=0x7fd3b00f4290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.537+0000 7fd3b57ea700 1 -- 172.21.15.6:0/3798116621 shutdown_connections 2024-03-12T16:12:07.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.537+0000 7fd3b57ea700 1 -- 172.21.15.6:0/3798116621 wait complete. 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.538+0000 7fd3b57ea700 1 Processor -- start 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.538+0000 7fd3b57ea700 1 -- start start 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.538+0000 7fd3b57ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 0x7fd3b00610c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.538+0000 7fd3b57ea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3b00f79b0 0x7fd3b010cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.538+0000 7fd3b57ea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b010d250 con 0x7fd3b00f6710 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.538+0000 7fd3b57ea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3b010d390 con 0x7fd3b00f79b0 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3aeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 0x7fd3b00610c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3aeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 0x7fd3b00610c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60232/0 (socket says 172.21.15.6:60232) 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3aeffd700 1 -- 172.21.15.6:0/2266305540 learned_addr learned my addr 172.21.15.6:0/2266305540 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:07.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3ae7fc700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3b00f79b0 0x7fd3b010cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3aeffd700 1 -- 172.21.15.6:0/2266305540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3b00f79b0 msgr2=0x7fd3b010cd60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3aeffd700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3b00f79b0 0x7fd3b010cd60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3aeffd700 1 -- 172.21.15.6:0/2266305540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd3a0005040 con 0x7fd3b00f6710 2024-03-12T16:12:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3aeffd700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 0x7fd3b00610c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd3a0000c00 tx=0x7fd3a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd397fff700 1 -- 172.21.15.6:0/2266305540 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a000e030 con 0x7fd3b00f6710 2024-03-12T16:12:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3b010d590 con 0x7fd3b00f6710 2024-03-12T16:12:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd397fff700 1 -- 172.21.15.6:0/2266305540 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd3a0007e90 con 0x7fd3b00f6710 2024-03-12T16:12:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd397fff700 1 -- 172.21.15.6:0/2266305540 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3a0018070 con 0x7fd3b00f6710 2024-03-12T16:12:07.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.539+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3b010da70 con 0x7fd3b00f6710 2024-03-12T16:12:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.540+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3b00feed0 con 0x7fd3b00f6710 2024-03-12T16:12:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.541+0000 7fd397fff700 1 -- 172.21.15.6:0/2266305540 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 31) v1 ==== 90777+0+0 (secure 0 0 0) 0x7fd3a001d420 con 0x7fd3b00f6710 2024-03-12T16:12:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.542+0000 7fd397fff700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd39806c7c0 0x7fd39806ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:07.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.542+0000 7fd397fff700 1 -- 172.21.15.6:0/2266305540 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fd3a008ccc0 con 0x7fd3b00f6710 2024-03-12T16:12:07.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.546+0000 7fd3ae7fc700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd39806c7c0 0x7fd39806ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:07.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.546+0000 7fd3ae7fc700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd39806c7c0 0x7fd39806ec80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd3a4004e60 tx=0x7fd3a400b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:07.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.547+0000 7fd397fff700 1 -- 172.21.15.6:0/2266305540 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fd3a005aba0 con 0x7fd3b00f6710 2024-03-12T16:12:07.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.917+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fd3b0100d40 con 0x7fd3b00f6710 2024-03-12T16:12:07.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.918+0000 7fd397fff700 1 -- 172.21.15.6:0/2266305540 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7fd3a005a730 con 0x7fd3b00f6710 2024-03-12T16:12:07.920 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:12:07.920 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:12:07.920 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:12:07.920 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 12, 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:12:07.921 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:12:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd39806c7c0 msgr2=0x7fd39806ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd39806c7c0 0x7fd39806ec80 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7fd3a4004e60 tx=0x7fd3a400b040).stop 2024-03-12T16:12:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 msgr2=0x7fd3b00610c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:07.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 0x7fd3b00610c0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7fd3a0000c00 tx=0x7fd3a0009cb0).stop 2024-03-12T16:12:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 shutdown_connections 2024-03-12T16:12:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd39806c7c0 0x7fd39806ec80 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3b00f6710 0x7fd3b00610c0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 --2- 172.21.15.6:0/2266305540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3b00f79b0 0x7fd3b010cd60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 >> 172.21.15.6:0/2266305540 conn(0x7fd3b00f1e70 msgr2=0x7fd3b00fb400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.920+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 shutdown_connections 2024-03-12T16:12:07.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:07.921+0000 7fd3b57ea700 1 -- 172.21.15.6:0/2266305540 wait complete. 2024-03-12T16:12:08.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.049+0000 7f17346e7700 1 -- 172.21.15.6:0/2879027024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 msgr2=0x7f172c0f6290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:08.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.049+0000 7f17346e7700 1 --2- 172.21.15.6:0/2879027024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 0x7f172c0f6290 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f17280048f0 tx=0x7f172800adc0).stop 2024-03-12T16:12:08.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.050+0000 7f17346e7700 1 -- 172.21.15.6:0/2879027024 shutdown_connections 2024-03-12T16:12:08.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.050+0000 7f17346e7700 1 --2- 172.21.15.6:0/2879027024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0f7070 0x7f172c0f74f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:12:08.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.050+0000 7f17346e7700 1 --2- 172.21.15.6:0/2879027024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 0x7f172c0f6290 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:08.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.050+0000 7f17346e7700 1 -- 172.21.15.6:0/2879027024 >> 172.21.15.6:0/2879027024 conn(0x7f172c0f15d0 msgr2=0x7f172c0f39f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:08.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.051+0000 7f17346e7700 1 -- 172.21.15.6:0/2879027024 shutdown_connections 2024-03-12T16:12:08.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.051+0000 7f17346e7700 1 -- 172.21.15.6:0/2879027024 wait complete. 2024-03-12T16:12:08.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.051+0000 7f17346e7700 1 Processor -- start 2024-03-12T16:12:08.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.051+0000 7f17346e7700 1 -- start start 2024-03-12T16:12:08.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f17346e7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 0x7f172c105d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:08.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f17346e7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0f7070 0x7f172c106280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:08.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f17346e7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c106910 con 0x7f172c0f5e70 2024-03-12T16:12:08.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f17346e7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f172c10f720 con 0x7f172c0f7070 2024-03-12T16:12:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f1732483700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 0x7f172c105d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f1732483700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 0x7f172c105d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60246/0 (socket says 172.21.15.6:60246) 2024-03-12T16:12:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f1732483700 1 -- 172.21.15.6:0/3334435860 learned_addr learned my addr 172.21.15.6:0/3334435860 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f1731c82700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0f7070 0x7f172c106280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f1732483700 1 -- 172.21.15.6:0/3334435860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0f7070 msgr2=0x7f172c106280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.052+0000 7f1732483700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0f7070 0x7f172c106280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.053+0000 7f1732483700 1 -- 172.21.15.6:0/3334435860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1728005040 con 0x7f172c0f5e70 2024-03-12T16:12:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.053+0000 7f1732483700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 0x7f172c105d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f172800c6c0 tx=0x7f172800adc0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:08.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.053+0000 7f17237fe700 1 -- 172.21.15.6:0/3334435860 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f172800f030 con 0x7f172c0f5e70 2024-03-12T16:12:08.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.053+0000 7f17237fe700 1 -- 172.21.15.6:0/3334435860 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1728007e70 con 0x7f172c0f5e70 2024-03-12T16:12:08.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.053+0000 7f17237fe700 1 -- 172.21.15.6:0/3334435860 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1728019070 con 0x7f172c0f5e70 2024-03-12T16:12:08.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.053+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f172c10f860 con 0x7f172c0f5e70 2024-03-12T16:12:08.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.053+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f172c10fd90 con 0x7f172c0f5e70 2024-03-12T16:12:08.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.055+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f172c0fde30 con 0x7f172c0f5e70 2024-03-12T16:12:08.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.058+0000 7f17237fe700 1 -- 172.21.15.6:0/3334435860 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 31) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f1728008510 con 0x7f172c0f5e70 2024-03-12T16:12:08.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.059+0000 7f17237fe700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f171806c8e0 0x7f171806eda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.059+0000 7f17237fe700 1 -- 172.21.15.6:0/3334435860 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f172808d0a0 con 0x7f172c0f5e70 2024-03-12T16:12:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.059+0000 7f1731c82700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f171806c8e0 0x7f171806eda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:08.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.060+0000 7f1731c82700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f171806c8e0 0x7f171806eda0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f171c006fd0 tx=0x7f171c009060).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:08.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.064+0000 7f17237fe700 1 -- 172.21.15.6:0/3334435860 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f17280575f0 con 0x7f172c0f5e70 2024-03-12T16:12:08.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:06.527193+0000 mgr.smithi006.kskdce (mgr.14664) 21 : audit [DBG] from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:08.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:06.577637+0000 mgr.smithi006.kskdce (mgr.14664) 22 : cephadm [INF] Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-12T16:12:08.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:06.837778+0000 mgr.smithi006.kskdce (mgr.14664) 23 : cephadm [INF] Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-12T16:12:08.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:06.943384+0000 mgr.smithi006.kskdce (mgr.14664) 24 : audit [DBG] from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:08.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:07.069910+0000 mgr.smithi006.kskdce (mgr.14664) 25 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-03-12T16:12:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:06.527193+0000 mgr.smithi006.kskdce (mgr.14664) 21 : audit [DBG] from='client.14694 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:06.577637+0000 mgr.smithi006.kskdce (mgr.14664) 22 : cephadm [INF] Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-12T16:12:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:06.837778+0000 mgr.smithi006.kskdce (mgr.14664) 23 : cephadm [INF] Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-12T16:12:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:06.943384+0000 mgr.smithi006.kskdce (mgr.14664) 24 : audit [DBG] from='client.14698 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:07.069910+0000 mgr.smithi006.kskdce (mgr.14664) 25 : cluster [DBG] pgmap v11: 65 pgs: 65 active+clean; 285 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 1.4 MiB/s wr, 390 op/s 2024-03-12T16:12:08.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.398+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f172c059120 con 0x7f171806c8e0 2024-03-12T16:12:08.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.400+0000 7f17237fe700 1 -- 172.21.15.6:0/3334435860 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+329 (secure 0 0 0) 0x7f172c059120 con 0x7f171806c8e0 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr" 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "2/2 daemons upgraded", 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2024-03-12T16:12:08.402 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:12:08.403 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:12:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f171806c8e0 msgr2=0x7f171806eda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f171806c8e0 0x7f171806eda0 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f171c006fd0 tx=0x7f171c009060).stop 2024-03-12T16:12:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 msgr2=0x7f172c105d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 0x7f172c105d90 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f172800c6c0 tx=0x7f172800adc0).stop 2024-03-12T16:12:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 shutdown_connections 2024-03-12T16:12:08.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f171806c8e0 0x7f171806eda0 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f172c0f5e70 0x7f172c105d90 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 --2- 172.21.15.6:0/3334435860 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f172c0f7070 0x7f172c106280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 >> 172.21.15.6:0/3334435860 conn(0x7f172c0f15d0 msgr2=0x7f172c0fab50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 shutdown_connections 2024-03-12T16:12:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:08.402+0000 7f17346e7700 1 -- 172.21.15.6:0/3334435860 wait complete. 2024-03-12T16:12:09.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:07.393772+0000 mgr.smithi006.kskdce (mgr.14664) 26 : audit [DBG] from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:09.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:08 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:07.919513+0000 mon.smithi006 (mon.0) 790 : audit [DBG] from='client.? 172.21.15.6:0/2266305540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:09.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:07.393772+0000 mgr.smithi006.kskdce (mgr.14664) 26 : audit [DBG] from='client.24515 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:09.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:07.919513+0000 mon.smithi006 (mon.0) 790 : audit [DBG] from='client.? 172.21.15.6:0/2266305540' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:10.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:08.400887+0000 mgr.smithi006.kskdce (mgr.14664) 27 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:10.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:09.070498+0000 mgr.smithi006.kskdce (mgr.14664) 28 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 74 KiB/s rd, 2.1 MiB/s wr, 588 op/s 2024-03-12T16:12:10.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:08.400887+0000 mgr.smithi006.kskdce (mgr.14664) 27 : audit [DBG] from='client.14706 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:10.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:09.070498+0000 mgr.smithi006.kskdce (mgr.14664) 28 : cluster [DBG] pgmap v12: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 74 KiB/s rd, 2.1 MiB/s wr, 588 op/s 2024-03-12T16:12:10.643 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.1... 2024-03-12T16:12:10.644 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.1 /home/ubuntu/cephtest/clone.client.1 2024-03-12T16:12:10.943 DEBUG:teuthology.parallel:result is None 2024-03-12T16:12:11.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:11.070897+0000 mgr.smithi006.kskdce (mgr.14664) 29 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.5 MiB/s wr, 386 op/s 2024-03-12T16:12:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:11.070897+0000 mgr.smithi006.kskdce (mgr.14664) 29 : cluster [DBG] pgmap v13: 65 pgs: 65 active+clean; 283 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 38 KiB/s rd, 1.5 MiB/s wr, 386 op/s 2024-03-12T16:12:13.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:13.071376+0000 mgr.smithi006.kskdce (mgr.14664) 30 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.0 MiB/s wr, 566 op/s 2024-03-12T16:12:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:13.071376+0000 mgr.smithi006.kskdce (mgr.14664) 30 : cluster [DBG] pgmap v14: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 56 KiB/s rd, 2.0 MiB/s wr, 566 op/s 2024-03-12T16:12:15.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:14.568802+0000 mon.smithi006 (mon.0) 791 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:15.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:14.583959+0000 mon.smithi006 (mon.0) 792 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:15.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:14.630281+0000 mon.smithi134 (mon.1) 45 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:12:15.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:14.630849+0000 mgr.smithi006.kskdce (mgr.14664) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:12:15.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:14.637022+0000 mon.smithi134 (mon.1) 46 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:15.879 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:15.071744+0000 mgr.smithi006.kskdce (mgr.14664) 32 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.3 MiB/s wr, 378 op/s 2024-03-12T16:12:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:14.568802+0000 mon.smithi006 (mon.0) 791 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:14.583959+0000 mon.smithi006 (mon.0) 792 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:14.630281+0000 mon.smithi134 (mon.1) 45 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:12:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:14.630849+0000 mgr.smithi006.kskdce (mgr.14664) 31 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:12:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:14.637022+0000 mon.smithi134 (mon.1) 46 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:15.071744+0000 mgr.smithi006.kskdce (mgr.14664) 32 : cluster [DBG] pgmap v15: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.3 MiB/s wr, 378 op/s 2024-03-12T16:12:16.840 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:16.259341+0000 mon.smithi134 (mon.1) 47 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:12:16.840 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:16.260001+0000 mon.smithi006 (mon.0) 793 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:12:16.840 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:16.261082+0000 mon.smithi134 (mon.1) 48 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:12:16.840 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:16.262109+0000 mon.smithi134 (mon.1) 49 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:12:16.883 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:16.259341+0000 mon.smithi134 (mon.1) 47 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:12:16.883 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:16.260001+0000 mon.smithi006 (mon.0) 793 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:12:16.884 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:16.261082+0000 mon.smithi134 (mon.1) 48 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:12:16.884 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:16 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:16.262109+0000 mon.smithi134 (mon.1) 49 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:12:16.885 INFO:tasks.workunit:Stopping ['suites/fsstress.sh'] on client.0... 2024-03-12T16:12:16.885 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/workunits.list.client.0 /home/ubuntu/cephtest/clone.client.0 2024-03-12T16:12:17.168 DEBUG:teuthology.parallel:result is None 2024-03-12T16:12:17.169 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.0/client.0 2024-03-12T16:12:17.207 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.0/client.0 2024-03-12T16:12:17.207 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -rf -- /home/ubuntu/cephtest/mnt.1/client.1 2024-03-12T16:12:17.256 INFO:tasks.workunit:Deleted dir /home/ubuntu/cephtest/mnt.1/client.1 2024-03-12T16:12:17.256 DEBUG:teuthology.parallel:result is None 2024-03-12T16:12:17.776 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:16.258883+0000 mgr.smithi006.kskdce (mgr.14664) 33 : cephadm [INF] Upgrade: Updating mgr.smithi134.gcntfu 2024-03-12T16:12:17.777 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:16.263048+0000 mgr.smithi006.kskdce (mgr.14664) 34 : cephadm [INF] Deploying daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:12:17.777 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:17.072155+0000 mgr.smithi006.kskdce (mgr.14664) 35 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.3 MiB/s wr, 378 op/s 2024-03-12T16:12:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:16.258883+0000 mgr.smithi006.kskdce (mgr.14664) 33 : cephadm [INF] Upgrade: Updating mgr.smithi134.gcntfu 2024-03-12T16:12:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:16.263048+0000 mgr.smithi006.kskdce (mgr.14664) 34 : cephadm [INF] Deploying daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:12:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:17.072155+0000 mgr.smithi006.kskdce (mgr.14664) 35 : cluster [DBG] pgmap v16: 65 pgs: 65 active+clean; 275 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 36 KiB/s rd, 1.3 MiB/s wr, 378 op/s 2024-03-12T16:12:19.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:19.072715+0000 mgr.smithi006.kskdce (mgr.14664) 36 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.7 MiB/s wr, 504 op/s 2024-03-12T16:12:19.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:19.072715+0000 mgr.smithi006.kskdce (mgr.14664) 36 : cluster [DBG] pgmap v17: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 46 KiB/s rd, 1.7 MiB/s wr, 504 op/s 2024-03-12T16:12:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:19.895967+0000 mon.smithi006 (mon.0) 794 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:19.901741+0000 mon.smithi006 (mon.0) 795 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:19.934784+0000 mon.smithi134 (mon.1) 50 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:19.895967+0000 mon.smithi006 (mon.0) 794 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:19.901741+0000 mon.smithi006 (mon.0) 795 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:19.934784+0000 mon.smithi134 (mon.1) 50 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:22.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:21.073270+0000 mgr.smithi006.kskdce (mgr.14664) 37 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2024-03-12T16:12:22.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:21.172602+0000 mon.smithi134 (mon.1) 51 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:12:22.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:21.073270+0000 mgr.smithi006.kskdce (mgr.14664) 37 : cluster [DBG] pgmap v18: 65 pgs: 65 active+clean; 273 MiB data, 2.6 GiB used, 534 GiB / 536 GiB avail; 28 KiB/s rd, 1.0 MiB/s wr, 306 op/s 2024-03-12T16:12:22.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:21.172602+0000 mon.smithi134 (mon.1) 51 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:12:23.424 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:23.073945+0000 mgr.smithi006.kskdce (mgr.14664) 38 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.0 MiB/s wr, 353 op/s 2024-03-12T16:12:23.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:23.073945+0000 mgr.smithi006.kskdce (mgr.14664) 38 : cluster [DBG] pgmap v19: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 34 KiB/s rd, 1.0 MiB/s wr, 353 op/s 2024-03-12T16:12:25.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:23.866989+0000 mon.smithi006 (mon.0) 796 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:25.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:23.872902+0000 mon.smithi006 (mon.0) 797 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:25.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:24.559179+0000 mon.smithi006 (mon.0) 798 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:25.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:24.567256+0000 mon.smithi006 (mon.0) 799 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:25.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:23.866989+0000 mon.smithi006 (mon.0) 796 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:25.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:23.872902+0000 mon.smithi006 (mon.0) 797 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:25.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:24.559179+0000 mon.smithi006 (mon.0) 798 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:25.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:24.567256+0000 mon.smithi006 (mon.0) 799 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:26.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:25.074447+0000 mgr.smithi006.kskdce (mgr.14664) 39 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 471 KiB/s wr, 173 op/s 2024-03-12T16:12:26.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:25.074447+0000 mgr.smithi006.kskdce (mgr.14664) 39 : cluster [DBG] pgmap v20: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 471 KiB/s wr, 173 op/s 2024-03-12T16:12:27.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:26.925050+0000 mon.smithi006 (mon.0) 800 : cluster [DBG] Standby manager daemon smithi134.gcntfu restarted 2024-03-12T16:12:27.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:26.925201+0000 mon.smithi006 (mon.0) 801 : cluster [DBG] Standby manager daemon smithi134.gcntfu started 2024-03-12T16:12:27.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:26.926297+0000 mon.smithi134 (mon.1) 52 : audit [DBG] from='mgr.? 172.21.15.134:0/2012104752' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:12:27.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:26.926770+0000 mon.smithi134 (mon.1) 53 : audit [DBG] from='mgr.? 172.21.15.134:0/2012104752' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:12:27.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:26.928648+0000 mon.smithi134 (mon.1) 54 : audit [DBG] from='mgr.? 172.21.15.134:0/2012104752' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:12:27.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:26.929618+0000 mon.smithi134 (mon.1) 55 : audit [DBG] from='mgr.? 172.21.15.134:0/2012104752' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:12:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:26.925050+0000 mon.smithi006 (mon.0) 800 : cluster [DBG] Standby manager daemon smithi134.gcntfu restarted 2024-03-12T16:12:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:26.925201+0000 mon.smithi006 (mon.0) 801 : cluster [DBG] Standby manager daemon smithi134.gcntfu started 2024-03-12T16:12:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:26.926297+0000 mon.smithi134 (mon.1) 52 : audit [DBG] from='mgr.? 172.21.15.134:0/2012104752' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:12:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:26.926770+0000 mon.smithi134 (mon.1) 53 : audit [DBG] from='mgr.? 172.21.15.134:0/2012104752' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:12:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:26.928648+0000 mon.smithi134 (mon.1) 54 : audit [DBG] from='mgr.? 172.21.15.134:0/2012104752' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:12:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:26.929618+0000 mon.smithi134 (mon.1) 55 : audit [DBG] from='mgr.? 172.21.15.134:0/2012104752' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:12:28.303 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:26.985270+0000 mon.smithi006 (mon.0) 802 : cluster [DBG] mgrmap e32: smithi006.kskdce(active, since 35s), standbys: smithi134.gcntfu 2024-03-12T16:12:28.303 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:27 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:27.074783+0000 mgr.smithi006.kskdce (mgr.14664) 40 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 471 KiB/s wr, 173 op/s 2024-03-12T16:12:28.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:26.985270+0000 mon.smithi006 (mon.0) 802 : cluster [DBG] mgrmap e32: smithi006.kskdce(active, since 35s), standbys: smithi134.gcntfu 2024-03-12T16:12:28.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:27 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:27.074783+0000 mgr.smithi006.kskdce (mgr.14664) 40 : cluster [DBG] pgmap v21: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 471 KiB/s wr, 173 op/s 2024-03-12T16:12:29.692 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.349006+0000 mon.smithi006 (mon.0) 803 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.692 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.356716+0000 mon.smithi006 (mon.0) 804 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.358367+0000 mon.smithi134 (mon.1) 56 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.359273+0000 mon.smithi134 (mon.1) 57 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.366687+0000 mon.smithi006 (mon.0) 805 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.505658+0000 mon.smithi134 (mon.1) 58 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.509640+0000 mon.smithi134 (mon.1) 59 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:28.510474+0000 mgr.smithi006.kskdce (mgr.14664) 41 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.517311+0000 mon.smithi006 (mon.0) 806 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.518315+0000 mon.smithi134 (mon.1) 60 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi006.kskdce"}]: dispatch 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.518748+0000 mon.smithi006 (mon.0) 807 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi006.kskdce"}]: dispatch 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.524313+0000 mon.smithi006 (mon.0) 808 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi006.kskdce"}]': finished 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.524961+0000 mon.smithi134 (mon.1) 61 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.gcntfu"}]: dispatch 2024-03-12T16:12:29.693 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.525348+0000 mon.smithi006 (mon.0) 809 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.gcntfu"}]: dispatch 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.530684+0000 mon.smithi006 (mon.0) 810 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.gcntfu"}]': finished 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.533570+0000 mon.smithi134 (mon.1) 62 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:28.534415+0000 mgr.smithi006.kskdce (mgr.14664) 42 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.540236+0000 mon.smithi006 (mon.0) 811 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.541536+0000 mon.smithi134 (mon.1) 63 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:28.542318+0000 mgr.smithi006.kskdce (mgr.14664) 43 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.548201+0000 mon.smithi006 (mon.0) 812 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.549297+0000 mon.smithi134 (mon.1) 64 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:28.550003+0000 mgr.smithi006.kskdce (mgr.14664) 44 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.554089+0000 mon.smithi006 (mon.0) 813 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.555044+0000 mon.smithi134 (mon.1) 65 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:28.555838+0000 mgr.smithi006.kskdce (mgr.14664) 45 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-03-12T16:12:29.694 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.559844+0000 mon.smithi006 (mon.0) 814 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.560854+0000 mon.smithi134 (mon.1) 66 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:28.561600+0000 mgr.smithi006.kskdce (mgr.14664) 46 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.566010+0000 mon.smithi006 (mon.0) 815 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.567011+0000 mon.smithi134 (mon.1) 67 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:28.567706+0000 mgr.smithi006.kskdce (mgr.14664) 47 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.571591+0000 mon.smithi006 (mon.0) 816 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.573058+0000 mon.smithi134 (mon.1) 68 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:28.573809+0000 mgr.smithi006.kskdce (mgr.14664) 48 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:28.578107+0000 mon.smithi006 (mon.0) 817 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:29.075465+0000 mgr.smithi006.kskdce (mgr.14664) 49 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 471 KiB/s wr, 173 op/s 2024-03-12T16:12:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.349006+0000 mon.smithi006 (mon.0) 803 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.356716+0000 mon.smithi006 (mon.0) 804 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.358367+0000 mon.smithi134 (mon.1) 56 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:12:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.359273+0000 mon.smithi134 (mon.1) 57 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.366687+0000 mon.smithi006 (mon.0) 805 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.505658+0000 mon.smithi134 (mon.1) 58 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.509640+0000 mon.smithi134 (mon.1) 59 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:28.510474+0000 mgr.smithi006.kskdce (mgr.14664) 41 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.517311+0000 mon.smithi006 (mon.0) 806 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.518315+0000 mon.smithi134 (mon.1) 60 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi006.kskdce"}]: dispatch 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.518748+0000 mon.smithi006 (mon.0) 807 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi006.kskdce"}]: dispatch 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.524313+0000 mon.smithi006 (mon.0) 808 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi006.kskdce"}]': finished 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.524961+0000 mon.smithi134 (mon.1) 61 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.gcntfu"}]: dispatch 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.525348+0000 mon.smithi006 (mon.0) 809 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.gcntfu"}]: dispatch 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.530684+0000 mon.smithi006 (mon.0) 810 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.smithi134.gcntfu"}]': finished 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.533570+0000 mon.smithi134 (mon.1) 62 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:28.534415+0000 mgr.smithi006.kskdce (mgr.14664) 42 : cephadm [INF] Upgrade: Setting container_image for all rgw 2024-03-12T16:12:29.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.540236+0000 mon.smithi006 (mon.0) 811 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.541536+0000 mon.smithi134 (mon.1) 63 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:28.542318+0000 mgr.smithi006.kskdce (mgr.14664) 43 : cephadm [INF] Upgrade: Setting container_image for all rbd-mirror 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.548201+0000 mon.smithi006 (mon.0) 812 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.549297+0000 mon.smithi134 (mon.1) 64 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:28.550003+0000 mgr.smithi006.kskdce (mgr.14664) 44 : cephadm [INF] Upgrade: Setting container_image for all cephfs-mirror 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.554089+0000 mon.smithi006 (mon.0) 813 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.555044+0000 mon.smithi134 (mon.1) 65 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:28.555838+0000 mgr.smithi006.kskdce (mgr.14664) 45 : cephadm [INF] Upgrade: Setting container_image for all ceph-exporter 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.559844+0000 mon.smithi006 (mon.0) 814 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.560854+0000 mon.smithi134 (mon.1) 66 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:28.561600+0000 mgr.smithi006.kskdce (mgr.14664) 46 : cephadm [INF] Upgrade: Setting container_image for all iscsi 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.566010+0000 mon.smithi006 (mon.0) 815 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.567011+0000 mon.smithi134 (mon.1) 67 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:28.567706+0000 mgr.smithi006.kskdce (mgr.14664) 47 : cephadm [INF] Upgrade: Setting container_image for all nfs 2024-03-12T16:12:29.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.571591+0000 mon.smithi006 (mon.0) 816 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.573058+0000 mon.smithi134 (mon.1) 68 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:29.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:28.573809+0000 mgr.smithi006.kskdce (mgr.14664) 48 : cephadm [INF] Upgrade: Setting container_image for all nvmeof 2024-03-12T16:12:29.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:28.578107+0000 mon.smithi006 (mon.0) 817 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:29.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:29.075465+0000 mgr.smithi006.kskdce (mgr.14664) 49 : cluster [DBG] pgmap v22: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 15 KiB/s rd, 471 KiB/s wr, 173 op/s 2024-03-12T16:12:30.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:30.046094+0000 mgr.smithi006.kskdce (mgr.14664) 50 : cephadm [INF] Upgrade: Updating node-exporter.smithi006 (1/2) 2024-03-12T16:12:30.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:30 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:30.046634+0000 mgr.smithi006.kskdce (mgr.14664) 51 : cephadm [INF] Deploying daemon node-exporter.smithi006 on smithi006 2024-03-12T16:12:30.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:30.046094+0000 mgr.smithi006.kskdce (mgr.14664) 50 : cephadm [INF] Upgrade: Updating node-exporter.smithi006 (1/2) 2024-03-12T16:12:30.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:30 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:30.046634+0000 mgr.smithi006.kskdce (mgr.14664) 51 : cephadm [INF] Deploying daemon node-exporter.smithi006 on smithi006 2024-03-12T16:12:31.803 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:31.075764+0000 mgr.smithi006.kskdce (mgr.14664) 52 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.4 KiB/s rd, 37 KiB/s wr, 48 op/s 2024-03-12T16:12:31.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:31.075764+0000 mgr.smithi006.kskdce (mgr.14664) 52 : cluster [DBG] pgmap v23: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.4 KiB/s rd, 37 KiB/s wr, 48 op/s 2024-03-12T16:12:33.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:33.076300+0000 mgr.smithi006.kskdce (mgr.14664) 53 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.4 KiB/s rd, 37 KiB/s wr, 48 op/s 2024-03-12T16:12:33.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:33.076300+0000 mgr.smithi006.kskdce (mgr.14664) 53 : cluster [DBG] pgmap v24: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 5.4 KiB/s rd, 37 KiB/s wr, 48 op/s 2024-03-12T16:12:35.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:35.076826+0000 mgr.smithi006.kskdce (mgr.14664) 54 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2024-03-12T16:12:35.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:35.076826+0000 mgr.smithi006.kskdce (mgr.14664) 54 : cluster [DBG] pgmap v25: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2024-03-12T16:12:36.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:35.179706+0000 mon.smithi006 (mon.0) 818 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:36.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:35.184778+0000 mon.smithi006 (mon.0) 819 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:36.403 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:36.172885+0000 mon.smithi134 (mon.1) 69 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:12:36.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:35.179706+0000 mon.smithi006 (mon.0) 818 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:36.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:35.184778+0000 mon.smithi006 (mon.0) 819 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:36.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:36.172885+0000 mon.smithi134 (mon.1) 69 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:12:37.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:36.839161+0000 mgr.smithi006.kskdce (mgr.14664) 55 : cephadm [INF] Upgrade: Updating node-exporter.smithi134 (2/2) 2024-03-12T16:12:37.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:36.839643+0000 mgr.smithi006.kskdce (mgr.14664) 56 : cephadm [INF] Deploying daemon node-exporter.smithi134 on smithi134 2024-03-12T16:12:37.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:37.077287+0000 mgr.smithi006.kskdce (mgr.14664) 57 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2024-03-12T16:12:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:36.839161+0000 mgr.smithi006.kskdce (mgr.14664) 55 : cephadm [INF] Upgrade: Updating node-exporter.smithi134 (2/2) 2024-03-12T16:12:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:36.839643+0000 mgr.smithi006.kskdce (mgr.14664) 56 : cephadm [INF] Deploying daemon node-exporter.smithi134 on smithi134 2024-03-12T16:12:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:37.077287+0000 mgr.smithi006.kskdce (mgr.14664) 57 : cluster [DBG] pgmap v26: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2024-03-12T16:12:38.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.522+0000 7f562d3d3700 1 -- 172.21.15.6:0/2521454066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f9800 msgr2=0x7f56280fbbf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:38.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.522+0000 7f562d3d3700 1 --2- 172.21.15.6:0/2521454066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f9800 0x7f56280fbbf0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f561c0047f0 tx=0x7f561c009cb0).stop 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.522+0000 7f562d3d3700 1 -- 172.21.15.6:0/2521454066 shutdown_connections 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.522+0000 7f562d3d3700 1 --2- 172.21.15.6:0/2521454066 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f9800 0x7f56280fbbf0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.522+0000 7f562d3d3700 1 --2- 172.21.15.6:0/2521454066 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280f6f20 0x7f56280f9310 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.522+0000 7f562d3d3700 1 -- 172.21.15.6:0/2521454066 >> 172.21.15.6:0/2521454066 conn(0x7f56280f1220 msgr2=0x7f56280f3640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.522+0000 7f562d3d3700 1 -- 172.21.15.6:0/2521454066 shutdown_connections 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.522+0000 7f562d3d3700 1 -- 172.21.15.6:0/2521454066 wait complete. 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.522+0000 7f562d3d3700 1 Processor -- start 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f562d3d3700 1 -- start start 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f562d3d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f6f20 0x7f56280fb960 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f562d3d3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280f9800 0x7f56280f9fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f562d3d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56280fbf10 con 0x7f56280f6f20 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f562d3d3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56280fa4b0 con 0x7f56280f9800 2024-03-12T16:12:38.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f5626ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f6f20 0x7f56280fb960 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f5626ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f6f20 0x7f56280fb960 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45924/0 (socket says 172.21.15.6:45924) 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f5626ffd700 1 -- 172.21.15.6:0/824318810 learned_addr learned my addr 172.21.15.6:0/824318810 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f56267fc700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280f9800 0x7f56280f9fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f5626ffd700 1 -- 172.21.15.6:0/824318810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280f9800 msgr2=0x7f56280f9fc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f5626ffd700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280f9800 0x7f56280f9fc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f5626ffd700 1 -- 172.21.15.6:0/824318810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f561c005040 con 0x7f56280f6f20 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.523+0000 7f5626ffd700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f6f20 0x7f56280fb960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f561800e940 tx=0x7f561800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.524+0000 7f560ffff700 1 -- 172.21.15.6:0/824318810 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5618007b40 con 0x7f56280f6f20 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.524+0000 7f560ffff700 1 -- 172.21.15.6:0/824318810 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f561800f040 con 0x7f56280f6f20 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.524+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56280fa6d0 con 0x7f56280f6f20 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.524+0000 7f560ffff700 1 -- 172.21.15.6:0/824318810 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56180148e0 con 0x7f56280f6f20 2024-03-12T16:12:38.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.524+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56280fac90 con 0x7f56280f6f20 2024-03-12T16:12:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.525+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56280feee0 con 0x7f56280f6f20 2024-03-12T16:12:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.525+0000 7f560ffff700 1 -- 172.21.15.6:0/824318810 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f5618007ca0 con 0x7f56280f6f20 2024-03-12T16:12:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.526+0000 7f560ffff700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f561006c810 0x7f561006ecd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.526+0000 7f560ffff700 1 -- 172.21.15.6:0/824318810 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f561808b4a0 con 0x7f56280f6f20 2024-03-12T16:12:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.526+0000 7f56267fc700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f561006c810 0x7f561006ecd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:38.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.526+0000 7f56267fc700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f561006c810 0x7f561006ecd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f561c0047c0 tx=0x7f561c009cb0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:38.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.531+0000 7f560ffff700 1 -- 172.21.15.6:0/824318810 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f56180592c0 con 0x7f56280f6f20 2024-03-12T16:12:38.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.744+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5628059120 con 0x7f561006c810 2024-03-12T16:12:38.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.746+0000 7f560ffff700 1 -- 172.21.15.6:0/824318810 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f5628059120 con 0x7f561006c810 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f561006c810 msgr2=0x7f561006ecd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f561006c810 0x7f561006ecd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f561c0047c0 tx=0x7f561c009cb0).stop 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f6f20 msgr2=0x7f56280fb960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f6f20 0x7f56280fb960 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f561800e940 tx=0x7f561800b040).stop 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 shutdown_connections 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f561006c810 0x7f561006ecd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56280f6f20 0x7f56280fb960 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 --2- 172.21.15.6:0/824318810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56280f9800 0x7f56280f9fc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 >> 172.21.15.6:0/824318810 conn(0x7f56280f1220 msgr2=0x7f56280f6690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 shutdown_connections 2024-03-12T16:12:38.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.748+0000 7f562d3d3700 1 -- 172.21.15.6:0/824318810 wait complete. 2024-03-12T16:12:38.759 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:12:38.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.850+0000 7fb3d1f98700 1 -- 172.21.15.6:0/939875010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc0fa950 msgr2=0x7fb3cc0fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:38.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.850+0000 7fb3d1f98700 1 --2- 172.21.15.6:0/939875010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc0fa950 0x7fb3cc0fcda0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fb3c00047f0 tx=0x7fb3c0009cb0).stop 2024-03-12T16:12:38.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.850+0000 7fb3d1f98700 1 -- 172.21.15.6:0/939875010 shutdown_connections 2024-03-12T16:12:38.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.850+0000 7fb3d1f98700 1 --2- 172.21.15.6:0/939875010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc0fa950 0x7fb3cc0fcda0 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:38.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.850+0000 7fb3d1f98700 1 --2- 172.21.15.6:0/939875010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3cc061280 0x7fb3cc0fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:38.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.850+0000 7fb3d1f98700 1 -- 172.21.15.6:0/939875010 >> 172.21.15.6:0/939875010 conn(0x7fb3cc0f1e50 msgr2=0x7fb3cc0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:38.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.850+0000 7fb3d1f98700 1 -- 172.21.15.6:0/939875010 shutdown_connections 2024-03-12T16:12:38.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.850+0000 7fb3d1f98700 1 -- 172.21.15.6:0/939875010 wait complete. 2024-03-12T16:12:38.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3d1f98700 1 Processor -- start 2024-03-12T16:12:38.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3d1f98700 1 -- start start 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3d1f98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc061280 0x7fb3cc107f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3d1f98700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3cc0fa950 0x7fb3cc108400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3d1f98700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc1089b0 con 0x7fb3cc061280 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3d1f98700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3cc108af0 con 0x7fb3cc0fa950 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc061280 0x7fb3cc107f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3cb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc061280 0x7fb3cc107f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45936/0 (socket says 172.21.15.6:45936) 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3cb7fe700 1 -- 172.21.15.6:0/3715136643 learned_addr learned my addr 172.21.15.6:0/3715136643 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.851+0000 7fb3caffd700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3cc0fa950 0x7fb3cc108400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.852+0000 7fb3cb7fe700 1 -- 172.21.15.6:0/3715136643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3cc0fa950 msgr2=0x7fb3cc108400 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.852+0000 7fb3cb7fe700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3cc0fa950 0x7fb3cc108400 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.852+0000 7fb3cb7fe700 1 -- 172.21.15.6:0/3715136643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3c0005040 con 0x7fb3cc061280 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.852+0000 7fb3cb7fe700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc061280 0x7fb3cc107f10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fb3bc0041d0 tx=0x7fb3bc009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:38.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.852+0000 7fb3c8ff9700 1 -- 172.21.15.6:0/3715136643 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3bc007b40 con 0x7fb3cc061280 2024-03-12T16:12:38.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.852+0000 7fb3c8ff9700 1 -- 172.21.15.6:0/3715136643 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb3bc00f040 con 0x7fb3cc061280 2024-03-12T16:12:38.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.852+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3cc10d590 con 0x7fb3cc061280 2024-03-12T16:12:38.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.852+0000 7fb3c8ff9700 1 -- 172.21.15.6:0/3715136643 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3bc0147b0 con 0x7fb3cc061280 2024-03-12T16:12:38.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.852+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3cc0f6230 con 0x7fb3cc061280 2024-03-12T16:12:38.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.853+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3cc0fffb0 con 0x7fb3cc061280 2024-03-12T16:12:38.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.854+0000 7fb3c8ff9700 1 -- 172.21.15.6:0/3715136643 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7fb3bc009110 con 0x7fb3cc061280 2024-03-12T16:12:38.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.854+0000 7fb3c8ff9700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fb3b406c7c0 0x7fb3b406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:38.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.854+0000 7fb3c8ff9700 1 -- 172.21.15.6:0/3715136643 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fb3bc08b9a0 con 0x7fb3cc061280 2024-03-12T16:12:38.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.854+0000 7fb3caffd700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fb3b406c7c0 0x7fb3b406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:38.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.854+0000 7fb3caffd700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fb3b406c7c0 0x7fb3b406ec80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb3c0004f10 tx=0x7fb3c000b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:38.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:38.859+0000 7fb3c8ff9700 1 -- 172.21.15.6:0/3715136643 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fb3bc059930 con 0x7fb3cc061280 2024-03-12T16:12:39.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.073+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb3cc059120 con 0x7fb3b406c7c0 2024-03-12T16:12:39.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.074+0000 7fb3c8ff9700 1 -- 172.21.15.6:0/3715136643 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7fb3cc059120 con 0x7fb3b406c7c0 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.076+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fb3b406c7c0 msgr2=0x7fb3b406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.076+0000 7fb3d1f98700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fb3b406c7c0 0x7fb3b406ec80 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7fb3c0004f10 tx=0x7fb3c000b040).stop 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.076+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc061280 msgr2=0x7fb3cc107f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.076+0000 7fb3d1f98700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc061280 0x7fb3cc107f10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7fb3bc0041d0 tx=0x7fb3bc009f60).stop 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.077+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 shutdown_connections 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.077+0000 7fb3d1f98700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fb3b406c7c0 0x7fb3b406ec80 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.077+0000 7fb3d1f98700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3cc061280 0x7fb3cc107f10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.077+0000 7fb3d1f98700 1 --2- 172.21.15.6:0/3715136643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3cc0fa950 0x7fb3cc108400 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.077+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 >> 172.21.15.6:0/3715136643 conn(0x7fb3cc0f1e50 msgr2=0x7fb3cc0f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.077+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 shutdown_connections 2024-03-12T16:12:39.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.077+0000 7fb3d1f98700 1 -- 172.21.15.6:0/3715136643 wait complete. 2024-03-12T16:12:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.179+0000 7f31b02f6700 1 -- 172.21.15.6:0/3043187615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f8aa0 msgr2=0x7f31a80f8f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.179+0000 7f31b02f6700 1 --2- 172.21.15.6:0/3043187615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f8aa0 0x7f31a80f8f00 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f31980047f0 tx=0x7f3198009cb0).stop 2024-03-12T16:12:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.179+0000 7f31b02f6700 1 -- 172.21.15.6:0/3043187615 shutdown_connections 2024-03-12T16:12:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.179+0000 7f31b02f6700 1 --2- 172.21.15.6:0/3043187615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f8aa0 0x7f31a80f8f00 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.179+0000 7f31b02f6700 1 --2- 172.21.15.6:0/3043187615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a80f7800 0x7f31a80f7c20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.179+0000 7f31b02f6700 1 -- 172.21.15.6:0/3043187615 >> 172.21.15.6:0/3043187615 conn(0x7f31a80f2f80 msgr2=0x7f31a80f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.179+0000 7f31b02f6700 1 -- 172.21.15.6:0/3043187615 shutdown_connections 2024-03-12T16:12:39.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.179+0000 7f31b02f6700 1 -- 172.21.15.6:0/3043187615 wait complete. 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31b02f6700 1 Processor -- start 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31b02f6700 1 -- start start 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31b02f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f7800 0x7f31a8107fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31b02f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a80f8aa0 0x7f31a81084c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31b02f6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8108a70 con 0x7f31a80f7800 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31b02f6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a8108bb0 con 0x7f31a80f8aa0 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31ae092700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f7800 0x7f31a8107fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31ae092700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f7800 0x7f31a8107fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45946/0 (socket says 172.21.15.6:45946) 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31ae092700 1 -- 172.21.15.6:0/2239336854 learned_addr learned my addr 172.21.15.6:0/2239336854 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.180+0000 7f31ad891700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a80f8aa0 0x7f31a81084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:39.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f31ae092700 1 -- 172.21.15.6:0/2239336854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a80f8aa0 msgr2=0x7f31a81084c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f31ae092700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a80f8aa0 0x7f31a81084c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f31ae092700 1 -- 172.21.15.6:0/2239336854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3198005040 con 0x7f31a80f7800 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f31ad891700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a80f8aa0 0x7f31a81084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f31ae092700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f7800 0x7f31a8107fd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f31a400ec20 tx=0x7f31a400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f319f7fe700 1 -- 172.21.15.6:0/2239336854 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31a40092e0 con 0x7f31a80f7800 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f319f7fe700 1 -- 172.21.15.6:0/2239336854 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31a400f040 con 0x7f31a80f7800 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a810d650 con 0x7f31a80f7800 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f319f7fe700 1 -- 172.21.15.6:0/2239336854 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31a400ca50 con 0x7f31a80f7800 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.181+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a810dc10 con 0x7f31a80f7800 2024-03-12T16:12:39.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.182+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a80fffc0 con 0x7f31a80f7800 2024-03-12T16:12:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.183+0000 7f319f7fe700 1 -- 172.21.15.6:0/2239336854 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f31a400cc90 con 0x7f31a80f7800 2024-03-12T16:12:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.183+0000 7f319f7fe700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f319406c7c0 0x7f319406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.183+0000 7f319f7fe700 1 -- 172.21.15.6:0/2239336854 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f31a408b790 con 0x7f31a80f7800 2024-03-12T16:12:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.183+0000 7f31ad891700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f319406c7c0 0x7f319406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:39.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.183+0000 7f31ad891700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f319406c7c0 0x7f319406ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f31980134c0 tx=0x7f3198009cb0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:39.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.187+0000 7f319f7fe700 1 -- 172.21.15.6:0/2239336854 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f31a4059670 con 0x7f31a80f7800 2024-03-12T16:12:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:38.746085+0000 mgr.smithi006.kskdce (mgr.14664) 58 : audit [DBG] from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:39.074799+0000 mgr.smithi006.kskdce (mgr.14664) 59 : audit [DBG] from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:39.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:39.077815+0000 mgr.smithi006.kskdce (mgr.14664) 60 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2024-03-12T16:12:39.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.393+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f31a8059120 con 0x7f319406c7c0 2024-03-12T16:12:39.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.403+0000 7f319f7fe700 1 -- 172.21.15.6:0/2239336854 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f31a8059120 con 0x7f319406c7c0 2024-03-12T16:12:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:12:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (2m) 40s ago 10m 17.0M - 0.23.0 ba2b418f427c 1cba788dfc1b 2024-03-12T16:12:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (10m) 40s ago 10m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:12:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (9m) 15s ago 9m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:12:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (100s) 40s ago 10m 46.7M - 8.3.5 dad864ee21e9 9e2a73f49bcc 2024-03-12T16:12:39.404 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (5m) 40s ago 5m 162M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (5m) 40s ago 5m 13.8M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (5m) 15s ago 5m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (5m) 15s ago 5m 16.7M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (60s) 40s ago 11m 473M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (20s) 15s ago 9m 47.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (11m) 40s ago 11m 52.8M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (9m) 15s ago 9m 42.8M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 starting - - - - 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (91s) 15s ago 9m 21.6M - 1.3.1 1dbe0e931976 6f6977dcc53d 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (9m) 40s ago 9m 202M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (8m) 40s ago 8m 220M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (8m) 40s ago 8m 182M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (7m) 15s ago 7m 264M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (7m) 15s ago 7m 236M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:12:39.405 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (6m) 15s ago 6m 226M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:12:39.406 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (25s) 15s ago 8m 43.7M - 2.33.4 514e6a882f6e 15718d027df8 2024-03-12T16:12:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f319406c7c0 msgr2=0x7f319406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f319406c7c0 0x7f319406ec80 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7f31980134c0 tx=0x7f3198009cb0).stop 2024-03-12T16:12:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f7800 msgr2=0x7f31a8107fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f7800 0x7f31a8107fd0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f31a400ec20 tx=0x7f31a400b040).stop 2024-03-12T16:12:39.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 shutdown_connections 2024-03-12T16:12:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f319406c7c0 0x7f319406ec80 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a80f7800 0x7f31a8107fd0 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 --2- 172.21.15.6:0/2239336854 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a80f8aa0 0x7f31a81084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 >> 172.21.15.6:0/2239336854 conn(0x7f31a80f2f80 msgr2=0x7f31a80fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 shutdown_connections 2024-03-12T16:12:39.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.405+0000 7f31b02f6700 1 -- 172.21.15.6:0/2239336854 wait complete. 2024-03-12T16:12:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:38.746085+0000 mgr.smithi006.kskdce (mgr.14664) 58 : audit [DBG] from='client.14712 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:39.074799+0000 mgr.smithi006.kskdce (mgr.14664) 59 : audit [DBG] from='client.14716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:39.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:39.077815+0000 mgr.smithi006.kskdce (mgr.14664) 60 : cluster [DBG] pgmap v27: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 682 B/s wr, 0 op/s 2024-03-12T16:12:39.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.506+0000 7f8746e58700 1 -- 172.21.15.6:0/2954260632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f7800 msgr2=0x7f87400f7c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.506+0000 7f8746e58700 1 --2- 172.21.15.6:0/2954260632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f7800 0x7f87400f7c20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f87340047f0 tx=0x7f8734009cb0).stop 2024-03-12T16:12:39.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.506+0000 7f8746e58700 1 -- 172.21.15.6:0/2954260632 shutdown_connections 2024-03-12T16:12:39.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.506+0000 7f8746e58700 1 --2- 172.21.15.6:0/2954260632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87400f8aa0 0x7f87400f8f00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.506+0000 7f8746e58700 1 --2- 172.21.15.6:0/2954260632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f7800 0x7f87400f7c20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.506+0000 7f8746e58700 1 -- 172.21.15.6:0/2954260632 >> 172.21.15.6:0/2954260632 conn(0x7f87400f2f80 msgr2=0x7f87400f53a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:39.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.506+0000 7f8746e58700 1 -- 172.21.15.6:0/2954260632 shutdown_connections 2024-03-12T16:12:39.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.506+0000 7f8746e58700 1 -- 172.21.15.6:0/2954260632 wait complete. 2024-03-12T16:12:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.506+0000 7f8746e58700 1 Processor -- start 2024-03-12T16:12:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f8746e58700 1 -- start start 2024-03-12T16:12:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f8746e58700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87400f7800 0x7f8740108080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f8746e58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f8aa0 0x7f8740108570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f8746e58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8740108b20 con 0x7f87400f8aa0 2024-03-12T16:12:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f8746e58700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8740108c60 con 0x7f87400f7800 2024-03-12T16:12:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f873ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f8aa0 0x7f8740108570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:39.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f873ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f8aa0 0x7f8740108570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45954/0 (socket says 172.21.15.6:45954) 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f873ffff700 1 -- 172.21.15.6:0/2484274703 learned_addr learned my addr 172.21.15.6:0/2484274703 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f8744bf4700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87400f7800 0x7f8740108080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f873ffff700 1 -- 172.21.15.6:0/2484274703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87400f7800 msgr2=0x7f8740108080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f873ffff700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87400f7800 0x7f8740108080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f873ffff700 1 -- 172.21.15.6:0/2484274703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8734005040 con 0x7f87400f8aa0 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f873ffff700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f8aa0 0x7f8740108570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f872c00e910 tx=0x7f872c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f873dffb700 1 -- 172.21.15.6:0/2484274703 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f872c007b40 con 0x7f87400f8aa0 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f873dffb700 1 -- 172.21.15.6:0/2484274703 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f872c00f040 con 0x7f87400f8aa0 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.507+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f874010d700 con 0x7f87400f8aa0 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.508+0000 7f873dffb700 1 -- 172.21.15.6:0/2484274703 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f872c014920 con 0x7f87400f8aa0 2024-03-12T16:12:39.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.508+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f874010dcc0 con 0x7f87400f8aa0 2024-03-12T16:12:39.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.509+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87400fffe0 con 0x7f87400f8aa0 2024-03-12T16:12:39.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.509+0000 7f873dffb700 1 -- 172.21.15.6:0/2484274703 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f872c007ca0 con 0x7f87400f8aa0 2024-03-12T16:12:39.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.509+0000 7f873dffb700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f873006c7c0 0x7f873006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:39.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.510+0000 7f873dffb700 1 -- 172.21.15.6:0/2484274703 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f872c08b310 con 0x7f87400f8aa0 2024-03-12T16:12:39.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.510+0000 7f8744bf4700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f873006c7c0 0x7f873006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:39.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.510+0000 7f8744bf4700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f873006c7c0 0x7f873006ec80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f87340047c0 tx=0x7f8734009cb0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:39.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.514+0000 7f873dffb700 1 -- 172.21.15.6:0/2484274703 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f872c0591f0 con 0x7f87400f8aa0 2024-03-12T16:12:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.795+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8740101e50 con 0x7f87400f8aa0 2024-03-12T16:12:39.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.795+0000 7f873dffb700 1 -- 172.21.15.6:0/2484274703 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7f872c05f070 con 0x7f87400f8aa0 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:12:39.797 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:12:39.798 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:12:39.798 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:12:39.798 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 12, 2024-03-12T16:12:39.798 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:12:39.798 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:12:39.798 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f873006c7c0 msgr2=0x7f873006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f873006c7c0 0x7f873006ec80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7f87340047c0 tx=0x7f8734009cb0).stop 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f8aa0 msgr2=0x7f8740108570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f8aa0 0x7f8740108570 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f872c00e910 tx=0x7f872c00b040).stop 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 shutdown_connections 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f873006c7c0 0x7f873006ec80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87400f7800 0x7f8740108080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 --2- 172.21.15.6:0/2484274703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87400f8aa0 0x7f8740108570 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 >> 172.21.15.6:0/2484274703 conn(0x7f87400f2f80 msgr2=0x7f87400fc4f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 shutdown_connections 2024-03-12T16:12:39.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.798+0000 7f8746e58700 1 -- 172.21.15.6:0/2484274703 wait complete. 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 -- 172.21.15.6:0/1342260789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 msgr2=0x7f3a4c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 --2- 172.21.15.6:0/1342260789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 0x7f3a4c0f6b10 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f3a3c0047f0 tx=0x7f3a3c009cb0).stop 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 -- 172.21.15.6:0/1342260789 shutdown_connections 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 --2- 172.21.15.6:0/1342260789 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a4c0f7990 0x7f3a4c0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 --2- 172.21.15.6:0/1342260789 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 0x7f3a4c0f6b10 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 -- 172.21.15.6:0/1342260789 >> 172.21.15.6:0/1342260789 conn(0x7f3a4c0f1e50 msgr2=0x7f3a4c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 -- 172.21.15.6:0/1342260789 shutdown_connections 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 -- 172.21.15.6:0/1342260789 wait complete. 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 Processor -- start 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.901+0000 7f3a53633700 1 -- start start 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a53633700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 0x7f3a4c107fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:39.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a53633700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a4c0f7990 0x7f3a4c1084c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a53633700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c108b00 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a53633700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3a4c108c40 con 0x7f3a4c0f7990 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a513cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 0x7f3a4c107fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a513cf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 0x7f3a4c107fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45962/0 (socket says 172.21.15.6:45962) 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a513cf700 1 -- 172.21.15.6:0/3024671835 learned_addr learned my addr 172.21.15.6:0/3024671835 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a50bce700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a4c0f7990 0x7f3a4c1084c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a513cf700 1 -- 172.21.15.6:0/3024671835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a4c0f7990 msgr2=0x7f3a4c1084c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a513cf700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a4c0f7990 0x7f3a4c1084c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a513cf700 1 -- 172.21.15.6:0/3024671835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3a3c005040 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a513cf700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 0x7f3a4c107fd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f3a3c00b120 tx=0x7f3a3c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a427fc700 1 -- 172.21.15.6:0/3024671835 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3c00e030 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a427fc700 1 -- 172.21.15.6:0/3024671835 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3a3c007e90 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3a4c10d680 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a427fc700 1 -- 172.21.15.6:0/3024671835 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3a3c018070 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.902+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3a4c10db60 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.903+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3a4c0fef30 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.904+0000 7f3a427fc700 1 -- 172.21.15.6:0/3024671835 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f3a3c01d420 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.904+0000 7f3a427fc700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3a3806c7a0 0x7f3a3806ec60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:12:39.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.904+0000 7f3a427fc700 1 -- 172.21.15.6:0/3024671835 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f3a3c08cf10 con 0x7f3a4c0f66f0 2024-03-12T16:12:39.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.905+0000 7f3a50bce700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3a3806c7a0 0x7f3a3806ec60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:12:39.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.905+0000 7f3a50bce700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3a3806c7a0 0x7f3a3806ec60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f3a48006fd0 tx=0x7f3a48009060).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:12:39.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:39.909+0000 7f3a427fc700 1 -- 172.21.15.6:0/3024671835 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f3a3c05adf0 con 0x7f3a4c0f66f0 2024-03-12T16:12:40.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.123+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3a4c0ff0f0 con 0x7f3a3806c7a0 2024-03-12T16:12:40.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.124+0000 7f3a427fc700 1 -- 172.21.15.6:0/3024671835 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+370 (secure 0 0 0) 0x7f3a4c0ff0f0 con 0x7f3a3806c7a0 2024-03-12T16:12:40.125 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:12:40.125 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:12:40.125 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:12:40.126 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-12T16:12:40.126 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:12:40.126 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr" 2024-03-12T16:12:40.126 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:12:40.126 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "2/2 daemons upgraded", 2024-03-12T16:12:40.126 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading node-exporter daemons", 2024-03-12T16:12:40.126 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:12:40.126 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:12:40.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3a3806c7a0 msgr2=0x7f3a3806ec60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:40.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3a3806c7a0 0x7f3a3806ec60 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7f3a48006fd0 tx=0x7f3a48009060).stop 2024-03-12T16:12:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 msgr2=0x7f3a4c107fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:12:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 0x7f3a4c107fd0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f3a3c00b120 tx=0x7f3a3c009cb0).stop 2024-03-12T16:12:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 shutdown_connections 2024-03-12T16:12:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3a3806c7a0 0x7f3a3806ec60 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3a4c0f66f0 0x7f3a4c107fd0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 --2- 172.21.15.6:0/3024671835 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3a4c0f7990 0x7f3a4c1084c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:12:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 >> 172.21.15.6:0/3024671835 conn(0x7f3a4c0f1e50 msgr2=0x7f3a4c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:12:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.126+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 shutdown_connections 2024-03-12T16:12:40.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:12:40.127+0000 7f3a53633700 1 -- 172.21.15.6:0/3024671835 wait complete. 2024-03-12T16:12:40.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:39.394745+0000 mgr.smithi006.kskdce (mgr.14664) 61 : audit [DBG] from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:40.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:39.796033+0000 mon.smithi006 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.6:0/2484274703' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:40.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:39.394745+0000 mgr.smithi006.kskdce (mgr.14664) 61 : audit [DBG] from='client.14720 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:40.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:40 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:39.796033+0000 mon.smithi006 (mon.0) 820 : audit [DBG] from='client.? 172.21.15.6:0/2484274703' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:41.450 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:40.124719+0000 mgr.smithi006.kskdce (mgr.14664) 62 : audit [DBG] from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:41.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:41.078242+0000 mgr.smithi006.kskdce (mgr.14664) 63 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-12T16:12:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:40.124719+0000 mgr.smithi006.kskdce (mgr.14664) 62 : audit [DBG] from='client.14728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:12:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:41.078242+0000 mgr.smithi006.kskdce (mgr.14664) 63 : cluster [DBG] pgmap v28: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-12T16:12:42.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:41.616690+0000 mon.smithi006 (mon.0) 821 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:42.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:41.624713+0000 mon.smithi006 (mon.0) 822 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:42.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:41.664178+0000 mon.smithi134 (mon.1) 70 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:42.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:41.935612+0000 mon.smithi006 (mon.0) 823 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:42.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:41.943764+0000 mon.smithi006 (mon.0) 824 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:42.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:41.616690+0000 mon.smithi006 (mon.0) 821 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:42.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:41.624713+0000 mon.smithi006 (mon.0) 822 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:42.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:41.664178+0000 mon.smithi134 (mon.1) 70 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:42.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:41.935612+0000 mon.smithi006 (mon.0) 823 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:42.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:41.943764+0000 mon.smithi006 (mon.0) 824 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:43.927 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:43.078684+0000 mgr.smithi006.kskdce (mgr.14664) 64 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-12T16:12:43.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:43.078684+0000 mgr.smithi006.kskdce (mgr.14664) 64 : cluster [DBG] pgmap v29: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 170 B/s wr, 0 op/s 2024-03-12T16:12:45.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:45.079013+0000 mgr.smithi006.kskdce (mgr.14664) 65 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:12:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:45.079013+0000 mgr.smithi006.kskdce (mgr.14664) 65 : cluster [DBG] pgmap v30: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:12:47.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:46.023258+0000 mon.smithi006 (mon.0) 825 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:47.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:46.028873+0000 mon.smithi006 (mon.0) 826 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:47.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:46.667471+0000 mon.smithi006 (mon.0) 827 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:47.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:46.673017+0000 mon.smithi006 (mon.0) 828 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:46.023258+0000 mon.smithi006 (mon.0) 825 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:46.028873+0000 mon.smithi006 (mon.0) 826 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:46.667471+0000 mon.smithi006 (mon.0) 827 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:46.673017+0000 mon.smithi006 (mon.0) 828 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:48.289 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:47.079349+0000 mgr.smithi006.kskdce (mgr.14664) 66 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:12:48.289 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:47.248586+0000 mon.smithi006 (mon.0) 829 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:48.289 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:47.253801+0000 mon.smithi006 (mon.0) 830 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:48.289 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:47.940514+0000 mon.smithi006 (mon.0) 831 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:48.290 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:47.945982+0000 mon.smithi006 (mon.0) 832 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:48.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:47.079349+0000 mgr.smithi006.kskdce (mgr.14664) 66 : cluster [DBG] pgmap v31: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:12:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:47.248586+0000 mon.smithi006 (mon.0) 829 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:47.253801+0000 mon.smithi006 (mon.0) 830 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:47.940514+0000 mon.smithi006 (mon.0) 831 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:47.945982+0000 mon.smithi006 (mon.0) 832 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:49.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:49.079768+0000 mgr.smithi006.kskdce (mgr.14664) 67 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:12:49.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:49.079768+0000 mgr.smithi006.kskdce (mgr.14664) 67 : cluster [DBG] pgmap v32: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:12:51.399 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:50.101760+0000 mon.smithi006 (mon.0) 833 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:51.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:50.108064+0000 mon.smithi006 (mon.0) 834 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:51.400 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:51.080112+0000 mgr.smithi006.kskdce (mgr.14664) 68 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:12:51.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:50.101760+0000 mon.smithi006 (mon.0) 833 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:51.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:50.108064+0000 mon.smithi006 (mon.0) 834 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:51.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:51.080112+0000 mgr.smithi006.kskdce (mgr.14664) 68 : cluster [DBG] pgmap v33: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:12:52.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.172912+0000 mon.smithi134 (mon.1) 71 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.475174+0000 mon.smithi006 (mon.0) 835 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.483163+0000 mon.smithi006 (mon.0) 836 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.484983+0000 mon.smithi134 (mon.1) 72 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.485920+0000 mon.smithi134 (mon.1) 73 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.491061+0000 mon.smithi006 (mon.0) 837 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.629479+0000 mon.smithi134 (mon.1) 74 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.633299+0000 mon.smithi134 (mon.1) 75 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.636080+0000 mon.smithi134 (mon.1) 76 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.637364+0000 mon.smithi134 (mon.1) 77 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.638464+0000 mon.smithi134 (mon.1) 78 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.639662+0000 mon.smithi134 (mon.1) 79 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.640901+0000 mon.smithi134 (mon.1) 80 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.442 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.642176+0000 mon.smithi134 (mon.1) 81 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.643442+0000 mon.smithi134 (mon.1) 82 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.443 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:51.645038+0000 mon.smithi134 (mon.1) 83 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.172912+0000 mon.smithi134 (mon.1) 71 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:12:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.475174+0000 mon.smithi006 (mon.0) 835 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.483163+0000 mon.smithi006 (mon.0) 836 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.484983+0000 mon.smithi134 (mon.1) 72 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:12:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.485920+0000 mon.smithi134 (mon.1) 73 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:12:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.491061+0000 mon.smithi006 (mon.0) 837 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.629479+0000 mon.smithi134 (mon.1) 74 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.633299+0000 mon.smithi134 (mon.1) 75 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.636080+0000 mon.smithi134 (mon.1) 76 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.637364+0000 mon.smithi134 (mon.1) 77 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.638464+0000 mon.smithi134 (mon.1) 78 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.639662+0000 mon.smithi134 (mon.1) 79 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.640901+0000 mon.smithi134 (mon.1) 80 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.642176+0000 mon.smithi134 (mon.1) 81 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.643442+0000 mon.smithi134 (mon.1) 82 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:52.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:51.645038+0000 mon.smithi134 (mon.1) 83 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:12:53.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:53.080786+0000 mgr.smithi006.kskdce (mgr.14664) 69 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:12:53.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:53.080786+0000 mgr.smithi006.kskdce (mgr.14664) 69 : cluster [DBG] pgmap v34: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:12:54.445 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:53.314817+0000 mgr.smithi006.kskdce (mgr.14664) 70 : cephadm [INF] Upgrade: Updating prometheus.smithi134 2024-03-12T16:12:54.446 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:12:53.557655+0000 mgr.smithi006.kskdce (mgr.14664) 71 : cephadm [INF] Deploying daemon prometheus.smithi134 on smithi134 2024-03-12T16:12:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:53.314817+0000 mgr.smithi006.kskdce (mgr.14664) 70 : cephadm [INF] Upgrade: Updating prometheus.smithi134 2024-03-12T16:12:54.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:12:53.557655+0000 mgr.smithi006.kskdce (mgr.14664) 71 : cephadm [INF] Deploying daemon prometheus.smithi134 on smithi134 2024-03-12T16:12:55.413 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:55.081206+0000 mgr.smithi006.kskdce (mgr.14664) 72 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:12:55.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:55.081206+0000 mgr.smithi006.kskdce (mgr.14664) 72 : cluster [DBG] pgmap v35: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:12:57.439 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:12:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:57.081626+0000 mgr.smithi006.kskdce (mgr.14664) 73 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:12:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:12:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:57.081626+0000 mgr.smithi006.kskdce (mgr.14664) 73 : cluster [DBG] pgmap v36: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:13:00.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:59.042542+0000 mon.smithi006 (mon.0) 838 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:00.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:59.048107+0000 mon.smithi006 (mon.0) 839 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:00.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:12:59.082080+0000 mgr.smithi006.kskdce (mgr.14664) 74 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:13:00.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:12:59.091005+0000 mon.smithi134 (mon.1) 84 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:59.042542+0000 mon.smithi006 (mon.0) 838 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:59.048107+0000 mon.smithi006 (mon.0) 839 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:12:59.082080+0000 mgr.smithi006.kskdce (mgr.14664) 74 : cluster [DBG] pgmap v37: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 85 B/s rd, 341 B/s wr, 0 op/s 2024-03-12T16:13:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:12:59.091005+0000 mon.smithi134 (mon.1) 84 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:01.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:01.082527+0000 mgr.smithi006.kskdce (mgr.14664) 75 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:01.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:01.082527+0000 mgr.smithi006.kskdce (mgr.14664) 75 : cluster [DBG] pgmap v38: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:02.774810+0000 mon.smithi006 (mon.0) 840 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:02.781072+0000 mon.smithi006 (mon.0) 841 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:03.083118+0000 mgr.smithi006.kskdce (mgr.14664) 76 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:03.418740+0000 mon.smithi006 (mon.0) 842 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:03.426513+0000 mon.smithi006 (mon.0) 843 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:02.774810+0000 mon.smithi006 (mon.0) 840 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:02.781072+0000 mon.smithi006 (mon.0) 841 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:03.083118+0000 mgr.smithi006.kskdce (mgr.14664) 76 : cluster [DBG] pgmap v39: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:03.418740+0000 mon.smithi006 (mon.0) 842 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:03.426513+0000 mon.smithi006 (mon.0) 843 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:05.407 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:05.083643+0000 mgr.smithi006.kskdce (mgr.14664) 77 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:05.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:05.083643+0000 mgr.smithi006.kskdce (mgr.14664) 77 : cluster [DBG] pgmap v40: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:06.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:06.173332+0000 mon.smithi134 (mon.1) 85 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:13:06.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:06.173332+0000 mon.smithi134 (mon.1) 85 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:13:08.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:06.856357+0000 mon.smithi006 (mon.0) 844 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:08.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:06.863339+0000 mon.smithi006 (mon.0) 845 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:08.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:06.864692+0000 mon.smithi134 (mon.1) 86 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:08.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:06.865676+0000 mon.smithi134 (mon.1) 87 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:08.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:06.871301+0000 mon.smithi006 (mon.0) 846 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:08.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.009031+0000 mon.smithi134 (mon.1) 88 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:13:08.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.009914+0000 mgr.smithi006.kskdce (mgr.14664) 78 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:13:08.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.015662+0000 mon.smithi134 (mon.1) 89 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:08.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.019786+0000 mon.smithi134 (mon.1) 90 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.022750+0000 mon.smithi134 (mon.1) 91 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.023958+0000 mon.smithi134 (mon.1) 92 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.025107+0000 mon.smithi134 (mon.1) 93 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.026228+0000 mon.smithi134 (mon.1) 94 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.027345+0000 mon.smithi134 (mon.1) 95 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.028501+0000 mon.smithi134 (mon.1) 96 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.029797+0000 mon.smithi134 (mon.1) 97 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.031327+0000 mon.smithi134 (mon.1) 98 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:07.032659+0000 mon.smithi134 (mon.1) 99 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:07.083991+0000 mgr.smithi006.kskdce (mgr.14664) 79 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:06.856357+0000 mon.smithi006 (mon.0) 844 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:06.863339+0000 mon.smithi006 (mon.0) 845 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:06.864692+0000 mon.smithi134 (mon.1) 86 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:06.865676+0000 mon.smithi134 (mon.1) 87 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:06.871301+0000 mon.smithi006 (mon.0) 846 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.009031+0000 mon.smithi134 (mon.1) 88 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.009914+0000 mgr.smithi006.kskdce (mgr.14664) 78 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.015662+0000 mon.smithi134 (mon.1) 89 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.019786+0000 mon.smithi134 (mon.1) 90 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.022750+0000 mon.smithi134 (mon.1) 91 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.023958+0000 mon.smithi134 (mon.1) 92 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.025107+0000 mon.smithi134 (mon.1) 93 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.026228+0000 mon.smithi134 (mon.1) 94 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.027345+0000 mon.smithi134 (mon.1) 95 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.028501+0000 mon.smithi134 (mon.1) 96 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.029797+0000 mon.smithi134 (mon.1) 97 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.031327+0000 mon.smithi134 (mon.1) 98 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:07.032659+0000 mon.smithi134 (mon.1) 99 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:08.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:07.083991+0000 mgr.smithi006.kskdce (mgr.14664) 79 : cluster [DBG] pgmap v41: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:09.401 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:13:08.700484+0000 mgr.smithi006.kskdce (mgr.14664) 80 : cephadm [INF] Upgrade: Updating alertmanager.smithi006 2024-03-12T16:13:09.401 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:13:08.706796+0000 mgr.smithi006.kskdce (mgr.14664) 81 : cephadm [INF] Deploying daemon alertmanager.smithi006 on smithi006 2024-03-12T16:13:09.401 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:09.084644+0000 mgr.smithi006.kskdce (mgr.14664) 82 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:13:08.700484+0000 mgr.smithi006.kskdce (mgr.14664) 80 : cephadm [INF] Upgrade: Updating alertmanager.smithi006 2024-03-12T16:13:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:13:08.706796+0000 mgr.smithi006.kskdce (mgr.14664) 81 : cephadm [INF] Deploying daemon alertmanager.smithi006 on smithi006 2024-03-12T16:13:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:09.084644+0000 mgr.smithi006.kskdce (mgr.14664) 82 : cluster [DBG] pgmap v42: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:10.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.243+0000 7fe447e89700 1 -- 172.21.15.6:0/3621601335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4400fa950 msgr2=0x7fe4400fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.243+0000 7fe447e89700 1 --2- 172.21.15.6:0/3621601335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4400fa950 0x7fe4400fcda0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fe4300047f0 tx=0x7fe430009cb0).stop 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.243+0000 7fe447e89700 1 -- 172.21.15.6:0/3621601335 shutdown_connections 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.243+0000 7fe447e89700 1 --2- 172.21.15.6:0/3621601335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4400fa950 0x7fe4400fcda0 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.243+0000 7fe447e89700 1 --2- 172.21.15.6:0/3621601335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe440061280 0x7fe4400fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.243+0000 7fe447e89700 1 -- 172.21.15.6:0/3621601335 >> 172.21.15.6:0/3621601335 conn(0x7fe4400f1e50 msgr2=0x7fe4400f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.243+0000 7fe447e89700 1 -- 172.21.15.6:0/3621601335 shutdown_connections 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.243+0000 7fe447e89700 1 -- 172.21.15.6:0/3621601335 wait complete. 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe447e89700 1 Processor -- start 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe447e89700 1 -- start start 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe447e89700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe440061280 0x7fe4400f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe447e89700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4400fa950 0x7fe4400f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:10.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe447e89700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400f8220 con 0x7fe440061280 2024-03-12T16:13:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe447e89700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe4400f67c0 con 0x7fe4400fa950 2024-03-12T16:13:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe445c25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe440061280 0x7fe4400f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe445c25700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe440061280 0x7fe4400f7c70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54088/0 (socket says 172.21.15.6:54088) 2024-03-12T16:13:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe445c25700 1 -- 172.21.15.6:0/2851474967 learned_addr learned my addr 172.21.15.6:0/2851474967 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe445424700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4400fa950 0x7fe4400f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe445c25700 1 -- 172.21.15.6:0/2851474967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4400fa950 msgr2=0x7fe4400f62d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe445c25700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4400fa950 0x7fe4400f62d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.244+0000 7fe445c25700 1 -- 172.21.15.6:0/2851474967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe430005040 con 0x7fe440061280 2024-03-12T16:13:10.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.245+0000 7fe445c25700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe440061280 0x7fe4400f7c70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fe43c0041d0 tx=0x7fe43c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.245+0000 7fe436ffd700 1 -- 172.21.15.6:0/2851474967 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe43c007b40 con 0x7fe440061280 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.245+0000 7fe436ffd700 1 -- 172.21.15.6:0/2851474967 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe43c00f040 con 0x7fe440061280 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.245+0000 7fe436ffd700 1 -- 172.21.15.6:0/2851474967 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe43c0147b0 con 0x7fe440061280 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.245+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe4400f6a40 con 0x7fe440061280 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.245+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe4400f7000 con 0x7fe440061280 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.246+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe4400fffb0 con 0x7fe440061280 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.246+0000 7fe436ffd700 1 -- 172.21.15.6:0/2851474967 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7fe43c009110 con 0x7fe440061280 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.247+0000 7fe436ffd700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe42c06c7c0 0x7fe42c06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.247+0000 7fe436ffd700 1 -- 172.21.15.6:0/2851474967 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fe43c08b930 con 0x7fe440061280 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.247+0000 7fe445424700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe42c06c7c0 0x7fe42c06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:10.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.247+0000 7fe445424700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe42c06c7c0 0x7fe42c06ec80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe430004f10 tx=0x7fe43000b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:10.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.252+0000 7fe436ffd700 1 -- 172.21.15.6:0/2851474967 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fe43c059810 con 0x7fe440061280 2024-03-12T16:13:10.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.471+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe440059120 con 0x7fe42c06c7c0 2024-03-12T16:13:10.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.472+0000 7fe436ffd700 1 -- 172.21.15.6:0/2851474967 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fe440059120 con 0x7fe42c06c7c0 2024-03-12T16:13:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe42c06c7c0 msgr2=0x7fe42c06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe42c06c7c0 0x7fe42c06ec80 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fe430004f10 tx=0x7fe43000b040).stop 2024-03-12T16:13:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe440061280 msgr2=0x7fe4400f7c70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe440061280 0x7fe4400f7c70 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7fe43c0041d0 tx=0x7fe43c009f60).stop 2024-03-12T16:13:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 shutdown_connections 2024-03-12T16:13:10.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe42c06c7c0 0x7fe42c06ec80 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe440061280 0x7fe4400f7c70 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 --2- 172.21.15.6:0/2851474967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4400fa950 0x7fe4400f62d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 >> 172.21.15.6:0/2851474967 conn(0x7fe4400f1e50 msgr2=0x7fe4400f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:10.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 shutdown_connections 2024-03-12T16:13:10.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.474+0000 7fe447e89700 1 -- 172.21.15.6:0/2851474967 wait complete. 2024-03-12T16:13:10.485 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:13:10.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.587+0000 7f65f2ea8700 1 -- 172.21.15.6:0/639991719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f7a10 msgr2=0x7f65ec0f7e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.587+0000 7f65f2ea8700 1 --2- 172.21.15.6:0/639991719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f7a10 0x7f65ec0f7e30 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f65e00047f0 tx=0x7f65e0009cb0).stop 2024-03-12T16:13:10.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.587+0000 7f65f2ea8700 1 -- 172.21.15.6:0/639991719 shutdown_connections 2024-03-12T16:13:10.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.587+0000 7f65f2ea8700 1 --2- 172.21.15.6:0/639991719 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65ec0f8cb0 0x7f65ec0f9110 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.587+0000 7f65f2ea8700 1 --2- 172.21.15.6:0/639991719 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f7a10 0x7f65ec0f7e30 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.587+0000 7f65f2ea8700 1 -- 172.21.15.6:0/639991719 >> 172.21.15.6:0/639991719 conn(0x7f65ec0f3150 msgr2=0x7f65ec0f5590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:10.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.587+0000 7f65f2ea8700 1 -- 172.21.15.6:0/639991719 shutdown_connections 2024-03-12T16:13:10.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.587+0000 7f65f2ea8700 1 -- 172.21.15.6:0/639991719 wait complete. 2024-03-12T16:13:10.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.587+0000 7f65f2ea8700 1 Processor -- start 2024-03-12T16:13:10.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65f2ea8700 1 -- start start 2024-03-12T16:13:10.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65f2ea8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65ec0f7a10 0x7f65ec108190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65f2ea8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f8cb0 0x7f65ec108680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65f2ea8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec108c30 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65f2ea8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f65ec108d70 con 0x7f65ec0f7a10 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f8cb0 0x7f65ec108680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65ebfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f8cb0 0x7f65ec108680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54120/0 (socket says 172.21.15.6:54120) 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65ebfff700 1 -- 172.21.15.6:0/604608672 learned_addr learned my addr 172.21.15.6:0/604608672 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65f0c44700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65ec0f7a10 0x7f65ec108190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65ebfff700 1 -- 172.21.15.6:0/604608672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65ec0f7a10 msgr2=0x7f65ec108190 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65ebfff700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65ec0f7a10 0x7f65ec108190 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65ebfff700 1 -- 172.21.15.6:0/604608672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f65e0005040 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65ebfff700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f8cb0 0x7f65ec108680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f65d80041d0 tx=0x7f65d8009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.588+0000 7f65e9ffb700 1 -- 172.21.15.6:0/604608672 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d8002d90 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.589+0000 7f65e9ffb700 1 -- 172.21.15.6:0/604608672 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f65d800f040 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.589+0000 7f65e9ffb700 1 -- 172.21.15.6:0/604608672 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f65d800d800 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.589+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f65ec10d810 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.589+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f65ec10ddd0 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.590+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f65ec05fb50 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.590+0000 7f65e9ffb700 1 -- 172.21.15.6:0/604608672 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f65d800da70 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.591+0000 7f65e9ffb700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f65dc06c7c0 0x7f65dc06ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.591+0000 7f65e9ffb700 1 -- 172.21.15.6:0/604608672 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f65d808b9b0 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.591+0000 7f65f0c44700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f65dc06c7c0 0x7f65dc06ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:10.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.591+0000 7f65f0c44700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f65dc06c7c0 0x7f65dc06ec80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f65e0004f10 tx=0x7f65e000b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:10.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.595+0000 7f65e9ffb700 1 -- 172.21.15.6:0/604608672 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f65d8059890 con 0x7f65ec0f8cb0 2024-03-12T16:13:10.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.813+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f65ec1021c0 con 0x7f65dc06c7c0 2024-03-12T16:13:10.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.814+0000 7f65e9ffb700 1 -- 172.21.15.6:0/604608672 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7f65ec1021c0 con 0x7f65dc06c7c0 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.816+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f65dc06c7c0 msgr2=0x7f65dc06ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.816+0000 7f65f2ea8700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f65dc06c7c0 0x7f65dc06ec80 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7f65e0004f10 tx=0x7f65e000b040).stop 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.816+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f8cb0 msgr2=0x7f65ec108680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.816+0000 7f65f2ea8700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f8cb0 0x7f65ec108680 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f65d80041d0 tx=0x7f65d8009f60).stop 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.817+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 shutdown_connections 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.817+0000 7f65f2ea8700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f65dc06c7c0 0x7f65dc06ec80 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.817+0000 7f65f2ea8700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f65ec0f7a10 0x7f65ec108190 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.817+0000 7f65f2ea8700 1 --2- 172.21.15.6:0/604608672 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f65ec0f8cb0 0x7f65ec108680 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.817+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 >> 172.21.15.6:0/604608672 conn(0x7f65ec0f3150 msgr2=0x7f65ec0fc700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.817+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 shutdown_connections 2024-03-12T16:13:10.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.817+0000 7f65f2ea8700 1 -- 172.21.15.6:0/604608672 wait complete. 2024-03-12T16:13:10.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.919+0000 7f1c7278d700 1 -- 172.21.15.6:0/1824474819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 msgr2=0x7f1c6c0f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.919+0000 7f1c7278d700 1 --2- 172.21.15.6:0/1824474819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 0x7f1c6c0f6b10 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f1c5c0047f0 tx=0x7f1c5c009cb0).stop 2024-03-12T16:13:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.919+0000 7f1c7278d700 1 -- 172.21.15.6:0/1824474819 shutdown_connections 2024-03-12T16:13:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.919+0000 7f1c7278d700 1 --2- 172.21.15.6:0/1824474819 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c6c0f7990 0x7f1c6c0f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:13:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.919+0000 7f1c7278d700 1 --2- 172.21.15.6:0/1824474819 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 0x7f1c6c0f6b10 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.919+0000 7f1c7278d700 1 -- 172.21.15.6:0/1824474819 >> 172.21.15.6:0/1824474819 conn(0x7f1c6c0f1e50 msgr2=0x7f1c6c0f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.919+0000 7f1c7278d700 1 -- 172.21.15.6:0/1824474819 shutdown_connections 2024-03-12T16:13:10.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.919+0000 7f1c7278d700 1 -- 172.21.15.6:0/1824474819 wait complete. 2024-03-12T16:13:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.920+0000 7f1c7278d700 1 Processor -- start 2024-03-12T16:13:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.920+0000 7f1c7278d700 1 -- start start 2024-03-12T16:13:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.920+0000 7f1c7278d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 0x7f1c6c061040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.920+0000 7f1c7278d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c6c0f7990 0x7f1c6c10ce00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.920+0000 7f1c7278d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c10d2f0 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.920+0000 7f1c7278d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c6c10d430 con 0x7f1c6c0f7990 2024-03-12T16:13:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 0x7f1c6c061040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 0x7f1c6c061040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54146/0 (socket says 172.21.15.6:54146) 2024-03-12T16:13:10.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c6bfff700 1 -- 172.21.15.6:0/4013100231 learned_addr learned my addr 172.21.15.6:0/4013100231 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c6bfff700 1 -- 172.21.15.6:0/4013100231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c6c0f7990 msgr2=0x7f1c6c10ce00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c6b7fe700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c6c0f7990 0x7f1c6c10ce00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c6bfff700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c6c0f7990 0x7f1c6c10ce00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c6bfff700 1 -- 172.21.15.6:0/4013100231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1c5c005040 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c6bfff700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 0x7f1c6c061040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f1c5c00b120 tx=0x7f1c5c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c697fa700 1 -- 172.21.15.6:0/4013100231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c5c00e030 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c697fa700 1 -- 172.21.15.6:0/4013100231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c5c007e90 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c6c10d6b0 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c697fa700 1 -- 172.21.15.6:0/4013100231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c5c018070 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.924 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.921+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c6c10db90 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.923+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c6c0fef30 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.923+0000 7f1c697fa700 1 -- 172.21.15.6:0/4013100231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f1c5c01d960 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.924+0000 7f1c697fa700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1c5406c7c0 0x7f1c5406ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.924+0000 7f1c697fa700 1 -- 172.21.15.6:0/4013100231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f1c5c08c680 con 0x7f1c6c0f66f0 2024-03-12T16:13:10.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.924+0000 7f1c6b7fe700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1c5406c7c0 0x7f1c5406ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:10.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.924+0000 7f1c6b7fe700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1c5406c7c0 0x7f1c5406ec80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1c6000a880 tx=0x7f1c60008040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:10.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:10.929+0000 7f1c697fa700 1 -- 172.21.15.6:0/4013100231 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f1c5c05a4d0 con 0x7f1c6c0f66f0 2024-03-12T16:13:11.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.137+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f1c6c059120 con 0x7f1c5406c7c0 2024-03-12T16:13:11.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.148+0000 7f1c697fa700 1 -- 172.21.15.6:0/4013100231 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f1c6c059120 con 0x7f1c5406c7c0 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (2m) 23s ago 11m 24.0M - 0.23.0 ba2b418f427c 1cba788dfc1b 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (10m) 23s ago 10m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (10m) 8s ago 10m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (2m) 23s ago 10m 45.7M - 8.3.5 dad864ee21e9 9e2a73f49bcc 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (5m) 23s ago 5m 125M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (5m) 23s ago 5m 14.1M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (5m) 8s ago 5m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (5m) 8s ago 5m 16.9M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (92s) 23s ago 12m 493M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:13:11.149 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (51s) 8s ago 10m 446M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (12m) 23s ago 12m 54.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (10m) 8s ago 10m 48.4M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (36s) 23s ago 10m 8014k - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (30s) 8s ago 9m 7960k - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (9m) 23s ago 9m 217M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (9m) 23s ago 9m 235M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (8m) 23s ago 8m 194M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (8m) 8s ago 8m 264M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (7m) 8s ago 7m 236M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (7m) 8s ago 7m 226M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:13:11.150 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (12s) 8s ago 9m 35.6M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:13:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1c5406c7c0 msgr2=0x7f1c5406ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1c5406c7c0 0x7f1c5406ec80 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7f1c6000a880 tx=0x7f1c60008040).stop 2024-03-12T16:13:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 msgr2=0x7f1c6c061040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 0x7f1c6c061040 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f1c5c00b120 tx=0x7f1c5c009cb0).stop 2024-03-12T16:13:11.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 shutdown_connections 2024-03-12T16:13:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1c5406c7c0 0x7f1c5406ec80 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c6c0f66f0 0x7f1c6c061040 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 --2- 172.21.15.6:0/4013100231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c6c0f7990 0x7f1c6c10ce00 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 >> 172.21.15.6:0/4013100231 conn(0x7f1c6c0f1e50 msgr2=0x7f1c6c0fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 shutdown_connections 2024-03-12T16:13:11.152 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.150+0000 7f1c7278d700 1 -- 172.21.15.6:0/4013100231 wait complete. 2024-03-12T16:13:11.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.252+0000 7f289b77d700 1 -- 172.21.15.6:0/3908600797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 msgr2=0x7f28940f5f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.252+0000 7f289b77d700 1 --2- 172.21.15.6:0/3908600797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 0x7f28940f5f10 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f28880047f0 tx=0x7f2888009cb0).stop 2024-03-12T16:13:11.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.252+0000 7f289b77d700 1 -- 172.21.15.6:0/3908600797 shutdown_connections 2024-03-12T16:13:11.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.252+0000 7f289b77d700 1 --2- 172.21.15.6:0/3908600797 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28940f6490 0x7f28940f8c10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.252+0000 7f289b77d700 1 --2- 172.21.15.6:0/3908600797 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 0x7f28940f5f10 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.252+0000 7f289b77d700 1 -- 172.21.15.6:0/3908600797 >> 172.21.15.6:0/3908600797 conn(0x7f28940f1610 msgr2=0x7f28940f3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:11.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.252+0000 7f289b77d700 1 -- 172.21.15.6:0/3908600797 shutdown_connections 2024-03-12T16:13:11.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.252+0000 7f289b77d700 1 -- 172.21.15.6:0/3908600797 wait complete. 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f289b77d700 1 Processor -- start 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f289b77d700 1 -- start start 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f289b77d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 0x7f28940f84c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f289b77d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28940f6490 0x7f28940f6b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f289b77d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28940f8a70 con 0x7f28940f5af0 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f289b77d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f28940f7010 con 0x7f28940f6490 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f2899519700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 0x7f28940f84c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f2899519700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 0x7f28940f84c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54176/0 (socket says 172.21.15.6:54176) 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f2899519700 1 -- 172.21.15.6:0/1130708924 learned_addr learned my addr 172.21.15.6:0/1130708924 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f2898d18700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28940f6490 0x7f28940f6b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f2899519700 1 -- 172.21.15.6:0/1130708924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28940f6490 msgr2=0x7f28940f6b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f2899519700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28940f6490 0x7f28940f6b20 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.253+0000 7f2899519700 1 -- 172.21.15.6:0/1130708924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2888005040 con 0x7f28940f5af0 2024-03-12T16:13:11.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.254+0000 7f2899519700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 0x7f28940f84c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f2888009eb0 tx=0x7f2888009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:11.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.254+0000 7f28867fc700 1 -- 172.21.15.6:0/1130708924 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f288800e030 con 0x7f28940f5af0 2024-03-12T16:13:11.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.254+0000 7f28867fc700 1 -- 172.21.15.6:0/1130708924 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2888007e90 con 0x7f28940f5af0 2024-03-12T16:13:11.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.254+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f28940f7230 con 0x7f28940f5af0 2024-03-12T16:13:11.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.254+0000 7f28867fc700 1 -- 172.21.15.6:0/1130708924 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2888018070 con 0x7f28940f5af0 2024-03-12T16:13:11.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.254+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f28940f7790 con 0x7f28940f5af0 2024-03-12T16:13:11.257 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.255+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2894100040 con 0x7f28940f5af0 2024-03-12T16:13:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.255+0000 7f28867fc700 1 -- 172.21.15.6:0/1130708924 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7f288801d420 con 0x7f28940f5af0 2024-03-12T16:13:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.256+0000 7f28867fc700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f288006c760 0x7f288006ec20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.256+0000 7f28867fc700 1 -- 172.21.15.6:0/1130708924 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f288808cc30 con 0x7f28940f5af0 2024-03-12T16:13:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.256+0000 7f2898d18700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f288006c760 0x7f288006ec20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:11.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.256+0000 7f2898d18700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f288006c760 0x7f288006ec20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f28940f68d0 tx=0x7f289000b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:11.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.261+0000 7f28867fc700 1 -- 172.21.15.6:0/1130708924 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f288805ab10 con 0x7f28940f5af0 2024-03-12T16:13:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:10.472425+0000 mgr.smithi006.kskdce (mgr.14664) 83 : audit [DBG] from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:10.814938+0000 mgr.smithi006.kskdce (mgr.14664) 84 : audit [DBG] from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:11.084942+0000 mgr.smithi006.kskdce (mgr.14664) 85 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:10.472425+0000 mgr.smithi006.kskdce (mgr.14664) 83 : audit [DBG] from='client.14732 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:10.814938+0000 mgr.smithi006.kskdce (mgr.14664) 84 : audit [DBG] from='client.14736 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:11.084942+0000 mgr.smithi006.kskdce (mgr.14664) 85 : cluster [DBG] pgmap v43: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:11.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.540+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2894101eb0 con 0x7f28940f5af0 2024-03-12T16:13:11.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.541+0000 7f28867fc700 1 -- 172.21.15.6:0/1130708924 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7f288805a6a0 con 0x7f28940f5af0 2024-03-12T16:13:11.542 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 12, 2024-03-12T16:13:11.543 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:13:11.544 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:13:11.544 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:13:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f288006c760 msgr2=0x7f288006ec20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f288006c760 0x7f288006ec20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7f28940f68d0 tx=0x7f289000b040).stop 2024-03-12T16:13:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 msgr2=0x7f28940f84c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 0x7f28940f84c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f2888009eb0 tx=0x7f2888009cb0).stop 2024-03-12T16:13:11.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 shutdown_connections 2024-03-12T16:13:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f288006c760 0x7f288006ec20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f28940f5af0 0x7f28940f84c0 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 --2- 172.21.15.6:0/1130708924 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f28940f6490 0x7f28940f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 >> 172.21.15.6:0/1130708924 conn(0x7f28940f1610 msgr2=0x7f28940fc660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 shutdown_connections 2024-03-12T16:13:11.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.543+0000 7f289b77d700 1 -- 172.21.15.6:0/1130708924 wait complete. 2024-03-12T16:13:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.647+0000 7fea3e35d700 1 -- 172.21.15.6:0/2547423879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 msgr2=0x7fea380fcda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.647+0000 7fea3e35d700 1 --2- 172.21.15.6:0/2547423879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 0x7fea380fcda0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fea2c0047f0 tx=0x7fea2c009cb0).stop 2024-03-12T16:13:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.647+0000 7fea3e35d700 1 -- 172.21.15.6:0/2547423879 shutdown_connections 2024-03-12T16:13:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.647+0000 7fea3e35d700 1 --2- 172.21.15.6:0/2547423879 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 0x7fea380fcda0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.647+0000 7fea3e35d700 1 --2- 172.21.15.6:0/2547423879 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea38061280 0x7fea380fa3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:13:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.647+0000 7fea3e35d700 1 -- 172.21.15.6:0/2547423879 >> 172.21.15.6:0/2547423879 conn(0x7fea380f1e50 msgr2=0x7fea380f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.647+0000 7fea3e35d700 1 -- 172.21.15.6:0/2547423879 shutdown_connections 2024-03-12T16:13:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.647+0000 7fea3e35d700 1 -- 172.21.15.6:0/2547423879 wait complete. 2024-03-12T16:13:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.647+0000 7fea3e35d700 1 Processor -- start 2024-03-12T16:13:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea3e35d700 1 -- start start 2024-03-12T16:13:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea3e35d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea38061280 0x7fea380f7c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea3e35d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 0x7fea380f62d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea3e35d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380f67c0 con 0x7fea380fa950 2024-03-12T16:13:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea3e35d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fea380f6900 con 0x7fea38061280 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea377fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 0x7fea380f62d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea377fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 0x7fea380f62d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54182/0 (socket says 172.21.15.6:54182) 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea377fe700 1 -- 172.21.15.6:0/3371289661 learned_addr learned my addr 172.21.15.6:0/3371289661 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea37fff700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea38061280 0x7fea380f7c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea377fe700 1 -- 172.21.15.6:0/3371289661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea38061280 msgr2=0x7fea380f7c70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea377fe700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea38061280 0x7fea380f7c70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.648+0000 7fea377fe700 1 -- 172.21.15.6:0/3371289661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fea2c005040 con 0x7fea380fa950 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.649+0000 7fea377fe700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 0x7fea380f62d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fea2c00b120 tx=0x7fea2c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.649+0000 7fea357fa700 1 -- 172.21.15.6:0/3371289661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea2c00e030 con 0x7fea380fa950 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.649+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fea380f6b80 con 0x7fea380fa950 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.649+0000 7fea357fa700 1 -- 172.21.15.6:0/3371289661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fea2c007e90 con 0x7fea380fa950 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.649+0000 7fea357fa700 1 -- 172.21.15.6:0/3371289661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fea2c018070 con 0x7fea380fa950 2024-03-12T16:13:11.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.649+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fea380f7060 con 0x7fea380fa950 2024-03-12T16:13:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.650+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fea38100030 con 0x7fea380fa950 2024-03-12T16:13:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.650+0000 7fea357fa700 1 -- 172.21.15.6:0/3371289661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 32) v1 ==== 90777+0+0 (secure 0 0 0) 0x7fea2c01d420 con 0x7fea380fa950 2024-03-12T16:13:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.651+0000 7fea357fa700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fea2006c7c0 0x7fea2006ec80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.651+0000 7fea357fa700 1 -- 172.21.15.6:0/3371289661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fea2c08ceb0 con 0x7fea380fa950 2024-03-12T16:13:11.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.651+0000 7fea37fff700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fea2006c7c0 0x7fea2006ec80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:11.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.651+0000 7fea37fff700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fea2006c7c0 0x7fea2006ec80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fea28006fd0 tx=0x7fea28009060).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:11.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.655+0000 7fea357fa700 1 -- 172.21.15.6:0/3371289661 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fea2c05ad90 con 0x7fea380fa950 2024-03-12T16:13:11.872 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.871+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fea38059120 con 0x7fea2006c7c0 2024-03-12T16:13:11.873 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.872+0000 7fea357fa700 1 -- 172.21.15.6:0/3371289661 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+369 (secure 0 0 0) 0x7fea38059120 con 0x7fea2006c7c0 2024-03-12T16:13:11.873 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:13:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:13:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:13:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-03-12T16:13:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:13:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr" 2024-03-12T16:13:11.873 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:13:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "2/2 daemons upgraded", 2024-03-12T16:13:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading alertmanager daemons", 2024-03-12T16:13:11.874 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:13:11.874 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:13:11.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fea2006c7c0 msgr2=0x7fea2006ec80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fea2006c7c0 0x7fea2006ec80 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7fea28006fd0 tx=0x7fea28009060).stop 2024-03-12T16:13:11.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 msgr2=0x7fea380f62d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:11.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 0x7fea380f62d0 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fea2c00b120 tx=0x7fea2c009cb0).stop 2024-03-12T16:13:11.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 shutdown_connections 2024-03-12T16:13:11.875 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fea2006c7c0 0x7fea2006ec80 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fea38061280 0x7fea380f7c70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 --2- 172.21.15.6:0/3371289661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fea380fa950 0x7fea380f62d0 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:11.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 >> 172.21.15.6:0/3371289661 conn(0x7fea380f1e50 msgr2=0x7fea380f4240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:11.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 shutdown_connections 2024-03-12T16:13:11.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:11.874+0000 7fea3e35d700 1 -- 172.21.15.6:0/3371289661 wait complete. 2024-03-12T16:13:12.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:12 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:11.139090+0000 mgr.smithi006.kskdce (mgr.14664) 86 : audit [DBG] from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:12.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:12 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:11.541307+0000 mon.smithi006 (mon.0) 847 : audit [DBG] from='client.? 172.21.15.6:0/1130708924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:12.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:12 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:11.872363+0000 mgr.smithi006.kskdce (mgr.14664) 87 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:12.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:11.139090+0000 mgr.smithi006.kskdce (mgr.14664) 86 : audit [DBG] from='client.14740 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:12.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:11.541307+0000 mon.smithi006 (mon.0) 847 : audit [DBG] from='client.? 172.21.15.6:0/1130708924' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:12.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:12 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:11.872363+0000 mgr.smithi006.kskdce (mgr.14664) 87 : audit [DBG] from='client.14748 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:13.085487+0000 mgr.smithi006.kskdce (mgr.14664) 88 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:13.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:13.085487+0000 mgr.smithi006.kskdce (mgr.14664) 88 : cluster [DBG] pgmap v44: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:14.626045+0000 mon.smithi006 (mon.0) 848 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:14.632098+0000 mon.smithi006 (mon.0) 849 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:14.683186+0000 mon.smithi134 (mon.1) 100 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:15.085774+0000 mgr.smithi006.kskdce (mgr.14664) 89 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:15.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:14.626045+0000 mon.smithi006 (mon.0) 848 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:15.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:14.632098+0000 mon.smithi006 (mon.0) 849 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:15.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:14.683186+0000 mon.smithi134 (mon.1) 100 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:15.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:15.085774+0000 mgr.smithi006.kskdce (mgr.14664) 89 : cluster [DBG] pgmap v45: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:17.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:17.086127+0000 mgr.smithi006.kskdce (mgr.14664) 90 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:17.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:17 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:17.086127+0000 mgr.smithi006.kskdce (mgr.14664) 90 : cluster [DBG] pgmap v46: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:19.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:18.414136+0000 mon.smithi006 (mon.0) 850 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:19.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:18.420274+0000 mon.smithi006 (mon.0) 851 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:19.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:19.086799+0000 mgr.smithi006.kskdce (mgr.14664) 91 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:18.414136+0000 mon.smithi006 (mon.0) 850 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:18.420274+0000 mon.smithi006 (mon.0) 851 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:19.086799+0000 mgr.smithi006.kskdce (mgr.14664) 91 : cluster [DBG] pgmap v47: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:20.734 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:19.468530+0000 mon.smithi006 (mon.0) 852 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:20.734 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:19.476309+0000 mon.smithi006 (mon.0) 853 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:20.734 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:20.166631+0000 mon.smithi006 (mon.0) 854 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:20.734 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:20.172409+0000 mon.smithi006 (mon.0) 855 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:20.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:19.468530+0000 mon.smithi006 (mon.0) 852 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:20.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:19.476309+0000 mon.smithi006 (mon.0) 853 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:20.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:20.166631+0000 mon.smithi006 (mon.0) 854 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:20.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:20.172409+0000 mon.smithi006 (mon.0) 855 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:21.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:21.087307+0000 mgr.smithi006.kskdce (mgr.14664) 92 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:21.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:21.173416+0000 mon.smithi134 (mon.1) 101 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:13:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:21.087307+0000 mgr.smithi006.kskdce (mgr.14664) 92 : cluster [DBG] pgmap v48: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:21.173416+0000 mon.smithi134 (mon.1) 101 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:13:24.246 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:22.990730+0000 mon.smithi006 (mon.0) 856 : cluster [DBG] mgrmap e33: smithi006.kskdce(active, since 91s), standbys: smithi134.gcntfu 2024-03-12T16:13:24.246 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:23.087844+0000 mgr.smithi006.kskdce (mgr.14664) 93 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.600021+0000 mon.smithi006 (mon.0) 857 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.606666+0000 mon.smithi006 (mon.0) 858 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.607955+0000 mon.smithi134 (mon.1) 102 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.608888+0000 mon.smithi134 (mon.1) 103 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.614114+0000 mon.smithi006 (mon.0) 859 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.750465+0000 mon.smithi134 (mon.1) 104 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.757462+0000 mon.smithi134 (mon.1) 105 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.762265+0000 mon.smithi134 (mon.1) 106 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.764926+0000 mon.smithi134 (mon.1) 107 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.766246+0000 mon.smithi134 (mon.1) 108 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.767343+0000 mon.smithi134 (mon.1) 109 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.768557+0000 mon.smithi134 (mon.1) 110 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.769980+0000 mon.smithi134 (mon.1) 111 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.247 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.771148+0000 mon.smithi134 (mon.1) 112 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.248 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.772278+0000 mon.smithi134 (mon.1) 113 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.248 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.773700+0000 mon.smithi134 (mon.1) 114 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.248 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.775266+0000 mon.smithi134 (mon.1) 115 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.248 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:23 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.776604+0000 mon.smithi134 (mon.1) 116 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:22.990730+0000 mon.smithi006 (mon.0) 856 : cluster [DBG] mgrmap e33: smithi006.kskdce(active, since 91s), standbys: smithi134.gcntfu 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:23.087844+0000 mgr.smithi006.kskdce (mgr.14664) 93 : cluster [DBG] pgmap v49: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.600021+0000 mon.smithi006 (mon.0) 857 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.606666+0000 mon.smithi006 (mon.0) 858 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.607955+0000 mon.smithi134 (mon.1) 102 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.608888+0000 mon.smithi134 (mon.1) 103 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.614114+0000 mon.smithi006 (mon.0) 859 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.750465+0000 mon.smithi134 (mon.1) 104 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.757462+0000 mon.smithi134 (mon.1) 105 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.762265+0000 mon.smithi134 (mon.1) 106 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.764926+0000 mon.smithi134 (mon.1) 107 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.766246+0000 mon.smithi134 (mon.1) 108 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.767343+0000 mon.smithi134 (mon.1) 109 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.768557+0000 mon.smithi134 (mon.1) 110 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.769980+0000 mon.smithi134 (mon.1) 111 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.771148+0000 mon.smithi134 (mon.1) 112 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.772278+0000 mon.smithi134 (mon.1) 113 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.773700+0000 mon.smithi134 (mon.1) 114 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.775266+0000 mon.smithi134 (mon.1) 115 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:24.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.776604+0000 mon.smithi134 (mon.1) 116 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:25.315 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:24 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:23.751283+0000 mgr.smithi006.kskdce (mgr.14664) 94 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:13:25.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:23.751283+0000 mgr.smithi006.kskdce (mgr.14664) 94 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-03-12T16:13:26.089 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:25 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:25.088177+0000 mgr.smithi006.kskdce (mgr.14664) 95 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:26.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:25.088177+0000 mgr.smithi006.kskdce (mgr.14664) 95 : cluster [DBG] pgmap v50: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:13:25.344931+0000 mgr.smithi006.kskdce (mgr.14664) 96 : cephadm [INF] Upgrade: Updating grafana.smithi006 2024-03-12T16:13:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:26 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:13:25.358679+0000 mgr.smithi006.kskdce (mgr.14664) 97 : cephadm [INF] Deploying daemon grafana.smithi006 on smithi006 2024-03-12T16:13:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:13:25.344931+0000 mgr.smithi006.kskdce (mgr.14664) 96 : cephadm [INF] Upgrade: Updating grafana.smithi006 2024-03-12T16:13:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:13:25.358679+0000 mgr.smithi006.kskdce (mgr.14664) 97 : cephadm [INF] Deploying daemon grafana.smithi006 on smithi006 2024-03-12T16:13:28.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:28 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:27.088663+0000 mgr.smithi006.kskdce (mgr.14664) 98 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:28.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:27.088663+0000 mgr.smithi006.kskdce (mgr.14664) 98 : cluster [DBG] pgmap v51: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:29.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:29 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:29.089072+0000 mgr.smithi006.kskdce (mgr.14664) 99 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:29.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:29 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:29.089072+0000 mgr.smithi006.kskdce (mgr.14664) 99 : cluster [DBG] pgmap v52: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:31.148 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:30.056917+0000 mon.smithi006 (mon.0) 860 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:31.148 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:30.065064+0000 mon.smithi006 (mon.0) 861 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:31.148 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:31 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:30.082169+0000 mon.smithi134 (mon.1) 117 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:31.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:30.056917+0000 mon.smithi006 (mon.0) 860 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:31.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:30.065064+0000 mon.smithi006 (mon.0) 861 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:31.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:30.082169+0000 mon.smithi134 (mon.1) 117 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:32.409 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:32 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:31.089371+0000 mgr.smithi006.kskdce (mgr.14664) 100 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:32.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:31.089371+0000 mgr.smithi006.kskdce (mgr.14664) 100 : cluster [DBG] pgmap v53: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:33.424 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:33 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:33.090064+0000 mgr.smithi006.kskdce (mgr.14664) 101 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:33.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:33.090064+0000 mgr.smithi006.kskdce (mgr.14664) 101 : cluster [DBG] pgmap v54: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:13:36.031 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:34.765961+0000 mon.smithi006 (mon.0) 862 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:36.031 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:34.772325+0000 mon.smithi006 (mon.0) 863 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:36.031 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:35.090356+0000 mgr.smithi006.kskdce (mgr.14664) 102 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:36.031 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:35.460349+0000 mon.smithi006 (mon.0) 864 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:36.032 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:35.467162+0000 mon.smithi006 (mon.0) 865 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:34.765961+0000 mon.smithi006 (mon.0) 862 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:34.772325+0000 mon.smithi006 (mon.0) 863 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:35.090356+0000 mgr.smithi006.kskdce (mgr.14664) 102 : cluster [DBG] pgmap v55: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:35.460349+0000 mon.smithi006 (mon.0) 864 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:35.467162+0000 mon.smithi006 (mon.0) 865 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:36.940 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:36 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:36.174130+0000 mon.smithi134 (mon.1) 118 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:13:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:36.174130+0000 mon.smithi134 (mon.1) 118 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:13:38.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:37.090665+0000 mgr.smithi006.kskdce (mgr.14664) 103 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:37 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:37.090665+0000 mgr.smithi006.kskdce (mgr.14664) 103 : cluster [DBG] pgmap v56: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:40.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.745199+0000 mon.smithi006 (mon.0) 866 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.751484+0000 mon.smithi006 (mon.0) 867 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.753532+0000 mon.smithi134 (mon.1) 119 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.754741+0000 mon.smithi134 (mon.1) 120 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.760002+0000 mon.smithi006 (mon.0) 868 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.896352+0000 mon.smithi134 (mon.1) 121 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.896997+0000 mgr.smithi006.kskdce (mgr.14664) 104 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.902987+0000 mon.smithi134 (mon.1) 122 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.906674+0000 mon.smithi134 (mon.1) 123 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.909579+0000 mon.smithi134 (mon.1) 124 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.910863+0000 mon.smithi134 (mon.1) 125 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.912126+0000 mon.smithi134 (mon.1) 126 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.913238+0000 mon.smithi134 (mon.1) 127 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.914294+0000 mon.smithi134 (mon.1) 128 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.915484+0000 mon.smithi134 (mon.1) 129 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.916867+0000 mon.smithi134 (mon.1) 130 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.918325+0000 mon.smithi134 (mon.1) 131 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.919855+0000 mon.smithi134 (mon.1) 132 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.921331+0000 mon.smithi134 (mon.1) 133 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.922587+0000 mon.smithi134 (mon.1) 134 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.923858+0000 mon.smithi134 (mon.1) 135 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.925169+0000 mon.smithi134 (mon.1) 136 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:13:38.925943+0000 mgr.smithi006.kskdce (mgr.14664) 105 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.930733+0000 mon.smithi006 (mon.0) 869 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.932912+0000 mon.smithi134 (mon.1) 137 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.933413+0000 mon.smithi006 (mon.0) 870 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.939151+0000 mon.smithi006 (mon.0) 871 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.940073+0000 mon.smithi134 (mon.1) 138 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.940560+0000 mon.smithi006 (mon.0) 872 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.945892+0000 mon.smithi006 (mon.0) 873 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.946929+0000 mon.smithi134 (mon.1) 139 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.947371+0000 mon.smithi006 (mon.0) 874 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.947997+0000 mon.smithi134 (mon.1) 140 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.948428+0000 mon.smithi006 (mon.0) 875 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.949041+0000 mon.smithi134 (mon.1) 141 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.949481+0000 mon.smithi006 (mon.0) 876 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.950068+0000 mon.smithi134 (mon.1) 142 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.950529+0000 mon.smithi006 (mon.0) 877 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.955852+0000 mon.smithi006 (mon.0) 878 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.956753+0000 mon.smithi134 (mon.1) 143 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.957169+0000 mon.smithi006 (mon.0) 879 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.962513+0000 mon.smithi006 (mon.0) 880 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-12T16:13:40.207 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.963472+0000 mon.smithi134 (mon.1) 144 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.963927+0000 mon.smithi006 (mon.0) 881 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.964516+0000 mon.smithi134 (mon.1) 145 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.965032+0000 mon.smithi006 (mon.0) 882 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.970210+0000 mon.smithi006 (mon.0) 883 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.971013+0000 mon.smithi134 (mon.1) 146 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.971453+0000 mon.smithi006 (mon.0) 884 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.976783+0000 mon.smithi006 (mon.0) 885 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.977701+0000 mon.smithi134 (mon.1) 147 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.978155+0000 mon.smithi006 (mon.0) 886 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.983724+0000 mon.smithi006 (mon.0) 887 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.994940+0000 mon.smithi134 (mon.1) 148 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:38.995421+0000 mon.smithi006 (mon.0) 888 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.000860+0000 mon.smithi006 (mon.0) 889 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-12T16:13:40.208 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.001790+0000 mon.smithi134 (mon.1) 149 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.002228+0000 mon.smithi006 (mon.0) 890 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.002695+0000 mon.smithi134 (mon.1) 150 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.003122+0000 mon.smithi006 (mon.0) 891 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.003624+0000 mon.smithi134 (mon.1) 151 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.004049+0000 mon.smithi006 (mon.0) 892 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.004673+0000 mon.smithi134 (mon.1) 152 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.005238+0000 mon.smithi006 (mon.0) 893 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.005793+0000 mon.smithi134 (mon.1) 153 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.006193+0000 mon.smithi006 (mon.0) 894 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.006779+0000 mon.smithi134 (mon.1) 154 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.007292+0000 mon.smithi006 (mon.0) 895 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.007880+0000 mon.smithi134 (mon.1) 155 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.008308+0000 mon.smithi006 (mon.0) 896 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.013520+0000 mon.smithi006 (mon.0) 897 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:13:39.014208+0000 mgr.smithi006.kskdce (mgr.14664) 106 : cephadm [INF] Upgrade: Complete! 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.014398+0000 mon.smithi134 (mon.1) 156 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-12T16:13:40.209 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.014834+0000 mon.smithi006 (mon.0) 898 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.019083+0000 mon.smithi006 (mon.0) 899 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.019794+0000 mon.smithi134 (mon.1) 157 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.021298+0000 mon.smithi134 (mon.1) 158 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.021967+0000 mon.smithi134 (mon.1) 159 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.028548+0000 mon.smithi006 (mon.0) 900 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:39.091006+0000 mgr.smithi006.kskdce (mgr.14664) 107 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.165693+0000 mon.smithi134 (mon.1) 160 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.167286+0000 mon.smithi134 (mon.1) 161 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.167969+0000 mon.smithi134 (mon.1) 162 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:40.210 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:39.175263+0000 mon.smithi006 (mon.0) 901 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.211 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.745199+0000 mon.smithi006 (mon.0) 866 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.211 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.751484+0000 mon.smithi006 (mon.0) 867 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.211 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.753532+0000 mon.smithi134 (mon.1) 119 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:40.211 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.754741+0000 mon.smithi134 (mon.1) 120 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:40.211 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.760002+0000 mon.smithi006 (mon.0) 868 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.896352+0000 mon.smithi134 (mon.1) 121 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.896997+0000 mgr.smithi006.kskdce (mgr.14664) 104 : audit [DBG] from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.902987+0000 mon.smithi134 (mon.1) 122 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.906674+0000 mon.smithi134 (mon.1) 123 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.909579+0000 mon.smithi134 (mon.1) 124 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.910863+0000 mon.smithi134 (mon.1) 125 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.912126+0000 mon.smithi134 (mon.1) 126 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.913238+0000 mon.smithi134 (mon.1) 127 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.914294+0000 mon.smithi134 (mon.1) 128 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.915484+0000 mon.smithi134 (mon.1) 129 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.916867+0000 mon.smithi134 (mon.1) 130 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.918325+0000 mon.smithi134 (mon.1) 131 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.919855+0000 mon.smithi134 (mon.1) 132 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.212 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.921331+0000 mon.smithi134 (mon.1) 133 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.922587+0000 mon.smithi134 (mon.1) 134 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.923858+0000 mon.smithi134 (mon.1) 135 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.925169+0000 mon.smithi134 (mon.1) 136 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:13:38.925943+0000 mgr.smithi006.kskdce (mgr.14664) 105 : cephadm [INF] Upgrade: Finalizing container_image settings 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.930733+0000 mon.smithi006 (mon.0) 869 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.932912+0000 mon.smithi134 (mon.1) 137 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.933413+0000 mon.smithi006 (mon.0) 870 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.939151+0000 mon.smithi006 (mon.0) 871 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.940073+0000 mon.smithi134 (mon.1) 138 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.940560+0000 mon.smithi006 (mon.0) 872 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.945892+0000 mon.smithi006 (mon.0) 873 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.946929+0000 mon.smithi134 (mon.1) 139 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.947371+0000 mon.smithi006 (mon.0) 874 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.947997+0000 mon.smithi134 (mon.1) 140 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-12T16:13:40.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.948428+0000 mon.smithi006 (mon.0) 875 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.949041+0000 mon.smithi134 (mon.1) 141 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.949481+0000 mon.smithi006 (mon.0) 876 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.950068+0000 mon.smithi134 (mon.1) 142 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.950529+0000 mon.smithi006 (mon.0) 877 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.955852+0000 mon.smithi006 (mon.0) 878 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.956753+0000 mon.smithi134 (mon.1) 143 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.957169+0000 mon.smithi006 (mon.0) 879 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.962513+0000 mon.smithi006 (mon.0) 880 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.963472+0000 mon.smithi134 (mon.1) 144 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.963927+0000 mon.smithi006 (mon.0) 881 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.964516+0000 mon.smithi134 (mon.1) 145 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.965032+0000 mon.smithi006 (mon.0) 882 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.970210+0000 mon.smithi006 (mon.0) 883 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.971013+0000 mon.smithi134 (mon.1) 146 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-12T16:13:40.214 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.971453+0000 mon.smithi006 (mon.0) 884 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.976783+0000 mon.smithi006 (mon.0) 885 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.977701+0000 mon.smithi134 (mon.1) 147 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.978155+0000 mon.smithi006 (mon.0) 886 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.983724+0000 mon.smithi006 (mon.0) 887 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.994940+0000 mon.smithi134 (mon.1) 148 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:38.995421+0000 mon.smithi006 (mon.0) 888 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.000860+0000 mon.smithi006 (mon.0) 889 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.001790+0000 mon.smithi134 (mon.1) 149 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.002228+0000 mon.smithi006 (mon.0) 890 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.002695+0000 mon.smithi134 (mon.1) 150 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.003122+0000 mon.smithi006 (mon.0) 891 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.003624+0000 mon.smithi134 (mon.1) 151 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.004049+0000 mon.smithi006 (mon.0) 892 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.215 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.004673+0000 mon.smithi134 (mon.1) 152 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.005238+0000 mon.smithi006 (mon.0) 893 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.005793+0000 mon.smithi134 (mon.1) 153 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.006193+0000 mon.smithi006 (mon.0) 894 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.006779+0000 mon.smithi134 (mon.1) 154 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.007292+0000 mon.smithi006 (mon.0) 895 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.007880+0000 mon.smithi134 (mon.1) 155 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.008308+0000 mon.smithi006 (mon.0) 896 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.013520+0000 mon.smithi006 (mon.0) 897 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:13:39.014208+0000 mgr.smithi006.kskdce (mgr.14664) 106 : cephadm [INF] Upgrade: Complete! 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.014398+0000 mon.smithi134 (mon.1) 156 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.014834+0000 mon.smithi006 (mon.0) 898 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.019083+0000 mon.smithi006 (mon.0) 899 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.019794+0000 mon.smithi134 (mon.1) 157 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:40.216 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.021298+0000 mon.smithi134 (mon.1) 158 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:40.217 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.021967+0000 mon.smithi134 (mon.1) 159 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:40.217 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.028548+0000 mon.smithi006 (mon.0) 900 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:40.217 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:39.091006+0000 mgr.smithi006.kskdce (mgr.14664) 107 : cluster [DBG] pgmap v57: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:40.217 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.165693+0000 mon.smithi134 (mon.1) 160 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:13:40.217 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.167286+0000 mon.smithi134 (mon.1) 161 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:13:40.217 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.167969+0000 mon.smithi134 (mon.1) 162 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:13:40.217 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:39.175263+0000 mon.smithi006 (mon.0) 901 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:41.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:41.091427+0000 mgr.smithi006.kskdce (mgr.14664) 108 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:41.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:41 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:41.091427+0000 mgr.smithi006.kskdce (mgr.14664) 108 : cluster [DBG] pgmap v58: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.986+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1216606922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f66f0 msgr2=0x7f8e580f6b10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.986+0000 7f8e5e67c700 1 --2- 172.21.15.6:0/1216606922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f66f0 0x7f8e580f6b10 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7f8e480047f0 tx=0x7f8e48009cb0).stop 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.986+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1216606922 shutdown_connections 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.986+0000 7f8e5e67c700 1 --2- 172.21.15.6:0/1216606922 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e580f7990 0x7f8e580f7df0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.986+0000 7f8e5e67c700 1 --2- 172.21.15.6:0/1216606922 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f66f0 0x7f8e580f6b10 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.986+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1216606922 >> 172.21.15.6:0/1216606922 conn(0x7f8e580f1e50 msgr2=0x7f8e580f4270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.986+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1216606922 shutdown_connections 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.986+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1216606922 wait complete. 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.987+0000 7f8e5e67c700 1 Processor -- start 2024-03-12T16:13:41.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.987+0000 7f8e5e67c700 1 -- start start 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.987+0000 7f8e5e67c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e580f66f0 0x7f8e58106ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.987+0000 7f8e5e67c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f7990 0x7f8e581073e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.987+0000 7f8e5e67c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58107a20 con 0x7f8e580f7990 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.987+0000 7f8e5e67c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8e58107b60 con 0x7f8e580f66f0 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.987+0000 7f8e577fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f7990 0x7f8e581073e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.987+0000 7f8e577fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f7990 0x7f8e581073e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:32772/0 (socket says 172.21.15.6:32772) 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.987+0000 7f8e577fe700 1 -- 172.21.15.6:0/1083386280 learned_addr learned my addr 172.21.15.6:0/1083386280 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e57fff700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e580f66f0 0x7f8e58106ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e577fe700 1 -- 172.21.15.6:0/1083386280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e580f66f0 msgr2=0x7f8e58106ef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:41.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e577fe700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e580f66f0 0x7f8e58106ef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e577fe700 1 -- 172.21.15.6:0/1083386280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8e48005040 con 0x7f8e580f7990 2024-03-12T16:13:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e57fff700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e580f66f0 0x7f8e58106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:13:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e577fe700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f7990 0x7f8e581073e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f8e4c00b4b0 tx=0x7f8e4c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e557fa700 1 -- 172.21.15.6:0/1083386280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e4c002500 con 0x7f8e580f7990 2024-03-12T16:13:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e557fa700 1 -- 172.21.15.6:0/1083386280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8e4c002b10 con 0x7f8e580f7990 2024-03-12T16:13:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8e5810c600 con 0x7f8e580f7990 2024-03-12T16:13:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e557fa700 1 -- 172.21.15.6:0/1083386280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8e4c012ca0 con 0x7f8e580f7990 2024-03-12T16:13:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.988+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8e5810cb40 con 0x7f8e580f7990 2024-03-12T16:13:41.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.989+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8e580fef30 con 0x7f8e580f7990 2024-03-12T16:13:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.990+0000 7f8e557fa700 1 -- 172.21.15.6:0/1083386280 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f8e4c002660 con 0x7f8e580f7990 2024-03-12T16:13:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.990+0000 7f8e557fa700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8e4006c6a0 0x7f8e4006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.990+0000 7f8e557fa700 1 -- 172.21.15.6:0/1083386280 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f8e4c08b810 con 0x7f8e580f7990 2024-03-12T16:13:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.990+0000 7f8e57fff700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8e4006c6a0 0x7f8e4006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:41.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.991+0000 7f8e57fff700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8e4006c6a0 0x7f8e4006eb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8e480043d0 tx=0x7f8e4800b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:41.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:41.995+0000 7f8e557fa700 1 -- 172.21.15.6:0/1083386280 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f8e4c059910 con 0x7f8e580f7990 2024-03-12T16:13:42.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.212+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8e58059120 con 0x7f8e4006c6a0 2024-03-12T16:13:42.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.213+0000 7f8e557fa700 1 -- 172.21.15.6:0/1083386280 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f8e58059120 con 0x7f8e4006c6a0 2024-03-12T16:13:42.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8e4006c6a0 msgr2=0x7f8e4006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:42.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8e4006c6a0 0x7f8e4006eb60 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7f8e480043d0 tx=0x7f8e4800b040).stop 2024-03-12T16:13:42.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f7990 msgr2=0x7f8e581073e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:42.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f7990 0x7f8e581073e0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7f8e4c00b4b0 tx=0x7f8e4c0090f0).stop 2024-03-12T16:13:42.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 shutdown_connections 2024-03-12T16:13:42.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8e4006c6a0 0x7f8e4006eb60 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:42.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8e580f66f0 0x7f8e58106ef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:42.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 --2- 172.21.15.6:0/1083386280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8e580f7990 0x7f8e581073e0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:42.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 >> 172.21.15.6:0/1083386280 conn(0x7f8e580f1e50 msgr2=0x7f8e580fb3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:42.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 shutdown_connections 2024-03-12T16:13:42.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:42.215+0000 7f8e5e67c700 1 -- 172.21.15.6:0/1083386280 wait complete. 2024-03-12T16:13:42.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:41.194525+0000 mon.smithi006 (mon.0) 902 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:41.194525+0000 mon.smithi006 (mon.0) 902 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:13:42.883 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-03-12T16:13:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:42.214564+0000 mgr.smithi006.kskdce (mgr.14664) 109 : audit [DBG] from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:43.091872+0000 mgr.smithi006.kskdce (mgr.14664) 110 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:42.214564+0000 mgr.smithi006.kskdce (mgr.14664) 109 : audit [DBG] from='client.14752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:43 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:43.091872+0000 mgr.smithi006.kskdce (mgr.14664) 110 : cluster [DBG] pgmap v59: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.973+0000 7f8b48d58700 1 -- 172.21.15.6:0/440167239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 msgr2=0x7f8b44101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.973+0000 7f8b48d58700 1 --2- 172.21.15.6:0/440167239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 0x7f8b44101910 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7f8b380047f0 tx=0x7f8b38009cb0).stop 2024-03-12T16:13:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.973+0000 7f8b48d58700 1 -- 172.21.15.6:0/440167239 shutdown_connections 2024-03-12T16:13:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.973+0000 7f8b48d58700 1 --2- 172.21.15.6:0/440167239 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 0x7f8b44101910 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.973+0000 7f8b48d58700 1 --2- 172.21.15.6:0/440167239 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b440f88a0 0x7f8b440f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.973+0000 7f8b48d58700 1 -- 172.21.15.6:0/440167239 >> 172.21.15.6:0/440167239 conn(0x7f8b44070590 msgr2=0x7f8b440f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.973+0000 7f8b48d58700 1 -- 172.21.15.6:0/440167239 shutdown_connections 2024-03-12T16:13:44.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.973+0000 7f8b48d58700 1 -- 172.21.15.6:0/440167239 wait complete. 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b48d58700 1 Processor -- start 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b48d58700 1 -- start start 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b48d58700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b440f88a0 0x7f8b4410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b48d58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 0x7f8b4410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b48d58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4410eb70 con 0x7f8b440f9200 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b48d58700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b4410ecb0 con 0x7f8b440f88a0 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b41d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 0x7f8b4410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b41d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 0x7f8b4410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55402/0 (socket says 172.21.15.6:55402) 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b41d9b700 1 -- 172.21.15.6:0/1859331468 learned_addr learned my addr 172.21.15.6:0/1859331468 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b4259c700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b440f88a0 0x7f8b4410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b41d9b700 1 -- 172.21.15.6:0/1859331468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b440f88a0 msgr2=0x7f8b4410e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b41d9b700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b440f88a0 0x7f8b4410e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:44.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b41d9b700 1 -- 172.21.15.6:0/1859331468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b38005040 con 0x7f8b440f9200 2024-03-12T16:13:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.974+0000 7f8b41d9b700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 0x7f8b4410e570 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f8b38005010 tx=0x7f8b38009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.975+0000 7f8b337fe700 1 -- 172.21.15.6:0/1859331468 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b3800e030 con 0x7f8b440f9200 2024-03-12T16:13:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.975+0000 7f8b337fe700 1 -- 172.21.15.6:0/1859331468 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b38007e90 con 0x7f8b440f9200 2024-03-12T16:13:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.975+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b441082e0 con 0x7f8b440f9200 2024-03-12T16:13:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.975+0000 7f8b337fe700 1 -- 172.21.15.6:0/1859331468 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b38018070 con 0x7f8b440f9200 2024-03-12T16:13:44.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.975+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b441087c0 con 0x7f8b440f9200 2024-03-12T16:13:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.976+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b4405f590 con 0x7f8b440f9200 2024-03-12T16:13:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.976+0000 7f8b337fe700 1 -- 172.21.15.6:0/1859331468 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f8b3801d6e0 con 0x7f8b440f9200 2024-03-12T16:13:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.977+0000 7f8b337fe700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8b2c06c6a0 0x7f8b2c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.977+0000 7f8b337fe700 1 -- 172.21.15.6:0/1859331468 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f8b3808c960 con 0x7f8b440f9200 2024-03-12T16:13:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.977+0000 7f8b4259c700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8b2c06c6a0 0x7f8b2c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:44.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.977+0000 7f8b4259c700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8b2c06c6a0 0x7f8b2c06eb60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8b34009170 tx=0x7f8b34009d60).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:44.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:44.981+0000 7f8b337fe700 1 -- 172.21.15.6:0/1859331468 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f8b3805ab20 con 0x7f8b440f9200 2024-03-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.269+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8b44047540 con 0x7f8b440f9200 2024-03-12T16:13:45.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.269+0000 7f8b337fe700 1 -- 172.21.15.6:0/1859331468 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7f8b3805a6b0 con 0x7f8b440f9200 2024-03-12T16:13:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.271+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8b2c06c6a0 msgr2=0x7f8b2c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.271+0000 7f8b48d58700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8b2c06c6a0 0x7f8b2c06eb60 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7f8b34009170 tx=0x7f8b34009d60).stop 2024-03-12T16:13:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.271+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 msgr2=0x7f8b4410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.271+0000 7f8b48d58700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 0x7f8b4410e570 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f8b38005010 tx=0x7f8b38009cb0).stop 2024-03-12T16:13:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.271+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 shutdown_connections 2024-03-12T16:13:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.271+0000 7f8b48d58700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f8b2c06c6a0 0x7f8b2c06eb60 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.271+0000 7f8b48d58700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b440f88a0 0x7f8b4410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.271+0000 7f8b48d58700 1 --2- 172.21.15.6:0/1859331468 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b440f9200 0x7f8b4410e570 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:45.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.271+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 >> 172.21.15.6:0/1859331468 conn(0x7f8b44070590 msgr2=0x7f8b440fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.272+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 shutdown_connections 2024-03-12T16:13:45.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:45.272+0000 7f8b48d58700 1 -- 172.21.15.6:0/1859331468 wait complete. 2024-03-12T16:13:45.285 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:13:45.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:45.092165+0000 mgr.smithi006.kskdce (mgr.14664) 111 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:45.092165+0000 mgr.smithi006.kskdce (mgr.14664) 111 : cluster [DBG] pgmap v60: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:46.000 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-03-12T16:13:46.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:45.271024+0000 mon.smithi006 (mon.0) 903 : audit [DBG] from='client.? 172.21.15.6:0/1859331468' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:46 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:45.271024+0000 mon.smithi006 (mon.0) 903 : audit [DBG] from='client.? 172.21.15.6:0/1859331468' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:47.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:47 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:47.092518+0000 mgr.smithi006.kskdce (mgr.14664) 112 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:47.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:47.092518+0000 mgr.smithi006.kskdce (mgr.14664) 112 : cluster [DBG] pgmap v61: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:48.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.057+0000 7f3cc21fa700 1 -- 172.21.15.6:0/2677729000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 msgr2=0x7f3cbc0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.057+0000 7f3cc21fa700 1 --2- 172.21.15.6:0/2677729000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 0x7f3cbc0fdcf0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f3cac0047f0 tx=0x7f3cac009cb0).stop 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.057+0000 7f3cc21fa700 1 -- 172.21.15.6:0/2677729000 shutdown_connections 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.057+0000 7f3cc21fa700 1 --2- 172.21.15.6:0/2677729000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cbc0fe270 0x7f3cbc0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.057+0000 7f3cc21fa700 1 --2- 172.21.15.6:0/2677729000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 0x7f3cbc0fdcf0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.057+0000 7f3cc21fa700 1 -- 172.21.15.6:0/2677729000 >> 172.21.15.6:0/2677729000 conn(0x7f3cbc0f3530 msgr2=0x7f3cbc0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.057+0000 7f3cc21fa700 1 -- 172.21.15.6:0/2677729000 shutdown_connections 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.057+0000 7f3cc21fa700 1 -- 172.21.15.6:0/2677729000 wait complete. 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.058+0000 7f3cc21fa700 1 Processor -- start 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.058+0000 7f3cc21fa700 1 -- start start 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cc21fa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 0x7f3cbc10df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cc21fa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cbc0fe270 0x7f3cbc10e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cc21fa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc10ea60 con 0x7f3cbc0fd910 2024-03-12T16:13:48.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cc21fa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3cbc10eba0 con 0x7f3cbc0fe270 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cbb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 0x7f3cbc10df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cbb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 0x7f3cbc10df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55414/0 (socket says 172.21.15.6:55414) 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cbb7fe700 1 -- 172.21.15.6:0/17203204 learned_addr learned my addr 172.21.15.6:0/17203204 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cbaffd700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cbc0fe270 0x7f3cbc10e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cbb7fe700 1 -- 172.21.15.6:0/17203204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cbc0fe270 msgr2=0x7f3cbc10e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cbb7fe700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cbc0fe270 0x7f3cbc10e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cbb7fe700 1 -- 172.21.15.6:0/17203204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3cac005040 con 0x7f3cbc0fd910 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cbaffd700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cbc0fe270 0x7f3cbc10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cbb7fe700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 0x7f3cbc10df70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f3cac005010 tx=0x7f3cac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cb8ff9700 1 -- 172.21.15.6:0/17203204 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cac00e030 con 0x7f3cbc0fd910 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cb8ff9700 1 -- 172.21.15.6:0/17203204 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3cac007e90 con 0x7f3cbc0fd910 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3cbc108240 con 0x7f3cbc0fd910 2024-03-12T16:13:48.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cb8ff9700 1 -- 172.21.15.6:0/17203204 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3cac018070 con 0x7f3cbc0fd910 2024-03-12T16:13:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.059+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3cbc1087a0 con 0x7f3cbc0fd910 2024-03-12T16:13:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.060+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3cbc05f570 con 0x7f3cbc0fd910 2024-03-12T16:13:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.061+0000 7f3cb8ff9700 1 -- 172.21.15.6:0/17203204 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f3cac01d6e0 con 0x7f3cbc0fd910 2024-03-12T16:13:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.062+0000 7f3cb8ff9700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3ca806c6a0 0x7f3ca806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.062+0000 7f3cb8ff9700 1 -- 172.21.15.6:0/17203204 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f3cac08cb60 con 0x7f3cbc0fd910 2024-03-12T16:13:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.062+0000 7f3cbaffd700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3ca806c6a0 0x7f3ca806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.062+0000 7f3cbaffd700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3ca806c6a0 0x7f3ca806eb60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3cbc1098b0 tx=0x7f3ca4009d60).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:48.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.066+0000 7f3cb8ff9700 1 -- 172.21.15.6:0/17203204 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f3cac05ada0 con 0x7f3cbc0fd910 2024-03-12T16:13:48.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.348+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3cbc047540 con 0x7f3cbc0fd910 2024-03-12T16:13:48.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.349+0000 7f3cb8ff9700 1 -- 172.21.15.6:0/17203204 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7f3cac05a930 con 0x7f3cbc0fd910 2024-03-12T16:13:48.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3ca806c6a0 msgr2=0x7f3ca806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:48.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3ca806c6a0 0x7f3ca806eb60 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7f3cbc1098b0 tx=0x7f3ca4009d60).stop 2024-03-12T16:13:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 msgr2=0x7f3cbc10df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 0x7f3cbc10df70 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7f3cac005010 tx=0x7f3cac009cb0).stop 2024-03-12T16:13:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 shutdown_connections 2024-03-12T16:13:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f3ca806c6a0 0x7f3ca806eb60 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3cbc0fd910 0x7f3cbc10df70 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 --2- 172.21.15.6:0/17203204 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3cbc0fe270 0x7f3cbc10e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 >> 172.21.15.6:0/17203204 conn(0x7f3cbc0f3530 msgr2=0x7f3cbc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 shutdown_connections 2024-03-12T16:13:48.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:48.351+0000 7f3cc21fa700 1 -- 172.21.15.6:0/17203204 wait complete. 2024-03-12T16:13:48.364 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)" 2024-03-12T16:13:48.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:48 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:48.350458+0000 mon.smithi006 (mon.0) 904 : audit [DBG] from='client.? 172.21.15.6:0/17203204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:48.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:48 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:48.350458+0000 mon.smithi006 (mon.0) 904 : audit [DBG] from='client.? 172.21.15.6:0/17203204' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:49.206 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-03-12T16:13:49.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:49 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:49.093015+0000 mgr.smithi006.kskdce (mgr.14664) 113 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:49.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:49 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:49.093015+0000 mgr.smithi006.kskdce (mgr.14664) 113 : cluster [DBG] pgmap v62: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.365+0000 7fcb982a2700 1 -- 172.21.15.6:0/1558291484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fe230 msgr2=0x7fcb900f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.365+0000 7fcb982a2700 1 --2- 172.21.15.6:0/1558291484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fe230 0x7fcb900f5f80 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7fcb800047f0 tx=0x7fcb80009cb0).stop 2024-03-12T16:13:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.365+0000 7fcb982a2700 1 -- 172.21.15.6:0/1558291484 shutdown_connections 2024-03-12T16:13:51.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.365+0000 7fcb982a2700 1 --2- 172.21.15.6:0/1558291484 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fe230 0x7fcb900f5f80 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.365+0000 7fcb982a2700 1 --2- 172.21.15.6:0/1558291484 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb900fd8d0 0x7fcb900fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.365+0000 7fcb982a2700 1 -- 172.21.15.6:0/1558291484 >> 172.21.15.6:0/1558291484 conn(0x7fcb9006cea0 msgr2=0x7fcb9006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.365+0000 7fcb982a2700 1 -- 172.21.15.6:0/1558291484 shutdown_connections 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.365+0000 7fcb982a2700 1 -- 172.21.15.6:0/1558291484 wait complete. 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb982a2700 1 Processor -- start 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb982a2700 1 -- start start 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb982a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fd8d0 0x7fcb9010e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb982a2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb900fe230 0x7fcb9010e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb982a2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb9010ec10 con 0x7fcb900fd8d0 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb982a2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcb90108230 con 0x7fcb900fe230 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb9603e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fd8d0 0x7fcb9010e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb9603e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fd8d0 0x7fcb9010e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55424/0 (socket says 172.21.15.6:55424) 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb9603e700 1 -- 172.21.15.6:0/613199455 learned_addr learned my addr 172.21.15.6:0/613199455 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:51.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb9583d700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb900fe230 0x7fcb9010e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb9603e700 1 -- 172.21.15.6:0/613199455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb900fe230 msgr2=0x7fcb9010e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb9603e700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb900fe230 0x7fcb9010e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb9603e700 1 -- 172.21.15.6:0/613199455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcb80005040 con 0x7fcb900fd8d0 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.366+0000 7fcb9583d700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb900fe230 0x7fcb9010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.367+0000 7fcb9603e700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fd8d0 0x7fcb9010e090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fcb8c00b4b0 tx=0x7fcb8c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.367+0000 7fcb87779700 1 -- 172.21.15.6:0/613199455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8c002500 con 0x7fcb900fd8d0 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.367+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcb901084e0 con 0x7fcb900fd8d0 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.367+0000 7fcb87779700 1 -- 172.21.15.6:0/613199455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcb8c002b10 con 0x7fcb900fd8d0 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.367+0000 7fcb87779700 1 -- 172.21.15.6:0/613199455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcb8c012cf0 con 0x7fcb900fd8d0 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.367+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcb90108a20 con 0x7fcb900fd8d0 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.368+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcb90047540 con 0x7fcb900fd8d0 2024-03-12T16:13:51.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.368+0000 7fcb87779700 1 -- 172.21.15.6:0/613199455 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7fcb8c002660 con 0x7fcb900fd8d0 2024-03-12T16:13:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.369+0000 7fcb87779700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fcb7c06c6f0 0x7fcb7c06ebb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.369+0000 7fcb87779700 1 -- 172.21.15.6:0/613199455 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fcb8c08b8f0 con 0x7fcb900fd8d0 2024-03-12T16:13:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.369+0000 7fcb9583d700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fcb7c06c6f0 0x7fcb7c06ebb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.369+0000 7fcb9583d700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fcb7c06c6f0 0x7fcb7c06ebb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fcb901099d0 tx=0x7fcb8000b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:51.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.373+0000 7fcb87779700 1 -- 172.21.15.6:0/613199455 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fcb8c059930 con 0x7fcb900fd8d0 2024-03-12T16:13:51.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:51 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:51.093372+0000 mgr.smithi006.kskdce (mgr.14664) 114 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:51.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:51.093372+0000 mgr.smithi006.kskdce (mgr.14664) 114 : cluster [DBG] pgmap v63: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:51.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.654+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fcb90109710 con 0x7fcb900fd8d0 2024-03-12T16:13:51.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.655+0000 7fcb87779700 1 -- 172.21.15.6:0/613199455 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7fcb8c0594c0 con 0x7fcb900fd8d0 2024-03-12T16:13:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fcb7c06c6f0 msgr2=0x7fcb7c06ebb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fcb7c06c6f0 0x7fcb7c06ebb0 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7fcb901099d0 tx=0x7fcb8000b040).stop 2024-03-12T16:13:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fd8d0 msgr2=0x7fcb9010e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fd8d0 0x7fcb9010e090 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7fcb8c00b4b0 tx=0x7fcb8c0090f0).stop 2024-03-12T16:13:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 shutdown_connections 2024-03-12T16:13:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fcb7c06c6f0 0x7fcb7c06ebb0 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:51.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcb900fd8d0 0x7fcb9010e090 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 --2- 172.21.15.6:0/613199455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcb900fe230 0x7fcb9010e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 >> 172.21.15.6:0/613199455 conn(0x7fcb9006cea0 msgr2=0x7fcb900fbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 shutdown_connections 2024-03-12T16:13:51.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:51.657+0000 7fcb982a2700 1 -- 172.21.15.6:0/613199455 wait complete. 2024-03-12T16:13:51.669 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:13:52.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:51.174397+0000 mon.smithi134 (mon.1) 163 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:13:52.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:52 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:51.656442+0000 mon.smithi006 (mon.0) 905 : audit [DBG] from='client.? 172.21.15.6:0/613199455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:51.174397+0000 mon.smithi134 (mon.1) 163 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:13:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:52 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:51.656442+0000 mon.smithi006 (mon.0) 905 : audit [DBG] from='client.? 172.21.15.6:0/613199455' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:13:52.564 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-03-12T16:13:53.428 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:53 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:53.093978+0000 mgr.smithi006.kskdce (mgr.14664) 115 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:53.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:53 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:53.093978+0000 mgr.smithi006.kskdce (mgr.14664) 115 : cluster [DBG] pgmap v64: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:54.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.714+0000 7f1a7b255700 1 -- 172.21.15.6:0/136876004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f9260 msgr2=0x7f1a74101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.714+0000 7f1a7b255700 1 --2- 172.21.15.6:0/136876004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f9260 0x7f1a74101970 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f1a600047f0 tx=0x7f1a60009cb0).stop 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.714+0000 7f1a7b255700 1 -- 172.21.15.6:0/136876004 shutdown_connections 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.714+0000 7f1a7b255700 1 --2- 172.21.15.6:0/136876004 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f9260 0x7f1a74101970 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.714+0000 7f1a7b255700 1 --2- 172.21.15.6:0/136876004 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a740f8900 0x7f1a740f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.714+0000 7f1a7b255700 1 -- 172.21.15.6:0/136876004 >> 172.21.15.6:0/136876004 conn(0x7f1a74070590 msgr2=0x7f1a740f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.714+0000 7f1a7b255700 1 -- 172.21.15.6:0/136876004 shutdown_connections 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.714+0000 7f1a7b255700 1 -- 172.21.15.6:0/136876004 wait complete. 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a7b255700 1 Processor -- start 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a7b255700 1 -- start start 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a7b255700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f8900 0x7f1a740f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a7b255700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a740f9260 0x7f1a740f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:54.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a7b255700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740f7290 con 0x7f1a740f8900 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a7b255700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a740f73d0 con 0x7f1a740f9260 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a78ff1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f8900 0x7f1a740f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a78ff1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f8900 0x7f1a740f68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44656/0 (socket says 172.21.15.6:44656) 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a78ff1700 1 -- 172.21.15.6:0/2749465129 learned_addr learned my addr 172.21.15.6:0/2749465129 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a73fff700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a740f9260 0x7f1a740f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a78ff1700 1 -- 172.21.15.6:0/2749465129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a740f9260 msgr2=0x7f1a740f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a78ff1700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a740f9260 0x7f1a740f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a78ff1700 1 -- 172.21.15.6:0/2749465129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a60005040 con 0x7f1a740f8900 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.715+0000 7f1a78ff1700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f8900 0x7f1a740f68b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f1a680041d0 tx=0x7f1a68009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.716+0000 7f1a71ffb700 1 -- 172.21.15.6:0/2749465129 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a68007b40 con 0x7f1a740f8900 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.716+0000 7f1a71ffb700 1 -- 172.21.15.6:0/2749465129 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a6800f040 con 0x7f1a740f8900 2024-03-12T16:13:54.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.716+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a740f7680 con 0x7f1a740f8900 2024-03-12T16:13:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.716+0000 7f1a71ffb700 1 -- 172.21.15.6:0/2749465129 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a680147b0 con 0x7f1a740f8900 2024-03-12T16:13:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.716+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a74114670 con 0x7f1a740f8900 2024-03-12T16:13:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.717+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a7405f590 con 0x7f1a740f8900 2024-03-12T16:13:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.717+0000 7f1a71ffb700 1 -- 172.21.15.6:0/2749465129 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f1a68009110 con 0x7f1a740f8900 2024-03-12T16:13:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.718+0000 7f1a71ffb700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1a6406c6a0 0x7f1a6406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.718+0000 7f1a71ffb700 1 -- 172.21.15.6:0/2749465129 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f1a6808b750 con 0x7f1a740f8900 2024-03-12T16:13:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.718+0000 7f1a73fff700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1a6406c6a0 0x7f1a6406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:54.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.718+0000 7f1a73fff700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1a6406c6a0 0x7f1a6406eb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1a60009ee0 tx=0x7f1a6000b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:54.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.722+0000 7f1a71ffb700 1 -- 172.21.15.6:0/2749465129 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f1a68055dc0 con 0x7f1a740f8900 2024-03-12T16:13:54.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:54.937+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a74059120 con 0x7f1a6406c6a0 2024-03-12T16:13:55.419 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:54.939570+0000 mgr.smithi006.kskdce (mgr.14664) 116 : audit [DBG] from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:55.419 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:55.094310+0000 mgr.smithi006.kskdce (mgr.14664) 117 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:55.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:54.939570+0000 mgr.smithi006.kskdce (mgr.14664) 116 : audit [DBG] from='client.14768 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:13:55.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:55.094310+0000 mgr.smithi006.kskdce (mgr.14664) 117 : cluster [DBG] pgmap v65: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:56.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.507+0000 7f1a71ffb700 1 -- 172.21.15.6:0/2749465129 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+5080 (secure 0 0 0) 0x7f1a74059120 con 0x7f1a6406c6a0 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1a6406c6a0 msgr2=0x7f1a6406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1a6406c6a0 0x7f1a6406eb60 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f1a60009ee0 tx=0x7f1a6000b040).stop 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f8900 msgr2=0x7f1a740f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f8900 0x7f1a740f68b0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7f1a680041d0 tx=0x7f1a68009f60).stop 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 shutdown_connections 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f1a6406c6a0 0x7f1a6406eb60 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a740f8900 0x7f1a740f68b0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 --2- 172.21.15.6:0/2749465129 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a740f9260 0x7f1a740f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 >> 172.21.15.6:0/2749465129 conn(0x7f1a74070590 msgr2=0x7f1a740fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 shutdown_connections 2024-03-12T16:13:56.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:56.510+0000 7f1a7b255700 1 -- 172.21.15.6:0/2749465129 wait complete. 2024-03-12T16:13:56.525 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:13:57.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:57.094698+0000 mgr.smithi006.kskdce (mgr.14664) 118 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:57.225 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph orch ps' 2024-03-12T16:13:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:57 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:57.094698+0000 mgr.smithi006.kskdce (mgr.14664) 118 : cluster [DBG] pgmap v66: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:59.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.357+0000 7fd21a2a2700 1 -- 172.21.15.6:0/4017637942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f88a0 msgr2=0x7fd2140f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.357+0000 7fd21a2a2700 1 --2- 172.21.15.6:0/4017637942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f88a0 0x7fd2140f8c80 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fd2040047f0 tx=0x7fd204009cb0).stop 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.357+0000 7fd21a2a2700 1 -- 172.21.15.6:0/4017637942 shutdown_connections 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.357+0000 7fd21a2a2700 1 --2- 172.21.15.6:0/4017637942 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2140f9200 0x7fd214101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.357+0000 7fd21a2a2700 1 --2- 172.21.15.6:0/4017637942 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f88a0 0x7fd2140f8c80 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.357+0000 7fd21a2a2700 1 -- 172.21.15.6:0/4017637942 >> 172.21.15.6:0/4017637942 conn(0x7fd214070590 msgr2=0x7fd2140f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.357+0000 7fd21a2a2700 1 -- 172.21.15.6:0/4017637942 shutdown_connections 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.357+0000 7fd21a2a2700 1 -- 172.21.15.6:0/4017637942 wait complete. 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd21a2a2700 1 Processor -- start 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd21a2a2700 1 -- start start 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd21a2a2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2140f88a0 0x7fd21410e0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd21a2a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f9200 0x7fd21410e5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd21a2a2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd21410ec60 con 0x7fd2140f9200 2024-03-12T16:13:59.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd21a2a2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd214108280 con 0x7fd2140f88a0 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd2137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f9200 0x7fd21410e5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd2137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f9200 0x7fd21410e5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44684/0 (socket says 172.21.15.6:44684) 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd2137fe700 1 -- 172.21.15.6:0/3351441046 learned_addr learned my addr 172.21.15.6:0/3351441046 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd2137fe700 1 -- 172.21.15.6:0/3351441046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2140f88a0 msgr2=0x7fd21410e0e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd213fff700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2140f88a0 0x7fd21410e0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd2137fe700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2140f88a0 0x7fd21410e0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.358+0000 7fd2137fe700 1 -- 172.21.15.6:0/3351441046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd204005040 con 0x7fd2140f9200 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.359+0000 7fd2137fe700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f9200 0x7fd21410e5d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fd20800b4b0 tx=0x7fd2080090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.359+0000 7fd211775700 1 -- 172.21.15.6:0/3351441046 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd208002500 con 0x7fd2140f9200 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.359+0000 7fd211775700 1 -- 172.21.15.6:0/3351441046 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd208002b10 con 0x7fd2140f9200 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.359+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd214108530 con 0x7fd2140f9200 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.359+0000 7fd211775700 1 -- 172.21.15.6:0/3351441046 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd208012cf0 con 0x7fd2140f9200 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.359+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd214108a70 con 0x7fd2140f9200 2024-03-12T16:13:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.360+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd21405f590 con 0x7fd2140f9200 2024-03-12T16:13:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.360+0000 7fd211775700 1 -- 172.21.15.6:0/3351441046 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7fd208002660 con 0x7fd2140f9200 2024-03-12T16:13:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.361+0000 7fd211775700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd1fc06c6a0 0x7fd1fc06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:13:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.361+0000 7fd211775700 1 -- 172.21.15.6:0/3351441046 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fd20808b2c0 con 0x7fd2140f9200 2024-03-12T16:13:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.361+0000 7fd213fff700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd1fc06c6a0 0x7fd1fc06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:13:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.361+0000 7fd213fff700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd1fc06c6a0 0x7fd1fc06eb60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd2040043d0 tx=0x7fd20400b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:13:59.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.366+0000 7fd211775700 1 -- 172.21.15.6:0/3351441046 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fd2080593c0 con 0x7fd2140f9200 2024-03-12T16:13:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:13:59 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:13:59.095071+0000 mgr.smithi006.kskdce (mgr.14664) 119 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:59.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:13:59 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:13:59.095071+0000 mgr.smithi006.kskdce (mgr.14664) 119 : cluster [DBG] pgmap v67: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:13:59.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.573+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd214109760 con 0x7fd1fc06c6a0 2024-03-12T16:13:59.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.583+0000 7fd211775700 1 -- 172.21.15.6:0/3351441046 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd214109760 con 0x7fd1fc06c6a0 2024-03-12T16:13:59.585 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:13:59.585 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (45s) 24s ago 11m 16.7M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:13:59.585 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (11m) 24s ago 11m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:13:59.585 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (11m) 41s ago 11m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:13:59.585 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (30s) 24s ago 11m 36.5M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (6m) 24s ago 6m 125M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (6m) 24s ago 6m 14.3M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (6m) 41s ago 6m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (6m) 41s ago 6m 17.0M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (2m) 24s ago 13m 497M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (100s) 41s ago 11m 446M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (13m) 24s ago 13m 57.9M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (11m) 41s ago 10m 49.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (84s) 24s ago 11m 9231k - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (78s) 41s ago 10m 13.0M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (10m) 24s ago 10m 217M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (10m) 24s ago 10m 235M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (9m) 24s ago 9m 194M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:13:59.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (9m) 41s ago 9m 264M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:13:59.587 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (8m) 41s ago 8m 236M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:13:59.587 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (8m) 41s ago 8m 226M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:13:59.587 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (61s) 41s ago 9m 44.2M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:13:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd1fc06c6a0 msgr2=0x7fd1fc06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:59.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd1fc06c6a0 0x7fd1fc06eb60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7fd2040043d0 tx=0x7fd20400b040).stop 2024-03-12T16:13:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f9200 msgr2=0x7fd21410e5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:13:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f9200 0x7fd21410e5d0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7fd20800b4b0 tx=0x7fd2080090f0).stop 2024-03-12T16:13:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 shutdown_connections 2024-03-12T16:13:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd1fc06c6a0 0x7fd1fc06eb60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2140f88a0 0x7fd21410e0e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 --2- 172.21.15.6:0/3351441046 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2140f9200 0x7fd21410e5d0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:13:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 >> 172.21.15.6:0/3351441046 conn(0x7fd214070590 msgr2=0x7fd2141001e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:13:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 shutdown_connections 2024-03-12T16:13:59.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:13:59.585+0000 7fd21a2a2700 1 -- 172.21.15.6:0/3351441046 wait complete. 2024-03-12T16:14:00.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:13:59.575428+0000 mgr.smithi006.kskdce (mgr.14664) 120 : audit [DBG] from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:00.322 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-12T16:14:00.323 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:14:00.323 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph config set mgr mgr/orchestrator/fail_fs true' 2024-03-12T16:14:00.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:00 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:13:59.575428+0000 mgr.smithi006.kskdce (mgr.14664) 120 : audit [DBG] from='client.14772 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:01.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:01 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:01.095509+0000 mgr.smithi006.kskdce (mgr.14664) 121 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:01.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:01.095509+0000 mgr.smithi006.kskdce (mgr.14664) 121 : cluster [DBG] pgmap v68: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.384+0000 7f2ed9f84700 1 -- 172.21.15.6:0/3777072304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f9210 msgr2=0x7f2ed41019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.384+0000 7f2ed9f84700 1 --2- 172.21.15.6:0/3777072304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f9210 0x7f2ed41019b0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f2ebc0047f0 tx=0x7f2ebc009cb0).stop 2024-03-12T16:14:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.384+0000 7f2ed9f84700 1 -- 172.21.15.6:0/3777072304 shutdown_connections 2024-03-12T16:14:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.384+0000 7f2ed9f84700 1 --2- 172.21.15.6:0/3777072304 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f9210 0x7f2ed41019b0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.384+0000 7f2ed9f84700 1 --2- 172.21.15.6:0/3777072304 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed40f8940 0x7f2ed40f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.384+0000 7f2ed9f84700 1 -- 172.21.15.6:0/3777072304 >> 172.21.15.6:0/3777072304 conn(0x7f2ed4070590 msgr2=0x7f2ed40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.384+0000 7f2ed9f84700 1 -- 172.21.15.6:0/3777072304 shutdown_connections 2024-03-12T16:14:02.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.384+0000 7f2ed9f84700 1 -- 172.21.15.6:0/3777072304 wait complete. 2024-03-12T16:14:02.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.385+0000 7f2ed9f84700 1 Processor -- start 2024-03-12T16:14:02.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.385+0000 7f2ed9f84700 1 -- start start 2024-03-12T16:14:02.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed9f84700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f8940 0x7f2ed410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:02.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed9f84700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed40f9210 0x7f2ed410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:02.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed9f84700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed410eb20 con 0x7f2ed40f8940 2024-03-12T16:14:02.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed9f84700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed410ec60 con 0x7f2ed40f9210 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f8940 0x7f2ed410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f8940 0x7f2ed410e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59540/0 (socket says 172.21.15.6:59540) 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed37fe700 1 -- 172.21.15.6:0/2519028195 learned_addr learned my addr 172.21.15.6:0/2519028195 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed2ffd700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed40f9210 0x7f2ed410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed37fe700 1 -- 172.21.15.6:0/2519028195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed40f9210 msgr2=0x7f2ed410e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed37fe700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed40f9210 0x7f2ed410e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed37fe700 1 -- 172.21.15.6:0/2519028195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ebc005040 con 0x7f2ed40f8940 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed2ffd700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed40f9210 0x7f2ed410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.386+0000 7f2ed37fe700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f8940 0x7f2ed410e030 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f2ec4002770 tx=0x7f2ec4002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.387+0000 7f2ed0ff9700 1 -- 172.21.15.6:0/2519028195 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec4002d80 con 0x7f2ed40f8940 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.387+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed41082f0 con 0x7f2ed40f8940 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.387+0000 7f2ed0ff9700 1 -- 172.21.15.6:0/2519028195 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ec400f040 con 0x7f2ed40f8940 2024-03-12T16:14:02.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.387+0000 7f2ed0ff9700 1 -- 172.21.15.6:0/2519028195 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec400d800 con 0x7f2ed40f8940 2024-03-12T16:14:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.387+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed4108830 con 0x7f2ed40f8940 2024-03-12T16:14:02.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.388+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed405f590 con 0x7f2ed40f8940 2024-03-12T16:14:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.388+0000 7f2ed0ff9700 1 -- 172.21.15.6:0/2519028195 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f2ec4009110 con 0x7f2ed40f8940 2024-03-12T16:14:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.389+0000 7f2ed0ff9700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f2ec006c6a0 0x7f2ec006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.389+0000 7f2ed2ffd700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f2ec006c6a0 0x7f2ec006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.389+0000 7f2ed0ff9700 1 -- 172.21.15.6:0/2519028195 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f2ec408b2b0 con 0x7f2ed40f8940 2024-03-12T16:14:02.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.389+0000 7f2ed2ffd700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f2ec006c6a0 0x7f2ec006eb60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2ed4109970 tx=0x7f2ebc00b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:02.395 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.393+0000 7f2ed0ff9700 1 -- 172.21.15.6:0/2519028195 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f2ec40593b0 con 0x7f2ed40f8940 2024-03-12T16:14:02.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.596+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mgr/orchestrator/fail_fs}] v 0) v1 -- 0x7f2ed40fee80 con 0x7f2ed40f8940 2024-03-12T16:14:02.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.600+0000 7f2ed0ff9700 1 -- 172.21.15.6:0/2519028195 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mgr/orchestrator/fail_fs}]=0 v48)=0 v48) v1 ==== 125+0+0 (secure 0 0 0) 0x7f2ec4058f40 con 0x7f2ed40f8940 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f2ec006c6a0 msgr2=0x7f2ec006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f2ec006c6a0 0x7f2ec006eb60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f2ed4109970 tx=0x7f2ebc00b040).stop 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f8940 msgr2=0x7f2ed410e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f8940 0x7f2ed410e030 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f2ec4002770 tx=0x7f2ec4002b30).stop 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 shutdown_connections 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f2ec006c6a0 0x7f2ec006eb60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed40f8940 0x7f2ed410e030 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 --2- 172.21.15.6:0/2519028195 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed40f9210 0x7f2ed410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 >> 172.21.15.6:0/2519028195 conn(0x7f2ed4070590 msgr2=0x7f2ed40fc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 shutdown_connections 2024-03-12T16:14:02.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:02.603+0000 7f2ed9f84700 1 -- 172.21.15.6:0/2519028195 wait complete. 2024-03-12T16:14:03.335 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-12T16:14:03.336 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:14:03.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-03-12T16:14:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:02.602089+0000 mon.smithi006 (mon.0) 906 : audit [INF] from='client.? 172.21.15.6:0/2519028195' entity='client.admin' 2024-03-12T16:14:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:02.623361+0000 mon.smithi134 (mon.1) 164 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:03.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:02.625094+0000 mon.smithi134 (mon.1) 165 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:03.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:02.625987+0000 mon.smithi134 (mon.1) 166 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:14:03.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:02.631110+0000 mon.smithi006 (mon.0) 907 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:03.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:03 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:03.095957+0000 mgr.smithi006.kskdce (mgr.14664) 122 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:02.602089+0000 mon.smithi006 (mon.0) 906 : audit [INF] from='client.? 172.21.15.6:0/2519028195' entity='client.admin' 2024-03-12T16:14:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:02.623361+0000 mon.smithi134 (mon.1) 164 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:02.625094+0000 mon.smithi134 (mon.1) 165 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:02.625987+0000 mon.smithi134 (mon.1) 166 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:14:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:02.631110+0000 mon.smithi006 (mon.0) 907 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:03 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:03.095957+0000 mgr.smithi006.kskdce (mgr.14664) 122 : cluster [DBG] pgmap v69: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:05.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.382+0000 7f232b3b6700 1 -- 172.21.15.6:0/524548115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 msgr2=0x7f23240f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:05.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.382+0000 7f232b3b6700 1 --2- 172.21.15.6:0/524548115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 0x7f23240f6930 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f23140047f0 tx=0x7f2314009cb0).stop 2024-03-12T16:14:05.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.382+0000 7f232b3b6700 1 -- 172.21.15.6:0/524548115 shutdown_connections 2024-03-12T16:14:05.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.382+0000 7f232b3b6700 1 --2- 172.21.15.6:0/524548115 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 0x7f23240f6930 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:05.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.382+0000 7f232b3b6700 1 --2- 172.21.15.6:0/524548115 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23240fc7f0 0x7f23240fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:14:05.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.382+0000 7f232b3b6700 1 -- 172.21.15.6:0/524548115 >> 172.21.15.6:0/524548115 conn(0x7f2324070590 msgr2=0x7f23240f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:05.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.382+0000 7f232b3b6700 1 -- 172.21.15.6:0/524548115 shutdown_connections 2024-03-12T16:14:05.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.382+0000 7f232b3b6700 1 -- 172.21.15.6:0/524548115 wait complete. 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.383+0000 7f232b3b6700 1 Processor -- start 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.383+0000 7f232b3b6700 1 -- start start 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.383+0000 7f232b3b6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23240fc7f0 0x7f232410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.383+0000 7f232b3b6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 0x7f232410e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.383+0000 7f232b3b6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f232410ebc0 con 0x7f23240fd150 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.383+0000 7f232b3b6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f23241081e0 con 0x7f23240fc7f0 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.383+0000 7f2328951700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 0x7f232410e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.383+0000 7f2328951700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 0x7f232410e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59552/0 (socket says 172.21.15.6:59552) 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.383+0000 7f2328951700 1 -- 172.21.15.6:0/278558273 learned_addr learned my addr 172.21.15.6:0/278558273 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f2329152700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23240fc7f0 0x7f232410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f2328951700 1 -- 172.21.15.6:0/278558273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23240fc7f0 msgr2=0x7f232410e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:05.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f2328951700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23240fc7f0 0x7f232410e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f2328951700 1 -- 172.21.15.6:0/278558273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2314005040 con 0x7f23240fd150 2024-03-12T16:14:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f2329152700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23240fc7f0 0x7f232410e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:14:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f2328951700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 0x7f232410e530 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f23140099f0 tx=0x7f2314009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f231a7fc700 1 -- 172.21.15.6:0/278558273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f231400e030 con 0x7f23240fd150 2024-03-12T16:14:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f231a7fc700 1 -- 172.21.15.6:0/278558273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2314007e90 con 0x7f23240fd150 2024-03-12T16:14:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2324108430 con 0x7f23240fd150 2024-03-12T16:14:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f231a7fc700 1 -- 172.21.15.6:0/278558273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2314018070 con 0x7f23240fd150 2024-03-12T16:14:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.384+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2324108910 con 0x7f23240fd150 2024-03-12T16:14:05.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.385+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f232405f590 con 0x7f23240fd150 2024-03-12T16:14:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.386+0000 7f231a7fc700 1 -- 172.21.15.6:0/278558273 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f231401d420 con 0x7f23240fd150 2024-03-12T16:14:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.386+0000 7f231a7fc700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f231006c6a0 0x7f231006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.386+0000 7f231a7fc700 1 -- 172.21.15.6:0/278558273 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f231408cb40 con 0x7f23240fd150 2024-03-12T16:14:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.386+0000 7f2329152700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f231006c6a0 0x7f231006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:05.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.387+0000 7f2329152700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f231006c6a0 0x7f231006eb60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2320009990 tx=0x7f2320008040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:05.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.391+0000 7f231a7fc700 1 -- 172.21.15.6:0/278558273 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f231405ac40 con 0x7f23240fd150 2024-03-12T16:14:05.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:05.096482+0000 mgr.smithi006.kskdce (mgr.14664) 123 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:05.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:05 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:05.096482+0000 mgr.smithi006.kskdce (mgr.14664) 123 : cluster [DBG] pgmap v70: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:05.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.587+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}] v 0) v1 -- 0x7f23241035f0 con 0x7f23240fd150 2024-03-12T16:14:05.590 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.588+0000 7f231a7fc700 1 -- 172.21.15.6:0/278558273 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim}]=0 v48)=0 v48) v1 ==== 155+0+0 (secure 0 0 0) 0x7f231405a7d0 con 0x7f23240fd150 2024-03-12T16:14:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f231006c6a0 msgr2=0x7f231006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f231006c6a0 0x7f231006eb60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7f2320009990 tx=0x7f2320008040).stop 2024-03-12T16:14:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 msgr2=0x7f232410e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 0x7f232410e530 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7f23140099f0 tx=0x7f2314009cb0).stop 2024-03-12T16:14:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 shutdown_connections 2024-03-12T16:14:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f231006c6a0 0x7f231006eb60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f23240fc7f0 0x7f232410e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 --2- 172.21.15.6:0/278558273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f23240fd150 0x7f232410e530 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:05.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 >> 172.21.15.6:0/278558273 conn(0x7f2324070590 msgr2=0x7f2324060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 shutdown_connections 2024-03-12T16:14:05.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:05.590+0000 7f232b3b6700 1 -- 172.21.15.6:0/278558273 wait complete. 2024-03-12T16:14:06.308 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-03-12T16:14:06.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:06 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:06.174585+0000 mon.smithi134 (mon.1) 167 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:14:06.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:06 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:06.174585+0000 mon.smithi134 (mon.1) 167 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:14:07.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:07 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:07.097044+0000 mgr.smithi006.kskdce (mgr.14664) 124 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:07.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:07 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:07.097044+0000 mgr.smithi006.kskdce (mgr.14664) 124 : cluster [DBG] pgmap v71: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:08.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.311+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2820534197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 msgr2=0x7f7c6c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.311+0000 7f7c72b3a700 1 --2- 172.21.15.6:0/2820534197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 0x7f7c6c0f6930 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7f7c580047f0 tx=0x7f7c58009cb0).stop 2024-03-12T16:14:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.311+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2820534197 shutdown_connections 2024-03-12T16:14:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.311+0000 7f7c72b3a700 1 --2- 172.21.15.6:0/2820534197 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 0x7f7c6c0f6930 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.311+0000 7f7c72b3a700 1 --2- 172.21.15.6:0/2820534197 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c0fc7f0 0x7f7c6c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.311+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2820534197 >> 172.21.15.6:0/2820534197 conn(0x7f7c6c070590 msgr2=0x7f7c6c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.311+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2820534197 shutdown_connections 2024-03-12T16:14:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.311+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2820534197 wait complete. 2024-03-12T16:14:08.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c72b3a700 1 Processor -- start 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c72b3a700 1 -- start start 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c72b3a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c0fc7f0 0x7f7c6c1090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c72b3a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 0x7f7c6c1095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c72b3a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c109aa0 con 0x7f7c6c0fd150 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c72b3a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7c6c109be0 con 0x7f7c6c0fc7f0 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 0x7f7c6c1095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 0x7f7c6c1095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59566/0 (socket says 172.21.15.6:59566) 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c6bfff700 1 -- 172.21.15.6:0/2379024937 learned_addr learned my addr 172.21.15.6:0/2379024937 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.312+0000 7f7c708d6700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c0fc7f0 0x7f7c6c1090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.313+0000 7f7c6bfff700 1 -- 172.21.15.6:0/2379024937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c0fc7f0 msgr2=0x7f7c6c1090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.313+0000 7f7c6bfff700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c0fc7f0 0x7f7c6c1090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.313+0000 7f7c6bfff700 1 -- 172.21.15.6:0/2379024937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7c58005040 con 0x7f7c6c0fd150 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.313+0000 7f7c6bfff700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 0x7f7c6c1095b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f7c580099f0 tx=0x7f7c58009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:08.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.313+0000 7f7c69ffb700 1 -- 172.21.15.6:0/2379024937 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c5800e030 con 0x7f7c6c0fd150 2024-03-12T16:14:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.313+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7c6c109e30 con 0x7f7c6c0fd150 2024-03-12T16:14:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.313+0000 7f7c69ffb700 1 -- 172.21.15.6:0/2379024937 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7c58007e90 con 0x7f7c6c0fd150 2024-03-12T16:14:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.313+0000 7f7c69ffb700 1 -- 172.21.15.6:0/2379024937 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7c58018070 con 0x7f7c6c0fd150 2024-03-12T16:14:08.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.313+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7c6c112420 con 0x7f7c6c0fd150 2024-03-12T16:14:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.314+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7c6c05f590 con 0x7f7c6c0fd150 2024-03-12T16:14:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.315+0000 7f7c69ffb700 1 -- 172.21.15.6:0/2379024937 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f7c5801d420 con 0x7f7c6c0fd150 2024-03-12T16:14:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.315+0000 7f7c69ffb700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f7c5c06c6a0 0x7f7c5c06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.315+0000 7f7c69ffb700 1 -- 172.21.15.6:0/2379024937 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f7c5808cb30 con 0x7f7c6c0fd150 2024-03-12T16:14:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.315+0000 7f7c708d6700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f7c5c06c6a0 0x7f7c5c06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:08.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.316+0000 7f7c708d6700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f7c5c06c6a0 0x7f7c5c06eb60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7c600041d0 tx=0x7f7c60009040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:08.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.320+0000 7f7c69ffb700 1 -- 172.21.15.6:0/2379024937 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f7c580571a0 con 0x7f7c6c0fd150 2024-03-12T16:14:08.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.515+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}] v 0) v1 -- 0x7f7c6c0feb80 con 0x7f7c6c0fd150 2024-03-12T16:14:08.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.516+0000 7f7c69ffb700 1 -- 172.21.15.6:0/2379024937 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_warn_on_insecure_global_id_reclaim_allowed}]=0 v48)=0 v48) v1 ==== 163+0+0 (secure 0 0 0) 0x7f7c5805a7c0 con 0x7f7c6c0fd150 2024-03-12T16:14:08.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f7c5c06c6a0 msgr2=0x7f7c5c06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:08.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f7c5c06c6a0 0x7f7c5c06eb60 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7f7c600041d0 tx=0x7f7c60009040).stop 2024-03-12T16:14:08.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 msgr2=0x7f7c6c1095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:08.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 0x7f7c6c1095b0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f7c580099f0 tx=0x7f7c58009cb0).stop 2024-03-12T16:14:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 shutdown_connections 2024-03-12T16:14:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f7c5c06c6a0 0x7f7c5c06eb60 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7c6c0fc7f0 0x7f7c6c1090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 --2- 172.21.15.6:0/2379024937 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7c6c0fd150 0x7f7c6c1095b0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 >> 172.21.15.6:0/2379024937 conn(0x7f7c6c070590 msgr2=0x7f7c6c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 shutdown_connections 2024-03-12T16:14:08.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:08.519+0000 7f7c72b3a700 1 -- 172.21.15.6:0/2379024937 wait complete. 2024-03-12T16:14:09.177 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph config set global log_to_journald false --force' 2024-03-12T16:14:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:09.097574+0000 mgr.smithi006.kskdce (mgr.14664) 125 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:09.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:09.097574+0000 mgr.smithi006.kskdce (mgr.14664) 125 : cluster [DBG] pgmap v72: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:11.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.197+0000 7fe7edba0700 1 -- 172.21.15.6:0/2714057903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fc5a0 msgr2=0x7fe7e80fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:11.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.197+0000 7fe7edba0700 1 --2- 172.21.15.6:0/2714057903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fc5a0 0x7fe7e80fc980 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7fe7dc0047f0 tx=0x7fe7dc009cb0).stop 2024-03-12T16:14:11.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 -- 172.21.15.6:0/2714057903 shutdown_connections 2024-03-12T16:14:11.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 --2- 172.21.15.6:0/2714057903 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e80fcf00 0x7fe7e80f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:11.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 --2- 172.21.15.6:0/2714057903 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fc5a0 0x7fe7e80fc980 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:11.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 -- 172.21.15.6:0/2714057903 >> 172.21.15.6:0/2714057903 conn(0x7fe7e806c550 msgr2=0x7fe7e806c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:11.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 -- 172.21.15.6:0/2714057903 shutdown_connections 2024-03-12T16:14:11.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 -- 172.21.15.6:0/2714057903 wait complete. 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 Processor -- start 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 -- start start 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e80fc5a0 0x7fe7e810dfb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fcf00 0x7fe7e810e4a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e810eaa0 con 0x7fe7e80fcf00 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.198+0000 7fe7edba0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe7e810ebe0 con 0x7fe7e80fc5a0 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fcf00 0x7fe7e810e4a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fcf00 0x7fe7e810e4a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59578/0 (socket says 172.21.15.6:59578) 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e7fff700 1 -- 172.21.15.6:0/1971843979 learned_addr learned my addr 172.21.15.6:0/1971843979 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7ecb9e700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e80fc5a0 0x7fe7e810dfb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e7fff700 1 -- 172.21.15.6:0/1971843979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e80fc5a0 msgr2=0x7fe7e810dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e7fff700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e80fc5a0 0x7fe7e810dfb0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e7fff700 1 -- 172.21.15.6:0/1971843979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe7dc005040 con 0x7fe7e80fcf00 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e7fff700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fcf00 0x7fe7e810e4a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fe7d4002820 tx=0x7fe7d4009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:11.201 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e5ffb700 1 -- 172.21.15.6:0/1971843979 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d4007b40 con 0x7fe7e80fcf00 2024-03-12T16:14:11.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e5ffb700 1 -- 172.21.15.6:0/1971843979 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe7d400f040 con 0x7fe7e80fcf00 2024-03-12T16:14:11.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe7e8108060 con 0x7fe7e80fcf00 2024-03-12T16:14:11.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7e5ffb700 1 -- 172.21.15.6:0/1971843979 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe7d40148b0 con 0x7fe7e80fcf00 2024-03-12T16:14:11.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.199+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe7e8108620 con 0x7fe7e80fcf00 2024-03-12T16:14:11.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.200+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe7e805f350 con 0x7fe7e80fcf00 2024-03-12T16:14:11.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.201+0000 7fe7e5ffb700 1 -- 172.21.15.6:0/1971843979 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7fe7d4007ca0 con 0x7fe7e80fcf00 2024-03-12T16:14:11.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.201+0000 7fe7e5ffb700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe7d806c6a0 0x7fe7d806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:11.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.201+0000 7fe7e5ffb700 1 -- 172.21.15.6:0/1971843979 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fe7d408b1f0 con 0x7fe7e80fcf00 2024-03-12T16:14:11.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.201+0000 7fe7ecb9e700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe7d806c6a0 0x7fe7d806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:11.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.202+0000 7fe7ecb9e700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe7d806c6a0 0x7fe7d806eb60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe7dc004f10 tx=0x7fe7dc00b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:11.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.206+0000 7fe7e5ffb700 1 -- 172.21.15.6:0/1971843979 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fe7d40592f0 con 0x7fe7e80fcf00 2024-03-12T16:14:11.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.402+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command([{prefix=config set, name=log_to_journald}] v 0) v1 -- 0x7fe7e80704b0 con 0x7fe7e80fcf00 2024-03-12T16:14:11.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.402+0000 7fe7e5ffb700 1 -- 172.21.15.6:0/1971843979 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{prefix=config set, name=log_to_journald}]=0 v48)=0 v48) v1 ==== 135+0+0 (secure 0 0 0) 0x7fe7e80704b0 con 0x7fe7e80fcf00 2024-03-12T16:14:11.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe7d806c6a0 msgr2=0x7fe7d806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:11.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe7d806c6a0 0x7fe7d806eb60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fe7dc004f10 tx=0x7fe7dc00b040).stop 2024-03-12T16:14:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fcf00 msgr2=0x7fe7e810e4a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fcf00 0x7fe7e810e4a0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7fe7d4002820 tx=0x7fe7d4009f20).stop 2024-03-12T16:14:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 shutdown_connections 2024-03-12T16:14:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fe7d806c6a0 0x7fe7d806eb60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe7e80fc5a0 0x7fe7e810dfb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 --2- 172.21.15.6:0/1971843979 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe7e80fcf00 0x7fe7e810e4a0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 >> 172.21.15.6:0/1971843979 conn(0x7fe7e806c550 msgr2=0x7fe7e8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 shutdown_connections 2024-03-12T16:14:11.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:11.404+0000 7fe7edba0700 1 -- 172.21.15.6:0/1971843979 wait complete. 2024-03-12T16:14:11.429 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:11 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:11.097887+0000 mgr.smithi006.kskdce (mgr.14664) 126 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:11.097887+0000 mgr.smithi006.kskdce (mgr.14664) 126 : cluster [DBG] pgmap v73: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:12.073 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-03-12T16:14:13.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:13.098597+0000 mgr.smithi006.kskdce (mgr.14664) 127 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:13.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:13 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:13.098597+0000 mgr.smithi006.kskdce (mgr.14664) 127 : cluster [DBG] pgmap v74: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:14.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.071+0000 7f24cc79d700 1 -- 172.21.15.6:0/1331632556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fd8f0 msgr2=0x7f24c40fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:14.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.071+0000 7f24cc79d700 1 --2- 172.21.15.6:0/1331632556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fd8f0 0x7f24c40fdcd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f24c00047f0 tx=0x7f24c0009cb0).stop 2024-03-12T16:14:14.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.071+0000 7f24cc79d700 1 -- 172.21.15.6:0/1331632556 shutdown_connections 2024-03-12T16:14:14.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.071+0000 7f24cc79d700 1 --2- 172.21.15.6:0/1331632556 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c40fe250 0x7f24c40f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:14:14.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.071+0000 7f24cc79d700 1 --2- 172.21.15.6:0/1331632556 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fd8f0 0x7f24c40fdcd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:14.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.071+0000 7f24cc79d700 1 -- 172.21.15.6:0/1331632556 >> 172.21.15.6:0/1331632556 conn(0x7f24c40f34b0 msgr2=0x7f24c40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:14.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.071+0000 7f24cc79d700 1 -- 172.21.15.6:0/1331632556 shutdown_connections 2024-03-12T16:14:14.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.071+0000 7f24cc79d700 1 -- 172.21.15.6:0/1331632556 wait complete. 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.072+0000 7f24cc79d700 1 Processor -- start 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.072+0000 7f24cc79d700 1 -- start start 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.072+0000 7f24cc79d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c40fd8f0 0x7f24c410e100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.072+0000 7f24cc79d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fe250 0x7f24c410e5f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.072+0000 7f24cc79d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c410ec80 con 0x7f24c40fe250 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.072+0000 7f24cc79d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24c41082a0 con 0x7f24c40fd8f0 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.072+0000 7f24c9d38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fe250 0x7f24c410e5f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.072+0000 7f24c9d38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fe250 0x7f24c410e5f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57008/0 (socket says 172.21.15.6:57008) 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.072+0000 7f24c9d38700 1 -- 172.21.15.6:0/3095911163 learned_addr learned my addr 172.21.15.6:0/3095911163 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.073+0000 7f24c9d38700 1 -- 172.21.15.6:0/3095911163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c40fd8f0 msgr2=0x7f24c410e100 unknown :-1 s=STATE_CONNECTING_RE l=1).mark_down 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.073+0000 7f24c9d38700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c40fd8f0 0x7f24c410e100 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.073+0000 7f24c9d38700 1 -- 172.21.15.6:0/3095911163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24c0005040 con 0x7f24c40fe250 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.073+0000 7f24c9d38700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fe250 0x7f24c410e5f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f24b800b480 tx=0x7f24b80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.073+0000 7f24b77fe700 1 -- 172.21.15.6:0/3095911163 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24b8002500 con 0x7f24c40fe250 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.073+0000 7f24b77fe700 1 -- 172.21.15.6:0/3095911163 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f24b8002b10 con 0x7f24c40fe250 2024-03-12T16:14:14.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.073+0000 7f24b77fe700 1 -- 172.21.15.6:0/3095911163 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24b8012c90 con 0x7f24c40fe250 2024-03-12T16:14:14.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.073+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24c4108550 con 0x7f24c40fe250 2024-03-12T16:14:14.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.073+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24c4108a90 con 0x7f24c40fe250 2024-03-12T16:14:14.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.074+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24c405f590 con 0x7f24c40fe250 2024-03-12T16:14:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.074+0000 7f24b77fe700 1 -- 172.21.15.6:0/3095911163 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f24b8002660 con 0x7f24c40fe250 2024-03-12T16:14:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.075+0000 7f24b77fe700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f24b006c6a0 0x7f24b006eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.075+0000 7f24b77fe700 1 -- 172.21.15.6:0/3095911163 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f24b808b820 con 0x7f24c40fe250 2024-03-12T16:14:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.075+0000 7f24ca539700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f24b006c6a0 0x7f24b006eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:14.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.075+0000 7f24ca539700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f24b006c6a0 0x7f24b006eb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f24c00047f0 tx=0x7f24c0009cb0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:14.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.079+0000 7f24b77fe700 1 -- 172.21.15.6:0/3095911163 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f24b8059920 con 0x7f24c40fe250 2024-03-12T16:14:14.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.295+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712", "target": ["mon-mgr", ""]}) v1 -- 0x7f24c41097f0 con 0x7f24b006c6a0 2024-03-12T16:14:14.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.302+0000 7f24b77fe700 1 -- 172.21.15.6:0/3095911163 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+89 (secure 0 0 0) 0x7f24c41097f0 con 0x7f24b006c6a0 2024-03-12T16:14:14.303 INFO:teuthology.orchestra.run.smithi006.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f24b006c6a0 msgr2=0x7f24b006eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f24b006c6a0 0x7f24b006eb60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f24c00047f0 tx=0x7f24c0009cb0).stop 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fe250 msgr2=0x7f24c410e5f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fe250 0x7f24c410e5f0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f24b800b480 tx=0x7f24b80090f0).stop 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 shutdown_connections 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f24b006c6a0 0x7f24b006eb60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24c40fd8f0 0x7f24c410e100 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 --2- 172.21.15.6:0/3095911163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24c40fe250 0x7f24c410e5f0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 >> 172.21.15.6:0/3095911163 conn(0x7f24c40f34b0 msgr2=0x7f24c40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.304+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 shutdown_connections 2024-03-12T16:14:14.306 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:14.305+0000 7f24cc79d700 1 -- 172.21.15.6:0/3095911163 wait complete. 2024-03-12T16:14:15.017 INFO:teuthology.task.sequential:In sequential, running task cephadm.shell... 2024-03-12T16:14:15.017 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:14:15.017 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph fs dump; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done' 2024-03-12T16:14:15.636 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:14.297012+0000 mgr.smithi006.kskdce (mgr.14664) 128 : audit [DBG] from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:15.637 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:14:14.297539+0000 mgr.smithi006.kskdce (mgr.14664) 129 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:14:15.637 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:14.301643+0000 mon.smithi006 (mon.0) 908 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:15.637 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:14.305990+0000 mon.smithi134 (mon.1) 168 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:15.637 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:14.722836+0000 mon.smithi134 (mon.1) 169 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:15.637 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:14.723714+0000 mon.smithi134 (mon.1) 170 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:14:15.637 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:14.728924+0000 mon.smithi006 (mon.0) 909 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:15.637 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:14:14.866292+0000 mgr.smithi006.kskdce (mgr.14664) 130 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:14:15.637 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:15 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:15.098920+0000 mgr.smithi006.kskdce (mgr.14664) 131 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:14.297012+0000 mgr.smithi006.kskdce (mgr.14664) 128 : audit [DBG] from='client.14792 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:14.297539+0000 mgr.smithi006.kskdce (mgr.14664) 129 : cephadm [INF] Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:14:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:14.301643+0000 mon.smithi006 (mon.0) 908 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:14.305990+0000 mon.smithi134 (mon.1) 168 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:14.722836+0000 mon.smithi134 (mon.1) 169 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:14.723714+0000 mon.smithi134 (mon.1) 170 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:14:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:14.728924+0000 mon.smithi006 (mon.0) 909 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:14.866292+0000 mgr.smithi006.kskdce (mgr.14664) 130 : cephadm [INF] Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:14:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:15.098920+0000 mgr.smithi006.kskdce (mgr.14664) 131 : cluster [DBG] pgmap v75: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:18.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.043+0000 7f19dcc8d700 1 -- 172.21.15.6:0/3864286678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fc7f0 msgr2=0x7f19d80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.043+0000 7f19dcc8d700 1 --2- 172.21.15.6:0/3864286678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fc7f0 0x7f19d80fcbd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f19c8004870 tx=0x7f19c8009cb0).stop 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.043+0000 7f19dcc8d700 1 -- 172.21.15.6:0/3864286678 shutdown_connections 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.043+0000 7f19dcc8d700 1 --2- 172.21.15.6:0/3864286678 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19d80fd150 0x7f19d80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.043+0000 7f19dcc8d700 1 --2- 172.21.15.6:0/3864286678 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fc7f0 0x7f19d80fcbd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.043+0000 7f19dcc8d700 1 -- 172.21.15.6:0/3864286678 >> 172.21.15.6:0/3864286678 conn(0x7f19d8070590 msgr2=0x7f19d80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.043+0000 7f19dcc8d700 1 -- 172.21.15.6:0/3864286678 shutdown_connections 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.043+0000 7f19dcc8d700 1 -- 172.21.15.6:0/3864286678 wait complete. 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.044+0000 7f19dcc8d700 1 Processor -- start 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.044+0000 7f19dcc8d700 1 -- start start 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.044+0000 7f19dcc8d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19d80fc7f0 0x7f19d810c050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.044+0000 7f19dcc8d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fd150 0x7f19d810c540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:18.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.044+0000 7f19dcc8d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d810cb40 con 0x7f19d80fd150 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.044+0000 7f19dcc8d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19d810cc80 con 0x7f19d80fc7f0 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.044+0000 7f19cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fd150 0x7f19d810c540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fd150 0x7f19d810c540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57016/0 (socket says 172.21.15.6:57016) 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19cffff700 1 -- 172.21.15.6:0/728688546 learned_addr learned my addr 172.21.15.6:0/728688546 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19d659c700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19d80fc7f0 0x7f19d810c050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19cffff700 1 -- 172.21.15.6:0/728688546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19d80fc7f0 msgr2=0x7f19d810c050 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19cffff700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19d80fc7f0 0x7f19d810c050 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19cffff700 1 -- 172.21.15.6:0/728688546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19c8005040 con 0x7f19d80fd150 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19cffff700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fd150 0x7f19d810c540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f19c000e8c0 tx=0x7f19c000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19cf7fe700 1 -- 172.21.15.6:0/728688546 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c0007b40 con 0x7f19d80fd150 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19d8106310 con 0x7f19d80fd150 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19cf7fe700 1 -- 172.21.15.6:0/728688546 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19c000f040 con 0x7f19d80fd150 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19cf7fe700 1 -- 172.21.15.6:0/728688546 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c0014830 con 0x7f19d80fd150 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.045+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19d81068d0 con 0x7f19d80fd150 2024-03-12T16:14:18.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.046+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19d805f590 con 0x7f19d80fd150 2024-03-12T16:14:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.047+0000 7f19cf7fe700 1 -- 172.21.15.6:0/728688546 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f19c0014af0 con 0x7f19d80fd150 2024-03-12T16:14:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.047+0000 7f19cf7fe700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f19c406c6a0 0x7f19c406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.047+0000 7f19cf7fe700 1 -- 172.21.15.6:0/728688546 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f19c008b220 con 0x7f19d80fd150 2024-03-12T16:14:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.047+0000 7f19d659c700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f19c406c6a0 0x7f19c406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.048+0000 7f19d659c700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f19c406c6a0 0x7f19c406eb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f19c8005010 tx=0x7f19c8009cb0).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:18.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.052+0000 7f19cf7fe700 1 -- 172.21.15.6:0/728688546 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f19c00593e0 con 0x7f19d80fd150 2024-03-12T16:14:18.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.271+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19d8106af0 con 0x7f19c406c6a0 2024-03-12T16:14:18.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.272+0000 7f19cf7fe700 1 -- 172.21.15.6:0/728688546 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f19d8106af0 con 0x7f19c406c6a0 2024-03-12T16:14:18.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f19c406c6a0 msgr2=0x7f19c406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f19c406c6a0 0x7f19c406eb60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f19c8005010 tx=0x7f19c8009cb0).stop 2024-03-12T16:14:18.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fd150 msgr2=0x7f19d810c540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fd150 0x7f19d810c540 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7f19c000e8c0 tx=0x7f19c000b040).stop 2024-03-12T16:14:18.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 shutdown_connections 2024-03-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f19c406c6a0 0x7f19c406eb60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19d80fc7f0 0x7f19d810c050 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 --2- 172.21.15.6:0/728688546 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19d80fd150 0x7f19d810c540 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 >> 172.21.15.6:0/728688546 conn(0x7f19d8070590 msgr2=0x7f19d80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 shutdown_connections 2024-03-12T16:14:18.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.274+0000 7f19dcc8d700 1 -- 172.21.15.6:0/728688546 wait complete. 2024-03-12T16:14:18.286 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:14:18.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:17.040600+0000 mon.smithi006 (mon.0) 910 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:18.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:14:17.041485+0000 mgr.smithi006.kskdce (mgr.14664) 132 : cephadm [INF] Upgrade: Target is version 18.2.2-797-g49e4a679 (reef) 2024-03-12T16:14:18.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:14:17.041555+0000 mgr.smithi006.kskdce (mgr.14664) 133 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846, digests ['quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846'] 2024-03-12T16:14:18.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:17.042527+0000 mon.smithi134 (mon.1) 171 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:18.313 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:17.050789+0000 mon.smithi006 (mon.0) 911 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:18.314 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:17.052893+0000 mon.smithi134 (mon.1) 172 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:14:18.314 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:14:17.053930+0000 mgr.smithi006.kskdce (mgr.14664) 134 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-03-12T16:14:18.314 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:17.058177+0000 mon.smithi006 (mon.0) 912 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:18.314 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:17.062083+0000 mon.smithi134 (mon.1) 173 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-12T16:14:18.314 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:18 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:17.099347+0000 mgr.smithi006.kskdce (mgr.14664) 135 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.385+0000 7f49d63a0700 1 -- 172.21.15.6:0/121550842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 msgr2=0x7f49d00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.385+0000 7f49d63a0700 1 --2- 172.21.15.6:0/121550842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 0x7f49d00fcc10 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7f49c00047f0 tx=0x7f49c0009cb0).stop 2024-03-12T16:14:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.385+0000 7f49d63a0700 1 -- 172.21.15.6:0/121550842 shutdown_connections 2024-03-12T16:14:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.385+0000 7f49d63a0700 1 --2- 172.21.15.6:0/121550842 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d00fd190 0x7f49d00f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:14:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.385+0000 7f49d63a0700 1 --2- 172.21.15.6:0/121550842 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 0x7f49d00fcc10 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.385+0000 7f49d63a0700 1 -- 172.21.15.6:0/121550842 >> 172.21.15.6:0/121550842 conn(0x7f49d006c760 msgr2=0x7f49d006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.385+0000 7f49d63a0700 1 -- 172.21.15.6:0/121550842 shutdown_connections 2024-03-12T16:14:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.385+0000 7f49d63a0700 1 -- 172.21.15.6:0/121550842 wait complete. 2024-03-12T16:14:18.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.386+0000 7f49d63a0700 1 Processor -- start 2024-03-12T16:14:18.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.386+0000 7f49d63a0700 1 -- start start 2024-03-12T16:14:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.386+0000 7f49d63a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 0x7f49d0110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.386+0000 7f49d63a0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d00fd190 0x7f49d0110740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.386+0000 7f49d63a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d0110dd0 con 0x7f49d00fc830 2024-03-12T16:14:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.386+0000 7f49d63a0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49d010a3f0 con 0x7f49d00fd190 2024-03-12T16:14:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.386+0000 7f49cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 0x7f49d0110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.386+0000 7f49cffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 0x7f49d0110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57044/0 (socket says 172.21.15.6:57044) 2024-03-12T16:14:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.386+0000 7f49cffff700 1 -- 172.21.15.6:0/2812384088 learned_addr learned my addr 172.21.15.6:0/2812384088 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49cf7fe700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d00fd190 0x7f49d0110740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:18.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49cffff700 1 -- 172.21.15.6:0/2812384088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d00fd190 msgr2=0x7f49d0110740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49cffff700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d00fd190 0x7f49d0110740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49cffff700 1 -- 172.21.15.6:0/2812384088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49c0005040 con 0x7f49d00fc830 2024-03-12T16:14:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49cffff700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 0x7f49d0110250 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f49c000b120 tx=0x7f49c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49cd7fa700 1 -- 172.21.15.6:0/2812384088 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c000e030 con 0x7f49d00fc830 2024-03-12T16:14:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49cd7fa700 1 -- 172.21.15.6:0/2812384088 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49c0007e90 con 0x7f49d00fc830 2024-03-12T16:14:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49d010a640 con 0x7f49d00fc830 2024-03-12T16:14:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49cd7fa700 1 -- 172.21.15.6:0/2812384088 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49c0018070 con 0x7f49d00fc830 2024-03-12T16:14:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.387+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49d010ab20 con 0x7f49d00fc830 2024-03-12T16:14:18.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.388+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49d005f570 con 0x7f49d00fc830 2024-03-12T16:14:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.388+0000 7f49cd7fa700 1 -- 172.21.15.6:0/2812384088 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f49c001d420 con 0x7f49d00fc830 2024-03-12T16:14:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.389+0000 7f49cd7fa700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f49b806c6a0 0x7f49b806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.389+0000 7f49cd7fa700 1 -- 172.21.15.6:0/2812384088 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f49c008cc00 con 0x7f49d00fc830 2024-03-12T16:14:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.389+0000 7f49cf7fe700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f49b806c6a0 0x7f49b806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:18.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.389+0000 7f49cf7fe700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f49b806c6a0 0x7f49b806eb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f49d010bb90 tx=0x7f49c4008040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:18.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.394+0000 7f49cd7fa700 1 -- 172.21.15.6:0/2812384088 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f49c0092020 con 0x7f49d00fc830 2024-03-12T16:14:18.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:17.040600+0000 mon.smithi006 (mon.0) 910 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:18.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:17.041485+0000 mgr.smithi006.kskdce (mgr.14664) 132 : cephadm [INF] Upgrade: Target is version 18.2.2-797-g49e4a679 (reef) 2024-03-12T16:14:18.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:17.041555+0000 mgr.smithi006.kskdce (mgr.14664) 133 : cephadm [INF] Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846, digests ['quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846'] 2024-03-12T16:14:18.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:17.042527+0000 mon.smithi134 (mon.1) 171 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:18.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:17.050789+0000 mon.smithi006 (mon.0) 911 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:18.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:17.052893+0000 mon.smithi134 (mon.1) 172 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:14:18.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:17.053930+0000 mgr.smithi006.kskdce (mgr.14664) 134 : cephadm [INF] Upgrade: Setting container_image for all mgr 2024-03-12T16:14:18.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:17.058177+0000 mon.smithi006 (mon.0) 912 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:18.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:17.062083+0000 mon.smithi134 (mon.1) 173 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-12T16:14:18.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:17.099347+0000 mgr.smithi006.kskdce (mgr.14664) 135 : cluster [DBG] pgmap v76: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:18.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.626+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49d010b940 con 0x7f49b806c6a0 2024-03-12T16:14:18.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.628+0000 7f49cd7fa700 1 -- 172.21.15.6:0/2812384088 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f49d010b940 con 0x7f49b806c6a0 2024-03-12T16:14:18.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f49b806c6a0 msgr2=0x7f49b806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f49b806c6a0 0x7f49b806eb60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f49d010bb90 tx=0x7f49c4008040).stop 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 msgr2=0x7f49d0110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 0x7f49d0110250 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f49c000b120 tx=0x7f49c0009cb0).stop 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 shutdown_connections 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f49b806c6a0 0x7f49b806eb60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49d00fc830 0x7f49d0110250 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 --2- 172.21.15.6:0/2812384088 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49d00fd190 0x7f49d0110740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 >> 172.21.15.6:0/2812384088 conn(0x7f49d006c760 msgr2=0x7f49d0060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 shutdown_connections 2024-03-12T16:14:18.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.630+0000 7f49d63a0700 1 -- 172.21.15.6:0/2812384088 wait complete. 2024-03-12T16:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.744+0000 7f6bc45c2700 1 -- 172.21.15.6:0/856405251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 msgr2=0x7f6bbc0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.744+0000 7f6bc45c2700 1 --2- 172.21.15.6:0/856405251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 0x7f6bbc0fdcf0 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f6bac0047f0 tx=0x7f6bac009cb0).stop 2024-03-12T16:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.744+0000 7f6bc45c2700 1 -- 172.21.15.6:0/856405251 shutdown_connections 2024-03-12T16:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.744+0000 7f6bc45c2700 1 --2- 172.21.15.6:0/856405251 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bbc0fe270 0x7f6bbc0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.744+0000 7f6bc45c2700 1 --2- 172.21.15.6:0/856405251 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 0x7f6bbc0fdcf0 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.744+0000 7f6bc45c2700 1 -- 172.21.15.6:0/856405251 >> 172.21.15.6:0/856405251 conn(0x7f6bbc0f3530 msgr2=0x7f6bbc0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.744+0000 7f6bc45c2700 1 -- 172.21.15.6:0/856405251 shutdown_connections 2024-03-12T16:14:18.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.744+0000 7f6bc45c2700 1 -- 172.21.15.6:0/856405251 wait complete. 2024-03-12T16:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc45c2700 1 Processor -- start 2024-03-12T16:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc45c2700 1 -- start start 2024-03-12T16:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc45c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 0x7f6bbc10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc45c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bbc0fe270 0x7f6bbc10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc45c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc10ead0 con 0x7f6bbc0fd910 2024-03-12T16:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc45c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6bbc10ec10 con 0x7f6bbc0fe270 2024-03-12T16:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc235e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 0x7f6bbc10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc235e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 0x7f6bbc10dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57050/0 (socket says 172.21.15.6:57050) 2024-03-12T16:14:18.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc235e700 1 -- 172.21.15.6:0/2266282629 learned_addr learned my addr 172.21.15.6:0/2266282629 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc1b5d700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bbc0fe270 0x7f6bbc10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.745+0000 7f6bc235e700 1 -- 172.21.15.6:0/2266282629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bbc0fe270 msgr2=0x7f6bbc10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.746+0000 7f6bc235e700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bbc0fe270 0x7f6bbc10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.746+0000 7f6bc235e700 1 -- 172.21.15.6:0/2266282629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bac005040 con 0x7f6bbc0fd910 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.746+0000 7f6bc235e700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 0x7f6bbc10dfe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f6bac005010 tx=0x7f6bac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.746+0000 7f6bb37fe700 1 -- 172.21.15.6:0/2266282629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bac00e030 con 0x7f6bbc0fd910 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.746+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6bbc108240 con 0x7f6bbc0fd910 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.746+0000 7f6bb37fe700 1 -- 172.21.15.6:0/2266282629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6bac007e90 con 0x7f6bbc0fd910 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.746+0000 7f6bb37fe700 1 -- 172.21.15.6:0/2266282629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6bac018070 con 0x7f6bbc0fd910 2024-03-12T16:14:18.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.746+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6bbc1087a0 con 0x7f6bbc0fd910 2024-03-12T16:14:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.747+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6bbc05f570 con 0x7f6bbc0fd910 2024-03-12T16:14:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.747+0000 7f6bb37fe700 1 -- 172.21.15.6:0/2266282629 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f6bac01d670 con 0x7f6bbc0fd910 2024-03-12T16:14:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.748+0000 7f6bb37fe700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f6ba806c6a0 0x7f6ba806eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.748+0000 7f6bb37fe700 1 -- 172.21.15.6:0/2266282629 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f6bac08c9d0 con 0x7f6bbc0fd910 2024-03-12T16:14:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.748+0000 7f6bc1b5d700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f6ba806c6a0 0x7f6ba806eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:18.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.748+0000 7f6bc1b5d700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f6ba806c6a0 0x7f6ba806eb60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6bbc109920 tx=0x7f6bb800b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:18.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.752+0000 7f6bb37fe700 1 -- 172.21.15.6:0/2266282629 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f6bac05aad0 con 0x7f6bbc0fd910 2024-03-12T16:14:18.963 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.962+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f6bbc0ffc60 con 0x7f6ba806c6a0 2024-03-12T16:14:18.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.972+0000 7f6bb37fe700 1 -- 172.21.15.6:0/2266282629 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f6bbc0ffc60 con 0x7f6ba806c6a0 2024-03-12T16:14:18.973 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (65s) 44s ago 12m 16.7M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (12m) 44s ago 12m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (11m) 60s ago 11m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (49s) 44s ago 11m 36.5M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (6m) 44s ago 6m 125M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (6m) 44s ago 6m 14.3M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (6m) 60s ago 6m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (6m) 60s ago 6m 17.0M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (2m) 44s ago 13m 497M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (119s) 60s ago 11m 446M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:14:18.974 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (13m) 44s ago 13m 57.9M 2048M 16.2.15-1-g8963e9de 727f386679cb 0a9d6f3ef42c 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (11m) 60s ago 11m 49.5M 2048M 16.2.15-1-g8963e9de 727f386679cb 6f04fa39fa4e 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (104s) 44s ago 11m 9231k - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (97s) 60s ago 10m 13.0M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (10m) 44s ago 10m 217M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (10m) 44s ago 10m 235M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (9m) 44s ago 9m 194M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (9m) 60s ago 9m 264M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (8m) 60s ago 8m 236M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (8m) 60s ago 8m 226M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:14:18.975 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (80s) 60s ago 10m 44.2M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:14:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f6ba806c6a0 msgr2=0x7f6ba806eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f6ba806c6a0 0x7f6ba806eb60 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f6bbc109920 tx=0x7f6bb800b040).stop 2024-03-12T16:14:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 msgr2=0x7f6bbc10dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 0x7f6bbc10dfe0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7f6bac005010 tx=0x7f6bac009cb0).stop 2024-03-12T16:14:18.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 shutdown_connections 2024-03-12T16:14:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f6ba806c6a0 0x7f6ba806eb60 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6bbc0fd910 0x7f6bbc10dfe0 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 --2- 172.21.15.6:0/2266282629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6bbc0fe270 0x7f6bbc10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 >> 172.21.15.6:0/2266282629 conn(0x7f6bbc0f3530 msgr2=0x7f6bbc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.974+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 shutdown_connections 2024-03-12T16:14:18.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:18.975+0000 7f6bc45c2700 1 -- 172.21.15.6:0/2266282629 wait complete. 2024-03-12T16:14:19.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.075+0000 7fa7f5684700 1 -- 172.21.15.6:0/2617096853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f6fc0 msgr2=0x7fa7f0103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.075+0000 7fa7f5684700 1 --2- 172.21.15.6:0/2617096853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f6fc0 0x7fa7f0103d60 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fa7d8004820 tx=0x7fa7d8009cb0).stop 2024-03-12T16:14:19.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.075+0000 7fa7f5684700 1 -- 172.21.15.6:0/2617096853 shutdown_connections 2024-03-12T16:14:19.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.075+0000 7fa7f5684700 1 --2- 172.21.15.6:0/2617096853 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f6fc0 0x7fa7f0103d60 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.075+0000 7fa7f5684700 1 --2- 172.21.15.6:0/2617096853 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f00f66f0 0x7fa7f00f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.075+0000 7fa7f5684700 1 -- 172.21.15.6:0/2617096853 >> 172.21.15.6:0/2617096853 conn(0x7fa7f0070590 msgr2=0x7fa7f00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.075+0000 7fa7f5684700 1 -- 172.21.15.6:0/2617096853 shutdown_connections 2024-03-12T16:14:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.075+0000 7fa7f5684700 1 -- 172.21.15.6:0/2617096853 wait complete. 2024-03-12T16:14:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.076+0000 7fa7f5684700 1 Processor -- start 2024-03-12T16:14:19.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.076+0000 7fa7f5684700 1 -- start start 2024-03-12T16:14:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.076+0000 7fa7f5684700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f66f0 0x7fa7f01102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.076+0000 7fa7f5684700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f00f6fc0 0x7fa7f01107e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.076+0000 7fa7f5684700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0110de0 con 0x7fa7f00f66f0 2024-03-12T16:14:19.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.076+0000 7fa7f5684700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa7f0110f20 con 0x7fa7f00f6fc0 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.076+0000 7fa7eeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f66f0 0x7fa7f01102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.076+0000 7fa7eeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f66f0 0x7fa7f01102f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57072/0 (socket says 172.21.15.6:57072) 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.076+0000 7fa7eeffd700 1 -- 172.21.15.6:0/533001149 learned_addr learned my addr 172.21.15.6:0/533001149 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7ee7fc700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f00f6fc0 0x7fa7f01107e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7eeffd700 1 -- 172.21.15.6:0/533001149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f00f6fc0 msgr2=0x7fa7f01107e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7eeffd700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f00f6fc0 0x7fa7f01107e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7eeffd700 1 -- 172.21.15.6:0/533001149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa7d8005040 con 0x7fa7f00f66f0 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7eeffd700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f66f0 0x7fa7f01102f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fa7e000c790 tx=0x7fa7e0004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7e7fff700 1 -- 172.21.15.6:0/533001149 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e00106f0 con 0x7fa7f00f66f0 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa7f010a5b0 con 0x7fa7f00f66f0 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7e7fff700 1 -- 172.21.15.6:0/533001149 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa7e0010d00 con 0x7fa7f00f66f0 2024-03-12T16:14:19.081 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7e7fff700 1 -- 172.21.15.6:0/533001149 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa7e0012da0 con 0x7fa7f00f66f0 2024-03-12T16:14:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.077+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa7f010aaf0 con 0x7fa7f00f66f0 2024-03-12T16:14:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.078+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa7f005f590 con 0x7fa7f00f66f0 2024-03-12T16:14:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.079+0000 7fa7e7fff700 1 -- 172.21.15.6:0/533001149 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7fa7e0012400 con 0x7fa7f00f66f0 2024-03-12T16:14:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.079+0000 7fa7e7fff700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa7dc06c6a0 0x7fa7dc06eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.079+0000 7fa7e7fff700 1 -- 172.21.15.6:0/533001149 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fa7e008b050 con 0x7fa7f00f66f0 2024-03-12T16:14:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.079+0000 7fa7ee7fc700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa7dc06c6a0 0x7fa7dc06eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:19.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.080+0000 7fa7ee7fc700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa7dc06c6a0 0x7fa7dc06eb60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa7d8005010 tx=0x7fa7d800b040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:19.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.084+0000 7fa7e7fff700 1 -- 172.21.15.6:0/533001149 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fa7e0059150 con 0x7fa7f00f66f0 2024-03-12T16:14:19.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.365+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa7f0047540 con 0x7fa7f00f66f0 2024-03-12T16:14:19.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.365+0000 7fa7e7fff700 1 -- 172.21.15.6:0/533001149 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+741 (secure 0 0 0) 0x7fa7e0058ce0 con 0x7fa7f00f66f0 2024-03-12T16:14:19.367 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:14:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:14:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2 2024-03-12T16:14:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:14:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:14:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:14:19.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 12, 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:14:19.368 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:14:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.367+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa7dc06c6a0 msgr2=0x7fa7dc06eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.367+0000 7fa7f5684700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa7dc06c6a0 0x7fa7dc06eb60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fa7d8005010 tx=0x7fa7d800b040).stop 2024-03-12T16:14:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.367+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f66f0 msgr2=0x7fa7f01102f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.368+0000 7fa7f5684700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f66f0 0x7fa7f01102f0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fa7e000c790 tx=0x7fa7e0004330).stop 2024-03-12T16:14:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.368+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 shutdown_connections 2024-03-12T16:14:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.368+0000 7fa7f5684700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa7dc06c6a0 0x7fa7dc06eb60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.368+0000 7fa7f5684700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7f00f66f0 0x7fa7f01102f0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.368+0000 7fa7f5684700 1 --2- 172.21.15.6:0/533001149 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7f00f6fc0 0x7fa7f01107e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.368+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 >> 172.21.15.6:0/533001149 conn(0x7fa7f0070590 msgr2=0x7fa7f006d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:19.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.368+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 shutdown_connections 2024-03-12T16:14:19.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.368+0000 7fa7f5684700 1 -- 172.21.15.6:0/533001149 wait complete. 2024-03-12T16:14:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.475+0000 7f35599b7700 1 -- 172.21.15.6:0/2564511828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 msgr2=0x7f35540fcc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.475+0000 7f35599b7700 1 --2- 172.21.15.6:0/2564511828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 0x7f35540fcc50 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7f35440047f0 tx=0x7f3544009cb0).stop 2024-03-12T16:14:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.475+0000 7f35599b7700 1 -- 172.21.15.6:0/2564511828 shutdown_connections 2024-03-12T16:14:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.475+0000 7f35599b7700 1 --2- 172.21.15.6:0/2564511828 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35540fd140 0x7f35540f7090 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.475+0000 7f35599b7700 1 --2- 172.21.15.6:0/2564511828 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 0x7f35540fcc50 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.475+0000 7f35599b7700 1 -- 172.21.15.6:0/2564511828 >> 172.21.15.6:0/2564511828 conn(0x7f355406ce40 msgr2=0x7f355406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.476+0000 7f35599b7700 1 -- 172.21.15.6:0/2564511828 shutdown_connections 2024-03-12T16:14:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.476+0000 7f35599b7700 1 -- 172.21.15.6:0/2564511828 wait complete. 2024-03-12T16:14:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.476+0000 7f35599b7700 1 Processor -- start 2024-03-12T16:14:19.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.476+0000 7f35599b7700 1 -- start start 2024-03-12T16:14:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f35599b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 0x7f3554110250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f35599b7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35540fd140 0x7f3554110740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f35599b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3554110d40 con 0x7f35540fc870 2024-03-12T16:14:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f35599b7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3554110e80 con 0x7f35540fd140 2024-03-12T16:14:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f3552ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 0x7f3554110250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:19.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f3552ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 0x7f3554110250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57086/0 (socket says 172.21.15.6:57086) 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f3552ffd700 1 -- 172.21.15.6:0/3125986201 learned_addr learned my addr 172.21.15.6:0/3125986201 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f35527fc700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35540fd140 0x7f3554110740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f3552ffd700 1 -- 172.21.15.6:0/3125986201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35540fd140 msgr2=0x7f3554110740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f3552ffd700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35540fd140 0x7f3554110740 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f3552ffd700 1 -- 172.21.15.6:0/3125986201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3544005040 con 0x7f35540fc870 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f35527fc700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35540fd140 0x7f3554110740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f3552ffd700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 0x7f3554110250 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f3544005010 tx=0x7f3544009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f353bfff700 1 -- 172.21.15.6:0/3125986201 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f354400e030 con 0x7f35540fc870 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f355410a4b0 con 0x7f35540fc870 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f353bfff700 1 -- 172.21.15.6:0/3125986201 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3544007e90 con 0x7f35540fc870 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.477+0000 7f353bfff700 1 -- 172.21.15.6:0/3125986201 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3544018070 con 0x7f35540fc870 2024-03-12T16:14:19.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.478+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f355410aa10 con 0x7f35540fc870 2024-03-12T16:14:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.479+0000 7f353bfff700 1 -- 172.21.15.6:0/3125986201 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7f354401d6e0 con 0x7f35540fc870 2024-03-12T16:14:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.479+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3554060670 con 0x7f35540fc870 2024-03-12T16:14:19.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.479+0000 7f353bfff700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f353c06c630 0x7f353c06eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.480+0000 7f353bfff700 1 -- 172.21.15.6:0/3125986201 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7f354408c630 con 0x7f35540fc870 2024-03-12T16:14:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.480+0000 7f35527fc700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f353c06c630 0x7f353c06eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:19.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.480+0000 7f35527fc700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f353c06c630 0x7f353c06eaf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f355410bb90 tx=0x7f3548009d60).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:19.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.485+0000 7f353bfff700 1 -- 172.21.15.6:0/3125986201 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7f354405a730 con 0x7f35540fc870 2024-03-12T16:14:19.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.739+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f355410b070 con 0x7f35540fc870 2024-03-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.739+0000 7f353bfff700 1 -- 172.21.15.6:0/3125986201 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 14 v14) v1 ==== 76+0+1805 (secure 0 0 0) 0x7f354405a2c0 con 0x7f35540fc870 2024-03-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi006.stdout:e14 2024-03-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:14:19.741 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 14 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:10:47.693652+0000 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:14:19.742 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:19.743 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:14:19.744 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:14:19.744 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:14:19.744 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:14:19.744 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:19.744 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:19.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f353c06c630 msgr2=0x7f353c06eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f353c06c630 0x7f353c06eaf0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f355410bb90 tx=0x7f3548009d60).stop 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 msgr2=0x7f3554110250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 0x7f3554110250 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7f3544005010 tx=0x7f3544009cb0).stop 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 shutdown_connections 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7f353c06c630 0x7f353c06eaf0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f35540fc870 0x7f3554110250 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 --2- 172.21.15.6:0/3125986201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f35540fd140 0x7f3554110740 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 >> 172.21.15.6:0/3125986201 conn(0x7f355406ce40 msgr2=0x7f35540f5af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 shutdown_connections 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.741+0000 7f35599b7700 1 -- 172.21.15.6:0/3125986201 wait complete. 2024-03-12T16:14:19.745 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 14 2024-03-12T16:14:19.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.846+0000 7fa6263e3700 1 -- 172.21.15.6:0/1309598188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 msgr2=0x7fa6200fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.846+0000 7fa6263e3700 1 --2- 172.21.15.6:0/1309598188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 0x7fa6200fcbd0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7fa6100047f0 tx=0x7fa610009cb0).stop 2024-03-12T16:14:19.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.846+0000 7fa6263e3700 1 -- 172.21.15.6:0/1309598188 shutdown_connections 2024-03-12T16:14:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.846+0000 7fa6263e3700 1 --2- 172.21.15.6:0/1309598188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6200fd150 0x7fa6200f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.846+0000 7fa6263e3700 1 --2- 172.21.15.6:0/1309598188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 0x7fa6200fcbd0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.846+0000 7fa6263e3700 1 -- 172.21.15.6:0/1309598188 >> 172.21.15.6:0/1309598188 conn(0x7fa620070590 msgr2=0x7fa6200f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.847+0000 7fa6263e3700 1 -- 172.21.15.6:0/1309598188 shutdown_connections 2024-03-12T16:14:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.847+0000 7fa6263e3700 1 -- 172.21.15.6:0/1309598188 wait complete. 2024-03-12T16:14:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.847+0000 7fa6263e3700 1 Processor -- start 2024-03-12T16:14:19.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.847+0000 7fa6263e3700 1 -- start start 2024-03-12T16:14:19.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa6263e3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 0x7fa6200f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa6263e3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6200fd150 0x7fa6200f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa6263e3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200f8f20 con 0x7fa6200fc7f0 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa6263e3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa6200f9060 con 0x7fa6200fd150 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 0x7fa6200f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 0x7fa6200f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57100/0 (socket says 172.21.15.6:57100) 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61ffff700 1 -- 172.21.15.6:0/1749702109 learned_addr learned my addr 172.21.15.6:0/1749702109 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61f7fe700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6200fd150 0x7fa6200f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61ffff700 1 -- 172.21.15.6:0/1749702109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6200fd150 msgr2=0x7fa6200f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61ffff700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6200fd150 0x7fa6200f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61ffff700 1 -- 172.21.15.6:0/1749702109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa610005040 con 0x7fa6200fc7f0 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61f7fe700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6200fd150 0x7fa6200f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61ffff700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 0x7fa6200f8540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fa610005010 tx=0x7fa610009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:19.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61d7fa700 1 -- 172.21.15.6:0/1749702109 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61000e030 con 0x7fa6200fc7f0 2024-03-12T16:14:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6200f92b0 con 0x7fa6200fc7f0 2024-03-12T16:14:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61d7fa700 1 -- 172.21.15.6:0/1749702109 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa610007e90 con 0x7fa6200fc7f0 2024-03-12T16:14:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.848+0000 7fa61d7fa700 1 -- 172.21.15.6:0/1749702109 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa610018070 con 0x7fa6200fc7f0 2024-03-12T16:14:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.849+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6201145d0 con 0x7fa6200fc7f0 2024-03-12T16:14:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.850+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa62005f590 con 0x7fa6200fc7f0 2024-03-12T16:14:19.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.850+0000 7fa61d7fa700 1 -- 172.21.15.6:0/1749702109 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7fa61001d6e0 con 0x7fa6200fc7f0 2024-03-12T16:14:19.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.851+0000 7fa61d7fa700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa60806c630 0x7fa60806eaf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:19.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.851+0000 7fa61d7fa700 1 -- 172.21.15.6:0/1749702109 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fa61008cac0 con 0x7fa6200fc7f0 2024-03-12T16:14:19.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.851+0000 7fa61f7fe700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa60806c630 0x7fa60806eaf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:19.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.851+0000 7fa61f7fe700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa60806c630 0x7fa60806eaf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa6200f9ce0 tx=0x7fa614009d60).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:19.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:19.855+0000 7fa61d7fa700 1 -- 172.21.15.6:0/1749702109 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fa610057070 con 0x7fa6200fc7f0 2024-03-12T16:14:19.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:18.272385+0000 mgr.smithi006.kskdce (mgr.14664) 136 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:19.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:18.628000+0000 mgr.smithi006.kskdce (mgr.14664) 137 : audit [DBG] from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:19.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:18.963675+0000 mgr.smithi006.kskdce (mgr.14664) 138 : audit [DBG] from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:19.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cluster 2024-03-12T16:14:19.099720+0000 mgr.smithi006.kskdce (mgr.14664) 139 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:19.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:19.366052+0000 mon.smithi006 (mon.0) 913 : audit [DBG] from='client.? 172.21.15.6:0/533001149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:14:19.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:19.435617+0000 mon.smithi006 (mon.0) 914 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:19.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:19.437193+0000 mon.smithi134 (mon.1) 174 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:14:19.961 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:19.437854+0000 mon.smithi134 (mon.1) 175 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:14:19.962 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:19 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:19.438605+0000 mon.smithi134 (mon.1) 176 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:20.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.074+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 --> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6200fb5a0 con 0x7fa60806c630 2024-03-12T16:14:20.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.075+0000 7fa61d7fa700 1 -- 172.21.15.6:0/1749702109 <== mgr.14664 v2:172.21.15.6:6800/2268121787 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7fa6200fb5a0 con 0x7fa60806c630 2024-03-12T16:14:20.076 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:14:20.076 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:14:20.076 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:14:20.076 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:14:20.076 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:14:20.076 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr" 2024-03-12T16:14:20.076 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:14:20.076 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "2/21 daemons upgraded", 2024-03-12T16:14:20.077 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mon daemons", 2024-03-12T16:14:20.077 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:14:20.077 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:14:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa60806c630 msgr2=0x7fa60806eaf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa60806c630 0x7fa60806eaf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa6200f9ce0 tx=0x7fa614009d60).stop 2024-03-12T16:14:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 msgr2=0x7fa6200f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 0x7fa6200f8540 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fa610005010 tx=0x7fa610009cb0).stop 2024-03-12T16:14:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 shutdown_connections 2024-03-12T16:14:20.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fa60806c630 0x7fa60806eaf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6200fc7f0 0x7fa6200f8540 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 --2- 172.21.15.6:0/1749702109 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6200fd150 0x7fa6200f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 >> 172.21.15.6:0/1749702109 conn(0x7fa620070590 msgr2=0x7fa620060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 shutdown_connections 2024-03-12T16:14:20.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.077+0000 7fa6263e3700 1 -- 172.21.15.6:0/1749702109 wait complete. 2024-03-12T16:14:20.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.179+0000 7fd640fd3700 1 -- 172.21.15.6:0/1464644558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 msgr2=0x7fd63c0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:20.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.179+0000 7fd640fd3700 1 --2- 172.21.15.6:0/1464644558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 0x7fd63c0fdcf0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fd62c0047f0 tx=0x7fd62c009cb0).stop 2024-03-12T16:14:20.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.180+0000 7fd640fd3700 1 -- 172.21.15.6:0/1464644558 shutdown_connections 2024-03-12T16:14:20.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.180+0000 7fd640fd3700 1 --2- 172.21.15.6:0/1464644558 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd63c0fe270 0x7fd63c0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:20.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.180+0000 7fd640fd3700 1 --2- 172.21.15.6:0/1464644558 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 0x7fd63c0fdcf0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:20.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.180+0000 7fd640fd3700 1 -- 172.21.15.6:0/1464644558 >> 172.21.15.6:0/1464644558 conn(0x7fd63c0f3530 msgr2=0x7fd63c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:20.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.180+0000 7fd640fd3700 1 -- 172.21.15.6:0/1464644558 shutdown_connections 2024-03-12T16:14:20.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.180+0000 7fd640fd3700 1 -- 172.21.15.6:0/1464644558 wait complete. 2024-03-12T16:14:20.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd640fd3700 1 Processor -- start 2024-03-12T16:14:20.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd640fd3700 1 -- start start 2024-03-12T16:14:20.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd640fd3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 0x7fd63c10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:20.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd640fd3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd63c0fe270 0x7fd63c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:20.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd640fd3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c10ead0 con 0x7fd63c0fd910 2024-03-12T16:14:20.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd640fd3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd63c10ec10 con 0x7fd63c0fe270 2024-03-12T16:14:20.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd63a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 0x7fd63c10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:20.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd63a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 0x7fd63c10dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57124/0 (socket says 172.21.15.6:57124) 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd63a59c700 1 -- 172.21.15.6:0/2072147982 learned_addr learned my addr 172.21.15.6:0/2072147982 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd639d9b700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd63c0fe270 0x7fd63c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=1 required=0 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd63a59c700 1 -- 172.21.15.6:0/2072147982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd63c0fe270 msgr2=0x7fd63c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd63a59c700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd63c0fe270 0x7fd63c10e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd63a59c700 1 -- 172.21.15.6:0/2072147982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd62c005040 con 0x7fd63c0fd910 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.181+0000 7fd63a59c700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 0x7fd63c10dfe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fd62c00b120 tx=0x7fd62c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.182+0000 7fd62b7fe700 1 -- 172.21.15.6:0/2072147982 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62c00e030 con 0x7fd63c0fd910 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.182+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd63c108240 con 0x7fd63c0fd910 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.182+0000 7fd62b7fe700 1 -- 172.21.15.6:0/2072147982 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd62c007e90 con 0x7fd63c0fd910 2024-03-12T16:14:20.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.182+0000 7fd62b7fe700 1 -- 172.21.15.6:0/2072147982 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd62c018070 con 0x7fd63c0fd910 2024-03-12T16:14:20.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.182+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd63c1087a0 con 0x7fd63c0fd910 2024-03-12T16:14:20.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.183+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd63c05f570 con 0x7fd63c0fd910 2024-03-12T16:14:20.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.184+0000 7fd62b7fe700 1 -- 172.21.15.6:0/2072147982 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 33) v1 ==== 90675+0+0 (secure 0 0 0) 0x7fd62c01d420 con 0x7fd63c0fd910 2024-03-12T16:14:20.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.184+0000 7fd62b7fe700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd62406c6a0 0x7fd62406eb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:20.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.184+0000 7fd62b7fe700 1 -- 172.21.15.6:0/2072147982 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(48..48 src has 1..48) v4 ==== 5789+0+0 (secure 0 0 0) 0x7fd62c08cf60 con 0x7fd63c0fd910 2024-03-12T16:14:20.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.184+0000 7fd639d9b700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd62406c6a0 0x7fd62406eb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:20.186 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.185+0000 7fd639d9b700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd62406c6a0 0x7fd62406eb60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd63c109920 tx=0x7fd630009040).ready entity=mgr.14664 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:20.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.188+0000 7fd62b7fe700 1 -- 172.21.15.6:0/2072147982 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+181002 (secure 0 0 0) 0x7fd62c05b060 con 0x7fd63c0fd910 2024-03-12T16:14:20.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:18.272385+0000 mgr.smithi006.kskdce (mgr.14664) 136 : audit [DBG] from='client.14796 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:20.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:18.628000+0000 mgr.smithi006.kskdce (mgr.14664) 137 : audit [DBG] from='client.14800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:20.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:18.963675+0000 mgr.smithi006.kskdce (mgr.14664) 138 : audit [DBG] from='client.14804 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:19.099720+0000 mgr.smithi006.kskdce (mgr.14664) 139 : cluster [DBG] pgmap v77: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:19.366052+0000 mon.smithi006 (mon.0) 913 : audit [DBG] from='client.? 172.21.15.6:0/533001149' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:14:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:19.435617+0000 mon.smithi006 (mon.0) 914 : audit [INF] from='mgr.14664 ' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:19.437193+0000 mon.smithi134 (mon.1) 174 : audit [INF] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:14:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:19.437854+0000 mon.smithi134 (mon.1) 175 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:14:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:19.438605+0000 mon.smithi134 (mon.1) 176 : audit [DBG] from='mgr.14664 172.21.15.6:0/2695370254' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:20.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.472+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd63c109760 con 0x7fd63c0fd910 2024-03-12T16:14:20.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.473+0000 7fd62b7fe700 1 -- 172.21.15.6:0/2072147982 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd62c05abf0 con 0x7fd63c0fd910 2024-03-12T16:14:20.474 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_OK 2024-03-12T16:14:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd62406c6a0 msgr2=0x7fd62406eb60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd62406c6a0 0x7fd62406eb60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7fd63c109920 tx=0x7fd630009040).stop 2024-03-12T16:14:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 msgr2=0x7fd63c10dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 0x7fd63c10dfe0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fd62c00b120 tx=0x7fd62c009cb0).stop 2024-03-12T16:14:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 shutdown_connections 2024-03-12T16:14:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:6800/2268121787,v1:172.21.15.6:6801/2268121787] conn(0x7fd62406c6a0 0x7fd62406eb60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:20.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd63c0fd910 0x7fd63c10dfe0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 --2- 172.21.15.6:0/2072147982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd63c0fe270 0x7fd63c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 >> 172.21.15.6:0/2072147982 conn(0x7fd63c0f3530 msgr2=0x7fd63c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 shutdown_connections 2024-03-12T16:14:20.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:20.475+0000 7fd640fd3700 1 -- 172.21.15.6:0/2072147982 wait complete. 2024-03-12T16:14:20.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:14:19.430377+0000 mgr.smithi006.kskdce (mgr.14664) 140 : cephadm [INF] Upgrade: Updating mon.smithi006 2024-03-12T16:14:20.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: cephadm 2024-03-12T16:14:19.439676+0000 mgr.smithi006.kskdce (mgr.14664) 141 : cephadm [INF] Deploying daemon mon.smithi006 on smithi006 2024-03-12T16:14:20.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:19.739723+0000 mon.smithi006 (mon.0) 915 : audit [DBG] from='client.? 172.21.15.6:0/3125986201' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:14:20.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:20.075203+0000 mgr.smithi006.kskdce (mgr.14664) 142 : audit [DBG] from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:20.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: audit 2024-03-12T16:14:20.473650+0000 mon.smithi006 (mon.0) 916 : audit [DBG] from='client.? 172.21.15.6:0/2072147982' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:14:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:19.430377+0000 mgr.smithi006.kskdce (mgr.14664) 140 : cephadm [INF] Upgrade: Updating mon.smithi006 2024-03-12T16:14:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:19.439676+0000 mgr.smithi006.kskdce (mgr.14664) 141 : cephadm [INF] Deploying daemon mon.smithi006 on smithi006 2024-03-12T16:14:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:19.739723+0000 mon.smithi006 (mon.0) 915 : audit [DBG] from='client.? 172.21.15.6:0/3125986201' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:14:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:20.075203+0000 mgr.smithi006.kskdce (mgr.14664) 142 : audit [DBG] from='client.14816 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:20.473650+0000 mon.smithi006 (mon.0) 916 : audit [DBG] from='client.? 172.21.15.6:0/2072147982' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:14:21.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:21 smithi006 systemd[1]: Stopping Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:14:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:14:21.502+0000 7f393c7eb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi006 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-12T16:14:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:21 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[39682]: debug 2024-03-12T16:14:21.502+0000 7f393c7eb700 -1 mon.smithi006@0(leader) e2 *** Got Signal Terminated *** 2024-03-12T16:14:22.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:22 smithi006 bash[103677]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006 2024-03-12T16:14:22.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:22 smithi006 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi006.service: Succeeded. 2024-03-12T16:14:22.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:22 smithi006 systemd[1]: Stopped Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:14:22.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:22 smithi006 systemd[1]: Starting Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:14:23.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: set uid:gid to 167:167 (ceph:ceph) 2024-03-12T16:14:23.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable), process ceph-mon, pid 7 2024-03-12T16:14:23.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: pidfile_write: ignore empty --pid-file 2024-03-12T16:14:23.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: load: jerasure load: lrc 2024-03-12T16:14:23.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: RocksDB version: 7.9.2 2024-03-12T16:14:23.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Git sha 0 2024-03-12T16:14:23.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Compile date 2024-03-11 19:41:08 2024-03-12T16:14:23.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: DB SUMMARY 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: DB Session ID: OVOQH8IACP82UO3XP74B 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: CURRENT file: CURRENT 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: IDENTITY file: IDENTITY 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: MANIFEST file: MANIFEST-000008 size: 1181 Bytes 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi006/store.db dir, Total Num: 1, files: 000026.sst 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi006/store.db: 000024.log size: 149689 ; 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.error_if_exists: 0 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.create_if_missing: 0 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.paranoid_checks: 1 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-12T16:14:23.459 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.env: 0x55b6a94fd720 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.fs: PosixFileSystem 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.info_log: 0x55b6aafbf380 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_file_opening_threads: 16 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.statistics: (nil) 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.use_fsync: 0 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_log_file_size: 0 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.keep_log_file_num: 1000 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.recycle_log_file_num: 0 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.allow_fallocate: 1 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.allow_mmap_reads: 0 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.allow_mmap_writes: 0 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.use_direct_reads: 0 2024-03-12T16:14:23.460 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.create_missing_column_families: 0 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.db_log_dir: 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.wal_dir: 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.advise_random_on_open: 1 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.db_write_buffer_size: 0 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.write_buffer_manager: 0x55b6aa238140 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-12T16:14:23.461 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.rate_limiter: (nil) 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.wal_recovery_mode: 2 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.enable_thread_tracking: 0 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.enable_pipelined_write: 0 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.unordered_write: 0 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.row_cache: None 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.wal_filter: None 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.allow_ingest_behind: 0 2024-03-12T16:14:23.462 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.two_write_queues: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.manual_wal_flush: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.wal_compression: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.atomic_flush: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.log_readahead_size: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.best_efforts_recovery: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.allow_data_in_errors: 0 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.db_host_id: __hostname__ 2024-03-12T16:14:23.463 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_background_jobs: 2 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_background_compactions: -1 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_subcompactions: 1 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_total_wal_size: 0 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_open_files: -1 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bytes_per_sync: 0 2024-03-12T16:14:23.464 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_readahead_size: 0 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_background_flushes: -1 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Compression algorithms supported: 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: kZSTD supported: 0 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: kXpressCompression supported: 0 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: kLZ4HCCompression supported: 1 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: kZlibCompression supported: 1 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: kSnappyCompression supported: 1 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: kLZ4Compression supported: 1 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: kBZip2Compression supported: 0 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-12T16:14:23.465 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi006/store.db/MANIFEST-000008 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.merge_operator: 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_filter: None 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_filter_factory: None 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.sst_partitioner_factory: None 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b6aafbf4a0) 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: cache_index_and_filter_blocks: 1 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-12T16:14:23.466 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: pin_top_level_index_and_filter: 1 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: index_type: 0 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: data_block_index_type: 0 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: index_shortening: 1 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: checksum: 4 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: no_block_cache: 0 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: block_cache: 0x55b6aa2d91f0 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: block_cache_name: BinnedLRUCache 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: block_cache_options: 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: capacity : 536870912 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: num_shard_bits : 4 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: strict_capacity_limit : 0 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: high_pri_pool_ratio: 0.000 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: block_cache_compressed: (nil) 2024-03-12T16:14:23.467 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: persistent_cache: (nil) 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: block_size: 4096 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: block_size_deviation: 10 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: block_restart_interval: 16 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: index_block_restart_interval: 1 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: metadata_block_size: 4096 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: partition_filters: 0 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: use_delta_encoding: 1 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: filter_policy: bloomfilter 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: whole_key_filtering: 1 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: verify_compression: 0 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: read_amp_bytes_per_bit: 0 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: format_version: 5 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: enable_index_compression: 1 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: block_align: 0 2024-03-12T16:14:23.468 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: max_auto_readahead_size: 262144 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: prepopulate_block_cache: 0 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: initial_auto_readahead_size: 8192 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: num_file_reads_for_auto_readahead: 2 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.write_buffer_size: 33554432 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_write_buffer_number: 2 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression: NoCompression 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression: Disabled 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.prefix_extractor: nullptr 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.num_levels: 7 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-12T16:14:23.469 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-12T16:14:23.470 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-12T16:14:23.470 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression_opts.level: 32767 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression_opts.strategy: 0 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-12T16:14:23.471 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression_opts.enabled: false 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.target_file_size_base: 67108864 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-12T16:14:23.472 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.arena_block_size: 1048576 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.disable_auto_compactions: 0 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-12T16:14:23.473 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.table_properties_collectors: 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.inplace_update_support: 0 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.bloom_locality: 0 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.max_successive_merges: 0 2024-03-12T16:14:23.474 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.paranoid_file_checks: 0 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.force_consistency_checks: 1 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.report_bg_io_stats: 0 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.ttl: 2592000 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.enable_blob_files: false 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.min_blob_size: 0 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.blob_file_size: 268435456 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-12T16:14:23.475 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.blob_file_starting_level: 0 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 26.sst 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi006/store.db/MANIFEST-000008 succeeded,manifest_file_number is 8, next_file_number is 28, last_sequence is 11546, log_number is 24,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 24 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 9222e331-ca8e-4068-ac26-ef8b07723787 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710260063192479, "job": 1, "event": "recovery_started", "wal_files": [24]} 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #24 mode 2 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710260063193705, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 29, "file_size": 150600, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 11547, "largest_seqno": 11579, "table_properties": {"data_size": 149364, "index_size": 162, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 582, "raw_average_key_size": 26, "raw_value_size": 148714, "raw_average_value_size": 6759, "num_data_blocks": 7, "num_entries": 22, "num_filter_entries": 22, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710260063, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "9222e331-ca8e-4068-ac26-ef8b07723787", "db_session_id": "OVOQH8IACP82UO3XP74B", "orig_file_number": 29, "seqno_to_time_mapping": "N/A"}} 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710260063193798, "job": 1, "event": "recovery_finished"} 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/version_set.cc:5047] Creating manifest 31 2024-03-12T16:14:23.476 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi006/store.db/000024.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55b6aa376000 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: DB pointer 0x55b6aa364000 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: ** DB Stats ** 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: 2024-03-12T16:14:23.477 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: ** Compaction Stats [default] ** 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: L0 1/0 147.07 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 193.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: L6 1/0 27.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Sum 2/0 28.04 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 193.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 193.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: ** Compaction Stats [default] ** 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 193.6 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-12T16:14:23.478 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Cumulative compaction: 0.00 GB write, 41.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Interval compaction: 0.00 GB write, 41.75 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Block cache BinnedLRUCache@0x55b6aa2d91f0#7 capacity: 512.00 MB usage: 0.36 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.11 KB,2.08616e-05%) IndexBlock(1,0.25 KB,4.76837e-05%) Misc(1,0.00 KB,0%) 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-12T16:14:23.479 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: starting mon.smithi006 rank 0 at public addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] at bind addrs [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi006 fsid 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: mon.smithi006@-1(???) e2 preinit fsid 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: mon.smithi006@-1(???).mds e14 new map 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: mon.smithi006@-1(???).mds e14 print_map 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: e14 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: legacy client fscid: 1 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Filesystem 'cephfs' (1) 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: fs_name cephfs 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: epoch 14 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:14:23.480 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: modified 2024-03-12T16:10:47.693652+0000 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: tableserver 0 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: root 0 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: session_timeout 60 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: session_autoclose 300 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: max_file_size 1099511627776 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: max_xattr_size 65536 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: required_client_features {} 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: last_failure 0 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: last_failure_osd_epoch 0 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: max_mds 2 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: in 0,1 2024-03-12T16:14:23.481 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: up {0=14432,1=24271} 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: failed 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: damaged 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: stopped 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: data_pools [3] 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: metadata_pool 2 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: inline_data disabled 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: balancer 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: bal_rank_mask -1 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: standby_count_wanted 1 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: [mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: [mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 export targets 0 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: 2024-03-12T16:14:23.482 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: Standby daemons: 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: [mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout: [mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: mon.smithi006@-1(???).osd e48 crush map has features 3314933000852226048, adjusting msgr requires 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: mon.smithi006@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: mon.smithi006@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: mon.smithi006@-1(???).osd e48 crush map has features 288514051259236352, adjusting msgr requires 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 ceph-mon[103869]: mon.smithi006@-1(???).paxosservice(auth 1..21) refresh upgraded, format 0 -> 3 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 bash[103831]: 34464f865bf12906536ba653b6c62e86f0e09fb1d1facae616675c50cafaf7ef 2024-03-12T16:14:23.483 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:23 smithi006 systemd[1]: Started Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:14:24.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:23.100786+0000 mgr.smithi006.kskdce (mgr.14664) 144 : cluster [DBG] pgmap v79: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:24.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:24.609733+0000 mon.smithi006 (mon.0) 1 : cluster [INF] mon.smithi006 calling monitor election 2024-03-12T16:14:24.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:24.623718+0000 mon.smithi006 (mon.0) 2 : cluster [INF] mon.smithi006 is new leader, mons smithi006,smithi134 in quorum (ranks 0,1) 2024-03-12T16:14:24.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:24.629236+0000 mon.smithi006 (mon.0) 3 : cluster [DBG] monmap e2: 2 mons at {smithi006=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-12T16:14:24.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:24.629833+0000 mon.smithi006 (mon.0) 4 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:24.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:24.629888+0000 mon.smithi006 (mon.0) 5 : cluster [DBG] osdmap e48: 6 total, 6 up, 6 in 2024-03-12T16:14:24.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:24.631069+0000 mon.smithi006 (mon.0) 6 : cluster [DBG] mgrmap e33: smithi006.kskdce(active, since 2m), standbys: smithi134.gcntfu 2024-03-12T16:14:24.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:24.641324+0000 mon.smithi006 (mon.0) 7 : cluster [DBG] mgrmap e34: smithi006.kskdce(active, since 2m), standbys: smithi134.gcntfu 2024-03-12T16:14:24.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:24.641354+0000 mon.smithi006 (mon.0) 8 : cluster [INF] overall HEALTH_OK 2024-03-12T16:14:24.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:24.641450+0000 mon.smithi006 (mon.0) 9 : audit [INF] from='mgr.14664 ' entity='' 2024-03-12T16:14:28.799 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:28 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:27.568931+0000 mon.smithi006 (mon.0) 10 : cluster [DBG] fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:31.435036+0000 mon.smithi006 (mon.0) 11 : cluster [DBG] Standby manager daemon smithi134.gcntfu restarted 2024-03-12T16:14:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:31.435123+0000 mon.smithi006 (mon.0) 12 : cluster [DBG] Standby manager daemon smithi134.gcntfu started 2024-03-12T16:14:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.437578+0000 mon.smithi134 (mon.1) 178 : audit [DBG] from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:14:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.438463+0000 mon.smithi134 (mon.1) 179 : audit [DBG] from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:14:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.440874+0000 mon.smithi134 (mon.1) 180 : audit [DBG] from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:14:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.441184+0000 mon.smithi134 (mon.1) 181 : audit [DBG] from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:14:32.861 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:31.489980+0000 mon.smithi006 (mon.0) 13 : cluster [DBG] mgrmap e35: smithi006.kskdce(active, since 2m), standbys: smithi134.gcntfu 2024-03-12T16:14:32.861 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:31.789342+0000 mon.smithi006 (mon.0) 14 : cluster [INF] Active manager daemon smithi006.kskdce restarted 2024-03-12T16:14:32.861 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:31.789676+0000 mon.smithi006 (mon.0) 15 : cluster [INF] Activating manager daemon smithi006.kskdce 2024-03-12T16:14:32.861 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:31.794781+0000 mon.smithi006 (mon.0) 16 : cluster [DBG] osdmap e49: 6 total, 6 up, 6 in 2024-03-12T16:14:32.861 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:31.795232+0000 mon.smithi006 (mon.0) 17 : cluster [DBG] mgrmap e36: smithi006.kskdce(active, starting, since 0.00564086s), standbys: smithi134.gcntfu 2024-03-12T16:14:32.861 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.797120+0000 mon.smithi006 (mon.0) 18 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:14:32.861 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.797253+0000 mon.smithi006 (mon.0) 19 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.798947+0000 mon.smithi006 (mon.0) 20 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.799179+0000 mon.smithi006 (mon.0) 21 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.799413+0000 mon.smithi006 (mon.0) 22 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.799631+0000 mon.smithi006 (mon.0) 23 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.799818+0000 mon.smithi006 (mon.0) 24 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.799974+0000 mon.smithi006 (mon.0) 25 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi134.gcntfu", "id": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.800114+0000 mon.smithi006 (mon.0) 26 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.800315+0000 mon.smithi006 (mon.0) 27 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.800522+0000 mon.smithi006 (mon.0) 28 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.800811+0000 mon.smithi006 (mon.0) 29 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.801126+0000 mon.smithi006 (mon.0) 30 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:14:32.862 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.801371+0000 mon.smithi006 (mon.0) 31 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:14:32.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.801570+0000 mon.smithi006 (mon.0) 32 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:14:32.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.801822+0000 mon.smithi006 (mon.0) 33 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:14:32.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.802153+0000 mon.smithi006 (mon.0) 34 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:14:32.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:31.820135+0000 mon.smithi006 (mon.0) 35 : cluster [INF] Manager daemon smithi006.kskdce is now available 2024-03-12T16:14:32.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.841955+0000 mon.smithi006 (mon.0) 36 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:32.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.843456+0000 mon.smithi006 (mon.0) 37 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:32.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.863415+0000 mon.smithi006 (mon.0) 38 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:14:32.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.877005+0000 mon.smithi006 (mon.0) 39 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:14:32.863 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:32 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:31.886995+0000 mon.smithi006 (mon.0) 40 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:14:33.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:32.799312+0000 mon.smithi006 (mon.0) 41 : cluster [DBG] mgrmap e37: smithi006.kskdce(active, since 1.00972s), standbys: smithi134.gcntfu 2024-03-12T16:14:33.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:33.056248+0000 mgr.smithi006.kskdce (mgr.34104) 2 : cephadm [INF] [12/Mar/2024:16:14:33] ENGINE Bus STARTING 2024-03-12T16:14:33.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:33.158332+0000 mgr.smithi006.kskdce (mgr.34104) 3 : cephadm [INF] [12/Mar/2024:16:14:33] ENGINE Serving on http://172.21.15.6:8765 2024-03-12T16:14:33.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:33.275269+0000 mgr.smithi006.kskdce (mgr.34104) 4 : cephadm [INF] [12/Mar/2024:16:14:33] ENGINE Serving on https://172.21.15.6:7150 2024-03-12T16:14:33.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:33 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:33.275383+0000 mgr.smithi006.kskdce (mgr.34104) 5 : cephadm [INF] [12/Mar/2024:16:14:33] ENGINE Bus STARTED 2024-03-12T16:14:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:33.800847+0000 mgr.smithi006.kskdce (mgr.34104) 6 : cluster [DBG] pgmap v4: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:35.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:35 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:34.210137+0000 mon.smithi006 (mon.0) 42 : cluster [DBG] mgrmap e38: smithi006.kskdce(active, since 2s), standbys: smithi134.gcntfu 2024-03-12T16:14:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:35.801309+0000 mgr.smithi006.kskdce (mgr.34104) 7 : cluster [DBG] pgmap v5: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:35.949810+0000 mon.smithi006 (mon.0) 43 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:37.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:35.954309+0000 mon.smithi006 (mon.0) 44 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:36.217351+0000 mon.smithi006 (mon.0) 45 : cluster [DBG] mgrmap e39: smithi006.kskdce(active, since 4s), standbys: smithi134.gcntfu 2024-03-12T16:14:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:36.590500+0000 mon.smithi006 (mon.0) 46 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:36.597524+0000 mon.smithi006 (mon.0) 47 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:36.711865+0000 mon.smithi006 (mon.0) 48 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:36 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:36.718533+0000 mon.smithi006 (mon.0) 49 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:38.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:37.351932+0000 mon.smithi006 (mon.0) 50 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:38.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:38 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:37.356842+0000 mon.smithi006 (mon.0) 51 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:39.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:37.801809+0000 mgr.smithi006.kskdce (mgr.34104) 8 : cluster [DBG] pgmap v6: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:41.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:39.802612+0000 mgr.smithi006.kskdce (mgr.34104) 9 : cluster [DBG] pgmap v7: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-12T16:14:41.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:41.083943+0000 mon.smithi006 (mon.0) 52 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:41.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:41.089173+0000 mon.smithi006 (mon.0) 53 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:41.090619+0000 mon.smithi006 (mon.0) 54 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:41 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:41.091467+0000 mon.smithi006 (mon.0) 55 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:14:42.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:41.078986+0000 mgr.smithi006.kskdce (mgr.34104) 10 : cephadm [INF] Detected new or changed devices on smithi006 2024-03-12T16:14:42.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:41.092621+0000 mgr.smithi006.kskdce (mgr.34104) 11 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:14:42.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:41.092855+0000 mgr.smithi006.kskdce (mgr.34104) 12 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:14:42.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:41.357561+0000 mgr.smithi006.kskdce (mgr.34104) 13 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:41.357703+0000 mgr.smithi006.kskdce (mgr.34104) 14 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:41.621809+0000 mgr.smithi006.kskdce (mgr.34104) 15 : cephadm [INF] Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:41.622409+0000 mgr.smithi006.kskdce (mgr.34104) 16 : cephadm [INF] Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:42.154105+0000 mon.smithi006 (mon.0) 56 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:42.156580+0000 mon.smithi006 (mon.0) 57 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:42.160252+0000 mon.smithi006 (mon.0) 58 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:42.163367+0000 mon.smithi006 (mon.0) 59 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:42.166627+0000 mon.smithi006 (mon.0) 60 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:42.305199+0000 mon.smithi006 (mon.0) 61 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:42.307957+0000 mon.smithi006 (mon.0) 62 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:14:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:42 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:42.309128+0000 mon.smithi006 (mon.0) 63 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-12T16:14:43.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:41.802961+0000 mgr.smithi006.kskdce (mgr.34104) 17 : cluster [DBG] pgmap v8: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-03-12T16:14:43.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:41.885974+0000 mgr.smithi006.kskdce (mgr.34104) 18 : cephadm [INF] Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:43.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:43 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:41.886662+0000 mgr.smithi006.kskdce (mgr.34104) 19 : cephadm [INF] Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:45.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cluster 2024-03-12T16:14:43.803736+0000 mgr.smithi006.kskdce (mgr.34104) 20 : cluster [DBG] pgmap v9: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-12T16:14:45.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:43.877184+0000 mgr.smithi006.kskdce (mgr.34104) 21 : cephadm [INF] Upgrade: Updating mon.smithi134 2024-03-12T16:14:45.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:43.882274+0000 mon.smithi006 (mon.0) 64 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:45.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:43.883337+0000 mon.smithi006 (mon.0) 65 : audit [INF] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:14:45.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:43.884238+0000 mon.smithi006 (mon.0) 66 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:14:45.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: audit 2024-03-12T16:14:43.885103+0000 mon.smithi006 (mon.0) 67 : audit [DBG] from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:45.206 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:44 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: cephadm 2024-03-12T16:14:43.886177+0000 mgr.smithi006.kskdce (mgr.34104) 22 : cephadm [INF] Deploying daemon mon.smithi134 on smithi134 2024-03-12T16:14:45.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:45 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:14:45.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:14:45.639+0000 7fdefe739700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-stderr=true (PID: 1) UID: 0 2024-03-12T16:14:45.643 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[42676]: debug 2024-03-12T16:14:45.639+0000 7fdefe739700 -1 mon.smithi134@1(peon) e2 *** Got Signal Terminated *** 2024-03-12T16:14:46.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:46 smithi134 bash[84908]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134 2024-03-12T16:14:46.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:46 smithi134 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi134.service: Succeeded. 2024-03-12T16:14:46.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:46 smithi134 systemd[1]: Stopped Ceph mon.smithi134 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:14:46.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:46 smithi134 systemd[1]: Starting Ceph mon.smithi134 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:14:47.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: set uid:gid to 167:167 (ceph:ceph) 2024-03-12T16:14:47.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable), process ceph-mon, pid 7 2024-03-12T16:14:47.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: pidfile_write: ignore empty --pid-file 2024-03-12T16:14:47.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: load: jerasure load: lrc 2024-03-12T16:14:47.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: RocksDB version: 7.9.2 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Git sha 0 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Compile date 2024-03-11 19:41:08 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: DB SUMMARY 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: DB Session ID: JEKUPQY0UAEYELROP45P 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: CURRENT file: CURRENT 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: IDENTITY file: IDENTITY 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: MANIFEST file: MANIFEST-000005 size: 1200 Bytes 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: SST files in /var/lib/ceph/mon/ceph-smithi134/store.db dir, Total Num: 1, files: 000025.sst 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-smithi134/store.db: 000023.log size: 4232538 ; 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.error_if_exists: 0 2024-03-12T16:14:47.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.create_if_missing: 0 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.paranoid_checks: 1 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.flush_verify_memtable_count: 1 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.env: 0x560e95e76720 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.fs: PosixFileSystem 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.info_log: 0x560e98cad380 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_file_opening_threads: 16 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.statistics: (nil) 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.use_fsync: 0 2024-03-12T16:14:47.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_log_file_size: 0 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.log_file_time_to_roll: 0 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.keep_log_file_num: 1000 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.recycle_log_file_num: 0 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.allow_fallocate: 1 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.allow_mmap_reads: 0 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.allow_mmap_writes: 0 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.use_direct_reads: 0 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.create_missing_column_families: 0 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.db_log_dir: 2024-03-12T16:14:47.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.wal_dir: 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.table_cache_numshardbits: 6 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.WAL_ttl_seconds: 0 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.WAL_size_limit_MB: 0 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.is_fd_close_on_exec: 1 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.advise_random_on_open: 1 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.db_write_buffer_size: 0 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.write_buffer_manager: 0x560e97f26140 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-03-12T16:14:47.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.use_adaptive_mutex: 0 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.rate_limiter: (nil) 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.wal_recovery_mode: 2 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.enable_thread_tracking: 0 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.enable_pipelined_write: 0 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.unordered_write: 0 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-03-12T16:14:47.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.row_cache: None 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.wal_filter: None 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.allow_ingest_behind: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.two_write_queues: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.manual_wal_flush: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.wal_compression: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.atomic_flush: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.persist_stats_to_disk: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.write_dbid_to_manifest: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.log_readahead_size: 0 2024-03-12T16:14:47.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.best_efforts_recovery: 0 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.allow_data_in_errors: 0 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.db_host_id: __hostname__ 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.enforce_single_del_contracts: true 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_background_jobs: 2 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_background_compactions: -1 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_subcompactions: 1 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-03-12T16:14:47.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.delayed_write_rate : 16777216 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_total_wal_size: 0 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.stats_dump_period_sec: 600 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.stats_persist_period_sec: 600 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_open_files: -1 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bytes_per_sync: 0 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.wal_bytes_per_sync: 0 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.strict_bytes_per_sync: 0 2024-03-12T16:14:47.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_readahead_size: 0 2024-03-12T16:14:47.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_background_flushes: -1 2024-03-12T16:14:47.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Compression algorithms supported: 2024-03-12T16:14:47.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-03-12T16:14:47.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: kZSTD supported: 0 2024-03-12T16:14:47.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: kXpressCompression supported: 0 2024-03-12T16:14:47.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: kLZ4HCCompression supported: 1 2024-03-12T16:14:47.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: kZlibCompression supported: 1 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: kSnappyCompression supported: 1 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: kLZ4Compression supported: 1 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: kBZip2Compression supported: 0 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Fast CRC32 supported: Supported on x86 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: DMutex implementation: pthread_mutex_t 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000005 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.merge_operator: 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_filter: None 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_filter_factory: None 2024-03-12T16:14:47.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.sst_partitioner_factory: None 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.memtable_factory: SkipListFactory 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.table_factory: BlockBasedTable 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x560e98cad4a0) 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks: 1 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: pin_top_level_index_and_filter: 1 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_type: 0 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_index_type: 0 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_shortening: 1 2024-03-12T16:14:47.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_block_hash_table_util_ratio: 0.750000 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: checksum: 4 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: no_block_cache: 0 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache: 0x560e97fc71f0 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_name: BinnedLRUCache 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_options: 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: capacity : 536870912 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_shard_bits : 4 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: strict_capacity_limit : 0 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: high_pri_pool_ratio: 0.000 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_cache_compressed: (nil) 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: persistent_cache: (nil) 2024-03-12T16:14:47.467 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size: 4096 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_size_deviation: 10 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_restart_interval: 16 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: index_block_restart_interval: 1 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_block_size: 4096 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: partition_filters: 0 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: use_delta_encoding: 1 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: filter_policy: bloomfilter 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: whole_key_filtering: 1 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: verify_compression: 0 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: read_amp_bytes_per_bit: 0 2024-03-12T16:14:47.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: format_version: 5 2024-03-12T16:14:47.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_index_compression: 1 2024-03-12T16:14:47.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: block_align: 0 2024-03-12T16:14:47.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_auto_readahead_size: 262144 2024-03-12T16:14:47.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: prepopulate_block_cache: 0 2024-03-12T16:14:47.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: initial_auto_readahead_size: 8192 2024-03-12T16:14:47.470 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: num_file_reads_for_auto_readahead: 2 2024-03-12T16:14:47.471 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.write_buffer_size: 33554432 2024-03-12T16:14:47.471 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_write_buffer_number: 2 2024-03-12T16:14:47.471 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression: NoCompression 2024-03-12T16:14:47.471 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression: Disabled 2024-03-12T16:14:47.471 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.prefix_extractor: nullptr 2024-03-12T16:14:47.471 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-03-12T16:14:47.471 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.num_levels: 7 2024-03-12T16:14:47.472 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-03-12T16:14:47.472 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-03-12T16:14:47.472 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-03-12T16:14:47.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-03-12T16:14:47.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-03-12T16:14:47.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-03-12T16:14:47.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-03-12T16:14:47.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:14:47.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-03-12T16:14:47.473 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression_opts.window_bits: -14 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression_opts.level: 32767 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression_opts.strategy: 0 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression_opts.enabled: false 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-03-12T16:14:47.474 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.target_file_size_base: 67108864 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.target_file_size_multiplier: 1 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-03-12T16:14:47.475 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.arena_block_size: 1048576 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.disable_auto_compactions: 0 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.table_properties_collectors: 2024-03-12T16:14:47.476 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.inplace_update_support: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.inplace_update_num_locks: 10000 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.memtable_huge_page_size: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.bloom_locality: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.max_successive_merges: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.optimize_filters_for_hits: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.paranoid_file_checks: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.force_consistency_checks: 1 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.report_bg_io_stats: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.ttl: 2592000 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.periodic_compaction_seconds: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-03-12T16:14:47.477 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.enable_blob_files: false 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.min_blob_size: 0 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.blob_file_size: 268435456 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.blob_compression_type: NoCompression 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.enable_blob_garbage_collection: false 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.blob_file_starting_level: 0 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 25.sst 2024-03-12T16:14:47.478 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-smithi134/store.db/MANIFEST-000005 succeeded,manifest_file_number is 5, next_file_number is 27, last_sequence is 12096, log_number is 23,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 23 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: d5d11db1-3039-4d25-ba67-97296a9b0919 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710260087205811, "job": 1, "event": "recovery_started", "wal_files": [23]} 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #23 mode 2 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710260087214626, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 28, "file_size": 2749977, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 12101, "largest_seqno": 12588, "table_properties": {"data_size": 2746398, "index_size": 2113, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 453, "raw_key_size": 3711, "raw_average_key_size": 21, "raw_value_size": 2741404, "raw_average_value_size": 16125, "num_data_blocks": 95, "num_entries": 170, "num_filter_entries": 170, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1710260087, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "d5d11db1-3039-4d25-ba67-97296a9b0919", "db_session_id": "JEKUPQY0UAEYELROP45P", "orig_file_number": 28, "seqno_to_time_mapping": "N/A"}} 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: EVENT_LOG_v1 {"time_micros": 1710260087214769, "job": 1, "event": "recovery_finished"} 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/version_set.cc:5047] Creating manifest 30 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-smithi134/store.db/000023.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x560e98064000 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: DB pointer 0x560e98052000 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** DB Stats ** 2024-03-12T16:14:47.479 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L0 1/0 2.62 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 726.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: L6 1/0 27.90 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Sum 2/0 30.52 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 726.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 726.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-12T16:14:47.480 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** Compaction Stats [default] ** 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 726.7 0.00 0.00 1 0.004 0 0 0.0 0.0 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Flush(GB): cumulative 0.003, interval 0.003 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: AddFile(Keys): cumulative 0, interval 0 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Cumulative compaction: 0.00 GB write, 198.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:14:47.481 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Interval compaction: 0.00 GB write, 198.36 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache BinnedLRUCache@0x560e97fc71f0#7 capacity: 512.00 MB usage: 2.83 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.50 KB,9.53674e-05%) IndexBlock(1,2.33 KB,0.000444055%) Misc(1,0.00 KB,0%) 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: ** File Read Latency Histogram By Level [default] ** 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: starting mon.smithi134 rank 1 at public addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] at bind addrs [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] mon_data /var/lib/ceph/mon/ceph-smithi134 fsid 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: mon.smithi134@-1(???) e2 preinit fsid 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: mon.smithi134@-1(???).mds e15 new map 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: mon.smithi134@-1(???).mds e15 print_map 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: e15 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: legacy client fscid: 1 2024-03-12T16:14:47.482 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Filesystem 'cephfs' (1) 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: fs_name cephfs 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: epoch 15 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: modified 2024-03-12T16:14:27.566046+0000 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: tableserver 0 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: root 0 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_timeout 60 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: session_autoclose 300 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_file_size 1099511627776 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_xattr_size 65536 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: required_client_features {} 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure 0 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: last_failure_osd_epoch 0 2024-03-12T16:14:47.483 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: max_mds 2 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: in 0,1 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: up {0=14432,1=24271} 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: failed 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: damaged 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: stopped 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: data_pools [3] 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: metadata_pool 2 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: inline_data disabled 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: balancer 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: bal_rank_mask -1 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: standby_count_wanted 1 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:47.484 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: Standby daemons: 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout: [mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: mon.smithi134@-1(???).osd e49 crush map has features 3314933000852226048, adjusting msgr requires 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: mon.smithi134@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: mon.smithi134@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: mon.smithi134@-1(???).osd e49 crush map has features 288514051259236352, adjusting msgr requires 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 ceph-mon[85099]: mon.smithi134@-1(???).paxosservice(auth 1..22) refresh upgraded, format 0 -> 3 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 bash[85061]: 7600006320db7a3dbae2f89622d61c5933cfa67ead063a683ee3e9d35594ec8b 2024-03-12T16:14:47.485 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:47 smithi134 systemd[1]: Started Ceph mon.smithi134 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:14:48.323 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mkfs 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:14:48.324 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mkfs 88d7ee42-e089-11ee-95c8-87774f69a715 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Updating mgr.smithi134.gcntfu 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Deploying daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all mgr 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all rgw 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all rbd-mirror 2024-03-12T16:14:48.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all ceph-exporter 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all iscsi 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all nfs 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all nvmeof 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Updating node-exporter.smithi006 (1/2) 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Deploying daemon node-exporter.smithi006 on smithi006 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Updating node-exporter.smithi134 (2/2) 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Deploying daemon node-exporter.smithi134 on smithi134 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Updating prometheus.smithi134 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Deploying daemon prometheus.smithi134 on smithi134 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Updating alertmanager.smithi006 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Deploying daemon alertmanager.smithi006 on smithi006 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Updating grafana.smithi006 2024-03-12T16:14:48.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Deploying daemon grafana.smithi006 on smithi006 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v55: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v56: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Finalizing container_image settings 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Complete! 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v57: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v58: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v59: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v60: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v61: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v62: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v63: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v64: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.456 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v65: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v66: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v67: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v68: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.457 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v69: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v70: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v71: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v72: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v73: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v74: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v75: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Target is version 18.2.2-797-g49e4a679 (reef) 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846, digests ['quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846'] 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all mgr 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v76: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.458 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v77: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Updating mon.smithi006 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Deploying daemon mon.smithi006 on smithi006 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v79: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mon.smithi006 calling monitor election 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mon.smithi006 is new leader, mons smithi006,smithi134 in quorum (ranks 0,1) 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: monmap e2: 2 mons at {smithi006=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: osdmap e48: 6 total, 6 up, 6 in 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mgrmap e33: smithi006.kskdce(active, since 2m), standbys: smithi134.gcntfu 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mgrmap e34: smithi006.kskdce(active, since 2m), standbys: smithi134.gcntfu 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: overall HEALTH_OK 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Standby manager daemon smithi134.gcntfu restarted 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Standby manager daemon smithi134.gcntfu started 2024-03-12T16:14:48.459 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mgrmap e35: smithi006.kskdce(active, since 2m), standbys: smithi134.gcntfu 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Active manager daemon smithi006.kskdce restarted 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Activating manager daemon smithi006.kskdce 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: osdmap e49: 6 total, 6 up, 6 in 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mgrmap e36: smithi006.kskdce(active, starting, since 0.00564086s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:14:48.460 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi134.gcntfu", "id": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Manager daemon smithi006.kskdce is now available 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:48.461 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mgrmap e37: smithi006.kskdce(active, since 1.00972s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: [12/Mar/2024:16:14:33] ENGINE Bus STARTING 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: [12/Mar/2024:16:14:33] ENGINE Serving on http://172.21.15.6:8765 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: [12/Mar/2024:16:14:33] ENGINE Serving on https://172.21.15.6:7150 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: [12/Mar/2024:16:14:33] ENGINE Bus STARTED 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v4: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mgrmap e38: smithi006.kskdce(active, since 2s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v5: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mgrmap e39: smithi006.kskdce(active, since 4s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.462 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v6: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v7: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Detected new or changed devices on smithi006 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:14:48.463 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v8: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:14:48.464 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: pgmap v9: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Upgrade: Updating mon.smithi134 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: Deploying daemon mon.smithi134 on smithi134 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: overall HEALTH_OK 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mon.smithi134 calling monitor election 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mon.smithi006 calling monitor election 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mon.smithi006 is new leader, mons smithi006,smithi134 in quorum (ranks 0,1) 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: monmap e3: 2 mons at {smithi006=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-12T16:14:48.465 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:48.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: osdmap e49: 6 total, 6 up, 6 in 2024-03-12T16:14:48.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: mgrmap e39: smithi006.kskdce(active, since 15s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: overall HEALTH_OK 2024-03-12T16:14:48.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.466 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:48 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Reconfiguring prometheus.smithi134 (dependencies changed)... 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Reconfiguring daemon prometheus.smithi134 on smithi134 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Updating mgr.smithi134.gcntfu 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Deploying daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all mgr 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all rgw 2024-03-12T16:14:48.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all rbd-mirror 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all cephfs-mirror 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all ceph-exporter 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all iscsi 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all nfs 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all nvmeof 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Updating node-exporter.smithi006 (1/2) 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Deploying daemon node-exporter.smithi006 on smithi006 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Updating node-exporter.smithi134 (2/2) 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Deploying daemon node-exporter.smithi134 on smithi134 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Updating prometheus.smithi134 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Deploying daemon prometheus.smithi134 on smithi134 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Updating alertmanager.smithi006 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Deploying daemon alertmanager.smithi006 on smithi006 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Updating grafana.smithi006 2024-03-12T16:14:48.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Deploying daemon grafana.smithi006 on smithi006 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v55: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v56: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Finalizing container_image settings 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Complete! 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v57: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v58: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v59: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v60: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v61: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v62: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v63: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v64: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v65: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v66: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v67: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v68: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v69: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v70: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v71: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v72: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v73: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v74: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:49e4a6794d5502bd66908faf714fc54896c51712 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v75: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Target is version 18.2.2-797-g49e4a679 (reef) 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846, digests ['quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846'] 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all mgr 2024-03-12T16:14:48.711 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v76: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v77: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Updating mon.smithi006 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Deploying daemon mon.smithi006 on smithi006 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v79: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mon.smithi006 calling monitor election 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mon.smithi006 is new leader, mons smithi006,smithi134 in quorum (ranks 0,1) 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: monmap e2: 2 mons at {smithi006=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: osdmap e48: 6 total, 6 up, 6 in 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mgrmap e33: smithi006.kskdce(active, since 2m), standbys: smithi134.gcntfu 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mgrmap e34: smithi006.kskdce(active, since 2m), standbys: smithi134.gcntfu 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: overall HEALTH_OK 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:48.712 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Standby manager daemon smithi134.gcntfu restarted 2024-03-12T16:14:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Standby manager daemon smithi134.gcntfu started 2024-03-12T16:14:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/crt"}]: dispatch 2024-03-12T16:14:48.713 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/smithi134.gcntfu/key"}]: dispatch 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.? 172.21.15.134:0/2582717102' entity='mgr.smithi134.gcntfu' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mgrmap e35: smithi006.kskdce(active, since 2m), standbys: smithi134.gcntfu 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Active manager daemon smithi006.kskdce restarted 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Activating manager daemon smithi006.kskdce 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: osdmap e49: 6 total, 6 up, 6 in 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mgrmap e36: smithi006.kskdce(active, starting, since 0.00564086s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:14:48.714 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi006.kskdce", "id": "smithi006.kskdce"}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr metadata", "who": "smithi134.gcntfu", "id": "smithi134.gcntfu"}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Manager daemon smithi006.kskdce is now available 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:48.715 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/mirror_snapshot_schedule"}]: dispatch 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/smithi006.kskdce/trash_purge_schedule"}]: dispatch 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mgrmap e37: smithi006.kskdce(active, since 1.00972s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: [12/Mar/2024:16:14:33] ENGINE Bus STARTING 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: [12/Mar/2024:16:14:33] ENGINE Serving on http://172.21.15.6:8765 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: [12/Mar/2024:16:14:33] ENGINE Serving on https://172.21.15.6:7150 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: [12/Mar/2024:16:14:33] ENGINE Bus STARTED 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v4: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mgrmap e38: smithi006.kskdce(active, since 2s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v5: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mgrmap e39: smithi006.kskdce(active, since 4s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.716 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v6: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v7: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 29 KiB/s rd, 0 B/s wr, 16 op/s 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Detected new or changed devices on smithi006 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi006:/etc/ceph/ceph.conf 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi134:/etc/ceph/ceph.conf 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:14:48.717 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.conf 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi006:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi134:/etc/ceph/ceph.client.admin.keyring 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v8: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 23 KiB/s rd, 0 B/s wr, 12 op/s 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Updating smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/config/ceph.client.admin.keyring 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-03-12T16:14:48.718 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: pgmap v9: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 19 KiB/s rd, 0 B/s wr, 10 op/s 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Upgrade: Updating mon.smithi134 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: Deploying daemon mon.smithi134 on smithi134 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: overall HEALTH_OK 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi006"}]: dispatch 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mon metadata", "id": "smithi134"}]: dispatch 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mon.smithi134 calling monitor election 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mon.smithi006 calling monitor election 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mon.smithi006 is new leader, mons smithi006,smithi134 in quorum (ranks 0,1) 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: monmap e3: 2 mons at {smithi006=[v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0],smithi134=[v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0]} removed_ranks: {} disallowed_leaders: {} 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:48.719 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: osdmap e49: 6 total, 6 up, 6 in 2024-03-12T16:14:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: mgrmap e39: smithi006.kskdce(active, since 15s), standbys: smithi134.gcntfu 2024-03-12T16:14:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: overall HEALTH_OK 2024-03-12T16:14:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:48.720 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:48 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:14:49.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:49 smithi134 ceph-mon[85099]: pgmap v11: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-12T16:14:49.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:49 smithi006 ceph-mon[103869]: pgmap v11: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-12T16:14:50.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.591+0000 7f134003c700 1 -- 172.21.15.6:0/1971393615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 msgr2=0x7f13380fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.591+0000 7f134003c700 1 --2- 172.21.15.6:0/1971393615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 0x7f13380fdcd0 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f13280047f0 tx=0x7f1328009cb0).stop 2024-03-12T16:14:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.591+0000 7f134003c700 1 -- 172.21.15.6:0/1971393615 shutdown_connections 2024-03-12T16:14:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.591+0000 7f134003c700 1 --2- 172.21.15.6:0/1971393615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 0x7f13380f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.591+0000 7f134003c700 1 --2- 172.21.15.6:0/1971393615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 0x7f13380fdcd0 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:50.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.591+0000 7f134003c700 1 -- 172.21.15.6:0/1971393615 >> 172.21.15.6:0/1971393615 conn(0x7f13380f34b0 msgr2=0x7f13380f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.591+0000 7f134003c700 1 -- 172.21.15.6:0/1971393615 shutdown_connections 2024-03-12T16:14:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.592+0000 7f134003c700 1 -- 172.21.15.6:0/1971393615 wait complete. 2024-03-12T16:14:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.592+0000 7f134003c700 1 Processor -- start 2024-03-12T16:14:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.592+0000 7f134003c700 1 -- start start 2024-03-12T16:14:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.592+0000 7f134003c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 0x7f133810e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:50.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.592+0000 7f134003c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 0x7f133810e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.592+0000 7f134003c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133810eb30 con 0x7f13380fd8f0 2024-03-12T16:14:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.592+0000 7f134003c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f133810ec70 con 0x7f13380fe250 2024-03-12T16:14:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133ddd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 0x7f133810e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133ddd8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 0x7f133810e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59610/0 (socket says 172.21.15.6:59610) 2024-03-12T16:14:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133ddd8700 1 -- 172.21.15.6:0/2365827669 learned_addr learned my addr 172.21.15.6:0/2365827669 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:50.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133d5d7700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 0x7f133810e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133d5d7700 1 -- 172.21.15.6:0/2365827669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 msgr2=0x7f133810e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-12T16:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133d5d7700 1 -- 172.21.15.6:0/2365827669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 msgr2=0x7f133810e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-12T16:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133d5d7700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 0x7f133810e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-12T16:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133d5d7700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 0x7f133810e530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133ddd8700 1 -- 172.21.15.6:0/2365827669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 msgr2=0x7f133810e530 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:14:50.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133ddd8700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 0x7f133810e530 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:50.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133ddd8700 1 -- 172.21.15.6:0/2365827669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1328005040 con 0x7f13380fd8f0 2024-03-12T16:14:50.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f133ddd8700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 0x7f133810e040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1328005010 tx=0x7f1328009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:50.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f132effd700 1 -- 172.21.15.6:0/2365827669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f132800e030 con 0x7f13380fd8f0 2024-03-12T16:14:50.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f132effd700 1 -- 172.21.15.6:0/2365827669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1328007e90 con 0x7f13380fd8f0 2024-03-12T16:14:50.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f132effd700 1 -- 172.21.15.6:0/2365827669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1328018070 con 0x7f13380fd8f0 2024-03-12T16:14:50.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f13381082a0 con 0x7f13380fd8f0 2024-03-12T16:14:50.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.593+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1338108780 con 0x7f13380fd8f0 2024-03-12T16:14:50.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.594+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f133805f590 con 0x7f13380fd8f0 2024-03-12T16:14:50.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.595+0000 7f132effd700 1 -- 172.21.15.6:0/2365827669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7f132801d6e0 con 0x7f13380fd8f0 2024-03-12T16:14:50.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.595+0000 7f132effd700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f132406cb60 0x7f132406f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:50.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.595+0000 7f132effd700 1 -- 172.21.15.6:0/2365827669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f132808d280 con 0x7f13380fd8f0 2024-03-12T16:14:50.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.595+0000 7f133d5d7700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f132406cb60 0x7f132406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:50.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.596+0000 7f133d5d7700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f132406cb60 0x7f132406f020 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1334009fd0 tx=0x7f1334009df0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:50.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.600+0000 7f132effd700 1 -- 172.21.15.6:0/2365827669 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f132805ac70 con 0x7f13380fd8f0 2024-03-12T16:14:50.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.819+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f13381097a0 con 0x7f132406cb60 2024-03-12T16:14:50.822 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.820+0000 7f132effd700 1 -- 172.21.15.6:0/2365827669 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+368 (secure 0 0 0) 0x7f13381097a0 con 0x7f132406cb60 2024-03-12T16:14:50.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f132406cb60 msgr2=0x7f132406f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:50.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f132406cb60 0x7f132406f020 secure :-1 s=READY pgs=20 cs=0 l=1 rev1=1 rx=0x7f1334009fd0 tx=0x7f1334009df0).stop 2024-03-12T16:14:50.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 msgr2=0x7f133810e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:50.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 0x7f133810e040 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 rx=0x7f1328005010 tx=0x7f1328009cb0).stop 2024-03-12T16:14:50.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 shutdown_connections 2024-03-12T16:14:50.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f132406cb60 0x7f132406f020 unknown :-1 s=CLOSED pgs=20 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:50.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f13380fd8f0 0x7f133810e040 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 --2- 172.21.15.6:0/2365827669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f13380fe250 0x7f133810e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 >> 172.21.15.6:0/2365827669 conn(0x7f13380f34b0 msgr2=0x7f13380fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 shutdown_connections 2024-03-12T16:14:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.822+0000 7f134003c700 1 -- 172.21.15.6:0/2365827669 wait complete. 2024-03-12T16:14:50.834 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.925+0000 7fc7032e2700 1 -- 172.21.15.6:0/3030209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f88a0 msgr2=0x7fc6fc0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.925+0000 7fc7032e2700 1 --2- 172.21.15.6:0/3030209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f88a0 0x7fc6fc0f8c80 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7fc6f80047f0 tx=0x7fc6f8009cb0).stop 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.925+0000 7fc7032e2700 1 -- 172.21.15.6:0/3030209 shutdown_connections 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.925+0000 7fc7032e2700 1 --2- 172.21.15.6:0/3030209 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f9200 0x7fc6fc101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.925+0000 7fc7032e2700 1 --2- 172.21.15.6:0/3030209 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f88a0 0x7fc6fc0f8c80 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.925+0000 7fc7032e2700 1 -- 172.21.15.6:0/3030209 >> 172.21.15.6:0/3030209 conn(0x7fc6fc070590 msgr2=0x7fc6fc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.925+0000 7fc7032e2700 1 -- 172.21.15.6:0/3030209 shutdown_connections 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.925+0000 7fc7032e2700 1 -- 172.21.15.6:0/3030209 wait complete. 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc7032e2700 1 Processor -- start 2024-03-12T16:14:50.928 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc7032e2700 1 -- start start 2024-03-12T16:14:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc7032e2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f88a0 0x7fc6fc10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc7032e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f9200 0x7fc6fc10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:50.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc7032e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc10eb10 con 0x7fc6fc0f9200 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc7032e2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6fc10ec50 con 0x7fc6fc0f88a0 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70087d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f9200 0x7fc6fc10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70087d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f9200 0x7fc6fc10e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59630/0 (socket says 172.21.15.6:59630) 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70087d700 1 -- 172.21.15.6:0/1892165177 learned_addr learned my addr 172.21.15.6:0/1892165177 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70107e700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f88a0 0x7fc6fc10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70107e700 1 -- 172.21.15.6:0/1892165177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f88a0 msgr2=0x7fc6fc10e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70107e700 1 -- 172.21.15.6:0/1892165177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f88a0 msgr2=0x7fc6fc10e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70107e700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f88a0 0x7fc6fc10e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70107e700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f88a0 0x7fc6fc10e020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70087d700 1 -- 172.21.15.6:0/1892165177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f88a0 msgr2=0x7fc6fc10e020 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70087d700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f88a0 0x7fc6fc10e020 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.926+0000 7fc70087d700 1 -- 172.21.15.6:0/1892165177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6f8005040 con 0x7fc6fc0f9200 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.927+0000 7fc70087d700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f9200 0x7fc6fc10e510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fc6f00041d0 tx=0x7fc6f0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.927+0000 7fc6ee777700 1 -- 172.21.15.6:0/1892165177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f0002d90 con 0x7fc6fc0f9200 2024-03-12T16:14:50.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.927+0000 7fc6ee777700 1 -- 172.21.15.6:0/1892165177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6f000f040 con 0x7fc6fc0f9200 2024-03-12T16:14:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.927+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6fc1082e0 con 0x7fc6fc0f9200 2024-03-12T16:14:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.927+0000 7fc6ee777700 1 -- 172.21.15.6:0/1892165177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6f000d800 con 0x7fc6fc0f9200 2024-03-12T16:14:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.927+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6fc108820 con 0x7fc6fc0f9200 2024-03-12T16:14:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.928+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6fc05f590 con 0x7fc6fc0f9200 2024-03-12T16:14:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.928+0000 7fc6ee777700 1 -- 172.21.15.6:0/1892165177 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fc6f000da90 con 0x7fc6fc0f9200 2024-03-12T16:14:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.929+0000 7fc6ee777700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e806cbc0 0x7fc6e806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.929+0000 7fc70107e700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e806cbc0 0x7fc6e806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.929+0000 7fc6ee777700 1 -- 172.21.15.6:0/1892165177 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fc6f008bed0 con 0x7fc6fc0f9200 2024-03-12T16:14:50.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.929+0000 7fc70107e700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e806cbc0 0x7fc6e806f080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc6f8004f10 tx=0x7fc6f800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:50.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:50.934+0000 7fc6ee777700 1 -- 172.21.15.6:0/1892165177 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc6f00598c0 con 0x7fc6fc0f9200 2024-03-12T16:14:51.154 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.152+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc6fc108af0 con 0x7fc6e806cbc0 2024-03-12T16:14:51.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.153+0000 7fc6ee777700 1 -- 172.21.15.6:0/1892165177 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fc6fc108af0 con 0x7fc6e806cbc0 2024-03-12T16:14:51.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e806cbc0 msgr2=0x7fc6e806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:51.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e806cbc0 0x7fc6e806f080 secure :-1 s=READY pgs=21 cs=0 l=1 rev1=1 rx=0x7fc6f8004f10 tx=0x7fc6f800b040).stop 2024-03-12T16:14:51.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f9200 msgr2=0x7fc6fc10e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f9200 0x7fc6fc10e510 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fc6f00041d0 tx=0x7fc6f0009f60).stop 2024-03-12T16:14:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 shutdown_connections 2024-03-12T16:14:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6fc0f88a0 0x7fc6fc10e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e806cbc0 0x7fc6e806f080 unknown :-1 s=CLOSED pgs=21 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 --2- 172.21.15.6:0/1892165177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6fc0f9200 0x7fc6fc10e510 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 >> 172.21.15.6:0/1892165177 conn(0x7fc6fc070590 msgr2=0x7fc6fc0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 shutdown_connections 2024-03-12T16:14:51.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.155+0000 7fc7032e2700 1 -- 172.21.15.6:0/1892165177 wait complete. 2024-03-12T16:14:51.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.256+0000 7fa919cfa700 1 -- 172.21.15.6:0/2491187172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fc7f0 msgr2=0x7fa9140fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.256+0000 7fa919cfa700 1 --2- 172.21.15.6:0/2491187172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fc7f0 0x7fa9140fcbd0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fa9040047f0 tx=0x7fa904009cb0).stop 2024-03-12T16:14:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.256+0000 7fa919cfa700 1 -- 172.21.15.6:0/2491187172 shutdown_connections 2024-03-12T16:14:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.256+0000 7fa919cfa700 1 --2- 172.21.15.6:0/2491187172 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fd150 0x7fa9140f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.256+0000 7fa919cfa700 1 --2- 172.21.15.6:0/2491187172 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fc7f0 0x7fa9140fcbd0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.256+0000 7fa919cfa700 1 -- 172.21.15.6:0/2491187172 >> 172.21.15.6:0/2491187172 conn(0x7fa914070590 msgr2=0x7fa9140f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.256+0000 7fa919cfa700 1 -- 172.21.15.6:0/2491187172 shutdown_connections 2024-03-12T16:14:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.256+0000 7fa919cfa700 1 -- 172.21.15.6:0/2491187172 wait complete. 2024-03-12T16:14:51.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa919cfa700 1 Processor -- start 2024-03-12T16:14:51.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa919cfa700 1 -- start start 2024-03-12T16:14:51.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa919cfa700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fc7f0 0x7fa91410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:51.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa919cfa700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fd150 0x7fa91410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:51.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa919cfa700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91410eae0 con 0x7fa9140fd150 2024-03-12T16:14:51.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa919cfa700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa91410ec20 con 0x7fa9140fc7f0 2024-03-12T16:14:51.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa912ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fd150 0x7fa91410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:51.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa912ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fd150 0x7fa91410e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59656/0 (socket says 172.21.15.6:59656) 2024-03-12T16:14:51.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa912ffd700 1 -- 172.21.15.6:0/3082788196 learned_addr learned my addr 172.21.15.6:0/3082788196 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa9137fe700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fc7f0 0x7fa91410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa9137fe700 1 -- 172.21.15.6:0/3082788196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fc7f0 msgr2=0x7fa91410dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa9137fe700 1 -- 172.21.15.6:0/3082788196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fc7f0 msgr2=0x7fa91410dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa9137fe700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fc7f0 0x7fa91410dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa9137fe700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fc7f0 0x7fa91410dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.257+0000 7fa912ffd700 1 -- 172.21.15.6:0/3082788196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fc7f0 msgr2=0x7fa91410dff0 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.258+0000 7fa912ffd700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fc7f0 0x7fa91410dff0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.258+0000 7fa912ffd700 1 -- 172.21.15.6:0/3082788196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa904005040 con 0x7fa9140fd150 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.258+0000 7fa912ffd700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fd150 0x7fa91410e4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa908002780 tx=0x7fa908009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.258+0000 7fa910ff9700 1 -- 172.21.15.6:0/3082788196 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa908007b40 con 0x7fa9140fd150 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.258+0000 7fa910ff9700 1 -- 172.21.15.6:0/3082788196 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa90800f040 con 0x7fa9140fd150 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.258+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa9141082b0 con 0x7fa9140fd150 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.258+0000 7fa910ff9700 1 -- 172.21.15.6:0/3082788196 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa908014780 con 0x7fa9140fd150 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.258+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa914108870 con 0x7fa9140fd150 2024-03-12T16:14:51.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.259+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa91405f590 con 0x7fa9140fd150 2024-03-12T16:14:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.260+0000 7fa910ff9700 1 -- 172.21.15.6:0/3082788196 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fa908007ca0 con 0x7fa9140fd150 2024-03-12T16:14:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.260+0000 7fa910ff9700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa8fc06cbc0 0x7fa8fc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.260+0000 7fa910ff9700 1 -- 172.21.15.6:0/3082788196 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fa90808be00 con 0x7fa9140fd150 2024-03-12T16:14:51.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.260+0000 7fa9137fe700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa8fc06cbc0 0x7fa8fc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:51.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.260+0000 7fa9137fe700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa8fc06cbc0 0x7fa8fc06f080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa904004f10 tx=0x7fa90400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:51.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.264+0000 7fa910ff9700 1 -- 172.21.15.6:0/3082788196 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa9080597f0 con 0x7fa9140fd150 2024-03-12T16:14:51.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.476+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa914108f60 con 0x7fa8fc06cbc0 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.486+0000 7fa910ff9700 1 -- 172.21.15.6:0/3082788196 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fa914108f60 con 0x7fa8fc06cbc0 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (97s) 14s ago 12m 26.1M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (12m) 14s ago 12m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (12m) 0s ago 12m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (81s) 14s ago 12m 80.0M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (7m) 14s ago 7m 124M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (7m) 14s ago 7m 14.8M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (7m) 0s ago 7m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:14:51.489 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (7m) 0s ago 7m 17.6M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (3m) 14s ago 14m 467M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (2m) 0s ago 11m 447M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (28s) 14s ago 14m 27.2M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (4s) 0s ago 11m 21.2M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (2m) 14s ago 12m 16.9M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 0s ago 11m 18.2M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (11m) 14s ago 11m 218M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (10m) 14s ago 10m 235M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (10m) 14s ago 10m 194M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (9m) 0s ago 9m 265M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (9m) 0s ago 9m 235M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (8m) 0s ago 8m 227M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:14:51.490 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (113s) 0s ago 10m 55.7M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:14:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.488+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa8fc06cbc0 msgr2=0x7fa8fc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.488+0000 7fa919cfa700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa8fc06cbc0 0x7fa8fc06f080 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 rx=0x7fa904004f10 tx=0x7fa90400b040).stop 2024-03-12T16:14:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.488+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fd150 msgr2=0x7fa91410e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.488+0000 7fa919cfa700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fd150 0x7fa91410e4e0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7fa908002780 tx=0x7fa908009ee0).stop 2024-03-12T16:14:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.488+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 shutdown_connections 2024-03-12T16:14:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.488+0000 7fa919cfa700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa9140fc7f0 0x7fa91410dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.488+0000 7fa919cfa700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa8fc06cbc0 0x7fa8fc06f080 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.488+0000 7fa919cfa700 1 --2- 172.21.15.6:0/3082788196 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa9140fd150 0x7fa91410e4e0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.488+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 >> 172.21.15.6:0/3082788196 conn(0x7fa914070590 msgr2=0x7fa914060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.489+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 shutdown_connections 2024-03-12T16:14:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.489+0000 7fa919cfa700 1 -- 172.21.15.6:0/3082788196 wait complete. 2024-03-12T16:14:51.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.590+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/1551217408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 msgr2=0x7f0f080f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:51.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.590+0000 7f0f0e7ca700 1 --2- 172.21.15.6:0/1551217408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 0x7f0f080f8c80 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7f0ef80047f0 tx=0x7f0ef8009cb0).stop 2024-03-12T16:14:51.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.590+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/1551217408 shutdown_connections 2024-03-12T16:14:51.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.590+0000 7f0f0e7ca700 1 --2- 172.21.15.6:0/1551217408 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 0x7f0f08101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.590+0000 7f0f0e7ca700 1 --2- 172.21.15.6:0/1551217408 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 0x7f0f080f8c80 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.590+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/1551217408 >> 172.21.15.6:0/1551217408 conn(0x7f0f08070590 msgr2=0x7f0f080f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:51.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.590+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/1551217408 shutdown_connections 2024-03-12T16:14:51.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.590+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/1551217408 wait complete. 2024-03-12T16:14:51.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.590+0000 7f0f0e7ca700 1 Processor -- start 2024-03-12T16:14:51.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f0e7ca700 1 -- start start 2024-03-12T16:14:51.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f0e7ca700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 0x7f0f0810e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:51.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f0e7ca700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 0x7f0f0810e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f0e7ca700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0810eb00 con 0x7f0f080f88a0 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f0e7ca700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f0810ec40 con 0x7f0f080f9200 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 0x7f0f0810e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f07fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 0x7f0f0810e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59674/0 (socket says 172.21.15.6:59674) 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f07fff700 1 -- 172.21.15.6:0/2216856993 learned_addr learned my addr 172.21.15.6:0/2216856993 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f077fe700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 0x7f0f0810e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f077fe700 1 -- 172.21.15.6:0/2216856993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 msgr2=0x7f0f0810e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 13 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f077fe700 1 -- 172.21.15.6:0/2216856993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 msgr2=0x7f0f0810e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f077fe700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 0x7f0f0810e500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f077fe700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 0x7f0f0810e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f07fff700 1 -- 172.21.15.6:0/2216856993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 msgr2=0x7f0f0810e500 unknown :-1 s=STATE_CONNECTING l=1).mark_down 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f07fff700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 0x7f0f0810e500 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f07fff700 1 -- 172.21.15.6:0/2216856993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0ef8005040 con 0x7f0f080f88a0 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.591+0000 7f0f07fff700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 0x7f0f0810e010 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0ef8005010 tx=0x7f0ef8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:51.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.592+0000 7f0f057fa700 1 -- 172.21.15.6:0/2216856993 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef800e030 con 0x7f0f080f88a0 2024-03-12T16:14:51.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.592+0000 7f0f057fa700 1 -- 172.21.15.6:0/2216856993 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0ef8007e90 con 0x7f0f080f88a0 2024-03-12T16:14:51.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.592+0000 7f0f057fa700 1 -- 172.21.15.6:0/2216856993 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0ef8018070 con 0x7f0f080f88a0 2024-03-12T16:14:51.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.592+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f08108270 con 0x7f0f080f88a0 2024-03-12T16:14:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.592+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f08108750 con 0x7f0f080f88a0 2024-03-12T16:14:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.593+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f0805f590 con 0x7f0f080f88a0 2024-03-12T16:14:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.593+0000 7f0f057fa700 1 -- 172.21.15.6:0/2216856993 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7f0ef801d6e0 con 0x7f0f080f88a0 2024-03-12T16:14:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.594+0000 7f0f057fa700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0ef006cbc0 0x7f0ef006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.594+0000 7f0f057fa700 1 -- 172.21.15.6:0/2216856993 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f0ef808d1e0 con 0x7f0f080f88a0 2024-03-12T16:14:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.594+0000 7f0f077fe700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0ef006cbc0 0x7f0ef006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:51.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.594+0000 7f0f077fe700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0ef006cbc0 0x7f0ef006f080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0efc009fd0 tx=0x7f0efc009df0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:51.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.598+0000 7f0f057fa700 1 -- 172.21.15.6:0/2216856993 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0ef805a940 con 0x7f0f080f88a0 2024-03-12T16:14:51.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:51 smithi134 ceph-mon[85099]: pgmap v12: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-12T16:14:51.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:51 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:51.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:51 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:51.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:51 smithi006 ceph-mon[103869]: pgmap v12: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 17 KiB/s rd, 0 B/s wr, 9 op/s 2024-03-12T16:14:51.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:51 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:51.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:51 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:51.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.894+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0f08047540 con 0x7f0f080f88a0 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.894+0000 7f0f057fa700 1 -- 172.21.15.6:0/2216856993 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7f0ef805a760 con 0x7f0f080f88a0 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:14:51.897 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:14:51.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:14:51.898 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:14:51.898 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:14:51.898 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:14:51.898 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:14:51.898 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 10, 2024-03-12T16:14:51.898 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:14:51.898 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:14:51.898 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:14:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.896+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0ef006cbc0 msgr2=0x7f0ef006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.896+0000 7f0f0e7ca700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0ef006cbc0 0x7f0ef006f080 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 rx=0x7f0efc009fd0 tx=0x7f0efc009df0).stop 2024-03-12T16:14:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.896+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 msgr2=0x7f0f0810e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.896+0000 7f0f0e7ca700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 0x7f0f0810e010 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f0ef8005010 tx=0x7f0ef8009cb0).stop 2024-03-12T16:14:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.897+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 shutdown_connections 2024-03-12T16:14:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.897+0000 7f0f0e7ca700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0ef006cbc0 0x7f0ef006f080 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.897+0000 7f0f0e7ca700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f080f88a0 0x7f0f0810e010 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.897+0000 7f0f0e7ca700 1 --2- 172.21.15.6:0/2216856993 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f080f9200 0x7f0f0810e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:51.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.897+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 >> 172.21.15.6:0/2216856993 conn(0x7f0f08070590 msgr2=0x7f0f080fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.897+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 shutdown_connections 2024-03-12T16:14:51.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.897+0000 7f0f0e7ca700 1 -- 172.21.15.6:0/2216856993 wait complete. 2024-03-12T16:14:52.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.999+0000 7f03ece96700 1 -- 172.21.15.6:0/4241533731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 msgr2=0x7f03e80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.999+0000 7f03ece96700 1 --2- 172.21.15.6:0/4241533731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 0x7f03e80f6930 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7f03d00047f0 tx=0x7f03d0009cb0).stop 2024-03-12T16:14:52.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.999+0000 7f03ece96700 1 -- 172.21.15.6:0/4241533731 shutdown_connections 2024-03-12T16:14:52.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.999+0000 7f03ece96700 1 --2- 172.21.15.6:0/4241533731 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 0x7f03e80f6930 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.999+0000 7f03ece96700 1 --2- 172.21.15.6:0/4241533731 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 0x7f03e80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.999+0000 7f03ece96700 1 -- 172.21.15.6:0/4241533731 >> 172.21.15.6:0/4241533731 conn(0x7f03e8070590 msgr2=0x7f03e80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:52.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.999+0000 7f03ece96700 1 -- 172.21.15.6:0/4241533731 shutdown_connections 2024-03-12T16:14:52.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:51.999+0000 7f03ece96700 1 -- 172.21.15.6:0/4241533731 wait complete. 2024-03-12T16:14:52.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.000+0000 7f03ece96700 1 Processor -- start 2024-03-12T16:14:52.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.000+0000 7f03ece96700 1 -- start start 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.000+0000 7f03ece96700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 0x7f03e810ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.000+0000 7f03ece96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 0x7f03e810d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.000+0000 7f03ece96700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e810d9c0 con 0x7f03e80fd150 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.000+0000 7f03ece96700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f03e810db00 con 0x7f03e80fc7f0 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 0x7f03e810d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 0x7f03e810d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59700/0 (socket says 172.21.15.6:59700) 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e5d9b700 1 -- 172.21.15.6:0/2462176825 learned_addr learned my addr 172.21.15.6:0/2462176825 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e659c700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 0x7f03e810ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e659c700 1 -- 172.21.15.6:0/2462176825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 msgr2=0x7f03e810ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_bulk peer close file descriptor 12 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e659c700 1 -- 172.21.15.6:0/2462176825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 msgr2=0x7f03e810ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).read_until read failed 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e659c700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 0x7f03e810ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_read_frame_preamble_main read frame preamble failed r=-1 ((1) Operation not permitted) 2024-03-12T16:14:52.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e5d9b700 1 -- 172.21.15.6:0/2462176825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 msgr2=0x7f03e810ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e659c700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 0x7f03e810ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0)._fault waiting 0.200000 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e5d9b700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 0x7f03e810ced0 unknown :-1 s=START_CONNECT pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e5d9b700 1 -- 172.21.15.6:0/2462176825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f03d0005040 con 0x7f03e80fd150 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03e5d9b700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 0x7f03e810d3c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f03d00099f0 tx=0x7f03d0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03df7fe700 1 -- 172.21.15.6:0/2462176825 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d000e030 con 0x7f03e80fd150 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03df7fe700 1 -- 172.21.15.6:0/2462176825 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f03d0007e90 con 0x7f03e80fd150 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f03e8107130 con 0x7f03e80fd150 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03df7fe700 1 -- 172.21.15.6:0/2462176825 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f03d0018070 con 0x7f03e80fd150 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.001+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f03e8107690 con 0x7f03e80fd150 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.002+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f03e805f590 con 0x7f03e80fd150 2024-03-12T16:14:52.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.003+0000 7f03df7fe700 1 -- 172.21.15.6:0/2462176825 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7f03d0009590 con 0x7f03e80fd150 2024-03-12T16:14:52.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.003+0000 7f03df7fe700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f03d406cb60 0x7f03d406f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:52.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.003+0000 7f03df7fe700 1 -- 172.21.15.6:0/2462176825 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f03d008d240 con 0x7f03e80fd150 2024-03-12T16:14:52.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.003+0000 7f03e659c700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f03d406cb60 0x7f03d406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:52.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.003+0000 7f03e659c700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f03d406cb60 0x7f03d406f020 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f03d8009fd0 tx=0x7f03d8009d90).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:52.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.007+0000 7f03df7fe700 1 -- 172.21.15.6:0/2462176825 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f03d005ac30 con 0x7f03e80fd150 2024-03-12T16:14:52.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.253+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f03e8047540 con 0x7f03e80fd150 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.253+0000 7f03df7fe700 1 -- 172.21.15.6:0/2462176825 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 15 v15) v1 ==== 76+0+1868 (secure 0 0 0) 0x7f03d005a7c0 con 0x7f03e80fd150 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout:e15 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 15 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:14:52.256 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:14:27.566046+0000 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:14:52.257 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 export targets 1 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:14:52.258 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:14:52.259 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:14:52.259 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:52.259 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:14:52.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.255+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f03d406cb60 msgr2=0x7f03d406f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.255+0000 7f03ece96700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f03d406cb60 0x7f03d406f020 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 rx=0x7f03d8009fd0 tx=0x7f03d8009d90).stop 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.256+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 msgr2=0x7f03e810d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.256+0000 7f03ece96700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 0x7f03e810d3c0 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 rx=0x7f03d00099f0 tx=0x7f03d0009cb0).stop 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.256+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 shutdown_connections 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.256+0000 7f03ece96700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03e80fc7f0 0x7f03e810ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.256+0000 7f03ece96700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f03d406cb60 0x7f03d406f020 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.256+0000 7f03ece96700 1 --2- 172.21.15.6:0/2462176825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03e80fd150 0x7f03e810d3c0 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.256+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 >> 172.21.15.6:0/2462176825 conn(0x7f03e8070590 msgr2=0x7f03e80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.256+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 shutdown_connections 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.256+0000 7f03ece96700 1 -- 172.21.15.6:0/2462176825 wait complete. 2024-03-12T16:14:52.260 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 15 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.358+0000 7fb94e6c2700 1 -- 172.21.15.6:0/1179037888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 msgr2=0x7fb9480fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.358+0000 7fb94e6c2700 1 --2- 172.21.15.6:0/1179037888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 0x7fb9480fcbd0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fb9380047f0 tx=0x7fb938009cb0).stop 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.358+0000 7fb94e6c2700 1 -- 172.21.15.6:0/1179037888 shutdown_connections 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.358+0000 7fb94e6c2700 1 --2- 172.21.15.6:0/1179037888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9480fd150 0x7fb9480f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.358+0000 7fb94e6c2700 1 --2- 172.21.15.6:0/1179037888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 0x7fb9480fcbd0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.358+0000 7fb94e6c2700 1 -- 172.21.15.6:0/1179037888 >> 172.21.15.6:0/1179037888 conn(0x7fb948070590 msgr2=0x7fb9480f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.358+0000 7fb94e6c2700 1 -- 172.21.15.6:0/1179037888 shutdown_connections 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.358+0000 7fb94e6c2700 1 -- 172.21.15.6:0/1179037888 wait complete. 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.359+0000 7fb94e6c2700 1 Processor -- start 2024-03-12T16:14:52.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.359+0000 7fb94e6c2700 1 -- start start 2024-03-12T16:14:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.359+0000 7fb94e6c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 0x7fb94810e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.359+0000 7fb94e6c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9480fd150 0x7fb94810e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.359+0000 7fb94e6c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94810eb80 con 0x7fb9480fc7f0 2024-03-12T16:14:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.359+0000 7fb94e6c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb94810ecc0 con 0x7fb9480fd150 2024-03-12T16:14:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.359+0000 7fb947fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 0x7fb94810e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:52.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.359+0000 7fb947fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 0x7fb94810e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59718/0 (socket says 172.21.15.6:59718) 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.359+0000 7fb947fff700 1 -- 172.21.15.6:0/4156019224 learned_addr learned my addr 172.21.15.6:0/4156019224 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb9477fe700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9480fd150 0x7fb94810e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb947fff700 1 -- 172.21.15.6:0/4156019224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9480fd150 msgr2=0x7fb94810e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb947fff700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9480fd150 0x7fb94810e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb947fff700 1 -- 172.21.15.6:0/4156019224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb938005040 con 0x7fb9480fc7f0 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb9477fe700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9480fd150 0x7fb94810e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb947fff700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 0x7fb94810e090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb938009380 tx=0x7fb938009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb9457fa700 1 -- 172.21.15.6:0/4156019224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb938018070 con 0x7fb9480fc7f0 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb9457fa700 1 -- 172.21.15.6:0/4156019224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb938007e90 con 0x7fb9480fc7f0 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb948108330 con 0x7fb9480fc7f0 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb9457fa700 1 -- 172.21.15.6:0/4156019224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb9380123c0 con 0x7fb9480fc7f0 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.360+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb948108890 con 0x7fb9480fc7f0 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.361+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb94805f590 con 0x7fb9480fc7f0 2024-03-12T16:14:52.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.361+0000 7fb9457fa700 1 -- 172.21.15.6:0/4156019224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fb93801d420 con 0x7fb9480fc7f0 2024-03-12T16:14:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.362+0000 7fb9457fa700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb93006cbc0 0x7fb93006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.362+0000 7fb9457fa700 1 -- 172.21.15.6:0/4156019224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fb93808cc30 con 0x7fb9480fc7f0 2024-03-12T16:14:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.362+0000 7fb9477fe700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb93006cbc0 0x7fb93006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:52.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.362+0000 7fb9477fe700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb93006cbc0 0x7fb93006f080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb93c009f20 tx=0x7fb93c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:52.368 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.366+0000 7fb9457fa700 1 -- 172.21.15.6:0/4156019224 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb938056b90 con 0x7fb9480fc7f0 2024-03-12T16:14:52.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.582+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb948108f90 con 0x7fb93006cbc0 2024-03-12T16:14:52.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.583+0000 7fb9457fa700 1 -- 172.21.15.6:0/4156019224 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+383 (secure 0 0 0) 0x7fb948108f90 con 0x7fb93006cbc0 2024-03-12T16:14:52.585 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:14:52.585 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:14:52.585 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:14:52.585 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:14:52.585 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:14:52.586 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:14:52.586 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr" 2024-03-12T16:14:52.586 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:14:52.586 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "4/21 daemons upgraded", 2024-03-12T16:14:52.586 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mon daemons", 2024-03-12T16:14:52.586 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:14:52.586 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:14:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb93006cbc0 msgr2=0x7fb93006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb93006cbc0 0x7fb93006f080 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 rx=0x7fb93c009f20 tx=0x7fb93c00b040).stop 2024-03-12T16:14:52.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 msgr2=0x7fb94810e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 0x7fb94810e090 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7fb938009380 tx=0x7fb938009cb0).stop 2024-03-12T16:14:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 shutdown_connections 2024-03-12T16:14:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb93006cbc0 0x7fb93006f080 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9480fc7f0 0x7fb94810e090 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 --2- 172.21.15.6:0/4156019224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9480fd150 0x7fb94810e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 >> 172.21.15.6:0/4156019224 conn(0x7fb948070590 msgr2=0x7fb948060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 shutdown_connections 2024-03-12T16:14:52.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.585+0000 7fb94e6c2700 1 -- 172.21.15.6:0/4156019224 wait complete. 2024-03-12T16:14:52.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.690+0000 7f173980a700 1 -- 172.21.15.6:0/2408680872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 msgr2=0x7f17340fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.690+0000 7f173980a700 1 --2- 172.21.15.6:0/2408680872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 0x7f17340fdcf0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7f17240047f0 tx=0x7f1724009cb0).stop 2024-03-12T16:14:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.690+0000 7f173980a700 1 -- 172.21.15.6:0/2408680872 shutdown_connections 2024-03-12T16:14:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.690+0000 7f173980a700 1 --2- 172.21.15.6:0/2408680872 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fe270 0x7f17340f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.690+0000 7f173980a700 1 --2- 172.21.15.6:0/2408680872 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 0x7f17340fdcf0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.690+0000 7f173980a700 1 -- 172.21.15.6:0/2408680872 >> 172.21.15.6:0/2408680872 conn(0x7f17340f3530 msgr2=0x7f17340f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.690+0000 7f173980a700 1 -- 172.21.15.6:0/2408680872 shutdown_connections 2024-03-12T16:14:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.690+0000 7f173980a700 1 -- 172.21.15.6:0/2408680872 wait complete. 2024-03-12T16:14:52.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f173980a700 1 Processor -- start 2024-03-12T16:14:52.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f173980a700 1 -- start start 2024-03-12T16:14:52.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f173980a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 0x7f173410e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:52.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f173980a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fe270 0x7f173410e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:52.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f173980a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173410ec20 con 0x7f17340fd910 2024-03-12T16:14:52.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f173980a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f173410ed60 con 0x7f17340fe270 2024-03-12T16:14:52.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f1732ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 0x7f173410e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f1732ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 0x7f173410e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52550/0 (socket says 172.21.15.6:52550) 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f1732ffd700 1 -- 172.21.15.6:0/2235348037 learned_addr learned my addr 172.21.15.6:0/2235348037 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f17327fc700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fe270 0x7f173410e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f1732ffd700 1 -- 172.21.15.6:0/2235348037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fe270 msgr2=0x7f173410e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f1732ffd700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fe270 0x7f173410e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.691+0000 7f1732ffd700 1 -- 172.21.15.6:0/2235348037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f171c005040 con 0x7f17340fd910 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.692+0000 7f1732ffd700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 0x7f173410e130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1724009380 tx=0x7f1724009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.692+0000 7f172bfff700 1 -- 172.21.15.6:0/2235348037 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1724018070 con 0x7f17340fd910 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.692+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1724005040 con 0x7f17340fd910 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.692+0000 7f172bfff700 1 -- 172.21.15.6:0/2235348037 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1724007e90 con 0x7f17340fd910 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.692+0000 7f172bfff700 1 -- 172.21.15.6:0/2235348037 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f17240123c0 con 0x7f17340fd910 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.692+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1734108760 con 0x7f17340fd910 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.693+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f173405f570 con 0x7f17340fd910 2024-03-12T16:14:52.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.693+0000 7f172bfff700 1 -- 172.21.15.6:0/2235348037 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7f172401d420 con 0x7f17340fd910 2024-03-12T16:14:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.694+0000 7f172bfff700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f172006cbc0 0x7f172006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:14:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.694+0000 7f172bfff700 1 -- 172.21.15.6:0/2235348037 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f172408caf0 con 0x7f17340fd910 2024-03-12T16:14:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.694+0000 7f17327fc700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f172006cbc0 0x7f172006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:14:52.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.694+0000 7f17327fc700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f172006cbc0 0x7f172006f080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1734109a70 tx=0x7f171c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:14:52.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.698+0000 7f172bfff700 1 -- 172.21.15.6:0/2235348037 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f172405a4e0 con 0x7f17340fd910 2024-03-12T16:14:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:52 smithi134 ceph-mon[85099]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:52 smithi134 ceph-mon[85099]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:52 smithi134 ceph-mon[85099]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:52 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2216856993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:14:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:52 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2462176825' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:14:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:52 smithi006 ceph-mon[103869]: from='client.34130 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:52 smithi006 ceph-mon[103869]: from='client.34134 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:52 smithi006 ceph-mon[103869]: from='client.34138 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:52.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:52 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2216856993' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:14:52.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:52 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2462176825' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:14:52.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.982+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f1734109150 con 0x7f17340fd910 2024-03-12T16:14:52.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.982+0000 7f172bfff700 1 -- 172.21.15.6:0/2235348037 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7f172405a070 con 0x7f17340fd910 2024-03-12T16:14:52.984 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_OK 2024-03-12T16:14:52.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f172006cbc0 msgr2=0x7f172006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f172006cbc0 0x7f172006f080 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 rx=0x7f1734109a70 tx=0x7f171c00b040).stop 2024-03-12T16:14:52.986 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 msgr2=0x7f173410e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:14:52.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 0x7f173410e130 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f1724009380 tx=0x7f1724009cb0).stop 2024-03-12T16:14:52.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 shutdown_connections 2024-03-12T16:14:52.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f172006cbc0 0x7f172006f080 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f17340fd910 0x7f173410e130 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 --2- 172.21.15.6:0/2235348037 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f17340fe270 0x7f173410e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:14:52.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 >> 172.21.15.6:0/2235348037 conn(0x7f17340f3530 msgr2=0x7f17340fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:14:52.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 shutdown_connections 2024-03-12T16:14:52.987 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:14:52.984+0000 7f173980a700 1 -- 172.21.15.6:0/2235348037 wait complete. 2024-03-12T16:14:53.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:53 smithi134 ceph-mon[85099]: pgmap v13: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:53.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:53 smithi134 ceph-mon[85099]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:53.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:53 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2235348037' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:14:53.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:53 smithi006 ceph-mon[103869]: pgmap v13: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:53.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:53 smithi006 ceph-mon[103869]: from='client.34150 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:14:53.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:53 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2235348037' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:14:55.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:55 smithi134 ceph-mon[85099]: pgmap v14: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:55.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:55.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:55.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:55.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:14:55.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:55.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:14:55.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:14:55.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:55.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:55 smithi006 ceph-mon[103869]: pgmap v14: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:55.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:55.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:55.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:55.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:14:55.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:55.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:14:55.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:14:55.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:56.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:56 smithi134 ceph-mon[85099]: Detected new or changed devices on smithi134 2024-03-12T16:14:56.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:56 smithi134 ceph-mon[85099]: Reconfiguring mon.smithi006 (monmap changed)... 2024-03-12T16:14:56.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:56 smithi134 ceph-mon[85099]: Reconfiguring daemon mon.smithi006 on smithi006 2024-03-12T16:14:56.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:56 smithi134 ceph-mon[85099]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:56.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:56 smithi006 ceph-mon[103869]: Detected new or changed devices on smithi134 2024-03-12T16:14:56.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:56 smithi006 ceph-mon[103869]: Reconfiguring mon.smithi006 (monmap changed)... 2024-03-12T16:14:56.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:56 smithi006 ceph-mon[103869]: Reconfiguring daemon mon.smithi006 on smithi006 2024-03-12T16:14:56.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:56 smithi006 ceph-mon[103869]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi134.jqydtn=up:active} 2 up:standby 2024-03-12T16:14:57.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:57 smithi134 ceph-mon[85099]: pgmap v15: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:57.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:57.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:57.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi006.kskdce", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:14:57.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:14:57.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:57.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:57 smithi006 ceph-mon[103869]: pgmap v15: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:57.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:57.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:57.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi006.kskdce", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:14:57.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:14:57.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:58 smithi134 ceph-mon[85099]: Reconfiguring mgr.smithi006.kskdce (monmap changed)... 2024-03-12T16:14:58.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:58 smithi134 ceph-mon[85099]: Reconfiguring daemon mgr.smithi006.kskdce on smithi006 2024-03-12T16:14:58.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:58 smithi006 ceph-mon[103869]: Reconfiguring mgr.smithi006.kskdce (monmap changed)... 2024-03-12T16:14:58.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:58 smithi006 ceph-mon[103869]: Reconfiguring daemon mgr.smithi006.kskdce on smithi006 2024-03-12T16:14:59.808 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:59 smithi006 ceph-mon[103869]: pgmap v16: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:59.808 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:59 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:59.808 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:59 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:59.808 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:59 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi006", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:14:59.808 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:14:59 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:14:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:59 smithi134 ceph-mon[85099]: pgmap v16: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:14:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:59 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:59 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:14:59.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:59 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi006", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:14:59.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:14:59 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:00.838 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:00 smithi006 ceph-mon[103869]: Reconfiguring crash.smithi006 (monmap changed)... 2024-03-12T16:15:00.838 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:00 smithi006 ceph-mon[103869]: Reconfiguring daemon crash.smithi006 on smithi006 2024-03-12T16:15:00.838 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:00 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:00.839 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:00 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:00 smithi134 ceph-mon[85099]: Reconfiguring crash.smithi006 (monmap changed)... 2024-03-12T16:15:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:00 smithi134 ceph-mon[85099]: Reconfiguring daemon crash.smithi006 on smithi006 2024-03-12T16:15:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:00 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:00 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:01 smithi006 ceph-mon[103869]: pgmap v17: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:01 smithi006 ceph-mon[103869]: Reconfiguring osd.0 (monmap changed)... 2024-03-12T16:15:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-12T16:15:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:01.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:01 smithi006 ceph-mon[103869]: Reconfiguring daemon osd.0 on smithi006 2024-03-12T16:15:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:01 smithi134 ceph-mon[85099]: pgmap v17: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:01 smithi134 ceph-mon[85099]: Reconfiguring osd.0 (monmap changed)... 2024-03-12T16:15:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-12T16:15:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:01.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:01 smithi134 ceph-mon[85099]: Reconfiguring daemon osd.0 on smithi006 2024-03-12T16:15:02.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:15:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-12T16:15:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:15:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-12T16:15:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:03 smithi134 ceph-mon[85099]: pgmap v18: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:03 smithi134 ceph-mon[85099]: Reconfiguring osd.1 (monmap changed)... 2024-03-12T16:15:03.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:03 smithi134 ceph-mon[85099]: Reconfiguring daemon osd.1 on smithi006 2024-03-12T16:15:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:03 smithi006 ceph-mon[103869]: pgmap v18: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:03 smithi006 ceph-mon[103869]: Reconfiguring osd.1 (monmap changed)... 2024-03-12T16:15:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:03 smithi006 ceph-mon[103869]: Reconfiguring daemon osd.1 on smithi006 2024-03-12T16:15:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:04 smithi134 ceph-mon[85099]: Reconfiguring osd.2 (monmap changed)... 2024-03-12T16:15:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-12T16:15:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:04 smithi134 ceph-mon[85099]: Reconfiguring daemon osd.2 on smithi006 2024-03-12T16:15:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:04 smithi134 ceph-mon[85099]: pgmap v19: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:04 smithi006 ceph-mon[103869]: Reconfiguring osd.2 (monmap changed)... 2024-03-12T16:15:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-12T16:15:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:04 smithi006 ceph-mon[103869]: Reconfiguring daemon osd.2 on smithi006 2024-03-12T16:15:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:04 smithi006 ceph-mon[103869]: pgmap v19: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:06.701 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:06.701 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:06.701 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:06 smithi006 ceph-mon[103869]: Reconfiguring mds.cephfs.smithi006.ncuwuc (monmap changed)... 2024-03-12T16:15:06.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ncuwuc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:15:06.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:06.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:06 smithi006 ceph-mon[103869]: Reconfiguring daemon mds.cephfs.smithi006.ncuwuc on smithi006 2024-03-12T16:15:06.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:06.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:06.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:06 smithi134 ceph-mon[85099]: Reconfiguring mds.cephfs.smithi006.ncuwuc (monmap changed)... 2024-03-12T16:15:06.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ncuwuc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:15:06.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:06.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:06 smithi134 ceph-mon[85099]: Reconfiguring daemon mds.cephfs.smithi006.ncuwuc on smithi006 2024-03-12T16:15:07.531 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:07 smithi006 ceph-mon[103869]: pgmap v20: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:07.531 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:07.531 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:07.532 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ufmcfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:15:07.532 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:07.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:07 smithi134 ceph-mon[85099]: pgmap v20: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:07.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:07.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:07.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ufmcfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:15:07.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:08.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:08 smithi134 ceph-mon[85099]: Reconfiguring mds.cephfs.smithi006.ufmcfu (monmap changed)... 2024-03-12T16:15:08.661 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:08 smithi134 ceph-mon[85099]: Reconfiguring daemon mds.cephfs.smithi006.ufmcfu on smithi006 2024-03-12T16:15:08.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:08 smithi006 ceph-mon[103869]: Reconfiguring mds.cephfs.smithi006.ufmcfu (monmap changed)... 2024-03-12T16:15:08.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:08 smithi006 ceph-mon[103869]: Reconfiguring daemon mds.cephfs.smithi006.ufmcfu on smithi006 2024-03-12T16:15:09.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:09 smithi134 ceph-mon[85099]: pgmap v21: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:09.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:09 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:09.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:09 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:09.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:09 smithi134 ceph-mon[85099]: Reconfiguring crash.smithi134 (monmap changed)... 2024-03-12T16:15:09.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:09 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:15:09.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:09 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:09.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:09 smithi134 ceph-mon[85099]: Reconfiguring daemon crash.smithi134 on smithi134 2024-03-12T16:15:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:09 smithi006 ceph-mon[103869]: pgmap v21: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:09 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:09 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:09 smithi006 ceph-mon[103869]: Reconfiguring crash.smithi134 (monmap changed)... 2024-03-12T16:15:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:09 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:15:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:09 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:09 smithi006 ceph-mon[103869]: Reconfiguring daemon crash.smithi134 on smithi134 2024-03-12T16:15:11.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:11 smithi134 ceph-mon[85099]: pgmap v22: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:11 smithi134 ceph-mon[85099]: Reconfiguring mgr.smithi134.gcntfu (monmap changed)... 2024-03-12T16:15:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:15:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:15:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:11 smithi134 ceph-mon[85099]: Reconfiguring daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:15:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:11 smithi006 ceph-mon[103869]: pgmap v22: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:11 smithi006 ceph-mon[103869]: Reconfiguring mgr.smithi134.gcntfu (monmap changed)... 2024-03-12T16:15:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.smithi134.gcntfu", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-03-12T16:15:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mgr services"}]: dispatch 2024-03-12T16:15:11.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:11.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:11 smithi006 ceph-mon[103869]: Reconfiguring daemon mgr.smithi134.gcntfu on smithi134 2024-03-12T16:15:12.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:12 smithi134 ceph-mon[85099]: pgmap v23: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:12.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:12 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:12.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:12 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:12.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:12 smithi134 ceph-mon[85099]: Reconfiguring mon.smithi134 (monmap changed)... 2024-03-12T16:15:12.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:12 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:15:12.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:12 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:15:12.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:12 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:12.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:12 smithi134 ceph-mon[85099]: Reconfiguring daemon mon.smithi134 on smithi134 2024-03-12T16:15:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:12 smithi006 ceph-mon[103869]: pgmap v23: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:12 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:12 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:12 smithi006 ceph-mon[103869]: Reconfiguring mon.smithi134 (monmap changed)... 2024-03-12T16:15:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:12 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-03-12T16:15:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:12 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-03-12T16:15:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:12 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:13.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:12 smithi006 ceph-mon[103869]: Reconfiguring daemon mon.smithi134 on smithi134 2024-03-12T16:15:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:14 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:14.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:14 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:14.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:14 smithi006 ceph-mon[103869]: Reconfiguring osd.3 (monmap changed)... 2024-03-12T16:15:14.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:14 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-12T16:15:14.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:14 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:14.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:14 smithi006 ceph-mon[103869]: Reconfiguring daemon osd.3 on smithi134 2024-03-12T16:15:14.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:14 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:14.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:14 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:14.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:14 smithi134 ceph-mon[85099]: Reconfiguring osd.3 (monmap changed)... 2024-03-12T16:15:14.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:14 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-12T16:15:14.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:14 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:14.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:14 smithi134 ceph-mon[85099]: Reconfiguring daemon osd.3 on smithi134 2024-03-12T16:15:15.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:15 smithi134 ceph-mon[85099]: pgmap v24: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:15.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:15 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:15.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:15 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:15.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:15 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-12T16:15:15.828 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:15 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:15 smithi006 ceph-mon[103869]: pgmap v24: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:15 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:15 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:15 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-12T16:15:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:15 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:16.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:16 smithi134 ceph-mon[85099]: Reconfiguring osd.4 (monmap changed)... 2024-03-12T16:15:16.601 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:16 smithi134 ceph-mon[85099]: Reconfiguring daemon osd.4 on smithi134 2024-03-12T16:15:16.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:16 smithi006 ceph-mon[103869]: Reconfiguring osd.4 (monmap changed)... 2024-03-12T16:15:16.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:16 smithi006 ceph-mon[103869]: Reconfiguring daemon osd.4 on smithi134 2024-03-12T16:15:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:17 smithi006 ceph-mon[103869]: pgmap v25: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-12T16:15:17.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:17.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:15:18.132 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:17 smithi134 ceph-mon[85099]: pgmap v25: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-12T16:15:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:18.133 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:15:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:18 smithi134 ceph-mon[85099]: Reconfiguring osd.5 (monmap changed)... 2024-03-12T16:15:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:18 smithi134 ceph-mon[85099]: Reconfiguring daemon osd.5 on smithi134 2024-03-12T16:15:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:18 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:18 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:18 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jqydtn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:15:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:18 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:19.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:18 smithi006 ceph-mon[103869]: Reconfiguring osd.5 (monmap changed)... 2024-03-12T16:15:19.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:18 smithi006 ceph-mon[103869]: Reconfiguring daemon osd.5 on smithi134 2024-03-12T16:15:19.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:18 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:19.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:18 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:19.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:18 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jqydtn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:15:19.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:18 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:19.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:19 smithi134 ceph-mon[85099]: pgmap v26: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:19.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:19 smithi134 ceph-mon[85099]: Reconfiguring mds.cephfs.smithi134.jqydtn (monmap changed)... 2024-03-12T16:15:19.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:19 smithi134 ceph-mon[85099]: Reconfiguring daemon mds.cephfs.smithi134.jqydtn on smithi134 2024-03-12T16:15:20.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:19 smithi006 ceph-mon[103869]: pgmap v26: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:20.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:19 smithi006 ceph-mon[103869]: Reconfiguring mds.cephfs.smithi134.jqydtn (monmap changed)... 2024-03-12T16:15:20.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:19 smithi006 ceph-mon[103869]: Reconfiguring daemon mds.cephfs.smithi134.jqydtn on smithi134 2024-03-12T16:15:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:20 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:20 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:20 smithi134 ceph-mon[85099]: Reconfiguring mds.cephfs.smithi134.ufgvbd (monmap changed)... 2024-03-12T16:15:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:20 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ufgvbd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:15:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:20 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:20 smithi134 ceph-mon[85099]: Reconfiguring daemon mds.cephfs.smithi134.ufgvbd on smithi134 2024-03-12T16:15:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:20 smithi134 ceph-mon[85099]: pgmap v27: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:20 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:20 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:20 smithi006 ceph-mon[103869]: Reconfiguring mds.cephfs.smithi134.ufgvbd (monmap changed)... 2024-03-12T16:15:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:20 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ufgvbd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:15:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:20 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:20 smithi006 ceph-mon[103869]: Reconfiguring daemon mds.cephfs.smithi134.ufgvbd on smithi134 2024-03-12T16:15:21.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:20 smithi006 ceph-mon[103869]: pgmap v27: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:22.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:22.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:22.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:15:22.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:22.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:22.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all mon 2024-03-12T16:15:22.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:22.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi006"}]: dispatch 2024-03-12T16:15:22.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi006"}]': finished 2024-03-12T16:15:22.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2024-03-12T16:15:22.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-03-12T16:15:22.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all mon 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi006"}]: dispatch 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi006"}]': finished 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]: dispatch 2024-03-12T16:15:22.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.smithi134"}]': finished 2024-03-12T16:15:23.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 -- 172.21.15.6:0/3380162362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f88a0 msgr2=0x7f31a40f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 --2- 172.21.15.6:0/3380162362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f88a0 0x7f31a40f8c80 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f31940047f0 tx=0x7f3194009cb0).stop 2024-03-12T16:15:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 -- 172.21.15.6:0/3380162362 shutdown_connections 2024-03-12T16:15:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 --2- 172.21.15.6:0/3380162362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a40f9200 0x7f31a4101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 --2- 172.21.15.6:0/3380162362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f88a0 0x7f31a40f8c80 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 -- 172.21.15.6:0/3380162362 >> 172.21.15.6:0/3380162362 conn(0x7f31a4070590 msgr2=0x7f31a40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 -- 172.21.15.6:0/3380162362 shutdown_connections 2024-03-12T16:15:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 -- 172.21.15.6:0/3380162362 wait complete. 2024-03-12T16:15:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 Processor -- start 2024-03-12T16:15:23.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.096+0000 7f31aa7c2700 1 -- start start 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31aa7c2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a40f88a0 0x7f31a410e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31aa7c2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f9200 0x7f31a410e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31aa7c2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a410eb10 con 0x7f31a40f9200 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31aa7c2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f31a410ec50 con 0x7f31a40f88a0 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31a37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f9200 0x7f31a410e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31a37fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f9200 0x7f31a410e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50454/0 (socket says 172.21.15.6:50454) 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31a37fe700 1 -- 172.21.15.6:0/738130025 learned_addr learned my addr 172.21.15.6:0/738130025 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31a3fff700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a40f88a0 0x7f31a410e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31a37fe700 1 -- 172.21.15.6:0/738130025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a40f88a0 msgr2=0x7f31a410e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.101 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31a37fe700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a40f88a0 0x7f31a410e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31a37fe700 1 -- 172.21.15.6:0/738130025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3194005040 con 0x7f31a40f9200 2024-03-12T16:15:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.097+0000 7f31a37fe700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f9200 0x7f31a410e510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f319800c790 tx=0x7f3198004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.098+0000 7f31a17fa700 1 -- 172.21.15.6:0/738130025 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f319800e680 con 0x7f31a40f9200 2024-03-12T16:15:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.098+0000 7f31a17fa700 1 -- 172.21.15.6:0/738130025 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f319800ec90 con 0x7f31a40f9200 2024-03-12T16:15:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.098+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f31a41082e0 con 0x7f31a40f9200 2024-03-12T16:15:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.098+0000 7f31a17fa700 1 -- 172.21.15.6:0/738130025 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3198012d60 con 0x7f31a40f9200 2024-03-12T16:15:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.098+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f31a4108820 con 0x7f31a40f9200 2024-03-12T16:15:23.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.099+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f31a405f590 con 0x7f31a40f9200 2024-03-12T16:15:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.099+0000 7f31a17fa700 1 -- 172.21.15.6:0/738130025 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7f3198012400 con 0x7f31a40f9200 2024-03-12T16:15:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.100+0000 7f31a17fa700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f318c06cbc0 0x7f318c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.100+0000 7f31a17fa700 1 -- 172.21.15.6:0/738130025 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f319808b640 con 0x7f31a40f9200 2024-03-12T16:15:23.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.100+0000 7f31a3fff700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f318c06cbc0 0x7f318c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:23.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.100+0000 7f31a3fff700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f318c06cbc0 0x7f318c06f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3194004f10 tx=0x7f3194009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:23.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.104+0000 7f31a17fa700 1 -- 172.21.15.6:0/738130025 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3198059140 con 0x7f31a40f9200 2024-03-12T16:15:23.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.334+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f31a4108a90 con 0x7f318c06cbc0 2024-03-12T16:15:23.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.336+0000 7f31a17fa700 1 -- 172.21.15.6:0/738130025 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7f31a4108a90 con 0x7f318c06cbc0 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f318c06cbc0 msgr2=0x7f318c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f318c06cbc0 0x7f318c06f080 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 rx=0x7f3194004f10 tx=0x7f3194009cb0).stop 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f9200 msgr2=0x7f31a410e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f9200 0x7f31a410e510 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f319800c790 tx=0x7f3198004330).stop 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 shutdown_connections 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f31a40f88a0 0x7f31a410e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f318c06cbc0 0x7f318c06f080 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 --2- 172.21.15.6:0/738130025 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f31a40f9200 0x7f31a410e510 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 >> 172.21.15.6:0/738130025 conn(0x7f31a4070590 msgr2=0x7f31a40fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 shutdown_connections 2024-03-12T16:15:23.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.338+0000 7f31aa7c2700 1 -- 172.21.15.6:0/738130025 wait complete. 2024-03-12T16:15:23.350 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.443+0000 7fae6619e700 1 -- 172.21.15.6:0/2862462808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 msgr2=0x7fae600f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.443+0000 7fae6619e700 1 --2- 172.21.15.6:0/2862462808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 0x7fae600f7a30 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7fae540047f0 tx=0x7fae54009cb0).stop 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.443+0000 7fae6619e700 1 -- 172.21.15.6:0/2862462808 shutdown_connections 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.443+0000 7fae6619e700 1 --2- 172.21.15.6:0/2862462808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 0x7fae600f7a30 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.443+0000 7fae6619e700 1 --2- 172.21.15.6:0/2862462808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae600fd8f0 0x7fae600fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.443+0000 7fae6619e700 1 -- 172.21.15.6:0/2862462808 >> 172.21.15.6:0/2862462808 conn(0x7fae600f34b0 msgr2=0x7fae600f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.443+0000 7fae6619e700 1 -- 172.21.15.6:0/2862462808 shutdown_connections 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.443+0000 7fae6619e700 1 -- 172.21.15.6:0/2862462808 wait complete. 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.443+0000 7fae6619e700 1 Processor -- start 2024-03-12T16:15:23.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae6619e700 1 -- start start 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae6619e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae600fd8f0 0x7fae6006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae6619e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 0x7fae6006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae6619e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6006bab0 con 0x7fae600fe250 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae6619e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae6006bbf0 con 0x7fae600fd8f0 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 0x7fae6006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae5effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 0x7fae6006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50470/0 (socket says 172.21.15.6:50470) 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae5effd700 1 -- 172.21.15.6:0/1715686743 learned_addr learned my addr 172.21.15.6:0/1715686743 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae5f7fe700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae600fd8f0 0x7fae6006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae5effd700 1 -- 172.21.15.6:0/1715686743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae600fd8f0 msgr2=0x7fae6006b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae5effd700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae600fd8f0 0x7fae6006b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.448 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae5effd700 1 -- 172.21.15.6:0/1715686743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fae54005040 con 0x7fae600fe250 2024-03-12T16:15:23.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.444+0000 7fae5effd700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 0x7fae6006b5c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fae54000c00 tx=0x7fae54009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:23.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.445+0000 7fae5cff9700 1 -- 172.21.15.6:0/1715686743 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae5400e030 con 0x7fae600fe250 2024-03-12T16:15:23.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.445+0000 7fae5cff9700 1 -- 172.21.15.6:0/1715686743 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fae54007e90 con 0x7fae600fe250 2024-03-12T16:15:23.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.445+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae6006be40 con 0x7fae600fe250 2024-03-12T16:15:23.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.445+0000 7fae5cff9700 1 -- 172.21.15.6:0/1715686743 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fae54018070 con 0x7fae600fe250 2024-03-12T16:15:23.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.445+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae60114690 con 0x7fae600fe250 2024-03-12T16:15:23.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.446+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae6005f590 con 0x7fae600fe250 2024-03-12T16:15:23.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.447+0000 7fae5cff9700 1 -- 172.21.15.6:0/1715686743 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fae5401d420 con 0x7fae600fe250 2024-03-12T16:15:23.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.447+0000 7fae5cff9700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fae4806cbc0 0x7fae4806f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:23.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.447+0000 7fae5cff9700 1 -- 172.21.15.6:0/1715686743 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fae5408d6e0 con 0x7fae600fe250 2024-03-12T16:15:23.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.447+0000 7fae5f7fe700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fae4806cbc0 0x7fae4806f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:23.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.448+0000 7fae5f7fe700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fae4806cbc0 0x7fae4806f080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fae50009170 tx=0x7fae50009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:23.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.451+0000 7fae5cff9700 1 -- 172.21.15.6:0/1715686743 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fae540576c0 con 0x7fae600fe250 2024-03-12T16:15:23.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.675+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fae60059120 con 0x7fae4806cbc0 2024-03-12T16:15:23.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.677+0000 7fae5cff9700 1 -- 172.21.15.6:0/1715686743 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fae60059120 con 0x7fae4806cbc0 2024-03-12T16:15:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fae4806cbc0 msgr2=0x7fae4806f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fae4806cbc0 0x7fae4806f080 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 rx=0x7fae50009170 tx=0x7fae50009d60).stop 2024-03-12T16:15:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 msgr2=0x7fae6006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 0x7fae6006b5c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 rx=0x7fae54000c00 tx=0x7fae54009cb0).stop 2024-03-12T16:15:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 shutdown_connections 2024-03-12T16:15:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae600fd8f0 0x7fae6006b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fae4806cbc0 0x7fae4806f080 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 --2- 172.21.15.6:0/1715686743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae600fe250 0x7fae6006b5c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 >> 172.21.15.6:0/1715686743 conn(0x7fae600f34b0 msgr2=0x7fae600fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 shutdown_connections 2024-03-12T16:15:23.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.680+0000 7fae6619e700 1 -- 172.21.15.6:0/1715686743 wait complete. 2024-03-12T16:15:23.700 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:23 smithi006 ceph-mon[103869]: pgmap v28: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:23.700 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:23 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:23.700 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:23 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi006", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:15:23.700 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:23 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:23.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:23 smithi134 ceph-mon[85099]: pgmap v28: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:23.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:23 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:23.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:23 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi006", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:15:23.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:23 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.789+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/2443606703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 msgr2=0x7fcd880f8d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.789+0000 7fcd8e8d8700 1 --2- 172.21.15.6:0/2443606703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 0x7fcd880f8d40 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7fcd78004820 tx=0x7fcd78009cb0).stop 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.789+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/2443606703 shutdown_connections 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.789+0000 7fcd8e8d8700 1 --2- 172.21.15.6:0/2443606703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd880f9230 0x7fcd881019d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.789+0000 7fcd8e8d8700 1 --2- 172.21.15.6:0/2443606703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 0x7fcd880f8d40 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.789+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/2443606703 >> 172.21.15.6:0/2443606703 conn(0x7fcd88070590 msgr2=0x7fcd880f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.789+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/2443606703 shutdown_connections 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.789+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/2443606703 wait complete. 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.790+0000 7fcd8e8d8700 1 Processor -- start 2024-03-12T16:15:23.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.790+0000 7fcd8e8d8700 1 -- start start 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.790+0000 7fcd8e8d8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 0x7fcd8810e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.790+0000 7fcd8e8d8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd880f9230 0x7fcd8810e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.790+0000 7fcd8e8d8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8810eb20 con 0x7fcd880f8960 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.790+0000 7fcd8e8d8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd8810ec60 con 0x7fcd880f9230 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.790+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 0x7fcd8810e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.790+0000 7fcd87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 0x7fcd8810e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50484/0 (socket says 172.21.15.6:50484) 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.790+0000 7fcd87fff700 1 -- 172.21.15.6:0/3970741542 learned_addr learned my addr 172.21.15.6:0/3970741542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.791+0000 7fcd87fff700 1 -- 172.21.15.6:0/3970741542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd880f9230 msgr2=0x7fcd8810e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.791+0000 7fcd87fff700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd880f9230 0x7fcd8810e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:15:23.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.791+0000 7fcd87fff700 1 -- 172.21.15.6:0/3970741542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd78005040 con 0x7fcd880f8960 2024-03-12T16:15:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.791+0000 7fcd87fff700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 0x7fcd8810e030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcd78005010 tx=0x7fcd78009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.791+0000 7fcd857fa700 1 -- 172.21.15.6:0/3970741542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd7800e030 con 0x7fcd880f8960 2024-03-12T16:15:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.791+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd88108290 con 0x7fcd880f8960 2024-03-12T16:15:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.791+0000 7fcd857fa700 1 -- 172.21.15.6:0/3970741542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd78007e90 con 0x7fcd880f8960 2024-03-12T16:15:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.791+0000 7fcd857fa700 1 -- 172.21.15.6:0/3970741542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd78018070 con 0x7fcd880f8960 2024-03-12T16:15:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.791+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd88108770 con 0x7fcd880f8960 2024-03-12T16:15:23.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.792+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd8805f590 con 0x7fcd880f8960 2024-03-12T16:15:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.792+0000 7fcd857fa700 1 -- 172.21.15.6:0/3970741542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fcd7801d420 con 0x7fcd880f8960 2024-03-12T16:15:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.793+0000 7fcd857fa700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd7406cb60 0x7fcd7406f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.793+0000 7fcd857fa700 1 -- 172.21.15.6:0/3970741542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fcd7808d260 con 0x7fcd880f8960 2024-03-12T16:15:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.793+0000 7fcd877fe700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd7406cb60 0x7fcd7406f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:23.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.793+0000 7fcd877fe700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd7406cb60 0x7fcd7406f020 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcd88109970 tx=0x7fcd70009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:23.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:23.797+0000 7fcd857fa700 1 -- 172.21.15.6:0/3970741542 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fcd7805ac50 con 0x7fcd880f8960 2024-03-12T16:15:24.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.006+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd880fee60 con 0x7fcd7406cb60 2024-03-12T16:15:24.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.019+0000 7fcd857fa700 1 -- 172.21.15.6:0/3970741542 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fcd880fee60 con 0x7fcd7406cb60 2024-03-12T16:15:24.021 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:15:24.021 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (2m) 47s ago 13m 26.1M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:15:24.021 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (13m) 47s ago 13m 6643k - 16.2.15-1-g8963e9de 727f386679cb 6f4fd831ec37 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (12m) 33s ago 12m 6643k - 16.2.15-1-g8963e9de 727f386679cb 576ab023bdd3 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (114s) 47s ago 12m 80.0M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (7m) 47s ago 7m 124M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (7m) 47s ago 7m 14.8M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (7m) 33s ago 7m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (7m) 33s ago 7m 17.6M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (3m) 47s ago 14m 467M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (3m) 33s ago 12m 447M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (61s) 47s ago 14m 27.2M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (37s) 33s ago 12m 21.2M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (2m) 47s ago 12m 16.9M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (2m) 33s ago 12m 18.2M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:15:24.022 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (11m) 47s ago 11m 218M 1911M 16.2.15-1-g8963e9de 727f386679cb 8e8f236b5ebe 2024-03-12T16:15:24.023 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (11m) 47s ago 11m 235M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:15:24.023 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (11m) 47s ago 11m 194M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:15:24.023 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (10m) 33s ago 10m 265M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:15:24.023 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (9m) 33s ago 9m 235M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:15:24.023 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (9m) 33s ago 9m 227M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:15:24.023 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (2m) 33s ago 11m 55.7M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:15:24.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.021+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd7406cb60 msgr2=0x7fcd7406f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.021+0000 7fcd8e8d8700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd7406cb60 0x7fcd7406f020 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 rx=0x7fcd88109970 tx=0x7fcd70009b60).stop 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.021+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 msgr2=0x7fcd8810e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.021+0000 7fcd8e8d8700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 0x7fcd8810e030 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7fcd78005010 tx=0x7fcd78009cb0).stop 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.021+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 shutdown_connections 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.021+0000 7fcd8e8d8700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd7406cb60 0x7fcd7406f020 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.021+0000 7fcd8e8d8700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd880f8960 0x7fcd8810e030 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.021+0000 7fcd8e8d8700 1 --2- 172.21.15.6:0/3970741542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd880f9230 0x7fcd8810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.021+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 >> 172.21.15.6:0/3970741542 conn(0x7fcd88070590 msgr2=0x7fcd880fc1a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.022+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 shutdown_connections 2024-03-12T16:15:24.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.022+0000 7fcd8e8d8700 1 -- 172.21.15.6:0/3970741542 wait complete. 2024-03-12T16:15:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.122+0000 7fc8afeb9700 1 -- 172.21.15.6:0/614083576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 msgr2=0x7fc8a80fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.122+0000 7fc8afeb9700 1 --2- 172.21.15.6:0/614083576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 0x7fc8a80fdcb0 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fc898009b60 tx=0x7fc898004d10).stop 2024-03-12T16:15:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.122+0000 7fc8afeb9700 1 -- 172.21.15.6:0/614083576 shutdown_connections 2024-03-12T16:15:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.122+0000 7fc8afeb9700 1 --2- 172.21.15.6:0/614083576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a80fe230 0x7fc8a80f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:15:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.123+0000 7fc8afeb9700 1 --2- 172.21.15.6:0/614083576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 0x7fc8a80fdcb0 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.123+0000 7fc8afeb9700 1 -- 172.21.15.6:0/614083576 >> 172.21.15.6:0/614083576 conn(0x7fc8a806cea0 msgr2=0x7fc8a806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.123+0000 7fc8afeb9700 1 -- 172.21.15.6:0/614083576 shutdown_connections 2024-03-12T16:15:24.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.123+0000 7fc8afeb9700 1 -- 172.21.15.6:0/614083576 wait complete. 2024-03-12T16:15:24.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.123+0000 7fc8afeb9700 1 Processor -- start 2024-03-12T16:15:24.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.123+0000 7fc8afeb9700 1 -- start start 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8afeb9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 0x7fc8a810e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8afeb9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a80fe230 0x7fc8a810e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8afeb9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a810ecb0 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8afeb9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8a81082d0 con 0x7fc8a80fe230 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8adc55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 0x7fc8a810e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8adc55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 0x7fc8a810e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50498/0 (socket says 172.21.15.6:50498) 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8adc55700 1 -- 172.21.15.6:0/1545508910 learned_addr learned my addr 172.21.15.6:0/1545508910 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8ad454700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a80fe230 0x7fc8a810e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8adc55700 1 -- 172.21.15.6:0/1545508910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a80fe230 msgr2=0x7fc8a810e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8adc55700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a80fe230 0x7fc8a810e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8adc55700 1 -- 172.21.15.6:0/1545508910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8980097c0 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8adc55700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 0x7fc8a810e130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc898009040 tx=0x7fc898004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:24.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.124+0000 7fc8a6ffd700 1 -- 172.21.15.6:0/1545508910 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc89800e070 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.125+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8a8108520 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.125+0000 7fc8a6ffd700 1 -- 172.21.15.6:0/1545508910 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc89800bec0 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.125+0000 7fc8a6ffd700 1 -- 172.21.15.6:0/1545508910 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc898019070 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.125+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8a8108a00 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.125+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8a8047540 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.126+0000 7fc8a6ffd700 1 -- 172.21.15.6:0/1545508910 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fc89801d7c0 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.126+0000 7fc8a6ffd700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc89006cbc0 0x7fc89006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:24.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.126+0000 7fc8a6ffd700 1 -- 172.21.15.6:0/1545508910 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fc89808d450 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.127+0000 7fc8ad454700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc89006cbc0 0x7fc89006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:24.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.127+0000 7fc8ad454700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc89006cbc0 0x7fc89006f080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc8a8109a70 tx=0x7fc89c008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:24.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.131+0000 7fc8a6ffd700 1 -- 172.21.15.6:0/1545508910 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc89805af00 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.414+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc8a81097b0 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.414+0000 7fc8a6ffd700 1 -- 172.21.15.6:0/1545508910 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+739 (secure 0 0 0) 0x7fc89805aa90 con 0x7fc8a80fd8d0 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:15:24.417 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:15:24.418 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:15:24.418 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 10, 2024-03-12T16:15:24.418 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:15:24.418 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:15:24.418 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:15:24.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc89006cbc0 msgr2=0x7fc89006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc89006cbc0 0x7fc89006f080 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 rx=0x7fc8a8109a70 tx=0x7fc89c008040).stop 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 msgr2=0x7fc8a810e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 0x7fc8a810e130 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7fc898009040 tx=0x7fc898004d10).stop 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 shutdown_connections 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc89006cbc0 0x7fc89006f080 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8a80fd8d0 0x7fc8a810e130 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 --2- 172.21.15.6:0/1545508910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8a80fe230 0x7fc8a810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 >> 172.21.15.6:0/1545508910 conn(0x7fc8a806cea0 msgr2=0x7fc8a8100ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 shutdown_connections 2024-03-12T16:15:24.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.416+0000 7fc8afeb9700 1 -- 172.21.15.6:0/1545508910 wait complete. 2024-03-12T16:15:24.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:24 smithi006 ceph-mon[103869]: Upgrade: Updating crash.smithi006 (1/2) 2024-03-12T16:15:24.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:24 smithi006 ceph-mon[103869]: Deploying daemon crash.smithi006 on smithi006 2024-03-12T16:15:24.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:24 smithi006 ceph-mon[103869]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:24.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:24 smithi006 ceph-mon[103869]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.518+0000 7fcc78d5f700 1 -- 172.21.15.6:0/1201888005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 msgr2=0x7fcc740f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.518+0000 7fcc78d5f700 1 --2- 172.21.15.6:0/1201888005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 0x7fcc740f7a50 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fcc680047f0 tx=0x7fcc68009cb0).stop 2024-03-12T16:15:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.518+0000 7fcc78d5f700 1 -- 172.21.15.6:0/1201888005 shutdown_connections 2024-03-12T16:15:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.518+0000 7fcc78d5f700 1 --2- 172.21.15.6:0/1201888005 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 0x7fcc740f7a50 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.518+0000 7fcc78d5f700 1 --2- 172.21.15.6:0/1201888005 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc740fd910 0x7fcc740fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.518+0000 7fcc78d5f700 1 -- 172.21.15.6:0/1201888005 >> 172.21.15.6:0/1201888005 conn(0x7fcc740f3530 msgr2=0x7fcc740f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.518+0000 7fcc78d5f700 1 -- 172.21.15.6:0/1201888005 shutdown_connections 2024-03-12T16:15:24.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.518+0000 7fcc78d5f700 1 -- 172.21.15.6:0/1201888005 wait complete. 2024-03-12T16:15:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.519+0000 7fcc78d5f700 1 Processor -- start 2024-03-12T16:15:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.519+0000 7fcc78d5f700 1 -- start start 2024-03-12T16:15:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.519+0000 7fcc78d5f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc740fd910 0x7fcc741101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.519+0000 7fcc78d5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 0x7fcc741106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.519+0000 7fcc78d5f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc74110cc0 con 0x7fcc740fe270 2024-03-12T16:15:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.519+0000 7fcc78d5f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcc74110e00 con 0x7fcc740fd910 2024-03-12T16:15:24.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.519+0000 7fcc71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 0x7fcc741106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.519+0000 7fcc71d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 0x7fcc741106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50516/0 (socket says 172.21.15.6:50516) 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.519+0000 7fcc71d9b700 1 -- 172.21.15.6:0/2133642566 learned_addr learned my addr 172.21.15.6:0/2133642566 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc7259c700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc740fd910 0x7fcc741101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc71d9b700 1 -- 172.21.15.6:0/2133642566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc740fd910 msgr2=0x7fcc741101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc71d9b700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc740fd910 0x7fcc741101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc71d9b700 1 -- 172.21.15.6:0/2133642566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcc68005040 con 0x7fcc740fe270 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc71d9b700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 0x7fcc741106c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fcc68000c00 tx=0x7fcc68009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc637fe700 1 -- 172.21.15.6:0/2133642566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc6800e030 con 0x7fcc740fe270 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcc7410a430 con 0x7fcc740fe270 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc637fe700 1 -- 172.21.15.6:0/2133642566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcc68007e90 con 0x7fcc740fe270 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc637fe700 1 -- 172.21.15.6:0/2133642566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcc68018070 con 0x7fcc740fe270 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.520+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcc7410a990 con 0x7fcc740fe270 2024-03-12T16:15:24.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.521+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcc7405f570 con 0x7fcc740fe270 2024-03-12T16:15:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.522+0000 7fcc637fe700 1 -- 172.21.15.6:0/2133642566 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fcc6801d420 con 0x7fcc740fe270 2024-03-12T16:15:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.522+0000 7fcc637fe700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcc5c06cbc0 0x7fcc5c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.522+0000 7fcc637fe700 1 -- 172.21.15.6:0/2133642566 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fcc6808d430 con 0x7fcc740fe270 2024-03-12T16:15:24.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.522+0000 7fcc7259c700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcc5c06cbc0 0x7fcc5c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:24.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.523+0000 7fcc7259c700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcc5c06cbc0 0x7fcc5c06f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcc64004b60 tx=0x7fcc64009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:24.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.527+0000 7fcc637fe700 1 -- 172.21.15.6:0/2133642566 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fcc6805aee0 con 0x7fcc740fe270 2024-03-12T16:15:24.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:24 smithi134 ceph-mon[85099]: Upgrade: Updating crash.smithi006 (1/2) 2024-03-12T16:15:24.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:24 smithi134 ceph-mon[85099]: Deploying daemon crash.smithi006 on smithi006 2024-03-12T16:15:24.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:24 smithi134 ceph-mon[85099]: from='client.34158 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:24.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:24 smithi134 ceph-mon[85099]: from='client.34162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:24.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.769+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcc74047540 con 0x7fcc740fe270 2024-03-12T16:15:24.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.770+0000 7fcc637fe700 1 -- 172.21.15.6:0/2133642566 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7fcc6805fe60 con 0x7fcc740fe270 2024-03-12T16:15:24.772 INFO:teuthology.orchestra.run.smithi006.stdout:e16 2024-03-12T16:15:24.772 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:15:24.772 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:15:24.772 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 16 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:14:55.638904+0000 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:15:24.773 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:15:24.774 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:15:24.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:15:24.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:15:24.775 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:15:24.775 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:15:24.775 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:15:24.775 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:15:24.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcc5c06cbc0 msgr2=0x7fcc5c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcc5c06cbc0 0x7fcc5c06f080 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 rx=0x7fcc64004b60 tx=0x7fcc64009040).stop 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 msgr2=0x7fcc741106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 0x7fcc741106c0 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7fcc68000c00 tx=0x7fcc68009cb0).stop 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 shutdown_connections 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcc740fd910 0x7fcc741101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcc5c06cbc0 0x7fcc5c06f080 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 --2- 172.21.15.6:0/2133642566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcc740fe270 0x7fcc741106c0 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 >> 172.21.15.6:0/2133642566 conn(0x7fcc740f3530 msgr2=0x7fcc740f9cc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 shutdown_connections 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.772+0000 7fcc78d5f700 1 -- 172.21.15.6:0/2133642566 wait complete. 2024-03-12T16:15:24.776 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-03-12T16:15:24.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.884+0000 7fc172f62700 1 -- 172.21.15.6:0/579737802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fc7f0 msgr2=0x7fc16c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.884+0000 7fc172f62700 1 --2- 172.21.15.6:0/579737802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fc7f0 0x7fc16c0fcbd0 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7fc1600047f0 tx=0x7fc160009cb0).stop 2024-03-12T16:15:24.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.884+0000 7fc172f62700 1 -- 172.21.15.6:0/579737802 shutdown_connections 2024-03-12T16:15:24.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.884+0000 7fc172f62700 1 --2- 172.21.15.6:0/579737802 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc16c0fd150 0x7fc16c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.884+0000 7fc172f62700 1 --2- 172.21.15.6:0/579737802 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fc7f0 0x7fc16c0fcbd0 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.884+0000 7fc172f62700 1 -- 172.21.15.6:0/579737802 >> 172.21.15.6:0/579737802 conn(0x7fc16c070590 msgr2=0x7fc16c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.884+0000 7fc172f62700 1 -- 172.21.15.6:0/579737802 shutdown_connections 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.884+0000 7fc172f62700 1 -- 172.21.15.6:0/579737802 wait complete. 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc172f62700 1 Processor -- start 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc172f62700 1 -- start start 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc172f62700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc16c0fc7f0 0x7fc16c1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc172f62700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fd150 0x7fc16c1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc172f62700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c110cc0 con 0x7fc16c0fd150 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc172f62700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc16c110e00 con 0x7fc16c0fc7f0 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc16bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fd150 0x7fc16c1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc16bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fd150 0x7fc16c1106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50546/0 (socket says 172.21.15.6:50546) 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc16bfff700 1 -- 172.21.15.6:0/3010845986 learned_addr learned my addr 172.21.15.6:0/3010845986 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.885+0000 7fc170cfe700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc16c0fc7f0 0x7fc16c1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:24.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc16bfff700 1 -- 172.21.15.6:0/3010845986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc16c0fc7f0 msgr2=0x7fc16c1101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:24.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc16bfff700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc16c0fc7f0 0x7fc16c1101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:24.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc16bfff700 1 -- 172.21.15.6:0/3010845986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc160005040 con 0x7fc16c0fd150 2024-03-12T16:15:24.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc170cfe700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc16c0fc7f0 0x7fc16c1101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:15:24.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc16bfff700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fd150 0x7fc16c1106c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc15800c790 tx=0x7fc158007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:24.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc169ffb700 1 -- 172.21.15.6:0/3010845986 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc1580106f0 con 0x7fc16c0fd150 2024-03-12T16:15:24.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc169ffb700 1 -- 172.21.15.6:0/3010845986 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc158010d00 con 0x7fc16c0fd150 2024-03-12T16:15:24.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc169ffb700 1 -- 172.21.15.6:0/3010845986 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc158012cf0 con 0x7fc16c0fd150 2024-03-12T16:15:24.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc16c10a490 con 0x7fc16c0fd150 2024-03-12T16:15:24.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.886+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc16c10aa50 con 0x7fc16c0fd150 2024-03-12T16:15:24.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.888+0000 7fc169ffb700 1 -- 172.21.15.6:0/3010845986 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fc158012400 con 0x7fc16c0fd150 2024-03-12T16:15:24.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.888+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc16c05f590 con 0x7fc16c0fd150 2024-03-12T16:15:24.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.888+0000 7fc169ffb700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc15c06cbc0 0x7fc15c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:24.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.888+0000 7fc169ffb700 1 -- 172.21.15.6:0/3010845986 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fc15808b680 con 0x7fc16c0fd150 2024-03-12T16:15:24.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.888+0000 7fc170cfe700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc15c06cbc0 0x7fc15c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:24.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.889+0000 7fc170cfe700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc15c06cbc0 0x7fc15c06f080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc160007cf0 tx=0x7fc16000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:24.894 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:24.893+0000 7fc169ffb700 1 -- 172.21.15.6:0/3010845986 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc158059180 con 0x7fc16c0fd150 2024-03-12T16:15:25.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.134+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc16c10b140 con 0x7fc15c06cbc0 2024-03-12T16:15:25.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.135+0000 7fc169ffb700 1 -- 172.21.15.6:0/3010845986 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+385 (secure 0 0 0) 0x7fc16c10b140 con 0x7fc15c06cbc0 2024-03-12T16:15:25.137 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:15:25.137 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr" 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "4/21 daemons upgraded", 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading crash daemons", 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:15:25.138 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:15:25.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc15c06cbc0 msgr2=0x7fc15c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:25.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc15c06cbc0 0x7fc15c06f080 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 rx=0x7fc160007cf0 tx=0x7fc16000b040).stop 2024-03-12T16:15:25.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fd150 msgr2=0x7fc16c1106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:25.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fd150 0x7fc16c1106c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 rx=0x7fc15800c790 tx=0x7fc158007f70).stop 2024-03-12T16:15:25.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 shutdown_connections 2024-03-12T16:15:25.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc16c0fc7f0 0x7fc16c1101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:25.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc15c06cbc0 0x7fc15c06f080 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:25.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 --2- 172.21.15.6:0/3010845986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc16c0fd150 0x7fc16c1106c0 unknown :-1 s=CLOSED pgs=65 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:25.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 >> 172.21.15.6:0/3010845986 conn(0x7fc16c070590 msgr2=0x7fc16c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:25.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 shutdown_connections 2024-03-12T16:15:25.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.137+0000 7fc172f62700 1 -- 172.21.15.6:0/3010845986 wait complete. 2024-03-12T16:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.246+0000 7fd319086700 1 -- 172.21.15.6:0/3869133200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 msgr2=0x7fd3140f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.246+0000 7fd319086700 1 --2- 172.21.15.6:0/3869133200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 0x7fd3140f6930 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7fd3080047f0 tx=0x7fd308009cb0).stop 2024-03-12T16:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.246+0000 7fd319086700 1 -- 172.21.15.6:0/3869133200 shutdown_connections 2024-03-12T16:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.246+0000 7fd319086700 1 --2- 172.21.15.6:0/3869133200 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 0x7fd3140f6930 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:25.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.246+0000 7fd319086700 1 --2- 172.21.15.6:0/3869133200 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140fc7f0 0x7fd3140fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.246+0000 7fd319086700 1 -- 172.21.15.6:0/3869133200 >> 172.21.15.6:0/3869133200 conn(0x7fd314070590 msgr2=0x7fd3140f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.246+0000 7fd319086700 1 -- 172.21.15.6:0/3869133200 shutdown_connections 2024-03-12T16:15:25.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.246+0000 7fd319086700 1 -- 172.21.15.6:0/3869133200 wait complete. 2024-03-12T16:15:25.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.246+0000 7fd319086700 1 Processor -- start 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd319086700 1 -- start start 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd319086700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140fc7f0 0x7fd3141090a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd319086700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 0x7fd314109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd319086700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd314109a80 con 0x7fd3140fd150 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd319086700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd314109bc0 con 0x7fd3140fc7f0 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd31259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 0x7fd314109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd31259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 0x7fd314109590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50570/0 (socket says 172.21.15.6:50570) 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd31259c700 1 -- 172.21.15.6:0/1862770492 learned_addr learned my addr 172.21.15.6:0/1862770492 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd312d9d700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140fc7f0 0x7fd3141090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd31259c700 1 -- 172.21.15.6:0/1862770492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140fc7f0 msgr2=0x7fd3141090a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd31259c700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140fc7f0 0x7fd3141090a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd31259c700 1 -- 172.21.15.6:0/1862770492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd308005040 con 0x7fd3140fd150 2024-03-12T16:15:25.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.247+0000 7fd312d9d700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140fc7f0 0x7fd3141090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:15:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.248+0000 7fd31259c700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 0x7fd314109590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd3080099f0 tx=0x7fd308009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.248+0000 7fd2fbfff700 1 -- 172.21.15.6:0/1862770492 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd30800e030 con 0x7fd3140fd150 2024-03-12T16:15:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.248+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd314109e10 con 0x7fd3140fd150 2024-03-12T16:15:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.248+0000 7fd2fbfff700 1 -- 172.21.15.6:0/1862770492 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd308007e90 con 0x7fd3140fd150 2024-03-12T16:15:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.248+0000 7fd2fbfff700 1 -- 172.21.15.6:0/1862770492 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd308018070 con 0x7fd3140fd150 2024-03-12T16:15:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.248+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd314112400 con 0x7fd3140fd150 2024-03-12T16:15:25.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.249+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd31405f590 con 0x7fd3140fd150 2024-03-12T16:15:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.249+0000 7fd2fbfff700 1 -- 172.21.15.6:0/1862770492 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fd308009590 con 0x7fd3140fd150 2024-03-12T16:15:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.250+0000 7fd2fbfff700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd2fc06cb60 0x7fd2fc06f020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.250+0000 7fd2fbfff700 1 -- 172.21.15.6:0/1862770492 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(49..49 src has 1..49) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fd30808d1e0 con 0x7fd3140fd150 2024-03-12T16:15:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.250+0000 7fd312d9d700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd2fc06cb60 0x7fd2fc06f020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:25.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.250+0000 7fd312d9d700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd2fc06cb60 0x7fd2fc06f020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd304004c80 tx=0x7fd30400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:25.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.254+0000 7fd2fbfff700 1 -- 172.21.15.6:0/1862770492 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd308057140 con 0x7fd3140fd150 2024-03-12T16:15:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:25 smithi006 ceph-mon[103869]: pgmap v29: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:25 smithi006 ceph-mon[103869]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:25 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1545508910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:25.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:25 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2133642566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:15:25.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.540+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd314047540 con 0x7fd3140fd150 2024-03-12T16:15:25.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.541+0000 7fd2fbfff700 1 -- 172.21.15.6:0/1862770492 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+10 (secure 0 0 0) 0x7fd30805a760 con 0x7fd3140fd150 2024-03-12T16:15:25.543 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_OK 2024-03-12T16:15:25.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd2fc06cb60 msgr2=0x7fd2fc06f020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:25.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd2fc06cb60 0x7fd2fc06f020 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 rx=0x7fd304004c80 tx=0x7fd30400b040).stop 2024-03-12T16:15:25.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 msgr2=0x7fd314109590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:25.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 0x7fd314109590 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7fd3080099f0 tx=0x7fd308009cb0).stop 2024-03-12T16:15:25.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 shutdown_connections 2024-03-12T16:15:25.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3140fc7f0 0x7fd3141090a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:25.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd2fc06cb60 0x7fd2fc06f020 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:25.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 --2- 172.21.15.6:0/1862770492 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3140fd150 0x7fd314109590 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:25.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 >> 172.21.15.6:0/1862770492 conn(0x7fd314070590 msgr2=0x7fd3140fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:25.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 shutdown_connections 2024-03-12T16:15:25.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:25.543+0000 7fd319086700 1 -- 172.21.15.6:0/1862770492 wait complete. 2024-03-12T16:15:25.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:25 smithi134 ceph-mon[85099]: pgmap v29: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:25.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:25 smithi134 ceph-mon[85099]: from='client.34166 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:25.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:25 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1545508910' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:25.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:25 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2133642566' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:15:26.569 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:26 smithi006 ceph-mon[103869]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:26.569 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:26 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1862770492' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:15:26.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:26 smithi134 ceph-mon[85099]: from='client.34178 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:26.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:26 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1862770492' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:15:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:27 smithi134 ceph-mon[85099]: pgmap v30: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:27 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:27 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:27 smithi006 ceph-mon[103869]: pgmap v30: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:27 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:27 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:29.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:29 smithi134 ceph-mon[85099]: pgmap v31: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:29.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:29 smithi134 ceph-mon[85099]: Upgrade: Updating crash.smithi134 (2/2) 2024-03-12T16:15:29.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:29.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:15:29.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:29.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:29 smithi134 ceph-mon[85099]: Deploying daemon crash.smithi134 on smithi134 2024-03-12T16:15:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:29 smithi006 ceph-mon[103869]: pgmap v31: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:29 smithi006 ceph-mon[103869]: Upgrade: Updating crash.smithi134 (2/2) 2024-03-12T16:15:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "client.crash.smithi134", "caps": ["mon", "profile crash", "mgr", "profile crash"]}]: dispatch 2024-03-12T16:15:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:29 smithi006 ceph-mon[103869]: Deploying daemon crash.smithi134 on smithi134 2024-03-12T16:15:31.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:31 smithi134 ceph-mon[85099]: pgmap v32: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:31.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:31 smithi006 ceph-mon[103869]: pgmap v32: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:32.898 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:15:32.899 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:32.899 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:32.899 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:15:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:15:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:15:33.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:33 smithi134 ceph-mon[85099]: pgmap v33: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:33 smithi006 ceph-mon[103869]: pgmap v33: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:35.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:35 smithi134 ceph-mon[85099]: pgmap v34: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:35.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:35 smithi006 ceph-mon[103869]: pgmap v34: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:36 smithi134 ceph-mon[85099]: pgmap v35: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:36 smithi006 ceph-mon[103869]: pgmap v35: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:38 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:38 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:38.446 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:38 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:38.447 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:38 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:39.546 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:39 smithi134 ceph-mon[85099]: pgmap v36: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:39.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:39 smithi006 ceph-mon[103869]: pgmap v36: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:41.572 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: pgmap v37: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:41.572 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.572 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.572 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.572 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all crash 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi006"}]: dispatch 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi006"}]': finished 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-03-12T16:15:41.573 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-12T16:15:41.574 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:41 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-12T16:15:41.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: pgmap v37: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:41.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all crash 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi006"}]: dispatch 2024-03-12T16:15:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi006"}]': finished 2024-03-12T16:15:41.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]: dispatch 2024-03-12T16:15:41.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash.smithi134"}]': finished 2024-03-12T16:15:41.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-12T16:15:41.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:41 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-03-12T16:15:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:42 smithi006 ceph-mon[103869]: Upgrade: osd.0 is safe to restart 2024-03-12T16:15:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:42 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:42 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-12T16:15:42.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:42 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:42.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:42 smithi134 ceph-mon[85099]: Upgrade: osd.0 is safe to restart 2024-03-12T16:15:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:42 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:42 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-03-12T16:15:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:42 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:15:43.587 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:43 smithi006 ceph-mon[103869]: pgmap v38: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:43.588 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:43 smithi006 ceph-mon[103869]: Upgrade: Updating osd.0 2024-03-12T16:15:43.588 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:43 smithi006 ceph-mon[103869]: Deploying daemon osd.0 on smithi006 2024-03-12T16:15:43.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:43 smithi134 ceph-mon[85099]: pgmap v38: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:43.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:43 smithi134 ceph-mon[85099]: Upgrade: Updating osd.0 2024-03-12T16:15:43.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:43 smithi134 ceph-mon[85099]: Deploying daemon osd.0 on smithi006 2024-03-12T16:15:45.355 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:45 smithi006 ceph-mon[103869]: pgmap v39: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:45.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:45 smithi134 ceph-mon[85099]: pgmap v39: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:45.707 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:45 smithi006 systemd[1]: Stopping Ceph osd.0 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:15:46.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[52104]: debug 2024-03-12T16:15:45.728+0000 7fc1a6699700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-12T16:15:46.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[52104]: debug 2024-03-12T16:15:45.728+0000 7fc1a6699700 -1 osd.0 49 *** Got signal Terminated *** 2024-03-12T16:15:46.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:45 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[52104]: debug 2024-03-12T16:15:45.728+0000 7fc1a6699700 -1 osd.0 49 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:15:46.695 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:46 smithi006 ceph-mon[103869]: osd.0 marked itself down and dead 2024-03-12T16:15:46.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:46 smithi134 ceph-mon[85099]: osd.0 marked itself down and dead 2024-03-12T16:15:46.957 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:46 smithi006 bash[117683]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0 2024-03-12T16:15:47.689 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:47 smithi006 ceph-mon[103869]: pgmap v40: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:47.689 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:47 smithi006 ceph-mon[103869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:15:47.689 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:47 smithi006 ceph-mon[103869]: osdmap e50: 6 total, 5 up, 6 in 2024-03-12T16:15:47.689 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:47.690 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:15:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:47 smithi134 ceph-mon[85099]: pgmap v40: 65 pgs: 65 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:15:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:47 smithi134 ceph-mon[85099]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:15:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:47 smithi134 ceph-mon[85099]: osdmap e50: 6 total, 5 up, 6 in 2024-03-12T16:15:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:15:48.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:48 smithi006 ceph-mon[103869]: osdmap e51: 6 total, 5 up, 6 in 2024-03-12T16:15:48.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:48 smithi134 ceph-mon[85099]: osdmap e51: 6 total, 5 up, 6 in 2024-03-12T16:15:49.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:48 smithi006 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.0.service: Succeeded. 2024-03-12T16:15:49.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:48 smithi006 systemd[1]: Stopped Ceph osd.0 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:15:49.208 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:48 smithi006 systemd[1]: Starting Ceph osd.0 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:15:49.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:49 smithi134 ceph-mon[85099]: pgmap v43: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:49.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:49 smithi134 ceph-mon[85099]: Health check failed: Degraded data redundancy: 65/330 objects degraded (19.697%), 19 pgs degraded (PG_DEGRADED) 2024-03-12T16:15:49.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:49 smithi006 ceph-mon[103869]: pgmap v43: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:49.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:49 smithi006 ceph-mon[103869]: Health check failed: Degraded data redundancy: 65/330 objects degraded (19.697%), 19 pgs degraded (PG_DEGRADED) 2024-03-12T16:15:50.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:49 smithi006 bash[117953]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-12T16:15:50.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:49 smithi006 bash[117953]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-12T16:15:50.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:49 smithi006 bash[117953]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-12T16:15:50.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:49 smithi006 bash[117953]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-12T16:15:50.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:49 smithi006 bash[117953]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-03-12T16:15:50.207 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:49 smithi006 bash[117953]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-03-12T16:15:50.208 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:49 smithi006 bash[117953]: --> ceph-volume raw activate successful for osd ID: 0 2024-03-12T16:15:51.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:51 smithi134 ceph-mon[85099]: pgmap v44: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:51.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:51 smithi006 ceph-mon[103869]: pgmap v44: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:51.707 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:51 smithi006 ceph-osd[118257]: -- 172.21.15.6:0/2088670268 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5641497464e0 con 0x564149716c00 2024-03-12T16:15:51.707 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:51 smithi006 bash[118219]: 36b3cfcba127268205a5de8e42ed746256e01423f9650ba78b65b31f4b5dbc7d 2024-03-12T16:15:51.707 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:51 smithi006 systemd[1]: Started Ceph osd.0 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:15:52.150 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:51 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[118234]: 2024-03-12T16:15:51.729+0000 7faffb8e2640 -1 Falling back to public interface 2024-03-12T16:15:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:52.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:15:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:52.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:15:53.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:53 smithi134 ceph-mon[85099]: pgmap v45: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:53.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:53 smithi006 ceph-mon[103869]: pgmap v45: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:55.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.654+0000 7faa29de5700 1 -- 172.21.15.6:0/1122104479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 msgr2=0x7faa24101990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:55.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.654+0000 7faa29de5700 1 --2- 172.21.15.6:0/1122104479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 0x7faa24101990 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7faa180047f0 tx=0x7faa18009cb0).stop 2024-03-12T16:15:55.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.654+0000 7faa29de5700 1 -- 172.21.15.6:0/1122104479 shutdown_connections 2024-03-12T16:15:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.654+0000 7faa29de5700 1 --2- 172.21.15.6:0/1122104479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 0x7faa24101990 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.654+0000 7faa29de5700 1 --2- 172.21.15.6:0/1122104479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa240f8920 0x7faa240f8d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:15:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.654+0000 7faa29de5700 1 -- 172.21.15.6:0/1122104479 >> 172.21.15.6:0/1122104479 conn(0x7faa24070590 msgr2=0x7faa240f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.654+0000 7faa29de5700 1 -- 172.21.15.6:0/1122104479 shutdown_connections 2024-03-12T16:15:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.654+0000 7faa29de5700 1 -- 172.21.15.6:0/1122104479 wait complete. 2024-03-12T16:15:55.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.654+0000 7faa29de5700 1 Processor -- start 2024-03-12T16:15:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa29de5700 1 -- start start 2024-03-12T16:15:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa29de5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa240f8920 0x7faa2410e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa29de5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 0x7faa2410e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa29de5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa2410ec10 con 0x7faa240f91f0 2024-03-12T16:15:55.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa29de5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa24108230 con 0x7faa240f8920 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa22ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 0x7faa2410e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa22ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 0x7faa2410e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54162/0 (socket says 172.21.15.6:54162) 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa22ffd700 1 -- 172.21.15.6:0/3793207182 learned_addr learned my addr 172.21.15.6:0/3793207182 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa237fe700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa240f8920 0x7faa2410e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa22ffd700 1 -- 172.21.15.6:0/3793207182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa240f8920 msgr2=0x7faa2410e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa22ffd700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa240f8920 0x7faa2410e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa22ffd700 1 -- 172.21.15.6:0/3793207182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa18005040 con 0x7faa240f91f0 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.655+0000 7faa22ffd700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 0x7faa2410e580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7faa1800b120 tx=0x7faa18009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.656+0000 7faa20ff9700 1 -- 172.21.15.6:0/3793207182 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa1800e030 con 0x7faa240f91f0 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.656+0000 7faa20ff9700 1 -- 172.21.15.6:0/3793207182 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa18007e90 con 0x7faa240f91f0 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.656+0000 7faa20ff9700 1 -- 172.21.15.6:0/3793207182 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa18018070 con 0x7faa240f91f0 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.656+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa24108480 con 0x7faa240f91f0 2024-03-12T16:15:55.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.656+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa24108960 con 0x7faa240f91f0 2024-03-12T16:15:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.657+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa2405f590 con 0x7faa240f91f0 2024-03-12T16:15:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.657+0000 7faa20ff9700 1 -- 172.21.15.6:0/3793207182 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7faa1801d420 con 0x7faa240f91f0 2024-03-12T16:15:55.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.658+0000 7faa20ff9700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa0c06cbc0 0x7faa0c06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.658+0000 7faa20ff9700 1 -- 172.21.15.6:0/3793207182 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7faa1808d370 con 0x7faa240f91f0 2024-03-12T16:15:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.658+0000 7faa237fe700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa0c06cbc0 0x7faa0c06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:55.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.658+0000 7faa237fe700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa0c06cbc0 0x7faa0c06f080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faa1400b910 tx=0x7faa14008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:55.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.663+0000 7faa20ff9700 1 -- 172.21.15.6:0/3793207182 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7faa1805ad60 con 0x7faa240f91f0 2024-03-12T16:15:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:55 smithi134 ceph-mon[85099]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:55 smithi006 ceph-mon[103869]: pgmap v46: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:55.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.889+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faa24109780 con 0x7faa0c06cbc0 2024-03-12T16:15:55.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.890+0000 7faa20ff9700 1 -- 172.21.15.6:0/3793207182 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7faa24109780 con 0x7faa0c06cbc0 2024-03-12T16:15:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.893+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa0c06cbc0 msgr2=0x7faa0c06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.893+0000 7faa29de5700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa0c06cbc0 0x7faa0c06f080 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 rx=0x7faa1400b910 tx=0x7faa14008040).stop 2024-03-12T16:15:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.893+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 msgr2=0x7faa2410e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.893+0000 7faa29de5700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 0x7faa2410e580 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7faa1800b120 tx=0x7faa18009cb0).stop 2024-03-12T16:15:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.894+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 shutdown_connections 2024-03-12T16:15:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.894+0000 7faa29de5700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa240f8920 0x7faa2410e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.894+0000 7faa29de5700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa0c06cbc0 0x7faa0c06f080 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.894+0000 7faa29de5700 1 --2- 172.21.15.6:0/3793207182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa240f91f0 0x7faa2410e580 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:55.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.894+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 >> 172.21.15.6:0/3793207182 conn(0x7faa24070590 msgr2=0x7faa240fc160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.894+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 shutdown_connections 2024-03-12T16:15:55.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:55.894+0000 7faa29de5700 1 -- 172.21.15.6:0/3793207182 wait complete. 2024-03-12T16:15:55.910 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:15:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.017+0000 7f49f7699700 1 -- 172.21.15.6:0/33803214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00fe230 msgr2=0x7f49f00f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.017+0000 7f49f7699700 1 --2- 172.21.15.6:0/33803214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00fe230 0x7f49f00f5f80 secure :-1 s=READY pgs=4 cs=0 l=1 rev1=1 rx=0x7f49e00047f0 tx=0x7f49e0009cb0).stop 2024-03-12T16:15:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.018+0000 7f49f7699700 1 -- 172.21.15.6:0/33803214 shutdown_connections 2024-03-12T16:15:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.018+0000 7f49f7699700 1 --2- 172.21.15.6:0/33803214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00fe230 0x7f49f00f5f80 unknown :-1 s=CLOSED pgs=4 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.018+0000 7f49f7699700 1 --2- 172.21.15.6:0/33803214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00fd8d0 0x7f49f00fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:15:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.018+0000 7f49f7699700 1 -- 172.21.15.6:0/33803214 >> 172.21.15.6:0/33803214 conn(0x7f49f006cea0 msgr2=0x7f49f006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.018+0000 7f49f7699700 1 -- 172.21.15.6:0/33803214 shutdown_connections 2024-03-12T16:15:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.018+0000 7f49f7699700 1 -- 172.21.15.6:0/33803214 wait complete. 2024-03-12T16:15:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.018+0000 7f49f7699700 1 Processor -- start 2024-03-12T16:15:56.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.018+0000 7f49f7699700 1 -- start start 2024-03-12T16:15:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f7699700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00fd8d0 0x7f49f010e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f7699700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00fe230 0x7f49f010e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f7699700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f010ecc0 con 0x7f49f00fd8d0 2024-03-12T16:15:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f7699700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f49f01082e0 con 0x7f49f00fe230 2024-03-12T16:15:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f5435700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00fd8d0 0x7f49f010e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f5435700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00fd8d0 0x7f49f010e140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54172/0 (socket says 172.21.15.6:54172) 2024-03-12T16:15:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f5435700 1 -- 172.21.15.6:0/1872746893 learned_addr learned my addr 172.21.15.6:0/1872746893 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f4c34700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00fe230 0x7f49f010e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:56.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f5435700 1 -- 172.21.15.6:0/1872746893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00fe230 msgr2=0x7f49f010e630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f5435700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00fe230 0x7f49f010e630 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f5435700 1 -- 172.21.15.6:0/1872746893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f49e0005040 con 0x7f49f00fd8d0 2024-03-12T16:15:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.019+0000 7f49f5435700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00fd8d0 0x7f49f010e140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f49ec00b4b0 tx=0x7f49ec0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.020+0000 7f49e67fc700 1 -- 172.21.15.6:0/1872746893 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ec002500 con 0x7f49f00fd8d0 2024-03-12T16:15:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.020+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f49f0108590 con 0x7f49f00fd8d0 2024-03-12T16:15:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.020+0000 7f49e67fc700 1 -- 172.21.15.6:0/1872746893 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f49ec002b10 con 0x7f49f00fd8d0 2024-03-12T16:15:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.020+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f49f0108ad0 con 0x7f49f00fd8d0 2024-03-12T16:15:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.020+0000 7f49e67fc700 1 -- 172.21.15.6:0/1872746893 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f49ec012cb0 con 0x7f49f00fd8d0 2024-03-12T16:15:56.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.021+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f49f0047540 con 0x7f49f00fd8d0 2024-03-12T16:15:56.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.021+0000 7f49e67fc700 1 -- 172.21.15.6:0/1872746893 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7f49ec002660 con 0x7f49f00fd8d0 2024-03-12T16:15:56.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.022+0000 7f49e67fc700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f49dc06cbc0 0x7f49dc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:56.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.022+0000 7f49e67fc700 1 -- 172.21.15.6:0/1872746893 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f49ec08bdd0 con 0x7f49f00fd8d0 2024-03-12T16:15:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.026+0000 7f49f4c34700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f49dc06cbc0 0x7f49dc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:56.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.026+0000 7f49f4c34700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f49dc06cbc0 0x7f49dc06f080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f49f0109a80 tx=0x7f49e000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:56.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.027+0000 7f49e67fc700 1 -- 172.21.15.6:0/1872746893 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f49ec0598d0 con 0x7f49f00fd8d0 2024-03-12T16:15:56.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.257+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f49f01097c0 con 0x7f49dc06cbc0 2024-03-12T16:15:56.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.258+0000 7f49e67fc700 1 -- 172.21.15.6:0/1872746893 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f49f01097c0 con 0x7f49dc06cbc0 2024-03-12T16:15:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f49dc06cbc0 msgr2=0x7f49dc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f49dc06cbc0 0x7f49dc06f080 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 rx=0x7f49f0109a80 tx=0x7f49e000b040).stop 2024-03-12T16:15:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00fd8d0 msgr2=0x7f49f010e140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00fd8d0 0x7f49f010e140 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7f49ec00b4b0 tx=0x7f49ec0090f0).stop 2024-03-12T16:15:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 shutdown_connections 2024-03-12T16:15:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f49dc06cbc0 0x7f49dc06f080 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f49f00fd8d0 0x7f49f010e140 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 --2- 172.21.15.6:0/1872746893 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f49f00fe230 0x7f49f010e630 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 >> 172.21.15.6:0/1872746893 conn(0x7f49f006cea0 msgr2=0x7f49f00fbd50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:56.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 shutdown_connections 2024-03-12T16:15:56.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.262+0000 7f49f7699700 1 -- 172.21.15.6:0/1872746893 wait complete. 2024-03-12T16:15:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.376+0000 7fae07449700 1 -- 172.21.15.6:0/2994879723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 msgr2=0x7fae0006b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.376+0000 7fae07449700 1 --2- 172.21.15.6:0/2994879723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 0x7fae0006b4f0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7fadfc0047f0 tx=0x7fadfc009cb0).stop 2024-03-12T16:15:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.376+0000 7fae07449700 1 -- 172.21.15.6:0/2994879723 shutdown_connections 2024-03-12T16:15:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.376+0000 7fae07449700 1 --2- 172.21.15.6:0/2994879723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0006b9e0 0x7fae00103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.376+0000 7fae07449700 1 --2- 172.21.15.6:0/2994879723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 0x7fae0006b4f0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.376+0000 7fae07449700 1 -- 172.21.15.6:0/2994879723 >> 172.21.15.6:0/2994879723 conn(0x7fae000f34b0 msgr2=0x7fae000f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.376+0000 7fae07449700 1 -- 172.21.15.6:0/2994879723 shutdown_connections 2024-03-12T16:15:56.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.376+0000 7fae07449700 1 -- 172.21.15.6:0/2994879723 wait complete. 2024-03-12T16:15:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.377+0000 7fae07449700 1 Processor -- start 2024-03-12T16:15:56.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.377+0000 7fae07449700 1 -- start start 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.377+0000 7fae07449700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 0x7fae001102c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.377+0000 7fae07449700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0006b9e0 0x7fae001107b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.377+0000 7fae07449700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae00110db0 con 0x7fae0006b110 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.377+0000 7fae07449700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fae00110ef0 con 0x7fae0006b9e0 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae051e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 0x7fae001102c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae051e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 0x7fae001102c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54198/0 (socket says 172.21.15.6:54198) 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae051e5700 1 -- 172.21.15.6:0/3792393633 learned_addr learned my addr 172.21.15.6:0/3792393633 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae049e4700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0006b9e0 0x7fae001107b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae051e5700 1 -- 172.21.15.6:0/3792393633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0006b9e0 msgr2=0x7fae001107b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae051e5700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0006b9e0 0x7fae001107b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae051e5700 1 -- 172.21.15.6:0/3792393633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fadfc005040 con 0x7fae0006b110 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae051e5700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 0x7fae001102c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fadfc0043a0 tx=0x7fadfc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fadf67fc700 1 -- 172.21.15.6:0/3792393633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadfc00e030 con 0x7fae0006b110 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fadf67fc700 1 -- 172.21.15.6:0/3792393633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fadfc007e90 con 0x7fae0006b110 2024-03-12T16:15:56.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fae0010a520 con 0x7fae0006b110 2024-03-12T16:15:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fadf67fc700 1 -- 172.21.15.6:0/3792393633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fadfc018070 con 0x7fae0006b110 2024-03-12T16:15:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.378+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fae0010aa00 con 0x7fae0006b110 2024-03-12T16:15:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.380+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fae0005f590 con 0x7fae0006b110 2024-03-12T16:15:56.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.381+0000 7fadf67fc700 1 -- 172.21.15.6:0/3792393633 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fadfc0094c0 con 0x7fae0006b110 2024-03-12T16:15:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.381+0000 7fadf67fc700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fadec06cbc0 0x7fadec06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.381+0000 7fadf67fc700 1 -- 172.21.15.6:0/3792393633 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fadfc08d4b0 con 0x7fae0006b110 2024-03-12T16:15:56.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.381+0000 7fae049e4700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fadec06cbc0 0x7fadec06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:56.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.382+0000 7fae049e4700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fadec06cbc0 0x7fadec06f080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fae0010bc00 tx=0x7fadf000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:56.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.385+0000 7fadf67fc700 1 -- 172.21.15.6:0/3792393633 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fadfc05aea0 con 0x7fae0006b110 2024-03-12T16:15:56.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.652+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fae0010b9b0 con 0x7fadec06cbc0 2024-03-12T16:15:56.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.672+0000 7fadf67fc700 1 -- 172.21.15.6:0/3792393633 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fae0010b9b0 con 0x7fadec06cbc0 2024-03-12T16:15:56.673 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:15:56.673 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (2m) 0s ago 13m 26.1M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:15:56.673 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (30s) 0s ago 13m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:15:56.673 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (25s) 20s ago 13m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:15:56.673 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (2m) 0s ago 13m 80.3M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (8m) 0s ago 8m 124M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (8m) 0s ago 8m 15.4M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (8m) 20s ago 8m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (8m) 20s ago 8m 17.8M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (4m) 0s ago 15m 494M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (3m) 20s ago 13m 447M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (93s) 0s ago 15m 42.4M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (69s) 20s ago 12m 32.0M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (3m) 0s ago 13m 17.3M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 20s ago 12m 18.1M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (5s) 0s ago 12m 11.5M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (12m) 0s ago 12m 236M 1911M 16.2.15-1-g8963e9de 727f386679cb 48427964204b 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (11m) 0s ago 11m 194M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:15:56.674 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (10m) 20s ago 10m 265M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:15:56.675 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (10m) 20s ago 10m 235M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:15:56.675 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (10m) 20s ago 10m 227M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:15:56.675 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (2m) 20s ago 11m 60.0M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:15:56.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fadec06cbc0 msgr2=0x7fadec06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fadec06cbc0 0x7fadec06f080 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 rx=0x7fae0010bc00 tx=0x7fadf000b040).stop 2024-03-12T16:15:56.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 msgr2=0x7fae001102c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 0x7fae001102c0 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 rx=0x7fadfc0043a0 tx=0x7fadfc009cb0).stop 2024-03-12T16:15:56.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 shutdown_connections 2024-03-12T16:15:56.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fadec06cbc0 0x7fadec06f080 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fae0006b110 0x7fae001102c0 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 --2- 172.21.15.6:0/3792393633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fae0006b9e0 0x7fae001107b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 >> 172.21.15.6:0/3792393633 conn(0x7fae000f34b0 msgr2=0x7fae00103650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:56.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 shutdown_connections 2024-03-12T16:15:56.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.675+0000 7fae07449700 1 -- 172.21.15.6:0/3792393633 wait complete. 2024-03-12T16:15:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.793+0000 7fc51cae5700 1 -- 172.21.15.6:0/1308452074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5180f8720 msgr2=0x7fc5180f8b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.793+0000 7fc51cae5700 1 --2- 172.21.15.6:0/1308452074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5180f8720 0x7fc5180f8b00 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7fc5080047f0 tx=0x7fc508009cb0).stop 2024-03-12T16:15:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.793+0000 7fc51cae5700 1 -- 172.21.15.6:0/1308452074 shutdown_connections 2024-03-12T16:15:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.793+0000 7fc51cae5700 1 --2- 172.21.15.6:0/1308452074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5180f5f80 0x7fc5180f6400 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.793+0000 7fc51cae5700 1 --2- 172.21.15.6:0/1308452074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5180f8720 0x7fc5180f8b00 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.793+0000 7fc51cae5700 1 -- 172.21.15.6:0/1308452074 >> 172.21.15.6:0/1308452074 conn(0x7fc51806ce40 msgr2=0x7fc51806d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.793+0000 7fc51cae5700 1 -- 172.21.15.6:0/1308452074 shutdown_connections 2024-03-12T16:15:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.793+0000 7fc51cae5700 1 -- 172.21.15.6:0/1308452074 wait complete. 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.794+0000 7fc51cae5700 1 Processor -- start 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.794+0000 7fc51cae5700 1 -- start start 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51cae5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5180f5f80 0x7fc5181101c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51cae5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5180f8720 0x7fc5181106b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51cae5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc518110cb0 con 0x7fc5180f8720 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51cae5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc518110df0 con 0x7fc5180f5f80 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc515d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5180f8720 0x7fc5181106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5180f5f80 0x7fc5181101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc515d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5180f8720 0x7fc5181106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54214/0 (socket says 172.21.15.6:54214) 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51659c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5180f5f80 0x7fc5181101c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.134:3300/0 says I am v2:172.21.15.6:50004/0 (socket says 172.21.15.6:50004) 2024-03-12T16:15:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc515d9b700 1 -- 172.21.15.6:0/3617894689 learned_addr learned my addr 172.21.15.6:0/3617894689 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51659c700 1 -- 172.21.15.6:0/3617894689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5180f8720 msgr2=0x7fc5181106b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51659c700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5180f8720 0x7fc5181106b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51659c700 1 -- 172.21.15.6:0/3617894689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc508005040 con 0x7fc5180f5f80 2024-03-12T16:15:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.795+0000 7fc51659c700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5180f5f80 0x7fc5181101c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc508000c00 tx=0x7fc508009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.796+0000 7fc5077fe700 1 -- 172.21.15.6:0/3617894689 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc50800e030 con 0x7fc5180f5f80 2024-03-12T16:15:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.796+0000 7fc5077fe700 1 -- 172.21.15.6:0/3617894689 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc508007e90 con 0x7fc5180f5f80 2024-03-12T16:15:56.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.796+0000 7fc5077fe700 1 -- 172.21.15.6:0/3617894689 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc508018070 con 0x7fc5180f5f80 2024-03-12T16:15:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.796+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc51810a420 con 0x7fc5180f5f80 2024-03-12T16:15:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.796+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc51810a980 con 0x7fc5180f5f80 2024-03-12T16:15:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.797+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc518060670 con 0x7fc5180f5f80 2024-03-12T16:15:56.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.797+0000 7fc5077fe700 1 -- 172.21.15.6:0/3617894689 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7fc5080094c0 con 0x7fc5180f5f80 2024-03-12T16:15:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.798+0000 7fc5077fe700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc50006cbc0 0x7fc50006f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.798+0000 7fc5077fe700 1 -- 172.21.15.6:0/3617894689 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fc50808d130 con 0x7fc5180f5f80 2024-03-12T16:15:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.798+0000 7fc515d9b700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc50006cbc0 0x7fc50006f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.798+0000 7fc515d9b700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc50006cbc0 0x7fc50006f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc51810bb00 tx=0x7fc50c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:56.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:56.803+0000 7fc5077fe700 1 -- 172.21.15.6:0/3617894689 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc50805ab20 con 0x7fc5180f5f80 2024-03-12T16:15:56.957 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:56 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[118234]: 2024-03-12T16:15:56.586+0000 7faffb8e2640 -1 osd.0 0 read_superblock omap replica is missing. 2024-03-12T16:15:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.142+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fc51810b8e0 con 0x7fc5180f5f80 2024-03-12T16:15:57.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.143+0000 7fc5077fe700 1 -- 172.21.15.6:0/3617894689 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+738 (secure 0 0 0) 0x7fc50805a6b0 con 0x7fc5180f5f80 2024-03-12T16:15:57.144 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 5 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:15:57.145 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:15:57.146 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:15:57.146 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:15:57.146 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 9, 2024-03-12T16:15:57.146 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:15:57.146 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:15:57.146 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.145+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc50006cbc0 msgr2=0x7fc50006f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.145+0000 7fc51cae5700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc50006cbc0 0x7fc50006f080 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 rx=0x7fc51810bb00 tx=0x7fc50c00b040).stop 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.145+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5180f5f80 msgr2=0x7fc5181101c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.145+0000 7fc51cae5700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5180f5f80 0x7fc5181101c0 secure :-1 s=READY pgs=5 cs=0 l=1 rev1=1 rx=0x7fc508000c00 tx=0x7fc508009cb0).stop 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.145+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 shutdown_connections 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.145+0000 7fc51cae5700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc5180f5f80 0x7fc5181101c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.145+0000 7fc51cae5700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc50006cbc0 0x7fc50006f080 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.145+0000 7fc51cae5700 1 --2- 172.21.15.6:0/3617894689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc5180f8720 0x7fc5181106b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.145+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 >> 172.21.15.6:0/3617894689 conn(0x7fc51806ce40 msgr2=0x7fc5180f49d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.146+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 shutdown_connections 2024-03-12T16:15:57.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.146+0000 7fc51cae5700 1 -- 172.21.15.6:0/3617894689 wait complete. 2024-03-12T16:15:57.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.250+0000 7ff7b13cd700 1 -- 172.21.15.6:0/876378346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fe270 msgr2=0x7ff7ac0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.250+0000 7ff7b13cd700 1 --2- 172.21.15.6:0/876378346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fe270 0x7ff7ac0f7a50 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7ff79c0047f0 tx=0x7ff79c009cb0).stop 2024-03-12T16:15:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.250+0000 7ff7b13cd700 1 -- 172.21.15.6:0/876378346 shutdown_connections 2024-03-12T16:15:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.250+0000 7ff7b13cd700 1 --2- 172.21.15.6:0/876378346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fe270 0x7ff7ac0f7a50 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.250+0000 7ff7b13cd700 1 --2- 172.21.15.6:0/876378346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7ac0fd910 0x7ff7ac0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.250+0000 7ff7b13cd700 1 -- 172.21.15.6:0/876378346 >> 172.21.15.6:0/876378346 conn(0x7ff7ac0f3530 msgr2=0x7ff7ac0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.250+0000 7ff7b13cd700 1 -- 172.21.15.6:0/876378346 shutdown_connections 2024-03-12T16:15:57.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.250+0000 7ff7b13cd700 1 -- 172.21.15.6:0/876378346 wait complete. 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.251+0000 7ff7b13cd700 1 Processor -- start 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.251+0000 7ff7b13cd700 1 -- start start 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7b13cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fd910 0x7ff7ac10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7b13cd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7ac0fe270 0x7ff7ac10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7b13cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac10eae0 con 0x7ff7ac0fd910 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7b13cd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff7ac10ec20 con 0x7ff7ac0fe270 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fd910 0x7ff7ac10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fd910 0x7ff7ac10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54238/0 (socket says 172.21.15.6:54238) 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7aaffd700 1 -- 172.21.15.6:0/559917091 learned_addr learned my addr 172.21.15.6:0/559917091 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:57.254 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7aa7fc700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7ac0fe270 0x7ff7ac10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7aaffd700 1 -- 172.21.15.6:0/559917091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7ac0fe270 msgr2=0x7ff7ac10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7aaffd700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7ac0fe270 0x7ff7ac10e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7aaffd700 1 -- 172.21.15.6:0/559917091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff79c005040 con 0x7ff7ac0fd910 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7aa7fc700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7ac0fe270 0x7ff7ac10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7aaffd700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fd910 0x7ff7ac10dff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff7a00041d0 tx=0x7ff7a0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff793fff700 1 -- 172.21.15.6:0/559917091 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a0002d90 con 0x7ff7ac0fd910 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff7ac1082b0 con 0x7ff7ac0fd910 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff793fff700 1 -- 172.21.15.6:0/559917091 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff7a000f040 con 0x7ff7ac0fd910 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff793fff700 1 -- 172.21.15.6:0/559917091 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff7a000d800 con 0x7ff7ac0fd910 2024-03-12T16:15:57.255 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.252+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff7ac108870 con 0x7ff7ac0fd910 2024-03-12T16:15:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.253+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff7ac05f570 con 0x7ff7ac0fd910 2024-03-12T16:15:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.254+0000 7ff793fff700 1 -- 172.21.15.6:0/559917091 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7ff7a000dac0 con 0x7ff7ac0fd910 2024-03-12T16:15:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.254+0000 7ff793fff700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff79406cbc0 0x7ff79406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.254+0000 7ff793fff700 1 -- 172.21.15.6:0/559917091 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7ff7a008c070 con 0x7ff7ac0fd910 2024-03-12T16:15:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.255+0000 7ff7aa7fc700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff79406cbc0 0x7ff79406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:57.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.255+0000 7ff7aa7fc700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff79406cbc0 0x7ff79406f080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff79c0043d0 tx=0x7ff79c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:57.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.259+0000 7ff793fff700 1 -- 172.21.15.6:0/559917091 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff7a00599a0 con 0x7ff7ac0fd910 2024-03-12T16:15:57.416 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[118234]: 2024-03-12T16:15:57.134+0000 7faffb8e2640 -1 osd.0 49 log_to_monitors true 2024-03-12T16:15:57.416 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:57 smithi006 ceph-mon[103869]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:57.417 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:57 smithi006 ceph-mon[103869]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:57.417 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:57.417 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:57.417 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:57 smithi006 ceph-mon[103869]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:57.417 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:57 smithi006 ceph-mon[103869]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:57.417 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:57.417 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:57 smithi134 ceph-mon[85099]: pgmap v47: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:57 smithi134 ceph-mon[85099]: from='client.34188 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:57.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:57 smithi134 ceph-mon[85099]: from='client.34190 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:57.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:57 smithi134 ceph-mon[85099]: from='client.34194 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:57.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:57.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.505+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7ff7ac047540 con 0x7ff7ac0fd910 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.506+0000 7ff793fff700 1 -- 172.21.15.6:0/559917091 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7ff7a0059530 con 0x7ff7ac0fd910 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:e16 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 16 2024-03-12T16:15:57.507 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:14:55.638904+0000 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:15:57.508 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:15:57.509 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:15:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff79406cbc0 msgr2=0x7ff79406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff79406cbc0 0x7ff79406f080 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 rx=0x7ff79c0043d0 tx=0x7ff79c00b040).stop 2024-03-12T16:15:57.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fd910 msgr2=0x7ff7ac10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fd910 0x7ff7ac10dff0 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7ff7a00041d0 tx=0x7ff7a0009f60).stop 2024-03-12T16:15:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 shutdown_connections 2024-03-12T16:15:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff79406cbc0 0x7ff79406f080 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff7ac0fd910 0x7ff7ac10dff0 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 --2- 172.21.15.6:0/559917091 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff7ac0fe270 0x7ff7ac10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 >> 172.21.15.6:0/559917091 conn(0x7ff7ac0f3530 msgr2=0x7ff7ac0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 shutdown_connections 2024-03-12T16:15:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.508+0000 7ff7b13cd700 1 -- 172.21.15.6:0/559917091 wait complete. 2024-03-12T16:15:57.511 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-03-12T16:15:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.612+0000 7f2ce839a700 1 -- 172.21.15.6:0/507300312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 msgr2=0x7f2ce00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.612+0000 7f2ce839a700 1 --2- 172.21.15.6:0/507300312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 0x7f2ce00f6930 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2cd00047f0 tx=0x7f2cd0009cb0).stop 2024-03-12T16:15:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.612+0000 7f2ce839a700 1 -- 172.21.15.6:0/507300312 shutdown_connections 2024-03-12T16:15:57.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.612+0000 7f2ce839a700 1 --2- 172.21.15.6:0/507300312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 0x7f2ce00f6930 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.612+0000 7f2ce839a700 1 --2- 172.21.15.6:0/507300312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce00fc7f0 0x7f2ce00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.612+0000 7f2ce839a700 1 -- 172.21.15.6:0/507300312 >> 172.21.15.6:0/507300312 conn(0x7f2ce0070590 msgr2=0x7f2ce00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.612+0000 7f2ce839a700 1 -- 172.21.15.6:0/507300312 shutdown_connections 2024-03-12T16:15:57.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.612+0000 7f2ce839a700 1 -- 172.21.15.6:0/507300312 wait complete. 2024-03-12T16:15:57.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce839a700 1 Processor -- start 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce839a700 1 -- start start 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce839a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce00fc7f0 0x7f2ce010dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce839a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 0x7f2ce010e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce839a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce010eac0 con 0x7f2ce00fd150 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce839a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ce010ec00 con 0x7f2ce00fc7f0 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce5935700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 0x7f2ce010e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce5935700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 0x7f2ce010e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54256/0 (socket says 172.21.15.6:54256) 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce5935700 1 -- 172.21.15.6:0/2549471633 learned_addr learned my addr 172.21.15.6:0/2549471633 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce6136700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce00fc7f0 0x7f2ce010dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce5935700 1 -- 172.21.15.6:0/2549471633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce00fc7f0 msgr2=0x7f2ce010dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce5935700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce00fc7f0 0x7f2ce010dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce5935700 1 -- 172.21.15.6:0/2549471633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2cd0005040 con 0x7f2ce00fd150 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce6136700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce00fc7f0 0x7f2ce010dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:15:57.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.613+0000 7f2ce5935700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 0x7f2ce010e4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2cd0000c00 tx=0x7f2cd0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:57.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.614+0000 7f2cd77fe700 1 -- 172.21.15.6:0/2549471633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd000e030 con 0x7f2ce00fd150 2024-03-12T16:15:57.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.614+0000 7f2cd77fe700 1 -- 172.21.15.6:0/2549471633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cd0007e90 con 0x7f2ce00fd150 2024-03-12T16:15:57.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.614+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ce0108230 con 0x7f2ce00fd150 2024-03-12T16:15:57.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.614+0000 7f2cd77fe700 1 -- 172.21.15.6:0/2549471633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cd0018070 con 0x7f2ce00fd150 2024-03-12T16:15:57.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.614+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ce0108790 con 0x7f2ce00fd150 2024-03-12T16:15:57.617 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.615+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ce005f590 con 0x7f2ce00fd150 2024-03-12T16:15:57.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.615+0000 7f2cd77fe700 1 -- 172.21.15.6:0/2549471633 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7f2cd001d420 con 0x7f2ce00fd150 2024-03-12T16:15:57.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.616+0000 7f2cd77fe700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ccc06cbc0 0x7f2ccc06f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:57.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.616+0000 7f2cd77fe700 1 -- 172.21.15.6:0/2549471633 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f2cd008d2d0 con 0x7f2ce00fd150 2024-03-12T16:15:57.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.616+0000 7f2ce6136700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ccc06cbc0 0x7f2ccc06f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:57.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.616+0000 7f2ce6136700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ccc06cbc0 0x7f2ccc06f080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2cdc004ba0 tx=0x7f2cdc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:57.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.620+0000 7f2cd77fe700 1 -- 172.21.15.6:0/2549471633 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2cd005acc0 con 0x7f2ce00fd150 2024-03-12T16:15:57.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.840+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ce0109760 con 0x7f2ccc06cbc0 2024-03-12T16:15:57.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.841+0000 7f2cd77fe700 1 -- 172.21.15.6:0/2549471633 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f2ce0109760 con 0x7f2ccc06cbc0 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "crash" 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "7/21 daemons upgraded", 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading osd daemons", 2024-03-12T16:15:57.843 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:15:57.844 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.843+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ccc06cbc0 msgr2=0x7f2ccc06f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ccc06cbc0 0x7f2ccc06f080 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 rx=0x7f2cdc004ba0 tx=0x7f2cdc009040).stop 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 msgr2=0x7f2ce010e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 0x7f2ce010e4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f2cd0000c00 tx=0x7f2cd0009cb0).stop 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 shutdown_connections 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ce00fc7f0 0x7f2ce010dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ccc06cbc0 0x7f2ccc06f080 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 --2- 172.21.15.6:0/2549471633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ce00fd150 0x7f2ce010e4c0 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 >> 172.21.15.6:0/2549471633 conn(0x7f2ce0070590 msgr2=0x7f2ce0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 shutdown_connections 2024-03-12T16:15:57.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.844+0000 7f2ce839a700 1 -- 172.21.15.6:0/2549471633 wait complete. 2024-03-12T16:15:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.947+0000 7f9550ea5700 1 -- 172.21.15.6:0/3100400938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 msgr2=0x7f954c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.947+0000 7f9550ea5700 1 --2- 172.21.15.6:0/3100400938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 0x7f954c0f6930 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7f95400047f0 tx=0x7f9540009cb0).stop 2024-03-12T16:15:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.947+0000 7f9550ea5700 1 -- 172.21.15.6:0/3100400938 shutdown_connections 2024-03-12T16:15:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.947+0000 7f9550ea5700 1 --2- 172.21.15.6:0/3100400938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 0x7f954c0f6930 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.947+0000 7f9550ea5700 1 --2- 172.21.15.6:0/3100400938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f954c0fc7f0 0x7f954c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.947+0000 7f9550ea5700 1 -- 172.21.15.6:0/3100400938 >> 172.21.15.6:0/3100400938 conn(0x7f954c070590 msgr2=0x7f954c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.947+0000 7f9550ea5700 1 -- 172.21.15.6:0/3100400938 shutdown_connections 2024-03-12T16:15:57.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.947+0000 7f9550ea5700 1 -- 172.21.15.6:0/3100400938 wait complete. 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f9550ea5700 1 Processor -- start 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f9550ea5700 1 -- start start 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f9550ea5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f954c0fc7f0 0x7f954c10cef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f9550ea5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 0x7f954c10d3e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f9550ea5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c10d9e0 con 0x7f954c0fd150 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f9550ea5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f954c10db20 con 0x7f954c0fc7f0 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f9549d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 0x7f954c10d3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f9549d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 0x7f954c10d3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54278/0 (socket says 172.21.15.6:54278) 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f9549d9b700 1 -- 172.21.15.6:0/2914550651 learned_addr learned my addr 172.21.15.6:0/2914550651 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.948+0000 7f954a59c700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f954c0fc7f0 0x7f954c10cef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:57.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.949+0000 7f9549d9b700 1 -- 172.21.15.6:0/2914550651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f954c0fc7f0 msgr2=0x7f954c10cef0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.949+0000 7f9549d9b700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f954c0fc7f0 0x7f954c10cef0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.949+0000 7f9549d9b700 1 -- 172.21.15.6:0/2914550651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9540005040 con 0x7f954c0fd150 2024-03-12T16:15:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.949+0000 7f9549d9b700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 0x7f954c10d3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f95400099f0 tx=0x7f9540009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.949+0000 7f953b7fe700 1 -- 172.21.15.6:0/2914550651 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f954000e030 con 0x7f954c0fd150 2024-03-12T16:15:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.949+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f954c107150 con 0x7f954c0fd150 2024-03-12T16:15:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.949+0000 7f953b7fe700 1 -- 172.21.15.6:0/2914550651 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9540007e90 con 0x7f954c0fd150 2024-03-12T16:15:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.949+0000 7f953b7fe700 1 -- 172.21.15.6:0/2914550651 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9540018070 con 0x7f954c0fd150 2024-03-12T16:15:57.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.949+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f954c1076b0 con 0x7f954c0fd150 2024-03-12T16:15:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.950+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f954c05f590 con 0x7f954c0fd150 2024-03-12T16:15:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.951+0000 7f953b7fe700 1 -- 172.21.15.6:0/2914550651 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 39) v1 ==== 90942+0+0 (secure 0 0 0) 0x7f95400094c0 con 0x7f954c0fd150 2024-03-12T16:15:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.951+0000 7f953b7fe700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f953406cbc0 0x7f953406f080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:15:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.951+0000 7f953b7fe700 1 -- 172.21.15.6:0/2914550651 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(51..51 src has 1..51) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f954008d120 con 0x7f954c0fd150 2024-03-12T16:15:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.951+0000 7f954a59c700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f953406cbc0 0x7f953406f080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:15:57.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.952+0000 7f954a59c700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f953406cbc0 0x7f953406f080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f953c004de0 tx=0x7f953c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:15:57.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:57.956+0000 7f953b7fe700 1 -- 172.21.15.6:0/2914550651 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f954005ab10 con 0x7f954c0fd150 2024-03-12T16:15:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.245+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f954c047540 con 0x7f954c0fd150 2024-03-12T16:15:58.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.245+0000 7f953b7fe700 1 -- 172.21.15.6:0/2914550651 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1328 (secure 0 0 0) 0x7f954005a6a0 con 0x7f954c0fd150 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 65/330 objects degraded (19.697%), 19 pgs degraded 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] OSD_DOWN: 1 osds down 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout: osd.0 (root=default,host=smithi006) is down 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 65/330 objects degraded (19.697%), 19 pgs degraded 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout: pg 1.0 is active+undersized+degraded, acting [3,1] 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.0 is active+undersized+degraded, acting [3,1] 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1 is active+undersized+degraded, acting [2,1] 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.2 is active+undersized+degraded, acting [5,1] 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.4 is active+undersized+degraded, acting [1,4] 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.5 is active+undersized+degraded, acting [3,4] 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.8 is active+undersized+degraded, acting [3,5] 2024-03-12T16:15:58.247 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.9 is active+undersized+degraded, acting [1,4] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.e is active+undersized+degraded, acting [2,3] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.f is active+undersized+degraded, acting [4,5] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.10 is active+undersized+degraded, acting [2,1] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.12 is active+undersized+degraded, acting [3,1] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.13 is active+undersized+degraded, acting [4,2] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.15 is active+undersized+degraded, acting [1,3] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.19 is active+undersized+degraded, acting [4,2] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1b is active+undersized+degraded, acting [1,5] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1d is active+undersized+degraded, acting [3,5] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1e is active+undersized+degraded, acting [2,5] 2024-03-12T16:15:58.248 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1f is active+undersized+degraded, acting [3,4] 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.247+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f953406cbc0 msgr2=0x7f953406f080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.247+0000 7f9550ea5700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f953406cbc0 0x7f953406f080 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 rx=0x7f953c004de0 tx=0x7f953c00b040).stop 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.247+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 msgr2=0x7f954c10d3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.247+0000 7f9550ea5700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 0x7f954c10d3e0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 rx=0x7f95400099f0 tx=0x7f9540009cb0).stop 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.247+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 shutdown_connections 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.247+0000 7f9550ea5700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f954c0fc7f0 0x7f954c10cef0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.247+0000 7f9550ea5700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f953406cbc0 0x7f953406f080 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.247+0000 7f9550ea5700 1 --2- 172.21.15.6:0/2914550651 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f954c0fd150 0x7f954c10d3e0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.248+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 >> 172.21.15.6:0/2914550651 conn(0x7f954c070590 msgr2=0x7f954c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:15:58.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.248+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 shutdown_connections 2024-03-12T16:15:58.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:15:58.248+0000 7f9550ea5700 1 -- 172.21.15.6:0/2914550651 wait complete. 2024-03-12T16:15:58.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:58 smithi134 ceph-mon[85099]: from='osd.0 [v2:172.21.15.6:6802/1475010970,v1:172.21.15.6:6803/1475010970]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-12T16:15:58.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:58 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3617894689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:58.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:58 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/559917091' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:15:58.457 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:15:58 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[118234]: 2024-03-12T16:15:58.113+0000 7fafead37700 -1 osd.0 49 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:15:58.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:58 smithi006 ceph-mon[103869]: from='osd.0 [v2:172.21.15.6:6802/1475010970,v1:172.21.15.6:6803/1475010970]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-03-12T16:15:58.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:58 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3617894689' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:15:58.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:58 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/559917091' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:15:59.121 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:59 smithi006 ceph-mon[103869]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:59.121 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:59 smithi006 ceph-mon[103869]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:59.121 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:59 smithi006 ceph-mon[103869]: from='osd.0 [v2:172.21.15.6:6802/1475010970,v1:172.21.15.6:6803/1475010970]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-12T16:15:59.121 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:59 smithi006 ceph-mon[103869]: osdmap e52: 6 total, 5 up, 6 in 2024-03-12T16:15:59.122 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:59 smithi006 ceph-mon[103869]: from='osd.0 [v2:172.21.15.6:6802/1475010970,v1:172.21.15.6:6803/1475010970]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:15:59.122 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:15:59 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2914550651' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:15:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:59 smithi134 ceph-mon[85099]: pgmap v48: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.5 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:15:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:59 smithi134 ceph-mon[85099]: from='client.34208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:15:59.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:59 smithi134 ceph-mon[85099]: from='osd.0 [v2:172.21.15.6:6802/1475010970,v1:172.21.15.6:6803/1475010970]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-03-12T16:15:59.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:59 smithi134 ceph-mon[85099]: osdmap e52: 6 total, 5 up, 6 in 2024-03-12T16:15:59.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:59 smithi134 ceph-mon[85099]: from='osd.0 [v2:172.21.15.6:6802/1475010970,v1:172.21.15.6:6803/1475010970]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:15:59.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:15:59 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2914550651' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:16:00.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:00 smithi134 ceph-mon[85099]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:16:00.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:00 smithi134 ceph-mon[85099]: osd.0 [v2:172.21.15.6:6802/1475010970,v1:172.21.15.6:6803/1475010970] boot 2024-03-12T16:16:00.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:00 smithi134 ceph-mon[85099]: osdmap e53: 6 total, 6 up, 6 in 2024-03-12T16:16:00.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:00 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:16:00.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:00 smithi134 ceph-mon[85099]: osdmap e54: 6 total, 6 up, 6 in 2024-03-12T16:16:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:00 smithi006 ceph-mon[103869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:16:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:00 smithi006 ceph-mon[103869]: osd.0 [v2:172.21.15.6:6802/1475010970,v1:172.21.15.6:6803/1475010970] boot 2024-03-12T16:16:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:00 smithi006 ceph-mon[103869]: osdmap e53: 6 total, 6 up, 6 in 2024-03-12T16:16:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:00 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-03-12T16:16:00.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:00 smithi006 ceph-mon[103869]: osdmap e54: 6 total, 6 up, 6 in 2024-03-12T16:16:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: pgmap v51: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:16:01.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:01.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:01.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:16:01.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:16:01.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:01.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:16:01.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:01.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:01.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:01.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-12T16:16:01.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-12T16:16:01.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:01 smithi134 ceph-mon[85099]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-12T16:16:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: pgmap v51: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:16:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-12T16:16:01.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:01 smithi006 ceph-mon[103869]: Upgrade: unsafe to stop osd(s) at this time (15 PGs are or would become offline) 2024-03-12T16:16:03.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:02 smithi134 ceph-mon[85099]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:16:03.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:03.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:16:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:02 smithi006 ceph-mon[103869]: pgmap v53: 65 pgs: 19 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 65/330 objects degraded (19.697%) 2024-03-12T16:16:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:16:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:03 smithi134 ceph-mon[85099]: mgrmap e40: smithi006.kskdce(active, since 91s), standbys: smithi134.gcntfu 2024-03-12T16:16:04.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:03 smithi006 ceph-mon[103869]: mgrmap e40: smithi006.kskdce(active, since 91s), standbys: smithi134.gcntfu 2024-03-12T16:16:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:04 smithi134 ceph-mon[85099]: pgmap v54: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-03-12T16:16:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:04 smithi134 ceph-mon[85099]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 65/330 objects degraded (19.697%), 19 pgs degraded) 2024-03-12T16:16:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:04 smithi134 ceph-mon[85099]: Cluster is now healthy 2024-03-12T16:16:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:04 smithi006 ceph-mon[103869]: pgmap v54: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 853 B/s wr, 0 op/s 2024-03-12T16:16:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:04 smithi006 ceph-mon[103869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 65/330 objects degraded (19.697%), 19 pgs degraded) 2024-03-12T16:16:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:04 smithi006 ceph-mon[103869]: Cluster is now healthy 2024-03-12T16:16:07.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:06 smithi134 ceph-mon[85099]: pgmap v55: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 663 B/s wr, 0 op/s 2024-03-12T16:16:07.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:06 smithi006 ceph-mon[103869]: pgmap v55: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 663 B/s wr, 0 op/s 2024-03-12T16:16:09.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:09 smithi134 ceph-mon[85099]: pgmap v56: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 587 B/s wr, 0 op/s 2024-03-12T16:16:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:09 smithi006 ceph-mon[103869]: pgmap v56: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 587 B/s wr, 0 op/s 2024-03-12T16:16:11.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:11 smithi134 ceph-mon[85099]: pgmap v57: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:16:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:11 smithi006 ceph-mon[103869]: pgmap v57: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 511 B/s wr, 0 op/s 2024-03-12T16:16:13.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:12 smithi134 ceph-mon[85099]: pgmap v58: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 436 B/s wr, 0 op/s 2024-03-12T16:16:13.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:12 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:12 smithi006 ceph-mon[103869]: pgmap v58: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 436 B/s wr, 0 op/s 2024-03-12T16:16:13.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:12 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:15.707 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:15 smithi134 ceph-mon[85099]: pgmap v59: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-12T16:16:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:15 smithi006 ceph-mon[103869]: pgmap v59: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 426 B/s wr, 0 op/s 2024-03-12T16:16:16.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:16 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-12T16:16:16.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:16 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-12T16:16:16.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:16 smithi006 ceph-mon[103869]: Upgrade: osd.1 is safe to restart 2024-03-12T16:16:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:16 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-12T16:16:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:16 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["1"], "max": 16}]: dispatch 2024-03-12T16:16:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:16 smithi134 ceph-mon[85099]: Upgrade: osd.1 is safe to restart 2024-03-12T16:16:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:17 smithi134 ceph-mon[85099]: pgmap v60: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:17.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:16:17.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:17 smithi006 ceph-mon[103869]: pgmap v60: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:17.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:17.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:16:18.437 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:18 smithi006 ceph-mon[103869]: Upgrade: Updating osd.1 2024-03-12T16:16:18.438 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:18 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:18.438 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:18 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-12T16:16:18.438 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:18 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:16:18.438 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:18 smithi006 ceph-mon[103869]: Deploying daemon osd.1 on smithi006 2024-03-12T16:16:18.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:18 smithi134 ceph-mon[85099]: Upgrade: Updating osd.1 2024-03-12T16:16:18.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:18 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:18.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:18 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-03-12T16:16:18.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:18 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:16:18.662 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:18 smithi134 ceph-mon[85099]: Deploying daemon osd.1 on smithi006 2024-03-12T16:16:19.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:19 smithi006 ceph-mon[103869]: pgmap v61: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:19.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:19 smithi134 ceph-mon[85099]: pgmap v61: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:20.780 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:20 smithi006 systemd[1]: Stopping Ceph osd.1 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:16:21.207 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[56039]: debug 2024-03-12T16:16:20.778+0000 7f7cd6e24700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-12T16:16:21.207 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[56039]: debug 2024-03-12T16:16:20.778+0000 7f7cd6e24700 -1 osd.1 54 *** Got signal Terminated *** 2024-03-12T16:16:21.207 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:20 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[56039]: debug 2024-03-12T16:16:20.778+0000 7f7cd6e24700 -1 osd.1 54 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:16:21.646 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:21 smithi006 ceph-mon[103869]: pgmap v62: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:21.646 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:21 smithi006 ceph-mon[103869]: osd.1 marked itself down and dead 2024-03-12T16:16:21.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:21 smithi134 ceph-mon[85099]: pgmap v62: 65 pgs: 65 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:21.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:21 smithi134 ceph-mon[85099]: osd.1 marked itself down and dead 2024-03-12T16:16:21.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:21 smithi006 bash[124207]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1 2024-03-12T16:16:22.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:22 smithi134 ceph-mon[85099]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:16:22.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:22 smithi134 ceph-mon[85099]: osdmap e55: 6 total, 5 up, 6 in 2024-03-12T16:16:22.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:22 smithi134 ceph-mon[85099]: osdmap e56: 6 total, 5 up, 6 in 2024-03-12T16:16:22.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:22 smithi006 ceph-mon[103869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:16:22.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:22 smithi006 ceph-mon[103869]: osdmap e55: 6 total, 5 up, 6 in 2024-03-12T16:16:22.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:22 smithi006 ceph-mon[103869]: osdmap e56: 6 total, 5 up, 6 in 2024-03-12T16:16:23.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:23 smithi006 ceph-mon[103869]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:23.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:23 smithi134 ceph-mon[85099]: pgmap v64: 65 pgs: 12 stale+active+clean, 53 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:23.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:23 smithi006 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.1.service: Succeeded. 2024-03-12T16:16:23.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:23 smithi006 systemd[1]: Stopped Ceph osd.1 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:16:23.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:23 smithi006 systemd[1]: Starting Ceph osd.1 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:16:24.631 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:24 smithi006 ceph-mon[103869]: Health check failed: Degraded data redundancy: 52/330 objects degraded (15.758%), 16 pgs degraded (PG_DEGRADED) 2024-03-12T16:16:24.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:24 smithi134 ceph-mon[85099]: Health check failed: Degraded data redundancy: 52/330 objects degraded (15.758%), 16 pgs degraded (PG_DEGRADED) 2024-03-12T16:16:24.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:24 smithi006 bash[124479]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-12T16:16:24.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:24 smithi006 bash[124479]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-1 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-12T16:16:24.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:24 smithi006 bash[124479]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-12T16:16:24.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:24 smithi006 bash[124479]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-12T16:16:24.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:24 smithi006 bash[124479]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-1/block 2024-03-12T16:16:24.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:24 smithi006 bash[124479]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-03-12T16:16:24.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:24 smithi006 bash[124479]: --> ceph-volume raw activate successful for osd ID: 1 2024-03-12T16:16:25.628 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:25 smithi006 ceph-mon[103869]: pgmap v66: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:25.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:25 smithi134 ceph-mon[85099]: pgmap v66: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:26.093 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:25 smithi006 ceph-osd[124775]: -- 172.21.15.6:0/3286168231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5649a60a84e0 con 0x5649a6079000 2024-03-12T16:16:26.457 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:26 smithi006 bash[124737]: f9ceda6861e6e389c3550d4d3ade778360280464150d46429b0d7a7e542b68ce 2024-03-12T16:16:26.458 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:26 smithi006 systemd[1]: Started Ceph osd.1 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:16:26.458 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:26 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[124752]: 2024-03-12T16:16:26.314+0000 7f28c841e640 -1 Falling back to public interface 2024-03-12T16:16:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:27 smithi134 ceph-mon[85099]: pgmap v67: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:27.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:27 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:27.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:27 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:27.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:27 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:16:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:27 smithi006 ceph-mon[103869]: pgmap v67: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:27 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:27 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:27.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:27 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:16:28.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.356+0000 7f107e3c8700 1 -- 172.21.15.6:0/2987553763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 msgr2=0x7f10780f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.356+0000 7f107e3c8700 1 --2- 172.21.15.6:0/2987553763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 0x7f10780f6930 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 rx=0x7f106c0047f0 tx=0x7f106c009cb0).stop 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.356+0000 7f107e3c8700 1 -- 172.21.15.6:0/2987553763 shutdown_connections 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.356+0000 7f107e3c8700 1 --2- 172.21.15.6:0/2987553763 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 0x7f10780f6930 unknown :-1 s=CLOSED pgs=83 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.356+0000 7f107e3c8700 1 --2- 172.21.15.6:0/2987553763 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10780fc7f0 0x7f10780fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.356+0000 7f107e3c8700 1 -- 172.21.15.6:0/2987553763 >> 172.21.15.6:0/2987553763 conn(0x7f1078070590 msgr2=0x7f10780f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.356+0000 7f107e3c8700 1 -- 172.21.15.6:0/2987553763 shutdown_connections 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.356+0000 7f107e3c8700 1 -- 172.21.15.6:0/2987553763 wait complete. 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.357+0000 7f107e3c8700 1 Processor -- start 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.357+0000 7f107e3c8700 1 -- start start 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.357+0000 7f107e3c8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10780fc7f0 0x7f10780f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.357+0000 7f107e3c8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 0x7f10780f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.357+0000 7f107e3c8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10780f8f20 con 0x7f10780fd150 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.357+0000 7f107e3c8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10780f9060 con 0x7f10780fc7f0 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.357+0000 7f10777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 0x7f10780f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f10777fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 0x7f10780f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42216/0 (socket says 172.21.15.6:42216) 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f10777fe700 1 -- 172.21.15.6:0/3434545928 learned_addr learned my addr 172.21.15.6:0/3434545928 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f1077fff700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10780fc7f0 0x7f10780f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f10777fe700 1 -- 172.21.15.6:0/3434545928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10780fc7f0 msgr2=0x7f10780f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f10777fe700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10780fc7f0 0x7f10780f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f10777fe700 1 -- 172.21.15.6:0/3434545928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f106c005040 con 0x7f10780fd150 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f1077fff700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10780fc7f0 0x7f10780f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f10777fe700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 0x7f10780f8a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f106c0099f0 tx=0x7f106c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f10757fa700 1 -- 172.21.15.6:0/3434545928 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106c00e030 con 0x7f10780fd150 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f10757fa700 1 -- 172.21.15.6:0/3434545928 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f106c007e90 con 0x7f10780fd150 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10780f92b0 con 0x7f10780fd150 2024-03-12T16:16:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f10757fa700 1 -- 172.21.15.6:0/3434545928 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f106c018070 con 0x7f10780fd150 2024-03-12T16:16:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.358+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10781145f0 con 0x7f10780fd150 2024-03-12T16:16:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.359+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f107805f590 con 0x7f10780fd150 2024-03-12T16:16:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.360+0000 7f10757fa700 1 -- 172.21.15.6:0/3434545928 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f106c01d420 con 0x7f10780fd150 2024-03-12T16:16:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.360+0000 7f10757fa700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f106006caa0 0x7f106006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.360+0000 7f10757fa700 1 -- 172.21.15.6:0/3434545928 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f106c08d180 con 0x7f10780fd150 2024-03-12T16:16:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.360+0000 7f1077fff700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f106006caa0 0x7f106006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.360+0000 7f1077fff700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f106006caa0 0x7f106006ef60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f10680041d0 tx=0x7f1068009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:28.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.364+0000 7f10757fa700 1 -- 172.21.15.6:0/3434545928 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f106c057300 con 0x7f10780fd150 2024-03-12T16:16:28.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.585+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10780fb5a0 con 0x7f106006caa0 2024-03-12T16:16:28.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.587+0000 7f10757fa700 1 -- 172.21.15.6:0/3434545928 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f10780fb5a0 con 0x7f106006caa0 2024-03-12T16:16:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.589+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f106006caa0 msgr2=0x7f106006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.589+0000 7f107e3c8700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f106006caa0 0x7f106006ef60 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 rx=0x7f10680041d0 tx=0x7f1068009040).stop 2024-03-12T16:16:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.589+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 msgr2=0x7f10780f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.589+0000 7f107e3c8700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 0x7f10780f8a30 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 rx=0x7f106c0099f0 tx=0x7f106c009cb0).stop 2024-03-12T16:16:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.590+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 shutdown_connections 2024-03-12T16:16:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.590+0000 7f107e3c8700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10780fc7f0 0x7f10780f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.590+0000 7f107e3c8700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f106006caa0 0x7f106006ef60 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.590+0000 7f107e3c8700 1 --2- 172.21.15.6:0/3434545928 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10780fd150 0x7f10780f8a30 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.590+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 >> 172.21.15.6:0/3434545928 conn(0x7f1078070590 msgr2=0x7f1078060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:28.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.590+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 shutdown_connections 2024-03-12T16:16:28.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.590+0000 7f107e3c8700 1 -- 172.21.15.6:0/3434545928 wait complete. 2024-03-12T16:16:28.603 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:16:28.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 -- 172.21.15.6:0/1592336599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fd8b0 msgr2=0x7fa6640fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:28.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 --2- 172.21.15.6:0/1592336599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fd8b0 0x7fa6640fdc90 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fa6540047f0 tx=0x7fa654009cb0).stop 2024-03-12T16:16:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 -- 172.21.15.6:0/1592336599 shutdown_connections 2024-03-12T16:16:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 --2- 172.21.15.6:0/1592336599 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640fe210 0x7fa6640f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 --2- 172.21.15.6:0/1592336599 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fd8b0 0x7fa6640fdc90 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 -- 172.21.15.6:0/1592336599 >> 172.21.15.6:0/1592336599 conn(0x7fa66406ce40 msgr2=0x7fa66406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 -- 172.21.15.6:0/1592336599 shutdown_connections 2024-03-12T16:16:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 -- 172.21.15.6:0/1592336599 wait complete. 2024-03-12T16:16:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 Processor -- start 2024-03-12T16:16:28.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.701+0000 7fa66a453700 1 -- start start 2024-03-12T16:16:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa66a453700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640fd8b0 0x7fa66410e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa66a453700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fe210 0x7fa66410e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:28.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa66a453700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66410ec10 con 0x7fa6640fe210 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa66a453700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66410ed50 con 0x7fa6640fd8b0 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa6637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fe210 0x7fa66410e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa6637fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fe210 0x7fa66410e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42242/0 (socket says 172.21.15.6:42242) 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa6637fe700 1 -- 172.21.15.6:0/1328604925 learned_addr learned my addr 172.21.15.6:0/1328604925 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa663fff700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640fd8b0 0x7fa66410e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa6637fe700 1 -- 172.21.15.6:0/1328604925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640fd8b0 msgr2=0x7fa66410e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa6637fe700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640fd8b0 0x7fa66410e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa6637fe700 1 -- 172.21.15.6:0/1328604925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa654005040 con 0x7fa6640fe210 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.702+0000 7fa6637fe700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fe210 0x7fa66410e610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa65800e910 tx=0x7fa65800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.703+0000 7fa6617fa700 1 -- 172.21.15.6:0/1328604925 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa658007b40 con 0x7fa6640fe210 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.703+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa664108380 con 0x7fa6640fe210 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.703+0000 7fa6617fa700 1 -- 172.21.15.6:0/1328604925 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa65800f040 con 0x7fa6640fe210 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.703+0000 7fa6617fa700 1 -- 172.21.15.6:0/1328604925 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa658014920 con 0x7fa6640fe210 2024-03-12T16:16:28.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.703+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6641088c0 con 0x7fa6640fe210 2024-03-12T16:16:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.704+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa664060670 con 0x7fa6640fe210 2024-03-12T16:16:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.704+0000 7fa6617fa700 1 -- 172.21.15.6:0/1328604925 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa658014ba0 con 0x7fa6640fe210 2024-03-12T16:16:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.704+0000 7fa6617fa700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa64c06caa0 0x7fa64c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.705+0000 7fa6617fa700 1 -- 172.21.15.6:0/1328604925 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fa65808b730 con 0x7fa6640fe210 2024-03-12T16:16:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.705+0000 7fa663fff700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa64c06caa0 0x7fa64c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:28.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.705+0000 7fa663fff700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa64c06caa0 0x7fa64c06ef60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa6540047c0 tx=0x7fa654009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:28.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.710+0000 7fa6617fa700 1 -- 172.21.15.6:0/1328604925 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa6580593b0 con 0x7fa6640fe210 2024-03-12T16:16:28.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.937+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa6641098b0 con 0x7fa64c06caa0 2024-03-12T16:16:28.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.938+0000 7fa6617fa700 1 -- 172.21.15.6:0/1328604925 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fa6641098b0 con 0x7fa64c06caa0 2024-03-12T16:16:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa64c06caa0 msgr2=0x7fa64c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa64c06caa0 0x7fa64c06ef60 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 rx=0x7fa6540047c0 tx=0x7fa654009cb0).stop 2024-03-12T16:16:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fe210 msgr2=0x7fa66410e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fe210 0x7fa66410e610 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7fa65800e910 tx=0x7fa65800b040).stop 2024-03-12T16:16:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 shutdown_connections 2024-03-12T16:16:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6640fd8b0 0x7fa66410e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa64c06caa0 0x7fa64c06ef60 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 --2- 172.21.15.6:0/1328604925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6640fe210 0x7fa66410e610 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:28.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 >> 172.21.15.6:0/1328604925 conn(0x7fa66406ce40 msgr2=0x7fa664100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:28.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 shutdown_connections 2024-03-12T16:16:28.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:28.940+0000 7fa66a453700 1 -- 172.21.15.6:0/1328604925 wait complete. 2024-03-12T16:16:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.045+0000 7fb10b54a700 1 -- 172.21.15.6:0/262898533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 msgr2=0x7fb104101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.045+0000 7fb10b54a700 1 --2- 172.21.15.6:0/262898533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 0x7fb104101910 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7fb0f40047f0 tx=0x7fb0f4009cb0).stop 2024-03-12T16:16:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.045+0000 7fb10b54a700 1 -- 172.21.15.6:0/262898533 shutdown_connections 2024-03-12T16:16:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.045+0000 7fb10b54a700 1 --2- 172.21.15.6:0/262898533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 0x7fb104101910 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.045+0000 7fb10b54a700 1 --2- 172.21.15.6:0/262898533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1040f88a0 0x7fb1040f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.045+0000 7fb10b54a700 1 -- 172.21.15.6:0/262898533 >> 172.21.15.6:0/262898533 conn(0x7fb104070590 msgr2=0x7fb1040f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.045+0000 7fb10b54a700 1 -- 172.21.15.6:0/262898533 shutdown_connections 2024-03-12T16:16:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.045+0000 7fb10b54a700 1 -- 172.21.15.6:0/262898533 wait complete. 2024-03-12T16:16:29.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb10b54a700 1 Processor -- start 2024-03-12T16:16:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb10b54a700 1 -- start start 2024-03-12T16:16:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb10b54a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1040f88a0 0x7fb10410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb10b54a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 0x7fb10410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb10b54a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10410eb70 con 0x7fb1040f9200 2024-03-12T16:16:29.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb10b54a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb10410ecb0 con 0x7fb1040f88a0 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb108ae5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 0x7fb10410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb108ae5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 0x7fb10410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42250/0 (socket says 172.21.15.6:42250) 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb108ae5700 1 -- 172.21.15.6:0/2000635873 learned_addr learned my addr 172.21.15.6:0/2000635873 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb1092e6700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1040f88a0 0x7fb10410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb108ae5700 1 -- 172.21.15.6:0/2000635873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1040f88a0 msgr2=0x7fb10410e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb108ae5700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1040f88a0 0x7fb10410e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.046+0000 7fb108ae5700 1 -- 172.21.15.6:0/2000635873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb0f4005040 con 0x7fb1040f9200 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.047+0000 7fb108ae5700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 0x7fb10410e570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb0f4005010 tx=0x7fb0f4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.047+0000 7fb0fa7fc700 1 -- 172.21.15.6:0/2000635873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f400e030 con 0x7fb1040f9200 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.047+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb1041082e0 con 0x7fb1040f9200 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.047+0000 7fb0fa7fc700 1 -- 172.21.15.6:0/2000635873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb0f4007e90 con 0x7fb1040f9200 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.047+0000 7fb0fa7fc700 1 -- 172.21.15.6:0/2000635873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb0f4018070 con 0x7fb1040f9200 2024-03-12T16:16:29.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.047+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb1041087c0 con 0x7fb1040f9200 2024-03-12T16:16:29.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.048+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb10405f590 con 0x7fb1040f9200 2024-03-12T16:16:29.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.049+0000 7fb0fa7fc700 1 -- 172.21.15.6:0/2000635873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb0f401d6e0 con 0x7fb1040f9200 2024-03-12T16:16:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.050+0000 7fb0fa7fc700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb0f006ca30 0x7fb0f006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.050+0000 7fb0fa7fc700 1 -- 172.21.15.6:0/2000635873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fb0f408d080 con 0x7fb1040f9200 2024-03-12T16:16:29.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.050+0000 7fb1092e6700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb0f006ca30 0x7fb0f006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:29.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.050+0000 7fb1092e6700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb0f006ca30 0x7fb0f006eef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb100009170 tx=0x7fb100009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:29.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.054+0000 7fb0fa7fc700 1 -- 172.21.15.6:0/2000635873 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb0f405ac10 con 0x7fb1040f9200 2024-03-12T16:16:29.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.268+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb104108af0 con 0x7fb0f006ca30 2024-03-12T16:16:29.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.278+0000 7fb0fa7fc700 1 -- 172.21.15.6:0/2000635873 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fb104108af0 con 0x7fb0f006ca30 2024-03-12T16:16:29.280 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:16:29.280 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (3m) 33s ago 14m 26.1M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (63s) 33s ago 14m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (57s) 53s ago 13m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (2m) 33s ago 13m 80.3M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (9m) 33s ago 9m 124M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (8m) 33s ago 8m 15.4M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (9m) 53s ago 9m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (8m) 53s ago 8m 17.8M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (4m) 33s ago 15m 494M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (4m) 53s ago 13m 447M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (2m) 33s ago 15m 42.4M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (102s) 53s ago 13m 32.0M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (3m) 33s ago 13m 17.3M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (3m) 53s ago 13m 18.1M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (38s) 33s ago 12m 11.5M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:16:29.281 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 starting - - - 1911M 2024-03-12T16:16:29.282 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (12m) 33s ago 12m 194M 1911M 16.2.15-1-g8963e9de 727f386679cb f81cfa7139a0 2024-03-12T16:16:29.282 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (11m) 53s ago 11m 265M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:16:29.282 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (11m) 53s ago 11m 235M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:16:29.282 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (10m) 53s ago 10m 227M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:16:29.282 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (3m) 53s ago 12m 60.0M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:16:29.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb0f006ca30 msgr2=0x7fb0f006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb0f006ca30 0x7fb0f006eef0 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 rx=0x7fb100009170 tx=0x7fb100009d60).stop 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 msgr2=0x7fb10410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 0x7fb10410e570 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7fb0f4005010 tx=0x7fb0f4009cb0).stop 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 shutdown_connections 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb1040f88a0 0x7fb10410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb0f006ca30 0x7fb0f006eef0 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 --2- 172.21.15.6:0/2000635873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb1040f9200 0x7fb10410e570 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 >> 172.21.15.6:0/2000635873 conn(0x7fb104070590 msgr2=0x7fb1040fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 shutdown_connections 2024-03-12T16:16:29.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.280+0000 7fb10b54a700 1 -- 172.21.15.6:0/2000635873 wait complete. 2024-03-12T16:16:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.386+0000 7f3c1472a700 1 -- 172.21.15.6:0/2427764493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 msgr2=0x7f3c0c0f8d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.386+0000 7f3c1472a700 1 --2- 172.21.15.6:0/2427764493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 0x7f3c0c0f8d10 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3c080047f0 tx=0x7f3c08009cb0).stop 2024-03-12T16:16:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.386+0000 7f3c1472a700 1 -- 172.21.15.6:0/2427764493 shutdown_connections 2024-03-12T16:16:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.386+0000 7f3c1472a700 1 --2- 172.21.15.6:0/2427764493 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c0c0f9290 0x7f3c0c1019a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.386+0000 7f3c1472a700 1 --2- 172.21.15.6:0/2427764493 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 0x7f3c0c0f8d10 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.386+0000 7f3c1472a700 1 -- 172.21.15.6:0/2427764493 >> 172.21.15.6:0/2427764493 conn(0x7f3c0c0f2400 msgr2=0x7f3c0c0f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:29.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.386+0000 7f3c1472a700 1 -- 172.21.15.6:0/2427764493 shutdown_connections 2024-03-12T16:16:29.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.386+0000 7f3c1472a700 1 -- 172.21.15.6:0/2427764493 wait complete. 2024-03-12T16:16:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.386+0000 7f3c1472a700 1 Processor -- start 2024-03-12T16:16:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c1472a700 1 -- start start 2024-03-12T16:16:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c1472a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 0x7f3c0c10e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c1472a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c0c0f9290 0x7f3c0c10e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c1472a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c10eb20 con 0x7f3c0c0f8930 2024-03-12T16:16:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c1472a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3c0c10ec60 con 0x7f3c0c0f9290 2024-03-12T16:16:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c124c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 0x7f3c0c10e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c124c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 0x7f3c0c10e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42268/0 (socket says 172.21.15.6:42268) 2024-03-12T16:16:29.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c124c6700 1 -- 172.21.15.6:0/2215037211 learned_addr learned my addr 172.21.15.6:0/2215037211 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c124c6700 1 -- 172.21.15.6:0/2215037211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c0c0f9290 msgr2=0x7f3c0c10e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c11cc5700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c0c0f9290 0x7f3c0c10e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c124c6700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c0c0f9290 0x7f3c0c10e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c124c6700 1 -- 172.21.15.6:0/2215037211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3c08005040 con 0x7f3c0c0f8930 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.387+0000 7f3c124c6700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 0x7f3c0c10e030 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f3c08009380 tx=0x7f3c08009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.388+0000 7f3c037fe700 1 -- 172.21.15.6:0/2215037211 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c0800e070 con 0x7f3c0c0f8930 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.388+0000 7f3c037fe700 1 -- 172.21.15.6:0/2215037211 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3c08007e90 con 0x7f3c0c0f8930 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.388+0000 7f3c037fe700 1 -- 172.21.15.6:0/2215037211 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3c08018070 con 0x7f3c0c0f8930 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.388+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3c0c108290 con 0x7f3c0c0f8930 2024-03-12T16:16:29.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.388+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3c0c108720 con 0x7f3c0c0f8930 2024-03-12T16:16:29.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.389+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3c0c05f510 con 0x7f3c0c0f8930 2024-03-12T16:16:29.392 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.390+0000 7f3c037fe700 1 -- 172.21.15.6:0/2215037211 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f3c0801d420 con 0x7f3c0c0f8930 2024-03-12T16:16:29.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.390+0000 7f3c037fe700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3bf806caa0 0x7f3bf806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:29.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.390+0000 7f3c037fe700 1 -- 172.21.15.6:0/2215037211 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f3c0808c840 con 0x7f3c0c0f8930 2024-03-12T16:16:29.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.392+0000 7f3c11cc5700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3bf806caa0 0x7f3bf806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:29.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.392+0000 7f3c11cc5700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3bf806caa0 0x7f3bf806ef60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3c0c109970 tx=0x7f3bfc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:29.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.399+0000 7f3c037fe700 1 -- 172.21.15.6:0/2215037211 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3c0805a450 con 0x7f3c0c0f8930 2024-03-12T16:16:29.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.688+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3c0c0feea0 con 0x7f3c0c0f8930 2024-03-12T16:16:29.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.688+0000 7f3c037fe700 1 -- 172.21.15.6:0/2215037211 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f3c08059fe0 con 0x7f3c0c0f8930 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4, 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:16:29.691 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:16:29.692 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:16:29.692 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:16:29.692 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:16:29.692 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 8, 2024-03-12T16:16:29.692 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 5 2024-03-12T16:16:29.692 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:16:29.692 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3bf806caa0 msgr2=0x7f3bf806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3bf806caa0 0x7f3bf806ef60 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 rx=0x7f3c0c109970 tx=0x7f3bfc00b040).stop 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 msgr2=0x7f3c0c10e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 0x7f3c0c10e030 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7f3c08009380 tx=0x7f3c08009cb0).stop 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 shutdown_connections 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3bf806caa0 0x7f3bf806ef60 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3c0c0f8930 0x7f3c0c10e030 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 --2- 172.21.15.6:0/2215037211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3c0c0f9290 0x7f3c0c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 >> 172.21.15.6:0/2215037211 conn(0x7f3c0c0f2400 msgr2=0x7f3c0c0fc1e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 shutdown_connections 2024-03-12T16:16:29.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.691+0000 7f3c1472a700 1 -- 172.21.15.6:0/2215037211 wait complete. 2024-03-12T16:16:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:29 smithi134 ceph-mon[85099]: pgmap v68: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:29 smithi134 ceph-mon[85099]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:16:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:29 smithi006 ceph-mon[103869]: pgmap v68: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:29 smithi006 ceph-mon[103869]: from='client.34218 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.796+0000 7fcdbe329700 1 -- 172.21.15.6:0/2297321312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f66f0 msgr2=0x7fcdb80f6ad0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.796+0000 7fcdbe329700 1 --2- 172.21.15.6:0/2297321312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f66f0 0x7fcdb80f6ad0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7fcda8004820 tx=0x7fcda8009cb0).stop 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.796+0000 7fcdbe329700 1 -- 172.21.15.6:0/2297321312 shutdown_connections 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.796+0000 7fcdbe329700 1 --2- 172.21.15.6:0/2297321312 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb80f6fc0 0x7fcdb8103d60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.796+0000 7fcdbe329700 1 --2- 172.21.15.6:0/2297321312 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f66f0 0x7fcdb80f6ad0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.796+0000 7fcdbe329700 1 -- 172.21.15.6:0/2297321312 >> 172.21.15.6:0/2297321312 conn(0x7fcdb8070590 msgr2=0x7fcdb80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.796+0000 7fcdbe329700 1 -- 172.21.15.6:0/2297321312 shutdown_connections 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.796+0000 7fcdbe329700 1 -- 172.21.15.6:0/2297321312 wait complete. 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdbe329700 1 Processor -- start 2024-03-12T16:16:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdbe329700 1 -- start start 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdbe329700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb80f66f0 0x7fcdb81102d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdbe329700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f6fc0 0x7fcdb81107c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdbe329700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8110dc0 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdbe329700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdb8110f00 con 0x7fcdb80f66f0 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdb77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f6fc0 0x7fcdb81107c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdb77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f6fc0 0x7fcdb81107c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42274/0 (socket says 172.21.15.6:42274) 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdb77fe700 1 -- 172.21.15.6:0/964506273 learned_addr learned my addr 172.21.15.6:0/964506273 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.797+0000 7fcdb7fff700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb80f66f0 0x7fcdb81102d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.798+0000 7fcdb77fe700 1 -- 172.21.15.6:0/964506273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb80f66f0 msgr2=0x7fcdb81102d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:29.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.798+0000 7fcdb77fe700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb80f66f0 0x7fcdb81102d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:29.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.798+0000 7fcdb77fe700 1 -- 172.21.15.6:0/964506273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcda8005040 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.798+0000 7fcdb77fe700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f6fc0 0x7fcdb81107c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcdac0041d0 tx=0x7fcdac009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:29.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.798+0000 7fcdb57fa700 1 -- 172.21.15.6:0/964506273 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdac007b40 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.798+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdb810a590 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.798+0000 7fcdb57fa700 1 -- 172.21.15.6:0/964506273 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcdac00f040 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.798+0000 7fcdb57fa700 1 -- 172.21.15.6:0/964506273 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcdac00d800 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.798+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdb810aad0 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.799+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdb805f590 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.800+0000 7fcdb57fa700 1 -- 172.21.15.6:0/964506273 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fcdac007ca0 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.800+0000 7fcdb57fa700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcda006caa0 0x7fcda006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:29.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.800+0000 7fcdb57fa700 1 -- 172.21.15.6:0/964506273 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fcdac08b810 con 0x7fcdb80f6fc0 2024-03-12T16:16:29.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.800+0000 7fcdb7fff700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcda006caa0 0x7fcda006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:29.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.801+0000 7fcdb7fff700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcda006caa0 0x7fcda006ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcda8004580 tx=0x7fcda800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:29.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:29.804+0000 7fcdb57fa700 1 -- 172.21.15.6:0/964506273 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fcdac059420 con 0x7fcdb80f6fc0 2024-03-12T16:16:30.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.068+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcdb8047540 con 0x7fcdb80f6fc0 2024-03-12T16:16:30.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.068+0000 7fcdb57fa700 1 -- 172.21.15.6:0/964506273 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7fcdac058fb0 con 0x7fcdb80f6fc0 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:e16 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 16 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:14:55.638904+0000 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:16:30.071 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:16:30.072 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:16:30.073 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:16:30.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcda006caa0 msgr2=0x7fcda006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcda006caa0 0x7fcda006ef60 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 rx=0x7fcda8004580 tx=0x7fcda800b040).stop 2024-03-12T16:16:30.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f6fc0 msgr2=0x7fcdb81107c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f6fc0 0x7fcdb81107c0 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 rx=0x7fcdac0041d0 tx=0x7fcdac009f60).stop 2024-03-12T16:16:30.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 shutdown_connections 2024-03-12T16:16:30.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdb80f66f0 0x7fcdb81102d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcda006caa0 0x7fcda006ef60 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 --2- 172.21.15.6:0/964506273 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdb80f6fc0 0x7fcdb81107c0 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 >> 172.21.15.6:0/964506273 conn(0x7fcdb8070590 msgr2=0x7fcdb806d950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:30.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 shutdown_connections 2024-03-12T16:16:30.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.071+0000 7fcdbe329700 1 -- 172.21.15.6:0/964506273 wait complete. 2024-03-12T16:16:30.075 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-03-12T16:16:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.176+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/2087680639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fbf40 msgr2=0x7f7cd80fc320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.176+0000 7f7cdd7e4700 1 --2- 172.21.15.6:0/2087680639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fbf40 0x7f7cd80fc320 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 rx=0x7f7cc80048f0 tx=0x7f7cc800adc0).stop 2024-03-12T16:16:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.176+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/2087680639 shutdown_connections 2024-03-12T16:16:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.176+0000 7f7cdd7e4700 1 --2- 172.21.15.6:0/2087680639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cd80fc8a0 0x7f7cd80f60d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.176+0000 7f7cdd7e4700 1 --2- 172.21.15.6:0/2087680639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fbf40 0x7f7cd80fc320 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.176+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/2087680639 >> 172.21.15.6:0/2087680639 conn(0x7f7cd806cea0 msgr2=0x7f7cd806d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.177+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/2087680639 shutdown_connections 2024-03-12T16:16:30.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.177+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/2087680639 wait complete. 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.177+0000 7f7cdd7e4700 1 Processor -- start 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.177+0000 7f7cdd7e4700 1 -- start start 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cdd7e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cd80fbf40 0x7f7cd810dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cdd7e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fc8a0 0x7f7cd810e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cdd7e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd810eac0 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cdd7e4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7cd810ec00 con 0x7f7cd80fbf40 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cd67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fc8a0 0x7f7cd810e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cd67fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fc8a0 0x7f7cd810e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42286/0 (socket says 172.21.15.6:42286) 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cd67fc700 1 -- 172.21.15.6:0/726484960 learned_addr learned my addr 172.21.15.6:0/726484960 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:16:30.181 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cd6ffd700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cd80fbf40 0x7f7cd810dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cd67fc700 1 -- 172.21.15.6:0/726484960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cd80fbf40 msgr2=0x7f7cd810dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cd67fc700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cd80fbf40 0x7f7cd810dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cd67fc700 1 -- 172.21.15.6:0/726484960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7cc8005040 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cd67fc700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fc8a0 0x7f7cd810e4c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7ccc002770 tx=0x7f7ccc002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cbffff700 1 -- 172.21.15.6:0/726484960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ccc007b40 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cbffff700 1 -- 172.21.15.6:0/726484960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7ccc00f040 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7cd8108290 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cbffff700 1 -- 172.21.15.6:0/726484960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7ccc014820 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.178+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7cd8108850 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.179+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7cd8047540 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.180+0000 7f7cbffff700 1 -- 172.21.15.6:0/726484960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7ccc007ca0 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.180+0000 7f7cbffff700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7cc006caa0 0x7f7cc006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.180+0000 7f7cbffff700 1 -- 172.21.15.6:0/726484960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f7ccc08b7d0 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.180+0000 7f7cd6ffd700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7cc006caa0 0x7f7cc006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:30.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.181+0000 7f7cd6ffd700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7cc006caa0 0x7f7cc006ef60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7cc800c3b0 tx=0x7f7cc8016040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.185+0000 7f7cbffff700 1 -- 172.21.15.6:0/726484960 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7ccc0593e0 con 0x7f7cd80fc8a0 2024-03-12T16:16:30.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.416+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7cd8108f40 con 0x7f7cc006caa0 2024-03-12T16:16:30.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.417+0000 7f7cbffff700 1 -- 172.21.15.6:0/726484960 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f7cd8108f40 con 0x7f7cc006caa0 2024-03-12T16:16:30.419 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:16:30.419 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:16:30.419 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:16:30.419 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:16:30.420 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:16:30.420 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:16:30.420 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:16:30.420 INFO:teuthology.orchestra.run.smithi006.stdout: "crash" 2024-03-12T16:16:30.420 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:16:30.420 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "7/21 daemons upgraded", 2024-03-12T16:16:30.420 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading osd daemons", 2024-03-12T16:16:30.420 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:16:30.420 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:16:30.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.419+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7cc006caa0 msgr2=0x7f7cc006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.419+0000 7f7cdd7e4700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7cc006caa0 0x7f7cc006ef60 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 rx=0x7f7cc800c3b0 tx=0x7f7cc8016040).stop 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.419+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fc8a0 msgr2=0x7f7cd810e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.419+0000 7f7cdd7e4700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fc8a0 0x7f7cd810e4c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f7ccc002770 tx=0x7f7ccc002a80).stop 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.419+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 shutdown_connections 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.419+0000 7f7cdd7e4700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7cd80fbf40 0x7f7cd810dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.419+0000 7f7cdd7e4700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7cc006caa0 0x7f7cc006ef60 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.419+0000 7f7cdd7e4700 1 --2- 172.21.15.6:0/726484960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7cd80fc8a0 0x7f7cd810e4c0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.419+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 >> 172.21.15.6:0/726484960 conn(0x7f7cd806cea0 msgr2=0x7f7cd80ff790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.420+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 shutdown_connections 2024-03-12T16:16:30.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.420+0000 7f7cdd7e4700 1 -- 172.21.15.6:0/726484960 wait complete. 2024-03-12T16:16:30.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.534+0000 7fee3130f700 1 -- 172.21.15.6:0/3915304523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 msgr2=0x7fee2c0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.534+0000 7fee3130f700 1 --2- 172.21.15.6:0/3915304523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 0x7fee2c0fdcf0 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fee1c0047f0 tx=0x7fee1c009cb0).stop 2024-03-12T16:16:30.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.534+0000 7fee3130f700 1 -- 172.21.15.6:0/3915304523 shutdown_connections 2024-03-12T16:16:30.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.534+0000 7fee3130f700 1 --2- 172.21.15.6:0/3915304523 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c0fe270 0x7fee2c0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.534+0000 7fee3130f700 1 --2- 172.21.15.6:0/3915304523 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 0x7fee2c0fdcf0 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.534+0000 7fee3130f700 1 -- 172.21.15.6:0/3915304523 >> 172.21.15.6:0/3915304523 conn(0x7fee2c0f3530 msgr2=0x7fee2c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:30.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.534+0000 7fee3130f700 1 -- 172.21.15.6:0/3915304523 shutdown_connections 2024-03-12T16:16:30.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.534+0000 7fee3130f700 1 -- 172.21.15.6:0/3915304523 wait complete. 2024-03-12T16:16:30.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee3130f700 1 Processor -- start 2024-03-12T16:16:30.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee3130f700 1 -- start start 2024-03-12T16:16:30.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee3130f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 0x7fee2c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee3130f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c0fe270 0x7fee2c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee3130f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c06bab0 con 0x7fee2c0fd910 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee3130f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fee2c06bbf0 con 0x7fee2c0fe270 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 0x7fee2c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee2affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 0x7fee2c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42302/0 (socket says 172.21.15.6:42302) 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee2affd700 1 -- 172.21.15.6:0/1081044840 learned_addr learned my addr 172.21.15.6:0/1081044840 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.535+0000 7fee2a7fc700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c0fe270 0x7fee2c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee2affd700 1 -- 172.21.15.6:0/1081044840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c0fe270 msgr2=0x7fee2c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee2affd700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c0fe270 0x7fee2c06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee2affd700 1 -- 172.21.15.6:0/1081044840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fee1c005040 con 0x7fee2c0fd910 2024-03-12T16:16:30.540 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee2a7fc700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c0fe270 0x7fee2c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:16:30.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee2affd700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 0x7fee2c06b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fee1c00b120 tx=0x7fee1c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:30.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee13fff700 1 -- 172.21.15.6:0/1081044840 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1c00e030 con 0x7fee2c0fd910 2024-03-12T16:16:30.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee13fff700 1 -- 172.21.15.6:0/1081044840 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fee1c007e90 con 0x7fee2c0fd910 2024-03-12T16:16:30.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fee2c06be40 con 0x7fee2c0fd910 2024-03-12T16:16:30.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee13fff700 1 -- 172.21.15.6:0/1081044840 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fee1c018070 con 0x7fee2c0fd910 2024-03-12T16:16:30.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.536+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fee2c1145f0 con 0x7fee2c0fd910 2024-03-12T16:16:30.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.537+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fee2c05f570 con 0x7fee2c0fd910 2024-03-12T16:16:30.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.537+0000 7fee13fff700 1 -- 172.21.15.6:0/1081044840 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fee1c01d420 con 0x7fee2c0fd910 2024-03-12T16:16:30.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.538+0000 7fee13fff700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fee1406caa0 0x7fee1406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:16:30.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.538+0000 7fee13fff700 1 -- 172.21.15.6:0/1081044840 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(56..56 src has 1..56) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fee1c08d190 con 0x7fee2c0fd910 2024-03-12T16:16:30.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.538+0000 7fee2a7fc700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fee1406caa0 0x7fee1406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:16:30.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.538+0000 7fee2a7fc700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fee1406caa0 0x7fee1406ef60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fee2c06c870 tx=0x7fee20009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:16:30.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.545+0000 7fee13fff700 1 -- 172.21.15.6:0/1081044840 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fee1c057310 con 0x7fee2c0fd910 2024-03-12T16:16:30.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:30 smithi134 ceph-mon[85099]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:16:30.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:30 smithi134 ceph-mon[85099]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:16:30.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:30 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2215037211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:30.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:30 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/964506273' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:16:30.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:30 smithi006 ceph-mon[103869]: from='client.34222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:16:30.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:30 smithi006 ceph-mon[103869]: from='client.34226 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:16:30.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:30 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2215037211' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:30.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:30 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/964506273' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:16:30.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.849+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fee2c0ffca0 con 0x7fee2c0fd910 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.849+0000 7fee13fff700 1 -- 172.21.15.6:0/1081044840 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1160 (secure 0 0 0) 0x7fee1c05a930 con 0x7fee2c0fd910 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 52/330 objects degraded (15.758%), 16 pgs degraded 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] OSD_DOWN: 1 osds down 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stdout: osd.1 (root=default,host=smithi006) is down 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 52/330 objects degraded (15.758%), 16 pgs degraded 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stdout: pg 1.0 is active+undersized+degraded, acting [3,0] 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.0 is active+undersized+degraded, acting [3,0] 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1 is active+undersized+degraded, acting [2,0] 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.2 is active+undersized+degraded, acting [5,0] 2024-03-12T16:16:30.852 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.3 is active+undersized+degraded, acting [5,2] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.4 is active+undersized+degraded, acting [0,4] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.6 is active+undersized+degraded, acting [3,4] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.9 is active+undersized+degraded, acting [4,0] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.a is active+undersized+degraded, acting [4,3] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.d is active+undersized+degraded, acting [3,2] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.10 is active+undersized+degraded, acting [2,0] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.11 is active+undersized+degraded, acting [4,3] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.12 is active+undersized+degraded, acting [3,0] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.15 is active+undersized+degraded, acting [3,0] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.17 is active+undersized+degraded, acting [5,2] 2024-03-12T16:16:30.853 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1b is active+undersized+degraded, acting [0,5] 2024-03-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fee1406caa0 msgr2=0x7fee1406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fee1406caa0 0x7fee1406ef60 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 rx=0x7fee2c06c870 tx=0x7fee20009040).stop 2024-03-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 msgr2=0x7fee2c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 0x7fee2c06b0d0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fee1c00b120 tx=0x7fee1c009cb0).stop 2024-03-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 shutdown_connections 2024-03-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fee1406caa0 0x7fee1406ef60 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fee2c0fd910 0x7fee2c06b0d0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 --2- 172.21.15.6:0/1081044840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fee2c0fe270 0x7fee2c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 >> 172.21.15.6:0/1081044840 conn(0x7fee2c0f3530 msgr2=0x7fee2c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 shutdown_connections 2024-03-12T16:16:30.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:16:30.852+0000 7fee3130f700 1 -- 172.21.15.6:0/1081044840 wait complete. 2024-03-12T16:16:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:31 smithi134 ceph-mon[85099]: pgmap v69: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:31 smithi134 ceph-mon[85099]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:16:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:31 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1081044840' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:16:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:31 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:31 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:31 smithi006 ceph-mon[103869]: pgmap v69: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:31 smithi006 ceph-mon[103869]: from='client.34238 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:16:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:31 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1081044840' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:16:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:31 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:31 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:32.810 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:32.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:32.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:32.811 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:16:32.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:32.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:32.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:32.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:16:33.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:33 smithi134 ceph-mon[85099]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:33 smithi006 ceph-mon[103869]: pgmap v70: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:34.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:34 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[124752]: 2024-03-12T16:16:34.552+0000 7f28c841e640 -1 osd.1 0 read_superblock omap replica is missing. 2024-03-12T16:16:35.374 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[124752]: 2024-03-12T16:16:35.065+0000 7f28c841e640 -1 osd.1 54 log_to_monitors true 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='osd.1 [v2:172.21.15.6:6810/4090040477,v1:172.21.15.6:6811/4090040477]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:35.641 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-12T16:16:35.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: pgmap v71: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.3 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='osd.1 [v2:172.21.15.6:6810/4090040477,v1:172.21.15.6:6811/4090040477]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:16:35.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-12T16:16:35.957 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:16:35 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[124752]: 2024-03-12T16:16:35.644+0000 7f28b9877700 -1 osd.1 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:16:36.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:36 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-12T16:16:36.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:36 smithi134 ceph-mon[85099]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-12T16:16:36.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:36 smithi134 ceph-mon[85099]: from='osd.1 [v2:172.21.15.6:6810/4090040477,v1:172.21.15.6:6811/4090040477]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-12T16:16:36.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:36 smithi134 ceph-mon[85099]: osdmap e57: 6 total, 5 up, 6 in 2024-03-12T16:16:36.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:36 smithi134 ceph-mon[85099]: from='osd.1 [v2:172.21.15.6:6810/4090040477,v1:172.21.15.6:6811/4090040477]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:16:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:36 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-12T16:16:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:36 smithi006 ceph-mon[103869]: Upgrade: unsafe to stop osd(s) at this time (12 PGs are or would become offline) 2024-03-12T16:16:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:36 smithi006 ceph-mon[103869]: from='osd.1 [v2:172.21.15.6:6810/4090040477,v1:172.21.15.6:6811/4090040477]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-03-12T16:16:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:36 smithi006 ceph-mon[103869]: osdmap e57: 6 total, 5 up, 6 in 2024-03-12T16:16:36.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:36 smithi006 ceph-mon[103869]: from='osd.1 [v2:172.21.15.6:6810/4090040477,v1:172.21.15.6:6811/4090040477]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:16:37.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:37 smithi134 ceph-mon[85099]: pgmap v73: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:37.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:37 smithi134 ceph-mon[85099]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:16:37.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:37 smithi134 ceph-mon[85099]: osd.1 [v2:172.21.15.6:6810/4090040477,v1:172.21.15.6:6811/4090040477] boot 2024-03-12T16:16:37.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:37 smithi134 ceph-mon[85099]: osdmap e58: 6 total, 6 up, 6 in 2024-03-12T16:16:37.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:37 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:16:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:37 smithi006 ceph-mon[103869]: pgmap v73: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 52/330 objects degraded (15.758%) 2024-03-12T16:16:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:37 smithi006 ceph-mon[103869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:16:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:37 smithi006 ceph-mon[103869]: osd.1 [v2:172.21.15.6:6810/4090040477,v1:172.21.15.6:6811/4090040477] boot 2024-03-12T16:16:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:37 smithi006 ceph-mon[103869]: osdmap e58: 6 total, 6 up, 6 in 2024-03-12T16:16:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:37 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-03-12T16:16:38.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:38 smithi134 ceph-mon[85099]: osdmap e59: 6 total, 6 up, 6 in 2024-03-12T16:16:38.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:38 smithi006 ceph-mon[103869]: osdmap e59: 6 total, 6 up, 6 in 2024-03-12T16:16:39.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:39 smithi134 ceph-mon[85099]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22/330 objects degraded (6.667%) 2024-03-12T16:16:39.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:39 smithi134 ceph-mon[85099]: Health check update: Degraded data redundancy: 22/330 objects degraded (6.667%), 7 pgs degraded (PG_DEGRADED) 2024-03-12T16:16:39.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:39 smithi006 ceph-mon[103869]: pgmap v76: 65 pgs: 7 active+undersized+degraded, 7 active+undersized, 51 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22/330 objects degraded (6.667%) 2024-03-12T16:16:39.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:39 smithi006 ceph-mon[103869]: Health check update: Degraded data redundancy: 22/330 objects degraded (6.667%), 7 pgs degraded (PG_DEGRADED) 2024-03-12T16:16:41.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:41 smithi134 ceph-mon[85099]: pgmap v77: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22/330 objects degraded (6.667%) 2024-03-12T16:16:41.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:41 smithi006 ceph-mon[103869]: pgmap v77: 65 pgs: 7 active+undersized+degraded, 5 active+undersized, 53 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 22/330 objects degraded (6.667%) 2024-03-12T16:16:43.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:42 smithi134 ceph-mon[85099]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/330 objects degraded (6.667%), 7 pgs degraded) 2024-03-12T16:16:43.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:42 smithi134 ceph-mon[85099]: Cluster is now healthy 2024-03-12T16:16:43.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:42 smithi006 ceph-mon[103869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 22/330 objects degraded (6.667%), 7 pgs degraded) 2024-03-12T16:16:43.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:42 smithi006 ceph-mon[103869]: Cluster is now healthy 2024-03-12T16:16:44.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:43 smithi134 ceph-mon[85099]: pgmap v78: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:44.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:43 smithi006 ceph-mon[103869]: pgmap v78: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:46.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:45 smithi134 ceph-mon[85099]: pgmap v79: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:46.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:45 smithi006 ceph-mon[103869]: pgmap v79: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:48.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:47 smithi134 ceph-mon[85099]: pgmap v80: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:48.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:48.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:16:48.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:48.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:47 smithi006 ceph-mon[103869]: pgmap v80: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:48.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:48.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:16:48.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:49.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:49 smithi134 ceph-mon[85099]: pgmap v81: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:49.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:49 smithi006 ceph-mon[103869]: pgmap v81: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:51.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:51 smithi006 ceph-mon[103869]: pgmap v82: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:51.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:51 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-12T16:16:51.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:51 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-12T16:16:51.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:51 smithi006 ceph-mon[103869]: Upgrade: osd.2 is safe to restart 2024-03-12T16:16:51.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:51 smithi134 ceph-mon[85099]: pgmap v82: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:51.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:51 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-12T16:16:51.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:51 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["2"], "max": 16}]: dispatch 2024-03-12T16:16:51.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:51 smithi134 ceph-mon[85099]: Upgrade: osd.2 is safe to restart 2024-03-12T16:16:53.698 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:53 smithi006 ceph-mon[103869]: pgmap v83: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:53.698 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:53 smithi006 ceph-mon[103869]: Upgrade: Updating osd.2 2024-03-12T16:16:53.698 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:53.698 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-12T16:16:53.698 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:16:53.698 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:53 smithi006 ceph-mon[103869]: Deploying daemon osd.2 on smithi006 2024-03-12T16:16:53.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:53 smithi134 ceph-mon[85099]: pgmap v83: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:53.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:53 smithi134 ceph-mon[85099]: Upgrade: Updating osd.2 2024-03-12T16:16:53.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:16:53.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-03-12T16:16:53.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:16:53.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:53 smithi134 ceph-mon[85099]: Deploying daemon osd.2 on smithi006 2024-03-12T16:16:55.586 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:55 smithi006 ceph-mon[103869]: pgmap v84: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:55.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:55 smithi134 ceph-mon[85099]: pgmap v84: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:55.957 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:16:55 smithi006 systemd[1]: Stopping Ceph osd.2 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:16:55.958 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:16:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[61865]: debug 2024-03-12T16:16:55.812+0000 7f21baec4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-12T16:16:55.958 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:16:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[61865]: debug 2024-03-12T16:16:55.812+0000 7f21baec4700 -1 osd.2 59 *** Got signal Terminated *** 2024-03-12T16:16:55.958 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:16:55 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[61865]: debug 2024-03-12T16:16:55.812+0000 7f21baec4700 -1 osd.2 59 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:16:56.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:56 smithi134 ceph-mon[85099]: osd.2 marked itself down and dead 2024-03-12T16:16:56.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:56 smithi006 ceph-mon[103869]: osd.2 marked itself down and dead 2024-03-12T16:16:57.457 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:16:57 smithi006 bash[130741]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2 2024-03-12T16:16:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:57 smithi006 ceph-mon[103869]: pgmap v85: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:57 smithi006 ceph-mon[103869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:16:57.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:57 smithi006 ceph-mon[103869]: osdmap e60: 6 total, 5 up, 6 in 2024-03-12T16:16:57.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:57 smithi134 ceph-mon[85099]: pgmap v85: 65 pgs: 65 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail 2024-03-12T16:16:57.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:57 smithi134 ceph-mon[85099]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:16:57.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:57 smithi134 ceph-mon[85099]: osdmap e60: 6 total, 5 up, 6 in 2024-03-12T16:16:58.670 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:58 smithi006 ceph-mon[103869]: osdmap e61: 6 total, 5 up, 6 in 2024-03-12T16:16:58.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:58 smithi134 ceph-mon[85099]: osdmap e61: 6 total, 5 up, 6 in 2024-03-12T16:16:59.279 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:16:59 smithi006 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.2.service: Succeeded. 2024-03-12T16:16:59.279 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:16:59 smithi006 systemd[1]: Stopped Ceph osd.2 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:16:59.279 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:16:59 smithi006 systemd[1]: Starting Ceph osd.2 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:16:59.574 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:59 smithi006 ceph-mon[103869]: pgmap v88: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 15/330 objects degraded (4.545%) 2024-03-12T16:16:59.574 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:16:59 smithi006 ceph-mon[103869]: Health check failed: Degraded data redundancy: 15/330 objects degraded (4.545%), 5 pgs degraded (PG_DEGRADED) 2024-03-12T16:16:59.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:59 smithi134 ceph-mon[85099]: pgmap v88: 65 pgs: 5 active+undersized+degraded, 7 stale+active+clean, 7 active+undersized, 46 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 15/330 objects degraded (4.545%) 2024-03-12T16:16:59.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:16:59 smithi134 ceph-mon[85099]: Health check failed: Degraded data redundancy: 15/330 objects degraded (4.545%), 5 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:00.457 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:00 smithi006 bash[131016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-12T16:17:00.457 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:00 smithi006 bash[131016]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-2 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-12T16:17:00.457 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:00 smithi006 bash[131016]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-12T16:17:00.457 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:00 smithi006 bash[131016]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-12T16:17:00.457 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:00 smithi006 bash[131016]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-2/block 2024-03-12T16:17:00.457 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:00 smithi006 bash[131016]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-03-12T16:17:00.457 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:00 smithi006 bash[131016]: --> ceph-volume raw activate successful for osd ID: 2 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.970+0000 7fe5d5934700 1 -- 172.21.15.6:0/2226675933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f5f80 msgr2=0x7fe5d00f6400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.970+0000 7fe5d5934700 1 --2- 172.21.15.6:0/2226675933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f5f80 0x7fe5d00f6400 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fe5c40047f0 tx=0x7fe5c4009cb0).stop 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.970+0000 7fe5d5934700 1 -- 172.21.15.6:0/2226675933 shutdown_connections 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.970+0000 7fe5d5934700 1 --2- 172.21.15.6:0/2226675933 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f5f80 0x7fe5d00f6400 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.970+0000 7fe5d5934700 1 --2- 172.21.15.6:0/2226675933 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d00f8720 0x7fe5d00f8b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.970+0000 7fe5d5934700 1 -- 172.21.15.6:0/2226675933 >> 172.21.15.6:0/2226675933 conn(0x7fe5d006ce40 msgr2=0x7fe5d006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.970+0000 7fe5d5934700 1 -- 172.21.15.6:0/2226675933 shutdown_connections 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.970+0000 7fe5d5934700 1 -- 172.21.15.6:0/2226675933 wait complete. 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5d5934700 1 Processor -- start 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5d5934700 1 -- start start 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5d5934700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d00f5f80 0x7fe5d006a9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5d5934700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f8720 0x7fe5d0065bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5d5934700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d00661c0 con 0x7fe5d00f8720 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5d5934700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5d0066300 con 0x7fe5d00f5f80 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5ce7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f8720 0x7fe5d0065bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5ce7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f8720 0x7fe5d0065bc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52324/0 (socket says 172.21.15.6:52324) 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5ce7fc700 1 -- 172.21.15.6:0/1800176906 learned_addr learned my addr 172.21.15.6:0/1800176906 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.971+0000 7fe5ceffd700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d00f5f80 0x7fe5d006a9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.972+0000 7fe5ce7fc700 1 -- 172.21.15.6:0/1800176906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d00f5f80 msgr2=0x7fe5d006a9c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.972+0000 7fe5ce7fc700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d00f5f80 0x7fe5d006a9c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.972+0000 7fe5ce7fc700 1 -- 172.21.15.6:0/1800176906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5c4005040 con 0x7fe5d00f8720 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.972+0000 7fe5ce7fc700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f8720 0x7fe5d0065bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe5c4009380 tx=0x7fe5c4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.972+0000 7fe5b7fff700 1 -- 172.21.15.6:0/1800176906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5c4018070 con 0x7fe5d00f8720 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.972+0000 7fe5b7fff700 1 -- 172.21.15.6:0/1800176906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5c4007e90 con 0x7fe5d00f8720 2024-03-12T16:17:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.972+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5d0066550 con 0x7fe5d00f8720 2024-03-12T16:17:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.972+0000 7fe5b7fff700 1 -- 172.21.15.6:0/1800176906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5c40123c0 con 0x7fe5d00f8720 2024-03-12T16:17:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.972+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5d011d030 con 0x7fe5d00f8720 2024-03-12T16:17:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.974+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5d0060670 con 0x7fe5d00f8720 2024-03-12T16:17:00.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.974+0000 7fe5b7fff700 1 -- 172.21.15.6:0/1800176906 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe5c401d420 con 0x7fe5d00f8720 2024-03-12T16:17:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.974+0000 7fe5b7fff700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5b806caa0 0x7fe5b806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.975+0000 7fe5b7fff700 1 -- 172.21.15.6:0/1800176906 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fe5c408c7d0 con 0x7fe5d00f8720 2024-03-12T16:17:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.975+0000 7fe5ceffd700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5b806caa0 0x7fe5b806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:00.978 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.975+0000 7fe5ceffd700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5b806caa0 0x7fe5b806ef60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe5c00048b0 tx=0x7fe5c000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:00.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:00.980+0000 7fe5b7fff700 1 -- 172.21.15.6:0/1800176906 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe5c4056950 con 0x7fe5d00f8720 2024-03-12T16:17:01.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.204+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe5d0067110 con 0x7fe5b806caa0 2024-03-12T16:17:01.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.206+0000 7fe5b7fff700 1 -- 172.21.15.6:0/1800176906 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7fe5d0067110 con 0x7fe5b806caa0 2024-03-12T16:17:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5b806caa0 msgr2=0x7fe5b806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5b806caa0 0x7fe5b806ef60 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 rx=0x7fe5c00048b0 tx=0x7fe5c000b040).stop 2024-03-12T16:17:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f8720 msgr2=0x7fe5d0065bc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f8720 0x7fe5d0065bc0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fe5c4009380 tx=0x7fe5c4009cb0).stop 2024-03-12T16:17:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 shutdown_connections 2024-03-12T16:17:01.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5d00f5f80 0x7fe5d006a9c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5b806caa0 0x7fe5b806ef60 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 --2- 172.21.15.6:0/1800176906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5d00f8720 0x7fe5d0065bc0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 >> 172.21.15.6:0/1800176906 conn(0x7fe5d006ce40 msgr2=0x7fe5d00f4a80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 shutdown_connections 2024-03-12T16:17:01.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.208+0000 7fe5d5934700 1 -- 172.21.15.6:0/1800176906 wait complete. 2024-03-12T16:17:01.220 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:17:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.321+0000 7f95f894a700 1 -- 172.21.15.6:0/446633895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 msgr2=0x7f95f40fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.321+0000 7f95f894a700 1 --2- 172.21.15.6:0/446633895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 0x7f95f40fdcd0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f95e40047f0 tx=0x7f95e4009cb0).stop 2024-03-12T16:17:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.322+0000 7f95f894a700 1 -- 172.21.15.6:0/446633895 shutdown_connections 2024-03-12T16:17:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.322+0000 7f95f894a700 1 --2- 172.21.15.6:0/446633895 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f40fe250 0x7f95f40f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.322+0000 7f95f894a700 1 --2- 172.21.15.6:0/446633895 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 0x7f95f40fdcd0 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.322+0000 7f95f894a700 1 -- 172.21.15.6:0/446633895 >> 172.21.15.6:0/446633895 conn(0x7f95f40f34b0 msgr2=0x7f95f40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:01.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.322+0000 7f95f894a700 1 -- 172.21.15.6:0/446633895 shutdown_connections 2024-03-12T16:17:01.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.322+0000 7f95f894a700 1 -- 172.21.15.6:0/446633895 wait complete. 2024-03-12T16:17:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.322+0000 7f95f894a700 1 Processor -- start 2024-03-12T16:17:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f894a700 1 -- start start 2024-03-12T16:17:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f894a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 0x7f95f4110210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f894a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f40fe250 0x7f95f4110700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f894a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4110d00 con 0x7f95f40fd8f0 2024-03-12T16:17:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f894a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95f4110e40 con 0x7f95f40fe250 2024-03-12T16:17:01.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 0x7f95f4110210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 0x7f95f4110210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52340/0 (socket says 172.21.15.6:52340) 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f259c700 1 -- 172.21.15.6:0/814094568 learned_addr learned my addr 172.21.15.6:0/814094568 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f1d9b700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f40fe250 0x7f95f4110700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f259c700 1 -- 172.21.15.6:0/814094568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f40fe250 msgr2=0x7f95f4110700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f259c700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f40fe250 0x7f95f4110700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f259c700 1 -- 172.21.15.6:0/814094568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e4005040 con 0x7f95f40fd8f0 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f1d9b700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f40fe250 0x7f95f4110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f259c700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 0x7f95f4110210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f95e4005010 tx=0x7f95e4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95e37fe700 1 -- 172.21.15.6:0/814094568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e400e030 con 0x7f95f40fd8f0 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95e37fe700 1 -- 172.21.15.6:0/814094568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f95e4007e90 con 0x7f95f40fd8f0 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95f410a4c0 con 0x7f95f40fd8f0 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.323+0000 7f95e37fe700 1 -- 172.21.15.6:0/814094568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e4018070 con 0x7f95f40fd8f0 2024-03-12T16:17:01.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.324+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95f410aa20 con 0x7f95f40fd8f0 2024-03-12T16:17:01.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.324+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95f405f590 con 0x7f95f40fd8f0 2024-03-12T16:17:01.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.326+0000 7f95e37fe700 1 -- 172.21.15.6:0/814094568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f95e401d6e0 con 0x7f95f40fd8f0 2024-03-12T16:17:01.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.326+0000 7f95e37fe700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95dc06caa0 0x7f95dc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:01.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.326+0000 7f95e37fe700 1 -- 172.21.15.6:0/814094568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f95e408d0f0 con 0x7f95f40fd8f0 2024-03-12T16:17:01.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.326+0000 7f95f1d9b700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95dc06caa0 0x7f95dc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:01.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.327+0000 7f95f1d9b700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95dc06caa0 0x7f95dc06ef60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f95f410bb50 tx=0x7f95e8009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:01.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.330+0000 7f95e37fe700 1 -- 172.21.15.6:0/814094568 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f95e405ae40 con 0x7f95f40fd8f0 2024-03-12T16:17:01.541 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:01 smithi006 ceph-mon[103869]: pgmap v89: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 27/330 objects degraded (8.182%) 2024-03-12T16:17:01.541 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:01 smithi006 ceph-osd[131355]: -- 172.21.15.6:0/3779000485 <== mon.0 v2:172.21.15.6:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55688bdec4e0 con 0x55688bdbd000 2024-03-12T16:17:01.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.546+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f95f40fca30 con 0x7f95dc06caa0 2024-03-12T16:17:01.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.548+0000 7f95e37fe700 1 -- 172.21.15.6:0/814094568 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f95f40fca30 con 0x7f95dc06caa0 2024-03-12T16:17:01.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95dc06caa0 msgr2=0x7f95dc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95dc06caa0 0x7f95dc06ef60 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 rx=0x7f95f410bb50 tx=0x7f95e8009da0).stop 2024-03-12T16:17:01.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 msgr2=0x7f95f4110210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 0x7f95f4110210 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 rx=0x7f95e4005010 tx=0x7f95e4009cb0).stop 2024-03-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 shutdown_connections 2024-03-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95dc06caa0 0x7f95dc06ef60 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95f40fd8f0 0x7f95f4110210 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 --2- 172.21.15.6:0/814094568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95f40fe250 0x7f95f4110700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 >> 172.21.15.6:0/814094568 conn(0x7f95f40f34b0 msgr2=0x7f95f406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 shutdown_connections 2024-03-12T16:17:01.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.550+0000 7f95f894a700 1 -- 172.21.15.6:0/814094568 wait complete. 2024-03-12T16:17:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.655+0000 7fa63a2db700 1 -- 172.21.15.6:0/3662454703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f88a0 msgr2=0x7fa6340f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.655+0000 7fa63a2db700 1 --2- 172.21.15.6:0/3662454703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f88a0 0x7fa6340f8c80 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fa6240047f0 tx=0x7fa624009cb0).stop 2024-03-12T16:17:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.655+0000 7fa63a2db700 1 -- 172.21.15.6:0/3662454703 shutdown_connections 2024-03-12T16:17:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.655+0000 7fa63a2db700 1 --2- 172.21.15.6:0/3662454703 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6340f9200 0x7fa634101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.655+0000 7fa63a2db700 1 --2- 172.21.15.6:0/3662454703 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f88a0 0x7fa6340f8c80 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.655+0000 7fa63a2db700 1 -- 172.21.15.6:0/3662454703 >> 172.21.15.6:0/3662454703 conn(0x7fa634070590 msgr2=0x7fa6340f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.656+0000 7fa63a2db700 1 -- 172.21.15.6:0/3662454703 shutdown_connections 2024-03-12T16:17:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.656+0000 7fa63a2db700 1 -- 172.21.15.6:0/3662454703 wait complete. 2024-03-12T16:17:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.656+0000 7fa63a2db700 1 Processor -- start 2024-03-12T16:17:01.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.656+0000 7fa63a2db700 1 -- start start 2024-03-12T16:17:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.656+0000 7fa63a2db700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6340f88a0 0x7fa63410e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.656+0000 7fa63a2db700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f9200 0x7fa63410e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.656+0000 7fa63a2db700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63410eb10 con 0x7fa6340f9200 2024-03-12T16:17:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.656+0000 7fa63a2db700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa63410ec50 con 0x7fa6340f88a0 2024-03-12T16:17:01.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa62b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f9200 0x7fa63410e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa62b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f9200 0x7fa63410e510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52374/0 (socket says 172.21.15.6:52374) 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa62b7fe700 1 -- 172.21.15.6:0/1183155887 learned_addr learned my addr 172.21.15.6:0/1183155887 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa633fff700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6340f88a0 0x7fa63410e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa62b7fe700 1 -- 172.21.15.6:0/1183155887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6340f88a0 msgr2=0x7fa63410e020 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa62b7fe700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6340f88a0 0x7fa63410e020 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa62b7fe700 1 -- 172.21.15.6:0/1183155887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa624005040 con 0x7fa6340f9200 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa62b7fe700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f9200 0x7fa63410e510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa61c002770 tx=0x7fa61c002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa631f76700 1 -- 172.21.15.6:0/1183155887 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c007b40 con 0x7fa6340f9200 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa631f76700 1 -- 172.21.15.6:0/1183155887 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa61c00f040 con 0x7fa6340f9200 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa6341082e0 con 0x7fa6340f9200 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.657+0000 7fa631f76700 1 -- 172.21.15.6:0/1183155887 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa61c014820 con 0x7fa6340f9200 2024-03-12T16:17:01.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.658+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa634108820 con 0x7fa6340f9200 2024-03-12T16:17:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.659+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa63405f590 con 0x7fa6340f9200 2024-03-12T16:17:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.659+0000 7fa631f76700 1 -- 172.21.15.6:0/1183155887 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa61c014a60 con 0x7fa6340f9200 2024-03-12T16:17:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.659+0000 7fa631f76700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa62006cab0 0x7fa62006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.659+0000 7fa631f76700 1 -- 172.21.15.6:0/1183155887 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fa61c08b840 con 0x7fa6340f9200 2024-03-12T16:17:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.660+0000 7fa633fff700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa62006cab0 0x7fa62006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:01.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.660+0000 7fa633fff700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa62006cab0 0x7fa62006ef70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa624004f10 tx=0x7fa624009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:01.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.664+0000 7fa631f76700 1 -- 172.21.15.6:0/1183155887 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa61c0593d0 con 0x7fa6340f9200 2024-03-12T16:17:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:01 smithi134 ceph-mon[85099]: pgmap v89: 65 pgs: 9 active+undersized+degraded, 4 stale+active+clean, 11 active+undersized, 41 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 27/330 objects degraded (8.182%) 2024-03-12T16:17:01.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.889+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa634108af0 con 0x7fa62006cab0 2024-03-12T16:17:01.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.906+0000 7fa631f76700 1 -- 172.21.15.6:0/1183155887 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa634108af0 con 0x7fa62006cab0 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (3m) 30s ago 14m 26.1M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (95s) 30s ago 14m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (90s) 86s ago 14m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (3m) 30s ago 14m 86.4M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (9m) 30s ago 9m 124M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (9m) 30s ago 9m 15.6M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (9m) 86s ago 9m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (9m) 86s ago 9m 17.8M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (5m) 30s ago 16m 495M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (4m) 86s ago 14m 447M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:17:01.909 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (2m) 30s ago 16m 44.1M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (2m) 86s ago 14m 32.0M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (4m) 30s ago 14m 17.0M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 86s ago 13m 18.1M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (71s) 30s ago 13m 87.3M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (36s) 30s ago 13m 12.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 starting - - - 1911M 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (12m) 86s ago 12m 265M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (11m) 86s ago 11m 235M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (11m) 86s ago 11m 227M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:17:01.910 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 86s ago 13m 60.0M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.908+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa62006cab0 msgr2=0x7fa62006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.908+0000 7fa63a2db700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa62006cab0 0x7fa62006ef70 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 rx=0x7fa624004f10 tx=0x7fa624009cb0).stop 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.908+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f9200 msgr2=0x7fa63410e510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.908+0000 7fa63a2db700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f9200 0x7fa63410e510 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7fa61c002770 tx=0x7fa61c002a80).stop 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.909+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 shutdown_connections 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.909+0000 7fa63a2db700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6340f88a0 0x7fa63410e020 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.909+0000 7fa63a2db700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa62006cab0 0x7fa62006ef70 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.909+0000 7fa63a2db700 1 --2- 172.21.15.6:0/1183155887 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6340f9200 0x7fa63410e510 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.909+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 >> 172.21.15.6:0/1183155887 conn(0x7fa634070590 msgr2=0x7fa6340fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.909+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 shutdown_connections 2024-03-12T16:17:01.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:01.909+0000 7fa63a2db700 1 -- 172.21.15.6:0/1183155887 wait complete. 2024-03-12T16:17:01.952 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:01 smithi006 bash[131292]: 5acba1c8368594a58801aa4df27ff04966442e9677f411b80de4a0425a4ce38d 2024-03-12T16:17:01.952 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:01 smithi006 systemd[1]: Started Ceph osd.2 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:17:01.952 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:01 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[131312]: 2024-03-12T16:17:01.948+0000 7f65b7a86640 -1 Falling back to public interface 2024-03-12T16:17:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.023+0000 7f944bfe4700 1 -- 172.21.15.6:0/2841644499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 msgr2=0x7f94440f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.023+0000 7f944bfe4700 1 --2- 172.21.15.6:0/2841644499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 0x7f94440f8c80 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7f94400047f0 tx=0x7f9440009cb0).stop 2024-03-12T16:17:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.023+0000 7f944bfe4700 1 -- 172.21.15.6:0/2841644499 shutdown_connections 2024-03-12T16:17:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.023+0000 7f944bfe4700 1 --2- 172.21.15.6:0/2841644499 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94440f9200 0x7f9444101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.023+0000 7f944bfe4700 1 --2- 172.21.15.6:0/2841644499 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 0x7f94440f8c80 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.023+0000 7f944bfe4700 1 -- 172.21.15.6:0/2841644499 >> 172.21.15.6:0/2841644499 conn(0x7f9444070590 msgr2=0x7f94440f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.023+0000 7f944bfe4700 1 -- 172.21.15.6:0/2841644499 shutdown_connections 2024-03-12T16:17:02.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.023+0000 7f944bfe4700 1 -- 172.21.15.6:0/2841644499 wait complete. 2024-03-12T16:17:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f944bfe4700 1 Processor -- start 2024-03-12T16:17:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f944bfe4700 1 -- start start 2024-03-12T16:17:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f944bfe4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 0x7f94440f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f944bfe4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94440f9200 0x7f94440f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f944bfe4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440f7230 con 0x7f94440f88a0 2024-03-12T16:17:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f944bfe4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f94440f7370 con 0x7f94440f9200 2024-03-12T16:17:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f9449d80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 0x7f94440f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:02.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f9449d80700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 0x7f94440f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52396/0 (socket says 172.21.15.6:52396) 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f9449d80700 1 -- 172.21.15.6:0/4169128019 learned_addr learned my addr 172.21.15.6:0/4169128019 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f944957f700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94440f9200 0x7f94440f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f9449d80700 1 -- 172.21.15.6:0/4169128019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94440f9200 msgr2=0x7f94440f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f9449d80700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94440f9200 0x7f94440f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.024+0000 7f9449d80700 1 -- 172.21.15.6:0/4169128019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9440005040 con 0x7f94440f88a0 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.025+0000 7f9449d80700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 0x7f94440f6850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f9440009380 tx=0x7f9440009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.025+0000 7f943affd700 1 -- 172.21.15.6:0/4169128019 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9440018070 con 0x7f94440f88a0 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.025+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f94440f75c0 con 0x7f94440f88a0 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.025+0000 7f943affd700 1 -- 172.21.15.6:0/4169128019 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9440007e90 con 0x7f94440f88a0 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.025+0000 7f943affd700 1 -- 172.21.15.6:0/4169128019 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f94400123c0 con 0x7f94440f88a0 2024-03-12T16:17:02.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.025+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9444114740 con 0x7f94440f88a0 2024-03-12T16:17:02.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.026+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f944405f590 con 0x7f94440f88a0 2024-03-12T16:17:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.027+0000 7f943affd700 1 -- 172.21.15.6:0/4169128019 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f944001d420 con 0x7f94440f88a0 2024-03-12T16:17:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.028+0000 7f943affd700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f943006caa0 0x7f943006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.028+0000 7f943affd700 1 -- 172.21.15.6:0/4169128019 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f944008cbe0 con 0x7f94440f88a0 2024-03-12T16:17:02.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.028+0000 7f944957f700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f943006caa0 0x7f943006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:02.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.029+0000 7f944957f700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f943006caa0 0x7f943006ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f94440f7ff0 tx=0x7f943400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:02.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.032+0000 7f943affd700 1 -- 172.21.15.6:0/4169128019 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9440056d60 con 0x7f94440f88a0 2024-03-12T16:17:02.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.319+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9444047540 con 0x7f94440f88a0 2024-03-12T16:17:02.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.320+0000 7f943affd700 1 -- 172.21.15.6:0/4169128019 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f944005a380 con 0x7f94440f88a0 2024-03-12T16:17:02.322 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:17:02.322 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:17:02.322 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 3, 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 7, 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:17:02.323 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:17:02.324 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.322+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f943006caa0 msgr2=0x7f943006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.322+0000 7f944bfe4700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f943006caa0 0x7f943006ef60 secure :-1 s=READY pgs=53 cs=0 l=1 rev1=1 rx=0x7f94440f7ff0 tx=0x7f943400b040).stop 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.323+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 msgr2=0x7f94440f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.323+0000 7f944bfe4700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 0x7f94440f6850 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f9440009380 tx=0x7f9440009cb0).stop 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.323+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 shutdown_connections 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.323+0000 7f944bfe4700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f943006caa0 0x7f943006ef60 unknown :-1 s=CLOSED pgs=53 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.323+0000 7f944bfe4700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94440f88a0 0x7f94440f6850 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.323+0000 7f944bfe4700 1 --2- 172.21.15.6:0/4169128019 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94440f9200 0x7f94440f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.323+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 >> 172.21.15.6:0/4169128019 conn(0x7f9444070590 msgr2=0x7f94440fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.323+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 shutdown_connections 2024-03-12T16:17:02.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.323+0000 7f944bfe4700 1 -- 172.21.15.6:0/4169128019 wait complete. 2024-03-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.428+0000 7f6b7148d700 1 -- 172.21.15.6:0/2332284308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd120 msgr2=0x7f6b6c0f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.428+0000 7f6b7148d700 1 --2- 172.21.15.6:0/2332284308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd120 0x7f6b6c0f7090 secure :-1 s=READY pgs=6 cs=0 l=1 rev1=1 rx=0x7f6b600047f0 tx=0x7f6b60009cb0).stop 2024-03-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.429+0000 7f6b7148d700 1 -- 172.21.15.6:0/2332284308 shutdown_connections 2024-03-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.429+0000 7f6b7148d700 1 --2- 172.21.15.6:0/2332284308 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd120 0x7f6b6c0f7090 unknown :-1 s=CLOSED pgs=6 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.429+0000 7f6b7148d700 1 --2- 172.21.15.6:0/2332284308 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc7c0 0x7f6b6c0fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.429+0000 7f6b7148d700 1 -- 172.21.15.6:0/2332284308 >> 172.21.15.6:0/2332284308 conn(0x7f6b6c06cea0 msgr2=0x7f6b6c06d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.429+0000 7f6b7148d700 1 -- 172.21.15.6:0/2332284308 shutdown_connections 2024-03-12T16:17:02.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.429+0000 7f6b7148d700 1 -- 172.21.15.6:0/2332284308 wait complete. 2024-03-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.429+0000 7f6b7148d700 1 Processor -- start 2024-03-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.429+0000 7f6b7148d700 1 -- start start 2024-03-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b7148d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc7c0 0x7f6b6c109210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b7148d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd120 0x7f6b6c109700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b7148d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c109bf0 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b7148d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c109d30 con 0x7f6b6c0fd120 2024-03-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b6affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc7c0 0x7f6b6c109210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b6affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc7c0 0x7f6b6c109210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55104/0 (socket says 172.21.15.6:55104) 2024-03-12T16:17:02.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b6affd700 1 -- 172.21.15.6:0/994560191 learned_addr learned my addr 172.21.15.6:0/994560191 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:02.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b6a7fc700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd120 0x7f6b6c109700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b6affd700 1 -- 172.21.15.6:0/994560191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd120 msgr2=0x7f6b6c109700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b6affd700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd120 0x7f6b6c109700 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b6affd700 1 -- 172.21.15.6:0/994560191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b60005040 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.430+0000 7f6b6a7fc700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd120 0x7f6b6c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.431+0000 7f6b6affd700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc7c0 0x7f6b6c109210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f6b5c00e8f0 tx=0x7f6b5c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.431+0000 7f6b53fff700 1 -- 172.21.15.6:0/994560191 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5c007b40 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.431+0000 7f6b53fff700 1 -- 172.21.15.6:0/994560191 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b5c00f040 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.431+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c109fe0 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.431+0000 7f6b53fff700 1 -- 172.21.15.6:0/994560191 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b5c014880 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.431+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c1125d0 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.432+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c047540 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.433+0000 7f6b53fff700 1 -- 172.21.15.6:0/994560191 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f6b5c009090 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.434+0000 7f6b53fff700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5406caa0 0x7f6b5406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.434+0000 7f6b53fff700 1 -- 172.21.15.6:0/994560191 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f6b5c08c010 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.434+0000 7f6b6a7fc700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5406caa0 0x7f6b5406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:02.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.434+0000 7f6b6a7fc700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5406caa0 0x7f6b5406ef60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6b6c0f68d0 tx=0x7f6b60009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:02.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.437+0000 7f6b53fff700 1 -- 172.21.15.6:0/994560191 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6b5c056190 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.684+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6b6c0f6700 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.685+0000 7f6b53fff700 1 -- 172.21.15.6:0/994560191 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f6b5c0597b0 con 0x7f6b6c0fc7c0 2024-03-12T16:17:02.687 INFO:teuthology.orchestra.run.smithi006.stdout:e16 2024-03-12T16:17:02.687 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:17:02.687 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 16 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:14:55.638904+0000 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:17:02.688 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:17:02.689 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:17:02.690 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5406caa0 msgr2=0x7f6b5406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5406caa0 0x7f6b5406ef60 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 rx=0x7f6b6c0f68d0 tx=0x7f6b60009cb0).stop 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc7c0 msgr2=0x7f6b6c109210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc7c0 0x7f6b6c109210 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7f6b5c00e8f0 tx=0x7f6b5c00b040).stop 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 shutdown_connections 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5406caa0 0x7f6b5406ef60 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc7c0 0x7f6b6c109210 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 --2- 172.21.15.6:0/994560191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd120 0x7f6b6c109700 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 >> 172.21.15.6:0/994560191 conn(0x7f6b6c06cea0 msgr2=0x7f6b6c0fac30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:02.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 shutdown_connections 2024-03-12T16:17:02.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.687+0000 7f6b7148d700 1 -- 172.21.15.6:0/994560191 wait complete. 2024-03-12T16:17:02.692 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-03-12T16:17:02.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:02 smithi006 ceph-mon[103869]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:02.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:02 smithi006 ceph-mon[103869]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:02.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:02.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:02.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:17:02.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:02.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:17:02.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:02 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/4169128019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:02.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.792+0000 7f54a0972700 1 -- 172.21.15.6:0/2118092580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fd8c0 msgr2=0x7f549c0fdca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.792+0000 7f54a0972700 1 --2- 172.21.15.6:0/2118092580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fd8c0 0x7f549c0fdca0 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f548c009b60 tx=0x7f548c004d10).stop 2024-03-12T16:17:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.792+0000 7f54a0972700 1 -- 172.21.15.6:0/2118092580 shutdown_connections 2024-03-12T16:17:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.792+0000 7f54a0972700 1 --2- 172.21.15.6:0/2118092580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f549c0fe220 0x7f549c0f7a00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.792+0000 7f54a0972700 1 --2- 172.21.15.6:0/2118092580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fd8c0 0x7f549c0fdca0 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.792+0000 7f54a0972700 1 -- 172.21.15.6:0/2118092580 >> 172.21.15.6:0/2118092580 conn(0x7f549c0f34a0 msgr2=0x7f549c0f58c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:02.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.792+0000 7f54a0972700 1 -- 172.21.15.6:0/2118092580 shutdown_connections 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.792+0000 7f54a0972700 1 -- 172.21.15.6:0/2118092580 wait complete. 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.793+0000 7f54a0972700 1 Processor -- start 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.793+0000 7f54a0972700 1 -- start start 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.793+0000 7f54a0972700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f549c0fd8c0 0x7f549c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.793+0000 7f54a0972700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fe220 0x7f549c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.793+0000 7f54a0972700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c10eae0 con 0x7f549c0fe220 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.793+0000 7f54a0972700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f549c10ec20 con 0x7f549c0fd8c0 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.793+0000 7f5499d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fe220 0x7f549c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.793+0000 7f5499d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fe220 0x7f549c10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55126/0 (socket says 172.21.15.6:55126) 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f5499d9b700 1 -- 172.21.15.6:0/3900210973 learned_addr learned my addr 172.21.15.6:0/3900210973 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f549a59c700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f549c0fd8c0 0x7f549c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f5499d9b700 1 -- 172.21.15.6:0/3900210973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f549c0fd8c0 msgr2=0x7f549c10dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f5499d9b700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f549c0fd8c0 0x7f549c10dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f5499d9b700 1 -- 172.21.15.6:0/3900210973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f548c0097c0 con 0x7f549c0fe220 2024-03-12T16:17:02.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f549a59c700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f549c0fd8c0 0x7f549c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:17:02.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f5499d9b700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fe220 0x7f549c10e4e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5490002780 tx=0x7f5490009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:02.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f548b7fe700 1 -- 172.21.15.6:0/3900210973 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5490007b40 con 0x7f549c0fe220 2024-03-12T16:17:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f548b7fe700 1 -- 172.21.15.6:0/3900210973 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f549000f040 con 0x7f549c0fe220 2024-03-12T16:17:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f549c1082b0 con 0x7f549c0fe220 2024-03-12T16:17:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f548b7fe700 1 -- 172.21.15.6:0/3900210973 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5490014780 con 0x7f549c0fe220 2024-03-12T16:17:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.794+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f549c108870 con 0x7f549c0fe220 2024-03-12T16:17:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.795+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f549c060390 con 0x7f549c0fe220 2024-03-12T16:17:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.796+0000 7f548b7fe700 1 -- 172.21.15.6:0/3900210973 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5490007ca0 con 0x7f549c0fe220 2024-03-12T16:17:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.796+0000 7f548b7fe700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f548406cab0 0x7f548406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:02.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.796+0000 7f548b7fe700 1 -- 172.21.15.6:0/3900210973 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f549008bc70 con 0x7f549c0fe220 2024-03-12T16:17:02.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.796+0000 7f549a59c700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f548406cab0 0x7f548406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:02.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.797+0000 7f549a59c700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f548406cab0 0x7f548406ef70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f548c004a60 tx=0x7f548c004d10).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:02.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:02.801+0000 7f548b7fe700 1 -- 172.21.15.6:0/3900210973 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5490059880 con 0x7f549c0fe220 2024-03-12T16:17:02.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:02 smithi134 ceph-mon[85099]: from='client.34248 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:02.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:02 smithi134 ceph-mon[85099]: from='client.34252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:17:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:17:02.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:02 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/4169128019' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:03.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.028+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f549c108af0 con 0x7f548406cab0 2024-03-12T16:17:03.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.029+0000 7f548b7fe700 1 -- 172.21.15.6:0/3900210973 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f549c108af0 con 0x7f548406cab0 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "crash" 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "8/21 daemons upgraded", 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading osd daemons", 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:17:03.032 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.031+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f548406cab0 msgr2=0x7f548406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.031+0000 7f54a0972700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f548406cab0 0x7f548406ef70 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 rx=0x7f548c004a60 tx=0x7f548c004d10).stop 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.032+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fe220 msgr2=0x7f549c10e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.032+0000 7f54a0972700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fe220 0x7f549c10e4e0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5490002780 tx=0x7f5490009ee0).stop 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.032+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 shutdown_connections 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.032+0000 7f54a0972700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f549c0fd8c0 0x7f549c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.032+0000 7f54a0972700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f548406cab0 0x7f548406ef70 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.032+0000 7f54a0972700 1 --2- 172.21.15.6:0/3900210973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f549c0fe220 0x7f549c10e4e0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.032+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 >> 172.21.15.6:0/3900210973 conn(0x7f549c0f34a0 msgr2=0x7f549c0fbc80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.032+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 shutdown_connections 2024-03-12T16:17:03.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.032+0000 7f54a0972700 1 -- 172.21.15.6:0/3900210973 wait complete. 2024-03-12T16:17:03.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.135+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/1421312765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 msgr2=0x7f8f180f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.135+0000 7f8f1cb6d700 1 --2- 172.21.15.6:0/1421312765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 0x7f8f180f6930 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f8f000047f0 tx=0x7f8f00009cb0).stop 2024-03-12T16:17:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.135+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/1421312765 shutdown_connections 2024-03-12T16:17:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.135+0000 7f8f1cb6d700 1 --2- 172.21.15.6:0/1421312765 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 0x7f8f180f6930 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.135+0000 7f8f1cb6d700 1 --2- 172.21.15.6:0/1421312765 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f180fc7f0 0x7f8f180fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.135+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/1421312765 >> 172.21.15.6:0/1421312765 conn(0x7f8f18070590 msgr2=0x7f8f180f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.135+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/1421312765 shutdown_connections 2024-03-12T16:17:03.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.135+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/1421312765 wait complete. 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.136+0000 7f8f1cb6d700 1 Processor -- start 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.136+0000 7f8f1cb6d700 1 -- start start 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.136+0000 7f8f1cb6d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f180fc7f0 0x7f8f1810e0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.136+0000 7f8f1cb6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 0x7f8f1810e5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.136+0000 7f8f1cb6d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1810ebb0 con 0x7f8f180fd150 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.136+0000 7f8f1cb6d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8f1810ecf0 con 0x7f8f180fc7f0 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.136+0000 7f8f15d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 0x7f8f1810e5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f15d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 0x7f8f1810e5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55144/0 (socket says 172.21.15.6:55144) 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f15d9b700 1 -- 172.21.15.6:0/2489500568 learned_addr learned my addr 172.21.15.6:0/2489500568 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f1659c700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f180fc7f0 0x7f8f1810e0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f15d9b700 1 -- 172.21.15.6:0/2489500568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f180fc7f0 msgr2=0x7f8f1810e0c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:03.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f15d9b700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f180fc7f0 0x7f8f1810e0c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f15d9b700 1 -- 172.21.15.6:0/2489500568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8f00005040 con 0x7f8f180fd150 2024-03-12T16:17:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f1659c700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f180fc7f0 0x7f8f1810e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:17:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f15d9b700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 0x7f8f1810e5b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f8f00000c00 tx=0x7f8f00009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f0f7fe700 1 -- 172.21.15.6:0/2489500568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f00018070 con 0x7f8f180fd150 2024-03-12T16:17:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f0f7fe700 1 -- 172.21.15.6:0/2489500568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8f00007e90 con 0x7f8f180fd150 2024-03-12T16:17:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8f18108360 con 0x7f8f180fd150 2024-03-12T16:17:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f0f7fe700 1 -- 172.21.15.6:0/2489500568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8f000123c0 con 0x7f8f180fd150 2024-03-12T16:17:03.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.137+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8f181088c0 con 0x7f8f180fd150 2024-03-12T16:17:03.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.138+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8f1805f590 con 0x7f8f180fd150 2024-03-12T16:17:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.139+0000 7f8f0f7fe700 1 -- 172.21.15.6:0/2489500568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8f00012680 con 0x7f8f180fd150 2024-03-12T16:17:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.139+0000 7f8f0f7fe700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8f0406caa0 0x7f8f0406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.139+0000 7f8f0f7fe700 1 -- 172.21.15.6:0/2489500568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(61..61 src has 1..61) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f8f0008c930 con 0x7f8f180fd150 2024-03-12T16:17:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.139+0000 7f8f1659c700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8f0406caa0 0x7f8f0406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:03.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.140+0000 7f8f1659c700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8f0406caa0 0x7f8f0406ef60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8f08007fd0 tx=0x7f8f0800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:03.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.144+0000 7f8f0f7fe700 1 -- 172.21.15.6:0/2489500568 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8f00056ab0 con 0x7f8f180fd150 2024-03-12T16:17:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.432+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8f18047540 con 0x7f8f180fd150 2024-03-12T16:17:03.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.432+0000 7f8f0f7fe700 1 -- 172.21.15.6:0/2489500568 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+941 (secure 0 0 0) 0x7f8f0005a0d0 con 0x7f8f180fd150 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 40/330 objects degraded (12.121%), 12 pgs degraded 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] OSD_DOWN: 1 osds down 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: osd.2 (root=default,host=smithi006) is down 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 40/330 objects degraded (12.121%), 12 pgs degraded 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1 is active+undersized+degraded, acting [1,0] 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.3 is active+undersized+degraded, acting [5,1] 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.7 is active+undersized+degraded, acting [3,4] 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.d is active+undersized+degraded, acting [1,3] 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.e is active+undersized+degraded, acting [0,3] 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.10 is active+undersized+degraded, acting [1,0] 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.13 is active+undersized+degraded, acting [0,4] 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.16 is active+undersized+degraded, acting [5,3] 2024-03-12T16:17:03.435 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.17 is active+undersized+degraded, acting [5,1] 2024-03-12T16:17:03.436 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.19 is active+undersized+degraded, acting [0,4] 2024-03-12T16:17:03.436 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1c is active+undersized+degraded, acting [4,5] 2024-03-12T16:17:03.436 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1e is active+undersized+degraded, acting [0,5] 2024-03-12T16:17:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8f0406caa0 msgr2=0x7f8f0406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:03.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8f0406caa0 0x7f8f0406ef60 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 rx=0x7f8f08007fd0 tx=0x7f8f0800b040).stop 2024-03-12T16:17:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 msgr2=0x7f8f1810e5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 0x7f8f1810e5b0 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7f8f00000c00 tx=0x7f8f00009cb0).stop 2024-03-12T16:17:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 shutdown_connections 2024-03-12T16:17:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8f180fc7f0 0x7f8f1810e0c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8f0406caa0 0x7f8f0406ef60 unknown :-1 s=CLOSED pgs=56 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 --2- 172.21.15.6:0/2489500568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8f180fd150 0x7f8f1810e5b0 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 >> 172.21.15.6:0/2489500568 conn(0x7f8f18070590 msgr2=0x7f8f18060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.434+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 shutdown_connections 2024-03-12T16:17:03.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:03.435+0000 7f8f1cb6d700 1 -- 172.21.15.6:0/2489500568 wait complete. 2024-03-12T16:17:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:03 smithi134 ceph-mon[85099]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:03 smithi134 ceph-mon[85099]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:03.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:03 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/994560191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:17:03.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:03 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2489500568' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:17:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:03 smithi006 ceph-mon[103869]: pgmap v90: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:03 smithi006 ceph-mon[103869]: from='client.34258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:03 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/994560191' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:17:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:03 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2489500568' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:17:04.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:04 smithi134 ceph-mon[85099]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:04.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:04 smithi006 ceph-mon[103869]: from='client.34270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:05.891 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:05 smithi006 ceph-mon[103869]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:05.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:05 smithi134 ceph-mon[85099]: pgmap v91: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:07.587 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:07 smithi006 ceph-mon[103869]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:07.587 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:07.587 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:07.587 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:07.587 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:07.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:07 smithi134 ceph-mon[85099]: pgmap v92: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:07.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:07.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:07.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:07.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:08.698 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:08 smithi006 ceph-mon[103869]: Health check update: Degraded data redundancy: 40/330 objects degraded (12.121%), 12 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:08.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:08 smithi134 ceph-mon[85099]: Health check update: Degraded data redundancy: 40/330 objects degraded (12.121%), 12 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:08.957 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:08 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[131312]: 2024-03-12T16:17:08.716+0000 7f65b7a86640 -1 osd.2 0 read_superblock omap replica is missing. 2024-03-12T16:17:09.345 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[131312]: 2024-03-12T16:17:09.122+0000 7f65b7a86640 -1 osd.2 59 log_to_monitors true 2024-03-12T16:17:09.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:09 smithi134 ceph-mon[85099]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:09.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:09 smithi134 ceph-mon[85099]: from='osd.2 [v2:172.21.15.6:6818/1248094022,v1:172.21.15.6:6819/1248094022]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-12T16:17:09.707 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:17:09 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[131312]: 2024-03-12T16:17:09.355+0000 7f65a7edd700 -1 osd.2 59 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:17:09.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:09 smithi006 ceph-mon[103869]: pgmap v93: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 2.0 GiB used, 534 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:09.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:09 smithi006 ceph-mon[103869]: from='osd.2 [v2:172.21.15.6:6818/1248094022,v1:172.21.15.6:6819/1248094022]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-03-12T16:17:10.640 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:10 smithi006 ceph-mon[103869]: from='osd.2 [v2:172.21.15.6:6818/1248094022,v1:172.21.15.6:6819/1248094022]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-12T16:17:10.640 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:10 smithi006 ceph-mon[103869]: osdmap e62: 6 total, 5 up, 6 in 2024-03-12T16:17:10.640 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:10 smithi006 ceph-mon[103869]: from='osd.2 [v2:172.21.15.6:6818/1248094022,v1:172.21.15.6:6819/1248094022]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:17:10.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:10 smithi134 ceph-mon[85099]: from='osd.2 [v2:172.21.15.6:6818/1248094022,v1:172.21.15.6:6819/1248094022]' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-03-12T16:17:10.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:10 smithi134 ceph-mon[85099]: osdmap e62: 6 total, 5 up, 6 in 2024-03-12T16:17:10.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:10 smithi134 ceph-mon[85099]: from='osd.2 [v2:172.21.15.6:6818/1248094022,v1:172.21.15.6:6819/1248094022]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi006", "root=default"]}]: dispatch 2024-03-12T16:17:11.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:11.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:17:11.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: osd.2 [v2:172.21.15.6:6818/1248094022,v1:172.21.15.6:6819/1248094022] boot 2024-03-12T16:17:11.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: osdmap e63: 6 total, 6 up, 6 in 2024-03-12T16:17:11.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:17:11.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:11.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:11.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:17:11.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:17:11.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:11.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:17:11.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:11.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:11.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:11.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-12T16:17:11.705 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:11 smithi134 ceph-mon[85099]: osdmap e64: 6 total, 6 up, 6 in 2024-03-12T16:17:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: pgmap v95: 65 pgs: 12 active+undersized+degraded, 15 active+undersized, 38 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 40/330 objects degraded (12.121%) 2024-03-12T16:17:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:17:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: osd.2 [v2:172.21.15.6:6818/1248094022,v1:172.21.15.6:6819/1248094022] boot 2024-03-12T16:17:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: osdmap e63: 6 total, 6 up, 6 in 2024-03-12T16:17:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-03-12T16:17:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:11.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:17:11.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:17:11.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:11.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:17:11.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:11.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:11.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:11.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-12T16:17:11.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:11 smithi006 ceph-mon[103869]: osdmap e64: 6 total, 6 up, 6 in 2024-03-12T16:17:12.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:12 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-12T16:17:12.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:12 smithi134 ceph-mon[85099]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-12T16:17:12.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:12 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-12T16:17:12.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:12 smithi006 ceph-mon[103869]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-12T16:17:13.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:13 smithi134 ceph-mon[85099]: pgmap v98: 65 pgs: 3 peering, 11 active+undersized+degraded, 13 active+undersized, 38 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 37/330 objects degraded (11.212%) 2024-03-12T16:17:13.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:13 smithi134 ceph-mon[85099]: Health check update: Degraded data redundancy: 37/330 objects degraded (11.212%), 11 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:13.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:13 smithi006 ceph-mon[103869]: pgmap v98: 65 pgs: 3 peering, 11 active+undersized+degraded, 13 active+undersized, 38 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 37/330 objects degraded (11.212%) 2024-03-12T16:17:13.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:13 smithi006 ceph-mon[103869]: Health check update: Degraded data redundancy: 37/330 objects degraded (11.212%), 11 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:15 smithi134 ceph-mon[85099]: pgmap v99: 65 pgs: 3 peering, 4 active+undersized+degraded, 5 active+undersized, 53 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 14/330 objects degraded (4.242%) 2024-03-12T16:17:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:15 smithi006 ceph-mon[103869]: pgmap v99: 65 pgs: 3 peering, 4 active+undersized+degraded, 5 active+undersized, 53 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 14/330 objects degraded (4.242%) 2024-03-12T16:17:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:16 smithi134 ceph-mon[85099]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/330 objects degraded (4.242%), 4 pgs degraded) 2024-03-12T16:17:16.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:16 smithi134 ceph-mon[85099]: Cluster is now healthy 2024-03-12T16:17:16.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:16 smithi006 ceph-mon[103869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 14/330 objects degraded (4.242%), 4 pgs degraded) 2024-03-12T16:17:16.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:16 smithi006 ceph-mon[103869]: Cluster is now healthy 2024-03-12T16:17:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:17 smithi134 ceph-mon[85099]: pgmap v100: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:17:17.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:17 smithi006 ceph-mon[103869]: pgmap v100: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:17.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:17.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:17:19.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:19 smithi134 ceph-mon[85099]: pgmap v101: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:19 smithi006 ceph-mon[103869]: pgmap v101: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:21.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:21 smithi134 ceph-mon[85099]: pgmap v102: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:21.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:21 smithi006 ceph-mon[103869]: pgmap v102: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:23.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:22 smithi134 ceph-mon[85099]: pgmap v103: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:23.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:22 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:23.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:22 smithi006 ceph-mon[103869]: pgmap v103: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:23.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:22 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:25.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:25 smithi134 ceph-mon[85099]: pgmap v104: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:25.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:25 smithi006 ceph-mon[103869]: pgmap v104: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:26.616 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:26 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-12T16:17:26.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:26 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-12T16:17:27.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:27 smithi134 ceph-mon[85099]: pgmap v105: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:27.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:27 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-12T16:17:27.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:27 smithi134 ceph-mon[85099]: Upgrade: osd.3 is safe to restart 2024-03-12T16:17:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:27 smithi006 ceph-mon[103869]: pgmap v105: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:27 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["3"], "max": 16}]: dispatch 2024-03-12T16:17:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:27 smithi006 ceph-mon[103869]: Upgrade: osd.3 is safe to restart 2024-03-12T16:17:28.468 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:28 smithi134 ceph-mon[85099]: Upgrade: Updating osd.3 2024-03-12T16:17:28.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:28 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:28.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:28 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-12T16:17:28.469 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:28 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:17:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:28 smithi006 ceph-mon[103869]: Upgrade: Updating osd.3 2024-03-12T16:17:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:28 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:28 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-03-12T16:17:28.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:28 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:17:29.699 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:29 smithi134 ceph-mon[85099]: Deploying daemon osd.3 on smithi134 2024-03-12T16:17:29.767 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:29 smithi134 ceph-mon[85099]: pgmap v106: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:29.768 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:29 smithi006 ceph-mon[103869]: Deploying daemon osd.3 on smithi134 2024-03-12T16:17:29.768 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:29 smithi006 ceph-mon[103869]: pgmap v106: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:31.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:31 smithi134 ceph-mon[85099]: pgmap v107: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:31.454 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:31 smithi134 systemd[1]: Stopping Ceph osd.3 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:17:31.454 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[48189]: debug 2024-03-12T16:17:31.416+0000 7f22e6fcd700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-12T16:17:31.454 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[48189]: debug 2024-03-12T16:17:31.416+0000 7f22e6fcd700 -1 osd.3 64 *** Got signal Terminated *** 2024-03-12T16:17:31.454 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:31 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[48189]: debug 2024-03-12T16:17:31.416+0000 7f22e6fcd700 -1 osd.3 64 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:17:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:31 smithi006 ceph-mon[103869]: pgmap v107: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:32.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:32 smithi134 ceph-mon[85099]: osd.3 marked itself down and dead 2024-03-12T16:17:32.649 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:17:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:32 smithi006 ceph-mon[103869]: osd.3 marked itself down and dead 2024-03-12T16:17:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:17:32.953 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:32 smithi134 bash[97644]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3 2024-03-12T16:17:33.516 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:33 smithi134 ceph-mon[85099]: pgmap v108: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:33.516 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:33 smithi134 ceph-mon[85099]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:17:33.516 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:33 smithi134 ceph-mon[85099]: osdmap e65: 6 total, 5 up, 6 in 2024-03-12T16:17:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.553+0000 7f5078702700 1 -- 172.21.15.6:0/377501049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 msgr2=0x7f50700f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.553+0000 7f5078702700 1 --2- 172.21.15.6:0/377501049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 0x7f50700f7a50 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7f50640047f0 tx=0x7f5064009cb0).stop 2024-03-12T16:17:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.553+0000 7f5078702700 1 -- 172.21.15.6:0/377501049 shutdown_connections 2024-03-12T16:17:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.553+0000 7f5078702700 1 --2- 172.21.15.6:0/377501049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 0x7f50700f7a50 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.553+0000 7f5078702700 1 --2- 172.21.15.6:0/377501049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50700fd910 0x7f50700fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:33.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.553+0000 7f5078702700 1 -- 172.21.15.6:0/377501049 >> 172.21.15.6:0/377501049 conn(0x7f50700f3530 msgr2=0x7f50700f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:33.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.554+0000 7f5078702700 1 -- 172.21.15.6:0/377501049 shutdown_connections 2024-03-12T16:17:33.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.554+0000 7f5078702700 1 -- 172.21.15.6:0/377501049 wait complete. 2024-03-12T16:17:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.554+0000 7f5078702700 1 Processor -- start 2024-03-12T16:17:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5078702700 1 -- start start 2024-03-12T16:17:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5078702700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50700fd910 0x7f507010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:33.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5078702700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 0x7f507010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5078702700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507010eab0 con 0x7f50700fe270 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5078702700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f507010ebf0 con 0x7f50700fd910 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5075c9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 0x7f507010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5075c9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 0x7f507010e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34652/0 (socket says 172.21.15.6:34652) 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5075c9d700 1 -- 172.21.15.6:0/2105782568 learned_addr learned my addr 172.21.15.6:0/2105782568 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f507649e700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50700fd910 0x7f507010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5075c9d700 1 -- 172.21.15.6:0/2105782568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50700fd910 msgr2=0x7f507010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5075c9d700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50700fd910 0x7f507010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5075c9d700 1 -- 172.21.15.6:0/2105782568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5064005040 con 0x7f50700fe270 2024-03-12T16:17:33.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.555+0000 7f5075c9d700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 0x7f507010e4b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f50640099f0 tx=0x7f5064009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:33.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.556+0000 7f50637fe700 1 -- 172.21.15.6:0/2105782568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f506400e030 con 0x7f50700fe270 2024-03-12T16:17:33.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.556+0000 7f50637fe700 1 -- 172.21.15.6:0/2105782568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5064007e90 con 0x7f50700fe270 2024-03-12T16:17:33.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.556+0000 7f50637fe700 1 -- 172.21.15.6:0/2105782568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5064018070 con 0x7f50700fe270 2024-03-12T16:17:33.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.556+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5070108220 con 0x7f50700fe270 2024-03-12T16:17:33.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.556+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5070108780 con 0x7f50700fe270 2024-03-12T16:17:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.557+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f507005f570 con 0x7f50700fe270 2024-03-12T16:17:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.557+0000 7f50637fe700 1 -- 172.21.15.6:0/2105782568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f506401d420 con 0x7f50700fe270 2024-03-12T16:17:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.558+0000 7f50637fe700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f505c06caa0 0x7f505c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.558+0000 7f50637fe700 1 -- 172.21.15.6:0/2105782568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f506408d100 con 0x7f50700fe270 2024-03-12T16:17:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.558+0000 7f507649e700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f505c06caa0 0x7f505c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:33.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.558+0000 7f507649e700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f505c06caa0 0x7f505c06ef60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f506c0041d0 tx=0x7f506c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:33.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.563+0000 7f50637fe700 1 -- 172.21.15.6:0/2105782568 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f506405ad10 con 0x7f50700fe270 2024-03-12T16:17:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:33 smithi006 ceph-mon[103869]: pgmap v108: 65 pgs: 65 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:33 smithi006 ceph-mon[103869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:17:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:33 smithi006 ceph-mon[103869]: osdmap e65: 6 total, 5 up, 6 in 2024-03-12T16:17:33.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.781+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f50700ffc60 con 0x7f505c06caa0 2024-03-12T16:17:33.783 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.782+0000 7f50637fe700 1 -- 172.21.15.6:0/2105782568 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f50700ffc60 con 0x7f505c06caa0 2024-03-12T16:17:33.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f505c06caa0 msgr2=0x7f505c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:33.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f505c06caa0 0x7f505c06ef60 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 rx=0x7f506c0041d0 tx=0x7f506c009040).stop 2024-03-12T16:17:33.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 msgr2=0x7f507010e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 0x7f507010e4b0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f50640099f0 tx=0x7f5064009cb0).stop 2024-03-12T16:17:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 shutdown_connections 2024-03-12T16:17:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50700fd910 0x7f507010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f505c06caa0 0x7f505c06ef60 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 --2- 172.21.15.6:0/2105782568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50700fe270 0x7f507010e4b0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 >> 172.21.15.6:0/2105782568 conn(0x7f50700f3530 msgr2=0x7f50700fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 shutdown_connections 2024-03-12T16:17:33.786 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.784+0000 7f5078702700 1 -- 172.21.15.6:0/2105782568 wait complete. 2024-03-12T16:17:33.796 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:17:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.887+0000 7f14bc72e700 1 -- 172.21.15.6:0/1845798476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fd910 msgr2=0x7f14b40fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.887+0000 7f14bc72e700 1 --2- 172.21.15.6:0/1845798476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fd910 0x7f14b40fdcf0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f14b00047f0 tx=0x7f14b0009cb0).stop 2024-03-12T16:17:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.887+0000 7f14bc72e700 1 -- 172.21.15.6:0/1845798476 shutdown_connections 2024-03-12T16:17:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.887+0000 7f14bc72e700 1 --2- 172.21.15.6:0/1845798476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b40fe270 0x7f14b40f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.887+0000 7f14bc72e700 1 --2- 172.21.15.6:0/1845798476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fd910 0x7f14b40fdcf0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:33.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.887+0000 7f14bc72e700 1 -- 172.21.15.6:0/1845798476 >> 172.21.15.6:0/1845798476 conn(0x7f14b40f3510 msgr2=0x7f14b40f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.887+0000 7f14bc72e700 1 -- 172.21.15.6:0/1845798476 shutdown_connections 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.887+0000 7f14bc72e700 1 -- 172.21.15.6:0/1845798476 wait complete. 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14bc72e700 1 Processor -- start 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14bc72e700 1 -- start start 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14bc72e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b40fd910 0x7f14b41101c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14bc72e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fe270 0x7f14b41106b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14bc72e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4110cb0 con 0x7f14b40fe270 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14bc72e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14b4110df0 con 0x7f14b40fd910 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14b9cc9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fe270 0x7f14b41106b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14b9cc9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fe270 0x7f14b41106b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34672/0 (socket says 172.21.15.6:34672) 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14b9cc9700 1 -- 172.21.15.6:0/3289576896 learned_addr learned my addr 172.21.15.6:0/3289576896 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.888+0000 7f14ba4ca700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b40fd910 0x7f14b41101c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.889+0000 7f14b9cc9700 1 -- 172.21.15.6:0/3289576896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b40fd910 msgr2=0x7f14b41101c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:33.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.889+0000 7f14b9cc9700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b40fd910 0x7f14b41101c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.889+0000 7f14b9cc9700 1 -- 172.21.15.6:0/3289576896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14b0005040 con 0x7f14b40fe270 2024-03-12T16:17:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.889+0000 7f14b9cc9700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fe270 0x7f14b41106b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f14a800c710 tx=0x7f14a8007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.889+0000 7f14a77fe700 1 -- 172.21.15.6:0/3289576896 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a800e680 con 0x7f14b40fe270 2024-03-12T16:17:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.889+0000 7f14a77fe700 1 -- 172.21.15.6:0/3289576896 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14a800ec90 con 0x7f14b40fe270 2024-03-12T16:17:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.889+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14b410a480 con 0x7f14b40fe270 2024-03-12T16:17:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.889+0000 7f14a77fe700 1 -- 172.21.15.6:0/3289576896 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14a8013d40 con 0x7f14b40fe270 2024-03-12T16:17:33.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.889+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14b410aa40 con 0x7f14b40fe270 2024-03-12T16:17:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.890+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14b4060650 con 0x7f14b40fe270 2024-03-12T16:17:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.890+0000 7f14a77fe700 1 -- 172.21.15.6:0/3289576896 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f14a800e7e0 con 0x7f14b40fe270 2024-03-12T16:17:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.891+0000 7f14a77fe700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14a006caa0 0x7f14a006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.891+0000 7f14ba4ca700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14a006caa0 0x7f14a006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.891+0000 7f14a77fe700 1 -- 172.21.15.6:0/3289576896 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f14a808b9e0 con 0x7f14b40fe270 2024-03-12T16:17:33.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.891+0000 7f14ba4ca700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14a006caa0 0x7f14a006ef60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f14b0007cf0 tx=0x7f14b000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:33.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:33.895+0000 7f14a77fe700 1 -- 172.21.15.6:0/3289576896 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f14a80595f0 con 0x7f14b40fe270 2024-03-12T16:17:34.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.113+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f14b410acb0 con 0x7f14a006caa0 2024-03-12T16:17:34.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.114+0000 7f14a77fe700 1 -- 172.21.15.6:0/3289576896 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f14b410acb0 con 0x7f14a006caa0 2024-03-12T16:17:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14a006caa0 msgr2=0x7f14a006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14a006caa0 0x7f14a006ef60 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 rx=0x7f14b0007cf0 tx=0x7f14b000b040).stop 2024-03-12T16:17:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fe270 msgr2=0x7f14b41106b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fe270 0x7f14b41106b0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f14a800c710 tx=0x7f14a8007ec0).stop 2024-03-12T16:17:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 shutdown_connections 2024-03-12T16:17:34.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14b40fd910 0x7f14b41101c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14a006caa0 0x7f14a006ef60 unknown :-1 s=CLOSED pgs=59 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 --2- 172.21.15.6:0/3289576896 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14b40fe270 0x7f14b41106b0 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 >> 172.21.15.6:0/3289576896 conn(0x7f14b40f3510 msgr2=0x7f14b406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 shutdown_connections 2024-03-12T16:17:34.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.116+0000 7f14bc72e700 1 -- 172.21.15.6:0/3289576896 wait complete. 2024-03-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.218+0000 7fd970dd5700 1 -- 172.21.15.6:0/1751563102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fe250 msgr2=0x7fd96c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.218+0000 7fd970dd5700 1 --2- 172.21.15.6:0/1751563102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fe250 0x7fd96c0f7a30 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7fd95c0047f0 tx=0x7fd95c009cb0).stop 2024-03-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.218+0000 7fd970dd5700 1 -- 172.21.15.6:0/1751563102 shutdown_connections 2024-03-12T16:17:34.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.218+0000 7fd970dd5700 1 --2- 172.21.15.6:0/1751563102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fe250 0x7fd96c0f7a30 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.218+0000 7fd970dd5700 1 --2- 172.21.15.6:0/1751563102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd96c0fd8f0 0x7fd96c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.218+0000 7fd970dd5700 1 -- 172.21.15.6:0/1751563102 >> 172.21.15.6:0/1751563102 conn(0x7fd96c0f34b0 msgr2=0x7fd96c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.218+0000 7fd970dd5700 1 -- 172.21.15.6:0/1751563102 shutdown_connections 2024-03-12T16:17:34.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.218+0000 7fd970dd5700 1 -- 172.21.15.6:0/1751563102 wait complete. 2024-03-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd970dd5700 1 Processor -- start 2024-03-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd970dd5700 1 -- start start 2024-03-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd970dd5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fd8f0 0x7fd96c10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd970dd5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd96c0fe250 0x7fd96c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd970dd5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c10eb70 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd970dd5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd96c10ecb0 con 0x7fd96c0fe250 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd96a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fd8f0 0x7fd96c10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd96a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fd8f0 0x7fd96c10e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34692/0 (socket says 172.21.15.6:34692) 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd96a59c700 1 -- 172.21.15.6:0/3216951799 learned_addr learned my addr 172.21.15.6:0/3216951799 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd969d9b700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd96c0fe250 0x7fd96c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd96a59c700 1 -- 172.21.15.6:0/3216951799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd96c0fe250 msgr2=0x7fd96c10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.219+0000 7fd96a59c700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd96c0fe250 0x7fd96c10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.220+0000 7fd96a59c700 1 -- 172.21.15.6:0/3216951799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd95c005040 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.220+0000 7fd96a59c700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fd8f0 0x7fd96c10e080 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fd960002770 tx=0x7fd960002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.220+0000 7fd95b7fe700 1 -- 172.21.15.6:0/3216951799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd960007b40 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.220+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd96c108340 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.220+0000 7fd95b7fe700 1 -- 172.21.15.6:0/3216951799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd96000f040 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.220+0000 7fd95b7fe700 1 -- 172.21.15.6:0/3216951799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd960014820 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.220+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd96c108880 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.221+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd96c05f590 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.221+0000 7fd95b7fe700 1 -- 172.21.15.6:0/3216951799 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd960007ca0 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.222+0000 7fd95b7fe700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd95406caa0 0x7fd95406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.222+0000 7fd95b7fe700 1 -- 172.21.15.6:0/3216951799 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fd96008b8d0 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.222+0000 7fd969d9b700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd95406caa0 0x7fd95406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:34.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.223+0000 7fd969d9b700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd95406caa0 0x7fd95406ef60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd96c1099c0 tx=0x7fd95c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:34.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.227+0000 7fd95b7fe700 1 -- 172.21.15.6:0/3216951799 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd9600594e0 con 0x7fd96c0fd8f0 2024-03-12T16:17:34.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.433+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd96c108b00 con 0x7fd95406caa0 2024-03-12T16:17:34.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.443+0000 7fd95b7fe700 1 -- 172.21.15.6:0/3216951799 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fd96c108b00 con 0x7fd95406caa0 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (4m) 28s ago 15m 26.2M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (2m) 28s ago 15m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (2m) 118s ago 14m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (4m) 28s ago 15m 89.5M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (10m) 28s ago 10m 124M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (10m) 28s ago 10m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (10m) 118s ago 10m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (10m) 118s ago 10m 17.8M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (5m) 28s ago 16m 500M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (5m) 118s ago 14m 447M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (3m) 28s ago 16m 46.0M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:17:34.445 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (2m) 118s ago 14m 32.0M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:17:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (4m) 28s ago 15m 17.2M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:17:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (4m) 118s ago 14m 18.1M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:17:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (103s) 28s ago 14m 88.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:17:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (69s) 28s ago 13m 92.1M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:17:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (33s) 28s ago 13m 13.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:17:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (12m) 118s ago 12m 265M 2251M 16.2.15-1-g8963e9de 727f386679cb 780c42ef9265 2024-03-12T16:17:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (12m) 118s ago 12m 235M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:17:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (11m) 118s ago 11m 227M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:17:34.446 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (4m) 118s ago 13m 60.0M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.445+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd95406caa0 msgr2=0x7fd95406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.445+0000 7fd970dd5700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd95406caa0 0x7fd95406ef60 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 rx=0x7fd96c1099c0 tx=0x7fd95c00b040).stop 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.445+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fd8f0 msgr2=0x7fd96c10e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.445+0000 7fd970dd5700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fd8f0 0x7fd96c10e080 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7fd960002770 tx=0x7fd960002a80).stop 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.446+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 shutdown_connections 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.446+0000 7fd970dd5700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd95406caa0 0x7fd95406ef60 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.446+0000 7fd970dd5700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd96c0fd8f0 0x7fd96c10e080 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.446+0000 7fd970dd5700 1 --2- 172.21.15.6:0/3216951799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd96c0fe250 0x7fd96c10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.446+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 >> 172.21.15.6:0/3216951799 conn(0x7fd96c0f34b0 msgr2=0x7fd96c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.446+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 shutdown_connections 2024-03-12T16:17:34.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.446+0000 7fd970dd5700 1 -- 172.21.15.6:0/3216951799 wait complete. 2024-03-12T16:17:34.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.546+0000 7f409e876700 1 -- 172.21.15.6:0/4003566938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fd150 msgr2=0x7f40980f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.546+0000 7f409e876700 1 --2- 172.21.15.6:0/4003566938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fd150 0x7f40980f6930 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7f408c0047f0 tx=0x7f408c009cb0).stop 2024-03-12T16:17:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.546+0000 7f409e876700 1 -- 172.21.15.6:0/4003566938 shutdown_connections 2024-03-12T16:17:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.546+0000 7f409e876700 1 --2- 172.21.15.6:0/4003566938 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fd150 0x7f40980f6930 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.546+0000 7f409e876700 1 --2- 172.21.15.6:0/4003566938 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40980fc7f0 0x7f40980fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.546+0000 7f409e876700 1 -- 172.21.15.6:0/4003566938 >> 172.21.15.6:0/4003566938 conn(0x7f4098070590 msgr2=0x7f40980f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.546+0000 7f409e876700 1 -- 172.21.15.6:0/4003566938 shutdown_connections 2024-03-12T16:17:34.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.546+0000 7f409e876700 1 -- 172.21.15.6:0/4003566938 wait complete. 2024-03-12T16:17:34.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.547+0000 7f409e876700 1 Processor -- start 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.547+0000 7f409e876700 1 -- start start 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.547+0000 7f409e876700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fc7f0 0x7f40980f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.547+0000 7f409e876700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40980fd150 0x7f40980f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.547+0000 7f409e876700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40980f8f20 con 0x7f40980fc7f0 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.547+0000 7f409e876700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40980f9060 con 0x7f40980fd150 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.547+0000 7f4097fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fc7f0 0x7f40980f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.547+0000 7f4097fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fc7f0 0x7f40980f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34704/0 (socket says 172.21.15.6:34704) 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.547+0000 7f4097fff700 1 -- 172.21.15.6:0/2350316335 learned_addr learned my addr 172.21.15.6:0/2350316335 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f40977fe700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40980fd150 0x7f40980f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f4097fff700 1 -- 172.21.15.6:0/2350316335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40980fd150 msgr2=0x7f40980f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f4097fff700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40980fd150 0x7f40980f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f4097fff700 1 -- 172.21.15.6:0/2350316335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f408c005040 con 0x7f40980fc7f0 2024-03-12T16:17:34.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f4097fff700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fc7f0 0x7f40980f8540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f408800c790 tx=0x7f4088004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f40957fa700 1 -- 172.21.15.6:0/2350316335 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f408800e680 con 0x7f40980fc7f0 2024-03-12T16:17:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f40957fa700 1 -- 172.21.15.6:0/2350316335 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f408800ec90 con 0x7f40980fc7f0 2024-03-12T16:17:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f40957fa700 1 -- 172.21.15.6:0/2350316335 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4088012d60 con 0x7f40980fc7f0 2024-03-12T16:17:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40980f9310 con 0x7f40980fc7f0 2024-03-12T16:17:34.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.548+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40981146a0 con 0x7f40980fc7f0 2024-03-12T16:17:34.551 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:34 smithi134 ceph-mon[85099]: osdmap e66: 6 total, 5 up, 6 in 2024-03-12T16:17:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.549+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f409805f590 con 0x7f40980fc7f0 2024-03-12T16:17:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.550+0000 7f40957fa700 1 -- 172.21.15.6:0/2350316335 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f4088012400 con 0x7f40980fc7f0 2024-03-12T16:17:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.550+0000 7f40957fa700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f408006caa0 0x7f408006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.550+0000 7f40957fa700 1 -- 172.21.15.6:0/2350316335 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f408808b5a0 con 0x7f40980fc7f0 2024-03-12T16:17:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.550+0000 7f40977fe700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f408006caa0 0x7f408006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:34.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.551+0000 7f40977fe700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f408006caa0 0x7f408006ef60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f40980f9ce0 tx=0x7f408c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:34.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.554+0000 7f40957fa700 1 -- 172.21.15.6:0/2350316335 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4088055720 con 0x7f40980fc7f0 2024-03-12T16:17:34.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:34 smithi006 ceph-mon[103869]: osdmap e66: 6 total, 5 up, 6 in 2024-03-12T16:17:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.834+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f40980f9b30 con 0x7f40980fc7f0 2024-03-12T16:17:34.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.834+0000 7f40957fa700 1 -- 172.21.15.6:0/2350316335 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f4088058d40 con 0x7f40980fc7f0 2024-03-12T16:17:34.835 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 2, 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 3 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:17:34.836 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:17:34.837 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 6, 2024-03-12T16:17:34.837 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 7 2024-03-12T16:17:34.837 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:17:34.837 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:17:34.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f408006caa0 msgr2=0x7f408006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f408006caa0 0x7f408006ef60 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 rx=0x7f40980f9ce0 tx=0x7f408c00b040).stop 2024-03-12T16:17:34.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fc7f0 msgr2=0x7f40980f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fc7f0 0x7f40980f8540 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7f408800c790 tx=0x7f4088004330).stop 2024-03-12T16:17:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 shutdown_connections 2024-03-12T16:17:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f408006caa0 0x7f408006ef60 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40980fc7f0 0x7f40980f8540 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 --2- 172.21.15.6:0/2350316335 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40980fd150 0x7f40980f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 >> 172.21.15.6:0/2350316335 conn(0x7f4098070590 msgr2=0x7f4098060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 shutdown_connections 2024-03-12T16:17:34.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.836+0000 7f409e876700 1 -- 172.21.15.6:0/2350316335 wait complete. 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.938+0000 7fd4f968d700 1 -- 172.21.15.6:0/2029115377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fc7f0 msgr2=0x7fd4f40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.938+0000 7fd4f968d700 1 --2- 172.21.15.6:0/2029115377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fc7f0 0x7fd4f40fcbd0 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7fd4e40047f0 tx=0x7fd4e4009cb0).stop 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.938+0000 7fd4f968d700 1 -- 172.21.15.6:0/2029115377 shutdown_connections 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.938+0000 7fd4f968d700 1 --2- 172.21.15.6:0/2029115377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4f40fd150 0x7fd4f40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.938+0000 7fd4f968d700 1 --2- 172.21.15.6:0/2029115377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fc7f0 0x7fd4f40fcbd0 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.938+0000 7fd4f968d700 1 -- 172.21.15.6:0/2029115377 >> 172.21.15.6:0/2029115377 conn(0x7fd4f40f23b0 msgr2=0x7fd4f40f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.938+0000 7fd4f968d700 1 -- 172.21.15.6:0/2029115377 shutdown_connections 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.938+0000 7fd4f968d700 1 -- 172.21.15.6:0/2029115377 wait complete. 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.939+0000 7fd4f968d700 1 Processor -- start 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.939+0000 7fd4f968d700 1 -- start start 2024-03-12T16:17:34.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.939+0000 7fd4f968d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4f40fc7f0 0x7fd4f40f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.939+0000 7fd4f968d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fd150 0x7fd4f40f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.939+0000 7fd4f968d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40f8f20 con 0x7fd4f40fd150 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.939+0000 7fd4f968d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd4f40f9060 con 0x7fd4f40fc7f0 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.939+0000 7fd4f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fd150 0x7fd4f40f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.939+0000 7fd4f27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fd150 0x7fd4f40f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34722/0 (socket says 172.21.15.6:34722) 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4f27fc700 1 -- 172.21.15.6:0/1402152416 learned_addr learned my addr 172.21.15.6:0/1402152416 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4f40fc7f0 0x7fd4f40f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4f27fc700 1 -- 172.21.15.6:0/1402152416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4f40fc7f0 msgr2=0x7fd4f40f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4f40fc7f0 0x7fd4f40f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4f27fc700 1 -- 172.21.15.6:0/1402152416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd4e4005040 con 0x7fd4f40fd150 2024-03-12T16:17:34.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4f27fc700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fd150 0x7fd4f40f8a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fd4e800e8c0 tx=0x7fd4e800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4dbfff700 1 -- 172.21.15.6:0/1402152416 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4e8007b40 con 0x7fd4f40fd150 2024-03-12T16:17:34.943 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4dbfff700 1 -- 172.21.15.6:0/1402152416 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd4e800f040 con 0x7fd4f40fd150 2024-03-12T16:17:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd4f40f9310 con 0x7fd4f40fd150 2024-03-12T16:17:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4dbfff700 1 -- 172.21.15.6:0/1402152416 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4e8014830 con 0x7fd4f40fd150 2024-03-12T16:17:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.940+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4f4114810 con 0x7fd4f40fd150 2024-03-12T16:17:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.941+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd4f4060370 con 0x7fd4f40fd150 2024-03-12T16:17:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.941+0000 7fd4dbfff700 1 -- 172.21.15.6:0/1402152416 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd4e8014aa0 con 0x7fd4f40fd150 2024-03-12T16:17:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.942+0000 7fd4dbfff700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd4dc06cab0 0x7fd4dc06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.942+0000 7fd4dbfff700 1 -- 172.21.15.6:0/1402152416 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fd4e808b6a0 con 0x7fd4f40fd150 2024-03-12T16:17:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.942+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd4dc06cab0 0x7fd4dc06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:34.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.942+0000 7fd4f2ffd700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd4dc06cab0 0x7fd4dc06ef70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd4e4004540 tx=0x7fd4e4009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:34.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:34.946+0000 7fd4dbfff700 1 -- 172.21.15.6:0/1402152416 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd4e8055820 con 0x7fd4f40fd150 2024-03-12T16:17:34.953 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:34 smithi134 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.3.service: Succeeded. 2024-03-12T16:17:34.953 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:34 smithi134 systemd[1]: Stopped Ceph osd.3 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:17:34.954 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:34 smithi134 systemd[1]: Starting Ceph osd.3 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.191+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd4f40f9af0 con 0x7fd4f40fd150 2024-03-12T16:17:35.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.191+0000 7fd4dbfff700 1 -- 172.21.15.6:0/1402152416 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7fd4e8058e40 con 0x7fd4f40fd150 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:e16 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 16 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:14:55.638904+0000 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:17:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:17:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:17:35.195 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd4dc06cab0 msgr2=0x7fd4dc06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd4dc06cab0 0x7fd4dc06ef70 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 rx=0x7fd4e4004540 tx=0x7fd4e4009cb0).stop 2024-03-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fd150 msgr2=0x7fd4f40f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fd150 0x7fd4f40f8a30 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7fd4e800e8c0 tx=0x7fd4e800b040).stop 2024-03-12T16:17:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 shutdown_connections 2024-03-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4f40fc7f0 0x7fd4f40f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd4dc06cab0 0x7fd4dc06ef70 unknown :-1 s=CLOSED pgs=62 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 --2- 172.21.15.6:0/1402152416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4f40fd150 0x7fd4f40f8a30 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 >> 172.21.15.6:0/1402152416 conn(0x7fd4f40f23b0 msgr2=0x7fd4f4061360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 shutdown_connections 2024-03-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.193+0000 7fd4f968d700 1 -- 172.21.15.6:0/1402152416 wait complete. 2024-03-12T16:17:35.197 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-03-12T16:17:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.298+0000 7f3207ade700 1 -- 172.21.15.6:0/2147360605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 msgr2=0x7f32000f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.298+0000 7f3207ade700 1 --2- 172.21.15.6:0/2147360605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 0x7f32000f8c80 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f31f00047f0 tx=0x7f31f0009cb0).stop 2024-03-12T16:17:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.298+0000 7f3207ade700 1 -- 172.21.15.6:0/2147360605 shutdown_connections 2024-03-12T16:17:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.298+0000 7f3207ade700 1 --2- 172.21.15.6:0/2147360605 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000f9200 0x7f3200101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.298+0000 7f3207ade700 1 --2- 172.21.15.6:0/2147360605 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 0x7f32000f8c80 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.298+0000 7f3207ade700 1 -- 172.21.15.6:0/2147360605 >> 172.21.15.6:0/2147360605 conn(0x7f3200070590 msgr2=0x7f32000f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.298+0000 7f3207ade700 1 -- 172.21.15.6:0/2147360605 shutdown_connections 2024-03-12T16:17:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.298+0000 7f3207ade700 1 -- 172.21.15.6:0/2147360605 wait complete. 2024-03-12T16:17:35.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f3207ade700 1 Processor -- start 2024-03-12T16:17:35.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f3207ade700 1 -- start start 2024-03-12T16:17:35.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f3207ade700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 0x7f32000f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f3207ade700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000f9200 0x7f32000f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f3207ade700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32000f7230 con 0x7f32000f88a0 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f3207ade700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f32000f7370 con 0x7f32000f9200 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f320587a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 0x7f32000f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f320587a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 0x7f32000f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34742/0 (socket says 172.21.15.6:34742) 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f320587a700 1 -- 172.21.15.6:0/2692715266 learned_addr learned my addr 172.21.15.6:0/2692715266 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f3205079700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000f9200 0x7f32000f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f320587a700 1 -- 172.21.15.6:0/2692715266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000f9200 msgr2=0x7f32000f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f320587a700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000f9200 0x7f32000f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.299+0000 7f320587a700 1 -- 172.21.15.6:0/2692715266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f31f0005040 con 0x7f32000f88a0 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.300+0000 7f320587a700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 0x7f32000f6850 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f31f0009380 tx=0x7f31f0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.300+0000 7f31f6f78700 1 -- 172.21.15.6:0/2692715266 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31f0018070 con 0x7f32000f88a0 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.300+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f32000f75c0 con 0x7f32000f88a0 2024-03-12T16:17:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.300+0000 7f31f6f78700 1 -- 172.21.15.6:0/2692715266 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f31f0007e90 con 0x7f32000f88a0 2024-03-12T16:17:35.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.300+0000 7f31f6f78700 1 -- 172.21.15.6:0/2692715266 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f31f00123c0 con 0x7f32000f88a0 2024-03-12T16:17:35.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.300+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3200114740 con 0x7f32000f88a0 2024-03-12T16:17:35.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.301+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f320005f590 con 0x7f32000f88a0 2024-03-12T16:17:35.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.301+0000 7f31f6f78700 1 -- 172.21.15.6:0/2692715266 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f31f001d420 con 0x7f32000f88a0 2024-03-12T16:17:35.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.302+0000 7f31f6f78700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f31ec06caa0 0x7f31ec06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:35.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.302+0000 7f31f6f78700 1 -- 172.21.15.6:0/2692715266 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f31f008c870 con 0x7f32000f88a0 2024-03-12T16:17:35.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.302+0000 7f3205079700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f31ec06caa0 0x7f31ec06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:35.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.302+0000 7f3205079700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f31ec06caa0 0x7f31ec06ef60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f32000f7ff0 tx=0x7f31fc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:35.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.306+0000 7f31f6f78700 1 -- 172.21.15.6:0/2692715266 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f31f00569f0 con 0x7f32000f88a0 2024-03-12T16:17:35.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:35 smithi134 ceph-mon[85099]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:35.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:35 smithi134 ceph-mon[85099]: pgmap v111: 65 pgs: 25 peering, 3 stale+active+clean, 37 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:35.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:35 smithi134 ceph-mon[85099]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:35.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:35 smithi134 ceph-mon[85099]: Health check failed: Reduced data availability: 13 pgs peering (PG_AVAILABILITY) 2024-03-12T16:17:35.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:35 smithi134 ceph-mon[85099]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:35.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:35 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2350316335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:35.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:35 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1402152416' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:17:35.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.523+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3200059120 con 0x7f31ec06caa0 2024-03-12T16:17:35.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.524+0000 7f31f6f78700 1 -- 172.21.15.6:0/2692715266 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+400 (secure 0 0 0) 0x7f3200059120 con 0x7f31ec06caa0 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "crash" 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "9/21 daemons upgraded", 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading osd daemons", 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:17:35.526 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f31ec06caa0 msgr2=0x7f31ec06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f31ec06caa0 0x7f31ec06ef60 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 rx=0x7f32000f7ff0 tx=0x7f31fc00b040).stop 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 msgr2=0x7f32000f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 0x7f32000f6850 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f31f0009380 tx=0x7f31f0009cb0).stop 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 shutdown_connections 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f31ec06caa0 0x7f31ec06ef60 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f32000f88a0 0x7f32000f6850 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 --2- 172.21.15.6:0/2692715266 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f32000f9200 0x7f32000f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 >> 172.21.15.6:0/2692715266 conn(0x7f3200070590 msgr2=0x7f32000fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 shutdown_connections 2024-03-12T16:17:35.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.527+0000 7f3207ade700 1 -- 172.21.15.6:0/2692715266 wait complete. 2024-03-12T16:17:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.628+0000 7f0d59279700 1 -- 172.21.15.6:0/1903014510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 msgr2=0x7f0d540fde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.628+0000 7f0d59279700 1 --2- 172.21.15.6:0/1903014510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 0x7f0d540fde30 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f0d440047f0 tx=0x7f0d44009cb0).stop 2024-03-12T16:17:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.628+0000 7f0d59279700 1 -- 172.21.15.6:0/1903014510 shutdown_connections 2024-03-12T16:17:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.628+0000 7f0d59279700 1 --2- 172.21.15.6:0/1903014510 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d540fe3b0 0x7f0d540f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.628+0000 7f0d59279700 1 --2- 172.21.15.6:0/1903014510 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 0x7f0d540fde30 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.628+0000 7f0d59279700 1 -- 172.21.15.6:0/1903014510 >> 172.21.15.6:0/1903014510 conn(0x7f0d5406ce50 msgr2=0x7f0d5406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.628+0000 7f0d59279700 1 -- 172.21.15.6:0/1903014510 shutdown_connections 2024-03-12T16:17:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.628+0000 7f0d59279700 1 -- 172.21.15.6:0/1903014510 wait complete. 2024-03-12T16:17:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.629+0000 7f0d59279700 1 Processor -- start 2024-03-12T16:17:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.629+0000 7f0d59279700 1 -- start start 2024-03-12T16:17:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.629+0000 7f0d59279700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 0x7f0d5410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.629+0000 7f0d59279700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d540fe3b0 0x7f0d5410e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.629+0000 7f0d59279700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5410eb30 con 0x7f0d540fda50 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.629+0000 7f0d59279700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d5410ec70 con 0x7f0d540fe3b0 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.629+0000 7f0d52ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 0x7f0d5410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d527fc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d540fe3b0 0x7f0d5410e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d52ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 0x7f0d5410e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34774/0 (socket says 172.21.15.6:34774) 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d52ffd700 1 -- 172.21.15.6:0/3658361477 learned_addr learned my addr 172.21.15.6:0/3658361477 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d52ffd700 1 -- 172.21.15.6:0/3658361477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d540fe3b0 msgr2=0x7f0d5410e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d52ffd700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d540fe3b0 0x7f0d5410e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d52ffd700 1 -- 172.21.15.6:0/3658361477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d44005040 con 0x7f0d540fda50 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d527fc700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d540fe3b0 0x7f0d5410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d52ffd700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 0x7f0d5410e040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0d44005010 tx=0x7f0d44009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d3bfff700 1 -- 172.21.15.6:0/3658361477 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d4400e030 con 0x7f0d540fda50 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d541082a0 con 0x7f0d540fda50 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d3bfff700 1 -- 172.21.15.6:0/3658361477 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d44007e90 con 0x7f0d540fda50 2024-03-12T16:17:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d3bfff700 1 -- 172.21.15.6:0/3658361477 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d44018070 con 0x7f0d540fda50 2024-03-12T16:17:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.630+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d54108780 con 0x7f0d540fda50 2024-03-12T16:17:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.631+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d54047540 con 0x7f0d540fda50 2024-03-12T16:17:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.632+0000 7f0d3bfff700 1 -- 172.21.15.6:0/3658361477 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f0d4401d670 con 0x7f0d540fda50 2024-03-12T16:17:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.632+0000 7f0d3bfff700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d3c06caa0 0x7f0d3c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:17:35.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.632+0000 7f0d3bfff700 1 -- 172.21.15.6:0/3658361477 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(66..66 src has 1..66) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f0d4408cf60 con 0x7f0d540fda50 2024-03-12T16:17:35.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.632+0000 7f0d527fc700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d3c06caa0 0x7f0d3c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:17:35.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.633+0000 7f0d527fc700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d3c06caa0 0x7f0d3c06ef60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0d54109980 tx=0x7f0d4800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:17:35.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.637+0000 7f0d3bfff700 1 -- 172.21.15.6:0/3658361477 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0d440c0190 con 0x7f0d540fda50 2024-03-12T16:17:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:35 smithi006 ceph-mon[103869]: from='client.34280 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:35 smithi006 ceph-mon[103869]: pgmap v111: 65 pgs: 25 peering, 3 stale+active+clean, 37 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:35 smithi006 ceph-mon[103869]: from='client.34284 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:35 smithi006 ceph-mon[103869]: Health check failed: Reduced data availability: 13 pgs peering (PG_AVAILABILITY) 2024-03-12T16:17:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:35 smithi006 ceph-mon[103869]: from='client.34288 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:35 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2350316335' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:35 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1402152416' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:17:35.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.918+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0d541096c0 con 0x7f0d540fda50 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.919+0000 7f0d3bfff700 1 -- 172.21.15.6:0/3658361477 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+1217 (secure 0 0 0) 0x7f0d4405a8e0 con 0x7f0d540fda50 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_WARN 1 osds down; Reduced data availability: 13 pgs peering 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] OSD_DOWN: 1 osds down 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stdout: osd.3 (root=default,host=smithi134) is down 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] PG_AVAILABILITY: Reduced data availability: 13 pgs peering 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stdout: pg 1.0 is stuck peering for 2m, current state peering, last acting [0,1] 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.5 is stuck peering for 5m, current state peering, last acting [0,4] 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.7 is stuck peering for 5m, current state peering, last acting [4,2] 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.8 is stuck peering for 6m, current state peering, last acting [5,0] 2024-03-12T16:17:35.920 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.b is stuck peering for 5m, current state peering, last acting [4,5] 2024-03-12T16:17:35.921 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.14 is stuck peering for 93s, current state peering, last acting [4,5] 2024-03-12T16:17:35.921 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1a is stuck peering for 5m, current state peering, last acting [4,5] 2024-03-12T16:17:35.921 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1d is stuck peering for 5m, current state peering, last acting [5,0] 2024-03-12T16:17:35.921 INFO:teuthology.orchestra.run.smithi006.stdout: pg 3.a is stuck peering for 5m, current state peering, last acting [4,1] 2024-03-12T16:17:35.921 INFO:teuthology.orchestra.run.smithi006.stdout: pg 3.11 is stuck peering for 5m, current state peering, last acting [4,0] 2024-03-12T16:17:35.921 INFO:teuthology.orchestra.run.smithi006.stdout: pg 3.13 is stuck peering for 5m, current state peering, last acting [5,2] 2024-03-12T16:17:35.921 INFO:teuthology.orchestra.run.smithi006.stdout: pg 3.14 is stuck peering for 5m, current state peering, last acting [4,5] 2024-03-12T16:17:35.921 INFO:teuthology.orchestra.run.smithi006.stdout: pg 3.15 is stuck peering for 5m, current state peering, last acting [0,4] 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.920+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d3c06caa0 msgr2=0x7f0d3c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.920+0000 7f0d59279700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d3c06caa0 0x7f0d3c06ef60 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 rx=0x7f0d54109980 tx=0x7f0d4800b040).stop 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.920+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 msgr2=0x7f0d5410e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.920+0000 7f0d59279700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 0x7f0d5410e040 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f0d44005010 tx=0x7f0d44009cb0).stop 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.921+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 shutdown_connections 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.921+0000 7f0d59279700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d3c06caa0 0x7f0d3c06ef60 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.921+0000 7f0d59279700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d540fda50 0x7f0d5410e040 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.921+0000 7f0d59279700 1 --2- 172.21.15.6:0/3658361477 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d540fe3b0 0x7f0d5410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.921+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 >> 172.21.15.6:0/3658361477 conn(0x7f0d5406ce50 msgr2=0x7f0d54101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.921+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 shutdown_connections 2024-03-12T16:17:35.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:17:35.921+0000 7f0d59279700 1 -- 172.21.15.6:0/3658361477 wait complete. 2024-03-12T16:17:35.953 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:35 smithi134 bash[97915]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-12T16:17:35.953 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:35 smithi134 bash[97915]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-3 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-03-12T16:17:35.954 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:35 smithi134 bash[97915]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-03-12T16:17:35.954 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:35 smithi134 bash[97915]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-03-12T16:17:35.954 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:35 smithi134 bash[97915]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-3/block 2024-03-12T16:17:35.954 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:35 smithi134 bash[97915]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-03-12T16:17:35.954 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:35 smithi134 bash[97915]: --> ceph-volume raw activate successful for osd ID: 3 2024-03-12T16:17:36.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:36 smithi134 ceph-mon[85099]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:36.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:36 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3658361477' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:17:36.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:36 smithi006 ceph-mon[103869]: from='client.34300 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:17:36.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:36 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3658361477' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:17:37.203 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:36 smithi134 ceph-osd[98239]: -- 172.21.15.134:0/4197469019 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5643e677e4e0 con 0x5643e674f000 2024-03-12T16:17:37.203 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:37 smithi134 bash[98202]: 705cb952fee40eb82a5ecc056b2626d0a8e62e8c40493cdc1a175a5a999a3066 2024-03-12T16:17:37.203 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:37 smithi134 systemd[1]: Started Ceph osd.3 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:17:37.703 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:37 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[98216]: 2024-03-12T16:17:37.467+0000 7ffb5b031640 -1 Falling back to public interface 2024-03-12T16:17:37.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:37 smithi134 ceph-mon[85099]: pgmap v112: 65 pgs: 7 active+undersized+degraded, 25 peering, 6 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 22/330 objects degraded (6.667%) 2024-03-12T16:17:37.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:37 smithi134 ceph-mon[85099]: Health check failed: Degraded data redundancy: 22/330 objects degraded (6.667%), 7 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:37.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:37 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:37.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:37 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:37.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:37 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:17:37.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:37 smithi006 ceph-mon[103869]: pgmap v112: 65 pgs: 7 active+undersized+degraded, 25 peering, 6 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 22/330 objects degraded (6.667%) 2024-03-12T16:17:37.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:37 smithi006 ceph-mon[103869]: Health check failed: Degraded data redundancy: 22/330 objects degraded (6.667%), 7 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:37.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:37 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:37.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:37 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:37.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:37 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:17:39.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:39 smithi134 ceph-mon[85099]: pgmap v113: 65 pgs: 16 active+undersized+degraded, 7 peering, 15 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 61/330 objects degraded (18.485%) 2024-03-12T16:17:39.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:39 smithi006 ceph-mon[103869]: pgmap v113: 65 pgs: 16 active+undersized+degraded, 7 peering, 15 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 61/330 objects degraded (18.485%) 2024-03-12T16:17:40.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:40 smithi134 ceph-mon[85099]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-03-12T16:17:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:40 smithi006 ceph-mon[103869]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 3 pgs peering) 2024-03-12T16:17:41.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:41 smithi134 ceph-mon[85099]: pgmap v114: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:41.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:41.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:41 smithi006 ceph-mon[103869]: pgmap v114: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:42.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:42 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:42.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:42 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:42.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:42 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:42.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:42 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:43.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:43 smithi134 ceph-mon[85099]: pgmap v115: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:43.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:43 smithi134 ceph-mon[85099]: Health check update: Degraded data redundancy: 68/330 objects degraded (20.606%), 19 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:43.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:43 smithi006 ceph-mon[103869]: pgmap v115: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:43.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:43 smithi006 ceph-mon[103869]: Health check update: Degraded data redundancy: 68/330 objects degraded (20.606%), 19 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:45.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:45 smithi134 ceph-mon[85099]: pgmap v116: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:45.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:45.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:45.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:17:45.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:17:45.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:45.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:45 smithi006 ceph-mon[103869]: pgmap v116: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:45.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:45.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:45.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:17:45.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:17:45.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:46.615 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[98216]: 2024-03-12T16:17:46.214+0000 7ffb5b031640 -1 osd.3 0 read_superblock omap replica is missing. 2024-03-12T16:17:46.953 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:46 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[98216]: 2024-03-12T16:17:46.744+0000 7ffb5b031640 -1 osd.3 64 log_to_monitors true 2024-03-12T16:17:46.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:46 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:17:46.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:46 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:46.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:46 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:46.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:46 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:46.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:46 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-12T16:17:46.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:46 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-12T16:17:46.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:46 smithi134 ceph-mon[85099]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-03-12T16:17:46.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:46 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:17:46.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:46 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:46.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:46 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:46.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:46 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:17:46.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:46 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-12T16:17:46.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:46 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-12T16:17:46.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:46 smithi006 ceph-mon[103869]: Upgrade: unsafe to stop osd(s) at this time (18 PGs are or would become offline) 2024-03-12T16:17:47.953 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:17:47 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[98216]: 2024-03-12T16:17:47.647+0000 7ffb4a486700 -1 osd.3 64 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:17:47.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:47 smithi134 ceph-mon[85099]: pgmap v117: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:47.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:47 smithi134 ceph-mon[85099]: from='osd.3 [v2:172.21.15.134:6800/3039719923,v1:172.21.15.134:6801/3039719923]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-12T16:17:47.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:47 smithi134 ceph-mon[85099]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-12T16:17:47.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:47.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:17:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:47 smithi006 ceph-mon[103869]: pgmap v117: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.8 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:47 smithi006 ceph-mon[103869]: from='osd.3 [v2:172.21.15.134:6800/3039719923,v1:172.21.15.134:6801/3039719923]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-12T16:17:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:47 smithi006 ceph-mon[103869]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-03-12T16:17:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:17:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:17:48.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:48 smithi134 ceph-mon[85099]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-12T16:17:48.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:48 smithi134 ceph-mon[85099]: osdmap e67: 6 total, 5 up, 6 in 2024-03-12T16:17:48.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:48 smithi134 ceph-mon[85099]: from='osd.3 [v2:172.21.15.134:6800/3039719923,v1:172.21.15.134:6801/3039719923]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:17:48.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:48 smithi134 ceph-mon[85099]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:17:48.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:48 smithi006 ceph-mon[103869]: from='osd.3 ' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-03-12T16:17:48.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:48 smithi006 ceph-mon[103869]: osdmap e67: 6 total, 5 up, 6 in 2024-03-12T16:17:48.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:48 smithi006 ceph-mon[103869]: from='osd.3 [v2:172.21.15.134:6800/3039719923,v1:172.21.15.134:6801/3039719923]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:17:48.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:48 smithi006 ceph-mon[103869]: from='osd.3 ' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:17:49.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:49 smithi134 ceph-mon[85099]: pgmap v119: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:49.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:49 smithi134 ceph-mon[85099]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:17:49.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:49 smithi134 ceph-mon[85099]: osd.3 [v2:172.21.15.134:6800/3039719923,v1:172.21.15.134:6801/3039719923] boot 2024-03-12T16:17:49.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:49 smithi134 ceph-mon[85099]: osdmap e68: 6 total, 6 up, 6 in 2024-03-12T16:17:49.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:49 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:17:49.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:49 smithi134 ceph-mon[85099]: osdmap e69: 6 total, 6 up, 6 in 2024-03-12T16:17:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:49 smithi006 ceph-mon[103869]: pgmap v119: 65 pgs: 19 active+undersized+degraded, 19 active+undersized, 27 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 68/330 objects degraded (20.606%) 2024-03-12T16:17:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:49 smithi006 ceph-mon[103869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:17:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:49 smithi006 ceph-mon[103869]: osd.3 [v2:172.21.15.134:6800/3039719923,v1:172.21.15.134:6801/3039719923] boot 2024-03-12T16:17:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:49 smithi006 ceph-mon[103869]: osdmap e68: 6 total, 6 up, 6 in 2024-03-12T16:17:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:49 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-03-12T16:17:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:49 smithi006 ceph-mon[103869]: osdmap e69: 6 total, 6 up, 6 in 2024-03-12T16:17:50.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:50 smithi134 ceph-mon[85099]: Health check update: Degraded data redundancy: 66/330 objects degraded (20.000%), 18 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:50.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:50 smithi006 ceph-mon[103869]: Health check update: Degraded data redundancy: 66/330 objects degraded (20.000%), 18 pgs degraded (PG_DEGRADED) 2024-03-12T16:17:51.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:51 smithi134 ceph-mon[85099]: pgmap v122: 65 pgs: 3 peering, 18 active+undersized+degraded, 17 active+undersized, 27 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 66/330 objects degraded (20.000%) 2024-03-12T16:17:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:51 smithi006 ceph-mon[103869]: pgmap v122: 65 pgs: 3 peering, 18 active+undersized+degraded, 17 active+undersized, 27 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 66/330 objects degraded (20.000%) 2024-03-12T16:17:53.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:53 smithi134 ceph-mon[85099]: pgmap v123: 65 pgs: 3 peering, 14 active+undersized+degraded, 14 active+undersized, 34 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:17:53.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:53 smithi006 ceph-mon[103869]: pgmap v123: 65 pgs: 3 peering, 14 active+undersized+degraded, 14 active+undersized, 34 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:17:55.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:54 smithi134 ceph-mon[85099]: pgmap v124: 65 pgs: 3 peering, 62 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:55.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:54 smithi134 ceph-mon[85099]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/330 objects degraded (16.364%), 14 pgs degraded) 2024-03-12T16:17:55.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:54 smithi134 ceph-mon[85099]: Cluster is now healthy 2024-03-12T16:17:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:54 smithi006 ceph-mon[103869]: pgmap v124: 65 pgs: 3 peering, 62 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:54 smithi006 ceph-mon[103869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 54/330 objects degraded (16.364%), 14 pgs degraded) 2024-03-12T16:17:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:54 smithi006 ceph-mon[103869]: Cluster is now healthy 2024-03-12T16:17:57.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:56 smithi134 ceph-mon[85099]: pgmap v125: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:57.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:56 smithi006 ceph-mon[103869]: pgmap v125: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:59.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:17:59 smithi134 ceph-mon[85099]: pgmap v126: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:17:59.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:17:59 smithi006 ceph-mon[103869]: pgmap v126: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:01.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:01 smithi134 ceph-mon[85099]: pgmap v127: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:01.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:01 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-12T16:18:01.663 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:01 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-12T16:18:01.664 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:01 smithi134 ceph-mon[85099]: Upgrade: osd.4 is safe to restart 2024-03-12T16:18:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:01 smithi006 ceph-mon[103869]: pgmap v127: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:01 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-12T16:18:01.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:01 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["4"], "max": 16}]: dispatch 2024-03-12T16:18:01.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:01 smithi006 ceph-mon[103869]: Upgrade: osd.4 is safe to restart 2024-03-12T16:18:03.153 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:02 smithi134 ceph-mon[85099]: pgmap v128: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:03.153 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:03.153 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:18:03.153 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:03.153 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:02 smithi134 ceph-mon[85099]: Upgrade: Updating osd.4 2024-03-12T16:18:03.153 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:03.153 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-12T16:18:03.153 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:03.153 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:02 smithi134 ceph-mon[85099]: Deploying daemon osd.4 on smithi134 2024-03-12T16:18:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:02 smithi006 ceph-mon[103869]: pgmap v128: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:18:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:02 smithi006 ceph-mon[103869]: Upgrade: Updating osd.4 2024-03-12T16:18:03.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:03.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-03-12T16:18:03.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:03.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:02 smithi006 ceph-mon[103869]: Deploying daemon osd.4 on smithi134 2024-03-12T16:18:05.553 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:05 smithi134 ceph-mon[85099]: pgmap v129: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:05.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:05 smithi006 ceph-mon[103869]: pgmap v129: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:05.887 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:05 smithi134 systemd[1]: Stopping Ceph osd.4 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.036+0000 7f2a6e330700 1 -- 172.21.15.6:0/1763652633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fd820 msgr2=0x7f2a680fdc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.036+0000 7f2a6e330700 1 --2- 172.21.15.6:0/1763652633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fd820 0x7f2a680fdc00 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f2a580047f0 tx=0x7f2a58009cb0).stop 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.036+0000 7f2a6e330700 1 -- 172.21.15.6:0/1763652633 shutdown_connections 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.036+0000 7f2a6e330700 1 --2- 172.21.15.6:0/1763652633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a680fe180 0x7f2a680f7960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.036+0000 7f2a6e330700 1 --2- 172.21.15.6:0/1763652633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fd820 0x7f2a680fdc00 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.036+0000 7f2a6e330700 1 -- 172.21.15.6:0/1763652633 >> 172.21.15.6:0/1763652633 conn(0x7f2a680f3400 msgr2=0x7f2a680f5820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.036+0000 7f2a6e330700 1 -- 172.21.15.6:0/1763652633 shutdown_connections 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.036+0000 7f2a6e330700 1 -- 172.21.15.6:0/1763652633 wait complete. 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.036+0000 7f2a6e330700 1 Processor -- start 2024-03-12T16:18:06.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.037+0000 7f2a6e330700 1 -- start start 2024-03-12T16:18:06.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.037+0000 7f2a6e330700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a680fd820 0x7f2a681102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:06.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.037+0000 7f2a6e330700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fe180 0x7f2a681107a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:06.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.037+0000 7f2a6e330700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68110da0 con 0x7f2a680fe180 2024-03-12T16:18:06.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.037+0000 7f2a6e330700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2a68110ee0 con 0x7f2a680fd820 2024-03-12T16:18:06.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.037+0000 7f2a677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fe180 0x7f2a681107a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:06.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.037+0000 7f2a677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fe180 0x7f2a681107a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44120/0 (socket says 172.21.15.6:44120) 2024-03-12T16:18:06.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.037+0000 7f2a67fff700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a680fd820 0x7f2a681102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.037+0000 7f2a677fe700 1 -- 172.21.15.6:0/3669719778 learned_addr learned my addr 172.21.15.6:0/3669719778 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a67fff700 1 -- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fe180 msgr2=0x7f2a681107a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a67fff700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fe180 0x7f2a681107a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a67fff700 1 -- 172.21.15.6:0/3669719778 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a58005040 con 0x7f2a680fd820 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a677fe700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fe180 0x7f2a681107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a67fff700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a680fd820 0x7f2a681102b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2a58000c00 tx=0x7f2a58009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a657fa700 1 -- 172.21.15.6:0/3669719778 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a5800e030 con 0x7f2a680fd820 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a657fa700 1 -- 172.21.15.6:0/3669719778 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a58007e90 con 0x7f2a680fd820 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2a6810a300 con 0x7f2a680fd820 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a657fa700 1 -- 172.21.15.6:0/3669719778 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a58018070 con 0x7f2a680fd820 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.038+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2a6810a860 con 0x7f2a680fd820 2024-03-12T16:18:06.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.039+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2a68060160 con 0x7f2a680fd820 2024-03-12T16:18:06.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.039+0000 7f2a657fa700 1 -- 172.21.15.6:0/3669719778 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2a5801d590 con 0x7f2a680fd820 2024-03-12T16:18:06.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.040+0000 7f2a657fa700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a5006caf0 0x7f2a5006efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:06.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.040+0000 7f2a657fa700 1 -- 172.21.15.6:0/3669719778 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(69..69 src has 1..69) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f2a5808cf50 con 0x7f2a680fd820 2024-03-12T16:18:06.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.040+0000 7f2a677fe700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a5006caf0 0x7f2a5006efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:06.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.040+0000 7f2a677fe700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a5006caf0 0x7f2a5006efb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2a6810bbf0 tx=0x7f2a5c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:06.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.044+0000 7f2a657fa700 1 -- 172.21.15.6:0/3669719778 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2a5805aae0 con 0x7f2a680fd820 2024-03-12T16:18:06.203 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[53929]: debug 2024-03-12T16:18:05.884+0000 7f4362c76700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-12T16:18:06.203 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[53929]: debug 2024-03-12T16:18:05.884+0000 7f4362c76700 -1 osd.4 69 *** Got signal Terminated *** 2024-03-12T16:18:06.204 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[53929]: debug 2024-03-12T16:18:05.884+0000 7f4362c76700 -1 osd.4 69 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:18:06.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.263+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2a6810b9a0 con 0x7f2a5006caf0 2024-03-12T16:18:06.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.265+0000 7f2a657fa700 1 -- 172.21.15.6:0/3669719778 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f2a6810b9a0 con 0x7f2a5006caf0 2024-03-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a5006caf0 msgr2=0x7f2a5006efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a5006caf0 0x7f2a5006efb0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 rx=0x7f2a6810bbf0 tx=0x7f2a5c00b040).stop 2024-03-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a680fd820 msgr2=0x7f2a681102b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a680fd820 0x7f2a681102b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 rx=0x7f2a58000c00 tx=0x7f2a58009cb0).stop 2024-03-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 shutdown_connections 2024-03-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2a680fd820 0x7f2a681102b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a5006caf0 0x7f2a5006efb0 secure :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 rx=0x7f2a6810bbf0 tx=0x7f2a5c00b040).stop 2024-03-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 --2- 172.21.15.6:0/3669719778 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2a680fe180 0x7f2a681107a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 >> 172.21.15.6:0/3669719778 conn(0x7f2a680f3400 msgr2=0x7f2a6806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 shutdown_connections 2024-03-12T16:18:06.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.270+0000 7f2a6e330700 1 -- 172.21.15.6:0/3669719778 wait complete. 2024-03-12T16:18:06.283 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:18:06.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.374+0000 7f7f607fd700 1 -- 172.21.15.6:0/1061147316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 msgr2=0x7f7f580fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.374+0000 7f7f607fd700 1 --2- 172.21.15.6:0/1061147316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 0x7f7f580fdcd0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f7f480047f0 tx=0x7f7f48009cb0).stop 2024-03-12T16:18:06.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.374+0000 7f7f607fd700 1 -- 172.21.15.6:0/1061147316 shutdown_connections 2024-03-12T16:18:06.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.374+0000 7f7f607fd700 1 --2- 172.21.15.6:0/1061147316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fe250 0x7f7f580f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.374+0000 7f7f607fd700 1 --2- 172.21.15.6:0/1061147316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 0x7f7f580fdcd0 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.374+0000 7f7f607fd700 1 -- 172.21.15.6:0/1061147316 >> 172.21.15.6:0/1061147316 conn(0x7f7f580f34b0 msgr2=0x7f7f580f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:06.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.374+0000 7f7f607fd700 1 -- 172.21.15.6:0/1061147316 shutdown_connections 2024-03-12T16:18:06.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.374+0000 7f7f607fd700 1 -- 172.21.15.6:0/1061147316 wait complete. 2024-03-12T16:18:06.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.374+0000 7f7f607fd700 1 Processor -- start 2024-03-12T16:18:06.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f607fd700 1 -- start start 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f607fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 0x7f7f5806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f607fd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fe250 0x7f7f5806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f607fd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5806bab0 con 0x7f7f580fd8f0 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f607fd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5806bbf0 con 0x7f7f580fe250 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f5e599700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 0x7f7f5806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f5e599700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 0x7f7f5806b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44146/0 (socket says 172.21.15.6:44146) 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f5e599700 1 -- 172.21.15.6:0/3966336628 learned_addr learned my addr 172.21.15.6:0/3966336628 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f5dd98700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fe250 0x7f7f5806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f5e599700 1 -- 172.21.15.6:0/3966336628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fe250 msgr2=0x7f7f5806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f5e599700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fe250 0x7f7f5806b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f5e599700 1 -- 172.21.15.6:0/3966336628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f48005040 con 0x7f7f580fd8f0 2024-03-12T16:18:06.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f5dd98700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fe250 0x7f7f5806b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:18:06.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.375+0000 7f7f5e599700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 0x7f7f5806b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7f48005010 tx=0x7f7f48009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:06.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.376+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/3966336628 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4800e030 con 0x7f7f580fd8f0 2024-03-12T16:18:06.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.376+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f5806be40 con 0x7f7f580fd8f0 2024-03-12T16:18:06.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.376+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/3966336628 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f48007e90 con 0x7f7f580fd8f0 2024-03-12T16:18:06.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.376+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/3966336628 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f48018070 con 0x7f7f580fd8f0 2024-03-12T16:18:06.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.376+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f581145f0 con 0x7f7f580fd8f0 2024-03-12T16:18:06.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.377+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5805f590 con 0x7f7f580fd8f0 2024-03-12T16:18:06.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.377+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/3966336628 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7f4801d6e0 con 0x7f7f580fd8f0 2024-03-12T16:18:06.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.378+0000 7f7f4f7fe700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f4406ca30 0x7f7f4406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:06.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.378+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/3966336628 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f7f4808d000 con 0x7f7f580fd8f0 2024-03-12T16:18:06.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.378+0000 7f7f5dd98700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f4406ca30 0x7f7f4406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:06.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.378+0000 7f7f5dd98700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f4406ca30 0x7f7f4406eef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7f5806c870 tx=0x7f7f54009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:06.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.382+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/3966336628 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7f48057180 con 0x7f7f580fd8f0 2024-03-12T16:18:06.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.597+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f58059120 con 0x7f7f4406ca30 2024-03-12T16:18:06.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.598+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/3966336628 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f7f58059120 con 0x7f7f4406ca30 2024-03-12T16:18:06.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.600+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f4406ca30 msgr2=0x7f7f4406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.600+0000 7f7f607fd700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f4406ca30 0x7f7f4406eef0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 rx=0x7f7f5806c870 tx=0x7f7f54009d60).stop 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.600+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 msgr2=0x7f7f5806b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.600+0000 7f7f607fd700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 0x7f7f5806b0d0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f7f48005010 tx=0x7f7f48009cb0).stop 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.600+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 shutdown_connections 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.600+0000 7f7f607fd700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f4406ca30 0x7f7f4406eef0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.600+0000 7f7f607fd700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f580fd8f0 0x7f7f5806b0d0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.600+0000 7f7f607fd700 1 --2- 172.21.15.6:0/3966336628 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f580fe250 0x7f7f5806b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.600+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 >> 172.21.15.6:0/3966336628 conn(0x7f7f580f34b0 msgr2=0x7f7f580fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.601+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 shutdown_connections 2024-03-12T16:18:06.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.601+0000 7f7f607fd700 1 -- 172.21.15.6:0/3966336628 wait complete. 2024-03-12T16:18:06.659 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:06 smithi134 ceph-mon[85099]: osd.4 marked itself down and dead 2024-03-12T16:18:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.702+0000 7f24c279f700 1 -- 172.21.15.6:0/493652888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 msgr2=0x7f24bc0f6700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.702+0000 7f24c279f700 1 --2- 172.21.15.6:0/493652888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 0x7f24bc0f6700 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7f24ac0047f0 tx=0x7f24ac009cb0).stop 2024-03-12T16:18:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.702+0000 7f24c279f700 1 -- 172.21.15.6:0/493652888 shutdown_connections 2024-03-12T16:18:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.702+0000 7f24c279f700 1 --2- 172.21.15.6:0/493652888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 0x7f24bc0f6700 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.702+0000 7f24c279f700 1 --2- 172.21.15.6:0/493652888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc0fc5c0 0x7f24bc0fc9a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.702+0000 7f24c279f700 1 -- 172.21.15.6:0/493652888 >> 172.21.15.6:0/493652888 conn(0x7f24bc0f21e0 msgr2=0x7f24bc0f4600 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.702+0000 7f24c279f700 1 -- 172.21.15.6:0/493652888 shutdown_connections 2024-03-12T16:18:06.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.702+0000 7f24c279f700 1 -- 172.21.15.6:0/493652888 wait complete. 2024-03-12T16:18:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.703+0000 7f24c279f700 1 Processor -- start 2024-03-12T16:18:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.703+0000 7f24c279f700 1 -- start start 2024-03-12T16:18:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.703+0000 7f24c279f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc0fc5c0 0x7f24bc10df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.703+0000 7f24c279f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 0x7f24bc10e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.703+0000 7f24c279f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc10ea60 con 0x7f24bc0fcf20 2024-03-12T16:18:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.703+0000 7f24c279f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f24bc10eba0 con 0x7f24bc0fc5c0 2024-03-12T16:18:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c0f9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 0x7f24bc10e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:06.707 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c0f9c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 0x7f24bc10e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44174/0 (socket says 172.21.15.6:44174) 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c0f9c700 1 -- 172.21.15.6:0/3675895094 learned_addr learned my addr 172.21.15.6:0/3675895094 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c179d700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc0fc5c0 0x7f24bc10df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c0f9c700 1 -- 172.21.15.6:0/3675895094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc0fc5c0 msgr2=0x7f24bc10df70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c0f9c700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc0fc5c0 0x7f24bc10df70 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c0f9c700 1 -- 172.21.15.6:0/3675895094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f24ac005040 con 0x7f24bc0fcf20 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c0f9c700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 0x7f24bc10e460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f24ac0099f0 tx=0x7f24ac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24b27fc700 1 -- 172.21.15.6:0/3675895094 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24ac00e030 con 0x7f24bc0fcf20 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f24bc107fc0 con 0x7f24bc0fcf20 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24b27fc700 1 -- 172.21.15.6:0/3675895094 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f24ac007e90 con 0x7f24bc0fcf20 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24b27fc700 1 -- 172.21.15.6:0/3675895094 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f24ac018070 con 0x7f24bc0fcf20 2024-03-12T16:18:06.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.704+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f24bc108520 con 0x7f24bc0fcf20 2024-03-12T16:18:06.709 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:06 smithi006 ceph-mon[103869]: osd.4 marked itself down and dead 2024-03-12T16:18:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.705+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f24bc05f130 con 0x7f24bc0fcf20 2024-03-12T16:18:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.706+0000 7f24b27fc700 1 -- 172.21.15.6:0/3675895094 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f24ac0094c0 con 0x7f24bc0fcf20 2024-03-12T16:18:06.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.706+0000 7f24b27fc700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f24a806caa0 0x7f24a806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.706+0000 7f24b27fc700 1 -- 172.21.15.6:0/3675895094 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f24ac08cf50 con 0x7f24bc0fcf20 2024-03-12T16:18:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.706+0000 7f24c179d700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f24a806caa0 0x7f24a806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:06.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.707+0000 7f24c179d700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f24a806caa0 0x7f24a806ef60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f24b8004dc0 tx=0x7f24b800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:06.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.711+0000 7f24b27fc700 1 -- 172.21.15.6:0/3675895094 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f24ac0c0190 con 0x7f24bc0fcf20 2024-03-12T16:18:06.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.923+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f24bc109660 con 0x7f24a806caa0 2024-03-12T16:18:06.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.933+0000 7f24b27fc700 1 -- 172.21.15.6:0/3675895094 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f24bc109660 con 0x7f24a806caa0 2024-03-12T16:18:06.935 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:18:06.935 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (4m) 60s ago 15m 26.2M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:18:06.935 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (2m) 60s ago 15m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:18:06.935 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (2m) 26s ago 15m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (4m) 60s ago 15m 89.5M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (10m) 60s ago 10m 124M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (10m) 60s ago 10m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (10m) 26s ago 10m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (10m) 26s ago 10m 18.3M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (6m) 60s ago 17m 500M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (5m) 26s ago 15m 448M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (3m) 60s ago 17m 46.0M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (3m) 26s ago 15m 37.3M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (5m) 60s ago 15m 17.2M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 26s ago 14m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:18:06.936 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (2m) 60s ago 14m 88.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:18:06.937 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (101s) 60s ago 14m 92.1M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:18:06.937 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (65s) 60s ago 13m 13.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:18:06.937 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (30s) 26s ago 13m 11.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:18:06.937 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (12m) 26s ago 12m 234M 2251M 16.2.15-1-g8963e9de 727f386679cb c4267e462407 2024-03-12T16:18:06.937 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (12m) 26s ago 12m 226M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:18:06.937 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 26s ago 14m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f24a806caa0 msgr2=0x7f24a806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f24a806caa0 0x7f24a806ef60 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 rx=0x7f24b8004dc0 tx=0x7f24b800b040).stop 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 msgr2=0x7f24bc10e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 0x7f24bc10e460 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f24ac0099f0 tx=0x7f24ac009cb0).stop 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 shutdown_connections 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f24bc0fc5c0 0x7f24bc10df70 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f24a806caa0 0x7f24a806ef60 unknown :-1 s=CLOSED pgs=68 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 --2- 172.21.15.6:0/3675895094 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f24bc0fcf20 0x7f24bc10e460 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 >> 172.21.15.6:0/3675895094 conn(0x7f24bc0f21e0 msgr2=0x7f24bc060f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 shutdown_connections 2024-03-12T16:18:06.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:06.935+0000 7f24c279f700 1 -- 172.21.15.6:0/3675895094 wait complete. 2024-03-12T16:18:06.953 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:06 smithi134 bash[104648]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4 2024-03-12T16:18:07.039 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.035+0000 7f5c9aefc700 1 -- 172.21.15.6:0/555370371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fd150 msgr2=0x7f5c940f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.035+0000 7f5c9aefc700 1 --2- 172.21.15.6:0/555370371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fd150 0x7f5c940f6930 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7f5c800047f0 tx=0x7f5c80009cb0).stop 2024-03-12T16:18:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.035+0000 7f5c9aefc700 1 -- 172.21.15.6:0/555370371 shutdown_connections 2024-03-12T16:18:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.035+0000 7f5c9aefc700 1 --2- 172.21.15.6:0/555370371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fd150 0x7f5c940f6930 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.035+0000 7f5c9aefc700 1 --2- 172.21.15.6:0/555370371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c940fc7f0 0x7f5c940fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.035+0000 7f5c9aefc700 1 -- 172.21.15.6:0/555370371 >> 172.21.15.6:0/555370371 conn(0x7f5c94070590 msgr2=0x7f5c940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.035+0000 7f5c9aefc700 1 -- 172.21.15.6:0/555370371 shutdown_connections 2024-03-12T16:18:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.035+0000 7f5c9aefc700 1 -- 172.21.15.6:0/555370371 wait complete. 2024-03-12T16:18:07.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.036+0000 7f5c9aefc700 1 Processor -- start 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.036+0000 7f5c9aefc700 1 -- start start 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.036+0000 7f5c9aefc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fc7f0 0x7f5c940f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.036+0000 7f5c9aefc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c940fd150 0x7f5c940f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.036+0000 7f5c9aefc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940f8f20 con 0x7f5c940fc7f0 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.036+0000 7f5c9aefc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c940f9060 con 0x7f5c940fd150 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.036+0000 7f5c98c98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fc7f0 0x7f5c940f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c98c98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fc7f0 0x7f5c940f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44192/0 (socket says 172.21.15.6:44192) 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c98c98700 1 -- 172.21.15.6:0/2875488183 learned_addr learned my addr 172.21.15.6:0/2875488183 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c93fff700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c940fd150 0x7f5c940f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c98c98700 1 -- 172.21.15.6:0/2875488183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c940fd150 msgr2=0x7f5c940f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c98c98700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c940fd150 0x7f5c940f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c98c98700 1 -- 172.21.15.6:0/2875488183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c80005040 con 0x7f5c940fc7f0 2024-03-12T16:18:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c93fff700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c940fd150 0x7f5c940f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:18:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c98c98700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fc7f0 0x7f5c940f8540 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5c880041d0 tx=0x7f5c88009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c91ffb700 1 -- 172.21.15.6:0/2875488183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c88002d90 con 0x7f5c940fc7f0 2024-03-12T16:18:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c91ffb700 1 -- 172.21.15.6:0/2875488183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c8800f040 con 0x7f5c940fc7f0 2024-03-12T16:18:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c940f9310 con 0x7f5c940fc7f0 2024-03-12T16:18:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c91ffb700 1 -- 172.21.15.6:0/2875488183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c8800d800 con 0x7f5c940fc7f0 2024-03-12T16:18:07.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.037+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c941146a0 con 0x7f5c940fc7f0 2024-03-12T16:18:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.038+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c9405f590 con 0x7f5c940fc7f0 2024-03-12T16:18:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.039+0000 7f5c91ffb700 1 -- 172.21.15.6:0/2875488183 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5c8800dac0 con 0x7f5c940fc7f0 2024-03-12T16:18:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.039+0000 7f5c91ffb700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c8406cab0 0x7f5c8406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.039+0000 7f5c91ffb700 1 -- 172.21.15.6:0/2875488183 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(70..70 src has 1..70) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f5c8808bdf0 con 0x7f5c940fc7f0 2024-03-12T16:18:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.039+0000 7f5c93fff700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c8406cab0 0x7f5c8406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:07.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.040+0000 7f5c93fff700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c8406cab0 0x7f5c8406ef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5c940f9ce0 tx=0x7f5c80009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:07.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.044+0000 7f5c91ffb700 1 -- 172.21.15.6:0/2875488183 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5c88055eb0 con 0x7f5c940fc7f0 2024-03-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.345+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5c94114d10 con 0x7f5c940fc7f0 2024-03-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.346+0000 7f5c91ffb700 1 -- 172.21.15.6:0/2875488183 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7f5c880594d0 con 0x7f5c940fc7f0 2024-03-12T16:18:07.348 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:18:07.349 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 5, 2024-03-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 8 2024-03-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:18:07.350 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c8406cab0 msgr2=0x7f5c8406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c8406cab0 0x7f5c8406ef70 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 rx=0x7f5c940f9ce0 tx=0x7f5c80009cb0).stop 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fc7f0 msgr2=0x7f5c940f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fc7f0 0x7f5c940f8540 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7f5c880041d0 tx=0x7f5c88009f60).stop 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 shutdown_connections 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c8406cab0 0x7f5c8406ef70 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c940fc7f0 0x7f5c940f8540 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 --2- 172.21.15.6:0/2875488183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c940fd150 0x7f5c940f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 >> 172.21.15.6:0/2875488183 conn(0x7f5c94070590 msgr2=0x7f5c94060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.348+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 shutdown_connections 2024-03-12T16:18:07.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.349+0000 7f5c9aefc700 1 -- 172.21.15.6:0/2875488183 wait complete. 2024-03-12T16:18:07.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.451+0000 7f33b04f3700 1 -- 172.21.15.6:0/2544857026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 msgr2=0x7f33a8103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.451+0000 7f33b04f3700 1 --2- 172.21.15.6:0/2544857026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 0x7f33a8103d60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7f339c004820 tx=0x7f339c009cb0).stop 2024-03-12T16:18:07.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.451+0000 7f33b04f3700 1 -- 172.21.15.6:0/2544857026 shutdown_connections 2024-03-12T16:18:07.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.451+0000 7f33b04f3700 1 --2- 172.21.15.6:0/2544857026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 0x7f33a8103d60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.451+0000 7f33b04f3700 1 --2- 172.21.15.6:0/2544857026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33a80f66f0 0x7f33a80f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.451+0000 7f33b04f3700 1 -- 172.21.15.6:0/2544857026 >> 172.21.15.6:0/2544857026 conn(0x7f33a8070590 msgr2=0x7f33a80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.451+0000 7f33b04f3700 1 -- 172.21.15.6:0/2544857026 shutdown_connections 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.451+0000 7f33b04f3700 1 -- 172.21.15.6:0/2544857026 wait complete. 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33b04f3700 1 Processor -- start 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33b04f3700 1 -- start start 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33b04f3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33a80f66f0 0x7f33a8110370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33b04f3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 0x7f33a8110860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33b04f3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8110e60 con 0x7f33a80f6fc0 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33b04f3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33a8110fa0 con 0x7f33a80f66f0 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33ada8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 0x7f33a8110860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33ada8e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 0x7f33a8110860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44210/0 (socket says 172.21.15.6:44210) 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33ada8e700 1 -- 172.21.15.6:0/3301524447 learned_addr learned my addr 172.21.15.6:0/3301524447 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33ae28f700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33a80f66f0 0x7f33a8110370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33ada8e700 1 -- 172.21.15.6:0/3301524447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33a80f66f0 msgr2=0x7f33a8110370 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33ada8e700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33a80f66f0 0x7f33a8110370 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33ada8e700 1 -- 172.21.15.6:0/3301524447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f339c005040 con 0x7f33a80f6fc0 2024-03-12T16:18:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.452+0000 7f33ada8e700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 0x7f33a8110860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f339c009360 tx=0x7f339c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.453+0000 7f339b7fe700 1 -- 172.21.15.6:0/3301524447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f339c018070 con 0x7f33a80f6fc0 2024-03-12T16:18:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.453+0000 7f339b7fe700 1 -- 172.21.15.6:0/3301524447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f339c007e90 con 0x7f33a80f6fc0 2024-03-12T16:18:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.453+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33a810a5d0 con 0x7f33a80f6fc0 2024-03-12T16:18:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.453+0000 7f339b7fe700 1 -- 172.21.15.6:0/3301524447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f339c01c3c0 con 0x7f33a80f6fc0 2024-03-12T16:18:07.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.453+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33a810aab0 con 0x7f33a80f6fc0 2024-03-12T16:18:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.454+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33a805f590 con 0x7f33a80f6fc0 2024-03-12T16:18:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.454+0000 7f339b7fe700 1 -- 172.21.15.6:0/3301524447 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f339c01d420 con 0x7f33a80f6fc0 2024-03-12T16:18:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.454+0000 7f339b7fe700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339406caa0 0x7f339406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.455+0000 7f339b7fe700 1 -- 172.21.15.6:0/3301524447 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f339c08d070 con 0x7f33a80f6fc0 2024-03-12T16:18:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.455+0000 7f33ae28f700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339406caa0 0x7f339406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:07.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.455+0000 7f33ae28f700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339406caa0 0x7f339406ef60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f33a40092f0 tx=0x7f33a400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:07.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.459+0000 7f339b7fe700 1 -- 172.21.15.6:0/3301524447 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f339c05ac80 con 0x7f33a80f6fc0 2024-03-12T16:18:07.569 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:07 smithi134 ceph-mon[85099]: pgmap v130: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:07.569 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:07 smithi134 ceph-mon[85099]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:18:07.569 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:07 smithi134 ceph-mon[85099]: osdmap e70: 6 total, 5 up, 6 in 2024-03-12T16:18:07.569 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:07 smithi134 ceph-mon[85099]: from='client.44221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:07.569 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:07 smithi134 ceph-mon[85099]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:07.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.702+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f33a8047540 con 0x7f33a80f6fc0 2024-03-12T16:18:07.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.702+0000 7f339b7fe700 1 -- 172.21.15.6:0/3301524447 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f339c05a810 con 0x7f33a80f6fc0 2024-03-12T16:18:07.705 INFO:teuthology.orchestra.run.smithi006.stdout:e16 2024-03-12T16:18:07.705 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:18:07.705 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:18:07.705 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:18:07.705 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:18:07.705 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 16 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:14:55.638904+0000 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:18:07.706 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:18:07.707 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:18:07.708 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:18:07.709 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:18:07.709 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:18:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339406caa0 msgr2=0x7f339406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339406caa0 0x7f339406ef60 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 rx=0x7f33a40092f0 tx=0x7f33a400b040).stop 2024-03-12T16:18:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 msgr2=0x7f33a8110860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 0x7f33a8110860 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f339c009360 tx=0x7f339c009cb0).stop 2024-03-12T16:18:07.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:07 smithi006 ceph-mon[103869]: pgmap v130: 65 pgs: 65 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:07.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:07 smithi006 ceph-mon[103869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:18:07.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:07 smithi006 ceph-mon[103869]: osdmap e70: 6 total, 5 up, 6 in 2024-03-12T16:18:07.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:07 smithi006 ceph-mon[103869]: from='client.44221 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:07.710 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:07 smithi006 ceph-mon[103869]: from='client.34312 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 shutdown_connections 2024-03-12T16:18:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33a80f66f0 0x7f33a8110370 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339406caa0 0x7f339406ef60 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 --2- 172.21.15.6:0/3301524447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33a80f6fc0 0x7f33a8110860 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 >> 172.21.15.6:0/3301524447 conn(0x7f33a8070590 msgr2=0x7f33a8102df0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 shutdown_connections 2024-03-12T16:18:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.705+0000 7f33b04f3700 1 -- 172.21.15.6:0/3301524447 wait complete. 2024-03-12T16:18:07.711 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-03-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.808+0000 7fab986b2700 1 -- 172.21.15.6:0/3818310983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f8900 msgr2=0x7fab900f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.808+0000 7fab986b2700 1 --2- 172.21.15.6:0/3818310983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f8900 0x7fab900f8ce0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7fab800047f0 tx=0x7fab80009cb0).stop 2024-03-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.808+0000 7fab986b2700 1 -- 172.21.15.6:0/3818310983 shutdown_connections 2024-03-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.808+0000 7fab986b2700 1 --2- 172.21.15.6:0/3818310983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab900f9260 0x7fab90101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.808+0000 7fab986b2700 1 --2- 172.21.15.6:0/3818310983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f8900 0x7fab900f8ce0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.808+0000 7fab986b2700 1 -- 172.21.15.6:0/3818310983 >> 172.21.15.6:0/3818310983 conn(0x7fab90070590 msgr2=0x7fab900f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.808+0000 7fab986b2700 1 -- 172.21.15.6:0/3818310983 shutdown_connections 2024-03-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.808+0000 7fab986b2700 1 -- 172.21.15.6:0/3818310983 wait complete. 2024-03-12T16:18:07.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.808+0000 7fab986b2700 1 Processor -- start 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab986b2700 1 -- start start 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab986b2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab900f8900 0x7fab900f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab986b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f9260 0x7fab900f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab986b2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900f7290 con 0x7fab900f9260 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab986b2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab900f73d0 con 0x7fab900f8900 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab95c4d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f9260 0x7fab900f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab95c4d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f9260 0x7fab900f6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44240/0 (socket says 172.21.15.6:44240) 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab95c4d700 1 -- 172.21.15.6:0/1037847008 learned_addr learned my addr 172.21.15.6:0/1037847008 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab9644e700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab900f8900 0x7fab900f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab95c4d700 1 -- 172.21.15.6:0/1037847008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab900f8900 msgr2=0x7fab900f68b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:07.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab95c4d700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab900f8900 0x7fab900f68b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab95c4d700 1 -- 172.21.15.6:0/1037847008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80005040 con 0x7fab900f9260 2024-03-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.809+0000 7fab95c4d700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f9260 0x7fab900f6da0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fab8c00e8f0 tx=0x7fab8c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.810+0000 7fab877fe700 1 -- 172.21.15.6:0/1037847008 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab8c007b40 con 0x7fab900f9260 2024-03-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.810+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab900f7680 con 0x7fab900f9260 2024-03-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.810+0000 7fab877fe700 1 -- 172.21.15.6:0/1037847008 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab8c00f040 con 0x7fab900f9260 2024-03-12T16:18:07.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.810+0000 7fab877fe700 1 -- 172.21.15.6:0/1037847008 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab8c014880 con 0x7fab900f9260 2024-03-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.810+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab90114760 con 0x7fab900f9260 2024-03-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.811+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab9005f590 con 0x7fab900f9260 2024-03-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.811+0000 7fab877fe700 1 -- 172.21.15.6:0/1037847008 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fab8c014b00 con 0x7fab900f9260 2024-03-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.812+0000 7fab877fe700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7c06caa0 0x7fab7c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.812+0000 7fab877fe700 1 -- 172.21.15.6:0/1037847008 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fab8c08b920 con 0x7fab900f9260 2024-03-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.812+0000 7fab9644e700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7c06caa0 0x7fab7c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:07.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.812+0000 7fab9644e700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7c06caa0 0x7fab7c06ef60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fab800047c0 tx=0x7fab80009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:07.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:07.816+0000 7fab877fe700 1 -- 172.21.15.6:0/1037847008 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fab8c055aa0 con 0x7fab900f9260 2024-03-12T16:18:08.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.031+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab90059120 con 0x7fab7c06caa0 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.033+0000 7fab877fe700 1 -- 172.21.15.6:0/1037847008 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fab90059120 con 0x7fab7c06caa0 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout: "crash" 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:18:08.035 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "10/21 daemons upgraded", 2024-03-12T16:18:08.036 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading osd daemons", 2024-03-12T16:18:08.036 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:18:08.036 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7c06caa0 msgr2=0x7fab7c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7c06caa0 0x7fab7c06ef60 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 rx=0x7fab800047c0 tx=0x7fab80009cb0).stop 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f9260 msgr2=0x7fab900f6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f9260 0x7fab900f6da0 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7fab8c00e8f0 tx=0x7fab8c00b040).stop 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 shutdown_connections 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab900f8900 0x7fab900f68b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7c06caa0 0x7fab7c06ef60 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 --2- 172.21.15.6:0/1037847008 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab900f9260 0x7fab900f6da0 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 >> 172.21.15.6:0/1037847008 conn(0x7fab90070590 msgr2=0x7fab90101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 shutdown_connections 2024-03-12T16:18:08.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.035+0000 7fab986b2700 1 -- 172.21.15.6:0/1037847008 wait complete. 2024-03-12T16:18:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.137+0000 7f2cbfa33700 1 -- 172.21.15.6:0/617482724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fd830 msgr2=0x7f2cb80fdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.137+0000 7f2cbfa33700 1 --2- 172.21.15.6:0/617482724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fd830 0x7f2cb80fdc10 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f2ca80047f0 tx=0x7f2ca8009cb0).stop 2024-03-12T16:18:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.137+0000 7f2cbfa33700 1 -- 172.21.15.6:0/617482724 shutdown_connections 2024-03-12T16:18:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.137+0000 7f2cbfa33700 1 --2- 172.21.15.6:0/617482724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cb80fe190 0x7f2cb80f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:18:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.137+0000 7f2cbfa33700 1 --2- 172.21.15.6:0/617482724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fd830 0x7f2cb80fdc10 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.137+0000 7f2cbfa33700 1 -- 172.21.15.6:0/617482724 >> 172.21.15.6:0/617482724 conn(0x7f2cb80f3450 msgr2=0x7f2cb80f5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:08.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.137+0000 7f2cbfa33700 1 -- 172.21.15.6:0/617482724 shutdown_connections 2024-03-12T16:18:08.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.137+0000 7f2cbfa33700 1 -- 172.21.15.6:0/617482724 wait complete. 2024-03-12T16:18:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbfa33700 1 Processor -- start 2024-03-12T16:18:08.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbfa33700 1 -- start start 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbfa33700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cb80fd830 0x7f2cb810e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbfa33700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fe190 0x7f2cb810e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbfa33700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb810ec90 con 0x7f2cb80fe190 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbfa33700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2cb81080a0 con 0x7f2cb80fd830 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbcfce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fe190 0x7f2cb810e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbcfce700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fe190 0x7f2cb810e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44258/0 (socket says 172.21.15.6:44258) 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbcfce700 1 -- 172.21.15.6:0/2790030735 learned_addr learned my addr 172.21.15.6:0/2790030735 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbd7cf700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cb80fd830 0x7f2cb810e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbcfce700 1 -- 172.21.15.6:0/2790030735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cb80fd830 msgr2=0x7f2cb810e110 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbcfce700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cb80fd830 0x7f2cb810e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.138+0000 7f2cbcfce700 1 -- 172.21.15.6:0/2790030735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ca8005040 con 0x7f2cb80fe190 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.139+0000 7f2cbcfce700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fe190 0x7f2cb810e600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f2cb400b480 tx=0x7f2cb40090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:08.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.139+0000 7f2cae7fc700 1 -- 172.21.15.6:0/2790030735 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cb4002500 con 0x7f2cb80fe190 2024-03-12T16:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.139+0000 7f2cae7fc700 1 -- 172.21.15.6:0/2790030735 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2cb4002b10 con 0x7f2cb80fe190 2024-03-12T16:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.139+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2cb8108350 con 0x7f2cb80fe190 2024-03-12T16:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.139+0000 7f2cae7fc700 1 -- 172.21.15.6:0/2790030735 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2cb4012c90 con 0x7f2cb80fe190 2024-03-12T16:18:08.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.139+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2cb8108890 con 0x7f2cb80fe190 2024-03-12T16:18:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.140+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2cb805f470 con 0x7f2cb80fe190 2024-03-12T16:18:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.140+0000 7f2cae7fc700 1 -- 172.21.15.6:0/2790030735 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2cb4002660 con 0x7f2cb80fe190 2024-03-12T16:18:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.141+0000 7f2cae7fc700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ca406caf0 0x7f2ca406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.141+0000 7f2cae7fc700 1 -- 172.21.15.6:0/2790030735 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(71..71 src has 1..71) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f2cb408bdb0 con 0x7f2cb80fe190 2024-03-12T16:18:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.141+0000 7f2cbd7cf700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ca406caf0 0x7f2ca406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:08.144 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.141+0000 7f2cbd7cf700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ca406caf0 0x7f2ca406efb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2ca8000c00 tx=0x7f2ca800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:08.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.145+0000 7f2cae7fc700 1 -- 172.21.15.6:0/2790030735 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2cb40599c0 con 0x7f2cb80fe190 2024-03-12T16:18:08.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:08 smithi134 ceph-mon[85099]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:08.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:08 smithi134 ceph-mon[85099]: osdmap e71: 6 total, 5 up, 6 in 2024-03-12T16:18:08.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:08 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2875488183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:08.408 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:08 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3301524447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:18:08.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.428+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2cb80f7060 con 0x7f2cb80fe190 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.429+0000 7f2cae7fc700 1 -- 172.21.15.6:0/2790030735 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+715 (secure 0 0 0) 0x7f2cb4059550 con 0x7f2cb80fe190 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_WARN 1 osds down; Degraded data redundancy: 30/330 objects degraded (9.091%), 8 pgs degraded 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] OSD_DOWN: 1 osds down 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout: osd.4 (root=default,host=smithi134) is down 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] PG_DEGRADED: Degraded data redundancy: 30/330 objects degraded (9.091%), 8 pgs degraded 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.5 is active+undersized+degraded, acting [3,0] 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.7 is active+undersized+degraded, acting [3,2] 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.b is active+undersized+degraded, acting [3,5] 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.11 is active+undersized+degraded, acting [3,1] 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.14 is active+undersized+degraded, acting [3,5] 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.18 is active+undersized+degraded, acting [5,3] 2024-03-12T16:18:08.431 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1a is active+undersized+degraded, acting [3,5] 2024-03-12T16:18:08.432 INFO:teuthology.orchestra.run.smithi006.stdout: pg 2.1c is active+undersized+degraded, acting [5,2] 2024-03-12T16:18:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.430+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ca406caf0 msgr2=0x7f2ca406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.430+0000 7f2cbfa33700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ca406caf0 0x7f2ca406efb0 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 rx=0x7f2ca8000c00 tx=0x7f2ca800b040).stop 2024-03-12T16:18:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.430+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fe190 msgr2=0x7f2cb810e600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.430+0000 7f2cbfa33700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fe190 0x7f2cb810e600 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7f2cb400b480 tx=0x7f2cb40090f0).stop 2024-03-12T16:18:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.431+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 shutdown_connections 2024-03-12T16:18:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.431+0000 7f2cbfa33700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2cb80fd830 0x7f2cb810e110 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:08.433 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.431+0000 7f2cbfa33700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ca406caf0 0x7f2ca406efb0 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.431+0000 7f2cbfa33700 1 --2- 172.21.15.6:0/2790030735 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2cb80fe190 0x7f2cb810e600 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.431+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 >> 172.21.15.6:0/2790030735 conn(0x7f2cb80f3450 msgr2=0x7f2cb80fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.431+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 shutdown_connections 2024-03-12T16:18:08.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:08.431+0000 7f2cbfa33700 1 -- 172.21.15.6:0/2790030735 wait complete. 2024-03-12T16:18:08.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:08 smithi006 ceph-mon[103869]: from='client.34316 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:08.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:08 smithi006 ceph-mon[103869]: osdmap e71: 6 total, 5 up, 6 in 2024-03-12T16:18:08.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:08 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2875488183' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:08.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:08 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3301524447' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:18:09.198 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:08 smithi134 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.4.service: Succeeded. 2024-03-12T16:18:09.198 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:08 smithi134 systemd[1]: Stopped Ceph osd.4 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:18:09.198 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:08 smithi134 systemd[1]: Starting Ceph osd.4 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:18:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:09 smithi134 ceph-mon[85099]: pgmap v133: 65 pgs: 8 active+undersized+degraded, 4 stale+active+clean, 8 active+undersized, 45 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30/330 objects degraded (9.091%) 2024-03-12T16:18:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:09 smithi134 ceph-mon[85099]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:09 smithi134 ceph-mon[85099]: Health check failed: Degraded data redundancy: 30/330 objects degraded (9.091%), 8 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:09.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:09 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2790030735' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:18:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:09 smithi006 ceph-mon[103869]: pgmap v133: 65 pgs: 8 active+undersized+degraded, 4 stale+active+clean, 8 active+undersized, 45 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 30/330 objects degraded (9.091%) 2024-03-12T16:18:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:09 smithi006 ceph-mon[103869]: from='client.34328 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:09 smithi006 ceph-mon[103869]: Health check failed: Degraded data redundancy: 30/330 objects degraded (9.091%), 8 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:09 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2790030735' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:18:10.203 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:09 smithi134 bash[104927]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-12T16:18:10.204 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:09 smithi134 bash[104927]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-4 --no-mon-config --dev /dev/mapper/vg_nvme-lv_3 2024-03-12T16:18:10.204 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:09 smithi134 bash[104927]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_3 2024-03-12T16:18:10.204 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:09 smithi134 bash[104927]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-2 2024-03-12T16:18:10.204 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:09 smithi134 bash[104927]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_3 /var/lib/ceph/osd/ceph-4/block 2024-03-12T16:18:10.204 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:09 smithi134 bash[104927]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-4 2024-03-12T16:18:10.204 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:09 smithi134 bash[104927]: --> ceph-volume raw activate successful for osd ID: 4 2024-03-12T16:18:11.453 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:11 smithi134 ceph-osd[105251]: -- 172.21.15.134:0/3810633666 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x5646bd3d64e0 con 0x5646bd3a6c00 2024-03-12T16:18:11.453 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:11 smithi134 bash[105213]: f7bee1f20e9a1f96f22fef48e2d819b8808ef83ab051980bce3ef5da3f8efe53 2024-03-12T16:18:11.453 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:11 smithi134 systemd[1]: Started Ceph osd.4 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:18:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:11 smithi134 ceph-mon[85099]: pgmap v134: 65 pgs: 12 active+undersized+degraded, 1 stale+active+clean, 14 active+undersized, 38 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43/330 objects degraded (13.030%) 2024-03-12T16:18:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:11.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:11 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:18:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:11 smithi006 ceph-mon[103869]: pgmap v134: 65 pgs: 12 active+undersized+degraded, 1 stale+active+clean, 14 active+undersized, 38 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 43/330 objects degraded (13.030%) 2024-03-12T16:18:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:11 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:18:11.953 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:18:11.576+0000 7f43b6d63640 -1 Falling back to public interface 2024-03-12T16:18:13.650 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:13 smithi134 ceph-mon[85099]: pgmap v135: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:13.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:13 smithi006 ceph-mon[103869]: pgmap v135: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:15 smithi134 ceph-mon[85099]: pgmap v136: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:16.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:15 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:16.186 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:15 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:16.187 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:15 smithi006 ceph-mon[103869]: pgmap v136: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:16.187 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:15 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:16.187 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:15 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:16.911 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:16 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:16.911 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:16 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:16.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:16 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:16.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:16 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:17.953 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:18:17.461+0000 7f43b6d63640 -1 osd.4 0 read_superblock omap replica is missing. 2024-03-12T16:18:17.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:17 smithi134 ceph-mon[85099]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:17.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:17.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:18:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:17 smithi006 ceph-mon[103869]: pgmap v137: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:18:18.453 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:18:17.962+0000 7f43b6d63640 -1 osd.4 69 log_to_monitors true 2024-03-12T16:18:18.953 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:18:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:18:18.726+0000 7f43a61b8700 -1 osd.4 69 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:18:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:18 smithi134 ceph-mon[85099]: from='osd.4 [v2:172.21.15.134:6808/3599039531,v1:172.21.15.134:6809/3599039531]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-12T16:18:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:18 smithi134 ceph-mon[85099]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-12T16:18:18.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:18 smithi134 ceph-mon[85099]: Health check update: Degraded data redundancy: 54/330 objects degraded (16.364%), 16 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:18.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:18 smithi006 ceph-mon[103869]: from='osd.4 [v2:172.21.15.134:6808/3599039531,v1:172.21.15.134:6809/3599039531]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-12T16:18:18.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:18 smithi006 ceph-mon[103869]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-03-12T16:18:18.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:18 smithi006 ceph-mon[103869]: Health check update: Degraded data redundancy: 54/330 objects degraded (16.364%), 16 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-12T16:18:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: osdmap e72: 6 total, 5 up, 6 in 2024-03-12T16:18:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='osd.4 [v2:172.21.15.134:6808/3599039531,v1:172.21.15.134:6809/3599039531]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:19.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:19 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: pgmap v138: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.5 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: osdmap e72: 6 total, 5 up, 6 in 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='osd.4 [v2:172.21.15.134:6808/3599039531,v1:172.21.15.134:6809/3599039531]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:20.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:20.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:20.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:19 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-12T16:18:21.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:20 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-12T16:18:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:20 smithi134 ceph-mon[85099]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-12T16:18:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:20 smithi134 ceph-mon[85099]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:18:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:20 smithi134 ceph-mon[85099]: osd.4 [v2:172.21.15.134:6808/3599039531,v1:172.21.15.134:6809/3599039531] boot 2024-03-12T16:18:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:20 smithi134 ceph-mon[85099]: osdmap e73: 6 total, 6 up, 6 in 2024-03-12T16:18:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:20 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:18:21.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:20 smithi134 ceph-mon[85099]: osdmap e74: 6 total, 6 up, 6 in 2024-03-12T16:18:21.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:20 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-12T16:18:21.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:20 smithi006 ceph-mon[103869]: Upgrade: unsafe to stop osd(s) at this time (11 PGs are or would become offline) 2024-03-12T16:18:21.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:20 smithi006 ceph-mon[103869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:18:21.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:20 smithi006 ceph-mon[103869]: osd.4 [v2:172.21.15.134:6808/3599039531,v1:172.21.15.134:6809/3599039531] boot 2024-03-12T16:18:21.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:20 smithi006 ceph-mon[103869]: osdmap e73: 6 total, 6 up, 6 in 2024-03-12T16:18:21.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:20 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-03-12T16:18:21.213 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:20 smithi006 ceph-mon[103869]: osdmap e74: 6 total, 6 up, 6 in 2024-03-12T16:18:22.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:21 smithi134 ceph-mon[85099]: pgmap v141: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:22.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:21 smithi006 ceph-mon[103869]: pgmap v141: 65 pgs: 16 active+undersized+degraded, 18 active+undersized, 31 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 54/330 objects degraded (16.364%) 2024-03-12T16:18:24.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:23 smithi134 ceph-mon[85099]: pgmap v143: 65 pgs: 7 peering, 12 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/330 objects degraded (13.030%) 2024-03-12T16:18:24.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:23 smithi134 ceph-mon[85099]: Health check update: Degraded data redundancy: 43/330 objects degraded (13.030%), 12 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:24.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:23 smithi006 ceph-mon[103869]: pgmap v143: 65 pgs: 7 peering, 12 active+undersized+degraded, 15 active+undersized, 31 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 43/330 objects degraded (13.030%) 2024-03-12T16:18:24.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:23 smithi006 ceph-mon[103869]: Health check update: Degraded data redundancy: 43/330 objects degraded (13.030%), 12 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:25.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:24 smithi134 ceph-mon[85099]: pgmap v144: 65 pgs: 7 peering, 1 active+undersized, 57 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:25.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:24 smithi134 ceph-mon[85099]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/330 objects degraded (13.030%), 12 pgs degraded) 2024-03-12T16:18:25.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:24 smithi134 ceph-mon[85099]: Cluster is now healthy 2024-03-12T16:18:25.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:24 smithi006 ceph-mon[103869]: pgmap v144: 65 pgs: 7 peering, 1 active+undersized, 57 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:25.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:24 smithi006 ceph-mon[103869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 43/330 objects degraded (13.030%), 12 pgs degraded) 2024-03-12T16:18:25.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:24 smithi006 ceph-mon[103869]: Cluster is now healthy 2024-03-12T16:18:27.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:26 smithi134 ceph-mon[85099]: pgmap v145: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:27.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:26 smithi006 ceph-mon[103869]: pgmap v145: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:29 smithi134 ceph-mon[85099]: pgmap v146: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:29 smithi006 ceph-mon[103869]: pgmap v146: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:31 smithi134 ceph-mon[85099]: pgmap v147: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:31 smithi006 ceph-mon[103869]: pgmap v147: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:33.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:32 smithi134 ceph-mon[85099]: pgmap v148: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:33.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:33.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:18:33.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:33.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:32 smithi006 ceph-mon[103869]: pgmap v148: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:33.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:33.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:18:33.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:35.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:35 smithi134 ceph-mon[85099]: pgmap v149: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:35.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:35 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-12T16:18:35.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:35 smithi134 ceph-mon[85099]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-12T16:18:35.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:35 smithi134 ceph-mon[85099]: Upgrade: osd.5 is safe to restart 2024-03-12T16:18:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:35 smithi006 ceph-mon[103869]: pgmap v149: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:35 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-12T16:18:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:35 smithi006 ceph-mon[103869]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["5"], "max": 16}]: dispatch 2024-03-12T16:18:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:35 smithi006 ceph-mon[103869]: Upgrade: osd.5 is safe to restart 2024-03-12T16:18:37.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:37 smithi134 ceph-mon[85099]: pgmap v150: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:37.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:37 smithi134 ceph-mon[85099]: Upgrade: Updating osd.5 2024-03-12T16:18:37.440 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:37 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:37.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:37 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-12T16:18:37.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:37 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:37.441 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:37 smithi134 ceph-mon[85099]: Deploying daemon osd.5 on smithi134 2024-03-12T16:18:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:37 smithi006 ceph-mon[103869]: pgmap v150: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:37 smithi006 ceph-mon[103869]: Upgrade: Updating osd.5 2024-03-12T16:18:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:37 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:37 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-03-12T16:18:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:37 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:37.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:37 smithi006 ceph-mon[103869]: Deploying daemon osd.5 on smithi134 2024-03-12T16:18:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.548+0000 7f9e35757700 1 -- 172.21.15.6:0/3847439907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 msgr2=0x7f9e300fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.548+0000 7f9e35757700 1 --2- 172.21.15.6:0/3847439907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 0x7f9e300fdd50 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f9e200047f0 tx=0x7f9e20009cb0).stop 2024-03-12T16:18:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.548+0000 7f9e35757700 1 -- 172.21.15.6:0/3847439907 shutdown_connections 2024-03-12T16:18:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.549+0000 7f9e35757700 1 --2- 172.21.15.6:0/3847439907 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e300fe2d0 0x7f9e300f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:38.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.549+0000 7f9e35757700 1 --2- 172.21.15.6:0/3847439907 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 0x7f9e300fdd50 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.549+0000 7f9e35757700 1 -- 172.21.15.6:0/3847439907 >> 172.21.15.6:0/3847439907 conn(0x7f9e300f3550 msgr2=0x7f9e300f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.549+0000 7f9e35757700 1 -- 172.21.15.6:0/3847439907 shutdown_connections 2024-03-12T16:18:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.549+0000 7f9e35757700 1 -- 172.21.15.6:0/3847439907 wait complete. 2024-03-12T16:18:38.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.549+0000 7f9e35757700 1 Processor -- start 2024-03-12T16:18:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.549+0000 7f9e35757700 1 -- start start 2024-03-12T16:18:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e35757700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 0x7f9e3006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e35757700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e300fe2d0 0x7f9e3006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e35757700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3006bab0 con 0x7f9e300fd970 2024-03-12T16:18:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e35757700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9e3006bbf0 con 0x7f9e300fe2d0 2024-03-12T16:18:38.553 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 0x7f9e3006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e2effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 0x7f9e3006b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50980/0 (socket says 172.21.15.6:50980) 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e2effd700 1 -- 172.21.15.6:0/3242530882 learned_addr learned my addr 172.21.15.6:0/3242530882 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e2e7fc700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e300fe2d0 0x7f9e3006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e2effd700 1 -- 172.21.15.6:0/3242530882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e300fe2d0 msgr2=0x7f9e3006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e2effd700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e300fe2d0 0x7f9e3006b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e2effd700 1 -- 172.21.15.6:0/3242530882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9e20005040 con 0x7f9e300fd970 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e2effd700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 0x7f9e3006b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f9e20009380 tx=0x7f9e20009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.550+0000 7f9e17fff700 1 -- 172.21.15.6:0/3242530882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e20018070 con 0x7f9e300fd970 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.551+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9e3006be40 con 0x7f9e300fd970 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.551+0000 7f9e17fff700 1 -- 172.21.15.6:0/3242530882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9e20007e90 con 0x7f9e300fd970 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.551+0000 7f9e17fff700 1 -- 172.21.15.6:0/3242530882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9e2001c380 con 0x7f9e300fd970 2024-03-12T16:18:38.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.551+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9e30114740 con 0x7f9e300fd970 2024-03-12T16:18:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.552+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9e30060370 con 0x7f9e300fd970 2024-03-12T16:18:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.552+0000 7f9e17fff700 1 -- 172.21.15.6:0/3242530882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9e200123c0 con 0x7f9e300fd970 2024-03-12T16:18:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.553+0000 7f9e17fff700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9e1806cab0 0x7f9e1806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:38.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.553+0000 7f9e17fff700 1 -- 172.21.15.6:0/3242530882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f9e2008cb10 con 0x7f9e300fd970 2024-03-12T16:18:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.553+0000 7f9e2e7fc700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9e1806cab0 0x7f9e1806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:38.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.553+0000 7f9e2e7fc700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9e1806cab0 0x7f9e1806ef70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f9e3006c870 tx=0x7f9e2400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:38.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.557+0000 7f9e17fff700 1 -- 172.21.15.6:0/3242530882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9e20056c90 con 0x7f9e300fd970 2024-03-12T16:18:38.777 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.775+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9e3006c6f0 con 0x7f9e1806cab0 2024-03-12T16:18:38.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.776+0000 7f9e17fff700 1 -- 172.21.15.6:0/3242530882 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f9e2400f040 con 0x7f9e1806cab0 2024-03-12T16:18:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9e1806cab0 msgr2=0x7f9e1806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9e1806cab0 0x7f9e1806ef70 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 rx=0x7f9e3006c870 tx=0x7f9e2400b040).stop 2024-03-12T16:18:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 msgr2=0x7f9e3006b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:38.780 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 0x7f9e3006b0d0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7f9e20009380 tx=0x7f9e20009cb0).stop 2024-03-12T16:18:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 shutdown_connections 2024-03-12T16:18:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9e1806cab0 0x7f9e1806ef70 unknown :-1 s=CLOSED pgs=74 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9e300fd970 0x7f9e3006b0d0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 --2- 172.21.15.6:0/3242530882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9e300fe2d0 0x7f9e3006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 >> 172.21.15.6:0/3242530882 conn(0x7f9e300f3550 msgr2=0x7f9e300fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 shutdown_connections 2024-03-12T16:18:38.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.778+0000 7f9e35757700 1 -- 172.21.15.6:0/3242530882 wait complete. 2024-03-12T16:18:38.791 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:18:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.881+0000 7fd43ac5a700 1 -- 172.21.15.6:0/3654607568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 msgr2=0x7fd4340fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.881+0000 7fd43ac5a700 1 --2- 172.21.15.6:0/3654607568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 0x7fd4340fdcd0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7fd4280047f0 tx=0x7fd428009cb0).stop 2024-03-12T16:18:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.881+0000 7fd43ac5a700 1 -- 172.21.15.6:0/3654607568 shutdown_connections 2024-03-12T16:18:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.881+0000 7fd43ac5a700 1 --2- 172.21.15.6:0/3654607568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340fe250 0x7fd4340f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.881+0000 7fd43ac5a700 1 --2- 172.21.15.6:0/3654607568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 0x7fd4340fdcd0 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.881+0000 7fd43ac5a700 1 -- 172.21.15.6:0/3654607568 >> 172.21.15.6:0/3654607568 conn(0x7fd4340f34b0 msgr2=0x7fd4340f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.881+0000 7fd43ac5a700 1 -- 172.21.15.6:0/3654607568 shutdown_connections 2024-03-12T16:18:38.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.881+0000 7fd43ac5a700 1 -- 172.21.15.6:0/3654607568 wait complete. 2024-03-12T16:18:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.882+0000 7fd43ac5a700 1 Processor -- start 2024-03-12T16:18:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.882+0000 7fd43ac5a700 1 -- start start 2024-03-12T16:18:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.882+0000 7fd43ac5a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 0x7fd43410e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd43ac5a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340fe250 0x7fd43410e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd43ac5a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43410ebe0 con 0x7fd4340fd8f0 2024-03-12T16:18:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd43ac5a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd43410ed20 con 0x7fd4340fe250 2024-03-12T16:18:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd4389f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 0x7fd43410e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:38.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd4389f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 0x7fd43410e0f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50994/0 (socket says 172.21.15.6:50994) 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd4389f6700 1 -- 172.21.15.6:0/1868749357 learned_addr learned my addr 172.21.15.6:0/1868749357 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd433fff700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340fe250 0x7fd43410e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd4389f6700 1 -- 172.21.15.6:0/1868749357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340fe250 msgr2=0x7fd43410e5e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd4389f6700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340fe250 0x7fd43410e5e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd4389f6700 1 -- 172.21.15.6:0/1868749357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd428005040 con 0x7fd4340fd8f0 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd4389f6700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 0x7fd43410e0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fd428009380 tx=0x7fd428009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd431ffb700 1 -- 172.21.15.6:0/1868749357 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd428018070 con 0x7fd4340fd8f0 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd431ffb700 1 -- 172.21.15.6:0/1868749357 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd428007e90 con 0x7fd4340fd8f0 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd434108350 con 0x7fd4340fd8f0 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd431ffb700 1 -- 172.21.15.6:0/1868749357 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd4280123c0 con 0x7fd4340fd8f0 2024-03-12T16:18:38.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.883+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd4341088b0 con 0x7fd4340fd8f0 2024-03-12T16:18:38.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.885+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd43405f590 con 0x7fd4340fd8f0 2024-03-12T16:18:38.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.885+0000 7fd431ffb700 1 -- 172.21.15.6:0/1868749357 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd42801d420 con 0x7fd4340fd8f0 2024-03-12T16:18:38.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.885+0000 7fd431ffb700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd42406caa0 0x7fd42406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:38.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.886+0000 7fd431ffb700 1 -- 172.21.15.6:0/1868749357 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6047+0+0 (secure 0 0 0) 0x7fd42808c870 con 0x7fd4340fd8f0 2024-03-12T16:18:38.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.886+0000 7fd433fff700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd42406caa0 0x7fd42406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:38.889 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.886+0000 7fd433fff700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd42406caa0 0x7fd42406ef60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd434109a30 tx=0x7fd42000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:38.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:38.890+0000 7fd431ffb700 1 -- 172.21.15.6:0/1868749357 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd42805a480 con 0x7fd4340fd8f0 2024-03-12T16:18:39.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.105+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd4340ffc40 con 0x7fd42406caa0 2024-03-12T16:18:39.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.106+0000 7fd431ffb700 1 -- 172.21.15.6:0/1868749357 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7fd4340ffc40 con 0x7fd42406caa0 2024-03-12T16:18:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd42406caa0 msgr2=0x7fd42406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd42406caa0 0x7fd42406ef60 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 rx=0x7fd434109a30 tx=0x7fd42000b040).stop 2024-03-12T16:18:39.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 msgr2=0x7fd43410e0f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 0x7fd43410e0f0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7fd428009380 tx=0x7fd428009cb0).stop 2024-03-12T16:18:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 shutdown_connections 2024-03-12T16:18:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd42406caa0 0x7fd42406ef60 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd4340fd8f0 0x7fd43410e0f0 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 --2- 172.21.15.6:0/1868749357 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd4340fe250 0x7fd43410e5e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 >> 172.21.15.6:0/1868749357 conn(0x7fd4340f34b0 msgr2=0x7fd4340fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 shutdown_connections 2024-03-12T16:18:39.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.108+0000 7fd43ac5a700 1 -- 172.21.15.6:0/1868749357 wait complete. 2024-03-12T16:18:39.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.210+0000 7f33b7712700 1 -- 172.21.15.6:0/3272570987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 msgr2=0x7f33b00f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.210+0000 7f33b7712700 1 --2- 172.21.15.6:0/3272570987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 0x7f33b00f7ab0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f33a00047f0 tx=0x7f33a0009cb0).stop 2024-03-12T16:18:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.210+0000 7f33b7712700 1 -- 172.21.15.6:0/3272570987 shutdown_connections 2024-03-12T16:18:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.210+0000 7f33b7712700 1 --2- 172.21.15.6:0/3272570987 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 0x7f33b00f7ab0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.210+0000 7f33b7712700 1 --2- 172.21.15.6:0/3272570987 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33b00fd970 0x7f33b00fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.210+0000 7f33b7712700 1 -- 172.21.15.6:0/3272570987 >> 172.21.15.6:0/3272570987 conn(0x7f33b00f3550 msgr2=0x7f33b00f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.210+0000 7f33b7712700 1 -- 172.21.15.6:0/3272570987 shutdown_connections 2024-03-12T16:18:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.210+0000 7f33b7712700 1 -- 172.21.15.6:0/3272570987 wait complete. 2024-03-12T16:18:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b7712700 1 Processor -- start 2024-03-12T16:18:39.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b7712700 1 -- start start 2024-03-12T16:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b7712700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33b00fd970 0x7f33b010e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b7712700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 0x7f33b010e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b7712700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b010ec20 con 0x7f33b00fe2d0 2024-03-12T16:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b7712700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f33b010ed60 con 0x7f33b00fd970 2024-03-12T16:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b4cad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 0x7f33b010e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b4cad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 0x7f33b010e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51016/0 (socket says 172.21.15.6:51016) 2024-03-12T16:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b4cad700 1 -- 172.21.15.6:0/1608498852 learned_addr learned my addr 172.21.15.6:0/1608498852 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b54ae700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33b00fd970 0x7f33b010e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:39.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b4cad700 1 -- 172.21.15.6:0/1608498852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33b00fd970 msgr2=0x7f33b010e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b4cad700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33b00fd970 0x7f33b010e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b4cad700 1 -- 172.21.15.6:0/1608498852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f33a0005040 con 0x7f33b00fe2d0 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.211+0000 7f33b4cad700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 0x7f33b010e620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f33a0000c00 tx=0x7f33a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.212+0000 7f33a67fc700 1 -- 172.21.15.6:0/1608498852 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33a0018070 con 0x7f33b00fe2d0 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.212+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f33b0108390 con 0x7f33b00fe2d0 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.212+0000 7f33a67fc700 1 -- 172.21.15.6:0/1608498852 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f33a0007e90 con 0x7f33b00fe2d0 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.212+0000 7f33a67fc700 1 -- 172.21.15.6:0/1608498852 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33a001de20 con 0x7f33b00fe2d0 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.212+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f33b01088f0 con 0x7f33b00fe2d0 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.213+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f33b0060370 con 0x7f33b00fe2d0 2024-03-12T16:18:39.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.213+0000 7f33a67fc700 1 -- 172.21.15.6:0/1608498852 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f33a001d420 con 0x7f33b00fe2d0 2024-03-12T16:18:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.214+0000 7f33a67fc700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339c06ca30 0x7f339c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.214+0000 7f33a67fc700 1 -- 172.21.15.6:0/1608498852 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f33a008c820 con 0x7f33b00fe2d0 2024-03-12T16:18:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.214+0000 7f33b54ae700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339c06ca30 0x7f339c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:39.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.214+0000 7f33b54ae700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339c06ca30 0x7f339c06eef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f33ac0048b0 tx=0x7f33ac00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:39.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.218+0000 7f33a67fc700 1 -- 172.21.15.6:0/1608498852 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f33a005a430 con 0x7f33b00fe2d0 2024-03-12T16:18:39.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.428+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f33b00ffcc0 con 0x7f339c06ca30 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.438+0000 7f33a67fc700 1 -- 172.21.15.6:0/1608498852 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f33b00ffcc0 con 0x7f339c06ca30 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (5m) 93s ago 16m 26.2M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (3m) 93s ago 16m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (3m) 24s ago 15m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (5m) 93s ago 16m 89.5M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (11m) 93s ago 11m 124M - 16.2.15-1-g8963e9de 727f386679cb b1580c25ae52 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (11m) 93s ago 11m 15.7M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (11m) 24s ago 11m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (11m) 24s ago 11m 18.4M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:18:39.440 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (7m) 93s ago 17m 500M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (6m) 24s ago 15m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (4m) 93s ago 17m 46.0M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (3m) 24s ago 15m 38.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (6m) 93s ago 16m 17.2M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (5m) 24s ago 15m 18.6M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (2m) 93s ago 15m 88.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (2m) 93s ago 14m 92.1M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (98s) 93s ago 14m 13.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (62s) 24s ago 13m 99.8M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (28s) 24s ago 13m 13.6M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (12m) 24s ago 12m 226M 2251M 16.2.15-1-g8963e9de 727f386679cb b9e165454f0a 2024-03-12T16:18:39.441 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (5m) 24s ago 14m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:18:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339c06ca30 msgr2=0x7f339c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339c06ca30 0x7f339c06eef0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 rx=0x7f33ac0048b0 tx=0x7f33ac00b040).stop 2024-03-12T16:18:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 msgr2=0x7f33b010e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 0x7f33b010e620 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f33a0000c00 tx=0x7f33a0009cb0).stop 2024-03-12T16:18:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 shutdown_connections 2024-03-12T16:18:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f33b00fd970 0x7f33b010e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f339c06ca30 0x7f339c06eef0 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 --2- 172.21.15.6:0/1608498852 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f33b00fe2d0 0x7f33b010e620 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 >> 172.21.15.6:0/1608498852 conn(0x7f33b00f3550 msgr2=0x7f33b00fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 shutdown_connections 2024-03-12T16:18:39.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.440+0000 7f33b7712700 1 -- 172.21.15.6:0/1608498852 wait complete. 2024-03-12T16:18:39.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:39 smithi134 ceph-mon[85099]: pgmap v151: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.540+0000 7efe30e6d700 1 -- 172.21.15.6:0/2561932578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 msgr2=0x7efe2c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.540+0000 7efe30e6d700 1 --2- 172.21.15.6:0/2561932578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 0x7efe2c0fcbd0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7efe140047f0 tx=0x7efe14009cb0).stop 2024-03-12T16:18:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.540+0000 7efe30e6d700 1 -- 172.21.15.6:0/2561932578 shutdown_connections 2024-03-12T16:18:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.540+0000 7efe30e6d700 1 --2- 172.21.15.6:0/2561932578 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe2c0fd150 0x7efe2c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:18:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.541+0000 7efe30e6d700 1 --2- 172.21.15.6:0/2561932578 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 0x7efe2c0fcbd0 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.541+0000 7efe30e6d700 1 -- 172.21.15.6:0/2561932578 >> 172.21.15.6:0/2561932578 conn(0x7efe2c070590 msgr2=0x7efe2c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.541+0000 7efe30e6d700 1 -- 172.21.15.6:0/2561932578 shutdown_connections 2024-03-12T16:18:39.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.541+0000 7efe30e6d700 1 -- 172.21.15.6:0/2561932578 wait complete. 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.541+0000 7efe30e6d700 1 Processor -- start 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.541+0000 7efe30e6d700 1 -- start start 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe30e6d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 0x7efe2c10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe30e6d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe2c0fd150 0x7efe2c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe30e6d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c10ebe0 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe30e6d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efe2c108200 con 0x7efe2c0fd150 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe2a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 0x7efe2c10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe2a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 0x7efe2c10e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51036/0 (socket says 172.21.15.6:51036) 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe2a59c700 1 -- 172.21.15.6:0/336848131 learned_addr learned my addr 172.21.15.6:0/336848131 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe29d9b700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe2c0fd150 0x7efe2c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:39.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe2a59c700 1 -- 172.21.15.6:0/336848131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe2c0fd150 msgr2=0x7efe2c10e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe2a59c700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe2c0fd150 0x7efe2c10e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe2a59c700 1 -- 172.21.15.6:0/336848131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efe14005040 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe2a59c700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 0x7efe2c10e060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7efe1400b120 tx=0x7efe14009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe237fe700 1 -- 172.21.15.6:0/336848131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe1400e030 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe237fe700 1 -- 172.21.15.6:0/336848131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efe14007e90 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efe2c108450 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe237fe700 1 -- 172.21.15.6:0/336848131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efe14018070 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.542+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efe2c108930 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.543+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efe2c05f590 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.544+0000 7efe237fe700 1 -- 172.21.15.6:0/336848131 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7efe1401d420 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.544+0000 7efe237fe700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efe1806caa0 0x7efe1806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.544+0000 7efe237fe700 1 -- 172.21.15.6:0/336848131 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6047+0+0 (secure 0 0 0) 0x7efe1408d000 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.545+0000 7efe29d9b700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efe1806caa0 0x7efe1806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:39.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.545+0000 7efe29d9b700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efe1806caa0 0x7efe1806ef60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7efe2c1099a0 tx=0x7efe1c009060).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:39.551 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.549+0000 7efe237fe700 1 -- 172.21.15.6:0/336848131 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7efe1405ac10 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:39 smithi006 ceph-mon[103869]: pgmap v151: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:39.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.830+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7efe2c109080 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.831+0000 7efe237fe700 1 -- 172.21.15.6:0/336848131 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+843 (secure 0 0 0) 0x7efe1405a7a0 con 0x7efe2c0fc7f0 2024-03-12T16:18:39.833 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:18:39.833 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:18:39.833 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:18:39.833 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:18:39.833 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:18:39.833 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 5 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 4 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 5, 2024-03-12T16:18:39.834 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 9 2024-03-12T16:18:39.835 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:18:39.835 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:18:39.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efe1806caa0 msgr2=0x7efe1806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efe1806caa0 0x7efe1806ef60 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 rx=0x7efe2c1099a0 tx=0x7efe1c009060).stop 2024-03-12T16:18:39.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 msgr2=0x7efe2c10e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 0x7efe2c10e060 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7efe1400b120 tx=0x7efe14009cb0).stop 2024-03-12T16:18:39.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 shutdown_connections 2024-03-12T16:18:39.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efe1806caa0 0x7efe1806ef60 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efe2c0fc7f0 0x7efe2c10e060 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 --2- 172.21.15.6:0/336848131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efe2c0fd150 0x7efe2c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 >> 172.21.15.6:0/336848131 conn(0x7efe2c070590 msgr2=0x7efe2c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:39.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 shutdown_connections 2024-03-12T16:18:39.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.833+0000 7efe30e6d700 1 -- 172.21.15.6:0/336848131 wait complete. 2024-03-12T16:18:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.934+0000 7f2919486700 1 -- 172.21.15.6:0/3366892573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 msgr2=0x7f29140f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.934+0000 7f2919486700 1 --2- 172.21.15.6:0/3366892573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 0x7f29140f7a30 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f29080047f0 tx=0x7f2908009cb0).stop 2024-03-12T16:18:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.934+0000 7f2919486700 1 -- 172.21.15.6:0/3366892573 shutdown_connections 2024-03-12T16:18:39.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.934+0000 7f2919486700 1 --2- 172.21.15.6:0/3366892573 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 0x7f29140f7a30 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.934+0000 7f2919486700 1 --2- 172.21.15.6:0/3366892573 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29140fd8f0 0x7f29140fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.934+0000 7f2919486700 1 -- 172.21.15.6:0/3366892573 >> 172.21.15.6:0/3366892573 conn(0x7f29140f34b0 msgr2=0x7f29140f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.934+0000 7f2919486700 1 -- 172.21.15.6:0/3366892573 shutdown_connections 2024-03-12T16:18:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.934+0000 7f2919486700 1 -- 172.21.15.6:0/3366892573 wait complete. 2024-03-12T16:18:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.935+0000 7f2919486700 1 Processor -- start 2024-03-12T16:18:39.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.935+0000 7f2919486700 1 -- start start 2024-03-12T16:18:39.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.935+0000 7f2919486700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29140fd8f0 0x7f291410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.935+0000 7f2919486700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 0x7f291410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.935+0000 7f2919486700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291410eae0 con 0x7f29140fe250 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.935+0000 7f2919486700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f291410ec20 con 0x7f29140fd8f0 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f29127fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 0x7f291410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f29127fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 0x7f291410e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51050/0 (socket says 172.21.15.6:51050) 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f29127fc700 1 -- 172.21.15.6:0/3261216750 learned_addr learned my addr 172.21.15.6:0/3261216750 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f2912ffd700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29140fd8f0 0x7f291410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f29127fc700 1 -- 172.21.15.6:0/3261216750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29140fd8f0 msgr2=0x7f291410dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f29127fc700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29140fd8f0 0x7f291410dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f29127fc700 1 -- 172.21.15.6:0/3261216750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2908005040 con 0x7f29140fe250 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f29127fc700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 0x7f291410e4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f29080099f0 tx=0x7f2908009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:39.941 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f28fbfff700 1 -- 172.21.15.6:0/3261216750 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f290800e030 con 0x7f29140fe250 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f28fbfff700 1 -- 172.21.15.6:0/3261216750 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2908007e90 con 0x7f29140fe250 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2914108250 con 0x7f29140fe250 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f28fbfff700 1 -- 172.21.15.6:0/3261216750 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2908018070 con 0x7f29140fe250 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.936+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29141087b0 con 0x7f29140fe250 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.937+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f291405f590 con 0x7f29140fe250 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.938+0000 7f28fbfff700 1 -- 172.21.15.6:0/3261216750 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f29080094c0 con 0x7f29140fe250 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.938+0000 7f28fbfff700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f28fc06caa0 0x7f28fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.938+0000 7f28fbfff700 1 -- 172.21.15.6:0/3261216750 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(74..74 src has 1..74) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f290808cfd0 con 0x7f29140fe250 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.938+0000 7f2912ffd700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f28fc06caa0 0x7f28fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:39.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.939+0000 7f2912ffd700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f28fc06caa0 0x7f28fc06ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2904004de0 tx=0x7f290400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:39.944 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:39.943+0000 7f28fbfff700 1 -- 172.21.15.6:0/3261216750 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f290805abe0 con 0x7f29140fe250 2024-03-12T16:18:39.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:39 smithi134 systemd[1]: Stopping Ceph osd.5 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:18:39.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[59654]: debug 2024-03-12T16:18:39.711+0000 7f8389e82700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-stderr=true --default-log-stderr-prefix=debug (PID: 1) UID: 0 2024-03-12T16:18:39.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[59654]: debug 2024-03-12T16:18:39.711+0000 7f8389e82700 -1 osd.5 74 *** Got signal Terminated *** 2024-03-12T16:18:39.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:39 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[59654]: debug 2024-03-12T16:18:39.711+0000 7f8389e82700 -1 osd.5 74 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:18:40.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.181+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f2914047540 con 0x7f29140fe250 2024-03-12T16:18:40.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.181+0000 7f28fbfff700 1 -- 172.21.15.6:0/3261216750 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 16 v16) v1 ==== 76+0+1851 (secure 0 0 0) 0x7f290805a770 con 0x7f29140fe250 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout:e16 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 16 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:18:40.184 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:14:55.638904+0000 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 0 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:18:40.185 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=14432,1=24271} 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:14432} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.6:6826/163878097,v1:172.21.15.6:6827/163878097] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{1:24271} state up:active seq 2 join_fscid=1 addr [v2:172.21.15.134:6824/3713757560,v1:172.21.15.134:6825/3713757560] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:18:40.186 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:18:40.187 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:18:40.187 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:18:40.187 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:18:40.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.183+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f28fc06caa0 msgr2=0x7f28fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.183+0000 7f2919486700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f28fc06caa0 0x7f28fc06ef60 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 rx=0x7f2904004de0 tx=0x7f290400b040).stop 2024-03-12T16:18:40.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.183+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 msgr2=0x7f291410e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.183+0000 7f2919486700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 0x7f291410e4e0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f29080099f0 tx=0x7f2908009cb0).stop 2024-03-12T16:18:40.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.183+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 shutdown_connections 2024-03-12T16:18:40.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.183+0000 7f2919486700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29140fd8f0 0x7f291410dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.183+0000 7f2919486700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f28fc06caa0 0x7f28fc06ef60 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.183+0000 7f2919486700 1 --2- 172.21.15.6:0/3261216750 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29140fe250 0x7f291410e4e0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.183+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 >> 172.21.15.6:0/3261216750 conn(0x7f29140f34b0 msgr2=0x7f29140fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:40.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.184+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 shutdown_connections 2024-03-12T16:18:40.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.184+0000 7f2919486700 1 -- 172.21.15.6:0/3261216750 wait complete. 2024-03-12T16:18:40.188 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-03-12T16:18:40.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.292+0000 7f69f0a91700 1 -- 172.21.15.6:0/2925960337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f9260 msgr2=0x7f69ec101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.292+0000 7f69f0a91700 1 --2- 172.21.15.6:0/2925960337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f9260 0x7f69ec101970 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f69d40047f0 tx=0x7f69d4009cb0).stop 2024-03-12T16:18:40.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.292+0000 7f69f0a91700 1 -- 172.21.15.6:0/2925960337 shutdown_connections 2024-03-12T16:18:40.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.292+0000 7f69f0a91700 1 --2- 172.21.15.6:0/2925960337 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f9260 0x7f69ec101970 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.292+0000 7f69f0a91700 1 --2- 172.21.15.6:0/2925960337 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ec0f8900 0x7f69ec0f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.292+0000 7f69f0a91700 1 -- 172.21.15.6:0/2925960337 >> 172.21.15.6:0/2925960337 conn(0x7f69ec070590 msgr2=0x7f69ec0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:40.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.292+0000 7f69f0a91700 1 -- 172.21.15.6:0/2925960337 shutdown_connections 2024-03-12T16:18:40.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.292+0000 7f69f0a91700 1 -- 172.21.15.6:0/2925960337 wait complete. 2024-03-12T16:18:40.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69f0a91700 1 Processor -- start 2024-03-12T16:18:40.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69f0a91700 1 -- start start 2024-03-12T16:18:40.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69f0a91700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f8900 0x7f69ec10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:40.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69f0a91700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ec0f9260 0x7f69ec10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69f0a91700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec10eb70 con 0x7f69ec0f8900 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69f0a91700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69ec10ecb0 con 0x7f69ec0f9260 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f8900 0x7f69ec10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f8900 0x7f69ec10e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51070/0 (socket says 172.21.15.6:51070) 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69ea59c700 1 -- 172.21.15.6:0/1936937997 learned_addr learned my addr 172.21.15.6:0/1936937997 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69e9d9b700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ec0f9260 0x7f69ec10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69ea59c700 1 -- 172.21.15.6:0/1936937997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ec0f9260 msgr2=0x7f69ec10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69ea59c700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ec0f9260 0x7f69ec10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69ea59c700 1 -- 172.21.15.6:0/1936937997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d4005040 con 0x7f69ec0f8900 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.293+0000 7f69ea59c700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f8900 0x7f69ec10e080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f69dc00ec20 tx=0x7f69dc00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.294+0000 7f69e37fe700 1 -- 172.21.15.6:0/1936937997 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc0092e0 con 0x7f69ec0f8900 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.294+0000 7f69e37fe700 1 -- 172.21.15.6:0/1936937997 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69dc00f040 con 0x7f69ec0f8900 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.294+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69ec108340 con 0x7f69ec0f8900 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.294+0000 7f69e37fe700 1 -- 172.21.15.6:0/1936937997 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69dc00ca80 con 0x7f69ec0f8900 2024-03-12T16:18:40.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.294+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69ec108880 con 0x7f69ec0f8900 2024-03-12T16:18:40.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.295+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69ec05f590 con 0x7f69ec0f8900 2024-03-12T16:18:40.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.295+0000 7f69e37fe700 1 -- 172.21.15.6:0/1936937997 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f69dc003020 con 0x7f69ec0f8900 2024-03-12T16:18:40.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.296+0000 7f69e37fe700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d806caa0 0x7f69d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:40.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.296+0000 7f69e9d9b700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d806caa0 0x7f69d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:40.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.296+0000 7f69e37fe700 1 -- 172.21.15.6:0/1936937997 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6047+0+0 (secure 0 0 0) 0x7f69dc08bb30 con 0x7f69ec0f8900 2024-03-12T16:18:40.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.296+0000 7f69e9d9b700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d806caa0 0x7f69d806ef60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f69d4004540 tx=0x7f69d4009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:40.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.300+0000 7f69e37fe700 1 -- 172.21.15.6:0/1936937997 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f69dc059740 con 0x7f69ec0f8900 2024-03-12T16:18:40.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.516+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69ec0fee70 con 0x7f69d806caa0 2024-03-12T16:18:40.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.518+0000 7f69e37fe700 1 -- 172.21.15.6:0/1936937997 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+401 (secure 0 0 0) 0x7f69ec0fee70 con 0x7f69d806caa0 2024-03-12T16:18:40.520 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:18:40.520 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:18:40.520 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:18:40.520 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:18:40.520 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:18:40.521 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:18:40.521 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:18:40.521 INFO:teuthology.orchestra.run.smithi006.stdout: "crash" 2024-03-12T16:18:40.521 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:18:40.521 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "11/21 daemons upgraded", 2024-03-12T16:18:40.521 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading osd daemons", 2024-03-12T16:18:40.521 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:18:40.521 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:18:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d806caa0 msgr2=0x7f69d806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d806caa0 0x7f69d806ef60 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 rx=0x7f69d4004540 tx=0x7f69d4009cb0).stop 2024-03-12T16:18:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f8900 msgr2=0x7f69ec10e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f8900 0x7f69ec10e080 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f69dc00ec20 tx=0x7f69dc00b040).stop 2024-03-12T16:18:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 shutdown_connections 2024-03-12T16:18:40.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d806caa0 0x7f69d806ef60 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69ec0f8900 0x7f69ec10e080 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 --2- 172.21.15.6:0/1936937997 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69ec0f9260 0x7f69ec10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 >> 172.21.15.6:0/1936937997 conn(0x7f69ec070590 msgr2=0x7f69ec0fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 shutdown_connections 2024-03-12T16:18:40.523 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.520+0000 7f69f0a91700 1 -- 172.21.15.6:0/1936937997 wait complete. 2024-03-12T16:18:40.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:40 smithi134 ceph-mon[85099]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:40.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:40 smithi134 ceph-mon[85099]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:40.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:40 smithi134 ceph-mon[85099]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:40.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:40 smithi134 ceph-mon[85099]: osd.5 marked itself down and dead 2024-03-12T16:18:40.585 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:40 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/336848131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:40.586 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:40 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3261216750' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:18:40.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.621+0000 7ffb11192700 1 -- 172.21.15.6:0/2304656725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f8940 msgr2=0x7ffb0c0f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.621+0000 7ffb11192700 1 --2- 172.21.15.6:0/2304656725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f8940 0x7ffb0c0f8d20 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7ffafc0047f0 tx=0x7ffafc009cb0).stop 2024-03-12T16:18:40.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.621+0000 7ffb11192700 1 -- 172.21.15.6:0/2304656725 shutdown_connections 2024-03-12T16:18:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.621+0000 7ffb11192700 1 --2- 172.21.15.6:0/2304656725 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb0c0f9210 0x7ffb0c1019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.621+0000 7ffb11192700 1 --2- 172.21.15.6:0/2304656725 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f8940 0x7ffb0c0f8d20 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.621+0000 7ffb11192700 1 -- 172.21.15.6:0/2304656725 >> 172.21.15.6:0/2304656725 conn(0x7ffb0c070590 msgr2=0x7ffb0c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.621+0000 7ffb11192700 1 -- 172.21.15.6:0/2304656725 shutdown_connections 2024-03-12T16:18:40.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.621+0000 7ffb11192700 1 -- 172.21.15.6:0/2304656725 wait complete. 2024-03-12T16:18:40.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.622+0000 7ffb11192700 1 Processor -- start 2024-03-12T16:18:40.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.622+0000 7ffb11192700 1 -- start start 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.622+0000 7ffb11192700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb0c0f8940 0x7ffb0c10e170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.622+0000 7ffb11192700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f9210 0x7ffb0c10e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.622+0000 7ffb11192700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c10ec60 con 0x7ffb0c0f9210 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.622+0000 7ffb11192700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffb0c10eda0 con 0x7ffb0c0f8940 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb0a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f9210 0x7ffb0c10e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb0a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f9210 0x7ffb0c10e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:51100/0 (socket says 172.21.15.6:51100) 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb0a59c700 1 -- 172.21.15.6:0/3844492691 learned_addr learned my addr 172.21.15.6:0/3844492691 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb0ad9d700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb0c0f8940 0x7ffb0c10e170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb0a59c700 1 -- 172.21.15.6:0/3844492691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb0c0f8940 msgr2=0x7ffb0c10e170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb0a59c700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb0c0f8940 0x7ffb0c10e170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb0a59c700 1 -- 172.21.15.6:0/3844492691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffafc005040 con 0x7ffb0c0f9210 2024-03-12T16:18:40.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb0a59c700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f9210 0x7ffb0c10e660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ffaf400e8f0 tx=0x7ffaf400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:40.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb03fff700 1 -- 172.21.15.6:0/3844492691 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf4007b40 con 0x7ffb0c0f9210 2024-03-12T16:18:40.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffb0c108430 con 0x7ffb0c0f9210 2024-03-12T16:18:40.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb03fff700 1 -- 172.21.15.6:0/3844492691 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffaf400f040 con 0x7ffb0c0f9210 2024-03-12T16:18:40.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb03fff700 1 -- 172.21.15.6:0/3844492691 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffaf4014880 con 0x7ffb0c0f9210 2024-03-12T16:18:40.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.623+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffb0c108970 con 0x7ffb0c0f9210 2024-03-12T16:18:40.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.624+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffb0c05f590 con 0x7ffb0c0f9210 2024-03-12T16:18:40.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.625+0000 7ffb03fff700 1 -- 172.21.15.6:0/3844492691 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7ffaf4014b00 con 0x7ffb0c0f9210 2024-03-12T16:18:40.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.625+0000 7ffb03fff700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffaf806cab0 0x7ffaf806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:18:40.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.625+0000 7ffb0ad9d700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffaf806cab0 0x7ffaf806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:18:40.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.625+0000 7ffb03fff700 1 -- 172.21.15.6:0/3844492691 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(75..75 src has 1..75) v4 ==== 6047+0+0 (secure 0 0 0) 0x7ffaf408b8e0 con 0x7ffb0c0f9210 2024-03-12T16:18:40.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.626+0000 7ffb0ad9d700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffaf806cab0 0x7ffaf806ef70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ffafc004540 tx=0x7ffafc009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:18:40.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.630+0000 7ffb03fff700 1 -- 172.21.15.6:0/3844492691 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffaf40594f0 con 0x7ffb0c0f9210 2024-03-12T16:18:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:40 smithi006 ceph-mon[103869]: from='client.34338 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:40 smithi006 ceph-mon[103869]: from='client.34342 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:40 smithi006 ceph-mon[103869]: from='client.34346 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:40 smithi006 ceph-mon[103869]: osd.5 marked itself down and dead 2024-03-12T16:18:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:40 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/336848131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:40.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:40 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3261216750' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:18:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.911+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ffb0c0fbf00 con 0x7ffb0c0f9210 2024-03-12T16:18:40.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.912+0000 7ffb03fff700 1 -- 172.21.15.6:0/3844492691 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+343 (secure 0 0 0) 0x7ffaf4059080 con 0x7ffb0c0f9210 2024-03-12T16:18:40.914 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_WARN 1 osds down; all OSDs are running quincy or later but require_osd_release < quincy 2024-03-12T16:18:40.914 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] OSD_DOWN: 1 osds down 2024-03-12T16:18:40.914 INFO:teuthology.orchestra.run.smithi006.stdout: osd.5 (root=default,host=smithi134) is down 2024-03-12T16:18:40.914 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] OSD_UPGRADE_FINISHED: all OSDs are running quincy or later but require_osd_release < quincy 2024-03-12T16:18:40.914 INFO:teuthology.orchestra.run.smithi006.stdout: all OSDs are running quincy or later but require_osd_release < quincy 2024-03-12T16:18:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffaf806cab0 msgr2=0x7ffaf806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffaf806cab0 0x7ffaf806ef70 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 rx=0x7ffafc004540 tx=0x7ffafc009cb0).stop 2024-03-12T16:18:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f9210 msgr2=0x7ffb0c10e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:18:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f9210 0x7ffb0c10e660 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7ffaf400e8f0 tx=0x7ffaf400b040).stop 2024-03-12T16:18:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 shutdown_connections 2024-03-12T16:18:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffb0c0f8940 0x7ffb0c10e170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffaf806cab0 0x7ffaf806ef70 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 --2- 172.21.15.6:0/3844492691 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffb0c0f9210 0x7ffb0c10e660 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:18:40.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 >> 172.21.15.6:0/3844492691 conn(0x7ffb0c070590 msgr2=0x7ffb0c101400 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:18:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 shutdown_connections 2024-03-12T16:18:40.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:18:40.914+0000 7ffb11192700 1 -- 172.21.15.6:0/3844492691 wait complete. 2024-03-12T16:18:40.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:40 smithi134 bash[111681]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5 2024-03-12T16:18:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:41 smithi134 ceph-mon[85099]: pgmap v152: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:41 smithi134 ceph-mon[85099]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:18:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:41 smithi134 ceph-mon[85099]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2024-03-12T16:18:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:41 smithi134 ceph-mon[85099]: osdmap e75: 6 total, 5 up, 6 in 2024-03-12T16:18:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:41 smithi134 ceph-mon[85099]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:41.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:41 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3844492691' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:18:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:41 smithi006 ceph-mon[103869]: pgmap v152: 65 pgs: 65 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:41 smithi006 ceph-mon[103869]: Health check failed: 1 osds down (OSD_DOWN) 2024-03-12T16:18:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:41 smithi006 ceph-mon[103869]: Health check failed: all OSDs are running quincy or later but require_osd_release < quincy (OSD_UPGRADE_FINISHED) 2024-03-12T16:18:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:41 smithi006 ceph-mon[103869]: osdmap e75: 6 total, 5 up, 6 in 2024-03-12T16:18:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:41 smithi006 ceph-mon[103869]: from='client.34358 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:18:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:41 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3844492691' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:18:42.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:42 smithi134 ceph-mon[85099]: osdmap e76: 6 total, 5 up, 6 in 2024-03-12T16:18:42.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:42 smithi006 ceph-mon[103869]: osdmap e76: 6 total, 5 up, 6 in 2024-03-12T16:18:42.952 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:42 smithi134 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.5.service: Succeeded. 2024-03-12T16:18:42.952 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:42 smithi134 systemd[1]: Stopped Ceph osd.5 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:18:42.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:42 smithi134 systemd[1]: Starting Ceph osd.5 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:18:43.529 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:43 smithi134 ceph-mon[85099]: pgmap v155: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:43.530 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:43 smithi134 ceph-mon[85099]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-03-12T16:18:43.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:43 smithi006 ceph-mon[103869]: pgmap v155: 65 pgs: 3 peering, 12 stale+active+clean, 50 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:18:43.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:43 smithi006 ceph-mon[103869]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-03-12T16:18:43.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:43 smithi134 bash[111962]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-12T16:18:43.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:43 smithi134 bash[111962]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-5 --no-mon-config --dev /dev/mapper/vg_nvme-lv_2 2024-03-12T16:18:43.953 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:43 smithi134 bash[111962]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_2 2024-03-12T16:18:43.954 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:43 smithi134 bash[111962]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-1 2024-03-12T16:18:43.954 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:43 smithi134 bash[111962]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_2 /var/lib/ceph/osd/ceph-5/block 2024-03-12T16:18:43.954 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:43 smithi134 bash[111962]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-5 2024-03-12T16:18:43.954 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:43 smithi134 bash[111962]: --> ceph-volume raw activate successful for osd ID: 5 2024-03-12T16:18:44.613 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:44 smithi134 ceph-mon[85099]: Health check failed: Degraded data redundancy: 37/330 objects degraded (11.212%), 9 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:44.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:44 smithi006 ceph-mon[103869]: Health check failed: Degraded data redundancy: 37/330 objects degraded (11.212%), 9 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:44.863 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:44 smithi134 ceph-osd[112285]: -- 172.21.15.134:0/2601388817 <== mon.1 v2:172.21.15.134:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x557c3ca744e0 con 0x557c3ca45000 2024-03-12T16:18:45.203 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:44 smithi134 bash[112246]: 7eeb27fa1187d8150371ee1cab4aa0b1287badb781b9232018c86bae8ed50470 2024-03-12T16:18:45.203 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:44 smithi134 systemd[1]: Started Ceph osd.5 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:18:45.558 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:45 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:18:45.304+0000 7f3c15f83640 -1 Falling back to public interface 2024-03-12T16:18:45.558 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:45 smithi134 ceph-mon[85099]: pgmap v156: 65 pgs: 9 active+undersized+degraded, 3 peering, 3 stale+active+clean, 11 active+undersized, 39 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/330 objects degraded (11.212%) 2024-03-12T16:18:45.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:45.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:45.559 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:18:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:45 smithi006 ceph-mon[103869]: pgmap v156: 65 pgs: 9 active+undersized+degraded, 3 peering, 3 stale+active+clean, 11 active+undersized, 39 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 37/330 objects degraded (11.212%) 2024-03-12T16:18:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:18:46.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:46 smithi134 ceph-mon[85099]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-03-12T16:18:46.734 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:46 smithi006 ceph-mon[103869]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-03-12T16:18:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:47 smithi134 ceph-mon[85099]: pgmap v157: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:18:47.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:47 smithi006 ceph-mon[103869]: pgmap v157: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:47.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:47.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:18:49.867 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:49 smithi134 ceph-mon[85099]: pgmap v158: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:49.867 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:49 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:49.867 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:49 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:49.867 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:49 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:49.867 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:49 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:49 smithi006 ceph-mon[103869]: pgmap v158: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:49 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:49 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:49 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:49 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:51.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:51 smithi134 ceph-mon[85099]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:51 smithi006 ceph-mon[103869]: pgmap v159: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:53.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:52 smithi134 ceph-mon[85099]: pgmap v160: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:53.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:53.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:53.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:53.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:53.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:18:53.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:53.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:52 smithi006 ceph-mon[103869]: pgmap v160: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:53.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:53.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:53.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:53.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:53.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:18:53.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:54.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:18:54.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all osd 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-12T16:18:54.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-12T16:18:54.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-12T16:18:54.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: Upgrade: Setting require_osd_release to 18 reef 2024-03-12T16:18:54.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-03-12T16:18:54.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:53 smithi134 ceph-mon[85099]: Health check update: Degraded data redundancy: 51/330 objects degraded (15.455%), 14 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:18:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:18:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all osd 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]: dispatch 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.0"}]': finished 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]: dispatch 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.1"}]': finished 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]: dispatch 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.2"}]': finished 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]: dispatch 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.3"}]': finished 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]: dispatch 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.4"}]': finished 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]: dispatch 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd.5"}]': finished 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: Upgrade: Setting require_osd_release to 18 reef 2024-03-12T16:18:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd require-osd-release", "release": "reef"}]: dispatch 2024-03-12T16:18:54.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:53 smithi006 ceph-mon[103869]: Health check update: Degraded data redundancy: 51/330 objects degraded (15.455%), 14 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:54.209 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[103846]: 2024-03-12T16:18:54.111+0000 7f02e38db700 -1 log_channel(cluster) log [ERR] : Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-12T16:18:54.609 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:18:54.208+0000 7f3c15f83640 -1 osd.5 0 read_superblock omap replica is missing. 2024-03-12T16:18:54.948 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:18:54.607+0000 7f3c15f83640 -1 osd.5 74 log_to_monitors true 2024-03-12T16:18:55.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:55.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: osdmap e77: 6 total, 5 up, 6 in 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: osdmap e78: 6 total, 5 up, 6 in 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: from='osd.5 [v2:172.21.15.134:6816/4202679969,v1:172.21.15.134:6817/4202679969]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-12T16:18:55.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:54 smithi134 ceph-mon[85099]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-12T16:18:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: pgmap v161: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.3 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: Health check cleared: OSD_UPGRADE_FINISHED (was: all OSDs are running quincy or later but require_osd_release < quincy) 2024-03-12T16:18:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "osd require-osd-release", "release": "reef"}]': finished 2024-03-12T16:18:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: osdmap e77: 6 total, 5 up, 6 in 2024-03-12T16:18:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: Upgrade: failing fs cephfs for rapid multi-rank mds upgrade 2024-03-12T16:18:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "fs fail", "fs_name": "cephfs"}]: dispatch 2024-03-12T16:18:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: Health check failed: 1 filesystem is degraded (FS_DEGRADED) 2024-03-12T16:18:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: Health check failed: 1 filesystem is offline (MDS_ALL_DOWN) 2024-03-12T16:18:55.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: osdmap e78: 6 total, 5 up, 6 in 2024-03-12T16:18:55.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "fs fail", "fs_name": "cephfs"}]': finished 2024-03-12T16:18:55.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 2 up:standby, 2 failed 2024-03-12T16:18:55.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: from='osd.5 [v2:172.21.15.134:6816/4202679969,v1:172.21.15.134:6817/4202679969]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-12T16:18:55.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:54 smithi006 ceph-mon[103869]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-03-12T16:18:55.703 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:18:55 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:18:55.283+0000 7f3c053d8700 -1 osd.5 74 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-03-12T16:18:56.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.134:6824/4005490805,v1:172.21.15.134:6825/4005490805] up:boot 2024-03-12T16:18:56.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6826/1318075023,v1:172.21.15.6:6827/1318075023] up:boot 2024-03-12T16:18:56.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: osdmap e79: 6 total, 5 up, 6 in 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: from='osd.5 [v2:172.21.15.134:6816/4202679969,v1:172.21.15.134:6817/4202679969]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: Upgrade: Updating mds.cephfs.smithi006.ncuwuc 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ncuwuc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:18:56.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:56 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.134:6824/4005490805,v1:172.21.15.134:6825/4005490805] up:boot 2024-03-12T16:18:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6826/1318075023,v1:172.21.15.6:6827/1318075023] up:boot 2024-03-12T16:18:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:18:56.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:18:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:18:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-03-12T16:18:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: osdmap e79: 6 total, 5 up, 6 in 2024-03-12T16:18:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: from='osd.5 [v2:172.21.15.134:6816/4202679969,v1:172.21.15.134:6817/4202679969]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:18:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi134", "root=default"]}]: dispatch 2024-03-12T16:18:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: Upgrade: Updating mds.cephfs.smithi006.ncuwuc 2024-03-12T16:18:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:18:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ncuwuc", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:18:56.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:56 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:18:57.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:57 smithi006 ceph-mon[103869]: Deploying daemon mds.cephfs.smithi006.ncuwuc on smithi006 2024-03-12T16:18:57.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:57 smithi006 ceph-mon[103869]: pgmap v165: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:57.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:57 smithi006 ceph-mon[103869]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:18:57.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:57 smithi006 ceph-mon[103869]: osd.5 [v2:172.21.15.134:6816/4202679969,v1:172.21.15.134:6817/4202679969] boot 2024-03-12T16:18:57.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:57 smithi006 ceph-mon[103869]: osdmap e80: 6 total, 6 up, 6 in 2024-03-12T16:18:57.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:18:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:57 smithi134 ceph-mon[85099]: Deploying daemon mds.cephfs.smithi006.ncuwuc on smithi006 2024-03-12T16:18:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:57 smithi134 ceph-mon[85099]: pgmap v165: 65 pgs: 14 active+undersized+degraded, 14 active+undersized, 37 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 51/330 objects degraded (15.455%) 2024-03-12T16:18:57.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:57 smithi134 ceph-mon[85099]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-03-12T16:18:57.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:57 smithi134 ceph-mon[85099]: osd.5 [v2:172.21.15.134:6816/4202679969,v1:172.21.15.134:6817/4202679969] boot 2024-03-12T16:18:57.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:57 smithi134 ceph-mon[85099]: osdmap e80: 6 total, 6 up, 6 in 2024-03-12T16:18:57.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-03-12T16:18:58.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:58 smithi134 ceph-mon[85099]: osdmap e81: 6 total, 6 up, 6 in 2024-03-12T16:18:58.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:58 smithi134 ceph-mon[85099]: osdmap e82: 6 total, 6 up, 6 in 2024-03-12T16:18:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:58 smithi006 ceph-mon[103869]: osdmap e81: 6 total, 6 up, 6 in 2024-03-12T16:18:58.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:58 smithi006 ceph-mon[103869]: osdmap e82: 6 total, 6 up, 6 in 2024-03-12T16:18:59.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:59 smithi134 ceph-mon[85099]: pgmap v169: 65 pgs: 9 active+undersized+degraded, 12 active+undersized, 44 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25/330 objects degraded (7.576%) 2024-03-12T16:18:59.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:59 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-03-12T16:18:59.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:18:59 smithi134 ceph-mon[85099]: Health check update: Degraded data redundancy: 25/330 objects degraded (7.576%), 9 pgs degraded (PG_DEGRADED) 2024-03-12T16:18:59.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:59 smithi006 ceph-mon[103869]: pgmap v169: 65 pgs: 9 active+undersized+degraded, 12 active+undersized, 44 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 25/330 objects degraded (7.576%) 2024-03-12T16:18:59.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:59 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-03-12T16:18:59.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:18:59 smithi006 ceph-mon[103869]: Health check update: Degraded data redundancy: 25/330 objects degraded (7.576%), 9 pgs degraded (PG_DEGRADED) 2024-03-12T16:19:00.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:00 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:19:00.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:00 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:19:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:01 smithi134 ceph-mon[85099]: pgmap v170: 65 pgs: 6 active+undersized+degraded, 9 active+undersized, 50 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19/330 objects degraded (5.758%) 2024-03-12T16:19:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:01 smithi006 ceph-mon[103869]: pgmap v170: 65 pgs: 6 active+undersized+degraded, 9 active+undersized, 50 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 19/330 objects degraded (5.758%) 2024-03-12T16:19:03.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:02 smithi134 ceph-mon[85099]: pgmap v171: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:03.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:03.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:19:03.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:02 smithi134 ceph-mon[85099]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/330 objects degraded (5.758%), 6 pgs degraded) 2024-03-12T16:19:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:02 smithi006 ceph-mon[103869]: pgmap v171: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:19:03.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:02 smithi006 ceph-mon[103869]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 19/330 objects degraded (5.758%), 6 pgs degraded) 2024-03-12T16:19:05.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:04 smithi134 ceph-mon[85099]: pgmap v172: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:04 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:boot 2024-03-12T16:19:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:04 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:19:05.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:19:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:04 smithi006 ceph-mon[103869]: pgmap v172: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:04 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:boot 2024-03-12T16:19:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:04 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:19:05.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:19:07.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:06 smithi134 ceph-mon[85099]: pgmap v173: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:07.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:06 smithi006 ceph-mon[103869]: pgmap v173: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:08.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:09.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:09 smithi134 ceph-mon[85099]: pgmap v174: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:09.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:09 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:09.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:09 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:09.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:09 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:09.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:09 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:09 smithi006 ceph-mon[103869]: pgmap v174: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:09 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:09 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:09 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:09 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.025+0000 7fefba6c1700 1 -- 172.21.15.6:0/1794499875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fd120 msgr2=0x7fefb40f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.025+0000 7fefba6c1700 1 --2- 172.21.15.6:0/1794499875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fd120 0x7fefb40f7090 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fef9c0047f0 tx=0x7fef9c009cb0).stop 2024-03-12T16:19:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.026+0000 7fefba6c1700 1 -- 172.21.15.6:0/1794499875 shutdown_connections 2024-03-12T16:19:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.026+0000 7fefba6c1700 1 --2- 172.21.15.6:0/1794499875 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fd120 0x7fefb40f7090 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.026+0000 7fefba6c1700 1 --2- 172.21.15.6:0/1794499875 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb40fc7c0 0x7fefb40fcba0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.026+0000 7fefba6c1700 1 -- 172.21.15.6:0/1794499875 >> 172.21.15.6:0/1794499875 conn(0x7fefb406cea0 msgr2=0x7fefb406d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:11.029 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.026+0000 7fefba6c1700 1 -- 172.21.15.6:0/1794499875 shutdown_connections 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.026+0000 7fefba6c1700 1 -- 172.21.15.6:0/1794499875 wait complete. 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.026+0000 7fefba6c1700 1 Processor -- start 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.026+0000 7fefba6c1700 1 -- start start 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefba6c1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fc7c0 0x7fefb40f85c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefba6c1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb40fd120 0x7fefb40f8ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefba6c1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40f8fa0 con 0x7fefb40fc7c0 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefba6c1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fefb40f90e0 con 0x7fefb40fd120 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fc7c0 0x7fefb40f85c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fc7c0 0x7fefb40f85c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47108/0 (socket says 172.21.15.6:47108) 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefb3fff700 1 -- 172.21.15.6:0/2016668820 learned_addr learned my addr 172.21.15.6:0/2016668820 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:11.030 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefb37fe700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb40fd120 0x7fefb40f8ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefb3fff700 1 -- 172.21.15.6:0/2016668820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb40fd120 msgr2=0x7fefb40f8ab0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefb3fff700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb40fd120 0x7fefb40f8ab0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefb3fff700 1 -- 172.21.15.6:0/2016668820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef9c005040 con 0x7fefb40fc7c0 2024-03-12T16:19:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefb3fff700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fc7c0 0x7fefb40f85c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fefa40041d0 tx=0x7fefa4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:11.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.027+0000 7fefb17fa700 1 -- 172.21.15.6:0/2016668820 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefa4002d90 con 0x7fefb40fc7c0 2024-03-12T16:19:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.028+0000 7fefb17fa700 1 -- 172.21.15.6:0/2016668820 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fefa400f040 con 0x7fefb40fc7c0 2024-03-12T16:19:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.028+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fefb40f9390 con 0x7fefb40fc7c0 2024-03-12T16:19:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.028+0000 7fefb17fa700 1 -- 172.21.15.6:0/2016668820 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fefa400d800 con 0x7fefb40fc7c0 2024-03-12T16:19:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.028+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fefb41146b0 con 0x7fefb40fc7c0 2024-03-12T16:19:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.029+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fefb4047540 con 0x7fefb40fc7c0 2024-03-12T16:19:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.029+0000 7fefb17fa700 1 -- 172.21.15.6:0/2016668820 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fefa400dac0 con 0x7fefb40fc7c0 2024-03-12T16:19:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.030+0000 7fefb17fa700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fefa006caa0 0x7fefa006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:11.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.030+0000 7fefb17fa700 1 -- 172.21.15.6:0/2016668820 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fefa408bde0 con 0x7fefb40fc7c0 2024-03-12T16:19:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.035+0000 7fefb37fe700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fefa006caa0 0x7fefa006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:11.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.035+0000 7fefb37fe700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fefa006caa0 0x7fefa006ef60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fef9c004f10 tx=0x7fef9c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:11.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.036+0000 7fefb17fa700 1 -- 172.21.15.6:0/2016668820 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fefa4055eb0 con 0x7fefb40fc7c0 2024-03-12T16:19:11.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.263+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fefb40fb620 con 0x7fefa006caa0 2024-03-12T16:19:11.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.265+0000 7fefb17fa700 1 -- 172.21.15.6:0/2016668820 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fefb40fb620 con 0x7fefa006caa0 2024-03-12T16:19:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fefa006caa0 msgr2=0x7fefa006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fefa006caa0 0x7fefa006ef60 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 rx=0x7fef9c004f10 tx=0x7fef9c00b040).stop 2024-03-12T16:19:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fc7c0 msgr2=0x7fefb40f85c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fc7c0 0x7fefb40f85c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fefa40041d0 tx=0x7fefa4009f60).stop 2024-03-12T16:19:11.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 shutdown_connections 2024-03-12T16:19:11.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fefa006caa0 0x7fefa006ef60 unknown :-1 s=CLOSED pgs=85 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fefb40fc7c0 0x7fefb40f85c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 --2- 172.21.15.6:0/2016668820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fefb40fd120 0x7fefb40f8ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 >> 172.21.15.6:0/2016668820 conn(0x7fefb406cea0 msgr2=0x7fefb40f5ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:11.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 shutdown_connections 2024-03-12T16:19:11.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.267+0000 7fefba6c1700 1 -- 172.21.15.6:0/2016668820 wait complete. 2024-03-12T16:19:11.279 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:19:11.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.372+0000 7f11033c4700 1 -- 172.21.15.6:0/1579315791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f6fc0 msgr2=0x7f10fc103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.372+0000 7f11033c4700 1 --2- 172.21.15.6:0/1579315791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f6fc0 0x7f10fc103d60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f10ec004820 tx=0x7f10ec009cb0).stop 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.372+0000 7f11033c4700 1 -- 172.21.15.6:0/1579315791 shutdown_connections 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.372+0000 7f11033c4700 1 --2- 172.21.15.6:0/1579315791 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f6fc0 0x7f10fc103d60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.372+0000 7f11033c4700 1 --2- 172.21.15.6:0/1579315791 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0f66f0 0x7f10fc0f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.372+0000 7f11033c4700 1 -- 172.21.15.6:0/1579315791 >> 172.21.15.6:0/1579315791 conn(0x7f10fc070590 msgr2=0x7f10fc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.372+0000 7f11033c4700 1 -- 172.21.15.6:0/1579315791 shutdown_connections 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.372+0000 7f11033c4700 1 -- 172.21.15.6:0/1579315791 wait complete. 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.373+0000 7f11033c4700 1 Processor -- start 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.373+0000 7f11033c4700 1 -- start start 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.373+0000 7f11033c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f66f0 0x7f10fc110370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.373+0000 7f11033c4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0f6fc0 0x7f10fc110860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:11.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.373+0000 7f11033c4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc110e60 con 0x7f10fc0f66f0 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.373+0000 7f11033c4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f10fc110fa0 con 0x7f10fc0f6fc0 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.373+0000 7f1101160700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f66f0 0x7f10fc110370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.373+0000 7f1101160700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f66f0 0x7f10fc110370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47114/0 (socket says 172.21.15.6:47114) 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.373+0000 7f1101160700 1 -- 172.21.15.6:0/3377190396 learned_addr learned my addr 172.21.15.6:0/3377190396 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f110095f700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0f6fc0 0x7f10fc110860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f1101160700 1 -- 172.21.15.6:0/3377190396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0f6fc0 msgr2=0x7f10fc110860 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f1101160700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0f6fc0 0x7f10fc110860 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f1101160700 1 -- 172.21.15.6:0/3377190396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f10ec005040 con 0x7f10fc0f66f0 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f1101160700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f66f0 0x7f10fc110370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f10f800e8f0 tx=0x7f10f800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f10f27fc700 1 -- 172.21.15.6:0/3377190396 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10f8007b40 con 0x7f10fc0f66f0 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f10f27fc700 1 -- 172.21.15.6:0/3377190396 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f10f800f040 con 0x7f10fc0f66f0 2024-03-12T16:19:11.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f10f27fc700 1 -- 172.21.15.6:0/3377190396 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f10f8014880 con 0x7f10fc0f66f0 2024-03-12T16:19:11.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f10fc10a630 con 0x7f10fc0f66f0 2024-03-12T16:19:11.378 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.374+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f10fc10ab20 con 0x7f10fc0f66f0 2024-03-12T16:19:11.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.375+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f10fc05f590 con 0x7f10fc0f66f0 2024-03-12T16:19:11.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.376+0000 7f10f27fc700 1 -- 172.21.15.6:0/3377190396 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f10f8014b00 con 0x7f10fc0f66f0 2024-03-12T16:19:11.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.376+0000 7f10f27fc700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f10e806caa0 0x7f10e806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:11.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.376+0000 7f10f27fc700 1 -- 172.21.15.6:0/3377190396 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f10f808b990 con 0x7f10fc0f66f0 2024-03-12T16:19:11.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.376+0000 7f110095f700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f10e806caa0 0x7f10e806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:11.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.377+0000 7f110095f700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f10e806caa0 0x7f10e806ef60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f10ec009ee0 tx=0x7f10ec009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:11.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.381+0000 7f10f27fc700 1 -- 172.21.15.6:0/3377190396 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f10f80594f0 con 0x7f10fc0f66f0 2024-03-12T16:19:11.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.599+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f10fc10ba60 con 0x7f10e806caa0 2024-03-12T16:19:11.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.601+0000 7f10f27fc700 1 -- 172.21.15.6:0/3377190396 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f10fc10ba60 con 0x7f10e806caa0 2024-03-12T16:19:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f10e806caa0 msgr2=0x7f10e806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f10e806caa0 0x7f10e806ef60 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 rx=0x7f10ec009ee0 tx=0x7f10ec009cb0).stop 2024-03-12T16:19:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f66f0 msgr2=0x7f10fc110370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f66f0 0x7f10fc110370 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f10f800e8f0 tx=0x7f10f800b040).stop 2024-03-12T16:19:11.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 shutdown_connections 2024-03-12T16:19:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f10e806caa0 0x7f10e806ef60 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f10fc0f66f0 0x7f10fc110370 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 --2- 172.21.15.6:0/3377190396 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f10fc0f6fc0 0x7f10fc110860 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 >> 172.21.15.6:0/3377190396 conn(0x7f10fc070590 msgr2=0x7f10fc06da20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 shutdown_connections 2024-03-12T16:19:11.605 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.603+0000 7f11033c4700 1 -- 172.21.15.6:0/3377190396 wait complete. 2024-03-12T16:19:11.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:11 smithi134 ceph-mon[85099]: pgmap v175: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:11 smithi006 ceph-mon[103869]: pgmap v175: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.708+0000 7f462d38f700 1 -- 172.21.15.6:0/2186108589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 msgr2=0x7f46280fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.708+0000 7f462d38f700 1 --2- 172.21.15.6:0/2186108589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 0x7f46280fdcf0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f46180047f0 tx=0x7f4618009cb0).stop 2024-03-12T16:19:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.708+0000 7f462d38f700 1 -- 172.21.15.6:0/2186108589 shutdown_connections 2024-03-12T16:19:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.708+0000 7f462d38f700 1 --2- 172.21.15.6:0/2186108589 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46280fe270 0x7f46280f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.708+0000 7f462d38f700 1 --2- 172.21.15.6:0/2186108589 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 0x7f46280fdcf0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.708+0000 7f462d38f700 1 -- 172.21.15.6:0/2186108589 >> 172.21.15.6:0/2186108589 conn(0x7f46280f3530 msgr2=0x7f46280f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.708+0000 7f462d38f700 1 -- 172.21.15.6:0/2186108589 shutdown_connections 2024-03-12T16:19:11.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.708+0000 7f462d38f700 1 -- 172.21.15.6:0/2186108589 wait complete. 2024-03-12T16:19:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.709+0000 7f462d38f700 1 Processor -- start 2024-03-12T16:19:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.709+0000 7f462d38f700 1 -- start start 2024-03-12T16:19:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.709+0000 7f462d38f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 0x7f462810e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:11.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.709+0000 7f462d38f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46280fe270 0x7f462810e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.709+0000 7f462d38f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462810ec20 con 0x7f46280fd910 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.709+0000 7f462d38f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f462810ed60 con 0x7f46280fe270 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.709+0000 7f4626ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 0x7f462810e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.709+0000 7f4626ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 0x7f462810e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47122/0 (socket says 172.21.15.6:47122) 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.709+0000 7f4626ffd700 1 -- 172.21.15.6:0/881745276 learned_addr learned my addr 172.21.15.6:0/881745276 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f46267fc700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46280fe270 0x7f462810e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f4626ffd700 1 -- 172.21.15.6:0/881745276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46280fe270 msgr2=0x7f462810e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f4626ffd700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46280fe270 0x7f462810e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f4626ffd700 1 -- 172.21.15.6:0/881745276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4618005040 con 0x7f46280fd910 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f4626ffd700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 0x7f462810e130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f4618009380 tx=0x7f4618009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f460ffff700 1 -- 172.21.15.6:0/881745276 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4618018070 con 0x7f46280fd910 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f460ffff700 1 -- 172.21.15.6:0/881745276 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4618007e90 con 0x7f46280fd910 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4628108390 con 0x7f46280fd910 2024-03-12T16:19:11.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f460ffff700 1 -- 172.21.15.6:0/881745276 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f46180123c0 con 0x7f46280fd910 2024-03-12T16:19:11.713 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.710+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f46281088f0 con 0x7f46280fd910 2024-03-12T16:19:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.711+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f462805f570 con 0x7f46280fd910 2024-03-12T16:19:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.711+0000 7f460ffff700 1 -- 172.21.15.6:0/881745276 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f461801d420 con 0x7f46280fd910 2024-03-12T16:19:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.712+0000 7f460ffff700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f461006caa0 0x7f461006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.712+0000 7f460ffff700 1 -- 172.21.15.6:0/881745276 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f461808ca80 con 0x7f46280fd910 2024-03-12T16:19:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.712+0000 7f46267fc700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f461006caa0 0x7f461006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:11.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.712+0000 7f46267fc700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f461006caa0 0x7f461006ef60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f461c009f20 tx=0x7f461c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:11.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.717+0000 7f460ffff700 1 -- 172.21.15.6:0/881745276 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f461805a5e0 con 0x7f46280fd910 2024-03-12T16:19:11.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.938+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f46280ffc60 con 0x7f461006caa0 2024-03-12T16:19:11.949 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.948+0000 7f460ffff700 1 -- 172.21.15.6:0/881745276 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f46280ffc60 con 0x7f461006caa0 2024-03-12T16:19:11.949 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (5m) 3s ago 17m 26.2M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (3m) 3s ago 16m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (3m) 23s ago 16m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (5m) 3s ago 16m 89.5M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (8s) 3s ago 11m 13.7M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (11m) 3s ago 11m 16.2M - 16.2.15-1-g8963e9de 727f386679cb 7926de4a27e9 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (11m) 23s ago 11m 115M - 16.2.15-1-g8963e9de 727f386679cb d1420883eac7 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (11m) 23s ago 11m 18.6M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (7m) 3s ago 18m 504M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:19:11.950 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (6m) 23s ago 16m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (4m) 3s ago 18m 49.7M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (4m) 23s ago 16m 38.9M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (6m) 3s ago 16m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (6m) 23s ago 15m 18.4M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (3m) 3s ago 15m 93.6M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (2m) 3s ago 15m 95.1M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (2m) 3s ago 14m 85.9M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (95s) 23s ago 14m 102M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (61s) 23s ago 13m 94.5M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (27s) 23s ago 13m 11.1M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:19:11.951 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 23s ago 15m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:19:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f461006caa0 msgr2=0x7f461006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f461006caa0 0x7f461006ef60 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 rx=0x7f461c009f20 tx=0x7f461c00b040).stop 2024-03-12T16:19:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 msgr2=0x7f462810e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 0x7f462810e130 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f4618009380 tx=0x7f4618009cb0).stop 2024-03-12T16:19:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 shutdown_connections 2024-03-12T16:19:11.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f461006caa0 0x7f461006ef60 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f46280fd910 0x7f462810e130 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 --2- 172.21.15.6:0/881745276 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f46280fe270 0x7f462810e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 >> 172.21.15.6:0/881745276 conn(0x7f46280f3530 msgr2=0x7f46280fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 shutdown_connections 2024-03-12T16:19:11.953 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:11.951+0000 7f462d38f700 1 -- 172.21.15.6:0/881745276 wait complete. 2024-03-12T16:19:12.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.064+0000 7f44ceb51700 1 -- 172.21.15.6:0/2000158342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c80fe270 msgr2=0x7f44c80f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.064+0000 7f44ceb51700 1 --2- 172.21.15.6:0/2000158342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c80fe270 0x7f44c80f7a50 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f44b40047f0 tx=0x7f44b4009cb0).stop 2024-03-12T16:19:12.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.064+0000 7f44ceb51700 1 -- 172.21.15.6:0/2000158342 shutdown_connections 2024-03-12T16:19:12.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.064+0000 7f44ceb51700 1 --2- 172.21.15.6:0/2000158342 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c80fe270 0x7f44c80f7a50 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.064+0000 7f44ceb51700 1 --2- 172.21.15.6:0/2000158342 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44c80fd910 0x7f44c80fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.064+0000 7f44ceb51700 1 -- 172.21.15.6:0/2000158342 >> 172.21.15.6:0/2000158342 conn(0x7f44c80f3510 msgr2=0x7f44c80f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:12.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.064+0000 7f44ceb51700 1 -- 172.21.15.6:0/2000158342 shutdown_connections 2024-03-12T16:19:12.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.064+0000 7f44ceb51700 1 -- 172.21.15.6:0/2000158342 wait complete. 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.065+0000 7f44ceb51700 1 Processor -- start 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.065+0000 7f44ceb51700 1 -- start start 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.065+0000 7f44ceb51700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c80fd910 0x7f44c810dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.065+0000 7f44ceb51700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44c80fe270 0x7f44c810e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.065+0000 7f44ceb51700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c810eac0 con 0x7f44c80fd910 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.065+0000 7f44ceb51700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f44c810ec00 con 0x7f44c80fe270 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44cc8ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c80fd910 0x7f44c810dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44cc8ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c80fd910 0x7f44c810dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47140/0 (socket says 172.21.15.6:47140) 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44cc8ed700 1 -- 172.21.15.6:0/1915427087 learned_addr learned my addr 172.21.15.6:0/1915427087 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44c7fff700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44c80fe270 0x7f44c810e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44c7fff700 1 -- 172.21.15.6:0/1915427087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c80fd910 msgr2=0x7f44c810dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44c7fff700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c80fd910 0x7f44c810dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44c7fff700 1 -- 172.21.15.6:0/1915427087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f44b4005040 con 0x7f44c80fe270 2024-03-12T16:19:12.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44c7fff700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44c80fe270 0x7f44c810e4c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f44b4000c00 tx=0x7f44b4009cb0).ready entity=mon.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:12.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44c5ffb700 1 -- 172.21.15.6:0/1915427087 <== mon.1 v2:172.21.15.134:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b400e030 con 0x7f44c80fe270 2024-03-12T16:19:12.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f44c8108230 con 0x7f44c80fe270 2024-03-12T16:19:12.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44c5ffb700 1 -- 172.21.15.6:0/1915427087 <== mon.1 v2:172.21.15.134:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f44b4007e90 con 0x7f44c80fe270 2024-03-12T16:19:12.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.066+0000 7f44c5ffb700 1 -- 172.21.15.6:0/1915427087 <== mon.1 v2:172.21.15.134:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f44b4018070 con 0x7f44c80fe270 2024-03-12T16:19:12.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.067+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f44c8108790 con 0x7f44c80fe270 2024-03-12T16:19:12.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.067+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f44c8060650 con 0x7f44c80fe270 2024-03-12T16:19:12.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.068+0000 7f44c5ffb700 1 -- 172.21.15.6:0/1915427087 <== mon.1 v2:172.21.15.134:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f44b401d420 con 0x7f44c80fe270 2024-03-12T16:19:12.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.069+0000 7f44c5ffb700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44b806cab0 0x7f44b806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:12.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.069+0000 7f44c5ffb700 1 -- 172.21.15.6:0/1915427087 <== mon.1 v2:172.21.15.134:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f44b408d0c0 con 0x7f44c80fe270 2024-03-12T16:19:12.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.069+0000 7f44cc8ed700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44b806cab0 0x7f44b806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:12.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.069+0000 7f44cc8ed700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44b806cab0 0x7f44b806ef70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f44bc009fd0 tx=0x7f44bc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:12.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.073+0000 7f44c5ffb700 1 -- 172.21.15.6:0/1915427087 <== mon.1 v2:172.21.15.134:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f44b405aca0 con 0x7f44c80fe270 2024-03-12T16:19:12.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.365+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f44c8047540 con 0x7f44c80fe270 2024-03-12T16:19:12.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.366+0000 7f44c5ffb700 1 -- 172.21.15.6:0/1915427087 <== mon.1 v2:172.21.15.134:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7f44b405a830 con 0x7f44c80fe270 2024-03-12T16:19:12.367 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:19:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:19:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:19:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:19:12.367 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 3, 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 1 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:19:12.368 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 3, 2024-03-12T16:19:12.369 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 11 2024-03-12T16:19:12.369 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:19:12.369 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:19:12.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44b806cab0 msgr2=0x7f44b806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44b806cab0 0x7f44b806ef70 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 rx=0x7f44bc009fd0 tx=0x7f44bc00b040).stop 2024-03-12T16:19:12.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44c80fe270 msgr2=0x7f44c810e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.370 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44c80fe270 0x7f44c810e4c0 secure :-1 s=READY pgs=16 cs=0 l=1 rev1=1 rx=0x7f44b4000c00 tx=0x7f44b4009cb0).stop 2024-03-12T16:19:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 shutdown_connections 2024-03-12T16:19:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44b806cab0 0x7f44b806ef70 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f44c80fd910 0x7f44c810dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 --2- 172.21.15.6:0/1915427087 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f44c80fe270 0x7f44c810e4c0 unknown :-1 s=CLOSED pgs=16 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 >> 172.21.15.6:0/1915427087 conn(0x7f44c80f3510 msgr2=0x7f44c80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:12.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 shutdown_connections 2024-03-12T16:19:12.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.368+0000 7f44ceb51700 1 -- 172.21.15.6:0/1915427087 wait complete. 2024-03-12T16:19:12.421 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:12 smithi006 ceph-mon[103869]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:12.421 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:12 smithi006 ceph-mon[103869]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:12.421 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:12 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1915427087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.472+0000 7f33a3352700 1 -- 172.21.15.6:0/293944975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fc7f0 msgr2=0x7f339c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.472+0000 7f33a3352700 1 --2- 172.21.15.6:0/293944975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fc7f0 0x7f339c0fcbd0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f33980047f0 tx=0x7f3398009cb0).stop 2024-03-12T16:19:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.472+0000 7f33a3352700 1 -- 172.21.15.6:0/293944975 shutdown_connections 2024-03-12T16:19:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.472+0000 7f33a3352700 1 --2- 172.21.15.6:0/293944975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c0fd150 0x7f339c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:19:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.472+0000 7f33a3352700 1 --2- 172.21.15.6:0/293944975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fc7f0 0x7f339c0fcbd0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.472+0000 7f33a3352700 1 -- 172.21.15.6:0/293944975 >> 172.21.15.6:0/293944975 conn(0x7f339c0f23b0 msgr2=0x7f339c0f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:12.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.473+0000 7f33a3352700 1 -- 172.21.15.6:0/293944975 shutdown_connections 2024-03-12T16:19:12.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.473+0000 7f33a3352700 1 -- 172.21.15.6:0/293944975 wait complete. 2024-03-12T16:19:12.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.473+0000 7f33a3352700 1 Processor -- start 2024-03-12T16:19:12.477 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.473+0000 7f33a3352700 1 -- start start 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a3352700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c0fc7f0 0x7f339c10e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a3352700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fd150 0x7f339c10e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a3352700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c10ec10 con 0x7f339c0fd150 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a3352700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f339c108230 con 0x7f339c0fc7f0 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a08ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fd150 0x7f339c10e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a08ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fd150 0x7f339c10e580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60406/0 (socket says 172.21.15.6:60406) 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a08ed700 1 -- 172.21.15.6:0/1545365309 learned_addr learned my addr 172.21.15.6:0/1545365309 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a10ee700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c0fc7f0 0x7f339c10e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a08ed700 1 -- 172.21.15.6:0/1545365309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c0fc7f0 msgr2=0x7f339c10e090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a08ed700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c0fc7f0 0x7f339c10e090 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a08ed700 1 -- 172.21.15.6:0/1545365309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3398005040 con 0x7f339c0fd150 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33a08ed700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fd150 0x7f339c10e580 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f338c00b480 tx=0x7f338c0090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.474+0000 7f33927fc700 1 -- 172.21.15.6:0/1545365309 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c002500 con 0x7f339c0fd150 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.475+0000 7f33927fc700 1 -- 172.21.15.6:0/1545365309 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f338c002b10 con 0x7f339c0fd150 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.475+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f339c1084e0 con 0x7f339c0fd150 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.475+0000 7f33927fc700 1 -- 172.21.15.6:0/1545365309 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f338c012c60 con 0x7f339c0fd150 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.475+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f339c108a20 con 0x7f339c0fd150 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.476+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f339c060370 con 0x7f339c0fd150 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.476+0000 7f33927fc700 1 -- 172.21.15.6:0/1545365309 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f338c002660 con 0x7f339c0fd150 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.476+0000 7f33927fc700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f338806caa0 0x7f338806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.477+0000 7f33927fc700 1 -- 172.21.15.6:0/1545365309 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f338c08bcd0 con 0x7f339c0fd150 2024-03-12T16:19:12.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.477+0000 7f33a10ee700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f338806caa0 0x7f338806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:12.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.477+0000 7f33a10ee700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f338806caa0 0x7f338806ef60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3398007cf0 tx=0x7f339800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:12.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.481+0000 7f33927fc700 1 -- 172.21.15.6:0/1545365309 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f338c059830 con 0x7f339c0fd150 2024-03-12T16:19:12.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:12 smithi134 ceph-mon[85099]: from='client.34382 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:12.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:12 smithi134 ceph-mon[85099]: from='client.34386 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:12.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:12 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1915427087' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.723+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f339c109110 con 0x7f339c0fd150 2024-03-12T16:19:12.724 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.723+0000 7f33927fc700 1 -- 172.21.15.6:0/1545365309 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 20 v20) v1 ==== 76+0+1837 (secure 0 0 0) 0x7f338c0593c0 con 0x7f339c0fd150 2024-03-12T16:19:12.724 INFO:teuthology.orchestra.run.smithi006.stdout:e20 2024-03-12T16:19:12.724 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:19:12.725 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:19:12.726 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:14444} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1071999293,v1:172.21.15.6:6829/1071999293] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:19:12.727 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44275} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/4005490805,v1:172.21.15.134:6825/4005490805] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f338806caa0 msgr2=0x7f338806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f338806caa0 0x7f338806ef60 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 rx=0x7f3398007cf0 tx=0x7f339800b040).stop 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fd150 msgr2=0x7f339c10e580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fd150 0x7f339c10e580 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7f338c00b480 tx=0x7f338c0090f0).stop 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 shutdown_connections 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f339c0fc7f0 0x7f339c10e090 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f338806caa0 0x7f338806ef60 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 --2- 172.21.15.6:0/1545365309 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f339c0fd150 0x7f339c10e580 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 >> 172.21.15.6:0/1545365309 conn(0x7f339c0f23b0 msgr2=0x7f339c061360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 shutdown_connections 2024-03-12T16:19:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.725+0000 7f33a3352700 1 -- 172.21.15.6:0/1545365309 wait complete. 2024-03-12T16:19:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 20 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.828+0000 7fd71c39a700 1 -- 172.21.15.6:0/3176498547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fd150 msgr2=0x7fd7140f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.828+0000 7fd71c39a700 1 --2- 172.21.15.6:0/3176498547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fd150 0x7fd7140f6930 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7fd7040047f0 tx=0x7fd704009cb0).stop 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.828+0000 7fd71c39a700 1 -- 172.21.15.6:0/3176498547 shutdown_connections 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.828+0000 7fd71c39a700 1 --2- 172.21.15.6:0/3176498547 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fd150 0x7fd7140f6930 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.828+0000 7fd71c39a700 1 --2- 172.21.15.6:0/3176498547 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7140fc7f0 0x7fd7140fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.828+0000 7fd71c39a700 1 -- 172.21.15.6:0/3176498547 >> 172.21.15.6:0/3176498547 conn(0x7fd714070590 msgr2=0x7fd7140f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.828+0000 7fd71c39a700 1 -- 172.21.15.6:0/3176498547 shutdown_connections 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.828+0000 7fd71c39a700 1 -- 172.21.15.6:0/3176498547 wait complete. 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71c39a700 1 Processor -- start 2024-03-12T16:19:12.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71c39a700 1 -- start start 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71c39a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fc7f0 0x7fd7141090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71c39a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7140fd150 0x7fd7141095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71c39a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd714109aa0 con 0x7fd7140fc7f0 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71c39a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd714109be0 con 0x7fd7140fd150 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71a136700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fc7f0 0x7fd7141090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71a136700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fc7f0 0x7fd7141090c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60410/0 (socket says 172.21.15.6:60410) 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71a136700 1 -- 172.21.15.6:0/3846516732 learned_addr learned my addr 172.21.15.6:0/3846516732 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd719935700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7140fd150 0x7fd7141095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71a136700 1 -- 172.21.15.6:0/3846516732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7140fd150 msgr2=0x7fd7141095b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71a136700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7140fd150 0x7fd7141095b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.829+0000 7fd71a136700 1 -- 172.21.15.6:0/3846516732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd704005040 con 0x7fd7140fc7f0 2024-03-12T16:19:12.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.830+0000 7fd71a136700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fc7f0 0x7fd7141090c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fd7100041d0 tx=0x7fd710009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.830+0000 7fd70b7fe700 1 -- 172.21.15.6:0/3846516732 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd710007b40 con 0x7fd7140fc7f0 2024-03-12T16:19:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.830+0000 7fd70b7fe700 1 -- 172.21.15.6:0/3846516732 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd71000f040 con 0x7fd7140fc7f0 2024-03-12T16:19:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.830+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd714109e90 con 0x7fd7140fc7f0 2024-03-12T16:19:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.830+0000 7fd70b7fe700 1 -- 172.21.15.6:0/3846516732 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd7100147b0 con 0x7fd7140fc7f0 2024-03-12T16:19:12.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.830+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd714112480 con 0x7fd7140fc7f0 2024-03-12T16:19:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.831+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd71405f590 con 0x7fd7140fc7f0 2024-03-12T16:19:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.831+0000 7fd70b7fe700 1 -- 172.21.15.6:0/3846516732 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd710009110 con 0x7fd7140fc7f0 2024-03-12T16:19:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.831+0000 7fd70b7fe700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd70006caa0 0x7fd70006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.832+0000 7fd70b7fe700 1 -- 172.21.15.6:0/3846516732 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd71008bcf0 con 0x7fd7140fc7f0 2024-03-12T16:19:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.832+0000 7fd719935700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd70006caa0 0x7fd70006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:12.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.832+0000 7fd719935700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd70006caa0 0x7fd70006ef60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd714060ee0 tx=0x7fd70400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:12.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:12.836+0000 7fd70b7fe700 1 -- 172.21.15.6:0/3846516732 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd710055dc0 con 0x7fd7140fc7f0 2024-03-12T16:19:13.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.059+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd714059120 con 0x7fd70006caa0 2024-03-12T16:19:13.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.061+0000 7fd70b7fe700 1 -- 172.21.15.6:0/3846516732 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd714059120 con 0x7fd70006caa0 2024-03-12T16:19:13.062 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:19:13.062 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:19:13.062 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:19:13.062 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:19:13.062 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:19:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:19:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:19:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:19:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "crash" 2024-03-12T16:19:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:19:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "13/21 daemons upgraded", 2024-03-12T16:19:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:19:13.063 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:19:13.063 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:19:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd70006caa0 msgr2=0x7fd70006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd70006caa0 0x7fd70006ef60 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 rx=0x7fd714060ee0 tx=0x7fd70400b040).stop 2024-03-12T16:19:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fc7f0 msgr2=0x7fd7141090c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:13.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fc7f0 0x7fd7141090c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7fd7100041d0 tx=0x7fd710009f60).stop 2024-03-12T16:19:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 shutdown_connections 2024-03-12T16:19:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd70006caa0 0x7fd70006ef60 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd7140fc7f0 0x7fd7141090c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 --2- 172.21.15.6:0/3846516732 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd7140fd150 0x7fd7141095b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 >> 172.21.15.6:0/3846516732 conn(0x7fd714070590 msgr2=0x7fd7140fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 shutdown_connections 2024-03-12T16:19:13.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.063+0000 7fd71c39a700 1 -- 172.21.15.6:0/3846516732 wait complete. 2024-03-12T16:19:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.167+0000 7f7fa45b3700 1 -- 172.21.15.6:0/1967794800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 msgr2=0x7f7f9c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.167+0000 7f7fa45b3700 1 --2- 172.21.15.6:0/1967794800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 0x7f7f9c0f6930 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7f7f8c0047f0 tx=0x7f7f8c009cb0).stop 2024-03-12T16:19:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.167+0000 7f7fa45b3700 1 -- 172.21.15.6:0/1967794800 shutdown_connections 2024-03-12T16:19:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.167+0000 7f7fa45b3700 1 --2- 172.21.15.6:0/1967794800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 0x7f7f9c0f6930 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.167+0000 7f7fa45b3700 1 --2- 172.21.15.6:0/1967794800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f9c0fc7f0 0x7f7f9c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:19:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.167+0000 7f7fa45b3700 1 -- 172.21.15.6:0/1967794800 >> 172.21.15.6:0/1967794800 conn(0x7f7f9c070590 msgr2=0x7f7f9c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.167+0000 7f7fa45b3700 1 -- 172.21.15.6:0/1967794800 shutdown_connections 2024-03-12T16:19:13.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.167+0000 7f7fa45b3700 1 -- 172.21.15.6:0/1967794800 wait complete. 2024-03-12T16:19:13.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.168+0000 7f7fa45b3700 1 Processor -- start 2024-03-12T16:19:13.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.168+0000 7f7fa45b3700 1 -- start start 2024-03-12T16:19:13.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.168+0000 7f7fa45b3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f9c0fc7f0 0x7f7f9c109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.168+0000 7f7fa45b3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 0x7f7f9c109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.168+0000 7f7fa45b3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c109be0 con 0x7f7f9c0fd150 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.168+0000 7f7fa45b3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f9c109d20 con 0x7f7f9c0fc7f0 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.168+0000 7f7fa1b4e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 0x7f7f9c109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7fa1b4e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 0x7f7f9c109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60418/0 (socket says 172.21.15.6:60418) 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7fa1b4e700 1 -- 172.21.15.6:0/3341597146 learned_addr learned my addr 172.21.15.6:0/3341597146 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7fa234f700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f9c0fc7f0 0x7f7f9c109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7fa1b4e700 1 -- 172.21.15.6:0/3341597146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f9c0fc7f0 msgr2=0x7f7f9c109170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7fa1b4e700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f9c0fc7f0 0x7f7f9c109170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7fa1b4e700 1 -- 172.21.15.6:0/3341597146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f8c005040 con 0x7f7f9c0fd150 2024-03-12T16:19:13.172 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7fa1b4e700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 0x7f7f9c109660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7f8c0099f0 tx=0x7f7f8c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7f937fe700 1 -- 172.21.15.6:0/3341597146 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f8c00e030 con 0x7f7f9c0fd150 2024-03-12T16:19:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7f937fe700 1 -- 172.21.15.6:0/3341597146 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f8c007e90 con 0x7f7f9c0fd150 2024-03-12T16:19:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7f937fe700 1 -- 172.21.15.6:0/3341597146 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f8c018070 con 0x7f7f9c0fd150 2024-03-12T16:19:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f9c109f70 con 0x7f7f9c0fd150 2024-03-12T16:19:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.169+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f9c112460 con 0x7f7f9c0fd150 2024-03-12T16:19:13.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.170+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f9c05f590 con 0x7f7f9c0fd150 2024-03-12T16:19:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.171+0000 7f7f937fe700 1 -- 172.21.15.6:0/3341597146 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7f8c01d420 con 0x7f7f9c0fd150 2024-03-12T16:19:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.171+0000 7f7f937fe700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f8806caa0 0x7f7f8806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.172+0000 7f7f937fe700 1 -- 172.21.15.6:0/3341597146 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(82..82 src has 1..82) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f7f8c08d230 con 0x7f7f9c0fd150 2024-03-12T16:19:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.172+0000 7f7fa234f700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f8806caa0 0x7f7f8806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:13.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.172+0000 7f7fa234f700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f8806caa0 0x7f7f8806ef60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f7f98001250 tx=0x7f7f98009620).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:13.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.176+0000 7f7f937fe700 1 -- 172.21.15.6:0/3341597146 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7f8c057300 con 0x7f7f9c0fd150 2024-03-12T16:19:13.472 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.471+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7f9c047540 con 0x7f7f9c0fd150 2024-03-12T16:19:13.473 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.471+0000 7f7f937fe700 1 -- 172.21.15.6:0/3341597146 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f7f8c05a920 con 0x7f7f9c0fd150 2024-03-12T16:19:13.473 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:19:13.473 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:19:13.473 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:19:13.473 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:19:13.473 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:19:13.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.473+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f8806caa0 msgr2=0x7f7f8806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:13.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.473+0000 7f7fa45b3700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f8806caa0 0x7f7f8806ef60 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 rx=0x7f7f98001250 tx=0x7f7f98009620).stop 2024-03-12T16:19:13.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.473+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 msgr2=0x7f7f9c109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:13.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.473+0000 7f7fa45b3700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 0x7f7f9c109660 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f7f8c0099f0 tx=0x7f7f8c009cb0).stop 2024-03-12T16:19:13.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.474+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 shutdown_connections 2024-03-12T16:19:13.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.474+0000 7f7fa45b3700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f9c0fc7f0 0x7f7f9c109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:13.475 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.474+0000 7f7fa45b3700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f8806caa0 0x7f7f8806ef60 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:13.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.474+0000 7f7fa45b3700 1 --2- 172.21.15.6:0/3341597146 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f9c0fd150 0x7f7f9c109660 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:13.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.474+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 >> 172.21.15.6:0/3341597146 conn(0x7f7f9c070590 msgr2=0x7f7f9c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:13.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.474+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 shutdown_connections 2024-03-12T16:19:13.476 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:13.474+0000 7f7fa45b3700 1 -- 172.21.15.6:0/3341597146 wait complete. 2024-03-12T16:19:13.690 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: pgmap v176: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:13.690 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:13.690 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1545365309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:19:13.690 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:13.690 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:13.690 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:13.690 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:19:13.691 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:13.691 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:13.691 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:13.691 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:13.691 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:13.691 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:13 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:13.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: pgmap v176: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:13.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='client.34390 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:13.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1545365309' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:19:13.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:13.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:13.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:13.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:19:13.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:13.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:13.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:13.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:13.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:13.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:13 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:14.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:14 smithi134 ceph-mon[85099]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:14.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:14 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3341597146' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:19:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:14 smithi006 ceph-mon[103869]: from='client.34402 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:14.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:14 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3341597146' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:19:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:15 smithi134 ceph-mon[85099]: pgmap v177: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:15 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:15 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ufmcfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:19:15.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:15 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:15 smithi006 ceph-mon[103869]: pgmap v177: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:15 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:15 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi006.ufmcfu", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:19:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:15 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:16.698 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:16 smithi006 ceph-mon[103869]: Upgrade: Updating mds.cephfs.smithi006.ufmcfu 2024-03-12T16:19:16.698 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:16 smithi006 ceph-mon[103869]: Deploying daemon mds.cephfs.smithi006.ufmcfu on smithi006 2024-03-12T16:19:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:16 smithi134 ceph-mon[85099]: Upgrade: Updating mds.cephfs.smithi006.ufmcfu 2024-03-12T16:19:16.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:16 smithi134 ceph-mon[85099]: Deploying daemon mds.cephfs.smithi006.ufmcfu on smithi006 2024-03-12T16:19:17.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:17 smithi134 ceph-mon[85099]: pgmap v178: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:17.725 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:17.725 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:19:17.725 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:17 smithi134 ceph-mon[85099]: osdmap e83: 6 total, 6 up, 6 in 2024-03-12T16:19:17.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:17 smithi006 ceph-mon[103869]: pgmap v178: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:17.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:17.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:19:17.726 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:17 smithi006 ceph-mon[103869]: osdmap e83: 6 total, 6 up, 6 in 2024-03-12T16:19:19.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:18 smithi134 ceph-mon[85099]: pgmap v180: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:19.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:18 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-03-12T16:19:19.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:18 smithi006 ceph-mon[103869]: pgmap v180: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:19.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:18 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-03-12T16:19:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:21 smithi134 ceph-mon[85099]: pgmap v181: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:21 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:21 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:21 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:21 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:boot 2024-03-12T16:19:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:21 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:19:21.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:21 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:19:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:21 smithi006 ceph-mon[103869]: pgmap v181: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:21 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:21 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:21 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:21 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:boot 2024-03-12T16:19:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:21 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:19:21.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:21 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:19:23.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:23 smithi134 ceph-mon[85099]: pgmap v182: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:23.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:23 smithi006 ceph-mon[103869]: pgmap v182: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:25.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:25 smithi134 ceph-mon[85099]: pgmap v183: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:25.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:25 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:25.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:25 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:25.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:25 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:25.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:25 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:25.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:25 smithi006 ceph-mon[103869]: pgmap v183: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:25.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:25 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:25.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:25 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:25.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:25 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:25.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:25 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:27 smithi134 ceph-mon[85099]: pgmap v184: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:27 smithi006 ceph-mon[103869]: pgmap v184: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:29.696 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: pgmap v185: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:29.697 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:29 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: pgmap v185: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:19:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:29.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:29.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:29.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:29.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:29.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:29 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:31 smithi134 ceph-mon[85099]: pgmap v186: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:31 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:31 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jqydtn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:19:31.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:31 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:31 smithi006 ceph-mon[103869]: pgmap v186: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:31 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:31 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.jqydtn", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:19:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:31 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:32.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:32 smithi134 ceph-mon[85099]: Upgrade: Updating mds.cephfs.smithi134.jqydtn 2024-03-12T16:19:32.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:32 smithi134 ceph-mon[85099]: Deploying daemon mds.cephfs.smithi134.jqydtn on smithi134 2024-03-12T16:19:32.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:19:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:32 smithi006 ceph-mon[103869]: Upgrade: Updating mds.cephfs.smithi134.jqydtn 2024-03-12T16:19:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:32 smithi006 ceph-mon[103869]: Deploying daemon mds.cephfs.smithi134.jqydtn on smithi134 2024-03-12T16:19:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:19:33.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:33 smithi134 ceph-mon[85099]: pgmap v187: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:33.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:33 smithi134 ceph-mon[85099]: osdmap e84: 6 total, 6 up, 6 in 2024-03-12T16:19:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:33 smithi006 ceph-mon[103869]: pgmap v187: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:33 smithi006 ceph-mon[103869]: osdmap e84: 6 total, 6 up, 6 in 2024-03-12T16:19:34.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:34 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-03-12T16:19:34.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:34 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-03-12T16:19:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:35 smithi134 ceph-mon[85099]: pgmap v189: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:35 smithi006 ceph-mon[103869]: pgmap v189: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:37.120 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:37.120 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:37.120 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:37.120 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:36 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] up:boot 2024-03-12T16:19:37.120 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:36 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:19:37.120 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:36 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:19:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:36 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] up:boot 2024-03-12T16:19:37.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:36 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:19:37.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:36 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:19:38.040 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:37 smithi134 ceph-mon[85099]: pgmap v190: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:37 smithi006 ceph-mon[103869]: pgmap v190: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:40.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:39 smithi134 ceph-mon[85099]: pgmap v191: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:40.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:39 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:40.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:39 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:39 smithi006 ceph-mon[103869]: pgmap v191: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:39 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:39 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:41.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:41 smithi134 ceph-mon[85099]: pgmap v192: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:41.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:41.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:41 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:41.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:41 smithi006 ceph-mon[103869]: pgmap v192: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:41.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:41.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:41 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:43.453 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:43 smithi134 ceph-mon[85099]: pgmap v193: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:43.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:43 smithi006 ceph-mon[103869]: pgmap v193: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:43.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.589+0000 7f53e8a81700 1 -- 172.21.15.6:0/3696749495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 msgr2=0x7f53e40f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:43.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.589+0000 7f53e8a81700 1 --2- 172.21.15.6:0/3696749495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 0x7f53e40f5fa0 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f53d80047f0 tx=0x7f53d8009cb0).stop 2024-03-12T16:19:43.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.590+0000 7f53e8a81700 1 -- 172.21.15.6:0/3696749495 shutdown_connections 2024-03-12T16:19:43.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.590+0000 7f53e8a81700 1 --2- 172.21.15.6:0/3696749495 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 0x7f53e40f5fa0 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:43.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.590+0000 7f53e8a81700 1 --2- 172.21.15.6:0/3696749495 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53e40fda50 0x7f53e40fde30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:43.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.590+0000 7f53e8a81700 1 -- 172.21.15.6:0/3696749495 >> 172.21.15.6:0/3696749495 conn(0x7f53e406ce50 msgr2=0x7f53e406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:43.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.590+0000 7f53e8a81700 1 -- 172.21.15.6:0/3696749495 shutdown_connections 2024-03-12T16:19:43.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.590+0000 7f53e8a81700 1 -- 172.21.15.6:0/3696749495 wait complete. 2024-03-12T16:19:43.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e8a81700 1 Processor -- start 2024-03-12T16:19:43.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e8a81700 1 -- start start 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e8a81700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53e40fda50 0x7f53e40f7270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e8a81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 0x7f53e40f7760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e8a81700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e40f7c50 con 0x7f53e40fe3b0 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e8a81700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f53e40f7d90 con 0x7f53e40fda50 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 0x7f53e40f7760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 0x7f53e40f7760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55332/0 (socket says 172.21.15.6:55332) 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e1d9b700 1 -- 172.21.15.6:0/1275269799 learned_addr learned my addr 172.21.15.6:0/1275269799 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e259c700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53e40fda50 0x7f53e40f7270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e1d9b700 1 -- 172.21.15.6:0/1275269799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53e40fda50 msgr2=0x7f53e40f7270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e1d9b700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53e40fda50 0x7f53e40f7270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:43.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e1d9b700 1 -- 172.21.15.6:0/1275269799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f53d8005040 con 0x7f53e40fe3b0 2024-03-12T16:19:43.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.591+0000 7f53e1d9b700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 0x7f53e40f7760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f53d8009380 tx=0x7f53d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:43.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.592+0000 7f53d37fe700 1 -- 172.21.15.6:0/1275269799 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d8018070 con 0x7f53e40fe3b0 2024-03-12T16:19:43.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.592+0000 7f53d37fe700 1 -- 172.21.15.6:0/1275269799 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f53d8007e90 con 0x7f53e40fe3b0 2024-03-12T16:19:43.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.592+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f53e40f7fe0 con 0x7f53e40fe3b0 2024-03-12T16:19:43.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.592+0000 7f53d37fe700 1 -- 172.21.15.6:0/1275269799 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f53d80123c0 con 0x7f53e40fe3b0 2024-03-12T16:19:43.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.592+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f53e41147d0 con 0x7f53e40fe3b0 2024-03-12T16:19:43.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.593+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f53e4047540 con 0x7f53e40fe3b0 2024-03-12T16:19:43.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.593+0000 7f53d37fe700 1 -- 172.21.15.6:0/1275269799 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f53d801d420 con 0x7f53e40fe3b0 2024-03-12T16:19:43.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.594+0000 7f53d37fe700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f53cc06caa0 0x7f53cc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:43.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.594+0000 7f53d37fe700 1 -- 172.21.15.6:0/1275269799 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f53d808c9e0 con 0x7f53e40fe3b0 2024-03-12T16:19:43.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.594+0000 7f53e259c700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f53cc06caa0 0x7f53cc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:43.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.594+0000 7f53e259c700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f53cc06caa0 0x7f53cc06ef60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f53d40048b0 tx=0x7f53d400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:43.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.599+0000 7f53d37fe700 1 -- 172.21.15.6:0/1275269799 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f53d80569f0 con 0x7f53e40fe3b0 2024-03-12T16:19:43.820 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.818+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f53e4059120 con 0x7f53cc06caa0 2024-03-12T16:19:43.821 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.819+0000 7f53d37fe700 1 -- 172.21.15.6:0/1275269799 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7f53e4059120 con 0x7f53cc06caa0 2024-03-12T16:19:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f53cc06caa0 msgr2=0x7f53cc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:43.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f53cc06caa0 0x7f53cc06ef60 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 rx=0x7f53d40048b0 tx=0x7f53d400b040).stop 2024-03-12T16:19:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 msgr2=0x7f53e40f7760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 0x7f53e40f7760 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f53d8009380 tx=0x7f53d8009cb0).stop 2024-03-12T16:19:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 shutdown_connections 2024-03-12T16:19:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53e40fda50 0x7f53e40f7270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f53cc06caa0 0x7f53cc06ef60 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 --2- 172.21.15.6:0/1275269799 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53e40fe3b0 0x7f53e40f7760 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 >> 172.21.15.6:0/1275269799 conn(0x7f53e406ce50 msgr2=0x7f53e40fbeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 shutdown_connections 2024-03-12T16:19:43.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.822+0000 7f53e8a81700 1 -- 172.21.15.6:0/1275269799 wait complete. 2024-03-12T16:19:43.834 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:19:43.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.925+0000 7fb49c147700 1 -- 172.21.15.6:0/1595895533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 msgr2=0x7fb4941019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.925+0000 7fb49c147700 1 --2- 172.21.15.6:0/1595895533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 0x7fb4941019b0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7fb4880047f0 tx=0x7fb488009cb0).stop 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.925+0000 7fb49c147700 1 -- 172.21.15.6:0/1595895533 shutdown_connections 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.925+0000 7fb49c147700 1 --2- 172.21.15.6:0/1595895533 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 0x7fb4941019b0 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.925+0000 7fb49c147700 1 --2- 172.21.15.6:0/1595895533 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4940f8940 0x7fb4940f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.925+0000 7fb49c147700 1 -- 172.21.15.6:0/1595895533 >> 172.21.15.6:0/1595895533 conn(0x7fb494070590 msgr2=0x7fb4940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.925+0000 7fb49c147700 1 -- 172.21.15.6:0/1595895533 shutdown_connections 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.925+0000 7fb49c147700 1 -- 172.21.15.6:0/1595895533 wait complete. 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.926+0000 7fb49c147700 1 Processor -- start 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.926+0000 7fb49c147700 1 -- start start 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.926+0000 7fb49c147700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4940f8940 0x7fb49410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:43.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.926+0000 7fb49c147700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 0x7fb49410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.926+0000 7fb49c147700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49410eb20 con 0x7fb4940f9210 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.926+0000 7fb49c147700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb49410ec60 con 0x7fb4940f8940 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.926+0000 7fb4996e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 0x7fb49410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.926+0000 7fb4996e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 0x7fb49410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55350/0 (socket says 172.21.15.6:55350) 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb4996e2700 1 -- 172.21.15.6:0/2341660710 learned_addr learned my addr 172.21.15.6:0/2341660710 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb499ee3700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4940f8940 0x7fb49410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb4996e2700 1 -- 172.21.15.6:0/2341660710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4940f8940 msgr2=0x7fb49410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb4996e2700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4940f8940 0x7fb49410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb4996e2700 1 -- 172.21.15.6:0/2341660710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb488005040 con 0x7fb4940f9210 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb4996e2700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 0x7fb49410e520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb488005010 tx=0x7fb488009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb486ffd700 1 -- 172.21.15.6:0/2341660710 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb48800e030 con 0x7fb4940f9210 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb486ffd700 1 -- 172.21.15.6:0/2341660710 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb488007e90 con 0x7fb4940f9210 2024-03-12T16:19:43.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb494108290 con 0x7fb4940f9210 2024-03-12T16:19:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb486ffd700 1 -- 172.21.15.6:0/2341660710 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb488018070 con 0x7fb4940f9210 2024-03-12T16:19:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.927+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb494108770 con 0x7fb4940f9210 2024-03-12T16:19:43.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.928+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb49405f590 con 0x7fb4940f9210 2024-03-12T16:19:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.929+0000 7fb486ffd700 1 -- 172.21.15.6:0/2341660710 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb48801d670 con 0x7fb4940f9210 2024-03-12T16:19:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.929+0000 7fb486ffd700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb48006caa0 0x7fb48006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.929+0000 7fb486ffd700 1 -- 172.21.15.6:0/2341660710 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb48808ce80 con 0x7fb4940f9210 2024-03-12T16:19:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.929+0000 7fb499ee3700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb48006caa0 0x7fb48006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:43.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.930+0000 7fb499ee3700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb48006caa0 0x7fb48006ef60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb490004e60 tx=0x7fb49000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:43.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:43.934+0000 7fb486ffd700 1 -- 172.21.15.6:0/2341660710 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb48805a750 con 0x7fb4940f9210 2024-03-12T16:19:44.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.154+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb4940fee40 con 0x7fb48006caa0 2024-03-12T16:19:44.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.155+0000 7fb486ffd700 1 -- 172.21.15.6:0/2341660710 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fb4940fee40 con 0x7fb48006caa0 2024-03-12T16:19:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb48006caa0 msgr2=0x7fb48006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb48006caa0 0x7fb48006ef60 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 rx=0x7fb490004e60 tx=0x7fb49000b040).stop 2024-03-12T16:19:44.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 msgr2=0x7fb49410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 0x7fb49410e520 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7fb488005010 tx=0x7fb488009cb0).stop 2024-03-12T16:19:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 shutdown_connections 2024-03-12T16:19:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4940f8940 0x7fb49410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb48006caa0 0x7fb48006ef60 unknown :-1 s=CLOSED pgs=95 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 --2- 172.21.15.6:0/2341660710 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4940f9210 0x7fb49410e520 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 >> 172.21.15.6:0/2341660710 conn(0x7fb494070590 msgr2=0x7fb4940fc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.157+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 shutdown_connections 2024-03-12T16:19:44.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.158+0000 7fb49c147700 1 -- 172.21.15.6:0/2341660710 wait complete. 2024-03-12T16:19:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.261+0000 7fad758f2700 1 -- 172.21.15.6:0/2442170518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006b660 msgr2=0x7fad7006bae0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.261+0000 7fad758f2700 1 --2- 172.21.15.6:0/2442170518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006b660 0x7fad7006bae0 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7fad640047f0 tx=0x7fad64009cb0).stop 2024-03-12T16:19:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.261+0000 7fad758f2700 1 -- 172.21.15.6:0/2442170518 shutdown_connections 2024-03-12T16:19:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.261+0000 7fad758f2700 1 --2- 172.21.15.6:0/2442170518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006b660 0x7fad7006bae0 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.261+0000 7fad758f2700 1 --2- 172.21.15.6:0/2442170518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7006cc20 0x7fad7006b170 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.261+0000 7fad758f2700 1 -- 172.21.15.6:0/2442170518 >> 172.21.15.6:0/2442170518 conn(0x7fad700f34b0 msgr2=0x7fad700f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.261+0000 7fad758f2700 1 -- 172.21.15.6:0/2442170518 shutdown_connections 2024-03-12T16:19:44.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.261+0000 7fad758f2700 1 -- 172.21.15.6:0/2442170518 wait complete. 2024-03-12T16:19:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.262+0000 7fad758f2700 1 Processor -- start 2024-03-12T16:19:44.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.262+0000 7fad758f2700 1 -- start start 2024-03-12T16:19:44.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.262+0000 7fad758f2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7006b660 0x7fad70114790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:44.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.262+0000 7fad758f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006cc20 0x7fad70114c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:44.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.262+0000 7fad758f2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad70115280 con 0x7fad7006cc20 2024-03-12T16:19:44.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.262+0000 7fad758f2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad701153c0 con 0x7fad7006b660 2024-03-12T16:19:44.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad6e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006cc20 0x7fad70114c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:44.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad6effd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7006b660 0x7fad70114790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad6e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006cc20 0x7fad70114c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55380/0 (socket says 172.21.15.6:55380) 2024-03-12T16:19:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad6e7fc700 1 -- 172.21.15.6:0/1759570660 learned_addr learned my addr 172.21.15.6:0/1759570660 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad6e7fc700 1 -- 172.21.15.6:0/1759570660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7006b660 msgr2=0x7fad70114790 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad6e7fc700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7006b660 0x7fad70114790 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad6e7fc700 1 -- 172.21.15.6:0/1759570660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad60005040 con 0x7fad7006cc20 2024-03-12T16:19:44.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad6effd700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7006b660 0x7fad70114790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_done state changed! 2024-03-12T16:19:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad6e7fc700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006cc20 0x7fad70114c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fad64009380 tx=0x7fad64009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad57fff700 1 -- 172.21.15.6:0/1759570660 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad64018070 con 0x7fad7006cc20 2024-03-12T16:19:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad57fff700 1 -- 172.21.15.6:0/1759570660 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad64007e90 con 0x7fad7006cc20 2024-03-12T16:19:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad64005040 con 0x7fad7006cc20 2024-03-12T16:19:44.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad57fff700 1 -- 172.21.15.6:0/1759570660 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad640123c0 con 0x7fad7006cc20 2024-03-12T16:19:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.263+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad7010ed70 con 0x7fad7006cc20 2024-03-12T16:19:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.264+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad7005f590 con 0x7fad7006cc20 2024-03-12T16:19:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.265+0000 7fad57fff700 1 -- 172.21.15.6:0/1759570660 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fad6401d420 con 0x7fad7006cc20 2024-03-12T16:19:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.265+0000 7fad57fff700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad5806caa0 0x7fad5806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:44.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.265+0000 7fad57fff700 1 -- 172.21.15.6:0/1759570660 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fad6408c9e0 con 0x7fad7006cc20 2024-03-12T16:19:44.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.265+0000 7fad6effd700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad5806caa0 0x7fad5806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:44.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.266+0000 7fad6effd700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad5806caa0 0x7fad5806ef60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fad60009760 tx=0x7fad6000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:44.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.270+0000 7fad57fff700 1 -- 172.21.15.6:0/1759570660 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fad6405a480 con 0x7fad7006cc20 2024-03-12T16:19:44.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.477+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fad700f8c20 con 0x7fad5806caa0 2024-03-12T16:19:44.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.487+0000 7fad57fff700 1 -- 172.21.15.6:0/1759570660 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fad700f8c20 con 0x7fad5806caa0 2024-03-12T16:19:44.489 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:19:44.489 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (6m) 20s ago 17m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:19:44.489 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (4m) 20s ago 17m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (4m) 5s ago 16m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (6m) 20s ago 17m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (41s) 20s ago 12m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (24s) 20s ago 12m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (9s) 5s ago 12m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (12m) 5s ago 12m 18.8M - 16.2.15-1-g8963e9de 727f386679cb fd7fce1443f9 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (8m) 20s ago 18m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (7m) 5s ago 16m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (5m) 20s ago 19m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (4m) 5s ago 16m 42.2M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (7m) 20s ago 17m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 5s ago 16m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (3m) 20s ago 16m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (3m) 20s ago 15m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:19:44.490 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (2m) 20s ago 15m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:19:44.491 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (2m) 5s ago 14m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:19:44.491 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (93s) 5s ago 14m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:19:44.491 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (60s) 5s ago 13m 87.8M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:19:44.491 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (6m) 5s ago 15m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:19:44.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad5806caa0 msgr2=0x7fad5806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad5806caa0 0x7fad5806ef60 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 rx=0x7fad60009760 tx=0x7fad6000b040).stop 2024-03-12T16:19:44.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006cc20 msgr2=0x7fad70114c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006cc20 0x7fad70114c80 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fad64009380 tx=0x7fad64009cb0).stop 2024-03-12T16:19:44.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 shutdown_connections 2024-03-12T16:19:44.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad7006b660 0x7fad70114790 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad5806caa0 0x7fad5806ef60 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 --2- 172.21.15.6:0/1759570660 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad7006cc20 0x7fad70114c80 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 >> 172.21.15.6:0/1759570660 conn(0x7fad700f34b0 msgr2=0x7fad70106c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:44.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.489+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 shutdown_connections 2024-03-12T16:19:44.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.490+0000 7fad758f2700 1 -- 172.21.15.6:0/1759570660 wait complete. 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.590+0000 7feb8241a700 1 -- 172.21.15.6:0/1845667967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 msgr2=0x7feb7c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.590+0000 7feb8241a700 1 --2- 172.21.15.6:0/1845667967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 0x7feb7c0f6930 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7feb700047f0 tx=0x7feb70009cb0).stop 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.590+0000 7feb8241a700 1 -- 172.21.15.6:0/1845667967 shutdown_connections 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.590+0000 7feb8241a700 1 --2- 172.21.15.6:0/1845667967 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 0x7feb7c0f6930 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.590+0000 7feb8241a700 1 --2- 172.21.15.6:0/1845667967 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7c0fc7f0 0x7feb7c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.590+0000 7feb8241a700 1 -- 172.21.15.6:0/1845667967 >> 172.21.15.6:0/1845667967 conn(0x7feb7c070590 msgr2=0x7feb7c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.590+0000 7feb8241a700 1 -- 172.21.15.6:0/1845667967 shutdown_connections 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.590+0000 7feb8241a700 1 -- 172.21.15.6:0/1845667967 wait complete. 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.591+0000 7feb8241a700 1 Processor -- start 2024-03-12T16:19:44.593 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.591+0000 7feb8241a700 1 -- start start 2024-03-12T16:19:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.591+0000 7feb8241a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7c0fc7f0 0x7feb7c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.591+0000 7feb8241a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 0x7feb7c10e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.591+0000 7feb8241a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c10eab0 con 0x7feb7c0fd150 2024-03-12T16:19:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.591+0000 7feb8241a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7feb7c10ebf0 con 0x7feb7c0fc7f0 2024-03-12T16:19:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 0x7feb7c10e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 0x7feb7c10e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55398/0 (socket says 172.21.15.6:55398) 2024-03-12T16:19:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb7b7fe700 1 -- 172.21.15.6:0/2918164657 learned_addr learned my addr 172.21.15.6:0/2918164657 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb7bfff700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7c0fc7f0 0x7feb7c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:44.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb7b7fe700 1 -- 172.21.15.6:0/2918164657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7c0fc7f0 msgr2=0x7feb7c10dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb7b7fe700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7c0fc7f0 0x7feb7c10dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb7b7fe700 1 -- 172.21.15.6:0/2918164657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7feb70005040 con 0x7feb7c0fd150 2024-03-12T16:19:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb7b7fe700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 0x7feb7c10e4b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7feb700099f0 tx=0x7feb70009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb797fa700 1 -- 172.21.15.6:0/2918164657 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb7000e030 con 0x7feb7c0fd150 2024-03-12T16:19:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7feb7c108220 con 0x7feb7c0fd150 2024-03-12T16:19:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb797fa700 1 -- 172.21.15.6:0/2918164657 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7feb70007e90 con 0x7feb7c0fd150 2024-03-12T16:19:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb797fa700 1 -- 172.21.15.6:0/2918164657 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7feb70018070 con 0x7feb7c0fd150 2024-03-12T16:19:44.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.592+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7feb7c108700 con 0x7feb7c0fd150 2024-03-12T16:19:44.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.593+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7feb7c05f590 con 0x7feb7c0fd150 2024-03-12T16:19:44.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.594+0000 7feb797fa700 1 -- 172.21.15.6:0/2918164657 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7feb700094c0 con 0x7feb7c0fd150 2024-03-12T16:19:44.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.594+0000 7feb797fa700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feb6406caa0 0x7feb6406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:44.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.594+0000 7feb797fa700 1 -- 172.21.15.6:0/2918164657 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7feb7008d000 con 0x7feb7c0fd150 2024-03-12T16:19:44.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.594+0000 7feb7bfff700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feb6406caa0 0x7feb6406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:44.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.595+0000 7feb7bfff700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feb6406caa0 0x7feb6406ef60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7feb6c004e60 tx=0x7feb6c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:44.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.599+0000 7feb797fa700 1 -- 172.21.15.6:0/2918164657 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7feb7005ab60 con 0x7feb7c0fd150 2024-03-12T16:19:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.881+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7feb7c108d40 con 0x7feb7c0fd150 2024-03-12T16:19:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.882+0000 7feb797fa700 1 -- 172.21.15.6:0/2918164657 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+842 (secure 0 0 0) 0x7feb7005a6f0 con 0x7feb7c0fd150 2024-03-12T16:19:44.885 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:19:44.885 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:19:44.885 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:19:44.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:19:44.886 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:19:44.886 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:19:44.886 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:19:44.887 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:19:44.887 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:19:44.887 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:19:44.887 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:19:44.888 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-03-12T16:19:44.888 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 3 2024-03-12T16:19:44.888 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:19:44.888 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:19:44.889 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 16.2.15-1-g8963e9de (8963e9dec9df5145388f0d6f6f32af0a74591caf) pacific (stable)": 1, 2024-03-12T16:19:44.889 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 13 2024-03-12T16:19:44.889 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:19:44.889 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:19:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feb6406caa0 msgr2=0x7feb6406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feb6406caa0 0x7feb6406ef60 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 rx=0x7feb6c004e60 tx=0x7feb6c00b040).stop 2024-03-12T16:19:44.891 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 msgr2=0x7feb7c10e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 0x7feb7c10e4b0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7feb700099f0 tx=0x7feb70009cb0).stop 2024-03-12T16:19:44.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 shutdown_connections 2024-03-12T16:19:44.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7feb7c0fc7f0 0x7feb7c10dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feb6406caa0 0x7feb6406ef60 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 --2- 172.21.15.6:0/2918164657 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7feb7c0fd150 0x7feb7c10e4b0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 >> 172.21.15.6:0/2918164657 conn(0x7feb7c070590 msgr2=0x7feb7c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:44.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 shutdown_connections 2024-03-12T16:19:44.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.884+0000 7feb8241a700 1 -- 172.21.15.6:0/2918164657 wait complete. 2024-03-12T16:19:44.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.986+0000 7fc6fac38700 1 -- 172.21.15.6:0/3950676549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fd8f0 msgr2=0x7fc6f40fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.986+0000 7fc6fac38700 1 --2- 172.21.15.6:0/3950676549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fd8f0 0x7fc6f40fdcd0 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7fc6e80047f0 tx=0x7fc6e8009cb0).stop 2024-03-12T16:19:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.986+0000 7fc6fac38700 1 -- 172.21.15.6:0/3950676549 shutdown_connections 2024-03-12T16:19:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.986+0000 7fc6fac38700 1 --2- 172.21.15.6:0/3950676549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6f40fe250 0x7fc6f40f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.986+0000 7fc6fac38700 1 --2- 172.21.15.6:0/3950676549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fd8f0 0x7fc6f40fdcd0 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.986+0000 7fc6fac38700 1 -- 172.21.15.6:0/3950676549 >> 172.21.15.6:0/3950676549 conn(0x7fc6f40f34b0 msgr2=0x7fc6f40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:44.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.986+0000 7fc6fac38700 1 -- 172.21.15.6:0/3950676549 shutdown_connections 2024-03-12T16:19:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.986+0000 7fc6fac38700 1 -- 172.21.15.6:0/3950676549 wait complete. 2024-03-12T16:19:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6fac38700 1 Processor -- start 2024-03-12T16:19:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6fac38700 1 -- start start 2024-03-12T16:19:44.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6fac38700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6f40fd8f0 0x7fc6f410dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6fac38700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fe250 0x7fc6f410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6fac38700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f410ead0 con 0x7fc6f40fe250 2024-03-12T16:19:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6fac38700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6f410ec10 con 0x7fc6f40fd8f0 2024-03-12T16:19:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fe250 0x7fc6f410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:44.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fe250 0x7fc6f410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55420/0 (socket says 172.21.15.6:55420) 2024-03-12T16:19:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6f3fff700 1 -- 172.21.15.6:0/1693727736 learned_addr learned my addr 172.21.15.6:0/1693727736 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6f89d4700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6f40fd8f0 0x7fc6f410dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6f3fff700 1 -- 172.21.15.6:0/1693727736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6f40fd8f0 msgr2=0x7fc6f410dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:44.998 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6f3fff700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6f40fd8f0 0x7fc6f410dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6f3fff700 1 -- 172.21.15.6:0/1693727736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6e8005040 con 0x7fc6f40fe250 2024-03-12T16:19:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.987+0000 7fc6f3fff700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fe250 0x7fc6f410e4d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc6e000c710 tx=0x7fc6e0007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.988+0000 7fc6f1ffb700 1 -- 172.21.15.6:0/1693727736 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e000e680 con 0x7fc6f40fe250 2024-03-12T16:19:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.988+0000 7fc6f1ffb700 1 -- 172.21.15.6:0/1693727736 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6e000ec90 con 0x7fc6f40fe250 2024-03-12T16:19:44.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.988+0000 7fc6f1ffb700 1 -- 172.21.15.6:0/1693727736 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6e0013d40 con 0x7fc6f40fe250 2024-03-12T16:19:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.988+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6f41082a0 con 0x7fc6f40fe250 2024-03-12T16:19:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.988+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6f4108860 con 0x7fc6f40fe250 2024-03-12T16:19:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.989+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6f405f590 con 0x7fc6f40fe250 2024-03-12T16:19:45.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.989+0000 7fc6f1ffb700 1 -- 172.21.15.6:0/1693727736 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fc6e000e7e0 con 0x7fc6f40fe250 2024-03-12T16:19:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.990+0000 7fc6f1ffb700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e406caa0 0x7fc6e406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.990+0000 7fc6f89d4700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e406caa0 0x7fc6e406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.990+0000 7fc6f1ffb700 1 -- 172.21.15.6:0/1693727736 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc6e008ba90 con 0x7fc6f40fe250 2024-03-12T16:19:45.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.990+0000 7fc6f89d4700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e406caa0 0x7fc6e406ef60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc6e8007cf0 tx=0x7fc6e800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:45.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:44.994+0000 7fc6f1ffb700 1 -- 172.21.15.6:0/1693727736 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc6e00595f0 con 0x7fc6f40fe250 2024-03-12T16:19:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.235+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc6f4047540 con 0x7fc6f40fe250 2024-03-12T16:19:45.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.236+0000 7fc6f1ffb700 1 -- 172.21.15.6:0/1693727736 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 24 v24) v1 ==== 76+0+1835 (secure 0 0 0) 0x7fc6e0059180 con 0x7fc6f40fe250 2024-03-12T16:19:45.238 INFO:teuthology.orchestra.run.smithi006.stdout:e24 2024-03-12T16:19:45.238 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:19:45.238 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:19:45.239 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:19:45.239 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:19:45.239 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:19:45.239 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:19:45.239 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:19:45.239 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:19:45.239 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:19:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:19:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:19:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:19:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:19:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:19:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:19:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:19:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:19:45.240 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:19:45.241 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:19:45.241 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:19:45.241 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:19:45.241 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:19:45.241 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:19:45.241 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:19:45.241 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:19:45.241 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:19:45.241 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:19:45.242 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:19:45.242 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:19:45.242 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:19:45.242 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:19:45.242 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:19:45.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:19:45.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:19:45.242 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:19:45.242 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:19:45.243 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:24283} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/2682762789,v1:172.21.15.134:6827/2682762789] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:19:45.243 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:19:45.243 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:19:45.243 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:19:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e406caa0 msgr2=0x7fc6e406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e406caa0 0x7fc6e406ef60 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 rx=0x7fc6e8007cf0 tx=0x7fc6e800b040).stop 2024-03-12T16:19:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fe250 msgr2=0x7fc6f410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fe250 0x7fc6f410e4d0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fc6e000c710 tx=0x7fc6e0007ec0).stop 2024-03-12T16:19:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 shutdown_connections 2024-03-12T16:19:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6f40fd8f0 0x7fc6f410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6e406caa0 0x7fc6e406ef60 unknown :-1 s=CLOSED pgs=98 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 --2- 172.21.15.6:0/1693727736 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6f40fe250 0x7fc6f410e4d0 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 >> 172.21.15.6:0/1693727736 conn(0x7fc6f40f34b0 msgr2=0x7fc6f40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 shutdown_connections 2024-03-12T16:19:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.238+0000 7fc6fac38700 1 -- 172.21.15.6:0/1693727736 wait complete. 2024-03-12T16:19:45.245 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2024-03-12T16:19:45.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 -- 172.21.15.6:0/3039788085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 msgr2=0x7fd3900f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 --2- 172.21.15.6:0/3039788085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 0x7fd3900f6930 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fd3800047f0 tx=0x7fd380009cb0).stop 2024-03-12T16:19:45.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 -- 172.21.15.6:0/3039788085 shutdown_connections 2024-03-12T16:19:45.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 --2- 172.21.15.6:0/3039788085 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 0x7fd3900f6930 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 --2- 172.21.15.6:0/3039788085 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900fc7f0 0x7fd3900fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 -- 172.21.15.6:0/3039788085 >> 172.21.15.6:0/3039788085 conn(0x7fd390070590 msgr2=0x7fd3900f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 -- 172.21.15.6:0/3039788085 shutdown_connections 2024-03-12T16:19:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 -- 172.21.15.6:0/3039788085 wait complete. 2024-03-12T16:19:45.350 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 Processor -- start 2024-03-12T16:19:45.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.343+0000 7fd397cec700 1 -- start start 2024-03-12T16:19:45.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd397cec700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900fc7f0 0x7fd39010e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:45.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd397cec700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 0x7fd39010e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:45.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd397cec700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39010eb90 con 0x7fd3900fd150 2024-03-12T16:19:45.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd397cec700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd39010ecd0 con 0x7fd3900fc7f0 2024-03-12T16:19:45.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd395287700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 0x7fd39010e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:45.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd395287700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 0x7fd39010e590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55436/0 (socket says 172.21.15.6:55436) 2024-03-12T16:19:45.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd395287700 1 -- 172.21.15.6:0/1750188080 learned_addr learned my addr 172.21.15.6:0/1750188080 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:45.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd395a88700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900fc7f0 0x7fd39010e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:45.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd395287700 1 -- 172.21.15.6:0/1750188080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900fc7f0 msgr2=0x7fd39010e0a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd395287700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900fc7f0 0x7fd39010e0a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd395287700 1 -- 172.21.15.6:0/1750188080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd380005040 con 0x7fd3900fd150 2024-03-12T16:19:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd395287700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 0x7fd39010e590 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fd380009360 tx=0x7fd380009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd386ffd700 1 -- 172.21.15.6:0/1750188080 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd380018070 con 0x7fd3900fd150 2024-03-12T16:19:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd386ffd700 1 -- 172.21.15.6:0/1750188080 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd380007e90 con 0x7fd3900fd150 2024-03-12T16:19:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd390108340 con 0x7fd3900fd150 2024-03-12T16:19:45.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd386ffd700 1 -- 172.21.15.6:0/1750188080 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd3800123c0 con 0x7fd3900fd150 2024-03-12T16:19:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.344+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3901088a0 con 0x7fd3900fd150 2024-03-12T16:19:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.345+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd39005f590 con 0x7fd3900fd150 2024-03-12T16:19:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.346+0000 7fd386ffd700 1 -- 172.21.15.6:0/1750188080 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd38001d420 con 0x7fd3900fd150 2024-03-12T16:19:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.346+0000 7fd386ffd700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd37c06cab0 0x7fd37c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.346+0000 7fd386ffd700 1 -- 172.21.15.6:0/1750188080 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd38008cae0 con 0x7fd3900fd150 2024-03-12T16:19:45.354 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.346+0000 7fd395a88700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd37c06cab0 0x7fd37c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.347+0000 7fd395a88700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd37c06cab0 0x7fd37c06ef70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd38c0092f0 tx=0x7fd38c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:45.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.351+0000 7fd386ffd700 1 -- 172.21.15.6:0/1750188080 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd380056bb0 con 0x7fd3900fd150 2024-03-12T16:19:45.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:45.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: pgmap v194: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:45.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:45.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:45.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:45.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:19:45.454 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:45.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:45.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:45.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:45.455 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:45 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2918164657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='client.34416 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: pgmap v194: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='client.34420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:45.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='client.34424 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:45.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:45 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2918164657' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:19:45.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.568+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd390108f30 con 0x7fd37c06cab0 2024-03-12T16:19:45.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.569+0000 7fd386ffd700 1 -- 172.21.15.6:0/1750188080 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+416 (secure 0 0 0) 0x7fd390108f30 con 0x7fd37c06cab0 2024-03-12T16:19:45.571 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:19:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:19:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:19:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:19:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:19:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:19:45.571 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:19:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:19:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "crash" 2024-03-12T16:19:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:19:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "15/21 daemons upgraded", 2024-03-12T16:19:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:19:45.572 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:19:45.572 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:19:45.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd37c06cab0 msgr2=0x7fd37c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd37c06cab0 0x7fd37c06ef70 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 rx=0x7fd38c0092f0 tx=0x7fd38c00b040).stop 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 msgr2=0x7fd39010e590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 0x7fd39010e590 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fd380009360 tx=0x7fd380009cb0).stop 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 shutdown_connections 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3900fc7f0 0x7fd39010e0a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd37c06cab0 0x7fd37c06ef70 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 --2- 172.21.15.6:0/1750188080 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3900fd150 0x7fd39010e590 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 >> 172.21.15.6:0/1750188080 conn(0x7fd390070590 msgr2=0x7fd390060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 shutdown_connections 2024-03-12T16:19:45.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.571+0000 7fd397cec700 1 -- 172.21.15.6:0/1750188080 wait complete. 2024-03-12T16:19:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.673+0000 7f278927f700 1 -- 172.21.15.6:0/3642886467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fe2d0 msgr2=0x7f27840f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.673+0000 7f278927f700 1 --2- 172.21.15.6:0/3642886467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fe2d0 0x7f27840f7ab0 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f27780047f0 tx=0x7f2778009cb0).stop 2024-03-12T16:19:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.673+0000 7f278927f700 1 -- 172.21.15.6:0/3642886467 shutdown_connections 2024-03-12T16:19:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.673+0000 7f278927f700 1 --2- 172.21.15.6:0/3642886467 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fe2d0 0x7f27840f7ab0 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.673+0000 7f278927f700 1 --2- 172.21.15.6:0/3642886467 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27840fd970 0x7f27840fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.673+0000 7f278927f700 1 -- 172.21.15.6:0/3642886467 >> 172.21.15.6:0/3642886467 conn(0x7f27840f3550 msgr2=0x7f27840f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.673+0000 7f278927f700 1 -- 172.21.15.6:0/3642886467 shutdown_connections 2024-03-12T16:19:45.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.674+0000 7f278927f700 1 -- 172.21.15.6:0/3642886467 wait complete. 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.674+0000 7f278927f700 1 Processor -- start 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.674+0000 7f278927f700 1 -- start start 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.674+0000 7f278927f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fd970 0x7f278410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.674+0000 7f278927f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27840fe2d0 0x7f278410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.674+0000 7f278927f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278410eb50 con 0x7f27840fd970 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f278927f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f278410ec90 con 0x7f27840fe2d0 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f2782ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fd970 0x7f278410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f2782ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fd970 0x7f278410e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:55448/0 (socket says 172.21.15.6:55448) 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f2782ffd700 1 -- 172.21.15.6:0/2804190024 learned_addr learned my addr 172.21.15.6:0/2804190024 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f27827fc700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27840fe2d0 0x7f278410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:45.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f2782ffd700 1 -- 172.21.15.6:0/2804190024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27840fe2d0 msgr2=0x7f278410e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f2782ffd700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27840fe2d0 0x7f278410e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f2782ffd700 1 -- 172.21.15.6:0/2804190024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2778005040 con 0x7f27840fd970 2024-03-12T16:19:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f2782ffd700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fd970 0x7f278410e060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f27740041d0 tx=0x7f2774009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f276bfff700 1 -- 172.21.15.6:0/2804190024 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2774007b40 con 0x7f27840fd970 2024-03-12T16:19:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f276bfff700 1 -- 172.21.15.6:0/2804190024 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f277400f040 con 0x7f27840fd970 2024-03-12T16:19:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f276bfff700 1 -- 172.21.15.6:0/2804190024 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27740147b0 con 0x7f27840fd970 2024-03-12T16:19:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2784108320 con 0x7f27840fd970 2024-03-12T16:19:45.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.675+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2784108860 con 0x7f27840fd970 2024-03-12T16:19:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.676+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2784060370 con 0x7f27840fd970 2024-03-12T16:19:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.677+0000 7f276bfff700 1 -- 172.21.15.6:0/2804190024 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2774009110 con 0x7f27840fd970 2024-03-12T16:19:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.677+0000 7f276bfff700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276c06caa0 0x7f276c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:19:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.677+0000 7f276bfff700 1 -- 172.21.15.6:0/2804190024 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(84..84 src has 1..84) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f277408bd90 con 0x7f27840fd970 2024-03-12T16:19:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.677+0000 7f27827fc700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276c06caa0 0x7f276c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:19:45.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.678+0000 7f27827fc700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276c06caa0 0x7f276c06ef60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f27841099a0 tx=0x7f277800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:19:45.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.682+0000 7f276bfff700 1 -- 172.21.15.6:0/2804190024 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f27740598f0 con 0x7f27840fd970 2024-03-12T16:19:45.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.965+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2784109780 con 0x7f27840fd970 2024-03-12T16:19:45.967 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.965+0000 7f276bfff700 1 -- 172.21.15.6:0/2804190024 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f2774059480 con 0x7f27840fd970 2024-03-12T16:19:45.968 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:19:45.968 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:19:45.968 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:19:45.968 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:19:45.968 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.967+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276c06caa0 msgr2=0x7f276c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.967+0000 7f278927f700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276c06caa0 0x7f276c06ef60 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 rx=0x7f27841099a0 tx=0x7f277800b040).stop 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.967+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fd970 msgr2=0x7f278410e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.967+0000 7f278927f700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fd970 0x7f278410e060 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7f27740041d0 tx=0x7f2774009f60).stop 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.968+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 shutdown_connections 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.968+0000 7f278927f700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276c06caa0 0x7f276c06ef60 unknown :-1 s=CLOSED pgs=100 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.968+0000 7f278927f700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27840fd970 0x7f278410e060 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.968+0000 7f278927f700 1 --2- 172.21.15.6:0/2804190024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27840fe2d0 0x7f278410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.968+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 >> 172.21.15.6:0/2804190024 conn(0x7f27840f3550 msgr2=0x7f27840fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:19:45.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.968+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 shutdown_connections 2024-03-12T16:19:45.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:19:45.968+0000 7f278927f700 1 -- 172.21.15.6:0/2804190024 wait complete. 2024-03-12T16:19:46.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:46 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1693727736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:19:46.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:46 smithi134 ceph-mon[85099]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:46.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:46 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:46.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:46 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ufgvbd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:19:46.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:46 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:46.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:46 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2804190024' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:19:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:46 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1693727736' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:19:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:46 smithi006 ceph-mon[103869]: from='client.34436 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:19:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:46 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:46 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get-or-create", "entity": "mds.cephfs.smithi134.ufgvbd", "caps": ["mon", "profile mds", "osd", "allow rw tag cephfs *=*", "mds", "allow"]}]: dispatch 2024-03-12T16:19:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:46 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:19:46.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:46 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2804190024' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:19:47.293 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:47 smithi134 ceph-mon[85099]: pgmap v195: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:47.293 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:47 smithi134 ceph-mon[85099]: Upgrade: Updating mds.cephfs.smithi134.ufgvbd 2024-03-12T16:19:47.294 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:47 smithi134 ceph-mon[85099]: Deploying daemon mds.cephfs.smithi134.ufgvbd on smithi134 2024-03-12T16:19:47.294 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:19:47.457 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:47 smithi006 ceph-mon[103869]: pgmap v195: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:47.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:47 smithi006 ceph-mon[103869]: Upgrade: Updating mds.cephfs.smithi134.ufgvbd 2024-03-12T16:19:47.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:47 smithi006 ceph-mon[103869]: Deploying daemon mds.cephfs.smithi134.ufgvbd on smithi134 2024-03-12T16:19:47.458 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:19:49.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:48 smithi134 ceph-mon[85099]: osdmap e85: 6 total, 6 up, 6 in 2024-03-12T16:19:49.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:48 smithi134 ceph-mon[85099]: pgmap v197: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:49.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:48 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-03-12T16:19:49.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:48 smithi006 ceph-mon[103869]: osdmap e85: 6 total, 6 up, 6 in 2024-03-12T16:19:49.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:48 smithi006 ceph-mon[103869]: pgmap v197: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:49.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:48 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 3 up:standby, 2 failed 2024-03-12T16:19:51.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:50 smithi134 ceph-mon[85099]: pgmap v198: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:51.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:50 smithi006 ceph-mon[103869]: pgmap v198: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:52.909 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:52.910 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:52.910 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:52.910 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:52 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] up:boot 2024-03-12T16:19:52.910 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:52 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:19:52.910 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:19:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:19:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:52 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] up:boot 2024-03-12T16:19:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:52 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:19:52.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "mds metadata", "who": "cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:19:53.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:53 smithi134 ceph-mon[85099]: pgmap v199: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:53.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:53 smithi006 ceph-mon[103869]: pgmap v199: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:55 smithi134 ceph-mon[85099]: pgmap v200: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:55 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:55 smithi006 ceph-mon[103869]: pgmap v200: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:55 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:19:57.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:57 smithi134 ceph-mon[85099]: pgmap v201: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:57.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:57 smithi006 ceph-mon[103869]: pgmap v201: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:59.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:19:59 smithi134 ceph-mon[85099]: pgmap v202: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:19:59.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:19:59 smithi006 ceph-mon[103869]: pgmap v202: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:00.455 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[103846]: 2024-03-12T16:19:59.998+0000 7f02e60e0700 -1 log_channel(cluster) log [ERR] : Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:20:00.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[103846]: 2024-03-12T16:19:59.998+0000 7f02e60e0700 -1 log_channel(cluster) log [ERR] : [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:20:00.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[103846]: 2024-03-12T16:19:59.998+0000 7f02e60e0700 -1 log_channel(cluster) log [ERR] : fs cephfs is degraded 2024-03-12T16:20:00.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[103846]: 2024-03-12T16:19:59.998+0000 7f02e60e0700 -1 log_channel(cluster) log [ERR] : [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:20:00.456 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[103846]: 2024-03-12T16:19:59.998+0000 7f02e60e0700 -1 log_channel(cluster) log [ERR] : fs cephfs is offline because no MDS is active for it. 2024-03-12T16:20:00.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-mon[103869]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:20:00.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-mon[103869]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:20:00.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-mon[103869]: fs cephfs is degraded 2024-03-12T16:20:00.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-mon[103869]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:20:00.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:00 smithi006 ceph-mon[103869]: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:20:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:00 smithi134 ceph-mon[85099]: Health detail: HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:20:00.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:00 smithi134 ceph-mon[85099]: [WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:20:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:00 smithi134 ceph-mon[85099]: fs cephfs is degraded 2024-03-12T16:20:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:00 smithi134 ceph-mon[85099]: [ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:20:00.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:00 smithi134 ceph-mon[85099]: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:20:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:01 smithi006 ceph-mon[103869]: pgmap v203: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:01 smithi134 ceph-mon[85099]: pgmap v203: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:02.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:20:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:20:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:03 smithi134 ceph-mon[85099]: pgmap v204: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:03 smithi006 ceph-mon[103869]: pgmap v204: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:05.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:05 smithi134 ceph-mon[85099]: pgmap v205: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:05.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:05 smithi006 ceph-mon[103869]: pgmap v205: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:07.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:07 smithi134 ceph-mon[85099]: pgmap v206: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:07.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:07 smithi006 ceph-mon[103869]: pgmap v206: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:09.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:09 smithi134 ceph-mon[85099]: pgmap v207: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:09 smithi006 ceph-mon[103869]: pgmap v207: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:11.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:11 smithi134 ceph-mon[85099]: pgmap v208: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:11.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:11 smithi006 ceph-mon[103869]: pgmap v208: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:13.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:13 smithi134 ceph-mon[85099]: pgmap v209: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:13.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:13 smithi006 ceph-mon[103869]: pgmap v209: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:15.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:15 smithi134 ceph-mon[85099]: pgmap v210: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:15 smithi006 ceph-mon[103869]: pgmap v210: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:16.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.085+0000 7fe45fa7a700 1 -- 172.21.15.6:0/2563550233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 msgr2=0x7fe458101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.085+0000 7fe45fa7a700 1 --2- 172.21.15.6:0/2563550233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 0x7fe458101910 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7fe4480047f0 tx=0x7fe448009cb0).stop 2024-03-12T16:20:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.085+0000 7fe45fa7a700 1 -- 172.21.15.6:0/2563550233 shutdown_connections 2024-03-12T16:20:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.085+0000 7fe45fa7a700 1 --2- 172.21.15.6:0/2563550233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 0x7fe458101910 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.085+0000 7fe45fa7a700 1 --2- 172.21.15.6:0/2563550233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4580f88a0 0x7fe4580f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.085+0000 7fe45fa7a700 1 -- 172.21.15.6:0/2563550233 >> 172.21.15.6:0/2563550233 conn(0x7fe458070590 msgr2=0x7fe4580f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.085+0000 7fe45fa7a700 1 -- 172.21.15.6:0/2563550233 shutdown_connections 2024-03-12T16:20:16.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.085+0000 7fe45fa7a700 1 -- 172.21.15.6:0/2563550233 wait complete. 2024-03-12T16:20:16.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.086+0000 7fe45fa7a700 1 Processor -- start 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.086+0000 7fe45fa7a700 1 -- start start 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.086+0000 7fe45fa7a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4580f88a0 0x7fe458110320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.086+0000 7fe45fa7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 0x7fe458110810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.086+0000 7fe45fa7a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe458110e10 con 0x7fe4580f9200 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.086+0000 7fe45fa7a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe458110f50 con 0x7fe4580f88a0 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.086+0000 7fe45d015700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 0x7fe458110810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.086+0000 7fe45d015700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 0x7fe458110810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40094/0 (socket says 172.21.15.6:40094) 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.086+0000 7fe45d015700 1 -- 172.21.15.6:0/934236288 learned_addr learned my addr 172.21.15.6:0/934236288 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe45d816700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4580f88a0 0x7fe458110320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe45d015700 1 -- 172.21.15.6:0/934236288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4580f88a0 msgr2=0x7fe458110320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe45d015700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4580f88a0 0x7fe458110320 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe45d015700 1 -- 172.21.15.6:0/934236288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe448005040 con 0x7fe4580f9200 2024-03-12T16:20:16.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe45d015700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 0x7fe458110810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fe448013640 tx=0x7fe448009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:16.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe44ef78700 1 -- 172.21.15.6:0/934236288 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe44800e030 con 0x7fe4580f9200 2024-03-12T16:20:16.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe44ef78700 1 -- 172.21.15.6:0/934236288 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe448007e90 con 0x7fe4580f9200 2024-03-12T16:20:16.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe45810a5c0 con 0x7fe4580f9200 2024-03-12T16:20:16.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe44ef78700 1 -- 172.21.15.6:0/934236288 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe448018070 con 0x7fe4580f9200 2024-03-12T16:20:16.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.087+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe45810aaa0 con 0x7fe4580f9200 2024-03-12T16:20:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.088+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe45805f590 con 0x7fe4580f9200 2024-03-12T16:20:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.089+0000 7fe44ef78700 1 -- 172.21.15.6:0/934236288 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe44801d420 con 0x7fe4580f9200 2024-03-12T16:20:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.089+0000 7fe44ef78700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe44406cab0 0x7fe44406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.089+0000 7fe44ef78700 1 -- 172.21.15.6:0/934236288 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe44808d190 con 0x7fe4580f9200 2024-03-12T16:20:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.089+0000 7fe45d816700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe44406cab0 0x7fe44406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:16.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.090+0000 7fe45d816700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe44406cab0 0x7fe44406ef70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe4540041d0 tx=0x7fe454009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:16.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.094+0000 7fe44ef78700 1 -- 172.21.15.6:0/934236288 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe448057260 con 0x7fe4580f9200 2024-03-12T16:20:16.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.313+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe45810b9e0 con 0x7fe44406cab0 2024-03-12T16:20:16.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.315+0000 7fe44ef78700 1 -- 172.21.15.6:0/934236288 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe45810b9e0 con 0x7fe44406cab0 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.316+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe44406cab0 msgr2=0x7fe44406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.316+0000 7fe45fa7a700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe44406cab0 0x7fe44406ef70 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 rx=0x7fe4540041d0 tx=0x7fe454009040).stop 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.316+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 msgr2=0x7fe458110810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.316+0000 7fe45fa7a700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 0x7fe458110810 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fe448013640 tx=0x7fe448009cb0).stop 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.317+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 shutdown_connections 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.317+0000 7fe45fa7a700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe4580f88a0 0x7fe458110320 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.317+0000 7fe45fa7a700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe44406cab0 0x7fe44406ef70 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.317+0000 7fe45fa7a700 1 --2- 172.21.15.6:0/934236288 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe4580f9200 0x7fe458110810 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.317+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 >> 172.21.15.6:0/934236288 conn(0x7fe458070590 msgr2=0x7fe4580f6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.317+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 shutdown_connections 2024-03-12T16:20:16.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.317+0000 7fe45fa7a700 1 -- 172.21.15.6:0/934236288 wait complete. 2024-03-12T16:20:16.329 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:20:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.420+0000 7fcad4ca7700 1 -- 172.21.15.6:0/1633393126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fc7f0 msgr2=0x7fcad00fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.420+0000 7fcad4ca7700 1 --2- 172.21.15.6:0/1633393126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fc7f0 0x7fcad00fcbd0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7fcac00047f0 tx=0x7fcac0009cb0).stop 2024-03-12T16:20:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.420+0000 7fcad4ca7700 1 -- 172.21.15.6:0/1633393126 shutdown_connections 2024-03-12T16:20:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.420+0000 7fcad4ca7700 1 --2- 172.21.15.6:0/1633393126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcad00fd150 0x7fcad00f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.420+0000 7fcad4ca7700 1 --2- 172.21.15.6:0/1633393126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fc7f0 0x7fcad00fcbd0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.420+0000 7fcad4ca7700 1 -- 172.21.15.6:0/1633393126 >> 172.21.15.6:0/1633393126 conn(0x7fcad0070590 msgr2=0x7fcad00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.420+0000 7fcad4ca7700 1 -- 172.21.15.6:0/1633393126 shutdown_connections 2024-03-12T16:20:16.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.420+0000 7fcad4ca7700 1 -- 172.21.15.6:0/1633393126 wait complete. 2024-03-12T16:20:16.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.421+0000 7fcad4ca7700 1 Processor -- start 2024-03-12T16:20:16.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.421+0000 7fcad4ca7700 1 -- start start 2024-03-12T16:20:16.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.421+0000 7fcad4ca7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcad00fc7f0 0x7fcad010cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:16.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.421+0000 7fcad4ca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fd150 0x7fcad010d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:16.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.421+0000 7fcad4ca7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad010da20 con 0x7fcad00fd150 2024-03-12T16:20:16.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.421+0000 7fcad4ca7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcad010db60 con 0x7fcad00fc7f0 2024-03-12T16:20:16.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.421+0000 7fcacdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fd150 0x7fcad010d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.421+0000 7fcacdd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fd150 0x7fcad010d420 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40100/0 (socket says 172.21.15.6:40100) 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.421+0000 7fcacdd9b700 1 -- 172.21.15.6:0/4242496850 learned_addr learned my addr 172.21.15.6:0/4242496850 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcace59c700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcad00fc7f0 0x7fcad010cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcacdd9b700 1 -- 172.21.15.6:0/4242496850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcad00fc7f0 msgr2=0x7fcad010cf30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcacdd9b700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcad00fc7f0 0x7fcad010cf30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcacdd9b700 1 -- 172.21.15.6:0/4242496850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcac0005040 con 0x7fcad00fd150 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcacdd9b700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fd150 0x7fcad010d420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fcac4002820 tx=0x7fcac4009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcabf7fe700 1 -- 172.21.15.6:0/4242496850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac4007b40 con 0x7fcad00fd150 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcabf7fe700 1 -- 172.21.15.6:0/4242496850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcac400f040 con 0x7fcad00fd150 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcad01071f0 con 0x7fcad00fd150 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcabf7fe700 1 -- 172.21.15.6:0/4242496850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcac40148b0 con 0x7fcad00fd150 2024-03-12T16:20:16.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.422+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcad01077b0 con 0x7fcad00fd150 2024-03-12T16:20:16.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.423+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcad005f590 con 0x7fcad00fd150 2024-03-12T16:20:16.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.424+0000 7fcabf7fe700 1 -- 172.21.15.6:0/4242496850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fcac4007ca0 con 0x7fcad00fd150 2024-03-12T16:20:16.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.424+0000 7fcabf7fe700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcab806caa0 0x7fcab806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:16.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.424+0000 7fcabf7fe700 1 -- 172.21.15.6:0/4242496850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fcac408b750 con 0x7fcad00fd150 2024-03-12T16:20:16.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.424+0000 7fcace59c700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcab806caa0 0x7fcab806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:16.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.424+0000 7fcace59c700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcab806caa0 0x7fcab806ef60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fcac0004f10 tx=0x7fcac000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:16.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.428+0000 7fcabf7fe700 1 -- 172.21.15.6:0/4242496850 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fcac40592b0 con 0x7fcad00fd150 2024-03-12T16:20:16.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.644+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcad0107a80 con 0x7fcab806caa0 2024-03-12T16:20:16.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.645+0000 7fcabf7fe700 1 -- 172.21.15.6:0/4242496850 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fcad0107a80 con 0x7fcab806caa0 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.648+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcab806caa0 msgr2=0x7fcab806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.648+0000 7fcad4ca7700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcab806caa0 0x7fcab806ef60 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 rx=0x7fcac0004f10 tx=0x7fcac000b040).stop 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.648+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fd150 msgr2=0x7fcad010d420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.648+0000 7fcad4ca7700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fd150 0x7fcad010d420 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7fcac4002820 tx=0x7fcac4009f20).stop 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.649+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 shutdown_connections 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.649+0000 7fcad4ca7700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcad00fc7f0 0x7fcad010cf30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.649+0000 7fcad4ca7700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcab806caa0 0x7fcab806ef60 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.649+0000 7fcad4ca7700 1 --2- 172.21.15.6:0/4242496850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcad00fd150 0x7fcad010d420 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.649+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 >> 172.21.15.6:0/4242496850 conn(0x7fcad0070590 msgr2=0x7fcad00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.649+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 shutdown_connections 2024-03-12T16:20:16.651 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.649+0000 7fcad4ca7700 1 -- 172.21.15.6:0/4242496850 wait complete. 2024-03-12T16:20:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.751+0000 7f5f30d65700 1 -- 172.21.15.6:0/1458674263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fe270 msgr2=0x7f5f2c0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.751+0000 7f5f30d65700 1 --2- 172.21.15.6:0/1458674263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fe270 0x7f5f2c0f7a50 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7f5f200047f0 tx=0x7f5f20009cb0).stop 2024-03-12T16:20:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.752+0000 7f5f30d65700 1 -- 172.21.15.6:0/1458674263 shutdown_connections 2024-03-12T16:20:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.752+0000 7f5f30d65700 1 --2- 172.21.15.6:0/1458674263 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fe270 0x7f5f2c0f7a50 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.752+0000 7f5f30d65700 1 --2- 172.21.15.6:0/1458674263 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f2c0fd910 0x7f5f2c0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.752+0000 7f5f30d65700 1 -- 172.21.15.6:0/1458674263 >> 172.21.15.6:0/1458674263 conn(0x7f5f2c0f3530 msgr2=0x7f5f2c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.752+0000 7f5f30d65700 1 -- 172.21.15.6:0/1458674263 shutdown_connections 2024-03-12T16:20:16.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.752+0000 7f5f30d65700 1 -- 172.21.15.6:0/1458674263 wait complete. 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.752+0000 7f5f30d65700 1 Processor -- start 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.752+0000 7f5f30d65700 1 -- start start 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f30d65700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fd910 0x7f5f2c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f30d65700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f2c0fe270 0x7f5f2c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f30d65700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c10eae0 con 0x7f5f2c0fd910 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f30d65700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f2c10ec20 con 0x7f5f2c0fe270 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f2a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fd910 0x7f5f2c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f2a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fd910 0x7f5f2c10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40124/0 (socket says 172.21.15.6:40124) 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f2a59c700 1 -- 172.21.15.6:0/4210156705 learned_addr learned my addr 172.21.15.6:0/4210156705 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f29d9b700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f2c0fe270 0x7f5f2c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:16.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f2a59c700 1 -- 172.21.15.6:0/4210156705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f2c0fe270 msgr2=0x7f5f2c10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f2a59c700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f2c0fe270 0x7f5f2c10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f2a59c700 1 -- 172.21.15.6:0/4210156705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f20005040 con 0x7f5f2c0fd910 2024-03-12T16:20:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f2a59c700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fd910 0x7f5f2c10dff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f5f1c0041d0 tx=0x7f5f1c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f1b7fe700 1 -- 172.21.15.6:0/4210156705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1c002d90 con 0x7f5f2c0fd910 2024-03-12T16:20:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f1b7fe700 1 -- 172.21.15.6:0/4210156705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5f1c00f040 con 0x7f5f2c0fd910 2024-03-12T16:20:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f2c1082b0 con 0x7f5f2c0fd910 2024-03-12T16:20:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f1b7fe700 1 -- 172.21.15.6:0/4210156705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5f1c00d800 con 0x7f5f2c0fd910 2024-03-12T16:20:16.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.753+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f2c108870 con 0x7f5f2c0fd910 2024-03-12T16:20:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.754+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f2c05f570 con 0x7f5f2c0fd910 2024-03-12T16:20:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.755+0000 7f5f1b7fe700 1 -- 172.21.15.6:0/4210156705 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5f1c00da70 con 0x7f5f2c0fd910 2024-03-12T16:20:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.756+0000 7f5f1b7fe700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5f1406caa0 0x7f5f1406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.756+0000 7f5f29d9b700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5f1406caa0 0x7f5f1406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.756+0000 7f5f1b7fe700 1 -- 172.21.15.6:0/4210156705 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5f1c08bd10 con 0x7f5f2c0fd910 2024-03-12T16:20:16.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.756+0000 7f5f29d9b700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5f1406caa0 0x7f5f1406ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5f20000c00 tx=0x7f5f2000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:16.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.760+0000 7f5f1b7fe700 1 -- 172.21.15.6:0/4210156705 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5f1c059870 con 0x7f5f2c0fd910 2024-03-12T16:20:16.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.968+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f5f2c108b40 con 0x7f5f1406caa0 2024-03-12T16:20:16.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.978+0000 7f5f1b7fe700 1 -- 172.21.15.6:0/4210156705 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f5f2c108b40 con 0x7f5f1406caa0 2024-03-12T16:20:16.980 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:20:16.980 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (7m) 52s ago 18m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:20:16.980 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (4m) 52s ago 18m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:20:16.980 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (4m) 22s ago 17m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (6m) 52s ago 17m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (73s) 52s ago 12m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (57s) 52s ago 12m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (41s) 22s ago 12m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (26s) 22s ago 12m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (8m) 52s ago 19m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (7m) 22s ago 17m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (5m) 52s ago 19m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (5m) 22s ago 17m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (7m) 52s ago 17m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (7m) 22s ago 16m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (4m) 52s ago 16m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:20:16.981 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (3m) 52s ago 16m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:20:16.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (3m) 52s ago 15m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:20:16.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (2m) 22s ago 15m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:20:16.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (2m) 22s ago 14m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:20:16.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (92s) 22s ago 14m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:20:16.982 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (7m) 22s ago 16m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5f1406caa0 msgr2=0x7f5f1406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5f1406caa0 0x7f5f1406ef60 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 rx=0x7f5f20000c00 tx=0x7f5f2000b040).stop 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fd910 msgr2=0x7f5f2c10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fd910 0x7f5f2c10dff0 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f5f1c0041d0 tx=0x7f5f1c009f60).stop 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 shutdown_connections 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5f1406caa0 0x7f5f1406ef60 unknown :-1 s=CLOSED pgs=104 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f2c0fd910 0x7f5f2c10dff0 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 --2- 172.21.15.6:0/4210156705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f2c0fe270 0x7f5f2c10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 >> 172.21.15.6:0/4210156705 conn(0x7f5f2c0f3530 msgr2=0x7f5f2c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 shutdown_connections 2024-03-12T16:20:16.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:16.980+0000 7f5f30d65700 1 -- 172.21.15.6:0/4210156705 wait complete. 2024-03-12T16:20:17.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.081+0000 7fb3f3e92700 1 -- 172.21.15.6:0/4044307905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 msgr2=0x7fb3ec0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.081+0000 7fb3f3e92700 1 --2- 172.21.15.6:0/4044307905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 0x7fb3ec0f8c80 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7fb3dc0047f0 tx=0x7fb3dc009cb0).stop 2024-03-12T16:20:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.081+0000 7fb3f3e92700 1 -- 172.21.15.6:0/4044307905 shutdown_connections 2024-03-12T16:20:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.081+0000 7fb3f3e92700 1 --2- 172.21.15.6:0/4044307905 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ec0f9200 0x7fb3ec101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.081+0000 7fb3f3e92700 1 --2- 172.21.15.6:0/4044307905 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 0x7fb3ec0f8c80 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.081+0000 7fb3f3e92700 1 -- 172.21.15.6:0/4044307905 >> 172.21.15.6:0/4044307905 conn(0x7fb3ec070590 msgr2=0x7fb3ec0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.081+0000 7fb3f3e92700 1 -- 172.21.15.6:0/4044307905 shutdown_connections 2024-03-12T16:20:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.081+0000 7fb3f3e92700 1 -- 172.21.15.6:0/4044307905 wait complete. 2024-03-12T16:20:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.081+0000 7fb3f3e92700 1 Processor -- start 2024-03-12T16:20:17.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f3e92700 1 -- start start 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f3e92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 0x7fb3ec0f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f3e92700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ec0f9200 0x7fb3ec0f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f3e92700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0f7230 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f3e92700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb3ec0f7370 con 0x7fb3ec0f9200 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f1c2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 0x7fb3ec0f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f1c2e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 0x7fb3ec0f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40140/0 (socket says 172.21.15.6:40140) 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f1c2e700 1 -- 172.21.15.6:0/3416697049 learned_addr learned my addr 172.21.15.6:0/3416697049 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f142d700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ec0f9200 0x7fb3ec0f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f1c2e700 1 -- 172.21.15.6:0/3416697049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ec0f9200 msgr2=0x7fb3ec0f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f1c2e700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ec0f9200 0x7fb3ec0f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f1c2e700 1 -- 172.21.15.6:0/3416697049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb3dc005040 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f1c2e700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 0x7fb3ec0f6850 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb3dc005010 tx=0x7fb3dc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3e2ffd700 1 -- 172.21.15.6:0/3416697049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3dc00e030 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3e2ffd700 1 -- 172.21.15.6:0/3416697049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb3dc007e90 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.082+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb3ec0f75c0 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.083+0000 7fb3e2ffd700 1 -- 172.21.15.6:0/3416697049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb3dc018070 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.083+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb3ec114630 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.083+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb3ec05f590 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.084+0000 7fb3e2ffd700 1 -- 172.21.15.6:0/3416697049 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb3dc01d6e0 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.084+0000 7fb3e2ffd700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb3d806ca30 0x7fb3d806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.084+0000 7fb3e2ffd700 1 -- 172.21.15.6:0/3416697049 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb3dc08d040 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.085+0000 7fb3f142d700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb3d806ca30 0x7fb3d806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:17.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.085+0000 7fb3f142d700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb3d806ca30 0x7fb3d806eef0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb3ec0f7ff0 tx=0x7fb3e8009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:17.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.089+0000 7fb3e2ffd700 1 -- 172.21.15.6:0/3416697049 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb3dc05aba0 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.375+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb3ec0fee10 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.375+0000 7fb3e2ffd700 1 -- 172.21.15.6:0/3416697049 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fb3dc05a730 con 0x7fb3ec0f88a0 2024-03-12T16:20:17.377 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:20:17.378 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:20:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:20:17.379 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:20:17.379 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:20:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb3d806ca30 msgr2=0x7fb3d806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.379 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb3d806ca30 0x7fb3d806eef0 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 rx=0x7fb3ec0f7ff0 tx=0x7fb3e8009d60).stop 2024-03-12T16:20:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 msgr2=0x7fb3ec0f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 0x7fb3ec0f6850 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7fb3dc005010 tx=0x7fb3dc009cb0).stop 2024-03-12T16:20:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 shutdown_connections 2024-03-12T16:20:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb3d806ca30 0x7fb3d806eef0 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb3ec0f88a0 0x7fb3ec0f6850 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 --2- 172.21.15.6:0/3416697049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb3ec0f9200 0x7fb3ec0f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 >> 172.21.15.6:0/3416697049 conn(0x7fb3ec070590 msgr2=0x7fb3ec0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 shutdown_connections 2024-03-12T16:20:17.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.377+0000 7fb3f3e92700 1 -- 172.21.15.6:0/3416697049 wait complete. 2024-03-12T16:20:17.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.479+0000 7f15020e2700 1 -- 172.21.15.6:0/529692039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 msgr2=0x7f14fc0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.479+0000 7f15020e2700 1 --2- 172.21.15.6:0/529692039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 0x7f14fc0fdcb0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7f14ec0047f0 tx=0x7f14ec009cb0).stop 2024-03-12T16:20:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.479+0000 7f15020e2700 1 -- 172.21.15.6:0/529692039 shutdown_connections 2024-03-12T16:20:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.479+0000 7f15020e2700 1 --2- 172.21.15.6:0/529692039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc0fe230 0x7f14fc0f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.479+0000 7f15020e2700 1 --2- 172.21.15.6:0/529692039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 0x7f14fc0fdcb0 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.479+0000 7f15020e2700 1 -- 172.21.15.6:0/529692039 >> 172.21.15.6:0/529692039 conn(0x7f14fc06cea0 msgr2=0x7f14fc06d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.479+0000 7f15020e2700 1 -- 172.21.15.6:0/529692039 shutdown_connections 2024-03-12T16:20:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.479+0000 7f15020e2700 1 -- 172.21.15.6:0/529692039 wait complete. 2024-03-12T16:20:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.479+0000 7f15020e2700 1 Processor -- start 2024-03-12T16:20:17.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f15020e2700 1 -- start start 2024-03-12T16:20:17.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f15020e2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 0x7f14fc10e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f15020e2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc0fe230 0x7f14fc10e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f15020e2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc10eb40 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f15020e2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14fc10ec80 con 0x7f14fc0fe230 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f14fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 0x7f14fc10e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f14fb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 0x7f14fc10e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40162/0 (socket says 172.21.15.6:40162) 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f14fb7fe700 1 -- 172.21.15.6:0/2130929144 learned_addr learned my addr 172.21.15.6:0/2130929144 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f14fb7fe700 1 -- 172.21.15.6:0/2130929144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc0fe230 msgr2=0x7f14fc10e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f14fb7fe700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc0fe230 0x7f14fc10e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f14fb7fe700 1 -- 172.21.15.6:0/2130929144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14ec005040 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.480+0000 7f14fb7fe700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 0x7f14fc10e050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f14ec005010 tx=0x7f14ec009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.481+0000 7f14f8ff9700 1 -- 172.21.15.6:0/2130929144 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ec00e030 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.481+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14fc1082b0 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.481+0000 7f14f8ff9700 1 -- 172.21.15.6:0/2130929144 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14ec007e90 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.481+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14fc108790 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.481+0000 7f14f8ff9700 1 -- 172.21.15.6:0/2130929144 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14ec018070 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.482+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14dc005150 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.482+0000 7f14f8ff9700 1 -- 172.21.15.6:0/2130929144 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f14ec009610 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.482+0000 7f14f8ff9700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14e806caa0 0x7f14e806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.482+0000 7f14f8ff9700 1 -- 172.21.15.6:0/2130929144 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f14ec08cf30 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.483+0000 7f14faffd700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14e806caa0 0x7f14e806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:17.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.483+0000 7f14faffd700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14e806caa0 0x7f14e806ef60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f14e4009fd0 tx=0x7f14e4009be0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:17.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.487+0000 7f14f8ff9700 1 -- 172.21.15.6:0/2130929144 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f14ec0c0190 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.726+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f14dc006030 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.726+0000 7f14f8ff9700 1 -- 172.21.15.6:0/2130929144 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f14ec05a800 con 0x7f14fc0fd8d0 2024-03-12T16:20:17.728 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:20:17.728 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:20:17.729 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:20:17.730 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:20:17.731 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:20:17.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14e806caa0 msgr2=0x7f14e806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14e806caa0 0x7f14e806ef60 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 rx=0x7f14e4009fd0 tx=0x7f14e4009be0).stop 2024-03-12T16:20:17.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 msgr2=0x7f14fc10e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 0x7f14fc10e050 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f14ec005010 tx=0x7f14ec009cb0).stop 2024-03-12T16:20:17.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 shutdown_connections 2024-03-12T16:20:17.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14e806caa0 0x7f14e806ef60 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14fc0fd8d0 0x7f14fc10e050 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 --2- 172.21.15.6:0/2130929144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14fc0fe230 0x7f14fc10e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:20:17.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 >> 172.21.15.6:0/2130929144 conn(0x7f14fc06cea0 msgr2=0x7f14fc100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:17.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 shutdown_connections 2024-03-12T16:20:17.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.728+0000 7f15020e2700 1 -- 172.21.15.6:0/2130929144 wait complete. 2024-03-12T16:20:17.733 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:20:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.831+0000 7fb299a45700 1 -- 172.21.15.6:0/901740883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 msgr2=0x7fb2940f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.831+0000 7fb299a45700 1 --2- 172.21.15.6:0/901740883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 0x7fb2940f7ab0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fb27c0047f0 tx=0x7fb27c009cb0).stop 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.831+0000 7fb299a45700 1 -- 172.21.15.6:0/901740883 shutdown_connections 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.831+0000 7fb299a45700 1 --2- 172.21.15.6:0/901740883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 0x7fb2940f7ab0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.831+0000 7fb299a45700 1 --2- 172.21.15.6:0/901740883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940fd970 0x7fb2940fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.831+0000 7fb299a45700 1 -- 172.21.15.6:0/901740883 >> 172.21.15.6:0/901740883 conn(0x7fb2940f3550 msgr2=0x7fb2940f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.831+0000 7fb299a45700 1 -- 172.21.15.6:0/901740883 shutdown_connections 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.831+0000 7fb299a45700 1 -- 172.21.15.6:0/901740883 wait complete. 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.832+0000 7fb299a45700 1 Processor -- start 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.832+0000 7fb299a45700 1 -- start start 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.832+0000 7fb299a45700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940fd970 0x7fb29410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.832+0000 7fb299a45700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 0x7fb29410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.832+0000 7fb299a45700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29410eb50 con 0x7fb2940fe2d0 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.832+0000 7fb299a45700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb29410ec90 con 0x7fb2940fd970 2024-03-12T16:20:17.836 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb2927fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 0x7fb29410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb2927fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 0x7fb29410e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40190/0 (socket says 172.21.15.6:40190) 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb2927fc700 1 -- 172.21.15.6:0/1072063351 learned_addr learned my addr 172.21.15.6:0/1072063351 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb292ffd700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940fd970 0x7fb29410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb2927fc700 1 -- 172.21.15.6:0/1072063351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940fd970 msgr2=0x7fb29410e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb2927fc700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940fd970 0x7fb29410e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb2927fc700 1 -- 172.21.15.6:0/1072063351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb27c005040 con 0x7fb2940fe2d0 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb2927fc700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 0x7fb29410e550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb27c0099f0 tx=0x7fb27c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb28bfff700 1 -- 172.21.15.6:0/1072063351 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27c00e030 con 0x7fb2940fe2d0 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb2941082c0 con 0x7fb2940fe2d0 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb28bfff700 1 -- 172.21.15.6:0/1072063351 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb27c007e90 con 0x7fb2940fe2d0 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb28bfff700 1 -- 172.21.15.6:0/1072063351 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb27c018070 con 0x7fb2940fe2d0 2024-03-12T16:20:17.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.833+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb2941087a0 con 0x7fb2940fe2d0 2024-03-12T16:20:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.834+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb294060370 con 0x7fb2940fe2d0 2024-03-12T16:20:17.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.835+0000 7fb28bfff700 1 -- 172.21.15.6:0/1072063351 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb27c01d420 con 0x7fb2940fe2d0 2024-03-12T16:20:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.835+0000 7fb28bfff700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb28006caa0 0x7fb28006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.835+0000 7fb28bfff700 1 -- 172.21.15.6:0/1072063351 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb27c08d180 con 0x7fb2940fe2d0 2024-03-12T16:20:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.835+0000 7fb292ffd700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb28006caa0 0x7fb28006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:17.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.836+0000 7fb292ffd700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb28006caa0 0x7fb28006ef60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb284004d20 tx=0x7fb284009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:17.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:17.839+0000 7fb28bfff700 1 -- 172.21.15.6:0/1072063351 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb27c05ace0 con 0x7fb2940fe2d0 2024-03-12T16:20:17.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:17 smithi134 ceph-mon[85099]: pgmap v211: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:17.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:17 smithi134 ceph-mon[85099]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:17.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:17 smithi134 ceph-mon[85099]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:17.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:20:17.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:17 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3416697049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:20:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:17 smithi006 ceph-mon[103869]: pgmap v211: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:17 smithi006 ceph-mon[103869]: from='client.34444 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:17 smithi006 ceph-mon[103869]: from='client.34448 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:20:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:17 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3416697049' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:20:18.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.055+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fb2941096e0 con 0x7fb28006caa0 2024-03-12T16:20:18.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.056+0000 7fb28bfff700 1 -- 172.21.15.6:0/1072063351 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fb2941096e0 con 0x7fb28006caa0 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:20:18.059 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:20:18.060 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:20:18.060 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:20:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.058+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb28006caa0 msgr2=0x7fb28006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:18.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.058+0000 7fb299a45700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb28006caa0 0x7fb28006ef60 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 rx=0x7fb284004d20 tx=0x7fb284009040).stop 2024-03-12T16:20:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.058+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 msgr2=0x7fb29410e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.058+0000 7fb299a45700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 0x7fb29410e550 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fb27c0099f0 tx=0x7fb27c009cb0).stop 2024-03-12T16:20:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.058+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 shutdown_connections 2024-03-12T16:20:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.058+0000 7fb299a45700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb2940fd970 0x7fb29410e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.058+0000 7fb299a45700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb28006caa0 0x7fb28006ef60 unknown :-1 s=CLOSED pgs=107 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.058+0000 7fb299a45700 1 --2- 172.21.15.6:0/1072063351 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb2940fe2d0 0x7fb29410e550 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.058+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 >> 172.21.15.6:0/1072063351 conn(0x7fb2940f3550 msgr2=0x7fb2940fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.059+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 shutdown_connections 2024-03-12T16:20:18.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.059+0000 7fb299a45700 1 -- 172.21.15.6:0/1072063351 wait complete. 2024-03-12T16:20:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 -- 172.21.15.6:0/3789237801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 msgr2=0x7f8c680fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 --2- 172.21.15.6:0/3789237801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 0x7f8c680fcbd0 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7f8c640047f0 tx=0x7f8c64009cb0).stop 2024-03-12T16:20:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 -- 172.21.15.6:0/3789237801 shutdown_connections 2024-03-12T16:20:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 --2- 172.21.15.6:0/3789237801 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c680fd150 0x7f8c680f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 --2- 172.21.15.6:0/3789237801 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 0x7f8c680fcbd0 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:18.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 -- 172.21.15.6:0/3789237801 >> 172.21.15.6:0/3789237801 conn(0x7f8c68070590 msgr2=0x7f8c680f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 -- 172.21.15.6:0/3789237801 shutdown_connections 2024-03-12T16:20:18.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 -- 172.21.15.6:0/3789237801 wait complete. 2024-03-12T16:20:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 Processor -- start 2024-03-12T16:20:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.161+0000 7f8c70012700 1 -- start start 2024-03-12T16:20:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c70012700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 0x7f8c6810e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c70012700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c680fd150 0x7f8c6810e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:18.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c70012700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6810eb80 con 0x7f8c680fc7f0 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c70012700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8c6810ecc0 con 0x7f8c680fd150 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c6ddae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 0x7f8c6810e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c6ddae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 0x7f8c6810e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40214/0 (socket says 172.21.15.6:40214) 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c6ddae700 1 -- 172.21.15.6:0/973586682 learned_addr learned my addr 172.21.15.6:0/973586682 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c6d5ad700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c680fd150 0x7f8c6810e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c6ddae700 1 -- 172.21.15.6:0/973586682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c680fd150 msgr2=0x7f8c6810e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c6ddae700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c680fd150 0x7f8c6810e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c6ddae700 1 -- 172.21.15.6:0/973586682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8c64005040 con 0x7f8c680fc7f0 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c6d5ad700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c680fd150 0x7f8c6810e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c6ddae700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 0x7f8c6810e090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f8c64009380 tx=0x7f8c64009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c5effd700 1 -- 172.21.15.6:0/973586682 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c64018070 con 0x7f8c680fc7f0 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8c68108330 con 0x7f8c680fc7f0 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c5effd700 1 -- 172.21.15.6:0/973586682 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8c64007e90 con 0x7f8c680fc7f0 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c5effd700 1 -- 172.21.15.6:0/973586682 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8c640123c0 con 0x7f8c680fc7f0 2024-03-12T16:20:18.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.162+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8c68108890 con 0x7f8c680fc7f0 2024-03-12T16:20:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.163+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8c6805f590 con 0x7f8c680fc7f0 2024-03-12T16:20:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.164+0000 7f8c5effd700 1 -- 172.21.15.6:0/973586682 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8c6401d420 con 0x7f8c680fc7f0 2024-03-12T16:20:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.164+0000 7f8c5effd700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8c5406caa0 0x7f8c5406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.164+0000 7f8c5effd700 1 -- 172.21.15.6:0/973586682 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8c6408ca60 con 0x7f8c680fc7f0 2024-03-12T16:20:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.164+0000 7f8c6d5ad700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8c5406caa0 0x7f8c5406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:18.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.165+0000 7f8c6d5ad700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8c5406caa0 0x7f8c5406ef60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f8c58009f20 tx=0x7f8c5800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:18.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.169+0000 7f8c5effd700 1 -- 172.21.15.6:0/973586682 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8c64056b30 con 0x7f8c680fc7f0 2024-03-12T16:20:18.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.452+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f8c68047540 con 0x7f8c680fc7f0 2024-03-12T16:20:18.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.453+0000 7f8c5effd700 1 -- 172.21.15.6:0/973586682 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f8c6405a150 con 0x7f8c680fc7f0 2024-03-12T16:20:18.455 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:20:18.455 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:20:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:20:18.455 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:20:18.455 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:20:18.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8c5406caa0 msgr2=0x7f8c5406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:18.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8c5406caa0 0x7f8c5406ef60 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 rx=0x7f8c58009f20 tx=0x7f8c5800b040).stop 2024-03-12T16:20:18.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 msgr2=0x7f8c6810e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:18.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 0x7f8c6810e090 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7f8c64009380 tx=0x7f8c64009cb0).stop 2024-03-12T16:20:18.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 shutdown_connections 2024-03-12T16:20:18.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8c5406caa0 0x7f8c5406ef60 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:18.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8c680fc7f0 0x7f8c6810e090 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:18.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 --2- 172.21.15.6:0/973586682 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8c680fd150 0x7f8c6810e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:18.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 >> 172.21.15.6:0/973586682 conn(0x7f8c68070590 msgr2=0x7f8c68060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:18.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 shutdown_connections 2024-03-12T16:20:18.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:18.455+0000 7f8c70012700 1 -- 172.21.15.6:0/973586682 wait complete. 2024-03-12T16:20:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:18 smithi134 ceph-mon[85099]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:18 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2130929144' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:20:18.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:18 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/973586682' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:20:18.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:18 smithi006 ceph-mon[103869]: from='client.34452 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:18.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:18 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2130929144' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:20:18.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:18 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/973586682' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:20:19.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:19 smithi134 ceph-mon[85099]: pgmap v212: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:19.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:19 smithi134 ceph-mon[85099]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:19 smithi006 ceph-mon[103869]: pgmap v212: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:19 smithi006 ceph-mon[103869]: from='client.34464 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:21 smithi134 ceph-mon[85099]: pgmap v213: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:21 smithi006 ceph-mon[103869]: pgmap v213: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:23.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:23 smithi134 ceph-mon[85099]: pgmap v214: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:23 smithi006 ceph-mon[103869]: pgmap v214: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:25.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:25 smithi134 ceph-mon[85099]: pgmap v215: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:25.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:25 smithi006 ceph-mon[103869]: pgmap v215: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:27.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:27 smithi134 ceph-mon[85099]: pgmap v216: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:27.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:27 smithi006 ceph-mon[103869]: pgmap v216: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:29.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:29 smithi134 ceph-mon[85099]: pgmap v217: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:29 smithi006 ceph-mon[103869]: pgmap v217: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:31.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:31 smithi134 ceph-mon[85099]: pgmap v218: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:31.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:31 smithi006 ceph-mon[103869]: pgmap v218: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:32.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:20:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:20:33.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:33 smithi134 ceph-mon[85099]: pgmap v219: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:33 smithi006 ceph-mon[103869]: pgmap v219: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:35.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:35 smithi134 ceph-mon[85099]: pgmap v220: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:35.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:35 smithi006 ceph-mon[103869]: pgmap v220: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:37.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:37 smithi134 ceph-mon[85099]: pgmap v221: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:37 smithi006 ceph-mon[103869]: pgmap v221: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:39.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:39 smithi134 ceph-mon[85099]: pgmap v222: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:39.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:39 smithi006 ceph-mon[103869]: pgmap v222: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:41.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:41 smithi134 ceph-mon[85099]: pgmap v223: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:41.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:41 smithi006 ceph-mon[103869]: pgmap v223: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:43.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:43 smithi134 ceph-mon[85099]: pgmap v224: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:43.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:43 smithi006 ceph-mon[103869]: pgmap v224: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:45 smithi134 ceph-mon[85099]: pgmap v225: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:45.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:45 smithi006 ceph-mon[103869]: pgmap v225: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:47.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:47 smithi134 ceph-mon[85099]: pgmap v226: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:47.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:20:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:47 smithi006 ceph-mon[103869]: pgmap v226: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:20:48.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.573+0000 7f5d97ba6700 1 -- 172.21.15.6:0/3694765018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 msgr2=0x7f5d900f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:48.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.573+0000 7f5d97ba6700 1 --2- 172.21.15.6:0/3694765018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 0x7f5d900f6930 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7f5d8c0047f0 tx=0x7f5d8c009cb0).stop 2024-03-12T16:20:48.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.573+0000 7f5d97ba6700 1 -- 172.21.15.6:0/3694765018 shutdown_connections 2024-03-12T16:20:48.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.573+0000 7f5d97ba6700 1 --2- 172.21.15.6:0/3694765018 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 0x7f5d900f6930 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:48.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.573+0000 7f5d97ba6700 1 --2- 172.21.15.6:0/3694765018 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d900fc7f0 0x7f5d900fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.573+0000 7f5d97ba6700 1 -- 172.21.15.6:0/3694765018 >> 172.21.15.6:0/3694765018 conn(0x7f5d900f23b0 msgr2=0x7f5d900f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.573+0000 7f5d97ba6700 1 -- 172.21.15.6:0/3694765018 shutdown_connections 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.573+0000 7f5d97ba6700 1 -- 172.21.15.6:0/3694765018 wait complete. 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.574+0000 7f5d97ba6700 1 Processor -- start 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.574+0000 7f5d97ba6700 1 -- start start 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.574+0000 7f5d97ba6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d900fc7f0 0x7f5d900f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.574+0000 7f5d97ba6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 0x7f5d900f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.574+0000 7f5d97ba6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900f8f20 con 0x7f5d900fd150 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.574+0000 7f5d97ba6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d900f9060 con 0x7f5d900fc7f0 2024-03-12T16:20:48.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.574+0000 7f5d95141700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 0x7f5d900f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.574+0000 7f5d95141700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 0x7f5d900f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38018/0 (socket says 172.21.15.6:38018) 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.574+0000 7f5d95141700 1 -- 172.21.15.6:0/4177299388 learned_addr learned my addr 172.21.15.6:0/4177299388 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d95942700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d900fc7f0 0x7f5d900f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d95141700 1 -- 172.21.15.6:0/4177299388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d900fc7f0 msgr2=0x7f5d900f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d95141700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d900fc7f0 0x7f5d900f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d95141700 1 -- 172.21.15.6:0/4177299388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d8c005040 con 0x7f5d900fd150 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d95141700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 0x7f5d900f8a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f5d8c0099f0 tx=0x7f5d8c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d82ffd700 1 -- 172.21.15.6:0/4177299388 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d8c00e030 con 0x7f5d900fd150 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d82ffd700 1 -- 172.21.15.6:0/4177299388 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5d8c007e90 con 0x7f5d900fd150 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d900f92b0 con 0x7f5d900fd150 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d82ffd700 1 -- 172.21.15.6:0/4177299388 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d8c018070 con 0x7f5d900fd150 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.575+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d90114660 con 0x7f5d900fd150 2024-03-12T16:20:48.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.576+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d90060350 con 0x7f5d900fd150 2024-03-12T16:20:48.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.577+0000 7f5d82ffd700 1 -- 172.21.15.6:0/4177299388 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5d8c009590 con 0x7f5d900fd150 2024-03-12T16:20:48.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.577+0000 7f5d82ffd700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d7c06caa0 0x7f5d7c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:48.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.577+0000 7f5d82ffd700 1 -- 172.21.15.6:0/4177299388 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5d8c08cf50 con 0x7f5d900fd150 2024-03-12T16:20:48.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.577+0000 7f5d95942700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d7c06caa0 0x7f5d7c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:48.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.578+0000 7f5d95942700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d7c06caa0 0x7f5d7c06ef60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5d84009170 tx=0x7f5d84009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:48.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.582+0000 7f5d82ffd700 1 -- 172.21.15.6:0/4177299388 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5d8c0c0190 con 0x7f5d900fd150 2024-03-12T16:20:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.797+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5d900fb5a0 con 0x7f5d7c06caa0 2024-03-12T16:20:48.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.799+0000 7f5d82ffd700 1 -- 172.21.15.6:0/4177299388 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f5d900fb5a0 con 0x7f5d7c06caa0 2024-03-12T16:20:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.800+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d7c06caa0 msgr2=0x7f5d7c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.800+0000 7f5d97ba6700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d7c06caa0 0x7f5d7c06ef60 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 rx=0x7f5d84009170 tx=0x7f5d84009d60).stop 2024-03-12T16:20:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.800+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 msgr2=0x7f5d900f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.800+0000 7f5d97ba6700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 0x7f5d900f8a30 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f5d8c0099f0 tx=0x7f5d8c009cb0).stop 2024-03-12T16:20:48.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.801+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 shutdown_connections 2024-03-12T16:20:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.801+0000 7f5d97ba6700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d900fc7f0 0x7f5d900f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.801+0000 7f5d97ba6700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d7c06caa0 0x7f5d7c06ef60 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.801+0000 7f5d97ba6700 1 --2- 172.21.15.6:0/4177299388 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d900fd150 0x7f5d900f8a30 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.801+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 >> 172.21.15.6:0/4177299388 conn(0x7f5d900f23b0 msgr2=0x7f5d90061340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:48.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.801+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 shutdown_connections 2024-03-12T16:20:48.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.801+0000 7f5d97ba6700 1 -- 172.21.15.6:0/4177299388 wait complete. 2024-03-12T16:20:48.812 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:20:48.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.903+0000 7f6892d95700 1 -- 172.21.15.6:0/4202680390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fc7f0 msgr2=0x7f688c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.903+0000 7f6892d95700 1 --2- 172.21.15.6:0/4202680390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fc7f0 0x7f688c0fcbd0 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f68800047f0 tx=0x7f6880009cb0).stop 2024-03-12T16:20:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 -- 172.21.15.6:0/4202680390 shutdown_connections 2024-03-12T16:20:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 --2- 172.21.15.6:0/4202680390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f688c0fd150 0x7f688c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 --2- 172.21.15.6:0/4202680390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fc7f0 0x7f688c0fcbd0 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 -- 172.21.15.6:0/4202680390 >> 172.21.15.6:0/4202680390 conn(0x7f688c070590 msgr2=0x7f688c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 -- 172.21.15.6:0/4202680390 shutdown_connections 2024-03-12T16:20:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 -- 172.21.15.6:0/4202680390 wait complete. 2024-03-12T16:20:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 Processor -- start 2024-03-12T16:20:48.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 -- start start 2024-03-12T16:20:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f688c0fc7f0 0x7f688c1090f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fd150 0x7f688c1095e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c109ad0 con 0x7f688c0fd150 2024-03-12T16:20:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.904+0000 7f6892d95700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f688c109c10 con 0x7f688c0fc7f0 2024-03-12T16:20:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f688bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fd150 0x7f688c1095e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f688bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fd150 0x7f688c1095e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38034/0 (socket says 172.21.15.6:38034) 2024-03-12T16:20:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f688bfff700 1 -- 172.21.15.6:0/1813464111 learned_addr learned my addr 172.21.15.6:0/1813464111 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:48.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f6890b31700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f688c0fc7f0 0x7f688c1090f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f688bfff700 1 -- 172.21.15.6:0/1813464111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f688c0fc7f0 msgr2=0x7f688c1090f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f688bfff700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f688c0fc7f0 0x7f688c1090f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:48.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f688bfff700 1 -- 172.21.15.6:0/1813464111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6880005040 con 0x7f688c0fd150 2024-03-12T16:20:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f688bfff700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fd150 0x7f688c1095e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f687800c710 tx=0x7f6878007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f6889ffb700 1 -- 172.21.15.6:0/1813464111 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f687800e680 con 0x7f688c0fd150 2024-03-12T16:20:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f6889ffb700 1 -- 172.21.15.6:0/1813464111 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f687800ec90 con 0x7f688c0fd150 2024-03-12T16:20:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f688c109ec0 con 0x7f688c0fd150 2024-03-12T16:20:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f6889ffb700 1 -- 172.21.15.6:0/1813464111 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6878013d40 con 0x7f688c0fd150 2024-03-12T16:20:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.905+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f688c1124b0 con 0x7f688c0fd150 2024-03-12T16:20:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.906+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f688c05f590 con 0x7f688c0fd150 2024-03-12T16:20:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.907+0000 7f6889ffb700 1 -- 172.21.15.6:0/1813464111 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f687800e7e0 con 0x7f688c0fd150 2024-03-12T16:20:48.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.907+0000 7f6889ffb700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f687c06caa0 0x7f687c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.907+0000 7f6889ffb700 1 -- 172.21.15.6:0/1813464111 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f687808bad0 con 0x7f688c0fd150 2024-03-12T16:20:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.907+0000 7f6890b31700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f687c06caa0 0x7f687c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:48.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.908+0000 7f6890b31700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f687c06caa0 0x7f687c06ef60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6880007cf0 tx=0x7f688000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:48.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:48.912+0000 7f6889ffb700 1 -- 172.21.15.6:0/1813464111 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6878055ba0 con 0x7f688c0fd150 2024-03-12T16:20:49.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.125+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f688c060d30 con 0x7f687c06caa0 2024-03-12T16:20:49.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.126+0000 7f6889ffb700 1 -- 172.21.15.6:0/1813464111 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f688c060d30 con 0x7f687c06caa0 2024-03-12T16:20:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.128+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f687c06caa0 msgr2=0x7f687c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.128+0000 7f6892d95700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f687c06caa0 0x7f687c06ef60 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 rx=0x7f6880007cf0 tx=0x7f688000b040).stop 2024-03-12T16:20:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.128+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fd150 msgr2=0x7f688c1095e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.128+0000 7f6892d95700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fd150 0x7f688c1095e0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f687800c710 tx=0x7f6878007ec0).stop 2024-03-12T16:20:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.128+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 shutdown_connections 2024-03-12T16:20:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.128+0000 7f6892d95700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f688c0fc7f0 0x7f688c1090f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.128+0000 7f6892d95700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f687c06caa0 0x7f687c06ef60 unknown :-1 s=CLOSED pgs=110 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.128+0000 7f6892d95700 1 --2- 172.21.15.6:0/1813464111 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f688c0fd150 0x7f688c1095e0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.128+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 >> 172.21.15.6:0/1813464111 conn(0x7f688c070590 msgr2=0x7f688c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.129+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 shutdown_connections 2024-03-12T16:20:49.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.129+0000 7f6892d95700 1 -- 172.21.15.6:0/1813464111 wait complete. 2024-03-12T16:20:49.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.230+0000 7fcaa0819700 1 -- 172.21.15.6:0/4279674925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 msgr2=0x7fca9c0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.230+0000 7fcaa0819700 1 --2- 172.21.15.6:0/4279674925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 0x7fca9c0f7a50 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fca900047f0 tx=0x7fca90009cb0).stop 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.230+0000 7fcaa0819700 1 -- 172.21.15.6:0/4279674925 shutdown_connections 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.230+0000 7fcaa0819700 1 --2- 172.21.15.6:0/4279674925 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 0x7fca9c0f7a50 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.230+0000 7fcaa0819700 1 --2- 172.21.15.6:0/4279674925 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca9c0fd910 0x7fca9c0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.230+0000 7fcaa0819700 1 -- 172.21.15.6:0/4279674925 >> 172.21.15.6:0/4279674925 conn(0x7fca9c0f3530 msgr2=0x7fca9c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.231+0000 7fcaa0819700 1 -- 172.21.15.6:0/4279674925 shutdown_connections 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.231+0000 7fcaa0819700 1 -- 172.21.15.6:0/4279674925 wait complete. 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.231+0000 7fcaa0819700 1 Processor -- start 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.231+0000 7fcaa0819700 1 -- start start 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fcaa0819700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca9c0fd910 0x7fca9c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:49.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fcaa0819700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 0x7fca9c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fcaa0819700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c10eae0 con 0x7fca9c0fe270 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fcaa0819700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fca9c10ec20 con 0x7fca9c0fd910 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca99d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 0x7fca9c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca99d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 0x7fca9c10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38054/0 (socket says 172.21.15.6:38054) 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca99d9b700 1 -- 172.21.15.6:0/3279993079 learned_addr learned my addr 172.21.15.6:0/3279993079 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca9a59c700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca9c0fd910 0x7fca9c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca99d9b700 1 -- 172.21.15.6:0/3279993079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca9c0fd910 msgr2=0x7fca9c10dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca99d9b700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca9c0fd910 0x7fca9c10dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca99d9b700 1 -- 172.21.15.6:0/3279993079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fca90005040 con 0x7fca9c0fe270 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca9a59c700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca9c0fd910 0x7fca9c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca99d9b700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 0x7fca9c10e4e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fca900099f0 tx=0x7fca90009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca8b7fe700 1 -- 172.21.15.6:0/3279993079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca9000e030 con 0x7fca9c0fe270 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fca9c108250 con 0x7fca9c0fe270 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca8b7fe700 1 -- 172.21.15.6:0/3279993079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fca90007e90 con 0x7fca9c0fe270 2024-03-12T16:20:49.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fca8b7fe700 1 -- 172.21.15.6:0/3279993079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fca90018070 con 0x7fca9c0fe270 2024-03-12T16:20:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.232+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fca9c1087b0 con 0x7fca9c0fe270 2024-03-12T16:20:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.234+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fca9c05f570 con 0x7fca9c0fe270 2024-03-12T16:20:49.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.234+0000 7fca8b7fe700 1 -- 172.21.15.6:0/3279993079 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fca9001d420 con 0x7fca9c0fe270 2024-03-12T16:20:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.234+0000 7fca8b7fe700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fca8406caa0 0x7fca8406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.234+0000 7fca8b7fe700 1 -- 172.21.15.6:0/3279993079 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fca9008d230 con 0x7fca9c0fe270 2024-03-12T16:20:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.234+0000 7fca9a59c700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fca8406caa0 0x7fca8406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:49.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.235+0000 7fca9a59c700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fca8406caa0 0x7fca8406ef60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fca8c004b80 tx=0x7fca8c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:49.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.239+0000 7fca8b7fe700 1 -- 172.21.15.6:0/3279993079 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fca9005ad90 con 0x7fca9c0fe270 2024-03-12T16:20:49.447 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.446+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fca9c109780 con 0x7fca8406caa0 2024-03-12T16:20:49.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.456+0000 7fca8b7fe700 1 -- 172.21.15.6:0/3279993079 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7fca9c109780 con 0x7fca8406caa0 2024-03-12T16:20:49.457 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:20:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (7m) 85s ago 18m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:20:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (5m) 85s ago 18m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:20:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (5m) 55s ago 17m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:20:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (7m) 85s ago 18m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:20:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (106s) 85s ago 13m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:20:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (89s) 85s ago 13m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:20:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (74s) 55s ago 13m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:20:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (58s) 55s ago 13m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:20:49.458 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (9m) 85s ago 19m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:20:49.459 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (8m) 55s ago 17m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:20:49.459 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (6m) 85s ago 20m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:20:49.459 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (6m) 55s ago 17m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:20:49.459 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (8m) 85s ago 18m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:20:49.459 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (8m) 55s ago 17m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:20:49.460 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (4m) 85s ago 17m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:20:49.460 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (4m) 85s ago 16m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:20:49.460 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (3m) 85s ago 16m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:20:49.460 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (3m) 55s ago 15m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:20:49.460 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (2m) 55s ago 15m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:20:49.461 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (2m) 55s ago 14m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:20:49.461 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (7m) 55s ago 16m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:20:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fca8406caa0 msgr2=0x7fca8406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fca8406caa0 0x7fca8406ef60 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 rx=0x7fca8c004b80 tx=0x7fca8c009040).stop 2024-03-12T16:20:49.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 msgr2=0x7fca9c10e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 0x7fca9c10e4e0 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fca900099f0 tx=0x7fca90009cb0).stop 2024-03-12T16:20:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 shutdown_connections 2024-03-12T16:20:49.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fca9c0fd910 0x7fca9c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fca8406caa0 0x7fca8406ef60 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 --2- 172.21.15.6:0/3279993079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fca9c0fe270 0x7fca9c10e4e0 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 >> 172.21.15.6:0/3279993079 conn(0x7fca9c0f3530 msgr2=0x7fca9c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 shutdown_connections 2024-03-12T16:20:49.464 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.458+0000 7fcaa0819700 1 -- 172.21.15.6:0/3279993079 wait complete. 2024-03-12T16:20:49.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.558+0000 7f7ac3692700 1 -- 172.21.15.6:0/3087289055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 msgr2=0x7f7abc0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.558+0000 7f7ac3692700 1 --2- 172.21.15.6:0/3087289055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 0x7f7abc0f6930 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f7aac0047f0 tx=0x7f7aac009cb0).stop 2024-03-12T16:20:49.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.558+0000 7f7ac3692700 1 -- 172.21.15.6:0/3087289055 shutdown_connections 2024-03-12T16:20:49.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.558+0000 7f7ac3692700 1 --2- 172.21.15.6:0/3087289055 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 0x7f7abc0f6930 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.558+0000 7f7ac3692700 1 --2- 172.21.15.6:0/3087289055 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc0fc7f0 0x7f7abc0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.559+0000 7f7ac3692700 1 -- 172.21.15.6:0/3087289055 >> 172.21.15.6:0/3087289055 conn(0x7f7abc070590 msgr2=0x7f7abc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.559+0000 7f7ac3692700 1 -- 172.21.15.6:0/3087289055 shutdown_connections 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.559+0000 7f7ac3692700 1 -- 172.21.15.6:0/3087289055 wait complete. 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.559+0000 7f7ac3692700 1 Processor -- start 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.559+0000 7f7ac3692700 1 -- start start 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.559+0000 7f7ac3692700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc0fc7f0 0x7f7abc1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.559+0000 7f7ac3692700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 0x7f7abc1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.559+0000 7f7ac3692700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc110cc0 con 0x7f7abc0fd150 2024-03-12T16:20:49.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.559+0000 7f7ac3692700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7abc110e00 con 0x7f7abc0fc7f0 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac0c2d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 0x7f7abc1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac0c2d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 0x7f7abc1106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38066/0 (socket says 172.21.15.6:38066) 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac0c2d700 1 -- 172.21.15.6:0/48940089 learned_addr learned my addr 172.21.15.6:0/48940089 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac142e700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc0fc7f0 0x7f7abc1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac0c2d700 1 -- 172.21.15.6:0/48940089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc0fc7f0 msgr2=0x7f7abc1101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac0c2d700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc0fc7f0 0x7f7abc1101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac0c2d700 1 -- 172.21.15.6:0/48940089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7aac005040 con 0x7f7abc0fd150 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac0c2d700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 0x7f7abc1106c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f7aac0099f0 tx=0x7f7aac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ab27fc700 1 -- 172.21.15.6:0/48940089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aac00e030 con 0x7f7abc0fd150 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ab27fc700 1 -- 172.21.15.6:0/48940089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7aac007e90 con 0x7f7abc0fd150 2024-03-12T16:20:49.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ab27fc700 1 -- 172.21.15.6:0/48940089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7aac018070 con 0x7f7abc0fd150 2024-03-12T16:20:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7abc10a430 con 0x7f7abc0fd150 2024-03-12T16:20:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.560+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7abc10a910 con 0x7f7abc0fd150 2024-03-12T16:20:49.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.561+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7abc05f590 con 0x7f7abc0fd150 2024-03-12T16:20:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.562+0000 7f7ab27fc700 1 -- 172.21.15.6:0/48940089 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7aac0094c0 con 0x7f7abc0fd150 2024-03-12T16:20:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.562+0000 7f7ab27fc700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7aa806caa0 0x7f7aa806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.562+0000 7f7ab27fc700 1 -- 172.21.15.6:0/48940089 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f7aac08cf50 con 0x7f7abc0fd150 2024-03-12T16:20:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.562+0000 7f7ac142e700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7aa806caa0 0x7f7aa806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:49.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.563+0000 7f7ac142e700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7aa806caa0 0x7f7aa806ef60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f7ab8004e60 tx=0x7f7ab800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:49.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.567+0000 7f7ab27fc700 1 -- 172.21.15.6:0/48940089 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7aac0c0190 con 0x7f7abc0fd150 2024-03-12T16:20:49.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.849+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7abc10b920 con 0x7f7abc0fd150 2024-03-12T16:20:49.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.850+0000 7f7ab27fc700 1 -- 172.21.15.6:0/48940089 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f7aac05a820 con 0x7f7abc0fd150 2024-03-12T16:20:49.851 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:20:49.851 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:20:49.852 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:20:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:20:49.853 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:20:49.853 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7aa806caa0 msgr2=0x7f7aa806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7aa806caa0 0x7f7aa806ef60 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 rx=0x7f7ab8004e60 tx=0x7f7ab800b040).stop 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 msgr2=0x7f7abc1106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 0x7f7abc1106c0 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7f7aac0099f0 tx=0x7f7aac009cb0).stop 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 shutdown_connections 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7abc0fc7f0 0x7f7abc1101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7aa806caa0 0x7f7aa806ef60 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 --2- 172.21.15.6:0/48940089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7abc0fd150 0x7f7abc1106c0 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 >> 172.21.15.6:0/48940089 conn(0x7f7abc070590 msgr2=0x7f7abc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 shutdown_connections 2024-03-12T16:20:49.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.852+0000 7f7ac3692700 1 -- 172.21.15.6:0/48940089 wait complete. 2024-03-12T16:20:49.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:49 smithi134 ceph-mon[85099]: pgmap v227: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.954+0000 7fa29aba1700 1 -- 172.21.15.6:0/382520540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 msgr2=0x7fa2940fdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.954+0000 7fa29aba1700 1 --2- 172.21.15.6:0/382520540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 0x7fa2940fdaa0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7fa290004a10 tx=0x7fa290009c50).stop 2024-03-12T16:20:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.955+0000 7fa29aba1700 1 -- 172.21.15.6:0/382520540 shutdown_connections 2024-03-12T16:20:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.955+0000 7fa29aba1700 1 --2- 172.21.15.6:0/382520540 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2940fe020 0x7fa2940f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.955+0000 7fa29aba1700 1 --2- 172.21.15.6:0/382520540 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 0x7fa2940fdaa0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.955+0000 7fa29aba1700 1 -- 172.21.15.6:0/382520540 >> 172.21.15.6:0/382520540 conn(0x7fa2940f3280 msgr2=0x7fa2940f56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.955+0000 7fa29aba1700 1 -- 172.21.15.6:0/382520540 shutdown_connections 2024-03-12T16:20:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.955+0000 7fa29aba1700 1 -- 172.21.15.6:0/382520540 wait complete. 2024-03-12T16:20:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.955+0000 7fa29aba1700 1 Processor -- start 2024-03-12T16:20:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.955+0000 7fa29aba1700 1 -- start start 2024-03-12T16:20:49.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa29aba1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 0x7fa2941103a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa29aba1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2940fe020 0x7fa294110890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa29aba1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa294110e90 con 0x7fa2940fd6c0 2024-03-12T16:20:49.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa29aba1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa294110fd0 con 0x7fa2940fe020 2024-03-12T16:20:49.958 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:49 smithi006 ceph-mon[103869]: pgmap v227: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa299b9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 0x7fa2941103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa299b9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 0x7fa2941103a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38084/0 (socket says 172.21.15.6:38084) 2024-03-12T16:20:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa299b9f700 1 -- 172.21.15.6:0/3900783662 learned_addr learned my addr 172.21.15.6:0/3900783662 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa29939e700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2940fe020 0x7fa294110890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa299b9f700 1 -- 172.21.15.6:0/3900783662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2940fe020 msgr2=0x7fa294110890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa299b9f700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2940fe020 0x7fa294110890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:49.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa299b9f700 1 -- 172.21.15.6:0/3900783662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2900045d0 con 0x7fa2940fd6c0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa299b9f700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 0x7fa2941103a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fa290009040 tx=0x7fa290009c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa28affd700 1 -- 172.21.15.6:0/3900783662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa29001a070 con 0x7fa2940fd6c0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa28affd700 1 -- 172.21.15.6:0/3900783662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa290009760 con 0x7fa2940fd6c0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa29410a3f0 con 0x7fa2940fd6c0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa28affd700 1 -- 172.21.15.6:0/3900783662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa29000e040 con 0x7fa2940fd6c0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.956+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa29410a950 con 0x7fa2940fd6c0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.957+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa29405f2f0 con 0x7fa2940fd6c0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.958+0000 7fa28affd700 1 -- 172.21.15.6:0/3900783662 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa29001f5b0 con 0x7fa2940fd6c0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.958+0000 7fa28affd700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa28006caa0 0x7fa28006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.959+0000 7fa28affd700 1 -- 172.21.15.6:0/3900783662 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa29008cb80 con 0x7fa2940fd6c0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.959+0000 7fa29939e700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa28006caa0 0x7fa28006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:49.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.959+0000 7fa29939e700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa28006caa0 0x7fa28006ef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa29410bce0 tx=0x7fa284009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:49.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:49.963+0000 7fa28affd700 1 -- 172.21.15.6:0/3900783662 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa29005a7a0 con 0x7fa2940fd6c0 2024-03-12T16:20:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.201+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fa29410ba20 con 0x7fa2940fd6c0 2024-03-12T16:20:50.203 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.202+0000 7fa28affd700 1 -- 172.21.15.6:0/3900783662 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fa29005a330 con 0x7fa2940fd6c0 2024-03-12T16:20:50.203 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:20:50.203 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:20:50.203 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:20:50.203 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:20:50.203 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:20:50.203 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:20:50.203 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:20:50.204 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:20:50.205 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:20:50.206 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:20:50.206 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:20:50.206 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:20:50.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa28006caa0 msgr2=0x7fa28006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.206 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa28006caa0 0x7fa28006ef60 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 rx=0x7fa29410bce0 tx=0x7fa284009040).stop 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 msgr2=0x7fa2941103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 0x7fa2941103a0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7fa290009040 tx=0x7fa290009c50).stop 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 shutdown_connections 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa28006caa0 0x7fa28006ef60 unknown :-1 s=CLOSED pgs=113 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2940fd6c0 0x7fa2941103a0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 --2- 172.21.15.6:0/3900783662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2940fe020 0x7fa294110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 >> 172.21.15.6:0/3900783662 conn(0x7fa2940f3280 msgr2=0x7fa29406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 shutdown_connections 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.204+0000 7fa29aba1700 1 -- 172.21.15.6:0/3900783662 wait complete. 2024-03-12T16:20:50.207 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:20:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 -- 172.21.15.6:0/3013103862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 msgr2=0x7f9de80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 --2- 172.21.15.6:0/3013103862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 0x7f9de80fcbd0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7f9dd80047f0 tx=0x7f9dd8009cb0).stop 2024-03-12T16:20:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 -- 172.21.15.6:0/3013103862 shutdown_connections 2024-03-12T16:20:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 --2- 172.21.15.6:0/3013103862 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9de80fd150 0x7f9de80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 --2- 172.21.15.6:0/3013103862 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 0x7f9de80fcbd0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 -- 172.21.15.6:0/3013103862 >> 172.21.15.6:0/3013103862 conn(0x7f9de8070590 msgr2=0x7f9de80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 -- 172.21.15.6:0/3013103862 shutdown_connections 2024-03-12T16:20:50.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 -- 172.21.15.6:0/3013103862 wait complete. 2024-03-12T16:20:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 Processor -- start 2024-03-12T16:20:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.307+0000 7f9def99a700 1 -- start start 2024-03-12T16:20:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9def99a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 0x7f9de80f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9def99a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9de80fd150 0x7f9de80f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9def99a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80f8f20 con 0x7f9de80fc7f0 2024-03-12T16:20:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9def99a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9de80f9060 con 0x7f9de80fd150 2024-03-12T16:20:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9ded736700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 0x7f9de80f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:50.310 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9ded736700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 0x7f9de80f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38102/0 (socket says 172.21.15.6:38102) 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9ded736700 1 -- 172.21.15.6:0/4171268566 learned_addr learned my addr 172.21.15.6:0/4171268566 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9decf35700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9de80fd150 0x7f9de80f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9ded736700 1 -- 172.21.15.6:0/4171268566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9de80fd150 msgr2=0x7f9de80f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9ded736700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9de80fd150 0x7f9de80f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9ded736700 1 -- 172.21.15.6:0/4171268566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9dd8005040 con 0x7f9de80fc7f0 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9ded736700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 0x7f9de80f8540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f9dd8005010 tx=0x7f9dd8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9dde7fc700 1 -- 172.21.15.6:0/4171268566 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd800e030 con 0x7f9de80fc7f0 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9dde7fc700 1 -- 172.21.15.6:0/4171268566 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9dd8007e90 con 0x7f9de80fc7f0 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9de80f92b0 con 0x7f9de80fc7f0 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.308+0000 7f9dde7fc700 1 -- 172.21.15.6:0/4171268566 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9dd8018070 con 0x7f9de80fc7f0 2024-03-12T16:20:50.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.309+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9de8114640 con 0x7f9de80fc7f0 2024-03-12T16:20:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.310+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9de805f590 con 0x7f9de80fc7f0 2024-03-12T16:20:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.310+0000 7f9dde7fc700 1 -- 172.21.15.6:0/4171268566 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9dd801d670 con 0x7f9de80fc7f0 2024-03-12T16:20:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.310+0000 7f9dde7fc700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9dd406caa0 0x7f9dd406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.310+0000 7f9dde7fc700 1 -- 172.21.15.6:0/4171268566 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9dd808d010 con 0x7f9de80fc7f0 2024-03-12T16:20:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.310+0000 7f9decf35700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9dd406caa0 0x7f9dd406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:50.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.311+0000 7f9decf35700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9dd406caa0 0x7f9dd406ef60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9de80f9ce0 tx=0x7f9de400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:50.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.315+0000 7f9dde7fc700 1 -- 172.21.15.6:0/4171268566 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9dd80570e0 con 0x7f9de80fc7f0 2024-03-12T16:20:50.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.533+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9de80fb5a0 con 0x7f9dd406caa0 2024-03-12T16:20:50.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.534+0000 7f9dde7fc700 1 -- 172.21.15.6:0/4171268566 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9de80fb5a0 con 0x7f9dd406caa0 2024-03-12T16:20:50.535 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:20:50.535 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:20:50.535 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:20:50.535 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:20:50.536 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:20:50.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9dd406caa0 msgr2=0x7f9dd406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9dd406caa0 0x7f9dd406ef60 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 rx=0x7f9de80f9ce0 tx=0x7f9de400b040).stop 2024-03-12T16:20:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 msgr2=0x7f9de80f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 0x7f9de80f8540 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7f9dd8005010 tx=0x7f9dd8009cb0).stop 2024-03-12T16:20:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 shutdown_connections 2024-03-12T16:20:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9dd406caa0 0x7f9dd406ef60 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9de80fc7f0 0x7f9de80f8540 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 --2- 172.21.15.6:0/4171268566 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9de80fd150 0x7f9de80f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 >> 172.21.15.6:0/4171268566 conn(0x7f9de8070590 msgr2=0x7f9de8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 shutdown_connections 2024-03-12T16:20:50.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.536+0000 7f9def99a700 1 -- 172.21.15.6:0/4171268566 wait complete. 2024-03-12T16:20:50.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.640+0000 7f76b5914700 1 -- 172.21.15.6:0/1227728024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 msgr2=0x7f76b01019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.640+0000 7f76b5914700 1 --2- 172.21.15.6:0/1227728024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 0x7f76b01019b0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7f76a00047f0 tx=0x7f76a0009cb0).stop 2024-03-12T16:20:50.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.640+0000 7f76b5914700 1 -- 172.21.15.6:0/1227728024 shutdown_connections 2024-03-12T16:20:50.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.640+0000 7f76b5914700 1 --2- 172.21.15.6:0/1227728024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 0x7f76b01019b0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.640+0000 7f76b5914700 1 --2- 172.21.15.6:0/1227728024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b00f8940 0x7f76b00f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.641+0000 7f76b5914700 1 -- 172.21.15.6:0/1227728024 >> 172.21.15.6:0/1227728024 conn(0x7f76b00f23b0 msgr2=0x7f76b00f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.641+0000 7f76b5914700 1 -- 172.21.15.6:0/1227728024 shutdown_connections 2024-03-12T16:20:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.641+0000 7f76b5914700 1 -- 172.21.15.6:0/1227728024 wait complete. 2024-03-12T16:20:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.641+0000 7f76b5914700 1 Processor -- start 2024-03-12T16:20:50.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.641+0000 7f76b5914700 1 -- start start 2024-03-12T16:20:50.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76b5914700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b00f8940 0x7f76b0110240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:50.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76b5914700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 0x7f76b0110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76b5914700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0110d30 con 0x7f76b00f9210 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76b5914700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f76b0110e70 con 0x7f76b00f8940 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76ae7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 0x7f76b0110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76ae7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 0x7f76b0110730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38124/0 (socket says 172.21.15.6:38124) 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76ae7fc700 1 -- 172.21.15.6:0/3454784845 learned_addr learned my addr 172.21.15.6:0/3454784845 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76aeffd700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b00f8940 0x7f76b0110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76ae7fc700 1 -- 172.21.15.6:0/3454784845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b00f8940 msgr2=0x7f76b0110240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76ae7fc700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b00f8940 0x7f76b0110240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76ae7fc700 1 -- 172.21.15.6:0/3454784845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f76a0005040 con 0x7f76b00f9210 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76aeffd700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b00f8940 0x7f76b0110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76ae7fc700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 0x7f76b0110730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f76a0005010 tx=0x7f76a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f7697fff700 1 -- 172.21.15.6:0/3454784845 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76a000e030 con 0x7f76b00f9210 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f76b010a4a0 con 0x7f76b00f9210 2024-03-12T16:20:50.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f7697fff700 1 -- 172.21.15.6:0/3454784845 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f76a0007e90 con 0x7f76b00f9210 2024-03-12T16:20:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f7697fff700 1 -- 172.21.15.6:0/3454784845 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f76a0018070 con 0x7f76b00f9210 2024-03-12T16:20:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.642+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f76b010a980 con 0x7f76b00f9210 2024-03-12T16:20:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.643+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f76b0060370 con 0x7f76b00f9210 2024-03-12T16:20:50.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.644+0000 7f7697fff700 1 -- 172.21.15.6:0/3454784845 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f76a001d6e0 con 0x7f76b00f9210 2024-03-12T16:20:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.644+0000 7f7697fff700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f769806ca30 0x7f769806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:20:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.645+0000 7f7697fff700 1 -- 172.21.15.6:0/3454784845 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f76a008d040 con 0x7f76b00f9210 2024-03-12T16:20:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.645+0000 7f76aeffd700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f769806ca30 0x7f769806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:20:50.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.645+0000 7f76aeffd700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f769806ca30 0x7f769806eef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f76a4009250 tx=0x7f76a4009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:20:50.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.649+0000 7f7697fff700 1 -- 172.21.15.6:0/3454784845 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f76a005a910 con 0x7f76b00f9210 2024-03-12T16:20:50.837 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:50 smithi006 ceph-mon[103869]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:50.838 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:50 smithi006 ceph-mon[103869]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:50.838 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:50 smithi006 ceph-mon[103869]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:50.838 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:50 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/48940089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:20:50.838 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:50 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3900783662' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:20:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.930+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f76b0047540 con 0x7f76b00f9210 2024-03-12T16:20:50.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.930+0000 7f7697fff700 1 -- 172.21.15.6:0/3454784845 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f76a005a730 con 0x7f76b00f9210 2024-03-12T16:20:50.932 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:20:50.932 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:20:50.932 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:20:50.932 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:20:50.932 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.932+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f769806ca30 msgr2=0x7f769806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.932+0000 7f76b5914700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f769806ca30 0x7f769806eef0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 rx=0x7f76a4009250 tx=0x7f76a4009d60).stop 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.932+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 msgr2=0x7f76b0110730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.932+0000 7f76b5914700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 0x7f76b0110730 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7f76a0005010 tx=0x7f76a0009cb0).stop 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.933+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 shutdown_connections 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.933+0000 7f76b5914700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f76b00f8940 0x7f76b0110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.933+0000 7f76b5914700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f769806ca30 0x7f769806eef0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.933+0000 7f76b5914700 1 --2- 172.21.15.6:0/3454784845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f76b00f9210 0x7f76b0110730 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.933+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 >> 172.21.15.6:0/3454784845 conn(0x7f76b00f23b0 msgr2=0x7f76b00f6f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.933+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 shutdown_connections 2024-03-12T16:20:50.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:20:50.933+0000 7f76b5914700 1 -- 172.21.15.6:0/3454784845 wait complete. 2024-03-12T16:20:50.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:50 smithi134 ceph-mon[85099]: from='client.34472 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:50.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:50 smithi134 ceph-mon[85099]: from='client.34476 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:50.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:50 smithi134 ceph-mon[85099]: from='client.34480 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:50.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:50 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/48940089' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:20:50.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:50 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3900783662' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:20:51.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:51 smithi134 ceph-mon[85099]: pgmap v228: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:51.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:51 smithi134 ceph-mon[85099]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:51.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:51 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3454784845' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:20:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:51 smithi006 ceph-mon[103869]: pgmap v228: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:51 smithi006 ceph-mon[103869]: from='client.34492 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:20:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:51 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3454784845' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:20:53.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:53 smithi134 ceph-mon[85099]: pgmap v229: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:53.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:53 smithi006 ceph-mon[103869]: pgmap v229: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:55.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:55 smithi134 ceph-mon[85099]: pgmap v230: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:55.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:55 smithi006 ceph-mon[103869]: pgmap v230: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:57.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:57 smithi134 ceph-mon[85099]: pgmap v231: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:57.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:57 smithi006 ceph-mon[103869]: pgmap v231: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:20:59 smithi134 ceph-mon[85099]: pgmap v232: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:20:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:20:59 smithi006 ceph-mon[103869]: pgmap v232: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:01 smithi134 ceph-mon[85099]: pgmap v233: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:01 smithi006 ceph-mon[103869]: pgmap v233: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:02.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:21:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:21:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:03 smithi134 ceph-mon[85099]: pgmap v234: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:03 smithi006 ceph-mon[103869]: pgmap v234: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:05.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:05 smithi134 ceph-mon[85099]: pgmap v235: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:05.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:05 smithi006 ceph-mon[103869]: pgmap v235: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:07.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:07 smithi134 ceph-mon[85099]: pgmap v236: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:07.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:07 smithi006 ceph-mon[103869]: pgmap v236: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:09.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:09 smithi134 ceph-mon[85099]: pgmap v237: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:09 smithi006 ceph-mon[103869]: pgmap v237: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:11.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:11 smithi134 ceph-mon[85099]: pgmap v238: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:11.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:11 smithi006 ceph-mon[103869]: pgmap v238: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:13.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:13 smithi134 ceph-mon[85099]: pgmap v239: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:13.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:13 smithi006 ceph-mon[103869]: pgmap v239: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:15.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:15 smithi134 ceph-mon[85099]: pgmap v240: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:15 smithi006 ceph-mon[103869]: pgmap v240: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:17.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:17 smithi134 ceph-mon[85099]: pgmap v241: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:17.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:21:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:17 smithi006 ceph-mon[103869]: pgmap v241: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:21:19.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:19 smithi134 ceph-mon[85099]: pgmap v242: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:19 smithi006 ceph-mon[103869]: pgmap v242: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:21.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.048+0000 7f2f20089700 1 -- 172.21.15.6:0/2734573346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6710 msgr2=0x7f2f180f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.048+0000 7f2f20089700 1 --2- 172.21.15.6:0/2734573346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6710 0x7f2f180f6af0 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2f140047f0 tx=0x7f2f14009cb0).stop 2024-03-12T16:21:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.048+0000 7f2f20089700 1 -- 172.21.15.6:0/2734573346 shutdown_connections 2024-03-12T16:21:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.048+0000 7f2f20089700 1 --2- 172.21.15.6:0/2734573346 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f180f6fe0 0x7f2f18103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.048+0000 7f2f20089700 1 --2- 172.21.15.6:0/2734573346 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6710 0x7f2f180f6af0 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.048+0000 7f2f20089700 1 -- 172.21.15.6:0/2734573346 >> 172.21.15.6:0/2734573346 conn(0x7f2f18070590 msgr2=0x7f2f180f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.048+0000 7f2f20089700 1 -- 172.21.15.6:0/2734573346 shutdown_connections 2024-03-12T16:21:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.048+0000 7f2f20089700 1 -- 172.21.15.6:0/2734573346 wait complete. 2024-03-12T16:21:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.048+0000 7f2f20089700 1 Processor -- start 2024-03-12T16:21:21.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f20089700 1 -- start start 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f20089700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f180f6710 0x7f2f18110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f20089700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6fe0 0x7f2f18110750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f20089700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18110d50 con 0x7f2f180f6fe0 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f20089700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2f18110e90 con 0x7f2f180f6710 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f1d624700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6fe0 0x7f2f18110750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f1d624700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6fe0 0x7f2f18110750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39984/0 (socket says 172.21.15.6:39984) 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f1d624700 1 -- 172.21.15.6:0/317524330 learned_addr learned my addr 172.21.15.6:0/317524330 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f1de25700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f180f6710 0x7f2f18110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f1d624700 1 -- 172.21.15.6:0/317524330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f180f6710 msgr2=0x7f2f18110260 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f1d624700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f180f6710 0x7f2f18110260 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f1d624700 1 -- 172.21.15.6:0/317524330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2f14005040 con 0x7f2f180f6fe0 2024-03-12T16:21:21.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.049+0000 7f2f1d624700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6fe0 0x7f2f18110750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f2f080041d0 tx=0x7f2f08009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.050+0000 7f2f0effd700 1 -- 172.21.15.6:0/317524330 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f08007b40 con 0x7f2f180f6fe0 2024-03-12T16:21:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.050+0000 7f2f0effd700 1 -- 172.21.15.6:0/317524330 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2f0800f040 con 0x7f2f180f6fe0 2024-03-12T16:21:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.050+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2f1810a520 con 0x7f2f180f6fe0 2024-03-12T16:21:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.050+0000 7f2f0effd700 1 -- 172.21.15.6:0/317524330 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2f080137d0 con 0x7f2f180f6fe0 2024-03-12T16:21:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.050+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2f1810aa60 con 0x7f2f180f6fe0 2024-03-12T16:21:21.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.051+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2f1805f590 con 0x7f2f180f6fe0 2024-03-12T16:21:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.051+0000 7f2f0effd700 1 -- 172.21.15.6:0/317524330 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2f08007ca0 con 0x7f2f180f6fe0 2024-03-12T16:21:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.052+0000 7f2f0effd700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2f0406caa0 0x7f2f0406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.052+0000 7f2f0effd700 1 -- 172.21.15.6:0/317524330 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2f0808b7d0 con 0x7f2f180f6fe0 2024-03-12T16:21:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.052+0000 7f2f1de25700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2f0406caa0 0x7f2f0406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:21.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.052+0000 7f2f1de25700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2f0406caa0 0x7f2f0406ef60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2f14004f10 tx=0x7f2f1400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:21.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.056+0000 7f2f0effd700 1 -- 172.21.15.6:0/317524330 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2f08059270 con 0x7f2f180f6fe0 2024-03-12T16:21:21.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.273+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2f1810ad30 con 0x7f2f0406caa0 2024-03-12T16:21:21.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.274+0000 7f2f0effd700 1 -- 172.21.15.6:0/317524330 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2f1810ad30 con 0x7f2f0406caa0 2024-03-12T16:21:21.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2f0406caa0 msgr2=0x7f2f0406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2f0406caa0 0x7f2f0406ef60 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 rx=0x7f2f14004f10 tx=0x7f2f1400b040).stop 2024-03-12T16:21:21.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6fe0 msgr2=0x7f2f18110750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6fe0 0x7f2f18110750 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7f2f080041d0 tx=0x7f2f08009f60).stop 2024-03-12T16:21:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 shutdown_connections 2024-03-12T16:21:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2f180f6710 0x7f2f18110260 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2f0406caa0 0x7f2f0406ef60 unknown :-1 s=CLOSED pgs=116 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 --2- 172.21.15.6:0/317524330 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2f180f6fe0 0x7f2f18110750 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 >> 172.21.15.6:0/317524330 conn(0x7f2f18070590 msgr2=0x7f2f1806d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 shutdown_connections 2024-03-12T16:21:21.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.276+0000 7f2f20089700 1 -- 172.21.15.6:0/317524330 wait complete. 2024-03-12T16:21:21.289 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:21:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.380+0000 7f19cb8b7700 1 -- 172.21.15.6:0/828677457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fc7f0 msgr2=0x7f19c40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.380+0000 7f19cb8b7700 1 --2- 172.21.15.6:0/828677457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fc7f0 0x7f19c40fcbd0 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f19b80047f0 tx=0x7f19b8009cb0).stop 2024-03-12T16:21:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.380+0000 7f19cb8b7700 1 -- 172.21.15.6:0/828677457 shutdown_connections 2024-03-12T16:21:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.380+0000 7f19cb8b7700 1 --2- 172.21.15.6:0/828677457 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40fd150 0x7f19c40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.380+0000 7f19cb8b7700 1 --2- 172.21.15.6:0/828677457 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fc7f0 0x7f19c40fcbd0 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.380+0000 7f19cb8b7700 1 -- 172.21.15.6:0/828677457 >> 172.21.15.6:0/828677457 conn(0x7f19c4070590 msgr2=0x7f19c40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.381+0000 7f19cb8b7700 1 -- 172.21.15.6:0/828677457 shutdown_connections 2024-03-12T16:21:21.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.381+0000 7f19cb8b7700 1 -- 172.21.15.6:0/828677457 wait complete. 2024-03-12T16:21:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.381+0000 7f19cb8b7700 1 Processor -- start 2024-03-12T16:21:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.381+0000 7f19cb8b7700 1 -- start start 2024-03-12T16:21:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.381+0000 7f19cb8b7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40fc7f0 0x7f19c41101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.381+0000 7f19cb8b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fd150 0x7f19c41106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.381+0000 7f19cb8b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4110cc0 con 0x7f19c40fd150 2024-03-12T16:21:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.381+0000 7f19cb8b7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19c4110e00 con 0x7f19c40fc7f0 2024-03-12T16:21:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19c8e52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fd150 0x7f19c41106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19c8e52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fd150 0x7f19c41106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40004/0 (socket says 172.21.15.6:40004) 2024-03-12T16:21:21.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19c8e52700 1 -- 172.21.15.6:0/2738102280 learned_addr learned my addr 172.21.15.6:0/2738102280 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19c9653700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40fc7f0 0x7f19c41101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19c8e52700 1 -- 172.21.15.6:0/2738102280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40fc7f0 msgr2=0x7f19c41101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19c8e52700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40fc7f0 0x7f19c41101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19c8e52700 1 -- 172.21.15.6:0/2738102280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19b8005040 con 0x7f19c40fd150 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19c8e52700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fd150 0x7f19c41106c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f19c000c790 tx=0x7f19c0007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19b67fc700 1 -- 172.21.15.6:0/2738102280 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c000e680 con 0x7f19c40fd150 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19c410a490 con 0x7f19c40fd150 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19b67fc700 1 -- 172.21.15.6:0/2738102280 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19c000ec90 con 0x7f19c40fd150 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19b67fc700 1 -- 172.21.15.6:0/2738102280 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19c0012c70 con 0x7f19c40fd150 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.382+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19c410aa50 con 0x7f19c40fd150 2024-03-12T16:21:21.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.383+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19c405f590 con 0x7f19c40fd150 2024-03-12T16:21:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.384+0000 7f19b67fc700 1 -- 172.21.15.6:0/2738102280 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f19c0012490 con 0x7f19c40fd150 2024-03-12T16:21:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.384+0000 7f19b67fc700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19b006caa0 0x7f19b006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.384+0000 7f19b67fc700 1 -- 172.21.15.6:0/2738102280 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f19c008b670 con 0x7f19c40fd150 2024-03-12T16:21:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.384+0000 7f19c9653700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19b006caa0 0x7f19b006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:21.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.385+0000 7f19c9653700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19b006caa0 0x7f19b006ef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f19b8007cf0 tx=0x7f19b800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:21.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.389+0000 7f19b67fc700 1 -- 172.21.15.6:0/2738102280 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f19c00591d0 con 0x7f19c40fd150 2024-03-12T16:21:21.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.604+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f19c410b090 con 0x7f19b006caa0 2024-03-12T16:21:21.607 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.605+0000 7f19b67fc700 1 -- 172.21.15.6:0/2738102280 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f19c410b090 con 0x7f19b006caa0 2024-03-12T16:21:21.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19b006caa0 msgr2=0x7f19b006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19b006caa0 0x7f19b006ef60 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 rx=0x7f19b8007cf0 tx=0x7f19b800b040).stop 2024-03-12T16:21:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fd150 msgr2=0x7f19c41106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fd150 0x7f19c41106c0 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f19c000c790 tx=0x7f19c0007f70).stop 2024-03-12T16:21:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 shutdown_connections 2024-03-12T16:21:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19c40fc7f0 0x7f19c41101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19b006caa0 0x7f19b006ef60 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 --2- 172.21.15.6:0/2738102280 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19c40fd150 0x7f19c41106c0 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 >> 172.21.15.6:0/2738102280 conn(0x7f19c4070590 msgr2=0x7f19c4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:21.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 shutdown_connections 2024-03-12T16:21:21.611 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.607+0000 7f19cb8b7700 1 -- 172.21.15.6:0/2738102280 wait complete. 2024-03-12T16:21:21.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.709+0000 7f15f8e27700 1 -- 172.21.15.6:0/2078124522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 msgr2=0x7f15f40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.709+0000 7f15f8e27700 1 --2- 172.21.15.6:0/2078124522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 0x7f15f40f6930 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7f15e80047f0 tx=0x7f15e8009cb0).stop 2024-03-12T16:21:21.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.710+0000 7f15f8e27700 1 -- 172.21.15.6:0/2078124522 shutdown_connections 2024-03-12T16:21:21.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.710+0000 7f15f8e27700 1 --2- 172.21.15.6:0/2078124522 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 0x7f15f40f6930 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.710+0000 7f15f8e27700 1 --2- 172.21.15.6:0/2078124522 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40fc7f0 0x7f15f40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.710+0000 7f15f8e27700 1 -- 172.21.15.6:0/2078124522 >> 172.21.15.6:0/2078124522 conn(0x7f15f4070590 msgr2=0x7f15f40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:21.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.710+0000 7f15f8e27700 1 -- 172.21.15.6:0/2078124522 shutdown_connections 2024-03-12T16:21:21.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.710+0000 7f15f8e27700 1 -- 172.21.15.6:0/2078124522 wait complete. 2024-03-12T16:21:21.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.710+0000 7f15f8e27700 1 Processor -- start 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.710+0000 7f15f8e27700 1 -- start start 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f8e27700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40fc7f0 0x7f15f40f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f8e27700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 0x7f15f40f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f8e27700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40f8f20 con 0x7f15f40fd150 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f8e27700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f15f40f9060 con 0x7f15f40fc7f0 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 0x7f15f40f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 0x7f15f40f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40020/0 (socket says 172.21.15.6:40020) 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f1d9b700 1 -- 172.21.15.6:0/545654375 learned_addr learned my addr 172.21.15.6:0/545654375 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f259c700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40fc7f0 0x7f15f40f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f1d9b700 1 -- 172.21.15.6:0/545654375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40fc7f0 msgr2=0x7f15f40f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f1d9b700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40fc7f0 0x7f15f40f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f1d9b700 1 -- 172.21.15.6:0/545654375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f15e8005040 con 0x7f15f40fd150 2024-03-12T16:21:21.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f1d9b700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 0x7f15f40f8a30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f15e8000c00 tx=0x7f15e8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:21.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15e37fe700 1 -- 172.21.15.6:0/545654375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15e8018070 con 0x7f15f40fd150 2024-03-12T16:21:21.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15e37fe700 1 -- 172.21.15.6:0/545654375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f15e8007e90 con 0x7f15f40fd150 2024-03-12T16:21:21.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f15f40f92e0 con 0x7f15f40fd150 2024-03-12T16:21:21.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15e37fe700 1 -- 172.21.15.6:0/545654375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f15e801de20 con 0x7f15f40fd150 2024-03-12T16:21:21.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.711+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f15f41146f0 con 0x7f15f40fd150 2024-03-12T16:21:21.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.712+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f15f405f590 con 0x7f15f40fd150 2024-03-12T16:21:21.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.713+0000 7f15e37fe700 1 -- 172.21.15.6:0/545654375 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f15e801d420 con 0x7f15f40fd150 2024-03-12T16:21:21.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.713+0000 7f15e37fe700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f15dc06ca30 0x7f15dc06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:21.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.713+0000 7f15e37fe700 1 -- 172.21.15.6:0/545654375 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f15e808c8d0 con 0x7f15f40fd150 2024-03-12T16:21:21.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.713+0000 7f15f259c700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f15dc06ca30 0x7f15dc06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:21.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.714+0000 7f15f259c700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f15dc06ca30 0x7f15dc06eef0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f15e40048b0 tx=0x7f15e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:21.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.718+0000 7f15e37fe700 1 -- 172.21.15.6:0/545654375 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f15e80569a0 con 0x7f15f40fd150 2024-03-12T16:21:21.927 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.925+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f15f40fb5a0 con 0x7f15dc06ca30 2024-03-12T16:21:21.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.935+0000 7f15e37fe700 1 -- 172.21.15.6:0/545654375 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3498 (secure 0 0 0) 0x7f15f40fb5a0 con 0x7f15dc06ca30 2024-03-12T16:21:21.937 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:21:21.937 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (8m) 117s ago 19m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:21:21.937 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (5m) 117s ago 19m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:21:21.937 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (5m) 87s ago 18m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:21:21.937 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (7m) 117s ago 18m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (2m) 117s ago 13m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (2m) 117s ago 13m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (106s) 87s ago 13m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (91s) 87s ago 13m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (9m) 117s ago 20m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (9m) 87s ago 18m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (6m) 117s ago 20m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (6m) 87s ago 18m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (8m) 117s ago 18m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (8m) 87s ago 18m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (5m) 117s ago 17m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (4m) 117s ago 17m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (4m) 117s ago 16m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:21:21.938 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (3m) 87s ago 16m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:21:21.939 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (3m) 87s ago 15m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:21:21.939 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (2m) 87s ago 15m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:21:21.939 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (8m) 87s ago 17m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:21:21.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f15dc06ca30 msgr2=0x7f15dc06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f15dc06ca30 0x7f15dc06eef0 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 rx=0x7f15e40048b0 tx=0x7f15e400b040).stop 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 msgr2=0x7f15f40f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 0x7f15f40f8a30 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7f15e8000c00 tx=0x7f15e8009cb0).stop 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 shutdown_connections 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f15f40fc7f0 0x7f15f40f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f15dc06ca30 0x7f15dc06eef0 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 --2- 172.21.15.6:0/545654375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f15f40fd150 0x7f15f40f8a30 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 >> 172.21.15.6:0/545654375 conn(0x7f15f4070590 msgr2=0x7f15f4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 shutdown_connections 2024-03-12T16:21:21.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:21.937+0000 7f15f8e27700 1 -- 172.21.15.6:0/545654375 wait complete. 2024-03-12T16:21:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:21 smithi134 ceph-mon[85099]: pgmap v243: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:21.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:21 smithi006 ceph-mon[103869]: pgmap v243: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:22.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.039+0000 7fb58227c700 1 -- 172.21.15.6:0/3666411027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 msgr2=0x7fb57c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.039+0000 7fb58227c700 1 --2- 172.21.15.6:0/3666411027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 0x7fb57c0f7a30 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7fb5700047f0 tx=0x7fb570009cb0).stop 2024-03-12T16:21:22.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.039+0000 7fb58227c700 1 -- 172.21.15.6:0/3666411027 shutdown_connections 2024-03-12T16:21:22.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.039+0000 7fb58227c700 1 --2- 172.21.15.6:0/3666411027 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 0x7fb57c0f7a30 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.039+0000 7fb58227c700 1 --2- 172.21.15.6:0/3666411027 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57c0fd8f0 0x7fb57c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.039+0000 7fb58227c700 1 -- 172.21.15.6:0/3666411027 >> 172.21.15.6:0/3666411027 conn(0x7fb57c0f34b0 msgr2=0x7fb57c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:22.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.039+0000 7fb58227c700 1 -- 172.21.15.6:0/3666411027 shutdown_connections 2024-03-12T16:21:22.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.039+0000 7fb58227c700 1 -- 172.21.15.6:0/3666411027 wait complete. 2024-03-12T16:21:22.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb58227c700 1 Processor -- start 2024-03-12T16:21:22.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb58227c700 1 -- start start 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb58227c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57c0fd8f0 0x7fb57c10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb58227c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 0x7fb57c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb58227c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c10eb70 con 0x7fb57c0fe250 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb58227c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57c10ecb0 con 0x7fb57c0fd8f0 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb57b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 0x7fb57c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb57b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 0x7fb57c10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40038/0 (socket says 172.21.15.6:40038) 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb57b7fe700 1 -- 172.21.15.6:0/191000856 learned_addr learned my addr 172.21.15.6:0/191000856 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb57b7fe700 1 -- 172.21.15.6:0/191000856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57c0fd8f0 msgr2=0x7fb57c10e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb57bfff700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57c0fd8f0 0x7fb57c10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:22.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb57b7fe700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57c0fd8f0 0x7fb57c10e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.040+0000 7fb57b7fe700 1 -- 172.21.15.6:0/191000856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb570005040 con 0x7fb57c0fe250 2024-03-12T16:21:22.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.041+0000 7fb57b7fe700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 0x7fb57c10e570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb5700099f0 tx=0x7fb570009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:22.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.041+0000 7fb579775700 1 -- 172.21.15.6:0/191000856 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb57000e030 con 0x7fb57c0fe250 2024-03-12T16:21:22.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.041+0000 7fb579775700 1 -- 172.21.15.6:0/191000856 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb570007e90 con 0x7fb57c0fe250 2024-03-12T16:21:22.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.041+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57c1082e0 con 0x7fb57c0fe250 2024-03-12T16:21:22.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.041+0000 7fb579775700 1 -- 172.21.15.6:0/191000856 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb570018070 con 0x7fb57c0fe250 2024-03-12T16:21:22.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.041+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb57c1087c0 con 0x7fb57c0fe250 2024-03-12T16:21:22.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.042+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57c05f590 con 0x7fb57c0fe250 2024-03-12T16:21:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.042+0000 7fb579775700 1 -- 172.21.15.6:0/191000856 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb570009590 con 0x7fb57c0fe250 2024-03-12T16:21:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.043+0000 7fb579775700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb56406ca30 0x7fb56406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.043+0000 7fb579775700 1 -- 172.21.15.6:0/191000856 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb57008d030 con 0x7fb57c0fe250 2024-03-12T16:21:22.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.043+0000 7fb57bfff700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb56406ca30 0x7fb56406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:22.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.043+0000 7fb57bfff700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb56406ca30 0x7fb56406eef0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb56c004be0 tx=0x7fb56c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:22.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.047+0000 7fb579775700 1 -- 172.21.15.6:0/191000856 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb57005ab90 con 0x7fb57c0fe250 2024-03-12T16:21:22.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.326+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fb57c0ffc40 con 0x7fb57c0fe250 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.326+0000 7fb579775700 1 -- 172.21.15.6:0/191000856 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fb57005a720 con 0x7fb57c0fe250 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:21:22.329 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:21:22.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:21:22.330 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:21:22.330 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:21:22.330 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:21:22.330 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:21:22.330 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:21:22.330 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:21:22.330 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:21:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb56406ca30 msgr2=0x7fb56406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb56406ca30 0x7fb56406eef0 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 rx=0x7fb56c004be0 tx=0x7fb56c00b040).stop 2024-03-12T16:21:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 msgr2=0x7fb57c10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 0x7fb57c10e570 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7fb5700099f0 tx=0x7fb570009cb0).stop 2024-03-12T16:21:22.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 shutdown_connections 2024-03-12T16:21:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb57c0fd8f0 0x7fb57c10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb56406ca30 0x7fb56406eef0 unknown :-1 s=CLOSED pgs=119 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 --2- 172.21.15.6:0/191000856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb57c0fe250 0x7fb57c10e570 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 >> 172.21.15.6:0/191000856 conn(0x7fb57c0f34b0 msgr2=0x7fb57c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 shutdown_connections 2024-03-12T16:21:22.332 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.328+0000 7fb58227c700 1 -- 172.21.15.6:0/191000856 wait complete. 2024-03-12T16:21:22.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.430+0000 7fe506394700 1 -- 172.21.15.6:0/2360009970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fd8f0 msgr2=0x7fe5000fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.434 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.430+0000 7fe506394700 1 --2- 172.21.15.6:0/2360009970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fd8f0 0x7fe5000fdcd0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7fe4e80047f0 tx=0x7fe4e8009cb0).stop 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.430+0000 7fe506394700 1 -- 172.21.15.6:0/2360009970 shutdown_connections 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.430+0000 7fe506394700 1 --2- 172.21.15.6:0/2360009970 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5000fe250 0x7fe5000f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.430+0000 7fe506394700 1 --2- 172.21.15.6:0/2360009970 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fd8f0 0x7fe5000fdcd0 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.430+0000 7fe506394700 1 -- 172.21.15.6:0/2360009970 >> 172.21.15.6:0/2360009970 conn(0x7fe5000f34b0 msgr2=0x7fe5000f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.430+0000 7fe506394700 1 -- 172.21.15.6:0/2360009970 shutdown_connections 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.430+0000 7fe506394700 1 -- 172.21.15.6:0/2360009970 wait complete. 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.430+0000 7fe506394700 1 Processor -- start 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe506394700 1 -- start start 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe506394700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5000fd8f0 0x7fe50006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe506394700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fe250 0x7fe50006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe506394700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50006bab0 con 0x7fe5000fe250 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe506394700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe50006bbf0 con 0x7fe5000fd8f0 2024-03-12T16:21:22.435 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe4ff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fe250 0x7fe50006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe4ff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fe250 0x7fe50006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56602/0 (socket says 172.21.15.6:56602) 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe4ff7fe700 1 -- 172.21.15.6:0/3425970169 learned_addr learned my addr 172.21.15.6:0/3425970169 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe4fffff700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5000fd8f0 0x7fe50006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe4ff7fe700 1 -- 172.21.15.6:0/3425970169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5000fd8f0 msgr2=0x7fe50006b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe4ff7fe700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5000fd8f0 0x7fe50006b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.431+0000 7fe4ff7fe700 1 -- 172.21.15.6:0/3425970169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe4e8005040 con 0x7fe5000fe250 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.432+0000 7fe4ff7fe700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fe250 0x7fe50006b5c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fe4f000b480 tx=0x7fe4f00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.432+0000 7fe4fd7fa700 1 -- 172.21.15.6:0/3425970169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f0002500 con 0x7fe5000fe250 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.432+0000 7fe4fd7fa700 1 -- 172.21.15.6:0/3425970169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe4f0002b10 con 0x7fe5000fe250 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.432+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe50006bea0 con 0x7fe5000fe250 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.432+0000 7fe4fd7fa700 1 -- 172.21.15.6:0/3425970169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe4f0012c90 con 0x7fe5000fe250 2024-03-12T16:21:22.436 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.432+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5001147c0 con 0x7fe5000fe250 2024-03-12T16:21:22.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.433+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe50005f590 con 0x7fe5000fe250 2024-03-12T16:21:22.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.434+0000 7fe4fd7fa700 1 -- 172.21.15.6:0/3425970169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe4f0002660 con 0x7fe5000fe250 2024-03-12T16:21:22.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.434+0000 7fe4fd7fa700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe4ec06caa0 0x7fe4ec06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:22.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.434+0000 7fe4fffff700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe4ec06caa0 0x7fe4ec06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:22.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.434+0000 7fe4fd7fa700 1 -- 172.21.15.6:0/3425970169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe4f008c180 con 0x7fe5000fe250 2024-03-12T16:21:22.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.435+0000 7fe4fffff700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe4ec06caa0 0x7fe4ec06ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe4e80043d0 tx=0x7fe4e800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:22.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.438+0000 7fe4fd7fa700 1 -- 172.21.15.6:0/3425970169 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe4f00562d0 con 0x7fe5000fe250 2024-03-12T16:21:22.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.680+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe5000ffc80 con 0x7fe5000fe250 2024-03-12T16:21:22.683 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.680+0000 7fe4fd7fa700 1 -- 172.21.15.6:0/3425970169 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fe4f00598f0 con 0x7fe5000fe250 2024-03-12T16:21:22.683 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:21:22.683 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:21:22.683 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:21:22.683 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:21:22.683 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:21:22.683 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:21:22.684 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:21:22.684 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:21:22.684 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:21:22.684 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:21:22.684 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:21:22.684 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:21:22.684 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:21:22.685 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:21:22.686 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:21:22.687 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:21:22.687 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:21:22.687 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:21:22.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.682+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe4ec06caa0 msgr2=0x7fe4ec06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe4ec06caa0 0x7fe4ec06ef60 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 rx=0x7fe4e80043d0 tx=0x7fe4e800b040).stop 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fe250 msgr2=0x7fe50006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fe250 0x7fe50006b5c0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7fe4f000b480 tx=0x7fe4f00090f0).stop 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 shutdown_connections 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5000fd8f0 0x7fe50006b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe4ec06caa0 0x7fe4ec06ef60 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 --2- 172.21.15.6:0/3425970169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5000fe250 0x7fe50006b5c0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 >> 172.21.15.6:0/3425970169 conn(0x7fe5000f34b0 msgr2=0x7fe5000fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 shutdown_connections 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.683+0000 7fe506394700 1 -- 172.21.15.6:0/3425970169 wait complete. 2024-03-12T16:21:22.688 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:21:22.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.785+0000 7f662d1ed700 1 -- 172.21.15.6:0/3227220084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fd150 msgr2=0x7f66280f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.785+0000 7f662d1ed700 1 --2- 172.21.15.6:0/3227220084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fd150 0x7f66280f6930 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f661c0047f0 tx=0x7f661c009cb0).stop 2024-03-12T16:21:22.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.785+0000 7f662d1ed700 1 -- 172.21.15.6:0/3227220084 shutdown_connections 2024-03-12T16:21:22.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.785+0000 7f662d1ed700 1 --2- 172.21.15.6:0/3227220084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fd150 0x7f66280f6930 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.785+0000 7f662d1ed700 1 --2- 172.21.15.6:0/3227220084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66280fc7f0 0x7f66280fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:21:22.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.785+0000 7f662d1ed700 1 -- 172.21.15.6:0/3227220084 >> 172.21.15.6:0/3227220084 conn(0x7f6628070590 msgr2=0x7f66280f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:22.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.785+0000 7f662d1ed700 1 -- 172.21.15.6:0/3227220084 shutdown_connections 2024-03-12T16:21:22.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.785+0000 7f662d1ed700 1 -- 172.21.15.6:0/3227220084 wait complete. 2024-03-12T16:21:22.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.786+0000 7f662d1ed700 1 Processor -- start 2024-03-12T16:21:22.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.786+0000 7f662d1ed700 1 -- start start 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.786+0000 7f662d1ed700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fc7f0 0x7f662810e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.786+0000 7f662d1ed700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66280fd150 0x7f662810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.786+0000 7f662d1ed700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f662810ec00 con 0x7f66280fc7f0 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.786+0000 7f662d1ed700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6628108220 con 0x7f66280fd150 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f6626d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fc7f0 0x7f662810e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f6626d9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fc7f0 0x7f662810e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56620/0 (socket says 172.21.15.6:56620) 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f6626d9d700 1 -- 172.21.15.6:0/211068072 learned_addr learned my addr 172.21.15.6:0/211068072 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f662659c700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66280fd150 0x7f662810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f6626d9d700 1 -- 172.21.15.6:0/211068072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66280fd150 msgr2=0x7f662810e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f6626d9d700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66280fd150 0x7f662810e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f6626d9d700 1 -- 172.21.15.6:0/211068072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f661c005040 con 0x7f66280fc7f0 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f662659c700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66280fd150 0x7f662810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:21:22.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f6626d9d700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fc7f0 0x7f662810e080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f661800b4b0 tx=0x7f66180090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:22.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f660ffff700 1 -- 172.21.15.6:0/211068072 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6618002500 con 0x7f66280fc7f0 2024-03-12T16:21:22.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f66281084d0 con 0x7f66280fc7f0 2024-03-12T16:21:22.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f660ffff700 1 -- 172.21.15.6:0/211068072 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6618002b10 con 0x7f66280fc7f0 2024-03-12T16:21:22.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f660ffff700 1 -- 172.21.15.6:0/211068072 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6618012cf0 con 0x7f66280fc7f0 2024-03-12T16:21:22.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.787+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6628108a10 con 0x7f66280fc7f0 2024-03-12T16:21:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.788+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f662805f590 con 0x7f66280fc7f0 2024-03-12T16:21:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.789+0000 7f660ffff700 1 -- 172.21.15.6:0/211068072 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f6618002660 con 0x7f66280fc7f0 2024-03-12T16:21:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.789+0000 7f660ffff700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f661006caa0 0x7f661006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.789+0000 7f660ffff700 1 -- 172.21.15.6:0/211068072 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f661808be70 con 0x7f66280fc7f0 2024-03-12T16:21:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.789+0000 7f662659c700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f661006caa0 0x7f661006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:22.792 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.790+0000 7f662659c700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f661006caa0 0x7f661006ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f661c004f10 tx=0x7f661c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:22.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:22.793+0000 7f660ffff700 1 -- 172.21.15.6:0/211068072 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f66180599d0 con 0x7f66280fc7f0 2024-03-12T16:21:22.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:22 smithi134 ceph-mon[85099]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:22.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:22 smithi134 ceph-mon[85099]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:22.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:22 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/191000856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:21:22.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:22 smithi006 ceph-mon[103869]: from='client.34500 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:22.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:22 smithi006 ceph-mon[103869]: from='client.34504 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:22.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:22 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/191000856' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:21:23.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.011+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6628103660 con 0x7f661006caa0 2024-03-12T16:21:23.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.012+0000 7f660ffff700 1 -- 172.21.15.6:0/211068072 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f6628103660 con 0x7f661006caa0 2024-03-12T16:21:23.014 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:21:23.014 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:21:23.014 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:21:23.014 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:21:23.015 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:21:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f661006caa0 msgr2=0x7f661006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f661006caa0 0x7f661006ef60 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 rx=0x7f661c004f10 tx=0x7f661c00b040).stop 2024-03-12T16:21:23.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fc7f0 msgr2=0x7f662810e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fc7f0 0x7f662810e080 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7f661800b4b0 tx=0x7f66180090f0).stop 2024-03-12T16:21:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 shutdown_connections 2024-03-12T16:21:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f661006caa0 0x7f661006ef60 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f66280fc7f0 0x7f662810e080 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 --2- 172.21.15.6:0/211068072 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f66280fd150 0x7f662810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 >> 172.21.15.6:0/211068072 conn(0x7f6628070590 msgr2=0x7f6628060590 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 shutdown_connections 2024-03-12T16:21:23.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.014+0000 7f662d1ed700 1 -- 172.21.15.6:0/211068072 wait complete. 2024-03-12T16:21:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.116+0000 7f038dd04700 1 -- 172.21.15.6:0/649347472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fd150 msgr2=0x7f03880f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:23.120 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.116+0000 7f038dd04700 1 --2- 172.21.15.6:0/649347472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fd150 0x7f03880f6930 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f037c0047f0 tx=0x7f037c009cb0).stop 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.116+0000 7f038dd04700 1 -- 172.21.15.6:0/649347472 shutdown_connections 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.116+0000 7f038dd04700 1 --2- 172.21.15.6:0/649347472 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fd150 0x7f03880f6930 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.116+0000 7f038dd04700 1 --2- 172.21.15.6:0/649347472 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03880fc7f0 0x7f03880fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.116+0000 7f038dd04700 1 -- 172.21.15.6:0/649347472 >> 172.21.15.6:0/649347472 conn(0x7f0388070590 msgr2=0x7f03880f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.116+0000 7f038dd04700 1 -- 172.21.15.6:0/649347472 shutdown_connections 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.116+0000 7f038dd04700 1 -- 172.21.15.6:0/649347472 wait complete. 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.117+0000 7f038dd04700 1 Processor -- start 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.117+0000 7f038dd04700 1 -- start start 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.117+0000 7f038dd04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fc7f0 0x7f038810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.117+0000 7f038dd04700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03880fd150 0x7f038810e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.117+0000 7f038dd04700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038810eab0 con 0x7f03880fc7f0 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.117+0000 7f038dd04700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f038810ebf0 con 0x7f03880fd150 2024-03-12T16:21:23.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f03877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fc7f0 0x7f038810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f03877fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fc7f0 0x7f038810dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56636/0 (socket says 172.21.15.6:56636) 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f03877fe700 1 -- 172.21.15.6:0/2092123952 learned_addr learned my addr 172.21.15.6:0/2092123952 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f0386ffd700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03880fd150 0x7f038810e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f03877fe700 1 -- 172.21.15.6:0/2092123952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03880fd150 msgr2=0x7f038810e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f03877fe700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03880fd150 0x7f038810e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f03877fe700 1 -- 172.21.15.6:0/2092123952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f037c005040 con 0x7f03880fc7f0 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f03877fe700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fc7f0 0x7f038810dfc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f037800c790 tx=0x7f0378004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f0384ff9700 1 -- 172.21.15.6:0/2092123952 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f037800e680 con 0x7f03880fc7f0 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0388108280 con 0x7f03880fc7f0 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f0384ff9700 1 -- 172.21.15.6:0/2092123952 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f037800ec90 con 0x7f03880fc7f0 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f0384ff9700 1 -- 172.21.15.6:0/2092123952 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0378012d60 con 0x7f03880fc7f0 2024-03-12T16:21:23.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.118+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0388108840 con 0x7f03880fc7f0 2024-03-12T16:21:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.119+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f038805f590 con 0x7f03880fc7f0 2024-03-12T16:21:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.120+0000 7f0384ff9700 1 -- 172.21.15.6:0/2092123952 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f0378012400 con 0x7f03880fc7f0 2024-03-12T16:21:23.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.120+0000 7f0384ff9700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f037006cab0 0x7f037006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.120+0000 7f0384ff9700 1 -- 172.21.15.6:0/2092123952 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f037808b660 con 0x7f03880fc7f0 2024-03-12T16:21:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.120+0000 7f0386ffd700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f037006cab0 0x7f037006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:23.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.121+0000 7f0386ffd700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f037006cab0 0x7f037006ef70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0388109900 tx=0x7f037c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:23.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.124+0000 7f0384ff9700 1 -- 172.21.15.6:0/2092123952 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f03780591c0 con 0x7f03880fc7f0 2024-03-12T16:21:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.403+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f0388047540 con 0x7f03880fc7f0 2024-03-12T16:21:23.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.403+0000 7f0384ff9700 1 -- 172.21.15.6:0/2092123952 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f0378058d50 con 0x7f03880fc7f0 2024-03-12T16:21:23.406 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:21:23.406 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:21:23.406 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:21:23.406 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:21:23.406 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:21:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.405+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f037006cab0 msgr2=0x7f037006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:23.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.405+0000 7f038dd04700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f037006cab0 0x7f037006ef70 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 rx=0x7f0388109900 tx=0x7f037c009cb0).stop 2024-03-12T16:21:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.405+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fc7f0 msgr2=0x7f038810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.405+0000 7f038dd04700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fc7f0 0x7f038810dfc0 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 rx=0x7f037800c790 tx=0x7f0378004330).stop 2024-03-12T16:21:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.405+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 shutdown_connections 2024-03-12T16:21:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.405+0000 7f038dd04700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f037006cab0 0x7f037006ef70 unknown :-1 s=CLOSED pgs=122 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.405+0000 7f038dd04700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f03880fc7f0 0x7f038810dfc0 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.405+0000 7f038dd04700 1 --2- 172.21.15.6:0/2092123952 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f03880fd150 0x7f038810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.405+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 >> 172.21.15.6:0/2092123952 conn(0x7f0388070590 msgr2=0x7f0388060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.406+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 shutdown_connections 2024-03-12T16:21:23.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:23.406+0000 7f038dd04700 1 -- 172.21.15.6:0/2092123952 wait complete. 2024-03-12T16:21:23.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:23 smithi134 ceph-mon[85099]: pgmap v244: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:23.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:23 smithi134 ceph-mon[85099]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:23.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:23 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3425970169' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:21:23.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:23 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2092123952' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:21:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:23 smithi006 ceph-mon[103869]: pgmap v244: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:23 smithi006 ceph-mon[103869]: from='client.34508 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:23 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3425970169' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:21:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:23 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2092123952' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:21:24.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:24 smithi134 ceph-mon[85099]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:24.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:24 smithi006 ceph-mon[103869]: from='client.34520 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:25.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:25 smithi134 ceph-mon[85099]: pgmap v245: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:25.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:25 smithi006 ceph-mon[103869]: pgmap v245: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:27.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:27 smithi134 ceph-mon[85099]: pgmap v246: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:27.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:27 smithi006 ceph-mon[103869]: pgmap v246: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:29.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:29 smithi134 ceph-mon[85099]: pgmap v247: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:29 smithi006 ceph-mon[103869]: pgmap v247: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:31.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:31 smithi134 ceph-mon[85099]: pgmap v248: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:31.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:31 smithi006 ceph-mon[103869]: pgmap v248: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:32.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:21:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:21:33.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:33 smithi134 ceph-mon[85099]: pgmap v249: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:33 smithi006 ceph-mon[103869]: pgmap v249: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:35.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:35 smithi134 ceph-mon[85099]: pgmap v250: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:35.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:35 smithi006 ceph-mon[103869]: pgmap v250: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:37.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:37 smithi134 ceph-mon[85099]: pgmap v251: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:37 smithi006 ceph-mon[103869]: pgmap v251: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:39.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:39 smithi134 ceph-mon[85099]: pgmap v252: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:39.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:39 smithi006 ceph-mon[103869]: pgmap v252: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:41.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:41 smithi134 ceph-mon[85099]: pgmap v253: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:41.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:41 smithi006 ceph-mon[103869]: pgmap v253: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:43.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:43 smithi134 ceph-mon[85099]: pgmap v254: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:43.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:43 smithi006 ceph-mon[103869]: pgmap v254: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:45 smithi134 ceph-mon[85099]: pgmap v255: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:45.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:45 smithi006 ceph-mon[103869]: pgmap v255: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:47.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:47 smithi134 ceph-mon[85099]: pgmap v256: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:47.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:21:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:47 smithi006 ceph-mon[103869]: pgmap v256: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:21:49.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:49 smithi134 ceph-mon[85099]: pgmap v257: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:49.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:49 smithi006 ceph-mon[103869]: pgmap v257: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:51.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:51 smithi134 ceph-mon[85099]: pgmap v258: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:51.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:51 smithi006 ceph-mon[103869]: pgmap v258: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.521+0000 7f9422080700 1 -- 172.21.15.6:0/2950056844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 msgr2=0x7f941c0f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.521+0000 7f9422080700 1 --2- 172.21.15.6:0/2950056844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 0x7f941c0f8ce0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 rx=0x7f940c0047f0 tx=0x7f940c009cb0).stop 2024-03-12T16:21:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.521+0000 7f9422080700 1 -- 172.21.15.6:0/2950056844 shutdown_connections 2024-03-12T16:21:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.521+0000 7f9422080700 1 --2- 172.21.15.6:0/2950056844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c0f91d0 0x7f941c101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:53.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.521+0000 7f9422080700 1 --2- 172.21.15.6:0/2950056844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 0x7f941c0f8ce0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.521+0000 7f9422080700 1 -- 172.21.15.6:0/2950056844 >> 172.21.15.6:0/2950056844 conn(0x7f941c0f23b0 msgr2=0x7f941c0f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.522+0000 7f9422080700 1 -- 172.21.15.6:0/2950056844 shutdown_connections 2024-03-12T16:21:53.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.522+0000 7f9422080700 1 -- 172.21.15.6:0/2950056844 wait complete. 2024-03-12T16:21:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.522+0000 7f9422080700 1 Processor -- start 2024-03-12T16:21:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.522+0000 7f9422080700 1 -- start start 2024-03-12T16:21:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f9422080700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 0x7f941c10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f9422080700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c0f91d0 0x7f941c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f9422080700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c10eb50 con 0x7f941c0f8900 2024-03-12T16:21:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f9422080700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f941c10ec90 con 0x7f941c0f91d0 2024-03-12T16:21:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 0x7f941c10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f941b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 0x7f941c10e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42294/0 (socket says 172.21.15.6:42294) 2024-03-12T16:21:53.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f941b7fe700 1 -- 172.21.15.6:0/3276648518 learned_addr learned my addr 172.21.15.6:0/3276648518 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f941affd700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c0f91d0 0x7f941c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f941b7fe700 1 -- 172.21.15.6:0/3276648518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c0f91d0 msgr2=0x7f941c10e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f941b7fe700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c0f91d0 0x7f941c10e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f941b7fe700 1 -- 172.21.15.6:0/3276648518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f940c005040 con 0x7f941c0f8900 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f941b7fe700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 0x7f941c10e060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f940c005010 tx=0x7f940c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f9418ff9700 1 -- 172.21.15.6:0/3276648518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940c00e030 con 0x7f941c0f8900 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f9418ff9700 1 -- 172.21.15.6:0/3276648518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f940c007e90 con 0x7f941c0f8900 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.523+0000 7f9418ff9700 1 -- 172.21.15.6:0/3276648518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f940c018070 con 0x7f941c0f8900 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.524+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f941c1082c0 con 0x7f941c0f8900 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.524+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f941c1087a0 con 0x7f941c0f8900 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.525+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f941c060370 con 0x7f941c0f8900 2024-03-12T16:21:53.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.525+0000 7f9418ff9700 1 -- 172.21.15.6:0/3276648518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f940c01d6e0 con 0x7f941c0f8900 2024-03-12T16:21:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.526+0000 7f9418ff9700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f940406ca30 0x7f940406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.526+0000 7f9418ff9700 1 -- 172.21.15.6:0/3276648518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f940c08d040 con 0x7f941c0f8900 2024-03-12T16:21:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.526+0000 7f941affd700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f940406ca30 0x7f940406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:53.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.526+0000 7f941affd700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f940406ca30 0x7f940406eef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f941c1099a0 tx=0x7f9410009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:53.532 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.530+0000 7f9418ff9700 1 -- 172.21.15.6:0/3276648518 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f940c05a910 con 0x7f941c0f8900 2024-03-12T16:21:53.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.745+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f941c0fee70 con 0x7f940406ca30 2024-03-12T16:21:53.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.746+0000 7f9418ff9700 1 -- 172.21.15.6:0/3276648518 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f941c0fee70 con 0x7f940406ca30 2024-03-12T16:21:53.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.748+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f940406ca30 msgr2=0x7f940406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.748+0000 7f9422080700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f940406ca30 0x7f940406eef0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 rx=0x7f941c1099a0 tx=0x7f9410009d60).stop 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.748+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 msgr2=0x7f941c10e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.748+0000 7f9422080700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 0x7f941c10e060 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 rx=0x7f940c005010 tx=0x7f940c009cb0).stop 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.748+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 shutdown_connections 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.748+0000 7f9422080700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f940406ca30 0x7f940406eef0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.748+0000 7f9422080700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f941c0f8900 0x7f941c10e060 unknown :-1 s=CLOSED pgs=230 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.748+0000 7f9422080700 1 --2- 172.21.15.6:0/3276648518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f941c0f91d0 0x7f941c10e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.748+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 >> 172.21.15.6:0/3276648518 conn(0x7f941c0f23b0 msgr2=0x7f941c0fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.749+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 shutdown_connections 2024-03-12T16:21:53.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.749+0000 7f9422080700 1 -- 172.21.15.6:0/3276648518 wait complete. 2024-03-12T16:21:53.761 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:21:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.851+0000 7f56d20ae700 1 -- 172.21.15.6:0/1152018324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 msgr2=0x7f56cc103d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.851+0000 7f56d20ae700 1 --2- 172.21.15.6:0/1152018324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 0x7f56cc103d60 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 rx=0x7f56c0004820 tx=0x7f56c0009cb0).stop 2024-03-12T16:21:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.851+0000 7f56d20ae700 1 -- 172.21.15.6:0/1152018324 shutdown_connections 2024-03-12T16:21:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.851+0000 7f56d20ae700 1 --2- 172.21.15.6:0/1152018324 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 0x7f56cc103d60 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.851+0000 7f56d20ae700 1 --2- 172.21.15.6:0/1152018324 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0f66f0 0x7f56cc0f6ad0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.851+0000 7f56d20ae700 1 -- 172.21.15.6:0/1152018324 >> 172.21.15.6:0/1152018324 conn(0x7f56cc070590 msgr2=0x7f56cc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.851+0000 7f56d20ae700 1 -- 172.21.15.6:0/1152018324 shutdown_connections 2024-03-12T16:21:53.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.851+0000 7f56d20ae700 1 -- 172.21.15.6:0/1152018324 wait complete. 2024-03-12T16:21:53.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.852+0000 7f56d20ae700 1 Processor -- start 2024-03-12T16:21:53.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.852+0000 7f56d20ae700 1 -- start start 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.852+0000 7f56d20ae700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0f66f0 0x7f56cc110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.852+0000 7f56d20ae700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 0x7f56cc110770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.852+0000 7f56d20ae700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc110d70 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.852+0000 7f56d20ae700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f56cc110eb0 con 0x7f56cc0f66f0 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56caffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 0x7f56cc110770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56caffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 0x7f56cc110770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42300/0 (socket says 172.21.15.6:42300) 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56caffd700 1 -- 172.21.15.6:0/1269946513 learned_addr learned my addr 172.21.15.6:0/1269946513 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56cb7fe700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0f66f0 0x7f56cc110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56caffd700 1 -- 172.21.15.6:0/1269946513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0f66f0 msgr2=0x7f56cc110280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56caffd700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0f66f0 0x7f56cc110280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56caffd700 1 -- 172.21.15.6:0/1269946513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f56c0005040 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56caffd700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 0x7f56cc110770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f56c0013560 tx=0x7f56c0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56c8ff9700 1 -- 172.21.15.6:0/1269946513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c000e030 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56c8ff9700 1 -- 172.21.15.6:0/1269946513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f56c0007e90 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f56cc10a550 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56c8ff9700 1 -- 172.21.15.6:0/1269946513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f56c0018070 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.853+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f56cc10aa30 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.854+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f56cc05f590 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.855+0000 7f56c8ff9700 1 -- 172.21.15.6:0/1269946513 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f56c001da60 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.855+0000 7f56c8ff9700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f56b406ca40 0x7f56b406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.855+0000 7f56c8ff9700 1 -- 172.21.15.6:0/1269946513 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f56c008d200 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.855+0000 7f56cb7fe700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f56b406ca40 0x7f56b406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:53.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.856+0000 7f56cb7fe700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f56b406ca40 0x7f56b406ef00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f56bc0041d0 tx=0x7f56bc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:53.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:53.860+0000 7f56c8ff9700 1 -- 172.21.15.6:0/1269946513 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f56c005ad60 con 0x7f56cc0f6fc0 2024-03-12T16:21:53.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:53 smithi134 ceph-mon[85099]: pgmap v259: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:53.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:53 smithi006 ceph-mon[103869]: pgmap v259: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:54.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.076+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f56cc106890 con 0x7f56b406ca40 2024-03-12T16:21:54.079 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.077+0000 7f56c8ff9700 1 -- 172.21.15.6:0/1269946513 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f56cc106890 con 0x7f56b406ca40 2024-03-12T16:21:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f56b406ca40 msgr2=0x7f56b406ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f56b406ca40 0x7f56b406ef00 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 rx=0x7f56bc0041d0 tx=0x7f56bc009040).stop 2024-03-12T16:21:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 msgr2=0x7f56cc110770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 0x7f56cc110770 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 rx=0x7f56c0013560 tx=0x7f56c0009cb0).stop 2024-03-12T16:21:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 shutdown_connections 2024-03-12T16:21:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f56cc0f66f0 0x7f56cc110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f56b406ca40 0x7f56b406ef00 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 --2- 172.21.15.6:0/1269946513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f56cc0f6fc0 0x7f56cc110770 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 >> 172.21.15.6:0/1269946513 conn(0x7f56cc070590 msgr2=0x7f56cc06d940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:54.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 shutdown_connections 2024-03-12T16:21:54.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.080+0000 7f56d20ae700 1 -- 172.21.15.6:0/1269946513 wait complete. 2024-03-12T16:21:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.182+0000 7f8685d90700 1 -- 172.21.15.6:0/308723348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 msgr2=0x7f86800fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.182+0000 7f8685d90700 1 --2- 172.21.15.6:0/308723348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 0x7f86800fcbd0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 rx=0x7f86700047f0 tx=0x7f8670009cb0).stop 2024-03-12T16:21:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.182+0000 7f8685d90700 1 -- 172.21.15.6:0/308723348 shutdown_connections 2024-03-12T16:21:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.182+0000 7f8685d90700 1 --2- 172.21.15.6:0/308723348 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86800fd150 0x7f86800f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.182+0000 7f8685d90700 1 --2- 172.21.15.6:0/308723348 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 0x7f86800fcbd0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.182+0000 7f8685d90700 1 -- 172.21.15.6:0/308723348 >> 172.21.15.6:0/308723348 conn(0x7f8680070590 msgr2=0x7f86800f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.182+0000 7f8685d90700 1 -- 172.21.15.6:0/308723348 shutdown_connections 2024-03-12T16:21:54.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.182+0000 7f8685d90700 1 -- 172.21.15.6:0/308723348 wait complete. 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.183+0000 7f8685d90700 1 Processor -- start 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.183+0000 7f8685d90700 1 -- start start 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.183+0000 7f8685d90700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 0x7f868010cf30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.183+0000 7f8685d90700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86800fd150 0x7f868010d420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.183+0000 7f8685d90700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868010da20 con 0x7f86800fc7f0 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.183+0000 7f8685d90700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f868010db60 con 0x7f86800fd150 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.183+0000 7f867f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 0x7f868010cf30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.183+0000 7f867f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 0x7f868010cf30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42322/0 (socket says 172.21.15.6:42322) 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.183+0000 7f867f7fe700 1 -- 172.21.15.6:0/2317272400 learned_addr learned my addr 172.21.15.6:0/2317272400 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f867effd700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86800fd150 0x7f868010d420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f867f7fe700 1 -- 172.21.15.6:0/2317272400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86800fd150 msgr2=0x7f868010d420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f867f7fe700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86800fd150 0x7f868010d420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f867f7fe700 1 -- 172.21.15.6:0/2317272400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8670005040 con 0x7f86800fc7f0 2024-03-12T16:21:54.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f867f7fe700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 0x7f868010cf30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f8670005010 tx=0x7f8670009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f867cff9700 1 -- 172.21.15.6:0/2317272400 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f867000e030 con 0x7f86800fc7f0 2024-03-12T16:21:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f867cff9700 1 -- 172.21.15.6:0/2317272400 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8670007e90 con 0x7f86800fc7f0 2024-03-12T16:21:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f867cff9700 1 -- 172.21.15.6:0/2317272400 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8670018070 con 0x7f86800fc7f0 2024-03-12T16:21:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8680107190 con 0x7f86800fc7f0 2024-03-12T16:21:54.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.184+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f86801076f0 con 0x7f86800fc7f0 2024-03-12T16:21:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.185+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f868005f590 con 0x7f86800fc7f0 2024-03-12T16:21:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.185+0000 7f867cff9700 1 -- 172.21.15.6:0/2317272400 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f867001d6e0 con 0x7f86800fc7f0 2024-03-12T16:21:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.186+0000 7f867cff9700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f866c06ca30 0x7f866c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.186+0000 7f867cff9700 1 -- 172.21.15.6:0/2317272400 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f867008d040 con 0x7f86800fc7f0 2024-03-12T16:21:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.186+0000 7f867effd700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f866c06ca30 0x7f866c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:54.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.186+0000 7f867effd700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f866c06ca30 0x7f866c06eef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f8680108870 tx=0x7f8668009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:54.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.190+0000 7f867cff9700 1 -- 172.21.15.6:0/2317272400 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f867005a910 con 0x7f86800fc7f0 2024-03-12T16:21:54.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.396+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f86800feb40 con 0x7f866c06ca30 2024-03-12T16:21:54.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.406+0000 7f867cff9700 1 -- 172.21.15.6:0/2317272400 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f86800feb40 con 0x7f866c06ca30 2024-03-12T16:21:54.408 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:21:54.408 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (8m) 2m ago 19m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (6m) 2m ago 19m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (6m) 119s ago 19m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (8m) 2m ago 19m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (2m) 2m ago 14m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (2m) 2m ago 14m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (2m) 119s ago 14m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (2m) 119s ago 14m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (10m) 2m ago 21m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (9m) 119s ago 19m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (7m) 2m ago 21m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (7m) 119s ago 18m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (9m) 2m ago 19m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (9m) 119s ago 18m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:21:54.409 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (6m) 2m ago 18m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:21:54.410 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (5m) 2m ago 17m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:21:54.410 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (4m) 2m ago 17m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:21:54.410 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (4m) 119s ago 16m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:21:54.410 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (3m) 119s ago 16m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:21:54.410 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (3m) 119s ago 16m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:21:54.410 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (8m) 119s ago 17m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.408+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f866c06ca30 msgr2=0x7f866c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.408+0000 7f8685d90700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f866c06ca30 0x7f866c06eef0 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 rx=0x7f8680108870 tx=0x7f8668009da0).stop 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.408+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 msgr2=0x7f868010cf30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.408+0000 7f8685d90700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 0x7f868010cf30 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 rx=0x7f8670005010 tx=0x7f8670009cb0).stop 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.408+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 shutdown_connections 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.408+0000 7f8685d90700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f866c06ca30 0x7f866c06eef0 unknown :-1 s=CLOSED pgs=125 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.408+0000 7f8685d90700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f86800fc7f0 0x7f868010cf30 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.408+0000 7f8685d90700 1 --2- 172.21.15.6:0/2317272400 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f86800fd150 0x7f868010d420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.409+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 >> 172.21.15.6:0/2317272400 conn(0x7f8680070590 msgr2=0x7f86800fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.409+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 shutdown_connections 2024-03-12T16:21:54.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.409+0000 7f8685d90700 1 -- 172.21.15.6:0/2317272400 wait complete. 2024-03-12T16:21:54.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.510+0000 7f87e68fb700 1 -- 172.21.15.6:0/4091860597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fd8f0 msgr2=0x7f87e00fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.510+0000 7f87e68fb700 1 --2- 172.21.15.6:0/4091860597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fd8f0 0x7f87e00fdcd0 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f87d00047f0 tx=0x7f87d0009cb0).stop 2024-03-12T16:21:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.510+0000 7f87e68fb700 1 -- 172.21.15.6:0/4091860597 shutdown_connections 2024-03-12T16:21:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.510+0000 7f87e68fb700 1 --2- 172.21.15.6:0/4091860597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e00fe250 0x7f87e00f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.510+0000 7f87e68fb700 1 --2- 172.21.15.6:0/4091860597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fd8f0 0x7f87e00fdcd0 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.510+0000 7f87e68fb700 1 -- 172.21.15.6:0/4091860597 >> 172.21.15.6:0/4091860597 conn(0x7f87e00f34b0 msgr2=0x7f87e00f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.510+0000 7f87e68fb700 1 -- 172.21.15.6:0/4091860597 shutdown_connections 2024-03-12T16:21:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.510+0000 7f87e68fb700 1 -- 172.21.15.6:0/4091860597 wait complete. 2024-03-12T16:21:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87e68fb700 1 Processor -- start 2024-03-12T16:21:54.513 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87e68fb700 1 -- start start 2024-03-12T16:21:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87e68fb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e00fd8f0 0x7f87e01101f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87e68fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fe250 0x7f87e01106e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87e68fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0110ce0 con 0x7f87e00fe250 2024-03-12T16:21:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87e68fb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f87e0110e20 con 0x7f87e00fd8f0 2024-03-12T16:21:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fe250 0x7f87e01106e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87df7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fe250 0x7f87e01106e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42348/0 (socket says 172.21.15.6:42348) 2024-03-12T16:21:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87df7fe700 1 -- 172.21.15.6:0/3235248650 learned_addr learned my addr 172.21.15.6:0/3235248650 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:54.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87dffff700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e00fd8f0 0x7f87e01101f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87df7fe700 1 -- 172.21.15.6:0/3235248650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e00fd8f0 msgr2=0x7f87e01101f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87df7fe700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e00fd8f0 0x7f87e01101f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87df7fe700 1 -- 172.21.15.6:0/3235248650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f87d0005040 con 0x7f87e00fe250 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.511+0000 7f87dffff700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e00fd8f0 0x7f87e01101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.512+0000 7f87df7fe700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fe250 0x7f87e01106e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f87d4002780 tx=0x7f87d4009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.512+0000 7f87dd7fa700 1 -- 172.21.15.6:0/3235248650 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87d4007b40 con 0x7f87e00fe250 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.512+0000 7f87dd7fa700 1 -- 172.21.15.6:0/3235248650 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f87d400f040 con 0x7f87e00fe250 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.512+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f87e010a500 con 0x7f87e00fe250 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.512+0000 7f87dd7fa700 1 -- 172.21.15.6:0/3235248650 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f87d4014780 con 0x7f87e00fe250 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.512+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f87e010aac0 con 0x7f87e00fe250 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.513+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f87e005f590 con 0x7f87e00fe250 2024-03-12T16:21:54.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.513+0000 7f87dd7fa700 1 -- 172.21.15.6:0/3235248650 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f87d4007ca0 con 0x7f87e00fe250 2024-03-12T16:21:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.514+0000 7f87dd7fa700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f87c806caa0 0x7f87c806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.514+0000 7f87dd7fa700 1 -- 172.21.15.6:0/3235248650 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f87d408bc30 con 0x7f87e00fe250 2024-03-12T16:21:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.514+0000 7f87dffff700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f87c806caa0 0x7f87c806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:54.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.514+0000 7f87dffff700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f87c806caa0 0x7f87c806ef60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f87d0004540 tx=0x7f87d000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:54.520 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.518+0000 7f87dd7fa700 1 -- 172.21.15.6:0/3235248650 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f87d4059790 con 0x7f87e00fe250 2024-03-12T16:21:54.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.797+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f87e0047540 con 0x7f87e00fe250 2024-03-12T16:21:54.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.797+0000 7f87dd7fa700 1 -- 172.21.15.6:0/3235248650 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f87d4059320 con 0x7f87e00fe250 2024-03-12T16:21:54.799 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:21:54.799 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:21:54.800 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:21:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:21:54.801 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:21:54.801 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:21:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f87c806caa0 msgr2=0x7f87c806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f87c806caa0 0x7f87c806ef60 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 rx=0x7f87d0004540 tx=0x7f87d000b040).stop 2024-03-12T16:21:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fe250 msgr2=0x7f87e01106e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fe250 0x7f87e01106e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f87d4002780 tx=0x7f87d4009ee0).stop 2024-03-12T16:21:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 shutdown_connections 2024-03-12T16:21:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f87e00fd8f0 0x7f87e01101f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f87c806caa0 0x7f87c806ef60 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 --2- 172.21.15.6:0/3235248650 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f87e00fe250 0x7f87e01106e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 >> 172.21.15.6:0/3235248650 conn(0x7f87e00f34b0 msgr2=0x7f87e006b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 shutdown_connections 2024-03-12T16:21:54.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.799+0000 7f87e68fb700 1 -- 172.21.15.6:0/3235248650 wait complete. 2024-03-12T16:21:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.901+0000 7f4adfb2b700 1 -- 172.21.15.6:0/565644328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 msgr2=0x7f4ad80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.901+0000 7f4adfb2b700 1 --2- 172.21.15.6:0/565644328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 0x7f4ad80f6930 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7f4acc0047f0 tx=0x7f4acc009cb0).stop 2024-03-12T16:21:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.901+0000 7f4adfb2b700 1 -- 172.21.15.6:0/565644328 shutdown_connections 2024-03-12T16:21:54.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.901+0000 7f4adfb2b700 1 --2- 172.21.15.6:0/565644328 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 0x7f4ad80f6930 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.901+0000 7f4adfb2b700 1 --2- 172.21.15.6:0/565644328 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ad80fc7f0 0x7f4ad80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.901+0000 7f4adfb2b700 1 -- 172.21.15.6:0/565644328 >> 172.21.15.6:0/565644328 conn(0x7f4ad8070590 msgr2=0x7f4ad80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.902+0000 7f4adfb2b700 1 -- 172.21.15.6:0/565644328 shutdown_connections 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.902+0000 7f4adfb2b700 1 -- 172.21.15.6:0/565644328 wait complete. 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.902+0000 7f4adfb2b700 1 Processor -- start 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.902+0000 7f4adfb2b700 1 -- start start 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.902+0000 7f4adfb2b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ad80fc7f0 0x7f4ad810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.902+0000 7f4adfb2b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 0x7f4ad810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.902+0000 7f4adfb2b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad810ead0 con 0x7f4ad80fd150 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.902+0000 7f4adfb2b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4ad810ec10 con 0x7f4ad80fc7f0 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4add0c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 0x7f4ad810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4add0c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 0x7f4ad810e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42366/0 (socket says 172.21.15.6:42366) 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4add0c6700 1 -- 172.21.15.6:0/2558764960 learned_addr learned my addr 172.21.15.6:0/2558764960 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:54.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4add8c7700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ad80fc7f0 0x7f4ad810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4add0c6700 1 -- 172.21.15.6:0/2558764960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ad80fc7f0 msgr2=0x7f4ad810dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4add0c6700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ad80fc7f0 0x7f4ad810dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4add0c6700 1 -- 172.21.15.6:0/2558764960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4acc005040 con 0x7f4ad80fd150 2024-03-12T16:21:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4add0c6700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 0x7f4ad810e4d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4acc0099f0 tx=0x7f4acc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4acaffd700 1 -- 172.21.15.6:0/2558764960 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4acc00e030 con 0x7f4ad80fd150 2024-03-12T16:21:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4acaffd700 1 -- 172.21.15.6:0/2558764960 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4acc007e90 con 0x7f4ad80fd150 2024-03-12T16:21:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4ad8108240 con 0x7f4ad80fd150 2024-03-12T16:21:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4acaffd700 1 -- 172.21.15.6:0/2558764960 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4acc018070 con 0x7f4ad80fd150 2024-03-12T16:21:54.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.903+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4ad81087a0 con 0x7f4ad80fd150 2024-03-12T16:21:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.904+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4ad805f590 con 0x7f4ad80fd150 2024-03-12T16:21:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.905+0000 7f4acaffd700 1 -- 172.21.15.6:0/2558764960 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f4acc0094c0 con 0x7f4ad80fd150 2024-03-12T16:21:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.905+0000 7f4acaffd700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4ac406caa0 0x7f4ac406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.905+0000 7f4acaffd700 1 -- 172.21.15.6:0/2558764960 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4acc08d000 con 0x7f4ad80fd150 2024-03-12T16:21:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.905+0000 7f4add8c7700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4ac406caa0 0x7f4ac406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:54.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.906+0000 7f4add8c7700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4ac406caa0 0x7f4ac406ef60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4ad4004de0 tx=0x7f4ad400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:54.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:54.909+0000 7f4acaffd700 1 -- 172.21.15.6:0/2558764960 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4acc05ab60 con 0x7f4ad80fd150 2024-03-12T16:21:54.955 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:54 smithi134 ceph-mon[85099]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:54.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:54 smithi006 ceph-mon[103869]: from='client.34528 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:55.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.153+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4ad8047540 con 0x7f4ad80fd150 2024-03-12T16:21:55.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.153+0000 7f4acaffd700 1 -- 172.21.15.6:0/2558764960 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f4acc05a6f0 con 0x7f4ad80fd150 2024-03-12T16:21:55.158 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:21:55.159 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:21:55.160 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:21:55.161 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:21:55.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4ac406caa0 msgr2=0x7f4ac406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4ac406caa0 0x7f4ac406ef60 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 rx=0x7f4ad4004de0 tx=0x7f4ad400b040).stop 2024-03-12T16:21:55.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 msgr2=0x7f4ad810e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 0x7f4ad810e4d0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f4acc0099f0 tx=0x7f4acc009cb0).stop 2024-03-12T16:21:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 shutdown_connections 2024-03-12T16:21:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4ad80fc7f0 0x7f4ad810dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4ac406caa0 0x7f4ac406ef60 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 --2- 172.21.15.6:0/2558764960 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4ad80fd150 0x7f4ad810e4d0 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 >> 172.21.15.6:0/2558764960 conn(0x7f4ad8070590 msgr2=0x7f4ad8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 shutdown_connections 2024-03-12T16:21:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.156+0000 7f4adfb2b700 1 -- 172.21.15.6:0/2558764960 wait complete. 2024-03-12T16:21:55.163 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:21:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.258+0000 7f8b228bc700 1 -- 172.21.15.6:0/588670712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 msgr2=0x7f8b1c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.258+0000 7f8b228bc700 1 --2- 172.21.15.6:0/588670712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 0x7f8b1c0f6930 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7f8b100047f0 tx=0x7f8b10009cb0).stop 2024-03-12T16:21:55.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.258+0000 7f8b228bc700 1 -- 172.21.15.6:0/588670712 shutdown_connections 2024-03-12T16:21:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.258+0000 7f8b228bc700 1 --2- 172.21.15.6:0/588670712 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 0x7f8b1c0f6930 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.258+0000 7f8b228bc700 1 --2- 172.21.15.6:0/588670712 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c0fc7f0 0x7f8b1c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:21:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.258+0000 7f8b228bc700 1 -- 172.21.15.6:0/588670712 >> 172.21.15.6:0/588670712 conn(0x7f8b1c070590 msgr2=0x7f8b1c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.258+0000 7f8b228bc700 1 -- 172.21.15.6:0/588670712 shutdown_connections 2024-03-12T16:21:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.258+0000 7f8b228bc700 1 -- 172.21.15.6:0/588670712 wait complete. 2024-03-12T16:21:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.259+0000 7f8b228bc700 1 Processor -- start 2024-03-12T16:21:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.259+0000 7f8b228bc700 1 -- start start 2024-03-12T16:21:55.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.259+0000 7f8b228bc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c0fc7f0 0x7f8b1c10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.259+0000 7f8b228bc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 0x7f8b1c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.259+0000 7f8b228bc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c10ebe0 con 0x7f8b1c0fd150 2024-03-12T16:21:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.259+0000 7f8b228bc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b1c108200 con 0x7f8b1c0fc7f0 2024-03-12T16:21:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 0x7f8b1c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b1b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 0x7f8b1c10e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42380/0 (socket says 172.21.15.6:42380) 2024-03-12T16:21:55.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b1b7fe700 1 -- 172.21.15.6:0/2258552806 learned_addr learned my addr 172.21.15.6:0/2258552806 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b1bfff700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c0fc7f0 0x7f8b1c10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b1b7fe700 1 -- 172.21.15.6:0/2258552806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c0fc7f0 msgr2=0x7f8b1c10e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b1b7fe700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c0fc7f0 0x7f8b1c10e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b1b7fe700 1 -- 172.21.15.6:0/2258552806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b10005040 con 0x7f8b1c0fd150 2024-03-12T16:21:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b1b7fe700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 0x7f8b1c10e550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8b100099f0 tx=0x7f8b10009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:55.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b197fa700 1 -- 172.21.15.6:0/2258552806 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b1000e030 con 0x7f8b1c0fd150 2024-03-12T16:21:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b197fa700 1 -- 172.21.15.6:0/2258552806 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b10007e90 con 0x7f8b1c0fd150 2024-03-12T16:21:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b1c108450 con 0x7f8b1c0fd150 2024-03-12T16:21:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b197fa700 1 -- 172.21.15.6:0/2258552806 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b10018070 con 0x7f8b1c0fd150 2024-03-12T16:21:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.260+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b1c108930 con 0x7f8b1c0fd150 2024-03-12T16:21:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.261+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b1c05f590 con 0x7f8b1c0fd150 2024-03-12T16:21:55.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.262+0000 7f8b197fa700 1 -- 172.21.15.6:0/2258552806 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8b1001d420 con 0x7f8b1c0fd150 2024-03-12T16:21:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.262+0000 7f8b197fa700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b0406caa0 0x7f8b0406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.262+0000 7f8b197fa700 1 -- 172.21.15.6:0/2258552806 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8b1008d180 con 0x7f8b1c0fd150 2024-03-12T16:21:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.262+0000 7f8b1bfff700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b0406caa0 0x7f8b0406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:55.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.263+0000 7f8b1bfff700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b0406caa0 0x7f8b0406ef60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8b0c006fd0 tx=0x7f8b0c009060).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:55.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.267+0000 7f8b197fa700 1 -- 172.21.15.6:0/2258552806 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8b1005ace0 con 0x7f8b1c0fd150 2024-03-12T16:21:55.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.485+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8b1c1097a0 con 0x7f8b0406caa0 2024-03-12T16:21:55.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.486+0000 7f8b197fa700 1 -- 172.21.15.6:0/2258552806 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f8b1c1097a0 con 0x7f8b0406caa0 2024-03-12T16:21:55.488 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:21:55.488 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:21:55.489 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:21:55.489 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:21:55.489 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:21:55.489 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:21:55.489 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:21:55.489 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:21:55.490 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:21:55.490 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:21:55.490 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:21:55.490 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:21:55.490 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:21:55.490 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:21:55.491 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:21:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b0406caa0 msgr2=0x7f8b0406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b0406caa0 0x7f8b0406ef60 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 rx=0x7f8b0c006fd0 tx=0x7f8b0c009060).stop 2024-03-12T16:21:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 msgr2=0x7f8b1c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 0x7f8b1c10e550 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7f8b100099f0 tx=0x7f8b10009cb0).stop 2024-03-12T16:21:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 shutdown_connections 2024-03-12T16:21:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b1c0fc7f0 0x7f8b1c10e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b0406caa0 0x7f8b0406ef60 unknown :-1 s=CLOSED pgs=128 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 --2- 172.21.15.6:0/2258552806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b1c0fd150 0x7f8b1c10e550 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 >> 172.21.15.6:0/2258552806 conn(0x7f8b1c070590 msgr2=0x7f8b1c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:55.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 shutdown_connections 2024-03-12T16:21:55.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.488+0000 7f8b228bc700 1 -- 172.21.15.6:0/2258552806 wait complete. 2024-03-12T16:21:55.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.590+0000 7f277c2b8700 1 -- 172.21.15.6:0/1710577595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 msgr2=0x7f27740f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.590+0000 7f277c2b8700 1 --2- 172.21.15.6:0/1710577595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 0x7f27740f6930 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7f27680047f0 tx=0x7f2768009cb0).stop 2024-03-12T16:21:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.590+0000 7f277c2b8700 1 -- 172.21.15.6:0/1710577595 shutdown_connections 2024-03-12T16:21:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.590+0000 7f277c2b8700 1 --2- 172.21.15.6:0/1710577595 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 0x7f27740f6930 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.590+0000 7f277c2b8700 1 --2- 172.21.15.6:0/1710577595 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740fc7f0 0x7f27740fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.590+0000 7f277c2b8700 1 -- 172.21.15.6:0/1710577595 >> 172.21.15.6:0/1710577595 conn(0x7f2774070590 msgr2=0x7f27740f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.590+0000 7f277c2b8700 1 -- 172.21.15.6:0/1710577595 shutdown_connections 2024-03-12T16:21:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.590+0000 7f277c2b8700 1 -- 172.21.15.6:0/1710577595 wait complete. 2024-03-12T16:21:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f277c2b8700 1 Processor -- start 2024-03-12T16:21:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f277c2b8700 1 -- start start 2024-03-12T16:21:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f277c2b8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740fc7f0 0x7f277410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:55.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f277c2b8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 0x7f277410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f277c2b8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277410eab0 con 0x7f27740fd150 2024-03-12T16:21:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f277c2b8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f277410ebf0 con 0x7f27740fc7f0 2024-03-12T16:21:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f2779853700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 0x7f277410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f2779853700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 0x7f277410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42408/0 (socket says 172.21.15.6:42408) 2024-03-12T16:21:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f2779853700 1 -- 172.21.15.6:0/1069278316 learned_addr learned my addr 172.21.15.6:0/1069278316 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:21:55.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f277a054700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740fc7f0 0x7f277410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f2779853700 1 -- 172.21.15.6:0/1069278316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740fc7f0 msgr2=0x7f277410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f2779853700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740fc7f0 0x7f277410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f2779853700 1 -- 172.21.15.6:0/1069278316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2768005040 con 0x7f27740fd150 2024-03-12T16:21:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.591+0000 7f277a054700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740fc7f0 0x7f277410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:21:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.592+0000 7f2779853700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 0x7f277410e4b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f2768000c00 tx=0x7f2768009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:55.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.592+0000 7f2767779700 1 -- 172.21.15.6:0/1069278316 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f276800e030 con 0x7f27740fd150 2024-03-12T16:21:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.592+0000 7f2767779700 1 -- 172.21.15.6:0/1069278316 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2768007e90 con 0x7f27740fd150 2024-03-12T16:21:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.592+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2774108220 con 0x7f27740fd150 2024-03-12T16:21:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.592+0000 7f2767779700 1 -- 172.21.15.6:0/1069278316 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2768018070 con 0x7f27740fd150 2024-03-12T16:21:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.592+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2774108780 con 0x7f27740fd150 2024-03-12T16:21:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.593+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f277405f590 con 0x7f27740fd150 2024-03-12T16:21:55.602 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.593+0000 7f2767779700 1 -- 172.21.15.6:0/1069278316 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f276801d420 con 0x7f27740fd150 2024-03-12T16:21:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.594+0000 7f2767779700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276006cab0 0x7f276006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:21:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.594+0000 7f2767779700 1 -- 172.21.15.6:0/1069278316 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f276808d260 con 0x7f27740fd150 2024-03-12T16:21:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.594+0000 7f277a054700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276006cab0 0x7f276006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:21:55.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.594+0000 7f277a054700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276006cab0 0x7f276006ef70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f2770004ba0 tx=0x7f2770009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:21:55.604 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.598+0000 7f2767779700 1 -- 172.21.15.6:0/1069278316 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f276805ae80 con 0x7f27740fd150 2024-03-12T16:21:55.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.880+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2774047540 con 0x7f27740fd150 2024-03-12T16:21:55.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.881+0000 7f2767779700 1 -- 172.21.15.6:0/1069278316 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f276805aa10 con 0x7f27740fd150 2024-03-12T16:21:55.883 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:21:55.883 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:21:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:21:55.883 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:21:55.883 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:21:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276006cab0 msgr2=0x7f276006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276006cab0 0x7f276006ef70 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 rx=0x7f2770004ba0 tx=0x7f2770009040).stop 2024-03-12T16:21:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 msgr2=0x7f277410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:21:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 0x7f277410e4b0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7f2768000c00 tx=0x7f2768009cb0).stop 2024-03-12T16:21:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 shutdown_connections 2024-03-12T16:21:55.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27740fc7f0 0x7f277410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f276006cab0 0x7f276006ef70 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 --2- 172.21.15.6:0/1069278316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27740fd150 0x7f277410e4b0 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:21:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 >> 172.21.15.6:0/1069278316 conn(0x7f2774070590 msgr2=0x7f2774060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:21:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 shutdown_connections 2024-03-12T16:21:55.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:21:55.883+0000 7f277c2b8700 1 -- 172.21.15.6:0/1069278316 wait complete. 2024-03-12T16:21:55.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:55 smithi134 ceph-mon[85099]: pgmap v260: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:55.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:55 smithi134 ceph-mon[85099]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:55.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:55 smithi134 ceph-mon[85099]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:55.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:55 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3235248650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:21:55.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:55 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2558764960' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:21:55.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:55 smithi006 ceph-mon[103869]: pgmap v260: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:55.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:55 smithi006 ceph-mon[103869]: from='client.34532 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:55.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:55 smithi006 ceph-mon[103869]: from='client.34536 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:55.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:55 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3235248650' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:21:55.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:55 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2558764960' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:21:56.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:56 smithi134 ceph-mon[85099]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:56.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:56 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1069278316' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:21:56.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:56 smithi006 ceph-mon[103869]: from='client.34548 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:21:56.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:56 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1069278316' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:21:57.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:57 smithi134 ceph-mon[85099]: pgmap v261: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:57.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:57 smithi006 ceph-mon[103869]: pgmap v261: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:21:59 smithi134 ceph-mon[85099]: pgmap v262: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:21:59.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:21:59 smithi006 ceph-mon[103869]: pgmap v262: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:01 smithi134 ceph-mon[85099]: pgmap v263: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:01.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:01 smithi006 ceph-mon[103869]: pgmap v263: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:22:03.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:22:03.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:03 smithi006 ceph-mon[103869]: pgmap v264: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:04.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:03 smithi134 ceph-mon[85099]: pgmap v264: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:06.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:05 smithi134 ceph-mon[85099]: pgmap v265: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:06.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:05 smithi006 ceph-mon[103869]: pgmap v265: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:08.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:07 smithi134 ceph-mon[85099]: pgmap v266: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:08.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:07 smithi006 ceph-mon[103869]: pgmap v266: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:10.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:09 smithi134 ceph-mon[85099]: pgmap v267: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:10.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:09 smithi006 ceph-mon[103869]: pgmap v267: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:12.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:11 smithi134 ceph-mon[85099]: pgmap v268: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:12.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:11 smithi006 ceph-mon[103869]: pgmap v268: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:14.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:13 smithi134 ceph-mon[85099]: pgmap v269: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:14.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:13 smithi006 ceph-mon[103869]: pgmap v269: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:16.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:15 smithi134 ceph-mon[85099]: pgmap v270: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:16.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:15 smithi006 ceph-mon[103869]: pgmap v270: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:18.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:17 smithi134 ceph-mon[85099]: pgmap v271: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:18.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:22:18.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:17 smithi006 ceph-mon[103869]: pgmap v271: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:18.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:22:20.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:19 smithi134 ceph-mon[85099]: pgmap v272: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:20.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:19 smithi006 ceph-mon[103869]: pgmap v272: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:22.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:21 smithi134 ceph-mon[85099]: pgmap v273: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:22.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:21 smithi006 ceph-mon[103869]: pgmap v273: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:24.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:23 smithi134 ceph-mon[85099]: pgmap v274: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:24.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:23 smithi006 ceph-mon[103869]: pgmap v274: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:26.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.000+0000 7fc2975d7700 1 -- 172.21.15.6:0/2109524476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 msgr2=0x7fc2900fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.000+0000 7fc2975d7700 1 --2- 172.21.15.6:0/2109524476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 0x7fc2900fcbd0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7fc2800047f0 tx=0x7fc280009cb0).stop 2024-03-12T16:22:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.000+0000 7fc2975d7700 1 -- 172.21.15.6:0/2109524476 shutdown_connections 2024-03-12T16:22:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.000+0000 7fc2975d7700 1 --2- 172.21.15.6:0/2109524476 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2900fd150 0x7fc2900f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.000+0000 7fc2975d7700 1 --2- 172.21.15.6:0/2109524476 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 0x7fc2900fcbd0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.000+0000 7fc2975d7700 1 -- 172.21.15.6:0/2109524476 >> 172.21.15.6:0/2109524476 conn(0x7fc290070590 msgr2=0x7fc2900f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.000+0000 7fc2975d7700 1 -- 172.21.15.6:0/2109524476 shutdown_connections 2024-03-12T16:22:26.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.000+0000 7fc2975d7700 1 -- 172.21.15.6:0/2109524476 wait complete. 2024-03-12T16:22:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc2975d7700 1 Processor -- start 2024-03-12T16:22:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc2975d7700 1 -- start start 2024-03-12T16:22:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc2975d7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 0x7fc2900f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc2975d7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2900fd150 0x7fc2900f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc2975d7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900f8f20 con 0x7fc2900fc7f0 2024-03-12T16:22:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc2975d7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc2900f9060 con 0x7fc2900fd150 2024-03-12T16:22:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc295373700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 0x7fc2900f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc295373700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 0x7fc2900f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47434/0 (socket says 172.21.15.6:47434) 2024-03-12T16:22:26.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc295373700 1 -- 172.21.15.6:0/290491081 learned_addr learned my addr 172.21.15.6:0/290491081 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.001+0000 7fc294b72700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2900fd150 0x7fc2900f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc295373700 1 -- 172.21.15.6:0/290491081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2900fd150 msgr2=0x7fc2900f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc295373700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2900fd150 0x7fc2900f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc295373700 1 -- 172.21.15.6:0/290491081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc280005040 con 0x7fc2900fc7f0 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc294b72700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2900fd150 0x7fc2900f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc295373700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 0x7fc2900f8540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fc280009380 tx=0x7fc280009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc2867fc700 1 -- 172.21.15.6:0/290491081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc280018070 con 0x7fc2900fc7f0 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc2900f92e0 con 0x7fc2900fc7f0 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc2867fc700 1 -- 172.21.15.6:0/290491081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc280007e90 con 0x7fc2900fc7f0 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc2867fc700 1 -- 172.21.15.6:0/290491081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc2800123c0 con 0x7fc2900fc7f0 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.002+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc290114770 con 0x7fc2900fc7f0 2024-03-12T16:22:26.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.003+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc29005f590 con 0x7fc2900fc7f0 2024-03-12T16:22:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.003+0000 7fc2867fc700 1 -- 172.21.15.6:0/290491081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fc28001d420 con 0x7fc2900fc7f0 2024-03-12T16:22:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.004+0000 7fc2867fc700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc27c06caa0 0x7fc27c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.004+0000 7fc2867fc700 1 -- 172.21.15.6:0/290491081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc28008ca10 con 0x7fc2900fc7f0 2024-03-12T16:22:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.004+0000 7fc294b72700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc27c06caa0 0x7fc27c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.005+0000 7fc294b72700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc27c06caa0 0x7fc27c06ef60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fc28c007fd0 tx=0x7fc28c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:26.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.009+0000 7fc2867fc700 1 -- 172.21.15.6:0/290491081 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc280056ae0 con 0x7fc2900fc7f0 2024-03-12T16:22:26.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:25 smithi134 ceph-mon[85099]: pgmap v275: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:26.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:25 smithi006 ceph-mon[103869]: pgmap v275: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:26.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.225+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc2900fb5a0 con 0x7fc27c06caa0 2024-03-12T16:22:26.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.226+0000 7fc2867fc700 1 -- 172.21.15.6:0/290491081 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc2900fb5a0 con 0x7fc27c06caa0 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.228+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc27c06caa0 msgr2=0x7fc27c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.228+0000 7fc2975d7700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc27c06caa0 0x7fc27c06ef60 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 rx=0x7fc28c007fd0 tx=0x7fc28c00b040).stop 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.228+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 msgr2=0x7fc2900f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.228+0000 7fc2975d7700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 0x7fc2900f8540 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7fc280009380 tx=0x7fc280009cb0).stop 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.228+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 shutdown_connections 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.228+0000 7fc2975d7700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc27c06caa0 0x7fc27c06ef60 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.228+0000 7fc2975d7700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc2900fc7f0 0x7fc2900f8540 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.228+0000 7fc2975d7700 1 --2- 172.21.15.6:0/290491081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc2900fd150 0x7fc2900f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.228+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 >> 172.21.15.6:0/290491081 conn(0x7fc290070590 msgr2=0x7fc290060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.229+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 shutdown_connections 2024-03-12T16:22:26.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.229+0000 7fc2975d7700 1 -- 172.21.15.6:0/290491081 wait complete. 2024-03-12T16:22:26.240 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:22:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.331+0000 7f62e8dbd700 1 -- 172.21.15.6:0/845395982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 msgr2=0x7f62e40f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.331+0000 7f62e8dbd700 1 --2- 172.21.15.6:0/845395982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 0x7f62e40f7a30 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f62d80047f0 tx=0x7f62d8009cb0).stop 2024-03-12T16:22:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.332+0000 7f62e8dbd700 1 -- 172.21.15.6:0/845395982 shutdown_connections 2024-03-12T16:22:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.332+0000 7f62e8dbd700 1 --2- 172.21.15.6:0/845395982 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 0x7f62e40f7a30 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.332+0000 7f62e8dbd700 1 --2- 172.21.15.6:0/845395982 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40fd8f0 0x7f62e40fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.332+0000 7f62e8dbd700 1 -- 172.21.15.6:0/845395982 >> 172.21.15.6:0/845395982 conn(0x7f62e40f34b0 msgr2=0x7f62e40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.332+0000 7f62e8dbd700 1 -- 172.21.15.6:0/845395982 shutdown_connections 2024-03-12T16:22:26.333 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.332+0000 7f62e8dbd700 1 -- 172.21.15.6:0/845395982 wait complete. 2024-03-12T16:22:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.332+0000 7f62e8dbd700 1 Processor -- start 2024-03-12T16:22:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.332+0000 7f62e8dbd700 1 -- start start 2024-03-12T16:22:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e8dbd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40fd8f0 0x7f62e406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e8dbd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 0x7f62e406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e8dbd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e406bab0 con 0x7f62e40fe250 2024-03-12T16:22:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e8dbd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f62e406bbf0 con 0x7f62e40fd8f0 2024-03-12T16:22:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 0x7f62e406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e1d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 0x7f62e406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47456/0 (socket says 172.21.15.6:47456) 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e1d9b700 1 -- 172.21.15.6:0/1681526946 learned_addr learned my addr 172.21.15.6:0/1681526946 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e259c700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40fd8f0 0x7f62e406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e1d9b700 1 -- 172.21.15.6:0/1681526946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40fd8f0 msgr2=0x7f62e406b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e1d9b700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40fd8f0 0x7f62e406b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e1d9b700 1 -- 172.21.15.6:0/1681526946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f62d8005040 con 0x7f62e40fe250 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e1d9b700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 0x7f62e406b5c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f62d80099f0 tx=0x7f62d8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62d37fe700 1 -- 172.21.15.6:0/1681526946 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d800e030 con 0x7f62e40fe250 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f62e406be40 con 0x7f62e40fe250 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62d37fe700 1 -- 172.21.15.6:0/1681526946 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f62d8007e90 con 0x7f62e40fe250 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62d37fe700 1 -- 172.21.15.6:0/1681526946 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f62d8018070 con 0x7f62e40fe250 2024-03-12T16:22:26.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.333+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f62e4114690 con 0x7f62e40fe250 2024-03-12T16:22:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.335+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f62e405f590 con 0x7f62e40fe250 2024-03-12T16:22:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.335+0000 7f62d37fe700 1 -- 172.21.15.6:0/1681526946 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f62d8009590 con 0x7f62e40fe250 2024-03-12T16:22:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.335+0000 7f62d37fe700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f62cc06ca30 0x7f62cc06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.336+0000 7f62d37fe700 1 -- 172.21.15.6:0/1681526946 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f62d808d0f0 con 0x7f62e40fe250 2024-03-12T16:22:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.336+0000 7f62e259c700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f62cc06ca30 0x7f62cc06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.336+0000 7f62e259c700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f62cc06ca30 0x7f62cc06eef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f62d4009170 tx=0x7f62d4009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:26.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.340+0000 7f62d37fe700 1 -- 172.21.15.6:0/1681526946 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f62d8057100 con 0x7f62e40fe250 2024-03-12T16:22:26.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.557+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f62e4059120 con 0x7f62cc06ca30 2024-03-12T16:22:26.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.558+0000 7f62d37fe700 1 -- 172.21.15.6:0/1681526946 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f62e4059120 con 0x7f62cc06ca30 2024-03-12T16:22:26.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f62cc06ca30 msgr2=0x7f62cc06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f62cc06ca30 0x7f62cc06eef0 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 rx=0x7f62d4009170 tx=0x7f62d4009d60).stop 2024-03-12T16:22:26.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 msgr2=0x7f62e406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 0x7f62e406b5c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f62d80099f0 tx=0x7f62d8009cb0).stop 2024-03-12T16:22:26.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 shutdown_connections 2024-03-12T16:22:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f62e40fd8f0 0x7f62e406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f62cc06ca30 0x7f62cc06eef0 unknown :-1 s=CLOSED pgs=131 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 --2- 172.21.15.6:0/1681526946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f62e40fe250 0x7f62e406b5c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 >> 172.21.15.6:0/1681526946 conn(0x7f62e40f34b0 msgr2=0x7f62e40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 shutdown_connections 2024-03-12T16:22:26.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.560+0000 7f62e8dbd700 1 -- 172.21.15.6:0/1681526946 wait complete. 2024-03-12T16:22:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.661+0000 7fb74519c700 1 -- 172.21.15.6:0/1493778944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fc7f0 msgr2=0x7fb7400fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.661+0000 7fb74519c700 1 --2- 172.21.15.6:0/1493778944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fc7f0 0x7fb7400fcbd0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7fb7340047f0 tx=0x7fb734009cb0).stop 2024-03-12T16:22:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.662+0000 7fb74519c700 1 -- 172.21.15.6:0/1493778944 shutdown_connections 2024-03-12T16:22:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.662+0000 7fb74519c700 1 --2- 172.21.15.6:0/1493778944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7400fd150 0x7fb7400f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:22:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.662+0000 7fb74519c700 1 --2- 172.21.15.6:0/1493778944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fc7f0 0x7fb7400fcbd0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.662+0000 7fb74519c700 1 -- 172.21.15.6:0/1493778944 >> 172.21.15.6:0/1493778944 conn(0x7fb740070590 msgr2=0x7fb7400f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.662+0000 7fb74519c700 1 -- 172.21.15.6:0/1493778944 shutdown_connections 2024-03-12T16:22:26.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.662+0000 7fb74519c700 1 -- 172.21.15.6:0/1493778944 wait complete. 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.662+0000 7fb74519c700 1 Processor -- start 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb74519c700 1 -- start start 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb74519c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7400fc7f0 0x7fb74010e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb74519c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fd150 0x7fb74010e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb74519c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb74010ebe0 con 0x7fb7400fd150 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb74519c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb740108200 con 0x7fb7400fc7f0 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb73e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fd150 0x7fb74010e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb73ed9d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7400fc7f0 0x7fb74010e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb73e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fd150 0x7fb74010e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47474/0 (socket says 172.21.15.6:47474) 2024-03-12T16:22:26.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb73e59c700 1 -- 172.21.15.6:0/220641075 learned_addr learned my addr 172.21.15.6:0/220641075 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb73e59c700 1 -- 172.21.15.6:0/220641075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7400fc7f0 msgr2=0x7fb74010e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb73e59c700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7400fc7f0 0x7fb74010e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.663+0000 7fb73e59c700 1 -- 172.21.15.6:0/220641075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb734005040 con 0x7fb7400fd150 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.664+0000 7fb73e59c700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fd150 0x7fb74010e550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fb73000b480 tx=0x7fb7300090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.664+0000 7fb727fff700 1 -- 172.21.15.6:0/220641075 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb730002500 con 0x7fb7400fd150 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.664+0000 7fb727fff700 1 -- 172.21.15.6:0/220641075 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb730002b10 con 0x7fb7400fd150 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.664+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7401084b0 con 0x7fb7400fd150 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.664+0000 7fb727fff700 1 -- 172.21.15.6:0/220641075 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb730012c60 con 0x7fb7400fd150 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.664+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7401089f0 con 0x7fb7400fd150 2024-03-12T16:22:26.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.665+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb74005f590 con 0x7fb7400fd150 2024-03-12T16:22:26.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.666+0000 7fb727fff700 1 -- 172.21.15.6:0/220641075 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb730002660 con 0x7fb7400fd150 2024-03-12T16:22:26.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.666+0000 7fb727fff700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb72806caa0 0x7fb72806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.666+0000 7fb727fff700 1 -- 172.21.15.6:0/220641075 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb73008bd90 con 0x7fb7400fd150 2024-03-12T16:22:26.667 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.666+0000 7fb73ed9d700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb72806caa0 0x7fb72806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.667+0000 7fb73ed9d700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb72806caa0 0x7fb72806ef60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb734007cf0 tx=0x7fb73400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:26.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.670+0000 7fb727fff700 1 -- 172.21.15.6:0/220641075 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb7300598f0 con 0x7fb7400fd150 2024-03-12T16:22:26.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.876+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fb7401096e0 con 0x7fb72806caa0 2024-03-12T16:22:26.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.886+0000 7fb727fff700 1 -- 172.21.15.6:0/220641075 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fb7401096e0 con 0x7fb72806caa0 2024-03-12T16:22:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:22:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (9m) 3m ago 20m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:22:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (7m) 3m ago 20m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:22:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (6m) 2m ago 19m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:22:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (8m) 3m ago 19m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:22:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (3m) 3m ago 15m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:22:26.888 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (3m) 3m ago 14m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:22:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (2m) 2m ago 14m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:22:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (2m) 2m ago 14m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:22:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (10m) 3m ago 21m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:22:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (10m) 2m ago 19m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:22:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (8m) 3m ago 21m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:22:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (7m) 2m ago 19m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:22:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (9m) 3m ago 19m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:22:26.889 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (9m) 2m ago 19m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:22:26.890 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (6m) 3m ago 18m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:22:26.890 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (6m) 3m ago 18m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:22:26.890 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (5m) 3m ago 18m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:22:26.890 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (4m) 2m ago 17m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:22:26.890 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (4m) 2m ago 17m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:22:26.891 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (3m) 2m ago 16m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:22:26.891 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (9m) 2m ago 18m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:22:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.888+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb72806caa0 msgr2=0x7fb72806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.888+0000 7fb74519c700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb72806caa0 0x7fb72806ef60 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 rx=0x7fb734007cf0 tx=0x7fb73400b040).stop 2024-03-12T16:22:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.888+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fd150 msgr2=0x7fb74010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.888+0000 7fb74519c700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fd150 0x7fb74010e550 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7fb73000b480 tx=0x7fb7300090f0).stop 2024-03-12T16:22:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.888+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 shutdown_connections 2024-03-12T16:22:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.888+0000 7fb74519c700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7400fc7f0 0x7fb74010e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.888+0000 7fb74519c700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb72806caa0 0x7fb72806ef60 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.888+0000 7fb74519c700 1 --2- 172.21.15.6:0/220641075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7400fd150 0x7fb74010e550 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.888+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 >> 172.21.15.6:0/220641075 conn(0x7fb740070590 msgr2=0x7fb740060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.889+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 shutdown_connections 2024-03-12T16:22:26.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.889+0000 7fb74519c700 1 -- 172.21.15.6:0/220641075 wait complete. 2024-03-12T16:22:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.989+0000 7fbce5bc8700 1 -- 172.21.15.6:0/2220466299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fd8f0 msgr2=0x7fbce00fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.989+0000 7fbce5bc8700 1 --2- 172.21.15.6:0/2220466299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fd8f0 0x7fbce00fdcd0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7fbcd00047f0 tx=0x7fbcd0009cb0).stop 2024-03-12T16:22:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.989+0000 7fbce5bc8700 1 -- 172.21.15.6:0/2220466299 shutdown_connections 2024-03-12T16:22:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.989+0000 7fbce5bc8700 1 --2- 172.21.15.6:0/2220466299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce00fe250 0x7fbce00f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.989+0000 7fbce5bc8700 1 --2- 172.21.15.6:0/2220466299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fd8f0 0x7fbce00fdcd0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.989+0000 7fbce5bc8700 1 -- 172.21.15.6:0/2220466299 >> 172.21.15.6:0/2220466299 conn(0x7fbce00f34b0 msgr2=0x7fbce00f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.989+0000 7fbce5bc8700 1 -- 172.21.15.6:0/2220466299 shutdown_connections 2024-03-12T16:22:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.989+0000 7fbce5bc8700 1 -- 172.21.15.6:0/2220466299 wait complete. 2024-03-12T16:22:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.990+0000 7fbce5bc8700 1 Processor -- start 2024-03-12T16:22:26.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.990+0000 7fbce5bc8700 1 -- start start 2024-03-12T16:22:26.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbce5bc8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce00fd8f0 0x7fbce010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbce5bc8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fe250 0x7fbce010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbce5bc8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce010ead0 con 0x7fbce00fe250 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbce5bc8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce010ec10 con 0x7fbce00fd8f0 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbcdeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fe250 0x7fbce010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbcdeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fe250 0x7fbce010e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47496/0 (socket says 172.21.15.6:47496) 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbcdeffd700 1 -- 172.21.15.6:0/3652082582 learned_addr learned my addr 172.21.15.6:0/3652082582 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbcdf7fe700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce00fd8f0 0x7fbce010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbcdeffd700 1 -- 172.21.15.6:0/3652082582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce00fd8f0 msgr2=0x7fbce010dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbcdeffd700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce00fd8f0 0x7fbce010dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:26.994 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbcdeffd700 1 -- 172.21.15.6:0/3652082582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbcd0005040 con 0x7fbce00fe250 2024-03-12T16:22:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbcdeffd700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fe250 0x7fbce010e4d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fbcd400c790 tx=0x7fbcd4007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.991+0000 7fbcdcff9700 1 -- 172.21.15.6:0/3652082582 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcd400e680 con 0x7fbce00fe250 2024-03-12T16:22:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.992+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce01082a0 con 0x7fbce00fe250 2024-03-12T16:22:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.992+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce0108860 con 0x7fbce00fe250 2024-03-12T16:22:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.992+0000 7fbcdcff9700 1 -- 172.21.15.6:0/3652082582 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbcd400ec90 con 0x7fbce00fe250 2024-03-12T16:22:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.992+0000 7fbcdcff9700 1 -- 172.21.15.6:0/3652082582 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbcd4012c70 con 0x7fbce00fe250 2024-03-12T16:22:26.995 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.993+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbccc005150 con 0x7fbce00fe250 2024-03-12T16:22:26.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.993+0000 7fbcdcff9700 1 -- 172.21.15.6:0/3652082582 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fbcd4012400 con 0x7fbce00fe250 2024-03-12T16:22:26.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.994+0000 7fbcdcff9700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcc806caa0 0x7fbcc806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:26.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.994+0000 7fbcdcff9700 1 -- 172.21.15.6:0/3652082582 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbcd408b4e0 con 0x7fbce00fe250 2024-03-12T16:22:26.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.994+0000 7fbcdf7fe700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcc806caa0 0x7fbcc806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:26.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.994+0000 7fbcdf7fe700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcc806caa0 0x7fbcc806ef60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fbcd0007cf0 tx=0x7fbcd000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:26.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:26.998+0000 7fbcdcff9700 1 -- 172.21.15.6:0/3652082582 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbcd4059040 con 0x7fbce00fe250 2024-03-12T16:22:27.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.279+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fbccc006030 con 0x7fbce00fe250 2024-03-12T16:22:27.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.280+0000 7fbcdcff9700 1 -- 172.21.15.6:0/3652082582 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fbcd4058bd0 con 0x7fbce00fe250 2024-03-12T16:22:27.281 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:22:27.281 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:22:27.281 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:22:27.281 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:22:27.281 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:22:27.282 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:22:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcc806caa0 msgr2=0x7fbcc806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcc806caa0 0x7fbcc806ef60 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 rx=0x7fbcd0007cf0 tx=0x7fbcd000b040).stop 2024-03-12T16:22:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fe250 msgr2=0x7fbce010e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fe250 0x7fbce010e4d0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fbcd400c790 tx=0x7fbcd4007f70).stop 2024-03-12T16:22:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 shutdown_connections 2024-03-12T16:22:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce00fd8f0 0x7fbce010dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcc806caa0 0x7fbcc806ef60 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 --2- 172.21.15.6:0/3652082582 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce00fe250 0x7fbce010e4d0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 >> 172.21.15.6:0/3652082582 conn(0x7fbce00f34b0 msgr2=0x7fbce00fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:27.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 shutdown_connections 2024-03-12T16:22:27.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.282+0000 7fbce5bc8700 1 -- 172.21.15.6:0/3652082582 wait complete. 2024-03-12T16:22:27.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.384+0000 7fdc818b9700 1 -- 172.21.15.6:0/1262533285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fda50 msgr2=0x7fdc7c0fde30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.384+0000 7fdc818b9700 1 --2- 172.21.15.6:0/1262533285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fda50 0x7fdc7c0fde30 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7fdc700047f0 tx=0x7fdc70009cb0).stop 2024-03-12T16:22:27.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.384+0000 7fdc818b9700 1 -- 172.21.15.6:0/1262533285 shutdown_connections 2024-03-12T16:22:27.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.384+0000 7fdc818b9700 1 --2- 172.21.15.6:0/1262533285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc7c0fe3b0 0x7fdc7c0f5fa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.384+0000 7fdc818b9700 1 --2- 172.21.15.6:0/1262533285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fda50 0x7fdc7c0fde30 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.384+0000 7fdc818b9700 1 -- 172.21.15.6:0/1262533285 >> 172.21.15.6:0/1262533285 conn(0x7fdc7c06ce50 msgr2=0x7fdc7c06d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:27.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.384+0000 7fdc818b9700 1 -- 172.21.15.6:0/1262533285 shutdown_connections 2024-03-12T16:22:27.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.384+0000 7fdc818b9700 1 -- 172.21.15.6:0/1262533285 wait complete. 2024-03-12T16:22:27.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.384+0000 7fdc818b9700 1 Processor -- start 2024-03-12T16:22:27.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc818b9700 1 -- start start 2024-03-12T16:22:27.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc818b9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc7c0fda50 0x7fdc7c10e140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:27.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc818b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fe3b0 0x7fdc7c10e630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc818b9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c10ec30 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc818b9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7c10ed70 con 0x7fdc7c0fda50 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc7a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fe3b0 0x7fdc7c10e630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc7a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fe3b0 0x7fdc7c10e630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47508/0 (socket says 172.21.15.6:47508) 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc7a7fc700 1 -- 172.21.15.6:0/82303371 learned_addr learned my addr 172.21.15.6:0/82303371 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc7affd700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc7c0fda50 0x7fdc7c10e140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc7a7fc700 1 -- 172.21.15.6:0/82303371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc7c0fda50 msgr2=0x7fdc7c10e140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc7a7fc700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc7c0fda50 0x7fdc7c10e140 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc7a7fc700 1 -- 172.21.15.6:0/82303371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc70005040 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc7a7fc700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fe3b0 0x7fdc7c10e630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fdc6c00e8f0 tx=0x7fdc6c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.385+0000 7fdc63fff700 1 -- 172.21.15.6:0/82303371 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c007b40 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.386+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7c108400 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.389 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.386+0000 7fdc63fff700 1 -- 172.21.15.6:0/82303371 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc6c00f040 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.386+0000 7fdc63fff700 1 -- 172.21.15.6:0/82303371 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc6c014880 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.386+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc7c108940 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.386+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc7c047540 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.388+0000 7fdc63fff700 1 -- 172.21.15.6:0/82303371 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fdc6c009090 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.388+0000 7fdc63fff700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6406caa0 0x7fdc6406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.388+0000 7fdc63fff700 1 -- 172.21.15.6:0/82303371 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdc6c08c110 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.390 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.388+0000 7fdc7affd700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6406caa0 0x7fdc6406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:27.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.389+0000 7fdc7affd700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6406caa0 0x7fdc6406ef60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdc700047c0 tx=0x7fdc70009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:27.393 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.392+0000 7fdc63fff700 1 -- 172.21.15.6:0/82303371 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdc6c059d30 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.633+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fdc7c1097c0 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.633+0000 7fdc63fff700 1 -- 172.21.15.6:0/82303371 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fdc6c0598c0 con 0x7fdc7c0fe3b0 2024-03-12T16:22:27.634 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:22:27.634 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:22:27.635 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:22:27.636 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:22:27.637 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:22:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6406caa0 msgr2=0x7fdc6406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6406caa0 0x7fdc6406ef60 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 rx=0x7fdc700047c0 tx=0x7fdc70009cb0).stop 2024-03-12T16:22:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fe3b0 msgr2=0x7fdc7c10e630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fe3b0 0x7fdc7c10e630 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7fdc6c00e8f0 tx=0x7fdc6c00b040).stop 2024-03-12T16:22:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 shutdown_connections 2024-03-12T16:22:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc7c0fda50 0x7fdc7c10e140 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6406caa0 0x7fdc6406ef60 unknown :-1 s=CLOSED pgs=134 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.638 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 --2- 172.21.15.6:0/82303371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc7c0fe3b0 0x7fdc7c10e630 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 >> 172.21.15.6:0/82303371 conn(0x7fdc7c06ce50 msgr2=0x7fdc7c101060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 shutdown_connections 2024-03-12T16:22:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.635+0000 7fdc818b9700 1 -- 172.21.15.6:0/82303371 wait complete. 2024-03-12T16:22:27.639 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:22:27.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.738+0000 7f4297d61700 1 -- 172.21.15.6:0/2800053406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fc830 msgr2=0x7f42900fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.738+0000 7f4297d61700 1 --2- 172.21.15.6:0/2800053406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fc830 0x7f42900fcc10 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f428c0047f0 tx=0x7f428c009cb0).stop 2024-03-12T16:22:27.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.738+0000 7f4297d61700 1 -- 172.21.15.6:0/2800053406 shutdown_connections 2024-03-12T16:22:27.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.738+0000 7f4297d61700 1 --2- 172.21.15.6:0/2800053406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42900fd190 0x7f42900f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:22:27.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.738+0000 7f4297d61700 1 --2- 172.21.15.6:0/2800053406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fc830 0x7f42900fcc10 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.738+0000 7f4297d61700 1 -- 172.21.15.6:0/2800053406 >> 172.21.15.6:0/2800053406 conn(0x7f429006c760 msgr2=0x7f429006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:27.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.738+0000 7f4297d61700 1 -- 172.21.15.6:0/2800053406 shutdown_connections 2024-03-12T16:22:27.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.738+0000 7f4297d61700 1 -- 172.21.15.6:0/2800053406 wait complete. 2024-03-12T16:22:27.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f4297d61700 1 Processor -- start 2024-03-12T16:22:27.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f4297d61700 1 -- start start 2024-03-12T16:22:27.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f4297d61700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42900fc830 0x7f429010e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f4297d61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fd190 0x7f429010e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f4297d61700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f429010ebe0 con 0x7f42900fd190 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f4297d61700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4290108200 con 0x7f42900fc830 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f42952fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fd190 0x7f429010e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f42952fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fd190 0x7f429010e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47532/0 (socket says 172.21.15.6:47532) 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f42952fc700 1 -- 172.21.15.6:0/1009957814 learned_addr learned my addr 172.21.15.6:0/1009957814 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f4295afd700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42900fc830 0x7f429010e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f42952fc700 1 -- 172.21.15.6:0/1009957814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42900fc830 msgr2=0x7f429010e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f42952fc700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42900fc830 0x7f429010e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f42952fc700 1 -- 172.21.15.6:0/1009957814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f428c005040 con 0x7f42900fd190 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.739+0000 7f42952fc700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fd190 0x7f429010e550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f428000b480 tx=0x7f42800090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.740+0000 7f4286ffd700 1 -- 172.21.15.6:0/1009957814 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4280002500 con 0x7f42900fd190 2024-03-12T16:22:27.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.740+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42901084b0 con 0x7f42900fd190 2024-03-12T16:22:27.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.740+0000 7f4286ffd700 1 -- 172.21.15.6:0/1009957814 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4280002b10 con 0x7f42900fd190 2024-03-12T16:22:27.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.740+0000 7f4286ffd700 1 -- 172.21.15.6:0/1009957814 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4280012c60 con 0x7f42900fd190 2024-03-12T16:22:27.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.740+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42901089f0 con 0x7f42900fd190 2024-03-12T16:22:27.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.741+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f429005f570 con 0x7f42900fd190 2024-03-12T16:22:27.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.741+0000 7f4286ffd700 1 -- 172.21.15.6:0/1009957814 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f4280002660 con 0x7f42900fd190 2024-03-12T16:22:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.741+0000 7f4286ffd700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f427c06caa0 0x7f427c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.742+0000 7f4286ffd700 1 -- 172.21.15.6:0/1009957814 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f428008bd90 con 0x7f42900fd190 2024-03-12T16:22:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.742+0000 7f4295afd700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f427c06caa0 0x7f427c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:27.744 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.742+0000 7f4295afd700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f427c06caa0 0x7f427c06ef60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f428c007cf0 tx=0x7f428c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:27.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.746+0000 7f4286ffd700 1 -- 172.21.15.6:0/1009957814 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f42800598f0 con 0x7f42900fd190 2024-03-12T16:22:27.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.963+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42901036f0 con 0x7f427c06caa0 2024-03-12T16:22:27.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.964+0000 7f4286ffd700 1 -- 172.21.15.6:0/1009957814 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f428c019040 con 0x7f427c06caa0 2024-03-12T16:22:27.965 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:22:27.966 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:22:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f427c06caa0 msgr2=0x7f427c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f427c06caa0 0x7f427c06ef60 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 rx=0x7f428c007cf0 tx=0x7f428c00b040).stop 2024-03-12T16:22:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fd190 msgr2=0x7f429010e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fd190 0x7f429010e550 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f428000b480 tx=0x7f42800090f0).stop 2024-03-12T16:22:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 shutdown_connections 2024-03-12T16:22:27.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42900fc830 0x7f429010e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f427c06caa0 0x7f427c06ef60 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 --2- 172.21.15.6:0/1009957814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42900fd190 0x7f429010e550 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:27.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 >> 172.21.15.6:0/1009957814 conn(0x7f429006c760 msgr2=0x7f4290060d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:27.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 shutdown_connections 2024-03-12T16:22:27.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:27.967+0000 7f4297d61700 1 -- 172.21.15.6:0/1009957814 wait complete. 2024-03-12T16:22:28.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.068+0000 7f8113ca2700 1 -- 172.21.15.6:0/3238791362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 msgr2=0x7f810c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.068+0000 7f8113ca2700 1 --2- 172.21.15.6:0/3238791362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 0x7f810c0f6930 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f80fc0047f0 tx=0x7f80fc009cb0).stop 2024-03-12T16:22:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.068+0000 7f8113ca2700 1 -- 172.21.15.6:0/3238791362 shutdown_connections 2024-03-12T16:22:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.068+0000 7f8113ca2700 1 --2- 172.21.15.6:0/3238791362 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 0x7f810c0f6930 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.068+0000 7f8113ca2700 1 --2- 172.21.15.6:0/3238791362 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f810c0fc7f0 0x7f810c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.068+0000 7f8113ca2700 1 -- 172.21.15.6:0/3238791362 >> 172.21.15.6:0/3238791362 conn(0x7f810c070590 msgr2=0x7f810c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.068+0000 7f8113ca2700 1 -- 172.21.15.6:0/3238791362 shutdown_connections 2024-03-12T16:22:28.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.069+0000 7f8113ca2700 1 -- 172.21.15.6:0/3238791362 wait complete. 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.069+0000 7f8113ca2700 1 Processor -- start 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.069+0000 7f8113ca2700 1 -- start start 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8113ca2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f810c0fc7f0 0x7f810c10ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8113ca2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 0x7f810c10d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8113ca2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c10d9c0 con 0x7f810c0fd150 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8113ca2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f810c10db00 con 0x7f810c0fc7f0 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f811123d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 0x7f810c10d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f811123d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 0x7f810c10d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:47560/0 (socket says 172.21.15.6:47560) 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f811123d700 1 -- 172.21.15.6:0/3257336141 learned_addr learned my addr 172.21.15.6:0/3257336141 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:28.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8111a3e700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f810c0fc7f0 0x7f810c10ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f811123d700 1 -- 172.21.15.6:0/3257336141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f810c0fc7f0 msgr2=0x7f810c10ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f811123d700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f810c0fc7f0 0x7f810c10ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f811123d700 1 -- 172.21.15.6:0/3257336141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc005040 con 0x7f810c0fd150 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8111a3e700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f810c0fc7f0 0x7f810c10ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f811123d700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 0x7f810c10d3c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f80fc0099f0 tx=0x7f80fc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8102ffd700 1 -- 172.21.15.6:0/3257336141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80fc00e030 con 0x7f810c0fd150 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f810c107130 con 0x7f810c0fd150 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8102ffd700 1 -- 172.21.15.6:0/3257336141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f80fc007e90 con 0x7f810c0fd150 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.070+0000 7f8102ffd700 1 -- 172.21.15.6:0/3257336141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80fc018070 con 0x7f810c0fd150 2024-03-12T16:22:28.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.071+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f810c107690 con 0x7f810c0fd150 2024-03-12T16:22:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.072+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f810c05f590 con 0x7f810c0fd150 2024-03-12T16:22:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.072+0000 7f8102ffd700 1 -- 172.21.15.6:0/3257336141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f80fc009590 con 0x7f810c0fd150 2024-03-12T16:22:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.072+0000 7f8102ffd700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f80f806ca30 0x7f80f806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.072+0000 7f8102ffd700 1 -- 172.21.15.6:0/3257336141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f80fc08d070 con 0x7f810c0fd150 2024-03-12T16:22:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.073+0000 7f8111a3e700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f80f806ca30 0x7f80f806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:28.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.073+0000 7f8111a3e700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f80f806ca30 0x7f80f806eef0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8108009250 tx=0x7f8108009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:28.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.077+0000 7f8102ffd700 1 -- 172.21.15.6:0/3257336141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f80fc05abd0 con 0x7f810c0fd150 2024-03-12T16:22:28.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:27 smithi134 ceph-mon[85099]: pgmap v276: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:28.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:27 smithi134 ceph-mon[85099]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:28.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:27 smithi134 ceph-mon[85099]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:28.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:27 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3652082582' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:22:28.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:27 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/82303371' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:22:28.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:27 smithi006 ceph-mon[103869]: pgmap v276: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:28.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:27 smithi006 ceph-mon[103869]: from='client.34556 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:28.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:27 smithi006 ceph-mon[103869]: from='client.34560 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:28.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:27 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3652082582' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:22:28.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:27 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/82303371' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:22:28.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.362+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f810c047540 con 0x7f810c0fd150 2024-03-12T16:22:28.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.362+0000 7f8102ffd700 1 -- 172.21.15.6:0/3257336141 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f80fc05a760 con 0x7f810c0fd150 2024-03-12T16:22:28.363 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:22:28.363 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:22:28.363 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:22:28.363 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:22:28.363 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:22:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f80f806ca30 msgr2=0x7f80f806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f80f806ca30 0x7f80f806eef0 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 rx=0x7f8108009250 tx=0x7f8108009d60).stop 2024-03-12T16:22:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 msgr2=0x7f810c10d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 0x7f810c10d3c0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f80fc0099f0 tx=0x7f80fc009cb0).stop 2024-03-12T16:22:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 shutdown_connections 2024-03-12T16:22:28.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f810c0fc7f0 0x7f810c10ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f80f806ca30 0x7f80f806eef0 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 --2- 172.21.15.6:0/3257336141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f810c0fd150 0x7f810c10d3c0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 >> 172.21.15.6:0/3257336141 conn(0x7f810c070590 msgr2=0x7f810c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 shutdown_connections 2024-03-12T16:22:28.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:28.364+0000 7f8113ca2700 1 -- 172.21.15.6:0/3257336141 wait complete. 2024-03-12T16:22:29.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:28 smithi134 ceph-mon[85099]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:29.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:28 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3257336141' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:22:29.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:28 smithi006 ceph-mon[103869]: from='client.34564 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:29.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:28 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3257336141' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:22:30.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:29 smithi134 ceph-mon[85099]: pgmap v277: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:30.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:29 smithi134 ceph-mon[85099]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:30.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:29 smithi006 ceph-mon[103869]: pgmap v277: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:30.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:29 smithi006 ceph-mon[103869]: from='client.34576 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:32.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:31 smithi134 ceph-mon[85099]: pgmap v278: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:32.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:31 smithi006 ceph-mon[103869]: pgmap v278: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:33.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:22:33.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:22:34.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:33 smithi134 ceph-mon[85099]: pgmap v279: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:34.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:33 smithi006 ceph-mon[103869]: pgmap v279: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:36.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:35 smithi134 ceph-mon[85099]: pgmap v280: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:36.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:35 smithi006 ceph-mon[103869]: pgmap v280: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:38.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:37 smithi134 ceph-mon[85099]: pgmap v281: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:38.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:37 smithi006 ceph-mon[103869]: pgmap v281: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:40.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:39 smithi134 ceph-mon[85099]: pgmap v282: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:40.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:39 smithi006 ceph-mon[103869]: pgmap v282: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:42.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:41 smithi134 ceph-mon[85099]: pgmap v283: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:42.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:41 smithi006 ceph-mon[103869]: pgmap v283: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:44.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:43 smithi134 ceph-mon[85099]: pgmap v284: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:44.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:43 smithi006 ceph-mon[103869]: pgmap v284: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:46.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:45 smithi134 ceph-mon[85099]: pgmap v285: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:46.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:45 smithi006 ceph-mon[103869]: pgmap v285: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:48.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:47 smithi134 ceph-mon[85099]: pgmap v286: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:48.203 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:22:48.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:47 smithi006 ceph-mon[103869]: pgmap v286: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:48.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:22:49.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:49 smithi134 ceph-mon[85099]: pgmap v287: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:49.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:49 smithi006 ceph-mon[103869]: pgmap v287: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:51.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:51 smithi134 ceph-mon[85099]: pgmap v288: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:51.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:51 smithi006 ceph-mon[103869]: pgmap v288: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:53.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:53 smithi134 ceph-mon[85099]: pgmap v289: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:53.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:53 smithi006 ceph-mon[103869]: pgmap v289: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:55 smithi134 ceph-mon[85099]: pgmap v290: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:55 smithi006 ceph-mon[103869]: pgmap v290: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:57.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:57 smithi134 ceph-mon[85099]: pgmap v291: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:57.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:57 smithi006 ceph-mon[103869]: pgmap v291: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:58.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.480+0000 7f74cf648700 1 -- 172.21.15.6:0/263325669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 msgr2=0x7f74c80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:58.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.480+0000 7f74cf648700 1 --2- 172.21.15.6:0/263325669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 0x7f74c80fcbd0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f74bc0047f0 tx=0x7f74bc009cb0).stop 2024-03-12T16:22:58.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.480+0000 7f74cf648700 1 -- 172.21.15.6:0/263325669 shutdown_connections 2024-03-12T16:22:58.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.480+0000 7f74cf648700 1 --2- 172.21.15.6:0/263325669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c80fd150 0x7f74c80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:58.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.480+0000 7f74cf648700 1 --2- 172.21.15.6:0/263325669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 0x7f74c80fcbd0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:58.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.480+0000 7f74cf648700 1 -- 172.21.15.6:0/263325669 >> 172.21.15.6:0/263325669 conn(0x7f74c8070590 msgr2=0x7f74c80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:58.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.480+0000 7f74cf648700 1 -- 172.21.15.6:0/263325669 shutdown_connections 2024-03-12T16:22:58.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.480+0000 7f74cf648700 1 -- 172.21.15.6:0/263325669 wait complete. 2024-03-12T16:22:58.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.481+0000 7f74cf648700 1 Processor -- start 2024-03-12T16:22:58.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.481+0000 7f74cf648700 1 -- start start 2024-03-12T16:22:58.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.481+0000 7f74cf648700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 0x7f74c810e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:58.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.481+0000 7f74cf648700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c80fd150 0x7f74c810e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:58.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cf648700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c810eaf0 con 0x7f74c80fc7f0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cf648700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74c810ec30 con 0x7f74c80fd150 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cd3e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 0x7f74c810e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cd3e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 0x7f74c810e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42408/0 (socket says 172.21.15.6:42408) 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cd3e4700 1 -- 172.21.15.6:0/3078065077 learned_addr learned my addr 172.21.15.6:0/3078065077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74ccbe3700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c80fd150 0x7f74c810e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cd3e4700 1 -- 172.21.15.6:0/3078065077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c80fd150 msgr2=0x7f74c810e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cd3e4700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c80fd150 0x7f74c810e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cd3e4700 1 -- 172.21.15.6:0/3078065077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f74bc005040 con 0x7f74c80fc7f0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cd3e4700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 0x7f74c810e000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f74bc013640 tx=0x7f74bc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74ba7fc700 1 -- 172.21.15.6:0/3078065077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74bc00e030 con 0x7f74c80fc7f0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74ba7fc700 1 -- 172.21.15.6:0/3078065077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f74bc007e90 con 0x7f74c80fc7f0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f74c8108260 con 0x7f74c80fc7f0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74ba7fc700 1 -- 172.21.15.6:0/3078065077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f74bc018070 con 0x7f74c80fc7f0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.482+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f74c81087c0 con 0x7f74c80fc7f0 2024-03-12T16:22:58.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.483+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f74c805f590 con 0x7f74c80fc7f0 2024-03-12T16:22:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.484+0000 7f74ba7fc700 1 -- 172.21.15.6:0/3078065077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f74bc01d420 con 0x7f74c80fc7f0 2024-03-12T16:22:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.484+0000 7f74ba7fc700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f74b406cab0 0x7f74b406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.485+0000 7f74ba7fc700 1 -- 172.21.15.6:0/3078065077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f74bc08d340 con 0x7f74c80fc7f0 2024-03-12T16:22:58.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.485+0000 7f74ccbe3700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f74b406cab0 0x7f74b406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:58.488 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.485+0000 7f74ccbe3700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f74b406cab0 0x7f74b406ef70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f74c8109940 tx=0x7f74c4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:58.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.489+0000 7f74ba7fc700 1 -- 172.21.15.6:0/3078065077 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f74bc05ade0 con 0x7f74c80fc7f0 2024-03-12T16:22:58.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.716+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f74c8109790 con 0x7f74b406cab0 2024-03-12T16:22:58.720 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.718+0000 7f74ba7fc700 1 -- 172.21.15.6:0/3078065077 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f74c8109790 con 0x7f74b406cab0 2024-03-12T16:22:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f74b406cab0 msgr2=0x7f74b406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f74b406cab0 0x7f74b406ef70 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 rx=0x7f74c8109940 tx=0x7f74c4009040).stop 2024-03-12T16:22:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 msgr2=0x7f74c810e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 0x7f74c810e000 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f74bc013640 tx=0x7f74bc009cb0).stop 2024-03-12T16:22:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 shutdown_connections 2024-03-12T16:22:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f74b406cab0 0x7f74b406ef70 unknown :-1 s=CLOSED pgs=137 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:58.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74c80fc7f0 0x7f74c810e000 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:58.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 --2- 172.21.15.6:0/3078065077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74c80fd150 0x7f74c810e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:58.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 >> 172.21.15.6:0/3078065077 conn(0x7f74c8070590 msgr2=0x7f74c80fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:58.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 shutdown_connections 2024-03-12T16:22:58.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.720+0000 7f74cf648700 1 -- 172.21.15.6:0/3078065077 wait complete. 2024-03-12T16:22:58.732 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:22:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.822+0000 7f85a0a14700 1 -- 172.21.15.6:0/4205045441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fd8f0 msgr2=0x7f859c0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.822+0000 7f85a0a14700 1 --2- 172.21.15.6:0/4205045441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fd8f0 0x7f859c0fdcd0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f858c0047f0 tx=0x7f858c009cb0).stop 2024-03-12T16:22:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.823+0000 7f85a0a14700 1 -- 172.21.15.6:0/4205045441 shutdown_connections 2024-03-12T16:22:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.823+0000 7f85a0a14700 1 --2- 172.21.15.6:0/4205045441 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0fe250 0x7f859c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.823+0000 7f85a0a14700 1 --2- 172.21.15.6:0/4205045441 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fd8f0 0x7f859c0fdcd0 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.823+0000 7f85a0a14700 1 -- 172.21.15.6:0/4205045441 >> 172.21.15.6:0/4205045441 conn(0x7f859c0f34b0 msgr2=0x7f859c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.823+0000 7f85a0a14700 1 -- 172.21.15.6:0/4205045441 shutdown_connections 2024-03-12T16:22:58.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.823+0000 7f85a0a14700 1 -- 172.21.15.6:0/4205045441 wait complete. 2024-03-12T16:22:58.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f85a0a14700 1 Processor -- start 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f85a0a14700 1 -- start start 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f85a0a14700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0fd8f0 0x7f859c10e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f85a0a14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fe250 0x7f859c10e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f85a0a14700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c10ebe0 con 0x7f859c0fe250 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f85a0a14700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f859c10ed20 con 0x7f859c0fd8f0 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f8599d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fe250 0x7f859c10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f8599d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fe250 0x7f859c10e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42426/0 (socket says 172.21.15.6:42426) 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f8599d9b700 1 -- 172.21.15.6:0/2581007838 learned_addr learned my addr 172.21.15.6:0/2581007838 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f859a59c700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0fd8f0 0x7f859c10e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f8599d9b700 1 -- 172.21.15.6:0/2581007838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0fd8f0 msgr2=0x7f859c10e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f8599d9b700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0fd8f0 0x7f859c10e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:58.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.824+0000 7f8599d9b700 1 -- 172.21.15.6:0/2581007838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f858c005040 con 0x7f859c0fe250 2024-03-12T16:22:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.825+0000 7f8599d9b700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fe250 0x7f859c10e5e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f859000e8c0 tx=0x7f859000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.825+0000 7f858b7fe700 1 -- 172.21.15.6:0/2581007838 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8590007b40 con 0x7f859c0fe250 2024-03-12T16:22:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.825+0000 7f858b7fe700 1 -- 172.21.15.6:0/2581007838 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f859000f040 con 0x7f859c0fe250 2024-03-12T16:22:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.825+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f859c1083b0 con 0x7f859c0fe250 2024-03-12T16:22:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.825+0000 7f858b7fe700 1 -- 172.21.15.6:0/2581007838 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8590014830 con 0x7f859c0fe250 2024-03-12T16:22:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.825+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f859c108970 con 0x7f859c0fe250 2024-03-12T16:22:58.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.826+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f859c05f590 con 0x7f859c0fe250 2024-03-12T16:22:58.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.826+0000 7f858b7fe700 1 -- 172.21.15.6:0/2581007838 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8590014af0 con 0x7f859c0fe250 2024-03-12T16:22:58.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.827+0000 7f858b7fe700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f858406caa0 0x7f858406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:58.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.827+0000 7f858b7fe700 1 -- 172.21.15.6:0/2581007838 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f859008b860 con 0x7f859c0fe250 2024-03-12T16:22:58.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.827+0000 7f859a59c700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f858406caa0 0x7f858406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:58.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.827+0000 7f859a59c700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f858406caa0 0x7f858406ef60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f858c0047c0 tx=0x7f858c009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:58.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:58.831+0000 7f858b7fe700 1 -- 172.21.15.6:0/2581007838 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8590059480 con 0x7f859c0fe250 2024-03-12T16:22:59.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.049+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f859c108b90 con 0x7f858406caa0 2024-03-12T16:22:59.052 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.050+0000 7f858b7fe700 1 -- 172.21.15.6:0/2581007838 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f859c108b90 con 0x7f858406caa0 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.052+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f858406caa0 msgr2=0x7f858406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.052+0000 7f85a0a14700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f858406caa0 0x7f858406ef60 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 rx=0x7f858c0047c0 tx=0x7f858c009cb0).stop 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.052+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fe250 msgr2=0x7f859c10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.052+0000 7f85a0a14700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fe250 0x7f859c10e5e0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7f859000e8c0 tx=0x7f859000b040).stop 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.052+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 shutdown_connections 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.052+0000 7f85a0a14700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f859c0fd8f0 0x7f859c10e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.052+0000 7f85a0a14700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f858406caa0 0x7f858406ef60 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.052+0000 7f85a0a14700 1 --2- 172.21.15.6:0/2581007838 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f859c0fe250 0x7f859c10e5e0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.052+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 >> 172.21.15.6:0/2581007838 conn(0x7f859c0f34b0 msgr2=0x7f859c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.053+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 shutdown_connections 2024-03-12T16:22:59.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.053+0000 7f85a0a14700 1 -- 172.21.15.6:0/2581007838 wait complete. 2024-03-12T16:22:59.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.154+0000 7fd2a86a5700 1 -- 172.21.15.6:0/2337701169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 msgr2=0x7fd2a00f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.154+0000 7fd2a86a5700 1 --2- 172.21.15.6:0/2337701169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 0x7fd2a00f7a30 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7fd2900047f0 tx=0x7fd290009cb0).stop 2024-03-12T16:22:59.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.154+0000 7fd2a86a5700 1 -- 172.21.15.6:0/2337701169 shutdown_connections 2024-03-12T16:22:59.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.154+0000 7fd2a86a5700 1 --2- 172.21.15.6:0/2337701169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 0x7fd2a00f7a30 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.154+0000 7fd2a86a5700 1 --2- 172.21.15.6:0/2337701169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2a00fd8f0 0x7fd2a00fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.154+0000 7fd2a86a5700 1 -- 172.21.15.6:0/2337701169 >> 172.21.15.6:0/2337701169 conn(0x7fd2a00f34b0 msgr2=0x7fd2a00f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.155+0000 7fd2a86a5700 1 -- 172.21.15.6:0/2337701169 shutdown_connections 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.155+0000 7fd2a86a5700 1 -- 172.21.15.6:0/2337701169 wait complete. 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.155+0000 7fd2a86a5700 1 Processor -- start 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.155+0000 7fd2a86a5700 1 -- start start 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.155+0000 7fd2a86a5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2a00fd8f0 0x7fd2a010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.155+0000 7fd2a86a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 0x7fd2a010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.155+0000 7fd2a86a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a010eb70 con 0x7fd2a00fe250 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.155+0000 7fd2a86a5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2a010ecb0 con 0x7fd2a00fd8f0 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a5c40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 0x7fd2a010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a5c40700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 0x7fd2a010e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42454/0 (socket says 172.21.15.6:42454) 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a5c40700 1 -- 172.21.15.6:0/3669434448 learned_addr learned my addr 172.21.15.6:0/3669434448 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:59.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a6441700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2a00fd8f0 0x7fd2a010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a5c40700 1 -- 172.21.15.6:0/3669434448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2a00fd8f0 msgr2=0x7fd2a010e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a5c40700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2a00fd8f0 0x7fd2a010e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a5c40700 1 -- 172.21.15.6:0/3669434448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd290005040 con 0x7fd2a00fe250 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a6441700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2a00fd8f0 0x7fd2a010e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a5c40700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 0x7fd2a010e570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fd2900099f0 tx=0x7fd290009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2977fe700 1 -- 172.21.15.6:0/3669434448 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd29000e030 con 0x7fd2a00fe250 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2977fe700 1 -- 172.21.15.6:0/3669434448 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd290007e90 con 0x7fd2a00fe250 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2a01082e0 con 0x7fd2a00fe250 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2977fe700 1 -- 172.21.15.6:0/3669434448 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd290018070 con 0x7fd2a00fe250 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.156+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd2a01087c0 con 0x7fd2a00fe250 2024-03-12T16:22:59.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.157+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd2a005f590 con 0x7fd2a00fe250 2024-03-12T16:22:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.158+0000 7fd2977fe700 1 -- 172.21.15.6:0/3669434448 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd29001d420 con 0x7fd2a00fe250 2024-03-12T16:22:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.158+0000 7fd2977fe700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd28c06caa0 0x7fd28c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.158+0000 7fd2977fe700 1 -- 172.21.15.6:0/3669434448 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd29001de40 con 0x7fd2a00fe250 2024-03-12T16:22:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.159+0000 7fd2a6441700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd28c06caa0 0x7fd28c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:59.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.159+0000 7fd2a6441700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd28c06caa0 0x7fd28c06ef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fd29c004b80 tx=0x7fd29c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:59.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.162+0000 7fd2977fe700 1 -- 172.21.15.6:0/3669434448 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd29005b0b0 con 0x7fd2a00fe250 2024-03-12T16:22:59.373 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.371+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd2a01097a0 con 0x7fd28c06caa0 2024-03-12T16:22:59.382 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.380+0000 7fd2977fe700 1 -- 172.21.15.6:0/3669434448 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fd2a01097a0 con 0x7fd28c06caa0 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (9m) 3m ago 20m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (7m) 3m ago 20m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (7m) 3m ago 20m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (9m) 3m ago 20m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (3m) 3m ago 15m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (3m) 3m ago 15m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (3m) 3m ago 15m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (3m) 3m ago 15m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (11m) 3m ago 22m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (10m) 3m ago 20m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (8m) 3m ago 22m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (8m) 3m ago 19m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:22:59.383 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (10m) 3m ago 20m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:22:59.384 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (10m) 3m ago 19m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:22:59.384 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (7m) 3m ago 19m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:22:59.384 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (6m) 3m ago 19m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:22:59.384 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (5m) 3m ago 18m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:22:59.384 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (5m) 3m ago 18m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:22:59.384 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (4m) 3m ago 17m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:22:59.384 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (4m) 3m ago 17m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:22:59.384 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (10m) 3m ago 18m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.382+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd28c06caa0 msgr2=0x7fd28c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.382+0000 7fd2a86a5700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd28c06caa0 0x7fd28c06ef60 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 rx=0x7fd29c004b80 tx=0x7fd29c009040).stop 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.382+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 msgr2=0x7fd2a010e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.382+0000 7fd2a86a5700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 0x7fd2a010e570 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7fd2900099f0 tx=0x7fd290009cb0).stop 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.382+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 shutdown_connections 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.382+0000 7fd2a86a5700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2a00fd8f0 0x7fd2a010e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.382+0000 7fd2a86a5700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd28c06caa0 0x7fd28c06ef60 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.382+0000 7fd2a86a5700 1 --2- 172.21.15.6:0/3669434448 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2a00fe250 0x7fd2a010e570 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.382+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 >> 172.21.15.6:0/3669434448 conn(0x7fd2a00f34b0 msgr2=0x7fd2a00fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:59.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.383+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 shutdown_connections 2024-03-12T16:22:59.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.383+0000 7fd2a86a5700 1 -- 172.21.15.6:0/3669434448 wait complete. 2024-03-12T16:22:59.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 -- 172.21.15.6:0/742691811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f88a0 msgr2=0x7f67bc0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 --2- 172.21.15.6:0/742691811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f88a0 0x7f67bc0f8c80 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f67a40047f0 tx=0x7f67a4009cb0).stop 2024-03-12T16:22:59.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 -- 172.21.15.6:0/742691811 shutdown_connections 2024-03-12T16:22:59.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 --2- 172.21.15.6:0/742691811 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67bc0f9200 0x7f67bc101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 --2- 172.21.15.6:0/742691811 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f88a0 0x7f67bc0f8c80 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 -- 172.21.15.6:0/742691811 >> 172.21.15.6:0/742691811 conn(0x7f67bc070590 msgr2=0x7f67bc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:59.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 -- 172.21.15.6:0/742691811 shutdown_connections 2024-03-12T16:22:59.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 -- 172.21.15.6:0/742691811 wait complete. 2024-03-12T16:22:59.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 Processor -- start 2024-03-12T16:22:59.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.484+0000 7f67c28a5700 1 -- start start 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67c28a5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67bc0f88a0 0x7f67bc10e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67c28a5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f9200 0x7f67bc10e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67c28a5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc10eb30 con 0x7f67bc0f9200 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67c28a5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f67bc10ec70 con 0x7f67bc0f88a0 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67bb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f9200 0x7f67bc10e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67bb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f9200 0x7f67bc10e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42472/0 (socket says 172.21.15.6:42472) 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67bb7fe700 1 -- 172.21.15.6:0/1210736713 learned_addr learned my addr 172.21.15.6:0/1210736713 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67bbfff700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67bc0f88a0 0x7f67bc10e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67bb7fe700 1 -- 172.21.15.6:0/1210736713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67bc0f88a0 msgr2=0x7f67bc10e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67bb7fe700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67bc0f88a0 0x7f67bc10e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67bb7fe700 1 -- 172.21.15.6:0/1210736713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f67a4005040 con 0x7f67bc0f9200 2024-03-12T16:22:59.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67bbfff700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67bc0f88a0 0x7f67bc10e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:22:59.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.485+0000 7f67bb7fe700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f9200 0x7f67bc10e530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f67ac0041d0 tx=0x7f67ac009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:59.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.486+0000 7f67b97fa700 1 -- 172.21.15.6:0/1210736713 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67ac007b40 con 0x7f67bc0f9200 2024-03-12T16:22:59.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.486+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f67bc108300 con 0x7f67bc0f9200 2024-03-12T16:22:59.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.486+0000 7f67b97fa700 1 -- 172.21.15.6:0/1210736713 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f67ac00f040 con 0x7f67bc0f9200 2024-03-12T16:22:59.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.486+0000 7f67b97fa700 1 -- 172.21.15.6:0/1210736713 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f67ac00d800 con 0x7f67bc0f9200 2024-03-12T16:22:59.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.486+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f67bc108840 con 0x7f67bc0f9200 2024-03-12T16:22:59.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.486+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f67bc05f590 con 0x7f67bc0f9200 2024-03-12T16:22:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.487+0000 7f67b97fa700 1 -- 172.21.15.6:0/1210736713 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f67ac007ca0 con 0x7f67bc0f9200 2024-03-12T16:22:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.488+0000 7f67b97fa700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f67a806caa0 0x7f67a806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.488+0000 7f67b97fa700 1 -- 172.21.15.6:0/1210736713 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f67ac08b8c0 con 0x7f67bc0f9200 2024-03-12T16:22:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.488+0000 7f67bbfff700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f67a806caa0 0x7f67a806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:59.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.488+0000 7f67bbfff700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f67a806caa0 0x7f67a806ef60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f67a40043d0 tx=0x7f67a400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:59.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.492+0000 7f67b97fa700 1 -- 172.21.15.6:0/1210736713 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f67ac059420 con 0x7f67bc0f9200 2024-03-12T16:22:59.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:59 smithi134 ceph-mon[85099]: pgmap v292: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:59.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:22:59 smithi134 ceph-mon[85099]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:59.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:59 smithi006 ceph-mon[103869]: pgmap v292: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:22:59.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:22:59 smithi006 ceph-mon[103869]: from='client.34584 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:22:59.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.770+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f67bc047540 con 0x7f67bc0f9200 2024-03-12T16:22:59.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.770+0000 7f67b97fa700 1 -- 172.21.15.6:0/1210736713 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f67ac058fb0 con 0x7f67bc0f9200 2024-03-12T16:22:59.772 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:22:59.772 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:22:59.772 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:22:59.773 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:22:59.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f67a806caa0 msgr2=0x7f67a806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f67a806caa0 0x7f67a806ef60 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 rx=0x7f67a40043d0 tx=0x7f67a400b040).stop 2024-03-12T16:22:59.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f9200 msgr2=0x7f67bc10e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f9200 0x7f67bc10e530 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f67ac0041d0 tx=0x7f67ac009f60).stop 2024-03-12T16:22:59.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 shutdown_connections 2024-03-12T16:22:59.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f67bc0f88a0 0x7f67bc10e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f67a806caa0 0x7f67a806ef60 unknown :-1 s=CLOSED pgs=140 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 --2- 172.21.15.6:0/1210736713 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f67bc0f9200 0x7f67bc10e530 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 >> 172.21.15.6:0/1210736713 conn(0x7f67bc070590 msgr2=0x7f67bc0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:59.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 shutdown_connections 2024-03-12T16:22:59.775 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.772+0000 7f67c28a5700 1 -- 172.21.15.6:0/1210736713 wait complete. 2024-03-12T16:22:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.874+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1892247830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 msgr2=0x7fd3a40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.874+0000 7fd3a9fa4700 1 --2- 172.21.15.6:0/1892247830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 0x7fd3a40f6930 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7fd3980047f0 tx=0x7fd398009cb0).stop 2024-03-12T16:22:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.874+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1892247830 shutdown_connections 2024-03-12T16:22:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.874+0000 7fd3a9fa4700 1 --2- 172.21.15.6:0/1892247830 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 0x7fd3a40f6930 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.874+0000 7fd3a9fa4700 1 --2- 172.21.15.6:0/1892247830 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a40fc7f0 0x7fd3a40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.874+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1892247830 >> 172.21.15.6:0/1892247830 conn(0x7fd3a4070590 msgr2=0x7fd3a40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:22:59.877 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.874+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1892247830 shutdown_connections 2024-03-12T16:22:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.874+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1892247830 wait complete. 2024-03-12T16:22:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.875+0000 7fd3a9fa4700 1 Processor -- start 2024-03-12T16:22:59.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.875+0000 7fd3a9fa4700 1 -- start start 2024-03-12T16:22:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.875+0000 7fd3a9fa4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a40fc7f0 0x7fd3a410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.875+0000 7fd3a9fa4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 0x7fd3a410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.875+0000 7fd3a9fa4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a410eab0 con 0x7fd3a40fd150 2024-03-12T16:22:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.875+0000 7fd3a9fa4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd3a410ebf0 con 0x7fd3a40fc7f0 2024-03-12T16:22:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 0x7fd3a410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 0x7fd3a410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42492/0 (socket says 172.21.15.6:42492) 2024-03-12T16:22:59.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a2ffd700 1 -- 172.21.15.6:0/1559868840 learned_addr learned my addr 172.21.15.6:0/1559868840 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a37fe700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a40fc7f0 0x7fd3a410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a2ffd700 1 -- 172.21.15.6:0/1559868840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a40fc7f0 msgr2=0x7fd3a410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a2ffd700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a40fc7f0 0x7fd3a410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a2ffd700 1 -- 172.21.15.6:0/1559868840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd398005040 con 0x7fd3a40fd150 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a2ffd700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 0x7fd3a410e4b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd3980099f0 tx=0x7fd398009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a0ff9700 1 -- 172.21.15.6:0/1559868840 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd39800e030 con 0x7fd3a40fd150 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a0ff9700 1 -- 172.21.15.6:0/1559868840 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd398007e90 con 0x7fd3a40fd150 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd3a4108220 con 0x7fd3a40fd150 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a0ff9700 1 -- 172.21.15.6:0/1559868840 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd398018070 con 0x7fd3a40fd150 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.876+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3a4108700 con 0x7fd3a40fd150 2024-03-12T16:22:59.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.877+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd3a405f590 con 0x7fd3a40fd150 2024-03-12T16:22:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.878+0000 7fd3a0ff9700 1 -- 172.21.15.6:0/1559868840 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd3980094c0 con 0x7fd3a40fd150 2024-03-12T16:22:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.878+0000 7fd3a0ff9700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd38c06caa0 0x7fd38c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:22:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.878+0000 7fd3a0ff9700 1 -- 172.21.15.6:0/1559868840 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd39808d000 con 0x7fd3a40fd150 2024-03-12T16:22:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.878+0000 7fd3a37fe700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd38c06caa0 0x7fd38c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:22:59.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.878+0000 7fd3a37fe700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd38c06caa0 0x7fd38c06ef60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd394004e60 tx=0x7fd39400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:22:59.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:22:59.882+0000 7fd3a0ff9700 1 -- 172.21.15.6:0/1559868840 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd39805ab60 con 0x7fd3a40fd150 2024-03-12T16:23:00.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.124+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fd3a4108d40 con 0x7fd3a40fd150 2024-03-12T16:23:00.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.124+0000 7fd3a0ff9700 1 -- 172.21.15.6:0/1559868840 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fd39805a6f0 con 0x7fd3a40fd150 2024-03-12T16:23:00.126 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:23:00.127 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:23:00.128 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:23:00.129 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:23:00.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd38c06caa0 msgr2=0x7fd38c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd38c06caa0 0x7fd38c06ef60 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 rx=0x7fd394004e60 tx=0x7fd39400b040).stop 2024-03-12T16:23:00.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 msgr2=0x7fd3a410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 0x7fd3a410e4b0 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fd3980099f0 tx=0x7fd398009cb0).stop 2024-03-12T16:23:00.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 shutdown_connections 2024-03-12T16:23:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3a40fc7f0 0x7fd3a410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd38c06caa0 0x7fd38c06ef60 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 --2- 172.21.15.6:0/1559868840 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3a40fd150 0x7fd3a410e4b0 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 >> 172.21.15.6:0/1559868840 conn(0x7fd3a4070590 msgr2=0x7fd3a4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 shutdown_connections 2024-03-12T16:23:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.126+0000 7fd3a9fa4700 1 -- 172.21.15.6:0/1559868840 wait complete. 2024-03-12T16:23:00.131 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:23:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.229+0000 7f43ff19e700 1 -- 172.21.15.6:0/1921399374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fd910 msgr2=0x7f43f80fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.229+0000 7f43ff19e700 1 --2- 172.21.15.6:0/1921399374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fd910 0x7f43f80fdcf0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7f43ec0047f0 tx=0x7f43ec009cb0).stop 2024-03-12T16:23:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.229+0000 7f43ff19e700 1 -- 172.21.15.6:0/1921399374 shutdown_connections 2024-03-12T16:23:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.229+0000 7f43ff19e700 1 --2- 172.21.15.6:0/1921399374 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43f80fe270 0x7f43f80f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.229+0000 7f43ff19e700 1 --2- 172.21.15.6:0/1921399374 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fd910 0x7f43f80fdcf0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.229+0000 7f43ff19e700 1 -- 172.21.15.6:0/1921399374 >> 172.21.15.6:0/1921399374 conn(0x7f43f80f3530 msgr2=0x7f43f80f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.229+0000 7f43ff19e700 1 -- 172.21.15.6:0/1921399374 shutdown_connections 2024-03-12T16:23:00.232 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.229+0000 7f43ff19e700 1 -- 172.21.15.6:0/1921399374 wait complete. 2024-03-12T16:23:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.229+0000 7f43ff19e700 1 Processor -- start 2024-03-12T16:23:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43ff19e700 1 -- start start 2024-03-12T16:23:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43ff19e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43f80fd910 0x7f43f806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43ff19e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fe270 0x7f43f806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43ff19e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f806bab0 con 0x7f43f80fe270 2024-03-12T16:23:00.233 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43ff19e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43f806bbf0 con 0x7f43f80fd910 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fe270 0x7f43f806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43f7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fe270 0x7f43f806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42498/0 (socket says 172.21.15.6:42498) 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43f7fff700 1 -- 172.21.15.6:0/3699094954 learned_addr learned my addr 172.21.15.6:0/3699094954 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43fcf3a700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43f80fd910 0x7f43f806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43f7fff700 1 -- 172.21.15.6:0/3699094954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43f80fd910 msgr2=0x7f43f806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43f7fff700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43f80fd910 0x7f43f806b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43f7fff700 1 -- 172.21.15.6:0/3699094954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43ec005040 con 0x7f43f80fe270 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.230+0000 7f43f7fff700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fe270 0x7f43f806b5c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f43e4002780 tx=0x7f43e4009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.231+0000 7f43f5ffb700 1 -- 172.21.15.6:0/3699094954 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e4007b40 con 0x7f43f80fe270 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.231+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43f806bea0 con 0x7f43f80fe270 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.231+0000 7f43f5ffb700 1 -- 172.21.15.6:0/3699094954 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43e400f040 con 0x7f43f80fe270 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.231+0000 7f43f5ffb700 1 -- 172.21.15.6:0/3699094954 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43e4014780 con 0x7f43f80fe270 2024-03-12T16:23:00.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.231+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43f81146c0 con 0x7f43f80fe270 2024-03-12T16:23:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.232+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43f805f570 con 0x7f43f80fe270 2024-03-12T16:23:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.232+0000 7f43f5ffb700 1 -- 172.21.15.6:0/3699094954 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f43e4007ca0 con 0x7f43f80fe270 2024-03-12T16:23:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.232+0000 7f43f5ffb700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43e806caa0 0x7f43e806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:00.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.233+0000 7f43f5ffb700 1 -- 172.21.15.6:0/3699094954 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f43e408bd60 con 0x7f43f80fe270 2024-03-12T16:23:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.233+0000 7f43fcf3a700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43e806caa0 0x7f43e806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:00.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.233+0000 7f43fcf3a700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43e806caa0 0x7f43e806ef60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f43ec000c00 tx=0x7f43ec00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:00.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.237+0000 7f43f5ffb700 1 -- 172.21.15.6:0/3699094954 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f43e4055e30 con 0x7f43f80fe270 2024-03-12T16:23:00.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.452+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43f806c6c0 con 0x7f43e806caa0 2024-03-12T16:23:00.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.454+0000 7f43f5ffb700 1 -- 172.21.15.6:0/3699094954 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f43f806c6c0 con 0x7f43e806caa0 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:23:00.456 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:23:00.457 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:23:00.457 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:23:00.457 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43e806caa0 msgr2=0x7f43e806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43e806caa0 0x7f43e806ef60 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 rx=0x7f43ec000c00 tx=0x7f43ec00b040).stop 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fe270 msgr2=0x7f43f806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fe270 0x7f43f806b5c0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f43e4002780 tx=0x7f43e4009ee0).stop 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 shutdown_connections 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43f80fd910 0x7f43f806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43e806caa0 0x7f43e806ef60 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 --2- 172.21.15.6:0/3699094954 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43f80fe270 0x7f43f806b5c0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 >> 172.21.15.6:0/3699094954 conn(0x7f43f80f3530 msgr2=0x7f43f80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 shutdown_connections 2024-03-12T16:23:00.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.456+0000 7f43ff19e700 1 -- 172.21.15.6:0/3699094954 wait complete. 2024-03-12T16:23:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.557+0000 7f411a5f5700 1 -- 172.21.15.6:0/1714779626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fd8f0 msgr2=0x7f41140fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.557+0000 7f411a5f5700 1 --2- 172.21.15.6:0/1714779626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fd8f0 0x7f41140fdcd0 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f41040047f0 tx=0x7f4104009cb0).stop 2024-03-12T16:23:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.557+0000 7f411a5f5700 1 -- 172.21.15.6:0/1714779626 shutdown_connections 2024-03-12T16:23:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.557+0000 7f411a5f5700 1 --2- 172.21.15.6:0/1714779626 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41140fe250 0x7f41140f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.557+0000 7f411a5f5700 1 --2- 172.21.15.6:0/1714779626 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fd8f0 0x7f41140fdcd0 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.557+0000 7f411a5f5700 1 -- 172.21.15.6:0/1714779626 >> 172.21.15.6:0/1714779626 conn(0x7f41140f34b0 msgr2=0x7f41140f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.557+0000 7f411a5f5700 1 -- 172.21.15.6:0/1714779626 shutdown_connections 2024-03-12T16:23:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.557+0000 7f411a5f5700 1 -- 172.21.15.6:0/1714779626 wait complete. 2024-03-12T16:23:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.558+0000 7f411a5f5700 1 Processor -- start 2024-03-12T16:23:00.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.558+0000 7f411a5f5700 1 -- start start 2024-03-12T16:23:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f411a5f5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41140fd8f0 0x7f411410dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f411a5f5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fe250 0x7f411410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f411a5f5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411410ead0 con 0x7f41140fe250 2024-03-12T16:23:00.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f411a5f5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f411410ec10 con 0x7f41140fd8f0 2024-03-12T16:23:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f41137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fe250 0x7f411410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f41137fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fe250 0x7f411410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42520/0 (socket says 172.21.15.6:42520) 2024-03-12T16:23:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f41137fe700 1 -- 172.21.15.6:0/3190194415 learned_addr learned my addr 172.21.15.6:0/3190194415 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:23:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f4113fff700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41140fd8f0 0x7f411410dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f41137fe700 1 -- 172.21.15.6:0/3190194415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41140fd8f0 msgr2=0x7f411410dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f41137fe700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41140fd8f0 0x7f411410dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f41137fe700 1 -- 172.21.15.6:0/3190194415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4104005040 con 0x7f41140fe250 2024-03-12T16:23:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f4113fff700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41140fd8f0 0x7f411410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:23:00.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.559+0000 7f41137fe700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fe250 0x7f411410e4d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f41080044e0 tx=0x7f4108002b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.560+0000 7f41117fa700 1 -- 172.21.15.6:0/3190194415 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4108007b40 con 0x7f41140fe250 2024-03-12T16:23:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.560+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f41141082a0 con 0x7f41140fe250 2024-03-12T16:23:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.560+0000 7f41117fa700 1 -- 172.21.15.6:0/3190194415 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f410800f040 con 0x7f41140fe250 2024-03-12T16:23:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.560+0000 7f41117fa700 1 -- 172.21.15.6:0/3190194415 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f410800d830 con 0x7f41140fe250 2024-03-12T16:23:00.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.560+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f41141087e0 con 0x7f41140fe250 2024-03-12T16:23:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.561+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f411405f590 con 0x7f41140fe250 2024-03-12T16:23:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.561+0000 7f41117fa700 1 -- 172.21.15.6:0/3190194415 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f4108007ca0 con 0x7f41140fe250 2024-03-12T16:23:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.562+0000 7f41117fa700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f40fc06caa0 0x7f40fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.562+0000 7f41117fa700 1 -- 172.21.15.6:0/3190194415 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f410808b9e0 con 0x7f41140fe250 2024-03-12T16:23:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.562+0000 7f4113fff700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f40fc06caa0 0x7f40fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:00.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.562+0000 7f4113fff700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f40fc06caa0 0x7f40fc06ef60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4104004540 tx=0x7f410400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:00.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.566+0000 7f41117fa700 1 -- 172.21.15.6:0/3190194415 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4108059540 con 0x7f41140fe250 2024-03-12T16:23:00.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:00 smithi134 ceph-mon[85099]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:00.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:00 smithi134 ceph-mon[85099]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:00.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:00 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1210736713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:23:00.750 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:00 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1559868840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:23:00.751 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:00 smithi006 ceph-mon[103869]: from='client.34588 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:00.751 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:00 smithi006 ceph-mon[103869]: from='client.34592 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:00.751 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:00 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1210736713' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:23:00.751 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:00 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1559868840' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:23:00.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.848+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f4114047540 con 0x7f41140fe250 2024-03-12T16:23:00.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.849+0000 7f41117fa700 1 -- 172.21.15.6:0/3190194415 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f41080590d0 con 0x7f41140fe250 2024-03-12T16:23:00.851 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:23:00.851 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:23:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:23:00.851 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:23:00.851 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:23:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f40fc06caa0 msgr2=0x7f40fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f40fc06caa0 0x7f40fc06ef60 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 rx=0x7f4104004540 tx=0x7f410400b040).stop 2024-03-12T16:23:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fe250 msgr2=0x7f411410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fe250 0x7f411410e4d0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f41080044e0 tx=0x7f4108002b00).stop 2024-03-12T16:23:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 shutdown_connections 2024-03-12T16:23:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f41140fd8f0 0x7f411410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f40fc06caa0 0x7f40fc06ef60 unknown :-1 s=CLOSED pgs=143 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 --2- 172.21.15.6:0/3190194415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f41140fe250 0x7f411410e4d0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 >> 172.21.15.6:0/3190194415 conn(0x7f41140f34b0 msgr2=0x7f41140fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 shutdown_connections 2024-03-12T16:23:00.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:00.851+0000 7f411a5f5700 1 -- 172.21.15.6:0/3190194415 wait complete. 2024-03-12T16:23:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:01 smithi134 ceph-mon[85099]: pgmap v293: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:01 smithi134 ceph-mon[85099]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:01.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:01 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3190194415' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:23:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:01 smithi006 ceph-mon[103869]: pgmap v293: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:01 smithi006 ceph-mon[103869]: from='client.34604 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:01 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3190194415' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:23:02.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:23:02.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:23:03.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:03 smithi134 ceph-mon[85099]: pgmap v294: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:03.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:03 smithi006 ceph-mon[103869]: pgmap v294: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:05.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:05 smithi134 ceph-mon[85099]: pgmap v295: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:05.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:05 smithi006 ceph-mon[103869]: pgmap v295: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:07.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:07 smithi134 ceph-mon[85099]: pgmap v296: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:07.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:07 smithi006 ceph-mon[103869]: pgmap v296: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:09.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:09 smithi134 ceph-mon[85099]: pgmap v297: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:09.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:09 smithi006 ceph-mon[103869]: pgmap v297: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:11.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:11 smithi134 ceph-mon[85099]: pgmap v298: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:11.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:11 smithi006 ceph-mon[103869]: pgmap v298: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:13.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:13 smithi134 ceph-mon[85099]: pgmap v299: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:13.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:13 smithi006 ceph-mon[103869]: pgmap v299: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:15.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:15 smithi134 ceph-mon[85099]: pgmap v300: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:15.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:15 smithi006 ceph-mon[103869]: pgmap v300: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:17.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:17 smithi134 ceph-mon[85099]: pgmap v301: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:17.706 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:23:17.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:17 smithi006 ceph-mon[103869]: pgmap v301: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:17.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:23:19.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:19 smithi134 ceph-mon[85099]: pgmap v302: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:19.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:19 smithi006 ceph-mon[103869]: pgmap v302: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:21.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:21 smithi134 ceph-mon[85099]: pgmap v303: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:21.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:21 smithi006 ceph-mon[103869]: pgmap v303: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:23.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:23 smithi134 ceph-mon[85099]: pgmap v304: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:23.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:23 smithi006 ceph-mon[103869]: pgmap v304: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:25.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:25 smithi134 ceph-mon[85099]: pgmap v305: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:25.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:25 smithi006 ceph-mon[103869]: pgmap v305: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:27.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:27 smithi134 ceph-mon[85099]: pgmap v306: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:27.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:27 smithi006 ceph-mon[103869]: pgmap v306: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:29 smithi134 ceph-mon[85099]: pgmap v307: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:29.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:29 smithi006 ceph-mon[103869]: pgmap v307: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:30.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.967+0000 7f842ad37700 1 -- 172.21.15.6:0/1057597877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 msgr2=0x7f84240fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.967+0000 7f842ad37700 1 --2- 172.21.15.6:0/1057597877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 0x7f84240fdcd0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f84180047f0 tx=0x7f8418009cb0).stop 2024-03-12T16:23:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.967+0000 7f842ad37700 1 -- 172.21.15.6:0/1057597877 shutdown_connections 2024-03-12T16:23:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.967+0000 7f842ad37700 1 --2- 172.21.15.6:0/1057597877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84240fe250 0x7f84240f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.967+0000 7f842ad37700 1 --2- 172.21.15.6:0/1057597877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 0x7f84240fdcd0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.967+0000 7f842ad37700 1 -- 172.21.15.6:0/1057597877 >> 172.21.15.6:0/1057597877 conn(0x7f84240f34b0 msgr2=0x7f84240f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.967+0000 7f842ad37700 1 -- 172.21.15.6:0/1057597877 shutdown_connections 2024-03-12T16:23:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.967+0000 7f842ad37700 1 -- 172.21.15.6:0/1057597877 wait complete. 2024-03-12T16:23:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f842ad37700 1 Processor -- start 2024-03-12T16:23:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f842ad37700 1 -- start start 2024-03-12T16:23:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f842ad37700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 0x7f842406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f842ad37700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84240fe250 0x7f842406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f842ad37700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842406bab0 con 0x7f84240fd8f0 2024-03-12T16:23:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f842ad37700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f842406bbf0 con 0x7f84240fe250 2024-03-12T16:23:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f8428ad3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 0x7f842406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f8428ad3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 0x7f842406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57390/0 (socket says 172.21.15.6:57390) 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f8428ad3700 1 -- 172.21.15.6:0/2249091629 learned_addr learned my addr 172.21.15.6:0/2249091629 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f8423fff700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84240fe250 0x7f842406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f8428ad3700 1 -- 172.21.15.6:0/2249091629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84240fe250 msgr2=0x7f842406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f8428ad3700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84240fe250 0x7f842406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f8428ad3700 1 -- 172.21.15.6:0/2249091629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8418005040 con 0x7f84240fd8f0 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.968+0000 7f8428ad3700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 0x7f842406b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f8418013640 tx=0x7f8418009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.969+0000 7f8421ffb700 1 -- 172.21.15.6:0/2249091629 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f841800e030 con 0x7f84240fd8f0 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.969+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f842406be40 con 0x7f84240fd8f0 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.969+0000 7f8421ffb700 1 -- 172.21.15.6:0/2249091629 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8418007e90 con 0x7f84240fd8f0 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.969+0000 7f8421ffb700 1 -- 172.21.15.6:0/2249091629 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8418018070 con 0x7f84240fd8f0 2024-03-12T16:23:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.969+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f84241145f0 con 0x7f84240fd8f0 2024-03-12T16:23:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.970+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f842405f590 con 0x7f84240fd8f0 2024-03-12T16:23:30.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.970+0000 7f8421ffb700 1 -- 172.21.15.6:0/2249091629 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f841801d420 con 0x7f84240fd8f0 2024-03-12T16:23:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.971+0000 7f8421ffb700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f841406cab0 0x7f841406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.971+0000 7f8421ffb700 1 -- 172.21.15.6:0/2249091629 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f841808d260 con 0x7f84240fd8f0 2024-03-12T16:23:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.971+0000 7f8423fff700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f841406cab0 0x7f841406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.971+0000 7f8423fff700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f841406cab0 0x7f841406ef70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f842406c870 tx=0x7f8410009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:30.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:30.976+0000 7f8421ffb700 1 -- 172.21.15.6:0/2249091629 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8418057330 con 0x7f84240fd8f0 2024-03-12T16:23:31.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.190+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f8424059120 con 0x7f841406cab0 2024-03-12T16:23:31.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.192+0000 7f8421ffb700 1 -- 172.21.15.6:0/2249091629 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f8424059120 con 0x7f841406cab0 2024-03-12T16:23:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f841406cab0 msgr2=0x7f841406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f841406cab0 0x7f841406ef70 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 rx=0x7f842406c870 tx=0x7f8410009040).stop 2024-03-12T16:23:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 msgr2=0x7f842406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 0x7f842406b0d0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f8418013640 tx=0x7f8418009cb0).stop 2024-03-12T16:23:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 shutdown_connections 2024-03-12T16:23:31.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f841406cab0 0x7f841406ef70 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84240fd8f0 0x7f842406b0d0 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 --2- 172.21.15.6:0/2249091629 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84240fe250 0x7f842406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 >> 172.21.15.6:0/2249091629 conn(0x7f84240f34b0 msgr2=0x7f84240fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 shutdown_connections 2024-03-12T16:23:31.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.194+0000 7f842ad37700 1 -- 172.21.15.6:0/2249091629 wait complete. 2024-03-12T16:23:31.206 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:23:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.296+0000 7f33718d1700 1 -- 172.21.15.6:0/535930848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 msgr2=0x7f336c0fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.296+0000 7f33718d1700 1 --2- 172.21.15.6:0/535930848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 0x7f336c0fcc40 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f33600047f0 tx=0x7f3360009cb0).stop 2024-03-12T16:23:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.297+0000 7f33718d1700 1 -- 172.21.15.6:0/535930848 shutdown_connections 2024-03-12T16:23:31.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.297+0000 7f33718d1700 1 --2- 172.21.15.6:0/535930848 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f336c0fd1c0 0x7f336c0f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.297+0000 7f33718d1700 1 --2- 172.21.15.6:0/535930848 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 0x7f336c0fcc40 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.297+0000 7f33718d1700 1 -- 172.21.15.6:0/535930848 >> 172.21.15.6:0/535930848 conn(0x7f336c0f2440 msgr2=0x7f336c0f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.297+0000 7f33718d1700 1 -- 172.21.15.6:0/535930848 shutdown_connections 2024-03-12T16:23:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.297+0000 7f33718d1700 1 -- 172.21.15.6:0/535930848 wait complete. 2024-03-12T16:23:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.297+0000 7f33718d1700 1 Processor -- start 2024-03-12T16:23:31.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.297+0000 7f33718d1700 1 -- start start 2024-03-12T16:23:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f33718d1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 0x7f336c10e110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f33718d1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f336c0fd1c0 0x7f336c10e600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f33718d1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c10ec00 con 0x7f336c0fc860 2024-03-12T16:23:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f33718d1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f336c10ed40 con 0x7f336c0fd1c0 2024-03-12T16:23:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f336affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 0x7f336c10e110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:31.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f336affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 0x7f336c10e110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57402/0 (socket says 172.21.15.6:57402) 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f336affd700 1 -- 172.21.15.6:0/3363145667 learned_addr learned my addr 172.21.15.6:0/3363145667 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f336a7fc700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f336c0fd1c0 0x7f336c10e600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f336affd700 1 -- 172.21.15.6:0/3363145667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f336c0fd1c0 msgr2=0x7f336c10e600 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f336affd700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f336c0fd1c0 0x7f336c10e600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f336affd700 1 -- 172.21.15.6:0/3363145667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3360005040 con 0x7f336c0fc860 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f336affd700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 0x7f336c10e110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f3360009380 tx=0x7f3360009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f3353fff700 1 -- 172.21.15.6:0/3363145667 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3360018070 con 0x7f336c0fc860 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f3353fff700 1 -- 172.21.15.6:0/3363145667 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3360007e90 con 0x7f336c0fc860 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f3353fff700 1 -- 172.21.15.6:0/3363145667 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f33600123c0 con 0x7f336c0fc860 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f336c108370 con 0x7f336c0fc860 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.298+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f336c1088d0 con 0x7f336c0fc860 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.299+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f336c060370 con 0x7f336c0fc860 2024-03-12T16:23:31.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.300+0000 7f3353fff700 1 -- 172.21.15.6:0/3363145667 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f336001d420 con 0x7f336c0fc860 2024-03-12T16:23:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.300+0000 7f3353fff700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f335406caa0 0x7f335406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.300+0000 7f3353fff700 1 -- 172.21.15.6:0/3363145667 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f336008ca60 con 0x7f336c0fc860 2024-03-12T16:23:31.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.300+0000 7f336a7fc700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f335406caa0 0x7f335406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:31.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.301+0000 7f336a7fc700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f335406caa0 0x7f335406ef60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f335c009f20 tx=0x7f335c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:31.307 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.306+0000 7f3353fff700 1 -- 172.21.15.6:0/3363145667 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f336005a5c0 con 0x7f336c0fc860 2024-03-12T16:23:31.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.524+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f336c108f10 con 0x7f335406caa0 2024-03-12T16:23:31.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.525+0000 7f3353fff700 1 -- 172.21.15.6:0/3363145667 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f336c108f10 con 0x7f335406caa0 2024-03-12T16:23:31.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f335406caa0 msgr2=0x7f335406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f335406caa0 0x7f335406ef60 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 rx=0x7f335c009f20 tx=0x7f335c00b040).stop 2024-03-12T16:23:31.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 msgr2=0x7f336c10e110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 0x7f336c10e110 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f3360009380 tx=0x7f3360009cb0).stop 2024-03-12T16:23:31.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 shutdown_connections 2024-03-12T16:23:31.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f335406caa0 0x7f335406ef60 unknown :-1 s=CLOSED pgs=145 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f336c0fc860 0x7f336c10e110 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 --2- 172.21.15.6:0/3363145667 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f336c0fd1c0 0x7f336c10e600 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 >> 172.21.15.6:0/3363145667 conn(0x7f336c0f2440 msgr2=0x7f336c0613a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:31.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 shutdown_connections 2024-03-12T16:23:31.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.527+0000 7f33718d1700 1 -- 172.21.15.6:0/3363145667 wait complete. 2024-03-12T16:23:31.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.629+0000 7f82800e5700 1 -- 172.21.15.6:0/2463992524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fd150 msgr2=0x7f82780f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.629+0000 7f82800e5700 1 --2- 172.21.15.6:0/2463992524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fd150 0x7f82780f6930 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f82740047f0 tx=0x7f8274009cb0).stop 2024-03-12T16:23:31.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.629+0000 7f82800e5700 1 -- 172.21.15.6:0/2463992524 shutdown_connections 2024-03-12T16:23:31.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.629+0000 7f82800e5700 1 --2- 172.21.15.6:0/2463992524 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fd150 0x7f82780f6930 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.629+0000 7f82800e5700 1 --2- 172.21.15.6:0/2463992524 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82780fc7f0 0x7f82780fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.629+0000 7f82800e5700 1 -- 172.21.15.6:0/2463992524 >> 172.21.15.6:0/2463992524 conn(0x7f8278070590 msgr2=0x7f82780f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.629+0000 7f82800e5700 1 -- 172.21.15.6:0/2463992524 shutdown_connections 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.629+0000 7f82800e5700 1 -- 172.21.15.6:0/2463992524 wait complete. 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f82800e5700 1 Processor -- start 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f82800e5700 1 -- start start 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f82800e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fc7f0 0x7f82780f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f82800e5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82780fd150 0x7f82780f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f82800e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780f8f20 con 0x7f82780fc7f0 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f82800e5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f82780f9060 con 0x7f82780fd150 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f827de81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fc7f0 0x7f82780f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f827de81700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fc7f0 0x7f82780f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57420/0 (socket says 172.21.15.6:57420) 2024-03-12T16:23:31.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f827de81700 1 -- 172.21.15.6:0/3043878455 learned_addr learned my addr 172.21.15.6:0/3043878455 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:23:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f827de81700 1 -- 172.21.15.6:0/3043878455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82780fd150 msgr2=0x7f82780f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f827d680700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82780fd150 0x7f82780f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f827de81700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82780fd150 0x7f82780f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.630+0000 7f827de81700 1 -- 172.21.15.6:0/3043878455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8274005040 con 0x7f82780fc7f0 2024-03-12T16:23:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.631+0000 7f827de81700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fc7f0 0x7f82780f8540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f826c0041d0 tx=0x7f826c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:31.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.631+0000 7f826affd700 1 -- 172.21.15.6:0/3043878455 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f826c002d90 con 0x7f82780fc7f0 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.631+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f82780f9310 con 0x7f82780fc7f0 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.631+0000 7f826affd700 1 -- 172.21.15.6:0/3043878455 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f826c00f040 con 0x7f82780fc7f0 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.631+0000 7f826affd700 1 -- 172.21.15.6:0/3043878455 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f826c00d800 con 0x7f82780fc7f0 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.631+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f82781146a0 con 0x7f82780fc7f0 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.632+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f827805f590 con 0x7f82780fc7f0 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.632+0000 7f826affd700 1 -- 172.21.15.6:0/3043878455 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f826c00dac0 con 0x7f82780fc7f0 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.633+0000 7f826affd700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f826406caa0 0x7f826406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.633+0000 7f826affd700 1 -- 172.21.15.6:0/3043878455 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f826c08bde0 con 0x7f82780fc7f0 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.633+0000 7f827d680700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f826406caa0 0x7f826406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:31.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.633+0000 7f827d680700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f826406caa0 0x7f826406ef60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f8274000c00 tx=0x7f827400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:31.639 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.638+0000 7f826affd700 1 -- 172.21.15.6:0/3043878455 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f826c055eb0 con 0x7f82780fc7f0 2024-03-12T16:23:31.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:31 smithi134 ceph-mon[85099]: pgmap v308: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:31.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:31 smithi006 ceph-mon[103869]: pgmap v308: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:31.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.843+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f82780fb5a0 con 0x7f826406caa0 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.853+0000 7f826affd700 1 -- 172.21.15.6:0/3043878455 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f82780fb5a0 con 0x7f826406caa0 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (10m) 4m ago 21m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (8m) 4m ago 21m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (8m) 3m ago 20m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (10m) 4m ago 21m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (4m) 4m ago 16m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (4m) 4m ago 16m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (3m) 3m ago 16m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:23:31.855 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (3m) 3m ago 15m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (11m) 4m ago 22m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (11m) 3m ago 20m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (9m) 4m ago 22m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (8m) 3m ago 20m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (10m) 4m ago 20m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (10m) 3m ago 20m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (7m) 4m ago 20m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (7m) 4m ago 19m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (6m) 4m ago 19m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (5m) 3m ago 18m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (5m) 3m ago 18m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (4m) 3m ago 17m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:23:31.856 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (10m) 3m ago 19m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:23:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f826406caa0 msgr2=0x7f826406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f826406caa0 0x7f826406ef60 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 rx=0x7f8274000c00 tx=0x7f827400b040).stop 2024-03-12T16:23:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fc7f0 msgr2=0x7f82780f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fc7f0 0x7f82780f8540 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f826c0041d0 tx=0x7f826c009f60).stop 2024-03-12T16:23:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 shutdown_connections 2024-03-12T16:23:31.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f826406caa0 0x7f826406ef60 unknown :-1 s=CLOSED pgs=146 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82780fc7f0 0x7f82780f8540 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 --2- 172.21.15.6:0/3043878455 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82780fd150 0x7f82780f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 >> 172.21.15.6:0/3043878455 conn(0x7f8278070590 msgr2=0x7f8278060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 shutdown_connections 2024-03-12T16:23:31.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.855+0000 7f82800e5700 1 -- 172.21.15.6:0/3043878455 wait complete. 2024-03-12T16:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.961+0000 7fa66db14700 1 -- 172.21.15.6:0/1159540379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fd8f0 msgr2=0x7fa6680fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.961+0000 7fa66db14700 1 --2- 172.21.15.6:0/1159540379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fd8f0 0x7fa6680fdcd0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 rx=0x7fa65c0047f0 tx=0x7fa65c009cb0).stop 2024-03-12T16:23:31.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.961+0000 7fa66db14700 1 -- 172.21.15.6:0/1159540379 shutdown_connections 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.961+0000 7fa66db14700 1 --2- 172.21.15.6:0/1159540379 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6680fe250 0x7fa6680f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.961+0000 7fa66db14700 1 --2- 172.21.15.6:0/1159540379 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fd8f0 0x7fa6680fdcd0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.961+0000 7fa66db14700 1 -- 172.21.15.6:0/1159540379 >> 172.21.15.6:0/1159540379 conn(0x7fa6680f34b0 msgr2=0x7fa6680f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.961+0000 7fa66db14700 1 -- 172.21.15.6:0/1159540379 shutdown_connections 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.961+0000 7fa66db14700 1 -- 172.21.15.6:0/1159540379 wait complete. 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.961+0000 7fa66db14700 1 Processor -- start 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa66db14700 1 -- start start 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa66db14700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6680fd8f0 0x7fa66806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa66db14700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fe250 0x7fa66806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa66db14700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66806bab0 con 0x7fa6680fe250 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa66db14700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa66806bbf0 con 0x7fa6680fd8f0 2024-03-12T16:23:31.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa666ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fe250 0x7fa66806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:31.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa666ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fe250 0x7fa66806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57448/0 (socket says 172.21.15.6:57448) 2024-03-12T16:23:31.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa666ffd700 1 -- 172.21.15.6:0/2293963881 learned_addr learned my addr 172.21.15.6:0/2293963881 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:23:31.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa6677fe700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6680fd8f0 0x7fa66806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:31.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa666ffd700 1 -- 172.21.15.6:0/2293963881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6680fd8f0 msgr2=0x7fa66806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:31.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa666ffd700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6680fd8f0 0x7fa66806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:31.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa666ffd700 1 -- 172.21.15.6:0/2293963881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa65c005040 con 0x7fa6680fe250 2024-03-12T16:23:31.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.962+0000 7fa666ffd700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fe250 0x7fa66806b5c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fa65800c790 tx=0x7fa658007f70).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:31.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.963+0000 7fa664ff9700 1 -- 172.21.15.6:0/2293963881 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa6580106f0 con 0x7fa6680fe250 2024-03-12T16:23:31.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.963+0000 7fa664ff9700 1 -- 172.21.15.6:0/2293963881 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa658010d00 con 0x7fa6680fe250 2024-03-12T16:23:31.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.963+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa66806bea0 con 0x7fa6680fe250 2024-03-12T16:23:31.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.963+0000 7fa664ff9700 1 -- 172.21.15.6:0/2293963881 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa658012cf0 con 0x7fa6680fe250 2024-03-12T16:23:31.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.963+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa6681146c0 con 0x7fa6680fe250 2024-03-12T16:23:31.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.963+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa66805f590 con 0x7fa6680fe250 2024-03-12T16:23:31.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.964+0000 7fa664ff9700 1 -- 172.21.15.6:0/2293963881 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa658012400 con 0x7fa6680fe250 2024-03-12T16:23:31.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.964+0000 7fa664ff9700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa65006caa0 0x7fa65006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:31.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.965+0000 7fa664ff9700 1 -- 172.21.15.6:0/2293963881 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa65808b570 con 0x7fa6680fe250 2024-03-12T16:23:31.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.965+0000 7fa6677fe700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa65006caa0 0x7fa65006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:31.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.965+0000 7fa6677fe700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa65006caa0 0x7fa65006ef60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa65c004f10 tx=0x7fa65c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:31.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:31.970+0000 7fa664ff9700 1 -- 172.21.15.6:0/2293963881 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa658055640 con 0x7fa6680fe250 2024-03-12T16:23:32.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.247+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa66806c650 con 0x7fa6680fe250 2024-03-12T16:23:32.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.248+0000 7fa664ff9700 1 -- 172.21.15.6:0/2293963881 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fa658058c60 con 0x7fa6680fe250 2024-03-12T16:23:32.250 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:23:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:23:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:23:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:23:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:23:32.250 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:23:32.251 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:23:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa65006caa0 msgr2=0x7fa65006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa65006caa0 0x7fa65006ef60 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 rx=0x7fa65c004f10 tx=0x7fa65c00b040).stop 2024-03-12T16:23:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fe250 msgr2=0x7fa66806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fe250 0x7fa66806b5c0 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fa65800c790 tx=0x7fa658007f70).stop 2024-03-12T16:23:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 shutdown_connections 2024-03-12T16:23:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa6680fd8f0 0x7fa66806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa65006caa0 0x7fa65006ef60 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 --2- 172.21.15.6:0/2293963881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa6680fe250 0x7fa66806b5c0 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 >> 172.21.15.6:0/2293963881 conn(0x7fa6680f34b0 msgr2=0x7fa6680fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:32.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 shutdown_connections 2024-03-12T16:23:32.253 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.251+0000 7fa66db14700 1 -- 172.21.15.6:0/2293963881 wait complete. 2024-03-12T16:23:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 -- 172.21.15.6:0/3516852941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 msgr2=0x7f40a80fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 --2- 172.21.15.6:0/3516852941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 0x7f40a80fdcf0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7f409c0047f0 tx=0x7f409c009cb0).stop 2024-03-12T16:23:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 -- 172.21.15.6:0/3516852941 shutdown_connections 2024-03-12T16:23:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 --2- 172.21.15.6:0/3516852941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40a80fe270 0x7f40a80f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 --2- 172.21.15.6:0/3516852941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 0x7f40a80fdcf0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 -- 172.21.15.6:0/3516852941 >> 172.21.15.6:0/3516852941 conn(0x7f40a80f3530 msgr2=0x7f40a80f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 -- 172.21.15.6:0/3516852941 shutdown_connections 2024-03-12T16:23:32.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 -- 172.21.15.6:0/3516852941 wait complete. 2024-03-12T16:23:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 Processor -- start 2024-03-12T16:23:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.353+0000 7f40aeeef700 1 -- start start 2024-03-12T16:23:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40aeeef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 0x7f40a810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40aeeef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40a80fe270 0x7f40a810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:32.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40aeeef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a810ead0 con 0x7f40a80fd910 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40aeeef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f40a810ec10 con 0x7f40a80fe270 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40acc8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 0x7f40a810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40acc8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 0x7f40a810dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:57470/0 (socket says 172.21.15.6:57470) 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40acc8b700 1 -- 172.21.15.6:0/1233587399 learned_addr learned my addr 172.21.15.6:0/1233587399 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40a7fff700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40a80fe270 0x7f40a810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40acc8b700 1 -- 172.21.15.6:0/1233587399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40a80fe270 msgr2=0x7f40a810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40acc8b700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40a80fe270 0x7f40a810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40acc8b700 1 -- 172.21.15.6:0/1233587399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f409c005040 con 0x7f40a80fd910 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40a7fff700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40a80fe270 0x7f40a810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40acc8b700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 0x7f40a810dfe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f409c00b120 tx=0x7f409c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40a5ffb700 1 -- 172.21.15.6:0/1233587399 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409c00e030 con 0x7f40a80fd910 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40a5ffb700 1 -- 172.21.15.6:0/1233587399 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f409c007e90 con 0x7f40a80fd910 2024-03-12T16:23:32.358 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f40a8108240 con 0x7f40a80fd910 2024-03-12T16:23:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.354+0000 7f40a5ffb700 1 -- 172.21.15.6:0/1233587399 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f409c018070 con 0x7f40a80fd910 2024-03-12T16:23:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.355+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f40a81087a0 con 0x7f40a80fd910 2024-03-12T16:23:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.355+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f40a805f570 con 0x7f40a80fd910 2024-03-12T16:23:32.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.356+0000 7f40a5ffb700 1 -- 172.21.15.6:0/1233587399 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f409c01d420 con 0x7f40a80fd910 2024-03-12T16:23:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.356+0000 7f40a5ffb700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f409806caa0 0x7f409806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.357+0000 7f40a5ffb700 1 -- 172.21.15.6:0/1233587399 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f409c08d300 con 0x7f40a80fd910 2024-03-12T16:23:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.357+0000 7f40a7fff700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f409806caa0 0x7f409806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:32.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.357+0000 7f40a7fff700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f409806caa0 0x7f409806ef60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4094007fd0 tx=0x7f4094009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:32.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.361+0000 7f40a5ffb700 1 -- 172.21.15.6:0/1233587399 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f409c05ada0 con 0x7f40a80fd910 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.603+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f40a8109760 con 0x7f40a80fd910 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.604+0000 7f40a5ffb700 1 -- 172.21.15.6:0/1233587399 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f409c05a930 con 0x7f40a80fd910 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:23:32.606 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:23:32.607 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:23:32.608 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:23:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f409806caa0 msgr2=0x7f409806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f409806caa0 0x7f409806ef60 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 rx=0x7f4094007fd0 tx=0x7f4094009040).stop 2024-03-12T16:23:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 msgr2=0x7f40a810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 0x7f40a810dfe0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7f409c00b120 tx=0x7f409c009cb0).stop 2024-03-12T16:23:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 shutdown_connections 2024-03-12T16:23:32.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f409806caa0 0x7f409806ef60 unknown :-1 s=CLOSED pgs=148 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f40a80fd910 0x7f40a810dfe0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 --2- 172.21.15.6:0/1233587399 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f40a80fe270 0x7f40a810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 >> 172.21.15.6:0/1233587399 conn(0x7f40a80f3530 msgr2=0x7f40a80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 shutdown_connections 2024-03-12T16:23:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.606+0000 7f40aeeef700 1 -- 172.21.15.6:0/1233587399 wait complete. 2024-03-12T16:23:32.610 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:23:32.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:32 smithi134 ceph-mon[85099]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:32.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:32 smithi134 ceph-mon[85099]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:32.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:23:32.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:32 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2293963881' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:23:32.706 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:32 smithi006 ceph-mon[103869]: from='client.34612 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:32 smithi006 ceph-mon[103869]: from='client.34616 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:23:32.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:32 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2293963881' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:23:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.709+0000 7f89be249700 1 -- 172.21.15.6:0/3699473730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 msgr2=0x7f89b80f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.709+0000 7f89be249700 1 --2- 172.21.15.6:0/3699473730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 0x7f89b80f7a50 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f89a00047f0 tx=0x7f89a0009cb0).stop 2024-03-12T16:23:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.709+0000 7f89be249700 1 -- 172.21.15.6:0/3699473730 shutdown_connections 2024-03-12T16:23:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.709+0000 7f89be249700 1 --2- 172.21.15.6:0/3699473730 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 0x7f89b80f7a50 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.709+0000 7f89be249700 1 --2- 172.21.15.6:0/3699473730 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89b80fd910 0x7f89b80fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.709+0000 7f89be249700 1 -- 172.21.15.6:0/3699473730 >> 172.21.15.6:0/3699473730 conn(0x7f89b80f3530 msgr2=0x7f89b80f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.709+0000 7f89be249700 1 -- 172.21.15.6:0/3699473730 shutdown_connections 2024-03-12T16:23:32.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.709+0000 7f89be249700 1 -- 172.21.15.6:0/3699473730 wait complete. 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89be249700 1 Processor -- start 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89be249700 1 -- start start 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89be249700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89b80fd910 0x7f89b81101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89be249700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 0x7f89b81106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89be249700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8110cc0 con 0x7f89b80fe270 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89be249700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f89b8110e00 con 0x7f89b80fd910 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89b6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 0x7f89b81106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89b6ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 0x7f89b81106c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34774/0 (socket says 172.21.15.6:34774) 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89b6ffd700 1 -- 172.21.15.6:0/948963141 learned_addr learned my addr 172.21.15.6:0/948963141 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.710+0000 7f89b77fe700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89b80fd910 0x7f89b81101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.711+0000 7f89b6ffd700 1 -- 172.21.15.6:0/948963141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89b80fd910 msgr2=0x7f89b81101d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.711+0000 7f89b6ffd700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89b80fd910 0x7f89b81101d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.711+0000 7f89b6ffd700 1 -- 172.21.15.6:0/948963141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f89a0005040 con 0x7f89b80fe270 2024-03-12T16:23:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.711+0000 7f89b6ffd700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 0x7f89b81106c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f89a00099f0 tx=0x7f89a0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.711+0000 7f89b4ff9700 1 -- 172.21.15.6:0/948963141 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a000e030 con 0x7f89b80fe270 2024-03-12T16:23:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.711+0000 7f89b4ff9700 1 -- 172.21.15.6:0/948963141 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f89a0007e90 con 0x7f89b80fe270 2024-03-12T16:23:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.711+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f89b810a430 con 0x7f89b80fe270 2024-03-12T16:23:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.711+0000 7f89b4ff9700 1 -- 172.21.15.6:0/948963141 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f89a0018070 con 0x7f89b80fe270 2024-03-12T16:23:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.711+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f89b810a910 con 0x7f89b80fe270 2024-03-12T16:23:32.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.712+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f89b805f570 con 0x7f89b80fe270 2024-03-12T16:23:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.712+0000 7f89b4ff9700 1 -- 172.21.15.6:0/948963141 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f89a0009590 con 0x7f89b80fe270 2024-03-12T16:23:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.713+0000 7f89b4ff9700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f89a406ca30 0x7f89a406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.713+0000 7f89b4ff9700 1 -- 172.21.15.6:0/948963141 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f89a008d030 con 0x7f89b80fe270 2024-03-12T16:23:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.713+0000 7f89b77fe700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f89a406ca30 0x7f89a406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:32.716 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.713+0000 7f89b77fe700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f89a406ca30 0x7f89a406eef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f89a8007f70 tx=0x7f89a8004d80).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:32.719 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.718+0000 7f89b4ff9700 1 -- 172.21.15.6:0/948963141 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f89a005ab90 con 0x7f89b80fe270 2024-03-12T16:23:32.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.936+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f89b80ffc60 con 0x7f89a406ca30 2024-03-12T16:23:32.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.937+0000 7f89b4ff9700 1 -- 172.21.15.6:0/948963141 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f89b80ffc60 con 0x7f89a406ca30 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:23:32.940 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f89a406ca30 msgr2=0x7f89a406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f89a406ca30 0x7f89a406eef0 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 rx=0x7f89a8007f70 tx=0x7f89a8004d80).stop 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 msgr2=0x7f89b81106c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 0x7f89b81106c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f89a00099f0 tx=0x7f89a0009cb0).stop 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 shutdown_connections 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f89b80fd910 0x7f89b81101d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f89a406ca30 0x7f89a406eef0 unknown :-1 s=CLOSED pgs=149 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 --2- 172.21.15.6:0/948963141 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f89b80fe270 0x7f89b81106c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 >> 172.21.15.6:0/948963141 conn(0x7f89b80f3530 msgr2=0x7f89b80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 shutdown_connections 2024-03-12T16:23:32.942 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:32.940+0000 7f89be249700 1 -- 172.21.15.6:0/948963141 wait complete. 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.042+0000 7f087e93c700 1 -- 172.21.15.6:0/1081842794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 msgr2=0x7f08780f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.042+0000 7f087e93c700 1 --2- 172.21.15.6:0/1081842794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 0x7f08780f8c80 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f08680047f0 tx=0x7f0868009cb0).stop 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.042+0000 7f087e93c700 1 -- 172.21.15.6:0/1081842794 shutdown_connections 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.042+0000 7f087e93c700 1 --2- 172.21.15.6:0/1081842794 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08780f9200 0x7f0878101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.042+0000 7f087e93c700 1 --2- 172.21.15.6:0/1081842794 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 0x7f08780f8c80 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.042+0000 7f087e93c700 1 -- 172.21.15.6:0/1081842794 >> 172.21.15.6:0/1081842794 conn(0x7f0878070590 msgr2=0x7f08780f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.042+0000 7f087e93c700 1 -- 172.21.15.6:0/1081842794 shutdown_connections 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.042+0000 7f087e93c700 1 -- 172.21.15.6:0/1081842794 wait complete. 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.043+0000 7f087e93c700 1 Processor -- start 2024-03-12T16:23:33.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.043+0000 7f087e93c700 1 -- start start 2024-03-12T16:23:33.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.043+0000 7f087e93c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 0x7f08780f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:33.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.043+0000 7f087e93c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08780f9200 0x7f08780f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:33.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.043+0000 7f087e93c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780f7230 con 0x7f08780f88a0 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.043+0000 7f087e93c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f08780f7370 con 0x7f08780f9200 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.043+0000 7f0877fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 0x7f08780f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.043+0000 7f0877fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 0x7f08780f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34796/0 (socket says 172.21.15.6:34796) 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.043+0000 7f0877fff700 1 -- 172.21.15.6:0/1745720164 learned_addr learned my addr 172.21.15.6:0/1745720164 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f08777fe700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08780f9200 0x7f08780f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f0877fff700 1 -- 172.21.15.6:0/1745720164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08780f9200 msgr2=0x7f08780f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f0877fff700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08780f9200 0x7f08780f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f0877fff700 1 -- 172.21.15.6:0/1745720164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0868005040 con 0x7f08780f88a0 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f08777fe700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08780f9200 0x7f08780f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f0877fff700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 0x7f08780f6850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f08680043a0 tx=0x7f0868009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f08757fa700 1 -- 172.21.15.6:0/1745720164 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f086800e030 con 0x7f08780f88a0 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f08757fa700 1 -- 172.21.15.6:0/1745720164 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0868007e90 con 0x7f08780f88a0 2024-03-12T16:23:33.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f08780f75c0 con 0x7f08780f88a0 2024-03-12T16:23:33.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f08757fa700 1 -- 172.21.15.6:0/1745720164 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0868018070 con 0x7f08780f88a0 2024-03-12T16:23:33.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.044+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0878114650 con 0x7f08780f88a0 2024-03-12T16:23:33.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.045+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f087805f590 con 0x7f08780f88a0 2024-03-12T16:23:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.046+0000 7f08757fa700 1 -- 172.21.15.6:0/1745720164 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f0868009590 con 0x7f08780f88a0 2024-03-12T16:23:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.046+0000 7f08757fa700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f086006ca40 0x7f086006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:23:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.046+0000 7f08757fa700 1 -- 172.21.15.6:0/1745720164 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f086808d0d0 con 0x7f08780f88a0 2024-03-12T16:23:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.046+0000 7f08777fe700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f086006ca40 0x7f086006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:23:33.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.046+0000 7f08777fe700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f086006ca40 0x7f086006ef00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f08780f7ff0 tx=0x7f086c009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:23:33.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.050+0000 7f08757fa700 1 -- 172.21.15.6:0/1745720164 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f08680571a0 con 0x7f08780f88a0 2024-03-12T16:23:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.333+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f08780fee10 con 0x7f08780f88a0 2024-03-12T16:23:33.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.334+0000 7f08757fa700 1 -- 172.21.15.6:0/1745720164 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f086805a7c0 con 0x7f08780f88a0 2024-03-12T16:23:33.335 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:23:33.335 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:23:33.335 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:23:33.335 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:23:33.335 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f086006ca40 msgr2=0x7f086006ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f086006ca40 0x7f086006ef00 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 rx=0x7f08780f7ff0 tx=0x7f086c009da0).stop 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 msgr2=0x7f08780f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 0x7f08780f6850 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f08680043a0 tx=0x7f0868009cb0).stop 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 shutdown_connections 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f086006ca40 0x7f086006ef00 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f08780f88a0 0x7f08780f6850 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 --2- 172.21.15.6:0/1745720164 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f08780f9200 0x7f08780f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 >> 172.21.15.6:0/1745720164 conn(0x7f0878070590 msgr2=0x7f08780fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:23:33.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 shutdown_connections 2024-03-12T16:23:33.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:23:33.336+0000 7f087e93c700 1 -- 172.21.15.6:0/1745720164 wait complete. 2024-03-12T16:23:33.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:33 smithi134 ceph-mon[85099]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:33.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:33 smithi134 ceph-mon[85099]: pgmap v309: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:33.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:33 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1233587399' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:23:33.704 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:33 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1745720164' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:23:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:33 smithi006 ceph-mon[103869]: from='client.34620 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:33 smithi006 ceph-mon[103869]: pgmap v309: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:33 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1233587399' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:23:33.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:33 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1745720164' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:23:34.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:34 smithi134 ceph-mon[85099]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:34.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:34 smithi006 ceph-mon[103869]: from='client.34632 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:23:35.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:35 smithi134 ceph-mon[85099]: pgmap v310: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:35.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:35 smithi006 ceph-mon[103869]: pgmap v310: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:37.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:37 smithi134 ceph-mon[85099]: pgmap v311: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:37.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:37 smithi006 ceph-mon[103869]: pgmap v311: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:39.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:39 smithi134 ceph-mon[85099]: pgmap v312: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:39.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:39 smithi006 ceph-mon[103869]: pgmap v312: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:41.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:41 smithi134 ceph-mon[85099]: pgmap v313: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:41.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:41 smithi006 ceph-mon[103869]: pgmap v313: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:43.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:43 smithi134 ceph-mon[85099]: pgmap v314: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:43.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:43 smithi006 ceph-mon[103869]: pgmap v314: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:45.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:45 smithi134 ceph-mon[85099]: pgmap v315: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:45.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:45 smithi006 ceph-mon[103869]: pgmap v315: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:47 smithi134 ceph-mon[85099]: pgmap v316: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:47.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:23:47.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:47 smithi006 ceph-mon[103869]: pgmap v316: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:47.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:23:49.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:49 smithi134 ceph-mon[85099]: pgmap v317: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:49.706 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:49 smithi006 ceph-mon[103869]: pgmap v317: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:51.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:51 smithi134 ceph-mon[85099]: pgmap v318: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:51.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:51 smithi006 ceph-mon[103869]: pgmap v318: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:53.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:53 smithi134 ceph-mon[85099]: pgmap v319: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:53.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:53 smithi006 ceph-mon[103869]: pgmap v319: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:55.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:55 smithi134 ceph-mon[85099]: pgmap v320: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:55.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:55 smithi006 ceph-mon[103869]: pgmap v320: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:57.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:57 smithi134 ceph-mon[85099]: pgmap v321: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:57.706 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:57 smithi006 ceph-mon[103869]: pgmap v321: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:59.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:23:59 smithi134 ceph-mon[85099]: pgmap v322: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:23:59.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:23:59 smithi006 ceph-mon[103869]: pgmap v322: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:01.707 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:01 smithi006 ceph-mon[103869]: pgmap v323: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:01 smithi134 ceph-mon[85099]: pgmap v323: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:02.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:24:02.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:24:03.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.452+0000 7f60bb8d3700 1 -- 172.21.15.6:0/981143306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 msgr2=0x7f60b40fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:03.453 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.452+0000 7f60bb8d3700 1 --2- 172.21.15.6:0/981143306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 0x7f60b40fdcd0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 rx=0x7f60a40047f0 tx=0x7f60a4009cb0).stop 2024-03-12T16:24:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.452+0000 7f60bb8d3700 1 -- 172.21.15.6:0/981143306 shutdown_connections 2024-03-12T16:24:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.452+0000 7f60bb8d3700 1 --2- 172.21.15.6:0/981143306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b40fe250 0x7f60b40f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.452+0000 7f60bb8d3700 1 --2- 172.21.15.6:0/981143306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 0x7f60b40fdcd0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.452+0000 7f60bb8d3700 1 -- 172.21.15.6:0/981143306 >> 172.21.15.6:0/981143306 conn(0x7f60b40f34b0 msgr2=0x7f60b40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.452+0000 7f60bb8d3700 1 -- 172.21.15.6:0/981143306 shutdown_connections 2024-03-12T16:24:03.454 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.452+0000 7f60bb8d3700 1 -- 172.21.15.6:0/981143306 wait complete. 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60bb8d3700 1 Processor -- start 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60bb8d3700 1 -- start start 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60bb8d3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 0x7f60b410e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60bb8d3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b40fe250 0x7f60b410e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60bb8d3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b410eaf0 con 0x7f60b40fd8f0 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60bb8d3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f60b410ec30 con 0x7f60b40fe250 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60b966f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 0x7f60b410e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60b966f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 0x7f60b410e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49376/0 (socket says 172.21.15.6:49376) 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60b966f700 1 -- 172.21.15.6:0/2777935157 learned_addr learned my addr 172.21.15.6:0/2777935157 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.453+0000 7f60b8e6e700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b40fe250 0x7f60b410e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60b966f700 1 -- 172.21.15.6:0/2777935157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b40fe250 msgr2=0x7f60b410e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:03.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60b966f700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b40fe250 0x7f60b410e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60b966f700 1 -- 172.21.15.6:0/2777935157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f60a4005040 con 0x7f60b40fd8f0 2024-03-12T16:24:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60b8e6e700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b40fe250 0x7f60b410e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:24:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60b966f700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 0x7f60b410e000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f60a4005010 tx=0x7f60a4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60aa7fc700 1 -- 172.21.15.6:0/2777935157 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a400e030 con 0x7f60b40fd8f0 2024-03-12T16:24:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60aa7fc700 1 -- 172.21.15.6:0/2777935157 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f60a4007e90 con 0x7f60b40fd8f0 2024-03-12T16:24:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f60b4108260 con 0x7f60b40fd8f0 2024-03-12T16:24:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60aa7fc700 1 -- 172.21.15.6:0/2777935157 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f60a4018070 con 0x7f60b40fd8f0 2024-03-12T16:24:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.454+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f60b41087c0 con 0x7f60b40fd8f0 2024-03-12T16:24:03.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.455+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f60b405f590 con 0x7f60b40fd8f0 2024-03-12T16:24:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.456+0000 7f60aa7fc700 1 -- 172.21.15.6:0/2777935157 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f60a401d6e0 con 0x7f60b40fd8f0 2024-03-12T16:24:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.456+0000 7f60aa7fc700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60a006caa0 0x7f60a006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.456+0000 7f60aa7fc700 1 -- 172.21.15.6:0/2777935157 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f60a408cfa0 con 0x7f60b40fd8f0 2024-03-12T16:24:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.456+0000 7f60b8e6e700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60a006caa0 0x7f60a006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:03.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.457+0000 7f60b8e6e700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60a006caa0 0x7f60a006ef60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f60b4109940 tx=0x7f60b0009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:03.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.461+0000 7f60aa7fc700 1 -- 172.21.15.6:0/2777935157 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f60a405abc0 con 0x7f60b40fd8f0 2024-03-12T16:24:03.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.677+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f60b40ffc40 con 0x7f60a006caa0 2024-03-12T16:24:03.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.678+0000 7f60aa7fc700 1 -- 172.21.15.6:0/2777935157 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f60b40ffc40 con 0x7f60a006caa0 2024-03-12T16:24:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60a006caa0 msgr2=0x7f60a006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60a006caa0 0x7f60a006ef60 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 rx=0x7f60b4109940 tx=0x7f60b0009da0).stop 2024-03-12T16:24:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 msgr2=0x7f60b410e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 0x7f60b410e000 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f60a4005010 tx=0x7f60a4009cb0).stop 2024-03-12T16:24:03.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 shutdown_connections 2024-03-12T16:24:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60a006caa0 0x7f60a006ef60 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f60b40fd8f0 0x7f60b410e000 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 --2- 172.21.15.6:0/2777935157 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f60b40fe250 0x7f60b410e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 >> 172.21.15.6:0/2777935157 conn(0x7f60b40f34b0 msgr2=0x7f60b40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 shutdown_connections 2024-03-12T16:24:03.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.680+0000 7f60bb8d3700 1 -- 172.21.15.6:0/2777935157 wait complete. 2024-03-12T16:24:03.691 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:24:03.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.783+0000 7f30fbae0700 1 -- 172.21.15.6:0/3228368529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 msgr2=0x7f30f40fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:03.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.783+0000 7f30fbae0700 1 --2- 172.21.15.6:0/3228368529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 0x7f30f40fdcf0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7f30f00047f0 tx=0x7f30f0009cb0).stop 2024-03-12T16:24:03.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.783+0000 7f30fbae0700 1 -- 172.21.15.6:0/3228368529 shutdown_connections 2024-03-12T16:24:03.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.783+0000 7f30fbae0700 1 --2- 172.21.15.6:0/3228368529 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30f40fe270 0x7f30f40f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:03.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.783+0000 7f30fbae0700 1 --2- 172.21.15.6:0/3228368529 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 0x7f30f40fdcf0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:03.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.783+0000 7f30fbae0700 1 -- 172.21.15.6:0/3228368529 >> 172.21.15.6:0/3228368529 conn(0x7f30f40f3530 msgr2=0x7f30f40f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:03.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.784+0000 7f30fbae0700 1 -- 172.21.15.6:0/3228368529 shutdown_connections 2024-03-12T16:24:03.785 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.784+0000 7f30fbae0700 1 -- 172.21.15.6:0/3228368529 wait complete. 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.784+0000 7f30fbae0700 1 Processor -- start 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.784+0000 7f30fbae0700 1 -- start start 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.784+0000 7f30fbae0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 0x7f30f410e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.784+0000 7f30fbae0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30f40fe270 0x7f30f410e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.784+0000 7f30fbae0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f410eba0 con 0x7f30f40fd910 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.784+0000 7f30fbae0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f30f410ece0 con 0x7f30f40fe270 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30f987c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 0x7f30f410e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30f987c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 0x7f30f410e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49392/0 (socket says 172.21.15.6:49392) 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30f987c700 1 -- 172.21.15.6:0/4216148752 learned_addr learned my addr 172.21.15.6:0/4216148752 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30f907b700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30f40fe270 0x7f30f410e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30f987c700 1 -- 172.21.15.6:0/4216148752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30f40fe270 msgr2=0x7f30f410e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:03.787 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30f987c700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30f40fe270 0x7f30f410e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:03.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30f987c700 1 -- 172.21.15.6:0/4216148752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f30f0005040 con 0x7f30f40fd910 2024-03-12T16:24:03.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30f987c700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 0x7f30f410e0b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f30f0005010 tx=0x7f30f0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:03.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30e6f78700 1 -- 172.21.15.6:0/4216148752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f000e030 con 0x7f30f40fd910 2024-03-12T16:24:03.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30e6f78700 1 -- 172.21.15.6:0/4216148752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f30f0007e90 con 0x7f30f40fd910 2024-03-12T16:24:03.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f30f4108310 con 0x7f30f40fd910 2024-03-12T16:24:03.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30e6f78700 1 -- 172.21.15.6:0/4216148752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f30f0018070 con 0x7f30f40fd910 2024-03-12T16:24:03.788 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.785+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f30f41087f0 con 0x7f30f40fd910 2024-03-12T16:24:03.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.786+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f30f405f570 con 0x7f30f40fd910 2024-03-12T16:24:03.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.787+0000 7f30e6f78700 1 -- 172.21.15.6:0/4216148752 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f30f001d670 con 0x7f30f40fd910 2024-03-12T16:24:03.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.787+0000 7f30e6f78700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f30e006caa0 0x7f30e006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:03.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.787+0000 7f30e6f78700 1 -- 172.21.15.6:0/4216148752 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f30f008cf40 con 0x7f30f40fd910 2024-03-12T16:24:03.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.787+0000 7f30f907b700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f30e006caa0 0x7f30e006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:03.789 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.788+0000 7f30f907b700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f30e006caa0 0x7f30e006ef60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f30f41099f0 tx=0x7f30e800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:03.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:03.792+0000 7f30e6f78700 1 -- 172.21.15.6:0/4216148752 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f30f00c0190 con 0x7f30f40fd910 2024-03-12T16:24:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:03 smithi134 ceph-mon[85099]: pgmap v324: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:03.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:03 smithi006 ceph-mon[103869]: pgmap v324: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:04.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.007+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f30f4109840 con 0x7f30e006caa0 2024-03-12T16:24:04.009 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.008+0000 7f30e6f78700 1 -- 172.21.15.6:0/4216148752 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f30f4109840 con 0x7f30e006caa0 2024-03-12T16:24:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.010+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f30e006caa0 msgr2=0x7f30e006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.010+0000 7f30fbae0700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f30e006caa0 0x7f30e006ef60 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 rx=0x7f30f41099f0 tx=0x7f30e800b040).stop 2024-03-12T16:24:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.010+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 msgr2=0x7f30f410e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.010+0000 7f30fbae0700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 0x7f30f410e0b0 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f30f0005010 tx=0x7f30f0009cb0).stop 2024-03-12T16:24:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.011+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 shutdown_connections 2024-03-12T16:24:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.011+0000 7f30fbae0700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f30e006caa0 0x7f30e006ef60 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.011+0000 7f30fbae0700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f30f40fd910 0x7f30f410e0b0 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.011+0000 7f30fbae0700 1 --2- 172.21.15.6:0/4216148752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f30f40fe270 0x7f30f410e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.011+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 >> 172.21.15.6:0/4216148752 conn(0x7f30f40f3530 msgr2=0x7f30f40fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:04.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.011+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 shutdown_connections 2024-03-12T16:24:04.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.011+0000 7f30fbae0700 1 -- 172.21.15.6:0/4216148752 wait complete. 2024-03-12T16:24:04.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.112+0000 7fd1253fb700 1 -- 172.21.15.6:0/2177472024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 msgr2=0x7fd1200fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.112+0000 7fd1253fb700 1 --2- 172.21.15.6:0/2177472024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 0x7fd1200fdd50 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7fd1100047f0 tx=0x7fd110009cb0).stop 2024-03-12T16:24:04.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.112+0000 7fd1253fb700 1 -- 172.21.15.6:0/2177472024 shutdown_connections 2024-03-12T16:24:04.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.112+0000 7fd1253fb700 1 --2- 172.21.15.6:0/2177472024 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1200fe2d0 0x7fd1200f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.112+0000 7fd1253fb700 1 --2- 172.21.15.6:0/2177472024 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 0x7fd1200fdd50 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.112+0000 7fd1253fb700 1 -- 172.21.15.6:0/2177472024 >> 172.21.15.6:0/2177472024 conn(0x7fd1200f3550 msgr2=0x7fd1200f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:04.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.113+0000 7fd1253fb700 1 -- 172.21.15.6:0/2177472024 shutdown_connections 2024-03-12T16:24:04.114 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.113+0000 7fd1253fb700 1 -- 172.21.15.6:0/2177472024 wait complete. 2024-03-12T16:24:04.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.113+0000 7fd1253fb700 1 Processor -- start 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.113+0000 7fd1253fb700 1 -- start start 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd1253fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 0x7fd12006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd1253fb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1200fe2d0 0x7fd12006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd1253fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12006bab0 con 0x7fd1200fd970 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd1253fb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd12006bbf0 con 0x7fd1200fe2d0 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd11effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 0x7fd12006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd11effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 0x7fd12006b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49408/0 (socket says 172.21.15.6:49408) 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd11effd700 1 -- 172.21.15.6:0/2208119345 learned_addr learned my addr 172.21.15.6:0/2208119345 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd11e7fc700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1200fe2d0 0x7fd12006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd11effd700 1 -- 172.21.15.6:0/2208119345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1200fe2d0 msgr2=0x7fd12006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd11effd700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1200fe2d0 0x7fd12006b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd11effd700 1 -- 172.21.15.6:0/2208119345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd110005040 con 0x7fd1200fd970 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd11effd700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 0x7fd12006b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fd110005010 tx=0x7fd110009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:04.116 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd107fff700 1 -- 172.21.15.6:0/2208119345 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd11000e030 con 0x7fd1200fd970 2024-03-12T16:24:04.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd107fff700 1 -- 172.21.15.6:0/2208119345 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd110007e90 con 0x7fd1200fd970 2024-03-12T16:24:04.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd12006be40 con 0x7fd1200fd970 2024-03-12T16:24:04.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd107fff700 1 -- 172.21.15.6:0/2208119345 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd110018070 con 0x7fd1200fd970 2024-03-12T16:24:04.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.114+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd120114600 con 0x7fd1200fd970 2024-03-12T16:24:04.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.115+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd120060370 con 0x7fd1200fd970 2024-03-12T16:24:04.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.116+0000 7fd107fff700 1 -- 172.21.15.6:0/2208119345 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd11001d670 con 0x7fd1200fd970 2024-03-12T16:24:04.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.116+0000 7fd107fff700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd10806caa0 0x7fd10806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:04.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.116+0000 7fd107fff700 1 -- 172.21.15.6:0/2208119345 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd11008d010 con 0x7fd1200fd970 2024-03-12T16:24:04.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.116+0000 7fd11e7fc700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd10806caa0 0x7fd10806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:04.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.117+0000 7fd11e7fc700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd10806caa0 0x7fd10806ef60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fd12006c870 tx=0x7fd11400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:04.121 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.121+0000 7fd107fff700 1 -- 172.21.15.6:0/2208119345 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd1100570e0 con 0x7fd1200fd970 2024-03-12T16:24:04.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.326+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fd120059120 con 0x7fd10806caa0 2024-03-12T16:24:04.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.336+0000 7fd107fff700 1 -- 172.21.15.6:0/2208119345 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fd120059120 con 0x7fd10806caa0 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (10m) 4m ago 21m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (8m) 4m ago 21m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (8m) 4m ago 21m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (10m) 4m ago 21m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (5m) 4m ago 16m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (4m) 4m ago 16m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (4m) 4m ago 16m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (4m) 4m ago 16m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (12m) 4m ago 23m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (11m) 4m ago 21m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:24:04.338 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (9m) 4m ago 23m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (9m) 4m ago 21m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (11m) 4m ago 21m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (11m) 4m ago 20m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (8m) 4m ago 20m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (7m) 4m ago 20m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (7m) 4m ago 19m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (6m) 4m ago 19m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (5m) 4m ago 18m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (5m) 4m ago 18m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:24:04.339 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (11m) 4m ago 20m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.338+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd10806caa0 msgr2=0x7fd10806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.338+0000 7fd1253fb700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd10806caa0 0x7fd10806ef60 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 rx=0x7fd12006c870 tx=0x7fd11400b040).stop 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.338+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 msgr2=0x7fd12006b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.338+0000 7fd1253fb700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 0x7fd12006b0d0 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fd110005010 tx=0x7fd110009cb0).stop 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.338+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 shutdown_connections 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.338+0000 7fd1253fb700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd10806caa0 0x7fd10806ef60 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.338+0000 7fd1253fb700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd1200fd970 0x7fd12006b0d0 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.338+0000 7fd1253fb700 1 --2- 172.21.15.6:0/2208119345 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd1200fe2d0 0x7fd12006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.338+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 >> 172.21.15.6:0/2208119345 conn(0x7fd1200f3550 msgr2=0x7fd1200fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.339+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 shutdown_connections 2024-03-12T16:24:04.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.339+0000 7fd1253fb700 1 -- 172.21.15.6:0/2208119345 wait complete. 2024-03-12T16:24:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 -- 172.21.15.6:0/1255472935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 msgr2=0x7f5d300f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 --2- 172.21.15.6:0/1255472935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 0x7f5d300f7a30 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f5d200047f0 tx=0x7f5d20009cb0).stop 2024-03-12T16:24:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 -- 172.21.15.6:0/1255472935 shutdown_connections 2024-03-12T16:24:04.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 --2- 172.21.15.6:0/1255472935 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 0x7f5d300f7a30 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 --2- 172.21.15.6:0/1255472935 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d300fd8f0 0x7f5d300fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 -- 172.21.15.6:0/1255472935 >> 172.21.15.6:0/1255472935 conn(0x7f5d300f34b0 msgr2=0x7f5d300f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 -- 172.21.15.6:0/1255472935 shutdown_connections 2024-03-12T16:24:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 -- 172.21.15.6:0/1255472935 wait complete. 2024-03-12T16:24:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 Processor -- start 2024-03-12T16:24:04.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.440+0000 7f5d387ac700 1 -- start start 2024-03-12T16:24:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d387ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d300fd8f0 0x7f5d30110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:04.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d387ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 0x7f5d30110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d387ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30110d60 con 0x7f5d300fe250 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d387ac700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5d30110ea0 con 0x7f5d300fd8f0 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d35d47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 0x7f5d30110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d35d47700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 0x7f5d30110760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49422/0 (socket says 172.21.15.6:49422) 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d35d47700 1 -- 172.21.15.6:0/2676109224 learned_addr learned my addr 172.21.15.6:0/2676109224 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d36548700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d300fd8f0 0x7f5d30110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d35d47700 1 -- 172.21.15.6:0/2676109224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d300fd8f0 msgr2=0x7f5d30110270 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d35d47700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d300fd8f0 0x7f5d30110270 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d35d47700 1 -- 172.21.15.6:0/2676109224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5d20005040 con 0x7f5d300fe250 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d35d47700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 0x7f5d30110760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f5d200099f0 tx=0x7f5d20009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d277fe700 1 -- 172.21.15.6:0/2676109224 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d2000e030 con 0x7f5d300fe250 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d277fe700 1 -- 172.21.15.6:0/2676109224 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5d20007e90 con 0x7f5d300fe250 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d277fe700 1 -- 172.21.15.6:0/2676109224 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5d20018070 con 0x7f5d300fe250 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.441+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5d3010a4d0 con 0x7f5d300fe250 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.442+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5d3010a9b0 con 0x7f5d300fe250 2024-03-12T16:24:04.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.443+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5d3005f590 con 0x7f5d300fe250 2024-03-12T16:24:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.443+0000 7f5d277fe700 1 -- 172.21.15.6:0/2676109224 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5d20009590 con 0x7f5d300fe250 2024-03-12T16:24:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.443+0000 7f5d277fe700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d1c06caa0 0x7f5d1c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.443+0000 7f5d277fe700 1 -- 172.21.15.6:0/2676109224 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5d2008cf50 con 0x7f5d300fe250 2024-03-12T16:24:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.444+0000 7f5d36548700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d1c06caa0 0x7f5d1c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:04.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.444+0000 7f5d36548700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d1c06caa0 0x7f5d1c06ef60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5d2c009170 tx=0x7f5d2c009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:04.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.448+0000 7f5d277fe700 1 -- 172.21.15.6:0/2676109224 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5d200c0190 con 0x7f5d300fe250 2024-03-12T16:24:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.731+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5d30047540 con 0x7f5d300fe250 2024-03-12T16:24:04.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.731+0000 7f5d277fe700 1 -- 172.21.15.6:0/2676109224 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f5d2005a820 con 0x7f5d300fe250 2024-03-12T16:24:04.733 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:24:04.733 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:24:04.733 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:24:04.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:24:04.733 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:24:04.733 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:24:04.733 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:24:04.733 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:24:04.734 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:24:04.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:24:04.734 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:24:04.734 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:24:04.734 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:24:04.734 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:24:04.734 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:24:04.734 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:24:04.734 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:24:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.733+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d1c06caa0 msgr2=0x7f5d1c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.733+0000 7f5d387ac700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d1c06caa0 0x7f5d1c06ef60 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 rx=0x7f5d2c009170 tx=0x7f5d2c009d60).stop 2024-03-12T16:24:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.733+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 msgr2=0x7f5d30110760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.733+0000 7f5d387ac700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 0x7f5d30110760 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7f5d200099f0 tx=0x7f5d20009cb0).stop 2024-03-12T16:24:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.733+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 shutdown_connections 2024-03-12T16:24:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.733+0000 7f5d387ac700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5d300fd8f0 0x7f5d30110270 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.733+0000 7f5d387ac700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5d1c06caa0 0x7f5d1c06ef60 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.735 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.733+0000 7f5d387ac700 1 --2- 172.21.15.6:0/2676109224 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5d300fe250 0x7f5d30110760 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.733+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 >> 172.21.15.6:0/2676109224 conn(0x7f5d300f34b0 msgr2=0x7f5d300f9ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.734+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 shutdown_connections 2024-03-12T16:24:04.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.734+0000 7f5d387ac700 1 -- 172.21.15.6:0/2676109224 wait complete. 2024-03-12T16:24:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.835+0000 7f420b8d9700 1 -- 172.21.15.6:0/963532257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 msgr2=0x7f42040fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.835+0000 7f420b8d9700 1 --2- 172.21.15.6:0/963532257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 0x7f42040fcbd0 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 rx=0x7f42000047f0 tx=0x7f4200009cb0).stop 2024-03-12T16:24:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.836+0000 7f420b8d9700 1 -- 172.21.15.6:0/963532257 shutdown_connections 2024-03-12T16:24:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.836+0000 7f420b8d9700 1 --2- 172.21.15.6:0/963532257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42040fd150 0x7f42040f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.836+0000 7f420b8d9700 1 --2- 172.21.15.6:0/963532257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 0x7f42040fcbd0 unknown :-1 s=CLOSED pgs=293 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.836+0000 7f420b8d9700 1 -- 172.21.15.6:0/963532257 >> 172.21.15.6:0/963532257 conn(0x7f4204070590 msgr2=0x7f42040f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.836+0000 7f420b8d9700 1 -- 172.21.15.6:0/963532257 shutdown_connections 2024-03-12T16:24:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.836+0000 7f420b8d9700 1 -- 172.21.15.6:0/963532257 wait complete. 2024-03-12T16:24:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.836+0000 7f420b8d9700 1 Processor -- start 2024-03-12T16:24:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.836+0000 7f420b8d9700 1 -- start start 2024-03-12T16:24:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f420b8d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 0x7f42040f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f420b8d9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42040fd150 0x7f42040f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f420b8d9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42040f8f20 con 0x7f42040fc7f0 2024-03-12T16:24:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f420b8d9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42040f9060 con 0x7f42040fd150 2024-03-12T16:24:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f4209675700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 0x7f42040f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:04.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f4209675700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 0x7f42040f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49440/0 (socket says 172.21.15.6:49440) 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f4209675700 1 -- 172.21.15.6:0/3270185587 learned_addr learned my addr 172.21.15.6:0/3270185587 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f4208e74700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42040fd150 0x7f42040f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f4209675700 1 -- 172.21.15.6:0/3270185587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42040fd150 msgr2=0x7f42040f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f4209675700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42040fd150 0x7f42040f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f4209675700 1 -- 172.21.15.6:0/3270185587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4200005040 con 0x7f42040fc7f0 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f4209675700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 0x7f42040f8540 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f420000b120 tx=0x7f4200009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f41fa7fc700 1 -- 172.21.15.6:0/3270185587 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f420000e030 con 0x7f42040fc7f0 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f41fa7fc700 1 -- 172.21.15.6:0/3270185587 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4200007e90 con 0x7f42040fc7f0 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42040f92b0 con 0x7f42040fc7f0 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f41fa7fc700 1 -- 172.21.15.6:0/3270185587 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4200018070 con 0x7f42040fc7f0 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.837+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42041145d0 con 0x7f42040fc7f0 2024-03-12T16:24:04.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.838+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f420405f590 con 0x7f42040fc7f0 2024-03-12T16:24:04.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.839+0000 7f41fa7fc700 1 -- 172.21.15.6:0/3270185587 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f420001d420 con 0x7f42040fc7f0 2024-03-12T16:24:04.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.840+0000 7f41fa7fc700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f41f006caa0 0x7f41f006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:04.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.840+0000 7f41fa7fc700 1 -- 172.21.15.6:0/3270185587 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f420008d4f0 con 0x7f42040fc7f0 2024-03-12T16:24:04.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.840+0000 7f4208e74700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f41f006caa0 0x7f41f006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:04.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.840+0000 7f4208e74700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f41f006caa0 0x7f41f006ef60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f42040f9ce0 tx=0x7f41f4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:04.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:04.843+0000 7f41fa7fc700 1 -- 172.21.15.6:0/3270185587 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f42000575c0 con 0x7f42040fc7f0 2024-03-12T16:24:04.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:04 smithi134 ceph-mon[85099]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:04.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:04 smithi006 ceph-mon[103869]: from='client.34640 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:05.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.084+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f4204114be0 con 0x7f42040fc7f0 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.085+0000 7f41fa7fc700 1 -- 172.21.15.6:0/3270185587 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f420005abe0 con 0x7f42040fc7f0 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:24:05.086 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:24:05.087 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:24:05.088 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:24:05.089 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:24:05.089 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:24:05.089 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:24:05.089 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:24:05.089 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:24:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.086+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f41f006caa0 msgr2=0x7f41f006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.086+0000 7f420b8d9700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f41f006caa0 0x7f41f006ef60 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 rx=0x7f42040f9ce0 tx=0x7f41f4009040).stop 2024-03-12T16:24:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.087+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 msgr2=0x7f42040f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.087+0000 7f420b8d9700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 0x7f42040f8540 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7f420000b120 tx=0x7f4200009cb0).stop 2024-03-12T16:24:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.087+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 shutdown_connections 2024-03-12T16:24:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.087+0000 7f420b8d9700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f41f006caa0 0x7f41f006ef60 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.087+0000 7f420b8d9700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42040fc7f0 0x7f42040f8540 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.087+0000 7f420b8d9700 1 --2- 172.21.15.6:0/3270185587 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42040fd150 0x7f42040f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.087+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 >> 172.21.15.6:0/3270185587 conn(0x7f4204070590 msgr2=0x7f4204060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.087+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 shutdown_connections 2024-03-12T16:24:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.087+0000 7f420b8d9700 1 -- 172.21.15.6:0/3270185587 wait complete. 2024-03-12T16:24:05.091 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:24:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.189+0000 7f3f59f58700 1 -- 172.21.15.6:0/535356891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f9200 msgr2=0x7f3f54101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.189+0000 7f3f59f58700 1 --2- 172.21.15.6:0/535356891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f9200 0x7f3f54101910 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 rx=0x7f3f480047f0 tx=0x7f3f48009cb0).stop 2024-03-12T16:24:05.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.189+0000 7f3f59f58700 1 -- 172.21.15.6:0/535356891 shutdown_connections 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.189+0000 7f3f59f58700 1 --2- 172.21.15.6:0/535356891 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f9200 0x7f3f54101910 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.189+0000 7f3f59f58700 1 --2- 172.21.15.6:0/535356891 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f540f88a0 0x7f3f540f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.189+0000 7f3f59f58700 1 -- 172.21.15.6:0/535356891 >> 172.21.15.6:0/535356891 conn(0x7f3f54070590 msgr2=0x7f3f540f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.190+0000 7f3f59f58700 1 -- 172.21.15.6:0/535356891 shutdown_connections 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.190+0000 7f3f59f58700 1 -- 172.21.15.6:0/535356891 wait complete. 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.190+0000 7f3f59f58700 1 Processor -- start 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.190+0000 7f3f59f58700 1 -- start start 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.190+0000 7f3f59f58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f88a0 0x7f3f540f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.190+0000 7f3f59f58700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f540f9200 0x7f3f540f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f59f58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540f7230 con 0x7f3f540f88a0 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f59f58700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f540f7370 con 0x7f3f540f9200 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f88a0 0x7f3f540f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f537fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f88a0 0x7f3f540f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49458/0 (socket says 172.21.15.6:49458) 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f537fe700 1 -- 172.21.15.6:0/2771364375 learned_addr learned my addr 172.21.15.6:0/2771364375 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:05.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f52ffd700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f540f9200 0x7f3f540f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f537fe700 1 -- 172.21.15.6:0/2771364375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f540f9200 msgr2=0x7f3f540f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f537fe700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f540f9200 0x7f3f540f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f537fe700 1 -- 172.21.15.6:0/2771364375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f48005040 con 0x7f3f540f88a0 2024-03-12T16:24:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f537fe700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f88a0 0x7f3f540f6850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f3f440041d0 tx=0x7f3f44009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f50ff9700 1 -- 172.21.15.6:0/2771364375 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f44007b40 con 0x7f3f540f88a0 2024-03-12T16:24:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f50ff9700 1 -- 172.21.15.6:0/2771364375 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f4400f040 con 0x7f3f540f88a0 2024-03-12T16:24:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f540f7620 con 0x7f3f540f88a0 2024-03-12T16:24:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f50ff9700 1 -- 172.21.15.6:0/2771364375 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f440137d0 con 0x7f3f540f88a0 2024-03-12T16:24:05.194 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.191+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f541146f0 con 0x7f3f540f88a0 2024-03-12T16:24:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.192+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5405f590 con 0x7f3f540f88a0 2024-03-12T16:24:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.193+0000 7f3f50ff9700 1 -- 172.21.15.6:0/2771364375 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f3f44007ca0 con 0x7f3f540f88a0 2024-03-12T16:24:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.193+0000 7f3f50ff9700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3c06caa0 0x7f3f3c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.193+0000 7f3f50ff9700 1 -- 172.21.15.6:0/2771364375 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f3f4408b7a0 con 0x7f3f540f88a0 2024-03-12T16:24:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.193+0000 7f3f52ffd700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3c06caa0 0x7f3f3c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:05.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.194+0000 7f3f52ffd700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3c06caa0 0x7f3f3c06ef60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3f540f7ff0 tx=0x7f3f4800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:05.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.198+0000 7f3f50ff9700 1 -- 172.21.15.6:0/2771364375 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3f44055870 con 0x7f3f540f88a0 2024-03-12T16:24:05.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.412+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3f540f7e40 con 0x7f3f3c06caa0 2024-03-12T16:24:05.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.414+0000 7f3f50ff9700 1 -- 172.21.15.6:0/2771364375 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f3f540f7e40 con 0x7f3f3c06caa0 2024-03-12T16:24:05.416 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:24:05.416 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:24:05.416 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:24:05.416 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:24:05.416 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:24:05.417 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:24:05.417 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:24:05.417 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:24:05.417 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:24:05.417 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:24:05.417 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:24:05.417 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:24:05.417 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:24:05.417 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:24:05.418 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:24:05.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3c06caa0 msgr2=0x7f3f3c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3c06caa0 0x7f3f3c06ef60 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 rx=0x7f3f540f7ff0 tx=0x7f3f4800b040).stop 2024-03-12T16:24:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f88a0 msgr2=0x7f3f540f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f88a0 0x7f3f540f6850 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f3f440041d0 tx=0x7f3f44009f60).stop 2024-03-12T16:24:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 shutdown_connections 2024-03-12T16:24:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3c06caa0 0x7f3f3c06ef60 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f540f88a0 0x7f3f540f6850 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 --2- 172.21.15.6:0/2771364375 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f540f9200 0x7f3f540f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 >> 172.21.15.6:0/2771364375 conn(0x7f3f54070590 msgr2=0x7f3f540fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:05.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 shutdown_connections 2024-03-12T16:24:05.420 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.416+0000 7f3f59f58700 1 -- 172.21.15.6:0/2771364375 wait complete. 2024-03-12T16:24:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.519+0000 7f9324b55700 1 -- 172.21.15.6:0/3713737416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fe250 msgr2=0x7f93200f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.519+0000 7f9324b55700 1 --2- 172.21.15.6:0/3713737416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fe250 0x7f93200f7a30 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f93080047f0 tx=0x7f9308009cb0).stop 2024-03-12T16:24:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.519+0000 7f9324b55700 1 -- 172.21.15.6:0/3713737416 shutdown_connections 2024-03-12T16:24:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.519+0000 7f9324b55700 1 --2- 172.21.15.6:0/3713737416 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fe250 0x7f93200f7a30 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.519+0000 7f9324b55700 1 --2- 172.21.15.6:0/3713737416 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200fd8f0 0x7f93200fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.519+0000 7f9324b55700 1 -- 172.21.15.6:0/3713737416 >> 172.21.15.6:0/3713737416 conn(0x7f93200f34b0 msgr2=0x7f93200f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:05.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.519+0000 7f9324b55700 1 -- 172.21.15.6:0/3713737416 shutdown_connections 2024-03-12T16:24:05.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.520+0000 7f9324b55700 1 -- 172.21.15.6:0/3713737416 wait complete. 2024-03-12T16:24:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.520+0000 7f9324b55700 1 Processor -- start 2024-03-12T16:24:05.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.520+0000 7f9324b55700 1 -- start start 2024-03-12T16:24:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f9324b55700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fd8f0 0x7f932010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f9324b55700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200fe250 0x7f932010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f9324b55700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932010eb70 con 0x7f93200fd8f0 2024-03-12T16:24:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f9324b55700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f932010ecb0 con 0x7f93200fe250 2024-03-12T16:24:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f931e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fd8f0 0x7f932010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f931e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fd8f0 0x7f932010e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49470/0 (socket says 172.21.15.6:49470) 2024-03-12T16:24:05.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f931e59c700 1 -- 172.21.15.6:0/972319620 learned_addr learned my addr 172.21.15.6:0/972319620 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f931dd9b700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200fe250 0x7f932010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f931e59c700 1 -- 172.21.15.6:0/972319620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200fe250 msgr2=0x7f932010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f931e59c700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200fe250 0x7f932010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f931e59c700 1 -- 172.21.15.6:0/972319620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9308005040 con 0x7f93200fd8f0 2024-03-12T16:24:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f931e59c700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fd8f0 0x7f932010e080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f931000c790 tx=0x7f9310004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f93177fe700 1 -- 172.21.15.6:0/972319620 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f931000e680 con 0x7f93200fd8f0 2024-03-12T16:24:05.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9320108340 con 0x7f93200fd8f0 2024-03-12T16:24:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f93177fe700 1 -- 172.21.15.6:0/972319620 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f931000ec90 con 0x7f93200fd8f0 2024-03-12T16:24:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f93177fe700 1 -- 172.21.15.6:0/972319620 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9310012d60 con 0x7f93200fd8f0 2024-03-12T16:24:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.521+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9320108880 con 0x7f93200fd8f0 2024-03-12T16:24:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.522+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f932005f590 con 0x7f93200fd8f0 2024-03-12T16:24:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.523+0000 7f93177fe700 1 -- 172.21.15.6:0/972319620 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9310012400 con 0x7f93200fd8f0 2024-03-12T16:24:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.523+0000 7f93177fe700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f930c06caa0 0x7f930c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.523+0000 7f93177fe700 1 -- 172.21.15.6:0/972319620 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f931008b660 con 0x7f93200fd8f0 2024-03-12T16:24:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.523+0000 7f931dd9b700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f930c06caa0 0x7f930c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:05.528 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.524+0000 7f931dd9b700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f930c06caa0 0x7f930c06ef60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f93201099c0 tx=0x7f930800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:05.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.528+0000 7f93177fe700 1 -- 172.21.15.6:0/972319620 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f93100591c0 con 0x7f93200fd8f0 2024-03-12T16:24:05.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.810+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9320047540 con 0x7f93200fd8f0 2024-03-12T16:24:05.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.811+0000 7f93177fe700 1 -- 172.21.15.6:0/972319620 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f9310058d50 con 0x7f93200fd8f0 2024-03-12T16:24:05.812 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:24:05.812 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:24:05.812 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:24:05.812 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:24:05.813 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f930c06caa0 msgr2=0x7f930c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f930c06caa0 0x7f930c06ef60 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 rx=0x7f93201099c0 tx=0x7f930800b040).stop 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fd8f0 msgr2=0x7f932010e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fd8f0 0x7f932010e080 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f931000c790 tx=0x7f9310004330).stop 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 shutdown_connections 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f930c06caa0 0x7f930c06ef60 unknown :-1 s=CLOSED pgs=157 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f93200fd8f0 0x7f932010e080 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 --2- 172.21.15.6:0/972319620 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f93200fe250 0x7f932010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 >> 172.21.15.6:0/972319620 conn(0x7f93200f34b0 msgr2=0x7f93200fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 shutdown_connections 2024-03-12T16:24:05.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:05.813+0000 7f9324b55700 1 -- 172.21.15.6:0/972319620 wait complete. 2024-03-12T16:24:05.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:05 smithi134 ceph-mon[85099]: pgmap v325: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:05.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:05 smithi134 ceph-mon[85099]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:05.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:05 smithi134 ceph-mon[85099]: from='client.34648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:05.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:05 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2676109224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:24:05.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:05 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3270185587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:24:05.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:05 smithi006 ceph-mon[103869]: pgmap v325: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:05.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:05 smithi006 ceph-mon[103869]: from='client.34644 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:05.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:05 smithi006 ceph-mon[103869]: from='client.34648 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:05.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:05 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2676109224' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:24:05.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:05 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3270185587' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:24:06.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:06 smithi134 ceph-mon[85099]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:06.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:06 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/972319620' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:24:06.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:06 smithi006 ceph-mon[103869]: from='client.34660 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:06.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:06 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/972319620' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:24:07.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:07 smithi134 ceph-mon[85099]: pgmap v326: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:07.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:07 smithi006 ceph-mon[103869]: pgmap v326: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:09.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:09 smithi134 ceph-mon[85099]: pgmap v327: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:09.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:09 smithi006 ceph-mon[103869]: pgmap v327: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:11.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:11 smithi134 ceph-mon[85099]: pgmap v328: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:11.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:11 smithi006 ceph-mon[103869]: pgmap v328: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:13.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:13 smithi134 ceph-mon[85099]: pgmap v329: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:13.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:13 smithi006 ceph-mon[103869]: pgmap v329: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:15.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:15 smithi134 ceph-mon[85099]: pgmap v330: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:15.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:15 smithi006 ceph-mon[103869]: pgmap v330: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:17.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:17 smithi134 ceph-mon[85099]: pgmap v331: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:17.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:24:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:17 smithi006 ceph-mon[103869]: pgmap v331: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:17.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:24:19.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:19 smithi134 ceph-mon[85099]: pgmap v332: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:19.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:19 smithi006 ceph-mon[103869]: pgmap v332: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:21.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:21 smithi134 ceph-mon[85099]: pgmap v333: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:21.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:21 smithi006 ceph-mon[103869]: pgmap v333: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:23.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:23 smithi134 ceph-mon[85099]: pgmap v334: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:23.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:23 smithi006 ceph-mon[103869]: pgmap v334: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:25.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:25 smithi134 ceph-mon[85099]: pgmap v335: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:25.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:25 smithi006 ceph-mon[103869]: pgmap v335: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:27.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:27 smithi134 ceph-mon[85099]: pgmap v336: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:27.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:27 smithi006 ceph-mon[103869]: pgmap v336: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:29.703 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:29 smithi134 ceph-mon[85099]: pgmap v337: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:29.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:29 smithi006 ceph-mon[103869]: pgmap v337: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:31.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:31 smithi134 ceph-mon[85099]: pgmap v338: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:31.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:31 smithi006 ceph-mon[103869]: pgmap v338: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:32.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:24:32.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:24:33.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:33 smithi134 ceph-mon[85099]: pgmap v339: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:33.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:33 smithi006 ceph-mon[103869]: pgmap v339: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.928+0000 7fc4778be700 1 -- 172.21.15.6:0/620694003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 msgr2=0x7fc4700f6a70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.928+0000 7fc4778be700 1 --2- 172.21.15.6:0/620694003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 0x7fc4700f6a70 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7fc46c004820 tx=0x7fc46c009cb0).stop 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.928+0000 7fc4778be700 1 -- 172.21.15.6:0/620694003 shutdown_connections 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.928+0000 7fc4778be700 1 --2- 172.21.15.6:0/620694003 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4700f6f60 0x7fc470103d00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.928+0000 7fc4778be700 1 --2- 172.21.15.6:0/620694003 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 0x7fc4700f6a70 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.928+0000 7fc4778be700 1 -- 172.21.15.6:0/620694003 >> 172.21.15.6:0/620694003 conn(0x7fc470070590 msgr2=0x7fc4700f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.928+0000 7fc4778be700 1 -- 172.21.15.6:0/620694003 shutdown_connections 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.928+0000 7fc4778be700 1 -- 172.21.15.6:0/620694003 wait complete. 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.928+0000 7fc4778be700 1 Processor -- start 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc4778be700 1 -- start start 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc4778be700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 0x7fc4701101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:35.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc4778be700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4700f6f60 0x7fc4701106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:35.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc4778be700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470110cc0 con 0x7fc4700f6690 2024-03-12T16:24:35.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc4778be700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc470110e00 con 0x7fc4700f6f60 2024-03-12T16:24:35.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc47565a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 0x7fc4701101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:35.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc47565a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 0x7fc4701101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38208/0 (socket says 172.21.15.6:38208) 2024-03-12T16:24:35.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc47565a700 1 -- 172.21.15.6:0/1272973527 learned_addr learned my addr 172.21.15.6:0/1272973527 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc474e59700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4700f6f60 0x7fc4701106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc47565a700 1 -- 172.21.15.6:0/1272973527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4700f6f60 msgr2=0x7fc4701106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc47565a700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4700f6f60 0x7fc4701106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc47565a700 1 -- 172.21.15.6:0/1272973527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc46c005040 con 0x7fc4700f6690 2024-03-12T16:24:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc474e59700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4700f6f60 0x7fc4701106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:24:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc47565a700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 0x7fc4701101d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fc46c004710 tx=0x7fc46c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:35.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.929+0000 7fc4667fc700 1 -- 172.21.15.6:0/1272973527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc46c00e030 con 0x7fc4700f6690 2024-03-12T16:24:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.930+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc47010a430 con 0x7fc4700f6690 2024-03-12T16:24:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.930+0000 7fc4667fc700 1 -- 172.21.15.6:0/1272973527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc46c007e90 con 0x7fc4700f6690 2024-03-12T16:24:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.930+0000 7fc4667fc700 1 -- 172.21.15.6:0/1272973527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc46c018070 con 0x7fc4700f6690 2024-03-12T16:24:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.930+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc47010a910 con 0x7fc4700f6690 2024-03-12T16:24:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.931+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc47005f590 con 0x7fc4700f6690 2024-03-12T16:24:35.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.931+0000 7fc4667fc700 1 -- 172.21.15.6:0/1272973527 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fc46c01d420 con 0x7fc4700f6690 2024-03-12T16:24:35.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.932+0000 7fc4667fc700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45c06ca30 0x7fc45c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:35.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.932+0000 7fc4667fc700 1 -- 172.21.15.6:0/1272973527 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc46c08d030 con 0x7fc4700f6690 2024-03-12T16:24:35.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.932+0000 7fc474e59700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45c06ca30 0x7fc45c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:35.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.932+0000 7fc474e59700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45c06ca30 0x7fc45c06eef0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc47010bb10 tx=0x7fc460009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:35.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:35.937+0000 7fc4667fc700 1 -- 172.21.15.6:0/1272973527 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc46c05ab90 con 0x7fc4700f6690 2024-03-12T16:24:35.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:35 smithi134 ceph-mon[85099]: pgmap v340: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:35.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:35 smithi006 ceph-mon[103869]: pgmap v340: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:36.155 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.153+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fc470101270 con 0x7fc45c06ca30 2024-03-12T16:24:36.156 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.154+0000 7fc4667fc700 1 -- 172.21.15.6:0/1272973527 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fc470101270 con 0x7fc45c06ca30 2024-03-12T16:24:36.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45c06ca30 msgr2=0x7fc45c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45c06ca30 0x7fc45c06eef0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 rx=0x7fc47010bb10 tx=0x7fc460009de0).stop 2024-03-12T16:24:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 msgr2=0x7fc4701101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 0x7fc4701101d0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7fc46c004710 tx=0x7fc46c009cb0).stop 2024-03-12T16:24:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 shutdown_connections 2024-03-12T16:24:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45c06ca30 0x7fc45c06eef0 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc4700f6690 0x7fc4701101d0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 --2- 172.21.15.6:0/1272973527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc4700f6f60 0x7fc4701106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 >> 172.21.15.6:0/1272973527 conn(0x7fc470070590 msgr2=0x7fc47006d6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 shutdown_connections 2024-03-12T16:24:36.159 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.156+0000 7fc4778be700 1 -- 172.21.15.6:0/1272973527 wait complete. 2024-03-12T16:24:36.168 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:24:36.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.259+0000 7fab91841700 1 -- 172.21.15.6:0/1451062000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fe230 msgr2=0x7fab8c0f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.259+0000 7fab91841700 1 --2- 172.21.15.6:0/1451062000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fe230 0x7fab8c0f5f80 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7fab800047f0 tx=0x7fab80009cb0).stop 2024-03-12T16:24:36.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.259+0000 7fab91841700 1 -- 172.21.15.6:0/1451062000 shutdown_connections 2024-03-12T16:24:36.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.259+0000 7fab91841700 1 --2- 172.21.15.6:0/1451062000 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fe230 0x7fab8c0f5f80 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.259+0000 7fab91841700 1 --2- 172.21.15.6:0/1451062000 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8c0fd8d0 0x7fab8c0fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.259+0000 7fab91841700 1 -- 172.21.15.6:0/1451062000 >> 172.21.15.6:0/1451062000 conn(0x7fab8c06cea0 msgr2=0x7fab8c06d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:36.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.259+0000 7fab91841700 1 -- 172.21.15.6:0/1451062000 shutdown_connections 2024-03-12T16:24:36.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.259+0000 7fab91841700 1 -- 172.21.15.6:0/1451062000 wait complete. 2024-03-12T16:24:36.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.260+0000 7fab91841700 1 Processor -- start 2024-03-12T16:24:36.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.260+0000 7fab91841700 1 -- start start 2024-03-12T16:24:36.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab91841700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fd8d0 0x7fab8c10e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab91841700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8c0fe230 0x7fab8c10e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab91841700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c10eba0 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab91841700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fab8c10ece0 con 0x7fab8c0fe230 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab8affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fd8d0 0x7fab8c10e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab8affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fd8d0 0x7fab8c10e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38230/0 (socket says 172.21.15.6:38230) 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab8affd700 1 -- 172.21.15.6:0/3127798767 learned_addr learned my addr 172.21.15.6:0/3127798767 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab8a7fc700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8c0fe230 0x7fab8c10e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab8affd700 1 -- 172.21.15.6:0/3127798767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8c0fe230 msgr2=0x7fab8c10e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab8affd700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8c0fe230 0x7fab8c10e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab8affd700 1 -- 172.21.15.6:0/3127798767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fab80005040 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab8affd700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fd8d0 0x7fab8c10e0b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fab7c00c790 tx=0x7fab7c004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.261+0000 7fab73fff700 1 -- 172.21.15.6:0/3127798767 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab7c0106f0 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.262+0000 7fab73fff700 1 -- 172.21.15.6:0/3127798767 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fab7c010d00 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.262+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fab8c108370 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.262+0000 7fab73fff700 1 -- 172.21.15.6:0/3127798767 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fab7c012da0 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.262+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fab8c1088b0 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.262+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fab8c047540 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.263+0000 7fab73fff700 1 -- 172.21.15.6:0/3127798767 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fab7c012400 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.263+0000 7fab73fff700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7406caa0 0x7fab7406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:36.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.263+0000 7fab73fff700 1 -- 172.21.15.6:0/3127798767 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fab7c08b690 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.264+0000 7fab8a7fc700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7406caa0 0x7fab7406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:36.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.264+0000 7fab8a7fc700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7406caa0 0x7fab7406ef60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fab80004f10 tx=0x7fab8000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:36.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.268+0000 7fab73fff700 1 -- 172.21.15.6:0/3127798767 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fab7c0591f0 con 0x7fab8c0fd8d0 2024-03-12T16:24:36.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.483+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fab8c109810 con 0x7fab7406caa0 2024-03-12T16:24:36.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.484+0000 7fab73fff700 1 -- 172.21.15.6:0/3127798767 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fab8c109810 con 0x7fab7406caa0 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.486+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7406caa0 msgr2=0x7fab7406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.486+0000 7fab91841700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7406caa0 0x7fab7406ef60 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 rx=0x7fab80004f10 tx=0x7fab8000b040).stop 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.486+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fd8d0 msgr2=0x7fab8c10e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.486+0000 7fab91841700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fd8d0 0x7fab8c10e0b0 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 rx=0x7fab7c00c790 tx=0x7fab7c004330).stop 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.486+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 shutdown_connections 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.486+0000 7fab91841700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fab7406caa0 0x7fab7406ef60 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.486+0000 7fab91841700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fab8c0fd8d0 0x7fab8c10e0b0 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.486+0000 7fab91841700 1 --2- 172.21.15.6:0/3127798767 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fab8c0fe230 0x7fab8c10e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.486+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 >> 172.21.15.6:0/3127798767 conn(0x7fab8c06cea0 msgr2=0x7fab8c100e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.487+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 shutdown_connections 2024-03-12T16:24:36.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.487+0000 7fab91841700 1 -- 172.21.15.6:0/3127798767 wait complete. 2024-03-12T16:24:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.589+0000 7f7985e66700 1 -- 172.21.15.6:0/3956386649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 msgr2=0x7f7980101970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.589+0000 7f7985e66700 1 --2- 172.21.15.6:0/3956386649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 0x7f7980101970 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 rx=0x7f79680047f0 tx=0x7f7968009cb0).stop 2024-03-12T16:24:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.589+0000 7f7985e66700 1 -- 172.21.15.6:0/3956386649 shutdown_connections 2024-03-12T16:24:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.589+0000 7f7985e66700 1 --2- 172.21.15.6:0/3956386649 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 0x7f7980101970 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.589+0000 7f7985e66700 1 --2- 172.21.15.6:0/3956386649 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800f8900 0x7f79800f8ce0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.589+0000 7f7985e66700 1 -- 172.21.15.6:0/3956386649 >> 172.21.15.6:0/3956386649 conn(0x7f7980070590 msgr2=0x7f79800f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.589+0000 7f7985e66700 1 -- 172.21.15.6:0/3956386649 shutdown_connections 2024-03-12T16:24:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.589+0000 7f7985e66700 1 -- 172.21.15.6:0/3956386649 wait complete. 2024-03-12T16:24:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.589+0000 7f7985e66700 1 Processor -- start 2024-03-12T16:24:36.592 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f7985e66700 1 -- start start 2024-03-12T16:24:36.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f7985e66700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800f8900 0x7f798010e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f7985e66700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 0x7f798010e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f7985e66700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798010eb00 con 0x7f79800f9260 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f7985e66700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f798010ec40 con 0x7f79800f8900 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f797effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 0x7f798010e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f797effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 0x7f798010e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38240/0 (socket says 172.21.15.6:38240) 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f797effd700 1 -- 172.21.15.6:0/1290487913 learned_addr learned my addr 172.21.15.6:0/1290487913 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f797f7fe700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800f8900 0x7f798010e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f797effd700 1 -- 172.21.15.6:0/1290487913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800f8900 msgr2=0x7f798010e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f797effd700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800f8900 0x7f798010e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f797effd700 1 -- 172.21.15.6:0/1290487913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7968005040 con 0x7f79800f9260 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f797f7fe700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800f8900 0x7f798010e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:24:36.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.590+0000 7f797effd700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 0x7f798010e500 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f7968009380 tx=0x7f7968009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.591+0000 7f797cff9700 1 -- 172.21.15.6:0/1290487913 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f796800e070 con 0x7f79800f9260 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.591+0000 7f797cff9700 1 -- 172.21.15.6:0/1290487913 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7968007e90 con 0x7f79800f9260 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.591+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7980108270 con 0x7f79800f9260 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.591+0000 7f797cff9700 1 -- 172.21.15.6:0/1290487913 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7968018070 con 0x7f79800f9260 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.591+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7980108750 con 0x7f79800f9260 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.592+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f798005f590 con 0x7f79800f9260 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.592+0000 7f797cff9700 1 -- 172.21.15.6:0/1290487913 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f796801d420 con 0x7f79800f9260 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.593+0000 7f797cff9700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f796c06caa0 0x7f796c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.593+0000 7f797cff9700 1 -- 172.21.15.6:0/1290487913 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f796808c970 con 0x7f79800f9260 2024-03-12T16:24:36.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.593+0000 7f797f7fe700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f796c06caa0 0x7f796c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:36.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.593+0000 7f797f7fe700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f796c06caa0 0x7f796c06ef60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f7970009250 tx=0x7f7970009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:36.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.597+0000 7f797cff9700 1 -- 172.21.15.6:0/1290487913 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f796805a4d0 con 0x7f79800f9260 2024-03-12T16:24:36.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.803+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7980109730 con 0x7f796c06caa0 2024-03-12T16:24:36.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.813+0000 7f797cff9700 1 -- 172.21.15.6:0/1290487913 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f7980109730 con 0x7f796c06caa0 2024-03-12T16:24:36.815 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:24:36.815 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (11m) 5m ago 22m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:24:36.815 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (9m) 5m ago 22m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:24:36.815 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (9m) 4m ago 21m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:24:36.815 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (11m) 5m ago 22m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (5m) 5m ago 17m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (5m) 5m ago 17m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (5m) 4m ago 17m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (4m) 4m ago 17m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (12m) 5m ago 23m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (12m) 4m ago 21m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (10m) 5m ago 23m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (9m) 4m ago 21m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (12m) 5m ago 22m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (11m) 4m ago 21m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (8m) 5m ago 21m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (8m) 5m ago 20m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (7m) 5m ago 20m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:24:36.816 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (7m) 4m ago 19m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:24:36.817 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (6m) 4m ago 19m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:24:36.817 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (5m) 4m ago 18m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:24:36.817 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (11m) 4m ago 20m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:24:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f796c06caa0 msgr2=0x7f796c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f796c06caa0 0x7f796c06ef60 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 rx=0x7f7970009250 tx=0x7f7970009d60).stop 2024-03-12T16:24:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 msgr2=0x7f798010e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 0x7f798010e500 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f7968009380 tx=0x7f7968009cb0).stop 2024-03-12T16:24:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 shutdown_connections 2024-03-12T16:24:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f79800f8900 0x7f798010e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f796c06caa0 0x7f796c06ef60 unknown :-1 s=CLOSED pgs=160 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 --2- 172.21.15.6:0/1290487913 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f79800f9260 0x7f798010e500 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 >> 172.21.15.6:0/1290487913 conn(0x7f7980070590 msgr2=0x7f79800fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 shutdown_connections 2024-03-12T16:24:36.818 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.815+0000 7f7985e66700 1 -- 172.21.15.6:0/1290487913 wait complete. 2024-03-12T16:24:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.916+0000 7f3f5494e700 1 -- 172.21.15.6:0/138527514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fd150 msgr2=0x7f3f500f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.916+0000 7f3f5494e700 1 --2- 172.21.15.6:0/138527514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fd150 0x7f3f500f6930 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f3f440047f0 tx=0x7f3f44009cb0).stop 2024-03-12T16:24:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.916+0000 7f3f5494e700 1 -- 172.21.15.6:0/138527514 shutdown_connections 2024-03-12T16:24:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.916+0000 7f3f5494e700 1 --2- 172.21.15.6:0/138527514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fd150 0x7f3f500f6930 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.916+0000 7f3f5494e700 1 --2- 172.21.15.6:0/138527514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f500fc7f0 0x7f3f500fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.916+0000 7f3f5494e700 1 -- 172.21.15.6:0/138527514 >> 172.21.15.6:0/138527514 conn(0x7f3f50070590 msgr2=0x7f3f500f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:36.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.916+0000 7f3f5494e700 1 -- 172.21.15.6:0/138527514 shutdown_connections 2024-03-12T16:24:36.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.916+0000 7f3f5494e700 1 -- 172.21.15.6:0/138527514 wait complete. 2024-03-12T16:24:36.920 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f5494e700 1 Processor -- start 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f5494e700 1 -- start start 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f5494e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fc7f0 0x7f3f5010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f5494e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f500fd150 0x7f3f5010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f5494e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5010eab0 con 0x7f3f500fc7f0 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f5494e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3f5010ebf0 con 0x7f3f500fd150 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f4e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fc7f0 0x7f3f5010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f4e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fc7f0 0x7f3f5010dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38254/0 (socket says 172.21.15.6:38254) 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f4e59c700 1 -- 172.21.15.6:0/628769813 learned_addr learned my addr 172.21.15.6:0/628769813 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f4dd9b700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f500fd150 0x7f3f5010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f4e59c700 1 -- 172.21.15.6:0/628769813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f500fd150 msgr2=0x7f3f5010e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f4e59c700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f500fd150 0x7f3f5010e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f4e59c700 1 -- 172.21.15.6:0/628769813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3f44005040 con 0x7f3f500fc7f0 2024-03-12T16:24:36.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.917+0000 7f3f4dd9b700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f500fd150 0x7f3f5010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:24:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.918+0000 7f3f4e59c700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fc7f0 0x7f3f5010dfc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f3f400041d0 tx=0x7f3f40009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.918+0000 7f3f3f7fe700 1 -- 172.21.15.6:0/628769813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f40002d90 con 0x7f3f500fc7f0 2024-03-12T16:24:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.918+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3f50108280 con 0x7f3f500fc7f0 2024-03-12T16:24:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.918+0000 7f3f3f7fe700 1 -- 172.21.15.6:0/628769813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3f4000f040 con 0x7f3f500fc7f0 2024-03-12T16:24:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.918+0000 7f3f3f7fe700 1 -- 172.21.15.6:0/628769813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3f4000d800 con 0x7f3f500fc7f0 2024-03-12T16:24:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.918+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3f50108840 con 0x7f3f500fc7f0 2024-03-12T16:24:36.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.919+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3f5005f590 con 0x7f3f500fc7f0 2024-03-12T16:24:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.919+0000 7f3f3f7fe700 1 -- 172.21.15.6:0/628769813 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f3f4000dac0 con 0x7f3f500fc7f0 2024-03-12T16:24:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.920+0000 7f3f3f7fe700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3806caa0 0x7f3f3806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.920+0000 7f3f3f7fe700 1 -- 172.21.15.6:0/628769813 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f3f4008bde0 con 0x7f3f500fc7f0 2024-03-12T16:24:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.920+0000 7f3f4dd9b700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3806caa0 0x7f3f3806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:36.923 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.920+0000 7f3f4dd9b700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3806caa0 0x7f3f3806ef60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f3f440043d0 tx=0x7f3f4400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:36.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:36.924+0000 7f3f3f7fe700 1 -- 172.21.15.6:0/628769813 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3f40059940 con 0x7f3f500fc7f0 2024-03-12T16:24:37.207 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.205+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f3f50108ee0 con 0x7f3f500fc7f0 2024-03-12T16:24:37.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.206+0000 7f3f3f7fe700 1 -- 172.21.15.6:0/628769813 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f3f400594d0 con 0x7f3f500fc7f0 2024-03-12T16:24:37.208 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:24:37.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:24:37.208 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:24:37.208 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:24:37.208 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:24:37.208 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:24:37.209 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:24:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3806caa0 msgr2=0x7f3f3806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3806caa0 0x7f3f3806ef60 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 rx=0x7f3f440043d0 tx=0x7f3f4400b040).stop 2024-03-12T16:24:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fc7f0 msgr2=0x7f3f5010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fc7f0 0x7f3f5010dfc0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f3f400041d0 tx=0x7f3f40009f60).stop 2024-03-12T16:24:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 shutdown_connections 2024-03-12T16:24:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3f3806caa0 0x7f3f3806ef60 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3f500fc7f0 0x7f3f5010dfc0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 --2- 172.21.15.6:0/628769813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3f500fd150 0x7f3f5010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 >> 172.21.15.6:0/628769813 conn(0x7f3f50070590 msgr2=0x7f3f50060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 shutdown_connections 2024-03-12T16:24:37.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.208+0000 7f3f5494e700 1 -- 172.21.15.6:0/628769813 wait complete. 2024-03-12T16:24:37.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.310+0000 7f4544071700 1 -- 172.21.15.6:0/2516858096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 msgr2=0x7f453c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.310+0000 7f4544071700 1 --2- 172.21.15.6:0/2516858096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 0x7f453c0fcbd0 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7f45380047f0 tx=0x7f4538009cb0).stop 2024-03-12T16:24:37.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.310+0000 7f4544071700 1 -- 172.21.15.6:0/2516858096 shutdown_connections 2024-03-12T16:24:37.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.310+0000 7f4544071700 1 --2- 172.21.15.6:0/2516858096 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c0fd150 0x7f453c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.310+0000 7f4544071700 1 --2- 172.21.15.6:0/2516858096 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 0x7f453c0fcbd0 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.310+0000 7f4544071700 1 -- 172.21.15.6:0/2516858096 >> 172.21.15.6:0/2516858096 conn(0x7f453c070590 msgr2=0x7f453c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.310+0000 7f4544071700 1 -- 172.21.15.6:0/2516858096 shutdown_connections 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.310+0000 7f4544071700 1 -- 172.21.15.6:0/2516858096 wait complete. 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4544071700 1 Processor -- start 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4544071700 1 -- start start 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4544071700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 0x7f453c10d000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4544071700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c0fd150 0x7f453c10d4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4544071700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c10daf0 con 0x7f453c0fc7f0 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4544071700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f453c10dc30 con 0x7f453c0fd150 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4541e0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 0x7f453c10d000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4541e0d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 0x7f453c10d000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38272/0 (socket says 172.21.15.6:38272) 2024-03-12T16:24:37.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4541e0d700 1 -- 172.21.15.6:0/2080446433 learned_addr learned my addr 172.21.15.6:0/2080446433 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4541e0d700 1 -- 172.21.15.6:0/2080446433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c0fd150 msgr2=0x7f453c10d4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f454160c700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c0fd150 0x7f453c10d4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4541e0d700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c0fd150 0x7f453c10d4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.311+0000 7f4541e0d700 1 -- 172.21.15.6:0/2080446433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4538005040 con 0x7f453c0fc7f0 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.312+0000 7f4541e0d700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 0x7f453c10d000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f4538009380 tx=0x7f4538009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.312+0000 7f452effd700 1 -- 172.21.15.6:0/2080446433 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4538018070 con 0x7f453c0fc7f0 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.312+0000 7f452effd700 1 -- 172.21.15.6:0/2080446433 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4538007e90 con 0x7f453c0fc7f0 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.312+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f453c107260 con 0x7f453c0fc7f0 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.312+0000 7f452effd700 1 -- 172.21.15.6:0/2080446433 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f45380123c0 con 0x7f453c0fc7f0 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.312+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f453c1077c0 con 0x7f453c0fc7f0 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.313+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f453c05f590 con 0x7f453c0fc7f0 2024-03-12T16:24:37.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.313+0000 7f452effd700 1 -- 172.21.15.6:0/2080446433 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f453801d420 con 0x7f453c0fc7f0 2024-03-12T16:24:37.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.314+0000 7f452effd700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f452806caa0 0x7f452806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:37.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.314+0000 7f452effd700 1 -- 172.21.15.6:0/2080446433 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f453808ca30 con 0x7f453c0fc7f0 2024-03-12T16:24:37.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.314+0000 7f454160c700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f452806caa0 0x7f452806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:37.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.314+0000 7f454160c700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f452806caa0 0x7f452806ef60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f4530009f20 tx=0x7f453000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:37.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.318+0000 7f452effd700 1 -- 172.21.15.6:0/2080446433 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f453805a590 con 0x7f453c0fc7f0 2024-03-12T16:24:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.559+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f453c0feb40 con 0x7f453c0fc7f0 2024-03-12T16:24:37.561 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.559+0000 7f452effd700 1 -- 172.21.15.6:0/2080446433 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f453808c740 con 0x7f453c0fc7f0 2024-03-12T16:24:37.561 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:24:37.561 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:24:37.562 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:24:37.563 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:24:37.564 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:24:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f452806caa0 msgr2=0x7f452806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f452806caa0 0x7f452806ef60 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 rx=0x7f4530009f20 tx=0x7f453000b040).stop 2024-03-12T16:24:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 msgr2=0x7f453c10d000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 0x7f453c10d000 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f4538009380 tx=0x7f4538009cb0).stop 2024-03-12T16:24:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 shutdown_connections 2024-03-12T16:24:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f452806caa0 0x7f452806ef60 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f453c0fc7f0 0x7f453c10d000 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 --2- 172.21.15.6:0/2080446433 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f453c0fd150 0x7f453c10d4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 >> 172.21.15.6:0/2080446433 conn(0x7f453c070590 msgr2=0x7f453c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 shutdown_connections 2024-03-12T16:24:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.561+0000 7f4544071700 1 -- 172.21.15.6:0/2080446433 wait complete. 2024-03-12T16:24:37.566 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:24:37.669 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.666+0000 7f2eac3e5700 1 -- 172.21.15.6:0/3997351783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 msgr2=0x7f2ea40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.666+0000 7f2eac3e5700 1 --2- 172.21.15.6:0/3997351783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 0x7f2ea40fcbd0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f2ea00047f0 tx=0x7f2ea0009cb0).stop 2024-03-12T16:24:37.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.667+0000 7f2eac3e5700 1 -- 172.21.15.6:0/3997351783 shutdown_connections 2024-03-12T16:24:37.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.667+0000 7f2eac3e5700 1 --2- 172.21.15.6:0/3997351783 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ea40fd150 0x7f2ea40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.667+0000 7f2eac3e5700 1 --2- 172.21.15.6:0/3997351783 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 0x7f2ea40fcbd0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.667+0000 7f2eac3e5700 1 -- 172.21.15.6:0/3997351783 >> 172.21.15.6:0/3997351783 conn(0x7f2ea4070590 msgr2=0x7f2ea40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:37.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.667+0000 7f2eac3e5700 1 -- 172.21.15.6:0/3997351783 shutdown_connections 2024-03-12T16:24:37.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.667+0000 7f2eac3e5700 1 -- 172.21.15.6:0/3997351783 wait complete. 2024-03-12T16:24:37.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.667+0000 7f2eac3e5700 1 Processor -- start 2024-03-12T16:24:37.670 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.667+0000 7f2eac3e5700 1 -- start start 2024-03-12T16:24:37.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.667+0000 7f2eac3e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 0x7f2ea40f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:37.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eac3e5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ea40fd150 0x7f2ea40f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:37.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eac3e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40f8f20 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eac3e5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ea40f9060 con 0x7f2ea40fd150 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eaa181700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 0x7f2ea40f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eaa181700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 0x7f2ea40f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38298/0 (socket says 172.21.15.6:38298) 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2ea9980700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ea40fd150 0x7f2ea40f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eaa181700 1 -- 172.21.15.6:0/563607067 learned_addr learned my addr 172.21.15.6:0/563607067 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eaa181700 1 -- 172.21.15.6:0/563607067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ea40fd150 msgr2=0x7f2ea40f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eaa181700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ea40fd150 0x7f2ea40f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eaa181700 1 -- 172.21.15.6:0/563607067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ea0005040 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.668+0000 7f2eaa181700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 0x7f2ea40f8540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f2ea000b120 tx=0x7f2ea0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.669+0000 7f2e9b7fe700 1 -- 172.21.15.6:0/563607067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea000e030 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.669+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ea40f92b0 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.669+0000 7f2e9b7fe700 1 -- 172.21.15.6:0/563607067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ea0007e90 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.669+0000 7f2e9b7fe700 1 -- 172.21.15.6:0/563607067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ea0018070 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.669+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ea41145d0 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.672 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.670+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ea405f590 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.670+0000 7f2e9b7fe700 1 -- 172.21.15.6:0/563607067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2ea001d420 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.670+0000 7f2e9b7fe700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2e9006caa0 0x7f2e9006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:37.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.671+0000 7f2e9b7fe700 1 -- 172.21.15.6:0/563607067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2ea008d180 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.671+0000 7f2ea9980700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2e9006caa0 0x7f2e9006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:37.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.671+0000 7f2ea9980700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2e9006caa0 0x7f2e9006ef60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2ea40f9ce0 tx=0x7f2e94009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:37.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.675+0000 7f2e9b7fe700 1 -- 172.21.15.6:0/563607067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2ea0057250 con 0x7f2ea40fc7f0 2024-03-12T16:24:37.892 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.890+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ea40fb5a0 con 0x7f2e9006caa0 2024-03-12T16:24:37.893 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.891+0000 7f2e9b7fe700 1 -- 172.21.15.6:0/563607067 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2ea40fb5a0 con 0x7f2e9006caa0 2024-03-12T16:24:37.893 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:24:37.893 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:24:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:24:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:24:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:24:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:24:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:24:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:24:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:24:37.894 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:24:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:24:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:24:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:24:37.895 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:24:37.895 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:24:37.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2e9006caa0 msgr2=0x7f2e9006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2e9006caa0 0x7f2e9006ef60 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 rx=0x7f2ea40f9ce0 tx=0x7f2e94009040).stop 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 msgr2=0x7f2ea40f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 0x7f2ea40f8540 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f2ea000b120 tx=0x7f2ea0009cb0).stop 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 shutdown_connections 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2e9006caa0 0x7f2e9006ef60 unknown :-1 s=CLOSED pgs=163 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ea40fc7f0 0x7f2ea40f8540 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 --2- 172.21.15.6:0/563607067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ea40fd150 0x7f2ea40f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 >> 172.21.15.6:0/563607067 conn(0x7f2ea4070590 msgr2=0x7f2ea4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 shutdown_connections 2024-03-12T16:24:37.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.893+0000 7f2eac3e5700 1 -- 172.21.15.6:0/563607067 wait complete. 2024-03-12T16:24:37.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:37 smithi134 ceph-mon[85099]: pgmap v341: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:37.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:37 smithi134 ceph-mon[85099]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:37.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:37 smithi134 ceph-mon[85099]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:37.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:37 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/628769813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:24:37.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:37 smithi006 ceph-mon[103869]: pgmap v341: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:37 smithi006 ceph-mon[103869]: from='client.34668 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:37 smithi006 ceph-mon[103869]: from='client.34672 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:37.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:37 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/628769813' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:24:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 -- 172.21.15.6:0/1036098205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 msgr2=0x7f69380fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 --2- 172.21.15.6:0/1036098205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 0x7f69380fdcd0 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7f692c0047f0 tx=0x7f692c009cb0).stop 2024-03-12T16:24:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 -- 172.21.15.6:0/1036098205 shutdown_connections 2024-03-12T16:24:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 --2- 172.21.15.6:0/1036098205 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69380fe250 0x7f69380f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 --2- 172.21.15.6:0/1036098205 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 0x7f69380fdcd0 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 -- 172.21.15.6:0/1036098205 >> 172.21.15.6:0/1036098205 conn(0x7f69380f34b0 msgr2=0x7f69380f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 -- 172.21.15.6:0/1036098205 shutdown_connections 2024-03-12T16:24:37.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 -- 172.21.15.6:0/1036098205 wait complete. 2024-03-12T16:24:37.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 Processor -- start 2024-03-12T16:24:37.999 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.995+0000 7f693ef07700 1 -- start start 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693ef07700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 0x7f69381101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693ef07700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69380fe250 0x7f69381106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693ef07700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6938110cd0 con 0x7f69380fd8f0 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693ef07700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6938110e10 con 0x7f69380fe250 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693cca3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 0x7f69381101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693cca3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 0x7f69381101e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:38316/0 (socket says 172.21.15.6:38316) 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693cca3700 1 -- 172.21.15.6:0/984980671 learned_addr learned my addr 172.21.15.6:0/984980671 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f6937fff700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69380fe250 0x7f69381106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693cca3700 1 -- 172.21.15.6:0/984980671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69380fe250 msgr2=0x7f69381106d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693cca3700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69380fe250 0x7f69381106d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:38.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693cca3700 1 -- 172.21.15.6:0/984980671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f692c005040 con 0x7f69380fd8f0 2024-03-12T16:24:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693cca3700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 0x7f69381101e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f692c005010 tx=0x7f692c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f6935ffb700 1 -- 172.21.15.6:0/984980671 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f692c00e030 con 0x7f69380fd8f0 2024-03-12T16:24:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f6935ffb700 1 -- 172.21.15.6:0/984980671 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f692c007e90 con 0x7f69380fd8f0 2024-03-12T16:24:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f693810a440 con 0x7f69380fd8f0 2024-03-12T16:24:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.996+0000 7f6935ffb700 1 -- 172.21.15.6:0/984980671 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f692c018070 con 0x7f69380fd8f0 2024-03-12T16:24:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.997+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f693810a9a0 con 0x7f69380fd8f0 2024-03-12T16:24:38.001 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.997+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f693805f590 con 0x7f69380fd8f0 2024-03-12T16:24:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.998+0000 7f6935ffb700 1 -- 172.21.15.6:0/984980671 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f692c01d6e0 con 0x7f69380fd8f0 2024-03-12T16:24:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.998+0000 7f6935ffb700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f692806caa0 0x7f692806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:24:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.998+0000 7f6935ffb700 1 -- 172.21.15.6:0/984980671 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f692c08cfa0 con 0x7f69380fd8f0 2024-03-12T16:24:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.998+0000 7f6937fff700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f692806caa0 0x7f692806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:24:38.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:37.999+0000 7f6937fff700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f692806caa0 0x7f692806ef60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f693810bb20 tx=0x7f6924009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:24:38.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.003+0000 7f6935ffb700 1 -- 172.21.15.6:0/984980671 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f692c05abc0 con 0x7f69380fd8f0 2024-03-12T16:24:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.282+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6938047540 con 0x7f69380fd8f0 2024-03-12T16:24:38.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.282+0000 7f6935ffb700 1 -- 172.21.15.6:0/984980671 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f692c05a750 con 0x7f69380fd8f0 2024-03-12T16:24:38.285 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:24:38.285 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:24:38.285 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:24:38.285 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:24:38.285 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:24:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.284+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f692806caa0 msgr2=0x7f692806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:38.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.284+0000 7f693ef07700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f692806caa0 0x7f692806ef60 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 rx=0x7f693810bb20 tx=0x7f6924009d60).stop 2024-03-12T16:24:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.284+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 msgr2=0x7f69381101e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:24:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.284+0000 7f693ef07700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 0x7f69381101e0 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7f692c005010 tx=0x7f692c009cb0).stop 2024-03-12T16:24:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.284+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 shutdown_connections 2024-03-12T16:24:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.284+0000 7f693ef07700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f692806caa0 0x7f692806ef60 unknown :-1 s=CLOSED pgs=164 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.284+0000 7f693ef07700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69380fd8f0 0x7f69381101e0 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.284+0000 7f693ef07700 1 --2- 172.21.15.6:0/984980671 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69380fe250 0x7f69381106d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:24:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.285+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 >> 172.21.15.6:0/984980671 conn(0x7f69380f34b0 msgr2=0x7f693806b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:24:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.285+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 shutdown_connections 2024-03-12T16:24:38.287 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:24:38.285+0000 7f693ef07700 1 -- 172.21.15.6:0/984980671 wait complete. 2024-03-12T16:24:38.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:38 smithi134 ceph-mon[85099]: from='client.34676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:38.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:38 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2080446433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:24:38.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:38 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/984980671' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:24:38.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:38 smithi006 ceph-mon[103869]: from='client.34676 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:38.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:38 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2080446433' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:24:38.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:38 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/984980671' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:24:39.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:39 smithi134 ceph-mon[85099]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:39.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:39 smithi134 ceph-mon[85099]: pgmap v342: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:39.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:39 smithi006 ceph-mon[103869]: from='client.34688 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:24:39.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:39 smithi006 ceph-mon[103869]: pgmap v342: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:41.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:41 smithi134 ceph-mon[85099]: pgmap v343: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:41.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:41 smithi006 ceph-mon[103869]: pgmap v343: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:43.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:43 smithi134 ceph-mon[85099]: pgmap v344: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:43.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:43 smithi006 ceph-mon[103869]: pgmap v344: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:45.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:45 smithi134 ceph-mon[85099]: pgmap v345: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:45.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:45 smithi006 ceph-mon[103869]: pgmap v345: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:47.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:47 smithi134 ceph-mon[85099]: pgmap v346: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:47.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:24:47.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:47 smithi006 ceph-mon[103869]: pgmap v346: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:47.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:24:49.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:49 smithi134 ceph-mon[85099]: pgmap v347: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:49.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:49 smithi006 ceph-mon[103869]: pgmap v347: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:51.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:51 smithi134 ceph-mon[85099]: pgmap v348: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:51.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:51 smithi006 ceph-mon[103869]: pgmap v348: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:53.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:53 smithi134 ceph-mon[85099]: pgmap v349: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:53.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:53 smithi006 ceph-mon[103869]: pgmap v349: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:55.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:55 smithi134 ceph-mon[85099]: pgmap v350: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:55.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:55 smithi006 ceph-mon[103869]: pgmap v350: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:57.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:57 smithi134 ceph-mon[85099]: pgmap v351: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:57.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:57 smithi006 ceph-mon[103869]: pgmap v351: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:59.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:24:59 smithi134 ceph-mon[85099]: pgmap v352: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:24:59.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:24:59 smithi006 ceph-mon[103869]: pgmap v352: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:01.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:01 smithi134 ceph-mon[85099]: pgmap v353: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:01.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:01 smithi006 ceph-mon[103869]: pgmap v353: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:02.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:25:02.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:25:03.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:03 smithi134 ceph-mon[85099]: pgmap v354: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:03.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:03 smithi006 ceph-mon[103869]: pgmap v354: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:05.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:05 smithi134 ceph-mon[85099]: pgmap v355: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:05.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:05 smithi006 ceph-mon[103869]: pgmap v355: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:07.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:07 smithi134 ceph-mon[85099]: pgmap v356: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:07.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:07 smithi006 ceph-mon[103869]: pgmap v356: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.404+0000 7f8571ebf700 1 -- 172.21.15.6:0/1933303260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 msgr2=0x7f856c0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.404+0000 7f8571ebf700 1 --2- 172.21.15.6:0/1933303260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 0x7f856c0f7a50 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f85600047f0 tx=0x7f8560009cb0).stop 2024-03-12T16:25:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.404+0000 7f8571ebf700 1 -- 172.21.15.6:0/1933303260 shutdown_connections 2024-03-12T16:25:08.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.404+0000 7f8571ebf700 1 --2- 172.21.15.6:0/1933303260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 0x7f856c0f7a50 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.404+0000 7f8571ebf700 1 --2- 172.21.15.6:0/1933303260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f856c0fd910 0x7f856c0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.404+0000 7f8571ebf700 1 -- 172.21.15.6:0/1933303260 >> 172.21.15.6:0/1933303260 conn(0x7f856c0f3530 msgr2=0x7f856c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.404+0000 7f8571ebf700 1 -- 172.21.15.6:0/1933303260 shutdown_connections 2024-03-12T16:25:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.404+0000 7f8571ebf700 1 -- 172.21.15.6:0/1933303260 wait complete. 2024-03-12T16:25:08.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.405+0000 7f8571ebf700 1 Processor -- start 2024-03-12T16:25:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.405+0000 7f8571ebf700 1 -- start start 2024-03-12T16:25:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.405+0000 7f8571ebf700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f856c0fd910 0x7f856c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.405+0000 7f8571ebf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 0x7f856c10e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.405+0000 7f8571ebf700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c10eab0 con 0x7f856c0fe270 2024-03-12T16:25:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.405+0000 7f8571ebf700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f856c10ebf0 con 0x7f856c0fd910 2024-03-12T16:25:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.405+0000 7f856affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 0x7f856c10e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:08.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f856affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 0x7f856c10e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56694/0 (socket says 172.21.15.6:56694) 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f856affd700 1 -- 172.21.15.6:0/299308039 learned_addr learned my addr 172.21.15.6:0/299308039 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f856b7fe700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f856c0fd910 0x7f856c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f856affd700 1 -- 172.21.15.6:0/299308039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f856c0fd910 msgr2=0x7f856c10dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f856affd700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f856c0fd910 0x7f856c10dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f856affd700 1 -- 172.21.15.6:0/299308039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8560005040 con 0x7f856c0fe270 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f856affd700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 0x7f856c10e4b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f85600099f0 tx=0x7f8560009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f8568ff9700 1 -- 172.21.15.6:0/299308039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f856000e030 con 0x7f856c0fe270 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f856c108220 con 0x7f856c0fe270 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f8568ff9700 1 -- 172.21.15.6:0/299308039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8560007e90 con 0x7f856c0fe270 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f8568ff9700 1 -- 172.21.15.6:0/299308039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8560018070 con 0x7f856c0fe270 2024-03-12T16:25:08.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.406+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f856c108780 con 0x7f856c0fe270 2024-03-12T16:25:08.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.407+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f856c05f570 con 0x7f856c0fe270 2024-03-12T16:25:08.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.408+0000 7f8568ff9700 1 -- 172.21.15.6:0/299308039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f85600094c0 con 0x7f856c0fe270 2024-03-12T16:25:08.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.408+0000 7f8568ff9700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f855406caa0 0x7f855406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:08.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.408+0000 7f8568ff9700 1 -- 172.21.15.6:0/299308039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f856008d000 con 0x7f856c0fe270 2024-03-12T16:25:08.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.408+0000 7f856b7fe700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f855406caa0 0x7f855406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:08.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.409+0000 7f856b7fe700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f855406caa0 0x7f855406ef60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f855c004de0 tx=0x7f855c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:08.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.413+0000 7f8568ff9700 1 -- 172.21.15.6:0/299308039 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f856005ab60 con 0x7f856c0fe270 2024-03-12T16:25:08.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.632+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f856c0ffc60 con 0x7f855406caa0 2024-03-12T16:25:08.634 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.634+0000 7f8568ff9700 1 -- 172.21.15.6:0/299308039 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f856c0ffc60 con 0x7f855406caa0 2024-03-12T16:25:08.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f855406caa0 msgr2=0x7f855406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:08.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f855406caa0 0x7f855406ef60 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 rx=0x7f855c004de0 tx=0x7f855c00b040).stop 2024-03-12T16:25:08.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 msgr2=0x7f856c10e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:08.636 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 0x7f856c10e4b0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f85600099f0 tx=0x7f8560009cb0).stop 2024-03-12T16:25:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 shutdown_connections 2024-03-12T16:25:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f856c0fd910 0x7f856c10dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f855406caa0 0x7f855406ef60 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 --2- 172.21.15.6:0/299308039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f856c0fe270 0x7f856c10e4b0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 >> 172.21.15.6:0/299308039 conn(0x7f856c0f3530 msgr2=0x7f856c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 shutdown_connections 2024-03-12T16:25:08.637 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.636+0000 7f8571ebf700 1 -- 172.21.15.6:0/299308039 wait complete. 2024-03-12T16:25:08.646 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.739+0000 7fafdbc94700 1 -- 172.21.15.6:0/809700421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 msgr2=0x7fafd40f6960 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.739+0000 7fafdbc94700 1 --2- 172.21.15.6:0/809700421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 0x7fafd40f6960 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fafc40047f0 tx=0x7fafc4009cb0).stop 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.739+0000 7fafdbc94700 1 -- 172.21.15.6:0/809700421 shutdown_connections 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.739+0000 7fafdbc94700 1 --2- 172.21.15.6:0/809700421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 0x7fafd40f6960 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.739+0000 7fafdbc94700 1 --2- 172.21.15.6:0/809700421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd40fc820 0x7fafd40fcc00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.739+0000 7fafdbc94700 1 -- 172.21.15.6:0/809700421 >> 172.21.15.6:0/809700421 conn(0x7fafd40f2400 msgr2=0x7fafd40f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.739+0000 7fafdbc94700 1 -- 172.21.15.6:0/809700421 shutdown_connections 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.739+0000 7fafdbc94700 1 -- 172.21.15.6:0/809700421 wait complete. 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafdbc94700 1 Processor -- start 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafdbc94700 1 -- start start 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafdbc94700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd40fc820 0x7fafd410e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:08.745 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafdbc94700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 0x7fafd410e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafdbc94700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd410eb00 con 0x7fafd40fd180 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafdbc94700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fafd410ec40 con 0x7fafd40fc820 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafd922f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 0x7fafd410e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafd922f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 0x7fafd410e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56710/0 (socket says 172.21.15.6:56710) 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafd922f700 1 -- 172.21.15.6:0/3678923906 learned_addr learned my addr 172.21.15.6:0/3678923906 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafd9a30700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd40fc820 0x7fafd410e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafd922f700 1 -- 172.21.15.6:0/3678923906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd40fc820 msgr2=0x7fafd410e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafd922f700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd40fc820 0x7fafd410e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafd922f700 1 -- 172.21.15.6:0/3678923906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fafc4005040 con 0x7fafd40fd180 2024-03-12T16:25:08.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafd9a30700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd40fc820 0x7fafd410e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:25:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.740+0000 7fafd922f700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 0x7fafd410e500 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fafc40099f0 tx=0x7fafc4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.741+0000 7fafcaffd700 1 -- 172.21.15.6:0/3678923906 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc400e030 con 0x7fafd40fd180 2024-03-12T16:25:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.741+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fafd4108270 con 0x7fafd40fd180 2024-03-12T16:25:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.741+0000 7fafcaffd700 1 -- 172.21.15.6:0/3678923906 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fafc4007e90 con 0x7fafd40fd180 2024-03-12T16:25:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.741+0000 7fafcaffd700 1 -- 172.21.15.6:0/3678923906 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fafc4018070 con 0x7fafd40fd180 2024-03-12T16:25:08.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.741+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fafd41087d0 con 0x7fafd40fd180 2024-03-12T16:25:08.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.742+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fafd405f510 con 0x7fafd40fd180 2024-03-12T16:25:08.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.743+0000 7fafcaffd700 1 -- 172.21.15.6:0/3678923906 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fafc401d420 con 0x7fafd40fd180 2024-03-12T16:25:08.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.743+0000 7fafcaffd700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fafc006caa0 0x7fafc006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:08.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.743+0000 7fafcaffd700 1 -- 172.21.15.6:0/3678923906 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fafc401de40 con 0x7fafd40fd180 2024-03-12T16:25:08.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.743+0000 7fafd9a30700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fafc006caa0 0x7fafc006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:08.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.744+0000 7fafd9a30700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fafc006caa0 0x7fafc006ef60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fafd0007fd0 tx=0x7fafd0009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:08.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.747+0000 7fafcaffd700 1 -- 172.21.15.6:0/3678923906 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fafc405b070 con 0x7fafd40fd180 2024-03-12T16:25:08.965 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.964+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fafd4108e60 con 0x7fafc006caa0 2024-03-12T16:25:08.966 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.966+0000 7fafcaffd700 1 -- 172.21.15.6:0/3678923906 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fafd4108e60 con 0x7fafc006caa0 2024-03-12T16:25:08.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fafc006caa0 msgr2=0x7fafc006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:08.968 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fafc006caa0 0x7fafc006ef60 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 rx=0x7fafd0007fd0 tx=0x7fafd0009040).stop 2024-03-12T16:25:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 msgr2=0x7fafd410e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 0x7fafd410e500 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fafc40099f0 tx=0x7fafc4009cb0).stop 2024-03-12T16:25:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 shutdown_connections 2024-03-12T16:25:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fafd40fc820 0x7fafd410e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fafc006caa0 0x7fafc006ef60 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 --2- 172.21.15.6:0/3678923906 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fafd40fd180 0x7fafd410e500 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 >> 172.21.15.6:0/3678923906 conn(0x7fafd40f2400 msgr2=0x7fafd4060e10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 shutdown_connections 2024-03-12T16:25:08.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:08.968+0000 7fafdbc94700 1 -- 172.21.15.6:0/3678923906 wait complete. 2024-03-12T16:25:09.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.069+0000 7f14ef9da700 1 -- 172.21.15.6:0/1500992056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fd830 msgr2=0x7f14e80fdc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.069+0000 7f14ef9da700 1 --2- 172.21.15.6:0/1500992056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fd830 0x7f14e80fdc10 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f14e40047f0 tx=0x7f14e4009cb0).stop 2024-03-12T16:25:09.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.070+0000 7f14ef9da700 1 -- 172.21.15.6:0/1500992056 shutdown_connections 2024-03-12T16:25:09.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.070+0000 7f14ef9da700 1 --2- 172.21.15.6:0/1500992056 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14e80fe190 0x7f14e80f7970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.070 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.070+0000 7f14ef9da700 1 --2- 172.21.15.6:0/1500992056 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fd830 0x7f14e80fdc10 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.070+0000 7f14ef9da700 1 -- 172.21.15.6:0/1500992056 >> 172.21.15.6:0/1500992056 conn(0x7f14e80f3450 msgr2=0x7f14e80f5870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:09.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.070+0000 7f14ef9da700 1 -- 172.21.15.6:0/1500992056 shutdown_connections 2024-03-12T16:25:09.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.070+0000 7f14ef9da700 1 -- 172.21.15.6:0/1500992056 wait complete. 2024-03-12T16:25:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.070+0000 7f14ef9da700 1 Processor -- start 2024-03-12T16:25:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.070+0000 7f14ef9da700 1 -- start start 2024-03-12T16:25:09.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.070+0000 7f14ef9da700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14e80fd830 0x7f14e806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ef9da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fe190 0x7f14e806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ef9da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e806bb70 con 0x7f14e80fe190 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ef9da700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f14e806bcb0 con 0x7f14e80fd830 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ecf75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fe190 0x7f14e806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ecf75700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fe190 0x7f14e806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56730/0 (socket says 172.21.15.6:56730) 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ecf75700 1 -- 172.21.15.6:0/3986005773 learned_addr learned my addr 172.21.15.6:0/3986005773 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ed776700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14e80fd830 0x7f14e806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ecf75700 1 -- 172.21.15.6:0/3986005773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14e80fd830 msgr2=0x7f14e806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ecf75700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14e80fd830 0x7f14e806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ecf75700 1 -- 172.21.15.6:0/3986005773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f14e4005040 con 0x7f14e80fe190 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ecf75700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fe190 0x7f14e806b5c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f14d8002780 tx=0x7f14d8009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14de7fc700 1 -- 172.21.15.6:0/3986005773 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d8007b40 con 0x7f14e80fe190 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14de7fc700 1 -- 172.21.15.6:0/3986005773 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f14d800f040 con 0x7f14e80fe190 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f14e81142e0 con 0x7f14e80fe190 2024-03-12T16:25:09.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14de7fc700 1 -- 172.21.15.6:0/3986005773 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f14d8014780 con 0x7f14e80fe190 2024-03-12T16:25:09.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.071+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14e8114760 con 0x7f14e80fe190 2024-03-12T16:25:09.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.072+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f14e805f470 con 0x7f14e80fe190 2024-03-12T16:25:09.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.073+0000 7f14de7fc700 1 -- 172.21.15.6:0/3986005773 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f14d8007ca0 con 0x7f14e80fe190 2024-03-12T16:25:09.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.073+0000 7f14de7fc700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14d406cb00 0x7f14d406efc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:09.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.073+0000 7f14de7fc700 1 -- 172.21.15.6:0/3986005773 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f14d808bc90 con 0x7f14e80fe190 2024-03-12T16:25:09.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.073+0000 7f14ed776700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14d406cb00 0x7f14d406efc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:09.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.074+0000 7f14ed776700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14d406cb00 0x7f14d406efc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f14e4004f10 tx=0x7f14e4009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:09.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.078+0000 7f14de7fc700 1 -- 172.21.15.6:0/3986005773 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f14d8055d60 con 0x7f14e80fe190 2024-03-12T16:25:09.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.285+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14e806c830 con 0x7f14d406cb00 2024-03-12T16:25:09.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.295+0000 7f14de7fc700 1 -- 172.21.15.6:0/3986005773 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f14e806c830 con 0x7f14d406cb00 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (11m) 5m ago 22m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (9m) 5m ago 22m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (9m) 5m ago 22m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (11m) 5m ago 22m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (6m) 5m ago 17m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (5m) 5m ago 17m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (5m) 5m ago 17m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (5m) 5m ago 17m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (13m) 5m ago 24m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (12m) 5m ago 22m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (10m) 5m ago 24m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (10m) 5m ago 22m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (12m) 5m ago 22m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:25:09.296 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (12m) 5m ago 21m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:25:09.297 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (9m) 5m ago 21m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:25:09.297 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (8m) 5m ago 21m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:25:09.297 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (8m) 5m ago 20m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:25:09.297 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (7m) 5m ago 20m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:25:09.297 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (6m) 5m ago 19m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:25:09.297 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (6m) 5m ago 19m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:25:09.297 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (12m) 5m ago 21m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14d406cb00 msgr2=0x7f14d406efc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14d406cb00 0x7f14d406efc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 rx=0x7f14e4004f10 tx=0x7f14e4009cb0).stop 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fe190 msgr2=0x7f14e806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fe190 0x7f14e806b5c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7f14d8002780 tx=0x7f14d8009ee0).stop 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 shutdown_connections 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14e80fd830 0x7f14e806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f14d406cb00 0x7f14d406efc0 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 --2- 172.21.15.6:0/3986005773 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14e80fe190 0x7f14e806b5c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 >> 172.21.15.6:0/3986005773 conn(0x7f14e80f3450 msgr2=0x7f14e80fbbf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 shutdown_connections 2024-03-12T16:25:09.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.297+0000 7f14ef9da700 1 -- 172.21.15.6:0/3986005773 wait complete. 2024-03-12T16:25:09.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.397+0000 7f0baacdc700 1 -- 172.21.15.6:0/3232021798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fd150 msgr2=0x7f0ba40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.397+0000 7f0baacdc700 1 --2- 172.21.15.6:0/3232021798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fd150 0x7f0ba40f6930 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f0b900047f0 tx=0x7f0b90009cb0).stop 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.397+0000 7f0baacdc700 1 -- 172.21.15.6:0/3232021798 shutdown_connections 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.397+0000 7f0baacdc700 1 --2- 172.21.15.6:0/3232021798 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fd150 0x7f0ba40f6930 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.397+0000 7f0baacdc700 1 --2- 172.21.15.6:0/3232021798 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40fc7f0 0x7f0ba40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.397+0000 7f0baacdc700 1 -- 172.21.15.6:0/3232021798 >> 172.21.15.6:0/3232021798 conn(0x7f0ba4070590 msgr2=0x7f0ba40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.397+0000 7f0baacdc700 1 -- 172.21.15.6:0/3232021798 shutdown_connections 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.397+0000 7f0baacdc700 1 -- 172.21.15.6:0/3232021798 wait complete. 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.398+0000 7f0baacdc700 1 Processor -- start 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.398+0000 7f0baacdc700 1 -- start start 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.398+0000 7f0baacdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fc7f0 0x7f0ba40f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.398+0000 7f0baacdc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40fd150 0x7f0ba40f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.398+0000 7f0baacdc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40f8f20 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.398+0000 7f0baacdc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0ba40f9060 con 0x7f0ba40fd150 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.398+0000 7f0ba8a78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fc7f0 0x7f0ba40f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.398+0000 7f0ba8a78700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fc7f0 0x7f0ba40f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56756/0 (socket says 172.21.15.6:56756) 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.398+0000 7f0ba8a78700 1 -- 172.21.15.6:0/3093849826 learned_addr learned my addr 172.21.15.6:0/3093849826 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0ba3fff700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40fd150 0x7f0ba40f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0ba8a78700 1 -- 172.21.15.6:0/3093849826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40fd150 msgr2=0x7f0ba40f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0ba8a78700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40fd150 0x7f0ba40f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0ba8a78700 1 -- 172.21.15.6:0/3093849826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0b90005040 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0ba8a78700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fc7f0 0x7f0ba40f8540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f0b980041d0 tx=0x7f0b98009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0ba1ffb700 1 -- 172.21.15.6:0/3093849826 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b98002d90 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0ba40f9310 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0ba1ffb700 1 -- 172.21.15.6:0/3093849826 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0b9800f040 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0ba1ffb700 1 -- 172.21.15.6:0/3093849826 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0b9800d800 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.399+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0ba41146a0 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.400+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0ba405f590 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.400+0000 7f0ba1ffb700 1 -- 172.21.15.6:0/3093849826 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f0b9800dac0 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.401+0000 7f0ba1ffb700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0b9406cab0 0x7f0b9406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.401+0000 7f0ba1ffb700 1 -- 172.21.15.6:0/3093849826 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0b9808bde0 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.401+0000 7f0ba3fff700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0b9406cab0 0x7f0b9406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:09.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.401+0000 7f0ba3fff700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0b9406cab0 0x7f0b9406ef70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f0ba40f9ce0 tx=0x7f0b90009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:09.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.405+0000 7f0ba1ffb700 1 -- 172.21.15.6:0/3093849826 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0b98055eb0 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.685+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0ba40f9b30 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.686+0000 7f0ba1ffb700 1 -- 172.21.15.6:0/3093849826 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f0b980594d0 con 0x7f0ba40fc7f0 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:25:09.687 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:25:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:25:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:25:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:25:09.688 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:25:09.688 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0b9406cab0 msgr2=0x7f0b9406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0b9406cab0 0x7f0b9406ef70 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 rx=0x7f0ba40f9ce0 tx=0x7f0b90009cb0).stop 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fc7f0 msgr2=0x7f0ba40f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fc7f0 0x7f0ba40f8540 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f0b980041d0 tx=0x7f0b98009f60).stop 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 shutdown_connections 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0b9406cab0 0x7f0b9406ef70 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0ba40fc7f0 0x7f0ba40f8540 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 --2- 172.21.15.6:0/3093849826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0ba40fd150 0x7f0ba40f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 >> 172.21.15.6:0/3093849826 conn(0x7f0ba4070590 msgr2=0x7f0ba4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 shutdown_connections 2024-03-12T16:25:09.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.688+0000 7f0baacdc700 1 -- 172.21.15.6:0/3093849826 wait complete. 2024-03-12T16:25:09.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.790+0000 7fe96bbd0700 1 -- 172.21.15.6:0/202976990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 msgr2=0x7fe9640f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.790+0000 7fe96bbd0700 1 --2- 172.21.15.6:0/202976990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 0x7fe9640f7a30 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7fe9600047f0 tx=0x7fe960009cb0).stop 2024-03-12T16:25:09.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.790+0000 7fe96bbd0700 1 -- 172.21.15.6:0/202976990 shutdown_connections 2024-03-12T16:25:09.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.790+0000 7fe96bbd0700 1 --2- 172.21.15.6:0/202976990 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 0x7fe9640f7a30 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.790+0000 7fe96bbd0700 1 --2- 172.21.15.6:0/202976990 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9640fd8f0 0x7fe9640fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.790+0000 7fe96bbd0700 1 -- 172.21.15.6:0/202976990 >> 172.21.15.6:0/202976990 conn(0x7fe9640f34b0 msgr2=0x7fe9640f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.790+0000 7fe96bbd0700 1 -- 172.21.15.6:0/202976990 shutdown_connections 2024-03-12T16:25:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.790+0000 7fe96bbd0700 1 -- 172.21.15.6:0/202976990 wait complete. 2024-03-12T16:25:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96bbd0700 1 Processor -- start 2024-03-12T16:25:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96bbd0700 1 -- start start 2024-03-12T16:25:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96bbd0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9640fd8f0 0x7fe96410e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:09.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96bbd0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 0x7fe96410e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96bbd0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96410eb70 con 0x7fe9640fe250 2024-03-12T16:25:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96bbd0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe96410ecb0 con 0x7fe9640fd8f0 2024-03-12T16:25:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96916b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 0x7fe96410e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96916b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 0x7fe96410e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56774/0 (socket says 172.21.15.6:56774) 2024-03-12T16:25:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96916b700 1 -- 172.21.15.6:0/2515825883 learned_addr learned my addr 172.21.15.6:0/2515825883 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96996c700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9640fd8f0 0x7fe96410e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:09.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96916b700 1 -- 172.21.15.6:0/2515825883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9640fd8f0 msgr2=0x7fe96410e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:09.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96916b700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9640fd8f0 0x7fe96410e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:09.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.791+0000 7fe96916b700 1 -- 172.21.15.6:0/2515825883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe960005040 con 0x7fe9640fe250 2024-03-12T16:25:09.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.792+0000 7fe96916b700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 0x7fe96410e570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fe9600099f0 tx=0x7fe960009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:09.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.792+0000 7fe95affd700 1 -- 172.21.15.6:0/2515825883 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe96000e030 con 0x7fe9640fe250 2024-03-12T16:25:09.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.792+0000 7fe95affd700 1 -- 172.21.15.6:0/2515825883 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe960007e90 con 0x7fe9640fe250 2024-03-12T16:25:09.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.792+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9641082e0 con 0x7fe9640fe250 2024-03-12T16:25:09.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.792+0000 7fe95affd700 1 -- 172.21.15.6:0/2515825883 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe960018070 con 0x7fe9640fe250 2024-03-12T16:25:09.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.792+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9641087c0 con 0x7fe9640fe250 2024-03-12T16:25:09.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.793+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe96405f590 con 0x7fe9640fe250 2024-03-12T16:25:09.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.793+0000 7fe95affd700 1 -- 172.21.15.6:0/2515825883 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe960009590 con 0x7fe9640fe250 2024-03-12T16:25:09.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.794+0000 7fe95affd700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe95006caa0 0x7fe95006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:09.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.794+0000 7fe95affd700 1 -- 172.21.15.6:0/2515825883 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe96008cf50 con 0x7fe9640fe250 2024-03-12T16:25:09.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.794+0000 7fe96996c700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe95006caa0 0x7fe95006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:09.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.794+0000 7fe96996c700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe95006caa0 0x7fe95006ef60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fe954009170 tx=0x7fe954009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:09.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:09.798+0000 7fe95affd700 1 -- 172.21.15.6:0/2515825883 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe9600c0190 con 0x7fe9640fe250 2024-03-12T16:25:09.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:09 smithi134 ceph-mon[85099]: pgmap v357: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:09.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:09 smithi134 ceph-mon[85099]: from='client.34696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:09.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:09 smithi006 ceph-mon[103869]: pgmap v357: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:09.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:09 smithi006 ceph-mon[103869]: from='client.34696 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.039+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe964047540 con 0x7fe9640fe250 2024-03-12T16:25:10.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.040+0000 7fe95affd700 1 -- 172.21.15.6:0/2515825883 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fe96005a820 con 0x7fe9640fe250 2024-03-12T16:25:10.040 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:25:10.041 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:25:10.042 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:25:10.043 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:25:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe95006caa0 msgr2=0x7fe95006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe95006caa0 0x7fe95006ef60 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 rx=0x7fe954009170 tx=0x7fe954009d60).stop 2024-03-12T16:25:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 msgr2=0x7fe96410e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 0x7fe96410e570 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7fe9600099f0 tx=0x7fe960009cb0).stop 2024-03-12T16:25:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 shutdown_connections 2024-03-12T16:25:10.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9640fd8f0 0x7fe96410e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe95006caa0 0x7fe95006ef60 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 --2- 172.21.15.6:0/2515825883 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9640fe250 0x7fe96410e570 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 >> 172.21.15.6:0/2515825883 conn(0x7fe9640f34b0 msgr2=0x7fe9640fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 shutdown_connections 2024-03-12T16:25:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.042+0000 7fe96bbd0700 1 -- 172.21.15.6:0/2515825883 wait complete. 2024-03-12T16:25:10.045 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:25:10.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.144+0000 7f69eb59e700 1 -- 172.21.15.6:0/1381363745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 msgr2=0x7f69e40fdaa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.144+0000 7f69eb59e700 1 --2- 172.21.15.6:0/1381363745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 0x7f69e40fdaa0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7f69d8004a10 tx=0x7f69d8009c50).stop 2024-03-12T16:25:10.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.144+0000 7f69eb59e700 1 -- 172.21.15.6:0/1381363745 shutdown_connections 2024-03-12T16:25:10.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.144+0000 7f69eb59e700 1 --2- 172.21.15.6:0/1381363745 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e40fe020 0x7f69e40f7800 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.144+0000 7f69eb59e700 1 --2- 172.21.15.6:0/1381363745 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 0x7f69e40fdaa0 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.144+0000 7f69eb59e700 1 -- 172.21.15.6:0/1381363745 >> 172.21.15.6:0/1381363745 conn(0x7f69e40f3280 msgr2=0x7f69e40f56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:10.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.144+0000 7f69eb59e700 1 -- 172.21.15.6:0/1381363745 shutdown_connections 2024-03-12T16:25:10.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.144+0000 7f69eb59e700 1 -- 172.21.15.6:0/1381363745 wait complete. 2024-03-12T16:25:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.145+0000 7f69eb59e700 1 Processor -- start 2024-03-12T16:25:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.145+0000 7f69eb59e700 1 -- start start 2024-03-12T16:25:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.145+0000 7f69eb59e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 0x7f69e410e1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.145+0000 7f69eb59e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e40fe020 0x7f69e410e6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.145+0000 7f69eb59e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e410eca0 con 0x7f69e40fd6c0 2024-03-12T16:25:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.145+0000 7f69eb59e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f69e410ede0 con 0x7f69e40fe020 2024-03-12T16:25:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.145+0000 7f69ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 0x7f69e410e1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.145+0000 7f69ea59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 0x7f69e410e1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56794/0 (socket says 172.21.15.6:56794) 2024-03-12T16:25:10.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.145+0000 7f69ea59c700 1 -- 172.21.15.6:0/114266539 learned_addr learned my addr 172.21.15.6:0/114266539 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69e9d9b700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e40fe020 0x7f69e410e6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69ea59c700 1 -- 172.21.15.6:0/114266539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e40fe020 msgr2=0x7f69e410e6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69ea59c700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e40fe020 0x7f69e410e6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69ea59c700 1 -- 172.21.15.6:0/114266539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f69d80045d0 con 0x7f69e40fd6c0 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69ea59c700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 0x7f69e410e1b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f69d8000c00 tx=0x7f69d8009c50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69d77fe700 1 -- 172.21.15.6:0/114266539 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69d801a070 con 0x7f69e40fd6c0 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69d77fe700 1 -- 172.21.15.6:0/114266539 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f69d8009580 con 0x7f69e40fd6c0 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f69e4108200 con 0x7f69e40fd6c0 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69d77fe700 1 -- 172.21.15.6:0/114266539 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f69d800e040 con 0x7f69e40fd6c0 2024-03-12T16:25:10.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.146+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f69e4108760 con 0x7f69e40fd6c0 2024-03-12T16:25:10.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.147+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f69e405f2f0 con 0x7f69e40fd6c0 2024-03-12T16:25:10.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.148+0000 7f69d77fe700 1 -- 172.21.15.6:0/114266539 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f69d80096f0 con 0x7f69e40fd6c0 2024-03-12T16:25:10.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.148+0000 7f69d77fe700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d006caa0 0x7f69d006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:10.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.148+0000 7f69d77fe700 1 -- 172.21.15.6:0/114266539 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f69d808c920 con 0x7f69e40fd6c0 2024-03-12T16:25:10.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.148+0000 7f69e9d9b700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d006caa0 0x7f69d006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:10.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.148+0000 7f69e9d9b700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d006caa0 0x7f69d006ef60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f69e4109af0 tx=0x7f69dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:10.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.153+0000 7f69d77fe700 1 -- 172.21.15.6:0/114266539 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f69d805a480 con 0x7f69e40fd6c0 2024-03-12T16:25:10.371 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.370+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f69e41098a0 con 0x7f69d006caa0 2024-03-12T16:25:10.372 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.371+0000 7f69d77fe700 1 -- 172.21.15.6:0/114266539 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f69e41098a0 con 0x7f69d006caa0 2024-03-12T16:25:10.372 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:25:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:25:10.372 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:25:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:25:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:25:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:25:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:25:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:25:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:25:10.373 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:25:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:25:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:25:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:25:10.374 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:25:10.374 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:25:10.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d006caa0 msgr2=0x7f69d006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.375 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d006caa0 0x7f69d006ef60 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 rx=0x7f69e4109af0 tx=0x7f69dc00b040).stop 2024-03-12T16:25:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 msgr2=0x7f69e410e1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 0x7f69e410e1b0 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f69d8000c00 tx=0x7f69d8009c50).stop 2024-03-12T16:25:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 shutdown_connections 2024-03-12T16:25:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f69d006caa0 0x7f69d006ef60 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f69e40fd6c0 0x7f69e410e1b0 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 --2- 172.21.15.6:0/114266539 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f69e40fe020 0x7f69e410e6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 >> 172.21.15.6:0/114266539 conn(0x7f69e40f3280 msgr2=0x7f69e40fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.373+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 shutdown_connections 2024-03-12T16:25:10.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.374+0000 7f69eb59e700 1 -- 172.21.15.6:0/114266539 wait complete. 2024-03-12T16:25:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 -- 172.21.15.6:0/2251667285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 msgr2=0x7fd3700fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 --2- 172.21.15.6:0/2251667285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 0x7fd3700fcbd0 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7fd3640047f0 tx=0x7fd364009cb0).stop 2024-03-12T16:25:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 -- 172.21.15.6:0/2251667285 shutdown_connections 2024-03-12T16:25:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 --2- 172.21.15.6:0/2251667285 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3700fd150 0x7fd3700f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 --2- 172.21.15.6:0/2251667285 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 0x7fd3700fcbd0 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 -- 172.21.15.6:0/2251667285 >> 172.21.15.6:0/2251667285 conn(0x7fd370070590 msgr2=0x7fd3700f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 -- 172.21.15.6:0/2251667285 shutdown_connections 2024-03-12T16:25:10.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 -- 172.21.15.6:0/2251667285 wait complete. 2024-03-12T16:25:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 Processor -- start 2024-03-12T16:25:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.476+0000 7fd376bab700 1 -- start start 2024-03-12T16:25:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd376bab700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 0x7fd37010dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd376bab700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3700fd150 0x7fd37010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd376bab700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37010eae0 con 0x7fd3700fc7f0 2024-03-12T16:25:10.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd376bab700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd37010ec20 con 0x7fd3700fd150 2024-03-12T16:25:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd374947700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 0x7fd37010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd374947700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 0x7fd37010dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56818/0 (socket says 172.21.15.6:56818) 2024-03-12T16:25:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd374947700 1 -- 172.21.15.6:0/1674964665 learned_addr learned my addr 172.21.15.6:0/1674964665 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd36ffff700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3700fd150 0x7fd37010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd374947700 1 -- 172.21.15.6:0/1674964665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3700fd150 msgr2=0x7fd37010e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd374947700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3700fd150 0x7fd37010e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd374947700 1 -- 172.21.15.6:0/1674964665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd364005040 con 0x7fd3700fc7f0 2024-03-12T16:25:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd374947700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 0x7fd37010dff0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd364005010 tx=0x7fd364009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd36dffb700 1 -- 172.21.15.6:0/1674964665 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd36400e030 con 0x7fd3700fc7f0 2024-03-12T16:25:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd36dffb700 1 -- 172.21.15.6:0/1674964665 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd364007e90 con 0x7fd3700fc7f0 2024-03-12T16:25:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd370108250 con 0x7fd3700fc7f0 2024-03-12T16:25:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.477+0000 7fd36dffb700 1 -- 172.21.15.6:0/1674964665 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd364018070 con 0x7fd3700fc7f0 2024-03-12T16:25:10.484 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.478+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd3701087b0 con 0x7fd3700fc7f0 2024-03-12T16:25:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.478+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd37005f590 con 0x7fd3700fc7f0 2024-03-12T16:25:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.479+0000 7fd36dffb700 1 -- 172.21.15.6:0/1674964665 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd36401d6e0 con 0x7fd3700fc7f0 2024-03-12T16:25:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.479+0000 7fd36dffb700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd36006caa0 0x7fd36006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.479+0000 7fd36dffb700 1 -- 172.21.15.6:0/1674964665 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd36408d0d0 con 0x7fd3700fc7f0 2024-03-12T16:25:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.479+0000 7fd36ffff700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd36006caa0 0x7fd36006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:10.485 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.480+0000 7fd36ffff700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd36006caa0 0x7fd36006ef60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fd370109930 tx=0x7fd35c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:10.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.484+0000 7fd36dffb700 1 -- 172.21.15.6:0/1674964665 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd36405a8e0 con 0x7fd3700fc7f0 2024-03-12T16:25:10.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.762+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd370047540 con 0x7fd3700fc7f0 2024-03-12T16:25:10.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.762+0000 7fd36dffb700 1 -- 172.21.15.6:0/1674964665 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fd36405a700 con 0x7fd3700fc7f0 2024-03-12T16:25:10.763 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:25:10.763 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:25:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:25:10.763 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:25:10.763 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:25:10.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.764+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd36006caa0 msgr2=0x7fd36006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.764+0000 7fd376bab700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd36006caa0 0x7fd36006ef60 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 rx=0x7fd370109930 tx=0x7fd35c00b040).stop 2024-03-12T16:25:10.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.764+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 msgr2=0x7fd37010dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:10.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.764+0000 7fd376bab700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 0x7fd37010dff0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fd364005010 tx=0x7fd364009cb0).stop 2024-03-12T16:25:10.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.765+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 shutdown_connections 2024-03-12T16:25:10.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.765+0000 7fd376bab700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd36006caa0 0x7fd36006ef60 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.765+0000 7fd376bab700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd3700fc7f0 0x7fd37010dff0 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.765 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.765+0000 7fd376bab700 1 --2- 172.21.15.6:0/1674964665 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd3700fd150 0x7fd37010e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:10.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.765+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 >> 172.21.15.6:0/1674964665 conn(0x7fd370070590 msgr2=0x7fd370060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:10.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.765+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 shutdown_connections 2024-03-12T16:25:10.766 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:10.765+0000 7fd376bab700 1 -- 172.21.15.6:0/1674964665 wait complete. 2024-03-12T16:25:10.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:10 smithi134 ceph-mon[85099]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:10.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:10 smithi134 ceph-mon[85099]: from='client.34704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:10.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:10 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3093849826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:25:10.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:10 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2515825883' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:25:10.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:10 smithi006 ceph-mon[103869]: from='client.34700 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:10.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:10 smithi006 ceph-mon[103869]: from='client.34704 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:10.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:10 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3093849826' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:25:10.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:10 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2515825883' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:25:11.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:11 smithi134 ceph-mon[85099]: pgmap v358: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:11.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:11 smithi134 ceph-mon[85099]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:11.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:11 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1674964665' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:25:11.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:11 smithi006 ceph-mon[103869]: pgmap v358: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:11.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:11 smithi006 ceph-mon[103869]: from='client.34716 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:11.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:11 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1674964665' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:25:13.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:13 smithi134 ceph-mon[85099]: pgmap v359: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:13.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:13 smithi006 ceph-mon[103869]: pgmap v359: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:15.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:15 smithi134 ceph-mon[85099]: pgmap v360: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:15.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:15 smithi006 ceph-mon[103869]: pgmap v360: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:17.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:17 smithi134 ceph-mon[85099]: pgmap v361: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:17.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:25:17.959 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:17 smithi006 ceph-mon[103869]: pgmap v361: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:17.959 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:25:19.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:19 smithi134 ceph-mon[85099]: pgmap v362: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:19.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:19 smithi006 ceph-mon[103869]: pgmap v362: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:21.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:21 smithi134 ceph-mon[85099]: pgmap v363: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:21.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:21 smithi006 ceph-mon[103869]: pgmap v363: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:23.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:23 smithi134 ceph-mon[85099]: pgmap v364: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:23.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:23 smithi006 ceph-mon[103869]: pgmap v364: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:25.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:25 smithi134 ceph-mon[85099]: pgmap v365: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:25.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:25 smithi006 ceph-mon[103869]: pgmap v365: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:27.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:27 smithi134 ceph-mon[85099]: pgmap v366: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:27.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:27 smithi006 ceph-mon[103869]: pgmap v366: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:29.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:29 smithi134 ceph-mon[85099]: pgmap v367: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:29.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:29 smithi006 ceph-mon[103869]: pgmap v367: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:31.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:31 smithi134 ceph-mon[85099]: pgmap v368: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:31.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:31 smithi006 ceph-mon[103869]: pgmap v368: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:32.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:25:32.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:25:33.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:33 smithi134 ceph-mon[85099]: pgmap v369: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:33.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:33 smithi006 ceph-mon[103869]: pgmap v369: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:35.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:35 smithi134 ceph-mon[85099]: pgmap v370: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:35.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:35 smithi006 ceph-mon[103869]: pgmap v370: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:37.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:37 smithi134 ceph-mon[85099]: pgmap v371: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:37.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:37 smithi006 ceph-mon[103869]: pgmap v371: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:39.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:39 smithi134 ceph-mon[85099]: pgmap v372: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:39.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:39 smithi006 ceph-mon[103869]: pgmap v372: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:40.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.881+0000 7f53a4673700 1 -- 172.21.15.6:0/358383138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b9e0 msgr2=0x7f539c103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:40.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.881+0000 7f53a4673700 1 --2- 172.21.15.6:0/358383138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b9e0 0x7f539c103cc0 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f53980047f0 tx=0x7f5398009cb0).stop 2024-03-12T16:25:40.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.881+0000 7f53a4673700 1 -- 172.21.15.6:0/358383138 shutdown_connections 2024-03-12T16:25:40.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.881+0000 7f53a4673700 1 --2- 172.21.15.6:0/358383138 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b9e0 0x7f539c103cc0 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:40.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.881+0000 7f53a4673700 1 --2- 172.21.15.6:0/358383138 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f539c06b110 0x7f539c06b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:40.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.881+0000 7f53a4673700 1 -- 172.21.15.6:0/358383138 >> 172.21.15.6:0/358383138 conn(0x7f539c0f3530 msgr2=0x7f539c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:40.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.881+0000 7f53a4673700 1 -- 172.21.15.6:0/358383138 shutdown_connections 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.881+0000 7f53a4673700 1 -- 172.21.15.6:0/358383138 wait complete. 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.882+0000 7f53a4673700 1 Processor -- start 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.882+0000 7f53a4673700 1 -- start start 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.882+0000 7f53a4673700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b110 0x7f539c1103a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.882+0000 7f53a4673700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f539c06b9e0 0x7f539c110890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.882+0000 7f53a4673700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c110e90 con 0x7f539c06b110 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.882+0000 7f53a4673700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f539c110fd0 con 0x7f539c06b9e0 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.882+0000 7f53a240f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b110 0x7f539c1103a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.882+0000 7f53a240f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b110 0x7f539c1103a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37456/0 (socket says 172.21.15.6:37456) 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.882+0000 7f53a240f700 1 -- 172.21.15.6:0/4132027247 learned_addr learned my addr 172.21.15.6:0/4132027247 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f53a1c0e700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f539c06b9e0 0x7f539c110890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f53a240f700 1 -- 172.21.15.6:0/4132027247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f539c06b9e0 msgr2=0x7f539c110890 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:40.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f53a240f700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f539c06b9e0 0x7f539c110890 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:40.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f53a240f700 1 -- 172.21.15.6:0/4132027247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5398005040 con 0x7f539c06b110 2024-03-12T16:25:40.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f53a240f700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b110 0x7f539c1103a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f539000e8f0 tx=0x7f539000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:40.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f538f7fe700 1 -- 172.21.15.6:0/4132027247 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f539000ee90 con 0x7f539c06b110 2024-03-12T16:25:40.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f538f7fe700 1 -- 172.21.15.6:0/4132027247 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f539000f040 con 0x7f539c06b110 2024-03-12T16:25:40.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f539c10a660 con 0x7f539c06b110 2024-03-12T16:25:40.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f538f7fe700 1 -- 172.21.15.6:0/4132027247 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f539000c8a0 con 0x7f539c06b110 2024-03-12T16:25:40.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.883+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f539c10aba0 con 0x7f539c06b110 2024-03-12T16:25:40.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.884+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f539c05f570 con 0x7f539c06b110 2024-03-12T16:25:40.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.885+0000 7f538f7fe700 1 -- 172.21.15.6:0/4132027247 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5390007b40 con 0x7f539c06b110 2024-03-12T16:25:40.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.885+0000 7f538f7fe700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f538806caa0 0x7f538806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:40.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.886+0000 7f538f7fe700 1 -- 172.21.15.6:0/4132027247 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f539008ba50 con 0x7f539c06b110 2024-03-12T16:25:40.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.886+0000 7f53a1c0e700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f538806caa0 0x7f538806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:40.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.886+0000 7f53a1c0e700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f538806caa0 0x7f538806ef60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5398004e60 tx=0x7f539800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:40.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:40.890+0000 7f538f7fe700 1 -- 172.21.15.6:0/4132027247 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f53900595b0 con 0x7f539c06b110 2024-03-12T16:25:41.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.107+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f539c10bb30 con 0x7f538806caa0 2024-03-12T16:25:41.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.108+0000 7f538f7fe700 1 -- 172.21.15.6:0/4132027247 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f539c10bb30 con 0x7f538806caa0 2024-03-12T16:25:41.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.110+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f538806caa0 msgr2=0x7f538806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.110+0000 7f53a4673700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f538806caa0 0x7f538806ef60 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 rx=0x7f5398004e60 tx=0x7f539800b040).stop 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.110+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b110 msgr2=0x7f539c1103a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.110+0000 7f53a4673700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b110 0x7f539c1103a0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f539000e8f0 tx=0x7f539000b040).stop 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.110+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 shutdown_connections 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.110+0000 7f53a4673700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f538806caa0 0x7f538806ef60 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.110+0000 7f53a4673700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f539c06b110 0x7f539c1103a0 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.110+0000 7f53a4673700 1 --2- 172.21.15.6:0/4132027247 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f539c06b9e0 0x7f539c110890 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.111+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 >> 172.21.15.6:0/4132027247 conn(0x7f539c0f3530 msgr2=0x7f539c103710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.111+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 shutdown_connections 2024-03-12T16:25:41.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.111+0000 7f53a4673700 1 -- 172.21.15.6:0/4132027247 wait complete. 2024-03-12T16:25:41.121 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:25:41.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.213+0000 7f2ede778700 1 -- 172.21.15.6:0/3961035807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 msgr2=0x7f2ed80fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.213+0000 7f2ede778700 1 --2- 172.21.15.6:0/3961035807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 0x7f2ed80fcbd0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f2ec80047f0 tx=0x7f2ec8009cb0).stop 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.213+0000 7f2ede778700 1 -- 172.21.15.6:0/3961035807 shutdown_connections 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.213+0000 7f2ede778700 1 --2- 172.21.15.6:0/3961035807 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed80fd150 0x7f2ed80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.213+0000 7f2ede778700 1 --2- 172.21.15.6:0/3961035807 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 0x7f2ed80fcbd0 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.213+0000 7f2ede778700 1 -- 172.21.15.6:0/3961035807 >> 172.21.15.6:0/3961035807 conn(0x7f2ed8070590 msgr2=0x7f2ed80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.213+0000 7f2ede778700 1 -- 172.21.15.6:0/3961035807 shutdown_connections 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.213+0000 7f2ede778700 1 -- 172.21.15.6:0/3961035807 wait complete. 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.214+0000 7f2ede778700 1 Processor -- start 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.214+0000 7f2ede778700 1 -- start start 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.214+0000 7f2ede778700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 0x7f2ed80f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.214+0000 7f2ede778700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed80fd150 0x7f2ed80f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.214+0000 7f2ede778700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80f8f20 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.214+0000 7f2ede778700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ed80f9060 con 0x7f2ed80fd150 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.214+0000 7f2ed7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 0x7f2ed80f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.214+0000 7f2ed7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 0x7f2ed80f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37484/0 (socket says 172.21.15.6:37484) 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.214+0000 7f2ed7fff700 1 -- 172.21.15.6:0/229855021 learned_addr learned my addr 172.21.15.6:0/229855021 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ed77fe700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed80fd150 0x7f2ed80f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ed7fff700 1 -- 172.21.15.6:0/229855021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed80fd150 msgr2=0x7f2ed80f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ed7fff700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed80fd150 0x7f2ed80f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ed7fff700 1 -- 172.21.15.6:0/229855021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ec8005040 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ed7fff700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 0x7f2ed80f8540 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f2ec8005010 tx=0x7f2ec8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ed57fa700 1 -- 172.21.15.6:0/229855021 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec800e030 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ed57fa700 1 -- 172.21.15.6:0/229855021 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ec8007e90 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ed80f92b0 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ed57fa700 1 -- 172.21.15.6:0/229855021 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ec8018070 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.215+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ed81145d0 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.216+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ed805f590 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.217+0000 7f2ed57fa700 1 -- 172.21.15.6:0/229855021 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2ec801d670 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.217+0000 7f2ed57fa700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ec006caa0 0x7f2ec006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.217+0000 7f2ed57fa700 1 -- 172.21.15.6:0/229855021 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2ec808cf40 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.217+0000 7f2ed77fe700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ec006caa0 0x7f2ec006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:41.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.217+0000 7f2ed77fe700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ec006caa0 0x7f2ec006ef60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f2ed80f9ce0 tx=0x7f2ecc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:41.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.221+0000 7f2ed57fa700 1 -- 172.21.15.6:0/229855021 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2ec80c0190 con 0x7f2ed80fc7f0 2024-03-12T16:25:41.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.437+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2ed80fb5a0 con 0x7f2ec006caa0 2024-03-12T16:25:41.438 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.438+0000 7f2ed57fa700 1 -- 172.21.15.6:0/229855021 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2ed80fb5a0 con 0x7f2ec006caa0 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.440+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ec006caa0 msgr2=0x7f2ec006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.440+0000 7f2ede778700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ec006caa0 0x7f2ec006ef60 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 rx=0x7f2ed80f9ce0 tx=0x7f2ecc00b040).stop 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.440+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 msgr2=0x7f2ed80f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.440+0000 7f2ede778700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 0x7f2ed80f8540 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7f2ec8005010 tx=0x7f2ec8009cb0).stop 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.440+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 shutdown_connections 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.441+0000 7f2ede778700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ec006caa0 0x7f2ec006ef60 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.441+0000 7f2ede778700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ed80fc7f0 0x7f2ed80f8540 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.441+0000 7f2ede778700 1 --2- 172.21.15.6:0/229855021 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ed80fd150 0x7f2ed80f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.441+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 >> 172.21.15.6:0/229855021 conn(0x7f2ed8070590 msgr2=0x7f2ed8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.441+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 shutdown_connections 2024-03-12T16:25:41.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.441+0000 7f2ede778700 1 -- 172.21.15.6:0/229855021 wait complete. 2024-03-12T16:25:41.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.542+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/1763750077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fe250 msgr2=0x7f2b640f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.542+0000 7f2b6b6f9700 1 --2- 172.21.15.6:0/1763750077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fe250 0x7f2b640f7a30 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f2b540047f0 tx=0x7f2b54009cb0).stop 2024-03-12T16:25:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.542+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/1763750077 shutdown_connections 2024-03-12T16:25:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.542+0000 7f2b6b6f9700 1 --2- 172.21.15.6:0/1763750077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fe250 0x7f2b640f7a30 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.542+0000 7f2b6b6f9700 1 --2- 172.21.15.6:0/1763750077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b640fd8f0 0x7f2b640fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.542+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/1763750077 >> 172.21.15.6:0/1763750077 conn(0x7f2b640f34b0 msgr2=0x7f2b640f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.542+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/1763750077 shutdown_connections 2024-03-12T16:25:41.543 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.542+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/1763750077 wait complete. 2024-03-12T16:25:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.543+0000 7f2b6b6f9700 1 Processor -- start 2024-03-12T16:25:41.544 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.543+0000 7f2b6b6f9700 1 -- start start 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.543+0000 7f2b6b6f9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fd8f0 0x7f2b64110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.543+0000 7f2b6b6f9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b640fe250 0x7f2b64110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.543+0000 7f2b6b6f9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64110d60 con 0x7f2b640fd8f0 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.543+0000 7f2b6b6f9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b64110ea0 con 0x7f2b640fe250 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.543+0000 7f2b69495700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fd8f0 0x7f2b64110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.543+0000 7f2b69495700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fd8f0 0x7f2b64110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37512/0 (socket says 172.21.15.6:37512) 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.543+0000 7f2b69495700 1 -- 172.21.15.6:0/4061838877 learned_addr learned my addr 172.21.15.6:0/4061838877 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b68c94700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b640fe250 0x7f2b64110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b69495700 1 -- 172.21.15.6:0/4061838877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b640fe250 msgr2=0x7f2b64110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b69495700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b640fe250 0x7f2b64110760 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b69495700 1 -- 172.21.15.6:0/4061838877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b54005040 con 0x7f2b640fd8f0 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b69495700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fd8f0 0x7f2b64110270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f2b60002770 tx=0x7f2b60002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b5a7fc700 1 -- 172.21.15.6:0/4061838877 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b60002d80 con 0x7f2b640fd8f0 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b5a7fc700 1 -- 172.21.15.6:0/4061838877 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b6000f040 con 0x7f2b640fd8f0 2024-03-12T16:25:41.545 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b5a7fc700 1 -- 172.21.15.6:0/4061838877 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b6000d800 con 0x7f2b640fd8f0 2024-03-12T16:25:41.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b6410a530 con 0x7f2b640fd8f0 2024-03-12T16:25:41.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.544+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b6410aa70 con 0x7f2b640fd8f0 2024-03-12T16:25:41.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.545+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b6405f590 con 0x7f2b640fd8f0 2024-03-12T16:25:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.545+0000 7f2b5a7fc700 1 -- 172.21.15.6:0/4061838877 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2b60009110 con 0x7f2b640fd8f0 2024-03-12T16:25:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.546+0000 7f2b5a7fc700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b5006caa0 0x7f2b5006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.546+0000 7f2b5a7fc700 1 -- 172.21.15.6:0/4061838877 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2b6008b8f0 con 0x7f2b640fd8f0 2024-03-12T16:25:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.546+0000 7f2b68c94700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b5006caa0 0x7f2b5006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:41.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.546+0000 7f2b68c94700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b5006caa0 0x7f2b5006ef60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f2b6410bbb0 tx=0x7f2b5400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:41.550 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.550+0000 7f2b5a7fc700 1 -- 172.21.15.6:0/4061838877 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2b60059450 con 0x7f2b640fd8f0 2024-03-12T16:25:41.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.761+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b6410ad40 con 0x7f2b5006caa0 2024-03-12T16:25:41.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.771+0000 7f2b5a7fc700 1 -- 172.21.15.6:0/4061838877 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f2b6410ad40 con 0x7f2b5006caa0 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (12m) 6m ago 23m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (10m) 6m ago 23m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (10m) 5m ago 22m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (12m) 6m ago 23m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (6m) 6m ago 18m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (6m) 6m ago 18m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (6m) 5m ago 18m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (5m) 5m ago 18m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (14m) 6m ago 24m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:25:41.771 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (13m) 5m ago 22m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (11m) 6m ago 24m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (10m) 5m ago 22m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (13m) 6m ago 23m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (13m) 5m ago 22m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (9m) 6m ago 22m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (9m) 6m ago 21m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (8m) 6m ago 21m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (8m) 5m ago 20m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (7m) 5m ago 20m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (6m) 5m ago 19m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:25:41.772 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (12m) 5m ago 21m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b5006caa0 msgr2=0x7f2b5006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b5006caa0 0x7f2b5006ef60 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 rx=0x7f2b6410bbb0 tx=0x7f2b5400b040).stop 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fd8f0 msgr2=0x7f2b64110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fd8f0 0x7f2b64110270 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7f2b60002770 tx=0x7f2b60002b30).stop 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 shutdown_connections 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b5006caa0 0x7f2b5006ef60 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b640fd8f0 0x7f2b64110270 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 --2- 172.21.15.6:0/4061838877 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b640fe250 0x7f2b64110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 >> 172.21.15.6:0/4061838877 conn(0x7f2b640f34b0 msgr2=0x7f2b6406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:41.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 shutdown_connections 2024-03-12T16:25:41.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.773+0000 7f2b6b6f9700 1 -- 172.21.15.6:0/4061838877 wait complete. 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.874+0000 7f34f671b700 1 -- 172.21.15.6:0/174050611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fc830 msgr2=0x7f34f00fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.874+0000 7f34f671b700 1 --2- 172.21.15.6:0/174050611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fc830 0x7f34f00fcc10 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f34e00047f0 tx=0x7f34e0009cb0).stop 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.874+0000 7f34f671b700 1 -- 172.21.15.6:0/174050611 shutdown_connections 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.874+0000 7f34f671b700 1 --2- 172.21.15.6:0/174050611 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34f00fd190 0x7f34f00f6980 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.874+0000 7f34f671b700 1 --2- 172.21.15.6:0/174050611 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fc830 0x7f34f00fcc10 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.874+0000 7f34f671b700 1 -- 172.21.15.6:0/174050611 >> 172.21.15.6:0/174050611 conn(0x7f34f006c760 msgr2=0x7f34f006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.874+0000 7f34f671b700 1 -- 172.21.15.6:0/174050611 shutdown_connections 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.874+0000 7f34f671b700 1 -- 172.21.15.6:0/174050611 wait complete. 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.875+0000 7f34f671b700 1 Processor -- start 2024-03-12T16:25:41.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.875+0000 7f34f671b700 1 -- start start 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.875+0000 7f34f671b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34f00fc830 0x7f34f010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.875+0000 7f34f671b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fd190 0x7f34f010d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.875+0000 7f34f671b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f010d9c0 con 0x7f34f00fd190 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.875+0000 7f34f671b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34f010db00 con 0x7f34f00fc830 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fd190 0x7f34f010d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ef7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fd190 0x7f34f010d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37520/0 (socket says 172.21.15.6:37520) 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ef7fe700 1 -- 172.21.15.6:0/2534091279 learned_addr learned my addr 172.21.15.6:0/2534091279 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34effff700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34f00fc830 0x7f34f010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ef7fe700 1 -- 172.21.15.6:0/2534091279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34f00fc830 msgr2=0x7f34f010ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ef7fe700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34f00fc830 0x7f34f010ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:41.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ef7fe700 1 -- 172.21.15.6:0/2534091279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0005040 con 0x7f34f00fd190 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34effff700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34f00fc830 0x7f34f010ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ef7fe700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fd190 0x7f34f010d3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f34e4002780 tx=0x7f34e4009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2534091279 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e4007b40 con 0x7f34f00fd190 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2534091279 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34e400f040 con 0x7f34f00fd190 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34f0107190 con 0x7f34f00fd190 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2534091279 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e4014780 con 0x7f34f00fd190 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.876+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34f0107750 con 0x7f34f00fd190 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.877+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34f005f570 con 0x7f34f00fd190 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.878+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2534091279 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f34e4007ca0 con 0x7f34f00fd190 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.878+0000 7f34ed7fa700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d806caa0 0x7f34d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.878+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2534091279 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f34e408bcf0 con 0x7f34f00fd190 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.878+0000 7f34effff700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d806caa0 0x7f34d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.879+0000 7f34effff700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d806caa0 0x7f34d806ef60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f34e0004540 tx=0x7f34e000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:41.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:41.883+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2534091279 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f34e4059850 con 0x7f34f00fd190 2024-03-12T16:25:41.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:41 smithi134 ceph-mon[85099]: pgmap v373: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:41.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:41 smithi006 ceph-mon[103869]: pgmap v373: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:42.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.164+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f34f0047540 con 0x7f34f00fd190 2024-03-12T16:25:42.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.165+0000 7f34ed7fa700 1 -- 172.21.15.6:0/2534091279 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f34e40593e0 con 0x7f34f00fd190 2024-03-12T16:25:42.165 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:25:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:25:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:25:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:25:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:25:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:25:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:25:42.165 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:25:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:25:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:25:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:25:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:25:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:25:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:25:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:25:42.166 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:25:42.166 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d806caa0 msgr2=0x7f34d806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d806caa0 0x7f34d806ef60 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 rx=0x7f34e0004540 tx=0x7f34e000b040).stop 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fd190 msgr2=0x7f34f010d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fd190 0x7f34f010d3c0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f34e4002780 tx=0x7f34e4009ee0).stop 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 shutdown_connections 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34f00fc830 0x7f34f010ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d806caa0 0x7f34d806ef60 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 --2- 172.21.15.6:0/2534091279 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34f00fd190 0x7f34f010d3c0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 >> 172.21.15.6:0/2534091279 conn(0x7f34f006c760 msgr2=0x7f34f00fabf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 shutdown_connections 2024-03-12T16:25:42.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.167+0000 7f34f671b700 1 -- 172.21.15.6:0/2534091279 wait complete. 2024-03-12T16:25:42.273 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.268+0000 7f6efb684700 1 -- 172.21.15.6:0/2558390882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 msgr2=0x7f6ef40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.268+0000 7f6efb684700 1 --2- 172.21.15.6:0/2558390882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 0x7f6ef40f6930 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f6ee40047f0 tx=0x7f6ee4009cb0).stop 2024-03-12T16:25:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.268+0000 7f6efb684700 1 -- 172.21.15.6:0/2558390882 shutdown_connections 2024-03-12T16:25:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.268+0000 7f6efb684700 1 --2- 172.21.15.6:0/2558390882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 0x7f6ef40f6930 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.268+0000 7f6efb684700 1 --2- 172.21.15.6:0/2558390882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ef40fc7f0 0x7f6ef40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.268+0000 7f6efb684700 1 -- 172.21.15.6:0/2558390882 >> 172.21.15.6:0/2558390882 conn(0x7f6ef4070590 msgr2=0x7f6ef40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.268+0000 7f6efb684700 1 -- 172.21.15.6:0/2558390882 shutdown_connections 2024-03-12T16:25:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.268+0000 7f6efb684700 1 -- 172.21.15.6:0/2558390882 wait complete. 2024-03-12T16:25:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6efb684700 1 Processor -- start 2024-03-12T16:25:42.275 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6efb684700 1 -- start start 2024-03-12T16:25:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6efb684700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ef40fc7f0 0x7f6ef40f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6efb684700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 0x7f6ef40f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6efb684700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef40f8f20 con 0x7f6ef40fd150 2024-03-12T16:25:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6efb684700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ef40f9060 con 0x7f6ef40fc7f0 2024-03-12T16:25:42.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6ef8c1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 0x7f6ef40f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6ef8c1f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 0x7f6ef40f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:37548/0 (socket says 172.21.15.6:37548) 2024-03-12T16:25:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6ef8c1f700 1 -- 172.21.15.6:0/870177514 learned_addr learned my addr 172.21.15.6:0/870177514 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.269+0000 7f6ef9420700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ef40fc7f0 0x7f6ef40f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.270+0000 7f6ef8c1f700 1 -- 172.21.15.6:0/870177514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ef40fc7f0 msgr2=0x7f6ef40f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.277 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.270+0000 7f6ef8c1f700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ef40fc7f0 0x7f6ef40f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.270+0000 7f6ef8c1f700 1 -- 172.21.15.6:0/870177514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ee4005040 con 0x7f6ef40fd150 2024-03-12T16:25:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.270+0000 7f6ef8c1f700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 0x7f6ef40f8a30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f6ee4000c00 tx=0x7f6ee4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.270+0000 7f6eea7fc700 1 -- 172.21.15.6:0/870177514 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee400e030 con 0x7f6ef40fd150 2024-03-12T16:25:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.270+0000 7f6eea7fc700 1 -- 172.21.15.6:0/870177514 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ee4007e90 con 0x7f6ef40fd150 2024-03-12T16:25:42.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.270+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ef40f92b0 con 0x7f6ef40fd150 2024-03-12T16:25:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.270+0000 7f6eea7fc700 1 -- 172.21.15.6:0/870177514 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ee4018070 con 0x7f6ef40fd150 2024-03-12T16:25:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.270+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ef41145d0 con 0x7f6ef40fd150 2024-03-12T16:25:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.271+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ef405f590 con 0x7f6ef40fd150 2024-03-12T16:25:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.271+0000 7f6eea7fc700 1 -- 172.21.15.6:0/870177514 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f6ee401d420 con 0x7f6ef40fd150 2024-03-12T16:25:42.279 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.272+0000 7f6eea7fc700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee006cab0 0x7f6ee006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:42.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.272+0000 7f6eea7fc700 1 -- 172.21.15.6:0/870177514 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6ee408cfe0 con 0x7f6ef40fd150 2024-03-12T16:25:42.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.272+0000 7f6ef9420700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee006cab0 0x7f6ee006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:42.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.272+0000 7f6ef9420700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee006cab0 0x7f6ee006ef70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6ef0004dc0 tx=0x7f6ef000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:42.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.276+0000 7f6eea7fc700 1 -- 172.21.15.6:0/870177514 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6ee40c0190 con 0x7f6ef40fd150 2024-03-12T16:25:42.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.518+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6ef4047540 con 0x7f6ef40fd150 2024-03-12T16:25:42.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.518+0000 7f6eea7fc700 1 -- 172.21.15.6:0/870177514 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f6ee4056ff0 con 0x7f6ef40fd150 2024-03-12T16:25:42.518 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:25:42.518 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:25:42.518 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:25:42.518 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:25:42.518 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:25:42.519 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:25:42.520 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:25:42.521 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:25:42.521 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:25:42.521 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:25:42.521 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:25:42.521 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:25:42.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee006cab0 msgr2=0x7f6ee006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee006cab0 0x7f6ee006ef70 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 rx=0x7f6ef0004dc0 tx=0x7f6ef000b040).stop 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 msgr2=0x7f6ef40f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 0x7f6ef40f8a30 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7f6ee4000c00 tx=0x7f6ee4009cb0).stop 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 shutdown_connections 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ef40fc7f0 0x7f6ef40f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee006cab0 0x7f6ee006ef70 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 --2- 172.21.15.6:0/870177514 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ef40fd150 0x7f6ef40f8a30 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 >> 172.21.15.6:0/870177514 conn(0x7f6ef4070590 msgr2=0x7f6ef4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 shutdown_connections 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.520+0000 7f6efb684700 1 -- 172.21.15.6:0/870177514 wait complete. 2024-03-12T16:25:42.522 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:25:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.622+0000 7f5762824700 1 -- 172.21.15.6:0/2117138452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fd150 msgr2=0x7f575c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.622+0000 7f5762824700 1 --2- 172.21.15.6:0/2117138452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fd150 0x7f575c0f6930 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f57500047f0 tx=0x7f5750009cb0).stop 2024-03-12T16:25:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.623+0000 7f5762824700 1 -- 172.21.15.6:0/2117138452 shutdown_connections 2024-03-12T16:25:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.623+0000 7f5762824700 1 --2- 172.21.15.6:0/2117138452 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fd150 0x7f575c0f6930 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.623+0000 7f5762824700 1 --2- 172.21.15.6:0/2117138452 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c0fc7f0 0x7f575c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.623+0000 7f5762824700 1 -- 172.21.15.6:0/2117138452 >> 172.21.15.6:0/2117138452 conn(0x7f575c070590 msgr2=0x7f575c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.623+0000 7f5762824700 1 -- 172.21.15.6:0/2117138452 shutdown_connections 2024-03-12T16:25:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.623+0000 7f5762824700 1 -- 172.21.15.6:0/2117138452 wait complete. 2024-03-12T16:25:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.623+0000 7f5762824700 1 Processor -- start 2024-03-12T16:25:42.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.623+0000 7f5762824700 1 -- start start 2024-03-12T16:25:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f5762824700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fc7f0 0x7f575c1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f5762824700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c0fd150 0x7f575c1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f5762824700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c110cc0 con 0x7f575c0fc7f0 2024-03-12T16:25:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f5762824700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f575c110e00 con 0x7f575c0fd150 2024-03-12T16:25:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f575bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fc7f0 0x7f575c1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:42.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f575bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fc7f0 0x7f575c1101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45296/0 (socket says 172.21.15.6:45296) 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f575bfff700 1 -- 172.21.15.6:0/1286129394 learned_addr learned my addr 172.21.15.6:0/1286129394 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f575b7fe700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c0fd150 0x7f575c1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f575bfff700 1 -- 172.21.15.6:0/1286129394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c0fd150 msgr2=0x7f575c1106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f575bfff700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c0fd150 0x7f575c1106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f575bfff700 1 -- 172.21.15.6:0/1286129394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5750005040 con 0x7f575c0fc7f0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f575bfff700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fc7f0 0x7f575c1101d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f574c002770 tx=0x7f574c002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f57597fa700 1 -- 172.21.15.6:0/1286129394 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f574c002d80 con 0x7f575c0fc7f0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f575c10a490 con 0x7f575c0fc7f0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f57597fa700 1 -- 172.21.15.6:0/1286129394 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f574c00f040 con 0x7f575c0fc7f0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f57597fa700 1 -- 172.21.15.6:0/1286129394 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f574c00d800 con 0x7f575c0fc7f0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.624+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f575c10a9d0 con 0x7f575c0fc7f0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.625+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f575c05f590 con 0x7f575c0fc7f0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.626+0000 7f57597fa700 1 -- 172.21.15.6:0/1286129394 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f574c009110 con 0x7f575c0fc7f0 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.626+0000 7f57597fa700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f574406cab0 0x7f574406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:42.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.626+0000 7f57597fa700 1 -- 172.21.15.6:0/1286129394 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f574c08bac0 con 0x7f575c0fc7f0 2024-03-12T16:25:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.626+0000 7f575b7fe700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f574406cab0 0x7f574406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:42.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.627+0000 7f575b7fe700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f574406cab0 0x7f574406ef70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f575c10bb10 tx=0x7f5750009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:42.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.631+0000 7f57597fa700 1 -- 172.21.15.6:0/1286129394 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f574c059560 con 0x7f575c0fc7f0 2024-03-12T16:25:42.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.847+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f575c10b070 con 0x7f574406cab0 2024-03-12T16:25:42.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.848+0000 7f57597fa700 1 -- 172.21.15.6:0/1286129394 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f575c10b070 con 0x7f574406cab0 2024-03-12T16:25:42.848 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:25:42.848 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:25:42.848 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:25:42.848 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:25:42.848 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:25:42.848 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:25:42.848 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:25:42.848 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:25:42.849 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:25:42.849 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:25:42.849 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:25:42.849 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:25:42.849 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:25:42.849 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:25:42.849 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:25:42.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f574406cab0 msgr2=0x7f574406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f574406cab0 0x7f574406ef70 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 rx=0x7f575c10bb10 tx=0x7f5750009cb0).stop 2024-03-12T16:25:42.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fc7f0 msgr2=0x7f575c1101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fc7f0 0x7f575c1101d0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7f574c002770 tx=0x7f574c002b30).stop 2024-03-12T16:25:42.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 shutdown_connections 2024-03-12T16:25:42.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f574406cab0 0x7f574406ef70 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f575c0fc7f0 0x7f575c1101d0 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 --2- 172.21.15.6:0/1286129394 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f575c0fd150 0x7f575c1106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 >> 172.21.15.6:0/1286129394 conn(0x7f575c070590 msgr2=0x7f575c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:42.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 shutdown_connections 2024-03-12T16:25:42.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.850+0000 7f5762824700 1 -- 172.21.15.6:0/1286129394 wait complete. 2024-03-12T16:25:42.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:42 smithi134 ceph-mon[85099]: from='client.34724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:42.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:42 smithi134 ceph-mon[85099]: from='client.34728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:42.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:42 smithi134 ceph-mon[85099]: from='client.34732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:42.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:42 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2534091279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:25:42.953 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:42 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/870177514' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:25:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.952+0000 7fa73d590700 1 -- 172.21.15.6:0/1321591438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fe2d0 msgr2=0x7fa7380f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.952+0000 7fa73d590700 1 --2- 172.21.15.6:0/1321591438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fe2d0 0x7fa7380f7ab0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7fa72c0047f0 tx=0x7fa72c009cb0).stop 2024-03-12T16:25:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.952+0000 7fa73d590700 1 -- 172.21.15.6:0/1321591438 shutdown_connections 2024-03-12T16:25:42.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.952+0000 7fa73d590700 1 --2- 172.21.15.6:0/1321591438 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fe2d0 0x7fa7380f7ab0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.952+0000 7fa73d590700 1 --2- 172.21.15.6:0/1321591438 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7380fd970 0x7fa7380fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.952+0000 7fa73d590700 1 -- 172.21.15.6:0/1321591438 >> 172.21.15.6:0/1321591438 conn(0x7fa7380f3550 msgr2=0x7fa7380f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.952+0000 7fa73d590700 1 -- 172.21.15.6:0/1321591438 shutdown_connections 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.952+0000 7fa73d590700 1 -- 172.21.15.6:0/1321591438 wait complete. 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa73d590700 1 Processor -- start 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa73d590700 1 -- start start 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa73d590700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fd970 0x7fa73810e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa73d590700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7380fe2d0 0x7fa73810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa73d590700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73810eb50 con 0x7fa7380fd970 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa73d590700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa73810ec90 con 0x7fa7380fe2d0 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa736ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fd970 0x7fa73810e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa736ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fd970 0x7fa73810e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45308/0 (socket says 172.21.15.6:45308) 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa736ffd700 1 -- 172.21.15.6:0/66464675 learned_addr learned my addr 172.21.15.6:0/66464675 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.953+0000 7fa7367fc700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7380fe2d0 0x7fa73810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:42.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.954+0000 7fa736ffd700 1 -- 172.21.15.6:0/66464675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7380fe2d0 msgr2=0x7fa73810e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.954+0000 7fa736ffd700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7380fe2d0 0x7fa73810e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.954+0000 7fa736ffd700 1 -- 172.21.15.6:0/66464675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa72c005040 con 0x7fa7380fd970 2024-03-12T16:25:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.954+0000 7fa736ffd700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fd970 0x7fa73810e060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fa72800dad0 tx=0x7fa728004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.954+0000 7fa71ffff700 1 -- 172.21.15.6:0/66464675 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa72800b750 con 0x7fa7380fd970 2024-03-12T16:25:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.954+0000 7fa71ffff700 1 -- 172.21.15.6:0/66464675 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa72800f040 con 0x7fa7380fd970 2024-03-12T16:25:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.954+0000 7fa71ffff700 1 -- 172.21.15.6:0/66464675 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa728013ba0 con 0x7fa7380fd970 2024-03-12T16:25:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.954+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa738108320 con 0x7fa7380fd970 2024-03-12T16:25:42.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.954+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa738108860 con 0x7fa7380fd970 2024-03-12T16:25:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.955+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa738060370 con 0x7fa7380fd970 2024-03-12T16:25:42.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.955+0000 7fa71ffff700 1 -- 172.21.15.6:0/66464675 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa72800b8b0 con 0x7fa7380fd970 2024-03-12T16:25:42.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:42 smithi006 ceph-mon[103869]: from='client.34724 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:42.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:42 smithi006 ceph-mon[103869]: from='client.34728 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:42.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:42 smithi006 ceph-mon[103869]: from='client.34732 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:42.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:42 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2534091279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:25:42.957 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:42 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/870177514' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:25:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.956+0000 7fa71ffff700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa72006caa0 0x7fa72006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:25:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.956+0000 7fa71ffff700 1 -- 172.21.15.6:0/66464675 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa72808b700 con 0x7fa7380fd970 2024-03-12T16:25:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.956+0000 7fa7367fc700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa72006caa0 0x7fa72006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:25:42.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.956+0000 7fa7367fc700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa72006caa0 0x7fa72006ef60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa7381099a0 tx=0x7fa72c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:25:42.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:42.960+0000 7fa71ffff700 1 -- 172.21.15.6:0/66464675 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa728059310 con 0x7fa7380fd970 2024-03-12T16:25:43.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.239+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fa738047540 con 0x7fa7380fd970 2024-03-12T16:25:43.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.239+0000 7fa71ffff700 1 -- 172.21.15.6:0/66464675 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fa728058ea0 con 0x7fa7380fd970 2024-03-12T16:25:43.239 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:25:43.239 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:25:43.240 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:25:43.240 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:25:43.240 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:25:43.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.241+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa72006caa0 msgr2=0x7fa72006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.241+0000 7fa73d590700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa72006caa0 0x7fa72006ef60 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 rx=0x7fa7381099a0 tx=0x7fa72c00b040).stop 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.241+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fd970 msgr2=0x7fa73810e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.241+0000 7fa73d590700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fd970 0x7fa73810e060 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7fa72800dad0 tx=0x7fa728004ee0).stop 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.242+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 shutdown_connections 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.242+0000 7fa73d590700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa72006caa0 0x7fa72006ef60 unknown :-1 s=CLOSED pgs=178 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.242+0000 7fa73d590700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa7380fd970 0x7fa73810e060 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.242+0000 7fa73d590700 1 --2- 172.21.15.6:0/66464675 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa7380fe2d0 0x7fa73810e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.242+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 >> 172.21.15.6:0/66464675 conn(0x7fa7380f3550 msgr2=0x7fa7380fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.242+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 shutdown_connections 2024-03-12T16:25:43.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:25:43.242+0000 7fa73d590700 1 -- 172.21.15.6:0/66464675 wait complete. 2024-03-12T16:25:43.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:43 smithi134 ceph-mon[85099]: pgmap v374: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:43.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:43 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/66464675' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:25:43.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:43 smithi006 ceph-mon[103869]: pgmap v374: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:43.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:43 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/66464675' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:25:44.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:44 smithi134 ceph-mon[85099]: from='client.34744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:44.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:44 smithi006 ceph-mon[103869]: from='client.34744 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:25:45.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:45 smithi134 ceph-mon[85099]: pgmap v375: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:45.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:45 smithi006 ceph-mon[103869]: pgmap v375: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:47.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:47 smithi134 ceph-mon[85099]: pgmap v376: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:47.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:25:47.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:47 smithi006 ceph-mon[103869]: pgmap v376: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:47.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:25:49.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:49 smithi134 ceph-mon[85099]: pgmap v377: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:49.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:49 smithi006 ceph-mon[103869]: pgmap v377: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:51.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:51 smithi134 ceph-mon[85099]: pgmap v378: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:51.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:51 smithi006 ceph-mon[103869]: pgmap v378: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:53.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:53 smithi134 ceph-mon[85099]: pgmap v379: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:53.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:53 smithi006 ceph-mon[103869]: pgmap v379: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:55.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:55 smithi134 ceph-mon[85099]: pgmap v380: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:55.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:55 smithi006 ceph-mon[103869]: pgmap v380: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:57.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:57 smithi134 ceph-mon[85099]: pgmap v381: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:57.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:57 smithi006 ceph-mon[103869]: pgmap v381: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:59.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:25:59 smithi134 ceph-mon[85099]: pgmap v382: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:25:59.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:25:59 smithi006 ceph-mon[103869]: pgmap v382: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:01.952 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:01 smithi134 ceph-mon[85099]: pgmap v383: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:01.955 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:01 smithi006 ceph-mon[103869]: pgmap v383: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:02.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:26:03.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:26:04.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:03 smithi134 ceph-mon[85099]: pgmap v384: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:04.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:03 smithi006 ceph-mon[103869]: pgmap v384: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:06.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:05 smithi134 ceph-mon[85099]: pgmap v385: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:06.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:05 smithi006 ceph-mon[103869]: pgmap v385: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:08.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:07 smithi134 ceph-mon[85099]: pgmap v386: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:08.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:07 smithi006 ceph-mon[103869]: pgmap v386: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:10.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:09 smithi134 ceph-mon[85099]: pgmap v387: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:10.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:09 smithi006 ceph-mon[103869]: pgmap v387: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:12.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:11 smithi134 ceph-mon[85099]: pgmap v388: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:12.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:11 smithi006 ceph-mon[103869]: pgmap v388: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:13.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.357+0000 7f9a5d19f700 1 -- 172.21.15.6:0/1836895648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 msgr2=0x7f9a580f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.357+0000 7f9a5d19f700 1 --2- 172.21.15.6:0/1836895648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 0x7f9a580f6930 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f9a400047f0 tx=0x7f9a40009cb0).stop 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.357+0000 7f9a5d19f700 1 -- 172.21.15.6:0/1836895648 shutdown_connections 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.357+0000 7f9a5d19f700 1 --2- 172.21.15.6:0/1836895648 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 0x7f9a580f6930 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.357+0000 7f9a5d19f700 1 --2- 172.21.15.6:0/1836895648 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a580fc7f0 0x7f9a580fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.357+0000 7f9a5d19f700 1 -- 172.21.15.6:0/1836895648 >> 172.21.15.6:0/1836895648 conn(0x7f9a58070590 msgr2=0x7f9a580f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.357+0000 7f9a5d19f700 1 -- 172.21.15.6:0/1836895648 shutdown_connections 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.357+0000 7f9a5d19f700 1 -- 172.21.15.6:0/1836895648 wait complete. 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.358+0000 7f9a5d19f700 1 Processor -- start 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a5d19f700 1 -- start start 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a5d19f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a580fc7f0 0x7f9a5810ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a5d19f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 0x7f9a5810d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a5d19f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5810d9c0 con 0x7f9a580fd150 2024-03-12T16:26:13.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a5d19f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a5810db00 con 0x7f9a580fc7f0 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 0x7f9a5810d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 0x7f9a5810d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39094/0 (socket says 172.21.15.6:39094) 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a4ffff700 1 -- 172.21.15.6:0/3509065170 learned_addr learned my addr 172.21.15.6:0/3509065170 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a56d9d700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a580fc7f0 0x7f9a5810ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a4ffff700 1 -- 172.21.15.6:0/3509065170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a580fc7f0 msgr2=0x7f9a5810ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a4ffff700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a580fc7f0 0x7f9a5810ced0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.359+0000 7f9a4ffff700 1 -- 172.21.15.6:0/3509065170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a40005040 con 0x7f9a580fd150 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.360+0000 7f9a4ffff700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 0x7f9a5810d3c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f9a400099f0 tx=0x7f9a40009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.360+0000 7f9a54d99700 1 -- 172.21.15.6:0/3509065170 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a4000e030 con 0x7f9a580fd150 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.360+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a58107130 con 0x7f9a580fd150 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.360+0000 7f9a54d99700 1 -- 172.21.15.6:0/3509065170 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a40007e90 con 0x7f9a580fd150 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.360+0000 7f9a54d99700 1 -- 172.21.15.6:0/3509065170 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a40018070 con 0x7f9a580fd150 2024-03-12T16:26:13.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.360+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a58107690 con 0x7f9a580fd150 2024-03-12T16:26:13.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.361+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a5805f590 con 0x7f9a580fd150 2024-03-12T16:26:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.361+0000 7f9a54d99700 1 -- 172.21.15.6:0/3509065170 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9a400094c0 con 0x7f9a580fd150 2024-03-12T16:26:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.362+0000 7f9a54d99700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a4406caa0 0x7f9a4406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.362+0000 7f9a54d99700 1 -- 172.21.15.6:0/3509065170 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9a4008d000 con 0x7f9a580fd150 2024-03-12T16:26:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.362+0000 7f9a56d9d700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a4406caa0 0x7f9a4406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.362+0000 7f9a56d9d700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a4406caa0 0x7f9a4406ef60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f9a48004dc0 tx=0x7f9a4800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:13.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.367+0000 7f9a54d99700 1 -- 172.21.15.6:0/3509065170 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9a4005ab60 con 0x7f9a580fd150 2024-03-12T16:26:13.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.584+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a580feb40 con 0x7f9a4406caa0 2024-03-12T16:26:13.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.585+0000 7f9a54d99700 1 -- 172.21.15.6:0/3509065170 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9a580feb40 con 0x7f9a4406caa0 2024-03-12T16:26:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.587+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a4406caa0 msgr2=0x7f9a4406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.587+0000 7f9a5d19f700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a4406caa0 0x7f9a4406ef60 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 rx=0x7f9a48004dc0 tx=0x7f9a4800b040).stop 2024-03-12T16:26:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.587+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 msgr2=0x7f9a5810d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.587+0000 7f9a5d19f700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 0x7f9a5810d3c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f9a400099f0 tx=0x7f9a40009cb0).stop 2024-03-12T16:26:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.587+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 shutdown_connections 2024-03-12T16:26:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.587+0000 7f9a5d19f700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a580fc7f0 0x7f9a5810ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.587+0000 7f9a5d19f700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a4406caa0 0x7f9a4406ef60 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.587+0000 7f9a5d19f700 1 --2- 172.21.15.6:0/3509065170 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a580fd150 0x7f9a5810d3c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.587+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 >> 172.21.15.6:0/3509065170 conn(0x7f9a58070590 msgr2=0x7f9a580fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.588+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 shutdown_connections 2024-03-12T16:26:13.589 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.588+0000 7f9a5d19f700 1 -- 172.21.15.6:0/3509065170 wait complete. 2024-03-12T16:26:13.598 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:26:13.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.691+0000 7f5c3144d700 1 -- 172.21.15.6:0/3551359395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 msgr2=0x7f5c2c0f5f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:13.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.691+0000 7f5c3144d700 1 --2- 172.21.15.6:0/3551359395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 0x7f5c2c0f5f60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f5c200047f0 tx=0x7f5c20009cb0).stop 2024-03-12T16:26:13.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.691+0000 7f5c3144d700 1 -- 172.21.15.6:0/3551359395 shutdown_connections 2024-03-12T16:26:13.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.691+0000 7f5c3144d700 1 --2- 172.21.15.6:0/3551359395 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 0x7f5c2c0f5f60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.691+0000 7f5c3144d700 1 --2- 172.21.15.6:0/3551359395 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c2c0fd940 0x7f5c2c0fdd20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.691+0000 7f5c3144d700 1 -- 172.21.15.6:0/3551359395 >> 172.21.15.6:0/3551359395 conn(0x7f5c2c06bdc0 msgr2=0x7f5c2c06c1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:13.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.691+0000 7f5c3144d700 1 -- 172.21.15.6:0/3551359395 shutdown_connections 2024-03-12T16:26:13.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.691+0000 7f5c3144d700 1 -- 172.21.15.6:0/3551359395 wait complete. 2024-03-12T16:26:13.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.692+0000 7f5c3144d700 1 Processor -- start 2024-03-12T16:26:13.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.692+0000 7f5c3144d700 1 -- start start 2024-03-12T16:26:13.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c3144d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c2c0fd940 0x7f5c2c10e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c3144d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 0x7f5c2c10e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c3144d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c10eb30 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c3144d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c2c10ec70 con 0x7f5c2c0fd940 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c2a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 0x7f5c2c10e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c2a7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 0x7f5c2c10e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39112/0 (socket says 172.21.15.6:39112) 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c2a7fc700 1 -- 172.21.15.6:0/3726526718 learned_addr learned my addr 172.21.15.6:0/3726526718 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c2affd700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c2c0fd940 0x7f5c2c10e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c2a7fc700 1 -- 172.21.15.6:0/3726526718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c2c0fd940 msgr2=0x7f5c2c10e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c2a7fc700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c2c0fd940 0x7f5c2c10e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c2a7fc700 1 -- 172.21.15.6:0/3726526718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5c20005040 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c2a7fc700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 0x7f5c2c10e530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f5c20005010 tx=0x7f5c20009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c13fff700 1 -- 172.21.15.6:0/3726526718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c2000e030 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c2c1082a0 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c13fff700 1 -- 172.21.15.6:0/3726526718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5c20007e90 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c13fff700 1 -- 172.21.15.6:0/3726526718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5c20018070 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.693+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c2c108780 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.694+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c2c05f090 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.695+0000 7f5c13fff700 1 -- 172.21.15.6:0/3726526718 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5c2001d6e0 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.695+0000 7f5c13fff700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c1406ca30 0x7f5c1406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:13.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.696+0000 7f5c13fff700 1 -- 172.21.15.6:0/3726526718 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5c2008d0b0 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.696+0000 7f5c2affd700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c1406ca30 0x7f5c1406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:13.697 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.696+0000 7f5c2affd700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c1406ca30 0x7f5c1406eef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5c1c009170 tx=0x7f5c1c009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:13.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.700+0000 7f5c13fff700 1 -- 172.21.15.6:0/3726526718 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5c2005ac10 con 0x7f5c2c0fe2a0 2024-03-12T16:26:13.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.917+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c2c109730 con 0x7f5c1406ca30 2024-03-12T16:26:13.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.918+0000 7f5c13fff700 1 -- 172.21.15.6:0/3726526718 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f5c2c109730 con 0x7f5c1406ca30 2024-03-12T16:26:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c1406ca30 msgr2=0x7f5c1406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c1406ca30 0x7f5c1406eef0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 rx=0x7f5c1c009170 tx=0x7f5c1c009da0).stop 2024-03-12T16:26:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 msgr2=0x7f5c2c10e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 0x7f5c2c10e530 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7f5c20005010 tx=0x7f5c20009cb0).stop 2024-03-12T16:26:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 shutdown_connections 2024-03-12T16:26:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c2c0fd940 0x7f5c2c10e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5c1406ca30 0x7f5c1406eef0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 --2- 172.21.15.6:0/3726526718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c2c0fe2a0 0x7f5c2c10e530 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 >> 172.21.15.6:0/3726526718 conn(0x7f5c2c06bdc0 msgr2=0x7f5c2c100ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 shutdown_connections 2024-03-12T16:26:13.922 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:13.920+0000 7f5c3144d700 1 -- 172.21.15.6:0/3726526718 wait complete. 2024-03-12T16:26:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.022+0000 7f8ebb076700 1 -- 172.21.15.6:0/1663569134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 msgr2=0x7f8eb40f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.022+0000 7f8ebb076700 1 --2- 172.21.15.6:0/1663569134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 0x7f8eb40f5f80 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7f8ea00047f0 tx=0x7f8ea0009cb0).stop 2024-03-12T16:26:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 -- 172.21.15.6:0/1663569134 shutdown_connections 2024-03-12T16:26:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 --2- 172.21.15.6:0/1663569134 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 0x7f8eb40f5f80 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 --2- 172.21.15.6:0/1663569134 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eb40fd8b0 0x7f8eb40fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:26:14.025 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 -- 172.21.15.6:0/1663569134 >> 172.21.15.6:0/1663569134 conn(0x7f8eb406ce40 msgr2=0x7f8eb406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 -- 172.21.15.6:0/1663569134 shutdown_connections 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 -- 172.21.15.6:0/1663569134 wait complete. 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 Processor -- start 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 -- start start 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eb40fd8b0 0x7f8eb410e070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 0x7f8eb410e560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb410ebf0 con 0x7f8eb40fe210 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.023+0000 7f8ebb076700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8eb4108260 con 0x7f8eb40fd8b0 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 0x7f8eb410e560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 0x7f8eb410e560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39128/0 (socket says 172.21.15.6:39128) 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb3fff700 1 -- 172.21.15.6:0/4200801165 learned_addr learned my addr 172.21.15.6:0/4200801165 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb8e12700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eb40fd8b0 0x7f8eb410e070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb3fff700 1 -- 172.21.15.6:0/4200801165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eb40fd8b0 msgr2=0x7f8eb410e070 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb3fff700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eb40fd8b0 0x7f8eb410e070 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb3fff700 1 -- 172.21.15.6:0/4200801165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8ea0005040 con 0x7f8eb40fe210 2024-03-12T16:26:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb3fff700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 0x7f8eb410e560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8ea000b120 tx=0x7f8ea0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb1ffb700 1 -- 172.21.15.6:0/4200801165 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea000e030 con 0x7f8eb40fe210 2024-03-12T16:26:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb1ffb700 1 -- 172.21.15.6:0/4200801165 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8ea0007e90 con 0x7f8eb40fe210 2024-03-12T16:26:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8eb41084b0 con 0x7f8eb40fe210 2024-03-12T16:26:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8eb1ffb700 1 -- 172.21.15.6:0/4200801165 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8ea0018070 con 0x7f8eb40fe210 2024-03-12T16:26:14.027 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.024+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8eb4108990 con 0x7f8eb40fe210 2024-03-12T16:26:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.025+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8eb4060670 con 0x7f8eb40fe210 2024-03-12T16:26:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.026+0000 7f8eb1ffb700 1 -- 172.21.15.6:0/4200801165 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8ea001d420 con 0x7f8eb40fe210 2024-03-12T16:26:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.026+0000 7f8eb1ffb700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8ea406caa0 0x7f8ea406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.026+0000 7f8eb1ffb700 1 -- 172.21.15.6:0/4200801165 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8ea008d0d0 con 0x7f8eb40fe210 2024-03-12T16:26:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.026+0000 7f8eb8e12700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8ea406caa0 0x7f8ea406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:14.028 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.027+0000 7f8eb8e12700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8ea406caa0 0x7f8ea406ef60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f8ea8006fd0 tx=0x7f8ea8009060).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:14.031 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.031+0000 7f8eb1ffb700 1 -- 172.21.15.6:0/4200801165 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8ea005ab70 con 0x7f8eb40fe210 2024-03-12T16:26:14.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:13 smithi134 ceph-mon[85099]: pgmap v389: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:14.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:13 smithi006 ceph-mon[103869]: pgmap v389: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:14.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.238+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8eb4109760 con 0x7f8ea406caa0 2024-03-12T16:26:14.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.248+0000 7f8eb1ffb700 1 -- 172.21.15.6:0/4200801165 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f8eb4109760 con 0x7f8ea406caa0 2024-03-12T16:26:14.249 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:26:14.249 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (13m) 6m ago 24m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:26:14.249 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (10m) 6m ago 23m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (10m) 6m ago 23m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (12m) 6m ago 23m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (7m) 6m ago 18m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (6m) 6m ago 18m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (6m) 6m ago 18m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (6m) 6m ago 18m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (14m) 6m ago 25m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (13m) 6m ago 23m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (11m) 6m ago 25m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (11m) 6m ago 23m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (13m) 6m ago 23m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (13m) 6m ago 22m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (10m) 6m ago 22m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:26:14.250 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (9m) 6m ago 22m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:26:14.251 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (9m) 6m ago 21m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:26:14.251 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (8m) 6m ago 21m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:26:14.251 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (8m) 6m ago 20m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:26:14.251 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (7m) 6m ago 20m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:26:14.251 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (13m) 6m ago 22m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:26:14.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8ea406caa0 msgr2=0x7f8ea406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8ea406caa0 0x7f8ea406ef60 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 rx=0x7f8ea8006fd0 tx=0x7f8ea8009060).stop 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 msgr2=0x7f8eb410e560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 0x7f8eb410e560 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7f8ea000b120 tx=0x7f8ea0009cb0).stop 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 shutdown_connections 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8eb40fd8b0 0x7f8eb410e070 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8ea406caa0 0x7f8ea406ef60 unknown :-1 s=CLOSED pgs=181 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 --2- 172.21.15.6:0/4200801165 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8eb40fe210 0x7f8eb410e560 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 >> 172.21.15.6:0/4200801165 conn(0x7f8eb406ce40 msgr2=0x7f8eb4100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 shutdown_connections 2024-03-12T16:26:14.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.251+0000 7f8ebb076700 1 -- 172.21.15.6:0/4200801165 wait complete. 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.352+0000 7fdc7c573700 1 -- 172.21.15.6:0/1988006382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fd970 msgr2=0x7fdc740fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.352+0000 7fdc7c573700 1 --2- 172.21.15.6:0/1988006382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fd970 0x7fdc740fdd50 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7fdc640047f0 tx=0x7fdc64009cb0).stop 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.352+0000 7fdc7c573700 1 -- 172.21.15.6:0/1988006382 shutdown_connections 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.352+0000 7fdc7c573700 1 --2- 172.21.15.6:0/1988006382 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc740fe2d0 0x7fdc740f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.352+0000 7fdc7c573700 1 --2- 172.21.15.6:0/1988006382 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fd970 0x7fdc740fdd50 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.352+0000 7fdc7c573700 1 -- 172.21.15.6:0/1988006382 >> 172.21.15.6:0/1988006382 conn(0x7fdc740f3550 msgr2=0x7fdc740f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.352+0000 7fdc7c573700 1 -- 172.21.15.6:0/1988006382 shutdown_connections 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.352+0000 7fdc7c573700 1 -- 172.21.15.6:0/1988006382 wait complete. 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.352+0000 7fdc7c573700 1 Processor -- start 2024-03-12T16:26:14.353 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc7c573700 1 -- start start 2024-03-12T16:26:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc7c573700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc740fd970 0x7fdc7406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc7c573700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fe2d0 0x7fdc7406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc7c573700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7406bab0 con 0x7fdc740fe2d0 2024-03-12T16:26:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc7c573700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdc7406bbf0 con 0x7fdc740fd970 2024-03-12T16:26:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc79b0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fe2d0 0x7fdc7406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc79b0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fe2d0 0x7fdc7406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39146/0 (socket says 172.21.15.6:39146) 2024-03-12T16:26:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc79b0e700 1 -- 172.21.15.6:0/517197992 learned_addr learned my addr 172.21.15.6:0/517197992 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:14.355 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc7a30f700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc740fd970 0x7fdc7406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc79b0e700 1 -- 172.21.15.6:0/517197992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc740fd970 msgr2=0x7fdc7406b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc79b0e700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc740fd970 0x7fdc7406b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc79b0e700 1 -- 172.21.15.6:0/517197992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdc64005040 con 0x7fdc740fe2d0 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc79b0e700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fe2d0 0x7fdc7406b5c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fdc70002780 tx=0x7fdc70009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc6b7fe700 1 -- 172.21.15.6:0/517197992 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc70007b40 con 0x7fdc740fe2d0 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc6b7fe700 1 -- 172.21.15.6:0/517197992 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdc7000f040 con 0x7fdc740fe2d0 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdc7406bea0 con 0x7fdc740fe2d0 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.353+0000 7fdc6b7fe700 1 -- 172.21.15.6:0/517197992 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdc70014780 con 0x7fdc740fe2d0 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.354+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdc741146d0 con 0x7fdc740fe2d0 2024-03-12T16:26:14.356 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.355+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdc74060370 con 0x7fdc740fe2d0 2024-03-12T16:26:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.355+0000 7fdc6b7fe700 1 -- 172.21.15.6:0/517197992 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fdc70007ca0 con 0x7fdc740fe2d0 2024-03-12T16:26:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.355+0000 7fdc6b7fe700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6006cab0 0x7fdc6006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.356+0000 7fdc6b7fe700 1 -- 172.21.15.6:0/517197992 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdc7008bc90 con 0x7fdc740fe2d0 2024-03-12T16:26:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.356+0000 7fdc7a30f700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6006cab0 0x7fdc6006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:14.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.356+0000 7fdc7a30f700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6006cab0 0x7fdc6006ef70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fdc64004f10 tx=0x7fdc64009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:14.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.360+0000 7fdc6b7fe700 1 -- 172.21.15.6:0/517197992 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdc70055d60 con 0x7fdc740fe2d0 2024-03-12T16:26:14.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.642+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdc74047540 con 0x7fdc740fe2d0 2024-03-12T16:26:14.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.642+0000 7fdc6b7fe700 1 -- 172.21.15.6:0/517197992 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fdc70059380 con 0x7fdc740fe2d0 2024-03-12T16:26:14.643 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:26:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:26:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:26:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:26:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:26:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:26:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:26:14.643 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:26:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:26:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:26:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:26:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:26:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:26:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:26:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:26:14.644 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:26:14.644 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6006cab0 msgr2=0x7fdc6006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6006cab0 0x7fdc6006ef70 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 rx=0x7fdc64004f10 tx=0x7fdc64009cb0).stop 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fe2d0 msgr2=0x7fdc7406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fe2d0 0x7fdc7406b5c0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7fdc70002780 tx=0x7fdc70009ee0).stop 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 shutdown_connections 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdc740fd970 0x7fdc7406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdc6006cab0 0x7fdc6006ef70 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 --2- 172.21.15.6:0/517197992 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdc740fe2d0 0x7fdc7406b5c0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 >> 172.21.15.6:0/517197992 conn(0x7fdc740f3550 msgr2=0x7fdc740fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 shutdown_connections 2024-03-12T16:26:14.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.644+0000 7fdc7c573700 1 -- 172.21.15.6:0/517197992 wait complete. 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.747+0000 7fb90f1df700 1 -- 172.21.15.6:0/58339213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 msgr2=0x7fb9080f8d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.747+0000 7fb90f1df700 1 --2- 172.21.15.6:0/58339213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 0x7fb9080f8d00 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 rx=0x7fb8fc0047f0 tx=0x7fb8fc009cb0).stop 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.747+0000 7fb90f1df700 1 -- 172.21.15.6:0/58339213 shutdown_connections 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.747+0000 7fb90f1df700 1 --2- 172.21.15.6:0/58339213 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9080f91f0 0x7fb908101990 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.747+0000 7fb90f1df700 1 --2- 172.21.15.6:0/58339213 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 0x7fb9080f8d00 unknown :-1 s=CLOSED pgs=349 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.747+0000 7fb90f1df700 1 -- 172.21.15.6:0/58339213 >> 172.21.15.6:0/58339213 conn(0x7fb908070590 msgr2=0x7fb9080f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.747+0000 7fb90f1df700 1 -- 172.21.15.6:0/58339213 shutdown_connections 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.747+0000 7fb90f1df700 1 -- 172.21.15.6:0/58339213 wait complete. 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90f1df700 1 Processor -- start 2024-03-12T16:26:14.748 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90f1df700 1 -- start start 2024-03-12T16:26:14.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90f1df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 0x7fb90810e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:14.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90f1df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9080f91f0 0x7fb90810e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:14.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90f1df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90810eb20 con 0x7fb9080f8920 2024-03-12T16:26:14.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90f1df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb90810ec60 con 0x7fb9080f91f0 2024-03-12T16:26:14.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90cf7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 0x7fb90810e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:14.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90cf7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 0x7fb90810e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39164/0 (socket says 172.21.15.6:39164) 2024-03-12T16:26:14.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90cf7b700 1 -- 172.21.15.6:0/600042257 learned_addr learned my addr 172.21.15.6:0/600042257 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb907fff700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9080f91f0 0x7fb90810e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90cf7b700 1 -- 172.21.15.6:0/600042257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9080f91f0 msgr2=0x7fb90810e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90cf7b700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9080f91f0 0x7fb90810e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90cf7b700 1 -- 172.21.15.6:0/600042257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb8fc005040 con 0x7fb9080f8920 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb907fff700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9080f91f0 0x7fb90810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb90cf7b700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 0x7fb90810e030 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fb8fc005010 tx=0x7fb8fc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.748+0000 7fb905ffb700 1 -- 172.21.15.6:0/600042257 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8fc00e030 con 0x7fb9080f8920 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.749+0000 7fb905ffb700 1 -- 172.21.15.6:0/600042257 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb8fc007e90 con 0x7fb9080f8920 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.749+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb908108290 con 0x7fb9080f8920 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.749+0000 7fb905ffb700 1 -- 172.21.15.6:0/600042257 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb8fc018070 con 0x7fb9080f8920 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.749+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb908108770 con 0x7fb9080f8920 2024-03-12T16:26:14.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.750+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb90805f590 con 0x7fb9080f8920 2024-03-12T16:26:14.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.750+0000 7fb905ffb700 1 -- 172.21.15.6:0/600042257 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb8fc009610 con 0x7fb9080f8920 2024-03-12T16:26:14.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.751+0000 7fb905ffb700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb8f806caa0 0x7fb8f806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:14.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.751+0000 7fb905ffb700 1 -- 172.21.15.6:0/600042257 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb8fc08cff0 con 0x7fb9080f8920 2024-03-12T16:26:14.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.751+0000 7fb907fff700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb8f806caa0 0x7fb8f806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:14.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.751+0000 7fb907fff700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb8f806caa0 0x7fb8f806ef60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fb908109970 tx=0x7fb8f400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:14.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.755+0000 7fb905ffb700 1 -- 172.21.15.6:0/600042257 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb8fc05ab50 con 0x7fb9080f8920 2024-03-12T16:26:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:14.999+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb9081097b0 con 0x7fb9080f8920 2024-03-12T16:26:15.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.000+0000 7fb905ffb700 1 -- 172.21.15.6:0/600042257 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fb8fc05a6e0 con 0x7fb9080f8920 2024-03-12T16:26:15.000 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:26:15.000 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:26:15.001 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:26:15.002 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:26:15.003 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:26:15.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb8f806caa0 msgr2=0x7fb8f806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb8f806caa0 0x7fb8f806ef60 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 rx=0x7fb908109970 tx=0x7fb8f400b040).stop 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 msgr2=0x7fb90810e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 0x7fb90810e030 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 rx=0x7fb8fc005010 tx=0x7fb8fc009cb0).stop 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 shutdown_connections 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb8f806caa0 0x7fb8f806ef60 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb9080f8920 0x7fb90810e030 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 --2- 172.21.15.6:0/600042257 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb9080f91f0 0x7fb90810e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 >> 172.21.15.6:0/600042257 conn(0x7fb908070590 msgr2=0x7fb9080fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 shutdown_connections 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.002+0000 7fb90f1df700 1 -- 172.21.15.6:0/600042257 wait complete. 2024-03-12T16:26:15.005 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:26:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.104+0000 7fe780cfd700 1 -- 172.21.15.6:0/3338438201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 msgr2=0x7fe77c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.104+0000 7fe780cfd700 1 --2- 172.21.15.6:0/3338438201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 0x7fe77c0fcbd0 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 rx=0x7fe76c0047f0 tx=0x7fe76c009cb0).stop 2024-03-12T16:26:15.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.104+0000 7fe780cfd700 1 -- 172.21.15.6:0/3338438201 shutdown_connections 2024-03-12T16:26:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.104+0000 7fe780cfd700 1 --2- 172.21.15.6:0/3338438201 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe77c0fd150 0x7fe77c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.104+0000 7fe780cfd700 1 --2- 172.21.15.6:0/3338438201 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 0x7fe77c0fcbd0 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.104+0000 7fe780cfd700 1 -- 172.21.15.6:0/3338438201 >> 172.21.15.6:0/3338438201 conn(0x7fe77c070590 msgr2=0x7fe77c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.105+0000 7fe780cfd700 1 -- 172.21.15.6:0/3338438201 shutdown_connections 2024-03-12T16:26:15.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.105+0000 7fe780cfd700 1 -- 172.21.15.6:0/3338438201 wait complete. 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.105+0000 7fe780cfd700 1 Processor -- start 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe780cfd700 1 -- start start 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe780cfd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 0x7fe77c10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe780cfd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe77c0fd150 0x7fe77c10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe780cfd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c10eb10 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe780cfd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe77c10ec50 con 0x7fe77c0fd150 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe77a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 0x7fe77c10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe77a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 0x7fe77c10e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39182/0 (socket says 172.21.15.6:39182) 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe77a59c700 1 -- 172.21.15.6:0/3161935188 learned_addr learned my addr 172.21.15.6:0/3161935188 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe779d9b700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe77c0fd150 0x7fe77c10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe77a59c700 1 -- 172.21.15.6:0/3161935188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe77c0fd150 msgr2=0x7fe77c10e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe77a59c700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe77c0fd150 0x7fe77c10e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe77a59c700 1 -- 172.21.15.6:0/3161935188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe76c005040 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.106+0000 7fe77a59c700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 0x7fe77c10e020 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fe76c005010 tx=0x7fe76c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.107+0000 7fe76b7fe700 1 -- 172.21.15.6:0/3161935188 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76c00e030 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.107+0000 7fe76b7fe700 1 -- 172.21.15.6:0/3161935188 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe76c007e90 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.107+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe77c108280 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.107+0000 7fe76b7fe700 1 -- 172.21.15.6:0/3161935188 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe76c018070 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.107+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe77c1087e0 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.108+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe77c05f590 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.108+0000 7fe76b7fe700 1 -- 172.21.15.6:0/3161935188 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe76c01d670 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.109+0000 7fe76b7fe700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe76406caa0 0x7fe76406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.109+0000 7fe76b7fe700 1 -- 172.21.15.6:0/3161935188 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe76c08cf40 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.109+0000 7fe779d9b700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe76406caa0 0x7fe76406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:15.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.109+0000 7fe779d9b700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe76406caa0 0x7fe76406ef60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fe77c109960 tx=0x7fe77000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:15.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.113+0000 7fe76b7fe700 1 -- 172.21.15.6:0/3161935188 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe76c0c0190 con 0x7fe77c0fc7f0 2024-03-12T16:26:15.204 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:14 smithi134 ceph-mon[85099]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:15.205 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:14 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/517197992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:26:15.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:14 smithi006 ceph-mon[103869]: from='client.34752 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:15.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:14 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/517197992' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:26:15.330 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.330+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe77c0feb40 con 0x7fe76406caa0 2024-03-12T16:26:15.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.331+0000 7fe76b7fe700 1 -- 172.21.15.6:0/3161935188 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe77c0feb40 con 0x7fe76406caa0 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:26:15.332 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:26:15.333 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe76406caa0 msgr2=0x7fe76406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe76406caa0 0x7fe76406ef60 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 rx=0x7fe77c109960 tx=0x7fe77000b040).stop 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 msgr2=0x7fe77c10e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 0x7fe77c10e020 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 rx=0x7fe76c005010 tx=0x7fe76c009cb0).stop 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 shutdown_connections 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe76406caa0 0x7fe76406ef60 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe77c0fc7f0 0x7fe77c10e020 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 --2- 172.21.15.6:0/3161935188 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe77c0fd150 0x7fe77c10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 >> 172.21.15.6:0/3161935188 conn(0x7fe77c070590 msgr2=0x7fe77c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:15.334 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 shutdown_connections 2024-03-12T16:26:15.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.333+0000 7fe780cfd700 1 -- 172.21.15.6:0/3161935188 wait complete. 2024-03-12T16:26:15.439 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.436+0000 7f73f6e04700 1 -- 172.21.15.6:0/2396836497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fe250 msgr2=0x7f73f00f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.436+0000 7f73f6e04700 1 --2- 172.21.15.6:0/2396836497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fe250 0x7f73f00f7a30 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 rx=0x7f73dc0047f0 tx=0x7f73dc009cb0).stop 2024-03-12T16:26:15.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.436+0000 7f73f6e04700 1 -- 172.21.15.6:0/2396836497 shutdown_connections 2024-03-12T16:26:15.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.436+0000 7f73f6e04700 1 --2- 172.21.15.6:0/2396836497 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fe250 0x7f73f00f7a30 unknown :-1 s=CLOSED pgs=353 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.436+0000 7f73f6e04700 1 --2- 172.21.15.6:0/2396836497 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f00fd8f0 0x7f73f00fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.436+0000 7f73f6e04700 1 -- 172.21.15.6:0/2396836497 >> 172.21.15.6:0/2396836497 conn(0x7f73f00f34b0 msgr2=0x7f73f00f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:15.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.436+0000 7f73f6e04700 1 -- 172.21.15.6:0/2396836497 shutdown_connections 2024-03-12T16:26:15.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.436+0000 7f73f6e04700 1 -- 172.21.15.6:0/2396836497 wait complete. 2024-03-12T16:26:15.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f6e04700 1 Processor -- start 2024-03-12T16:26:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f6e04700 1 -- start start 2024-03-12T16:26:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f6e04700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fd8f0 0x7f73f010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f6e04700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f00fe250 0x7f73f010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f6e04700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f010eb70 con 0x7f73f00fd8f0 2024-03-12T16:26:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f6e04700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f010ecb0 con 0x7f73f00fe250 2024-03-12T16:26:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f4ba0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fd8f0 0x7f73f010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f4ba0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fd8f0 0x7f73f010e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39212/0 (socket says 172.21.15.6:39212) 2024-03-12T16:26:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f4ba0700 1 -- 172.21.15.6:0/542972453 learned_addr learned my addr 172.21.15.6:0/542972453 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:15.441 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73effff700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f00fe250 0x7f73f010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f4ba0700 1 -- 172.21.15.6:0/542972453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f00fe250 msgr2=0x7f73f010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f4ba0700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f00fe250 0x7f73f010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f4ba0700 1 -- 172.21.15.6:0/542972453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73dc005040 con 0x7f73f00fd8f0 2024-03-12T16:26:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.437+0000 7f73f4ba0700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fd8f0 0x7f73f010e080 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f73e40041d0 tx=0x7f73e4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.438+0000 7f73edffb700 1 -- 172.21.15.6:0/542972453 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e4007b40 con 0x7f73f00fd8f0 2024-03-12T16:26:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.438+0000 7f73edffb700 1 -- 172.21.15.6:0/542972453 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73e400f040 con 0x7f73f00fd8f0 2024-03-12T16:26:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.438+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f0108340 con 0x7f73f00fd8f0 2024-03-12T16:26:15.442 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.438+0000 7f73edffb700 1 -- 172.21.15.6:0/542972453 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e40147b0 con 0x7f73f00fd8f0 2024-03-12T16:26:15.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.438+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f0108880 con 0x7f73f00fd8f0 2024-03-12T16:26:15.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.439+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f005f590 con 0x7f73f00fd8f0 2024-03-12T16:26:15.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.439+0000 7f73edffb700 1 -- 172.21.15.6:0/542972453 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f73e4009110 con 0x7f73f00fd8f0 2024-03-12T16:26:15.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.440+0000 7f73edffb700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73e006caa0 0x7f73e006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:15.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.440+0000 7f73edffb700 1 -- 172.21.15.6:0/542972453 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f73e408bcf0 con 0x7f73f00fd8f0 2024-03-12T16:26:15.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.440+0000 7f73effff700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73e006caa0 0x7f73e006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:15.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.440+0000 7f73effff700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73e006caa0 0x7f73e006ef60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f73f01099c0 tx=0x7f73dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:15.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.444+0000 7f73edffb700 1 -- 172.21.15.6:0/542972453 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f73e4059850 con 0x7f73f00fd8f0 2024-03-12T16:26:15.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.725+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f73f0047540 con 0x7f73f00fd8f0 2024-03-12T16:26:15.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.726+0000 7f73edffb700 1 -- 172.21.15.6:0/542972453 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f73e40593e0 con 0x7f73f00fd8f0 2024-03-12T16:26:15.727 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:26:15.727 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:26:15.727 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:26:15.727 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:26:15.727 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:26:15.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73e006caa0 msgr2=0x7f73e006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73e006caa0 0x7f73e006ef60 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 rx=0x7f73f01099c0 tx=0x7f73dc00b040).stop 2024-03-12T16:26:15.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fd8f0 msgr2=0x7f73f010e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:15.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fd8f0 0x7f73f010e080 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 rx=0x7f73e40041d0 tx=0x7f73e4009f60).stop 2024-03-12T16:26:15.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 shutdown_connections 2024-03-12T16:26:15.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73e006caa0 0x7f73e006ef60 unknown :-1 s=CLOSED pgs=185 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f00fd8f0 0x7f73f010e080 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 --2- 172.21.15.6:0/542972453 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f00fe250 0x7f73f010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:15.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 >> 172.21.15.6:0/542972453 conn(0x7f73f00f34b0 msgr2=0x7f73f00fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:15.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 shutdown_connections 2024-03-12T16:26:15.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:15.728+0000 7f73f6e04700 1 -- 172.21.15.6:0/542972453 wait complete. 2024-03-12T16:26:16.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:15 smithi134 ceph-mon[85099]: from='client.34756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:16.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:15 smithi134 ceph-mon[85099]: pgmap v390: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:16.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:15 smithi134 ceph-mon[85099]: from='client.34760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:16.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:15 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/600042257' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:26:16.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:15 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/542972453' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:26:16.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:15 smithi006 ceph-mon[103869]: from='client.34756 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:16.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:15 smithi006 ceph-mon[103869]: pgmap v390: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:16.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:15 smithi006 ceph-mon[103869]: from='client.34760 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:16.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:15 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/600042257' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:26:16.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:15 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/542972453' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:26:17.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:16 smithi134 ceph-mon[85099]: from='client.34772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:17.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:16 smithi006 ceph-mon[103869]: from='client.34772 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:18.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:17 smithi134 ceph-mon[85099]: pgmap v391: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:18.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:26:18.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:17 smithi006 ceph-mon[103869]: pgmap v391: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:18.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:26:20.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:19 smithi134 ceph-mon[85099]: pgmap v392: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:20.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:19 smithi006 ceph-mon[103869]: pgmap v392: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:22.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:21 smithi134 ceph-mon[85099]: pgmap v393: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:22.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:21 smithi006 ceph-mon[103869]: pgmap v393: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:24.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:23 smithi134 ceph-mon[85099]: pgmap v394: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:24.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:23 smithi006 ceph-mon[103869]: pgmap v394: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:26.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:25 smithi134 ceph-mon[85099]: pgmap v395: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:26.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:25 smithi006 ceph-mon[103869]: pgmap v395: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:28.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:27 smithi134 ceph-mon[85099]: pgmap v396: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:28.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:27 smithi006 ceph-mon[103869]: pgmap v396: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:30.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:29 smithi134 ceph-mon[85099]: pgmap v397: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:30.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:29 smithi006 ceph-mon[103869]: pgmap v397: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:32.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:31 smithi134 ceph-mon[85099]: pgmap v398: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:32.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:31 smithi006 ceph-mon[103869]: pgmap v398: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:33.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:26:33.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:26:34.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:33 smithi134 ceph-mon[85099]: pgmap v399: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:34.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:33 smithi006 ceph-mon[103869]: pgmap v399: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:36.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:35 smithi134 ceph-mon[85099]: pgmap v400: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:36.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:35 smithi006 ceph-mon[103869]: pgmap v400: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:38.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:37 smithi134 ceph-mon[85099]: pgmap v401: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:38.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:37 smithi006 ceph-mon[103869]: pgmap v401: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:40.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:39 smithi134 ceph-mon[85099]: pgmap v402: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:40.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:39 smithi006 ceph-mon[103869]: pgmap v402: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:42.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:41 smithi134 ceph-mon[85099]: pgmap v403: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:42.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:41 smithi006 ceph-mon[103869]: pgmap v403: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:44.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:43 smithi134 ceph-mon[85099]: pgmap v404: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:44.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:43 smithi006 ceph-mon[103869]: pgmap v404: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.847+0000 7ff304c92700 1 -- 172.21.15.6:0/258974281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f9210 msgr2=0x7ff3001019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.847+0000 7ff304c92700 1 --2- 172.21.15.6:0/258974281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f9210 0x7ff3001019b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 rx=0x7ff2f00047f0 tx=0x7ff2f0009cb0).stop 2024-03-12T16:26:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.847+0000 7ff304c92700 1 -- 172.21.15.6:0/258974281 shutdown_connections 2024-03-12T16:26:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.847+0000 7ff304c92700 1 --2- 172.21.15.6:0/258974281 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f9210 0x7ff3001019b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.847+0000 7ff304c92700 1 --2- 172.21.15.6:0/258974281 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3000f8940 0x7ff3000f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.847+0000 7ff304c92700 1 -- 172.21.15.6:0/258974281 >> 172.21.15.6:0/258974281 conn(0x7ff3000f23d0 msgr2=0x7ff3000f47f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.847+0000 7ff304c92700 1 -- 172.21.15.6:0/258974281 shutdown_connections 2024-03-12T16:26:45.847 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.847+0000 7ff304c92700 1 -- 172.21.15.6:0/258974281 wait complete. 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff304c92700 1 Processor -- start 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff304c92700 1 -- start start 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff304c92700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f8940 0x7ff300110340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff304c92700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3000f9210 0x7ff300110830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff304c92700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff300110e30 con 0x7ff3000f8940 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff304c92700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff300110f70 con 0x7ff3000f9210 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff2fe59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f8940 0x7ff300110340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff2fe59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f8940 0x7ff300110340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34536/0 (socket says 172.21.15.6:34536) 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff2fe59c700 1 -- 172.21.15.6:0/3224661757 learned_addr learned my addr 172.21.15.6:0/3224661757 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.848+0000 7ff2fdd9b700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3000f9210 0x7ff300110830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.849+0000 7ff2fe59c700 1 -- 172.21.15.6:0/3224661757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3000f9210 msgr2=0x7ff300110830 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:45.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.849+0000 7ff2fe59c700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3000f9210 0x7ff300110830 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.849+0000 7ff2fe59c700 1 -- 172.21.15.6:0/3224661757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff2f0005040 con 0x7ff3000f8940 2024-03-12T16:26:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.849+0000 7ff2fe59c700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f8940 0x7ff300110340 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7ff2f400e8f0 tx=0x7ff2f400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.849+0000 7ff2ef7fe700 1 -- 172.21.15.6:0/3224661757 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f4007b40 con 0x7ff3000f8940 2024-03-12T16:26:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.849+0000 7ff2ef7fe700 1 -- 172.21.15.6:0/3224661757 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff2f400f040 con 0x7ff3000f8940 2024-03-12T16:26:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.849+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff30010a600 con 0x7ff3000f8940 2024-03-12T16:26:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.849+0000 7ff2ef7fe700 1 -- 172.21.15.6:0/3224661757 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff2f4014880 con 0x7ff3000f8940 2024-03-12T16:26:45.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.849+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff30010ab40 con 0x7ff3000f8940 2024-03-12T16:26:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.850+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff300060390 con 0x7ff3000f8940 2024-03-12T16:26:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.851+0000 7ff2ef7fe700 1 -- 172.21.15.6:0/3224661757 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7ff2f4014ab0 con 0x7ff3000f8940 2024-03-12T16:26:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.851+0000 7ff2ef7fe700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff2e806caa0 0x7ff2e806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.851+0000 7ff2ef7fe700 1 -- 172.21.15.6:0/3224661757 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff2f408b940 con 0x7ff3000f8940 2024-03-12T16:26:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.851+0000 7ff2fdd9b700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff2e806caa0 0x7ff2e806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:45.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.852+0000 7ff2fdd9b700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff2e806caa0 0x7ff2e806ef60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ff30010bc80 tx=0x7ff2f0009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:45.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:45.856+0000 7ff2ef7fe700 1 -- 172.21.15.6:0/3224661757 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff2f40594a0 con 0x7ff3000f8940 2024-03-12T16:26:46.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.074+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff30010adb0 con 0x7ff2e806caa0 2024-03-12T16:26:46.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.075+0000 7ff2ef7fe700 1 -- 172.21.15.6:0/3224661757 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ff30010adb0 con 0x7ff2e806caa0 2024-03-12T16:26:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff2e806caa0 msgr2=0x7ff2e806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff2e806caa0 0x7ff2e806ef60 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 rx=0x7ff30010bc80 tx=0x7ff2f0009cb0).stop 2024-03-12T16:26:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f8940 msgr2=0x7ff300110340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f8940 0x7ff300110340 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 rx=0x7ff2f400e8f0 tx=0x7ff2f400b040).stop 2024-03-12T16:26:46.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 shutdown_connections 2024-03-12T16:26:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff2e806caa0 0x7ff2e806ef60 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff3000f8940 0x7ff300110340 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 --2- 172.21.15.6:0/3224661757 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff3000f9210 0x7ff300110830 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 >> 172.21.15.6:0/3224661757 conn(0x7ff3000f23d0 msgr2=0x7ff3000f6ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 shutdown_connections 2024-03-12T16:26:46.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.077+0000 7ff304c92700 1 -- 172.21.15.6:0/3224661757 wait complete. 2024-03-12T16:26:46.086 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 -- 172.21.15.6:0/2719347358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 msgr2=0x7f0d2c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 --2- 172.21.15.6:0/2719347358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 0x7f0d2c0f6930 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 rx=0x7f0d1c0047f0 tx=0x7f0d1c009cb0).stop 2024-03-12T16:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 -- 172.21.15.6:0/2719347358 shutdown_connections 2024-03-12T16:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 --2- 172.21.15.6:0/2719347358 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 0x7f0d2c0f6930 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 --2- 172.21.15.6:0/2719347358 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c0fc7f0 0x7f0d2c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 -- 172.21.15.6:0/2719347358 >> 172.21.15.6:0/2719347358 conn(0x7f0d2c070590 msgr2=0x7f0d2c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 -- 172.21.15.6:0/2719347358 shutdown_connections 2024-03-12T16:26:46.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 -- 172.21.15.6:0/2719347358 wait complete. 2024-03-12T16:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 Processor -- start 2024-03-12T16:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.181+0000 7f0d341af700 1 -- start start 2024-03-12T16:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d341af700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c0fc7f0 0x7f0d2c1090c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d341af700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 0x7f0d2c1095b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d341af700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c109aa0 con 0x7f0d2c0fd150 2024-03-12T16:26:46.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d341af700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0d2c109be0 con 0x7f0d2c0fc7f0 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d3174a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 0x7f0d2c1095b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d3174a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 0x7f0d2c1095b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34556/0 (socket says 172.21.15.6:34556) 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d3174a700 1 -- 172.21.15.6:0/50096191 learned_addr learned my addr 172.21.15.6:0/50096191 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d31f4b700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c0fc7f0 0x7f0d2c1090c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d3174a700 1 -- 172.21.15.6:0/50096191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c0fc7f0 msgr2=0x7f0d2c1090c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d3174a700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c0fc7f0 0x7f0d2c1090c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d3174a700 1 -- 172.21.15.6:0/50096191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0d1c005040 con 0x7f0d2c0fd150 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d3174a700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 0x7f0d2c1095b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f0d1c0099f0 tx=0x7f0d1c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d22ffd700 1 -- 172.21.15.6:0/50096191 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d1c00e030 con 0x7f0d2c0fd150 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0d2c109e30 con 0x7f0d2c0fd150 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d22ffd700 1 -- 172.21.15.6:0/50096191 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0d1c007e90 con 0x7f0d2c0fd150 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d22ffd700 1 -- 172.21.15.6:0/50096191 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0d1c018070 con 0x7f0d2c0fd150 2024-03-12T16:26:46.183 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.182+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0d2c112420 con 0x7f0d2c0fd150 2024-03-12T16:26:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.184+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0d2c05f590 con 0x7f0d2c0fd150 2024-03-12T16:26:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.185+0000 7f0d22ffd700 1 -- 172.21.15.6:0/50096191 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f0d1c0094c0 con 0x7f0d2c0fd150 2024-03-12T16:26:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.185+0000 7f0d22ffd700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d1806caa0 0x7f0d1806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:46.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.185+0000 7f0d22ffd700 1 -- 172.21.15.6:0/50096191 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0d1c08d370 con 0x7f0d2c0fd150 2024-03-12T16:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.185+0000 7f0d31f4b700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d1806caa0 0x7f0d1806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:46.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.186+0000 7f0d31f4b700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d1806caa0 0x7f0d1806ef60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f0d28004dc0 tx=0x7f0d2800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:46.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.189+0000 7f0d22ffd700 1 -- 172.21.15.6:0/50096191 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0d1c057440 con 0x7f0d2c0fd150 2024-03-12T16:26:46.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:45 smithi134 ceph-mon[85099]: pgmap v405: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:46.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:45 smithi006 ceph-mon[103869]: pgmap v405: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:46.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.407+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f0d2c059120 con 0x7f0d1806caa0 2024-03-12T16:26:46.407 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.408+0000 7f0d22ffd700 1 -- 172.21.15.6:0/50096191 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f0d2c059120 con 0x7f0d1806caa0 2024-03-12T16:26:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d1806caa0 msgr2=0x7f0d1806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d1806caa0 0x7f0d1806ef60 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 rx=0x7f0d28004dc0 tx=0x7f0d2800b040).stop 2024-03-12T16:26:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 msgr2=0x7f0d2c1095b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 0x7f0d2c1095b0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 rx=0x7f0d1c0099f0 tx=0x7f0d1c009cb0).stop 2024-03-12T16:26:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 shutdown_connections 2024-03-12T16:26:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0d2c0fc7f0 0x7f0d2c1090c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0d1806caa0 0x7f0d1806ef60 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 --2- 172.21.15.6:0/50096191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0d2c0fd150 0x7f0d2c1095b0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 >> 172.21.15.6:0/50096191 conn(0x7f0d2c070590 msgr2=0x7f0d2c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 shutdown_connections 2024-03-12T16:26:46.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.410+0000 7f0d341af700 1 -- 172.21.15.6:0/50096191 wait complete. 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2059970402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fe210 msgr2=0x7fc19c0f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 --2- 172.21.15.6:0/2059970402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fe210 0x7fc19c0f5f80 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 rx=0x7fc1840047f0 tx=0x7fc184009cb0).stop 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2059970402 shutdown_connections 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 --2- 172.21.15.6:0/2059970402 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fe210 0x7fc19c0f5f80 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 --2- 172.21.15.6:0/2059970402 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c0fd8b0 0x7fc19c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2059970402 >> 172.21.15.6:0/2059970402 conn(0x7fc19c06ce40 msgr2=0x7fc19c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2059970402 shutdown_connections 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2059970402 wait complete. 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 Processor -- start 2024-03-12T16:26:46.516 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.513+0000 7fc1a22c6700 1 -- start start 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc1a22c6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fd8b0 0x7fc19c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc1a22c6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c0fe210 0x7fc19c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc1a22c6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c10eae0 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc1a22c6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc19c10ec20 con 0x7fc19c0fe210 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc19bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fd8b0 0x7fc19c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc19bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fd8b0 0x7fc19c10dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34578/0 (socket says 172.21.15.6:34578) 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc19bfff700 1 -- 172.21.15.6:0/2929030385 learned_addr learned my addr 172.21.15.6:0/2929030385 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc19b7fe700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c0fe210 0x7fc19c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc19bfff700 1 -- 172.21.15.6:0/2929030385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c0fe210 msgr2=0x7fc19c10e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc19bfff700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c0fe210 0x7fc19c10e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc19bfff700 1 -- 172.21.15.6:0/2929030385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc184005040 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc19bfff700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fd8b0 0x7fc19c10dff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fc18c002770 tx=0x7fc18c002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc199775700 1 -- 172.21.15.6:0/2929030385 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18c002d80 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc199775700 1 -- 172.21.15.6:0/2929030385 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc18c00f040 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.517 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc19c1082b0 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.514+0000 7fc199775700 1 -- 172.21.15.6:0/2929030385 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc18c00d800 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.515+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc19c1087f0 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.515+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc19c060670 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.516+0000 7fc199775700 1 -- 172.21.15.6:0/2929030385 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fc18c009110 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.516+0000 7fc199775700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc18806caa0 0x7fc18806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.516+0000 7fc199775700 1 -- 172.21.15.6:0/2929030385 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc18c08b9c0 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.516+0000 7fc19b7fe700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc18806caa0 0x7fc18806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:46.518 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.517+0000 7fc19b7fe700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc18806caa0 0x7fc18806ef60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc19c109930 tx=0x7fc18400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:46.519 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.521+0000 7fc199775700 1 -- 172.21.15.6:0/2929030385 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc18c059520 con 0x7fc19c0fd8b0 2024-03-12T16:26:46.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.727+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc19c108a70 con 0x7fc18806caa0 2024-03-12T16:26:46.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.737+0000 7fc199775700 1 -- 172.21.15.6:0/2929030385 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fc19c108a70 con 0x7fc18806caa0 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (13m) 7m ago 24m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (11m) 7m ago 24m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (11m) 6m ago 23m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (13m) 7m ago 24m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (7m) 7m ago 19m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (7m) 7m ago 19m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (7m) 6m ago 19m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (6m) 6m ago 19m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:26:46.737 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (15m) 7m ago 25m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (14m) 6m ago 23m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (12m) 7m ago 26m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (11m) 6m ago 23m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (14m) 7m ago 24m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (14m) 6m ago 23m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (10m) 7m ago 23m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (10m) 7m ago 22m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (9m) 7m ago 22m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (9m) 6m ago 21m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (8m) 6m ago 21m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (8m) 6m ago 20m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:26:46.738 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (13m) 6m ago 22m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:26:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.739+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc18806caa0 msgr2=0x7fc18806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc18806caa0 0x7fc18806ef60 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 rx=0x7fc19c109930 tx=0x7fc18400b040).stop 2024-03-12T16:26:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fd8b0 msgr2=0x7fc19c10dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fd8b0 0x7fc19c10dff0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 rx=0x7fc18c002770 tx=0x7fc18c002b30).stop 2024-03-12T16:26:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 shutdown_connections 2024-03-12T16:26:46.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc18806caa0 0x7fc18806ef60 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc19c0fd8b0 0x7fc19c10dff0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 --2- 172.21.15.6:0/2929030385 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc19c0fe210 0x7fc19c10e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 >> 172.21.15.6:0/2929030385 conn(0x7fc19c06ce40 msgr2=0x7fc19c100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 shutdown_connections 2024-03-12T16:26:46.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.740+0000 7fc1a22c6700 1 -- 172.21.15.6:0/2929030385 wait complete. 2024-03-12T16:26:46.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.841+0000 7f272b661700 1 -- 172.21.15.6:0/2082846283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fd150 msgr2=0x7f27240f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.841+0000 7f272b661700 1 --2- 172.21.15.6:0/2082846283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fd150 0x7f27240f6930 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 rx=0x7f27140047f0 tx=0x7f2714009cb0).stop 2024-03-12T16:26:46.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.841+0000 7f272b661700 1 -- 172.21.15.6:0/2082846283 shutdown_connections 2024-03-12T16:26:46.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.841+0000 7f272b661700 1 --2- 172.21.15.6:0/2082846283 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fd150 0x7f27240f6930 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.841+0000 7f272b661700 1 --2- 172.21.15.6:0/2082846283 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27240fc7f0 0x7f27240fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.841+0000 7f272b661700 1 -- 172.21.15.6:0/2082846283 >> 172.21.15.6:0/2082846283 conn(0x7f27240f23b0 msgr2=0x7f27240f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:46.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.841+0000 7f272b661700 1 -- 172.21.15.6:0/2082846283 shutdown_connections 2024-03-12T16:26:46.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.841+0000 7f272b661700 1 -- 172.21.15.6:0/2082846283 wait complete. 2024-03-12T16:26:46.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f272b661700 1 Processor -- start 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f272b661700 1 -- start start 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f272b661700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fc7f0 0x7f272410e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f272b661700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27240fd150 0x7f272410e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f272b661700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272410eb80 con 0x7f27240fc7f0 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f272b661700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f272410ecc0 con 0x7f27240fd150 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f27293fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fc7f0 0x7f272410e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f27293fd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fc7f0 0x7f272410e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34592/0 (socket says 172.21.15.6:34592) 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f27293fd700 1 -- 172.21.15.6:0/4232509341 learned_addr learned my addr 172.21.15.6:0/4232509341 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.842+0000 7f2728bfc700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27240fd150 0x7f272410e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.843+0000 7f27293fd700 1 -- 172.21.15.6:0/4232509341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27240fd150 msgr2=0x7f272410e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.843+0000 7f27293fd700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27240fd150 0x7f272410e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.843+0000 7f27293fd700 1 -- 172.21.15.6:0/4232509341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2714005040 con 0x7f27240fc7f0 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.843+0000 7f27293fd700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fc7f0 0x7f272410e090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f27200041d0 tx=0x7f2720009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:46.844 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.843+0000 7f271a7fc700 1 -- 172.21.15.6:0/4232509341 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2720007b40 con 0x7f27240fc7f0 2024-03-12T16:26:46.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.843+0000 7f271a7fc700 1 -- 172.21.15.6:0/4232509341 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f272000f040 con 0x7f27240fc7f0 2024-03-12T16:26:46.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.843+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2724108350 con 0x7f27240fc7f0 2024-03-12T16:26:46.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.843+0000 7f271a7fc700 1 -- 172.21.15.6:0/4232509341 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f27200147b0 con 0x7f27240fc7f0 2024-03-12T16:26:46.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.843+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2724108890 con 0x7f27240fc7f0 2024-03-12T16:26:46.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.844+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2724060370 con 0x7f27240fc7f0 2024-03-12T16:26:46.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.845+0000 7f271a7fc700 1 -- 172.21.15.6:0/4232509341 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2720009110 con 0x7f27240fc7f0 2024-03-12T16:26:46.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.845+0000 7f271a7fc700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f271006caa0 0x7f271006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:46.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.845+0000 7f271a7fc700 1 -- 172.21.15.6:0/4232509341 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f272008bd90 con 0x7f27240fc7f0 2024-03-12T16:26:46.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.845+0000 7f2728bfc700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f271006caa0 0x7f271006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:46.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.846+0000 7f2728bfc700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f271006caa0 0x7f271006ef60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f27241099d0 tx=0x7f271400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:46.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:46.850+0000 7f271a7fc700 1 -- 172.21.15.6:0/4232509341 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f27200598f0 con 0x7f27240fc7f0 2024-03-12T16:26:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.132+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2724047540 con 0x7f27240fc7f0 2024-03-12T16:26:47.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.132+0000 7f271a7fc700 1 -- 172.21.15.6:0/4232509341 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f2720059480 con 0x7f27240fc7f0 2024-03-12T16:26:47.132 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:26:47.132 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:26:47.132 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:26:47.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:26:47.132 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:26:47.132 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:26:47.132 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:26:47.133 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:26:47.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.134+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f271006caa0 msgr2=0x7f271006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.134+0000 7f272b661700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f271006caa0 0x7f271006ef60 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 rx=0x7f27241099d0 tx=0x7f271400b040).stop 2024-03-12T16:26:47.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.134+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fc7f0 msgr2=0x7f272410e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.134+0000 7f272b661700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fc7f0 0x7f272410e090 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 rx=0x7f27200041d0 tx=0x7f2720009f60).stop 2024-03-12T16:26:47.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.134+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 shutdown_connections 2024-03-12T16:26:47.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.135+0000 7f272b661700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f271006caa0 0x7f271006ef60 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.135+0000 7f272b661700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f27240fc7f0 0x7f272410e090 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.135+0000 7f272b661700 1 --2- 172.21.15.6:0/4232509341 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f27240fd150 0x7f272410e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.135+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 >> 172.21.15.6:0/4232509341 conn(0x7f27240f23b0 msgr2=0x7f2724061340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:47.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.135+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 shutdown_connections 2024-03-12T16:26:47.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.135+0000 7f272b661700 1 -- 172.21.15.6:0/4232509341 wait complete. 2024-03-12T16:26:47.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.236+0000 7f6ec91f4700 1 -- 172.21.15.6:0/292090185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc060 msgr2=0x7f6ec40fc440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.236+0000 7f6ec91f4700 1 --2- 172.21.15.6:0/292090185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc060 0x7f6ec40fc440 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 rx=0x7f6eb40047f0 tx=0x7f6eb4009cb0).stop 2024-03-12T16:26:47.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.236+0000 7f6ec91f4700 1 -- 172.21.15.6:0/292090185 shutdown_connections 2024-03-12T16:26:47.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.236+0000 7f6ec91f4700 1 --2- 172.21.15.6:0/292090185 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ec40fc9c0 0x7f6ec40f6240 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.236+0000 7f6ec91f4700 1 --2- 172.21.15.6:0/292090185 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc060 0x7f6ec40fc440 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.236+0000 7f6ec91f4700 1 -- 172.21.15.6:0/292090185 >> 172.21.15.6:0/292090185 conn(0x7f6ec406ce50 msgr2=0x7f6ec406d260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:47.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.237+0000 7f6ec91f4700 1 -- 172.21.15.6:0/292090185 shutdown_connections 2024-03-12T16:26:47.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.237+0000 7f6ec91f4700 1 -- 172.21.15.6:0/292090185 wait complete. 2024-03-12T16:26:47.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.237+0000 7f6ec91f4700 1 Processor -- start 2024-03-12T16:26:47.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.237+0000 7f6ec91f4700 1 -- start start 2024-03-12T16:26:47.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec91f4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ec40fc060 0x7f6ec40fd040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:47.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec91f4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc9c0 0x7f6ec40fd530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:47.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec91f4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40fda20 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec91f4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6ec40fdb60 con 0x7f6ec40fc060 2024-03-12T16:26:47.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc9c0 0x7f6ec40fd530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:47.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc9c0 0x7f6ec40fd530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34610/0 (socket says 172.21.15.6:34610) 2024-03-12T16:26:47.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec259c700 1 -- 172.21.15.6:0/2454046161 learned_addr learned my addr 172.21.15.6:0/2454046161 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:47.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec2d9d700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ec40fc060 0x7f6ec40fd040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:47.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec259c700 1 -- 172.21.15.6:0/2454046161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ec40fc060 msgr2=0x7f6ec40fd040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec259c700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ec40fc060 0x7f6ec40fd040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec259c700 1 -- 172.21.15.6:0/2454046161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6eb4005040 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec259c700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc9c0 0x7f6ec40fd530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f6eb800a370 tx=0x7f6eb800c040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:47.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6eabfff700 1 -- 172.21.15.6:0/2454046161 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb8007b40 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6eabfff700 1 -- 172.21.15.6:0/2454046161 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6eb8010040 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.238+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6ec40fde10 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.239+0000 7f6eabfff700 1 -- 172.21.15.6:0/2454046161 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6eb80147e0 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.239+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6ec4114700 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.239+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6ec4047540 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.240+0000 7f6eabfff700 1 -- 172.21.15.6:0/2454046161 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f6eb8014a50 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.240+0000 7f6eabfff700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6eac06caa0 0x7f6eac06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.240+0000 7f6eabfff700 1 -- 172.21.15.6:0/2454046161 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6eb808b330 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.240+0000 7f6ec2d9d700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6eac06caa0 0x7f6eac06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:47.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.241+0000 7f6ec2d9d700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6eac06caa0 0x7f6eac06ef60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f6eb4004540 tx=0x7f6eb4009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:47.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.245+0000 7f6eabfff700 1 -- 172.21.15.6:0/2454046161 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6eb80554b0 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.488+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f6ec4114d60 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.487 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.489+0000 7f6eabfff700 1 -- 172.21.15.6:0/2454046161 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f6eb8058ad0 con 0x7f6ec40fc9c0 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:26:47.488 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:26:47.489 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:26:47.490 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:26:47.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6eac06caa0 msgr2=0x7f6eac06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6eac06caa0 0x7f6eac06ef60 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 rx=0x7f6eb4004540 tx=0x7f6eb4009cb0).stop 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc9c0 msgr2=0x7f6ec40fd530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc9c0 0x7f6ec40fd530 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 rx=0x7f6eb800a370 tx=0x7f6eb800c040).stop 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 shutdown_connections 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6ec40fc060 0x7f6ec40fd040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6eac06caa0 0x7f6eac06ef60 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 --2- 172.21.15.6:0/2454046161 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6ec40fc9c0 0x7f6ec40fd530 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 >> 172.21.15.6:0/2454046161 conn(0x7f6ec406ce50 msgr2=0x7f6ec40ff8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 shutdown_connections 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.491+0000 7f6ec91f4700 1 -- 172.21.15.6:0/2454046161 wait complete. 2024-03-12T16:26:47.492 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:26:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.594+0000 7fcdb249b700 1 -- 172.21.15.6:0/205329159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fe270 msgr2=0x7fcdac0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.594+0000 7fcdb249b700 1 --2- 172.21.15.6:0/205329159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fe270 0x7fcdac0f7a50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 rx=0x7fcd940047f0 tx=0x7fcd94009cb0).stop 2024-03-12T16:26:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.595+0000 7fcdb249b700 1 -- 172.21.15.6:0/205329159 shutdown_connections 2024-03-12T16:26:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.595+0000 7fcdb249b700 1 --2- 172.21.15.6:0/205329159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fe270 0x7fcdac0f7a50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.595+0000 7fcdb249b700 1 --2- 172.21.15.6:0/205329159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdac0fd910 0x7fcdac0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.595+0000 7fcdb249b700 1 -- 172.21.15.6:0/205329159 >> 172.21.15.6:0/205329159 conn(0x7fcdac0f3530 msgr2=0x7fcdac0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.595+0000 7fcdb249b700 1 -- 172.21.15.6:0/205329159 shutdown_connections 2024-03-12T16:26:47.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.595+0000 7fcdb249b700 1 -- 172.21.15.6:0/205329159 wait complete. 2024-03-12T16:26:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.595+0000 7fcdb249b700 1 Processor -- start 2024-03-12T16:26:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.595+0000 7fcdb249b700 1 -- start start 2024-03-12T16:26:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdb249b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fd910 0x7fcdac06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdb249b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdac0fe270 0x7fcdac06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdb249b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac06bab0 con 0x7fcdac0fd910 2024-03-12T16:26:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdb249b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcdac06bbf0 con 0x7fcdac0fe270 2024-03-12T16:26:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdabfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fd910 0x7fcdac06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:47.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdabfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fd910 0x7fcdac06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34636/0 (socket says 172.21.15.6:34636) 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdabfff700 1 -- 172.21.15.6:0/1736451572 learned_addr learned my addr 172.21.15.6:0/1736451572 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdab7fe700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdac0fe270 0x7fcdac06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdabfff700 1 -- 172.21.15.6:0/1736451572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdac0fe270 msgr2=0x7fcdac06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdabfff700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdac0fe270 0x7fcdac06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdabfff700 1 -- 172.21.15.6:0/1736451572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd94005040 con 0x7fcdac0fd910 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdabfff700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fd910 0x7fcdac06b0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fcd9c0041d0 tx=0x7fcd9c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcda97fa700 1 -- 172.21.15.6:0/1736451572 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c007b40 con 0x7fcdac0fd910 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcdac06bea0 con 0x7fcdac0fd910 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcda97fa700 1 -- 172.21.15.6:0/1736451572 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd9c00f040 con 0x7fcdac0fd910 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcda97fa700 1 -- 172.21.15.6:0/1736451572 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9c0147b0 con 0x7fcdac0fd910 2024-03-12T16:26:47.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.596+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcdac1146d0 con 0x7fcdac0fd910 2024-03-12T16:26:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.597+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcdac05f570 con 0x7fcdac0fd910 2024-03-12T16:26:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.598+0000 7fcda97fa700 1 -- 172.21.15.6:0/1736451572 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fcd9c009110 con 0x7fcdac0fd910 2024-03-12T16:26:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.598+0000 7fcda97fa700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd9806caa0 0x7fcd9806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:47.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.598+0000 7fcda97fa700 1 -- 172.21.15.6:0/1736451572 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fcd9c08bd80 con 0x7fcdac0fd910 2024-03-12T16:26:47.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.598+0000 7fcdab7fe700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd9806caa0 0x7fcd9806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:47.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.599+0000 7fcdab7fe700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd9806caa0 0x7fcd9806ef60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fcdac06c870 tx=0x7fcd9400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:47.601 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.603+0000 7fcda97fa700 1 -- 172.21.15.6:0/1736451572 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fcd9c055e50 con 0x7fcdac0fd910 2024-03-12T16:26:47.823 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.823+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcdac059120 con 0x7fcd9806caa0 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.825+0000 7fcda97fa700 1 -- 172.21.15.6:0/1736451572 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fcdac059120 con 0x7fcd9806caa0 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:26:47.824 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:26:47.825 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:26:47.825 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:26:47.825 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:26:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd9806caa0 msgr2=0x7fcd9806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd9806caa0 0x7fcd9806ef60 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 rx=0x7fcdac06c870 tx=0x7fcd9400b040).stop 2024-03-12T16:26:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fd910 msgr2=0x7fcdac06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fd910 0x7fcdac06b0d0 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 rx=0x7fcd9c0041d0 tx=0x7fcd9c009f60).stop 2024-03-12T16:26:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 shutdown_connections 2024-03-12T16:26:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd9806caa0 0x7fcd9806ef60 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcdac0fd910 0x7fcdac06b0d0 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 --2- 172.21.15.6:0/1736451572 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcdac0fe270 0x7fcdac06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 >> 172.21.15.6:0/1736451572 conn(0x7fcdac0f3530 msgr2=0x7fcdac0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:47.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 shutdown_connections 2024-03-12T16:26:47.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.827+0000 7fcdb249b700 1 -- 172.21.15.6:0/1736451572 wait complete. 2024-03-12T16:26:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.929+0000 7f6b74591700 1 -- 172.21.15.6:0/2499899282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 msgr2=0x7f6b6c0fcc40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.929+0000 7f6b74591700 1 --2- 172.21.15.6:0/2499899282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 0x7f6b6c0fcc40 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 rx=0x7f6b680047f0 tx=0x7f6b68009cb0).stop 2024-03-12T16:26:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 -- 172.21.15.6:0/2499899282 shutdown_connections 2024-03-12T16:26:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 --2- 172.21.15.6:0/2499899282 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd1c0 0x7f6b6c0f69a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 --2- 172.21.15.6:0/2499899282 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 0x7f6b6c0fcc40 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 -- 172.21.15.6:0/2499899282 >> 172.21.15.6:0/2499899282 conn(0x7f6b6c0f2440 msgr2=0x7f6b6c0f4860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 -- 172.21.15.6:0/2499899282 shutdown_connections 2024-03-12T16:26:47.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 -- 172.21.15.6:0/2499899282 wait complete. 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 Processor -- start 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 -- start start 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 0x7f6b6c0f8dd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.930+0000 7f6b74591700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd1c0 0x7f6b6c0f92c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b74591700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0f97b0 con 0x7f6b6c0fc860 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b74591700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6b6c0f98f0 con 0x7f6b6c0fd1c0 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b7232d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 0x7f6b6c0f8dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b7232d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 0x7f6b6c0f8dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:34654/0 (socket says 172.21.15.6:34654) 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b7232d700 1 -- 172.21.15.6:0/2355064568 learned_addr learned my addr 172.21.15.6:0/2355064568 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:26:47.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b71b2c700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd1c0 0x7f6b6c0f92c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b7232d700 1 -- 172.21.15.6:0/2355064568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd1c0 msgr2=0x7f6b6c0f92c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b7232d700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd1c0 0x7f6b6c0f92c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b7232d700 1 -- 172.21.15.6:0/2355064568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6b68005040 con 0x7f6b6c0fc860 2024-03-12T16:26:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b7232d700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 0x7f6b6c0f8dd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f6b680043a0 tx=0x7f6b68009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b637fe700 1 -- 172.21.15.6:0/2355064568 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b6800e030 con 0x7f6b6c0fc860 2024-03-12T16:26:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b637fe700 1 -- 172.21.15.6:0/2355064568 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6b68007e90 con 0x7f6b6c0fc860 2024-03-12T16:26:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6b6c0f9b40 con 0x7f6b6c0fc860 2024-03-12T16:26:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b637fe700 1 -- 172.21.15.6:0/2355064568 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6b68018070 con 0x7f6b6c0fc860 2024-03-12T16:26:47.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.931+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6b6c1145f0 con 0x7f6b6c0fc860 2024-03-12T16:26:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.932+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6b6c060370 con 0x7f6b6c0fc860 2024-03-12T16:26:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.933+0000 7f6b637fe700 1 -- 172.21.15.6:0/2355064568 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f6b68009590 con 0x7f6b6c0fc860 2024-03-12T16:26:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.933+0000 7f6b637fe700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5806cab0 0x7f6b5806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:26:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.933+0000 7f6b637fe700 1 -- 172.21.15.6:0/2355064568 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6b6808cf70 con 0x7f6b6c0fc860 2024-03-12T16:26:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.934+0000 7f6b71b2c700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5806cab0 0x7f6b5806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:26:47.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.934+0000 7f6b71b2c700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5806cab0 0x7f6b5806ef70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f6b6c0fa570 tx=0x7f6b5c009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:26:47.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:47.938+0000 7f6b637fe700 1 -- 172.21.15.6:0/2355064568 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6b680c0190 con 0x7f6b6c0fc860 2024-03-12T16:26:48.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:47 smithi134 ceph-mon[85099]: pgmap v406: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:48.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:47 smithi134 ceph-mon[85099]: from='client.34780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:48.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:47 smithi134 ceph-mon[85099]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:48.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:47 smithi134 ceph-mon[85099]: from='client.34788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:48.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:26:48.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:47 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/4232509341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:26:48.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:47 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2454046161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:26:48.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:47 smithi006 ceph-mon[103869]: pgmap v406: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:48.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:47 smithi006 ceph-mon[103869]: from='client.34780 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:48.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:47 smithi006 ceph-mon[103869]: from='client.34784 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:48.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:47 smithi006 ceph-mon[103869]: from='client.34788 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:48.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:26:48.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:47 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/4232509341' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:26:48.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:47 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2454046161' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:26:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.219+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f6b6c114c50 con 0x7f6b6c0fc860 2024-03-12T16:26:48.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.219+0000 7f6b637fe700 1 -- 172.21.15.6:0/2355064568 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f6b68057040 con 0x7f6b6c0fc860 2024-03-12T16:26:48.218 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:26:48.219 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:26:48.219 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:26:48.219 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:26:48.219 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:26:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5806cab0 msgr2=0x7f6b5806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5806cab0 0x7f6b5806ef70 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 rx=0x7f6b6c0fa570 tx=0x7f6b5c009da0).stop 2024-03-12T16:26:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 msgr2=0x7f6b6c0f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:26:48.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 0x7f6b6c0f8dd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 rx=0x7f6b680043a0 tx=0x7f6b68009cb0).stop 2024-03-12T16:26:48.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 shutdown_connections 2024-03-12T16:26:48.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6b5806cab0 0x7f6b5806ef70 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:48.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6b6c0fc860 0x7f6b6c0f8dd0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:48.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 --2- 172.21.15.6:0/2355064568 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6b6c0fd1c0 0x7f6b6c0f92c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:26:48.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 >> 172.21.15.6:0/2355064568 conn(0x7f6b6c0f2440 msgr2=0x7f6b6c060b80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:26:48.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 shutdown_connections 2024-03-12T16:26:48.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:26:48.221+0000 7f6b74591700 1 -- 172.21.15.6:0/2355064568 wait complete. 2024-03-12T16:26:49.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:48 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2355064568' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:26:49.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:48 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2355064568' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:26:50.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:49 smithi134 ceph-mon[85099]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:50.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:49 smithi134 ceph-mon[85099]: pgmap v407: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:50.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:49 smithi006 ceph-mon[103869]: from='client.34800 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:26:50.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:49 smithi006 ceph-mon[103869]: pgmap v407: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:52.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:51 smithi134 ceph-mon[85099]: pgmap v408: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:52.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:51 smithi006 ceph-mon[103869]: pgmap v408: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:53 smithi134 ceph-mon[85099]: pgmap v409: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:54.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:53 smithi006 ceph-mon[103869]: pgmap v409: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:56.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:55 smithi134 ceph-mon[85099]: pgmap v410: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:56.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:55 smithi006 ceph-mon[103869]: pgmap v410: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:58.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:57 smithi134 ceph-mon[85099]: pgmap v411: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:26:58.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:57 smithi006 ceph-mon[103869]: pgmap v411: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:00.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:26:59 smithi134 ceph-mon[85099]: pgmap v412: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:00.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:26:59 smithi006 ceph-mon[103869]: pgmap v412: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:02.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:01 smithi134 ceph-mon[85099]: pgmap v413: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:02.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:01 smithi006 ceph-mon[103869]: pgmap v413: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:03.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:27:03.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:27:04.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:03 smithi134 ceph-mon[85099]: pgmap v414: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:04.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:03 smithi006 ceph-mon[103869]: pgmap v414: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:05.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:04 smithi134 ceph-mon[85099]: pgmap v415: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:05.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:04 smithi006 ceph-mon[103869]: pgmap v415: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:07.451 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:07 smithi134 ceph-mon[85099]: pgmap v416: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:07.454 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:07 smithi006 ceph-mon[103869]: pgmap v416: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:09.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:09 smithi134 ceph-mon[85099]: pgmap v417: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:09.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:09 smithi006 ceph-mon[103869]: pgmap v417: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:11.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:11 smithi134 ceph-mon[85099]: pgmap v418: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:11.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:11 smithi006 ceph-mon[103869]: pgmap v418: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:13.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:13 smithi134 ceph-mon[85099]: pgmap v419: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:13.705 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:13 smithi006 ceph-mon[103869]: pgmap v419: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:15.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:15 smithi134 ceph-mon[85099]: pgmap v420: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:15.708 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:15 smithi006 ceph-mon[103869]: pgmap v420: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:17.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:17 smithi134 ceph-mon[85099]: pgmap v421: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:17.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:27:17.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:17 smithi006 ceph-mon[103869]: pgmap v421: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:17.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:27:18.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.337+0000 7f2fd350b700 1 -- 172.21.15.6:0/4023079128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fd150 msgr2=0x7f2fcc0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:18.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.337+0000 7f2fd350b700 1 --2- 172.21.15.6:0/4023079128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fd150 0x7f2fcc0f6930 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 rx=0x7f2fbc0047f0 tx=0x7f2fbc009cb0).stop 2024-03-12T16:27:18.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.337+0000 7f2fd350b700 1 -- 172.21.15.6:0/4023079128 shutdown_connections 2024-03-12T16:27:18.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.337+0000 7f2fd350b700 1 --2- 172.21.15.6:0/4023079128 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fd150 0x7f2fcc0f6930 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.337+0000 7f2fd350b700 1 --2- 172.21.15.6:0/4023079128 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fcc0fc7f0 0x7f2fcc0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.337+0000 7f2fd350b700 1 -- 172.21.15.6:0/4023079128 >> 172.21.15.6:0/4023079128 conn(0x7f2fcc070590 msgr2=0x7f2fcc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:18.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.337+0000 7f2fd350b700 1 -- 172.21.15.6:0/4023079128 shutdown_connections 2024-03-12T16:27:18.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.337+0000 7f2fd350b700 1 -- 172.21.15.6:0/4023079128 wait complete. 2024-03-12T16:27:18.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd350b700 1 Processor -- start 2024-03-12T16:27:18.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd350b700 1 -- start start 2024-03-12T16:27:18.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd350b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fc7f0 0x7f2fcc10e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd350b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fcc0fd150 0x7f2fcc10e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd350b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc10eb90 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd350b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2fcc10ecd0 con 0x7f2fcc0fd150 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd12a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fc7f0 0x7f2fcc10e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd12a7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fc7f0 0x7f2fcc10e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46578/0 (socket says 172.21.15.6:46578) 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd12a7700 1 -- 172.21.15.6:0/3615741299 learned_addr learned my addr 172.21.15.6:0/3615741299 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd0aa6700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fcc0fd150 0x7f2fcc10e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd12a7700 1 -- 172.21.15.6:0/3615741299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fcc0fd150 msgr2=0x7f2fcc10e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.338+0000 7f2fd12a7700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fcc0fd150 0x7f2fcc10e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.339+0000 7f2fd12a7700 1 -- 172.21.15.6:0/3615741299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2fbc005040 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.339+0000 7f2fd12a7700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fc7f0 0x7f2fcc10e0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f2fc800e8f0 tx=0x7f2fc800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:18.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.339+0000 7f2fc27fc700 1 -- 172.21.15.6:0/3615741299 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fc8007b40 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.339+0000 7f2fc27fc700 1 -- 172.21.15.6:0/3615741299 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2fc800f040 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.339+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2fcc1083a0 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.339+0000 7f2fc27fc700 1 -- 172.21.15.6:0/3615741299 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2fc8014880 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.339+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2fcc108960 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.340+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2fcc05f590 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.340+0000 7f2fc27fc700 1 -- 172.21.15.6:0/3615741299 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2fc8014b00 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.341+0000 7f2fc27fc700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2fb806caa0 0x7f2fb806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.341+0000 7f2fc27fc700 1 -- 172.21.15.6:0/3615741299 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2fc808b990 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.341+0000 7f2fd0aa6700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2fb806caa0 0x7f2fb806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:18.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.342+0000 7f2fd0aa6700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2fb806caa0 0x7f2fb806ef60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f2fcc109a20 tx=0x7f2fbc009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:18.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.346+0000 7f2fc27fc700 1 -- 172.21.15.6:0/3615741299 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2fc8055a60 con 0x7f2fcc0fc7f0 2024-03-12T16:27:18.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.566+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2fcc108fa0 con 0x7f2fb806caa0 2024-03-12T16:27:18.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.567+0000 7f2fc27fc700 1 -- 172.21.15.6:0/3615741299 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2fcc108fa0 con 0x7f2fb806caa0 2024-03-12T16:27:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2fb806caa0 msgr2=0x7f2fb806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2fb806caa0 0x7f2fb806ef60 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 rx=0x7f2fcc109a20 tx=0x7f2fbc009cb0).stop 2024-03-12T16:27:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fc7f0 msgr2=0x7f2fcc10e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fc7f0 0x7f2fcc10e0a0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 rx=0x7f2fc800e8f0 tx=0x7f2fc800b040).stop 2024-03-12T16:27:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 shutdown_connections 2024-03-12T16:27:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2fb806caa0 0x7f2fb806ef60 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2fcc0fc7f0 0x7f2fcc10e0a0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 --2- 172.21.15.6:0/3615741299 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2fcc0fd150 0x7f2fcc10e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 >> 172.21.15.6:0/3615741299 conn(0x7f2fcc070590 msgr2=0x7f2fcc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 shutdown_connections 2024-03-12T16:27:18.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.569+0000 7f2fd350b700 1 -- 172.21.15.6:0/3615741299 wait complete. 2024-03-12T16:27:18.579 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:27:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.673+0000 7f186e021700 1 -- 172.21.15.6:0/1045788113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b9c0 msgr2=0x7f1868103cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.673+0000 7f186e021700 1 --2- 172.21.15.6:0/1045788113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b9c0 0x7f1868103cc0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 rx=0x7f18580047f0 tx=0x7f1858009cb0).stop 2024-03-12T16:27:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.673+0000 7f186e021700 1 -- 172.21.15.6:0/1045788113 shutdown_connections 2024-03-12T16:27:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.673+0000 7f186e021700 1 --2- 172.21.15.6:0/1045788113 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b9c0 0x7f1868103cc0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.673+0000 7f186e021700 1 --2- 172.21.15.6:0/1045788113 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f186806b0f0 0x7f186806b4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.673+0000 7f186e021700 1 -- 172.21.15.6:0/1045788113 >> 172.21.15.6:0/1045788113 conn(0x7f18680f34b0 msgr2=0x7f18680f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.673+0000 7f186e021700 1 -- 172.21.15.6:0/1045788113 shutdown_connections 2024-03-12T16:27:18.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.673+0000 7f186e021700 1 -- 172.21.15.6:0/1045788113 wait complete. 2024-03-12T16:27:18.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.673+0000 7f186e021700 1 Processor -- start 2024-03-12T16:27:18.675 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f186e021700 1 -- start start 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f186e021700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b0f0 0x7f18681103c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f186e021700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f186806b9c0 0x7f18681108b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f186e021700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1868110eb0 con 0x7f186806b0f0 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f186e021700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1868110ff0 con 0x7f186806b9c0 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f18677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b0f0 0x7f18681103c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f18677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b0f0 0x7f18681103c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46602/0 (socket says 172.21.15.6:46602) 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f18677fe700 1 -- 172.21.15.6:0/1679039214 learned_addr learned my addr 172.21.15.6:0/1679039214 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f18677fe700 1 -- 172.21.15.6:0/1679039214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f186806b9c0 msgr2=0x7f18681108b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f1866ffd700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f186806b9c0 0x7f18681108b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f18677fe700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f186806b9c0 0x7f18681108b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f18677fe700 1 -- 172.21.15.6:0/1679039214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1858005040 con 0x7f186806b0f0 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f1866ffd700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f186806b9c0 0x7f18681108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.674+0000 7f18677fe700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b0f0 0x7f18681103c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f185c00c790 tx=0x7f185c004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:18.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.675+0000 7f1864ff9700 1 -- 172.21.15.6:0/1679039214 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185c0106f0 con 0x7f186806b0f0 2024-03-12T16:27:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.675+0000 7f1864ff9700 1 -- 172.21.15.6:0/1679039214 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f185c010d00 con 0x7f186806b0f0 2024-03-12T16:27:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.675+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f186810a680 con 0x7f186806b0f0 2024-03-12T16:27:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.675+0000 7f1864ff9700 1 -- 172.21.15.6:0/1679039214 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f185c012da0 con 0x7f186806b0f0 2024-03-12T16:27:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.675+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f186810abc0 con 0x7f186806b0f0 2024-03-12T16:27:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.676+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f186805f590 con 0x7f186806b0f0 2024-03-12T16:27:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.676+0000 7f1864ff9700 1 -- 172.21.15.6:0/1679039214 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f185c012400 con 0x7f186806b0f0 2024-03-12T16:27:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.677+0000 7f1864ff9700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f185006caa0 0x7f185006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:18.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.677+0000 7f1864ff9700 1 -- 172.21.15.6:0/1679039214 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f185c08b690 con 0x7f186806b0f0 2024-03-12T16:27:18.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.677+0000 7f1866ffd700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f185006caa0 0x7f185006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:18.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.677+0000 7f1866ffd700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f185006caa0 0x7f185006ef60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f18580043d0 tx=0x7f185800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:18.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.681+0000 7f1864ff9700 1 -- 172.21.15.6:0/1679039214 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f185c0591f0 con 0x7f186806b0f0 2024-03-12T16:27:18.896 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.897+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f186810ba40 con 0x7f185006caa0 2024-03-12T16:27:18.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.898+0000 7f1864ff9700 1 -- 172.21.15.6:0/1679039214 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f186810ba40 con 0x7f185006caa0 2024-03-12T16:27:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f185006caa0 msgr2=0x7f185006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f185006caa0 0x7f185006ef60 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 rx=0x7f18580043d0 tx=0x7f185800b040).stop 2024-03-12T16:27:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b0f0 msgr2=0x7f18681103c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b0f0 0x7f18681103c0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 rx=0x7f185c00c790 tx=0x7f185c004330).stop 2024-03-12T16:27:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 shutdown_connections 2024-03-12T16:27:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f185006caa0 0x7f185006ef60 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f186806b0f0 0x7f18681103c0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 --2- 172.21.15.6:0/1679039214 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f186806b9c0 0x7f18681108b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:18.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 >> 172.21.15.6:0/1679039214 conn(0x7f18680f34b0 msgr2=0x7f1868101580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 shutdown_connections 2024-03-12T16:27:18.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:18.900+0000 7f186e021700 1 -- 172.21.15.6:0/1679039214 wait complete. 2024-03-12T16:27:19.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.002+0000 7fc472973700 1 -- 172.21.15.6:0/2629898316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 msgr2=0x7fc46c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.002 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.002+0000 7fc472973700 1 --2- 172.21.15.6:0/2629898316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 0x7fc46c0fcbd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 rx=0x7fc45c0047f0 tx=0x7fc45c009cb0).stop 2024-03-12T16:27:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.002+0000 7fc472973700 1 -- 172.21.15.6:0/2629898316 shutdown_connections 2024-03-12T16:27:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.002+0000 7fc472973700 1 --2- 172.21.15.6:0/2629898316 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc46c0fd150 0x7fc46c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.002+0000 7fc472973700 1 --2- 172.21.15.6:0/2629898316 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 0x7fc46c0fcbd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.002+0000 7fc472973700 1 -- 172.21.15.6:0/2629898316 >> 172.21.15.6:0/2629898316 conn(0x7fc46c0f23b0 msgr2=0x7fc46c0f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.002+0000 7fc472973700 1 -- 172.21.15.6:0/2629898316 shutdown_connections 2024-03-12T16:27:19.003 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.003+0000 7fc472973700 1 -- 172.21.15.6:0/2629898316 wait complete. 2024-03-12T16:27:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.003+0000 7fc472973700 1 Processor -- start 2024-03-12T16:27:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.003+0000 7fc472973700 1 -- start start 2024-03-12T16:27:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc472973700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 0x7fc46c109220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:19.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc472973700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc46c0fd150 0x7fc46c109710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc472973700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c109c00 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc472973700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc46c109d40 con 0x7fc46c0fd150 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc46bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 0x7fc46c109220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc46bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 0x7fc46c109220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46618/0 (socket says 172.21.15.6:46618) 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc46bfff700 1 -- 172.21.15.6:0/1815272421 learned_addr learned my addr 172.21.15.6:0/1815272421 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc46b7fe700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc46c0fd150 0x7fc46c109710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc46bfff700 1 -- 172.21.15.6:0/1815272421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc46c0fd150 msgr2=0x7fc46c109710 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc46bfff700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc46c0fd150 0x7fc46c109710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc46bfff700 1 -- 172.21.15.6:0/1815272421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc45c005040 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.004+0000 7fc46bfff700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 0x7fc46c109220 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fc45c009380 tx=0x7fc45c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.005+0000 7fc4697fa700 1 -- 172.21.15.6:0/1815272421 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc45c018070 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.005+0000 7fc4697fa700 1 -- 172.21.15.6:0/1815272421 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc45c007e90 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.005+0000 7fc4697fa700 1 -- 172.21.15.6:0/1815272421 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc45c0123c0 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.005+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc46c109f90 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.005 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.005+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc46c112580 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.006+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc46c060370 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.006+0000 7fc4697fa700 1 -- 172.21.15.6:0/1815272421 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fc45c01d420 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.007+0000 7fc4697fa700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45406caa0 0x7fc45406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.007+0000 7fc4697fa700 1 -- 172.21.15.6:0/1815272421 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc45c08cd60 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.007+0000 7fc46b7fe700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45406caa0 0x7fc45406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:19.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.007+0000 7fc46b7fe700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45406caa0 0x7fc45406ef60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fc460009f20 tx=0x7fc46000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:19.010 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.011+0000 7fc4697fa700 1 -- 172.21.15.6:0/1815272421 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc45c056eb0 con 0x7fc46c0fc7f0 2024-03-12T16:27:19.217 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.217+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fc46c059120 con 0x7fc45406caa0 2024-03-12T16:27:19.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.227+0000 7fc4697fa700 1 -- 172.21.15.6:0/1815272421 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fc46c059120 con 0x7fc45406caa0 2024-03-12T16:27:19.227 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:27:19.227 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (14m) 7m ago 25m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:27:19.227 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (11m) 7m ago 25m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:27:19.227 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (11m) 7m ago 24m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:27:19.227 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (13m) 7m ago 24m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:27:19.227 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (8m) 7m ago 19m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:27:19.227 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (7m) 7m ago 19m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (7m) 7m ago 19m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (7m) 7m ago 19m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (15m) 7m ago 26m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (14m) 7m ago 24m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (12m) 7m ago 26m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (12m) 7m ago 24m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (14m) 7m ago 24m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (14m) 7m ago 23m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (11m) 7m ago 23m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (10m) 7m ago 23m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (10m) 7m ago 22m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (9m) 7m ago 22m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (9m) 7m ago 21m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (8m) 7m ago 21m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:27:19.228 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (14m) 7m ago 23m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:27:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.229+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45406caa0 msgr2=0x7fc45406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.229+0000 7fc472973700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45406caa0 0x7fc45406ef60 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 rx=0x7fc460009f20 tx=0x7fc46000b040).stop 2024-03-12T16:27:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.229+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 msgr2=0x7fc46c109220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.229+0000 7fc472973700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 0x7fc46c109220 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 rx=0x7fc45c009380 tx=0x7fc45c009cb0).stop 2024-03-12T16:27:19.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.229+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 shutdown_connections 2024-03-12T16:27:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.229+0000 7fc472973700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc45406caa0 0x7fc45406ef60 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.229+0000 7fc472973700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc46c0fc7f0 0x7fc46c109220 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.229+0000 7fc472973700 1 --2- 172.21.15.6:0/1815272421 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc46c0fd150 0x7fc46c109710 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.229+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 >> 172.21.15.6:0/1815272421 conn(0x7fc46c0f23b0 msgr2=0x7fc46c0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.230+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 shutdown_connections 2024-03-12T16:27:19.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.230+0000 7fc472973700 1 -- 172.21.15.6:0/1815272421 wait complete. 2024-03-12T16:27:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.330+0000 7f0f68703700 1 -- 172.21.15.6:0/1682857983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6710 msgr2=0x7f0f600f6af0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.330+0000 7f0f68703700 1 --2- 172.21.15.6:0/1682857983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6710 0x7f0f600f6af0 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 rx=0x7f0f5c0047f0 tx=0x7f0f5c009cb0).stop 2024-03-12T16:27:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.330+0000 7f0f68703700 1 -- 172.21.15.6:0/1682857983 shutdown_connections 2024-03-12T16:27:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.330+0000 7f0f68703700 1 --2- 172.21.15.6:0/1682857983 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f600f6fe0 0x7f0f60103d80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.335 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.330+0000 7f0f68703700 1 --2- 172.21.15.6:0/1682857983 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6710 0x7f0f600f6af0 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.330+0000 7f0f68703700 1 -- 172.21.15.6:0/1682857983 >> 172.21.15.6:0/1682857983 conn(0x7f0f60070590 msgr2=0x7f0f600f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.331+0000 7f0f68703700 1 -- 172.21.15.6:0/1682857983 shutdown_connections 2024-03-12T16:27:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.331+0000 7f0f68703700 1 -- 172.21.15.6:0/1682857983 wait complete. 2024-03-12T16:27:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.331+0000 7f0f68703700 1 Processor -- start 2024-03-12T16:27:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.331+0000 7f0f68703700 1 -- start start 2024-03-12T16:27:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.331+0000 7f0f68703700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f600f6710 0x7f0f60110240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:19.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.331+0000 7f0f68703700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6fe0 0x7f0f60110730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.331+0000 7f0f68703700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60110d30 con 0x7f0f600f6fe0 2024-03-12T16:27:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.331+0000 7f0f68703700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f0f60110e70 con 0x7f0f600f6710 2024-03-12T16:27:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.331+0000 7f0f65c9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6fe0 0x7f0f60110730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f65c9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6fe0 0x7f0f60110730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46640/0 (socket says 172.21.15.6:46640) 2024-03-12T16:27:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f65c9e700 1 -- 172.21.15.6:0/3645554131 learned_addr learned my addr 172.21.15.6:0/3645554131 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f6649f700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f600f6710 0x7f0f60110240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:19.337 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f65c9e700 1 -- 172.21.15.6:0/3645554131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f600f6710 msgr2=0x7f0f60110240 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f65c9e700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f600f6710 0x7f0f60110240 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f65c9e700 1 -- 172.21.15.6:0/3645554131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0f5c005040 con 0x7f0f600f6fe0 2024-03-12T16:27:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f6649f700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f600f6710 0x7f0f60110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:27:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f65c9e700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6fe0 0x7f0f60110730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f0f500041d0 tx=0x7f0f50009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f577fe700 1 -- 172.21.15.6:0/3645554131 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f50002d90 con 0x7f0f600f6fe0 2024-03-12T16:27:19.338 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0f6010a500 con 0x7f0f600f6fe0 2024-03-12T16:27:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f577fe700 1 -- 172.21.15.6:0/3645554131 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0f5000f040 con 0x7f0f600f6fe0 2024-03-12T16:27:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f577fe700 1 -- 172.21.15.6:0/3645554131 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0f5000d800 con 0x7f0f600f6fe0 2024-03-12T16:27:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.332+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0f6010aa40 con 0x7f0f600f6fe0 2024-03-12T16:27:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.333+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0f6005f590 con 0x7f0f600f6fe0 2024-03-12T16:27:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.334+0000 7f0f577fe700 1 -- 172.21.15.6:0/3645554131 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f0f5000dae0 con 0x7f0f600f6fe0 2024-03-12T16:27:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.334+0000 7f0f577fe700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0f4c06caa0 0x7f0f4c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:19.339 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.334+0000 7f0f577fe700 1 -- 172.21.15.6:0/3645554131 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f0f5008bdc0 con 0x7f0f600f6fe0 2024-03-12T16:27:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.334+0000 7f0f6649f700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0f4c06caa0 0x7f0f4c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.335+0000 7f0f6649f700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0f4c06caa0 0x7f0f4c06ef60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0f5c000c00 tx=0x7f0f5c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:19.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.339+0000 7f0f577fe700 1 -- 172.21.15.6:0/3645554131 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0f50059920 con 0x7f0f600f6fe0 2024-03-12T16:27:19.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.623+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f0f6010b9a0 con 0x7f0f600f6fe0 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.624+0000 7f0f577fe700 1 -- 172.21.15.6:0/3645554131 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f0f6010b9a0 con 0x7f0f600f6fe0 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:27:19.624 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:27:19.625 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:27:19.625 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:27:19.625 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:27:19.625 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:27:19.625 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:27:19.625 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:27:19.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0f4c06caa0 msgr2=0x7f0f4c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0f4c06caa0 0x7f0f4c06ef60 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 rx=0x7f0f5c000c00 tx=0x7f0f5c00b040).stop 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6fe0 msgr2=0x7f0f60110730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6fe0 0x7f0f60110730 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 rx=0x7f0f500041d0 tx=0x7f0f50009f60).stop 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 shutdown_connections 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f0f600f6710 0x7f0f60110240 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f0f4c06caa0 0x7f0f4c06ef60 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 --2- 172.21.15.6:0/3645554131 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f0f600f6fe0 0x7f0f60110730 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 >> 172.21.15.6:0/3645554131 conn(0x7f0f60070590 msgr2=0x7f0f6006d930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 shutdown_connections 2024-03-12T16:27:19.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.626+0000 7f0f68703700 1 -- 172.21.15.6:0/3645554131 wait complete. 2024-03-12T16:27:19.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:19 smithi134 ceph-mon[85099]: pgmap v422: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:19.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:19 smithi134 ceph-mon[85099]: from='client.34808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:19.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:19 smithi006 ceph-mon[103869]: pgmap v422: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:19.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:19 smithi006 ceph-mon[103869]: from='client.34808 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:19.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.734+0000 7fbe882b4700 1 -- 172.21.15.6:0/3707093817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 msgr2=0x7fbe800f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.734+0000 7fbe882b4700 1 --2- 172.21.15.6:0/3707093817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 0x7fbe800f7a50 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 rx=0x7fbe740047f0 tx=0x7fbe74009cb0).stop 2024-03-12T16:27:19.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.734+0000 7fbe882b4700 1 -- 172.21.15.6:0/3707093817 shutdown_connections 2024-03-12T16:27:19.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.734+0000 7fbe882b4700 1 --2- 172.21.15.6:0/3707093817 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 0x7fbe800f7a50 unknown :-1 s=CLOSED pgs=377 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.734+0000 7fbe882b4700 1 --2- 172.21.15.6:0/3707093817 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe800fd910 0x7fbe800fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.734+0000 7fbe882b4700 1 -- 172.21.15.6:0/3707093817 >> 172.21.15.6:0/3707093817 conn(0x7fbe800f3530 msgr2=0x7fbe800f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:19.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.734+0000 7fbe882b4700 1 -- 172.21.15.6:0/3707093817 shutdown_connections 2024-03-12T16:27:19.734 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.734+0000 7fbe882b4700 1 -- 172.21.15.6:0/3707093817 wait complete. 2024-03-12T16:27:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe882b4700 1 Processor -- start 2024-03-12T16:27:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe882b4700 1 -- start start 2024-03-12T16:27:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe882b4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe800fd910 0x7fbe8010dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe882b4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 0x7fbe8010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:19.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe882b4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8010eae0 con 0x7fbe800fe270 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe882b4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbe8010ec20 con 0x7fbe800fd910 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe8584f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 0x7fbe8010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe8584f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 0x7fbe8010e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46662/0 (socket says 172.21.15.6:46662) 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe8584f700 1 -- 172.21.15.6:0/1481424418 learned_addr learned my addr 172.21.15.6:0/1481424418 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe86050700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe800fd910 0x7fbe8010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe8584f700 1 -- 172.21.15.6:0/1481424418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe800fd910 msgr2=0x7fbe8010dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe8584f700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe800fd910 0x7fbe8010dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe8584f700 1 -- 172.21.15.6:0/1481424418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbe74005040 con 0x7fbe800fe270 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.735+0000 7fbe8584f700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 0x7fbe8010e4e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fbe740099f0 tx=0x7fbe74009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.736+0000 7fbe73779700 1 -- 172.21.15.6:0/1481424418 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe7400e030 con 0x7fbe800fe270 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.736+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbe80108250 con 0x7fbe800fe270 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.736+0000 7fbe73779700 1 -- 172.21.15.6:0/1481424418 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbe74007e90 con 0x7fbe800fe270 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.736+0000 7fbe73779700 1 -- 172.21.15.6:0/1481424418 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbe74018070 con 0x7fbe800fe270 2024-03-12T16:27:19.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.736+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbe80108730 con 0x7fbe800fe270 2024-03-12T16:27:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.737+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbe8005f570 con 0x7fbe800fe270 2024-03-12T16:27:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.737+0000 7fbe73779700 1 -- 172.21.15.6:0/1481424418 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fbe7401d420 con 0x7fbe800fe270 2024-03-12T16:27:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.737+0000 7fbe73779700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbe6c06caa0 0x7fbe6c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:19.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.738+0000 7fbe73779700 1 -- 172.21.15.6:0/1481424418 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbe7408cfa0 con 0x7fbe800fe270 2024-03-12T16:27:19.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.738+0000 7fbe86050700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbe6c06caa0 0x7fbe6c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:19.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.738+0000 7fbe86050700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbe6c06caa0 0x7fbe6c06ef60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fbe7c009250 tx=0x7fbe7c009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:19.741 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.742+0000 7fbe73779700 1 -- 172.21.15.6:0/1481424418 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbe7405ab00 con 0x7fbe800fe270 2024-03-12T16:27:19.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.982+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fbe80047540 con 0x7fbe800fe270 2024-03-12T16:27:19.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.982+0000 7fbe73779700 1 -- 172.21.15.6:0/1481424418 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fbe7405a690 con 0x7fbe800fe270 2024-03-12T16:27:19.983 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:27:19.983 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:27:19.983 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:27:19.983 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:27:19.983 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:27:19.983 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:27:19.983 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:27:19.983 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:27:19.984 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:27:19.984 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:27:19.984 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:27:19.984 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:27:19.984 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:27:19.984 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:27:19.984 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:27:19.984 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:27:19.985 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:27:19.986 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:27:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:27:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:27:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:27:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:27:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:27:19.987 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:27:19.987 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:27:19.987 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:27:19.988 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:27:19.988 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:27:19.988 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:27:19.988 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:27:19.988 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:27:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.984+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbe6c06caa0 msgr2=0x7fbe6c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.984+0000 7fbe882b4700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbe6c06caa0 0x7fbe6c06ef60 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 rx=0x7fbe7c009250 tx=0x7fbe7c009de0).stop 2024-03-12T16:27:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.984+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 msgr2=0x7fbe8010e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.984+0000 7fbe882b4700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 0x7fbe8010e4e0 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 rx=0x7fbe740099f0 tx=0x7fbe74009cb0).stop 2024-03-12T16:27:19.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.985+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 shutdown_connections 2024-03-12T16:27:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.985+0000 7fbe882b4700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbe800fd910 0x7fbe8010dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.985+0000 7fbe882b4700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbe6c06caa0 0x7fbe6c06ef60 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.990 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.985+0000 7fbe882b4700 1 --2- 172.21.15.6:0/1481424418 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbe800fe270 0x7fbe8010e4e0 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.985+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 >> 172.21.15.6:0/1481424418 conn(0x7fbe800f3530 msgr2=0x7fbe800fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.985+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 shutdown_connections 2024-03-12T16:27:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:19.985+0000 7fbe882b4700 1 -- 172.21.15.6:0/1481424418 wait complete. 2024-03-12T16:27:19.991 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:27:20.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.088+0000 7fef9b61d700 1 -- 172.21.15.6:0/2232720885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 msgr2=0x7fef940f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.088+0000 7fef9b61d700 1 --2- 172.21.15.6:0/2232720885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 0x7fef940f8c80 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 rx=0x7fef900047f0 tx=0x7fef90009cb0).stop 2024-03-12T16:27:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.088+0000 7fef9b61d700 1 -- 172.21.15.6:0/2232720885 shutdown_connections 2024-03-12T16:27:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.088+0000 7fef9b61d700 1 --2- 172.21.15.6:0/2232720885 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef940f9200 0x7fef94101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.088+0000 7fef9b61d700 1 --2- 172.21.15.6:0/2232720885 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 0x7fef940f8c80 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.088+0000 7fef9b61d700 1 -- 172.21.15.6:0/2232720885 >> 172.21.15.6:0/2232720885 conn(0x7fef94070590 msgr2=0x7fef940f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.088+0000 7fef9b61d700 1 -- 172.21.15.6:0/2232720885 shutdown_connections 2024-03-12T16:27:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.088+0000 7fef9b61d700 1 -- 172.21.15.6:0/2232720885 wait complete. 2024-03-12T16:27:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.089+0000 7fef9b61d700 1 Processor -- start 2024-03-12T16:27:20.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.089+0000 7fef9b61d700 1 -- start start 2024-03-12T16:27:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.089+0000 7fef9b61d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 0x7fef9410e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.089+0000 7fef9b61d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef940f9200 0x7fef9410e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.089+0000 7fef9b61d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9410eb10 con 0x7fef940f88a0 2024-03-12T16:27:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.089+0000 7fef9b61d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fef9410ec50 con 0x7fef940f9200 2024-03-12T16:27:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.089+0000 7fef993b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 0x7fef9410e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.089+0000 7fef993b9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 0x7fef9410e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46678/0 (socket says 172.21.15.6:46678) 2024-03-12T16:27:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.089+0000 7fef993b9700 1 -- 172.21.15.6:0/2369813105 learned_addr learned my addr 172.21.15.6:0/2369813105 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:20.091 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef98bb8700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef940f9200 0x7fef9410e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef993b9700 1 -- 172.21.15.6:0/2369813105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef940f9200 msgr2=0x7fef9410e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef993b9700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef940f9200 0x7fef9410e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef993b9700 1 -- 172.21.15.6:0/2369813105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fef90005040 con 0x7fef940f88a0 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef993b9700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 0x7fef9410e020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fef90005010 tx=0x7fef90009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef867fc700 1 -- 172.21.15.6:0/2369813105 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef9000e030 con 0x7fef940f88a0 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef867fc700 1 -- 172.21.15.6:0/2369813105 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fef90007e90 con 0x7fef940f88a0 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fef94108280 con 0x7fef940f88a0 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef867fc700 1 -- 172.21.15.6:0/2369813105 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fef90018070 con 0x7fef940f88a0 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.090+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fef94108760 con 0x7fef940f88a0 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.091+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fef9405f590 con 0x7fef940f88a0 2024-03-12T16:27:20.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.091+0000 7fef867fc700 1 -- 172.21.15.6:0/2369813105 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fef9001d6e0 con 0x7fef940f88a0 2024-03-12T16:27:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.092+0000 7fef867fc700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fef8006ca30 0x7fef8006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.092+0000 7fef867fc700 1 -- 172.21.15.6:0/2369813105 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fef9008d040 con 0x7fef940f88a0 2024-03-12T16:27:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.092+0000 7fef98bb8700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fef8006ca30 0x7fef8006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:20.093 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.092+0000 7fef98bb8700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fef8006ca30 0x7fef8006eef0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fef94109960 tx=0x7fef88009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:20.096 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.096+0000 7fef867fc700 1 -- 172.21.15.6:0/2369813105 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fef9005a910 con 0x7fef940f88a0 2024-03-12T16:27:20.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.313+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fef940fedd0 con 0x7fef8006ca30 2024-03-12T16:27:20.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.314+0000 7fef867fc700 1 -- 172.21.15.6:0/2369813105 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fef940fedd0 con 0x7fef8006ca30 2024-03-12T16:27:20.314 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:27:20.314 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:27:20.314 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:27:20.314 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:27:20.314 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:27:20.314 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:27:20.314 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:27:20.315 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:27:20.315 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:27:20.315 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:27:20.315 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:27:20.315 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:27:20.315 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:27:20.315 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:27:20.315 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:27:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.316+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fef8006ca30 msgr2=0x7fef8006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.316+0000 7fef9b61d700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fef8006ca30 0x7fef8006eef0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 rx=0x7fef94109960 tx=0x7fef88009d60).stop 2024-03-12T16:27:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.316+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 msgr2=0x7fef9410e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.316+0000 7fef9b61d700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 0x7fef9410e020 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 rx=0x7fef90005010 tx=0x7fef90009cb0).stop 2024-03-12T16:27:20.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.317+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 shutdown_connections 2024-03-12T16:27:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.317+0000 7fef9b61d700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fef8006ca30 0x7fef8006eef0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.317+0000 7fef9b61d700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fef940f88a0 0x7fef9410e020 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.317+0000 7fef9b61d700 1 --2- 172.21.15.6:0/2369813105 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fef940f9200 0x7fef9410e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.317+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 >> 172.21.15.6:0/2369813105 conn(0x7fef94070590 msgr2=0x7fef940fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.317+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 shutdown_connections 2024-03-12T16:27:20.317 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.317+0000 7fef9b61d700 1 -- 172.21.15.6:0/2369813105 wait complete. 2024-03-12T16:27:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.420+0000 7eff85943700 1 -- 172.21.15.6:0/1348444612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fe2d0 msgr2=0x7eff800f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.420+0000 7eff85943700 1 --2- 172.21.15.6:0/1348444612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fe2d0 0x7eff800f7ab0 secure :-1 s=READY pgs=381 cs=0 l=1 rev1=1 rx=0x7eff740047f0 tx=0x7eff74009cb0).stop 2024-03-12T16:27:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.420+0000 7eff85943700 1 -- 172.21.15.6:0/1348444612 shutdown_connections 2024-03-12T16:27:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.420+0000 7eff85943700 1 --2- 172.21.15.6:0/1348444612 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fe2d0 0x7eff800f7ab0 unknown :-1 s=CLOSED pgs=381 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.420+0000 7eff85943700 1 --2- 172.21.15.6:0/1348444612 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff800fd970 0x7eff800fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.420+0000 7eff85943700 1 -- 172.21.15.6:0/1348444612 >> 172.21.15.6:0/1348444612 conn(0x7eff800f3550 msgr2=0x7eff800f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.420+0000 7eff85943700 1 -- 172.21.15.6:0/1348444612 shutdown_connections 2024-03-12T16:27:20.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.420+0000 7eff85943700 1 -- 172.21.15.6:0/1348444612 wait complete. 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.421+0000 7eff85943700 1 Processor -- start 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.421+0000 7eff85943700 1 -- start start 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.421+0000 7eff85943700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fd970 0x7eff8006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.421+0000 7eff85943700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff800fe2d0 0x7eff8006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.421+0000 7eff85943700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8006bab0 con 0x7eff800fd970 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.421+0000 7eff85943700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7eff8006bbf0 con 0x7eff800fe2d0 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fd970 0x7eff8006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff7effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fd970 0x7eff8006b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:46698/0 (socket says 172.21.15.6:46698) 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff7effd700 1 -- 172.21.15.6:0/2167227074 learned_addr learned my addr 172.21.15.6:0/2167227074 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff7e7fc700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff800fe2d0 0x7eff8006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff7effd700 1 -- 172.21.15.6:0/2167227074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff800fe2d0 msgr2=0x7eff8006b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff7effd700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff800fe2d0 0x7eff8006b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff7effd700 1 -- 172.21.15.6:0/2167227074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7eff74005040 con 0x7eff800fd970 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff7e7fc700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff800fe2d0 0x7eff8006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff7effd700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fd970 0x7eff8006b0d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7eff70002770 tx=0x7eff70002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:20.423 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff67fff700 1 -- 172.21.15.6:0/2167227074 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff70002d80 con 0x7eff800fd970 2024-03-12T16:27:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff67fff700 1 -- 172.21.15.6:0/2167227074 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7eff7000f040 con 0x7eff800fd970 2024-03-12T16:27:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7eff8006bea0 con 0x7eff800fd970 2024-03-12T16:27:20.424 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff67fff700 1 -- 172.21.15.6:0/2167227074 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7eff7000d800 con 0x7eff800fd970 2024-03-12T16:27:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.422+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7eff801146c0 con 0x7eff800fd970 2024-03-12T16:27:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.423+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7eff80060370 con 0x7eff800fd970 2024-03-12T16:27:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.424+0000 7eff67fff700 1 -- 172.21.15.6:0/2167227074 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7eff70009110 con 0x7eff800fd970 2024-03-12T16:27:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.424+0000 7eff67fff700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7eff6806caa0 0x7eff6806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.424+0000 7eff67fff700 1 -- 172.21.15.6:0/2167227074 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7eff7008b8d0 con 0x7eff800fd970 2024-03-12T16:27:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.424+0000 7eff7e7fc700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7eff6806caa0 0x7eff6806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:20.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.425+0000 7eff7e7fc700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7eff6806caa0 0x7eff6806ef60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7eff8006c870 tx=0x7eff7400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:20.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.429+0000 7eff67fff700 1 -- 172.21.15.6:0/2167227074 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7eff700559a0 con 0x7eff800fd970 2024-03-12T16:27:20.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:20 smithi134 ceph-mon[85099]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:20.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:20 smithi134 ceph-mon[85099]: from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:20.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:20 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3645554131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:27:20.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:20 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1481424418' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:27:20.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:20 smithi006 ceph-mon[103869]: from='client.34812 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:20.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:20 smithi006 ceph-mon[103869]: from='client.34816 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:20.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:20 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3645554131' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:27:20.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:20 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1481424418' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:27:20.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.706+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7eff80047540 con 0x7eff800fd970 2024-03-12T16:27:20.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.706+0000 7eff67fff700 1 -- 172.21.15.6:0/2167227074 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7eff70058fc0 con 0x7eff800fd970 2024-03-12T16:27:20.706 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:27:20.706 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:27:20.706 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:27:20.706 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:27:20.706 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7eff6806caa0 msgr2=0x7eff6806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7eff6806caa0 0x7eff6806ef60 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 rx=0x7eff8006c870 tx=0x7eff7400b040).stop 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fd970 msgr2=0x7eff8006b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fd970 0x7eff8006b0d0 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 rx=0x7eff70002770 tx=0x7eff70002b30).stop 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 shutdown_connections 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7eff6806caa0 0x7eff6806ef60 unknown :-1 s=CLOSED pgs=199 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7eff800fd970 0x7eff8006b0d0 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 --2- 172.21.15.6:0/2167227074 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7eff800fe2d0 0x7eff8006b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 >> 172.21.15.6:0/2167227074 conn(0x7eff800f3550 msgr2=0x7eff800fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:20.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.708+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 shutdown_connections 2024-03-12T16:27:20.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:20.709+0000 7eff85943700 1 -- 172.21.15.6:0/2167227074 wait complete. 2024-03-12T16:27:21.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:21 smithi134 ceph-mon[85099]: pgmap v423: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:21.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:21 smithi134 ceph-mon[85099]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:21.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:21 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2167227074' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:27:21.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:21 smithi006 ceph-mon[103869]: pgmap v423: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:21.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:21 smithi006 ceph-mon[103869]: from='client.34828 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:21.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:21 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2167227074' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:27:23.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:23 smithi134 ceph-mon[85099]: pgmap v424: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:23.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:23 smithi006 ceph-mon[103869]: pgmap v424: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:25.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:25 smithi134 ceph-mon[85099]: pgmap v425: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:25.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:25 smithi006 ceph-mon[103869]: pgmap v425: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:27.700 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:27 smithi134 ceph-mon[85099]: pgmap v426: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:27.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:27 smithi006 ceph-mon[103869]: pgmap v426: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:29.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:29 smithi134 ceph-mon[85099]: pgmap v427: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:29.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:29 smithi006 ceph-mon[103869]: pgmap v427: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:31.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:31 smithi134 ceph-mon[85099]: pgmap v428: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:31.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:31 smithi006 ceph-mon[103869]: pgmap v428: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:32.700 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:27:32.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:27:33.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:33 smithi134 ceph-mon[85099]: pgmap v429: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:33.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:33 smithi006 ceph-mon[103869]: pgmap v429: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:35.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:35 smithi134 ceph-mon[85099]: pgmap v430: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:35.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:35 smithi006 ceph-mon[103869]: pgmap v430: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:37.700 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:37 smithi134 ceph-mon[85099]: pgmap v431: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:37.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:37 smithi006 ceph-mon[103869]: pgmap v431: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:39.700 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:39 smithi134 ceph-mon[85099]: pgmap v432: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:39.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:39 smithi006 ceph-mon[103869]: pgmap v432: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:41.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:41 smithi134 ceph-mon[85099]: pgmap v433: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:41.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:41 smithi006 ceph-mon[103869]: pgmap v433: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:43.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:43 smithi134 ceph-mon[85099]: pgmap v434: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:43.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:43 smithi006 ceph-mon[103869]: pgmap v434: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:45.701 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:45 smithi134 ceph-mon[85099]: pgmap v435: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:45.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:45 smithi006 ceph-mon[103869]: pgmap v435: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:47.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:47 smithi006 ceph-mon[103869]: pgmap v436: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:47.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:27:47.951 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:47 smithi134 ceph-mon[85099]: pgmap v436: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:47.951 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:27:49.704 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:49 smithi006 ceph-mon[103869]: pgmap v437: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:49.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:49 smithi134 ceph-mon[85099]: pgmap v437: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.825+0000 7fd694641700 1 -- 172.21.15.6:0/2240756391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fc7f0 msgr2=0x7fd68c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.825+0000 7fd694641700 1 --2- 172.21.15.6:0/2240756391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fc7f0 0x7fd68c0fcbd0 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 rx=0x7fd6880047f0 tx=0x7fd688009cb0).stop 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.826+0000 7fd694641700 1 -- 172.21.15.6:0/2240756391 shutdown_connections 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.826+0000 7fd694641700 1 --2- 172.21.15.6:0/2240756391 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c0fd150 0x7fd68c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.826+0000 7fd694641700 1 --2- 172.21.15.6:0/2240756391 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fc7f0 0x7fd68c0fcbd0 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.826+0000 7fd694641700 1 -- 172.21.15.6:0/2240756391 >> 172.21.15.6:0/2240756391 conn(0x7fd68c070590 msgr2=0x7fd68c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.826+0000 7fd694641700 1 -- 172.21.15.6:0/2240756391 shutdown_connections 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.826+0000 7fd694641700 1 -- 172.21.15.6:0/2240756391 wait complete. 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.826+0000 7fd694641700 1 Processor -- start 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.826+0000 7fd694641700 1 -- start start 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd694641700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c0fc7f0 0x7fd68c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:50.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd694641700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fd150 0x7fd68c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:50.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd694641700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c10eae0 con 0x7fd68c0fd150 2024-03-12T16:27:50.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd694641700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd68c10ec20 con 0x7fd68c0fc7f0 2024-03-12T16:27:50.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd691bdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fd150 0x7fd68c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:50.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd691bdc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fd150 0x7fd68c10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39350/0 (socket says 172.21.15.6:39350) 2024-03-12T16:27:50.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd691bdc700 1 -- 172.21.15.6:0/2729288965 learned_addr learned my addr 172.21.15.6:0/2729288965 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:50.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd6923dd700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c0fc7f0 0x7fd68c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:50.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd691bdc700 1 -- 172.21.15.6:0/2729288965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c0fc7f0 msgr2=0x7fd68c10dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:50.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd691bdc700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c0fc7f0 0x7fd68c10dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:50.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd691bdc700 1 -- 172.21.15.6:0/2729288965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd688005040 con 0x7fd68c0fd150 2024-03-12T16:27:50.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd691bdc700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fd150 0x7fd68c10e4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fd6800044e0 tx=0x7fd680002a50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:50.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd67f7fe700 1 -- 172.21.15.6:0/2729288965 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd680007b40 con 0x7fd68c0fd150 2024-03-12T16:27:50.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd67f7fe700 1 -- 172.21.15.6:0/2729288965 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd68000f040 con 0x7fd68c0fd150 2024-03-12T16:27:50.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd68c1082b0 con 0x7fd68c0fd150 2024-03-12T16:27:50.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd67f7fe700 1 -- 172.21.15.6:0/2729288965 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd680014850 con 0x7fd68c0fd150 2024-03-12T16:27:50.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.827+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd68c1087f0 con 0x7fd68c0fd150 2024-03-12T16:27:50.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.828+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd68c05f590 con 0x7fd68c0fd150 2024-03-12T16:27:50.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.829+0000 7fd67f7fe700 1 -- 172.21.15.6:0/2729288965 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd680009110 con 0x7fd68c0fd150 2024-03-12T16:27:50.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.829+0000 7fd67f7fe700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd67806caa0 0x7fd67806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:50.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.830+0000 7fd67f7fe700 1 -- 172.21.15.6:0/2729288965 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd68008b800 con 0x7fd68c0fd150 2024-03-12T16:27:50.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.830+0000 7fd6923dd700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd67806caa0 0x7fd67806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:50.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.830+0000 7fd6923dd700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd67806caa0 0x7fd67806ef60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fd688004f10 tx=0x7fd68800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:50.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:50.834+0000 7fd67f7fe700 1 -- 172.21.15.6:0/2729288965 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd680059360 con 0x7fd68c0fd150 2024-03-12T16:27:51.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.055+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fd68c108ee0 con 0x7fd67806caa0 2024-03-12T16:27:51.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.056+0000 7fd67f7fe700 1 -- 172.21.15.6:0/2729288965 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fd68c108ee0 con 0x7fd67806caa0 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.058+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd67806caa0 msgr2=0x7fd67806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.058+0000 7fd694641700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd67806caa0 0x7fd67806ef60 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 rx=0x7fd688004f10 tx=0x7fd68800b040).stop 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.058+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fd150 msgr2=0x7fd68c10e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.058+0000 7fd694641700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fd150 0x7fd68c10e4e0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 rx=0x7fd6800044e0 tx=0x7fd680002a50).stop 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.058+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 shutdown_connections 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.058+0000 7fd694641700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd68c0fc7f0 0x7fd68c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.058+0000 7fd694641700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd67806caa0 0x7fd67806ef60 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.058+0000 7fd694641700 1 --2- 172.21.15.6:0/2729288965 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd68c0fd150 0x7fd68c10e4e0 unknown :-1 s=CLOSED pgs=384 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.058+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 >> 172.21.15.6:0/2729288965 conn(0x7fd68c070590 msgr2=0x7fd68c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:51.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.059+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 shutdown_connections 2024-03-12T16:27:51.059 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.059+0000 7fd694641700 1 -- 172.21.15.6:0/2729288965 wait complete. 2024-03-12T16:27:51.068 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:27:51.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.162+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2584068173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fd910 msgr2=0x7fcd400fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.162+0000 7fcd45ba3700 1 --2- 172.21.15.6:0/2584068173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fd910 0x7fcd400fdcf0 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 rx=0x7fcd340047f0 tx=0x7fcd34009cb0).stop 2024-03-12T16:27:51.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.162+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2584068173 shutdown_connections 2024-03-12T16:27:51.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.162+0000 7fcd45ba3700 1 --2- 172.21.15.6:0/2584068173 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd400fe270 0x7fcd400f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.162+0000 7fcd45ba3700 1 --2- 172.21.15.6:0/2584068173 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fd910 0x7fcd400fdcf0 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.162+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2584068173 >> 172.21.15.6:0/2584068173 conn(0x7fcd400f3530 msgr2=0x7fcd400f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:51.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.162+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2584068173 shutdown_connections 2024-03-12T16:27:51.162 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.162+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2584068173 wait complete. 2024-03-12T16:27:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd45ba3700 1 Processor -- start 2024-03-12T16:27:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd45ba3700 1 -- start start 2024-03-12T16:27:51.163 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd45ba3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd400fd910 0x7fcd4006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd45ba3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fe270 0x7fcd4006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd45ba3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4006bab0 con 0x7fcd400fe270 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd45ba3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcd4006bbf0 con 0x7fcd400fd910 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd3effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fe270 0x7fcd4006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd3effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fe270 0x7fcd4006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39358/0 (socket says 172.21.15.6:39358) 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd3effd700 1 -- 172.21.15.6:0/2457491406 learned_addr learned my addr 172.21.15.6:0/2457491406 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd3f7fe700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd400fd910 0x7fcd4006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd3effd700 1 -- 172.21.15.6:0/2457491406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd400fd910 msgr2=0x7fcd4006b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd3effd700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd400fd910 0x7fcd4006b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.163+0000 7fcd3effd700 1 -- 172.21.15.6:0/2457491406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd34005040 con 0x7fcd400fe270 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.164+0000 7fcd3effd700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fe270 0x7fcd4006b5c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fcd3000e8c0 tx=0x7fcd3000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.164+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2457491406 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3000ee60 con 0x7fcd400fe270 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.164+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2457491406 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd3000f040 con 0x7fcd400fe270 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.164+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcd4006be40 con 0x7fcd400fe270 2024-03-12T16:27:51.164 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.164+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2457491406 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd3000c810 con 0x7fcd400fe270 2024-03-12T16:27:51.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.164+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcd401147c0 con 0x7fcd400fe270 2024-03-12T16:27:51.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.165+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcd4005f570 con 0x7fcd400fe270 2024-03-12T16:27:51.165 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.165+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2457491406 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fcd30007b40 con 0x7fcd400fe270 2024-03-12T16:27:51.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.166+0000 7fcd3cff9700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd2806caa0 0x7fcd2806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:51.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.166+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2457491406 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fcd3008b910 con 0x7fcd400fe270 2024-03-12T16:27:51.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.166+0000 7fcd3f7fe700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd2806caa0 0x7fcd2806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:51.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.166+0000 7fcd3f7fe700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd2806caa0 0x7fcd2806ef60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fcd34004e60 tx=0x7fcd3400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:51.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.170+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2457491406 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fcd300559e0 con 0x7fcd400fe270 2024-03-12T16:27:51.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.385+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fcd4006c6c0 con 0x7fcd2806caa0 2024-03-12T16:27:51.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.386+0000 7fcd3cff9700 1 -- 172.21.15.6:0/2457491406 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fcd4006c6c0 con 0x7fcd2806caa0 2024-03-12T16:27:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd2806caa0 msgr2=0x7fcd2806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd2806caa0 0x7fcd2806ef60 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 rx=0x7fcd34004e60 tx=0x7fcd3400b040).stop 2024-03-12T16:27:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fe270 msgr2=0x7fcd4006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fe270 0x7fcd4006b5c0 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 rx=0x7fcd3000e8c0 tx=0x7fcd3000b040).stop 2024-03-12T16:27:51.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 shutdown_connections 2024-03-12T16:27:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcd400fd910 0x7fcd4006b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd2806caa0 0x7fcd2806ef60 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 --2- 172.21.15.6:0/2457491406 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcd400fe270 0x7fcd4006b5c0 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 >> 172.21.15.6:0/2457491406 conn(0x7fcd400f3530 msgr2=0x7fcd400fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 shutdown_connections 2024-03-12T16:27:51.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.388+0000 7fcd45ba3700 1 -- 172.21.15.6:0/2457491406 wait complete. 2024-03-12T16:27:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.491+0000 7fa002fea700 1 -- 172.21.15.6:0/3020220996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 msgr2=0x7f9ffc0f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.491+0000 7fa002fea700 1 --2- 172.21.15.6:0/3020220996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 0x7f9ffc0f8c80 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 rx=0x7f9ff00047f0 tx=0x7f9ff0009cb0).stop 2024-03-12T16:27:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 -- 172.21.15.6:0/3020220996 shutdown_connections 2024-03-12T16:27:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 --2- 172.21.15.6:0/3020220996 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ffc0f9200 0x7f9ffc101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 --2- 172.21.15.6:0/3020220996 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 0x7f9ffc0f8c80 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 -- 172.21.15.6:0/3020220996 >> 172.21.15.6:0/3020220996 conn(0x7f9ffc070590 msgr2=0x7f9ffc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 -- 172.21.15.6:0/3020220996 shutdown_connections 2024-03-12T16:27:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 -- 172.21.15.6:0/3020220996 wait complete. 2024-03-12T16:27:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 Processor -- start 2024-03-12T16:27:51.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 -- start start 2024-03-12T16:27:51.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 0x7f9ffc10e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.492+0000 7fa002fea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ffc0f9200 0x7f9ffc10e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa002fea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc10eb10 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa002fea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ffc10ec50 con 0x7f9ffc0f9200 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa000d86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 0x7f9ffc10e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa000d86700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 0x7f9ffc10e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39374/0 (socket says 172.21.15.6:39374) 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa000d86700 1 -- 172.21.15.6:0/1632866832 learned_addr learned my addr 172.21.15.6:0/1632866832 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7f9ffbfff700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ffc0f9200 0x7f9ffc10e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa000d86700 1 -- 172.21.15.6:0/1632866832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ffc0f9200 msgr2=0x7f9ffc10e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa000d86700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ffc0f9200 0x7f9ffc10e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa000d86700 1 -- 172.21.15.6:0/1632866832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9ff0005040 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa000d86700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 0x7f9ffc10e020 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f9ff000b120 tx=0x7f9ff0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7f9ff9ffb700 1 -- 172.21.15.6:0/1632866832 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff000e030 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7f9ff9ffb700 1 -- 172.21.15.6:0/1632866832 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9ff0007e90 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ffc108280 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.493+0000 7f9ff9ffb700 1 -- 172.21.15.6:0/1632866832 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9ff0018070 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.494+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ffc108760 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.494+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ffc05f590 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.495+0000 7f9ff9ffb700 1 -- 172.21.15.6:0/1632866832 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9ff001d420 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.496+0000 7f9ff9ffb700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9fec06caa0 0x7f9fec06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:51.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.496+0000 7f9ff9ffb700 1 -- 172.21.15.6:0/1632866832 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9ff008d400 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.496+0000 7f9ffbfff700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9fec06caa0 0x7f9fec06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:51.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.496+0000 7f9ffbfff700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9fec06caa0 0x7f9fec06ef60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f9ffc109960 tx=0x7f9fe8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:51.499 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.500+0000 7f9ff9ffb700 1 -- 172.21.15.6:0/1632866832 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9ff005afc0 con 0x7f9ffc0f88a0 2024-03-12T16:27:51.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.706+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ffc1097b0 con 0x7f9fec06caa0 2024-03-12T16:27:51.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.716+0000 7f9ff9ffb700 1 -- 172.21.15.6:0/1632866832 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f9ffc1097b0 con 0x7f9fec06caa0 2024-03-12T16:27:51.715 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:27:51.715 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (14m) 8m ago 25m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:27:51.715 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (12m) 8m ago 25m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:27:51.715 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (12m) 7m ago 25m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:27:51.715 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (14m) 8m ago 25m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (8m) 8m ago 20m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (8m) 8m ago 20m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (8m) 7m ago 20m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (8m) 7m ago 20m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (16m) 8m ago 27m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (15m) 7m ago 24m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (13m) 8m ago 27m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (13m) 7m ago 24m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (15m) 8m ago 25m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (15m) 7m ago 24m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (12m) 8m ago 24m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (11m) 8m ago 23m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (10m) 8m ago 23m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:27:51.716 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (10m) 7m ago 22m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:27:51.717 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (9m) 7m ago 22m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:27:51.717 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (9m) 7m ago 21m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:27:51.717 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (14m) 7m ago 23m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:27:51.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9fec06caa0 msgr2=0x7f9fec06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9fec06caa0 0x7f9fec06ef60 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 rx=0x7f9ffc109960 tx=0x7f9fe8009040).stop 2024-03-12T16:27:51.717 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 msgr2=0x7f9ffc10e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 0x7f9ffc10e020 secure :-1 s=READY pgs=388 cs=0 l=1 rev1=1 rx=0x7f9ff000b120 tx=0x7f9ff0009cb0).stop 2024-03-12T16:27:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 shutdown_connections 2024-03-12T16:27:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9fec06caa0 0x7f9fec06ef60 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ffc0f88a0 0x7f9ffc10e020 unknown :-1 s=CLOSED pgs=388 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 --2- 172.21.15.6:0/1632866832 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ffc0f9200 0x7f9ffc10e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 >> 172.21.15.6:0/1632866832 conn(0x7f9ffc070590 msgr2=0x7f9ffc0fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 shutdown_connections 2024-03-12T16:27:51.718 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.718+0000 7fa002fea700 1 -- 172.21.15.6:0/1632866832 wait complete. 2024-03-12T16:27:51.824 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.820+0000 7f735cd96700 1 -- 172.21.15.6:0/1935622632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f9200 msgr2=0x7f7358101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.820+0000 7f735cd96700 1 --2- 172.21.15.6:0/1935622632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f9200 0x7f7358101910 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 rx=0x7f734c0047f0 tx=0x7f734c009cb0).stop 2024-03-12T16:27:51.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.820+0000 7f735cd96700 1 -- 172.21.15.6:0/1935622632 shutdown_connections 2024-03-12T16:27:51.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.820+0000 7f735cd96700 1 --2- 172.21.15.6:0/1935622632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f9200 0x7f7358101910 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.820+0000 7f735cd96700 1 --2- 172.21.15.6:0/1935622632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73580f88a0 0x7f73580f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.825 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.820+0000 7f735cd96700 1 -- 172.21.15.6:0/1935622632 >> 172.21.15.6:0/1935622632 conn(0x7f7358070590 msgr2=0x7f73580f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:51.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.820+0000 7f735cd96700 1 -- 172.21.15.6:0/1935622632 shutdown_connections 2024-03-12T16:27:51.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.820+0000 7f735cd96700 1 -- 172.21.15.6:0/1935622632 wait complete. 2024-03-12T16:27:51.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f735cd96700 1 Processor -- start 2024-03-12T16:27:51.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f735cd96700 1 -- start start 2024-03-12T16:27:51.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f735cd96700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f88a0 0x7f735810e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:51.826 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f735cd96700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73580f9200 0x7f735810e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f735cd96700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735810eb70 con 0x7f73580f88a0 2024-03-12T16:27:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f735cd96700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f735810ecb0 con 0x7f73580f9200 2024-03-12T16:27:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f735659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f88a0 0x7f735810e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f735659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f88a0 0x7f735810e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39386/0 (socket says 172.21.15.6:39386) 2024-03-12T16:27:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f735659c700 1 -- 172.21.15.6:0/405229502 learned_addr learned my addr 172.21.15.6:0/405229502 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.821+0000 7f7355d9b700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73580f9200 0x7f735810e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:51.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.822+0000 7f735659c700 1 -- 172.21.15.6:0/405229502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73580f9200 msgr2=0x7f735810e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.822+0000 7f735659c700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73580f9200 0x7f735810e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.822+0000 7f735659c700 1 -- 172.21.15.6:0/405229502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f734c005040 con 0x7f73580f88a0 2024-03-12T16:27:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.822+0000 7f735659c700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f88a0 0x7f735810e080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f73480041d0 tx=0x7f7348009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.822+0000 7f73477fe700 1 -- 172.21.15.6:0/405229502 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7348007b40 con 0x7f73580f88a0 2024-03-12T16:27:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.822+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7358108340 con 0x7f73580f88a0 2024-03-12T16:27:51.828 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.822+0000 7f73477fe700 1 -- 172.21.15.6:0/405229502 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f734800f040 con 0x7f73580f88a0 2024-03-12T16:27:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.822+0000 7f73477fe700 1 -- 172.21.15.6:0/405229502 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73480147b0 con 0x7f73580f88a0 2024-03-12T16:27:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.822+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7358108880 con 0x7f73580f88a0 2024-03-12T16:27:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.823+0000 7f73477fe700 1 -- 172.21.15.6:0/405229502 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7348009110 con 0x7f73580f88a0 2024-03-12T16:27:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.823+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f735805f590 con 0x7f73580f88a0 2024-03-12T16:27:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.824+0000 7f73477fe700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f734006caa0 0x7f734006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:51.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.824+0000 7f73477fe700 1 -- 172.21.15.6:0/405229502 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f734808b7d0 con 0x7f73580f88a0 2024-03-12T16:27:51.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.824+0000 7f7355d9b700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f734006caa0 0x7f734006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:51.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.824+0000 7f7355d9b700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f734006caa0 0x7f734006ef60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f73581099c0 tx=0x7f734c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:51.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:51.828+0000 7f73477fe700 1 -- 172.21.15.6:0/405229502 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7348059330 con 0x7f73580f88a0 2024-03-12T16:27:51.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:51 smithi134 ceph-mon[85099]: pgmap v438: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:51.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:51 smithi006 ceph-mon[103869]: pgmap v438: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:52.110 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.111+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7358109810 con 0x7f73580f88a0 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.111+0000 7f73477fe700 1 -- 172.21.15.6:0/405229502 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f7348055030 con 0x7f73580f88a0 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:27:52.111 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:27:52.112 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:27:52.112 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:27:52.112 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:27:52.112 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:27:52.112 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:27:52.112 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:27:52.112 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f734006caa0 msgr2=0x7f734006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f734006caa0 0x7f734006ef60 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 rx=0x7f73581099c0 tx=0x7f734c00b040).stop 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f88a0 msgr2=0x7f735810e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f88a0 0x7f735810e080 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 rx=0x7f73480041d0 tx=0x7f7348009f60).stop 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 shutdown_connections 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f734006caa0 0x7f734006ef60 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73580f88a0 0x7f735810e080 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 --2- 172.21.15.6:0/405229502 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73580f9200 0x7f735810e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 >> 172.21.15.6:0/405229502 conn(0x7f7358070590 msgr2=0x7f73580fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.113+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 shutdown_connections 2024-03-12T16:27:52.113 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.114+0000 7f735cd96700 1 -- 172.21.15.6:0/405229502 wait complete. 2024-03-12T16:27:52.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.215+0000 7f83a8a67700 1 -- 172.21.15.6:0/3551393711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 msgr2=0x7f83a40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.215+0000 7f83a8a67700 1 --2- 172.21.15.6:0/3551393711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 0x7f83a40fcbd0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 rx=0x7f83940047f0 tx=0x7f8394009cb0).stop 2024-03-12T16:27:52.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.215+0000 7f83a8a67700 1 -- 172.21.15.6:0/3551393711 shutdown_connections 2024-03-12T16:27:52.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.216+0000 7f83a8a67700 1 --2- 172.21.15.6:0/3551393711 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a40fd150 0x7f83a40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.215 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.216+0000 7f83a8a67700 1 --2- 172.21.15.6:0/3551393711 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 0x7f83a40fcbd0 unknown :-1 s=CLOSED pgs=391 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.216+0000 7f83a8a67700 1 -- 172.21.15.6:0/3551393711 >> 172.21.15.6:0/3551393711 conn(0x7f83a4070590 msgr2=0x7f83a40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.216+0000 7f83a8a67700 1 -- 172.21.15.6:0/3551393711 shutdown_connections 2024-03-12T16:27:52.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.216+0000 7f83a8a67700 1 -- 172.21.15.6:0/3551393711 wait complete. 2024-03-12T16:27:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.216+0000 7f83a8a67700 1 Processor -- start 2024-03-12T16:27:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.216+0000 7f83a8a67700 1 -- start start 2024-03-12T16:27:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a8a67700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 0x7f83a410dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a8a67700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a40fd150 0x7f83a410e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a8a67700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a410eae0 con 0x7f83a40fc7f0 2024-03-12T16:27:52.218 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a8a67700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f83a410ec20 con 0x7f83a40fd150 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 0x7f83a410dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 0x7f83a410dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:39394/0 (socket says 172.21.15.6:39394) 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a259c700 1 -- 172.21.15.6:0/374318981 learned_addr learned my addr 172.21.15.6:0/374318981 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a1d9b700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a40fd150 0x7f83a410e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a259c700 1 -- 172.21.15.6:0/374318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a40fd150 msgr2=0x7f83a410e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a259c700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a40fd150 0x7f83a410e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a259c700 1 -- 172.21.15.6:0/374318981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8394005040 con 0x7f83a40fc7f0 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a1d9b700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a40fd150 0x7f83a410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a259c700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 0x7f83a410dff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f839400b120 tx=0x7f8394009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:52.219 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83937fe700 1 -- 172.21.15.6:0/374318981 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f839400e030 con 0x7f83a40fc7f0 2024-03-12T16:27:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f83a4108250 con 0x7f83a40fc7f0 2024-03-12T16:27:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83937fe700 1 -- 172.21.15.6:0/374318981 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8394007e90 con 0x7f83a40fc7f0 2024-03-12T16:27:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83937fe700 1 -- 172.21.15.6:0/374318981 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8394018070 con 0x7f83a40fc7f0 2024-03-12T16:27:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.217+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f83a41087b0 con 0x7f83a40fc7f0 2024-03-12T16:27:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.218+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f83a405f590 con 0x7f83a40fc7f0 2024-03-12T16:27:52.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.219+0000 7f83937fe700 1 -- 172.21.15.6:0/374318981 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f839401d420 con 0x7f83a40fc7f0 2024-03-12T16:27:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.219+0000 7f83937fe700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f838c06caa0 0x7f838c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.219+0000 7f83937fe700 1 -- 172.21.15.6:0/374318981 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f839408d240 con 0x7f83a40fc7f0 2024-03-12T16:27:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.219+0000 7f83a1d9b700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f838c06caa0 0x7f838c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:52.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.220+0000 7f83a1d9b700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f838c06caa0 0x7f838c06ef60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f83a4109930 tx=0x7f8398009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:52.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.224+0000 7f83937fe700 1 -- 172.21.15.6:0/374318981 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f839405ada0 con 0x7f83a40fc7f0 2024-03-12T16:27:52.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.467+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f83a4109710 con 0x7f83a40fc7f0 2024-03-12T16:27:52.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.467+0000 7f83937fe700 1 -- 172.21.15.6:0/374318981 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f839405a930 con 0x7f83a40fc7f0 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:27:52.467 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:27:52.468 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:27:52.469 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:27:52.470 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:27:52.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f838c06caa0 msgr2=0x7f838c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f838c06caa0 0x7f838c06ef60 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 rx=0x7f83a4109930 tx=0x7f8398009040).stop 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 msgr2=0x7f83a410dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 0x7f83a410dff0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 rx=0x7f839400b120 tx=0x7f8394009cb0).stop 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 shutdown_connections 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f838c06caa0 0x7f838c06ef60 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f83a40fc7f0 0x7f83a410dff0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 --2- 172.21.15.6:0/374318981 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f83a40fd150 0x7f83a410e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 >> 172.21.15.6:0/374318981 conn(0x7f83a4070590 msgr2=0x7f83a4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 shutdown_connections 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.469+0000 7f83a8a67700 1 -- 172.21.15.6:0/374318981 wait complete. 2024-03-12T16:27:52.471 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:27:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.572+0000 7fe9b8e87700 1 -- 172.21.15.6:0/3230959270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fd150 msgr2=0x7fe9b40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.572+0000 7fe9b8e87700 1 --2- 172.21.15.6:0/3230959270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fd150 0x7fe9b40f6930 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 rx=0x7fe9a40047f0 tx=0x7fe9a4009cb0).stop 2024-03-12T16:27:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.572+0000 7fe9b8e87700 1 -- 172.21.15.6:0/3230959270 shutdown_connections 2024-03-12T16:27:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.572+0000 7fe9b8e87700 1 --2- 172.21.15.6:0/3230959270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fd150 0x7fe9b40f6930 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.572+0000 7fe9b8e87700 1 --2- 172.21.15.6:0/3230959270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9b40fc7f0 0x7fe9b40fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:27:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.572+0000 7fe9b8e87700 1 -- 172.21.15.6:0/3230959270 >> 172.21.15.6:0/3230959270 conn(0x7fe9b4070590 msgr2=0x7fe9b40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.572+0000 7fe9b8e87700 1 -- 172.21.15.6:0/3230959270 shutdown_connections 2024-03-12T16:27:52.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.572+0000 7fe9b8e87700 1 -- 172.21.15.6:0/3230959270 wait complete. 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b8e87700 1 Processor -- start 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b8e87700 1 -- start start 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b8e87700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fc7f0 0x7fe9b410e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b8e87700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9b40fd150 0x7fe9b410e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b8e87700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b410ebc0 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b8e87700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe9b41081e0 con 0x7fe9b40fd150 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fc7f0 0x7fe9b410e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fc7f0 0x7fe9b410e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35126/0 (socket says 172.21.15.6:35126) 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b259c700 1 -- 172.21.15.6:0/1875396446 learned_addr learned my addr 172.21.15.6:0/1875396446 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:52.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b1d9b700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9b40fd150 0x7fe9b410e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.573+0000 7fe9b259c700 1 -- 172.21.15.6:0/1875396446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9b40fd150 msgr2=0x7fe9b410e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.574+0000 7fe9b259c700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9b40fd150 0x7fe9b410e530 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.574+0000 7fe9b259c700 1 -- 172.21.15.6:0/1875396446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe9a4005040 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.574+0000 7fe9b259c700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fc7f0 0x7fe9b410e040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fe9a800b4b0 tx=0x7fe9a80090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.574+0000 7fe9a37fe700 1 -- 172.21.15.6:0/1875396446 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a8002500 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.574+0000 7fe9a37fe700 1 -- 172.21.15.6:0/1875396446 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe9a8002b10 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.574+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe9b4108490 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.574+0000 7fe9a37fe700 1 -- 172.21.15.6:0/1875396446 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe9a8012cf0 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.574+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe9b41089d0 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.575+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe9b405f590 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.575+0000 7fe9a37fe700 1 -- 172.21.15.6:0/1875396446 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe9a8002660 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.576+0000 7fe9a37fe700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe99c06caa0 0x7fe99c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.576+0000 7fe9a37fe700 1 -- 172.21.15.6:0/1875396446 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe9a808be70 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.576+0000 7fe9b1d9b700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe99c06caa0 0x7fe99c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:52.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.576+0000 7fe9b1d9b700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe99c06caa0 0x7fe99c06ef60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe9a4004f10 tx=0x7fe9a400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:52.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.580+0000 7fe9a37fe700 1 -- 172.21.15.6:0/1875396446 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe9a80599d0 con 0x7fe9b40fc7f0 2024-03-12T16:27:52.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.796+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe9b4103660 con 0x7fe99c06caa0 2024-03-12T16:27:52.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.797+0000 7fe9a37fe700 1 -- 172.21.15.6:0/1875396446 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe9b4103660 con 0x7fe99c06caa0 2024-03-12T16:27:52.796 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:27:52.796 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:27:52.797 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:27:52.798 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:27:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe99c06caa0 msgr2=0x7fe99c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe99c06caa0 0x7fe99c06ef60 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 rx=0x7fe9a4004f10 tx=0x7fe9a400b040).stop 2024-03-12T16:27:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fc7f0 msgr2=0x7fe9b410e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fc7f0 0x7fe9b410e040 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 rx=0x7fe9a800b4b0 tx=0x7fe9a80090f0).stop 2024-03-12T16:27:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 shutdown_connections 2024-03-12T16:27:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe99c06caa0 0x7fe99c06ef60 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe9b40fc7f0 0x7fe9b410e040 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 --2- 172.21.15.6:0/1875396446 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe9b40fd150 0x7fe9b410e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 >> 172.21.15.6:0/1875396446 conn(0x7fe9b4070590 msgr2=0x7fe9b4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:52.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 shutdown_connections 2024-03-12T16:27:52.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.799+0000 7fe9b8e87700 1 -- 172.21.15.6:0/1875396446 wait complete. 2024-03-12T16:27:52.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.902+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/3269930237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 msgr2=0x7fb8ac0f8d20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.902+0000 7fb8b0ce2700 1 --2- 172.21.15.6:0/3269930237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 0x7fb8ac0f8d20 secure :-1 s=READY pgs=395 cs=0 l=1 rev1=1 rx=0x7fb89c0047f0 tx=0x7fb89c009cb0).stop 2024-03-12T16:27:52.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.902+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/3269930237 shutdown_connections 2024-03-12T16:27:52.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.902+0000 7fb8b0ce2700 1 --2- 172.21.15.6:0/3269930237 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8ac0f92a0 0x7fb8ac1019b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.902+0000 7fb8b0ce2700 1 --2- 172.21.15.6:0/3269930237 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 0x7fb8ac0f8d20 unknown :-1 s=CLOSED pgs=395 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:52.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.902+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/3269930237 >> 172.21.15.6:0/3269930237 conn(0x7fb8ac0f2430 msgr2=0x7fb8ac0f4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:52.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.902+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/3269930237 shutdown_connections 2024-03-12T16:27:52.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.902+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/3269930237 wait complete. 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8b0ce2700 1 Processor -- start 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8b0ce2700 1 -- start start 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8b0ce2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 0x7fb8ac10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8b0ce2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8ac0f92a0 0x7fb8ac10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8b0ce2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac10eb70 con 0x7fb8ac0f8940 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8b0ce2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb8ac10ecb0 con 0x7fb8ac0f92a0 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8aa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 0x7fb8ac10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8aa59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 0x7fb8ac10e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35152/0 (socket says 172.21.15.6:35152) 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8aa59c700 1 -- 172.21.15.6:0/2087370897 learned_addr learned my addr 172.21.15.6:0/2087370897 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8aa59c700 1 -- 172.21.15.6:0/2087370897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8ac0f92a0 msgr2=0x7fb8ac10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:52.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8aa59c700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8ac0f92a0 0x7fb8ac10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:27:52.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8aa59c700 1 -- 172.21.15.6:0/2087370897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb89c005040 con 0x7fb8ac0f8940 2024-03-12T16:27:52.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.903+0000 7fb8aa59c700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 0x7fb8ac10e080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fb89c009380 tx=0x7fb89c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:52.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.904+0000 7fb8a37fe700 1 -- 172.21.15.6:0/2087370897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb89c00e030 con 0x7fb8ac0f8940 2024-03-12T16:27:52.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.904+0000 7fb8a37fe700 1 -- 172.21.15.6:0/2087370897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb89c007e90 con 0x7fb8ac0f8940 2024-03-12T16:27:52.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.904+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb8ac1082e0 con 0x7fb8ac0f8940 2024-03-12T16:27:52.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.904+0000 7fb8a37fe700 1 -- 172.21.15.6:0/2087370897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb89c018070 con 0x7fb8ac0f8940 2024-03-12T16:27:52.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.904+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb8ac1087c0 con 0x7fb8ac0f8940 2024-03-12T16:27:52.905 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.905+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb8ac047540 con 0x7fb8ac0f8940 2024-03-12T16:27:52.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.905+0000 7fb8a37fe700 1 -- 172.21.15.6:0/2087370897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb89c01d420 con 0x7fb8ac0f8940 2024-03-12T16:27:52.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.905+0000 7fb8a37fe700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb89806cab0 0x7fb89806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:27:52.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.906+0000 7fb8a37fe700 1 -- 172.21.15.6:0/2087370897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb89c08d290 con 0x7fb8ac0f8940 2024-03-12T16:27:52.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.906+0000 7fb8a9d9b700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb89806cab0 0x7fb89806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:27:52.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.906+0000 7fb8a9d9b700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb89806cab0 0x7fb89806ef70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb8ac1099c0 tx=0x7fb894007b40).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:27:52.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:52.910+0000 7fb8a37fe700 1 -- 172.21.15.6:0/2087370897 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb89c05adf0 con 0x7fb8ac0f8940 2024-03-12T16:27:52.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:52 smithi134 ceph-mon[85099]: from='client.34836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:52.951 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:52 smithi134 ceph-mon[85099]: from='client.34840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:52.951 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:52 smithi134 ceph-mon[85099]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:52.951 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:52 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/405229502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:27:52.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:52 smithi006 ceph-mon[103869]: from='client.34836 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:52.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:52 smithi006 ceph-mon[103869]: from='client.34840 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:52.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:52 smithi006 ceph-mon[103869]: from='client.34844 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:52.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:52 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/405229502' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:27:53.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.194+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fb8ac109700 con 0x7fb8ac0f8940 2024-03-12T16:27:53.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.194+0000 7fb8a37fe700 1 -- 172.21.15.6:0/2087370897 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fb89c05a980 con 0x7fb8ac0f8940 2024-03-12T16:27:53.193 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:27:53.193 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:27:53.194 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:27:53.194 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:27:53.194 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:27:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb89806cab0 msgr2=0x7fb89806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb89806cab0 0x7fb89806ef70 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 rx=0x7fb8ac1099c0 tx=0x7fb894007b40).stop 2024-03-12T16:27:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 msgr2=0x7fb8ac10e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:27:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 0x7fb8ac10e080 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 rx=0x7fb89c009380 tx=0x7fb89c009cb0).stop 2024-03-12T16:27:53.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 shutdown_connections 2024-03-12T16:27:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb89806cab0 0x7fb89806ef70 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb8ac0f8940 0x7fb8ac10e080 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:27:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 --2- 172.21.15.6:0/2087370897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb8ac0f92a0 0x7fb8ac10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:27:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 >> 172.21.15.6:0/2087370897 conn(0x7fb8ac0f2430 msgr2=0x7fb8ac0fc1f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:27:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 shutdown_connections 2024-03-12T16:27:53.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:27:53.196+0000 7fb8b0ce2700 1 -- 172.21.15.6:0/2087370897 wait complete. 2024-03-12T16:27:53.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:53 smithi134 ceph-mon[85099]: pgmap v439: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:53.951 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:53 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/374318981' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:27:53.951 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:53 smithi134 ceph-mon[85099]: from='client.34856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:53.951 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:53 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2087370897' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:27:53.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:53 smithi006 ceph-mon[103869]: pgmap v439: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:53.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:53 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/374318981' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:27:53.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:53 smithi006 ceph-mon[103869]: from='client.34856 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:27:53.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:53 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2087370897' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:27:55.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:55 smithi134 ceph-mon[85099]: pgmap v440: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:55.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:55 smithi006 ceph-mon[103869]: pgmap v440: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:57.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:57 smithi134 ceph-mon[85099]: pgmap v441: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:57.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:57 smithi006 ceph-mon[103869]: pgmap v441: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:59.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:27:59 smithi134 ceph-mon[85099]: pgmap v442: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:27:59.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:27:59 smithi006 ceph-mon[103869]: pgmap v442: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:01.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:01 smithi134 ceph-mon[85099]: pgmap v443: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:01.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:01 smithi006 ceph-mon[103869]: pgmap v443: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:02.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:28:02.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:28:03.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:03 smithi134 ceph-mon[85099]: pgmap v444: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:03.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:03 smithi006 ceph-mon[103869]: pgmap v444: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:05.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:05 smithi134 ceph-mon[85099]: pgmap v445: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:05.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:05 smithi006 ceph-mon[103869]: pgmap v445: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:07.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:07 smithi134 ceph-mon[85099]: pgmap v446: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:07.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:07 smithi006 ceph-mon[103869]: pgmap v446: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:09.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:09 smithi134 ceph-mon[85099]: pgmap v447: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:09.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:09 smithi006 ceph-mon[103869]: pgmap v447: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:11.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:11 smithi134 ceph-mon[85099]: pgmap v448: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:11.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:11 smithi006 ceph-mon[103869]: pgmap v448: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:13.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:13 smithi134 ceph-mon[85099]: pgmap v449: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:13.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:13 smithi006 ceph-mon[103869]: pgmap v449: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:15.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:15 smithi134 ceph-mon[85099]: pgmap v450: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:15.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:15 smithi006 ceph-mon[103869]: pgmap v450: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:17.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:17 smithi134 ceph-mon[85099]: pgmap v451: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:17.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:28:17.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:17 smithi006 ceph-mon[103869]: pgmap v451: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:17.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:28:19.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:19 smithi134 ceph-mon[85099]: pgmap v452: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:19.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:19 smithi006 ceph-mon[103869]: pgmap v452: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:21.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:21 smithi134 ceph-mon[85099]: pgmap v453: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:21.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:21 smithi006 ceph-mon[103869]: pgmap v453: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.313+0000 7f4517c4e700 1 -- 172.21.15.6:0/29549183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fc7f0 msgr2=0x7f45100fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.313+0000 7f4517c4e700 1 --2- 172.21.15.6:0/29549183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fc7f0 0x7f45100fcbd0 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 rx=0x7f45040047f0 tx=0x7f4504009cb0).stop 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.313+0000 7f4517c4e700 1 -- 172.21.15.6:0/29549183 shutdown_connections 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.313+0000 7f4517c4e700 1 --2- 172.21.15.6:0/29549183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45100fd150 0x7f45100f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.313+0000 7f4517c4e700 1 --2- 172.21.15.6:0/29549183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fc7f0 0x7f45100fcbd0 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.313+0000 7f4517c4e700 1 -- 172.21.15.6:0/29549183 >> 172.21.15.6:0/29549183 conn(0x7f4510070590 msgr2=0x7f45100f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.313+0000 7f4517c4e700 1 -- 172.21.15.6:0/29549183 shutdown_connections 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.313+0000 7f4517c4e700 1 -- 172.21.15.6:0/29549183 wait complete. 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f4517c4e700 1 Processor -- start 2024-03-12T16:28:23.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f4517c4e700 1 -- start start 2024-03-12T16:28:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f4517c4e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45100fc7f0 0x7f4510110280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f4517c4e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fd150 0x7f4510110770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f4517c4e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4510110d70 con 0x7f45100fd150 2024-03-12T16:28:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f4517c4e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4510110eb0 con 0x7f45100fc7f0 2024-03-12T16:28:23.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f45151e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fd150 0x7f4510110770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f45151e9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fd150 0x7f4510110770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44016/0 (socket says 172.21.15.6:44016) 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f45151e9700 1 -- 172.21.15.6:0/3071125721 learned_addr learned my addr 172.21.15.6:0/3071125721 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.314+0000 7f45159ea700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45100fc7f0 0x7f4510110280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.315+0000 7f45151e9700 1 -- 172.21.15.6:0/3071125721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45100fc7f0 msgr2=0x7f4510110280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.315+0000 7f45151e9700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45100fc7f0 0x7f4510110280 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.315+0000 7f45151e9700 1 -- 172.21.15.6:0/3071125721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4504005040 con 0x7f45100fd150 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.315+0000 7f45151e9700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fd150 0x7f4510110770 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f450c00b450 tx=0x7f450c00d040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.315+0000 7f4502ffd700 1 -- 172.21.15.6:0/3071125721 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f450c010040 con 0x7f45100fd150 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.315+0000 7f4502ffd700 1 -- 172.21.15.6:0/3071125721 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f450c007d20 con 0x7f45100fd150 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.315+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f451010a590 con 0x7f45100fd150 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.315+0000 7f4502ffd700 1 -- 172.21.15.6:0/3071125721 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f450c015a70 con 0x7f45100fd150 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.315+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f451010ab50 con 0x7f45100fd150 2024-03-12T16:28:23.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.316+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f451005f590 con 0x7f45100fd150 2024-03-12T16:28:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.317+0000 7f4502ffd700 1 -- 172.21.15.6:0/3071125721 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f450c01f440 con 0x7f45100fd150 2024-03-12T16:28:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.317+0000 7f4502ffd700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44fc06caa0 0x7f44fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.317+0000 7f4502ffd700 1 -- 172.21.15.6:0/3071125721 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f450c08bea0 con 0x7f45100fd150 2024-03-12T16:28:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.317+0000 7f45159ea700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44fc06caa0 0x7f44fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:23.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.317+0000 7f45159ea700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44fc06caa0 0x7f44fc06ef60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f4504004540 tx=0x7f4504009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:23.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.322+0000 7f4502ffd700 1 -- 172.21.15.6:0/3071125721 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f450c059a00 con 0x7f45100fd150 2024-03-12T16:28:23.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.537+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f451010ad70 con 0x7f44fc06caa0 2024-03-12T16:28:23.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.539+0000 7f4502ffd700 1 -- 172.21.15.6:0/3071125721 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f451010ad70 con 0x7f44fc06caa0 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44fc06caa0 msgr2=0x7f44fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44fc06caa0 0x7f44fc06ef60 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 rx=0x7f4504004540 tx=0x7f4504009cb0).stop 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fd150 msgr2=0x7f4510110770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fd150 0x7f4510110770 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 rx=0x7f450c00b450 tx=0x7f450c00d040).stop 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 shutdown_connections 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f45100fc7f0 0x7f4510110280 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f44fc06caa0 0x7f44fc06ef60 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 --2- 172.21.15.6:0/3071125721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f45100fd150 0x7f4510110770 unknown :-1 s=CLOSED pgs=398 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 >> 172.21.15.6:0/3071125721 conn(0x7f4510070590 msgr2=0x7f45100fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 shutdown_connections 2024-03-12T16:28:23.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.541+0000 7f4517c4e700 1 -- 172.21.15.6:0/3071125721 wait complete. 2024-03-12T16:28:23.549 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:28:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.643+0000 7ffa8754f700 1 -- 172.21.15.6:0/3968636158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 msgr2=0x7ffa800f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.643+0000 7ffa8754f700 1 --2- 172.21.15.6:0/3968636158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 0x7ffa800f6930 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 rx=0x7ffa700047f0 tx=0x7ffa70009cb0).stop 2024-03-12T16:28:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.643+0000 7ffa8754f700 1 -- 172.21.15.6:0/3968636158 shutdown_connections 2024-03-12T16:28:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.643+0000 7ffa8754f700 1 --2- 172.21.15.6:0/3968636158 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 0x7ffa800f6930 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.643+0000 7ffa8754f700 1 --2- 172.21.15.6:0/3968636158 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa800fc7f0 0x7ffa800fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.643 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.643+0000 7ffa8754f700 1 -- 172.21.15.6:0/3968636158 >> 172.21.15.6:0/3968636158 conn(0x7ffa80070590 msgr2=0x7ffa800f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa8754f700 1 -- 172.21.15.6:0/3968636158 shutdown_connections 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa8754f700 1 -- 172.21.15.6:0/3968636158 wait complete. 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa8754f700 1 Processor -- start 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa8754f700 1 -- start start 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa8754f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa800fc7f0 0x7ffa80109060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa8754f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 0x7ffa80109550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa8754f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80109a90 con 0x7ffa800fd150 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa8754f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa80109bd0 con 0x7ffa800fc7f0 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa84aea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 0x7ffa80109550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa84aea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 0x7ffa80109550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44032/0 (socket says 172.21.15.6:44032) 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.644+0000 7ffa84aea700 1 -- 172.21.15.6:0/3379350766 learned_addr learned my addr 172.21.15.6:0/3379350766 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa852eb700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa800fc7f0 0x7ffa80109060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:23.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa84aea700 1 -- 172.21.15.6:0/3379350766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa800fc7f0 msgr2=0x7ffa80109060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa84aea700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa800fc7f0 0x7ffa80109060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa84aea700 1 -- 172.21.15.6:0/3379350766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa70005040 con 0x7ffa800fd150 2024-03-12T16:28:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa852eb700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa800fc7f0 0x7ffa80109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:28:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa84aea700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 0x7ffa80109550 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7ffa700099f0 tx=0x7ffa70009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa767fc700 1 -- 172.21.15.6:0/3379350766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa7000e030 con 0x7ffa800fd150 2024-03-12T16:28:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa767fc700 1 -- 172.21.15.6:0/3379350766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa70007e90 con 0x7ffa800fd150 2024-03-12T16:28:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa80109e20 con 0x7ffa800fd150 2024-03-12T16:28:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa767fc700 1 -- 172.21.15.6:0/3379350766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa70018070 con 0x7ffa800fd150 2024-03-12T16:28:23.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.645+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa801123c0 con 0x7ffa800fd150 2024-03-12T16:28:23.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.646+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa8005f590 con 0x7ffa800fd150 2024-03-12T16:28:23.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.647+0000 7ffa767fc700 1 -- 172.21.15.6:0/3379350766 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7ffa7001d420 con 0x7ffa800fd150 2024-03-12T16:28:23.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.647+0000 7ffa767fc700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa6c06caa0 0x7ffa6c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:23.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.647+0000 7ffa767fc700 1 -- 172.21.15.6:0/3379350766 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ffa7008d230 con 0x7ffa800fd150 2024-03-12T16:28:23.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.647+0000 7ffa852eb700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa6c06caa0 0x7ffa6c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:23.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.647+0000 7ffa852eb700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa6c06caa0 0x7ffa6c06ef60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7ffa7c004ba0 tx=0x7ffa7c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:23.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.652+0000 7ffa767fc700 1 -- 172.21.15.6:0/3379350766 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffa70057300 con 0x7ffa800fd150 2024-03-12T16:28:23.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.869+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa80060d90 con 0x7ffa6c06caa0 2024-03-12T16:28:23.867 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.870+0000 7ffa767fc700 1 -- 172.21.15.6:0/3379350766 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ffa80060d90 con 0x7ffa6c06caa0 2024-03-12T16:28:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa6c06caa0 msgr2=0x7ffa6c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa6c06caa0 0x7ffa6c06ef60 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 rx=0x7ffa7c004ba0 tx=0x7ffa7c009040).stop 2024-03-12T16:28:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 msgr2=0x7ffa80109550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 0x7ffa80109550 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 rx=0x7ffa700099f0 tx=0x7ffa70009cb0).stop 2024-03-12T16:28:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 shutdown_connections 2024-03-12T16:28:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa800fc7f0 0x7ffa80109060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa6c06caa0 0x7ffa6c06ef60 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.870 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 --2- 172.21.15.6:0/3379350766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa800fd150 0x7ffa80109550 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 >> 172.21.15.6:0/3379350766 conn(0x7ffa80070590 msgr2=0x7ffa800fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:23.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 shutdown_connections 2024-03-12T16:28:23.871 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.872+0000 7ffa8754f700 1 -- 172.21.15.6:0/3379350766 wait complete. 2024-03-12T16:28:23.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:23 smithi134 ceph-mon[85099]: pgmap v454: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:23.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:23 smithi006 ceph-mon[103869]: pgmap v454: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:23.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 -- 172.21.15.6:0/3985191168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 msgr2=0x7f84540fdd50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 --2- 172.21.15.6:0/3985191168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 0x7f84540fdd50 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 rx=0x7f84480047f0 tx=0x7f8448009cb0).stop 2024-03-12T16:28:23.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 -- 172.21.15.6:0/3985191168 shutdown_connections 2024-03-12T16:28:23.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 --2- 172.21.15.6:0/3985191168 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84540fe2d0 0x7f84540f7ab0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 --2- 172.21.15.6:0/3985191168 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 0x7f84540fdd50 unknown :-1 s=CLOSED pgs=401 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 -- 172.21.15.6:0/3985191168 >> 172.21.15.6:0/3985191168 conn(0x7f84540f3550 msgr2=0x7f84540f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 -- 172.21.15.6:0/3985191168 shutdown_connections 2024-03-12T16:28:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 -- 172.21.15.6:0/3985191168 wait complete. 2024-03-12T16:28:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 Processor -- start 2024-03-12T16:28:23.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.974+0000 7f845aa2d700 1 -- start start 2024-03-12T16:28:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f845aa2d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 0x7f845406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:23.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f845aa2d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84540fe2d0 0x7f845406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f845aa2d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845406bab0 con 0x7f84540fd970 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f845aa2d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f845406bbf0 con 0x7f84540fe2d0 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f8453fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 0x7f845406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f8453fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 0x7f845406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44046/0 (socket says 172.21.15.6:44046) 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f8453fff700 1 -- 172.21.15.6:0/367994856 learned_addr learned my addr 172.21.15.6:0/367994856 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f84537fe700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84540fe2d0 0x7f845406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f8453fff700 1 -- 172.21.15.6:0/367994856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84540fe2d0 msgr2=0x7f845406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f8453fff700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84540fe2d0 0x7f845406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f8453fff700 1 -- 172.21.15.6:0/367994856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8448005040 con 0x7f84540fd970 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f84537fe700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84540fe2d0 0x7f845406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f8453fff700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 0x7f845406b0d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f8448005010 tx=0x7f8448009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.975+0000 7f84517fa700 1 -- 172.21.15.6:0/367994856 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f844800e030 con 0x7f84540fd970 2024-03-12T16:28:23.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.976+0000 7f84517fa700 1 -- 172.21.15.6:0/367994856 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8448007e90 con 0x7f84540fd970 2024-03-12T16:28:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.976+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f845406be40 con 0x7f84540fd970 2024-03-12T16:28:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.976+0000 7f84517fa700 1 -- 172.21.15.6:0/367994856 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8448018070 con 0x7f84540fd970 2024-03-12T16:28:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.976+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8454114600 con 0x7f84540fd970 2024-03-12T16:28:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.977+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8454060370 con 0x7f84540fd970 2024-03-12T16:28:23.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.977+0000 7f84517fa700 1 -- 172.21.15.6:0/367994856 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f844801d6e0 con 0x7f84540fd970 2024-03-12T16:28:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.978+0000 7f84517fa700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f843c06ca30 0x7f843c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.978+0000 7f84537fe700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f843c06ca30 0x7f843c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.978+0000 7f84517fa700 1 -- 172.21.15.6:0/367994856 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f844808d040 con 0x7f84540fd970 2024-03-12T16:28:23.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.978+0000 7f84537fe700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f843c06ca30 0x7f843c06eef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f845406c870 tx=0x7f8444009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:23.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:23.982+0000 7f84517fa700 1 -- 172.21.15.6:0/367994856 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f844805aba0 con 0x7f84540fd970 2024-03-12T16:28:24.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.189+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8454059120 con 0x7f843c06ca30 2024-03-12T16:28:24.197 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.199+0000 7f84517fa700 1 -- 172.21.15.6:0/367994856 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f8454059120 con 0x7f843c06ca30 2024-03-12T16:28:24.197 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:28:24.197 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (15m) 8m ago 26m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:28:24.197 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (12m) 8m ago 26m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:28:24.197 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (12m) 8m ago 25m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:28:24.197 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (14m) 8m ago 25m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:28:24.197 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (9m) 8m ago 20m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (9m) 8m ago 20m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (8m) 8m ago 20m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (8m) 8m ago 20m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (16m) 8m ago 27m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (16m) 8m ago 25m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (14m) 8m ago 27m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (13m) 8m ago 25m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (15m) 8m ago 25m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (15m) 8m ago 25m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (12m) 8m ago 24m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (11m) 8m ago 24m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (11m) 8m ago 24m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (10m) 8m ago 23m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:28:24.198 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (10m) 8m ago 22m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:28:24.199 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (9m) 8m ago 22m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:28:24.199 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (15m) 8m ago 24m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:28:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f843c06ca30 msgr2=0x7f843c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f843c06ca30 0x7f843c06eef0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 rx=0x7f845406c870 tx=0x7f8444009d60).stop 2024-03-12T16:28:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 msgr2=0x7f845406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 0x7f845406b0d0 secure :-1 s=READY pgs=402 cs=0 l=1 rev1=1 rx=0x7f8448005010 tx=0x7f8448009cb0).stop 2024-03-12T16:28:24.199 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 shutdown_connections 2024-03-12T16:28:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f843c06ca30 0x7f843c06eef0 unknown :-1 s=CLOSED pgs=209 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f84540fd970 0x7f845406b0d0 unknown :-1 s=CLOSED pgs=402 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 --2- 172.21.15.6:0/367994856 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f84540fe2d0 0x7f845406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 >> 172.21.15.6:0/367994856 conn(0x7f84540f3550 msgr2=0x7f84540fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.201+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 shutdown_connections 2024-03-12T16:28:24.200 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.202+0000 7f845aa2d700 1 -- 172.21.15.6:0/367994856 wait complete. 2024-03-12T16:28:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.302+0000 7f96258ff700 1 -- 172.21.15.6:0/2845584766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 msgr2=0x7f96200f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.302+0000 7f96258ff700 1 --2- 172.21.15.6:0/2845584766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 0x7f96200f7a50 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 rx=0x7f96080047f0 tx=0x7f9608009cb0).stop 2024-03-12T16:28:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.302+0000 7f96258ff700 1 -- 172.21.15.6:0/2845584766 shutdown_connections 2024-03-12T16:28:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.302+0000 7f96258ff700 1 --2- 172.21.15.6:0/2845584766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 0x7f96200f7a50 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.302+0000 7f96258ff700 1 --2- 172.21.15.6:0/2845584766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96200fd910 0x7f96200fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.302+0000 7f96258ff700 1 -- 172.21.15.6:0/2845584766 >> 172.21.15.6:0/2845584766 conn(0x7f96200f3530 msgr2=0x7f96200f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.302+0000 7f96258ff700 1 -- 172.21.15.6:0/2845584766 shutdown_connections 2024-03-12T16:28:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.302+0000 7f96258ff700 1 -- 172.21.15.6:0/2845584766 wait complete. 2024-03-12T16:28:24.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f96258ff700 1 Processor -- start 2024-03-12T16:28:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f96258ff700 1 -- start start 2024-03-12T16:28:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f96258ff700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96200fd910 0x7f962010dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:24.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f96258ff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 0x7f962010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f96258ff700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962010eae0 con 0x7f96200fe270 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f96258ff700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f962010ec20 con 0x7f96200fd910 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f961e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 0x7f962010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f961e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 0x7f962010e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44068/0 (socket says 172.21.15.6:44068) 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f961e7fc700 1 -- 172.21.15.6:0/3559391833 learned_addr learned my addr 172.21.15.6:0/3559391833 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f961effd700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96200fd910 0x7f962010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f961e7fc700 1 -- 172.21.15.6:0/3559391833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96200fd910 msgr2=0x7f962010dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f961e7fc700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96200fd910 0x7f962010dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f961e7fc700 1 -- 172.21.15.6:0/3559391833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9608005040 con 0x7f96200fe270 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f961effd700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96200fd910 0x7f962010dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.303+0000 7f961e7fc700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 0x7f962010e4e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f96080099f0 tx=0x7f9608009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.304+0000 7f9617fff700 1 -- 172.21.15.6:0/3559391833 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f960800e030 con 0x7f96200fe270 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.304+0000 7f9617fff700 1 -- 172.21.15.6:0/3559391833 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9608007e90 con 0x7f96200fe270 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.304+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9620108250 con 0x7f96200fe270 2024-03-12T16:28:24.303 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.304+0000 7f9617fff700 1 -- 172.21.15.6:0/3559391833 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9608018070 con 0x7f96200fe270 2024-03-12T16:28:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.304+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f96201087b0 con 0x7f96200fe270 2024-03-12T16:28:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.305+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f962005f570 con 0x7f96200fe270 2024-03-12T16:28:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.305+0000 7f9617fff700 1 -- 172.21.15.6:0/3559391833 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9608009590 con 0x7f96200fe270 2024-03-12T16:28:24.304 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.306+0000 7f9617fff700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f960c06ca30 0x7f960c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:24.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.306+0000 7f9617fff700 1 -- 172.21.15.6:0/3559391833 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f960808d030 con 0x7f96200fe270 2024-03-12T16:28:24.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.306+0000 7f961effd700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f960c06ca30 0x7f960c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:24.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.306+0000 7f961effd700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f960c06ca30 0x7f960c06eef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f9610004c80 tx=0x7f961000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:24.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.310+0000 7f9617fff700 1 -- 172.21.15.6:0/3559391833 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f960805ab90 con 0x7f96200fe270 2024-03-12T16:28:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.593+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9620047540 con 0x7f96200fe270 2024-03-12T16:28:24.591 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.593+0000 7f9617fff700 1 -- 172.21.15.6:0/3559391833 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f960805a720 con 0x7f96200fe270 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:28:24.592 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:28:24.593 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:28:24.593 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:28:24.593 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:28:24.593 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:28:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f960c06ca30 msgr2=0x7f960c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f960c06ca30 0x7f960c06eef0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 rx=0x7f9610004c80 tx=0x7f961000b040).stop 2024-03-12T16:28:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 msgr2=0x7f962010e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 0x7f962010e4e0 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 rx=0x7f96080099f0 tx=0x7f9608009cb0).stop 2024-03-12T16:28:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 shutdown_connections 2024-03-12T16:28:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f96200fd910 0x7f962010dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f960c06ca30 0x7f960c06eef0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.594 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 --2- 172.21.15.6:0/3559391833 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f96200fe270 0x7f962010e4e0 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 >> 172.21.15.6:0/3559391833 conn(0x7f96200f3530 msgr2=0x7f96200fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 shutdown_connections 2024-03-12T16:28:24.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.596+0000 7f96258ff700 1 -- 172.21.15.6:0/3559391833 wait complete. 2024-03-12T16:28:24.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.697+0000 7fb575650700 1 -- 172.21.15.6:0/2937931182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 msgr2=0x7fb5700f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.697+0000 7fb575650700 1 --2- 172.21.15.6:0/2937931182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 0x7fb5700f7a50 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 rx=0x7fb5600047f0 tx=0x7fb560009cb0).stop 2024-03-12T16:28:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.697+0000 7fb575650700 1 -- 172.21.15.6:0/2937931182 shutdown_connections 2024-03-12T16:28:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.697+0000 7fb575650700 1 --2- 172.21.15.6:0/2937931182 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 0x7fb5700f7a50 unknown :-1 s=CLOSED pgs=405 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.697+0000 7fb575650700 1 --2- 172.21.15.6:0/2937931182 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700fd910 0x7fb5700fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.697+0000 7fb575650700 1 -- 172.21.15.6:0/2937931182 >> 172.21.15.6:0/2937931182 conn(0x7fb5700f3530 msgr2=0x7fb5700f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.697+0000 7fb575650700 1 -- 172.21.15.6:0/2937931182 shutdown_connections 2024-03-12T16:28:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.697+0000 7fb575650700 1 -- 172.21.15.6:0/2937931182 wait complete. 2024-03-12T16:28:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb575650700 1 Processor -- start 2024-03-12T16:28:24.696 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb575650700 1 -- start start 2024-03-12T16:28:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb575650700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700fd910 0x7fb57006b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb575650700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 0x7fb57006b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:24.698 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb575650700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57006bab0 con 0x7fb5700fe270 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb575650700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb57006bbf0 con 0x7fb5700fd910 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb56e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 0x7fb57006b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb56e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 0x7fb57006b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44086/0 (socket says 172.21.15.6:44086) 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb56e7fc700 1 -- 172.21.15.6:0/2207323231 learned_addr learned my addr 172.21.15.6:0/2207323231 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb56effd700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700fd910 0x7fb57006b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb56e7fc700 1 -- 172.21.15.6:0/2207323231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700fd910 msgr2=0x7fb57006b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb56e7fc700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700fd910 0x7fb57006b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb56e7fc700 1 -- 172.21.15.6:0/2207323231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb560005040 con 0x7fb5700fe270 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.698+0000 7fb56effd700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700fd910 0x7fb57006b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.699+0000 7fb56e7fc700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 0x7fb57006b5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fb560000c00 tx=0x7fb560009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.699+0000 7fb557fff700 1 -- 172.21.15.6:0/2207323231 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb56000e030 con 0x7fb5700fe270 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.699+0000 7fb557fff700 1 -- 172.21.15.6:0/2207323231 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb560007e90 con 0x7fb5700fe270 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.699+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb57006be40 con 0x7fb5700fe270 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.699+0000 7fb557fff700 1 -- 172.21.15.6:0/2207323231 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb560018070 con 0x7fb5700fe270 2024-03-12T16:28:24.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.699+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb5701145d0 con 0x7fb5700fe270 2024-03-12T16:28:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.700+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb57005f570 con 0x7fb5700fe270 2024-03-12T16:28:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.700+0000 7fb557fff700 1 -- 172.21.15.6:0/2207323231 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb56001d420 con 0x7fb5700fe270 2024-03-12T16:28:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.700+0000 7fb557fff700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb55806ca40 0x7fb55806ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.701+0000 7fb557fff700 1 -- 172.21.15.6:0/2207323231 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb56008d010 con 0x7fb5700fe270 2024-03-12T16:28:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.701+0000 7fb56effd700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb55806ca40 0x7fb55806ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:24.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.701+0000 7fb56effd700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb55806ca40 0x7fb55806ef00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb564004ca0 tx=0x7fb56400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:24.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.705+0000 7fb557fff700 1 -- 172.21.15.6:0/2207323231 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb5600570e0 con 0x7fb5700fe270 2024-03-12T16:28:24.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.948+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fb570047540 con 0x7fb5700fe270 2024-03-12T16:28:24.947 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.949+0000 7fb557fff700 1 -- 172.21.15.6:0/2207323231 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fb56005a700 con 0x7fb5700fe270 2024-03-12T16:28:24.947 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:28:24.947 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:28:24.947 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:28:24.947 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:28:24.947 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:28:24.948 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:28:24.949 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:28:24.950 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:28:24.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:28:24.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:28:24.950 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:28:24.950 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:28:24.950 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:28:24.950 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:28:24.950 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:28:24.950 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:28:24.951 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:24 smithi134 ceph-mon[85099]: from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:24.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb55806ca40 msgr2=0x7fb55806ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb55806ca40 0x7fb55806ef00 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 rx=0x7fb564004ca0 tx=0x7fb56400b040).stop 2024-03-12T16:28:24.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 msgr2=0x7fb57006b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:24.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 0x7fb57006b5c0 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 rx=0x7fb560000c00 tx=0x7fb560009cb0).stop 2024-03-12T16:28:24.951 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 shutdown_connections 2024-03-12T16:28:24.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb5700fd910 0x7fb57006b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb55806ca40 0x7fb55806ef00 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 --2- 172.21.15.6:0/2207323231 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb5700fe270 0x7fb57006b5c0 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:24.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 >> 172.21.15.6:0/2207323231 conn(0x7fb5700f3530 msgr2=0x7fb5700fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:24.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 shutdown_connections 2024-03-12T16:28:24.952 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:24.951+0000 7fb575650700 1 -- 172.21.15.6:0/2207323231 wait complete. 2024-03-12T16:28:24.952 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:28:24.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:24 smithi006 ceph-mon[103869]: from='client.34864 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.054+0000 7fbcef49a700 1 -- 172.21.15.6:0/2220020946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 msgr2=0x7fbce80fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.054+0000 7fbcef49a700 1 --2- 172.21.15.6:0/2220020946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 0x7fbce80fdcd0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 rx=0x7fbce40047f0 tx=0x7fbce4009cb0).stop 2024-03-12T16:28:25.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 -- 172.21.15.6:0/2220020946 shutdown_connections 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 --2- 172.21.15.6:0/2220020946 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce80fe250 0x7fbce80f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 --2- 172.21.15.6:0/2220020946 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 0x7fbce80fdcd0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 -- 172.21.15.6:0/2220020946 >> 172.21.15.6:0/2220020946 conn(0x7fbce80f34b0 msgr2=0x7fbce80f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 -- 172.21.15.6:0/2220020946 shutdown_connections 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 -- 172.21.15.6:0/2220020946 wait complete. 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 Processor -- start 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 -- start start 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 0x7fbce806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce80fe250 0x7fbce806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce806bab0 con 0x7fbce80fd8f0 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.055+0000 7fbcef49a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbce806bbf0 con 0x7fbce80fe250 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbced236700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 0x7fbce806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbced236700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 0x7fbce806b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44108/0 (socket says 172.21.15.6:44108) 2024-03-12T16:28:25.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbced236700 1 -- 172.21.15.6:0/3588105490 learned_addr learned my addr 172.21.15.6:0/3588105490 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbceca35700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce80fe250 0x7fbce806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbced236700 1 -- 172.21.15.6:0/3588105490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce80fe250 msgr2=0x7fbce806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbced236700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce80fe250 0x7fbce806b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbced236700 1 -- 172.21.15.6:0/3588105490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbce4005040 con 0x7fbce80fd8f0 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbced236700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 0x7fbce806b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fbce4005010 tx=0x7fbce4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbcde7fc700 1 -- 172.21.15.6:0/3588105490 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce400e030 con 0x7fbce80fd8f0 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbcde7fc700 1 -- 172.21.15.6:0/3588105490 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbce4007e90 con 0x7fbce80fd8f0 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbcde7fc700 1 -- 172.21.15.6:0/3588105490 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbce4018070 con 0x7fbce80fd8f0 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbce806be40 con 0x7fbce80fd8f0 2024-03-12T16:28:25.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.056+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbce8114610 con 0x7fbce80fd8f0 2024-03-12T16:28:25.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.057+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbce805f590 con 0x7fbce80fd8f0 2024-03-12T16:28:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.058+0000 7fbcde7fc700 1 -- 172.21.15.6:0/3588105490 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fbce401d6e0 con 0x7fbce80fd8f0 2024-03-12T16:28:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.059+0000 7fbcde7fc700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcd406ca30 0x7fbcd406eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.059+0000 7fbcde7fc700 1 -- 172.21.15.6:0/3588105490 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbce408d420 con 0x7fbce80fd8f0 2024-03-12T16:28:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.059+0000 7fbceca35700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcd406ca30 0x7fbcd406eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:25.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.059+0000 7fbceca35700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcd406ca30 0x7fbcd406eef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fbce806c870 tx=0x7fbcd8009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:25.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.063+0000 7fbcde7fc700 1 -- 172.21.15.6:0/3588105490 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbce40574f0 con 0x7fbce80fd8f0 2024-03-12T16:28:25.276 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.278+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fbce8059120 con 0x7fbcd406ca30 2024-03-12T16:28:25.278 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.280+0000 7fbcde7fc700 1 -- 172.21.15.6:0/3588105490 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fbce8059120 con 0x7fbcd406ca30 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:28:25.279 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:28:25.280 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:28:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcd406ca30 msgr2=0x7fbcd406eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcd406ca30 0x7fbcd406eef0 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 rx=0x7fbce806c870 tx=0x7fbcd8009da0).stop 2024-03-12T16:28:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 msgr2=0x7fbce806b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 0x7fbce806b0d0 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 rx=0x7fbce4005010 tx=0x7fbce4009cb0).stop 2024-03-12T16:28:25.280 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 shutdown_connections 2024-03-12T16:28:25.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbcd406ca30 0x7fbcd406eef0 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbce80fd8f0 0x7fbce806b0d0 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 --2- 172.21.15.6:0/3588105490 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbce80fe250 0x7fbce806b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 >> 172.21.15.6:0/3588105490 conn(0x7fbce80f34b0 msgr2=0x7fbce80fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:25.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 shutdown_connections 2024-03-12T16:28:25.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.282+0000 7fbcef49a700 1 -- 172.21.15.6:0/3588105490 wait complete. 2024-03-12T16:28:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.385+0000 7fe520dfb700 1 -- 172.21.15.6:0/4229396369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fd910 msgr2=0x7fe51c0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.385+0000 7fe520dfb700 1 --2- 172.21.15.6:0/4229396369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fd910 0x7fe51c0fdcf0 secure :-1 s=READY pgs=409 cs=0 l=1 rev1=1 rx=0x7fe50c0047f0 tx=0x7fe50c009cb0).stop 2024-03-12T16:28:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.385+0000 7fe520dfb700 1 -- 172.21.15.6:0/4229396369 shutdown_connections 2024-03-12T16:28:25.383 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.385+0000 7fe520dfb700 1 --2- 172.21.15.6:0/4229396369 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe51c0fe270 0x7fe51c0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.385+0000 7fe520dfb700 1 --2- 172.21.15.6:0/4229396369 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fd910 0x7fe51c0fdcf0 unknown :-1 s=CLOSED pgs=409 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.385+0000 7fe520dfb700 1 -- 172.21.15.6:0/4229396369 >> 172.21.15.6:0/4229396369 conn(0x7fe51c0f3530 msgr2=0x7fe51c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.385+0000 7fe520dfb700 1 -- 172.21.15.6:0/4229396369 shutdown_connections 2024-03-12T16:28:25.384 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.385+0000 7fe520dfb700 1 -- 172.21.15.6:0/4229396369 wait complete. 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe520dfb700 1 Processor -- start 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe520dfb700 1 -- start start 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe520dfb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe51c0fd910 0x7fe51c10e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe520dfb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fe270 0x7fe51c10e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe520dfb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c10ec20 con 0x7fe51c0fe270 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe520dfb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe51c10ed60 con 0x7fe51c0fd910 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe519d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fe270 0x7fe51c10e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe519d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fe270 0x7fe51c10e620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:44120/0 (socket says 172.21.15.6:44120) 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe519d9b700 1 -- 172.21.15.6:0/2145472513 learned_addr learned my addr 172.21.15.6:0/2145472513 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:25.386 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe51a59c700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe51c0fd910 0x7fe51c10e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe519d9b700 1 -- 172.21.15.6:0/2145472513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe51c0fd910 msgr2=0x7fe51c10e130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe519d9b700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe51c0fd910 0x7fe51c10e130 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.386+0000 7fe519d9b700 1 -- 172.21.15.6:0/2145472513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe50c005040 con 0x7fe51c0fe270 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.387+0000 7fe519d9b700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fe270 0x7fe51c10e620 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fe50400e8c0 tx=0x7fe50400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.387+0000 7fe5137fe700 1 -- 172.21.15.6:0/2145472513 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe50400ee60 con 0x7fe51c0fe270 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.387+0000 7fe5137fe700 1 -- 172.21.15.6:0/2145472513 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe50400f040 con 0x7fe51c0fe270 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.387+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe51c108390 con 0x7fe51c0fe270 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.387+0000 7fe5137fe700 1 -- 172.21.15.6:0/2145472513 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe50400c810 con 0x7fe51c0fe270 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.387+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe51c108950 con 0x7fe51c0fe270 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.388+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe51c05f570 con 0x7fe51c0fe270 2024-03-12T16:28:25.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.388+0000 7fe5137fe700 1 -- 172.21.15.6:0/2145472513 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe504007b40 con 0x7fe51c0fe270 2024-03-12T16:28:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.389+0000 7fe5137fe700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe50806cab0 0x7fe50806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.389+0000 7fe5137fe700 1 -- 172.21.15.6:0/2145472513 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe50408b910 con 0x7fe51c0fe270 2024-03-12T16:28:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.389+0000 7fe51a59c700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe50806cab0 0x7fe50806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:25.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.389+0000 7fe51a59c700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe50806cab0 0x7fe50806ef70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe50c004e60 tx=0x7fe50c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:25.391 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.393+0000 7fe5137fe700 1 -- 172.21.15.6:0/2145472513 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe504059470 con 0x7fe51c0fe270 2024-03-12T16:28:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.673+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fe51c047540 con 0x7fe51c0fe270 2024-03-12T16:28:25.671 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.673+0000 7fe5137fe700 1 -- 172.21.15.6:0/2145472513 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fe504059000 con 0x7fe51c0fe270 2024-03-12T16:28:25.671 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:28:25.672 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:28:25.672 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:28:25.672 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:28:25.672 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:28:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.675+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe50806cab0 msgr2=0x7fe50806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.675+0000 7fe520dfb700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe50806cab0 0x7fe50806ef70 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 rx=0x7fe50c004e60 tx=0x7fe50c00b040).stop 2024-03-12T16:28:25.673 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.675+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fe270 msgr2=0x7fe51c10e620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.675+0000 7fe520dfb700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fe270 0x7fe51c10e620 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 rx=0x7fe50400e8c0 tx=0x7fe50400b040).stop 2024-03-12T16:28:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.676+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 shutdown_connections 2024-03-12T16:28:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.676+0000 7fe520dfb700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe51c0fd910 0x7fe51c10e130 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.676+0000 7fe520dfb700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe50806cab0 0x7fe50806ef70 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.676+0000 7fe520dfb700 1 --2- 172.21.15.6:0/2145472513 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe51c0fe270 0x7fe51c10e620 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.676+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 >> 172.21.15.6:0/2145472513 conn(0x7fe51c0f3530 msgr2=0x7fe51c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.676+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 shutdown_connections 2024-03-12T16:28:25.674 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:25.676+0000 7fe520dfb700 1 -- 172.21.15.6:0/2145472513 wait complete. 2024-03-12T16:28:25.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:25 smithi134 ceph-mon[85099]: from='client.34868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:25.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:25 smithi134 ceph-mon[85099]: pgmap v455: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:25.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:25 smithi134 ceph-mon[85099]: from='client.34872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:25.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:25 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3559391833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:28:25.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:25 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2207323231' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:28:25.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:25 smithi006 ceph-mon[103869]: from='client.34868 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:25.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:25 smithi006 ceph-mon[103869]: pgmap v455: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:25.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:25 smithi006 ceph-mon[103869]: from='client.34872 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:25.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:25 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3559391833' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:28:25.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:25 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2207323231' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:28:26.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:26 smithi134 ceph-mon[85099]: from='client.34884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:26.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:26 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2145472513' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:28:26.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:26 smithi006 ceph-mon[103869]: from='client.34884 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:26.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:26 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2145472513' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:28:27.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:27 smithi134 ceph-mon[85099]: pgmap v456: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:27.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:27 smithi006 ceph-mon[103869]: pgmap v456: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:29.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:29 smithi134 ceph-mon[85099]: pgmap v457: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:29.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:29 smithi006 ceph-mon[103869]: pgmap v457: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:31.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:31 smithi134 ceph-mon[85099]: pgmap v458: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:31.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:31 smithi006 ceph-mon[103869]: pgmap v458: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:32.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:28:32.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:28:33.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:33 smithi134 ceph-mon[85099]: pgmap v459: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:33.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:33 smithi006 ceph-mon[103869]: pgmap v459: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:35.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:35 smithi134 ceph-mon[85099]: pgmap v460: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:35.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:35 smithi006 ceph-mon[103869]: pgmap v460: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:37.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:37 smithi134 ceph-mon[85099]: pgmap v461: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:37.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:37 smithi006 ceph-mon[103869]: pgmap v461: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:39.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:39 smithi134 ceph-mon[85099]: pgmap v462: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:39.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:39 smithi006 ceph-mon[103869]: pgmap v462: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:41.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:41 smithi134 ceph-mon[85099]: pgmap v463: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:41.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:41 smithi006 ceph-mon[103869]: pgmap v463: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:43.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:43 smithi134 ceph-mon[85099]: pgmap v464: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:43.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:43 smithi006 ceph-mon[103869]: pgmap v464: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:45.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:45 smithi134 ceph-mon[85099]: pgmap v465: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:45.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:45 smithi006 ceph-mon[103869]: pgmap v465: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:47.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:47 smithi134 ceph-mon[85099]: pgmap v466: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:47.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:28:47.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:47 smithi006 ceph-mon[103869]: pgmap v466: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:47.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:28:49.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:49 smithi134 ceph-mon[85099]: pgmap v467: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:49.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:49 smithi006 ceph-mon[103869]: pgmap v467: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:51.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:51 smithi134 ceph-mon[85099]: pgmap v468: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:51.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:51 smithi006 ceph-mon[103869]: pgmap v468: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:53.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:53 smithi134 ceph-mon[85099]: pgmap v469: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:53.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:53 smithi006 ceph-mon[103869]: pgmap v469: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:55.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.791+0000 7efca21fb700 1 -- 172.21.15.6:0/4067052407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 msgr2=0x7efc9c0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.791+0000 7efca21fb700 1 --2- 172.21.15.6:0/4067052407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 0x7efc9c0fdcd0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 rx=0x7efc900047f0 tx=0x7efc90009cb0).stop 2024-03-12T16:28:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.791+0000 7efca21fb700 1 -- 172.21.15.6:0/4067052407 shutdown_connections 2024-03-12T16:28:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.791+0000 7efca21fb700 1 --2- 172.21.15.6:0/4067052407 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9c0fe250 0x7efc9c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.791+0000 7efca21fb700 1 --2- 172.21.15.6:0/4067052407 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 0x7efc9c0fdcd0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.791+0000 7efca21fb700 1 -- 172.21.15.6:0/4067052407 >> 172.21.15.6:0/4067052407 conn(0x7efc9c0f34b0 msgr2=0x7efc9c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.791+0000 7efca21fb700 1 -- 172.21.15.6:0/4067052407 shutdown_connections 2024-03-12T16:28:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.791+0000 7efca21fb700 1 -- 172.21.15.6:0/4067052407 wait complete. 2024-03-12T16:28:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.792+0000 7efca21fb700 1 Processor -- start 2024-03-12T16:28:55.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.792+0000 7efca21fb700 1 -- start start 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.792+0000 7efca21fb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 0x7efc9c10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efca21fb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9c0fe250 0x7efc9c10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efca21fb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c10ead0 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efca21fb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efc9c10ec10 con 0x7efc9c0fe250 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc9b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 0x7efc9c10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc9b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 0x7efc9c10dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54384/0 (socket says 172.21.15.6:54384) 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc9b7fe700 1 -- 172.21.15.6:0/2284196478 learned_addr learned my addr 172.21.15.6:0/2284196478 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc9affd700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9c0fe250 0x7efc9c10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc9b7fe700 1 -- 172.21.15.6:0/2284196478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9c0fe250 msgr2=0x7efc9c10e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:55.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc9b7fe700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9c0fe250 0x7efc9c10e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc9b7fe700 1 -- 172.21.15.6:0/2284196478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efc90005040 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc9b7fe700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 0x7efc9c10dfe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7efc90005010 tx=0x7efc90009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc98ff9700 1 -- 172.21.15.6:0/2284196478 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc9000e030 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc98ff9700 1 -- 172.21.15.6:0/2284196478 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efc90007e90 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efc9c108240 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efc98ff9700 1 -- 172.21.15.6:0/2284196478 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efc90018070 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.793+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efc9c1087a0 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.794+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efc9c05f590 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.795+0000 7efc98ff9700 1 -- 172.21.15.6:0/2284196478 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7efc9001d670 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.795+0000 7efc98ff9700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efc8406caa0 0x7efc8406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.796+0000 7efc98ff9700 1 -- 172.21.15.6:0/2284196478 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7efc9008d090 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.796+0000 7efc9affd700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efc8406caa0 0x7efc8406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:55.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.796+0000 7efc9affd700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efc8406caa0 0x7efc8406ef60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7efc9c109920 tx=0x7efc8c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:55.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:55.800+0000 7efc98ff9700 1 -- 172.21.15.6:0/2284196478 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7efc9005abf0 con 0x7efc9c0fd8f0 2024-03-12T16:28:55.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:55 smithi134 ceph-mon[85099]: pgmap v470: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:55.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:55 smithi006 ceph-mon[103869]: pgmap v470: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:56.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.020+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7efc9c109700 con 0x7efc8406caa0 2024-03-12T16:28:56.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.021+0000 7efc98ff9700 1 -- 172.21.15.6:0/2284196478 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7efc9c109700 con 0x7efc8406caa0 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efc8406caa0 msgr2=0x7efc8406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efc8406caa0 0x7efc8406ef60 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 rx=0x7efc9c109920 tx=0x7efc8c00b040).stop 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 msgr2=0x7efc9c10dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 0x7efc9c10dfe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 rx=0x7efc90005010 tx=0x7efc90009cb0).stop 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 shutdown_connections 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efc8406caa0 0x7efc8406ef60 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efc9c0fd8f0 0x7efc9c10dfe0 unknown :-1 s=CLOSED pgs=412 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 --2- 172.21.15.6:0/2284196478 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efc9c0fe250 0x7efc9c10e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 >> 172.21.15.6:0/2284196478 conn(0x7efc9c0f34b0 msgr2=0x7efc9c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 shutdown_connections 2024-03-12T16:28:56.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.023+0000 7efca21fb700 1 -- 172.21.15.6:0/2284196478 wait complete. 2024-03-12T16:28:56.032 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:28:56.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.125+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/1446248061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 msgr2=0x7f2dc00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.124 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.125+0000 7f2dc6ef5700 1 --2- 172.21.15.6:0/1446248061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 0x7f2dc00f6930 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 rx=0x7f2dac0047f0 tx=0x7f2dac009cb0).stop 2024-03-12T16:28:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.125+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/1446248061 shutdown_connections 2024-03-12T16:28:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.125+0000 7f2dc6ef5700 1 --2- 172.21.15.6:0/1446248061 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 0x7f2dc00f6930 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.125+0000 7f2dc6ef5700 1 --2- 172.21.15.6:0/1446248061 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc00fc7f0 0x7f2dc00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.125+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/1446248061 >> 172.21.15.6:0/1446248061 conn(0x7f2dc0070590 msgr2=0x7f2dc00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.125+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/1446248061 shutdown_connections 2024-03-12T16:28:56.125 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.125+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/1446248061 wait complete. 2024-03-12T16:28:56.126 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.126+0000 7f2dc6ef5700 1 Processor -- start 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.126+0000 7f2dc6ef5700 1 -- start start 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dc6ef5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc00fc7f0 0x7f2dc010ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dc6ef5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 0x7f2dc010d3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dc6ef5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc010d9c0 con 0x7f2dc00fd150 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dc6ef5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2dc010db00 con 0x7f2dc00fc7f0 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 0x7f2dc010d3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 0x7f2dc010d3c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54406/0 (socket says 172.21.15.6:54406) 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbffff700 1 -- 172.21.15.6:0/2899622077 learned_addr learned my addr 172.21.15.6:0/2899622077 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dc4c91700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc00fc7f0 0x7f2dc010ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbffff700 1 -- 172.21.15.6:0/2899622077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc00fc7f0 msgr2=0x7f2dc010ced0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbffff700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc00fc7f0 0x7f2dc010ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbffff700 1 -- 172.21.15.6:0/2899622077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2dac005040 con 0x7f2dc00fd150 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbffff700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 0x7f2dc010d3c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f2dac0099f0 tx=0x7f2dac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbdffb700 1 -- 172.21.15.6:0/2899622077 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dac00e030 con 0x7f2dc00fd150 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbdffb700 1 -- 172.21.15.6:0/2899622077 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2dac007e90 con 0x7f2dc00fd150 2024-03-12T16:28:56.127 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2dc0107130 con 0x7f2dc00fd150 2024-03-12T16:28:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.127+0000 7f2dbdffb700 1 -- 172.21.15.6:0/2899622077 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2dac018070 con 0x7f2dc00fd150 2024-03-12T16:28:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.128+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2dc0107610 con 0x7f2dc00fd150 2024-03-12T16:28:56.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.128+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2dc005f590 con 0x7f2dc00fd150 2024-03-12T16:28:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.129+0000 7f2dbdffb700 1 -- 172.21.15.6:0/2899622077 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2dac009590 con 0x7f2dc00fd150 2024-03-12T16:28:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.129+0000 7f2dbdffb700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2db006caa0 0x7f2db006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.130+0000 7f2dbdffb700 1 -- 172.21.15.6:0/2899622077 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2dac08cf50 con 0x7f2dc00fd150 2024-03-12T16:28:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.130+0000 7f2dc4c91700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2db006caa0 0x7f2db006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:56.129 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.130+0000 7f2dc4c91700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2db006caa0 0x7f2db006ef60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2db4009a00 tx=0x7f2db400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:56.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.134+0000 7f2dbdffb700 1 -- 172.21.15.6:0/2899622077 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2dac0c0190 con 0x7f2dc00fd150 2024-03-12T16:28:56.348 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.349+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2dc00feb40 con 0x7f2db006caa0 2024-03-12T16:28:56.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.350+0000 7f2dbdffb700 1 -- 172.21.15.6:0/2899622077 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2dc00feb40 con 0x7f2db006caa0 2024-03-12T16:28:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2db006caa0 msgr2=0x7f2db006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2db006caa0 0x7f2db006ef60 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 rx=0x7f2db4009a00 tx=0x7f2db400b040).stop 2024-03-12T16:28:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 msgr2=0x7f2dc010d3c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 0x7f2dc010d3c0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 rx=0x7f2dac0099f0 tx=0x7f2dac009cb0).stop 2024-03-12T16:28:56.351 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 shutdown_connections 2024-03-12T16:28:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2dc00fc7f0 0x7f2dc010ced0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2db006caa0 0x7f2db006ef60 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 --2- 172.21.15.6:0/2899622077 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2dc00fd150 0x7f2dc010d3c0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 >> 172.21.15.6:0/2899622077 conn(0x7f2dc0070590 msgr2=0x7f2dc00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 shutdown_connections 2024-03-12T16:28:56.352 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.353+0000 7f2dc6ef5700 1 -- 172.21.15.6:0/2899622077 wait complete. 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.454+0000 7fa5c43f6700 1 -- 172.21.15.6:0/115768371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fd910 msgr2=0x7fa5bc0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.454+0000 7fa5c43f6700 1 --2- 172.21.15.6:0/115768371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fd910 0x7fa5bc0fdcf0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 rx=0x7fa5b80047f0 tx=0x7fa5b8009cb0).stop 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.454+0000 7fa5c43f6700 1 -- 172.21.15.6:0/115768371 shutdown_connections 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.454+0000 7fa5c43f6700 1 --2- 172.21.15.6:0/115768371 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5bc0fe270 0x7fa5bc0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.454+0000 7fa5c43f6700 1 --2- 172.21.15.6:0/115768371 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fd910 0x7fa5bc0fdcf0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.454+0000 7fa5c43f6700 1 -- 172.21.15.6:0/115768371 >> 172.21.15.6:0/115768371 conn(0x7fa5bc0f3530 msgr2=0x7fa5bc0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.454+0000 7fa5c43f6700 1 -- 172.21.15.6:0/115768371 shutdown_connections 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.454+0000 7fa5c43f6700 1 -- 172.21.15.6:0/115768371 wait complete. 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c43f6700 1 Processor -- start 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c43f6700 1 -- start start 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c43f6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5bc0fd910 0x7fa5bc10dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:56.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c43f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fe270 0x7fa5bc10e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c43f6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc10ead0 con 0x7fa5bc0fe270 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c43f6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa5bc10ec10 con 0x7fa5bc0fd910 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c1991700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fe270 0x7fa5bc10e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c1991700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fe270 0x7fa5bc10e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54414/0 (socket says 172.21.15.6:54414) 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c1991700 1 -- 172.21.15.6:0/3679489720 learned_addr learned my addr 172.21.15.6:0/3679489720 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c2192700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5bc0fd910 0x7fa5bc10dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c1991700 1 -- 172.21.15.6:0/3679489720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5bc0fd910 msgr2=0x7fa5bc10dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c1991700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5bc0fd910 0x7fa5bc10dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c1991700 1 -- 172.21.15.6:0/3679489720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa5b8005040 con 0x7fa5bc0fe270 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.455+0000 7fa5c2192700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5bc0fd910 0x7fa5bc10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.456+0000 7fa5c1991700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fe270 0x7fa5bc10e4d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa5b00044e0 tx=0x7fa5b0002b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:56.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.456+0000 7fa5af7fe700 1 -- 172.21.15.6:0/3679489720 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b0007b40 con 0x7fa5bc0fe270 2024-03-12T16:28:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.456+0000 7fa5af7fe700 1 -- 172.21.15.6:0/3679489720 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa5b000f040 con 0x7fa5bc0fe270 2024-03-12T16:28:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.456+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5bc1082a0 con 0x7fa5bc0fe270 2024-03-12T16:28:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.456+0000 7fa5af7fe700 1 -- 172.21.15.6:0/3679489720 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa5b000d830 con 0x7fa5bc0fe270 2024-03-12T16:28:56.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.456+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5bc1087e0 con 0x7fa5bc0fe270 2024-03-12T16:28:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.457+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa5bc05f570 con 0x7fa5bc0fe270 2024-03-12T16:28:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.457+0000 7fa5af7fe700 1 -- 172.21.15.6:0/3679489720 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa5b0007ca0 con 0x7fa5bc0fe270 2024-03-12T16:28:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.458+0000 7fa5af7fe700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa5a806caa0 0x7fa5a806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.458+0000 7fa5af7fe700 1 -- 172.21.15.6:0/3679489720 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa5b008b920 con 0x7fa5bc0fe270 2024-03-12T16:28:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.458+0000 7fa5c2192700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa5a806caa0 0x7fa5a806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:56.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.458+0000 7fa5c2192700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa5a806caa0 0x7fa5a806ef60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fa5b80043d0 tx=0x7fa5b800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:56.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.462+0000 7fa5af7fe700 1 -- 172.21.15.6:0/3679489720 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa5b0059480 con 0x7fa5bc0fe270 2024-03-12T16:28:56.668 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.669+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5bc108ab0 con 0x7fa5a806caa0 2024-03-12T16:28:56.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.679+0000 7fa5af7fe700 1 -- 172.21.15.6:0/3679489720 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa5bc108ab0 con 0x7fa5a806caa0 2024-03-12T16:28:56.678 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:28:56.678 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (15m) 9m ago 26m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:28:56.678 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (13m) 9m ago 26m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:28:56.678 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (13m) 9m ago 26m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:28:56.678 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (15m) 9m ago 26m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:28:56.678 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (9m) 9m ago 21m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:28:56.678 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (9m) 9m ago 21m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (9m) 9m ago 21m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (9m) 9m ago 21m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (17m) 9m ago 28m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (16m) 9m ago 26m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (14m) 9m ago 28m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (14m) 9m ago 25m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (16m) 9m ago 26m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (16m) 9m ago 25m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (13m) 9m ago 25m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (12m) 9m ago 25m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:28:56.679 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (11m) 9m ago 24m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:28:56.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (11m) 9m ago 23m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:28:56.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (10m) 9m ago 23m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:28:56.680 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (10m) 9m ago 23m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:28:56.680 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (15m) 9m ago 24m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:28:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa5a806caa0 msgr2=0x7fa5a806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.680 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa5a806caa0 0x7fa5a806ef60 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 rx=0x7fa5b80043d0 tx=0x7fa5b800b040).stop 2024-03-12T16:28:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fe270 msgr2=0x7fa5bc10e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fe270 0x7fa5bc10e4d0 secure :-1 s=READY pgs=416 cs=0 l=1 rev1=1 rx=0x7fa5b00044e0 tx=0x7fa5b0002b00).stop 2024-03-12T16:28:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 shutdown_connections 2024-03-12T16:28:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5bc0fd910 0x7fa5bc10dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa5a806caa0 0x7fa5a806ef60 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 --2- 172.21.15.6:0/3679489720 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5bc0fe270 0x7fa5bc10e4d0 unknown :-1 s=CLOSED pgs=416 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 >> 172.21.15.6:0/3679489720 conn(0x7fa5bc0f3530 msgr2=0x7fa5bc0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 shutdown_connections 2024-03-12T16:28:56.681 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.682+0000 7fa5c43f6700 1 -- 172.21.15.6:0/3679489720 wait complete. 2024-03-12T16:28:56.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.782+0000 7f514dadb700 1 -- 172.21.15.6:0/1090945144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 msgr2=0x7f51480f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.782+0000 7f514dadb700 1 --2- 172.21.15.6:0/1090945144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 0x7f51480f8c80 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 rx=0x7f51300047f0 tx=0x7f5130009cb0).stop 2024-03-12T16:28:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.782+0000 7f514dadb700 1 -- 172.21.15.6:0/1090945144 shutdown_connections 2024-03-12T16:28:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.782+0000 7f514dadb700 1 --2- 172.21.15.6:0/1090945144 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480f9200 0x7f5148101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.795 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.782+0000 7f514dadb700 1 --2- 172.21.15.6:0/1090945144 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 0x7f51480f8c80 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.782+0000 7f514dadb700 1 -- 172.21.15.6:0/1090945144 >> 172.21.15.6:0/1090945144 conn(0x7f5148070590 msgr2=0x7f51480f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.782+0000 7f514dadb700 1 -- 172.21.15.6:0/1090945144 shutdown_connections 2024-03-12T16:28:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.782+0000 7f514dadb700 1 -- 172.21.15.6:0/1090945144 wait complete. 2024-03-12T16:28:56.796 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.782+0000 7f514dadb700 1 Processor -- start 2024-03-12T16:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f514dadb700 1 -- start start 2024-03-12T16:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f514dadb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 0x7f514810e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f514dadb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480f9200 0x7f514810e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f514dadb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514810eb10 con 0x7f51480f88a0 2024-03-12T16:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f514dadb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f514810ec50 con 0x7f51480f9200 2024-03-12T16:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f51477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 0x7f514810e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f51477fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 0x7f514810e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54430/0 (socket says 172.21.15.6:54430) 2024-03-12T16:28:56.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f51477fe700 1 -- 172.21.15.6:0/3459869007 learned_addr learned my addr 172.21.15.6:0/3459869007 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f5146ffd700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480f9200 0x7f514810e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f51477fe700 1 -- 172.21.15.6:0/3459869007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480f9200 msgr2=0x7f514810e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f51477fe700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480f9200 0x7f514810e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f51477fe700 1 -- 172.21.15.6:0/3459869007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5130005040 con 0x7f51480f88a0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.783+0000 7f51477fe700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 0x7f514810e020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f5130005010 tx=0x7f5130009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.784+0000 7f5144f74700 1 -- 172.21.15.6:0/3459869007 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f513000e030 con 0x7f51480f88a0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.784+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5148108280 con 0x7f51480f88a0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.784+0000 7f5144f74700 1 -- 172.21.15.6:0/3459869007 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5130007e90 con 0x7f51480f88a0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.784+0000 7f5144f74700 1 -- 172.21.15.6:0/3459869007 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5130018070 con 0x7f51480f88a0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.784+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5148108760 con 0x7f51480f88a0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.785+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f514805f590 con 0x7f51480f88a0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.785+0000 7f5144f74700 1 -- 172.21.15.6:0/3459869007 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f513001d670 con 0x7f51480f88a0 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.786+0000 7f5144f74700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f513406caa0 0x7f513406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:56.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.786+0000 7f5146ffd700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f513406caa0 0x7f513406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.786+0000 7f5144f74700 1 -- 172.21.15.6:0/3459869007 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f513008d010 con 0x7f51480f88a0 2024-03-12T16:28:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.786+0000 7f5146ffd700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f513406caa0 0x7f513406ef60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f5148109960 tx=0x7f513800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:56.801 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:56.790+0000 7f5144f74700 1 -- 172.21.15.6:0/3459869007 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f513005ab70 con 0x7f51480f88a0 2024-03-12T16:28:57.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.072+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f51480fedd0 con 0x7f51480f88a0 2024-03-12T16:28:57.071 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.073+0000 7f5144f74700 1 -- 172.21.15.6:0/3459869007 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f513005a700 con 0x7f51480f88a0 2024-03-12T16:28:57.071 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:28:57.071 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:28:57.071 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:28:57.071 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:28:57.072 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:28:57.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f513406caa0 msgr2=0x7f513406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f513406caa0 0x7f513406ef60 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 rx=0x7f5148109960 tx=0x7f513800b040).stop 2024-03-12T16:28:57.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 msgr2=0x7f514810e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 0x7f514810e020 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 rx=0x7f5130005010 tx=0x7f5130009cb0).stop 2024-03-12T16:28:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 shutdown_connections 2024-03-12T16:28:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f513406caa0 0x7f513406ef60 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51480f88a0 0x7f514810e020 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 --2- 172.21.15.6:0/3459869007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51480f9200 0x7f514810e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 >> 172.21.15.6:0/3459869007 conn(0x7f5148070590 msgr2=0x7f51480fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 shutdown_connections 2024-03-12T16:28:57.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.075+0000 7f514dadb700 1 -- 172.21.15.6:0/3459869007 wait complete. 2024-03-12T16:28:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.176+0000 7f708475a700 1 -- 172.21.15.6:0/3081438857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fd150 msgr2=0x7f707c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.176+0000 7f708475a700 1 --2- 172.21.15.6:0/3081438857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fd150 0x7f707c0f6930 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 rx=0x7f706c0047f0 tx=0x7f706c009cb0).stop 2024-03-12T16:28:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.176+0000 7f708475a700 1 -- 172.21.15.6:0/3081438857 shutdown_connections 2024-03-12T16:28:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.176+0000 7f708475a700 1 --2- 172.21.15.6:0/3081438857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fd150 0x7f707c0f6930 unknown :-1 s=CLOSED pgs=419 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.176+0000 7f708475a700 1 --2- 172.21.15.6:0/3081438857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f707c0fc7f0 0x7f707c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.176+0000 7f708475a700 1 -- 172.21.15.6:0/3081438857 >> 172.21.15.6:0/3081438857 conn(0x7f707c070590 msgr2=0x7f707c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.176+0000 7f708475a700 1 -- 172.21.15.6:0/3081438857 shutdown_connections 2024-03-12T16:28:57.175 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.176+0000 7f708475a700 1 -- 172.21.15.6:0/3081438857 wait complete. 2024-03-12T16:28:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f708475a700 1 Processor -- start 2024-03-12T16:28:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f708475a700 1 -- start start 2024-03-12T16:28:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f708475a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fc7f0 0x7f707c0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:57.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f708475a700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f707c0fd150 0x7f707c0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f708475a700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0f8f20 con 0x7f707c0fc7f0 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f708475a700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f707c0f9060 con 0x7f707c0fd150 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f70824f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fc7f0 0x7f707c0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f70824f6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fc7f0 0x7f707c0f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54454/0 (socket says 172.21.15.6:54454) 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f70824f6700 1 -- 172.21.15.6:0/1839468511 learned_addr learned my addr 172.21.15.6:0/1839468511 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f7081cf5700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f707c0fd150 0x7f707c0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f70824f6700 1 -- 172.21.15.6:0/1839468511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f707c0fd150 msgr2=0x7f707c0f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f70824f6700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f707c0fd150 0x7f707c0f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f70824f6700 1 -- 172.21.15.6:0/1839468511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f706c005040 con 0x7f707c0fc7f0 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.177+0000 7f7081cf5700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f707c0fd150 0x7f707c0f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.178+0000 7f70824f6700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fc7f0 0x7f707c0f8540 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f707800c790 tx=0x7f7078004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.178+0000 7f70737fe700 1 -- 172.21.15.6:0/1839468511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f70780106f0 con 0x7f707c0fc7f0 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.178+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f707c0f9310 con 0x7f707c0fc7f0 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.178+0000 7f70737fe700 1 -- 172.21.15.6:0/1839468511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7078010d00 con 0x7f707c0fc7f0 2024-03-12T16:28:57.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.178+0000 7f70737fe700 1 -- 172.21.15.6:0/1839468511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7078012da0 con 0x7f707c0fc7f0 2024-03-12T16:28:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.178+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f707c1146a0 con 0x7f707c0fc7f0 2024-03-12T16:28:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.179+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f707c05f590 con 0x7f707c0fc7f0 2024-03-12T16:28:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.179+0000 7f70737fe700 1 -- 172.21.15.6:0/1839468511 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7078012400 con 0x7f707c0fc7f0 2024-03-12T16:28:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.180+0000 7f70737fe700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f706806caa0 0x7f706806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:57.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.180+0000 7f70737fe700 1 -- 172.21.15.6:0/1839468511 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f707808b690 con 0x7f707c0fc7f0 2024-03-12T16:28:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.180+0000 7f7081cf5700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f706806caa0 0x7f706806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:57.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.180+0000 7f7081cf5700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f706806caa0 0x7f706806ef60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f706c0043d0 tx=0x7f706c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:57.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.184+0000 7f70737fe700 1 -- 172.21.15.6:0/1839468511 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7078055760 con 0x7f707c0fc7f0 2024-03-12T16:28:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.427+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f707c114d10 con 0x7f707c0fc7f0 2024-03-12T16:28:57.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.427+0000 7f70737fe700 1 -- 172.21.15.6:0/1839468511 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f707805f020 con 0x7f707c0fc7f0 2024-03-12T16:28:57.426 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:28:57.426 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:28:57.426 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:28:57.427 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:28:57.428 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:28:57.429 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:28:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f706806caa0 msgr2=0x7f706806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f706806caa0 0x7f706806ef60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 rx=0x7f706c0043d0 tx=0x7f706c00b040).stop 2024-03-12T16:28:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fc7f0 msgr2=0x7f707c0f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fc7f0 0x7f707c0f8540 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 rx=0x7f707800c790 tx=0x7f7078004330).stop 2024-03-12T16:28:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 shutdown_connections 2024-03-12T16:28:57.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f706806caa0 0x7f706806ef60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f707c0fc7f0 0x7f707c0f8540 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 --2- 172.21.15.6:0/1839468511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f707c0fd150 0x7f707c0f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 >> 172.21.15.6:0/1839468511 conn(0x7f707c070590 msgr2=0x7f707c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 shutdown_connections 2024-03-12T16:28:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.429+0000 7f708475a700 1 -- 172.21.15.6:0/1839468511 wait complete. 2024-03-12T16:28:57.432 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:28:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.532+0000 7ff4a5376700 1 -- 172.21.15.6:0/68741777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 msgr2=0x7ff4a00f6920 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.532+0000 7ff4a5376700 1 --2- 172.21.15.6:0/68741777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 0x7ff4a00f6920 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 rx=0x7ff4940047f0 tx=0x7ff494009cb0).stop 2024-03-12T16:28:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.532+0000 7ff4a5376700 1 -- 172.21.15.6:0/68741777 shutdown_connections 2024-03-12T16:28:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.532+0000 7ff4a5376700 1 --2- 172.21.15.6:0/68741777 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 0x7ff4a00f6920 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.532+0000 7ff4a5376700 1 --2- 172.21.15.6:0/68741777 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4a00fc7e0 0x7ff4a00fcbc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.532+0000 7ff4a5376700 1 -- 172.21.15.6:0/68741777 >> 172.21.15.6:0/68741777 conn(0x7ff4a00f23c0 msgr2=0x7ff4a00f47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.532+0000 7ff4a5376700 1 -- 172.21.15.6:0/68741777 shutdown_connections 2024-03-12T16:28:57.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.532+0000 7ff4a5376700 1 -- 172.21.15.6:0/68741777 wait complete. 2024-03-12T16:28:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.533+0000 7ff4a5376700 1 Processor -- start 2024-03-12T16:28:57.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.533+0000 7ff4a5376700 1 -- start start 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.533+0000 7ff4a5376700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4a00fc7e0 0x7ff4a010e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.533+0000 7ff4a5376700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 0x7ff4a010e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.533+0000 7ff4a5376700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a010eb30 con 0x7ff4a00fd140 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.533+0000 7ff4a5376700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff4a010ec70 con 0x7ff4a00fc7e0 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.533+0000 7ff49e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 0x7ff4a010e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.533+0000 7ff49e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 0x7ff4a010e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54476/0 (socket says 172.21.15.6:54476) 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.533+0000 7ff49e7fc700 1 -- 172.21.15.6:0/3823202754 learned_addr learned my addr 172.21.15.6:0/3823202754 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff49effd700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4a00fc7e0 0x7ff4a010e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff49e7fc700 1 -- 172.21.15.6:0/3823202754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4a00fc7e0 msgr2=0x7ff4a010e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff49e7fc700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4a00fc7e0 0x7ff4a010e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff49e7fc700 1 -- 172.21.15.6:0/3823202754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff494005040 con 0x7ff4a00fd140 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff49effd700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4a00fc7e0 0x7ff4a010e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:28:57.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff49e7fc700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 0x7ff4a010e530 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7ff4940099f0 tx=0x7ff494009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff487fff700 1 -- 172.21.15.6:0/3823202754 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff49400e030 con 0x7ff4a00fd140 2024-03-12T16:28:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff487fff700 1 -- 172.21.15.6:0/3823202754 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff494007e90 con 0x7ff4a00fd140 2024-03-12T16:28:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff4a01082a0 con 0x7ff4a00fd140 2024-03-12T16:28:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff487fff700 1 -- 172.21.15.6:0/3823202754 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff494018070 con 0x7ff4a00fd140 2024-03-12T16:28:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.534+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff4a0108780 con 0x7ff4a00fd140 2024-03-12T16:28:57.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.535+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff4a0060370 con 0x7ff4a00fd140 2024-03-12T16:28:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.536+0000 7ff487fff700 1 -- 172.21.15.6:0/3823202754 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7ff494009590 con 0x7ff4a00fd140 2024-03-12T16:28:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.536+0000 7ff487fff700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff48806caa0 0x7ff48806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.536+0000 7ff487fff700 1 -- 172.21.15.6:0/3823202754 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff49408cf50 con 0x7ff4a00fd140 2024-03-12T16:28:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.536+0000 7ff49effd700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff48806caa0 0x7ff48806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:57.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.537+0000 7ff49effd700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff48806caa0 0x7ff48806ef60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7ff490004c80 tx=0x7ff49000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:57.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.541+0000 7ff487fff700 1 -- 172.21.15.6:0/3823202754 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff4940c0190 con 0x7ff4a00fd140 2024-03-12T16:28:57.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.757+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ff4a0108e10 con 0x7ff48806caa0 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.758+0000 7ff487fff700 1 -- 172.21.15.6:0/3823202754 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ff4a0108e10 con 0x7ff48806caa0 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:28:57.757 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:28:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:28:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:28:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:28:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:28:57.758 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:28:57.758 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:28:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff48806caa0 msgr2=0x7ff48806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff48806caa0 0x7ff48806ef60 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 rx=0x7ff490004c80 tx=0x7ff49000b040).stop 2024-03-12T16:28:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 msgr2=0x7ff4a010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 0x7ff4a010e530 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 rx=0x7ff4940099f0 tx=0x7ff494009cb0).stop 2024-03-12T16:28:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 shutdown_connections 2024-03-12T16:28:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff4a00fc7e0 0x7ff4a010e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff48806caa0 0x7ff48806ef60 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 --2- 172.21.15.6:0/3823202754 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff4a00fd140 0x7ff4a010e530 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 >> 172.21.15.6:0/3823202754 conn(0x7ff4a00f23c0 msgr2=0x7ff4a0061380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 shutdown_connections 2024-03-12T16:28:57.760 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.760+0000 7ff4a5376700 1 -- 172.21.15.6:0/3823202754 wait complete. 2024-03-12T16:28:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 -- 172.21.15.6:0/3037990390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 msgr2=0x7ff9b00f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 --2- 172.21.15.6:0/3037990390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 0x7ff9b00f5f80 secure :-1 s=READY pgs=423 cs=0 l=1 rev1=1 rx=0x7ff99c0047f0 tx=0x7ff99c009cb0).stop 2024-03-12T16:28:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 -- 172.21.15.6:0/3037990390 shutdown_connections 2024-03-12T16:28:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 --2- 172.21.15.6:0/3037990390 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 0x7ff9b00f5f80 unknown :-1 s=CLOSED pgs=423 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 --2- 172.21.15.6:0/3037990390 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b00fd8b0 0x7ff9b00fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 -- 172.21.15.6:0/3037990390 >> 172.21.15.6:0/3037990390 conn(0x7ff9b006ce40 msgr2=0x7ff9b006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 -- 172.21.15.6:0/3037990390 shutdown_connections 2024-03-12T16:28:57.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 -- 172.21.15.6:0/3037990390 wait complete. 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 Processor -- start 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.862+0000 7ff9b6a7b700 1 -- start start 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9b6a7b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b00fd8b0 0x7ff9b010e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9b6a7b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 0x7ff9b010e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9b6a7b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b010eb20 con 0x7ff9b00fe210 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9b6a7b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff9b010ec60 con 0x7ff9b00fd8b0 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 0x7ff9b010e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9affff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 0x7ff9b010e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:54488/0 (socket says 172.21.15.6:54488) 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9affff700 1 -- 172.21.15.6:0/361668761 learned_addr learned my addr 172.21.15.6:0/361668761 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9b4817700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b00fd8b0 0x7ff9b010e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9affff700 1 -- 172.21.15.6:0/361668761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b00fd8b0 msgr2=0x7ff9b010e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9affff700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b00fd8b0 0x7ff9b010e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9affff700 1 -- 172.21.15.6:0/361668761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff99c005040 con 0x7ff9b00fe210 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9affff700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 0x7ff9b010e520 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff99c005010 tx=0x7ff99c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:57.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9adf76700 1 -- 172.21.15.6:0/361668761 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff99c00e030 con 0x7ff9b00fe210 2024-03-12T16:28:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9b6a7b700 1 -- 172.21.15.6:0/361668761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff9b0108290 con 0x7ff9b00fe210 2024-03-12T16:28:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9adf76700 1 -- 172.21.15.6:0/361668761 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff99c007e90 con 0x7ff9b00fe210 2024-03-12T16:28:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.863+0000 7ff9adf76700 1 -- 172.21.15.6:0/361668761 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff99c018070 con 0x7ff9b00fe210 2024-03-12T16:28:57.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.864+0000 7ff9b6a7b700 1 -- 172.21.15.6:0/361668761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff9b0108770 con 0x7ff9b00fe210 2024-03-12T16:28:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.865+0000 7ff99b7fe700 1 -- 172.21.15.6:0/361668761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff990005120 con 0x7ff9b00fe210 2024-03-12T16:28:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.865+0000 7ff9adf76700 1 -- 172.21.15.6:0/361668761 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7ff99c01d6e0 con 0x7ff9b00fe210 2024-03-12T16:28:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.865+0000 7ff9adf76700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff9a006ca30 0x7ff9a006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:28:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.866+0000 7ff9adf76700 1 -- 172.21.15.6:0/361668761 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff99c08d040 con 0x7ff9b00fe210 2024-03-12T16:28:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.866+0000 7ff9b4817700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff9a006ca30 0x7ff9a006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:28:57.866 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.866+0000 7ff9b4817700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff9a006ca30 0x7ff9a006eef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7ff9a4009170 tx=0x7ff9a4009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:28:57.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:57.870+0000 7ff9adf76700 1 -- 172.21.15.6:0/361668761 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff99c05aba0 con 0x7ff9b00fe210 2024-03-12T16:28:57.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:57 smithi134 ceph-mon[85099]: pgmap v471: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:57.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:57 smithi134 ceph-mon[85099]: from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:57.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:57 smithi134 ceph-mon[85099]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:57.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:57 smithi134 ceph-mon[85099]: from='client.34900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:57.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:57 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3459869007' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:28:57.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:57 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1839468511' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:28:57.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:57 smithi006 ceph-mon[103869]: pgmap v471: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:57.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:57 smithi006 ceph-mon[103869]: from='client.34892 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:57.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:57 smithi006 ceph-mon[103869]: from='client.34896 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:57.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:57 smithi006 ceph-mon[103869]: from='client.34900 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:57.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:57 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3459869007' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:28:57.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:57 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1839468511' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:28:58.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.149+0000 7ff99b7fe700 1 -- 172.21.15.6:0/361668761 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7ff9900057f0 con 0x7ff9b00fe210 2024-03-12T16:28:58.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.150+0000 7ff9adf76700 1 -- 172.21.15.6:0/361668761 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7ff99c05a730 con 0x7ff9b00fe210 2024-03-12T16:28:58.149 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:28:58.149 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:28:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:28:58.149 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:28:58.149 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:28:58.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 -- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff9a006ca30 msgr2=0x7ff9a006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff9a006ca30 0x7ff9a006eef0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 rx=0x7ff9a4009170 tx=0x7ff9a4009da0).stop 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 -- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 msgr2=0x7ff9b010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 0x7ff9b010e520 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 rx=0x7ff99c005010 tx=0x7ff99c009cb0).stop 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 -- 172.21.15.6:0/361668761 shutdown_connections 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff9b00fd8b0 0x7ff9b010e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff9a006ca30 0x7ff9a006eef0 unknown :-1 s=CLOSED pgs=220 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 --2- 172.21.15.6:0/361668761 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff9b00fe210 0x7ff9b010e520 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 -- 172.21.15.6:0/361668761 >> 172.21.15.6:0/361668761 conn(0x7ff9b006ce40 msgr2=0x7ff9b0100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 -- 172.21.15.6:0/361668761 shutdown_connections 2024-03-12T16:28:58.151 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:28:58.152+0000 7ff99b7fe700 1 -- 172.21.15.6:0/361668761 wait complete. 2024-03-12T16:28:58.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:58 smithi134 ceph-mon[85099]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:58.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:58 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/361668761' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:28:58.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:58 smithi006 ceph-mon[103869]: from='client.34912 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:28:58.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:58 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/361668761' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:28:59.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:28:59 smithi134 ceph-mon[85099]: pgmap v472: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:28:59.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:28:59 smithi006 ceph-mon[103869]: pgmap v472: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:01.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:01 smithi134 ceph-mon[85099]: pgmap v473: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:01.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:01 smithi006 ceph-mon[103869]: pgmap v473: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:02.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:29:02.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:29:03.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:03 smithi134 ceph-mon[85099]: pgmap v474: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:03.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:03 smithi006 ceph-mon[103869]: pgmap v474: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:05.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:05 smithi134 ceph-mon[85099]: pgmap v475: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:05.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:05 smithi006 ceph-mon[103869]: pgmap v475: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:07.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:07 smithi134 ceph-mon[85099]: pgmap v476: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:07.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:07 smithi006 ceph-mon[103869]: pgmap v476: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:09.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:09 smithi134 ceph-mon[85099]: pgmap v477: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:09.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:09 smithi006 ceph-mon[103869]: pgmap v477: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:11.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:11 smithi134 ceph-mon[85099]: pgmap v478: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:11.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:11 smithi006 ceph-mon[103869]: pgmap v478: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:13.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:13 smithi134 ceph-mon[85099]: pgmap v479: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:13.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:13 smithi006 ceph-mon[103869]: pgmap v479: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:15.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:15 smithi134 ceph-mon[85099]: pgmap v480: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:15.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:15 smithi006 ceph-mon[103869]: pgmap v480: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:17.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:17 smithi134 ceph-mon[85099]: pgmap v481: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:17.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:29:17.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:17 smithi006 ceph-mon[103869]: pgmap v481: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:17.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:29:19.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:19 smithi134 ceph-mon[85099]: pgmap v482: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:19.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:19 smithi006 ceph-mon[103869]: pgmap v482: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:21.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:21 smithi134 ceph-mon[85099]: pgmap v483: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:21.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:21 smithi006 ceph-mon[103869]: pgmap v483: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:23.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:23 smithi134 ceph-mon[85099]: pgmap v484: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:23.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:23 smithi006 ceph-mon[103869]: pgmap v484: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:25.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:25 smithi134 ceph-mon[85099]: pgmap v485: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:25.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:25 smithi006 ceph-mon[103869]: pgmap v485: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:27.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:27 smithi134 ceph-mon[85099]: pgmap v486: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:27.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:27 smithi006 ceph-mon[103869]: pgmap v486: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:28.266 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.268+0000 7f142797b700 1 -- 172.21.15.6:0/3502325162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fd150 msgr2=0x7f14200f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.268+0000 7f142797b700 1 --2- 172.21.15.6:0/3502325162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fd150 0x7f14200f6930 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 rx=0x7f14100047f0 tx=0x7f1410009cb0).stop 2024-03-12T16:29:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.268+0000 7f142797b700 1 -- 172.21.15.6:0/3502325162 shutdown_connections 2024-03-12T16:29:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.268+0000 7f142797b700 1 --2- 172.21.15.6:0/3502325162 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fd150 0x7f14200f6930 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.268+0000 7f142797b700 1 --2- 172.21.15.6:0/3502325162 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14200fc7f0 0x7f14200fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.268+0000 7f142797b700 1 -- 172.21.15.6:0/3502325162 >> 172.21.15.6:0/3502325162 conn(0x7f1420070590 msgr2=0x7f14200f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.268+0000 7f142797b700 1 -- 172.21.15.6:0/3502325162 shutdown_connections 2024-03-12T16:29:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.268+0000 7f142797b700 1 -- 172.21.15.6:0/3502325162 wait complete. 2024-03-12T16:29:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.268+0000 7f142797b700 1 Processor -- start 2024-03-12T16:29:28.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f142797b700 1 -- start start 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f142797b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fc7f0 0x7f142010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f142797b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14200fd150 0x7f142010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f142797b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142010eab0 con 0x7f14200fc7f0 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f142797b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f142010ebf0 con 0x7f14200fd150 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f1425717700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fc7f0 0x7f142010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f1425717700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fc7f0 0x7f142010dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52868/0 (socket says 172.21.15.6:52868) 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f1425717700 1 -- 172.21.15.6:0/1903330723 learned_addr learned my addr 172.21.15.6:0/1903330723 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f1424f16700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14200fd150 0x7f142010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f1425717700 1 -- 172.21.15.6:0/1903330723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14200fd150 msgr2=0x7f142010e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f1425717700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14200fd150 0x7f142010e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f1425717700 1 -- 172.21.15.6:0/1903330723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1410005040 con 0x7f14200fc7f0 2024-03-12T16:29:28.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f1425717700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fc7f0 0x7f142010dfc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f141c0041d0 tx=0x7f141c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:28.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.269+0000 7f14167fc700 1 -- 172.21.15.6:0/1903330723 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c002d90 con 0x7f14200fc7f0 2024-03-12T16:29:28.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.270+0000 7f14167fc700 1 -- 172.21.15.6:0/1903330723 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f141c00f040 con 0x7f14200fc7f0 2024-03-12T16:29:28.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.270+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1420108280 con 0x7f14200fc7f0 2024-03-12T16:29:28.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.270+0000 7f14167fc700 1 -- 172.21.15.6:0/1903330723 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f141c00d800 con 0x7f14200fc7f0 2024-03-12T16:29:28.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.270+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1420108840 con 0x7f14200fc7f0 2024-03-12T16:29:28.270 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.270+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f142005f590 con 0x7f14200fc7f0 2024-03-12T16:29:28.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.271+0000 7f14167fc700 1 -- 172.21.15.6:0/1903330723 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f141c007b40 con 0x7f14200fc7f0 2024-03-12T16:29:28.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.272+0000 7f14167fc700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f140c06caa0 0x7f140c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:28.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.272+0000 7f14167fc700 1 -- 172.21.15.6:0/1903330723 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f141c08c080 con 0x7f14200fc7f0 2024-03-12T16:29:28.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.272+0000 7f1424f16700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f140c06caa0 0x7f140c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:28.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.272+0000 7f1424f16700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f140c06caa0 0x7f140c06ef60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1410000c00 tx=0x7f141000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:28.274 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.276+0000 7f14167fc700 1 -- 172.21.15.6:0/1903330723 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f141c059c60 con 0x7f14200fc7f0 2024-03-12T16:29:28.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.491+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1420109640 con 0x7f140c06caa0 2024-03-12T16:29:28.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.492+0000 7f14167fc700 1 -- 172.21.15.6:0/1903330723 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1420109640 con 0x7f140c06caa0 2024-03-12T16:29:28.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f140c06caa0 msgr2=0x7f140c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f140c06caa0 0x7f140c06ef60 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 rx=0x7f1410000c00 tx=0x7f141000b040).stop 2024-03-12T16:29:28.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fc7f0 msgr2=0x7f142010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fc7f0 0x7f142010dfc0 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 rx=0x7f141c0041d0 tx=0x7f141c009f60).stop 2024-03-12T16:29:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 shutdown_connections 2024-03-12T16:29:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f140c06caa0 0x7f140c06ef60 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14200fc7f0 0x7f142010dfc0 unknown :-1 s=CLOSED pgs=426 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 --2- 172.21.15.6:0/1903330723 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14200fd150 0x7f142010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 >> 172.21.15.6:0/1903330723 conn(0x7f1420070590 msgr2=0x7f1420060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 shutdown_connections 2024-03-12T16:29:28.493 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.494+0000 7f142797b700 1 -- 172.21.15.6:0/1903330723 wait complete. 2024-03-12T16:29:28.502 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:29:28.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.597+0000 7ffa2b39e700 1 -- 172.21.15.6:0/2137376881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fe020 msgr2=0x7ffa240f7800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.597+0000 7ffa2b39e700 1 --2- 172.21.15.6:0/2137376881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fe020 0x7ffa240f7800 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 rx=0x7ffa200047f0 tx=0x7ffa20009cb0).stop 2024-03-12T16:29:28.595 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.597+0000 7ffa2b39e700 1 -- 172.21.15.6:0/2137376881 shutdown_connections 2024-03-12T16:29:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.597+0000 7ffa2b39e700 1 --2- 172.21.15.6:0/2137376881 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fe020 0x7ffa240f7800 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.597+0000 7ffa2b39e700 1 --2- 172.21.15.6:0/2137376881 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa240fd6c0 0x7ffa240fdaa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.597+0000 7ffa2b39e700 1 -- 172.21.15.6:0/2137376881 >> 172.21.15.6:0/2137376881 conn(0x7ffa240f3280 msgr2=0x7ffa240f56a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.597+0000 7ffa2b39e700 1 -- 172.21.15.6:0/2137376881 shutdown_connections 2024-03-12T16:29:28.596 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.597+0000 7ffa2b39e700 1 -- 172.21.15.6:0/2137376881 wait complete. 2024-03-12T16:29:28.597 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2b39e700 1 Processor -- start 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2b39e700 1 -- start start 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2b39e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fd6c0 0x7ffa2406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2b39e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa240fe020 0x7ffa2406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2b39e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2406bb70 con 0x7ffa240fd6c0 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2b39e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffa2406bcb0 con 0x7ffa240fe020 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2a39c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fd6c0 0x7ffa2406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2a39c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fd6c0 0x7ffa2406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52876/0 (socket says 172.21.15.6:52876) 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2a39c700 1 -- 172.21.15.6:0/3239611486 learned_addr learned my addr 172.21.15.6:0/3239611486 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa29b9b700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa240fe020 0x7ffa2406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2a39c700 1 -- 172.21.15.6:0/3239611486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa240fe020 msgr2=0x7ffa2406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2a39c700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa240fe020 0x7ffa2406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa2a39c700 1 -- 172.21.15.6:0/3239611486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffa20005040 con 0x7ffa240fd6c0 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.598+0000 7ffa29b9b700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa240fe020 0x7ffa2406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:29:28.598 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.599+0000 7ffa2a39c700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fd6c0 0x7ffa2406b0d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7ffa14002700 tx=0x7ffa14009f10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.599+0000 7ffa1b7fe700 1 -- 172.21.15.6:0/3239611486 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa14007ae0 con 0x7ffa240fd6c0 2024-03-12T16:29:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.599+0000 7ffa1b7fe700 1 -- 172.21.15.6:0/3239611486 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffa1400f040 con 0x7ffa240fd6c0 2024-03-12T16:29:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.599+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffa241141f0 con 0x7ffa240fd6c0 2024-03-12T16:29:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.599+0000 7ffa1b7fe700 1 -- 172.21.15.6:0/3239611486 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffa140147d0 con 0x7ffa240fd6c0 2024-03-12T16:29:28.599 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.599+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffa24114670 con 0x7ffa240fd6c0 2024-03-12T16:29:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.600+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffa2405f2f0 con 0x7ffa240fd6c0 2024-03-12T16:29:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.600+0000 7ffa1b7fe700 1 -- 172.21.15.6:0/3239611486 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7ffa14009110 con 0x7ffa240fd6c0 2024-03-12T16:29:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.601+0000 7ffa1b7fe700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa1006caa0 0x7ffa1006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.601+0000 7ffa1b7fe700 1 -- 172.21.15.6:0/3239611486 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ffa1408bd40 con 0x7ffa240fd6c0 2024-03-12T16:29:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.601+0000 7ffa29b9b700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa1006caa0 0x7ffa1006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:28.600 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.601+0000 7ffa29b9b700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa1006caa0 0x7ffa1006ef60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7ffa2406ca80 tx=0x7ffa2000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:28.603 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.605+0000 7ffa1b7fe700 1 -- 172.21.15.6:0/3239611486 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffa14055e10 con 0x7ffa240fd6c0 2024-03-12T16:29:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.828+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7ffa2406c880 con 0x7ffa1006caa0 2024-03-12T16:29:28.827 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.830+0000 7ffa1b7fe700 1 -- 172.21.15.6:0/3239611486 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7ffa2406c880 con 0x7ffa1006caa0 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.831+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa1006caa0 msgr2=0x7ffa1006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.831+0000 7ffa2b39e700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa1006caa0 0x7ffa1006ef60 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 rx=0x7ffa2406ca80 tx=0x7ffa2000b040).stop 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.832+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fd6c0 msgr2=0x7ffa2406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.832+0000 7ffa2b39e700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fd6c0 0x7ffa2406b0d0 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 rx=0x7ffa14002700 tx=0x7ffa14009f10).stop 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.832+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 shutdown_connections 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.832+0000 7ffa2b39e700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffa1006caa0 0x7ffa1006ef60 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.832+0000 7ffa2b39e700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffa240fd6c0 0x7ffa2406b0d0 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.832+0000 7ffa2b39e700 1 --2- 172.21.15.6:0/3239611486 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffa240fe020 0x7ffa2406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.832+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 >> 172.21.15.6:0/3239611486 conn(0x7ffa240f3280 msgr2=0x7ffa240fba80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:28.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.832+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 shutdown_connections 2024-03-12T16:29:28.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.832+0000 7ffa2b39e700 1 -- 172.21.15.6:0/3239611486 wait complete. 2024-03-12T16:29:28.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.933+0000 7f1468036700 1 -- 172.21.15.6:0/992492825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 msgr2=0x7f14600fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.933+0000 7f1468036700 1 --2- 172.21.15.6:0/992492825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 0x7f14600fdcd0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 rx=0x7f145c0047f0 tx=0x7f145c009cb0).stop 2024-03-12T16:29:28.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.933+0000 7f1468036700 1 -- 172.21.15.6:0/992492825 shutdown_connections 2024-03-12T16:29:28.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.933+0000 7f1468036700 1 --2- 172.21.15.6:0/992492825 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14600fe250 0x7f14600f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.933+0000 7f1468036700 1 --2- 172.21.15.6:0/992492825 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 0x7f14600fdcd0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.933+0000 7f1468036700 1 -- 172.21.15.6:0/992492825 >> 172.21.15.6:0/992492825 conn(0x7f14600f34b0 msgr2=0x7f14600f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:28.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.933+0000 7f1468036700 1 -- 172.21.15.6:0/992492825 shutdown_connections 2024-03-12T16:29:28.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.933+0000 7f1468036700 1 -- 172.21.15.6:0/992492825 wait complete. 2024-03-12T16:29:28.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1468036700 1 Processor -- start 2024-03-12T16:29:28.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1468036700 1 -- start start 2024-03-12T16:29:28.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1468036700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 0x7f146010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:28.933 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1468036700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14600fe250 0x7f146010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1468036700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146010ead0 con 0x7f14600fd8f0 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1468036700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f146010ec10 con 0x7f14600fe250 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1465dd2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 0x7f146010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1465dd2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 0x7f146010dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52896/0 (socket says 172.21.15.6:52896) 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1465dd2700 1 -- 172.21.15.6:0/4000361175 learned_addr learned my addr 172.21.15.6:0/4000361175 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1465dd2700 1 -- 172.21.15.6:0/4000361175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14600fe250 msgr2=0x7f146010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f14655d1700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14600fe250 0x7f146010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1465dd2700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14600fe250 0x7f146010e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1465dd2700 1 -- 172.21.15.6:0/4000361175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f145c005040 con 0x7f14600fd8f0 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.934+0000 7f1465dd2700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 0x7f146010dfe0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f145c005010 tx=0x7f145c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.935+0000 7f1456ffd700 1 -- 172.21.15.6:0/4000361175 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f145c00e030 con 0x7f14600fd8f0 2024-03-12T16:29:28.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.935+0000 7f1456ffd700 1 -- 172.21.15.6:0/4000361175 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f145c007e90 con 0x7f14600fd8f0 2024-03-12T16:29:28.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.935+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1460108240 con 0x7f14600fd8f0 2024-03-12T16:29:28.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.935+0000 7f1456ffd700 1 -- 172.21.15.6:0/4000361175 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f145c018070 con 0x7f14600fd8f0 2024-03-12T16:29:28.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.935+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f14601087a0 con 0x7f14600fd8f0 2024-03-12T16:29:28.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.936+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f146005f590 con 0x7f14600fd8f0 2024-03-12T16:29:28.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.936+0000 7f1456ffd700 1 -- 172.21.15.6:0/4000361175 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f145c01d6e0 con 0x7f14600fd8f0 2024-03-12T16:29:28.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.936+0000 7f1456ffd700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f144c06caa0 0x7f144c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:28.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.937+0000 7f1456ffd700 1 -- 172.21.15.6:0/4000361175 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f145c08cfa0 con 0x7f14600fd8f0 2024-03-12T16:29:28.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.937+0000 7f14655d1700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f144c06caa0 0x7f144c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:28.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.937+0000 7f14655d1700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f144c06caa0 0x7f144c06ef60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f1460109920 tx=0x7f145000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:28.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:28.941+0000 7f1456ffd700 1 -- 172.21.15.6:0/4000361175 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f145c05abc0 con 0x7f14600fd8f0 2024-03-12T16:29:29.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.150+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f14600ffc40 con 0x7f144c06caa0 2024-03-12T16:29:29.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.160+0000 7f1456ffd700 1 -- 172.21.15.6:0/4000361175 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f14600ffc40 con 0x7f144c06caa0 2024-03-12T16:29:29.158 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:29:29.158 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (16m) 10m ago 27m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:29:29.158 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (14m) 10m ago 27m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (13m) 9m ago 26m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (15m) 10m ago 26m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (10m) 10m ago 22m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (10m) 10m ago 21m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (9m) 9m ago 22m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (9m) 9m ago 21m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (17m) 10m ago 28m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (17m) 9m ago 26m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (15m) 10m ago 28m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (14m) 9m ago 26m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (16m) 10m ago 26m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (16m) 9m ago 26m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (13m) 10m ago 25m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (13m) 10m ago 25m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:29:29.159 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (12m) 10m ago 25m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:29:29.160 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (11m) 9m ago 24m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:29:29.160 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (11m) 9m ago 24m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:29:29.160 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (10m) 9m ago 23m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:29:29.160 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (16m) 9m ago 25m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:29:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f144c06caa0 msgr2=0x7f144c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f144c06caa0 0x7f144c06ef60 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 rx=0x7f1460109920 tx=0x7f145000b040).stop 2024-03-12T16:29:29.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 msgr2=0x7f146010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 0x7f146010dfe0 secure :-1 s=READY pgs=430 cs=0 l=1 rev1=1 rx=0x7f145c005010 tx=0x7f145c009cb0).stop 2024-03-12T16:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 shutdown_connections 2024-03-12T16:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f144c06caa0 0x7f144c06ef60 unknown :-1 s=CLOSED pgs=223 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f14600fd8f0 0x7f146010dfe0 unknown :-1 s=CLOSED pgs=430 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 --2- 172.21.15.6:0/4000361175 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f14600fe250 0x7f146010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 >> 172.21.15.6:0/4000361175 conn(0x7f14600f34b0 msgr2=0x7f14600fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 shutdown_connections 2024-03-12T16:29:29.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.162+0000 7f1468036700 1 -- 172.21.15.6:0/4000361175 wait complete. 2024-03-12T16:29:29.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.262+0000 7f95f13b7700 1 -- 172.21.15.6:0/1169502163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 msgr2=0x7f95ec0f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.262+0000 7f95f13b7700 1 --2- 172.21.15.6:0/1169502163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 0x7f95ec0f6940 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 rx=0x7f95e00047f0 tx=0x7f95e0009cb0).stop 2024-03-12T16:29:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.262+0000 7f95f13b7700 1 -- 172.21.15.6:0/1169502163 shutdown_connections 2024-03-12T16:29:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.262+0000 7f95f13b7700 1 --2- 172.21.15.6:0/1169502163 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 0x7f95ec0f6940 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.262+0000 7f95f13b7700 1 --2- 172.21.15.6:0/1169502163 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec0fc800 0x7f95ec0fcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.262+0000 7f95f13b7700 1 -- 172.21.15.6:0/1169502163 >> 172.21.15.6:0/1169502163 conn(0x7f95ec0f23c0 msgr2=0x7f95ec0f47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.262+0000 7f95f13b7700 1 -- 172.21.15.6:0/1169502163 shutdown_connections 2024-03-12T16:29:29.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.262+0000 7f95f13b7700 1 -- 172.21.15.6:0/1169502163 wait complete. 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.263+0000 7f95f13b7700 1 Processor -- start 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.263+0000 7f95f13b7700 1 -- start start 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.263+0000 7f95f13b7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec0fc800 0x7f95ec10cf60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.263+0000 7f95f13b7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 0x7f95ec10d450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.263+0000 7f95f13b7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec10da50 con 0x7f95ec0fd160 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.263+0000 7f95f13b7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f95ec10db90 con 0x7f95ec0fc800 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 0x7f95ec10d450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 0x7f95ec10d450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52914/0 (socket says 172.21.15.6:52914) 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95ea7fc700 1 -- 172.21.15.6:0/794020752 learned_addr learned my addr 172.21.15.6:0/794020752 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95eaffd700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec0fc800 0x7f95ec10cf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95ea7fc700 1 -- 172.21.15.6:0/794020752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec0fc800 msgr2=0x7f95ec10cf60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95ea7fc700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec0fc800 0x7f95ec10cf60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.263 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95ea7fc700 1 -- 172.21.15.6:0/794020752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f95e0005040 con 0x7f95ec0fd160 2024-03-12T16:29:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95ea7fc700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 0x7f95ec10d450 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f95e00099f0 tx=0x7f95e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95d3fff700 1 -- 172.21.15.6:0/794020752 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e000e030 con 0x7f95ec0fd160 2024-03-12T16:29:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95d3fff700 1 -- 172.21.15.6:0/794020752 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f95e0007e90 con 0x7f95ec0fd160 2024-03-12T16:29:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f95ec1071c0 con 0x7f95ec0fd160 2024-03-12T16:29:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95d3fff700 1 -- 172.21.15.6:0/794020752 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f95e0018070 con 0x7f95ec0fd160 2024-03-12T16:29:29.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.264+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f95ec1076a0 con 0x7f95ec0fd160 2024-03-12T16:29:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.265+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f95ec060370 con 0x7f95ec0fd160 2024-03-12T16:29:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.266+0000 7f95d3fff700 1 -- 172.21.15.6:0/794020752 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f95e001d420 con 0x7f95ec0fd160 2024-03-12T16:29:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.266+0000 7f95d3fff700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95d406caa0 0x7f95d406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.266+0000 7f95d3fff700 1 -- 172.21.15.6:0/794020752 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f95e008d0a0 con 0x7f95ec0fd160 2024-03-12T16:29:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.266+0000 7f95eaffd700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95d406caa0 0x7f95d406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:29.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.267+0000 7f95eaffd700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95d406caa0 0x7f95d406ef60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f95dc0041d0 tx=0x7f95dc009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:29.269 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.271+0000 7f95d3fff700 1 -- 172.21.15.6:0/794020752 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f95e005ac00 con 0x7f95ec0fd160 2024-03-12T16:29:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.553+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f95ec108610 con 0x7f95ec0fd160 2024-03-12T16:29:29.552 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.554+0000 7f95d3fff700 1 -- 172.21.15.6:0/794020752 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f95e005a790 con 0x7f95ec0fd160 2024-03-12T16:29:29.552 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:29:29.552 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:29:29.553 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:29:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95d406caa0 msgr2=0x7f95d406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95d406caa0 0x7f95d406ef60 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 rx=0x7f95dc0041d0 tx=0x7f95dc009040).stop 2024-03-12T16:29:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 msgr2=0x7f95ec10d450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.554 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 0x7f95ec10d450 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 rx=0x7f95e00099f0 tx=0x7f95e0009cb0).stop 2024-03-12T16:29:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 shutdown_connections 2024-03-12T16:29:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f95ec0fc800 0x7f95ec10cf60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f95d406caa0 0x7f95d406ef60 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 --2- 172.21.15.6:0/794020752 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f95ec0fd160 0x7f95ec10d450 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 >> 172.21.15.6:0/794020752 conn(0x7f95ec0f23c0 msgr2=0x7f95ec0fabc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 shutdown_connections 2024-03-12T16:29:29.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.556+0000 7f95f13b7700 1 -- 172.21.15.6:0/794020752 wait complete. 2024-03-12T16:29:29.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.658+0000 7f488cc6b700 1 -- 172.21.15.6:0/4104142412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 msgr2=0x7f48880fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.658+0000 7f488cc6b700 1 --2- 172.21.15.6:0/4104142412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 0x7f48880fdcd0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 rx=0x7f48780047f0 tx=0x7f4878009cb0).stop 2024-03-12T16:29:29.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.658+0000 7f488cc6b700 1 -- 172.21.15.6:0/4104142412 shutdown_connections 2024-03-12T16:29:29.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.658+0000 7f488cc6b700 1 --2- 172.21.15.6:0/4104142412 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fe250 0x7f48880f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.658+0000 7f488cc6b700 1 --2- 172.21.15.6:0/4104142412 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 0x7f48880fdcd0 unknown :-1 s=CLOSED pgs=433 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.658+0000 7f488cc6b700 1 -- 172.21.15.6:0/4104142412 >> 172.21.15.6:0/4104142412 conn(0x7f48880f34b0 msgr2=0x7f48880f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:29.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.658+0000 7f488cc6b700 1 -- 172.21.15.6:0/4104142412 shutdown_connections 2024-03-12T16:29:29.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.658+0000 7f488cc6b700 1 -- 172.21.15.6:0/4104142412 wait complete. 2024-03-12T16:29:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488cc6b700 1 Processor -- start 2024-03-12T16:29:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488cc6b700 1 -- start start 2024-03-12T16:29:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488cc6b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 0x7f488810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:29.658 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488cc6b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fe250 0x7f488810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488cc6b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488810ead0 con 0x7f48880fd8f0 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488cc6b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f488810ec10 con 0x7f48880fe250 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 0x7f488810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488659c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 0x7f488810dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52922/0 (socket says 172.21.15.6:52922) 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488659c700 1 -- 172.21.15.6:0/3275382700 learned_addr learned my addr 172.21.15.6:0/3275382700 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488659c700 1 -- 172.21.15.6:0/3275382700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fe250 msgr2=0x7f488810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488659c700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fe250 0x7f488810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.659+0000 7f488659c700 1 -- 172.21.15.6:0/3275382700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4878005040 con 0x7f48880fd8f0 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.660+0000 7f488659c700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 0x7f488810dfe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f48780043a0 tx=0x7f4878009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.660+0000 7f487f7fe700 1 -- 172.21.15.6:0/3275382700 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f487800e030 con 0x7f48880fd8f0 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.660+0000 7f487f7fe700 1 -- 172.21.15.6:0/3275382700 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4878007e90 con 0x7f48880fd8f0 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.660+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4888108240 con 0x7f48880fd8f0 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.660+0000 7f487f7fe700 1 -- 172.21.15.6:0/3275382700 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4878018070 con 0x7f48880fd8f0 2024-03-12T16:29:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.660+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f48881087a0 con 0x7f48880fd8f0 2024-03-12T16:29:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.661+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f488805f590 con 0x7f48880fd8f0 2024-03-12T16:29:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.662+0000 7f487f7fe700 1 -- 172.21.15.6:0/3275382700 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f4878009590 con 0x7f48880fd8f0 2024-03-12T16:29:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.662+0000 7f487f7fe700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f487406ca40 0x7f487406ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:29.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.662+0000 7f487f7fe700 1 -- 172.21.15.6:0/3275382700 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f487808d3f0 con 0x7f48880fd8f0 2024-03-12T16:29:29.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.662+0000 7f4885d9b700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f487406ca40 0x7f487406ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:29.661 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.663+0000 7f4885d9b700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f487406ca40 0x7f487406ef00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4888109920 tx=0x7f4870009b60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:29.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.666+0000 7f487f7fe700 1 -- 172.21.15.6:0/3275382700 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f487805af50 con 0x7f48880fd8f0 2024-03-12T16:29:29.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.908+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f48880ffc40 con 0x7f48880fd8f0 2024-03-12T16:29:29.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.908+0000 7f487f7fe700 1 -- 172.21.15.6:0/3275382700 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f487805aae0 con 0x7f48880fd8f0 2024-03-12T16:29:29.907 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:29:29.907 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:29:29.907 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:29:29.907 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:29:29.907 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:29:29.907 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:29:29.908 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:29:29.909 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:29:29.910 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:29:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:29:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:29:29.910 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:29:29.910 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:29:29.910 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:29:29.910 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:29:29.910 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:29:29.910 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:29:29.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f487406ca40 msgr2=0x7f487406ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f487406ca40 0x7f487406ef00 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 rx=0x7f4888109920 tx=0x7f4870009b60).stop 2024-03-12T16:29:29.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 msgr2=0x7f488810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:29.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 0x7f488810dfe0 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 rx=0x7f48780043a0 tx=0x7f4878009cb0).stop 2024-03-12T16:29:29.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 shutdown_connections 2024-03-12T16:29:29.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f487406ca40 0x7f487406ef00 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f48880fd8f0 0x7f488810dfe0 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:29.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 --2- 172.21.15.6:0/3275382700 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f48880fe250 0x7f488810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:29:29.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 >> 172.21.15.6:0/3275382700 conn(0x7f48880f34b0 msgr2=0x7f48880fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:29.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.910+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 shutdown_connections 2024-03-12T16:29:29.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:29.911+0000 7f488cc6b700 1 -- 172.21.15.6:0/3275382700 wait complete. 2024-03-12T16:29:29.912 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:29:29.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:29 smithi134 ceph-mon[85099]: pgmap v487: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:29.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:29 smithi134 ceph-mon[85099]: from='client.34920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:29:29.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:29 smithi134 ceph-mon[85099]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:29:29.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:29 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/794020752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:29:29.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:29 smithi006 ceph-mon[103869]: pgmap v487: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:29.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:29 smithi006 ceph-mon[103869]: from='client.34920 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:29:29.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:29 smithi006 ceph-mon[103869]: from='client.34924 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:29:29.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:29 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/794020752' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:29:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.013+0000 7fdb988e1700 1 -- 172.21.15.6:0/446657270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 msgr2=0x7fdb940f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.013+0000 7fdb988e1700 1 --2- 172.21.15.6:0/446657270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 0x7fdb940f7a30 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 rx=0x7fdb7c0047f0 tx=0x7fdb7c009cb0).stop 2024-03-12T16:29:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.013+0000 7fdb988e1700 1 -- 172.21.15.6:0/446657270 shutdown_connections 2024-03-12T16:29:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.013+0000 7fdb988e1700 1 --2- 172.21.15.6:0/446657270 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 0x7fdb940f7a30 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.013+0000 7fdb988e1700 1 --2- 172.21.15.6:0/446657270 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940fd8f0 0x7fdb940fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.013+0000 7fdb988e1700 1 -- 172.21.15.6:0/446657270 >> 172.21.15.6:0/446657270 conn(0x7fdb940f34b0 msgr2=0x7fdb940f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.013+0000 7fdb988e1700 1 -- 172.21.15.6:0/446657270 shutdown_connections 2024-03-12T16:29:30.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.013+0000 7fdb988e1700 1 -- 172.21.15.6:0/446657270 wait complete. 2024-03-12T16:29:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb988e1700 1 Processor -- start 2024-03-12T16:29:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb988e1700 1 -- start start 2024-03-12T16:29:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb988e1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940fd8f0 0x7fdb9406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb988e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 0x7fdb9406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb988e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9406bab0 con 0x7fdb940fe250 2024-03-12T16:29:30.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb988e1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdb9406bbf0 con 0x7fdb940fd8f0 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb91d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 0x7fdb9406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb91d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 0x7fdb9406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52946/0 (socket says 172.21.15.6:52946) 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb91d9b700 1 -- 172.21.15.6:0/3454562562 learned_addr learned my addr 172.21.15.6:0/3454562562 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb9259c700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940fd8f0 0x7fdb9406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb91d9b700 1 -- 172.21.15.6:0/3454562562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940fd8f0 msgr2=0x7fdb9406b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb91d9b700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940fd8f0 0x7fdb9406b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.014+0000 7fdb91d9b700 1 -- 172.21.15.6:0/3454562562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdb7c005040 con 0x7fdb940fe250 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.015+0000 7fdb91d9b700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 0x7fdb9406b5c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fdb7c0099f0 tx=0x7fdb7c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.015+0000 7fdb8b7fe700 1 -- 172.21.15.6:0/3454562562 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb7c00e030 con 0x7fdb940fe250 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.015+0000 7fdb8b7fe700 1 -- 172.21.15.6:0/3454562562 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdb7c007e90 con 0x7fdb940fe250 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.015+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdb9406be40 con 0x7fdb940fe250 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.015+0000 7fdb8b7fe700 1 -- 172.21.15.6:0/3454562562 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdb7c018070 con 0x7fdb940fe250 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.015+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdb94114690 con 0x7fdb940fe250 2024-03-12T16:29:30.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.016+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdb9405f590 con 0x7fdb940fe250 2024-03-12T16:29:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.016+0000 7fdb8b7fe700 1 -- 172.21.15.6:0/3454562562 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fdb7c01d420 con 0x7fdb940fe250 2024-03-12T16:29:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.017+0000 7fdb8b7fe700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdb8006caa0 0x7fdb8006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.017+0000 7fdb9259c700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdb8006caa0 0x7fdb8006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.017+0000 7fdb8b7fe700 1 -- 172.21.15.6:0/3454562562 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdb7c08d1b0 con 0x7fdb940fe250 2024-03-12T16:29:30.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.017+0000 7fdb9259c700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdb8006caa0 0x7fdb8006ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fdb84004b60 tx=0x7fdb84009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:30.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.021+0000 7fdb8b7fe700 1 -- 172.21.15.6:0/3454562562 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdb7c057280 con 0x7fdb940fe250 2024-03-12T16:29:30.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.238+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fdb9406c6c0 con 0x7fdb8006caa0 2024-03-12T16:29:30.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.239+0000 7fdb8b7fe700 1 -- 172.21.15.6:0/3454562562 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fdb9406c6c0 con 0x7fdb8006caa0 2024-03-12T16:29:30.237 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:29:30.238 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:29:30.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdb8006caa0 msgr2=0x7fdb8006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdb8006caa0 0x7fdb8006ef60 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 rx=0x7fdb84004b60 tx=0x7fdb84009040).stop 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 msgr2=0x7fdb9406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 0x7fdb9406b5c0 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 rx=0x7fdb7c0099f0 tx=0x7fdb7c009cb0).stop 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 shutdown_connections 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdb940fd8f0 0x7fdb9406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdb8006caa0 0x7fdb8006ef60 unknown :-1 s=CLOSED pgs=226 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 --2- 172.21.15.6:0/3454562562 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdb940fe250 0x7fdb9406b5c0 unknown :-1 s=CLOSED pgs=436 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 >> 172.21.15.6:0/3454562562 conn(0x7fdb940f34b0 msgr2=0x7fdb940fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 shutdown_connections 2024-03-12T16:29:30.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.241+0000 7fdb988e1700 1 -- 172.21.15.6:0/3454562562 wait complete. 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.343+0000 7f21d6648700 1 -- 172.21.15.6:0/2330125845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fc7f0 msgr2=0x7f21d00fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.343+0000 7f21d6648700 1 --2- 172.21.15.6:0/2330125845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fc7f0 0x7f21d00fcbd0 secure :-1 s=READY pgs=437 cs=0 l=1 rev1=1 rx=0x7f21c00047f0 tx=0x7f21c0009cb0).stop 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.343+0000 7f21d6648700 1 -- 172.21.15.6:0/2330125845 shutdown_connections 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.343+0000 7f21d6648700 1 --2- 172.21.15.6:0/2330125845 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00fd150 0x7f21d00f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.343+0000 7f21d6648700 1 --2- 172.21.15.6:0/2330125845 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fc7f0 0x7f21d00fcbd0 unknown :-1 s=CLOSED pgs=437 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.343+0000 7f21d6648700 1 -- 172.21.15.6:0/2330125845 >> 172.21.15.6:0/2330125845 conn(0x7f21d0070590 msgr2=0x7f21d00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.343+0000 7f21d6648700 1 -- 172.21.15.6:0/2330125845 shutdown_connections 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.343+0000 7f21d6648700 1 -- 172.21.15.6:0/2330125845 wait complete. 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21d6648700 1 Processor -- start 2024-03-12T16:29:30.342 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21d6648700 1 -- start start 2024-03-12T16:29:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21d6648700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00fc7f0 0x7f21d0101d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21d6648700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fd150 0x7f21d0102220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21d6648700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0102710 con 0x7f21d00fd150 2024-03-12T16:29:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21d6648700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21d0102850 con 0x7f21d00fc7f0 2024-03-12T16:29:30.345 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fd150 0x7f21d0102220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21cf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fd150 0x7f21d0102220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:52952/0 (socket says 172.21.15.6:52952) 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21cf7fe700 1 -- 172.21.15.6:0/2861666101 learned_addr learned my addr 172.21.15.6:0/2861666101 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21cffff700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00fc7f0 0x7f21d0101d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21cf7fe700 1 -- 172.21.15.6:0/2861666101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00fc7f0 msgr2=0x7f21d0101d30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21cf7fe700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00fc7f0 0x7f21d0101d30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21cf7fe700 1 -- 172.21.15.6:0/2861666101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21c0005040 con 0x7f21d00fd150 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.344+0000 7f21cffff700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00fc7f0 0x7f21d0101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.345+0000 7f21cf7fe700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fd150 0x7f21d0102220 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f21c4002780 tx=0x7f21c4009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.345+0000 7f21cd7fa700 1 -- 172.21.15.6:0/2861666101 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c4007b40 con 0x7f21d00fd150 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.345+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21d0102b00 con 0x7f21d00fd150 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.345+0000 7f21cd7fa700 1 -- 172.21.15.6:0/2861666101 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f21c400f040 con 0x7f21d00fd150 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.345+0000 7f21cd7fa700 1 -- 172.21.15.6:0/2861666101 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21c4014780 con 0x7f21d00fd150 2024-03-12T16:29:30.346 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.345+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21d01146e0 con 0x7f21d00fd150 2024-03-12T16:29:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.346+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21d005f590 con 0x7f21d00fd150 2024-03-12T16:29:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.347+0000 7f21cd7fa700 1 -- 172.21.15.6:0/2861666101 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f21c4007ca0 con 0x7f21d00fd150 2024-03-12T16:29:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.347+0000 7f21cd7fa700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f21b806caa0 0x7f21b806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:29:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.347+0000 7f21cd7fa700 1 -- 172.21.15.6:0/2861666101 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f21c408c000 con 0x7f21d00fd150 2024-03-12T16:29:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.347+0000 7f21cffff700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f21b806caa0 0x7f21b806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:29:30.347 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.347+0000 7f21cffff700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f21b806caa0 0x7f21b806ef60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f21c00043d0 tx=0x7f21c000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:29:30.349 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.351+0000 7f21cd7fa700 1 -- 172.21.15.6:0/2861666101 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f21c40560d0 con 0x7f21d00fd150 2024-03-12T16:29:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.630+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f21d0047540 con 0x7f21d00fd150 2024-03-12T16:29:30.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.630+0000 7f21cd7fa700 1 -- 172.21.15.6:0/2861666101 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f21c40596f0 con 0x7f21d00fd150 2024-03-12T16:29:30.629 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:29:30.630 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:29:30.630 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:29:30.630 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:29:30.630 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:29:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f21b806caa0 msgr2=0x7f21b806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f21b806caa0 0x7f21b806ef60 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 rx=0x7f21c00043d0 tx=0x7f21c000b040).stop 2024-03-12T16:29:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fd150 msgr2=0x7f21d0102220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:29:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fd150 0x7f21d0102220 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 rx=0x7f21c4002780 tx=0x7f21c4009ee0).stop 2024-03-12T16:29:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 shutdown_connections 2024-03-12T16:29:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21d00fc7f0 0x7f21d0101d30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f21b806caa0 0x7f21b806ef60 unknown :-1 s=CLOSED pgs=227 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 --2- 172.21.15.6:0/2861666101 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21d00fd150 0x7f21d0102220 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:29:30.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 >> 172.21.15.6:0/2861666101 conn(0x7f21d0070590 msgr2=0x7f21d00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:29:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 shutdown_connections 2024-03-12T16:29:30.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:29:30.633+0000 7f21d6648700 1 -- 172.21.15.6:0/2861666101 wait complete. 2024-03-12T16:29:30.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:30 smithi134 ceph-mon[85099]: from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:29:30.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:30 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3275382700' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:29:30.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:30 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2861666101' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:29:30.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:30 smithi006 ceph-mon[103869]: from='client.34928 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:29:30.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:30 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3275382700' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:29:30.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:30 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2861666101' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:29:31.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:31 smithi134 ceph-mon[85099]: pgmap v488: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:31.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:31 smithi134 ceph-mon[85099]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:29:31.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:31 smithi006 ceph-mon[103869]: pgmap v488: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:31.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:31 smithi006 ceph-mon[103869]: from='client.34940 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:29:32.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:29:32.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:29:33.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:33 smithi134 ceph-mon[85099]: pgmap v489: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:33.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:33 smithi006 ceph-mon[103869]: pgmap v489: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:35.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:35 smithi134 ceph-mon[85099]: pgmap v490: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:35.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:35 smithi006 ceph-mon[103869]: pgmap v490: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:37.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:37 smithi134 ceph-mon[85099]: pgmap v491: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:37.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:37 smithi006 ceph-mon[103869]: pgmap v491: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:39.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:39 smithi134 ceph-mon[85099]: pgmap v492: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:39.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:39 smithi006 ceph-mon[103869]: pgmap v492: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:41.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:41 smithi134 ceph-mon[85099]: pgmap v493: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:41.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:41 smithi006 ceph-mon[103869]: pgmap v493: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:43.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:43 smithi134 ceph-mon[85099]: pgmap v494: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:43.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:43 smithi006 ceph-mon[103869]: pgmap v494: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:45.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:45 smithi134 ceph-mon[85099]: pgmap v495: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:45.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:45 smithi006 ceph-mon[103869]: pgmap v495: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:47.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:47 smithi134 ceph-mon[85099]: pgmap v496: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:47.986 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:29:47.987 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:47 smithi006 ceph-mon[103869]: pgmap v496: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:47.987 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:29:49.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:49 smithi134 ceph-mon[85099]: pgmap v497: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:49.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:49 smithi006 ceph-mon[103869]: pgmap v497: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:51.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:51 smithi134 ceph-mon[85099]: pgmap v498: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:51.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:51 smithi006 ceph-mon[103869]: pgmap v498: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:53.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:53 smithi134 ceph-mon[85099]: pgmap v499: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:53.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:53 smithi006 ceph-mon[103869]: pgmap v499: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:55.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:55 smithi134 ceph-mon[85099]: pgmap v500: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:55.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:55 smithi006 ceph-mon[103869]: pgmap v500: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:57.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:57 smithi134 ceph-mon[85099]: pgmap v501: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:57.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:57 smithi006 ceph-mon[103869]: pgmap v501: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:59.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:29:59 smithi134 ceph-mon[85099]: pgmap v502: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:29:59.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:29:59 smithi006 ceph-mon[103869]: pgmap v502: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:00.453 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:00 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[103846]: 2024-03-12T16:29:59.999+0000 7f02e60e0700 -1 log_channel(cluster) log [ERR] : overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:30:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.752+0000 7f29a975f700 1 -- 172.21.15.6:0/3485770911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fe2d0 msgr2=0x7f29a40f7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.752+0000 7f29a975f700 1 --2- 172.21.15.6:0/3485770911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fe2d0 0x7f29a40f7ab0 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 rx=0x7f29980047f0 tx=0x7f2998009cb0).stop 2024-03-12T16:30:00.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.752+0000 7f29a975f700 1 -- 172.21.15.6:0/3485770911 shutdown_connections 2024-03-12T16:30:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.752+0000 7f29a975f700 1 --2- 172.21.15.6:0/3485770911 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fe2d0 0x7f29a40f7ab0 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.752+0000 7f29a975f700 1 --2- 172.21.15.6:0/3485770911 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a40fd970 0x7f29a40fdd50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.752+0000 7f29a975f700 1 -- 172.21.15.6:0/3485770911 >> 172.21.15.6:0/3485770911 conn(0x7f29a40f3550 msgr2=0x7f29a40f5970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.752+0000 7f29a975f700 1 -- 172.21.15.6:0/3485770911 shutdown_connections 2024-03-12T16:30:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.752+0000 7f29a975f700 1 -- 172.21.15.6:0/3485770911 wait complete. 2024-03-12T16:30:00.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.752+0000 7f29a975f700 1 Processor -- start 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a975f700 1 -- start start 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a975f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fd970 0x7f29a410e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a975f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a40fe2d0 0x7f29a410e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a975f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a410eb50 con 0x7f29a40fd970 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a975f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f29a410ec90 con 0x7f29a40fe2d0 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fd970 0x7f29a410e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a2ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fd970 0x7f29a410e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50178/0 (socket says 172.21.15.6:50178) 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a2ffd700 1 -- 172.21.15.6:0/32195585 learned_addr learned my addr 172.21.15.6:0/32195585 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a27fc700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a40fe2d0 0x7f29a410e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:00.752 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a2ffd700 1 -- 172.21.15.6:0/32195585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a40fe2d0 msgr2=0x7f29a410e550 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:00.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a2ffd700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a40fe2d0 0x7f29a410e550 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:00.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.753+0000 7f29a2ffd700 1 -- 172.21.15.6:0/32195585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2998005040 con 0x7f29a40fd970 2024-03-12T16:30:00.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.754+0000 7f29a2ffd700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fd970 0x7f29a410e060 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f299400c790 tx=0x7f2994004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:00.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.754+0000 7f298bfff700 1 -- 172.21.15.6:0/32195585 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f299400e680 con 0x7f29a40fd970 2024-03-12T16:30:00.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.754+0000 7f298bfff700 1 -- 172.21.15.6:0/32195585 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f299400ec90 con 0x7f29a40fd970 2024-03-12T16:30:00.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.754+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f29a4108320 con 0x7f29a40fd970 2024-03-12T16:30:00.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.754+0000 7f298bfff700 1 -- 172.21.15.6:0/32195585 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2994012d60 con 0x7f29a40fd970 2024-03-12T16:30:00.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.754+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f29a4108860 con 0x7f29a40fd970 2024-03-12T16:30:00.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.755+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f29a4060370 con 0x7f29a40fd970 2024-03-12T16:30:00.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.755+0000 7f298bfff700 1 -- 172.21.15.6:0/32195585 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2994012400 con 0x7f29a40fd970 2024-03-12T16:30:00.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.756+0000 7f298bfff700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f298c06caa0 0x7f298c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:00.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.756+0000 7f298bfff700 1 -- 172.21.15.6:0/32195585 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f299408b580 con 0x7f29a40fd970 2024-03-12T16:30:00.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.756+0000 7f29a27fc700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f298c06caa0 0x7f298c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:00.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.756+0000 7f29a27fc700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f298c06caa0 0x7f298c06ef60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f29a41099a0 tx=0x7f299800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:00.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.761+0000 7f298bfff700 1 -- 172.21.15.6:0/32195585 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f29940590e0 con 0x7f29a40fd970 2024-03-12T16:30:00.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:00 smithi134 ceph-mon[85099]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:30:00.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:00 smithi006 ceph-mon[103869]: overall HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:30:00.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.978+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f29a4108ad0 con 0x7f298c06caa0 2024-03-12T16:30:00.976 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.980+0000 7f298bfff700 1 -- 172.21.15.6:0/32195585 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f29a4108ad0 con 0x7f298c06caa0 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f298c06caa0 msgr2=0x7f298c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f298c06caa0 0x7f298c06ef60 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 rx=0x7f29a41099a0 tx=0x7f299800b040).stop 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fd970 msgr2=0x7f29a410e060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fd970 0x7f29a410e060 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 rx=0x7f299400c790 tx=0x7f2994004330).stop 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 shutdown_connections 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f298c06caa0 0x7f298c06ef60 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f29a40fd970 0x7f29a410e060 unknown :-1 s=CLOSED pgs=440 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 --2- 172.21.15.6:0/32195585 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f29a40fe2d0 0x7f29a410e550 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 >> 172.21.15.6:0/32195585 conn(0x7f29a40f3550 msgr2=0x7f29a40fbd30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 shutdown_connections 2024-03-12T16:30:00.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:00.982+0000 7f29a975f700 1 -- 172.21.15.6:0/32195585 wait complete. 2024-03-12T16:30:00.989 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:30:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.084+0000 7f7113e02700 1 -- 172.21.15.6:0/1852000681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fc7f0 msgr2=0x7f710c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.084+0000 7f7113e02700 1 --2- 172.21.15.6:0/1852000681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fc7f0 0x7f710c0fcbd0 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 rx=0x7f71080047f0 tx=0x7f7108009cb0).stop 2024-03-12T16:30:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.084+0000 7f7113e02700 1 -- 172.21.15.6:0/1852000681 shutdown_connections 2024-03-12T16:30:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.084+0000 7f7113e02700 1 --2- 172.21.15.6:0/1852000681 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f710c0fd150 0x7f710c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:30:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.084+0000 7f7113e02700 1 --2- 172.21.15.6:0/1852000681 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fc7f0 0x7f710c0fcbd0 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.084+0000 7f7113e02700 1 -- 172.21.15.6:0/1852000681 >> 172.21.15.6:0/1852000681 conn(0x7f710c070590 msgr2=0x7f710c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.084+0000 7f7113e02700 1 -- 172.21.15.6:0/1852000681 shutdown_connections 2024-03-12T16:30:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.084+0000 7f7113e02700 1 -- 172.21.15.6:0/1852000681 wait complete. 2024-03-12T16:30:01.082 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.085+0000 7f7113e02700 1 Processor -- start 2024-03-12T16:30:01.083 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.085+0000 7f7113e02700 1 -- start start 2024-03-12T16:30:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.085+0000 7f7113e02700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f710c0fc7f0 0x7f710c10e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.085+0000 7f7113e02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fd150 0x7f710c10e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.085+0000 7f7113e02700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c10ebe0 con 0x7f710c0fd150 2024-03-12T16:30:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.085+0000 7f7113e02700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f710c108200 con 0x7f710c0fc7f0 2024-03-12T16:30:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.085+0000 7f711139d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fd150 0x7f710c10e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.085+0000 7f711139d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fd150 0x7f710c10e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50190/0 (socket says 172.21.15.6:50190) 2024-03-12T16:30:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.085+0000 7f711139d700 1 -- 172.21.15.6:0/2521475882 learned_addr learned my addr 172.21.15.6:0/2521475882 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f7111b9e700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f710c0fc7f0 0x7f710c10e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:01.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f711139d700 1 -- 172.21.15.6:0/2521475882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f710c0fc7f0 msgr2=0x7f710c10e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f711139d700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f710c0fc7f0 0x7f710c10e060 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f711139d700 1 -- 172.21.15.6:0/2521475882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7108005040 con 0x7f710c0fd150 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f7111b9e700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f710c0fc7f0 0x7f710c10e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f711139d700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fd150 0x7f710c10e550 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f710000b480 tx=0x7f71000090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f70feffd700 1 -- 172.21.15.6:0/2521475882 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7100002500 con 0x7f710c0fd150 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f710c1084b0 con 0x7f710c0fd150 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f70feffd700 1 -- 172.21.15.6:0/2521475882 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7100002b10 con 0x7f710c0fd150 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f70feffd700 1 -- 172.21.15.6:0/2521475882 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7100012c90 con 0x7f710c0fd150 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.086+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f710c1089f0 con 0x7f710c0fd150 2024-03-12T16:30:01.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.087+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f710c05f590 con 0x7f710c0fd150 2024-03-12T16:30:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.088+0000 7f70feffd700 1 -- 172.21.15.6:0/2521475882 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7100002660 con 0x7f710c0fd150 2024-03-12T16:30:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.088+0000 7f70feffd700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f70f806caa0 0x7f70f806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.088+0000 7f70feffd700 1 -- 172.21.15.6:0/2521475882 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f710008be60 con 0x7f710c0fd150 2024-03-12T16:30:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.088+0000 7f7111b9e700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f70f806caa0 0x7f70f806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:01.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.088+0000 7f7111b9e700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f70f806caa0 0x7f70f806ef60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f71080043d0 tx=0x7f710800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:01.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.092+0000 7f70feffd700 1 -- 172.21.15.6:0/2521475882 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f71000599c0 con 0x7f710c0fd150 2024-03-12T16:30:01.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.311+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f710c103680 con 0x7f70f806caa0 2024-03-12T16:30:01.308 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.312+0000 7f70feffd700 1 -- 172.21.15.6:0/2521475882 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f710c103680 con 0x7f70f806caa0 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f70f806caa0 msgr2=0x7f70f806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f70f806caa0 0x7f70f806ef60 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 rx=0x7f71080043d0 tx=0x7f710800b040).stop 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fd150 msgr2=0x7f710c10e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fd150 0x7f710c10e550 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 rx=0x7f710000b480 tx=0x7f71000090f0).stop 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 shutdown_connections 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f710c0fc7f0 0x7f710c10e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f70f806caa0 0x7f70f806ef60 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 --2- 172.21.15.6:0/2521475882 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f710c0fd150 0x7f710c10e550 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 >> 172.21.15.6:0/2521475882 conn(0x7f710c070590 msgr2=0x7f710c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 shutdown_connections 2024-03-12T16:30:01.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.314+0000 7f7113e02700 1 -- 172.21.15.6:0/2521475882 wait complete. 2024-03-12T16:30:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.416+0000 7fa4b0480700 1 -- 172.21.15.6:0/2372319583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fd150 msgr2=0x7fa4a80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.416+0000 7fa4b0480700 1 --2- 172.21.15.6:0/2372319583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fd150 0x7fa4a80f6930 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 rx=0x7fa4980047f0 tx=0x7fa498009cb0).stop 2024-03-12T16:30:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.416+0000 7fa4b0480700 1 -- 172.21.15.6:0/2372319583 shutdown_connections 2024-03-12T16:30:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.416+0000 7fa4b0480700 1 --2- 172.21.15.6:0/2372319583 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fd150 0x7fa4a80f6930 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.416+0000 7fa4b0480700 1 --2- 172.21.15.6:0/2372319583 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fc7f0 0x7fa4a80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.416+0000 7fa4b0480700 1 -- 172.21.15.6:0/2372319583 >> 172.21.15.6:0/2372319583 conn(0x7fa4a8070590 msgr2=0x7fa4a80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.416+0000 7fa4b0480700 1 -- 172.21.15.6:0/2372319583 shutdown_connections 2024-03-12T16:30:01.414 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.416+0000 7fa4b0480700 1 -- 172.21.15.6:0/2372319583 wait complete. 2024-03-12T16:30:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4b0480700 1 Processor -- start 2024-03-12T16:30:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4b0480700 1 -- start start 2024-03-12T16:30:01.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4b0480700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fc7f0 0x7fa4a80f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:01.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4b0480700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fd150 0x7fa4a80f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:01.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4b0480700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80f8f20 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4b0480700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa4a80f9060 con 0x7fa4a80fd150 2024-03-12T16:30:01.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4ae21c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fc7f0 0x7fa4a80f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:01.416 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4ae21c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fc7f0 0x7fa4a80f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50206/0 (socket says 172.21.15.6:50206) 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4ae21c700 1 -- 172.21.15.6:0/1230646892 learned_addr learned my addr 172.21.15.6:0/1230646892 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.417+0000 7fa4ada1b700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fd150 0x7fa4a80f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.418+0000 7fa4ae21c700 1 -- 172.21.15.6:0/1230646892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fd150 msgr2=0x7fa4a80f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.418+0000 7fa4ae21c700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fd150 0x7fa4a80f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.418+0000 7fa4ae21c700 1 -- 172.21.15.6:0/1230646892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa498005040 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.418+0000 7fa4ae21c700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fc7f0 0x7fa4a80f8540 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fa4a400c790 tx=0x7fa4a4004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.418+0000 7fa49f7fe700 1 -- 172.21.15.6:0/1230646892 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4a40106f0 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.418+0000 7fa49f7fe700 1 -- 172.21.15.6:0/1230646892 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa4a4010d00 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.418+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa4a80f9310 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.417 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.418+0000 7fa49f7fe700 1 -- 172.21.15.6:0/1230646892 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa4a4012da0 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.418+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa4a81146b0 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.419+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa4a805f590 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.420+0000 7fa49f7fe700 1 -- 172.21.15.6:0/1230646892 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa4a4012400 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.420+0000 7fa49f7fe700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa49406caa0 0x7fa49406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.420+0000 7fa49f7fe700 1 -- 172.21.15.6:0/1230646892 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa4a408b610 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.420+0000 7fa4ada1b700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa49406caa0 0x7fa49406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:01.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.421+0000 7fa4ada1b700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa49406caa0 0x7fa49406ef60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fa498004f10 tx=0x7fa49800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:01.421 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.425+0000 7fa49f7fe700 1 -- 172.21.15.6:0/1230646892 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa4a40556e0 con 0x7fa4a80fc7f0 2024-03-12T16:30:01.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.635+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fa4a80fb5a0 con 0x7fa49406caa0 2024-03-12T16:30:01.642 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.645+0000 7fa49f7fe700 1 -- 172.21.15.6:0/1230646892 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fa4a80fb5a0 con 0x7fa49406caa0 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (16m) 10m ago 27m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (14m) 10m ago 27m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (14m) 10m ago 27m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (16m) 10m ago 27m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (10m) 10m ago 22m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (10m) 10m ago 22m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (10m) 10m ago 22m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (10m) 10m ago 22m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (18m) 10m ago 29m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (17m) 10m ago 27m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (15m) 10m ago 29m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:30:01.643 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (15m) 10m ago 27m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:30:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (17m) 10m ago 27m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:30:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (17m) 10m ago 26m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:30:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (14m) 10m ago 26m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:30:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (13m) 10m ago 26m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:30:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (13m) 10m ago 25m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:30:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (12m) 10m ago 25m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:30:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (11m) 10m ago 24m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:30:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (11m) 10m ago 24m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:30:01.644 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (17m) 10m ago 26m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.647+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa49406caa0 msgr2=0x7fa49406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.647+0000 7fa4b0480700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa49406caa0 0x7fa49406ef60 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 rx=0x7fa498004f10 tx=0x7fa49800b040).stop 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.647+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fc7f0 msgr2=0x7fa4a80f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.647+0000 7fa4b0480700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fc7f0 0x7fa4a80f8540 secure :-1 s=READY pgs=444 cs=0 l=1 rev1=1 rx=0x7fa4a400c790 tx=0x7fa4a4004330).stop 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.647+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 shutdown_connections 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.647+0000 7fa4b0480700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa49406caa0 0x7fa49406ef60 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.647+0000 7fa4b0480700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa4a80fc7f0 0x7fa4a80f8540 unknown :-1 s=CLOSED pgs=444 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.647+0000 7fa4b0480700 1 --2- 172.21.15.6:0/1230646892 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa4a80fd150 0x7fa4a80f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.647+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 >> 172.21.15.6:0/1230646892 conn(0x7fa4a8070590 msgr2=0x7fa4a8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:01.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.648+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 shutdown_connections 2024-03-12T16:30:01.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.648+0000 7fa4b0480700 1 -- 172.21.15.6:0/1230646892 wait complete. 2024-03-12T16:30:01.746 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.749+0000 7f74188d4700 1 -- 172.21.15.6:0/37330057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fd150 msgr2=0x7f74140f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.749+0000 7f74188d4700 1 --2- 172.21.15.6:0/37330057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fd150 0x7f74140f6930 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 rx=0x7f74040047f0 tx=0x7f7404009cb0).stop 2024-03-12T16:30:01.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.749+0000 7f74188d4700 1 -- 172.21.15.6:0/37330057 shutdown_connections 2024-03-12T16:30:01.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.749+0000 7f74188d4700 1 --2- 172.21.15.6:0/37330057 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fd150 0x7f74140f6930 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.749+0000 7f74188d4700 1 --2- 172.21.15.6:0/37330057 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74140fc7f0 0x7f74140fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.749+0000 7f74188d4700 1 -- 172.21.15.6:0/37330057 >> 172.21.15.6:0/37330057 conn(0x7f7414070590 msgr2=0x7f74140f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:01.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.749+0000 7f74188d4700 1 -- 172.21.15.6:0/37330057 shutdown_connections 2024-03-12T16:30:01.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.749+0000 7f74188d4700 1 -- 172.21.15.6:0/37330057 wait complete. 2024-03-12T16:30:01.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f74188d4700 1 Processor -- start 2024-03-12T16:30:01.747 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f74188d4700 1 -- start start 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f74188d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fc7f0 0x7f7414106ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f74188d4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74140fd150 0x7f74141073c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f74188d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74140614e0 con 0x7f74140fc7f0 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f74188d4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74141078b0 con 0x7f74140fd150 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f741259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fc7f0 0x7f7414106ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f741259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fc7f0 0x7f7414106ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50220/0 (socket says 172.21.15.6:50220) 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f741259c700 1 -- 172.21.15.6:0/4228432552 learned_addr learned my addr 172.21.15.6:0/4228432552 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f7411d9b700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74140fd150 0x7f74141073c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.750+0000 7f741259c700 1 -- 172.21.15.6:0/4228432552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74140fd150 msgr2=0x7f74141073c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.751+0000 7f741259c700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74140fd150 0x7f74141073c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.751+0000 7f741259c700 1 -- 172.21.15.6:0/4228432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7404005040 con 0x7f74140fc7f0 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.751+0000 7f741259c700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fc7f0 0x7f7414106ed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f73fc0041d0 tx=0x7f73fc009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:01.749 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.751+0000 7f740b7fe700 1 -- 172.21.15.6:0/4228432552 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73fc007b40 con 0x7f74140fc7f0 2024-03-12T16:30:01.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.751+0000 7f740b7fe700 1 -- 172.21.15.6:0/4228432552 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73fc00f040 con 0x7f74140fc7f0 2024-03-12T16:30:01.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.751+0000 7f740b7fe700 1 -- 172.21.15.6:0/4228432552 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73fc0137d0 con 0x7f74140fc7f0 2024-03-12T16:30:01.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.751+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7414107b90 con 0x7f74140fc7f0 2024-03-12T16:30:01.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.751+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7414114700 con 0x7f74140fc7f0 2024-03-12T16:30:01.750 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.752+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f741405f590 con 0x7f74140fc7f0 2024-03-12T16:30:01.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.752+0000 7f740b7fe700 1 -- 172.21.15.6:0/4228432552 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f73fc007ca0 con 0x7f74140fc7f0 2024-03-12T16:30:01.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.753+0000 7f740b7fe700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f740006cab0 0x7f740006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:01.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.753+0000 7f740b7fe700 1 -- 172.21.15.6:0/4228432552 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f73fc08b720 con 0x7f74140fc7f0 2024-03-12T16:30:01.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.753+0000 7f7411d9b700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f740006cab0 0x7f740006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:01.751 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.753+0000 7f7411d9b700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f740006cab0 0x7f740006ef70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7414060f90 tx=0x7f7404009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:01.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:01.757+0000 7f740b7fe700 1 -- 172.21.15.6:0/4228432552 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f73fc059280 con 0x7f74140fc7f0 2024-03-12T16:30:01.949 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:01 smithi134 ceph-mon[85099]: pgmap v503: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:01.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:01 smithi006 ceph-mon[103869]: pgmap v503: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.043+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7414060d20 con 0x7f74140fc7f0 2024-03-12T16:30:02.041 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.044+0000 7f740b7fe700 1 -- 172.21.15.6:0/4228432552 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f73fc058e10 con 0x7f74140fc7f0 2024-03-12T16:30:02.041 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:30:02.041 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:30:02.041 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:30:02.041 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:30:02.041 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:30:02.041 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:30:02.042 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:30:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f740006cab0 msgr2=0x7f740006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f740006cab0 0x7f740006ef70 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 rx=0x7f7414060f90 tx=0x7f7404009cb0).stop 2024-03-12T16:30:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fc7f0 msgr2=0x7f7414106ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fc7f0 0x7f7414106ed0 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 rx=0x7f73fc0041d0 tx=0x7f73fc009f60).stop 2024-03-12T16:30:02.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 shutdown_connections 2024-03-12T16:30:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f740006cab0 0x7f740006ef70 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f74140fc7f0 0x7f7414106ed0 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 --2- 172.21.15.6:0/4228432552 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f74140fd150 0x7f74141073c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 >> 172.21.15.6:0/4228432552 conn(0x7f7414070590 msgr2=0x7f74140fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 shutdown_connections 2024-03-12T16:30:02.044 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.046+0000 7f74188d4700 1 -- 172.21.15.6:0/4228432552 wait complete. 2024-03-12T16:30:02.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.148+0000 7fc8d39df700 1 -- 172.21.15.6:0/638948800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 msgr2=0x7fc8cc103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.148+0000 7fc8d39df700 1 --2- 172.21.15.6:0/638948800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 0x7fc8cc103ca0 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 rx=0x7fc8bc0047f0 tx=0x7fc8bc009cb0).stop 2024-03-12T16:30:02.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.148+0000 7fc8d39df700 1 -- 172.21.15.6:0/638948800 shutdown_connections 2024-03-12T16:30:02.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.148+0000 7fc8d39df700 1 --2- 172.21.15.6:0/638948800 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 0x7fc8cc103ca0 unknown :-1 s=CLOSED pgs=447 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.148+0000 7fc8d39df700 1 --2- 172.21.15.6:0/638948800 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8cc06b110 0x7fc8cc06b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.145 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.148+0000 7fc8d39df700 1 -- 172.21.15.6:0/638948800 >> 172.21.15.6:0/638948800 conn(0x7fc8cc0f34b0 msgr2=0x7fc8cc0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:02.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.148+0000 7fc8d39df700 1 -- 172.21.15.6:0/638948800 shutdown_connections 2024-03-12T16:30:02.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.148+0000 7fc8d39df700 1 -- 172.21.15.6:0/638948800 wait complete. 2024-03-12T16:30:02.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d39df700 1 Processor -- start 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d39df700 1 -- start start 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d39df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8cc06b110 0x7fc8cc110300 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d39df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 0x7fc8cc1107f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d39df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc110df0 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d39df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc8cc110f30 con 0x7fc8cc06b110 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d0f7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 0x7fc8cc1107f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d0f7a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 0x7fc8cc1107f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50228/0 (socket says 172.21.15.6:50228) 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d0f7a700 1 -- 172.21.15.6:0/240739874 learned_addr learned my addr 172.21.15.6:0/240739874 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d177b700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8cc06b110 0x7fc8cc110300 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d0f7a700 1 -- 172.21.15.6:0/240739874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8cc06b110 msgr2=0x7fc8cc110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d0f7a700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8cc06b110 0x7fc8cc110300 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.149+0000 7fc8d0f7a700 1 -- 172.21.15.6:0/240739874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc8bc005040 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.150+0000 7fc8d0f7a700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 0x7fc8cc1107f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fc8bc005010 tx=0x7fc8bc009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:02.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.150+0000 7fc8c27fc700 1 -- 172.21.15.6:0/240739874 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8bc00e030 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.150+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc8cc10a560 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.150+0000 7fc8c27fc700 1 -- 172.21.15.6:0/240739874 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc8bc007e90 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.150+0000 7fc8c27fc700 1 -- 172.21.15.6:0/240739874 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc8bc018070 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.150+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc8cc10aa40 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.151+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc8cc05f590 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.151+0000 7fc8c27fc700 1 -- 172.21.15.6:0/240739874 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fc8bc01d670 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.152+0000 7fc8c27fc700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc8b806caa0 0x7fc8b806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.152+0000 7fc8c27fc700 1 -- 172.21.15.6:0/240739874 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc8bc08d090 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.152+0000 7fc8d177b700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc8b806caa0 0x7fc8b806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:02.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.152+0000 7fc8d177b700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc8b806caa0 0x7fc8b806ef60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fc8c8004dc0 tx=0x7fc8c800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:02.153 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.156+0000 7fc8c27fc700 1 -- 172.21.15.6:0/240739874 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc8bc05abf0 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.396+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fc8cc047540 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.394 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.397+0000 7fc8c27fc700 1 -- 172.21.15.6:0/240739874 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fc8bc05a780 con 0x7fc8cc06b9e0 2024-03-12T16:30:02.394 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:30:02.394 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:30:02.394 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:30:02.394 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:30:02.394 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:30:02.394 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:30:02.394 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:30:02.395 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:30:02.396 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:30:02.397 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:30:02.397 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:30:02.397 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:30:02.397 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:30:02.397 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:30:02.397 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc8b806caa0 msgr2=0x7fc8b806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc8b806caa0 0x7fc8b806ef60 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 rx=0x7fc8c8004dc0 tx=0x7fc8c800b040).stop 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 msgr2=0x7fc8cc1107f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 0x7fc8cc1107f0 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 rx=0x7fc8bc005010 tx=0x7fc8bc009cb0).stop 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 shutdown_connections 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8cc06b110 0x7fc8cc110300 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc8b806caa0 0x7fc8b806ef60 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 --2- 172.21.15.6:0/240739874 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8cc06b9e0 0x7fc8cc1107f0 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 >> 172.21.15.6:0/240739874 conn(0x7fc8cc0f34b0 msgr2=0x7fc8cc103630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 shutdown_connections 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.399+0000 7fc8d39df700 1 -- 172.21.15.6:0/240739874 wait complete. 2024-03-12T16:30:02.398 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.501+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/2260657636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fd150 msgr2=0x7fa2ec0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.501+0000 7fa2f3fa8700 1 --2- 172.21.15.6:0/2260657636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fd150 0x7fa2ec0f6930 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 rx=0x7fa2dc0047f0 tx=0x7fa2dc009cb0).stop 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.501+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/2260657636 shutdown_connections 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.501+0000 7fa2f3fa8700 1 --2- 172.21.15.6:0/2260657636 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fd150 0x7fa2ec0f6930 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.501+0000 7fa2f3fa8700 1 --2- 172.21.15.6:0/2260657636 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2ec0fc7f0 0x7fa2ec0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.501+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/2260657636 >> 172.21.15.6:0/2260657636 conn(0x7fa2ec070590 msgr2=0x7fa2ec0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.501+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/2260657636 shutdown_connections 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.501+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/2260657636 wait complete. 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f3fa8700 1 Processor -- start 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f3fa8700 1 -- start start 2024-03-12T16:30:02.500 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f3fa8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fc7f0 0x7fa2ec10e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f3fa8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2ec0fd150 0x7fa2ec10e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f3fa8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec10eb00 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f3fa8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa2ec10ec40 con 0x7fa2ec0fd150 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f1d44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fc7f0 0x7fa2ec10e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f1d44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fc7f0 0x7fa2ec10e010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60016/0 (socket says 172.21.15.6:60016) 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f1d44700 1 -- 172.21.15.6:0/4056189049 learned_addr learned my addr 172.21.15.6:0/4056189049 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f1d44700 1 -- 172.21.15.6:0/4056189049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2ec0fd150 msgr2=0x7fa2ec10e500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f1d44700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2ec0fd150 0x7fa2ec10e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f1d44700 1 -- 172.21.15.6:0/4056189049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa2dc005040 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.502+0000 7fa2f1d44700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fc7f0 0x7fa2ec10e010 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fa2e800c790 tx=0x7fa2e8004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.503+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/4056189049 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e80106f0 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.503+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/4056189049 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa2e8010d00 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.503+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa2ec1082d0 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.503+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/4056189049 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa2e8012da0 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.503+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa2ec108890 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.503+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa2ec05f590 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.504+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/4056189049 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa2e8012400 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.504+0000 7fa2e2ffd700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa2d806caa0 0x7fa2d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:02.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.505+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/4056189049 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa2e808b690 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.505+0000 7fa2f1543700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa2d806caa0 0x7fa2d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:02.503 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.505+0000 7fa2f1543700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa2d806caa0 0x7fa2d806ef60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa2ec109950 tx=0x7fa2dc009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:02.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.509+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/4056189049 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa2e80591f0 con 0x7fa2ec0fc7f0 2024-03-12T16:30:02.722 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.725+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa2ec108b10 con 0x7fa2d806caa0 2024-03-12T16:30:02.723 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.726+0000 7fa2e2ffd700 1 -- 172.21.15.6:0/4056189049 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa2ec108b10 con 0x7fa2d806caa0 2024-03-12T16:30:02.723 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:30:02.723 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:30:02.723 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:30:02.724 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:30:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.728+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa2d806caa0 msgr2=0x7fa2d806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.728+0000 7fa2f3fa8700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa2d806caa0 0x7fa2d806ef60 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 rx=0x7fa2ec109950 tx=0x7fa2dc009cb0).stop 2024-03-12T16:30:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.728+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fc7f0 msgr2=0x7fa2ec10e010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.728+0000 7fa2f3fa8700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fc7f0 0x7fa2ec10e010 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 rx=0x7fa2e800c790 tx=0x7fa2e8004330).stop 2024-03-12T16:30:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.728+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 shutdown_connections 2024-03-12T16:30:02.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.728+0000 7fa2f3fa8700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa2d806caa0 0x7fa2d806ef60 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.728+0000 7fa2f3fa8700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa2ec0fc7f0 0x7fa2ec10e010 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.728+0000 7fa2f3fa8700 1 --2- 172.21.15.6:0/4056189049 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa2ec0fd150 0x7fa2ec10e500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:30:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.728+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 >> 172.21.15.6:0/4056189049 conn(0x7fa2ec070590 msgr2=0x7fa2ec0fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.729+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 shutdown_connections 2024-03-12T16:30:02.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.729+0000 7fa2f3fa8700 1 -- 172.21.15.6:0/4056189049 wait complete. 2024-03-12T16:30:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.830+0000 7fedc01e4700 1 -- 172.21.15.6:0/2337285459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 msgr2=0x7fedb80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.830+0000 7fedc01e4700 1 --2- 172.21.15.6:0/2337285459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 0x7fedb80f6930 secure :-1 s=READY pgs=451 cs=0 l=1 rev1=1 rx=0x7fedac0047f0 tx=0x7fedac009cb0).stop 2024-03-12T16:30:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.830+0000 7fedc01e4700 1 -- 172.21.15.6:0/2337285459 shutdown_connections 2024-03-12T16:30:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.830+0000 7fedc01e4700 1 --2- 172.21.15.6:0/2337285459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 0x7fedb80f6930 unknown :-1 s=CLOSED pgs=451 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.830+0000 7fedc01e4700 1 --2- 172.21.15.6:0/2337285459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb80fc7f0 0x7fedb80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:30:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.830+0000 7fedc01e4700 1 -- 172.21.15.6:0/2337285459 >> 172.21.15.6:0/2337285459 conn(0x7fedb8070590 msgr2=0x7fedb80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.830+0000 7fedc01e4700 1 -- 172.21.15.6:0/2337285459 shutdown_connections 2024-03-12T16:30:02.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.830+0000 7fedc01e4700 1 -- 172.21.15.6:0/2337285459 wait complete. 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.831+0000 7fedc01e4700 1 Processor -- start 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.831+0000 7fedc01e4700 1 -- start start 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.831+0000 7fedc01e4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb80fc7f0 0x7fedb810e060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.831+0000 7fedc01e4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 0x7fedb810e550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.831+0000 7fedc01e4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb810ebe0 con 0x7fedb80fd150 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.831+0000 7fedc01e4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fedb8108200 con 0x7fedb80fc7f0 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.831+0000 7fedbd77f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 0x7fedb810e550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.831+0000 7fedbd77f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 0x7fedb810e550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60046/0 (socket says 172.21.15.6:60046) 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.831+0000 7fedbd77f700 1 -- 172.21.15.6:0/2239063439 learned_addr learned my addr 172.21.15.6:0/2239063439 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedbd77f700 1 -- 172.21.15.6:0/2239063439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb80fc7f0 msgr2=0x7fedb810e060 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedbdf80700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb80fc7f0 0x7fedb810e060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedbd77f700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb80fc7f0 0x7fedb810e060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:02.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedbd77f700 1 -- 172.21.15.6:0/2239063439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fedac005040 con 0x7fedb80fd150 2024-03-12T16:30:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedbd77f700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 0x7fedb810e550 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fedac0099f0 tx=0x7fedac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedaaffd700 1 -- 172.21.15.6:0/2239063439 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedac00e030 con 0x7fedb80fd150 2024-03-12T16:30:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fedb8108450 con 0x7fedb80fd150 2024-03-12T16:30:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedaaffd700 1 -- 172.21.15.6:0/2239063439 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fedac007e90 con 0x7fedb80fd150 2024-03-12T16:30:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedaaffd700 1 -- 172.21.15.6:0/2239063439 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fedac018070 con 0x7fedb80fd150 2024-03-12T16:30:02.831 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.832+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fedb8108930 con 0x7fedb80fd150 2024-03-12T16:30:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.833+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fedb805f590 con 0x7fedb80fd150 2024-03-12T16:30:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.833+0000 7fedaaffd700 1 -- 172.21.15.6:0/2239063439 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fedac01d420 con 0x7fedb80fd150 2024-03-12T16:30:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.834+0000 7fedaaffd700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feda406caa0 0x7feda406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.834+0000 7fedaaffd700 1 -- 172.21.15.6:0/2239063439 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fedac08d230 con 0x7fedb80fd150 2024-03-12T16:30:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.834+0000 7fedbdf80700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feda406caa0 0x7feda406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:02.832 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.834+0000 7fedbdf80700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feda406caa0 0x7feda406ef60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fedb400a880 tx=0x7fedb4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:02.835 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:02.838+0000 7fedaaffd700 1 -- 172.21.15.6:0/2239063439 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fedac05ad90 con 0x7fedb80fd150 2024-03-12T16:30:02.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:02 smithi006 ceph-mon[103869]: from='client.34948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:02.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:02 smithi006 ceph-mon[103869]: from='client.34952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:02.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:02 smithi006 ceph-mon[103869]: from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:02.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:30:02.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:02 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/4228432552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:30:02.953 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:02 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/240739874' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:30:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.118+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fedb8047540 con 0x7fedb80fd150 2024-03-12T16:30:03.115 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.118+0000 7fedaaffd700 1 -- 172.21.15.6:0/2239063439 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fedac05a920 con 0x7fedb80fd150 2024-03-12T16:30:03.116 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:30:03.116 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:30:03.116 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:30:03.116 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:30:03.116 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:30:03.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.120+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feda406caa0 msgr2=0x7feda406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:03.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.120+0000 7fedc01e4700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feda406caa0 0x7feda406ef60 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 rx=0x7fedb400a880 tx=0x7fedb4008040).stop 2024-03-12T16:30:03.117 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.120+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 msgr2=0x7fedb810e550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:03.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.120+0000 7fedc01e4700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 0x7fedb810e550 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 rx=0x7fedac0099f0 tx=0x7fedac009cb0).stop 2024-03-12T16:30:03.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.120+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 shutdown_connections 2024-03-12T16:30:03.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.120+0000 7fedc01e4700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fedb80fc7f0 0x7fedb810e060 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:03.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.120+0000 7fedc01e4700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7feda406caa0 0x7feda406ef60 unknown :-1 s=CLOSED pgs=241 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:03.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.120+0000 7fedc01e4700 1 --2- 172.21.15.6:0/2239063439 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fedb80fd150 0x7fedb810e550 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:03.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.120+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 >> 172.21.15.6:0/2239063439 conn(0x7fedb8070590 msgr2=0x7fedb8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:03.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.121+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 shutdown_connections 2024-03-12T16:30:03.118 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:03.121+0000 7fedc01e4700 1 -- 172.21.15.6:0/2239063439 wait complete. 2024-03-12T16:30:03.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:02 smithi134 ceph-mon[85099]: from='client.34948 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:03.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:02 smithi134 ceph-mon[85099]: from='client.34952 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:03.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:02 smithi134 ceph-mon[85099]: from='client.34956 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:03.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:30:03.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:02 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/4228432552' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:30:03.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:02 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/240739874' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:30:04.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:03 smithi134 ceph-mon[85099]: pgmap v504: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:04.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:03 smithi134 ceph-mon[85099]: from='client.34968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:04.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:03 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2239063439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:30:04.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:03 smithi006 ceph-mon[103869]: pgmap v504: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:04.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:03 smithi006 ceph-mon[103869]: from='client.34968 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:04.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:03 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2239063439' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:30:06.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:05 smithi134 ceph-mon[85099]: pgmap v505: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:06.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:05 smithi006 ceph-mon[103869]: pgmap v505: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:08.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:07 smithi134 ceph-mon[85099]: pgmap v506: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:08.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:07 smithi006 ceph-mon[103869]: pgmap v506: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:10.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:09 smithi134 ceph-mon[85099]: pgmap v507: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:10.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:09 smithi006 ceph-mon[103869]: pgmap v507: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:12.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:11 smithi134 ceph-mon[85099]: pgmap v508: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:12.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:11 smithi006 ceph-mon[103869]: pgmap v508: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:14.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:13 smithi134 ceph-mon[85099]: pgmap v509: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:14.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:13 smithi006 ceph-mon[103869]: pgmap v509: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:16.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:15 smithi134 ceph-mon[85099]: pgmap v510: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:16.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:15 smithi006 ceph-mon[103869]: pgmap v510: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:18.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:17 smithi134 ceph-mon[85099]: pgmap v511: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:18.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:30:18.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:17 smithi006 ceph-mon[103869]: pgmap v511: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:18.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:30:20.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:19 smithi134 ceph-mon[85099]: pgmap v512: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:20.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:19 smithi006 ceph-mon[103869]: pgmap v512: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:22.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:21 smithi134 ceph-mon[85099]: pgmap v513: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:22.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:21 smithi006 ceph-mon[103869]: pgmap v513: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:24.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:23 smithi134 ceph-mon[85099]: pgmap v514: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:24.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:23 smithi006 ceph-mon[103869]: pgmap v514: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:26.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:25 smithi134 ceph-mon[85099]: pgmap v515: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:26.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:25 smithi006 ceph-mon[103869]: pgmap v515: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:28.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:27 smithi134 ceph-mon[85099]: pgmap v516: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:28.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:27 smithi006 ceph-mon[103869]: pgmap v516: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:30.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:29 smithi134 ceph-mon[85099]: pgmap v517: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:30.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:29 smithi006 ceph-mon[103869]: pgmap v517: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:32.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:31 smithi134 ceph-mon[85099]: pgmap v518: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:32.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:31 smithi006 ceph-mon[103869]: pgmap v518: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:33.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:30:33.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:30:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 -- 172.21.15.6:0/58617986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f9200 msgr2=0x7fa15c101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 --2- 172.21.15.6:0/58617986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f9200 0x7fa15c101910 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 rx=0x7fa1480047f0 tx=0x7fa148009cb0).stop 2024-03-12T16:30:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 -- 172.21.15.6:0/58617986 shutdown_connections 2024-03-12T16:30:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 --2- 172.21.15.6:0/58617986 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f9200 0x7fa15c101910 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 --2- 172.21.15.6:0/58617986 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0f88a0 0x7fa15c0f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.234 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 -- 172.21.15.6:0/58617986 >> 172.21.15.6:0/58617986 conn(0x7fa15c0f23b0 msgr2=0x7fa15c0f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 -- 172.21.15.6:0/58617986 shutdown_connections 2024-03-12T16:30:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 -- 172.21.15.6:0/58617986 wait complete. 2024-03-12T16:30:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 Processor -- start 2024-03-12T16:30:33.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.236+0000 7fa162f93700 1 -- start start 2024-03-12T16:30:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa162f93700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f88a0 0x7fa15c10e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa162f93700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0f9200 0x7fa15c10e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:33.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa162f93700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c10eb40 con 0x7fa15c0f88a0 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa162f93700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa15c10ec80 con 0x7fa15c0f9200 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa160d2f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f88a0 0x7fa15c10e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa160d2f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f88a0 0x7fa15c10e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43858/0 (socket says 172.21.15.6:43858) 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa160d2f700 1 -- 172.21.15.6:0/3622253674 learned_addr learned my addr 172.21.15.6:0/3622253674 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa15bfff700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0f9200 0x7fa15c10e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa160d2f700 1 -- 172.21.15.6:0/3622253674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0f9200 msgr2=0x7fa15c10e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa160d2f700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0f9200 0x7fa15c10e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa160d2f700 1 -- 172.21.15.6:0/3622253674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa148005040 con 0x7fa15c0f88a0 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa160d2f700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f88a0 0x7fa15c10e050 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fa1500041d0 tx=0x7fa150009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.237+0000 7fa159ffb700 1 -- 172.21.15.6:0/3622253674 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa150002d90 con 0x7fa15c0f88a0 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.238+0000 7fa159ffb700 1 -- 172.21.15.6:0/3622253674 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa15000f040 con 0x7fa15c0f88a0 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.238+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa15c108310 con 0x7fa15c0f88a0 2024-03-12T16:30:33.237 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.238+0000 7fa159ffb700 1 -- 172.21.15.6:0/3622253674 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa15000d800 con 0x7fa15c0f88a0 2024-03-12T16:30:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.238+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa15c108850 con 0x7fa15c0f88a0 2024-03-12T16:30:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.239+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa15c060370 con 0x7fa15c0f88a0 2024-03-12T16:30:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.239+0000 7fa159ffb700 1 -- 172.21.15.6:0/3622253674 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa15000dae0 con 0x7fa15c0f88a0 2024-03-12T16:30:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.239+0000 7fa159ffb700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa14c06caa0 0x7fa14c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.240+0000 7fa159ffb700 1 -- 172.21.15.6:0/3622253674 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa15008bdc0 con 0x7fa15c0f88a0 2024-03-12T16:30:33.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.240+0000 7fa15bfff700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa14c06caa0 0x7fa14c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:33.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.240+0000 7fa15bfff700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa14c06caa0 0x7fa14c06ef60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fa148004f10 tx=0x7fa14800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:33.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.244+0000 7fa159ffb700 1 -- 172.21.15.6:0/3622253674 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa150059920 con 0x7fa15c0f88a0 2024-03-12T16:30:33.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.464+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa15c108ad0 con 0x7fa14c06caa0 2024-03-12T16:30:33.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.465+0000 7fa159ffb700 1 -- 172.21.15.6:0/3622253674 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa15c108ad0 con 0x7fa14c06caa0 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa14c06caa0 msgr2=0x7fa14c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa14c06caa0 0x7fa14c06ef60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 rx=0x7fa148004f10 tx=0x7fa14800b040).stop 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f88a0 msgr2=0x7fa15c10e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f88a0 0x7fa15c10e050 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 rx=0x7fa1500041d0 tx=0x7fa150009f60).stop 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 shutdown_connections 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa14c06caa0 0x7fa14c06ef60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa15c0f88a0 0x7fa15c10e050 unknown :-1 s=CLOSED pgs=454 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 --2- 172.21.15.6:0/3622253674 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa15c0f9200 0x7fa15c10e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 >> 172.21.15.6:0/3622253674 conn(0x7fa15c0f23b0 msgr2=0x7fa15c0fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 shutdown_connections 2024-03-12T16:30:33.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.467+0000 7fa162f93700 1 -- 172.21.15.6:0/3622253674 wait complete. 2024-03-12T16:30:33.476 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 -- 172.21.15.6:0/3506654865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fe270 msgr2=0x7f37980f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 --2- 172.21.15.6:0/3506654865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fe270 0x7f37980f7a50 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 rx=0x7f37840047f0 tx=0x7f3784009cb0).stop 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 -- 172.21.15.6:0/3506654865 shutdown_connections 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 --2- 172.21.15.6:0/3506654865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fe270 0x7f37980f7a50 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 --2- 172.21.15.6:0/3506654865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37980fd910 0x7f37980fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 -- 172.21.15.6:0/3506654865 >> 172.21.15.6:0/3506654865 conn(0x7f37980f3530 msgr2=0x7f37980f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 -- 172.21.15.6:0/3506654865 shutdown_connections 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 -- 172.21.15.6:0/3506654865 wait complete. 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 Processor -- start 2024-03-12T16:30:33.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 -- start start 2024-03-12T16:30:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.570+0000 7f379eebd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fd910 0x7f379806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379eebd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37980fe270 0x7f379806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379eebd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379806bab0 con 0x7f37980fd910 2024-03-12T16:30:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379eebd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f379806bbf0 con 0x7f37980fe270 2024-03-12T16:30:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379cc59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fd910 0x7f379806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379cc59700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fd910 0x7f379806b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43868/0 (socket says 172.21.15.6:43868) 2024-03-12T16:30:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379cc59700 1 -- 172.21.15.6:0/3829923702 learned_addr learned my addr 172.21.15.6:0/3829923702 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f3797fff700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37980fe270 0x7f379806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:33.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379cc59700 1 -- 172.21.15.6:0/3829923702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37980fe270 msgr2=0x7f379806b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379cc59700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37980fe270 0x7f379806b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379cc59700 1 -- 172.21.15.6:0/3829923702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3784005040 con 0x7f37980fd910 2024-03-12T16:30:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379cc59700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fd910 0x7f379806b0d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f378c00c790 tx=0x7f378c004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f3795ffb700 1 -- 172.21.15.6:0/3829923702 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f378c0106f0 con 0x7f37980fd910 2024-03-12T16:30:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f3795ffb700 1 -- 172.21.15.6:0/3829923702 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f378c010d00 con 0x7f37980fd910 2024-03-12T16:30:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f379806bea0 con 0x7f37980fd910 2024-03-12T16:30:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.571+0000 7f3795ffb700 1 -- 172.21.15.6:0/3829923702 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f378c012da0 con 0x7f37980fd910 2024-03-12T16:30:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.572+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f37981146d0 con 0x7f37980fd910 2024-03-12T16:30:33.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.572+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f379805f570 con 0x7f37980fd910 2024-03-12T16:30:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.573+0000 7f3795ffb700 1 -- 172.21.15.6:0/3829923702 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f378c012400 con 0x7f37980fd910 2024-03-12T16:30:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.573+0000 7f3795ffb700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f378806caa0 0x7f378806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:33.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.574+0000 7f3795ffb700 1 -- 172.21.15.6:0/3829923702 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f378c08b610 con 0x7f37980fd910 2024-03-12T16:30:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.574+0000 7f3797fff700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f378806caa0 0x7f378806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:33.573 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.574+0000 7f3797fff700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f378806caa0 0x7f378806ef60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3784004f10 tx=0x7f378400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:33.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.578+0000 7f3795ffb700 1 -- 172.21.15.6:0/3829923702 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f378c0556e0 con 0x7f37980fd910 2024-03-12T16:30:33.790 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.792+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3798059120 con 0x7f378806caa0 2024-03-12T16:30:33.791 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.793+0000 7f3795ffb700 1 -- 172.21.15.6:0/3829923702 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f3798059120 con 0x7f378806caa0 2024-03-12T16:30:33.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.795+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f378806caa0 msgr2=0x7f378806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.793 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.795+0000 7f379eebd700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f378806caa0 0x7f378806ef60 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 rx=0x7f3784004f10 tx=0x7f378400b040).stop 2024-03-12T16:30:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.795+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fd910 msgr2=0x7f379806b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.795+0000 7f379eebd700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fd910 0x7f379806b0d0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 rx=0x7f378c00c790 tx=0x7f378c004330).stop 2024-03-12T16:30:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.796+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 shutdown_connections 2024-03-12T16:30:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.796+0000 7f379eebd700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f378806caa0 0x7f378806ef60 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.796+0000 7f379eebd700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f37980fd910 0x7f379806b0d0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.796+0000 7f379eebd700 1 --2- 172.21.15.6:0/3829923702 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f37980fe270 0x7f379806b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.796+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 >> 172.21.15.6:0/3829923702 conn(0x7f37980f3530 msgr2=0x7f37980fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.796+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 shutdown_connections 2024-03-12T16:30:33.794 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.796+0000 7f379eebd700 1 -- 172.21.15.6:0/3829923702 wait complete. 2024-03-12T16:30:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.897+0000 7f252ece0700 1 -- 172.21.15.6:0/4241997320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fd910 msgr2=0x7f25280fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.897+0000 7f252ece0700 1 --2- 172.21.15.6:0/4241997320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fd910 0x7f25280fdcf0 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 rx=0x7f251c0047f0 tx=0x7f251c009cb0).stop 2024-03-12T16:30:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.897+0000 7f252ece0700 1 -- 172.21.15.6:0/4241997320 shutdown_connections 2024-03-12T16:30:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.897+0000 7f252ece0700 1 --2- 172.21.15.6:0/4241997320 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25280fe270 0x7f25280f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.897+0000 7f252ece0700 1 --2- 172.21.15.6:0/4241997320 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fd910 0x7f25280fdcf0 unknown :-1 s=CLOSED pgs=457 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.897+0000 7f252ece0700 1 -- 172.21.15.6:0/4241997320 >> 172.21.15.6:0/4241997320 conn(0x7f25280f3530 msgr2=0x7f25280f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.897+0000 7f252ece0700 1 -- 172.21.15.6:0/4241997320 shutdown_connections 2024-03-12T16:30:33.895 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.897+0000 7f252ece0700 1 -- 172.21.15.6:0/4241997320 wait complete. 2024-03-12T16:30:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f252ece0700 1 Processor -- start 2024-03-12T16:30:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f252ece0700 1 -- start start 2024-03-12T16:30:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f252ece0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25280fd910 0x7f252806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f252ece0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fe270 0x7f252806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:33.897 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f252ece0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252806bab0 con 0x7f25280fe270 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f252ece0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f252806bbf0 con 0x7f25280fd910 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f2527fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fe270 0x7f252806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f2527fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fe270 0x7f252806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43894/0 (socket says 172.21.15.6:43894) 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f2527fff700 1 -- 172.21.15.6:0/3568696073 learned_addr learned my addr 172.21.15.6:0/3568696073 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f252ca7c700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25280fd910 0x7f252806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f2527fff700 1 -- 172.21.15.6:0/3568696073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25280fd910 msgr2=0x7f252806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f2527fff700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25280fd910 0x7f252806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f2527fff700 1 -- 172.21.15.6:0/3568696073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f251c005040 con 0x7f25280fe270 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f252ca7c700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25280fd910 0x7f252806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.898+0000 7f2527fff700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fe270 0x7f252806b5c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f2514002780 tx=0x7f2514009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.899+0000 7f2525ffb700 1 -- 172.21.15.6:0/3568696073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2514007b40 con 0x7f25280fe270 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.899+0000 7f2525ffb700 1 -- 172.21.15.6:0/3568696073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f251400f040 con 0x7f25280fe270 2024-03-12T16:30:33.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.899+0000 7f2525ffb700 1 -- 172.21.15.6:0/3568696073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2514014780 con 0x7f25280fe270 2024-03-12T16:30:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.899+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f252806bea0 con 0x7f25280fe270 2024-03-12T16:30:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.899+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f25281146c0 con 0x7f25280fe270 2024-03-12T16:30:33.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.900+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f252805f570 con 0x7f25280fe270 2024-03-12T16:30:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.900+0000 7f2525ffb700 1 -- 172.21.15.6:0/3568696073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2514007ca0 con 0x7f25280fe270 2024-03-12T16:30:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.901+0000 7f2525ffb700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f251806caa0 0x7f251806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.901+0000 7f2525ffb700 1 -- 172.21.15.6:0/3568696073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f251408bc40 con 0x7f25280fe270 2024-03-12T16:30:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.901+0000 7f252ca7c700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f251806caa0 0x7f251806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:33.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.901+0000 7f252ca7c700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f251806caa0 0x7f251806ef60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f251c0043d0 tx=0x7f251c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:33.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:33.905+0000 7f2525ffb700 1 -- 172.21.15.6:0/3568696073 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2514055d10 con 0x7f25280fe270 2024-03-12T16:30:34.109 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.112+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f252806c6c0 con 0x7f251806caa0 2024-03-12T16:30:34.119 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.121+0000 7f2525ffb700 1 -- 172.21.15.6:0/3568696073 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f252806c6c0 con 0x7f251806caa0 2024-03-12T16:30:34.119 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (17m) 11m ago 28m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (15m) 11m ago 28m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (15m) 10m ago 27m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (17m) 11m ago 28m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (11m) 11m ago 23m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (11m) 11m ago 23m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (10m) 10m ago 23m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (10m) 10m ago 23m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (18m) 11m ago 29m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (18m) 10m ago 27m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (16m) 11m ago 29m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (15m) 10m ago 27m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:30:34.120 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (17m) 11m ago 28m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:30:34.121 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (17m) 10m ago 27m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:30:34.121 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (14m) 11m ago 27m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:30:34.121 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (14m) 11m ago 26m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:30:34.121 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (13m) 11m ago 26m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:30:34.121 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (12m) 10m ago 25m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:30:34.121 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (12m) 10m ago 25m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:30:34.121 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (11m) 10m ago 24m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:30:34.121 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (17m) 10m ago 26m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:30:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.123+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f251806caa0 msgr2=0x7f251806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.123+0000 7f252ece0700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f251806caa0 0x7f251806ef60 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 rx=0x7f251c0043d0 tx=0x7f251c00b040).stop 2024-03-12T16:30:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.123+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fe270 msgr2=0x7f252806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.123+0000 7f252ece0700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fe270 0x7f252806b5c0 secure :-1 s=READY pgs=458 cs=0 l=1 rev1=1 rx=0x7f2514002780 tx=0x7f2514009ee0).stop 2024-03-12T16:30:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.123+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 shutdown_connections 2024-03-12T16:30:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.123+0000 7f252ece0700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f25280fd910 0x7f252806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.122 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.123+0000 7f252ece0700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f251806caa0 0x7f251806ef60 unknown :-1 s=CLOSED pgs=244 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.123+0000 7f252ece0700 1 --2- 172.21.15.6:0/3568696073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f25280fe270 0x7f252806b5c0 unknown :-1 s=CLOSED pgs=458 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.124+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 >> 172.21.15.6:0/3568696073 conn(0x7f25280f3530 msgr2=0x7f25280fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.124+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 shutdown_connections 2024-03-12T16:30:34.123 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.124+0000 7f252ece0700 1 -- 172.21.15.6:0/3568696073 wait complete. 2024-03-12T16:30:34.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:33 smithi134 ceph-mon[85099]: pgmap v519: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:34.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:33 smithi006 ceph-mon[103869]: pgmap v519: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.224+0000 7f01a682c700 1 -- 172.21.15.6:0/582240847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 msgr2=0x7f01a00fdc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.224+0000 7f01a682c700 1 --2- 172.21.15.6:0/582240847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 0x7f01a00fdc90 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 rx=0x7f01900047f0 tx=0x7f0190009cb0).stop 2024-03-12T16:30:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.224+0000 7f01a682c700 1 -- 172.21.15.6:0/582240847 shutdown_connections 2024-03-12T16:30:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.224+0000 7f01a682c700 1 --2- 172.21.15.6:0/582240847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01a00fe210 0x7f01a00f5f80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.224+0000 7f01a682c700 1 --2- 172.21.15.6:0/582240847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 0x7f01a00fdc90 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.224+0000 7f01a682c700 1 -- 172.21.15.6:0/582240847 >> 172.21.15.6:0/582240847 conn(0x7f01a006ce40 msgr2=0x7f01a006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:34.222 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.224+0000 7f01a682c700 1 -- 172.21.15.6:0/582240847 shutdown_connections 2024-03-12T16:30:34.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.224+0000 7f01a682c700 1 -- 172.21.15.6:0/582240847 wait complete. 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.225+0000 7f01a682c700 1 Processor -- start 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.225+0000 7f01a682c700 1 -- start start 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.225+0000 7f01a682c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 0x7f01a010e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f01a682c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01a00fe210 0x7f01a010e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f01a682c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a010ec10 con 0x7f01a00fd8b0 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f01a682c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f01a010ed50 con 0x7f01a00fe210 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 0x7f01a010e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 0x7f01a010e120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43918/0 (socket says 172.21.15.6:43918) 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019ffff700 1 -- 172.21.15.6:0/2703493177 learned_addr learned my addr 172.21.15.6:0/2703493177 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019f7fe700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01a00fe210 0x7f01a010e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:34.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019ffff700 1 -- 172.21.15.6:0/2703493177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01a00fe210 msgr2=0x7f01a010e610 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019ffff700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01a00fe210 0x7f01a010e610 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019ffff700 1 -- 172.21.15.6:0/2703493177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0190005040 con 0x7f01a00fd8b0 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019f7fe700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01a00fe210 0x7f01a010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019ffff700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 0x7f01a010e120 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f0190009380 tx=0x7f0190009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019d7fa700 1 -- 172.21.15.6:0/2703493177 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0190018070 con 0x7f01a00fd8b0 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f01a0108380 con 0x7f01a00fd8b0 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019d7fa700 1 -- 172.21.15.6:0/2703493177 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0190007e90 con 0x7f01a00fd8b0 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f019d7fa700 1 -- 172.21.15.6:0/2703493177 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f01900123c0 con 0x7f01a00fd8b0 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.226+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f01a0108860 con 0x7f01a00fd8b0 2024-03-12T16:30:34.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.227+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f01a0060670 con 0x7f01a00fd8b0 2024-03-12T16:30:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.228+0000 7f019d7fa700 1 -- 172.21.15.6:0/2703493177 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f019001d420 con 0x7f01a00fd8b0 2024-03-12T16:30:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.228+0000 7f019d7fa700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f018806caa0 0x7f018806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.228+0000 7f019d7fa700 1 -- 172.21.15.6:0/2703493177 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f019008ca10 con 0x7f01a00fd8b0 2024-03-12T16:30:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.228+0000 7f019f7fe700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f018806caa0 0x7f018806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:34.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.229+0000 7f019f7fe700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f018806caa0 0x7f018806ef60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f0194007fd0 tx=0x7f019400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:34.230 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.233+0000 7f019d7fa700 1 -- 172.21.15.6:0/2703493177 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f019005a570 con 0x7f01a00fd8b0 2024-03-12T16:30:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.514+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f01a0047540 con 0x7f01a00fd8b0 2024-03-12T16:30:34.512 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.515+0000 7f019d7fa700 1 -- 172.21.15.6:0/2703493177 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f019005a100 con 0x7f01a00fd8b0 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:30:34.513 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:30:34.514 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:30:34.514 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:30:34.514 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:30:34.514 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:30:34.514 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f018806caa0 msgr2=0x7f018806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f018806caa0 0x7f018806ef60 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 rx=0x7f0194007fd0 tx=0x7f019400b040).stop 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 msgr2=0x7f01a010e120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 0x7f01a010e120 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 rx=0x7f0190009380 tx=0x7f0190009cb0).stop 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 shutdown_connections 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f018806caa0 0x7f018806ef60 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f01a00fd8b0 0x7f01a010e120 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 --2- 172.21.15.6:0/2703493177 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f01a00fe210 0x7f01a010e610 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 >> 172.21.15.6:0/2703493177 conn(0x7f01a006ce40 msgr2=0x7f01a0100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 shutdown_connections 2024-03-12T16:30:34.515 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.517+0000 7f01a682c700 1 -- 172.21.15.6:0/2703493177 wait complete. 2024-03-12T16:30:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.618+0000 7f739737d700 1 -- 172.21.15.6:0/789411450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006b170 msgr2=0x7f739006b550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.618+0000 7f739737d700 1 --2- 172.21.15.6:0/789411450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006b170 0x7f739006b550 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 rx=0x7f738c0047f0 tx=0x7f738c009cb0).stop 2024-03-12T16:30:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.618+0000 7f739737d700 1 -- 172.21.15.6:0/789411450 shutdown_connections 2024-03-12T16:30:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.618+0000 7f739737d700 1 --2- 172.21.15.6:0/789411450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f739006ba40 0x7f7390103c40 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.618+0000 7f739737d700 1 --2- 172.21.15.6:0/789411450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006b170 0x7f739006b550 unknown :-1 s=CLOSED pgs=461 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.618+0000 7f739737d700 1 -- 172.21.15.6:0/789411450 >> 172.21.15.6:0/789411450 conn(0x7f73900f34b0 msgr2=0x7f73900f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.618+0000 7f739737d700 1 -- 172.21.15.6:0/789411450 shutdown_connections 2024-03-12T16:30:34.616 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.618+0000 7f739737d700 1 -- 172.21.15.6:0/789411450 wait complete. 2024-03-12T16:30:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f739737d700 1 Processor -- start 2024-03-12T16:30:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f739737d700 1 -- start start 2024-03-12T16:30:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f739737d700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f739006b170 0x7f7390110420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f739737d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006ba40 0x7f7390110910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f739737d700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390110f10 con 0x7f739006ba40 2024-03-12T16:30:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f739737d700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7390111050 con 0x7f739006b170 2024-03-12T16:30:34.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f7394918700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006ba40 0x7f7390110910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f7394918700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006ba40 0x7f7390110910 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43936/0 (socket says 172.21.15.6:43936) 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f7394918700 1 -- 172.21.15.6:0/571430464 learned_addr learned my addr 172.21.15.6:0/571430464 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f7395119700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f739006b170 0x7f7390110420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f7394918700 1 -- 172.21.15.6:0/571430464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f739006b170 msgr2=0x7f7390110420 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f7394918700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f739006b170 0x7f7390110420 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f7394918700 1 -- 172.21.15.6:0/571430464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f738c005040 con 0x7f739006ba40 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.619+0000 7f7394918700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006ba40 0x7f7390110910 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f738400e940 tx=0x7f738400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.620+0000 7f73827fc700 1 -- 172.21.15.6:0/571430464 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f738400eee0 con 0x7f739006ba40 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.620+0000 7f73827fc700 1 -- 172.21.15.6:0/571430464 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f738400f040 con 0x7f739006ba40 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.620+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f739010a710 con 0x7f739006ba40 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.620+0000 7f73827fc700 1 -- 172.21.15.6:0/571430464 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f738400c790 con 0x7f739006ba40 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.620+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f739010ac50 con 0x7f739006ba40 2024-03-12T16:30:34.619 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.621+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f739005f590 con 0x7f739006ba40 2024-03-12T16:30:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.621+0000 7f73827fc700 1 -- 172.21.15.6:0/571430464 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7384007b40 con 0x7f739006ba40 2024-03-12T16:30:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.621+0000 7f73827fc700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737c06caa0 0x7f737c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.622+0000 7f73827fc700 1 -- 172.21.15.6:0/571430464 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f738408b8e0 con 0x7f739006ba40 2024-03-12T16:30:34.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.622+0000 7f7395119700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737c06caa0 0x7f737c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:34.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.622+0000 7f7395119700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737c06caa0 0x7f737c06ef60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f738c004e60 tx=0x7f738c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:34.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.626+0000 7f73827fc700 1 -- 172.21.15.6:0/571430464 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7384059430 con 0x7f739006ba40 2024-03-12T16:30:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.866+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f739010baa0 con 0x7f739006ba40 2024-03-12T16:30:34.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.866+0000 7f73827fc700 1 -- 172.21.15.6:0/571430464 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f7384058fc0 con 0x7f739006ba40 2024-03-12T16:30:34.864 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:30:34.864 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:30:34.865 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:30:34.866 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:30:34.867 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:30:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.868+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737c06caa0 msgr2=0x7f737c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.868+0000 7f739737d700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737c06caa0 0x7f737c06ef60 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 rx=0x7f738c004e60 tx=0x7f738c00b040).stop 2024-03-12T16:30:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.868+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006ba40 msgr2=0x7f7390110910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.868+0000 7f739737d700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006ba40 0x7f7390110910 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 rx=0x7f738400e940 tx=0x7f738400b040).stop 2024-03-12T16:30:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.869+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 shutdown_connections 2024-03-12T16:30:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.869+0000 7f739737d700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f739006b170 0x7f7390110420 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.869+0000 7f739737d700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737c06caa0 0x7f737c06ef60 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.869+0000 7f739737d700 1 --2- 172.21.15.6:0/571430464 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f739006ba40 0x7f7390110910 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.869+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 >> 172.21.15.6:0/571430464 conn(0x7f73900f34b0 msgr2=0x7f7390102d40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:34.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.869+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 shutdown_connections 2024-03-12T16:30:34.869 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.869+0000 7f739737d700 1 -- 172.21.15.6:0/571430464 wait complete. 2024-03-12T16:30:34.869 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:30:34.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.971+0000 7f9247eb6700 1 -- 172.21.15.6:0/1622159643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 msgr2=0x7f92400f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.971+0000 7f9247eb6700 1 --2- 172.21.15.6:0/1622159643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 0x7f92400f8ce0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 rx=0x7f923c0047f0 tx=0x7f923c009cb0).stop 2024-03-12T16:30:34.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.971+0000 7f9247eb6700 1 -- 172.21.15.6:0/1622159643 shutdown_connections 2024-03-12T16:30:34.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.971+0000 7f9247eb6700 1 --2- 172.21.15.6:0/1622159643 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92400f9260 0x7f9240101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.971+0000 7f9247eb6700 1 --2- 172.21.15.6:0/1622159643 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 0x7f92400f8ce0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.969 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.971+0000 7f9247eb6700 1 -- 172.21.15.6:0/1622159643 >> 172.21.15.6:0/1622159643 conn(0x7f9240070590 msgr2=0x7f92400f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:34.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.971+0000 7f9247eb6700 1 -- 172.21.15.6:0/1622159643 shutdown_connections 2024-03-12T16:30:34.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.971+0000 7f9247eb6700 1 -- 172.21.15.6:0/1622159643 wait complete. 2024-03-12T16:30:34.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9247eb6700 1 Processor -- start 2024-03-12T16:30:34.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9247eb6700 1 -- start start 2024-03-12T16:30:34.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9247eb6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 0x7f924010e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:34.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9247eb6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92400f9260 0x7f924010e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:34.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9247eb6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924010eb30 con 0x7f92400f8900 2024-03-12T16:30:34.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9247eb6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f924010ec70 con 0x7f92400f9260 2024-03-12T16:30:34.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9245c52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 0x7f924010e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9245c52700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 0x7f924010e040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43942/0 (socket says 172.21.15.6:43942) 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9245c52700 1 -- 172.21.15.6:0/2948745586 learned_addr learned my addr 172.21.15.6:0/2948745586 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9245c52700 1 -- 172.21.15.6:0/2948745586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92400f9260 msgr2=0x7f924010e530 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9245451700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92400f9260 0x7f924010e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9245c52700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92400f9260 0x7f924010e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.972+0000 7f9245c52700 1 -- 172.21.15.6:0/2948745586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f923c005040 con 0x7f92400f8900 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.973+0000 7f9245c52700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 0x7f924010e040 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f923c009310 tx=0x7f923c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.973+0000 7f9232ffd700 1 -- 172.21.15.6:0/2948745586 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c00e030 con 0x7f92400f8900 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.973+0000 7f9232ffd700 1 -- 172.21.15.6:0/2948745586 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f923c007e90 con 0x7f92400f8900 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.973+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f92401082a0 con 0x7f92400f8900 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.973+0000 7f9232ffd700 1 -- 172.21.15.6:0/2948745586 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f923c018070 con 0x7f92400f8900 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.973+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9240108780 con 0x7f92400f8900 2024-03-12T16:30:34.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.974+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f924005f590 con 0x7f92400f8900 2024-03-12T16:30:34.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.974+0000 7f9232ffd700 1 -- 172.21.15.6:0/2948745586 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f923c01d420 con 0x7f92400f8900 2024-03-12T16:30:34.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.975+0000 7f9232ffd700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f922c06caa0 0x7f922c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:34.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.975+0000 7f9232ffd700 1 -- 172.21.15.6:0/2948745586 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f923c08d2d0 con 0x7f92400f8900 2024-03-12T16:30:34.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.975+0000 7f9245451700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f922c06caa0 0x7f922c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:34.974 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.975+0000 7f9245451700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f922c06caa0 0x7f922c06ef60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9240109980 tx=0x7f9234009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:34.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:34.979+0000 7f9232ffd700 1 -- 172.21.15.6:0/2948745586 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f923c05ae30 con 0x7f92400f8900 2024-03-12T16:30:35.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.194+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f92400fee70 con 0x7f922c06caa0 2024-03-12T16:30:35.193 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.196+0000 7f9232ffd700 1 -- 172.21.15.6:0/2948745586 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f92400fee70 con 0x7f922c06caa0 2024-03-12T16:30:35.193 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:30:35.193 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:30:35.193 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:30:35.193 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:30:35.194 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:30:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.197+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f922c06caa0 msgr2=0x7f922c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.197+0000 7f9247eb6700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f922c06caa0 0x7f922c06ef60 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 rx=0x7f9240109980 tx=0x7f9234009040).stop 2024-03-12T16:30:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.197+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 msgr2=0x7f924010e040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.197+0000 7f9247eb6700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 0x7f924010e040 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 rx=0x7f923c009310 tx=0x7f923c009cb0).stop 2024-03-12T16:30:35.195 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.198+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 shutdown_connections 2024-03-12T16:30:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.198+0000 7f9247eb6700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f922c06caa0 0x7f922c06ef60 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.198+0000 7f9247eb6700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f92400f8900 0x7f924010e040 unknown :-1 s=CLOSED pgs=464 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.198+0000 7f9247eb6700 1 --2- 172.21.15.6:0/2948745586 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f92400f9260 0x7f924010e530 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.198+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 >> 172.21.15.6:0/2948745586 conn(0x7f9240070590 msgr2=0x7f92400fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.198+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 shutdown_connections 2024-03-12T16:30:35.196 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.198+0000 7f9247eb6700 1 -- 172.21.15.6:0/2948745586 wait complete. 2024-03-12T16:30:35.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:34 smithi134 ceph-mon[85099]: from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:35.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:34 smithi134 ceph-mon[85099]: from='client.34980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:35.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:34 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2703493177' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:30:35.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:34 smithi006 ceph-mon[103869]: from='client.34976 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:35.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:34 smithi006 ceph-mon[103869]: from='client.34980 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:35.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:34 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2703493177' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:30:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.299+0000 7f0730ee3700 1 -- 172.21.15.6:0/2272906597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 msgr2=0x7f072c0f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.299+0000 7f0730ee3700 1 --2- 172.21.15.6:0/2272906597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 0x7f072c0f8ce0 secure :-1 s=READY pgs=465 cs=0 l=1 rev1=1 rx=0x7f07200047f0 tx=0x7f0720009cb0).stop 2024-03-12T16:30:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.299+0000 7f0730ee3700 1 -- 172.21.15.6:0/2272906597 shutdown_connections 2024-03-12T16:30:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.299+0000 7f0730ee3700 1 --2- 172.21.15.6:0/2272906597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f072c0f9260 0x7f072c101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.299+0000 7f0730ee3700 1 --2- 172.21.15.6:0/2272906597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 0x7f072c0f8ce0 unknown :-1 s=CLOSED pgs=465 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.299+0000 7f0730ee3700 1 -- 172.21.15.6:0/2272906597 >> 172.21.15.6:0/2272906597 conn(0x7f072c070590 msgr2=0x7f072c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.299+0000 7f0730ee3700 1 -- 172.21.15.6:0/2272906597 shutdown_connections 2024-03-12T16:30:35.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.299+0000 7f0730ee3700 1 -- 172.21.15.6:0/2272906597 wait complete. 2024-03-12T16:30:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f0730ee3700 1 Processor -- start 2024-03-12T16:30:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f0730ee3700 1 -- start start 2024-03-12T16:30:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f0730ee3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 0x7f072c0f68b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f0730ee3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f072c0f9260 0x7f072c0f6da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f0730ee3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0f7290 con 0x7f072c0f8900 2024-03-12T16:30:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f0730ee3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f072c0f73d0 con 0x7f072c0f9260 2024-03-12T16:30:35.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f072a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 0x7f072c0f68b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f072a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 0x7f072c0f68b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43966/0 (socket says 172.21.15.6:43966) 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f072a59c700 1 -- 172.21.15.6:0/2697592271 learned_addr learned my addr 172.21.15.6:0/2697592271 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f0729d9b700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f072c0f9260 0x7f072c0f6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f072a59c700 1 -- 172.21.15.6:0/2697592271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f072c0f9260 msgr2=0x7f072c0f6da0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f072a59c700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f072c0f9260 0x7f072c0f6da0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f072a59c700 1 -- 172.21.15.6:0/2697592271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0720005040 con 0x7f072c0f8900 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.300+0000 7f0729d9b700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f072c0f9260 0x7f072c0f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.301+0000 7f072a59c700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 0x7f072c0f68b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f0720009380 tx=0x7f0720009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.301+0000 7f071b7fe700 1 -- 172.21.15.6:0/2697592271 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0720018070 con 0x7f072c0f8900 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.301+0000 7f071b7fe700 1 -- 172.21.15.6:0/2697592271 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0720007e90 con 0x7f072c0f8900 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.301+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f072c0f7620 con 0x7f072c0f8900 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.301+0000 7f071b7fe700 1 -- 172.21.15.6:0/2697592271 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07200123c0 con 0x7f072c0f8900 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.301+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f072c114710 con 0x7f072c0f8900 2024-03-12T16:30:35.300 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.302+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f072c05f590 con 0x7f072c0f8900 2024-03-12T16:30:35.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.302+0000 7f071b7fe700 1 -- 172.21.15.6:0/2697592271 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f072001d420 con 0x7f072c0f8900 2024-03-12T16:30:35.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.303+0000 7f071b7fe700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f071406cb70 0x7f071406f030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:30:35.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.303+0000 7f071b7fe700 1 -- 172.21.15.6:0/2697592271 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f072008ca50 con 0x7f072c0f8900 2024-03-12T16:30:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.303+0000 7f0729d9b700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f071406cb70 0x7f071406f030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:30:35.302 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.303+0000 7f0729d9b700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f071406cb70 0x7f071406f030 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f071c009f20 tx=0x7f071c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:30:35.305 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.307+0000 7f071b7fe700 1 -- 172.21.15.6:0/2697592271 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0720056a60 con 0x7f072c0f8900 2024-03-12T16:30:35.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.585+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f072c047540 con 0x7f072c0f8900 2024-03-12T16:30:35.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.585+0000 7f071b7fe700 1 -- 172.21.15.6:0/2697592271 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f072005a080 con 0x7f072c0f8900 2024-03-12T16:30:35.583 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:30:35.583 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:30:35.583 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:30:35.583 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:30:35.583 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:30:35.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f071406cb70 msgr2=0x7f071406f030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:35.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f071406cb70 0x7f071406f030 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 rx=0x7f071c009f20 tx=0x7f071c00b040).stop 2024-03-12T16:30:35.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 msgr2=0x7f072c0f68b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:30:35.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 0x7f072c0f68b0 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 rx=0x7f0720009380 tx=0x7f0720009cb0).stop 2024-03-12T16:30:35.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 shutdown_connections 2024-03-12T16:30:35.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f071406cb70 0x7f071406f030 unknown :-1 s=CLOSED pgs=248 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:35.585 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f072c0f8900 0x7f072c0f68b0 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:35.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 --2- 172.21.15.6:0/2697592271 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f072c0f9260 0x7f072c0f6da0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:30:35.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 >> 172.21.15.6:0/2697592271 conn(0x7f072c070590 msgr2=0x7f072c101390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:30:35.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 shutdown_connections 2024-03-12T16:30:35.586 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:30:35.587+0000 7f0730ee3700 1 -- 172.21.15.6:0/2697592271 wait complete. 2024-03-12T16:30:36.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:35 smithi134 ceph-mon[85099]: pgmap v520: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:36.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:35 smithi134 ceph-mon[85099]: from='client.34984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:36.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:35 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/571430464' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:30:36.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:35 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2697592271' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:30:36.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:35 smithi006 ceph-mon[103869]: pgmap v520: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:36.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:35 smithi006 ceph-mon[103869]: from='client.34984 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:36.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:35 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/571430464' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:30:36.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:35 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2697592271' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:30:37.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:36 smithi134 ceph-mon[85099]: from='client.34996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:37.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:36 smithi006 ceph-mon[103869]: from='client.34996 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:30:38.084 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:37 smithi134 ceph-mon[85099]: pgmap v521: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:38.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:37 smithi006 ceph-mon[103869]: pgmap v521: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:40.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:39 smithi134 ceph-mon[85099]: pgmap v522: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:40.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:39 smithi006 ceph-mon[103869]: pgmap v522: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:42.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:41 smithi134 ceph-mon[85099]: pgmap v523: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:42.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:41 smithi006 ceph-mon[103869]: pgmap v523: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:44.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:43 smithi134 ceph-mon[85099]: pgmap v524: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:44.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:43 smithi006 ceph-mon[103869]: pgmap v524: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:46.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:45 smithi134 ceph-mon[85099]: pgmap v525: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:46.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:45 smithi006 ceph-mon[103869]: pgmap v525: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:48.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:47 smithi134 ceph-mon[85099]: pgmap v526: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:48.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:30:48.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:47 smithi006 ceph-mon[103869]: pgmap v526: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:48.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:30:50.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:49 smithi134 ceph-mon[85099]: pgmap v527: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:50.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:49 smithi006 ceph-mon[103869]: pgmap v527: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:52.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:51 smithi134 ceph-mon[85099]: pgmap v528: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:52.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:51 smithi006 ceph-mon[103869]: pgmap v528: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:53 smithi134 ceph-mon[85099]: pgmap v529: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:54.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:53 smithi006 ceph-mon[103869]: pgmap v529: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:56.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:55 smithi134 ceph-mon[85099]: pgmap v530: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:56.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:55 smithi006 ceph-mon[103869]: pgmap v530: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:58.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:57 smithi134 ceph-mon[85099]: pgmap v531: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:30:58.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:57 smithi006 ceph-mon[103869]: pgmap v531: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:00.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:30:59 smithi134 ceph-mon[85099]: pgmap v532: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:00.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:30:59 smithi006 ceph-mon[103869]: pgmap v532: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:02.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:01 smithi134 ceph-mon[85099]: pgmap v533: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:02.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:01 smithi006 ceph-mon[103869]: pgmap v533: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:03.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:31:03.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:31:04.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:03 smithi134 ceph-mon[85099]: pgmap v534: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:04.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:03 smithi006 ceph-mon[103869]: pgmap v534: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.702+0000 7f7338174700 1 -- 172.21.15.6:0/1684899815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fd1d0 msgr2=0x7f73300f69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.702+0000 7f7338174700 1 --2- 172.21.15.6:0/1684899815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fd1d0 0x7f73300f69b0 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 rx=0x7f73200047f0 tx=0x7f7320009cb0).stop 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.702+0000 7f7338174700 1 -- 172.21.15.6:0/1684899815 shutdown_connections 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.702+0000 7f7338174700 1 --2- 172.21.15.6:0/1684899815 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fd1d0 0x7f73300f69b0 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.702+0000 7f7338174700 1 --2- 172.21.15.6:0/1684899815 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73300fc870 0x7f73300fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.702+0000 7f7338174700 1 -- 172.21.15.6:0/1684899815 >> 172.21.15.6:0/1684899815 conn(0x7f73300f2430 msgr2=0x7f73300f4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.702+0000 7f7338174700 1 -- 172.21.15.6:0/1684899815 shutdown_connections 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.702+0000 7f7338174700 1 -- 172.21.15.6:0/1684899815 wait complete. 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.703+0000 7f7338174700 1 Processor -- start 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.703+0000 7f7338174700 1 -- start start 2024-03-12T16:31:05.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.703+0000 7f7338174700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fc870 0x7f733010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.703+0000 7f7338174700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73300fd1d0 0x7f733010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.703+0000 7f7338174700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733010ead0 con 0x7f73300fc870 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.703+0000 7f7338174700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f733010ec10 con 0x7f73300fd1d0 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.703+0000 7f7335f10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fc870 0x7f733010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7335f10700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fc870 0x7f733010dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49386/0 (socket says 172.21.15.6:49386) 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7335f10700 1 -- 172.21.15.6:0/98343897 learned_addr learned my addr 172.21.15.6:0/98343897 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f733570f700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73300fd1d0 0x7f733010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7335f10700 1 -- 172.21.15.6:0/98343897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73300fd1d0 msgr2=0x7f733010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7335f10700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73300fd1d0 0x7f733010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7335f10700 1 -- 172.21.15.6:0/98343897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7320005040 con 0x7f73300fc870 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7335f10700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fc870 0x7f733010dfe0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f732c00c740 tx=0x7f732c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7326ffd700 1 -- 172.21.15.6:0/98343897 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732c00e680 con 0x7f73300fc870 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7326ffd700 1 -- 172.21.15.6:0/98343897 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f732c00ec90 con 0x7f73300fc870 2024-03-12T16:31:05.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73301082a0 con 0x7f73300fc870 2024-03-12T16:31:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7326ffd700 1 -- 172.21.15.6:0/98343897 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f732c013d30 con 0x7f73300fc870 2024-03-12T16:31:05.704 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.704+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7330108860 con 0x7f73300fc870 2024-03-12T16:31:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.705+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7330060390 con 0x7f73300fc870 2024-03-12T16:31:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.706+0000 7f7326ffd700 1 -- 172.21.15.6:0/98343897 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f732c013410 con 0x7f73300fc870 2024-03-12T16:31:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.706+0000 7f7326ffd700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f731c06caa0 0x7f731c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.706+0000 7f7326ffd700 1 -- 172.21.15.6:0/98343897 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f732c08bf90 con 0x7f73300fc870 2024-03-12T16:31:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.706+0000 7f733570f700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f731c06caa0 0x7f731c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:05.705 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.707+0000 7f733570f700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f731c06caa0 0x7f731c06ef60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7330109920 tx=0x7f732000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:05.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.711+0000 7f7326ffd700 1 -- 172.21.15.6:0/98343897 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f732c059af0 con 0x7f73300fc870 2024-03-12T16:31:05.925 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.928+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f7330109060 con 0x7f731c06caa0 2024-03-12T16:31:05.926 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.929+0000 7f7326ffd700 1 -- 172.21.15.6:0/98343897 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f7330109060 con 0x7f731c06caa0 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f731c06caa0 msgr2=0x7f731c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f731c06caa0 0x7f731c06ef60 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 rx=0x7f7330109920 tx=0x7f732000b040).stop 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fc870 msgr2=0x7f733010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fc870 0x7f733010dfe0 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 rx=0x7f732c00c740 tx=0x7f732c007ef0).stop 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 shutdown_connections 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f731c06caa0 0x7f731c06ef60 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73300fc870 0x7f733010dfe0 unknown :-1 s=CLOSED pgs=468 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 --2- 172.21.15.6:0/98343897 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73300fd1d0 0x7f733010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 >> 172.21.15.6:0/98343897 conn(0x7f73300f2430 msgr2=0x7f73300613c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 shutdown_connections 2024-03-12T16:31:05.929 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:05.931+0000 7f7338174700 1 -- 172.21.15.6:0/98343897 wait complete. 2024-03-12T16:31:05.939 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:31:06.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.034+0000 7fa56770c700 1 -- 172.21.15.6:0/1387252297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 msgr2=0x7fa560101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.034+0000 7fa56770c700 1 --2- 172.21.15.6:0/1387252297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 0x7fa560101910 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 rx=0x7fa5500047f0 tx=0x7fa550009cb0).stop 2024-03-12T16:31:06.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.034+0000 7fa56770c700 1 -- 172.21.15.6:0/1387252297 shutdown_connections 2024-03-12T16:31:06.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.034+0000 7fa56770c700 1 --2- 172.21.15.6:0/1387252297 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 0x7fa560101910 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.034+0000 7fa56770c700 1 --2- 172.21.15.6:0/1387252297 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5600f88a0 0x7fa5600f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.034+0000 7fa56770c700 1 -- 172.21.15.6:0/1387252297 >> 172.21.15.6:0/1387252297 conn(0x7fa560070590 msgr2=0x7fa5600f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.035+0000 7fa56770c700 1 -- 172.21.15.6:0/1387252297 shutdown_connections 2024-03-12T16:31:06.033 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.035+0000 7fa56770c700 1 -- 172.21.15.6:0/1387252297 wait complete. 2024-03-12T16:31:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.035+0000 7fa56770c700 1 Processor -- start 2024-03-12T16:31:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.035+0000 7fa56770c700 1 -- start start 2024-03-12T16:31:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa56770c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5600f88a0 0x7fa56010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa56770c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 0x7fa56010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:06.034 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa56770c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56010eb70 con 0x7fa5600f9200 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa56770c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa56010ecb0 con 0x7fa5600f88a0 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa564ca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 0x7fa56010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa564ca7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 0x7fa56010e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49402/0 (socket says 172.21.15.6:49402) 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa564ca7700 1 -- 172.21.15.6:0/2281611873 learned_addr learned my addr 172.21.15.6:0/2281611873 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa5654a8700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5600f88a0 0x7fa56010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa564ca7700 1 -- 172.21.15.6:0/2281611873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5600f88a0 msgr2=0x7fa56010e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa564ca7700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5600f88a0 0x7fa56010e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa564ca7700 1 -- 172.21.15.6:0/2281611873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa550005040 con 0x7fa5600f9200 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa564ca7700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 0x7fa56010e570 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fa550005010 tx=0x7fa550009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa5567fc700 1 -- 172.21.15.6:0/2281611873 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa55000e030 con 0x7fa5600f9200 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa5567fc700 1 -- 172.21.15.6:0/2281611873 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa550007e90 con 0x7fa5600f9200 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa5567fc700 1 -- 172.21.15.6:0/2281611873 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa550018070 con 0x7fa5600f9200 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.036+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa5601082e0 con 0x7fa5600f9200 2024-03-12T16:31:06.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.037+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa5601087c0 con 0x7fa5600f9200 2024-03-12T16:31:06.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.038+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa56005f590 con 0x7fa5600f9200 2024-03-12T16:31:06.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.038+0000 7fa5567fc700 1 -- 172.21.15.6:0/2281611873 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa55001d6e0 con 0x7fa5600f9200 2024-03-12T16:31:06.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.039+0000 7fa5567fc700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa54c06ca30 0x7fa54c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:06.036 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.039+0000 7fa5567fc700 1 -- 172.21.15.6:0/2281611873 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa55008d0b0 con 0x7fa5600f9200 2024-03-12T16:31:06.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.039+0000 7fa5654a8700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa54c06ca30 0x7fa54c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:06.037 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.039+0000 7fa5654a8700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa54c06ca30 0x7fa54c06eef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fa55c004be0 tx=0x7fa55c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:06.040 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.043+0000 7fa5567fc700 1 -- 172.21.15.6:0/2281611873 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa55005ac10 con 0x7fa5600f9200 2024-03-12T16:31:06.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:05 smithi134 ceph-mon[85099]: pgmap v535: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:06.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:05 smithi006 ceph-mon[103869]: pgmap v535: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:06.256 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.259+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa5601097a0 con 0x7fa54c06ca30 2024-03-12T16:31:06.258 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.260+0000 7fa5567fc700 1 -- 172.21.15.6:0/2281611873 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa5601097a0 con 0x7fa54c06ca30 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.262+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa54c06ca30 msgr2=0x7fa54c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.262+0000 7fa56770c700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa54c06ca30 0x7fa54c06eef0 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 rx=0x7fa55c004be0 tx=0x7fa55c00b040).stop 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.262+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 msgr2=0x7fa56010e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.262+0000 7fa56770c700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 0x7fa56010e570 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 rx=0x7fa550005010 tx=0x7fa550009cb0).stop 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.262+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 shutdown_connections 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.262+0000 7fa56770c700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa5600f88a0 0x7fa56010e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.262+0000 7fa56770c700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa54c06ca30 0x7fa54c06eef0 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.262+0000 7fa56770c700 1 --2- 172.21.15.6:0/2281611873 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa5600f9200 0x7fa56010e570 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.262+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 >> 172.21.15.6:0/2281611873 conn(0x7fa560070590 msgr2=0x7fa5600fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:06.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.263+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 shutdown_connections 2024-03-12T16:31:06.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.263+0000 7fa56770c700 1 -- 172.21.15.6:0/2281611873 wait complete. 2024-03-12T16:31:06.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.364+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/3249995814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fd8f0 msgr2=0x7f9a680fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.364+0000 7f9a6ddf9700 1 --2- 172.21.15.6:0/3249995814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fd8f0 0x7f9a680fdcd0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 rx=0x7f9a5c0047f0 tx=0x7f9a5c009cb0).stop 2024-03-12T16:31:06.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.364+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/3249995814 shutdown_connections 2024-03-12T16:31:06.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.364+0000 7f9a6ddf9700 1 --2- 172.21.15.6:0/3249995814 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a680fe250 0x7f9a680f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.364+0000 7f9a6ddf9700 1 --2- 172.21.15.6:0/3249995814 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fd8f0 0x7f9a680fdcd0 unknown :-1 s=CLOSED pgs=471 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.364+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/3249995814 >> 172.21.15.6:0/3249995814 conn(0x7f9a680f34b0 msgr2=0x7f9a680f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.364+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/3249995814 shutdown_connections 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.364+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/3249995814 wait complete. 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.364+0000 7f9a6ddf9700 1 Processor -- start 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a6ddf9700 1 -- start start 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a6ddf9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a680fd8f0 0x7f9a6806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a6ddf9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fe250 0x7f9a6806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a6ddf9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6806bab0 con 0x7f9a680fe250 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a6ddf9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a6806bbf0 con 0x7f9a680fd8f0 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a66ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fe250 0x7f9a6806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a66ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fe250 0x7f9a6806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49418/0 (socket says 172.21.15.6:49418) 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a66ffd700 1 -- 172.21.15.6:0/1270246820 learned_addr learned my addr 172.21.15.6:0/1270246820 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a677fe700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a680fd8f0 0x7f9a6806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:06.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a66ffd700 1 -- 172.21.15.6:0/1270246820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a680fd8f0 msgr2=0x7f9a6806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a66ffd700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a680fd8f0 0x7f9a6806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a66ffd700 1 -- 172.21.15.6:0/1270246820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a5c005040 con 0x7f9a680fe250 2024-03-12T16:31:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a677fe700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a680fd8f0 0x7f9a6806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:31:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a66ffd700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fe250 0x7f9a6806b5c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f9a5800c710 tx=0x7f9a58007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a64ff9700 1 -- 172.21.15.6:0/1270246820 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a5800e680 con 0x7f9a680fe250 2024-03-12T16:31:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a64ff9700 1 -- 172.21.15.6:0/1270246820 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a5800ec90 con 0x7f9a680fe250 2024-03-12T16:31:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.365+0000 7f9a64ff9700 1 -- 172.21.15.6:0/1270246820 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a58013cd0 con 0x7f9a680fe250 2024-03-12T16:31:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.366+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a6806bea0 con 0x7f9a680fe250 2024-03-12T16:31:06.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.366+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a681146c0 con 0x7f9a680fe250 2024-03-12T16:31:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.367+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a6805f590 con 0x7f9a680fe250 2024-03-12T16:31:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.367+0000 7f9a64ff9700 1 -- 172.21.15.6:0/1270246820 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9a58013410 con 0x7f9a680fe250 2024-03-12T16:31:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.367+0000 7f9a64ff9700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a5006caa0 0x7f9a5006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:06.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.368+0000 7f9a64ff9700 1 -- 172.21.15.6:0/1270246820 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9a5808bfc0 con 0x7f9a680fe250 2024-03-12T16:31:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.368+0000 7f9a677fe700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a5006caa0 0x7f9a5006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:06.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.368+0000 7f9a677fe700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a5006caa0 0x7f9a5006ef60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f9a5c0043d0 tx=0x7f9a5c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:06.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.372+0000 7f9a64ff9700 1 -- 172.21.15.6:0/1270246820 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9a58056090 con 0x7f9a680fe250 2024-03-12T16:31:06.575 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.577+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f9a6806c670 con 0x7f9a5006caa0 2024-03-12T16:31:06.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.587+0000 7f9a64ff9700 1 -- 172.21.15.6:0/1270246820 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f9a6806c670 con 0x7f9a5006caa0 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (17m) 11m ago 28m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (15m) 11m ago 28m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (15m) 11m ago 28m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (17m) 11m ago 28m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (12m) 11m ago 23m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (11m) 11m ago 23m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (11m) 11m ago 23m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (11m) 11m ago 23m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:31:06.585 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (19m) 11m ago 30m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (18m) 11m ago 28m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (16m) 11m ago 30m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (16m) 11m ago 28m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (18m) 11m ago 28m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (18m) 11m ago 27m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (15m) 11m ago 27m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (14m) 11m ago 27m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (14m) 11m ago 26m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (13m) 11m ago 26m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (12m) 11m ago 25m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (12m) 11m ago 25m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:31:06.586 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (18m) 11m ago 27m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:31:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.589+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a5006caa0 msgr2=0x7f9a5006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.589+0000 7f9a6ddf9700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a5006caa0 0x7f9a5006ef60 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 rx=0x7f9a5c0043d0 tx=0x7f9a5c00b040).stop 2024-03-12T16:31:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.589+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fe250 msgr2=0x7f9a6806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.589+0000 7f9a6ddf9700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fe250 0x7f9a6806b5c0 secure :-1 s=READY pgs=472 cs=0 l=1 rev1=1 rx=0x7f9a5800c710 tx=0x7f9a58007ec0).stop 2024-03-12T16:31:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.590+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 shutdown_connections 2024-03-12T16:31:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.590+0000 7f9a6ddf9700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a680fd8f0 0x7f9a6806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.590+0000 7f9a6ddf9700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a5006caa0 0x7f9a5006ef60 unknown :-1 s=CLOSED pgs=251 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.587 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.590+0000 7f9a6ddf9700 1 --2- 172.21.15.6:0/1270246820 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a680fe250 0x7f9a6806b5c0 unknown :-1 s=CLOSED pgs=472 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.590+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 >> 172.21.15.6:0/1270246820 conn(0x7f9a680f34b0 msgr2=0x7f9a680fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.590+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 shutdown_connections 2024-03-12T16:31:06.588 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.590+0000 7f9a6ddf9700 1 -- 172.21.15.6:0/1270246820 wait complete. 2024-03-12T16:31:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.690+0000 7f2adc499700 1 -- 172.21.15.6:0/416665591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 msgr2=0x7f2ad40fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.690+0000 7f2adc499700 1 --2- 172.21.15.6:0/416665591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 0x7f2ad40fdcd0 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 rx=0x7f2ad00047f0 tx=0x7f2ad0009cb0).stop 2024-03-12T16:31:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.690+0000 7f2adc499700 1 -- 172.21.15.6:0/416665591 shutdown_connections 2024-03-12T16:31:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.690+0000 7f2adc499700 1 --2- 172.21.15.6:0/416665591 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ad40fe250 0x7f2ad40f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.690+0000 7f2adc499700 1 --2- 172.21.15.6:0/416665591 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 0x7f2ad40fdcd0 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.690+0000 7f2adc499700 1 -- 172.21.15.6:0/416665591 >> 172.21.15.6:0/416665591 conn(0x7f2ad40f34b0 msgr2=0x7f2ad40f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.690+0000 7f2adc499700 1 -- 172.21.15.6:0/416665591 shutdown_connections 2024-03-12T16:31:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.690+0000 7f2adc499700 1 -- 172.21.15.6:0/416665591 wait complete. 2024-03-12T16:31:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.691+0000 7f2adc499700 1 Processor -- start 2024-03-12T16:31:06.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.691+0000 7f2adc499700 1 -- start start 2024-03-12T16:31:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.691+0000 7f2adc499700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 0x7f2ad406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.691+0000 7f2adc499700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ad40fe250 0x7f2ad406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:06.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.691+0000 7f2adc499700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad406bab0 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.691+0000 7f2adc499700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2ad406bbf0 con 0x7f2ad40fe250 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.691+0000 7f2ada235700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 0x7f2ad406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.691+0000 7f2ada235700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 0x7f2ad406b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49438/0 (socket says 172.21.15.6:49438) 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.691+0000 7f2ada235700 1 -- 172.21.15.6:0/1291726459 learned_addr learned my addr 172.21.15.6:0/1291726459 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2ad9a34700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ad40fe250 0x7f2ad406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2ada235700 1 -- 172.21.15.6:0/1291726459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ad40fe250 msgr2=0x7f2ad406b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2ada235700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ad40fe250 0x7f2ad406b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2ada235700 1 -- 172.21.15.6:0/1291726459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2ad0005040 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2ada235700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 0x7f2ad406b0d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f2ad000b120 tx=0x7f2ad0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2acb7fe700 1 -- 172.21.15.6:0/1291726459 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ad000e030 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2ad406be40 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2acb7fe700 1 -- 172.21.15.6:0/1291726459 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2ad0007e90 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2acb7fe700 1 -- 172.21.15.6:0/1291726459 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2ad0018070 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.692+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2ad41145f0 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.691 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.693+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2ad405f590 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.693+0000 7f2acb7fe700 1 -- 172.21.15.6:0/1291726459 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2ad001d420 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.694+0000 7f2acb7fe700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ac006caa0 0x7f2ac006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:06.692 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.694+0000 7f2acb7fe700 1 -- 172.21.15.6:0/1291726459 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2ad008d240 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.694+0000 7f2ad9a34700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ac006caa0 0x7f2ac006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:06.693 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.694+0000 7f2ad9a34700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ac006caa0 0x7f2ac006ef60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f2ad406c870 tx=0x7f2ac4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:06.695 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.698+0000 7f2acb7fe700 1 -- 172.21.15.6:0/1291726459 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2ad0057310 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.981+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f2ad4047540 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.982+0000 7f2acb7fe700 1 -- 172.21.15.6:0/1291726459 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f2ad005a930 con 0x7f2ad40fd8f0 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:31:06.980 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:31:06.981 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:31:06.981 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:31:06.981 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:31:06.981 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:31:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ac006caa0 msgr2=0x7f2ac006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ac006caa0 0x7f2ac006ef60 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 rx=0x7f2ad406c870 tx=0x7f2ac4009040).stop 2024-03-12T16:31:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 msgr2=0x7f2ad406b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 0x7f2ad406b0d0 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 rx=0x7f2ad000b120 tx=0x7f2ad0009cb0).stop 2024-03-12T16:31:06.982 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 shutdown_connections 2024-03-12T16:31:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2ac006caa0 0x7f2ac006ef60 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2ad40fd8f0 0x7f2ad406b0d0 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 --2- 172.21.15.6:0/1291726459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2ad40fe250 0x7f2ad406b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 >> 172.21.15.6:0/1291726459 conn(0x7f2ad40f34b0 msgr2=0x7f2ad40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 shutdown_connections 2024-03-12T16:31:06.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:06.985+0000 7f2adc499700 1 -- 172.21.15.6:0/1291726459 wait complete. 2024-03-12T16:31:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.087+0000 7f20be959700 1 -- 172.21.15.6:0/3696426826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f8900 msgr2=0x7f20b80f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.084 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.087+0000 7f20be959700 1 --2- 172.21.15.6:0/3696426826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f8900 0x7f20b80f8ce0 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 rx=0x7f20a00047f0 tx=0x7f20a0009cb0).stop 2024-03-12T16:31:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.087+0000 7f20be959700 1 -- 172.21.15.6:0/3696426826 shutdown_connections 2024-03-12T16:31:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.087+0000 7f20be959700 1 --2- 172.21.15.6:0/3696426826 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b80f9260 0x7f20b8101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.087+0000 7f20be959700 1 --2- 172.21.15.6:0/3696426826 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f8900 0x7f20b80f8ce0 unknown :-1 s=CLOSED pgs=475 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.087+0000 7f20be959700 1 -- 172.21.15.6:0/3696426826 >> 172.21.15.6:0/3696426826 conn(0x7f20b8070590 msgr2=0x7f20b80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.087+0000 7f20be959700 1 -- 172.21.15.6:0/3696426826 shutdown_connections 2024-03-12T16:31:07.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.087+0000 7f20be959700 1 -- 172.21.15.6:0/3696426826 wait complete. 2024-03-12T16:31:07.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.087+0000 7f20be959700 1 Processor -- start 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20be959700 1 -- start start 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20be959700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b80f8900 0x7f20b810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20be959700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f9260 0x7f20b810e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20be959700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b810eab0 con 0x7f20b80f9260 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20be959700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20b810ebf0 con 0x7f20b80f8900 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20b77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f9260 0x7f20b810e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20b77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f9260 0x7f20b810e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49458/0 (socket says 172.21.15.6:49458) 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20b77fe700 1 -- 172.21.15.6:0/1638165305 learned_addr learned my addr 172.21.15.6:0/1638165305 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20b7fff700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b80f8900 0x7f20b810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20b77fe700 1 -- 172.21.15.6:0/1638165305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b80f8900 msgr2=0x7f20b810dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20b77fe700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b80f8900 0x7f20b810dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20b77fe700 1 -- 172.21.15.6:0/1638165305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f20a0005040 con 0x7f20b80f9260 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.088+0000 7f20b77fe700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f9260 0x7f20b810e4b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f20a8002770 tx=0x7f20a8002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:07.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.089+0000 7f20b57fa700 1 -- 172.21.15.6:0/1638165305 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a8007b40 con 0x7f20b80f9260 2024-03-12T16:31:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.089+0000 7f20b57fa700 1 -- 172.21.15.6:0/1638165305 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f20a800f040 con 0x7f20b80f9260 2024-03-12T16:31:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.089+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20b8108280 con 0x7f20b80f9260 2024-03-12T16:31:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.089+0000 7f20b57fa700 1 -- 172.21.15.6:0/1638165305 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f20a8014820 con 0x7f20b80f9260 2024-03-12T16:31:07.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.089+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20b81087c0 con 0x7f20b80f9260 2024-03-12T16:31:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.090+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20b805f590 con 0x7f20b80f9260 2024-03-12T16:31:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.090+0000 7f20b57fa700 1 -- 172.21.15.6:0/1638165305 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f20a8007ca0 con 0x7f20b80f9260 2024-03-12T16:31:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.090+0000 7f20b57fa700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f20a406caa0 0x7f20a406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.091+0000 7f20b57fa700 1 -- 172.21.15.6:0/1638165305 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f20a808b880 con 0x7f20b80f9260 2024-03-12T16:31:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.091+0000 7f20b7fff700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f20a406caa0 0x7f20a406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:07.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.091+0000 7f20b7fff700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f20a406caa0 0x7f20a406ef60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f20a0009ee0 tx=0x7f20a000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:07.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.095+0000 7f20b57fa700 1 -- 172.21.15.6:0/1638165305 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f20a80593e0 con 0x7f20b80f9260 2024-03-12T16:31:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.338+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f20b80fee10 con 0x7f20b80f9260 2024-03-12T16:31:07.336 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.339+0000 7f20b57fa700 1 -- 172.21.15.6:0/1638165305 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f20a8058f70 con 0x7f20b80f9260 2024-03-12T16:31:07.336 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:31:07.337 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:31:07.338 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:31:07.339 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:31:07.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f20a406caa0 msgr2=0x7f20a406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f20a406caa0 0x7f20a406ef60 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 rx=0x7f20a0009ee0 tx=0x7f20a000b040).stop 2024-03-12T16:31:07.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f9260 msgr2=0x7f20b810e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f9260 0x7f20b810e4b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 rx=0x7f20a8002770 tx=0x7f20a8002a80).stop 2024-03-12T16:31:07.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 shutdown_connections 2024-03-12T16:31:07.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20b80f8900 0x7f20b810dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.340 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f20a406caa0 0x7f20a406ef60 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 --2- 172.21.15.6:0/1638165305 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20b80f9260 0x7f20b810e4b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 >> 172.21.15.6:0/1638165305 conn(0x7f20b8070590 msgr2=0x7f20b80fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 shutdown_connections 2024-03-12T16:31:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.341+0000 7f20be959700 1 -- 172.21.15.6:0/1638165305 wait complete. 2024-03-12T16:31:07.341 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:31:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 -- 172.21.15.6:0/1436141634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 msgr2=0x7f39380f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 --2- 172.21.15.6:0/1436141634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 0x7f39380f6930 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 rx=0x7f392c0047f0 tx=0x7f392c009cb0).stop 2024-03-12T16:31:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 -- 172.21.15.6:0/1436141634 shutdown_connections 2024-03-12T16:31:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 --2- 172.21.15.6:0/1436141634 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 0x7f39380f6930 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 --2- 172.21.15.6:0/1436141634 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39380fc7f0 0x7f39380fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 -- 172.21.15.6:0/1436141634 >> 172.21.15.6:0/1436141634 conn(0x7f39380f23b0 msgr2=0x7f39380f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:07.443 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 -- 172.21.15.6:0/1436141634 shutdown_connections 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 -- 172.21.15.6:0/1436141634 wait complete. 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 Processor -- start 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.444+0000 7f393d454700 1 -- start start 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f393d454700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39380fc7f0 0x7f3938109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f393d454700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 0x7f3938109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f393d454700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938109b40 con 0x7f39380fd150 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f393d454700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3938109c80 con 0x7f39380fc7f0 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f39367fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 0x7f3938109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f39367fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 0x7f3938109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49474/0 (socket says 172.21.15.6:49474) 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f39367fc700 1 -- 172.21.15.6:0/3264643865 learned_addr learned my addr 172.21.15.6:0/3264643865 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f3936ffd700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39380fc7f0 0x7f3938109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f39367fc700 1 -- 172.21.15.6:0/3264643865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39380fc7f0 msgr2=0x7f3938109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f39367fc700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39380fc7f0 0x7f3938109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f39367fc700 1 -- 172.21.15.6:0/3264643865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f392c005040 con 0x7f39380fd150 2024-03-12T16:31:07.444 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f3936ffd700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39380fc7f0 0x7f3938109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:31:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f39367fc700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 0x7f3938109650 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f392c0099f0 tx=0x7f392c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f391ffff700 1 -- 172.21.15.6:0/3264643865 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f392c00e030 con 0x7f39380fd150 2024-03-12T16:31:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f391ffff700 1 -- 172.21.15.6:0/3264643865 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f392c007e90 con 0x7f39380fd150 2024-03-12T16:31:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.445+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3938109ed0 con 0x7f39380fd150 2024-03-12T16:31:07.445 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.446+0000 7f391ffff700 1 -- 172.21.15.6:0/3264643865 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f392c018070 con 0x7f39380fd150 2024-03-12T16:31:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.446+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3938112390 con 0x7f39380fd150 2024-03-12T16:31:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.447+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3938060370 con 0x7f39380fd150 2024-03-12T16:31:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.447+0000 7f391ffff700 1 -- 172.21.15.6:0/3264643865 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f392c01d420 con 0x7f39380fd150 2024-03-12T16:31:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.447+0000 7f391ffff700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f392006caa0 0x7f392006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.447+0000 7f391ffff700 1 -- 172.21.15.6:0/3264643865 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f392c08d230 con 0x7f39380fd150 2024-03-12T16:31:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.447+0000 7f3936ffd700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f392006caa0 0x7f392006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:07.446 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.448+0000 7f3936ffd700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f392006caa0 0x7f392006ef60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f39280041d0 tx=0x7f3928009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:07.449 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.452+0000 7f391ffff700 1 -- 172.21.15.6:0/3264643865 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f392c057300 con 0x7f39380fd150 2024-03-12T16:31:07.662 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.665+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3938059120 con 0x7f392006caa0 2024-03-12T16:31:07.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.666+0000 7f391ffff700 1 -- 172.21.15.6:0/3264643865 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f3938059120 con 0x7f392006caa0 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:31:07.664 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:31:07.665 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:31:07.665 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.668+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f392006caa0 msgr2=0x7f392006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.668+0000 7f393d454700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f392006caa0 0x7f392006ef60 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 rx=0x7f39280041d0 tx=0x7f3928009040).stop 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.668+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 msgr2=0x7f3938109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.668+0000 7f393d454700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 0x7f3938109650 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 rx=0x7f392c0099f0 tx=0x7f392c009cb0).stop 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.669+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 shutdown_connections 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.669+0000 7f393d454700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f39380fc7f0 0x7f3938109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.669+0000 7f393d454700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f392006caa0 0x7f392006ef60 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.669+0000 7f393d454700 1 --2- 172.21.15.6:0/3264643865 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f39380fd150 0x7f3938109650 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.669+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 >> 172.21.15.6:0/3264643865 conn(0x7f39380f23b0 msgr2=0x7f39380fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.669+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 shutdown_connections 2024-03-12T16:31:07.666 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.669+0000 7f393d454700 1 -- 172.21.15.6:0/3264643865 wait complete. 2024-03-12T16:31:07.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 -- 172.21.15.6:0/3600927075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fc7f0 msgr2=0x7f2c340fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 --2- 172.21.15.6:0/3600927075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fc7f0 0x7f2c340fcbd0 secure :-1 s=READY pgs=479 cs=0 l=1 rev1=1 rx=0x7f2c280047f0 tx=0x7f2c28009cb0).stop 2024-03-12T16:31:07.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 -- 172.21.15.6:0/3600927075 shutdown_connections 2024-03-12T16:31:07.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 --2- 172.21.15.6:0/3600927075 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c340fd150 0x7f2c340f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.767 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 --2- 172.21.15.6:0/3600927075 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fc7f0 0x7f2c340fcbd0 unknown :-1 s=CLOSED pgs=479 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 -- 172.21.15.6:0/3600927075 >> 172.21.15.6:0/3600927075 conn(0x7f2c34070590 msgr2=0x7f2c340f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:07.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 -- 172.21.15.6:0/3600927075 shutdown_connections 2024-03-12T16:31:07.768 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 -- 172.21.15.6:0/3600927075 wait complete. 2024-03-12T16:31:07.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 Processor -- start 2024-03-12T16:31:07.769 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.770+0000 7f2c3bff2700 1 -- start start 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3bff2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c340fc7f0 0x7f2c3410dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3bff2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fd150 0x7f2c3410e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3bff2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3410eab0 con 0x7f2c340fd150 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3bff2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2c3410ebf0 con 0x7f2c340fc7f0 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3958d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fd150 0x7f2c3410e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3958d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fd150 0x7f2c3410e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49486/0 (socket says 172.21.15.6:49486) 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3958d700 1 -- 172.21.15.6:0/2994741191 learned_addr learned my addr 172.21.15.6:0/2994741191 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c39d8e700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c340fc7f0 0x7f2c3410dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3958d700 1 -- 172.21.15.6:0/2994741191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c340fc7f0 msgr2=0x7f2c3410dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3958d700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c340fc7f0 0x7f2c3410dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3958d700 1 -- 172.21.15.6:0/2994741191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2c28005040 con 0x7f2c340fd150 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3958d700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fd150 0x7f2c3410e4b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f2c30002780 tx=0x7f2c30009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c26ffd700 1 -- 172.21.15.6:0/2994741191 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c30007b40 con 0x7f2c340fd150 2024-03-12T16:31:07.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c26ffd700 1 -- 172.21.15.6:0/2994741191 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2c3000f040 con 0x7f2c340fd150 2024-03-12T16:31:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c26ffd700 1 -- 172.21.15.6:0/2994741191 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2c30014780 con 0x7f2c340fd150 2024-03-12T16:31:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.771+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2c34108280 con 0x7f2c340fd150 2024-03-12T16:31:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.772+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2c34108840 con 0x7f2c340fd150 2024-03-12T16:31:07.771 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.772+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2c3405f590 con 0x7f2c340fd150 2024-03-12T16:31:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.773+0000 7f2c26ffd700 1 -- 172.21.15.6:0/2994741191 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2c30007ca0 con 0x7f2c340fd150 2024-03-12T16:31:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.773+0000 7f2c26ffd700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2c2006caa0 0x7f2c2006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.774+0000 7f2c26ffd700 1 -- 172.21.15.6:0/2994741191 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2c3008bc90 con 0x7f2c340fd150 2024-03-12T16:31:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.774+0000 7f2c39d8e700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2c2006caa0 0x7f2c2006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:07.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.774+0000 7f2c39d8e700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2c2006caa0 0x7f2c2006ef60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f2c28004f10 tx=0x7f2c2800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:07.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:07.778+0000 7f2c26ffd700 1 -- 172.21.15.6:0/2994741191 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2c300597f0 con 0x7f2c340fd150 2024-03-12T16:31:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.057+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f2c34047540 con 0x7f2c340fd150 2024-03-12T16:31:08.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.058+0000 7f2c26ffd700 1 -- 172.21.15.6:0/2994741191 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f2c30059380 con 0x7f2c340fd150 2024-03-12T16:31:08.055 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:31:08.056 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:31:08.056 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:31:08.056 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:31:08.056 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:31:08.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2c2006caa0 msgr2=0x7f2c2006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2c2006caa0 0x7f2c2006ef60 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 rx=0x7f2c28004f10 tx=0x7f2c2800b040).stop 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fd150 msgr2=0x7f2c3410e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fd150 0x7f2c3410e4b0 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 rx=0x7f2c30002780 tx=0x7f2c30009ee0).stop 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 shutdown_connections 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2c340fc7f0 0x7f2c3410dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2c2006caa0 0x7f2c2006ef60 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 --2- 172.21.15.6:0/2994741191 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2c340fd150 0x7f2c3410e4b0 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 >> 172.21.15.6:0/2994741191 conn(0x7f2c34070590 msgr2=0x7f2c34060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 shutdown_connections 2024-03-12T16:31:08.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:08.060+0000 7f2c3bff2700 1 -- 172.21.15.6:0/2994741191 wait complete. 2024-03-12T16:31:08.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:07 smithi134 ceph-mon[85099]: from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:08.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:07 smithi134 ceph-mon[85099]: pgmap v536: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:08.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:07 smithi134 ceph-mon[85099]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:08.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:07 smithi134 ceph-mon[85099]: from='client.35012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:08.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:07 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1291726459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:31:08.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:07 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1638165305' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:31:08.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:07 smithi006 ceph-mon[103869]: from='client.35004 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:08.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:07 smithi006 ceph-mon[103869]: pgmap v536: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:08.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:07 smithi006 ceph-mon[103869]: from='client.35008 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:08.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:07 smithi006 ceph-mon[103869]: from='client.35012 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:08.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:07 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1291726459' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:31:08.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:07 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1638165305' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:31:09.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:08 smithi134 ceph-mon[85099]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:09.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:08 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2994741191' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:31:09.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:08 smithi006 ceph-mon[103869]: from='client.35024 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:09.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:08 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2994741191' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:31:10.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:09 smithi134 ceph-mon[85099]: pgmap v537: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:10.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:09 smithi006 ceph-mon[103869]: pgmap v537: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:12.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:11 smithi134 ceph-mon[85099]: pgmap v538: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:12.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:11 smithi006 ceph-mon[103869]: pgmap v538: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:14.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:13 smithi134 ceph-mon[85099]: pgmap v539: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:14.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:13 smithi006 ceph-mon[103869]: pgmap v539: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:16.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:15 smithi134 ceph-mon[85099]: pgmap v540: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:16.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:15 smithi006 ceph-mon[103869]: pgmap v540: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:18.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:17 smithi134 ceph-mon[85099]: pgmap v541: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:18.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:31:18.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:17 smithi006 ceph-mon[103869]: pgmap v541: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:18.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:31:20.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:19 smithi134 ceph-mon[85099]: pgmap v542: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:20.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:19 smithi006 ceph-mon[103869]: pgmap v542: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:22.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:21 smithi134 ceph-mon[85099]: pgmap v543: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:22.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:21 smithi006 ceph-mon[103869]: pgmap v543: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:24.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:23 smithi134 ceph-mon[85099]: pgmap v544: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:24.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:23 smithi006 ceph-mon[103869]: pgmap v544: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:26.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:25 smithi134 ceph-mon[85099]: pgmap v545: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:26.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:25 smithi006 ceph-mon[103869]: pgmap v545: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:28.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:27 smithi134 ceph-mon[85099]: pgmap v546: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:28.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:27 smithi006 ceph-mon[103869]: pgmap v546: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:30.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:29 smithi134 ceph-mon[85099]: pgmap v547: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:30.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:29 smithi006 ceph-mon[103869]: pgmap v547: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:32.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:31 smithi134 ceph-mon[85099]: pgmap v548: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:32.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:31 smithi006 ceph-mon[103869]: pgmap v548: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:33.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:31:33.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:31:34.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:33 smithi134 ceph-mon[85099]: pgmap v549: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:34.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:33 smithi006 ceph-mon[103869]: pgmap v549: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:36.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:35 smithi134 ceph-mon[85099]: pgmap v550: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:36.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:35 smithi006 ceph-mon[103869]: pgmap v550: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.177+0000 7f3151029700 1 -- 172.21.15.6:0/4142312884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 msgr2=0x7f314c101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.177+0000 7f3151029700 1 --2- 172.21.15.6:0/4142312884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 0x7f314c101910 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 rx=0x7f31340047f0 tx=0x7f3134009cb0).stop 2024-03-12T16:31:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.177+0000 7f3151029700 1 -- 172.21.15.6:0/4142312884 shutdown_connections 2024-03-12T16:31:38.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.177+0000 7f3151029700 1 --2- 172.21.15.6:0/4142312884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 0x7f314c101910 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.177+0000 7f3151029700 1 --2- 172.21.15.6:0/4142312884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f314c0f88a0 0x7f314c0f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.177+0000 7f3151029700 1 -- 172.21.15.6:0/4142312884 >> 172.21.15.6:0/4142312884 conn(0x7f314c070590 msgr2=0x7f314c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.177+0000 7f3151029700 1 -- 172.21.15.6:0/4142312884 shutdown_connections 2024-03-12T16:31:38.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.177+0000 7f3151029700 1 -- 172.21.15.6:0/4142312884 wait complete. 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.177+0000 7f3151029700 1 Processor -- start 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f3151029700 1 -- start start 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f3151029700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f314c0f88a0 0x7f314c10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f3151029700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 0x7f314c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f3151029700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c10eb70 con 0x7f314c0f9200 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f3151029700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f314c10ecb0 con 0x7f314c0f88a0 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f314a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 0x7f314c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f314a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 0x7f314c10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42850/0 (socket says 172.21.15.6:42850) 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f314a59c700 1 -- 172.21.15.6:0/553561463 learned_addr learned my addr 172.21.15.6:0/553561463 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f314ad9d700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f314c0f88a0 0x7f314c10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f314a59c700 1 -- 172.21.15.6:0/553561463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f314c0f88a0 msgr2=0x7f314c10e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.178+0000 7f314a59c700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f314c0f88a0 0x7f314c10e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.179+0000 7f314a59c700 1 -- 172.21.15.6:0/553561463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3134005040 con 0x7f314c0f9200 2024-03-12T16:31:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.179+0000 7f314a59c700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 0x7f314c10e570 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f3134005010 tx=0x7f3134009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.179+0000 7f3143fff700 1 -- 172.21.15.6:0/553561463 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f313400e030 con 0x7f314c0f9200 2024-03-12T16:31:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.179+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f314c1082e0 con 0x7f314c0f9200 2024-03-12T16:31:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.179+0000 7f3143fff700 1 -- 172.21.15.6:0/553561463 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3134007e90 con 0x7f314c0f9200 2024-03-12T16:31:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.179+0000 7f3143fff700 1 -- 172.21.15.6:0/553561463 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3134018070 con 0x7f314c0f9200 2024-03-12T16:31:38.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.179+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f314c1087c0 con 0x7f314c0f9200 2024-03-12T16:31:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.180+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f314c05f590 con 0x7f314c0f9200 2024-03-12T16:31:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.181+0000 7f3143fff700 1 -- 172.21.15.6:0/553561463 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f313401d6e0 con 0x7f314c0f9200 2024-03-12T16:31:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.181+0000 7f3143fff700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f313806ca30 0x7f313806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.181+0000 7f3143fff700 1 -- 172.21.15.6:0/553561463 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f313408d030 con 0x7f314c0f9200 2024-03-12T16:31:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.181+0000 7f314ad9d700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f313806ca30 0x7f313806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:38.178 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.181+0000 7f314ad9d700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f313806ca30 0x7f313806eef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f313c009250 tx=0x7f313c009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:38.182 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.186+0000 7f3143fff700 1 -- 172.21.15.6:0/553561463 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f313405ab90 con 0x7f314c0f9200 2024-03-12T16:31:38.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:37 smithi134 ceph-mon[85099]: pgmap v551: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:38.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:37 smithi006 ceph-mon[103869]: pgmap v551: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:38.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.403+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f314c109770 con 0x7f313806ca30 2024-03-12T16:31:38.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.404+0000 7f3143fff700 1 -- 172.21.15.6:0/553561463 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f314c109770 con 0x7f313806ca30 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f313806ca30 msgr2=0x7f313806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f313806ca30 0x7f313806eef0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 rx=0x7f313c009250 tx=0x7f313c009de0).stop 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 msgr2=0x7f314c10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 0x7f314c10e570 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 rx=0x7f3134005010 tx=0x7f3134009cb0).stop 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 shutdown_connections 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f314c0f88a0 0x7f314c10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f313806ca30 0x7f313806eef0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 --2- 172.21.15.6:0/553561463 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f314c0f9200 0x7f314c10e570 unknown :-1 s=CLOSED pgs=482 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 >> 172.21.15.6:0/553561463 conn(0x7f314c070590 msgr2=0x7f314c0fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 shutdown_connections 2024-03-12T16:31:38.403 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.406+0000 7f3151029700 1 -- 172.21.15.6:0/553561463 wait complete. 2024-03-12T16:31:38.412 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.509+0000 7f5c05468700 1 -- 172.21.15.6:0/1934641724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f9200 msgr2=0x7f5c00101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.509+0000 7f5c05468700 1 --2- 172.21.15.6:0/1934641724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f9200 0x7f5c00101910 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 rx=0x7f5bf40047f0 tx=0x7f5bf4009cb0).stop 2024-03-12T16:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.509+0000 7f5c05468700 1 -- 172.21.15.6:0/1934641724 shutdown_connections 2024-03-12T16:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.509+0000 7f5c05468700 1 --2- 172.21.15.6:0/1934641724 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f9200 0x7f5c00101910 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.509+0000 7f5c05468700 1 --2- 172.21.15.6:0/1934641724 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000f88a0 0x7f5c000f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.509+0000 7f5c05468700 1 -- 172.21.15.6:0/1934641724 >> 172.21.15.6:0/1934641724 conn(0x7f5c00070590 msgr2=0x7f5c000f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.510+0000 7f5c05468700 1 -- 172.21.15.6:0/1934641724 shutdown_connections 2024-03-12T16:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.510+0000 7f5c05468700 1 -- 172.21.15.6:0/1934641724 wait complete. 2024-03-12T16:31:38.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.510+0000 7f5c05468700 1 Processor -- start 2024-03-12T16:31:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.510+0000 7f5c05468700 1 -- start start 2024-03-12T16:31:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5c05468700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f88a0 0x7f5c000f6850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5c05468700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000f9200 0x7f5c000f6d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:38.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5c05468700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000f7230 con 0x7f5c000f88a0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5c05468700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5c000f7370 con 0x7f5c000f9200 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5bfeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f88a0 0x7f5c000f6850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5bfeffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f88a0 0x7f5c000f6850 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42870/0 (socket says 172.21.15.6:42870) 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5bfeffd700 1 -- 172.21.15.6:0/1372073110 learned_addr learned my addr 172.21.15.6:0/1372073110 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5bfe7fc700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000f9200 0x7f5c000f6d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5bfeffd700 1 -- 172.21.15.6:0/1372073110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000f9200 msgr2=0x7f5c000f6d40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5bfeffd700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000f9200 0x7f5c000f6d40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5bfeffd700 1 -- 172.21.15.6:0/1372073110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5bf4005040 con 0x7f5c000f88a0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5bfeffd700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f88a0 0x7f5c000f6850 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f5bf0002770 tx=0x7f5bf0002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5be7fff700 1 -- 172.21.15.6:0/1372073110 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf0007b40 con 0x7f5c000f88a0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5be7fff700 1 -- 172.21.15.6:0/1372073110 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5bf000f040 con 0x7f5c000f88a0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5c000f7620 con 0x7f5c000f88a0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5be7fff700 1 -- 172.21.15.6:0/1372073110 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5bf0014820 con 0x7f5c000f88a0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.511+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5c001146e0 con 0x7f5c000f88a0 2024-03-12T16:31:38.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.512+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5c0005f590 con 0x7f5c000f88a0 2024-03-12T16:31:38.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.513+0000 7f5be7fff700 1 -- 172.21.15.6:0/1372073110 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5bf0009110 con 0x7f5c000f88a0 2024-03-12T16:31:38.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.513+0000 7f5be7fff700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5be806caa0 0x7f5be806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:38.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.513+0000 7f5be7fff700 1 -- 172.21.15.6:0/1372073110 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5bf008b970 con 0x7f5c000f88a0 2024-03-12T16:31:38.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.513+0000 7f5bfe7fc700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5be806caa0 0x7f5be806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:38.511 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.514+0000 7f5bfe7fc700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5be806caa0 0x7f5be806ef60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f5c000f7ff0 tx=0x7f5bf400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:38.514 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.518+0000 7f5be7fff700 1 -- 172.21.15.6:0/1372073110 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5bf0055a40 con 0x7f5c000f88a0 2024-03-12T16:31:38.732 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.736+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f5c00059120 con 0x7f5be806caa0 2024-03-12T16:31:38.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.738+0000 7f5be7fff700 1 -- 172.21.15.6:0/1372073110 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f5c00059120 con 0x7f5be806caa0 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5be806caa0 msgr2=0x7f5be806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5be806caa0 0x7f5be806ef60 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 rx=0x7f5c000f7ff0 tx=0x7f5bf400b040).stop 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f88a0 msgr2=0x7f5c000f6850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f88a0 0x7f5c000f6850 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 rx=0x7f5bf0002770 tx=0x7f5bf0002a80).stop 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 shutdown_connections 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5be806caa0 0x7f5be806ef60 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5c000f88a0 0x7f5c000f6850 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 --2- 172.21.15.6:0/1372073110 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5c000f9200 0x7f5c000f6d40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 >> 172.21.15.6:0/1372073110 conn(0x7f5c00070590 msgr2=0x7f5c000fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 shutdown_connections 2024-03-12T16:31:38.736 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.740+0000 7f5c05468700 1 -- 172.21.15.6:0/1372073110 wait complete. 2024-03-12T16:31:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.841+0000 7f50c01c4700 1 -- 172.21.15.6:0/1804610549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 msgr2=0x7f50b80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.841+0000 7f50c01c4700 1 --2- 172.21.15.6:0/1804610549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 0x7f50b80f6930 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 rx=0x7f50a80047f0 tx=0x7f50a8009cb0).stop 2024-03-12T16:31:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.841+0000 7f50c01c4700 1 -- 172.21.15.6:0/1804610549 shutdown_connections 2024-03-12T16:31:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.841+0000 7f50c01c4700 1 --2- 172.21.15.6:0/1804610549 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 0x7f50b80f6930 unknown :-1 s=CLOSED pgs=485 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.841+0000 7f50c01c4700 1 --2- 172.21.15.6:0/1804610549 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50b80fc7f0 0x7f50b80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:31:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.841+0000 7f50c01c4700 1 -- 172.21.15.6:0/1804610549 >> 172.21.15.6:0/1804610549 conn(0x7f50b8070590 msgr2=0x7f50b80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:38.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.841+0000 7f50c01c4700 1 -- 172.21.15.6:0/1804610549 shutdown_connections 2024-03-12T16:31:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.841+0000 7f50c01c4700 1 -- 172.21.15.6:0/1804610549 wait complete. 2024-03-12T16:31:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.842+0000 7f50c01c4700 1 Processor -- start 2024-03-12T16:31:38.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.842+0000 7f50c01c4700 1 -- start start 2024-03-12T16:31:38.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.842+0000 7f50c01c4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50b80fc7f0 0x7f50b810e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:38.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.842+0000 7f50c01c4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 0x7f50b810e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:38.840 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.842+0000 7f50c01c4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b810ebc0 con 0x7f50b80fd150 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.842+0000 7f50c01c4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f50b81081e0 con 0x7f50b80fc7f0 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.842+0000 7f50bd75f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 0x7f50b810e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50bd75f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 0x7f50b810e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42888/0 (socket says 172.21.15.6:42888) 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50bd75f700 1 -- 172.21.15.6:0/1150351565 learned_addr learned my addr 172.21.15.6:0/1150351565 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50bdf60700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50b80fc7f0 0x7f50b810e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50bd75f700 1 -- 172.21.15.6:0/1150351565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50b80fc7f0 msgr2=0x7f50b810e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50bd75f700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50b80fc7f0 0x7f50b810e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50bd75f700 1 -- 172.21.15.6:0/1150351565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f50a8005040 con 0x7f50b80fd150 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50bd75f700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 0x7f50b810e530 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f50a8000c00 tx=0x7f50a8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50aeffd700 1 -- 172.21.15.6:0/1150351565 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50a800e030 con 0x7f50b80fd150 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50aeffd700 1 -- 172.21.15.6:0/1150351565 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f50a8007e90 con 0x7f50b80fd150 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f50b8108430 con 0x7f50b80fd150 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50aeffd700 1 -- 172.21.15.6:0/1150351565 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f50a8018070 con 0x7f50b80fd150 2024-03-12T16:31:38.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.843+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f50b8108910 con 0x7f50b80fd150 2024-03-12T16:31:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.844+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f50b805f590 con 0x7f50b80fd150 2024-03-12T16:31:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.845+0000 7f50aeffd700 1 -- 172.21.15.6:0/1150351565 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f50a801d420 con 0x7f50b80fd150 2024-03-12T16:31:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.845+0000 7f50aeffd700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f50a406cab0 0x7f50a406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.845+0000 7f50aeffd700 1 -- 172.21.15.6:0/1150351565 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f50a808d260 con 0x7f50b80fd150 2024-03-12T16:31:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.845+0000 7f50bdf60700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f50a406cab0 0x7f50a406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:38.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.845+0000 7f50bdf60700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f50a406cab0 0x7f50a406ef70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f50b400b910 tx=0x7f50b4008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:38.845 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:38.849+0000 7f50aeffd700 1 -- 172.21.15.6:0/1150351565 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f50a805ae80 con 0x7f50b80fd150 2024-03-12T16:31:39.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.057+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f50b8109730 con 0x7f50a406cab0 2024-03-12T16:31:39.063 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.067+0000 7f50aeffd700 1 -- 172.21.15.6:0/1150351565 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f50b8109730 con 0x7f50a406cab0 2024-03-12T16:31:39.063 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:31:39.063 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (18m) 12m ago 29m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:31:39.063 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (16m) 12m ago 29m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:31:39.063 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (16m) 11m ago 28m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (18m) 12m ago 29m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (12m) 12m ago 24m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (12m) 12m ago 24m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (12m) 11m ago 24m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (11m) 11m ago 24m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (20m) 12m ago 30m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (19m) 11m ago 28m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (17m) 12m ago 30m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (16m) 11m ago 28m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (19m) 12m ago 29m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (18m) 11m ago 28m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (15m) 12m ago 28m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (15m) 12m ago 27m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:31:39.064 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (14m) 12m ago 27m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:31:39.065 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (14m) 11m ago 26m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:31:39.065 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (13m) 11m ago 26m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:31:39.065 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (12m) 11m ago 25m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:31:39.065 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (18m) 11m ago 27m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:31:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f50a406cab0 msgr2=0x7f50a406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f50a406cab0 0x7f50a406ef70 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 rx=0x7f50b400b910 tx=0x7f50b4008040).stop 2024-03-12T16:31:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 msgr2=0x7f50b810e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 0x7f50b810e530 secure :-1 s=READY pgs=486 cs=0 l=1 rev1=1 rx=0x7f50a8000c00 tx=0x7f50a8009cb0).stop 2024-03-12T16:31:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 shutdown_connections 2024-03-12T16:31:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f50b80fc7f0 0x7f50b810e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f50a406cab0 0x7f50a406ef70 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 --2- 172.21.15.6:0/1150351565 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f50b80fd150 0x7f50b810e530 unknown :-1 s=CLOSED pgs=486 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 >> 172.21.15.6:0/1150351565 conn(0x7f50b8070590 msgr2=0x7f50b8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 shutdown_connections 2024-03-12T16:31:39.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.069+0000 7f50c01c4700 1 -- 172.21.15.6:0/1150351565 wait complete. 2024-03-12T16:31:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.169+0000 7f512b2ba700 1 -- 172.21.15.6:0/2177102813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 msgr2=0x7f51240fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.169+0000 7f512b2ba700 1 --2- 172.21.15.6:0/2177102813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 0x7f51240fdcf0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 rx=0x7f51200047f0 tx=0x7f5120009cb0).stop 2024-03-12T16:31:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.169+0000 7f512b2ba700 1 -- 172.21.15.6:0/2177102813 shutdown_connections 2024-03-12T16:31:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.169+0000 7f512b2ba700 1 --2- 172.21.15.6:0/2177102813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51240fe270 0x7f51240f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.169+0000 7f512b2ba700 1 --2- 172.21.15.6:0/2177102813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 0x7f51240fdcf0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.169+0000 7f512b2ba700 1 -- 172.21.15.6:0/2177102813 >> 172.21.15.6:0/2177102813 conn(0x7f51240f3530 msgr2=0x7f51240f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.170+0000 7f512b2ba700 1 -- 172.21.15.6:0/2177102813 shutdown_connections 2024-03-12T16:31:39.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.170+0000 7f512b2ba700 1 -- 172.21.15.6:0/2177102813 wait complete. 2024-03-12T16:31:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.170+0000 7f512b2ba700 1 Processor -- start 2024-03-12T16:31:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.170+0000 7f512b2ba700 1 -- start start 2024-03-12T16:31:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.170+0000 7f512b2ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 0x7f512410e0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.170+0000 7f512b2ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51240fe270 0x7f512410e5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:39.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.170+0000 7f512b2ba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512410eba0 con 0x7f51240fd910 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.170+0000 7f512b2ba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f512410ece0 con 0x7f51240fe270 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f5129056700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 0x7f512410e0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f5129056700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 0x7f512410e0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42916/0 (socket says 172.21.15.6:42916) 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f5129056700 1 -- 172.21.15.6:0/4107116073 learned_addr learned my addr 172.21.15.6:0/4107116073 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f5128855700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51240fe270 0x7f512410e5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f5129056700 1 -- 172.21.15.6:0/4107116073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51240fe270 msgr2=0x7f512410e5a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f5129056700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51240fe270 0x7f512410e5a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f5129056700 1 -- 172.21.15.6:0/4107116073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5120005040 con 0x7f51240fd910 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f5129056700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 0x7f512410e0b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f5120005010 tx=0x7f5120009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f511a777700 1 -- 172.21.15.6:0/4107116073 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f512000e030 con 0x7f51240fd910 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f511a777700 1 -- 172.21.15.6:0/4107116073 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5120007e90 con 0x7f51240fd910 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f511a777700 1 -- 172.21.15.6:0/4107116073 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5120018070 con 0x7f51240fd910 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5124108310 con 0x7f51240fd910 2024-03-12T16:31:39.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.171+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f51241087f0 con 0x7f51240fd910 2024-03-12T16:31:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.172+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f512405f570 con 0x7f51240fd910 2024-03-12T16:31:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.173+0000 7f511a777700 1 -- 172.21.15.6:0/4107116073 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f512001d670 con 0x7f51240fd910 2024-03-12T16:31:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.173+0000 7f511a777700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f511006caa0 0x7f511006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.173+0000 7f511a777700 1 -- 172.21.15.6:0/4107116073 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f512008d010 con 0x7f51240fd910 2024-03-12T16:31:39.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.173+0000 7f5128855700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f511006caa0 0x7f511006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:39.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.174+0000 7f5128855700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f511006caa0 0x7f511006ef60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f51241099f0 tx=0x7f511400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:39.174 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.178+0000 7f511a777700 1 -- 172.21.15.6:0/4107116073 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f512005ab70 con 0x7f51240fd910 2024-03-12T16:31:39.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.458+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f5124047540 con 0x7f51240fd910 2024-03-12T16:31:39.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.459+0000 7f511a777700 1 -- 172.21.15.6:0/4107116073 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f512005a700 con 0x7f51240fd910 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:31:39.456 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:31:39.457 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:31:39.457 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:31:39.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f511006caa0 msgr2=0x7f511006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f511006caa0 0x7f511006ef60 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 rx=0x7f51241099f0 tx=0x7f511400b040).stop 2024-03-12T16:31:39.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 msgr2=0x7f512410e0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.457 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 0x7f512410e0b0 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 rx=0x7f5120005010 tx=0x7f5120009cb0).stop 2024-03-12T16:31:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 shutdown_connections 2024-03-12T16:31:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f511006caa0 0x7f511006ef60 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f51240fd910 0x7f512410e0b0 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 --2- 172.21.15.6:0/4107116073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f51240fe270 0x7f512410e5a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 >> 172.21.15.6:0/4107116073 conn(0x7f51240f3530 msgr2=0x7f51240fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 shutdown_connections 2024-03-12T16:31:39.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.461+0000 7f512b2ba700 1 -- 172.21.15.6:0/4107116073 wait complete. 2024-03-12T16:31:39.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.563+0000 7efcbe098700 1 -- 172.21.15.6:0/549293449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 msgr2=0x7efcb80fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.563+0000 7efcbe098700 1 --2- 172.21.15.6:0/549293449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 0x7efcb80fdcf0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 rx=0x7efca80047f0 tx=0x7efca8009cb0).stop 2024-03-12T16:31:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.563+0000 7efcbe098700 1 -- 172.21.15.6:0/549293449 shutdown_connections 2024-03-12T16:31:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.563+0000 7efcbe098700 1 --2- 172.21.15.6:0/549293449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcb80fe270 0x7efcb80f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.563+0000 7efcbe098700 1 --2- 172.21.15.6:0/549293449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 0x7efcb80fdcf0 unknown :-1 s=CLOSED pgs=489 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.563+0000 7efcbe098700 1 -- 172.21.15.6:0/549293449 >> 172.21.15.6:0/549293449 conn(0x7efcb80f3510 msgr2=0x7efcb80f5930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.563+0000 7efcbe098700 1 -- 172.21.15.6:0/549293449 shutdown_connections 2024-03-12T16:31:39.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.563+0000 7efcbe098700 1 -- 172.21.15.6:0/549293449 wait complete. 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.564+0000 7efcbe098700 1 Processor -- start 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.564+0000 7efcbe098700 1 -- start start 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.564+0000 7efcbe098700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 0x7efcb810e000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.564+0000 7efcbe098700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcb80fe270 0x7efcb810e4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.564+0000 7efcbe098700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb810eaf0 con 0x7efcb80fd910 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.564+0000 7efcbe098700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7efcb810ec30 con 0x7efcb80fe270 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 0x7efcb810e000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb77fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 0x7efcb810e000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42936/0 (socket says 172.21.15.6:42936) 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb77fe700 1 -- 172.21.15.6:0/2672436219 learned_addr learned my addr 172.21.15.6:0/2672436219 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb6ffd700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcb80fe270 0x7efcb810e4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb77fe700 1 -- 172.21.15.6:0/2672436219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcb80fe270 msgr2=0x7efcb810e4f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb77fe700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcb80fe270 0x7efcb810e4f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.562 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb77fe700 1 -- 172.21.15.6:0/2672436219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7efca8005040 con 0x7efcb80fd910 2024-03-12T16:31:39.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb77fe700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 0x7efcb810e000 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7efca8005010 tx=0x7efca8009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:39.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb4ff9700 1 -- 172.21.15.6:0/2672436219 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca800e030 con 0x7efcb80fd910 2024-03-12T16:31:39.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb4ff9700 1 -- 172.21.15.6:0/2672436219 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7efca8007e90 con 0x7efcb80fd910 2024-03-12T16:31:39.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7efcb8108260 con 0x7efcb80fd910 2024-03-12T16:31:39.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcb4ff9700 1 -- 172.21.15.6:0/2672436219 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7efca8018070 con 0x7efcb80fd910 2024-03-12T16:31:39.563 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.565+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7efcb81087c0 con 0x7efcb80fd910 2024-03-12T16:31:39.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.566+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7efcb8060650 con 0x7efcb80fd910 2024-03-12T16:31:39.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.567+0000 7efcb4ff9700 1 -- 172.21.15.6:0/2672436219 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7efca801d6e0 con 0x7efcb80fd910 2024-03-12T16:31:39.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.567+0000 7efcb4ff9700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efca006ca30 0x7efca006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:39.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.567+0000 7efcb4ff9700 1 -- 172.21.15.6:0/2672436219 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7efca808d040 con 0x7efcb80fd910 2024-03-12T16:31:39.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.567+0000 7efcb6ffd700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efca006ca30 0x7efca006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:39.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.568+0000 7efcb6ffd700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efca006ca30 0x7efca006eef0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7efcb8109940 tx=0x7efcac009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:39.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.572+0000 7efcb4ff9700 1 -- 172.21.15.6:0/2672436219 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7efca805a910 con 0x7efcb80fd910 2024-03-12T16:31:39.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:39 smithi134 ceph-mon[85099]: pgmap v552: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:39.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:39 smithi134 ceph-mon[85099]: from='client.35032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:39.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:39 smithi134 ceph-mon[85099]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:39.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:39 smithi006 ceph-mon[103869]: pgmap v552: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:39.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:39 smithi006 ceph-mon[103869]: from='client.35032 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:39.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:39 smithi006 ceph-mon[103869]: from='client.35036 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:39.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.812+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7efcb80ffc60 con 0x7efcb80fd910 2024-03-12T16:31:39.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.813+0000 7efcb4ff9700 1 -- 172.21.15.6:0/2672436219 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7efca805a730 con 0x7efcb80fd910 2024-03-12T16:31:39.809 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:31:39.809 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:31:39.809 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:31:39.809 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:31:39.809 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:31:39.809 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:31:39.810 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:31:39.811 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:31:39.812 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:31:39.812 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:31:39.812 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:31:39.812 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:31:39.812 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:31:39.812 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:31:39.812 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efca006ca30 msgr2=0x7efca006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efca006ca30 0x7efca006eef0 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 rx=0x7efcb8109940 tx=0x7efcac009d60).stop 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 msgr2=0x7efcb810e000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 0x7efcb810e000 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 rx=0x7efca8005010 tx=0x7efca8009cb0).stop 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 shutdown_connections 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7efca006ca30 0x7efca006eef0 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7efcb80fd910 0x7efcb810e000 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 --2- 172.21.15.6:0/2672436219 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7efcb80fe270 0x7efcb810e4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 >> 172.21.15.6:0/2672436219 conn(0x7efcb80f3510 msgr2=0x7efcb80fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:39.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 shutdown_connections 2024-03-12T16:31:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.815+0000 7efcbe098700 1 -- 172.21.15.6:0/2672436219 wait complete. 2024-03-12T16:31:39.814 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:31:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.917+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2088402415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fd8f0 msgr2=0x7f2b840fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.917+0000 7f2b8ae9e700 1 --2- 172.21.15.6:0/2088402415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fd8f0 0x7f2b840fdcd0 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 rx=0x7f2b780047f0 tx=0x7f2b78009cb0).stop 2024-03-12T16:31:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.917+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2088402415 shutdown_connections 2024-03-12T16:31:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.917+0000 7f2b8ae9e700 1 --2- 172.21.15.6:0/2088402415 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b840fe250 0x7f2b840f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.917+0000 7f2b8ae9e700 1 --2- 172.21.15.6:0/2088402415 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fd8f0 0x7f2b840fdcd0 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.917+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2088402415 >> 172.21.15.6:0/2088402415 conn(0x7f2b840f34b0 msgr2=0x7f2b840f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.918+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2088402415 shutdown_connections 2024-03-12T16:31:39.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.918+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2088402415 wait complete. 2024-03-12T16:31:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.918+0000 7f2b8ae9e700 1 Processor -- start 2024-03-12T16:31:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.918+0000 7f2b8ae9e700 1 -- start start 2024-03-12T16:31:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.918+0000 7f2b8ae9e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b840fd8f0 0x7f2b8410dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.918+0000 7f2b8ae9e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fe250 0x7f2b8410e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.918+0000 7f2b8ae9e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8410ead0 con 0x7f2b840fe250 2024-03-12T16:31:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.918+0000 7f2b8ae9e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2b8410ec10 con 0x7f2b840fd8f0 2024-03-12T16:31:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.918+0000 7f2b83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fe250 0x7f2b8410e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:39.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b83fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fe250 0x7f2b8410e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42948/0 (socket says 172.21.15.6:42948) 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b83fff700 1 -- 172.21.15.6:0/2893308909 learned_addr learned my addr 172.21.15.6:0/2893308909 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b88c3a700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b840fd8f0 0x7f2b8410dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b83fff700 1 -- 172.21.15.6:0/2893308909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b840fd8f0 msgr2=0x7f2b8410dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b83fff700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b840fd8f0 0x7f2b8410dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b83fff700 1 -- 172.21.15.6:0/2893308909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2b78005040 con 0x7f2b840fe250 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b88c3a700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b840fd8f0 0x7f2b8410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b83fff700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fe250 0x7f2b8410e4d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f2b70002780 tx=0x7f2b70009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b81ffb700 1 -- 172.21.15.6:0/2893308909 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b70007b40 con 0x7f2b840fe250 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b81ffb700 1 -- 172.21.15.6:0/2893308909 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2b7000f040 con 0x7f2b840fe250 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2b841082a0 con 0x7f2b840fe250 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b81ffb700 1 -- 172.21.15.6:0/2893308909 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2b70014780 con 0x7f2b840fe250 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.919+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2b84108860 con 0x7f2b840fe250 2024-03-12T16:31:39.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.920+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2b8405f590 con 0x7f2b840fe250 2024-03-12T16:31:39.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.921+0000 7f2b81ffb700 1 -- 172.21.15.6:0/2893308909 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2b70007ca0 con 0x7f2b840fe250 2024-03-12T16:31:39.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.921+0000 7f2b81ffb700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b7406caa0 0x7f2b7406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:39.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.921+0000 7f2b81ffb700 1 -- 172.21.15.6:0/2893308909 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2b7008bcf0 con 0x7f2b840fe250 2024-03-12T16:31:39.918 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.921+0000 7f2b88c3a700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b7406caa0 0x7f2b7406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:39.919 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.922+0000 7f2b88c3a700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b7406caa0 0x7f2b7406ef60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f2b780043d0 tx=0x7f2b7800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:39.921 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:39.925+0000 7f2b81ffb700 1 -- 172.21.15.6:0/2893308909 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2b70059850 con 0x7f2b840fe250 2024-03-12T16:31:40.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.141+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f2b84108ae0 con 0x7f2b7406caa0 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.143+0000 7f2b81ffb700 1 -- 172.21.15.6:0/2893308909 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f2b84108ae0 con 0x7f2b7406caa0 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:31:40.139 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:31:40.140 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:31:40.140 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:31:40.140 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:31:40.140 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:31:40.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b7406caa0 msgr2=0x7f2b7406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:40.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b7406caa0 0x7f2b7406ef60 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 rx=0x7f2b780043d0 tx=0x7f2b7800b040).stop 2024-03-12T16:31:40.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fe250 msgr2=0x7f2b8410e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:40.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fe250 0x7f2b8410e4d0 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 rx=0x7f2b70002780 tx=0x7f2b70009ee0).stop 2024-03-12T16:31:40.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 shutdown_connections 2024-03-12T16:31:40.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2b840fd8f0 0x7f2b8410dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:40.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2b7406caa0 0x7f2b7406ef60 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:40.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 --2- 172.21.15.6:0/2893308909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2b840fe250 0x7f2b8410e4d0 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:40.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 >> 172.21.15.6:0/2893308909 conn(0x7f2b840f34b0 msgr2=0x7f2b840fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:40.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 shutdown_connections 2024-03-12T16:31:40.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.145+0000 7f2b8ae9e700 1 -- 172.21.15.6:0/2893308909 wait complete. 2024-03-12T16:31:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.247+0000 7f7d60d02700 1 -- 172.21.15.6:0/2590471910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fc7f0 msgr2=0x7f7d5c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.247+0000 7f7d60d02700 1 --2- 172.21.15.6:0/2590471910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fc7f0 0x7f7d5c0fcbd0 secure :-1 s=READY pgs=493 cs=0 l=1 rev1=1 rx=0x7f7d4c0047f0 tx=0x7f7d4c009cb0).stop 2024-03-12T16:31:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.247+0000 7f7d60d02700 1 -- 172.21.15.6:0/2590471910 shutdown_connections 2024-03-12T16:31:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.247+0000 7f7d60d02700 1 --2- 172.21.15.6:0/2590471910 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d5c0fd150 0x7f7d5c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.247+0000 7f7d60d02700 1 --2- 172.21.15.6:0/2590471910 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fc7f0 0x7f7d5c0fcbd0 unknown :-1 s=CLOSED pgs=493 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:40.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.247+0000 7f7d60d02700 1 -- 172.21.15.6:0/2590471910 >> 172.21.15.6:0/2590471910 conn(0x7f7d5c0f23b0 msgr2=0x7f7d5c0f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:40.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.247+0000 7f7d60d02700 1 -- 172.21.15.6:0/2590471910 shutdown_connections 2024-03-12T16:31:40.244 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.247+0000 7f7d60d02700 1 -- 172.21.15.6:0/2590471910 wait complete. 2024-03-12T16:31:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d60d02700 1 Processor -- start 2024-03-12T16:31:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d60d02700 1 -- start start 2024-03-12T16:31:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d60d02700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d5c0fc7f0 0x7f7d5c0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d60d02700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fd150 0x7f7d5c0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d60d02700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0f8f20 con 0x7f7d5c0fd150 2024-03-12T16:31:40.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d60d02700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7d5c0f9060 con 0x7f7d5c0fc7f0 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d59d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fd150 0x7f7d5c0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d59d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fd150 0x7f7d5c0f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:42964/0 (socket says 172.21.15.6:42964) 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d59d9b700 1 -- 172.21.15.6:0/317592520 learned_addr learned my addr 172.21.15.6:0/317592520 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d59d9b700 1 -- 172.21.15.6:0/317592520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d5c0fc7f0 msgr2=0x7f7d5c0f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d5a59c700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d5c0fc7f0 0x7f7d5c0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d59d9b700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d5c0fc7f0 0x7f7d5c0f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d59d9b700 1 -- 172.21.15.6:0/317592520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7d4c005040 con 0x7f7d5c0fd150 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.248+0000 7f7d59d9b700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fd150 0x7f7d5c0f8a30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f7d50002780 tx=0x7f7d50009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.249+0000 7f7d4b7fe700 1 -- 172.21.15.6:0/317592520 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d50007b40 con 0x7f7d5c0fd150 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.249+0000 7f7d4b7fe700 1 -- 172.21.15.6:0/317592520 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7d5000f040 con 0x7f7d5c0fd150 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.249+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7d5c0f9310 con 0x7f7d5c0fd150 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.249+0000 7f7d4b7fe700 1 -- 172.21.15.6:0/317592520 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7d50014780 con 0x7f7d5c0fd150 2024-03-12T16:31:40.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.249+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7d5c1146f0 con 0x7f7d5c0fd150 2024-03-12T16:31:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.250+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7d5c060370 con 0x7f7d5c0fd150 2024-03-12T16:31:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.250+0000 7f7d4b7fe700 1 -- 172.21.15.6:0/317592520 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7d50007ca0 con 0x7f7d5c0fd150 2024-03-12T16:31:40.247 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.250+0000 7f7d4b7fe700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7d4406caa0 0x7f7d4406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:31:40.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.251+0000 7f7d4b7fe700 1 -- 172.21.15.6:0/317592520 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f7d5008bc40 con 0x7f7d5c0fd150 2024-03-12T16:31:40.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.251+0000 7f7d5a59c700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7d4406caa0 0x7f7d4406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:31:40.248 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.251+0000 7f7d5a59c700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7d4406caa0 0x7f7d4406ef60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7d4c000c00 tx=0x7f7d4c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:31:40.251 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.255+0000 7f7d4b7fe700 1 -- 172.21.15.6:0/317592520 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7d50055d10 con 0x7f7d5c0fd150 2024-03-12T16:31:40.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.540+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7d5c047540 con 0x7f7d5c0fd150 2024-03-12T16:31:40.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.541+0000 7f7d4b7fe700 1 -- 172.21.15.6:0/317592520 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f7d50059330 con 0x7f7d5c0fd150 2024-03-12T16:31:40.537 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:31:40.537 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:31:40.537 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:31:40.537 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:31:40.537 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.542+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7d4406caa0 msgr2=0x7f7d4406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.542+0000 7f7d60d02700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7d4406caa0 0x7f7d4406ef60 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 rx=0x7f7d4c000c00 tx=0x7f7d4c00b040).stop 2024-03-12T16:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.543+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fd150 msgr2=0x7f7d5c0f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.543+0000 7f7d60d02700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fd150 0x7f7d5c0f8a30 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 rx=0x7f7d50002780 tx=0x7f7d50009ee0).stop 2024-03-12T16:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.543+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 shutdown_connections 2024-03-12T16:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.543+0000 7f7d60d02700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7d5c0fc7f0 0x7f7d5c0f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.543+0000 7f7d60d02700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7d4406caa0 0x7f7d4406ef60 unknown :-1 s=CLOSED pgs=262 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.543+0000 7f7d60d02700 1 --2- 172.21.15.6:0/317592520 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7d5c0fd150 0x7f7d5c0f8a30 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:31:40.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.543+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 >> 172.21.15.6:0/317592520 conn(0x7f7d5c0f23b0 msgr2=0x7f7d5c061340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:31:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.543+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 shutdown_connections 2024-03-12T16:31:40.541 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:31:40.543+0000 7f7d60d02700 1 -- 172.21.15.6:0/317592520 wait complete. 2024-03-12T16:31:40.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:40 smithi134 ceph-mon[85099]: from='client.35040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:40.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:40 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/4107116073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:31:40.735 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:40 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2672436219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:31:40.736 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:40 smithi006 ceph-mon[103869]: from='client.35040 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:40.736 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:40 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/4107116073' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:31:40.736 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:40 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2672436219' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:31:41.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:41 smithi134 ceph-mon[85099]: pgmap v553: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:41.698 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:41 smithi134 ceph-mon[85099]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:41.699 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:41 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/317592520' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:31:41.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:41 smithi006 ceph-mon[103869]: pgmap v553: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:41.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:41 smithi006 ceph-mon[103869]: from='client.35052 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:31:41.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:41 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/317592520' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:31:43.702 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:43 smithi006 ceph-mon[103869]: pgmap v554: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:43.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:43 smithi134 ceph-mon[85099]: pgmap v554: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:45.954 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:45 smithi134 ceph-mon[85099]: pgmap v555: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:45.956 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:45 smithi006 ceph-mon[103869]: pgmap v555: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:47.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:47 smithi134 ceph-mon[85099]: pgmap v556: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:47.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:31:47.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:47 smithi006 ceph-mon[103869]: pgmap v556: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:47.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:31:49.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:49 smithi134 ceph-mon[85099]: pgmap v557: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:49.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:49 smithi006 ceph-mon[103869]: pgmap v557: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:51.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:51 smithi134 ceph-mon[85099]: pgmap v558: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:51.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:51 smithi006 ceph-mon[103869]: pgmap v558: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:53.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:53 smithi134 ceph-mon[85099]: pgmap v559: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:53.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:53 smithi006 ceph-mon[103869]: pgmap v559: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:55.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:55 smithi134 ceph-mon[85099]: pgmap v560: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:55.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:55 smithi006 ceph-mon[103869]: pgmap v560: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:57.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:57 smithi134 ceph-mon[85099]: pgmap v561: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:57.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:57 smithi006 ceph-mon[103869]: pgmap v561: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:59.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:31:59 smithi134 ceph-mon[85099]: pgmap v562: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:31:59.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:31:59 smithi006 ceph-mon[103869]: pgmap v562: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:01.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:01 smithi134 ceph-mon[85099]: pgmap v563: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:01.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:01 smithi006 ceph-mon[103869]: pgmap v563: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:02.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:32:02.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:32:03.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:03 smithi134 ceph-mon[85099]: pgmap v564: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:03.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:03 smithi006 ceph-mon[103869]: pgmap v564: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:05.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:05 smithi134 ceph-mon[85099]: pgmap v565: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:05.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:05 smithi006 ceph-mon[103869]: pgmap v565: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:07.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:07 smithi134 ceph-mon[85099]: pgmap v566: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:07.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:07 smithi006 ceph-mon[103869]: pgmap v566: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:09.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:09 smithi134 ceph-mon[85099]: pgmap v567: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:09.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:09 smithi006 ceph-mon[103869]: pgmap v567: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.659+0000 7f1f724f2700 1 -- 172.21.15.6:0/3165248610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fd910 msgr2=0x7f1f6c0fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.659+0000 7f1f724f2700 1 --2- 172.21.15.6:0/3165248610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fd910 0x7f1f6c0fdcf0 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 rx=0x7f1f5c0047f0 tx=0x7f1f5c009cb0).stop 2024-03-12T16:32:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.659+0000 7f1f724f2700 1 -- 172.21.15.6:0/3165248610 shutdown_connections 2024-03-12T16:32:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.659+0000 7f1f724f2700 1 --2- 172.21.15.6:0/3165248610 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6c0fe270 0x7f1f6c0f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:32:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.659+0000 7f1f724f2700 1 --2- 172.21.15.6:0/3165248610 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fd910 0x7f1f6c0fdcf0 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.659+0000 7f1f724f2700 1 -- 172.21.15.6:0/3165248610 >> 172.21.15.6:0/3165248610 conn(0x7f1f6c0f3530 msgr2=0x7f1f6c0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.660+0000 7f1f724f2700 1 -- 172.21.15.6:0/3165248610 shutdown_connections 2024-03-12T16:32:10.657 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.660+0000 7f1f724f2700 1 -- 172.21.15.6:0/3165248610 wait complete. 2024-03-12T16:32:10.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.660+0000 7f1f724f2700 1 Processor -- start 2024-03-12T16:32:10.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.660+0000 7f1f724f2700 1 -- start start 2024-03-12T16:32:10.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.661+0000 7f1f724f2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6c0fd910 0x7f1f6c10e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:10.663 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.661+0000 7f1f724f2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fe270 0x7f1f6c10e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.661+0000 7f1f724f2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c10ec70 con 0x7f1f6c0fe270 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.661+0000 7f1f724f2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1f6c108290 con 0x7f1f6c0fd910 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.661+0000 7f1f6b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fe270 0x7f1f6c10e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.661+0000 7f1f6b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fe270 0x7f1f6c10e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56748/0 (socket says 172.21.15.6:56748) 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.661+0000 7f1f6b7fe700 1 -- 172.21.15.6:0/1021783888 learned_addr learned my addr 172.21.15.6:0/1021783888 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.661+0000 7f1f6bfff700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6c0fd910 0x7f1f6c10e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.662+0000 7f1f6b7fe700 1 -- 172.21.15.6:0/1021783888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6c0fd910 msgr2=0x7f1f6c10e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.662+0000 7f1f6b7fe700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6c0fd910 0x7f1f6c10e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.662+0000 7f1f6b7fe700 1 -- 172.21.15.6:0/1021783888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1f5c005040 con 0x7f1f6c0fe270 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.662+0000 7f1f6b7fe700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fe270 0x7f1f6c10e5e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f1f6000b480 tx=0x7f1f600090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.662+0000 7f1f697fa700 1 -- 172.21.15.6:0/1021783888 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f60002500 con 0x7f1f6c0fe270 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.662+0000 7f1f697fa700 1 -- 172.21.15.6:0/1021783888 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1f60002b10 con 0x7f1f6c0fe270 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.662+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1f6c108540 con 0x7f1f6c0fe270 2024-03-12T16:32:10.664 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.662+0000 7f1f697fa700 1 -- 172.21.15.6:0/1021783888 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1f60012c60 con 0x7f1f6c0fe270 2024-03-12T16:32:10.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.662+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1f6c108a80 con 0x7f1f6c0fe270 2024-03-12T16:32:10.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.663+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1f6c05f570 con 0x7f1f6c0fe270 2024-03-12T16:32:10.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.663+0000 7f1f697fa700 1 -- 172.21.15.6:0/1021783888 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f1f60002660 con 0x7f1f6c0fe270 2024-03-12T16:32:10.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.664+0000 7f1f697fa700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1f5406caa0 0x7f1f5406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:10.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.664+0000 7f1f697fa700 1 -- 172.21.15.6:0/1021783888 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1f6008bd90 con 0x7f1f6c0fe270 2024-03-12T16:32:10.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.664+0000 7f1f6bfff700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1f5406caa0 0x7f1f5406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:10.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.664+0000 7f1f6bfff700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1f5406caa0 0x7f1f5406ef60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f1f5c004f10 tx=0x7f1f5c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:10.665 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.669+0000 7f1f697fa700 1 -- 172.21.15.6:0/1021783888 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1f600598f0 con 0x7f1f6c0fe270 2024-03-12T16:32:10.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.885+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1f6c1097e0 con 0x7f1f5406caa0 2024-03-12T16:32:10.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.886+0000 7f1f697fa700 1 -- 172.21.15.6:0/1021783888 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1f6c1097e0 con 0x7f1f5406caa0 2024-03-12T16:32:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.888+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1f5406caa0 msgr2=0x7f1f5406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:10.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.888+0000 7f1f724f2700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1f5406caa0 0x7f1f5406ef60 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 rx=0x7f1f5c004f10 tx=0x7f1f5c00b040).stop 2024-03-12T16:32:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.889+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fe270 msgr2=0x7f1f6c10e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.889+0000 7f1f724f2700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fe270 0x7f1f6c10e5e0 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 rx=0x7f1f6000b480 tx=0x7f1f600090f0).stop 2024-03-12T16:32:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.889+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 shutdown_connections 2024-03-12T16:32:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.889+0000 7f1f724f2700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1f6c0fd910 0x7f1f6c10e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.889+0000 7f1f724f2700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1f5406caa0 0x7f1f5406ef60 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.889+0000 7f1f724f2700 1 --2- 172.21.15.6:0/1021783888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1f6c0fe270 0x7f1f6c10e5e0 unknown :-1 s=CLOSED pgs=496 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.889+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 >> 172.21.15.6:0/1021783888 conn(0x7f1f6c0f3530 msgr2=0x7f1f6c0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.889+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 shutdown_connections 2024-03-12T16:32:10.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.889+0000 7f1f724f2700 1 -- 172.21.15.6:0/1021783888 wait complete. 2024-03-12T16:32:10.896 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.991+0000 7f6f06605700 1 -- 172.21.15.6:0/4047029260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 msgr2=0x7f6f000f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.991+0000 7f6f06605700 1 --2- 172.21.15.6:0/4047029260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 0x7f6f000f6930 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 rx=0x7f6ef40047f0 tx=0x7f6ef4009cb0).stop 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.991+0000 7f6f06605700 1 -- 172.21.15.6:0/4047029260 shutdown_connections 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.991+0000 7f6f06605700 1 --2- 172.21.15.6:0/4047029260 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 0x7f6f000f6930 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.991+0000 7f6f06605700 1 --2- 172.21.15.6:0/4047029260 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f000fc7f0 0x7f6f000fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.991+0000 7f6f06605700 1 -- 172.21.15.6:0/4047029260 >> 172.21.15.6:0/4047029260 conn(0x7f6f00070590 msgr2=0x7f6f000f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.992+0000 7f6f06605700 1 -- 172.21.15.6:0/4047029260 shutdown_connections 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.992+0000 7f6f06605700 1 -- 172.21.15.6:0/4047029260 wait complete. 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.992+0000 7f6f06605700 1 Processor -- start 2024-03-12T16:32:10.989 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.992+0000 7f6f06605700 1 -- start start 2024-03-12T16:32:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.992+0000 7f6f06605700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f000fc7f0 0x7f6f0010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6f06605700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 0x7f6f0010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6f06605700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0010eab0 con 0x7f6f000fd150 2024-03-12T16:32:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6f06605700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6f0010ebf0 con 0x7f6f000fc7f0 2024-03-12T16:32:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6eff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 0x7f6f0010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6eff7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 0x7f6f0010e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56768/0 (socket says 172.21.15.6:56768) 2024-03-12T16:32:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6eff7fe700 1 -- 172.21.15.6:0/1386822705 learned_addr learned my addr 172.21.15.6:0/1386822705 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:10.991 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6efffff700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f000fc7f0 0x7f6f0010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6eff7fe700 1 -- 172.21.15.6:0/1386822705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f000fc7f0 msgr2=0x7f6f0010dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6eff7fe700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f000fc7f0 0x7f6f0010dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6eff7fe700 1 -- 172.21.15.6:0/1386822705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ef4005040 con 0x7f6f000fd150 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6eff7fe700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 0x7f6f0010e4b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f6ef4000c00 tx=0x7f6ef4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6efd7fa700 1 -- 172.21.15.6:0/1386822705 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef400e030 con 0x7f6f000fd150 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6efd7fa700 1 -- 172.21.15.6:0/1386822705 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ef4007e90 con 0x7f6f000fd150 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6f00108220 con 0x7f6f000fd150 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6efd7fa700 1 -- 172.21.15.6:0/1386822705 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ef4018070 con 0x7f6f000fd150 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.993+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6f00108780 con 0x7f6f000fd150 2024-03-12T16:32:10.992 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.994+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6f0005f590 con 0x7f6f000fd150 2024-03-12T16:32:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.995+0000 7f6efd7fa700 1 -- 172.21.15.6:0/1386822705 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f6ef401d420 con 0x7f6f000fd150 2024-03-12T16:32:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.995+0000 7f6efd7fa700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee806cab0 0x7f6ee806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.995+0000 7f6efd7fa700 1 -- 172.21.15.6:0/1386822705 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6ef408cf20 con 0x7f6f000fd150 2024-03-12T16:32:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.995+0000 7f6efffff700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee806cab0 0x7f6ee806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:10.993 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:10.996+0000 7f6efffff700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee806cab0 0x7f6ee806ef70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f6ef0004dc0 tx=0x7f6ef000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:10.996 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.000+0000 7f6efd7fa700 1 -- 172.21.15.6:0/1386822705 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6ef40c0190 con 0x7f6f000fd150 2024-03-12T16:32:11.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.213+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6f00108dc0 con 0x7f6ee806cab0 2024-03-12T16:32:11.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.214+0000 7f6efd7fa700 1 -- 172.21.15.6:0/1386822705 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f6f00108dc0 con 0x7f6ee806cab0 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee806cab0 msgr2=0x7f6ee806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee806cab0 0x7f6ee806ef70 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 rx=0x7f6ef0004dc0 tx=0x7f6ef000b040).stop 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 msgr2=0x7f6f0010e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 0x7f6f0010e4b0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 rx=0x7f6ef4000c00 tx=0x7f6ef4009cb0).stop 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 shutdown_connections 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6f000fc7f0 0x7f6f0010dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ee806cab0 0x7f6ee806ef70 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 --2- 172.21.15.6:0/1386822705 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6f000fd150 0x7f6f0010e4b0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 >> 172.21.15.6:0/1386822705 conn(0x7f6f00070590 msgr2=0x7f6f00060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 shutdown_connections 2024-03-12T16:32:11.214 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.217+0000 7f6f06605700 1 -- 172.21.15.6:0/1386822705 wait complete. 2024-03-12T16:32:11.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.318+0000 7f534d8d9700 1 -- 172.21.15.6:0/132105580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f9200 msgr2=0x7f5348101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.318+0000 7f534d8d9700 1 --2- 172.21.15.6:0/132105580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f9200 0x7f5348101910 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 rx=0x7f533c0047f0 tx=0x7f533c009cb0).stop 2024-03-12T16:32:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.318+0000 7f534d8d9700 1 -- 172.21.15.6:0/132105580 shutdown_connections 2024-03-12T16:32:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.318+0000 7f534d8d9700 1 --2- 172.21.15.6:0/132105580 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f9200 0x7f5348101910 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.318+0000 7f534d8d9700 1 --2- 172.21.15.6:0/132105580 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480f88a0 0x7f53480f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.318+0000 7f534d8d9700 1 -- 172.21.15.6:0/132105580 >> 172.21.15.6:0/132105580 conn(0x7f53480f23b0 msgr2=0x7f53480f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.318+0000 7f534d8d9700 1 -- 172.21.15.6:0/132105580 shutdown_connections 2024-03-12T16:32:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.318+0000 7f534d8d9700 1 -- 172.21.15.6:0/132105580 wait complete. 2024-03-12T16:32:11.316 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.319+0000 7f534d8d9700 1 Processor -- start 2024-03-12T16:32:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.319+0000 7f534d8d9700 1 -- start start 2024-03-12T16:32:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.319+0000 7f534d8d9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f88a0 0x7f534810e050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.319+0000 7f534d8d9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480f9200 0x7f534810e540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.319+0000 7f534d8d9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534810eb40 con 0x7f53480f88a0 2024-03-12T16:32:11.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.319+0000 7f534d8d9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f534810ec80 con 0x7f53480f9200 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f5346ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f88a0 0x7f534810e050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f5346ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f88a0 0x7f534810e050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56790/0 (socket says 172.21.15.6:56790) 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f5346ffd700 1 -- 172.21.15.6:0/1157952909 learned_addr learned my addr 172.21.15.6:0/1157952909 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f53467fc700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480f9200 0x7f534810e540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f5346ffd700 1 -- 172.21.15.6:0/1157952909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480f9200 msgr2=0x7f534810e540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f5346ffd700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480f9200 0x7f534810e540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f5346ffd700 1 -- 172.21.15.6:0/1157952909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f533c005040 con 0x7f53480f88a0 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f5346ffd700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f88a0 0x7f534810e050 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f533800c790 tx=0x7f5338004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f532ffff700 1 -- 172.21.15.6:0/1157952909 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f533800e680 con 0x7f53480f88a0 2024-03-12T16:32:11.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f532ffff700 1 -- 172.21.15.6:0/1157952909 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f533800ec90 con 0x7f53480f88a0 2024-03-12T16:32:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5348108310 con 0x7f53480f88a0 2024-03-12T16:32:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f532ffff700 1 -- 172.21.15.6:0/1157952909 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5338012d60 con 0x7f53480f88a0 2024-03-12T16:32:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.320+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5348108850 con 0x7f53480f88a0 2024-03-12T16:32:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.321+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5348060370 con 0x7f53480f88a0 2024-03-12T16:32:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.322+0000 7f532ffff700 1 -- 172.21.15.6:0/1157952909 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5338012400 con 0x7f53480f88a0 2024-03-12T16:32:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.322+0000 7f532ffff700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f533006caa0 0x7f533006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.322+0000 7f532ffff700 1 -- 172.21.15.6:0/1157952909 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f533808b660 con 0x7f53480f88a0 2024-03-12T16:32:11.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.322+0000 7f53467fc700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f533006caa0 0x7f533006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:11.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.323+0000 7f53467fc700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f533006caa0 0x7f533006ef60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f533c007cf0 tx=0x7f533c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:11.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.327+0000 7f532ffff700 1 -- 172.21.15.6:0/1157952909 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f53380591c0 con 0x7f53480f88a0 2024-03-12T16:32:11.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.534+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f53480fee30 con 0x7f533006caa0 2024-03-12T16:32:11.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.544+0000 7f532ffff700 1 -- 172.21.15.6:0/1157952909 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f53480fee30 con 0x7f533006caa0 2024-03-12T16:32:11.542 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:32:11.543 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (18m) 12m ago 30m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (16m) 12m ago 29m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (16m) 12m ago 29m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (18m) 12m ago 29m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (13m) 12m ago 24m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (12m) 12m ago 24m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (12m) 12m ago 24m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (12m) 12m ago 24m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (20m) 12m ago 31m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (19m) 12m ago 29m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (17m) 12m ago 31m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:32:11.545 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (17m) 12m ago 29m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:32:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (19m) 12m ago 29m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:32:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (19m) 12m ago 28m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:32:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (16m) 12m ago 28m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:32:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (15m) 12m ago 28m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:32:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (15m) 12m ago 27m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:32:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (14m) 12m ago 27m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:32:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (14m) 12m ago 26m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:32:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (13m) 12m ago 26m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:32:11.546 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (19m) 12m ago 28m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:32:11.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.546+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f533006caa0 msgr2=0x7f533006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.546+0000 7f534d8d9700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f533006caa0 0x7f533006ef60 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 rx=0x7f533c007cf0 tx=0x7f533c00b040).stop 2024-03-12T16:32:11.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.546+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f88a0 msgr2=0x7f534810e050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.546+0000 7f534d8d9700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f88a0 0x7f534810e050 secure :-1 s=READY pgs=500 cs=0 l=1 rev1=1 rx=0x7f533800c790 tx=0x7f5338004330).stop 2024-03-12T16:32:11.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.546+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 shutdown_connections 2024-03-12T16:32:11.547 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.546+0000 7f534d8d9700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f533006caa0 0x7f533006ef60 unknown :-1 s=CLOSED pgs=265 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.546+0000 7f534d8d9700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f53480f88a0 0x7f534810e050 unknown :-1 s=CLOSED pgs=500 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.546+0000 7f534d8d9700 1 --2- 172.21.15.6:0/1157952909 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f53480f9200 0x7f534810e540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.546+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 >> 172.21.15.6:0/1157952909 conn(0x7f53480f23b0 msgr2=0x7f53480fc170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:11.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.547+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 shutdown_connections 2024-03-12T16:32:11.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.547+0000 7f534d8d9700 1 -- 172.21.15.6:0/1157952909 wait complete. 2024-03-12T16:32:11.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.647+0000 7fad2d861700 1 -- 172.21.15.6:0/1078037202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fd8f0 msgr2=0x7fad280fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.647+0000 7fad2d861700 1 --2- 172.21.15.6:0/1078037202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fd8f0 0x7fad280fdcd0 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 rx=0x7fad180047f0 tx=0x7fad18009cb0).stop 2024-03-12T16:32:11.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.647+0000 7fad2d861700 1 -- 172.21.15.6:0/1078037202 shutdown_connections 2024-03-12T16:32:11.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.647+0000 7fad2d861700 1 --2- 172.21.15.6:0/1078037202 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad280fe250 0x7fad280f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.647+0000 7fad2d861700 1 --2- 172.21.15.6:0/1078037202 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fd8f0 0x7fad280fdcd0 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.647+0000 7fad2d861700 1 -- 172.21.15.6:0/1078037202 >> 172.21.15.6:0/1078037202 conn(0x7fad280f34b0 msgr2=0x7fad280f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:11.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.647+0000 7fad2d861700 1 -- 172.21.15.6:0/1078037202 shutdown_connections 2024-03-12T16:32:11.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.647+0000 7fad2d861700 1 -- 172.21.15.6:0/1078037202 wait complete. 2024-03-12T16:32:11.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad2d861700 1 Processor -- start 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad2d861700 1 -- start start 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad2d861700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad280fd8f0 0x7fad2806b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad2d861700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fe250 0x7fad2806b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad2d861700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2806bab0 con 0x7fad280fe250 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad2d861700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fad2806bbf0 con 0x7fad280fd8f0 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad1e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fe250 0x7fad2806b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad1e7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fe250 0x7fad2806b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56798/0 (socket says 172.21.15.6:56798) 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad1e7fc700 1 -- 172.21.15.6:0/1812973296 learned_addr learned my addr 172.21.15.6:0/1812973296 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad26ffd700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad280fd8f0 0x7fad2806b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad1e7fc700 1 -- 172.21.15.6:0/1812973296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad280fd8f0 msgr2=0x7fad2806b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.648+0000 7fad1e7fc700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad280fd8f0 0x7fad2806b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.649+0000 7fad1e7fc700 1 -- 172.21.15.6:0/1812973296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fad18005040 con 0x7fad280fe250 2024-03-12T16:32:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.649+0000 7fad1e7fc700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fe250 0x7fad2806b5c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fad10002780 tx=0x7fad10009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.649+0000 7fad24ff9700 1 -- 172.21.15.6:0/1812973296 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad10007b40 con 0x7fad280fe250 2024-03-12T16:32:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.649+0000 7fad24ff9700 1 -- 172.21.15.6:0/1812973296 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fad1000f040 con 0x7fad280fe250 2024-03-12T16:32:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.649+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fad2806bea0 con 0x7fad280fe250 2024-03-12T16:32:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.649+0000 7fad24ff9700 1 -- 172.21.15.6:0/1812973296 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fad10014780 con 0x7fad280fe250 2024-03-12T16:32:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.649+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fad281146c0 con 0x7fad280fe250 2024-03-12T16:32:11.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.650+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fad2805f590 con 0x7fad280fe250 2024-03-12T16:32:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.650+0000 7fad24ff9700 1 -- 172.21.15.6:0/1812973296 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fad10007ca0 con 0x7fad280fe250 2024-03-12T16:32:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.651+0000 7fad24ff9700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad1406caa0 0x7fad1406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.651+0000 7fad24ff9700 1 -- 172.21.15.6:0/1812973296 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fad1008bbb0 con 0x7fad280fe250 2024-03-12T16:32:11.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.651+0000 7fad26ffd700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad1406caa0 0x7fad1406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:11.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.651+0000 7fad26ffd700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad1406caa0 0x7fad1406ef60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fad18004f10 tx=0x7fad1800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:11.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.655+0000 7fad24ff9700 1 -- 172.21.15.6:0/1812973296 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fad10092080 con 0x7fad280fe250 2024-03-12T16:32:11.937 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.940+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fad28047540 con 0x7fad280fe250 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.941+0000 7fad24ff9700 1 -- 172.21.15.6:0/1812973296 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fad10055c80 con 0x7fad280fe250 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:32:11.938 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:32:11.939 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad1406caa0 msgr2=0x7fad1406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad1406caa0 0x7fad1406ef60 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 rx=0x7fad18004f10 tx=0x7fad1800b040).stop 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fe250 msgr2=0x7fad2806b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fe250 0x7fad2806b5c0 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 rx=0x7fad10002780 tx=0x7fad10009ee0).stop 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 shutdown_connections 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fad280fd8f0 0x7fad2806b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fad1406caa0 0x7fad1406ef60 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 --2- 172.21.15.6:0/1812973296 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fad280fe250 0x7fad2806b5c0 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 >> 172.21.15.6:0/1812973296 conn(0x7fad280f34b0 msgr2=0x7fad280fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 shutdown_connections 2024-03-12T16:32:11.940 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:11.943+0000 7fad2d861700 1 -- 172.21.15.6:0/1812973296 wait complete. 2024-03-12T16:32:11.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:11 smithi134 ceph-mon[85099]: pgmap v568: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:11.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:11 smithi006 ceph-mon[103869]: pgmap v568: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.044+0000 7fe541d8c700 1 -- 172.21.15.6:0/171752943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fd150 msgr2=0x7fe53c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.044+0000 7fe541d8c700 1 --2- 172.21.15.6:0/171752943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fd150 0x7fe53c0f6930 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 rx=0x7fe5300047f0 tx=0x7fe530009cb0).stop 2024-03-12T16:32:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.044+0000 7fe541d8c700 1 -- 172.21.15.6:0/171752943 shutdown_connections 2024-03-12T16:32:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.044+0000 7fe541d8c700 1 --2- 172.21.15.6:0/171752943 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fd150 0x7fe53c0f6930 unknown :-1 s=CLOSED pgs=503 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.044+0000 7fe541d8c700 1 --2- 172.21.15.6:0/171752943 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe53c0fc7f0 0x7fe53c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.044+0000 7fe541d8c700 1 -- 172.21.15.6:0/171752943 >> 172.21.15.6:0/171752943 conn(0x7fe53c070590 msgr2=0x7fe53c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.044+0000 7fe541d8c700 1 -- 172.21.15.6:0/171752943 shutdown_connections 2024-03-12T16:32:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.044+0000 7fe541d8c700 1 -- 172.21.15.6:0/171752943 wait complete. 2024-03-12T16:32:12.042 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.045+0000 7fe541d8c700 1 Processor -- start 2024-03-12T16:32:12.043 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.045+0000 7fe541d8c700 1 -- start start 2024-03-12T16:32:12.045 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.045+0000 7fe541d8c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fc7f0 0x7fe53c0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.045+0000 7fe541d8c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe53c0fd150 0x7fe53c0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.045+0000 7fe541d8c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c0f8f20 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.045+0000 7fe541d8c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe53c0f9060 con 0x7fe53c0fd150 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.045+0000 7fe53b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fc7f0 0x7fe53c0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe53b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fc7f0 0x7fe53c0f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:56826/0 (socket says 172.21.15.6:56826) 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe53b7fe700 1 -- 172.21.15.6:0/692025615 learned_addr learned my addr 172.21.15.6:0/692025615 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe53affd700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe53c0fd150 0x7fe53c0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe53b7fe700 1 -- 172.21.15.6:0/692025615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe53c0fd150 msgr2=0x7fe53c0f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe53b7fe700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe53c0fd150 0x7fe53c0f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe53b7fe700 1 -- 172.21.15.6:0/692025615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe530005040 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe53b7fe700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fc7f0 0x7fe53c0f8540 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fe52c00c740 tx=0x7fe52c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:12.046 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe538ff9700 1 -- 172.21.15.6:0/692025615 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe52c00e680 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe53c0f9310 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe538ff9700 1 -- 172.21.15.6:0/692025615 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe52c00ec90 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe538ff9700 1 -- 172.21.15.6:0/692025615 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe52c013d30 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.046+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe53c1146b0 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.047+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe53c05f590 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.048+0000 7fe538ff9700 1 -- 172.21.15.6:0/692025615 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe52c013410 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.048+0000 7fe538ff9700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe52406cab0 0x7fe52406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.048+0000 7fe538ff9700 1 -- 172.21.15.6:0/692025615 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe52c08bfb0 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.048+0000 7fe53affd700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe52406cab0 0x7fe52406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:12.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.048+0000 7fe53affd700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe52406cab0 0x7fe52406ef70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fe53c0f9ce0 tx=0x7fe530009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:12.049 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.052+0000 7fe538ff9700 1 -- 172.21.15.6:0/692025615 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe52c056080 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.294+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fe53c0f9b20 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.291 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.294+0000 7fe538ff9700 1 -- 172.21.15.6:0/692025615 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fe52c0596a0 con 0x7fe53c0fc7f0 2024-03-12T16:32:12.291 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:32:12.292 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:32:12.293 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:32:12.294 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:32:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe52406cab0 msgr2=0x7fe52406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe52406cab0 0x7fe52406ef70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 rx=0x7fe53c0f9ce0 tx=0x7fe530009cb0).stop 2024-03-12T16:32:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fc7f0 msgr2=0x7fe53c0f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fc7f0 0x7fe53c0f8540 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 rx=0x7fe52c00c740 tx=0x7fe52c007ef0).stop 2024-03-12T16:32:12.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 shutdown_connections 2024-03-12T16:32:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe52406cab0 0x7fe52406ef70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe53c0fc7f0 0x7fe53c0f8540 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 --2- 172.21.15.6:0/692025615 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe53c0fd150 0x7fe53c0f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 >> 172.21.15.6:0/692025615 conn(0x7fe53c070590 msgr2=0x7fe53c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 shutdown_connections 2024-03-12T16:32:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.297+0000 7fe541d8c700 1 -- 172.21.15.6:0/692025615 wait complete. 2024-03-12T16:32:12.296 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:32:12.396 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.399+0000 7f1a72d65700 1 -- 172.21.15.6:0/579722336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 msgr2=0x7f1a6c0f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.399+0000 7f1a72d65700 1 --2- 172.21.15.6:0/579722336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 0x7f1a6c0f7a30 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 rx=0x7f1a580047f0 tx=0x7f1a58009cb0).stop 2024-03-12T16:32:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 -- 172.21.15.6:0/579722336 shutdown_connections 2024-03-12T16:32:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 --2- 172.21.15.6:0/579722336 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 0x7f1a6c0f7a30 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 --2- 172.21.15.6:0/579722336 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a6c0fd8f0 0x7f1a6c0fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 -- 172.21.15.6:0/579722336 >> 172.21.15.6:0/579722336 conn(0x7f1a6c0f34b0 msgr2=0x7f1a6c0f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 -- 172.21.15.6:0/579722336 shutdown_connections 2024-03-12T16:32:12.397 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 -- 172.21.15.6:0/579722336 wait complete. 2024-03-12T16:32:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 Processor -- start 2024-03-12T16:32:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 -- start start 2024-03-12T16:32:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a6c0fd8f0 0x7f1a6c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.400+0000 7f1a72d65700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 0x7f1a6c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a72d65700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c06bab0 con 0x7f1a6c0fe250 2024-03-12T16:32:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a72d65700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1a6c06bbf0 con 0x7f1a6c0fd8f0 2024-03-12T16:32:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 0x7f1a6c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:12.399 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a6bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 0x7f1a6c06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48226/0 (socket says 172.21.15.6:48226) 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a6bfff700 1 -- 172.21.15.6:0/2550566447 learned_addr learned my addr 172.21.15.6:0/2550566447 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a70b01700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a6c0fd8f0 0x7f1a6c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a6bfff700 1 -- 172.21.15.6:0/2550566447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a6c0fd8f0 msgr2=0x7f1a6c06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a6bfff700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a6c0fd8f0 0x7f1a6c06b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a6bfff700 1 -- 172.21.15.6:0/2550566447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1a58005040 con 0x7f1a6c0fe250 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a6bfff700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 0x7f1a6c06b5c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f1a58000c00 tx=0x7f1a58009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a69ffb700 1 -- 172.21.15.6:0/2550566447 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a58018070 con 0x7f1a6c0fe250 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a69ffb700 1 -- 172.21.15.6:0/2550566447 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1a58007e90 con 0x7f1a6c0fe250 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1a6c06be40 con 0x7f1a6c0fe250 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a69ffb700 1 -- 172.21.15.6:0/2550566447 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1a5801de20 con 0x7f1a6c0fe250 2024-03-12T16:32:12.400 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.401+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1a6c114740 con 0x7f1a6c0fe250 2024-03-12T16:32:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.402+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1a6c05f590 con 0x7f1a6c0fe250 2024-03-12T16:32:12.401 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.403+0000 7f1a69ffb700 1 -- 172.21.15.6:0/2550566447 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f1a5801d420 con 0x7f1a6c0fe250 2024-03-12T16:32:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.403+0000 7f1a69ffb700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1a5c06ca30 0x7f1a5c06eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.403+0000 7f1a69ffb700 1 -- 172.21.15.6:0/2550566447 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1a5808c8d0 con 0x7f1a6c0fe250 2024-03-12T16:32:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.404+0000 7f1a70b01700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1a5c06ca30 0x7f1a5c06eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:12.402 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.404+0000 7f1a70b01700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1a5c06ca30 0x7f1a5c06eef0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1a600048b0 tx=0x7f1a6000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:12.404 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.408+0000 7f1a69ffb700 1 -- 172.21.15.6:0/2550566447 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1a580569a0 con 0x7f1a6c0fe250 2024-03-12T16:32:12.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.623+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f1a6c059120 con 0x7f1a5c06ca30 2024-03-12T16:32:12.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.625+0000 7f1a69ffb700 1 -- 172.21.15.6:0/2550566447 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f1a6c059120 con 0x7f1a5c06ca30 2024-03-12T16:32:12.621 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:32:12.621 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:32:12.622 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1a5c06ca30 msgr2=0x7f1a5c06eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1a5c06ca30 0x7f1a5c06eef0 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 rx=0x7f1a600048b0 tx=0x7f1a6000b040).stop 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 msgr2=0x7f1a6c06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 0x7f1a6c06b5c0 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 rx=0x7f1a58000c00 tx=0x7f1a58009cb0).stop 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 shutdown_connections 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1a6c0fd8f0 0x7f1a6c06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1a5c06ca30 0x7f1a5c06eef0 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 --2- 172.21.15.6:0/2550566447 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1a6c0fe250 0x7f1a6c06b5c0 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 >> 172.21.15.6:0/2550566447 conn(0x7f1a6c0f34b0 msgr2=0x7f1a6c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 shutdown_connections 2024-03-12T16:32:12.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.627+0000 7f1a72d65700 1 -- 172.21.15.6:0/2550566447 wait complete. 2024-03-12T16:32:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.728+0000 7f94773ea700 1 -- 172.21.15.6:0/1734342973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6fe0 msgr2=0x7f9470103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.728+0000 7f94773ea700 1 --2- 172.21.15.6:0/1734342973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6fe0 0x7f9470103d80 secure :-1 s=READY pgs=507 cs=0 l=1 rev1=1 rx=0x7f946c0047f0 tx=0x7f946c009cb0).stop 2024-03-12T16:32:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.728+0000 7f94773ea700 1 -- 172.21.15.6:0/1734342973 shutdown_connections 2024-03-12T16:32:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.728+0000 7f94773ea700 1 --2- 172.21.15.6:0/1734342973 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6fe0 0x7f9470103d80 unknown :-1 s=CLOSED pgs=507 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.728+0000 7f94773ea700 1 --2- 172.21.15.6:0/1734342973 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700f6710 0x7f94700f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.728+0000 7f94773ea700 1 -- 172.21.15.6:0/1734342973 >> 172.21.15.6:0/1734342973 conn(0x7f9470070590 msgr2=0x7f94700f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:12.725 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.728+0000 7f94773ea700 1 -- 172.21.15.6:0/1734342973 shutdown_connections 2024-03-12T16:32:12.726 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.728+0000 7f94773ea700 1 -- 172.21.15.6:0/1734342973 wait complete. 2024-03-12T16:32:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f94773ea700 1 Processor -- start 2024-03-12T16:32:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f94773ea700 1 -- start start 2024-03-12T16:32:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f94773ea700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6710 0x7f9470110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f94773ea700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700f6fe0 0x7f9470110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f94773ea700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9470110d60 con 0x7f94700f6710 2024-03-12T16:32:12.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f94773ea700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9470110ea0 con 0x7f94700f6fe0 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f9475186700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6710 0x7f9470110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f9475186700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6710 0x7f9470110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48246/0 (socket says 172.21.15.6:48246) 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f9475186700 1 -- 172.21.15.6:0/3004643527 learned_addr learned my addr 172.21.15.6:0/3004643527 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f9474985700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700f6fe0 0x7f9470110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f9475186700 1 -- 172.21.15.6:0/3004643527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700f6fe0 msgr2=0x7f9470110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f9475186700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700f6fe0 0x7f9470110760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.729+0000 7f9475186700 1 -- 172.21.15.6:0/3004643527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f946c005040 con 0x7f94700f6710 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.730+0000 7f9475186700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6710 0x7f9470110270 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f94640041d0 tx=0x7f9464009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.730+0000 7f94627fc700 1 -- 172.21.15.6:0/3004643527 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9464007b40 con 0x7f94700f6710 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.730+0000 7f94627fc700 1 -- 172.21.15.6:0/3004643527 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f946400f040 con 0x7f94700f6710 2024-03-12T16:32:12.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.730+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f947010a530 con 0x7f94700f6710 2024-03-12T16:32:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.730+0000 7f94627fc700 1 -- 172.21.15.6:0/3004643527 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f946400d800 con 0x7f94700f6710 2024-03-12T16:32:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.730+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f947010aa70 con 0x7f94700f6710 2024-03-12T16:32:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.731+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f947005f590 con 0x7f94700f6710 2024-03-12T16:32:12.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.731+0000 7f94627fc700 1 -- 172.21.15.6:0/3004643527 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9464007ca0 con 0x7f94700f6710 2024-03-12T16:32:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.732+0000 7f94627fc700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f945c06caa0 0x7f945c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.732+0000 7f94627fc700 1 -- 172.21.15.6:0/3004643527 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f946408b890 con 0x7f94700f6710 2024-03-12T16:32:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.732+0000 7f9474985700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f945c06caa0 0x7f945c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:12.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.732+0000 7f9474985700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f945c06caa0 0x7f945c06ef60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f946c0043d0 tx=0x7f946c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:12.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:12.736+0000 7f94627fc700 1 -- 172.21.15.6:0/3004643527 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f94640593f0 con 0x7f94700f6710 2024-03-12T16:32:12.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:12 smithi134 ceph-mon[85099]: from='client.35060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:12.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:12 smithi134 ceph-mon[85099]: from='client.35064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:12.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:12 smithi134 ceph-mon[85099]: from='client.35068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:12.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:12 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1812973296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:32:12.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:12 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/692025615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:32:12.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:12 smithi006 ceph-mon[103869]: from='client.35060 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:12.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:12 smithi006 ceph-mon[103869]: from='client.35064 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:12.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:12 smithi006 ceph-mon[103869]: from='client.35068 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:12.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:12 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1812973296' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:32:12.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:12 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/692025615' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:32:13.014 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.017+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f9470047540 con 0x7f94700f6710 2024-03-12T16:32:13.015 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.018+0000 7f94627fc700 1 -- 172.21.15.6:0/3004643527 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f9464058f80 con 0x7f94700f6710 2024-03-12T16:32:13.015 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:32:13.015 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:32:13.015 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:32:13.015 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:32:13.015 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f945c06caa0 msgr2=0x7f945c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f945c06caa0 0x7f945c06ef60 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 rx=0x7f946c0043d0 tx=0x7f946c00b040).stop 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6710 msgr2=0x7f9470110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6710 0x7f9470110270 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 rx=0x7f94640041d0 tx=0x7f9464009f60).stop 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 shutdown_connections 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f945c06caa0 0x7f945c06ef60 unknown :-1 s=CLOSED pgs=269 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f94700f6710 0x7f9470110270 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 --2- 172.21.15.6:0/3004643527 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f94700f6fe0 0x7f9470110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 >> 172.21.15.6:0/3004643527 conn(0x7f9470070590 msgr2=0x7f947006d960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:13.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 shutdown_connections 2024-03-12T16:32:13.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:13.020+0000 7f94773ea700 1 -- 172.21.15.6:0/3004643527 wait complete. 2024-03-12T16:32:13.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:13 smithi134 ceph-mon[85099]: pgmap v569: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:13.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:13 smithi134 ceph-mon[85099]: from='client.35080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:13.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:13 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3004643527' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:32:13.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:13 smithi006 ceph-mon[103869]: pgmap v569: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:13.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:13 smithi006 ceph-mon[103869]: from='client.35080 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:13.954 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:13 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3004643527' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:32:15.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:15 smithi134 ceph-mon[85099]: pgmap v570: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:15.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:15 smithi006 ceph-mon[103869]: pgmap v570: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:17.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:17 smithi134 ceph-mon[85099]: pgmap v571: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:17.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:32:17.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:17 smithi006 ceph-mon[103869]: pgmap v571: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:17.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:32:19.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:19 smithi134 ceph-mon[85099]: pgmap v572: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:19.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:19 smithi006 ceph-mon[103869]: pgmap v572: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:21.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:21 smithi134 ceph-mon[85099]: pgmap v573: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:21.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:21 smithi006 ceph-mon[103869]: pgmap v573: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:23.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:23 smithi134 ceph-mon[85099]: pgmap v574: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:23.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:23 smithi006 ceph-mon[103869]: pgmap v574: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:25.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:25 smithi134 ceph-mon[85099]: pgmap v575: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:25.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:25 smithi006 ceph-mon[103869]: pgmap v575: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:27.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:27 smithi134 ceph-mon[85099]: pgmap v576: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:27.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:27 smithi006 ceph-mon[103869]: pgmap v576: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:29.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:29 smithi134 ceph-mon[85099]: pgmap v577: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:29.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:29 smithi006 ceph-mon[103869]: pgmap v577: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:31.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:31 smithi134 ceph-mon[85099]: pgmap v578: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:31.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:31 smithi006 ceph-mon[103869]: pgmap v578: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:32.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:32:32.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:32:33.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:33 smithi134 ceph-mon[85099]: pgmap v579: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:33.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:33 smithi006 ceph-mon[103869]: pgmap v579: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:35.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:35 smithi134 ceph-mon[85099]: pgmap v580: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:35.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:35 smithi006 ceph-mon[103869]: pgmap v580: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:37.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:37 smithi134 ceph-mon[85099]: pgmap v581: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:37.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:37 smithi006 ceph-mon[103869]: pgmap v581: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:39.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:39 smithi134 ceph-mon[85099]: pgmap v582: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:39.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:39 smithi006 ceph-mon[103869]: pgmap v582: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:41.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:41 smithi134 ceph-mon[85099]: pgmap v583: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:41.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:41 smithi006 ceph-mon[103869]: pgmap v583: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.138+0000 7f6030b9f700 1 -- 172.21.15.6:0/469436810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 msgr2=0x7f602c0fc980 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.138+0000 7f6030b9f700 1 --2- 172.21.15.6:0/469436810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 0x7f602c0fc980 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 rx=0x7f60140047f0 tx=0x7f6014009cb0).stop 2024-03-12T16:32:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.138+0000 7f6030b9f700 1 -- 172.21.15.6:0/469436810 shutdown_connections 2024-03-12T16:32:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.138+0000 7f6030b9f700 1 --2- 172.21.15.6:0/469436810 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f602c0fcf00 0x7f602c0f66e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.138+0000 7f6030b9f700 1 --2- 172.21.15.6:0/469436810 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 0x7f602c0fc980 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.138+0000 7f6030b9f700 1 -- 172.21.15.6:0/469436810 >> 172.21.15.6:0/469436810 conn(0x7f602c06c550 msgr2=0x7f602c06c960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:43.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.138+0000 7f6030b9f700 1 -- 172.21.15.6:0/469436810 shutdown_connections 2024-03-12T16:32:43.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.138+0000 7f6030b9f700 1 -- 172.21.15.6:0/469436810 wait complete. 2024-03-12T16:32:43.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.139+0000 7f6030b9f700 1 Processor -- start 2024-03-12T16:32:43.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.139+0000 7f6030b9f700 1 -- start start 2024-03-12T16:32:43.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f6030b9f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 0x7f602c10ce90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f6030b9f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f602c0fcf00 0x7f602c10d380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f6030b9f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c10d980 con 0x7f602c0fc5a0 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f6030b9f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f602c10dac0 con 0x7f602c0fcf00 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f602b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 0x7f602c10ce90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f602b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 0x7f602c10ce90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59772/0 (socket says 172.21.15.6:59772) 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f602b7fe700 1 -- 172.21.15.6:0/1152396994 learned_addr learned my addr 172.21.15.6:0/1152396994 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f602affd700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f602c0fcf00 0x7f602c10d380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f602b7fe700 1 -- 172.21.15.6:0/1152396994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f602c0fcf00 msgr2=0x7f602c10d380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f602b7fe700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f602c0fcf00 0x7f602c10d380 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f602b7fe700 1 -- 172.21.15.6:0/1152396994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6014005040 con 0x7f602c0fc5a0 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.140+0000 7f602b7fe700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 0x7f602c10ce90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f601400b120 tx=0x7f6014009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.141+0000 7f6028ff9700 1 -- 172.21.15.6:0/1152396994 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f601400e030 con 0x7f602c0fc5a0 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.141+0000 7f6028ff9700 1 -- 172.21.15.6:0/1152396994 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6014007e90 con 0x7f602c0fc5a0 2024-03-12T16:32:43.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.141+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f602c106ee0 con 0x7f602c0fc5a0 2024-03-12T16:32:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.141+0000 7f6028ff9700 1 -- 172.21.15.6:0/1152396994 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6014018070 con 0x7f602c0fc5a0 2024-03-12T16:32:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.141+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f602c107440 con 0x7f602c0fc5a0 2024-03-12T16:32:43.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.142+0000 7f6028ff9700 1 -- 172.21.15.6:0/1152396994 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f601401d420 con 0x7f602c0fc5a0 2024-03-12T16:32:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.142+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f602c05f350 con 0x7f602c0fc5a0 2024-03-12T16:32:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.143+0000 7f6028ff9700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f601806caa0 0x7f601806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.143+0000 7f6028ff9700 1 -- 172.21.15.6:0/1152396994 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f601408d180 con 0x7f602c0fc5a0 2024-03-12T16:32:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.143+0000 7f602affd700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f601806caa0 0x7f601806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:43.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.143+0000 7f602affd700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f601806caa0 0x7f601806ef60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f602c1087d0 tx=0x7f601c009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:43.143 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.147+0000 7f6028ff9700 1 -- 172.21.15.6:0/1152396994 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f601405ace0 con 0x7f602c0fc5a0 2024-03-12T16:32:43.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.363+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f602c108510 con 0x7f601806caa0 2024-03-12T16:32:43.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.364+0000 7f6028ff9700 1 -- 172.21.15.6:0/1152396994 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f602c108510 con 0x7f601806caa0 2024-03-12T16:32:43.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.366+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f601806caa0 msgr2=0x7f601806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.366+0000 7f6030b9f700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f601806caa0 0x7f601806ef60 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 rx=0x7f602c1087d0 tx=0x7f601c009040).stop 2024-03-12T16:32:43.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.366+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 msgr2=0x7f602c10ce90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.366+0000 7f6030b9f700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 0x7f602c10ce90 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 rx=0x7f601400b120 tx=0x7f6014009cb0).stop 2024-03-12T16:32:43.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.366+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 shutdown_connections 2024-03-12T16:32:43.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.366+0000 7f6030b9f700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f601806caa0 0x7f601806ef60 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.366+0000 7f6030b9f700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f602c0fc5a0 0x7f602c10ce90 unknown :-1 s=CLOSED pgs=510 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.366+0000 7f6030b9f700 1 --2- 172.21.15.6:0/1152396994 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f602c0fcf00 0x7f602c10d380 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.366+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 >> 172.21.15.6:0/1152396994 conn(0x7f602c06c550 msgr2=0x7f602c0fa960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:43.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.367+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 shutdown_connections 2024-03-12T16:32:43.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.367+0000 7f6030b9f700 1 -- 172.21.15.6:0/1152396994 wait complete. 2024-03-12T16:32:43.372 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:32:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.470+0000 7f43cc879700 1 -- 172.21.15.6:0/855278622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f8900 msgr2=0x7f43c80f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.470+0000 7f43cc879700 1 --2- 172.21.15.6:0/855278622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f8900 0x7f43c80f8ce0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 rx=0x7f43b80047f0 tx=0x7f43b8009cb0).stop 2024-03-12T16:32:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.470+0000 7f43cc879700 1 -- 172.21.15.6:0/855278622 shutdown_connections 2024-03-12T16:32:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.470+0000 7f43cc879700 1 --2- 172.21.15.6:0/855278622 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80f9260 0x7f43c8101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.470+0000 7f43cc879700 1 --2- 172.21.15.6:0/855278622 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f8900 0x7f43c80f8ce0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.470+0000 7f43cc879700 1 -- 172.21.15.6:0/855278622 >> 172.21.15.6:0/855278622 conn(0x7f43c8070590 msgr2=0x7f43c80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.470+0000 7f43cc879700 1 -- 172.21.15.6:0/855278622 shutdown_connections 2024-03-12T16:32:43.466 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.470+0000 7f43cc879700 1 -- 172.21.15.6:0/855278622 wait complete. 2024-03-12T16:32:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43cc879700 1 Processor -- start 2024-03-12T16:32:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43cc879700 1 -- start start 2024-03-12T16:32:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43cc879700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80f8900 0x7f43c810e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43cc879700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f9260 0x7f43c810e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43cc879700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c810eb30 con 0x7f43c80f9260 2024-03-12T16:32:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43cc879700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f43c810ec70 con 0x7f43c80f8900 2024-03-12T16:32:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43c5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f9260 0x7f43c810e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43c5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f9260 0x7f43c810e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59786/0 (socket says 172.21.15.6:59786) 2024-03-12T16:32:43.468 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43c5d9b700 1 -- 172.21.15.6:0/974091669 learned_addr learned my addr 172.21.15.6:0/974091669 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.471+0000 7f43c659c700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80f8900 0x7f43c810e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.472+0000 7f43c5d9b700 1 -- 172.21.15.6:0/974091669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80f8900 msgr2=0x7f43c810e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.472+0000 7f43c5d9b700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80f8900 0x7f43c810e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.472+0000 7f43c5d9b700 1 -- 172.21.15.6:0/974091669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f43b8005040 con 0x7f43c80f9260 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.472+0000 7f43c5d9b700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f9260 0x7f43c810e530 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f43b00041d0 tx=0x7f43b0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.472+0000 7f43bf7fe700 1 -- 172.21.15.6:0/974091669 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b0007b40 con 0x7f43c80f9260 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.472+0000 7f43bf7fe700 1 -- 172.21.15.6:0/974091669 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f43b000f040 con 0x7f43c80f9260 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.472+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f43c8108300 con 0x7f43c80f9260 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.472+0000 7f43bf7fe700 1 -- 172.21.15.6:0/974091669 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f43b00147b0 con 0x7f43c80f9260 2024-03-12T16:32:43.469 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.472+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f43c8108840 con 0x7f43c80f9260 2024-03-12T16:32:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.473+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f43c805f590 con 0x7f43c80f9260 2024-03-12T16:32:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.473+0000 7f43bf7fe700 1 -- 172.21.15.6:0/974091669 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f43b0009110 con 0x7f43c80f9260 2024-03-12T16:32:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.474+0000 7f43bf7fe700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43b406caf0 0x7f43b406efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.474+0000 7f43bf7fe700 1 -- 172.21.15.6:0/974091669 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f43b008be50 con 0x7f43c80f9260 2024-03-12T16:32:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.474+0000 7f43c659c700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43b406caf0 0x7f43b406efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:43.470 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.475+0000 7f43c659c700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43b406caf0 0x7f43b406efb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f43b8009ee0 tx=0x7f43b800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:43.474 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.479+0000 7f43bf7fe700 1 -- 172.21.15.6:0/974091669 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f43b00598f0 con 0x7f43c80f9260 2024-03-12T16:32:43.699 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.703+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f43c81097d0 con 0x7f43b406caf0 2024-03-12T16:32:43.700 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.704+0000 7f43bf7fe700 1 -- 172.21.15.6:0/974091669 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f43c81097d0 con 0x7f43b406caf0 2024-03-12T16:32:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.706+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43b406caf0 msgr2=0x7f43b406efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.706+0000 7f43cc879700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43b406caf0 0x7f43b406efb0 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 rx=0x7f43b8009ee0 tx=0x7f43b800b040).stop 2024-03-12T16:32:43.702 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.706+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f9260 msgr2=0x7f43c810e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.706+0000 7f43cc879700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f9260 0x7f43c810e530 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 rx=0x7f43b00041d0 tx=0x7f43b0009f60).stop 2024-03-12T16:32:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.707+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 shutdown_connections 2024-03-12T16:32:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.707+0000 7f43cc879700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f43c80f8900 0x7f43c810e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.707+0000 7f43cc879700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f43b406caf0 0x7f43b406efb0 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.707+0000 7f43cc879700 1 --2- 172.21.15.6:0/974091669 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f43c80f9260 0x7f43c810e530 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.707+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 >> 172.21.15.6:0/974091669 conn(0x7f43c8070590 msgr2=0x7f43c80fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.707+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 shutdown_connections 2024-03-12T16:32:43.703 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.707+0000 7f43cc879700 1 -- 172.21.15.6:0/974091669 wait complete. 2024-03-12T16:32:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.808+0000 7f21b6636700 1 -- 172.21.15.6:0/1412661818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 msgr2=0x7f21b00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.808+0000 7f21b6636700 1 --2- 172.21.15.6:0/1412661818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 0x7f21b00f6930 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 rx=0x7f21a40047f0 tx=0x7f21a4009cb0).stop 2024-03-12T16:32:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.808+0000 7f21b6636700 1 -- 172.21.15.6:0/1412661818 shutdown_connections 2024-03-12T16:32:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.808+0000 7f21b6636700 1 --2- 172.21.15.6:0/1412661818 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 0x7f21b00f6930 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.808+0000 7f21b6636700 1 --2- 172.21.15.6:0/1412661818 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21b00fc7f0 0x7f21b00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.808+0000 7f21b6636700 1 -- 172.21.15.6:0/1412661818 >> 172.21.15.6:0/1412661818 conn(0x7f21b0070590 msgr2=0x7f21b00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:43.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.808+0000 7f21b6636700 1 -- 172.21.15.6:0/1412661818 shutdown_connections 2024-03-12T16:32:43.805 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.808+0000 7f21b6636700 1 -- 172.21.15.6:0/1412661818 wait complete. 2024-03-12T16:32:43.806 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21b6636700 1 Processor -- start 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21b6636700 1 -- start start 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21b6636700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21b00fc7f0 0x7f21b00f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21b6636700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 0x7f21b00f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21b6636700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00f8f20 con 0x7f21b00fd150 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21b6636700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f21b00f9060 con 0x7f21b00fc7f0 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21af7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 0x7f21b00f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21af7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 0x7f21b00f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59808/0 (socket says 172.21.15.6:59808) 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21af7fe700 1 -- 172.21.15.6:0/3358743630 learned_addr learned my addr 172.21.15.6:0/3358743630 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.809+0000 7f21affff700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21b00fc7f0 0x7f21b00f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.810+0000 7f21af7fe700 1 -- 172.21.15.6:0/3358743630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21b00fc7f0 msgr2=0x7f21b00f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.810+0000 7f21af7fe700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21b00fc7f0 0x7f21b00f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.810+0000 7f21af7fe700 1 -- 172.21.15.6:0/3358743630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f21a4005040 con 0x7f21b00fd150 2024-03-12T16:32:43.807 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.810+0000 7f21af7fe700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 0x7f21b00f8a30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f21a40099f0 tx=0x7f21a4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.810+0000 7f21ad7fa700 1 -- 172.21.15.6:0/3358743630 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a400e030 con 0x7f21b00fd150 2024-03-12T16:32:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.810+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f21b00f92b0 con 0x7f21b00fd150 2024-03-12T16:32:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.810+0000 7f21ad7fa700 1 -- 172.21.15.6:0/3358743630 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f21a4007e90 con 0x7f21b00fd150 2024-03-12T16:32:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.810+0000 7f21ad7fa700 1 -- 172.21.15.6:0/3358743630 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f21a4018070 con 0x7f21b00fd150 2024-03-12T16:32:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.810+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f21b0114610 con 0x7f21b00fd150 2024-03-12T16:32:43.808 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.811+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f21b005f590 con 0x7f21b00fd150 2024-03-12T16:32:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.812+0000 7f21ad7fa700 1 -- 172.21.15.6:0/3358743630 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f21a40094c0 con 0x7f21b00fd150 2024-03-12T16:32:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.812+0000 7f21ad7fa700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f219806caa0 0x7f219806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.812+0000 7f21ad7fa700 1 -- 172.21.15.6:0/3358743630 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f21a408d000 con 0x7f21b00fd150 2024-03-12T16:32:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.812+0000 7f21affff700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f219806caa0 0x7f219806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:43.809 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.813+0000 7f21affff700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f219806caa0 0x7f219806ef60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f21a0004de0 tx=0x7f21a000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:43.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:43.817+0000 7f21ad7fa700 1 -- 172.21.15.6:0/3358743630 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f21a40570d0 con 0x7f21b00fd150 2024-03-12T16:32:43.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:43 smithi134 ceph-mon[85099]: pgmap v584: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:43.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:43 smithi006 ceph-mon[103869]: pgmap v584: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:44.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.026+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f21b00fb5a0 con 0x7f219806caa0 2024-03-12T16:32:44.032 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.036+0000 7f21ad7fa700 1 -- 172.21.15.6:0/3358743630 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f21b00fb5a0 con 0x7f219806caa0 2024-03-12T16:32:44.032 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (19m) 13m ago 30m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (17m) 13m ago 30m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (17m) 12m ago 29m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (19m) 13m ago 30m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (13m) 13m ago 25m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (13m) 13m ago 25m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (13m) 12m ago 25m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (12m) 12m ago 25m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (21m) 13m ago 31m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (20m) 12m ago 29m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (18m) 13m ago 32m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (17m) 12m ago 29m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (20m) 13m ago 30m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:32:44.033 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (20m) 12m ago 29m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:32:44.034 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (16m) 13m ago 29m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:32:44.034 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (16m) 13m ago 28m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:32:44.034 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (15m) 13m ago 28m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:32:44.034 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (15m) 12m ago 27m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:32:44.034 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (14m) 12m ago 27m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:32:44.034 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (13m) 12m ago 26m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:32:44.034 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (19m) 12m ago 28m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.038+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f219806caa0 msgr2=0x7f219806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.038+0000 7f21b6636700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f219806caa0 0x7f219806ef60 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 rx=0x7f21a0004de0 tx=0x7f21a000b040).stop 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.038+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 msgr2=0x7f21b00f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.038+0000 7f21b6636700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 0x7f21b00f8a30 secure :-1 s=READY pgs=514 cs=0 l=1 rev1=1 rx=0x7f21a40099f0 tx=0x7f21a4009cb0).stop 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.039+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 shutdown_connections 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.039+0000 7f21b6636700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f21b00fc7f0 0x7f21b00f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.039+0000 7f21b6636700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f219806caa0 0x7f219806ef60 unknown :-1 s=CLOSED pgs=272 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.039+0000 7f21b6636700 1 --2- 172.21.15.6:0/3358743630 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f21b00fd150 0x7f21b00f8a30 unknown :-1 s=CLOSED pgs=514 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.039+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 >> 172.21.15.6:0/3358743630 conn(0x7f21b0070590 msgr2=0x7f21b0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.039+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 shutdown_connections 2024-03-12T16:32:44.035 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.039+0000 7f21b6636700 1 -- 172.21.15.6:0/3358743630 wait complete. 2024-03-12T16:32:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 -- 172.21.15.6:0/1520703624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 msgr2=0x7f7f7c0f5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 --2- 172.21.15.6:0/1520703624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 0x7f7f7c0f5f80 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 rx=0x7f7f680047f0 tx=0x7f7f68009cb0).stop 2024-03-12T16:32:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 -- 172.21.15.6:0/1520703624 shutdown_connections 2024-03-12T16:32:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 --2- 172.21.15.6:0/1520703624 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 0x7f7f7c0f5f80 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 --2- 172.21.15.6:0/1520703624 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0fd8b0 0x7f7f7c0fdc90 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 -- 172.21.15.6:0/1520703624 >> 172.21.15.6:0/1520703624 conn(0x7f7f7c06ce40 msgr2=0x7f7f7c06d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 -- 172.21.15.6:0/1520703624 shutdown_connections 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 -- 172.21.15.6:0/1520703624 wait complete. 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 Processor -- start 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.139+0000 7f7f82cef700 1 -- start start 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f82cef700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0fd8b0 0x7f7f7c10dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f82cef700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 0x7f7f7c10e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f82cef700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c10eae0 con 0x7f7f7c0fe210 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f82cef700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f7c10ec20 con 0x7f7f7c0fd8b0 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f7bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 0x7f7f7c10e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f7bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 0x7f7f7c10e4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59828/0 (socket says 172.21.15.6:59828) 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f7bfff700 1 -- 172.21.15.6:0/2228542360 learned_addr learned my addr 172.21.15.6:0/2228542360 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f80a8b700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0fd8b0 0x7f7f7c10dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:44.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f7bfff700 1 -- 172.21.15.6:0/2228542360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0fd8b0 msgr2=0x7f7f7c10dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f7bfff700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0fd8b0 0x7f7f7c10dff0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f7bfff700 1 -- 172.21.15.6:0/2228542360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f68005040 con 0x7f7f7c0fe210 2024-03-12T16:32:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f7bfff700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 0x7f7f7c10e4e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f7f68005010 tx=0x7f7f68009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f79ffb700 1 -- 172.21.15.6:0/2228542360 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f6800e030 con 0x7f7f7c0fe210 2024-03-12T16:32:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f79ffb700 1 -- 172.21.15.6:0/2228542360 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f68007e90 con 0x7f7f7c0fe210 2024-03-12T16:32:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f7c108250 con 0x7f7f7c0fe210 2024-03-12T16:32:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.140+0000 7f7f79ffb700 1 -- 172.21.15.6:0/2228542360 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f68018070 con 0x7f7f7c0fe210 2024-03-12T16:32:44.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.141+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f7c108730 con 0x7f7f7c0fe210 2024-03-12T16:32:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.142+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f7c060670 con 0x7f7f7c0fe210 2024-03-12T16:32:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.142+0000 7f7f79ffb700 1 -- 172.21.15.6:0/2228542360 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7f6801d670 con 0x7f7f7c0fe210 2024-03-12T16:32:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.143+0000 7f7f79ffb700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f6c06caa0 0x7f7f6c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.143+0000 7f7f79ffb700 1 -- 172.21.15.6:0/2228542360 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f7f6808d0d0 con 0x7f7f7c0fe210 2024-03-12T16:32:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.143+0000 7f7f80a8b700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f6c06caa0 0x7f7f6c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:44.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.143+0000 7f7f80a8b700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f6c06caa0 0x7f7f6c06ef60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7f70004dc0 tx=0x7f7f7000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:44.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.147+0000 7f7f79ffb700 1 -- 172.21.15.6:0/2228542360 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7f6805ab70 con 0x7f7f7c0fe210 2024-03-12T16:32:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.426+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f7f7c109710 con 0x7f7f7c0fe210 2024-03-12T16:32:44.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.427+0000 7f7f79ffb700 1 -- 172.21.15.6:0/2228542360 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f7f6805a700 con 0x7f7f7c0fe210 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:32:44.423 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:32:44.424 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:32:44.424 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:32:44.424 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f6c06caa0 msgr2=0x7f7f6c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f6c06caa0 0x7f7f6c06ef60 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 rx=0x7f7f70004dc0 tx=0x7f7f7000b040).stop 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 msgr2=0x7f7f7c10e4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 0x7f7f7c10e4e0 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 rx=0x7f7f68005010 tx=0x7f7f68009cb0).stop 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 shutdown_connections 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f7c0fd8b0 0x7f7f7c10dff0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f6c06caa0 0x7f7f6c06ef60 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 --2- 172.21.15.6:0/2228542360 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f7c0fe210 0x7f7f7c10e4e0 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 >> 172.21.15.6:0/2228542360 conn(0x7f7f7c06ce40 msgr2=0x7f7f7c100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 shutdown_connections 2024-03-12T16:32:44.425 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.429+0000 7f7f82cef700 1 -- 172.21.15.6:0/2228542360 wait complete. 2024-03-12T16:32:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.531+0000 7f9c89e58700 1 -- 172.21.15.6:0/2253418969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fe250 msgr2=0x7f9c840f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.531+0000 7f9c89e58700 1 --2- 172.21.15.6:0/2253418969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fe250 0x7f9c840f7a30 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 rx=0x7f9c740047f0 tx=0x7f9c74009cb0).stop 2024-03-12T16:32:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.531+0000 7f9c89e58700 1 -- 172.21.15.6:0/2253418969 shutdown_connections 2024-03-12T16:32:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.531+0000 7f9c89e58700 1 --2- 172.21.15.6:0/2253418969 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fe250 0x7f9c840f7a30 unknown :-1 s=CLOSED pgs=517 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.531+0000 7f9c89e58700 1 --2- 172.21.15.6:0/2253418969 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c840fd8f0 0x7f9c840fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.531+0000 7f9c89e58700 1 -- 172.21.15.6:0/2253418969 >> 172.21.15.6:0/2253418969 conn(0x7f9c840f34b0 msgr2=0x7f9c840f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.531+0000 7f9c89e58700 1 -- 172.21.15.6:0/2253418969 shutdown_connections 2024-03-12T16:32:44.527 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.531+0000 7f9c89e58700 1 -- 172.21.15.6:0/2253418969 wait complete. 2024-03-12T16:32:44.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c89e58700 1 Processor -- start 2024-03-12T16:32:44.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c89e58700 1 -- start start 2024-03-12T16:32:44.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c89e58700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fd8f0 0x7f9c84110260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:44.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c89e58700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c840fe250 0x7f9c84110750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:44.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c89e58700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84110d50 con 0x7f9c840fd8f0 2024-03-12T16:32:44.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c89e58700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c84110e90 con 0x7f9c840fe250 2024-03-12T16:32:44.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fd8f0 0x7f9c84110260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c837fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fd8f0 0x7f9c84110260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59840/0 (socket says 172.21.15.6:59840) 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c837fe700 1 -- 172.21.15.6:0/251122301 learned_addr learned my addr 172.21.15.6:0/251122301 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c82ffd700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c840fe250 0x7f9c84110750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c837fe700 1 -- 172.21.15.6:0/251122301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c840fe250 msgr2=0x7f9c84110750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c837fe700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c840fe250 0x7f9c84110750 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c837fe700 1 -- 172.21.15.6:0/251122301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c74005040 con 0x7f9c840fd8f0 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.532+0000 7f9c82ffd700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c840fe250 0x7f9c84110750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.533+0000 7f9c837fe700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fd8f0 0x7f9c84110260 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f9c7800c740 tx=0x7f9c78007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.533+0000 7f9c80ff9700 1 -- 172.21.15.6:0/251122301 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c7800e680 con 0x7f9c840fd8f0 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.533+0000 7f9c80ff9700 1 -- 172.21.15.6:0/251122301 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c7800ec90 con 0x7f9c840fd8f0 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.533+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c8410a520 con 0x7f9c840fd8f0 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.533+0000 7f9c80ff9700 1 -- 172.21.15.6:0/251122301 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c78013d60 con 0x7f9c840fd8f0 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.533+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c8410aa60 con 0x7f9c840fd8f0 2024-03-12T16:32:44.530 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.534+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c8405f590 con 0x7f9c840fd8f0 2024-03-12T16:32:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.534+0000 7f9c80ff9700 1 -- 172.21.15.6:0/251122301 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9c7800e7e0 con 0x7f9c840fd8f0 2024-03-12T16:32:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.535+0000 7f9c80ff9700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c6c06caa0 0x7f9c6c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.535+0000 7f9c80ff9700 1 -- 172.21.15.6:0/251122301 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9c7808c040 con 0x7f9c840fd8f0 2024-03-12T16:32:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.535+0000 7f9c82ffd700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c6c06caa0 0x7f9c6c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:44.531 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.535+0000 7f9c82ffd700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c6c06caa0 0x7f9c6c06ef60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f9c74004f10 tx=0x7f9c7400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:44.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.539+0000 7f9c80ff9700 1 -- 172.21.15.6:0/251122301 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9c78059ba0 con 0x7f9c840fd8f0 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.782+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f9c8410b980 con 0x7f9c840fd8f0 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.782+0000 7f9c80ff9700 1 -- 172.21.15.6:0/251122301 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f9c78059730 con 0x7f9c840fd8f0 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:32:44.778 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:32:44.779 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:32:44.780 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:32:44.781 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:32:44.781 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:32:44.781 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c6c06caa0 msgr2=0x7f9c6c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c6c06caa0 0x7f9c6c06ef60 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 rx=0x7f9c74004f10 tx=0x7f9c7400b040).stop 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fd8f0 msgr2=0x7f9c84110260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fd8f0 0x7f9c84110260 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 rx=0x7f9c7800c740 tx=0x7f9c78007ef0).stop 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 shutdown_connections 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c6c06caa0 0x7f9c6c06ef60 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c840fd8f0 0x7f9c84110260 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 --2- 172.21.15.6:0/251122301 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c840fe250 0x7f9c84110750 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 >> 172.21.15.6:0/251122301 conn(0x7f9c840f34b0 msgr2=0x7f9c8406b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.784+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 shutdown_connections 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.785+0000 7f9c89e58700 1 -- 172.21.15.6:0/251122301 wait complete. 2024-03-12T16:32:44.782 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:32:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.886+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3591306639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fd8f0 msgr2=0x7f4d540fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.886+0000 7f4d5b93e700 1 --2- 172.21.15.6:0/3591306639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fd8f0 0x7f4d540fdcd0 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 rx=0x7f4d500047f0 tx=0x7f4d50009cb0).stop 2024-03-12T16:32:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.886+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3591306639 shutdown_connections 2024-03-12T16:32:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.886+0000 7f4d5b93e700 1 --2- 172.21.15.6:0/3591306639 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d540fe250 0x7f4d540f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.886+0000 7f4d5b93e700 1 --2- 172.21.15.6:0/3591306639 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fd8f0 0x7f4d540fdcd0 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.886+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3591306639 >> 172.21.15.6:0/3591306639 conn(0x7f4d540f34b0 msgr2=0x7f4d540f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.887+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3591306639 shutdown_connections 2024-03-12T16:32:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.887+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3591306639 wait complete. 2024-03-12T16:32:44.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.887+0000 7f4d5b93e700 1 Processor -- start 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.887+0000 7f4d5b93e700 1 -- start start 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.887+0000 7f4d5b93e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d540fd8f0 0x7f4d5406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.887+0000 7f4d5b93e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fe250 0x7f4d5406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.887+0000 7f4d5b93e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5406bab0 con 0x7f4d540fe250 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.887+0000 7f4d5b93e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4d5406bbf0 con 0x7f4d540fd8f0 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.887+0000 7f4d58ed9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fe250 0x7f4d5406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d58ed9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fe250 0x7f4d5406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59858/0 (socket says 172.21.15.6:59858) 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d58ed9700 1 -- 172.21.15.6:0/3331920183 learned_addr learned my addr 172.21.15.6:0/3331920183 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d596da700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d540fd8f0 0x7f4d5406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d58ed9700 1 -- 172.21.15.6:0/3331920183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d540fd8f0 msgr2=0x7f4d5406b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d58ed9700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d540fd8f0 0x7f4d5406b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d58ed9700 1 -- 172.21.15.6:0/3331920183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4d50005040 con 0x7f4d540fe250 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d58ed9700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fe250 0x7f4d5406b5c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f4d44002820 tx=0x7f4d44009f20).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d4a7fc700 1 -- 172.21.15.6:0/3331920183 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d44007b40 con 0x7f4d540fe250 2024-03-12T16:32:44.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d4a7fc700 1 -- 172.21.15.6:0/3331920183 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4d4400f040 con 0x7f4d540fe250 2024-03-12T16:32:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4d5406bea0 con 0x7f4d540fe250 2024-03-12T16:32:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d4a7fc700 1 -- 172.21.15.6:0/3331920183 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4d440148b0 con 0x7f4d540fe250 2024-03-12T16:32:44.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.888+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4d541146e0 con 0x7f4d540fe250 2024-03-12T16:32:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.889+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4d5405f590 con 0x7f4d540fe250 2024-03-12T16:32:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.890+0000 7f4d4a7fc700 1 -- 172.21.15.6:0/3331920183 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f4d44007ca0 con 0x7f4d540fe250 2024-03-12T16:32:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.890+0000 7f4d4a7fc700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4d4006caa0 0x7f4d4006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.890+0000 7f4d4a7fc700 1 -- 172.21.15.6:0/3331920183 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4d4408b720 con 0x7f4d540fe250 2024-03-12T16:32:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.890+0000 7f4d596da700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4d4006caa0 0x7f4d4006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:44.887 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.890+0000 7f4d596da700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4d4006caa0 0x7f4d4006ef60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f4d50004f10 tx=0x7f4d5000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:44.890 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:44.894+0000 7f4d4a7fc700 1 -- 172.21.15.6:0/3331920183 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4d440557f0 con 0x7f4d540fe250 2024-03-12T16:32:44.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:44 smithi134 ceph-mon[85099]: from='client.35088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:44.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:44 smithi134 ceph-mon[85099]: from='client.35092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:44.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:44 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2228542360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:32:44.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:44 smithi006 ceph-mon[103869]: from='client.35088 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:44.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:44 smithi006 ceph-mon[103869]: from='client.35092 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:44.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:44 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2228542360' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:32:45.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.108+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4d5406c6c0 con 0x7f4d4006caa0 2024-03-12T16:32:45.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.109+0000 7f4d4a7fc700 1 -- 172.21.15.6:0/3331920183 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4d5406c6c0 con 0x7f4d4006caa0 2024-03-12T16:32:45.105 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:32:45.105 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:32:45.105 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:32:45.105 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:32:45.105 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:32:45.105 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:32:45.105 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:32:45.106 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:32:45.106 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:32:45.106 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:32:45.106 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:32:45.106 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:32:45.106 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:32:45.106 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:32:45.106 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:32:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.111+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4d4006caa0 msgr2=0x7f4d4006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.111+0000 7f4d5b93e700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4d4006caa0 0x7f4d4006ef60 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 rx=0x7f4d50004f10 tx=0x7f4d5000b040).stop 2024-03-12T16:32:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.111+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fe250 msgr2=0x7f4d5406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.111+0000 7f4d5b93e700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fe250 0x7f4d5406b5c0 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 rx=0x7f4d44002820 tx=0x7f4d44009f20).stop 2024-03-12T16:32:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.111+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 shutdown_connections 2024-03-12T16:32:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.111+0000 7f4d5b93e700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4d540fd8f0 0x7f4d5406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.111+0000 7f4d5b93e700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4d4006caa0 0x7f4d4006ef60 unknown :-1 s=CLOSED pgs=275 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:45.107 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.111+0000 7f4d5b93e700 1 --2- 172.21.15.6:0/3331920183 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4d540fe250 0x7f4d5406b5c0 unknown :-1 s=CLOSED pgs=520 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.111+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 >> 172.21.15.6:0/3331920183 conn(0x7f4d540f34b0 msgr2=0x7f4d540fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.112+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 shutdown_connections 2024-03-12T16:32:45.108 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.112+0000 7f4d5b93e700 1 -- 172.21.15.6:0/3331920183 wait complete. 2024-03-12T16:32:45.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.212+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/4253793584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fd150 msgr2=0x7f3ed00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.212+0000 7f3ed5eb2700 1 --2- 172.21.15.6:0/4253793584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fd150 0x7f3ed00f6930 secure :-1 s=READY pgs=521 cs=0 l=1 rev1=1 rx=0x7f3ec40047f0 tx=0x7f3ec4009cb0).stop 2024-03-12T16:32:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.212+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/4253793584 shutdown_connections 2024-03-12T16:32:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.212+0000 7f3ed5eb2700 1 --2- 172.21.15.6:0/4253793584 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fd150 0x7f3ed00f6930 unknown :-1 s=CLOSED pgs=521 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.212+0000 7f3ed5eb2700 1 --2- 172.21.15.6:0/4253793584 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed00fc7f0 0x7f3ed00fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.212+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/4253793584 >> 172.21.15.6:0/4253793584 conn(0x7f3ed0070590 msgr2=0x7f3ed00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.212+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/4253793584 shutdown_connections 2024-03-12T16:32:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.213+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/4253793584 wait complete. 2024-03-12T16:32:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.213+0000 7f3ed5eb2700 1 Processor -- start 2024-03-12T16:32:45.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.213+0000 7f3ed5eb2700 1 -- start start 2024-03-12T16:32:45.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.213+0000 7f3ed5eb2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fc7f0 0x7f3ed010dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.213+0000 7f3ed5eb2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed00fd150 0x7f3ed010e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ed5eb2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed010ead0 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ed5eb2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ed010ec10 con 0x7f3ed00fd150 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ecf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fc7f0 0x7f3ed010dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ecf7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fc7f0 0x7f3ed010dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59862/0 (socket says 172.21.15.6:59862) 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ecf7fe700 1 -- 172.21.15.6:0/3164939079 learned_addr learned my addr 172.21.15.6:0/3164939079 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3eceffd700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed00fd150 0x7f3ed010e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ecf7fe700 1 -- 172.21.15.6:0/3164939079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed00fd150 msgr2=0x7f3ed010e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ecf7fe700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed00fd150 0x7f3ed010e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ecf7fe700 1 -- 172.21.15.6:0/3164939079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3ec4005040 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ecf7fe700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fc7f0 0x7f3ed010dfe0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f3ec00041d0 tx=0x7f3ec0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3eccff9700 1 -- 172.21.15.6:0/3164939079 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec0007b40 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3eccff9700 1 -- 172.21.15.6:0/3164939079 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ec000f040 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ed01082a0 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3eccff9700 1 -- 172.21.15.6:0/3164939079 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ec00137d0 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.214+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ed0108860 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.215+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ed005f590 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.216+0000 7f3eccff9700 1 -- 172.21.15.6:0/3164939079 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f3ec0007ca0 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.216+0000 7f3eccff9700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3eb806caa0 0x7f3eb806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:32:45.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.216+0000 7f3eccff9700 1 -- 172.21.15.6:0/3164939079 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f3ec008b7a0 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.216+0000 7f3eceffd700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3eb806caa0 0x7f3eb806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:32:45.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.217+0000 7f3eceffd700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3eb806caa0 0x7f3eb806ef60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f3ed0109920 tx=0x7f3ec400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:32:45.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.221+0000 7f3eccff9700 1 -- 172.21.15.6:0/3164939079 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3ec0059300 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.502+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f3ed0109770 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.498 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.503+0000 7f3eccff9700 1 -- 172.21.15.6:0/3164939079 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f3ec0058e90 con 0x7f3ed00fc7f0 2024-03-12T16:32:45.499 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:32:45.499 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:32:45.499 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:32:45.499 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:32:45.499 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:32:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3eb806caa0 msgr2=0x7f3eb806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3eb806caa0 0x7f3eb806ef60 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 rx=0x7f3ed0109920 tx=0x7f3ec400b040).stop 2024-03-12T16:32:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fc7f0 msgr2=0x7f3ed010dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:32:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fc7f0 0x7f3ed010dfe0 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 rx=0x7f3ec00041d0 tx=0x7f3ec0009f60).stop 2024-03-12T16:32:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 shutdown_connections 2024-03-12T16:32:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3eb806caa0 0x7f3eb806ef60 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ed00fc7f0 0x7f3ed010dfe0 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 --2- 172.21.15.6:0/3164939079 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ed00fd150 0x7f3ed010e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:32:45.501 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 >> 172.21.15.6:0/3164939079 conn(0x7f3ed0070590 msgr2=0x7f3ed0060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:32:45.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 shutdown_connections 2024-03-12T16:32:45.502 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:32:45.505+0000 7f3ed5eb2700 1 -- 172.21.15.6:0/3164939079 wait complete. 2024-03-12T16:32:45.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:45 smithi134 ceph-mon[85099]: from='client.35096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:45.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:45 smithi134 ceph-mon[85099]: pgmap v585: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:45.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:45 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/251122301' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:32:45.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:45 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3164939079' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:32:45.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:45 smithi006 ceph-mon[103869]: from='client.35096 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:45.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:45 smithi006 ceph-mon[103869]: pgmap v585: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:45.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:45 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/251122301' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:32:45.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:45 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3164939079' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:32:46.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:46 smithi134 ceph-mon[85099]: from='client.35108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:46.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:46 smithi006 ceph-mon[103869]: from='client.35108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:32:47.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:47 smithi134 ceph-mon[85099]: pgmap v586: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:47.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:32:47.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:47 smithi006 ceph-mon[103869]: pgmap v586: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:47.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:32:49.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:49 smithi134 ceph-mon[85099]: pgmap v587: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:49.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:49 smithi006 ceph-mon[103869]: pgmap v587: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:51.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:51 smithi134 ceph-mon[85099]: pgmap v588: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:51.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:51 smithi006 ceph-mon[103869]: pgmap v588: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:53.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:53 smithi134 ceph-mon[85099]: pgmap v589: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:53.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:53 smithi006 ceph-mon[103869]: pgmap v589: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:55.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:55 smithi134 ceph-mon[85099]: pgmap v590: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:55.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:55 smithi006 ceph-mon[103869]: pgmap v590: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:57.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:57 smithi134 ceph-mon[85099]: pgmap v591: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:57.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:57 smithi006 ceph-mon[103869]: pgmap v591: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:59.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:32:59 smithi134 ceph-mon[85099]: pgmap v592: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:32:59.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:32:59 smithi006 ceph-mon[103869]: pgmap v592: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:01.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:01 smithi134 ceph-mon[85099]: pgmap v593: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:01.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:01 smithi006 ceph-mon[103869]: pgmap v593: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:02.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:33:02.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:33:03.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:03 smithi134 ceph-mon[85099]: pgmap v594: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:03.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:03 smithi006 ceph-mon[103869]: pgmap v594: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:05.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:05 smithi134 ceph-mon[85099]: pgmap v595: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:05 smithi006 ceph-mon[103869]: pgmap v595: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:07.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:07 smithi134 ceph-mon[85099]: pgmap v596: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:07.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:07 smithi006 ceph-mon[103869]: pgmap v596: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:09.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:09 smithi134 ceph-mon[85099]: pgmap v597: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:09.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:09 smithi006 ceph-mon[103869]: pgmap v597: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:11.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:11 smithi134 ceph-mon[85099]: pgmap v598: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:11.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:11 smithi006 ceph-mon[103869]: pgmap v598: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:13.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:13 smithi134 ceph-mon[85099]: pgmap v599: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:13.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:13 smithi006 ceph-mon[103869]: pgmap v599: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.624+0000 7fe196bc6700 1 -- 172.21.15.6:0/1309658755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 msgr2=0x7fe1900f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.624+0000 7fe196bc6700 1 --2- 172.21.15.6:0/1309658755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 0x7fe1900f8c80 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 rx=0x7fe1800047f0 tx=0x7fe180009cb0).stop 2024-03-12T16:33:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.624+0000 7fe196bc6700 1 -- 172.21.15.6:0/1309658755 shutdown_connections 2024-03-12T16:33:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.624+0000 7fe196bc6700 1 --2- 172.21.15.6:0/1309658755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1900f9200 0x7fe190101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.624+0000 7fe196bc6700 1 --2- 172.21.15.6:0/1309658755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 0x7fe1900f8c80 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.624+0000 7fe196bc6700 1 -- 172.21.15.6:0/1309658755 >> 172.21.15.6:0/1309658755 conn(0x7fe190070590 msgr2=0x7fe1900f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:15.620 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.624+0000 7fe196bc6700 1 -- 172.21.15.6:0/1309658755 shutdown_connections 2024-03-12T16:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.624+0000 7fe196bc6700 1 -- 172.21.15.6:0/1309658755 wait complete. 2024-03-12T16:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe196bc6700 1 Processor -- start 2024-03-12T16:33:15.621 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe196bc6700 1 -- start start 2024-03-12T16:33:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe196bc6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 0x7fe19010e130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe196bc6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1900f9200 0x7fe19010e620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe196bc6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19010ec20 con 0x7fe1900f88a0 2024-03-12T16:33:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe196bc6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe19010ed60 con 0x7fe1900f9200 2024-03-12T16:33:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe194962700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 0x7fe19010e130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:15.622 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe194962700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 0x7fe19010e130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59394/0 (socket says 172.21.15.6:59394) 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe194962700 1 -- 172.21.15.6:0/848835089 learned_addr learned my addr 172.21.15.6:0/848835089 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe18ffff700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1900f9200 0x7fe19010e620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe194962700 1 -- 172.21.15.6:0/848835089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1900f9200 msgr2=0x7fe19010e620 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe194962700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1900f9200 0x7fe19010e620 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.625+0000 7fe194962700 1 -- 172.21.15.6:0/848835089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe180005040 con 0x7fe1900f88a0 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.626+0000 7fe18ffff700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1900f9200 0x7fe19010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.626+0000 7fe194962700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 0x7fe19010e130 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fe180009380 tx=0x7fe180009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.626+0000 7fe18dffb700 1 -- 172.21.15.6:0/848835089 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe180018070 con 0x7fe1900f88a0 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.626+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe190108390 con 0x7fe1900f88a0 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.626+0000 7fe18dffb700 1 -- 172.21.15.6:0/848835089 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe180007e90 con 0x7fe1900f88a0 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.626+0000 7fe18dffb700 1 -- 172.21.15.6:0/848835089 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe18001c380 con 0x7fe1900f88a0 2024-03-12T16:33:15.623 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.626+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe190108870 con 0x7fe1900f88a0 2024-03-12T16:33:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.627+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe19005f590 con 0x7fe1900f88a0 2024-03-12T16:33:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.628+0000 7fe18dffb700 1 -- 172.21.15.6:0/848835089 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe1800123c0 con 0x7fe1900f88a0 2024-03-12T16:33:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.628+0000 7fe18dffb700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe17c06cab0 0x7fe17c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.628+0000 7fe18dffb700 1 -- 172.21.15.6:0/848835089 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe18008cbc0 con 0x7fe1900f88a0 2024-03-12T16:33:15.624 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.628+0000 7fe18ffff700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe17c06cab0 0x7fe17c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:15.625 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.629+0000 7fe18ffff700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe17c06cab0 0x7fe17c06ef70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fe178007fd0 tx=0x7fe17800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:15.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.633+0000 7fe18dffb700 1 -- 172.21.15.6:0/848835089 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe18005a720 con 0x7fe1900f88a0 2024-03-12T16:33:15.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.852+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe1900fef10 con 0x7fe17c06cab0 2024-03-12T16:33:15.848 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.853+0000 7fe18dffb700 1 -- 172.21.15.6:0/848835089 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe1900fef10 con 0x7fe17c06cab0 2024-03-12T16:33:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe17c06cab0 msgr2=0x7fe17c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe17c06cab0 0x7fe17c06ef70 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 rx=0x7fe178007fd0 tx=0x7fe17800b040).stop 2024-03-12T16:33:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 msgr2=0x7fe19010e130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 0x7fe19010e130 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 rx=0x7fe180009380 tx=0x7fe180009cb0).stop 2024-03-12T16:33:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 shutdown_connections 2024-03-12T16:33:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe17c06cab0 0x7fe17c06ef70 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:15.851 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe1900f88a0 0x7fe19010e130 unknown :-1 s=CLOSED pgs=524 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 --2- 172.21.15.6:0/848835089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe1900f9200 0x7fe19010e620 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 >> 172.21.15.6:0/848835089 conn(0x7fe190070590 msgr2=0x7fe1900fc250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 shutdown_connections 2024-03-12T16:33:15.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.856+0000 7fe196bc6700 1 -- 172.21.15.6:0/848835089 wait complete. 2024-03-12T16:33:15.861 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:33:15.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:15 smithi134 ceph-mon[85099]: pgmap v600: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:15.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:15 smithi006 ceph-mon[103869]: pgmap v600: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.958+0000 7fa3b10e1700 1 -- 172.21.15.6:0/1876038506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f9200 msgr2=0x7fa3ac101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.958+0000 7fa3b10e1700 1 --2- 172.21.15.6:0/1876038506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f9200 0x7fa3ac101910 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 rx=0x7fa39c0047f0 tx=0x7fa39c009cb0).stop 2024-03-12T16:33:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.958+0000 7fa3b10e1700 1 -- 172.21.15.6:0/1876038506 shutdown_connections 2024-03-12T16:33:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.958+0000 7fa3b10e1700 1 --2- 172.21.15.6:0/1876038506 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f9200 0x7fa3ac101910 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.958+0000 7fa3b10e1700 1 --2- 172.21.15.6:0/1876038506 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3ac0f88a0 0x7fa3ac0f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.958+0000 7fa3b10e1700 1 -- 172.21.15.6:0/1876038506 >> 172.21.15.6:0/1876038506 conn(0x7fa3ac070590 msgr2=0x7fa3ac0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.958+0000 7fa3b10e1700 1 -- 172.21.15.6:0/1876038506 shutdown_connections 2024-03-12T16:33:15.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.959+0000 7fa3b10e1700 1 -- 172.21.15.6:0/1876038506 wait complete. 2024-03-12T16:33:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.959+0000 7fa3b10e1700 1 Processor -- start 2024-03-12T16:33:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.959+0000 7fa3b10e1700 1 -- start start 2024-03-12T16:33:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3b10e1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f88a0 0x7fa3ac10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3b10e1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3ac0f9200 0x7fa3ac10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3b10e1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac10eb70 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3b10e1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa3ac10ecb0 con 0x7fa3ac0f9200 2024-03-12T16:33:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3aad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f88a0 0x7fa3ac10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:15.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3aad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f88a0 0x7fa3ac10e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59412/0 (socket says 172.21.15.6:59412) 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3aad9d700 1 -- 172.21.15.6:0/949915662 learned_addr learned my addr 172.21.15.6:0/949915662 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3aa59c700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3ac0f9200 0x7fa3ac10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3aad9d700 1 -- 172.21.15.6:0/949915662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3ac0f9200 msgr2=0x7fa3ac10e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3aad9d700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3ac0f9200 0x7fa3ac10e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3aad9d700 1 -- 172.21.15.6:0/949915662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa39c005040 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3aad9d700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f88a0 0x7fa3ac10e080 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fa3a000c740 tx=0x7fa3a0007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa393fff700 1 -- 172.21.15.6:0/949915662 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a000e680 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa393fff700 1 -- 172.21.15.6:0/949915662 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa3a000ec90 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa3ac108340 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.960+0000 7fa393fff700 1 -- 172.21.15.6:0/949915662 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa3a0013d30 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.961+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa3ac108880 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.962+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa3ac05f590 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.962+0000 7fa393fff700 1 -- 172.21.15.6:0/949915662 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa3a0013410 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.962+0000 7fa393fff700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa39406caa0 0x7fa39406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.962+0000 7fa393fff700 1 -- 172.21.15.6:0/949915662 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa3a008bfd0 con 0x7fa3ac0f88a0 2024-03-12T16:33:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.962+0000 7fa3aa59c700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa39406caa0 0x7fa39406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:15.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.963+0000 7fa3aa59c700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa39406caa0 0x7fa39406ef60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fa39c007cf0 tx=0x7fa39c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:15.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:15.967+0000 7fa393fff700 1 -- 172.21.15.6:0/949915662 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa3a0059b30 con 0x7fa3ac0f88a0 2024-03-12T16:33:16.176 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.181+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fa3ac108b00 con 0x7fa39406caa0 2024-03-12T16:33:16.177 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.182+0000 7fa393fff700 1 -- 172.21.15.6:0/949915662 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fa3ac108b00 con 0x7fa39406caa0 2024-03-12T16:33:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa39406caa0 msgr2=0x7fa39406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa39406caa0 0x7fa39406ef60 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 rx=0x7fa39c007cf0 tx=0x7fa39c00b040).stop 2024-03-12T16:33:16.179 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f88a0 msgr2=0x7fa3ac10e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f88a0 0x7fa3ac10e080 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 rx=0x7fa3a000c740 tx=0x7fa3a0007ef0).stop 2024-03-12T16:33:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 shutdown_connections 2024-03-12T16:33:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa39406caa0 0x7fa39406ef60 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa3ac0f88a0 0x7fa3ac10e080 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 --2- 172.21.15.6:0/949915662 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa3ac0f9200 0x7fa3ac10e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 >> 172.21.15.6:0/949915662 conn(0x7fa3ac070590 msgr2=0x7fa3ac0fc150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 shutdown_connections 2024-03-12T16:33:16.180 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.184+0000 7fa3b10e1700 1 -- 172.21.15.6:0/949915662 wait complete. 2024-03-12T16:33:16.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 -- 172.21.15.6:0/2341680743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fe230 msgr2=0x7fce500f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.281 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 --2- 172.21.15.6:0/2341680743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fe230 0x7fce500f5fa0 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 rx=0x7fce400047f0 tx=0x7fce40009cb0).stop 2024-03-12T16:33:16.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 -- 172.21.15.6:0/2341680743 shutdown_connections 2024-03-12T16:33:16.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 --2- 172.21.15.6:0/2341680743 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fe230 0x7fce500f5fa0 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 --2- 172.21.15.6:0/2341680743 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce500fd8d0 0x7fce500fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 -- 172.21.15.6:0/2341680743 >> 172.21.15.6:0/2341680743 conn(0x7fce5006ce40 msgr2=0x7fce5006d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:16.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 -- 172.21.15.6:0/2341680743 shutdown_connections 2024-03-12T16:33:16.282 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 -- 172.21.15.6:0/2341680743 wait complete. 2024-03-12T16:33:16.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 Processor -- start 2024-03-12T16:33:16.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.286+0000 7fce56511700 1 -- start start 2024-03-12T16:33:16.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce56511700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fd8d0 0x7fce5010e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:16.283 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce56511700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce500fe230 0x7fce5010e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce56511700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5010eb20 con 0x7fce500fd8d0 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce56511700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fce5010ec60 con 0x7fce500fe230 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fd8d0 0x7fce5010e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce4ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fd8d0 0x7fce5010e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59436/0 (socket says 172.21.15.6:59436) 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce4ffff700 1 -- 172.21.15.6:0/1629484545 learned_addr learned my addr 172.21.15.6:0/1629484545 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce4f7fe700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce500fe230 0x7fce5010e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce4ffff700 1 -- 172.21.15.6:0/1629484545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce500fe230 msgr2=0x7fce5010e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce4ffff700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce500fe230 0x7fce5010e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce4ffff700 1 -- 172.21.15.6:0/1629484545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fce40005040 con 0x7fce500fd8d0 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.287+0000 7fce4ffff700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fd8d0 0x7fce5010e030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fce380041d0 tx=0x7fce38009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.288+0000 7fce4d7fa700 1 -- 172.21.15.6:0/1629484545 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce38002d90 con 0x7fce500fd8d0 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.288+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fce501082f0 con 0x7fce500fd8d0 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.288+0000 7fce4d7fa700 1 -- 172.21.15.6:0/1629484545 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fce3800f040 con 0x7fce500fd8d0 2024-03-12T16:33:16.284 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.288+0000 7fce4d7fa700 1 -- 172.21.15.6:0/1629484545 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fce3800d800 con 0x7fce500fd8d0 2024-03-12T16:33:16.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.288+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fce50108830 con 0x7fce500fd8d0 2024-03-12T16:33:16.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.289+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fce5005f090 con 0x7fce500fd8d0 2024-03-12T16:33:16.285 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.289+0000 7fce4d7fa700 1 -- 172.21.15.6:0/1629484545 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fce3800dac0 con 0x7fce500fd8d0 2024-03-12T16:33:16.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.290+0000 7fce4d7fa700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fce3c06caa0 0x7fce3c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:16.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.290+0000 7fce4d7fa700 1 -- 172.21.15.6:0/1629484545 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fce3808bde0 con 0x7fce500fd8d0 2024-03-12T16:33:16.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.290+0000 7fce4f7fe700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fce3c06caa0 0x7fce3c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:16.286 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.290+0000 7fce4f7fe700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fce3c06caa0 0x7fce3c06ef60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fce40000c00 tx=0x7fce4000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:16.289 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.294+0000 7fce4d7fa700 1 -- 172.21.15.6:0/1629484545 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fce38059940 con 0x7fce500fd8d0 2024-03-12T16:33:16.496 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.501+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7fce50108ab0 con 0x7fce3c06caa0 2024-03-12T16:33:16.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.511+0000 7fce4d7fa700 1 -- 172.21.15.6:0/1629484545 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7fce50108ab0 con 0x7fce3c06caa0 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (20m) 13m ago 31m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (17m) 13m ago 31m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (17m) 13m ago 30m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (19m) 13m ago 30m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (14m) 13m ago 25m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (13m) 13m ago 25m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (13m) 13m ago 25m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (13m) 13m ago 25m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (21m) 13m ago 32m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (20m) 13m ago 30m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:33:16.507 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (18m) 13m ago 32m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (18m) 13m ago 30m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (20m) 13m ago 30m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (20m) 13m ago 29m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (17m) 13m ago 29m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (16m) 13m ago 29m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (16m) 13m ago 28m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (15m) 13m ago 28m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (15m) 13m ago 27m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (14m) 13m ago 27m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:33:16.508 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (20m) 13m ago 29m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fce3c06caa0 msgr2=0x7fce3c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fce3c06caa0 0x7fce3c06ef60 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 rx=0x7fce40000c00 tx=0x7fce4000b040).stop 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fd8d0 msgr2=0x7fce5010e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fd8d0 0x7fce5010e030 secure :-1 s=READY pgs=528 cs=0 l=1 rev1=1 rx=0x7fce380041d0 tx=0x7fce38009f60).stop 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 shutdown_connections 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fce3c06caa0 0x7fce3c06ef60 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fce500fd8d0 0x7fce5010e030 unknown :-1 s=CLOSED pgs=528 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 --2- 172.21.15.6:0/1629484545 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fce500fe230 0x7fce5010e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 >> 172.21.15.6:0/1629484545 conn(0x7fce5006ce40 msgr2=0x7fce50100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 shutdown_connections 2024-03-12T16:33:16.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.513+0000 7fce56511700 1 -- 172.21.15.6:0/1629484545 wait complete. 2024-03-12T16:33:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.614+0000 7f61162cd700 1 -- 172.21.15.6:0/466089600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fd150 msgr2=0x7f61100f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.614+0000 7f61162cd700 1 --2- 172.21.15.6:0/466089600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fd150 0x7f61100f6930 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 rx=0x7f61040047f0 tx=0x7f6104009cb0).stop 2024-03-12T16:33:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.614+0000 7f61162cd700 1 -- 172.21.15.6:0/466089600 shutdown_connections 2024-03-12T16:33:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.614+0000 7f61162cd700 1 --2- 172.21.15.6:0/466089600 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fd150 0x7f61100f6930 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.614+0000 7f61162cd700 1 --2- 172.21.15.6:0/466089600 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61100fc7f0 0x7f61100fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.614+0000 7f61162cd700 1 -- 172.21.15.6:0/466089600 >> 172.21.15.6:0/466089600 conn(0x7f6110070590 msgr2=0x7f61100f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.614+0000 7f61162cd700 1 -- 172.21.15.6:0/466089600 shutdown_connections 2024-03-12T16:33:16.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.614+0000 7f61162cd700 1 -- 172.21.15.6:0/466089600 wait complete. 2024-03-12T16:33:16.612 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.615+0000 7f61162cd700 1 Processor -- start 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.615+0000 7f61162cd700 1 -- start start 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.615+0000 7f61162cd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fc7f0 0x7f61101090a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.615+0000 7f61162cd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61100fd150 0x7f6110109590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f61162cd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110109a80 con 0x7f61100fc7f0 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f61162cd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6110109bc0 con 0x7f61100fd150 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fc7f0 0x7f61101090a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fc7f0 0x7f61101090a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59458/0 (socket says 172.21.15.6:59458) 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610ffff700 1 -- 172.21.15.6:0/1292200076 learned_addr learned my addr 172.21.15.6:0/1292200076 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610f7fe700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61100fd150 0x7f6110109590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610ffff700 1 -- 172.21.15.6:0/1292200076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61100fd150 msgr2=0x7f6110109590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610ffff700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61100fd150 0x7f6110109590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610ffff700 1 -- 172.21.15.6:0/1292200076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6104005040 con 0x7f61100fc7f0 2024-03-12T16:33:16.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610ffff700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fc7f0 0x7f61101090a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f610000c740 tx=0x7f6100007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:16.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610d775700 1 -- 172.21.15.6:0/1292200076 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f610000e680 con 0x7f61100fc7f0 2024-03-12T16:33:16.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6110109e70 con 0x7f61100fc7f0 2024-03-12T16:33:16.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610d775700 1 -- 172.21.15.6:0/1292200076 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f610000ec90 con 0x7f61100fc7f0 2024-03-12T16:33:16.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f610d775700 1 -- 172.21.15.6:0/1292200076 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6100013d60 con 0x7f61100fc7f0 2024-03-12T16:33:16.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.616+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6110112490 con 0x7f61100fc7f0 2024-03-12T16:33:16.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.617+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f611005f590 con 0x7f61100fc7f0 2024-03-12T16:33:16.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.618+0000 7f610d775700 1 -- 172.21.15.6:0/1292200076 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f610000e7e0 con 0x7f61100fc7f0 2024-03-12T16:33:16.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.618+0000 7f610d775700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60f806caa0 0x7f60f806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:16.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.618+0000 7f610d775700 1 -- 172.21.15.6:0/1292200076 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f610008c090 con 0x7f61100fc7f0 2024-03-12T16:33:16.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.618+0000 7f610f7fe700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60f806caa0 0x7f60f806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:16.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.619+0000 7f610f7fe700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60f806caa0 0x7f60f806ef60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f6104004f10 tx=0x7f610400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:16.618 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.623+0000 7f610d775700 1 -- 172.21.15.6:0/1292200076 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6100056160 con 0x7f61100fc7f0 2024-03-12T16:33:16.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.905+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6110047540 con 0x7f61100fc7f0 2024-03-12T16:33:16.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.905+0000 7f610d775700 1 -- 172.21.15.6:0/1292200076 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f6100059780 con 0x7f61100fc7f0 2024-03-12T16:33:16.901 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:33:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:33:16.901 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:33:16.902 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:33:16.903 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:33:16.903 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.907+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60f806caa0 msgr2=0x7f60f806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.903 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.907+0000 7f61162cd700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60f806caa0 0x7f60f806ef60 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 rx=0x7f6104004f10 tx=0x7f610400b040).stop 2024-03-12T16:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.907+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fc7f0 msgr2=0x7f61101090a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.907+0000 7f61162cd700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fc7f0 0x7f61101090a0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 rx=0x7f610000c740 tx=0x7f6100007ef0).stop 2024-03-12T16:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.908+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 shutdown_connections 2024-03-12T16:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.908+0000 7f61162cd700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f60f806caa0 0x7f60f806ef60 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.908+0000 7f61162cd700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f61100fc7f0 0x7f61101090a0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.908+0000 7f61162cd700 1 --2- 172.21.15.6:0/1292200076 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f61100fd150 0x7f6110109590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.908+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 >> 172.21.15.6:0/1292200076 conn(0x7f6110070590 msgr2=0x7f61100fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.908+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 shutdown_connections 2024-03-12T16:33:16.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:16.908+0000 7f61162cd700 1 -- 172.21.15.6:0/1292200076 wait complete. 2024-03-12T16:33:16.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:16 smithi134 ceph-mon[85099]: from='client.35116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:16.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:16 smithi006 ceph-mon[103869]: from='client.35116 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.008+0000 7f1841132700 1 -- 172.21.15.6:0/239808152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fc7f0 msgr2=0x7f183c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.008+0000 7f1841132700 1 --2- 172.21.15.6:0/239808152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fc7f0 0x7f183c0fcbd0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 rx=0x7f182c0047f0 tx=0x7f182c009cb0).stop 2024-03-12T16:33:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.008+0000 7f1841132700 1 -- 172.21.15.6:0/239808152 shutdown_connections 2024-03-12T16:33:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.008+0000 7f1841132700 1 --2- 172.21.15.6:0/239808152 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c0fd150 0x7f183c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:33:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.008+0000 7f1841132700 1 --2- 172.21.15.6:0/239808152 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fc7f0 0x7f183c0fcbd0 unknown :-1 s=CLOSED pgs=531 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.008+0000 7f1841132700 1 -- 172.21.15.6:0/239808152 >> 172.21.15.6:0/239808152 conn(0x7f183c070590 msgr2=0x7f183c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.008+0000 7f1841132700 1 -- 172.21.15.6:0/239808152 shutdown_connections 2024-03-12T16:33:17.004 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.008+0000 7f1841132700 1 -- 172.21.15.6:0/239808152 wait complete. 2024-03-12T16:33:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.009+0000 7f1841132700 1 Processor -- start 2024-03-12T16:33:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.009+0000 7f1841132700 1 -- start start 2024-03-12T16:33:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f1841132700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c0fc7f0 0x7f183c10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f1841132700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fd150 0x7f183c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f1841132700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c10ec00 con 0x7f183c0fd150 2024-03-12T16:33:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f1841132700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f183c108220 con 0x7f183c0fc7f0 2024-03-12T16:33:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f183a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fd150 0x7f183c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:17.006 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f183a59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fd150 0x7f183c10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59486/0 (socket says 172.21.15.6:59486) 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f183a59c700 1 -- 172.21.15.6:0/957229795 learned_addr learned my addr 172.21.15.6:0/957229795 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f183ad9d700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c0fc7f0 0x7f183c10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f183a59c700 1 -- 172.21.15.6:0/957229795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c0fc7f0 msgr2=0x7f183c10e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f183a59c700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c0fc7f0 0x7f183c10e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f183a59c700 1 -- 172.21.15.6:0/957229795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f182c005040 con 0x7f183c0fd150 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f183a59c700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fd150 0x7f183c10e570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f183000b480 tx=0x7f18300090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f1823fff700 1 -- 172.21.15.6:0/957229795 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1830002500 con 0x7f183c0fd150 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f1823fff700 1 -- 172.21.15.6:0/957229795 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1830002b10 con 0x7f183c0fd150 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f183c1084d0 con 0x7f183c0fd150 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f1823fff700 1 -- 172.21.15.6:0/957229795 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1830012c90 con 0x7f183c0fd150 2024-03-12T16:33:17.007 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.010+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f183c108a10 con 0x7f183c0fd150 2024-03-12T16:33:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.011+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f183c05f590 con 0x7f183c0fd150 2024-03-12T16:33:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.012+0000 7f1823fff700 1 -- 172.21.15.6:0/957229795 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f1830002660 con 0x7f183c0fd150 2024-03-12T16:33:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.013+0000 7f1823fff700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f182406caa0 0x7f182406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.013+0000 7f183ad9d700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f182406caa0 0x7f182406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.013+0000 7f1823fff700 1 -- 172.21.15.6:0/957229795 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f183008be10 con 0x7f183c0fd150 2024-03-12T16:33:17.008 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.013+0000 7f183ad9d700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f182406caa0 0x7f182406ef60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f182c004f10 tx=0x7f182c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:17.012 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.017+0000 7f1823fff700 1 -- 172.21.15.6:0/957229795 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1830059970 con 0x7f183c0fd150 2024-03-12T16:33:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.256+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f183c103610 con 0x7f183c0fd150 2024-03-12T16:33:17.252 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.257+0000 7f1823fff700 1 -- 172.21.15.6:0/957229795 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7f1830059500 con 0x7f183c0fd150 2024-03-12T16:33:17.252 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:33:17.252 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:33:17.253 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:33:17.254 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:33:17.254 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:33:17.254 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:33:17.254 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:33:17.254 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:33:17.254 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:33:17.257 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:33:17.257 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:33:17.257 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:33:17.257 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:33:17.257 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:33:17.257 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:33:17.257 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:33:17.257 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:33:17.258 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:33:17.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f182406caa0 msgr2=0x7f182406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f182406caa0 0x7f182406ef60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 rx=0x7f182c004f10 tx=0x7f182c00b040).stop 2024-03-12T16:33:17.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fd150 msgr2=0x7f183c10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fd150 0x7f183c10e570 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 rx=0x7f183000b480 tx=0x7f18300090f0).stop 2024-03-12T16:33:17.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 shutdown_connections 2024-03-12T16:33:17.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f183c0fc7f0 0x7f183c10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.259 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f182406caa0 0x7f182406ef60 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 --2- 172.21.15.6:0/957229795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f183c0fd150 0x7f183c10e570 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 >> 172.21.15.6:0/957229795 conn(0x7f183c070590 msgr2=0x7f183c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:17.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 shutdown_connections 2024-03-12T16:33:17.260 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.259+0000 7f1841132700 1 -- 172.21.15.6:0/957229795 wait complete. 2024-03-12T16:33:17.260 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:33:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.361+0000 7f058c6b1700 1 -- 172.21.15.6:0/2649961664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 msgr2=0x7f05840f8cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.361+0000 7f058c6b1700 1 --2- 172.21.15.6:0/2649961664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 0x7f05840f8cc0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 rx=0x7f05740047f0 tx=0x7f0574009cb0).stop 2024-03-12T16:33:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.361+0000 7f058c6b1700 1 -- 172.21.15.6:0/2649961664 shutdown_connections 2024-03-12T16:33:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.361+0000 7f058c6b1700 1 --2- 172.21.15.6:0/2649961664 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05840f9240 0x7f0584101950 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.361+0000 7f058c6b1700 1 --2- 172.21.15.6:0/2649961664 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 0x7f05840f8cc0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.361+0000 7f058c6b1700 1 -- 172.21.15.6:0/2649961664 >> 172.21.15.6:0/2649961664 conn(0x7f05840f2430 msgr2=0x7f05840f4850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.361+0000 7f058c6b1700 1 -- 172.21.15.6:0/2649961664 shutdown_connections 2024-03-12T16:33:17.357 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.361+0000 7f058c6b1700 1 -- 172.21.15.6:0/2649961664 wait complete. 2024-03-12T16:33:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f058c6b1700 1 Processor -- start 2024-03-12T16:33:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f058c6b1700 1 -- start start 2024-03-12T16:33:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f058c6b1700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 0x7f058410e0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f058c6b1700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05840f9240 0x7f058410e590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f058c6b1700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058410eb90 con 0x7f05840f88e0 2024-03-12T16:33:17.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f058c6b1700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f058410ecd0 con 0x7f05840f9240 2024-03-12T16:33:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f058a44d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 0x7f058410e0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f058a44d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 0x7f058410e0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59508/0 (socket says 172.21.15.6:59508) 2024-03-12T16:33:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f058a44d700 1 -- 172.21.15.6:0/1378618210 learned_addr learned my addr 172.21.15.6:0/1378618210 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.362+0000 7f0589c4c700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05840f9240 0x7f058410e590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f058a44d700 1 -- 172.21.15.6:0/1378618210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05840f9240 msgr2=0x7f058410e590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f058a44d700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05840f9240 0x7f058410e590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f058a44d700 1 -- 172.21.15.6:0/1378618210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0574005040 con 0x7f05840f88e0 2024-03-12T16:33:17.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f0589c4c700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05840f9240 0x7f058410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:33:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f058a44d700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 0x7f058410e0a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f0574005010 tx=0x7f0574009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f057b7fe700 1 -- 172.21.15.6:0/1378618210 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f057400e030 con 0x7f05840f88e0 2024-03-12T16:33:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f057b7fe700 1 -- 172.21.15.6:0/1378618210 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f0574007e90 con 0x7f05840f88e0 2024-03-12T16:33:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f057b7fe700 1 -- 172.21.15.6:0/1378618210 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0574018070 con 0x7f05840f88e0 2024-03-12T16:33:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0584108300 con 0x7f05840f88e0 2024-03-12T16:33:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.363+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05841087e0 con 0x7f05840f88e0 2024-03-12T16:33:17.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.364+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f0584047540 con 0x7f05840f88e0 2024-03-12T16:33:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.364+0000 7f057b7fe700 1 -- 172.21.15.6:0/1378618210 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f057401d6e0 con 0x7f05840f88e0 2024-03-12T16:33:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.365+0000 7f057b7fe700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f057006ca30 0x7f057006eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.365+0000 7f057b7fe700 1 -- 172.21.15.6:0/1378618210 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f057408d040 con 0x7f05840f88e0 2024-03-12T16:33:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.365+0000 7f0589c4c700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f057006ca30 0x7f057006eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:17.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.365+0000 7f0589c4c700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f057006ca30 0x7f057006eef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f05841099e0 tx=0x7f0580009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:17.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.369+0000 7f057b7fe700 1 -- 172.21.15.6:0/1378618210 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f057405a910 con 0x7f05840f88e0 2024-03-12T16:33:17.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.584+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f05840fee50 con 0x7f057006ca30 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.585+0000 7f057b7fe700 1 -- 172.21.15.6:0/1378618210 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f05840fee50 con 0x7f057006ca30 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:33:17.581 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:33:17.582 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:33:17.582 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:33:17.582 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:33:17.582 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:33:17.582 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:33:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f057006ca30 msgr2=0x7f057006eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f057006ca30 0x7f057006eef0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 rx=0x7f05841099e0 tx=0x7f0580009d60).stop 2024-03-12T16:33:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 msgr2=0x7f058410e0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 0x7f058410e0a0 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 rx=0x7f0574005010 tx=0x7f0574009cb0).stop 2024-03-12T16:33:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 shutdown_connections 2024-03-12T16:33:17.583 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f057006ca30 0x7f057006eef0 unknown :-1 s=CLOSED pgs=283 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05840f88e0 0x7f058410e0a0 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 --2- 172.21.15.6:0/1378618210 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05840f9240 0x7f058410e590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 >> 172.21.15.6:0/1378618210 conn(0x7f05840f2430 msgr2=0x7f05840fc190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 shutdown_connections 2024-03-12T16:33:17.584 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.588+0000 7f058c6b1700 1 -- 172.21.15.6:0/1378618210 wait complete. 2024-03-12T16:33:17.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.690+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1837988007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 msgr2=0x7f7e280f7090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.690+0000 7f7e2cda9700 1 --2- 172.21.15.6:0/1837988007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 0x7f7e280f7090 secure :-1 s=READY pgs=535 cs=0 l=1 rev1=1 rx=0x7f7e180047f0 tx=0x7f7e18009cb0).stop 2024-03-12T16:33:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.690+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1837988007 shutdown_connections 2024-03-12T16:33:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.690+0000 7f7e2cda9700 1 --2- 172.21.15.6:0/1837988007 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 0x7f7e280f7090 unknown :-1 s=CLOSED pgs=535 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.690+0000 7f7e2cda9700 1 --2- 172.21.15.6:0/1837988007 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e280fc870 0x7f7e280fcc50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.690+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1837988007 >> 172.21.15.6:0/1837988007 conn(0x7f7e2806ce40 msgr2=0x7f7e2806d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.690+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1837988007 shutdown_connections 2024-03-12T16:33:17.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.690+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1837988007 wait complete. 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e2cda9700 1 Processor -- start 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e2cda9700 1 -- start start 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e2cda9700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e280fc870 0x7f7e2810e0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e2cda9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 0x7f7e2810e5e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e2cda9700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2810ebe0 con 0x7f7e280fd140 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e2cda9700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7e2810ed20 con 0x7f7e280fc870 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e25d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 0x7f7e2810e5e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e25d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 0x7f7e2810e5e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:59532/0 (socket says 172.21.15.6:59532) 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e25d9b700 1 -- 172.21.15.6:0/1425475531 learned_addr learned my addr 172.21.15.6:0/1425475531 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.691+0000 7f7e2659c700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e280fc870 0x7f7e2810e0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.692+0000 7f7e25d9b700 1 -- 172.21.15.6:0/1425475531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e280fc870 msgr2=0x7f7e2810e0f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.688 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.692+0000 7f7e25d9b700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e280fc870 0x7f7e2810e0f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.692+0000 7f7e25d9b700 1 -- 172.21.15.6:0/1425475531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7e18005040 con 0x7f7e280fd140 2024-03-12T16:33:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.692+0000 7f7e25d9b700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 0x7f7e2810e5e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f7e18000c00 tx=0x7f7e18009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.692+0000 7f7e177fe700 1 -- 172.21.15.6:0/1425475531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e18018070 con 0x7f7e280fd140 2024-03-12T16:33:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.692+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7e28108350 con 0x7f7e280fd140 2024-03-12T16:33:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.692+0000 7f7e177fe700 1 -- 172.21.15.6:0/1425475531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7e18007e90 con 0x7f7e280fd140 2024-03-12T16:33:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.692+0000 7f7e177fe700 1 -- 172.21.15.6:0/1425475531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7e1801de60 con 0x7f7e280fd140 2024-03-12T16:33:17.689 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.692+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7e281088b0 con 0x7f7e280fd140 2024-03-12T16:33:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.693+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7e28060670 con 0x7f7e280fd140 2024-03-12T16:33:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.693+0000 7f7e177fe700 1 -- 172.21.15.6:0/1425475531 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7e1801d420 con 0x7f7e280fd140 2024-03-12T16:33:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.694+0000 7f7e177fe700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7e1006ca40 0x7f7e1006ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.694+0000 7f7e2659c700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7e1006ca40 0x7f7e1006ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.694+0000 7f7e177fe700 1 -- 172.21.15.6:0/1425475531 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f7e1808ca00 con 0x7f7e280fd140 2024-03-12T16:33:17.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.694+0000 7f7e2659c700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7e1006ca40 0x7f7e1006ef00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f7e20004fd0 tx=0x7f7e2000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:17.694 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.698+0000 7f7e177fe700 1 -- 172.21.15.6:0/1425475531 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7e1805a620 con 0x7f7e280fd140 2024-03-12T16:33:17.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:17 smithi134 ceph-mon[85099]: pgmap v601: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:17.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:17 smithi134 ceph-mon[85099]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:17.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:17 smithi134 ceph-mon[85099]: from='client.35124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:17.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:33:17.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:17 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1292200076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:33:17.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:17 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/957229795' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:33:17.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:17 smithi006 ceph-mon[103869]: pgmap v601: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:17.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:17 smithi006 ceph-mon[103869]: from='client.35120 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:17.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:17 smithi006 ceph-mon[103869]: from='client.35124 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:17.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:33:17.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:17 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1292200076' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:33:17.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:17 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/957229795' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:33:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.981+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f7e28047540 con 0x7f7e280fd140 2024-03-12T16:33:17.977 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.981+0000 7f7e177fe700 1 -- 172.21.15.6:0/1425475531 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f7e1805a1b0 con 0x7f7e280fd140 2024-03-12T16:33:17.977 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:33:17.977 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:33:17.977 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:33:17.977 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:33:17.977 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:33:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7e1006ca40 msgr2=0x7f7e1006ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7e1006ca40 0x7f7e1006ef00 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 rx=0x7f7e20004fd0 tx=0x7f7e2000b040).stop 2024-03-12T16:33:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 msgr2=0x7f7e2810e5e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 0x7f7e2810e5e0 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 rx=0x7f7e18000c00 tx=0x7f7e18009cb0).stop 2024-03-12T16:33:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 shutdown_connections 2024-03-12T16:33:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7e280fc870 0x7f7e2810e0f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7e1006ca40 0x7f7e1006ef00 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.979 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 --2- 172.21.15.6:0/1425475531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7e280fd140 0x7f7e2810e5e0 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 >> 172.21.15.6:0/1425475531 conn(0x7f7e2806ce40 msgr2=0x7f7e280f5c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 shutdown_connections 2024-03-12T16:33:17.980 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:17.983+0000 7f7e2cda9700 1 -- 172.21.15.6:0/1425475531 wait complete. 2024-03-12T16:33:18.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:18 smithi134 ceph-mon[85099]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:18.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:18 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1425475531' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:33:18.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:18 smithi006 ceph-mon[103869]: from='client.35136 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:18.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:18 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1425475531' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:33:19.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:19 smithi134 ceph-mon[85099]: pgmap v602: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:19.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:19 smithi006 ceph-mon[103869]: pgmap v602: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:21.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:21 smithi134 ceph-mon[85099]: pgmap v603: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:21.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:21 smithi006 ceph-mon[103869]: pgmap v603: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:23.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:23 smithi134 ceph-mon[85099]: pgmap v604: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:23.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:23 smithi006 ceph-mon[103869]: pgmap v604: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:25.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:25 smithi134 ceph-mon[85099]: pgmap v605: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:25.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:25 smithi006 ceph-mon[103869]: pgmap v605: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:27.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:27 smithi134 ceph-mon[85099]: pgmap v606: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:27.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:27 smithi006 ceph-mon[103869]: pgmap v606: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:29.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:29 smithi134 ceph-mon[85099]: pgmap v607: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:29.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:29 smithi006 ceph-mon[103869]: pgmap v607: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:31.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:31 smithi134 ceph-mon[85099]: pgmap v608: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:31.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:31 smithi006 ceph-mon[103869]: pgmap v608: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:32.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:33:32.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:33:33.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:33 smithi134 ceph-mon[85099]: pgmap v609: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:33.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:33 smithi006 ceph-mon[103869]: pgmap v609: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:35.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:35 smithi134 ceph-mon[85099]: pgmap v610: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:35.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:35 smithi006 ceph-mon[103869]: pgmap v610: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:37.950 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:37 smithi134 ceph-mon[85099]: pgmap v611: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:37.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:37 smithi006 ceph-mon[103869]: pgmap v611: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:39.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:39 smithi134 ceph-mon[85099]: pgmap v612: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:39.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:39 smithi006 ceph-mon[103869]: pgmap v612: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:41.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:41 smithi134 ceph-mon[85099]: pgmap v613: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:41.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:41 smithi006 ceph-mon[103869]: pgmap v613: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:43.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:43 smithi134 ceph-mon[85099]: pgmap v614: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:43.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:43 smithi006 ceph-mon[103869]: pgmap v614: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:45.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:45 smithi134 ceph-mon[85099]: pgmap v615: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:45.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:45 smithi006 ceph-mon[103869]: pgmap v615: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:47.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:47 smithi134 ceph-mon[85099]: pgmap v616: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:47.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:33:47.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:47 smithi006 ceph-mon[103869]: pgmap v616: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:47.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.098+0000 7f6ac242f700 1 -- 172.21.15.6:0/3239602857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 msgr2=0x7f6abc101910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.098+0000 7f6ac242f700 1 --2- 172.21.15.6:0/3239602857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 0x7f6abc101910 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 rx=0x7f6aac0047f0 tx=0x7f6aac009cb0).stop 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.098+0000 7f6ac242f700 1 -- 172.21.15.6:0/3239602857 shutdown_connections 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.098+0000 7f6ac242f700 1 --2- 172.21.15.6:0/3239602857 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 0x7f6abc101910 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.098+0000 7f6ac242f700 1 --2- 172.21.15.6:0/3239602857 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6abc0f88a0 0x7f6abc0f8c80 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.098+0000 7f6ac242f700 1 -- 172.21.15.6:0/3239602857 >> 172.21.15.6:0/3239602857 conn(0x7f6abc070590 msgr2=0x7f6abc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.098+0000 7f6ac242f700 1 -- 172.21.15.6:0/3239602857 shutdown_connections 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.098+0000 7f6ac242f700 1 -- 172.21.15.6:0/3239602857 wait complete. 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.099+0000 7f6ac242f700 1 Processor -- start 2024-03-12T16:33:48.095 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.099+0000 7f6ac242f700 1 -- start start 2024-03-12T16:33:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.099+0000 7f6ac242f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6abc0f88a0 0x7f6abc110290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.099+0000 7f6ac242f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 0x7f6abc110780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.099+0000 7f6ac242f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc110d80 con 0x7f6abc0f9200 2024-03-12T16:33:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.099+0000 7f6ac242f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6abc110ec0 con 0x7f6abc0f88a0 2024-03-12T16:33:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.099+0000 7f6abb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 0x7f6abc110780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.099+0000 7f6abb7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 0x7f6abc110780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:48978/0 (socket says 172.21.15.6:48978) 2024-03-12T16:33:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.099+0000 7f6abb7fe700 1 -- 172.21.15.6:0/602625126 learned_addr learned my addr 172.21.15.6:0/602625126 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6abbfff700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6abc0f88a0 0x7f6abc110290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:48.097 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6abb7fe700 1 -- 172.21.15.6:0/602625126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6abc0f88a0 msgr2=0x7f6abc110290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6abb7fe700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6abc0f88a0 0x7f6abc110290 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6abb7fe700 1 -- 172.21.15.6:0/602625126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6aac005040 con 0x7f6abc0f9200 2024-03-12T16:33:48.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6abb7fe700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 0x7f6abc110780 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f6aac005010 tx=0x7f6aac009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:48.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6ab97fa700 1 -- 172.21.15.6:0/602625126 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac00e030 con 0x7f6abc0f9200 2024-03-12T16:33:48.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6ab97fa700 1 -- 172.21.15.6:0/602625126 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6aac007e90 con 0x7f6abc0f9200 2024-03-12T16:33:48.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6abc10a530 con 0x7f6abc0f9200 2024-03-12T16:33:48.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6ab97fa700 1 -- 172.21.15.6:0/602625126 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6aac018070 con 0x7f6abc0f9200 2024-03-12T16:33:48.098 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.100+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6abc10aa10 con 0x7f6abc0f9200 2024-03-12T16:33:48.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.101+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6abc05f590 con 0x7f6abc0f9200 2024-03-12T16:33:48.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.103+0000 7f6ab97fa700 1 -- 172.21.15.6:0/602625126 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f6aac01d670 con 0x7f6abc0f9200 2024-03-12T16:33:48.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.103+0000 7f6ab97fa700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6aa406caa0 0x7f6aa406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:48.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.103+0000 7f6ab97fa700 1 -- 172.21.15.6:0/602625126 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6aac08d5e0 con 0x7f6abc0f9200 2024-03-12T16:33:48.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.103+0000 7f6abbfff700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6aa406caa0 0x7f6aa406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:48.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.104+0000 7f6abbfff700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6aa406caa0 0x7f6aa406ef60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f6ab0004dc0 tx=0x7f6ab000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:48.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.107+0000 7f6ab97fa700 1 -- 172.21.15.6:0/602625126 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6aac0576b0 con 0x7f6abc0f9200 2024-03-12T16:33:48.319 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.323+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f6abc101240 con 0x7f6aa406caa0 2024-03-12T16:33:48.320 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.324+0000 7f6ab97fa700 1 -- 172.21.15.6:0/602625126 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f6abc101240 con 0x7f6aa406caa0 2024-03-12T16:33:48.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6aa406caa0 msgr2=0x7f6aa406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6aa406caa0 0x7f6aa406ef60 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 rx=0x7f6ab0004dc0 tx=0x7f6ab000b040).stop 2024-03-12T16:33:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 msgr2=0x7f6abc110780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 0x7f6abc110780 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 rx=0x7f6aac005010 tx=0x7f6aac009cb0).stop 2024-03-12T16:33:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 shutdown_connections 2024-03-12T16:33:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6abc0f88a0 0x7f6abc110290 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6aa406caa0 0x7f6aa406ef60 unknown :-1 s=CLOSED pgs=286 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 --2- 172.21.15.6:0/602625126 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6abc0f9200 0x7f6abc110780 unknown :-1 s=CLOSED pgs=538 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 >> 172.21.15.6:0/602625126 conn(0x7f6abc070590 msgr2=0x7f6abc0f6eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 shutdown_connections 2024-03-12T16:33:48.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.326+0000 7f6ac242f700 1 -- 172.21.15.6:0/602625126 wait complete. 2024-03-12T16:33:48.332 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:33:48.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.428+0000 7fe0f8217700 1 -- 172.21.15.6:0/3493845026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 msgr2=0x7fe0f01019b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.428+0000 7fe0f8217700 1 --2- 172.21.15.6:0/3493845026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 0x7fe0f01019b0 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 rx=0x7fe0e00047f0 tx=0x7fe0e0009cb0).stop 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.428+0000 7fe0f8217700 1 -- 172.21.15.6:0/3493845026 shutdown_connections 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.428+0000 7fe0f8217700 1 --2- 172.21.15.6:0/3493845026 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 0x7fe0f01019b0 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.428+0000 7fe0f8217700 1 --2- 172.21.15.6:0/3493845026 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f00f8940 0x7fe0f00f8d20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.428+0000 7fe0f8217700 1 -- 172.21.15.6:0/3493845026 >> 172.21.15.6:0/3493845026 conn(0x7fe0f0070590 msgr2=0x7fe0f00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.428+0000 7fe0f8217700 1 -- 172.21.15.6:0/3493845026 shutdown_connections 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.429+0000 7fe0f8217700 1 -- 172.21.15.6:0/3493845026 wait complete. 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.429+0000 7fe0f8217700 1 Processor -- start 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.429+0000 7fe0f8217700 1 -- start start 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.429+0000 7fe0f8217700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f00f8940 0x7fe0f010e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:48.428 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.429+0000 7fe0f8217700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 0x7fe0f010e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.429+0000 7fe0f8217700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f010eb20 con 0x7fe0f00f9210 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.429+0000 7fe0f8217700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe0f010ec60 con 0x7fe0f00f8940 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.429+0000 7fe0f57b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 0x7fe0f010e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f57b2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 0x7fe0f010e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49000/0 (socket says 172.21.15.6:49000) 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f57b2700 1 -- 172.21.15.6:0/1176440844 learned_addr learned my addr 172.21.15.6:0/1176440844 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f5fb3700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f00f8940 0x7fe0f010e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f57b2700 1 -- 172.21.15.6:0/1176440844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f00f8940 msgr2=0x7fe0f010e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f57b2700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f00f8940 0x7fe0f010e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f57b2700 1 -- 172.21.15.6:0/1176440844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe0e0005040 con 0x7fe0f00f9210 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f5fb3700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f00f8940 0x7fe0f010e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f57b2700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 0x7fe0f010e520 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fe0e00043a0 tx=0x7fe0e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:48.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0e6ffd700 1 -- 172.21.15.6:0/1176440844 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e000e030 con 0x7fe0f00f9210 2024-03-12T16:33:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0e6ffd700 1 -- 172.21.15.6:0/1176440844 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe0e0007e90 con 0x7fe0f00f9210 2024-03-12T16:33:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0e6ffd700 1 -- 172.21.15.6:0/1176440844 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe0e0018070 con 0x7fe0f00f9210 2024-03-12T16:33:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe0f0108290 con 0x7fe0f00f9210 2024-03-12T16:33:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.430+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe0f0108770 con 0x7fe0f00f9210 2024-03-12T16:33:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.431+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe0f005f590 con 0x7fe0f00f9210 2024-03-12T16:33:48.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.432+0000 7fe0e6ffd700 1 -- 172.21.15.6:0/1176440844 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe0e0009590 con 0x7fe0f00f9210 2024-03-12T16:33:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.432+0000 7fe0e6ffd700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe0dc06ca40 0x7fe0dc06ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.432+0000 7fe0e6ffd700 1 -- 172.21.15.6:0/1176440844 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe0e008d0b0 con 0x7fe0f00f9210 2024-03-12T16:33:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.432+0000 7fe0f5fb3700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe0dc06ca40 0x7fe0dc06ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:48.431 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.432+0000 7fe0f5fb3700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe0dc06ca40 0x7fe0dc06ef00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fe0ec009250 tx=0x7fe0ec009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:48.432 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.437+0000 7fe0e6ffd700 1 -- 172.21.15.6:0/1176440844 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe0e005ac10 con 0x7fe0f00f9210 2024-03-12T16:33:48.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.653+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7fe0f0109790 con 0x7fe0dc06ca40 2024-03-12T16:33:48.650 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.654+0000 7fe0e6ffd700 1 -- 172.21.15.6:0/1176440844 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7fe0f0109790 con 0x7fe0dc06ca40 2024-03-12T16:33:48.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe0dc06ca40 msgr2=0x7fe0dc06ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe0dc06ca40 0x7fe0dc06ef00 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 rx=0x7fe0ec009250 tx=0x7fe0ec009d60).stop 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 msgr2=0x7fe0f010e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 0x7fe0f010e520 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 rx=0x7fe0e00043a0 tx=0x7fe0e0009cb0).stop 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 shutdown_connections 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe0f00f8940 0x7fe0f010e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe0dc06ca40 0x7fe0dc06ef00 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 --2- 172.21.15.6:0/1176440844 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe0f00f9210 0x7fe0f010e520 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 >> 172.21.15.6:0/1176440844 conn(0x7fe0f0070590 msgr2=0x7fe0f00fc180 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 shutdown_connections 2024-03-12T16:33:48.653 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.656+0000 7fe0f8217700 1 -- 172.21.15.6:0/1176440844 wait complete. 2024-03-12T16:33:48.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.759+0000 7f73157a0700 1 -- 172.21.15.6:0/1754499975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fd150 msgr2=0x7f73100f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.759+0000 7f73157a0700 1 --2- 172.21.15.6:0/1754499975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fd150 0x7f73100f6930 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 rx=0x7f72f80047f0 tx=0x7f72f8009cb0).stop 2024-03-12T16:33:48.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.759+0000 7f73157a0700 1 -- 172.21.15.6:0/1754499975 shutdown_connections 2024-03-12T16:33:48.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.759+0000 7f73157a0700 1 --2- 172.21.15.6:0/1754499975 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fd150 0x7f73100f6930 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.759+0000 7f73157a0700 1 --2- 172.21.15.6:0/1754499975 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100fc7f0 0x7f73100fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.759+0000 7f73157a0700 1 -- 172.21.15.6:0/1754499975 >> 172.21.15.6:0/1754499975 conn(0x7f73100f23b0 msgr2=0x7f73100f47d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.759+0000 7f73157a0700 1 -- 172.21.15.6:0/1754499975 shutdown_connections 2024-03-12T16:33:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.759+0000 7f73157a0700 1 -- 172.21.15.6:0/1754499975 wait complete. 2024-03-12T16:33:48.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.759+0000 7f73157a0700 1 Processor -- start 2024-03-12T16:33:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f73157a0700 1 -- start start 2024-03-12T16:33:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f73157a0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fc7f0 0x7f731010dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f73157a0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100fd150 0x7f731010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f73157a0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731010eae0 con 0x7f73100fc7f0 2024-03-12T16:33:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f73157a0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f731010ec20 con 0x7f73100fd150 2024-03-12T16:33:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f730effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fc7f0 0x7f731010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f730effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fc7f0 0x7f731010dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49020/0 (socket says 172.21.15.6:49020) 2024-03-12T16:33:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f730effd700 1 -- 172.21.15.6:0/2128369542 learned_addr learned my addr 172.21.15.6:0/2128369542 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:48.757 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f730effd700 1 -- 172.21.15.6:0/2128369542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100fd150 msgr2=0x7f731010e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f730effd700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100fd150 0x7f731010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:33:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f730effd700 1 -- 172.21.15.6:0/2128369542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f72f8005040 con 0x7f73100fc7f0 2024-03-12T16:33:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.760+0000 7f730effd700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fc7f0 0x7f731010dff0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f7300002770 tx=0x7f7300002b30).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.761+0000 7f7307fff700 1 -- 172.21.15.6:0/2128369542 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7300002d80 con 0x7f73100fc7f0 2024-03-12T16:33:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.761+0000 7f7307fff700 1 -- 172.21.15.6:0/2128369542 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f730000f040 con 0x7f73100fc7f0 2024-03-12T16:33:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.761+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73101082b0 con 0x7f73100fc7f0 2024-03-12T16:33:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.761+0000 7f7307fff700 1 -- 172.21.15.6:0/2128369542 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f730000d800 con 0x7f73100fc7f0 2024-03-12T16:33:48.758 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.761+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73101087f0 con 0x7f73100fc7f0 2024-03-12T16:33:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.762+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7310060370 con 0x7f73100fc7f0 2024-03-12T16:33:48.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.762+0000 7f7307fff700 1 -- 172.21.15.6:0/2128369542 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7300009110 con 0x7f73100fc7f0 2024-03-12T16:33:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.763+0000 7f7307fff700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f72fc06caa0 0x7f72fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.763+0000 7f7307fff700 1 -- 172.21.15.6:0/2128369542 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f730008b8f0 con 0x7f73100fc7f0 2024-03-12T16:33:48.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.763+0000 7f730e7fc700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f72fc06caa0 0x7f72fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:48.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.763+0000 7f730e7fc700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f72fc06caa0 0x7f72fc06ef60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f7310109930 tx=0x7f72f8009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:48.763 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.767+0000 7f7307fff700 1 -- 172.21.15.6:0/2128369542 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7300059450 con 0x7f73100fc7f0 2024-03-12T16:33:48.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.975+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7310108ee0 con 0x7f72fc06caa0 2024-03-12T16:33:48.981 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.985+0000 7f7307fff700 1 -- 172.21.15.6:0/2128369542 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f7310108ee0 con 0x7f72fc06caa0 2024-03-12T16:33:48.981 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:33:48.981 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (20m) 14m ago 31m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:33:48.981 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (18m) 14m ago 31m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:33:48.981 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (18m) 13m ago 30m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:33:48.981 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (20m) 14m ago 31m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:33:48.981 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (14m) 14m ago 26m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:33:48.981 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (14m) 14m ago 26m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (14m) 13m ago 26m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (13m) 13m ago 26m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (22m) 14m ago 32m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (21m) 13m ago 30m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (19m) 14m ago 33m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (19m) 13m ago 30m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (21m) 14m ago 31m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (21m) 13m ago 30m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (17m) 14m ago 30m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (17m) 14m ago 29m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (16m) 14m ago 29m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (16m) 13m ago 28m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (15m) 13m ago 28m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (15m) 13m ago 27m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:33:48.982 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (20m) 13m ago 29m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:33:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f72fc06caa0 msgr2=0x7f72fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f72fc06caa0 0x7f72fc06ef60 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 rx=0x7f7310109930 tx=0x7f72f8009cb0).stop 2024-03-12T16:33:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fc7f0 msgr2=0x7f731010dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:48.983 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fc7f0 0x7f731010dff0 secure :-1 s=READY pgs=542 cs=0 l=1 rev1=1 rx=0x7f7300002770 tx=0x7f7300002b30).stop 2024-03-12T16:33:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 shutdown_connections 2024-03-12T16:33:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f72fc06caa0 0x7f72fc06ef60 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73100fc7f0 0x7f731010dff0 unknown :-1 s=CLOSED pgs=542 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 --2- 172.21.15.6:0/2128369542 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73100fd150 0x7f731010e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:33:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 >> 172.21.15.6:0/2128369542 conn(0x7f73100f23b0 msgr2=0x7f7310060b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 shutdown_connections 2024-03-12T16:33:48.984 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:48.987+0000 7f73157a0700 1 -- 172.21.15.6:0/2128369542 wait complete. 2024-03-12T16:33:49.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.088+0000 7ff877d5f700 1 -- 172.21.15.6:0/115254306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fd160 msgr2=0x7ff8700f6940 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.088+0000 7ff877d5f700 1 --2- 172.21.15.6:0/115254306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fd160 0x7ff8700f6940 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 rx=0x7ff8600047f0 tx=0x7ff860009cb0).stop 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.088+0000 7ff877d5f700 1 -- 172.21.15.6:0/115254306 shutdown_connections 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.088+0000 7ff877d5f700 1 --2- 172.21.15.6:0/115254306 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fd160 0x7ff8700f6940 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.088+0000 7ff877d5f700 1 --2- 172.21.15.6:0/115254306 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8700fc800 0x7ff8700fcbe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.088+0000 7ff877d5f700 1 -- 172.21.15.6:0/115254306 >> 172.21.15.6:0/115254306 conn(0x7ff8700f23c0 msgr2=0x7ff8700f47e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.089+0000 7ff877d5f700 1 -- 172.21.15.6:0/115254306 shutdown_connections 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.089+0000 7ff877d5f700 1 -- 172.21.15.6:0/115254306 wait complete. 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.089+0000 7ff877d5f700 1 Processor -- start 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.089+0000 7ff877d5f700 1 -- start start 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.089+0000 7ff877d5f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fc800 0x7ff8700f8550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.089+0000 7ff877d5f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8700fd160 0x7ff8700f8a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.089+0000 7ff877d5f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700f8f30 con 0x7ff8700fc800 2024-03-12T16:33:49.087 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.089+0000 7ff877d5f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff8700f9070 con 0x7ff8700fd160 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff875afb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fc800 0x7ff8700f8550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff875afb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fc800 0x7ff8700f8550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49030/0 (socket says 172.21.15.6:49030) 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff875afb700 1 -- 172.21.15.6:0/947084189 learned_addr learned my addr 172.21.15.6:0/947084189 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff8752fa700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8700fd160 0x7ff8700f8a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff875afb700 1 -- 172.21.15.6:0/947084189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8700fd160 msgr2=0x7ff8700f8a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff875afb700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8700fd160 0x7ff8700f8a40 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff875afb700 1 -- 172.21.15.6:0/947084189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff860005040 con 0x7ff8700fc800 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff875afb700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fc800 0x7ff8700f8550 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7ff86c0041d0 tx=0x7ff86c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff866ffd700 1 -- 172.21.15.6:0/947084189 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff86c007b40 con 0x7ff8700fc800 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff866ffd700 1 -- 172.21.15.6:0/947084189 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff86c00f040 con 0x7ff8700fc800 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff8700f9320 con 0x7ff8700fc800 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff866ffd700 1 -- 172.21.15.6:0/947084189 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff86c0147b0 con 0x7ff8700fc800 2024-03-12T16:33:49.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.090+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff8701146b0 con 0x7ff8700fc800 2024-03-12T16:33:49.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.091+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff870060370 con 0x7ff8700fc800 2024-03-12T16:33:49.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.092+0000 7ff866ffd700 1 -- 172.21.15.6:0/947084189 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7ff86c009110 con 0x7ff8700fc800 2024-03-12T16:33:49.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.092+0000 7ff866ffd700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff85c06caa0 0x7ff85c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:49.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.092+0000 7ff866ffd700 1 -- 172.21.15.6:0/947084189 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff86c08bcf0 con 0x7ff8700fc800 2024-03-12T16:33:49.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.092+0000 7ff8752fa700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff85c06caa0 0x7ff85c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:49.090 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.092+0000 7ff8752fa700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff85c06caa0 0x7ff85c06ef60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7ff8700f9cf0 tx=0x7ff86000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:49.092 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.096+0000 7ff866ffd700 1 -- 172.21.15.6:0/947084189 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff86c055dc0 con 0x7ff8700fc800 2024-03-12T16:33:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.377+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7ff8700f9b40 con 0x7ff8700fc800 2024-03-12T16:33:49.374 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.378+0000 7ff866ffd700 1 -- 172.21.15.6:0/947084189 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7ff86c0593e0 con 0x7ff8700fc800 2024-03-12T16:33:49.374 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:33:49.375 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:33:49.376 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:33:49.376 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:33:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff85c06caa0 msgr2=0x7ff85c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff85c06caa0 0x7ff85c06ef60 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 rx=0x7ff8700f9cf0 tx=0x7ff86000b040).stop 2024-03-12T16:33:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fc800 msgr2=0x7ff8700f8550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fc800 0x7ff8700f8550 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 rx=0x7ff86c0041d0 tx=0x7ff86c009f60).stop 2024-03-12T16:33:49.376 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 shutdown_connections 2024-03-12T16:33:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff85c06caa0 0x7ff85c06ef60 unknown :-1 s=CLOSED pgs=289 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff8700fc800 0x7ff8700f8550 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 --2- 172.21.15.6:0/947084189 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff8700fd160 0x7ff8700f8a40 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 >> 172.21.15.6:0/947084189 conn(0x7ff8700f23c0 msgr2=0x7ff8700613c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 shutdown_connections 2024-03-12T16:33:49.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.380+0000 7ff877d5f700 1 -- 172.21.15.6:0/947084189 wait complete. 2024-03-12T16:33:49.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.481+0000 7fcda5ef3700 1 -- 172.21.15.6:0/2638920806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fc820 msgr2=0x7fcda00fcc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.481+0000 7fcda5ef3700 1 --2- 172.21.15.6:0/2638920806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fc820 0x7fcda00fcc00 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 rx=0x7fcd900047f0 tx=0x7fcd90009cb0).stop 2024-03-12T16:33:49.478 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.481+0000 7fcda5ef3700 1 -- 172.21.15.6:0/2638920806 shutdown_connections 2024-03-12T16:33:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.481+0000 7fcda5ef3700 1 --2- 172.21.15.6:0/2638920806 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcda00fd180 0x7fcda00f6960 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.481+0000 7fcda5ef3700 1 --2- 172.21.15.6:0/2638920806 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fc820 0x7fcda00fcc00 unknown :-1 s=CLOSED pgs=545 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.481+0000 7fcda5ef3700 1 -- 172.21.15.6:0/2638920806 >> 172.21.15.6:0/2638920806 conn(0x7fcda00f2400 msgr2=0x7fcda00f4820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.482+0000 7fcda5ef3700 1 -- 172.21.15.6:0/2638920806 shutdown_connections 2024-03-12T16:33:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.482+0000 7fcda5ef3700 1 -- 172.21.15.6:0/2638920806 wait complete. 2024-03-12T16:33:49.479 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.482+0000 7fcda5ef3700 1 Processor -- start 2024-03-12T16:33:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.482+0000 7fcda5ef3700 1 -- start start 2024-03-12T16:33:49.480 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcda5ef3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcda00fc820 0x7fcda010e120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcda5ef3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fd180 0x7fcda010e610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcda5ef3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda010ec10 con 0x7fcda00fd180 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcda5ef3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fcda010ed50 con 0x7fcda00fc820 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fd180 0x7fcda010e610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fd180 0x7fcda010e610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49054/0 (socket says 172.21.15.6:49054) 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9effd700 1 -- 172.21.15.6:0/663043217 learned_addr learned my addr 172.21.15.6:0/663043217 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9f7fe700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcda00fc820 0x7fcda010e120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9effd700 1 -- 172.21.15.6:0/663043217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcda00fc820 msgr2=0x7fcda010e120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9effd700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcda00fc820 0x7fcda010e120 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9effd700 1 -- 172.21.15.6:0/663043217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fcd90005040 con 0x7fcda00fd180 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9f7fe700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcda00fc820 0x7fcda010e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9effd700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fd180 0x7fcda010e610 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fcd9400e940 tx=0x7fcd9400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9cff9700 1 -- 172.21.15.6:0/663043217 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9400ee80 con 0x7fcda00fd180 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9cff9700 1 -- 172.21.15.6:0/663043217 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fcd9400f040 con 0x7fcda00fd180 2024-03-12T16:33:49.481 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fcda0108380 con 0x7fcda00fd180 2024-03-12T16:33:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcd9cff9700 1 -- 172.21.15.6:0/663043217 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fcd9400c810 con 0x7fcda00fd180 2024-03-12T16:33:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.483+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fcda0108940 con 0x7fcda00fd180 2024-03-12T16:33:49.482 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.484+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fcda005f090 con 0x7fcda00fd180 2024-03-12T16:33:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.485+0000 7fcd9cff9700 1 -- 172.21.15.6:0/663043217 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fcd940090d0 con 0x7fcda00fd180 2024-03-12T16:33:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.485+0000 7fcd9cff9700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd8806ca80 0x7fcd8806ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.485+0000 7fcd9cff9700 1 -- 172.21.15.6:0/663043217 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fcd9408b870 con 0x7fcda00fd180 2024-03-12T16:33:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.485+0000 7fcd9f7fe700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd8806ca80 0x7fcd8806ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:49.483 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.486+0000 7fcd9f7fe700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd8806ca80 0x7fcd8806ef40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fcd90004e60 tx=0x7fcd9000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:49.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.490+0000 7fcd9cff9700 1 -- 172.21.15.6:0/663043217 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fcd940593d0 con 0x7fcda00fd180 2024-03-12T16:33:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.737+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7fcda0108fd0 con 0x7fcda00fd180 2024-03-12T16:33:49.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.737+0000 7fcd9cff9700 1 -- 172.21.15.6:0/663043217 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7fcd94058f60 con 0x7fcda00fd180 2024-03-12T16:33:49.733 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:33:49.734 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:33:49.735 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:33:49.736 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:33:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd8806ca80 msgr2=0x7fcd8806ef40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd8806ca80 0x7fcd8806ef40 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 rx=0x7fcd90004e60 tx=0x7fcd9000b040).stop 2024-03-12T16:33:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fd180 msgr2=0x7fcda010e610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fd180 0x7fcda010e610 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 rx=0x7fcd9400e940 tx=0x7fcd9400b040).stop 2024-03-12T16:33:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 shutdown_connections 2024-03-12T16:33:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fcda00fc820 0x7fcda010e120 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fcd8806ca80 0x7fcd8806ef40 unknown :-1 s=CLOSED pgs=290 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.737 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 --2- 172.21.15.6:0/663043217 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fcda00fd180 0x7fcda010e610 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 >> 172.21.15.6:0/663043217 conn(0x7fcda00f2400 msgr2=0x7fcda0061320 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 shutdown_connections 2024-03-12T16:33:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.739+0000 7fcda5ef3700 1 -- 172.21.15.6:0/663043217 wait complete. 2024-03-12T16:33:49.738 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:33:49.838 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.842+0000 7f3e97f69700 1 -- 172.21.15.6:0/1095793655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fc7f0 msgr2=0x7f3e900fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.842+0000 7f3e97f69700 1 --2- 172.21.15.6:0/1095793655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fc7f0 0x7f3e900fcbd0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 rx=0x7f3e800047f0 tx=0x7f3e80009cb0).stop 2024-03-12T16:33:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.842+0000 7f3e97f69700 1 -- 172.21.15.6:0/1095793655 shutdown_connections 2024-03-12T16:33:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.842+0000 7f3e97f69700 1 --2- 172.21.15.6:0/1095793655 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e900fd150 0x7f3e900f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.842+0000 7f3e97f69700 1 --2- 172.21.15.6:0/1095793655 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fc7f0 0x7f3e900fcbd0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.842+0000 7f3e97f69700 1 -- 172.21.15.6:0/1095793655 >> 172.21.15.6:0/1095793655 conn(0x7f3e90070590 msgr2=0x7f3e900f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.842+0000 7f3e97f69700 1 -- 172.21.15.6:0/1095793655 shutdown_connections 2024-03-12T16:33:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.842+0000 7f3e97f69700 1 -- 172.21.15.6:0/1095793655 wait complete. 2024-03-12T16:33:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.842+0000 7f3e97f69700 1 Processor -- start 2024-03-12T16:33:49.839 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e97f69700 1 -- start start 2024-03-12T16:33:49.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e97f69700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e900fc7f0 0x7f3e901090d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:49.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e97f69700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fd150 0x7f3e901095c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:49.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e97f69700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e90109ab0 con 0x7f3e900fd150 2024-03-12T16:33:49.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e97f69700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3e90109bf0 con 0x7f3e900fc7f0 2024-03-12T16:33:49.841 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e95504700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fd150 0x7f3e901095c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e95504700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fd150 0x7f3e901095c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49078/0 (socket says 172.21.15.6:49078) 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e95504700 1 -- 172.21.15.6:0/358787766 learned_addr learned my addr 172.21.15.6:0/358787766 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e95d05700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e900fc7f0 0x7f3e901090d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e95504700 1 -- 172.21.15.6:0/358787766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e900fc7f0 msgr2=0x7f3e901090d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e95504700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e900fc7f0 0x7f3e901090d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e95504700 1 -- 172.21.15.6:0/358787766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3e80005040 con 0x7f3e900fd150 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e95d05700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e900fc7f0 0x7f3e901090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.843+0000 7f3e95504700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fd150 0x7f3e901095c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f3e8c002780 tx=0x7f3e8c009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.844+0000 7f3e86ffd700 1 -- 172.21.15.6:0/358787766 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8c007b40 con 0x7f3e900fd150 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.844+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3e90109ea0 con 0x7f3e900fd150 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.844+0000 7f3e86ffd700 1 -- 172.21.15.6:0/358787766 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3e8c00f040 con 0x7f3e900fd150 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.844+0000 7f3e86ffd700 1 -- 172.21.15.6:0/358787766 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3e8c014780 con 0x7f3e900fd150 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.844+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3e901124c0 con 0x7f3e900fd150 2024-03-12T16:33:49.842 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.845+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3e9005f590 con 0x7f3e900fd150 2024-03-12T16:33:49.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.845+0000 7f3e86ffd700 1 -- 172.21.15.6:0/358787766 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f3e8c007ca0 con 0x7f3e900fd150 2024-03-12T16:33:49.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.845+0000 7f3e86ffd700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3e7c06cab0 0x7f3e7c06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:49.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.846+0000 7f3e86ffd700 1 -- 172.21.15.6:0/358787766 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f3e8c08bd20 con 0x7f3e900fd150 2024-03-12T16:33:49.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.846+0000 7f3e95d05700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3e7c06cab0 0x7f3e7c06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:49.843 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.846+0000 7f3e95d05700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3e7c06cab0 0x7f3e7c06ef70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f3e80004540 tx=0x7f3e80009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:49.846 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:49.850+0000 7f3e86ffd700 1 -- 172.21.15.6:0/358787766 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3e8c055df0 con 0x7f3e900fd150 2024-03-12T16:33:49.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:49 smithi134 ceph-mon[85099]: pgmap v617: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:49.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:49 smithi134 ceph-mon[85099]: from='client.35144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:49.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:49 smithi134 ceph-mon[85099]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:49.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:49 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/947084189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:33:49.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:49 smithi006 ceph-mon[103869]: pgmap v617: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:49.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:49 smithi006 ceph-mon[103869]: from='client.35144 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:49.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:49 smithi006 ceph-mon[103869]: from='client.35148 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:49.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:49 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/947084189' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:33:50.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.065+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3e90060d50 con 0x7f3e7c06cab0 2024-03-12T16:33:50.062 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.066+0000 7f3e86ffd700 1 -- 172.21.15.6:0/358787766 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f3e90060d50 con 0x7f3e7c06cab0 2024-03-12T16:33:50.062 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:33:50.062 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:33:50.063 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:33:50.063 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:33:50.063 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:33:50.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:33:50.063 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:33:50.063 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:33:50.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:33:50.063 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:33:50.063 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:33:50.064 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:33:50.064 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:33:50.064 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:33:50.064 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:33:50.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3e7c06cab0 msgr2=0x7f3e7c06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:50.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3e7c06cab0 0x7f3e7c06ef70 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 rx=0x7f3e80004540 tx=0x7f3e80009cb0).stop 2024-03-12T16:33:50.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fd150 msgr2=0x7f3e901095c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:50.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fd150 0x7f3e901095c0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 rx=0x7f3e8c002780 tx=0x7f3e8c009ee0).stop 2024-03-12T16:33:50.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 shutdown_connections 2024-03-12T16:33:50.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3e900fc7f0 0x7f3e901090d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:50.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3e7c06cab0 0x7f3e7c06ef70 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:50.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 --2- 172.21.15.6:0/358787766 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3e900fd150 0x7f3e901095c0 unknown :-1 s=CLOSED pgs=548 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:50.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 >> 172.21.15.6:0/358787766 conn(0x7f3e90070590 msgr2=0x7f3e900fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:50.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 shutdown_connections 2024-03-12T16:33:50.066 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.068+0000 7f3e97f69700 1 -- 172.21.15.6:0/358787766 wait complete. 2024-03-12T16:33:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.169+0000 7fd22c0d4700 1 -- 172.21.15.6:0/895278964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 msgr2=0x7fd2240fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.169+0000 7fd22c0d4700 1 --2- 172.21.15.6:0/895278964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 0x7fd2240fcbd0 secure :-1 s=READY pgs=549 cs=0 l=1 rev1=1 rx=0x7fd2200047f0 tx=0x7fd220009cb0).stop 2024-03-12T16:33:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.169+0000 7fd22c0d4700 1 -- 172.21.15.6:0/895278964 shutdown_connections 2024-03-12T16:33:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.169+0000 7fd22c0d4700 1 --2- 172.21.15.6:0/895278964 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2240fd150 0x7fd2240f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.169+0000 7fd22c0d4700 1 --2- 172.21.15.6:0/895278964 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 0x7fd2240fcbd0 unknown :-1 s=CLOSED pgs=549 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.169+0000 7fd22c0d4700 1 -- 172.21.15.6:0/895278964 >> 172.21.15.6:0/895278964 conn(0x7fd224070590 msgr2=0x7fd2240f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.169+0000 7fd22c0d4700 1 -- 172.21.15.6:0/895278964 shutdown_connections 2024-03-12T16:33:50.166 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.169+0000 7fd22c0d4700 1 -- 172.21.15.6:0/895278964 wait complete. 2024-03-12T16:33:50.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd22c0d4700 1 Processor -- start 2024-03-12T16:33:50.167 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd22c0d4700 1 -- start start 2024-03-12T16:33:50.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd22c0d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 0x7fd2240f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:50.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd22c0d4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2240fd150 0x7fd2240f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:50.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd22c0d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240f8f20 con 0x7fd2240fc7f0 2024-03-12T16:33:50.168 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd22c0d4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fd2240f9060 con 0x7fd2240fd150 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd229e70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 0x7fd2240f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd229e70700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 0x7fd2240f8540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:49092/0 (socket says 172.21.15.6:49092) 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd229e70700 1 -- 172.21.15.6:0/2505910430 learned_addr learned my addr 172.21.15.6:0/2505910430 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.170+0000 7fd22966f700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2240fd150 0x7fd2240f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.171+0000 7fd229e70700 1 -- 172.21.15.6:0/2505910430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2240fd150 msgr2=0x7fd2240f8a30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.171+0000 7fd229e70700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2240fd150 0x7fd2240f8a30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.171+0000 7fd229e70700 1 -- 172.21.15.6:0/2505910430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fd220005040 con 0x7fd2240fc7f0 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.171+0000 7fd229e70700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 0x7fd2240f8540 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd22000b120 tx=0x7fd220009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.171+0000 7fd216ffd700 1 -- 172.21.15.6:0/2505910430 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd22000e030 con 0x7fd2240fc7f0 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.171+0000 7fd216ffd700 1 -- 172.21.15.6:0/2505910430 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fd220007e90 con 0x7fd2240fc7f0 2024-03-12T16:33:50.169 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.171+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fd2240f92b0 con 0x7fd2240fc7f0 2024-03-12T16:33:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.171+0000 7fd216ffd700 1 -- 172.21.15.6:0/2505910430 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fd220018070 con 0x7fd2240fc7f0 2024-03-12T16:33:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.171+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fd224114600 con 0x7fd2240fc7f0 2024-03-12T16:33:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.172+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fd22405f590 con 0x7fd2240fc7f0 2024-03-12T16:33:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.172+0000 7fd216ffd700 1 -- 172.21.15.6:0/2505910430 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fd22001d420 con 0x7fd2240fc7f0 2024-03-12T16:33:50.170 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.173+0000 7fd216ffd700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd21006caa0 0x7fd21006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:33:50.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.173+0000 7fd216ffd700 1 -- 172.21.15.6:0/2505910430 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fd22008d0b0 con 0x7fd2240fc7f0 2024-03-12T16:33:50.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.173+0000 7fd22966f700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd21006caa0 0x7fd21006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:33:50.171 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.173+0000 7fd22966f700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd21006caa0 0x7fd21006ef60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd2240f9ce0 tx=0x7fd218009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:33:50.173 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.178+0000 7fd216ffd700 1 -- 172.21.15.6:0/2505910430 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fd220057180 con 0x7fd2240fc7f0 2024-03-12T16:33:50.455 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.459+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fd224047540 con 0x7fd2240fc7f0 2024-03-12T16:33:50.456 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.460+0000 7fd216ffd700 1 -- 172.21.15.6:0/2505910430 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7fd22005a7a0 con 0x7fd2240fc7f0 2024-03-12T16:33:50.456 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:33:50.456 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:33:50.456 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:33:50.456 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:33:50.456 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd21006caa0 msgr2=0x7fd21006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd21006caa0 0x7fd21006ef60 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 rx=0x7fd2240f9ce0 tx=0x7fd218009040).stop 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 msgr2=0x7fd2240f8540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 0x7fd2240f8540 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 rx=0x7fd22000b120 tx=0x7fd220009cb0).stop 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 shutdown_connections 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fd21006caa0 0x7fd21006ef60 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fd2240fc7f0 0x7fd2240f8540 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 --2- 172.21.15.6:0/2505910430 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fd2240fd150 0x7fd2240f8a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 >> 172.21.15.6:0/2505910430 conn(0x7fd224070590 msgr2=0x7fd224060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 shutdown_connections 2024-03-12T16:33:50.458 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:33:50.462+0000 7fd22c0d4700 1 -- 172.21.15.6:0/2505910430 wait complete. 2024-03-12T16:33:50.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:50 smithi134 ceph-mon[85099]: from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:50.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:50 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/663043217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:33:50.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:50 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2505910430' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:33:50.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:50 smithi006 ceph-mon[103869]: from='client.35152 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:50.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:50 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/663043217' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:33:50.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:50 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2505910430' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:33:51.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:51 smithi134 ceph-mon[85099]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:51.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:51 smithi134 ceph-mon[85099]: pgmap v618: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:51.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:51 smithi006 ceph-mon[103869]: from='client.35164 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:33:51.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:51 smithi006 ceph-mon[103869]: pgmap v618: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:53.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:53 smithi134 ceph-mon[85099]: pgmap v619: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:53.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:53 smithi006 ceph-mon[103869]: pgmap v619: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:55.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:55 smithi134 ceph-mon[85099]: pgmap v620: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:55.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:55 smithi006 ceph-mon[103869]: pgmap v620: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:57.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:57 smithi134 ceph-mon[85099]: pgmap v621: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:57.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:57 smithi006 ceph-mon[103869]: pgmap v621: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:33:59.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:33:59 smithi006 ceph-mon[103869]: pgmap v622: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:00.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:33:59 smithi134 ceph-mon[85099]: pgmap v622: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:01.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:01 smithi006 ceph-mon[103869]: pgmap v623: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:02.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:01 smithi134 ceph-mon[85099]: pgmap v623: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:03.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:34:03.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:34:04.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:03 smithi134 ceph-mon[85099]: pgmap v624: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:04.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:03 smithi006 ceph-mon[103869]: pgmap v624: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:06.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:05 smithi134 ceph-mon[85099]: pgmap v625: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:06.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:05 smithi006 ceph-mon[103869]: pgmap v625: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:08.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:07 smithi134 ceph-mon[85099]: pgmap v626: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:08.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:07 smithi006 ceph-mon[103869]: pgmap v626: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:10.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:09 smithi134 ceph-mon[85099]: pgmap v627: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:10.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:09 smithi006 ceph-mon[103869]: pgmap v627: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:12.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:11 smithi134 ceph-mon[85099]: pgmap v628: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:12.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:11 smithi006 ceph-mon[103869]: pgmap v628: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:14.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:13 smithi134 ceph-mon[85099]: pgmap v629: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:14.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:13 smithi006 ceph-mon[103869]: pgmap v629: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:16.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:15 smithi134 ceph-mon[85099]: pgmap v630: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:16.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:15 smithi006 ceph-mon[103869]: pgmap v630: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:18.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:17 smithi134 ceph-mon[85099]: pgmap v631: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:18.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:34:18.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:17 smithi006 ceph-mon[103869]: pgmap v631: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:18.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:34:20.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:19 smithi134 ceph-mon[85099]: pgmap v632: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:20.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:19 smithi006 ceph-mon[103869]: pgmap v632: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.578+0000 7faae0f23700 1 -- 172.21.15.6:0/304970010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fc7f0 msgr2=0x7faadc0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.578+0000 7faae0f23700 1 --2- 172.21.15.6:0/304970010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fc7f0 0x7faadc0fcbd0 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 rx=0x7faac40047f0 tx=0x7faac4009cb0).stop 2024-03-12T16:34:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.578+0000 7faae0f23700 1 -- 172.21.15.6:0/304970010 shutdown_connections 2024-03-12T16:34:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.578+0000 7faae0f23700 1 --2- 172.21.15.6:0/304970010 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faadc0fd150 0x7faadc0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.578+0000 7faae0f23700 1 --2- 172.21.15.6:0/304970010 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fc7f0 0x7faadc0fcbd0 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.578+0000 7faae0f23700 1 -- 172.21.15.6:0/304970010 >> 172.21.15.6:0/304970010 conn(0x7faadc070590 msgr2=0x7faadc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.578+0000 7faae0f23700 1 -- 172.21.15.6:0/304970010 shutdown_connections 2024-03-12T16:34:20.574 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.578+0000 7faae0f23700 1 -- 172.21.15.6:0/304970010 wait complete. 2024-03-12T16:34:20.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.579+0000 7faae0f23700 1 Processor -- start 2024-03-12T16:34:20.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.579+0000 7faae0f23700 1 -- start start 2024-03-12T16:34:20.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faae0f23700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faadc0fc7f0 0x7faadc1101e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faae0f23700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fd150 0x7faadc1106d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faae0f23700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc110cd0 con 0x7faadc0fd150 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faae0f23700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faadc110e10 con 0x7faadc0fc7f0 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fd150 0x7faadc1106d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fd150 0x7faadc1106d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43344/0 (socket says 172.21.15.6:43344) 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad9d9b700 1 -- 172.21.15.6:0/2992710130 learned_addr learned my addr 172.21.15.6:0/2992710130 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faada59c700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faadc0fc7f0 0x7faadc1101e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad9d9b700 1 -- 172.21.15.6:0/2992710130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faadc0fc7f0 msgr2=0x7faadc1101e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad9d9b700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faadc0fc7f0 0x7faadc1101e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad9d9b700 1 -- 172.21.15.6:0/2992710130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faac4005040 con 0x7faadc0fd150 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faada59c700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faadc0fc7f0 0x7faadc1101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad9d9b700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fd150 0x7faadc1106d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7faacc00c710 tx=0x7faacc007ec0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad37fe700 1 -- 172.21.15.6:0/2992710130 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faacc00e680 con 0x7faadc0fd150 2024-03-12T16:34:20.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad37fe700 1 -- 172.21.15.6:0/2992710130 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faacc00ec90 con 0x7faadc0fd150 2024-03-12T16:34:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faadc10a4a0 con 0x7faadc0fd150 2024-03-12T16:34:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faad37fe700 1 -- 172.21.15.6:0/2992710130 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faacc013cd0 con 0x7faadc0fd150 2024-03-12T16:34:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.580+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faadc10aa60 con 0x7faadc0fd150 2024-03-12T16:34:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.581+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faadc05f590 con 0x7faadc0fd150 2024-03-12T16:34:20.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.582+0000 7faad37fe700 1 -- 172.21.15.6:0/2992710130 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7faacc013410 con 0x7faadc0fd150 2024-03-12T16:34:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.582+0000 7faad37fe700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faac806caa0 0x7faac806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.583+0000 7faad37fe700 1 -- 172.21.15.6:0/2992710130 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7faacc08c010 con 0x7faadc0fd150 2024-03-12T16:34:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.583+0000 7faada59c700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faac806caa0 0x7faac806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:20.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.583+0000 7faada59c700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faac806caa0 0x7faac806ef60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7faac40043d0 tx=0x7faac400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:20.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.587+0000 7faad37fe700 1 -- 172.21.15.6:0/2992710130 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7faacc059b70 con 0x7faadc0fd150 2024-03-12T16:34:20.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.805+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7faadc10b150 con 0x7faac806caa0 2024-03-12T16:34:20.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.806+0000 7faad37fe700 1 -- 172.21.15.6:0/2992710130 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7faadc10b150 con 0x7faac806caa0 2024-03-12T16:34:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faac806caa0 msgr2=0x7faac806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faac806caa0 0x7faac806ef60 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 rx=0x7faac40043d0 tx=0x7faac400b040).stop 2024-03-12T16:34:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fd150 msgr2=0x7faadc1106d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fd150 0x7faadc1106d0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 rx=0x7faacc00c710 tx=0x7faacc007ec0).stop 2024-03-12T16:34:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 shutdown_connections 2024-03-12T16:34:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faadc0fc7f0 0x7faadc1101e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faac806caa0 0x7faac806ef60 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 --2- 172.21.15.6:0/2992710130 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faadc0fd150 0x7faadc1106d0 unknown :-1 s=CLOSED pgs=552 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:20.803 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 >> 172.21.15.6:0/2992710130 conn(0x7faadc070590 msgr2=0x7faadc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 shutdown_connections 2024-03-12T16:34:20.804 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.808+0000 7faae0f23700 1 -- 172.21.15.6:0/2992710130 wait complete. 2024-03-12T16:34:20.813 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:34:20.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.911+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1027463102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fc7f0 msgr2=0x7f9ebc0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:20.906 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.911+0000 7f9ec0da8700 1 --2- 172.21.15.6:0/1027463102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fc7f0 0x7f9ebc0fcbd0 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 rx=0x7f9eac0047f0 tx=0x7f9eac009cb0).stop 2024-03-12T16:34:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.911+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1027463102 shutdown_connections 2024-03-12T16:34:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.911+0000 7f9ec0da8700 1 --2- 172.21.15.6:0/1027463102 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ebc0fd150 0x7f9ebc0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:34:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.911+0000 7f9ec0da8700 1 --2- 172.21.15.6:0/1027463102 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fc7f0 0x7f9ebc0fcbd0 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.911+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1027463102 >> 172.21.15.6:0/1027463102 conn(0x7f9ebc070590 msgr2=0x7f9ebc0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.911+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1027463102 shutdown_connections 2024-03-12T16:34:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.911+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1027463102 wait complete. 2024-03-12T16:34:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9ec0da8700 1 Processor -- start 2024-03-12T16:34:20.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9ec0da8700 1 -- start start 2024-03-12T16:34:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9ec0da8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ebc0fc7f0 0x7f9ebc0f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9ec0da8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fd150 0x7f9ebc0f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9ec0da8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0f8f20 con 0x7f9ebc0fd150 2024-03-12T16:34:20.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9ec0da8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9ebc0f9060 con 0x7f9ebc0fc7f0 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9eb9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fd150 0x7f9ebc0f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9eb9d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fd150 0x7f9ebc0f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43368/0 (socket says 172.21.15.6:43368) 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9eb9d9b700 1 -- 172.21.15.6:0/1399609107 learned_addr learned my addr 172.21.15.6:0/1399609107 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9eba59c700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ebc0fc7f0 0x7f9ebc0f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9eb9d9b700 1 -- 172.21.15.6:0/1399609107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ebc0fc7f0 msgr2=0x7f9ebc0f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9eb9d9b700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ebc0fc7f0 0x7f9ebc0f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9eb9d9b700 1 -- 172.21.15.6:0/1399609107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9eac005040 con 0x7f9ebc0fd150 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9eba59c700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ebc0fc7f0 0x7f9ebc0f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.912+0000 7f9eb9d9b700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fd150 0x7f9ebc0f8a30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9eb000b480 tx=0x7f9eb00090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.913+0000 7f9eab7fe700 1 -- 172.21.15.6:0/1399609107 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb0002500 con 0x7f9ebc0fd150 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.913+0000 7f9eab7fe700 1 -- 172.21.15.6:0/1399609107 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9eb0002b10 con 0x7f9ebc0fd150 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.913+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9ebc0f9310 con 0x7f9ebc0fd150 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.913+0000 7f9eab7fe700 1 -- 172.21.15.6:0/1399609107 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9eb0012c90 con 0x7f9ebc0fd150 2024-03-12T16:34:20.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.913+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9ebc114720 con 0x7f9ebc0fd150 2024-03-12T16:34:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.914+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9ebc05f590 con 0x7f9ebc0fd150 2024-03-12T16:34:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.914+0000 7f9eab7fe700 1 -- 172.21.15.6:0/1399609107 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9eb0002660 con 0x7f9ebc0fd150 2024-03-12T16:34:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.915+0000 7f9eab7fe700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9ea406caa0 0x7f9ea406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.915+0000 7f9eab7fe700 1 -- 172.21.15.6:0/1399609107 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9eb008be60 con 0x7f9ebc0fd150 2024-03-12T16:34:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.915+0000 7f9eba59c700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9ea406caa0 0x7f9ea406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:20.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.915+0000 7f9eba59c700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9ea406caa0 0x7f9ea406ef60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f9eac0043d0 tx=0x7f9eac00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:20.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:20.919+0000 7f9eab7fe700 1 -- 172.21.15.6:0/1399609107 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9eb0055f30 con 0x7f9ebc0fd150 2024-03-12T16:34:21.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.135+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f9ebc0f9b30 con 0x7f9ea406caa0 2024-03-12T16:34:21.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.137+0000 7f9eab7fe700 1 -- 172.21.15.6:0/1399609107 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f9ebc0f9b30 con 0x7f9ea406caa0 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.138+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9ea406caa0 msgr2=0x7f9ea406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.138+0000 7f9ec0da8700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9ea406caa0 0x7f9ea406ef60 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 rx=0x7f9eac0043d0 tx=0x7f9eac00b040).stop 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.139+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fd150 msgr2=0x7f9ebc0f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.139+0000 7f9ec0da8700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fd150 0x7f9ebc0f8a30 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 rx=0x7f9eb000b480 tx=0x7f9eb00090f0).stop 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.139+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 shutdown_connections 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.139+0000 7f9ec0da8700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9ebc0fc7f0 0x7f9ebc0f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.139+0000 7f9ec0da8700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9ea406caa0 0x7f9ea406ef60 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.139+0000 7f9ec0da8700 1 --2- 172.21.15.6:0/1399609107 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9ebc0fd150 0x7f9ebc0f8a30 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.139+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 >> 172.21.15.6:0/1399609107 conn(0x7f9ebc070590 msgr2=0x7f9ebc060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.139+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 shutdown_connections 2024-03-12T16:34:21.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.139+0000 7f9ec0da8700 1 -- 172.21.15.6:0/1399609107 wait complete. 2024-03-12T16:34:21.235 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.240+0000 7f7f56218700 1 -- 172.21.15.6:0/1566154971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 msgr2=0x7f7f500fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.240+0000 7f7f56218700 1 --2- 172.21.15.6:0/1566154971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 0x7f7f500fcbd0 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 rx=0x7f7f400047f0 tx=0x7f7f40009cb0).stop 2024-03-12T16:34:21.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.240+0000 7f7f56218700 1 -- 172.21.15.6:0/1566154971 shutdown_connections 2024-03-12T16:34:21.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.240+0000 7f7f56218700 1 --2- 172.21.15.6:0/1566154971 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f500fd150 0x7f7f500f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.240+0000 7f7f56218700 1 --2- 172.21.15.6:0/1566154971 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 0x7f7f500fcbd0 unknown :-1 s=CLOSED pgs=555 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.240+0000 7f7f56218700 1 -- 172.21.15.6:0/1566154971 >> 172.21.15.6:0/1566154971 conn(0x7f7f50070590 msgr2=0x7f7f500f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:21.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.240+0000 7f7f56218700 1 -- 172.21.15.6:0/1566154971 shutdown_connections 2024-03-12T16:34:21.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.240+0000 7f7f56218700 1 -- 172.21.15.6:0/1566154971 wait complete. 2024-03-12T16:34:21.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f56218700 1 Processor -- start 2024-03-12T16:34:21.236 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f56218700 1 -- start start 2024-03-12T16:34:21.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f56218700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 0x7f7f5010dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:21.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f56218700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f500fd150 0x7f7f5010e4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:21.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f56218700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5010eae0 con 0x7f7f500fc7f0 2024-03-12T16:34:21.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f56218700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7f5010ec20 con 0x7f7f500fd150 2024-03-12T16:34:21.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f4f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 0x7f7f5010dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:21.238 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f4f7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 0x7f7f5010dff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43396/0 (socket says 172.21.15.6:43396) 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/2058571984 learned_addr learned my addr 172.21.15.6:0/2058571984 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f4effd700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f500fd150 0x7f7f5010e4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/2058571984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f500fd150 msgr2=0x7f7f5010e4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f4f7fe700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f500fd150 0x7f7f5010e4e0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.241+0000 7f7f4f7fe700 1 -- 172.21.15.6:0/2058571984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7f40005040 con 0x7f7f500fc7f0 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.242+0000 7f7f4f7fe700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 0x7f7f5010dff0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f7f40005010 tx=0x7f7f40009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.242+0000 7f7f4cff9700 1 -- 172.21.15.6:0/2058571984 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f4000e030 con 0x7f7f500fc7f0 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.242+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7f50108250 con 0x7f7f500fc7f0 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.242+0000 7f7f4cff9700 1 -- 172.21.15.6:0/2058571984 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7f40007e90 con 0x7f7f500fc7f0 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.242+0000 7f7f4cff9700 1 -- 172.21.15.6:0/2058571984 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7f40018070 con 0x7f7f500fc7f0 2024-03-12T16:34:21.239 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.242+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7f50108730 con 0x7f7f500fc7f0 2024-03-12T16:34:21.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.243+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7f5005f590 con 0x7f7f500fc7f0 2024-03-12T16:34:21.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.243+0000 7f7f4cff9700 1 -- 172.21.15.6:0/2058571984 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7f4001d6e0 con 0x7f7f500fc7f0 2024-03-12T16:34:21.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.244+0000 7f7f4cff9700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f3806ca30 0x7f7f3806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:21.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.244+0000 7f7f4cff9700 1 -- 172.21.15.6:0/2058571984 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f7f4008d040 con 0x7f7f500fc7f0 2024-03-12T16:34:21.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.244+0000 7f7f4effd700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f3806ca30 0x7f7f3806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:21.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.244+0000 7f7f4effd700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f3806ca30 0x7f7f3806eef0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f7f50109930 tx=0x7f7f44009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:21.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.248+0000 7f7f4cff9700 1 -- 172.21.15.6:0/2058571984 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7f4005a910 con 0x7f7f500fc7f0 2024-03-12T16:34:21.450 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.455+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f7f50108dc0 con 0x7f7f3806ca30 2024-03-12T16:34:21.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.465+0000 7f7f4cff9700 1 -- 172.21.15.6:0/2058571984 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f7f50108dc0 con 0x7f7f3806ca30 2024-03-12T16:34:21.460 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:34:21.460 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (21m) 14m ago 32m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:34:21.460 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (18m) 14m ago 32m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (18m) 14m ago 31m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (20m) 14m ago 31m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (15m) 14m ago 26m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (15m) 14m ago 26m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (14m) 14m ago 26m 12.2M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (14m) 14m ago 26m 10.9M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (22m) 14m ago 33m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (22m) 14m ago 31m 449M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (19m) 14m ago 33m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (19m) 14m ago 31m 40.6M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (21m) 14m ago 31m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (21m) 14m ago 31m 18.5M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (18m) 14m ago 30m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:34:21.461 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (17m) 14m ago 30m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:34:21.462 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (17m) 14m ago 29m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:34:21.462 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (16m) 14m ago 29m 103M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:34:21.462 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (16m) 14m ago 28m 94.4M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:34:21.462 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (15m) 14m ago 28m 87.7M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:34:21.462 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (21m) 14m ago 30m 60.1M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:34:21.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f3806ca30 msgr2=0x7f7f3806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f3806ca30 0x7f7f3806eef0 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 rx=0x7f7f50109930 tx=0x7f7f44009de0).stop 2024-03-12T16:34:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 msgr2=0x7f7f5010dff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 0x7f7f5010dff0 secure :-1 s=READY pgs=556 cs=0 l=1 rev1=1 rx=0x7f7f40005010 tx=0x7f7f40009cb0).stop 2024-03-12T16:34:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 shutdown_connections 2024-03-12T16:34:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7f3806ca30 0x7f7f3806eef0 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7f500fc7f0 0x7f7f5010dff0 unknown :-1 s=CLOSED pgs=556 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 --2- 172.21.15.6:0/2058571984 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7f500fd150 0x7f7f5010e4e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 >> 172.21.15.6:0/2058571984 conn(0x7f7f50070590 msgr2=0x7f7f50060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 shutdown_connections 2024-03-12T16:34:21.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.467+0000 7f7f56218700 1 -- 172.21.15.6:0/2058571984 wait complete. 2024-03-12T16:34:21.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.567+0000 7f821663c700 1 -- 172.21.15.6:0/2037102563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fe250 msgr2=0x7f82100f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.567+0000 7f821663c700 1 --2- 172.21.15.6:0/2037102563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fe250 0x7f82100f7a30 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 rx=0x7f82000047f0 tx=0x7f8200009cb0).stop 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.567+0000 7f821663c700 1 -- 172.21.15.6:0/2037102563 shutdown_connections 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.567+0000 7f821663c700 1 --2- 172.21.15.6:0/2037102563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fe250 0x7f82100f7a30 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.567+0000 7f821663c700 1 --2- 172.21.15.6:0/2037102563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82100fd8f0 0x7f82100fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.567+0000 7f821663c700 1 -- 172.21.15.6:0/2037102563 >> 172.21.15.6:0/2037102563 conn(0x7f82100f34b0 msgr2=0x7f82100f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.568+0000 7f821663c700 1 -- 172.21.15.6:0/2037102563 shutdown_connections 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.568+0000 7f821663c700 1 -- 172.21.15.6:0/2037102563 wait complete. 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.568+0000 7f821663c700 1 Processor -- start 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.568+0000 7f821663c700 1 -- start start 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f821663c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fd8f0 0x7f821010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f821663c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82100fe250 0x7f821010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f821663c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821010eb70 con 0x7f82100fd8f0 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f821663c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f821010ecb0 con 0x7f82100fe250 2024-03-12T16:34:21.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fd8f0 0x7f821010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fd8f0 0x7f821010e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43414/0 (socket says 172.21.15.6:43414) 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820ffff700 1 -- 172.21.15.6:0/2465922039 learned_addr learned my addr 172.21.15.6:0/2465922039 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820f7fe700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82100fe250 0x7f821010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820ffff700 1 -- 172.21.15.6:0/2465922039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82100fe250 msgr2=0x7f821010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820ffff700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82100fe250 0x7f821010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820ffff700 1 -- 172.21.15.6:0/2465922039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8200005040 con 0x7f82100fd8f0 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820ffff700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fd8f0 0x7f821010e080 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f81f8002770 tx=0x7f81f8002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820d7fa700 1 -- 172.21.15.6:0/2465922039 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81f8007b40 con 0x7f82100fd8f0 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820d7fa700 1 -- 172.21.15.6:0/2465922039 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f81f800f040 con 0x7f82100fd8f0 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8210108340 con 0x7f82100fd8f0 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f820d7fa700 1 -- 172.21.15.6:0/2465922039 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f81f8014820 con 0x7f82100fd8f0 2024-03-12T16:34:21.566 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.569+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8210108880 con 0x7f82100fd8f0 2024-03-12T16:34:21.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.570+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f821005f590 con 0x7f82100fd8f0 2024-03-12T16:34:21.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.571+0000 7f820d7fa700 1 -- 172.21.15.6:0/2465922039 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f81f8007ca0 con 0x7f82100fd8f0 2024-03-12T16:34:21.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.571+0000 7f820d7fa700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f81fc06caf0 0x7f81fc06efb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:21.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.571+0000 7f820d7fa700 1 -- 172.21.15.6:0/2465922039 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f81f808ba10 con 0x7f82100fd8f0 2024-03-12T16:34:21.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.571+0000 7f820f7fe700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f81fc06caf0 0x7f81fc06efb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:21.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.572+0000 7f820f7fe700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f81fc06caf0 0x7f81fc06efb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f82101099c0 tx=0x7f820000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:21.570 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.576+0000 7f820d7fa700 1 -- 172.21.15.6:0/2465922039 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f81f80594b0 con 0x7f82100fd8f0 2024-03-12T16:34:21.849 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.854+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f8210109800 con 0x7f82100fd8f0 2024-03-12T16:34:21.850 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.855+0000 7f820d7fa700 1 -- 172.21.15.6:0/2465922039 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f81f8059040 con 0x7f82100fd8f0 2024-03-12T16:34:21.850 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:34:21.850 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:34:21.850 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:34:21.850 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:34:21.850 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:34:21.850 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:34:21.851 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:34:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f81fc06caf0 msgr2=0x7f81fc06efb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f81fc06caf0 0x7f81fc06efb0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 rx=0x7f82101099c0 tx=0x7f820000b040).stop 2024-03-12T16:34:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fd8f0 msgr2=0x7f821010e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fd8f0 0x7f821010e080 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 rx=0x7f81f8002770 tx=0x7f81f8002a80).stop 2024-03-12T16:34:21.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 shutdown_connections 2024-03-12T16:34:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f81fc06caf0 0x7f81fc06efb0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f82100fd8f0 0x7f821010e080 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 --2- 172.21.15.6:0/2465922039 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f82100fe250 0x7f821010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 >> 172.21.15.6:0/2465922039 conn(0x7f82100f34b0 msgr2=0x7f82100fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 shutdown_connections 2024-03-12T16:34:21.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.857+0000 7f821663c700 1 -- 172.21.15.6:0/2465922039 wait complete. 2024-03-12T16:34:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.959+0000 7faa34930700 1 -- 172.21.15.6:0/1151158575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 msgr2=0x7faa300f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.959+0000 7faa34930700 1 --2- 172.21.15.6:0/1151158575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 0x7faa300f6930 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 rx=0x7faa180047f0 tx=0x7faa18009cb0).stop 2024-03-12T16:34:21.954 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.959+0000 7faa34930700 1 -- 172.21.15.6:0/1151158575 shutdown_connections 2024-03-12T16:34:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.959+0000 7faa34930700 1 --2- 172.21.15.6:0/1151158575 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 0x7faa300f6930 unknown :-1 s=CLOSED pgs=559 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.959+0000 7faa34930700 1 --2- 172.21.15.6:0/1151158575 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa300fc7f0 0x7faa300fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:34:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.959+0000 7faa34930700 1 -- 172.21.15.6:0/1151158575 >> 172.21.15.6:0/1151158575 conn(0x7faa30070590 msgr2=0x7faa300f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.959+0000 7faa34930700 1 -- 172.21.15.6:0/1151158575 shutdown_connections 2024-03-12T16:34:21.955 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.959+0000 7faa34930700 1 -- 172.21.15.6:0/1151158575 wait complete. 2024-03-12T16:34:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa34930700 1 Processor -- start 2024-03-12T16:34:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa34930700 1 -- start start 2024-03-12T16:34:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa34930700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa300fc7f0 0x7faa30109170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa34930700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 0x7faa30109660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:21.957 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa34930700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30109be0 con 0x7faa300fd150 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa34930700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7faa30109d20 con 0x7faa300fc7f0 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa2dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 0x7faa30109660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa2dd9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 0x7faa30109660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43436/0 (socket says 172.21.15.6:43436) 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa2dd9b700 1 -- 172.21.15.6:0/1633257813 learned_addr learned my addr 172.21.15.6:0/1633257813 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.960+0000 7faa2e59c700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa300fc7f0 0x7faa30109170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.961+0000 7faa2dd9b700 1 -- 172.21.15.6:0/1633257813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa300fc7f0 msgr2=0x7faa30109170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.961+0000 7faa2dd9b700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa300fc7f0 0x7faa30109170 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.961+0000 7faa2dd9b700 1 -- 172.21.15.6:0/1633257813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7faa18005040 con 0x7faa300fd150 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.961+0000 7faa2dd9b700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 0x7faa30109660 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7faa180099f0 tx=0x7faa18009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.961+0000 7faa277fe700 1 -- 172.21.15.6:0/1633257813 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa1800e030 con 0x7faa300fd150 2024-03-12T16:34:21.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.961+0000 7faa277fe700 1 -- 172.21.15.6:0/1633257813 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7faa18007e90 con 0x7faa300fd150 2024-03-12T16:34:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.961+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7faa30109f70 con 0x7faa300fd150 2024-03-12T16:34:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.961+0000 7faa277fe700 1 -- 172.21.15.6:0/1633257813 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7faa18018070 con 0x7faa300fd150 2024-03-12T16:34:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.961+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7faa301124b0 con 0x7faa300fd150 2024-03-12T16:34:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.962+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7faa3005f590 con 0x7faa300fd150 2024-03-12T16:34:21.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.963+0000 7faa277fe700 1 -- 172.21.15.6:0/1633257813 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7faa1801d420 con 0x7faa300fd150 2024-03-12T16:34:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.963+0000 7faa277fe700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa1c06caa0 0x7faa1c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.963+0000 7faa277fe700 1 -- 172.21.15.6:0/1633257813 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7faa1808d220 con 0x7faa300fd150 2024-03-12T16:34:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.963+0000 7faa2e59c700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa1c06caa0 0x7faa1c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:21.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.964+0000 7faa2e59c700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa1c06caa0 0x7faa1c06ef60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7faa2000b910 tx=0x7faa20008040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:21.962 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:21.968+0000 7faa277fe700 1 -- 172.21.15.6:0/1633257813 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7faa18057230 con 0x7faa300fd150 2024-03-12T16:34:22.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:21 smithi134 ceph-mon[85099]: pgmap v633: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:22.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:21 smithi134 ceph-mon[85099]: from='client.35172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:22.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:21 smithi006 ceph-mon[103869]: pgmap v633: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:22.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:21 smithi006 ceph-mon[103869]: from='client.35172 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:22.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.210+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7faa30047540 con 0x7faa300fd150 2024-03-12T16:34:22.205 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.210+0000 7faa277fe700 1 -- 172.21.15.6:0/1633257813 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 26 v26) v1 ==== 76+0+1833 (secure 0 0 0) 0x7faa1805a850 con 0x7faa300fd150 2024-03-12T16:34:22.205 INFO:teuthology.orchestra.run.smithi006.stdout:e26 2024-03-12T16:34:22.205 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 17 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:flags 13 allow_snaps allow_multimds_snaps 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:18:54.112159+0000 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:34:22.206 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:up {} 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:failed 0,1 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:34:22.207 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{-1:34378} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{-1:34410} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:34:22.208 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:34:22.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.212+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa1c06caa0 msgr2=0x7faa1c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.212+0000 7faa34930700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa1c06caa0 0x7faa1c06ef60 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 rx=0x7faa2000b910 tx=0x7faa20008040).stop 2024-03-12T16:34:22.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.212+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 msgr2=0x7faa30109660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.212+0000 7faa34930700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 0x7faa30109660 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 rx=0x7faa180099f0 tx=0x7faa18009cb0).stop 2024-03-12T16:34:22.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.212+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 shutdown_connections 2024-03-12T16:34:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.212+0000 7faa34930700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7faa300fc7f0 0x7faa30109170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.212+0000 7faa34930700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7faa1c06caa0 0x7faa1c06ef60 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.213+0000 7faa34930700 1 --2- 172.21.15.6:0/1633257813 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7faa300fd150 0x7faa30109660 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.213+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 >> 172.21.15.6:0/1633257813 conn(0x7faa30070590 msgr2=0x7faa300fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.213+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 shutdown_connections 2024-03-12T16:34:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.213+0000 7faa34930700 1 -- 172.21.15.6:0/1633257813 wait complete. 2024-03-12T16:34:22.210 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:34:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.315+0000 7f4e82770700 1 -- 172.21.15.6:0/3638646758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fc7f0 msgr2=0x7f4e7c0fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.315+0000 7f4e82770700 1 --2- 172.21.15.6:0/3638646758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fc7f0 0x7f4e7c0fcbd0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 rx=0x7f4e6c0047f0 tx=0x7f4e6c009cb0).stop 2024-03-12T16:34:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.315+0000 7f4e82770700 1 -- 172.21.15.6:0/3638646758 shutdown_connections 2024-03-12T16:34:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.315+0000 7f4e82770700 1 --2- 172.21.15.6:0/3638646758 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c0fd150 0x7f4e7c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.315+0000 7f4e82770700 1 --2- 172.21.15.6:0/3638646758 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fc7f0 0x7f4e7c0fcbd0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.315+0000 7f4e82770700 1 -- 172.21.15.6:0/3638646758 >> 172.21.15.6:0/3638646758 conn(0x7f4e7c070590 msgr2=0x7f4e7c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.315+0000 7f4e82770700 1 -- 172.21.15.6:0/3638646758 shutdown_connections 2024-03-12T16:34:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.315+0000 7f4e82770700 1 -- 172.21.15.6:0/3638646758 wait complete. 2024-03-12T16:34:22.311 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.316+0000 7f4e82770700 1 Processor -- start 2024-03-12T16:34:22.312 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.316+0000 7f4e82770700 1 -- start start 2024-03-12T16:34:22.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.316+0000 7f4e82770700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c0fc7f0 0x7f4e7c10dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:22.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.316+0000 7f4e82770700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fd150 0x7f4e7c10e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:22.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.316+0000 7f4e82770700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c10eab0 con 0x7f4e7c0fd150 2024-03-12T16:34:22.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.316+0000 7f4e82770700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4e7c10ebf0 con 0x7f4e7c0fc7f0 2024-03-12T16:34:22.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.316+0000 7f4e7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fd150 0x7f4e7c10e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:22.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.316+0000 7f4e7b7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fd150 0x7f4e7c10e4b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:43458/0 (socket says 172.21.15.6:43458) 2024-03-12T16:34:22.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.316+0000 7f4e7b7fe700 1 -- 172.21.15.6:0/1333253531 learned_addr learned my addr 172.21.15.6:0/1333253531 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:34:22.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e7bfff700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c0fc7f0 0x7f4e7c10dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:22.313 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e7b7fe700 1 -- 172.21.15.6:0/1333253531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c0fc7f0 msgr2=0x7f4e7c10dfc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e7b7fe700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c0fc7f0 0x7f4e7c10dfc0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e7b7fe700 1 -- 172.21.15.6:0/1333253531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4e6c005040 con 0x7f4e7c0fd150 2024-03-12T16:34:22.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e7b7fe700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fd150 0x7f4e7c10e4b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f4e64002780 tx=0x7f4e64009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:22.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e797fa700 1 -- 172.21.15.6:0/1333253531 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e64007b40 con 0x7f4e7c0fd150 2024-03-12T16:34:22.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e797fa700 1 -- 172.21.15.6:0/1333253531 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4e6400f040 con 0x7f4e7c0fd150 2024-03-12T16:34:22.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4e7c108280 con 0x7f4e7c0fd150 2024-03-12T16:34:22.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e797fa700 1 -- 172.21.15.6:0/1333253531 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4e64014780 con 0x7f4e7c0fd150 2024-03-12T16:34:22.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.317+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4e7c108840 con 0x7f4e7c0fd150 2024-03-12T16:34:22.314 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.318+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4e7c05f590 con 0x7f4e7c0fd150 2024-03-12T16:34:22.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.319+0000 7f4e797fa700 1 -- 172.21.15.6:0/1333253531 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f4e64007ca0 con 0x7f4e7c0fd150 2024-03-12T16:34:22.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.319+0000 7f4e797fa700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4e6806caa0 0x7f4e6806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:22.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.319+0000 7f4e797fa700 1 -- 172.21.15.6:0/1333253531 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4e6408bbb0 con 0x7f4e7c0fd150 2024-03-12T16:34:22.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.319+0000 7f4e7bfff700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4e6806caa0 0x7f4e6806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:22.315 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.319+0000 7f4e7bfff700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4e6806caa0 0x7f4e6806ef60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f4e6c004f10 tx=0x7f4e6c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:22.318 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.324+0000 7f4e797fa700 1 -- 172.21.15.6:0/1333253531 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4e64092080 con 0x7f4e7c0fd150 2024-03-12T16:34:22.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.543+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f4e7c108f30 con 0x7f4e6806caa0 2024-03-12T16:34:22.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.544+0000 7f4e797fa700 1 -- 172.21.15.6:0/1333253531 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+431 (secure 0 0 0) 0x7f4e7c108f30 con 0x7f4e6806caa0 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846", 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": true, 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "Upgrading all daemon types on all hosts", 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [ 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr", 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "crash", 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "osd", 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "mon", 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "mds" 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: ], 2024-03-12T16:34:22.539 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": "16/21 daemons upgraded", 2024-03-12T16:34:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "Currently upgrading mds daemons", 2024-03-12T16:34:22.540 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:34:22.540 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4e6806caa0 msgr2=0x7f4e6806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4e6806caa0 0x7f4e6806ef60 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 rx=0x7f4e6c004f10 tx=0x7f4e6c00b040).stop 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fd150 msgr2=0x7f4e7c10e4b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fd150 0x7f4e7c10e4b0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 rx=0x7f4e64002780 tx=0x7f4e64009ee0).stop 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 shutdown_connections 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4e7c0fc7f0 0x7f4e7c10dfc0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4e6806caa0 0x7f4e6806ef60 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 --2- 172.21.15.6:0/1333253531 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4e7c0fd150 0x7f4e7c10e4b0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 >> 172.21.15.6:0/1333253531 conn(0x7f4e7c070590 msgr2=0x7f4e7c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 shutdown_connections 2024-03-12T16:34:22.542 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.547+0000 7f4e82770700 1 -- 172.21.15.6:0/1333253531 wait complete. 2024-03-12T16:34:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.649+0000 7f34f1a11700 1 -- 172.21.15.6:0/57474787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 msgr2=0x7f34ec0f7a50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.649+0000 7f34f1a11700 1 --2- 172.21.15.6:0/57474787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 0x7f34ec0f7a50 secure :-1 s=READY pgs=563 cs=0 l=1 rev1=1 rx=0x7f34e00047f0 tx=0x7f34e0009cb0).stop 2024-03-12T16:34:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.649+0000 7f34f1a11700 1 -- 172.21.15.6:0/57474787 shutdown_connections 2024-03-12T16:34:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.649+0000 7f34f1a11700 1 --2- 172.21.15.6:0/57474787 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 0x7f34ec0f7a50 unknown :-1 s=CLOSED pgs=563 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.649+0000 7f34f1a11700 1 --2- 172.21.15.6:0/57474787 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34ec0fd910 0x7f34ec0fdcf0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.649+0000 7f34f1a11700 1 -- 172.21.15.6:0/57474787 >> 172.21.15.6:0/57474787 conn(0x7f34ec0f3530 msgr2=0x7f34ec0f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:22.644 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.649+0000 7f34f1a11700 1 -- 172.21.15.6:0/57474787 shutdown_connections 2024-03-12T16:34:22.645 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.649+0000 7f34f1a11700 1 -- 172.21.15.6:0/57474787 wait complete. 2024-03-12T16:34:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34f1a11700 1 Processor -- start 2024-03-12T16:34:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34f1a11700 1 -- start start 2024-03-12T16:34:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34f1a11700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34ec0fd910 0x7f34ec06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34f1a11700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 0x7f34ec06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34f1a11700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec06bab0 con 0x7f34ec0fe270 2024-03-12T16:34:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34f1a11700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f34ec06bbf0 con 0x7f34ec0fd910 2024-03-12T16:34:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 0x7f34ec06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34ea7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 0x7f34ec06b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:45942/0 (socket says 172.21.15.6:45942) 2024-03-12T16:34:22.646 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34ea7fc700 1 -- 172.21.15.6:0/2216421180 learned_addr learned my addr 172.21.15.6:0/2216421180 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:34:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.650+0000 7f34eaffd700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34ec0fd910 0x7f34ec06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.651+0000 7f34ea7fc700 1 -- 172.21.15.6:0/2216421180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34ec0fd910 msgr2=0x7f34ec06b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.651+0000 7f34ea7fc700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34ec0fd910 0x7f34ec06b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.651+0000 7f34ea7fc700 1 -- 172.21.15.6:0/2216421180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f34e0005040 con 0x7f34ec0fe270 2024-03-12T16:34:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.651+0000 7f34ea7fc700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 0x7f34ec06b5c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f34e00099f0 tx=0x7f34e0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.651+0000 7f34d3fff700 1 -- 172.21.15.6:0/2216421180 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e000e030 con 0x7f34ec0fe270 2024-03-12T16:34:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.651+0000 7f34d3fff700 1 -- 172.21.15.6:0/2216421180 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f34e0007e90 con 0x7f34ec0fe270 2024-03-12T16:34:22.647 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.651+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f34ec06be40 con 0x7f34ec0fe270 2024-03-12T16:34:22.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.651+0000 7f34d3fff700 1 -- 172.21.15.6:0/2216421180 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f34e0018070 con 0x7f34ec0fe270 2024-03-12T16:34:22.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.651+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f34ec114600 con 0x7f34ec0fe270 2024-03-12T16:34:22.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.652+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f34ec05f570 con 0x7f34ec0fe270 2024-03-12T16:34:22.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.653+0000 7f34d3fff700 1 -- 172.21.15.6:0/2216421180 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f34e00094c0 con 0x7f34ec0fe270 2024-03-12T16:34:22.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.653+0000 7f34d3fff700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d406caa0 0x7f34d406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:22.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.653+0000 7f34d3fff700 1 -- 172.21.15.6:0/2216421180 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f34e008d040 con 0x7f34ec0fe270 2024-03-12T16:34:22.648 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.653+0000 7f34eaffd700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d406caa0 0x7f34d406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:22.649 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.654+0000 7f34eaffd700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d406caa0 0x7f34d406ef60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f34dc004dc0 tx=0x7f34dc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:22.652 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.658+0000 7f34d3fff700 1 -- 172.21.15.6:0/2216421180 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f34e0057110 con 0x7f34ec0fe270 2024-03-12T16:34:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.937+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7f34ec047540 con 0x7f34ec0fe270 2024-03-12T16:34:22.932 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.937+0000 7f34d3fff700 1 -- 172.21.15.6:0/2216421180 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+233 (secure 0 0 0) 0x7f34e005a730 con 0x7f34ec0fe270 2024-03-12T16:34:22.932 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_ERR 1 filesystem is degraded; 1 filesystem is offline 2024-03-12T16:34:22.932 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:34:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:34:22.932 INFO:teuthology.orchestra.run.smithi006.stdout:[ERR] MDS_ALL_DOWN: 1 filesystem is offline 2024-03-12T16:34:22.932 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is offline because no MDS is active for it. 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d406caa0 msgr2=0x7f34d406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d406caa0 0x7f34d406ef60 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 rx=0x7f34dc004dc0 tx=0x7f34dc00b040).stop 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 msgr2=0x7f34ec06b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 0x7f34ec06b5c0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 rx=0x7f34e00099f0 tx=0x7f34e0009cb0).stop 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 shutdown_connections 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f34ec0fd910 0x7f34ec06b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f34d406caa0 0x7f34d406ef60 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 --2- 172.21.15.6:0/2216421180 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f34ec0fe270 0x7f34ec06b5c0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 >> 172.21.15.6:0/2216421180 conn(0x7f34ec0f3530 msgr2=0x7f34ec0fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:22.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 shutdown_connections 2024-03-12T16:34:22.935 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:22.939+0000 7f34f1a11700 1 -- 172.21.15.6:0/2216421180 wait complete. 2024-03-12T16:34:23.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:22 smithi134 ceph-mon[85099]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:23.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:22 smithi134 ceph-mon[85099]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:23.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:22 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2465922039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:23.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:22 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1633257813' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:34:23.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:22 smithi006 ceph-mon[103869]: from='client.35176 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:23.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:22 smithi006 ceph-mon[103869]: from='client.35180 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:23.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:22 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2465922039' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:23.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:22 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1633257813' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:34:24.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:23 smithi134 ceph-mon[85099]: pgmap v634: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:24.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:23 smithi134 ceph-mon[85099]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:24.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:23 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2216421180' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:34:24.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:23 smithi006 ceph-mon[103869]: pgmap v634: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:24.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:23 smithi006 ceph-mon[103869]: from='client.35192 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:24.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:23 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2216421180' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:34:26.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:25 smithi134 ceph-mon[85099]: pgmap v635: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:26.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:25 smithi006 ceph-mon[103869]: pgmap v635: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:28.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:27 smithi134 ceph-mon[85099]: pgmap v636: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:28.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:27 smithi006 ceph-mon[103869]: pgmap v636: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:30.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:29 smithi134 ceph-mon[85099]: pgmap v637: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:30.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:29 smithi006 ceph-mon[103869]: pgmap v637: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:32.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:31 smithi134 ceph-mon[85099]: pgmap v638: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:32.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:31 smithi006 ceph-mon[103869]: pgmap v638: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:33.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:34:33.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:34:34.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:33 smithi134 ceph-mon[85099]: pgmap v639: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:34.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:33 smithi006 ceph-mon[103869]: pgmap v639: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:36.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:35 smithi134 ceph-mon[85099]: pgmap v640: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:36.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:35 smithi006 ceph-mon[103869]: pgmap v640: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:38.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:37 smithi134 ceph-mon[85099]: pgmap v641: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:38.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:37 smithi006 ceph-mon[103869]: pgmap v641: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:40.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:39 smithi134 ceph-mon[85099]: pgmap v642: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:40.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:39 smithi006 ceph-mon[103869]: pgmap v642: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:42.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:41 smithi134 ceph-mon[85099]: pgmap v643: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:42.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:41 smithi006 ceph-mon[103869]: pgmap v643: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:44.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:43 smithi134 ceph-mon[85099]: pgmap v644: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:44.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:43 smithi006 ceph-mon[103869]: pgmap v644: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:46.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:45 smithi134 ceph-mon[85099]: pgmap v645: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:46.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:45 smithi006 ceph-mon[103869]: pgmap v645: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:48.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:47 smithi134 ceph-mon[85099]: pgmap v646: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:48.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:34:48.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:47 smithi006 ceph-mon[103869]: pgmap v646: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:48.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:34:50.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:49 smithi134 ceph-mon[85099]: pgmap v647: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:50.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:49 smithi006 ceph-mon[103869]: pgmap v647: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:52.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:51 smithi134 ceph-mon[85099]: pgmap v648: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:52.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:51 smithi006 ceph-mon[103869]: pgmap v648: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:53.050 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.054+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1109917548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fd910 msgr2=0x7f3fe40fdcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:53.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.054+0000 7f3fe98a6700 1 --2- 172.21.15.6:0/1109917548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fd910 0x7f3fe40fdcf0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 rx=0x7f3fd80047f0 tx=0x7f3fd8009cb0).stop 2024-03-12T16:34:53.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.054+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1109917548 shutdown_connections 2024-03-12T16:34:53.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.054+0000 7f3fe98a6700 1 --2- 172.21.15.6:0/1109917548 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe40fe270 0x7f3fe40f7a50 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:53.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.054+0000 7f3fe98a6700 1 --2- 172.21.15.6:0/1109917548 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fd910 0x7f3fe40fdcf0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:53.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.054+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1109917548 >> 172.21.15.6:0/1109917548 conn(0x7f3fe40f3530 msgr2=0x7f3fe40f5950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:53.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.054+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1109917548 shutdown_connections 2024-03-12T16:34:53.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.054+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1109917548 wait complete. 2024-03-12T16:34:53.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.055+0000 7f3fe98a6700 1 Processor -- start 2024-03-12T16:34:53.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.055+0000 7f3fe98a6700 1 -- start start 2024-03-12T16:34:53.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.055+0000 7f3fe98a6700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe40fd910 0x7f3fe406b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:53.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.055+0000 7f3fe98a6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fe270 0x7f3fe406b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:53.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.055+0000 7f3fe98a6700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe406bab0 con 0x7f3fe40fe270 2024-03-12T16:34:53.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.055+0000 7f3fe98a6700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3fe406bbf0 con 0x7f3fe40fd910 2024-03-12T16:34:53.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fe270 0x7f3fe406b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:53.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe27fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fe270 0x7f3fe406b5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35020/0 (socket says 172.21.15.6:35020) 2024-03-12T16:34:53.053 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe27fc700 1 -- 172.21.15.6:0/1955086377 learned_addr learned my addr 172.21.15.6:0/1955086377 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe2ffd700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe40fd910 0x7f3fe406b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe27fc700 1 -- 172.21.15.6:0/1955086377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe40fd910 msgr2=0x7f3fe406b0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe27fc700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe40fd910 0x7f3fe406b0d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe27fc700 1 -- 172.21.15.6:0/1955086377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3fd8005040 con 0x7f3fe40fe270 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe2ffd700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe40fd910 0x7f3fe406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe27fc700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fe270 0x7f3fe406b5c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f3fd40044e0 tx=0x7f3fd4002b00).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fcbfff700 1 -- 172.21.15.6:0/1955086377 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd4007b40 con 0x7f3fe40fe270 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fcbfff700 1 -- 172.21.15.6:0/1955086377 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3fd400f040 con 0x7f3fe40fe270 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3fe406bea0 con 0x7f3fe40fe270 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fcbfff700 1 -- 172.21.15.6:0/1955086377 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3fd400d830 con 0x7f3fe40fe270 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.056+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3fe4114640 con 0x7f3fe40fe270 2024-03-12T16:34:53.054 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.057+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3fe405f570 con 0x7f3fe40fe270 2024-03-12T16:34:53.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.058+0000 7f3fcbfff700 1 -- 172.21.15.6:0/1955086377 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f3fd4007ca0 con 0x7f3fe40fe270 2024-03-12T16:34:53.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.058+0000 7f3fcbfff700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3fcc06caa0 0x7f3fcc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:53.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.058+0000 7f3fcbfff700 1 -- 172.21.15.6:0/1955086377 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f3fd408b9d0 con 0x7f3fe40fe270 2024-03-12T16:34:53.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.058+0000 7f3fe2ffd700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3fcc06caa0 0x7f3fcc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:53.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.059+0000 7f3fe2ffd700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3fcc06caa0 0x7f3fcc06ef60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f3fd8004540 tx=0x7f3fd800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:53.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.063+0000 7f3fcbfff700 1 -- 172.21.15.6:0/1955086377 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3fd4055aa0 con 0x7f3fe40fe270 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:53.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:34:53.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi006.ncuwuc"}]': finished 2024-03-12T16:34:53.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:34:53.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi006.ufmcfu"}]': finished 2024-03-12T16:34:53.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:34:53.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.jqydtn"}]': finished 2024-03-12T16:34:53.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:34:53.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.ufgvbd"}]': finished 2024-03-12T16:34:53.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:52 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-03-12T16:34:53.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi006.ncuwuc"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi006.ncuwuc"}]': finished 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi006.ufmcfu"}]: dispatch 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi006.ufmcfu"}]': finished 2024-03-12T16:34:53.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.jqydtn"}]: dispatch 2024-03-12T16:34:53.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.jqydtn"}]': finished 2024-03-12T16:34:53.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.ufgvbd"}]: dispatch 2024-03-12T16:34:53.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds.cephfs.smithi134.ufgvbd"}]': finished 2024-03-12T16:34:53.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:52 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]: dispatch 2024-03-12T16:34:53.408 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.413+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f3fe4059120 con 0x7f3fcc06caa0 2024-03-12T16:34:53.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.414+0000 7f3fcbfff700 1 -- 172.21.15.6:0/1955086377 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f3fe4059120 con 0x7f3fcc06caa0 2024-03-12T16:34:53.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.416+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3fcc06caa0 msgr2=0x7f3fcc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:53.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.416+0000 7f3fe98a6700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3fcc06caa0 0x7f3fcc06ef60 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 rx=0x7f3fd8004540 tx=0x7f3fd800b040).stop 2024-03-12T16:34:53.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.416+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fe270 msgr2=0x7f3fe406b5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:53.412 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.416+0000 7f3fe98a6700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fe270 0x7f3fe406b5c0 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 rx=0x7f3fd40044e0 tx=0x7f3fd4002b00).stop 2024-03-12T16:34:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.416+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 shutdown_connections 2024-03-12T16:34:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.416+0000 7f3fe98a6700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3fe40fd910 0x7f3fe406b0d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.416+0000 7f3fe98a6700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3fcc06caa0 0x7f3fcc06ef60 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.416+0000 7f3fe98a6700 1 --2- 172.21.15.6:0/1955086377 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3fe40fe270 0x7f3fe406b5c0 unknown :-1 s=CLOSED pgs=566 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.416+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 >> 172.21.15.6:0/1955086377 conn(0x7f3fe40f3530 msgr2=0x7f3fe40fbcd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.418+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 shutdown_connections 2024-03-12T16:34:53.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:53.418+0000 7f3fe98a6700 1 -- 172.21.15.6:0/1955086377 wait complete. 2024-03-12T16:34:54.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: pgmap v649: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all mds 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: Upgrade: Setting filesystem cephfs Joinable 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: Standby daemon mds.cephfs.smithi006.ncuwuc assigned to filesystem cephfs as rank 0 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: Standby daemon mds.cephfs.smithi006.ufmcfu assigned to filesystem cephfs as rank 1 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:replay,1=cephfs.smithi006.ufmcfu=up:replay} 2 up:standby 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-12T16:34:54.200 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.201 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.202 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:53 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: pgmap v649: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:34:54.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all mds 2024-03-12T16:34:54.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: Upgrade: Setting filesystem cephfs Joinable 2024-03-12T16:34:54.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: Health check failed: failed to probe daemons or devices (CEPHADM_REFRESH_FAILED) 2024-03-12T16:34:54.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "fs set", "fs_name": "cephfs", "var": "joinable", "val": "true"}]': finished 2024-03-12T16:34:54.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: Standby daemon mds.cephfs.smithi006.ncuwuc assigned to filesystem cephfs as rank 0 2024-03-12T16:34:54.203 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: Standby daemon mds.cephfs.smithi006.ufmcfu assigned to filesystem cephfs as rank 1 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: Health check cleared: MDS_ALL_DOWN (was: 1 filesystem is offline) 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: fsmap cephfs:0/2 4 up:standby, 2 failed 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:replay,1=cephfs.smithi006.ufmcfu=up:replay} 2 up:standby 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.204 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.205 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "osd"}]': finished 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]': finished 2024-03-12T16:34:54.206 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]': finished 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.207 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-03-12T16:34:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]: dispatch 2024-03-12T16:34:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix": "config rm", "name": "mon_mds_skip_sanity", "who": "mon"}]': finished 2024-03-12T16:34:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-03-12T16:34:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-03-12T16:34:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:34:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.208 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:53 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:54.254 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph orch ps' 2024-03-12T16:34:55.149 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all rgw 2024-03-12T16:34:55.149 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all rbd-mirror 2024-03-12T16:34:55.149 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all ceph-exporter 2024-03-12T16:34:55.150 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all iscsi 2024-03-12T16:34:55.150 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all nfs 2024-03-12T16:34:55.150 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: Upgrade: Setting container_image for all nvmeof 2024-03-12T16:34:55.150 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: Upgrade: Finalizing container_image settings 2024-03-12T16:34:55.150 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: Upgrade: Complete! 2024-03-12T16:34:55.150 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:55.150 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:55.150 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:54 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:55.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all rgw 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all rbd-mirror 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all ceph-exporter 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all iscsi 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all nfs 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: Upgrade: Setting container_image for all nvmeof 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: Upgrade: Finalizing container_image settings 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: Upgrade: Complete! 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: from='client.35200 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:55.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:54 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:56.028 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:55 smithi006 ceph-mon[103869]: pgmap v650: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 0 op/s 2024-03-12T16:34:56.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:55 smithi134 ceph-mon[85099]: pgmap v650: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.4 MiB/s rd, 0 op/s 2024-03-12T16:34:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.798+0000 7f7437d8b700 1 -- 172.21.15.6:0/3501425488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 msgr2=0x7f7430108340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.798+0000 7f7437d8b700 1 --2- 172.21.15.6:0/3501425488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 0x7f7430108340 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 rx=0x7f742c0047f0 tx=0x7f742c009cb0).stop 2024-03-12T16:34:56.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.798+0000 7f7437d8b700 1 -- 172.21.15.6:0/3501425488 shutdown_connections 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.798+0000 7f7437d8b700 1 --2- 172.21.15.6:0/3501425488 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 0x7f7430108340 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.798+0000 7f7437d8b700 1 --2- 172.21.15.6:0/3501425488 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f743006d300 0x7f743006d6e0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.798+0000 7f7437d8b700 1 -- 172.21.15.6:0/3501425488 >> 172.21.15.6:0/3501425488 conn(0x7f74300f5830 msgr2=0x7f74300f7c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.798+0000 7f7437d8b700 1 -- 172.21.15.6:0/3501425488 shutdown_connections 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.798+0000 7f7437d8b700 1 -- 172.21.15.6:0/3501425488 wait complete. 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.799+0000 7f7437d8b700 1 Processor -- start 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.799+0000 7f7437d8b700 1 -- start start 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7437d8b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f743006d300 0x7f7430114590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7437d8b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 0x7f7430114aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7437d8b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74301150a0 con 0x7f743006dbd0 2024-03-12T16:34:56.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7437d8b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f74301151e0 con 0x7f743006d300 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7435326700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 0x7f7430114aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7435326700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 0x7f7430114aa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35046/0 (socket says 172.21.15.6:35046) 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7435326700 1 -- 172.21.15.6:0/3726583099 learned_addr learned my addr 172.21.15.6:0/3726583099 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7435b27700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f743006d300 0x7f7430114590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7435326700 1 -- 172.21.15.6:0/3726583099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f743006d300 msgr2=0x7f7430114590 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7435326700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f743006d300 0x7f7430114590 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7435326700 1 -- 172.21.15.6:0/3726583099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f742c005040 con 0x7f743006dbd0 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.800+0000 7f7435326700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 0x7f7430114aa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f742c00b120 tx=0x7f742c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.801+0000 7f7426ffd700 1 -- 172.21.15.6:0/3726583099 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742c00e030 con 0x7f743006dbd0 2024-03-12T16:34:56.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.801+0000 7f7426ffd700 1 -- 172.21.15.6:0/3726583099 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f742c007e90 con 0x7f743006dbd0 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.801+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f743010e870 con 0x7f743006dbd0 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.801+0000 7f7426ffd700 1 -- 172.21.15.6:0/3726583099 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f742c018070 con 0x7f743006dbd0 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.801+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f743010ed50 con 0x7f743006dbd0 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.802+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f743005f570 con 0x7f743006dbd0 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.803+0000 7f7426ffd700 1 -- 172.21.15.6:0/3726583099 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f742c01d420 con 0x7f743006dbd0 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.804+0000 7f7426ffd700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f741c06caa0 0x7f741c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.804+0000 7f7426ffd700 1 -- 172.21.15.6:0/3726583099 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f742c092060 con 0x7f743006dbd0 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.805+0000 7f7435b27700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f741c06caa0 0x7f741c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.809+0000 7f7435b27700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f741c06caa0 0x7f741c06ef60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f74300f6330 tx=0x7f7420009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:34:56.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:56.814+0000 7f7426ffd700 1 -- 172.21.15.6:0/3726583099 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f742c05a3a0 con 0x7f743006dbd0 2024-03-12T16:34:57.202 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.205+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f74301058b0 con 0x7f741c06caa0 2024-03-12T16:34:57.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.225+0000 7f7426ffd700 1 -- 172.21.15.6:0/3726583099 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f74301058b0 con 0x7f741c06caa0 2024-03-12T16:34:57.226 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:34:57.226 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (21m) 15m ago 32m 26.4M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (19m) 15m ago 32m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (19m) 0s ago 32m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (21m) 15m ago 32m 88.7M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (15m) 15m ago 27m 15.0M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (15m) 15m ago 27m 11.4M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (15m) 0s ago 27m 17.8M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (15m) 0s ago 27m 17.7M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (23m) 15m ago 34m 505M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (22m) 0s ago 32m 456M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (20m) 15m ago 34m 50.5M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (20m) 0s ago 31m 51.3M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (22m) 15m ago 32m 17.5M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (22m) 0s ago 31m 18.4M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (19m) 15m ago 31m 93.7M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:34:57.227 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (18m) 15m ago 31m 95.2M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:34:57.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (17m) 15m ago 30m 86.0M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:34:57.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (17m) 0s ago 29m 135M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:34:57.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (16m) 0s ago 29m 99.9M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:34:57.228 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (16m) 0s ago 29m 99.6M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:34:57.228 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (21m) 0s ago 30m 79.8M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:34:57.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.232+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f741c06caa0 msgr2=0x7f741c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:57.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.232+0000 7f7437d8b700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f741c06caa0 0x7f741c06ef60 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 rx=0x7f74300f6330 tx=0x7f7420009040).stop 2024-03-12T16:34:57.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.232+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 msgr2=0x7f7430114aa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:34:57.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.232+0000 7f7437d8b700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 0x7f7430114aa0 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 rx=0x7f742c00b120 tx=0x7f742c009cb0).stop 2024-03-12T16:34:57.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.232+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 shutdown_connections 2024-03-12T16:34:57.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.232+0000 7f7437d8b700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f743006d300 0x7f7430114590 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:57.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.232+0000 7f7437d8b700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f741c06caa0 0x7f741c06ef60 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:57.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.232+0000 7f7437d8b700 1 --2- 172.21.15.6:0/3726583099 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f743006dbd0 0x7f7430114aa0 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:34:57.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.232+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 >> 172.21.15.6:0/3726583099 conn(0x7f74300f5830 msgr2=0x7f74300f7230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:34:57.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.233+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 shutdown_connections 2024-03-12T16:34:57.229 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:34:57.233+0000 7f7437d8b700 1 -- 172.21.15.6:0/3726583099 wait complete. 2024-03-12T16:34:57.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:57 smithi006 ceph-mon[103869]: pgmap v651: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.1 MiB/s rd, 3 op/s 2024-03-12T16:34:57.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:57.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:57.916 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:57 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:57.944 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph orch upgrade status' 2024-03-12T16:34:57.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:57 smithi134 ceph-mon[85099]: pgmap v651: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 8.1 MiB/s rd, 3 op/s 2024-03-12T16:34:57.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:57.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:57.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:57 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:34:58.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:58 smithi134 ceph-mon[85099]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:58.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:58 smithi006 ceph-mon[103869]: from='client.35204 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:34:59.868 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:34:59 smithi006 ceph-mon[103869]: pgmap v652: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-03-12T16:34:59.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:34:59 smithi134 ceph-mon[85099]: pgmap v652: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 17 MiB/s rd, 6 op/s 2024-03-12T16:35:00.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.667+0000 7f42b07d5700 1 -- 172.21.15.6:0/561602932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6fe0 msgr2=0x7f42a8103d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:00.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.667+0000 7f42b07d5700 1 --2- 172.21.15.6:0/561602932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6fe0 0x7f42a8103d80 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 rx=0x7f42980047f0 tx=0x7f4298009cb0).stop 2024-03-12T16:35:00.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.667+0000 7f42b07d5700 1 -- 172.21.15.6:0/561602932 shutdown_connections 2024-03-12T16:35:00.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.667+0000 7f42b07d5700 1 --2- 172.21.15.6:0/561602932 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6fe0 0x7f42a8103d80 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:00.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.667+0000 7f42b07d5700 1 --2- 172.21.15.6:0/561602932 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a80f6710 0x7f42a80f6af0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:00.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.667+0000 7f42b07d5700 1 -- 172.21.15.6:0/561602932 >> 172.21.15.6:0/561602932 conn(0x7f42a8070590 msgr2=0x7f42a80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:35:00.727 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.667+0000 7f42b07d5700 1 -- 172.21.15.6:0/561602932 shutdown_connections 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.667+0000 7f42b07d5700 1 -- 172.21.15.6:0/561602932 wait complete. 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42b07d5700 1 Processor -- start 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42b07d5700 1 -- start start 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42b07d5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6710 0x7f42a8110270 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42b07d5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a80f6fe0 0x7f42a8110760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42b07d5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a8110d60 con 0x7f42a80f6710 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42b07d5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f42a8110ea0 con 0x7f42a80f6fe0 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42ae571700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6710 0x7f42a8110270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42ae571700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6710 0x7f42a8110270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:35062/0 (socket says 172.21.15.6:35062) 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42ae571700 1 -- 172.21.15.6:0/1195431460 learned_addr learned my addr 172.21.15.6:0/1195431460 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42ae571700 1 -- 172.21.15.6:0/1195431460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a80f6fe0 msgr2=0x7f42a8110760 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.668+0000 7f42ae571700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a80f6fe0 0x7f42a8110760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.669+0000 7f42ae571700 1 -- 172.21.15.6:0/1195431460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4298005040 con 0x7f42a80f6710 2024-03-12T16:35:00.728 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.669+0000 7f42ae571700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6710 0x7f42a8110270 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f42a40041d0 tx=0x7f42a4009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.669+0000 7f429f7fe700 1 -- 172.21.15.6:0/1195431460 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42a4002d90 con 0x7f42a80f6710 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.669+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f42a810a580 con 0x7f42a80f6710 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.669+0000 7f429f7fe700 1 -- 172.21.15.6:0/1195431460 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f42a400f040 con 0x7f42a80f6710 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.669+0000 7f429f7fe700 1 -- 172.21.15.6:0/1195431460 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f42a400d800 con 0x7f42a80f6710 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.669+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f42a810aac0 con 0x7f42a80f6710 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.670+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f42a805f590 con 0x7f42a80f6710 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.671+0000 7f429f7fe700 1 -- 172.21.15.6:0/1195431460 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f42a400dac0 con 0x7f42a80f6710 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.671+0000 7f429f7fe700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f429406cab0 0x7f429406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.672+0000 7f429f7fe700 1 -- 172.21.15.6:0/1195431460 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f42a408bde0 con 0x7f42a80f6710 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.674+0000 7f42add70700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f429406cab0 0x7f429406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.674+0000 7f42add70700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f429406cab0 0x7f429406ef70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f42980047c0 tx=0x7f4298009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:35:00.729 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.680+0000 7f429f7fe700 1 -- 172.21.15.6:0/1195431460 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f42a4059940 con 0x7f42a80f6710 2024-03-12T16:35:00.913 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.917+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}) v1 -- 0x7f42a810ad40 con 0x7f429406cab0 2024-03-12T16:35:00.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.918+0000 7f429f7fe700 1 -- 172.21.15.6:0/1195431460 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+175 (secure 0 0 0) 0x7f42a810ad40 con 0x7f429406cab0 2024-03-12T16:35:00.914 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:35:00.914 INFO:teuthology.orchestra.run.smithi006.stdout: "target_image": null, 2024-03-12T16:35:00.914 INFO:teuthology.orchestra.run.smithi006.stdout: "in_progress": false, 2024-03-12T16:35:00.914 INFO:teuthology.orchestra.run.smithi006.stdout: "which": "", 2024-03-12T16:35:00.915 INFO:teuthology.orchestra.run.smithi006.stdout: "services_complete": [], 2024-03-12T16:35:00.915 INFO:teuthology.orchestra.run.smithi006.stdout: "progress": null, 2024-03-12T16:35:00.915 INFO:teuthology.orchestra.run.smithi006.stdout: "message": "", 2024-03-12T16:35:00.915 INFO:teuthology.orchestra.run.smithi006.stdout: "is_paused": false 2024-03-12T16:35:00.915 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:35:00.916 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f429406cab0 msgr2=0x7f429406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f429406cab0 0x7f429406ef70 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 rx=0x7f42980047c0 tx=0x7f4298009cb0).stop 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6710 msgr2=0x7f42a8110270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6710 0x7f42a8110270 secure :-1 s=READY pgs=570 cs=0 l=1 rev1=1 rx=0x7f42a40041d0 tx=0x7f42a4009f60).stop 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 shutdown_connections 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f429406cab0 0x7f429406ef70 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f42a80f6710 0x7f42a8110270 unknown :-1 s=CLOSED pgs=570 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 --2- 172.21.15.6:0/1195431460 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f42a80f6fe0 0x7f42a8110760 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 >> 172.21.15.6:0/1195431460 conn(0x7f42a8070590 msgr2=0x7f42a80fed40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 shutdown_connections 2024-03-12T16:35:00.917 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:00.921+0000 7f42b07d5700 1 -- 172.21.15.6:0/1195431460 wait complete. 2024-03-12T16:35:01.657 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph health detail' 2024-03-12T16:35:01.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:01 smithi134 ceph-mon[85099]: pgmap v653: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-03-12T16:35:01.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:01 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:resolve 2024-03-12T16:35:01.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:01 smithi134 ceph-mon[85099]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:replay,1=cephfs.smithi006.ufmcfu=up:resolve} 2 up:standby 2024-03-12T16:35:01.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:01 smithi006 ceph-mon[103869]: pgmap v653: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 20 MiB/s rd, 7 op/s 2024-03-12T16:35:01.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:01 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:resolve 2024-03-12T16:35:01.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:01 smithi006 ceph-mon[103869]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:replay,1=cephfs.smithi006.ufmcfu=up:resolve} 2 up:standby 2024-03-12T16:35:02.909 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:02 smithi006 ceph-mon[103869]: from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:35:02.909 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:02 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:resolve 2024-03-12T16:35:02.910 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:02 smithi006 ceph-mon[103869]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:resolve,1=cephfs.smithi006.ufmcfu=up:resolve} 2 up:standby 2024-03-12T16:35:02.910 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:02.910 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:35:02.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:02 smithi134 ceph-mon[85099]: from='client.35208 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:35:02.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:02 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:resolve 2024-03-12T16:35:02.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:02 smithi134 ceph-mon[85099]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:resolve,1=cephfs.smithi006.ufmcfu=up:resolve} 2 up:standby 2024-03-12T16:35:02.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:02.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:35:03.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:03 smithi134 ceph-mon[85099]: pgmap v654: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-03-12T16:35:03.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:03 smithi134 ceph-mon[85099]: reconnect by client.24327 192.168.0.1:0/3416510794 after 0.000999989 2024-03-12T16:35:03.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:03 smithi134 ceph-mon[85099]: reconnect by client.24327 192.168.0.1:0/3416510794 after 0.000999989 2024-03-12T16:35:03.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:03 smithi134 ceph-mon[85099]: reconnect by client.14494 192.168.0.1:0/1262025081 after 0.00199998 2024-03-12T16:35:03.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:03 smithi134 ceph-mon[85099]: reconnect by client.14494 192.168.0.1:0/1262025081 after 0.00199998 2024-03-12T16:35:03.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:03 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:reconnect 2024-03-12T16:35:03.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:03 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:reconnect 2024-03-12T16:35:03.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:03 smithi134 ceph-mon[85099]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:reconnect,1=cephfs.smithi006.ufmcfu=up:reconnect} 2 up:standby 2024-03-12T16:35:03.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:03 smithi006 ceph-mon[103869]: pgmap v654: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-03-12T16:35:03.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:03 smithi006 ceph-mon[103869]: reconnect by client.24327 192.168.0.1:0/3416510794 after 0.000999989 2024-03-12T16:35:03.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:03 smithi006 ceph-mon[103869]: reconnect by client.24327 192.168.0.1:0/3416510794 after 0.000999989 2024-03-12T16:35:03.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:03 smithi006 ceph-mon[103869]: reconnect by client.14494 192.168.0.1:0/1262025081 after 0.00199998 2024-03-12T16:35:03.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:03 smithi006 ceph-mon[103869]: reconnect by client.14494 192.168.0.1:0/1262025081 after 0.00199998 2024-03-12T16:35:03.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:03 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:reconnect 2024-03-12T16:35:03.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:03 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:reconnect 2024-03-12T16:35:03.952 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:03 smithi006 ceph-mon[103869]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:reconnect,1=cephfs.smithi006.ufmcfu=up:reconnect} 2 up:standby 2024-03-12T16:35:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.057+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/494487233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fc7f0 msgr2=0x7fc6d40fcbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.057+0000 7fc6dc2a2700 1 --2- 172.21.15.6:0/494487233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d40fcbd0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 rx=0x7fc6c40047f0 tx=0x7fc6c4009cb0).stop 2024-03-12T16:35:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.057+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/494487233 shutdown_connections 2024-03-12T16:35:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.057+0000 7fc6dc2a2700 1 --2- 172.21.15.6:0/494487233 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6d40fd150 0x7fc6d40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.057+0000 7fc6dc2a2700 1 --2- 172.21.15.6:0/494487233 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d40fcbd0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.057+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/494487233 >> 172.21.15.6:0/494487233 conn(0x7fc6d4070590 msgr2=0x7fc6d40f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:35:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.057+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/494487233 shutdown_connections 2024-03-12T16:35:04.055 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.057+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/494487233 wait complete. 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6dc2a2700 1 Processor -- start 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6dc2a2700 1 -- start start 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6dc2a2700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6dc2a2700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6dc2a2700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d410eb20 con 0x7fc6d40fd150 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6dc2a2700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc6d410ec60 con 0x7fc6d40fc7f0 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6d983d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6d983d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50266/0 (socket says 172.21.15.6:50266) 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6d983d700 1 -- 172.21.15.6:0/551237899 learned_addr learned my addr 172.21.15.6:0/551237899 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.058+0000 7fc6da03e700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.059+0000 7fc6d983d700 1 -- 172.21.15.6:0/551237899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6d40fc7f0 msgr2=0x7fc6d410e030 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.059+0000 7fc6d983d700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410e030 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:04.056 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.059+0000 7fc6d983d700 1 -- 172.21.15.6:0/551237899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc6c4005040 con 0x7fc6d40fd150 2024-03-12T16:35:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.059+0000 7fc6d983d700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e520 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fc6d000c790 tx=0x7fc6d0007f50).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:35:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.059+0000 7fc6cb779700 1 -- 172.21.15.6:0/551237899 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d00106f0 con 0x7fc6d40fd150 2024-03-12T16:35:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.059+0000 7fc6cb779700 1 -- 172.21.15.6:0/551237899 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc6d0010d00 con 0x7fc6d40fd150 2024-03-12T16:35:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.059+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc6d41082f0 con 0x7fc6d40fd150 2024-03-12T16:35:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.059+0000 7fc6cb779700 1 -- 172.21.15.6:0/551237899 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc6d0012d50 con 0x7fc6d40fd150 2024-03-12T16:35:04.057 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.059+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc6d41088b0 con 0x7fc6d40fd150 2024-03-12T16:35:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.060+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc6d405f590 con 0x7fc6d40fd150 2024-03-12T16:35:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.060+0000 7fc6cb779700 1 -- 172.21.15.6:0/551237899 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fc6d0012570 con 0x7fc6d40fd150 2024-03-12T16:35:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.061+0000 7fc6cb779700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6c006caa0 0x7fc6c006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:35:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.061+0000 7fc6cb779700 1 -- 172.21.15.6:0/551237899 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc6d008b630 con 0x7fc6d40fd150 2024-03-12T16:35:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.061+0000 7fc6da03e700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6c006caa0 0x7fc6c006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:35:04.058 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.061+0000 7fc6da03e700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6c006caa0 0x7fc6c006ef60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fc6c4004f10 tx=0x7fc6c400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:35:04.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.065+0000 7fc6cb779700 1 -- 172.21.15.6:0/551237899 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc6d00590d0 con 0x7fc6d40fd150 2024-03-12T16:35:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.381+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "health", "detail": "detail"} v 0) v1 -- 0x7fc6d4109780 con 0x7fc6d40fd150 2024-03-12T16:35:04.377 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.381+0000 7fc6cb779700 1 -- 172.21.15.6:0/551237899 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "health", "detail": "detail"}]=0 v0) v1 ==== 74+0+3457 (secure 0 0 0) 0x7fc6d0016da0 con 0x7fc6d40fd150 2024-03-12T16:35:04.377 INFO:teuthology.orchestra.run.smithi006.stdout:HEALTH_WARN failed to probe daemons or devices; 1 filesystem is degraded 2024-03-12T16:35:04.377 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] CEPHADM_REFRESH_FAILED: failed to probe daemons or devices 2024-03-12T16:35:04.377 INFO:teuthology.orchestra.run.smithi006.stdout: host smithi134 `cephadm ceph-volume` failed: cephadm exited with an error code: 1, stderr: Inferring config /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/mon.smithi134/config 2024-03-12T16:35:04.377 INFO:teuthology.orchestra.run.smithi006.stdout:/usr/bin/podman: timeout after 895 seconds 2024-03-12T16:35:04.377 INFO:teuthology.orchestra.run.smithi006.stdout:Non-zero exit code 124 from /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846 -e NODE_NAME=smithi134 -e CEPH_USE_RANDOM_NONCE=1 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/88d7ee42-e089-11ee-95c8-87774f69a715:/var/run/ceph:z -v /var/log/ceph/88d7ee42-e089-11ee-95c8-87774f69a715:/var/log/ceph:z -v /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/selinux:/sys/fs/selinux:ro -v /:/rootfs -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpdfdp6jkm:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846 inventory --format=json-pretty --filter-for-batch 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout:Traceback (most recent call last): 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/usr/lib64/python3.6/runpy.py", line 193, in _run_module_as_main 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: "__main__", mod_spec) 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/usr/lib64/python3.6/runpy.py", line 85, in _run_code 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: exec(code, run_globals) 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/tmp/tmpf0b20xbh.cephadm.build/__main__.py", line 10863, in 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/tmp/tmpf0b20xbh.cephadm.build/__main__.py", line 10851, in main 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/tmp/tmpf0b20xbh.cephadm.build/__main__.py", line 2568, in _infer_config 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/tmp/tmpf0b20xbh.cephadm.build/__main__.py", line 2484, in _infer_fsid 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/tmp/tmpf0b20xbh.cephadm.build/__main__.py", line 2596, in _infer_image 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/tmp/tmpf0b20xbh.cephadm.build/__main__.py", line 2471, in _validate_fsid 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/tmp/tmpf0b20xbh.cephadm.build/__main__.py", line 7129, in command_ceph_volume 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout: File "/tmp/tmpf0b20xbh.cephadm.build/__main__.py", line 2259, in call_throws 2024-03-12T16:35:04.378 INFO:teuthology.orchestra.run.smithi006.stdout:RuntimeError: Failed command: /usr/bin/podman run --rm --ipc=host --stop-signal=SIGTERM --net=host --entrypoint /usr/sbin/ceph-volume --privileged --group-add=disk --init -e CONTAINER_IMAGE=quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846 -e NODE_NAME=smithi134 -e CEPH_USE_RANDOM_NONCE=1 -e CEPH_VOLUME_SKIP_RESTORECON=yes -e CEPH_VOLUME_DEBUG=1 -v /var/run/ceph/88d7ee42-e089-11ee-95c8-87774f69a715:/var/run/ceph:z -v /var/log/ceph/88d7ee42-e089-11ee-95c8-87774f69a715:/var/log/ceph:z -v /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/crash:/var/lib/ceph/crash:z -v /run/systemd/journal:/run/systemd/journal -v /dev:/dev -v /run/udev:/run/udev -v /sys:/sys -v /run/lvm:/run/lvm -v /run/lock/lvm:/run/lock/lvm -v /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/selinux:/sys/fs/selinux:ro -v /:/rootfs -v /etc/hosts:/etc/hosts:ro -v /tmp/ceph-tmpdfdp6jkm:/etc/ceph/ceph.conf:z quay.ceph.io/ceph-ci/ceph@sha256:5f5e1c7643f7a7de6ec1d48b6fbcff4edc8348b6188ac58d6e174a7ac9ad6846 inventory --format=json-pretty --filter-for-batch 2024-03-12T16:35:04.379 INFO:teuthology.orchestra.run.smithi006.stdout:[WRN] FS_DEGRADED: 1 filesystem is degraded 2024-03-12T16:35:04.379 INFO:teuthology.orchestra.run.smithi006.stdout: fs cephfs is degraded 2024-03-12T16:35:04.380 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6c006caa0 msgr2=0x7fc6c006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6c006caa0 0x7fc6c006ef60 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 rx=0x7fc6c4004f10 tx=0x7fc6c400b040).stop 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fd150 msgr2=0x7fc6d410e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e520 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 rx=0x7fc6d000c790 tx=0x7fc6d0007f50).stop 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 shutdown_connections 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc6d40fc7f0 0x7fc6d410e030 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc6c006caa0 0x7fc6c006ef60 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 --2- 172.21.15.6:0/551237899 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc6d40fd150 0x7fc6d410e520 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 >> 172.21.15.6:0/551237899 conn(0x7fc6d4070590 msgr2=0x7fc6d4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 shutdown_connections 2024-03-12T16:35:04.381 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:04.385+0000 7fc6dc2a2700 1 -- 172.21.15.6:0/551237899 wait complete. 2024-03-12T16:35:04.673 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:rejoin 2024-03-12T16:35:04.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:rejoin 2024-03-12T16:35:04.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:rejoin 2024-03-12T16:35:04.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:rejoin,1=cephfs.smithi006.ufmcfu=up:rejoin} 2 up:standby 2024-03-12T16:35:04.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: daemon mds.cephfs.smithi006.ufmcfu is now active in filesystem cephfs as rank 1 2024-03-12T16:35:04.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: daemon mds.cephfs.smithi006.ncuwuc is now active in filesystem cephfs as rank 0 2024-03-12T16:35:04.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:04.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:04.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/551237899' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:35:04.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:35:04.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:35:04.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:04 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:04.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:rejoin 2024-03-12T16:35:04.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: fsmap cephfs:2/2 {0=cephfs.smithi006.ncuwuc=up:rejoin,1=cephfs.smithi006.ufmcfu=up:rejoin} 2 up:standby 2024-03-12T16:35:04.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: daemon mds.cephfs.smithi006.ufmcfu is now active in filesystem cephfs as rank 1 2024-03-12T16:35:04.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: daemon mds.cephfs.smithi006.ncuwuc is now active in filesystem cephfs as rank 0 2024-03-12T16:35:04.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:04.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:04.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/551237899' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-03-12T16:35:04.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:35:04.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:35:04.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:04 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:05.061 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph versions' 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: pgmap v655: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: pgmap v656: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 95 B/s wr, 7 op/s 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:active 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:active 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi006.ufmcfu=up:active} 2 up:standby 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:35:05.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:35:05.948 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:05 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:05.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: pgmap v655: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 22 MiB/s rd, 7 op/s 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: pgmap v656: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 23 MiB/s rd, 95 B/s wr, 7 op/s 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: Health check cleared: CEPHADM_REFRESH_FAILED (was: failed to probe daemons or devices) 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: Health check cleared: FS_DEGRADED (was: 1 filesystem is degraded) 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] up:active 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: mds.? [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] up:active 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: fsmap cephfs:2 {0=cephfs.smithi006.ncuwuc=up:active,1=cephfs.smithi006.ufmcfu=up:active} 2 up:standby 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:35:05.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:05 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.856+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/1099452638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 msgr2=0x7f9a980f8c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.856+0000 7f9a9f7f8700 1 --2- 172.21.15.6:0/1099452638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 0x7f9a980f8c80 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 rx=0x7f9a940047f0 tx=0x7f9a94009cb0).stop 2024-03-12T16:35:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.856+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/1099452638 shutdown_connections 2024-03-12T16:35:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.856+0000 7f9a9f7f8700 1 --2- 172.21.15.6:0/1099452638 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a980f9200 0x7f9a98101910 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.856+0000 7f9a9f7f8700 1 --2- 172.21.15.6:0/1099452638 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 0x7f9a980f8c80 unknown :-1 s=CLOSED pgs=573 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.856+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/1099452638 >> 172.21.15.6:0/1099452638 conn(0x7f9a98070590 msgr2=0x7f9a980f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:35:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.857+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/1099452638 shutdown_connections 2024-03-12T16:35:06.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.857+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/1099452638 wait complete. 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.857+0000 7f9a9f7f8700 1 Processor -- start 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.857+0000 7f9a9f7f8700 1 -- start start 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.857+0000 7f9a9f7f8700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 0x7f9a9810e020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.857+0000 7f9a9f7f8700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a980f9200 0x7f9a9810e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.857+0000 7f9a9f7f8700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9810eb10 con 0x7f9a980f88a0 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.857+0000 7f9a9f7f8700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9a9810ec50 con 0x7f9a980f9200 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9d594700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 0x7f9a9810e020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9d594700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 0x7f9a9810e020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:50276/0 (socket says 172.21.15.6:50276) 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9d594700 1 -- 172.21.15.6:0/945084795 learned_addr learned my addr 172.21.15.6:0/945084795 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9cd93700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a980f9200 0x7f9a9810e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9d594700 1 -- 172.21.15.6:0/945084795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a980f9200 msgr2=0x7f9a9810e510 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:06.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9d594700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a980f9200 0x7f9a9810e510 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9d594700 1 -- 172.21.15.6:0/945084795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9a94005040 con 0x7f9a980f88a0 2024-03-12T16:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9d594700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 0x7f9a9810e020 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f9a94005010 tx=0x7f9a94009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a8e7fc700 1 -- 172.21.15.6:0/945084795 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a9400e030 con 0x7f9a980f88a0 2024-03-12T16:35:06.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a8e7fc700 1 -- 172.21.15.6:0/945084795 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9a94007e90 con 0x7f9a980f88a0 2024-03-12T16:35:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9a98108280 con 0x7f9a980f88a0 2024-03-12T16:35:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a8e7fc700 1 -- 172.21.15.6:0/945084795 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9a94018070 con 0x7f9a980f88a0 2024-03-12T16:35:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.858+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9a98108760 con 0x7f9a980f88a0 2024-03-12T16:35:06.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.859+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9a9805f590 con 0x7f9a980f88a0 2024-03-12T16:35:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.860+0000 7f9a8e7fc700 1 -- 172.21.15.6:0/945084795 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9a9401d670 con 0x7f9a980f88a0 2024-03-12T16:35:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.860+0000 7f9a8e7fc700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a8406caa0 0x7f9a8406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:35:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.860+0000 7f9a8e7fc700 1 -- 172.21.15.6:0/945084795 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9a9408d010 con 0x7f9a980f88a0 2024-03-12T16:35:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.860+0000 7f9a9cd93700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a8406caa0 0x7f9a8406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:35:06.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.861+0000 7f9a9cd93700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a8406caa0 0x7f9a8406ef60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f9a98109960 tx=0x7f9a8800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:35:06.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:06.865+0000 7f9a8e7fc700 1 -- 172.21.15.6:0/945084795 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9a9405ab70 con 0x7f9a980f88a0 2024-03-12T16:35:07.140 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.143+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f9a98047540 con 0x7f9a980f88a0 2024-03-12T16:35:07.141 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.144+0000 7f9a8e7fc700 1 -- 172.21.15.6:0/945084795 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f9a9405a700 con 0x7f9a980f88a0 2024-03-12T16:35:07.141 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:35:07.142 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:35:07.142 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:35:07.143 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:35:07.143 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:35:07.144 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:35:07.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:35:07.144 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:35:07.144 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:35:07.144 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:35:07.144 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:35:07.144 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:35:07.145 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:35:07.146 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:35:07.146 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:35:07.146 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:35:07.146 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:35:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a8406caa0 msgr2=0x7f9a8406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a8406caa0 0x7f9a8406ef60 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 rx=0x7f9a98109960 tx=0x7f9a8800b040).stop 2024-03-12T16:35:07.148 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 msgr2=0x7f9a9810e020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:35:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 0x7f9a9810e020 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 rx=0x7f9a94005010 tx=0x7f9a94009cb0).stop 2024-03-12T16:35:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 shutdown_connections 2024-03-12T16:35:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9a8406caa0 0x7f9a8406ef60 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9a980f88a0 0x7f9a9810e020 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 --2- 172.21.15.6:0/945084795 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9a980f9200 0x7f9a9810e510 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:35:07.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 >> 172.21.15.6:0/945084795 conn(0x7f9a98070590 msgr2=0x7f9a980fc110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:35:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 shutdown_connections 2024-03-12T16:35:07.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:35:07.146+0000 7f9a9f7f8700 1 -- 172.21.15.6:0/945084795 wait complete. 2024-03-12T16:35:07.806 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:07 smithi006 ceph-mon[103869]: pgmap v657: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 190 B/s wr, 6 op/s 2024-03-12T16:35:07.806 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:07 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/945084795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:35:07.831 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'echo "wait for servicemap items w/ changing names to refresh"' 2024-03-12T16:35:07.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:07 smithi134 ceph-mon[85099]: pgmap v657: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 16 MiB/s rd, 190 B/s wr, 6 op/s 2024-03-12T16:35:07.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:07 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/945084795' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:35:09.539 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:09 smithi006 ceph-mon[103869]: pgmap v658: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 381 B/s wr, 6 op/s 2024-03-12T16:35:09.769 INFO:teuthology.orchestra.run.smithi006.stdout:wait for servicemap items w/ changing names to refresh 2024-03-12T16:35:09.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:09 smithi134 ceph-mon[85099]: pgmap v658: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.1 MiB/s rd, 381 B/s wr, 6 op/s 2024-03-12T16:35:10.363 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'sleep 60' 2024-03-12T16:35:11.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:11 smithi134 ceph-mon[85099]: pgmap v659: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-03-12T16:35:11.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:11 smithi006 ceph-mon[103869]: pgmap v659: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 2.6 MiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-03-12T16:35:13.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:13 smithi134 ceph-mon[85099]: pgmap v660: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 756 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-03-12T16:35:13.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:13 smithi006 ceph-mon[103869]: pgmap v660: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 756 KiB/s rd, 4.8 KiB/s wr, 9 op/s 2024-03-12T16:35:15.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:15 smithi006 ceph-mon[103869]: pgmap v661: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.0 KiB/s rd, 9.4 KiB/s wr, 11 op/s 2024-03-12T16:35:16.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:15 smithi134 ceph-mon[85099]: pgmap v661: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 7.0 KiB/s rd, 9.4 KiB/s wr, 11 op/s 2024-03-12T16:35:18.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:17 smithi134 ceph-mon[85099]: pgmap v662: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 8.3 KiB/s wr, 9 op/s 2024-03-12T16:35:18.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:18.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:35:18.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:17 smithi006 ceph-mon[103869]: pgmap v662: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 6.2 KiB/s rd, 8.3 KiB/s wr, 9 op/s 2024-03-12T16:35:18.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:35:18.201 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:35:19.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:19 smithi134 ceph-mon[85099]: pgmap v663: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2024-03-12T16:35:19.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:19 smithi006 ceph-mon[103869]: pgmap v663: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.7 KiB/s rd, 8.2 KiB/s wr, 8 op/s 2024-03-12T16:35:21.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:21 smithi134 ceph-mon[85099]: pgmap v664: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2024-03-12T16:35:21.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:21 smithi006 ceph-mon[103869]: pgmap v664: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 1.7 KiB/s rd, 8.1 KiB/s wr, 5 op/s 2024-03-12T16:35:23.951 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:23 smithi006 ceph-mon[103869]: pgmap v665: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-03-12T16:35:24.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:23 smithi134 ceph-mon[85099]: pgmap v665: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-03-12T16:35:26.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:25 smithi134 ceph-mon[85099]: pgmap v666: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-03-12T16:35:26.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:25 smithi006 ceph-mon[103869]: pgmap v666: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail; 4.2 KiB/s wr, 1 op/s 2024-03-12T16:35:28.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:27 smithi134 ceph-mon[85099]: pgmap v667: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:28.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:27 smithi006 ceph-mon[103869]: pgmap v667: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:29.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:29 smithi134 ceph-mon[85099]: pgmap v668: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:29.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:29 smithi006 ceph-mon[103869]: pgmap v668: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:31.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:31 smithi006 ceph-mon[103869]: pgmap v669: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:32.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:31 smithi134 ceph-mon[85099]: pgmap v669: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:33.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:35:33.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:35:34.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:33 smithi134 ceph-mon[85099]: pgmap v670: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:34.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:33 smithi006 ceph-mon[103869]: pgmap v670: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:36.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:35 smithi134 ceph-mon[85099]: pgmap v671: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:36.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:35 smithi006 ceph-mon[103869]: pgmap v671: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:38.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:37 smithi134 ceph-mon[85099]: pgmap v672: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:38.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:37 smithi006 ceph-mon[103869]: pgmap v672: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:39.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:39 smithi134 ceph-mon[85099]: pgmap v673: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:39.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:39 smithi006 ceph-mon[103869]: pgmap v673: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:41.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:41 smithi006 ceph-mon[103869]: pgmap v674: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:42.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:41 smithi134 ceph-mon[85099]: pgmap v674: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:44.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:43 smithi134 ceph-mon[85099]: pgmap v675: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:44.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:43 smithi006 ceph-mon[103869]: pgmap v675: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:46.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:45 smithi134 ceph-mon[85099]: pgmap v676: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:46.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:45 smithi006 ceph-mon[103869]: pgmap v676: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:48.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:47 smithi134 ceph-mon[85099]: pgmap v677: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:48.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:35:48.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:47 smithi006 ceph-mon[103869]: pgmap v677: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:48.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:35:49.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:49 smithi134 ceph-mon[85099]: pgmap v678: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:49.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:49 smithi006 ceph-mon[103869]: pgmap v678: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:51 smithi134 ceph-mon[85099]: pgmap v679: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:52.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:51 smithi006 ceph-mon[103869]: pgmap v679: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:54.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:53 smithi134 ceph-mon[85099]: pgmap v680: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:54.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:53 smithi006 ceph-mon[103869]: pgmap v680: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:56.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:55 smithi134 ceph-mon[85099]: pgmap v681: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:56.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:55 smithi006 ceph-mon[103869]: pgmap v681: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:58.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:57 smithi134 ceph-mon[85099]: pgmap v682: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:58.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:57 smithi006 ceph-mon[103869]: pgmap v682: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:59.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:35:59 smithi134 ceph-mon[85099]: pgmap v683: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:35:59.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:35:59 smithi006 ceph-mon[103869]: pgmap v683: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:02.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:01 smithi134 ceph-mon[85099]: pgmap v684: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:02.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:01 smithi006 ceph-mon[103869]: pgmap v684: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:03.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:36:03.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:36:04.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:03 smithi134 ceph-mon[85099]: pgmap v685: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:04.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:03 smithi006 ceph-mon[103869]: pgmap v685: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:06.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:05 smithi134 ceph-mon[85099]: pgmap v686: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:06.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:05 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:36:06.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:05 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:36:06.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:05 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:36:06.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:05 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:36:06.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:05 smithi006 ceph-mon[103869]: pgmap v686: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:06.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:05 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:36:06.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:05 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:36:06.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:05 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:36:06.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:05 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:36:08.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:07 smithi134 ceph-mon[85099]: pgmap v687: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:08.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:07 smithi006 ceph-mon[103869]: pgmap v687: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:09.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:09 smithi134 ceph-mon[85099]: pgmap v688: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:09.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:09 smithi006 ceph-mon[103869]: pgmap v688: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:12.093 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:11 smithi006 ceph-mon[103869]: pgmap v689: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:12.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:11 smithi134 ceph-mon[85099]: pgmap v689: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:12.649 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph orch ps' 2024-03-12T16:36:13.997 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:13 smithi006 ceph-mon[103869]: pgmap v690: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:14.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:13 smithi134 ceph-mon[85099]: pgmap v690: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 -- 172.21.15.6:0/2989382594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fd8f0 msgr2=0x7f8cd80fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 --2- 172.21.15.6:0/2989382594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fd8f0 0x7f8cd80fdcd0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 rx=0x7f8cd40047f0 tx=0x7f8cd4009cb0).stop 2024-03-12T16:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 -- 172.21.15.6:0/2989382594 shutdown_connections 2024-03-12T16:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 --2- 172.21.15.6:0/2989382594 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd80fe250 0x7f8cd80f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 --2- 172.21.15.6:0/2989382594 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fd8f0 0x7f8cd80fdcd0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 -- 172.21.15.6:0/2989382594 >> 172.21.15.6:0/2989382594 conn(0x7f8cd80f34b0 msgr2=0x7f8cd80f58d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:14.505 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 -- 172.21.15.6:0/2989382594 shutdown_connections 2024-03-12T16:36:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 -- 172.21.15.6:0/2989382594 wait complete. 2024-03-12T16:36:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 Processor -- start 2024-03-12T16:36:14.506 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.508+0000 7f8cdfe72700 1 -- start start 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdfe72700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd80fd8f0 0x7f8cd810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdfe72700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fe250 0x7f8cd810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdfe72700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd810ead0 con 0x7f8cd80fe250 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdfe72700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8cd810ec10 con 0x7f8cd80fd8f0 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdd40d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fe250 0x7f8cd810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdd40d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fe250 0x7f8cd810e4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41296/0 (socket says 172.21.15.6:41296) 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdd40d700 1 -- 172.21.15.6:0/3963679078 learned_addr learned my addr 172.21.15.6:0/3963679078 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cddc0e700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd80fd8f0 0x7f8cd810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdd40d700 1 -- 172.21.15.6:0/3963679078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd80fd8f0 msgr2=0x7f8cd810dfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdd40d700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd80fd8f0 0x7f8cd810dfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdd40d700 1 -- 172.21.15.6:0/3963679078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8cd4005040 con 0x7f8cd80fe250 2024-03-12T16:36:14.507 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdd40d700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fe250 0x7f8cd810e4d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f8cc8002780 tx=0x7f8cc8009ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cceffd700 1 -- 172.21.15.6:0/3963679078 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc8007b40 con 0x7f8cd80fe250 2024-03-12T16:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cceffd700 1 -- 172.21.15.6:0/3963679078 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8cc800f040 con 0x7f8cd80fe250 2024-03-12T16:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.509+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8cd81082a0 con 0x7f8cd80fe250 2024-03-12T16:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.510+0000 7f8cceffd700 1 -- 172.21.15.6:0/3963679078 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8cc8014780 con 0x7f8cd80fe250 2024-03-12T16:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.510+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8cd8108860 con 0x7f8cd80fe250 2024-03-12T16:36:14.508 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.510+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8cd805f590 con 0x7f8cd80fe250 2024-03-12T16:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.511+0000 7f8cceffd700 1 -- 172.21.15.6:0/3963679078 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8cc8007ca0 con 0x7f8cd80fe250 2024-03-12T16:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.511+0000 7f8cceffd700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8cc406caa0 0x7f8cc406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.512+0000 7f8cceffd700 1 -- 172.21.15.6:0/3963679078 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8cc808bd20 con 0x7f8cd80fe250 2024-03-12T16:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.512+0000 7f8cddc0e700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8cc406caa0 0x7f8cc406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:14.509 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.512+0000 7f8cddc0e700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8cc406caa0 0x7f8cc406ef60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f8cd4004f10 tx=0x7f8cd400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:14.510 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.516+0000 7f8cceffd700 1 -- 172.21.15.6:0/3963679078 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8cc8059880 con 0x7f8cd80fe250 2024-03-12T16:36:14.721 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.726+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 --> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] -- mgr_command(tid 0: {"prefix": "orch ps", "target": ["mon-mgr", ""]}) v1 -- 0x7f8cd8108ae0 con 0x7f8cc406caa0 2024-03-12T16:36:14.730 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.736+0000 7f8cceffd700 1 -- 172.21.15.6:0/3963679078 <== mgr.34104 v2:172.21.15.6:6800/2635749422 1 ==== mgr_command_reply(tid 0: 0 ) v1 ==== 8+0+3476 (secure 0 0 0) 0x7f8cd8108ae0 con 0x7f8cc406caa0 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:alertmanager.smithi006 smithi006 *:9093,9094 running (23m) 70s ago 34m 26.5M - 0.25.0 c8568f914cd2 ae8e46bcf1fd 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi006 smithi006 running (20m) 70s ago 34m 6656k - 18.2.2-797-g49e4a679 72a574b3d6f5 1478b59be6fe 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:crash.smithi134 smithi134 running (20m) 78s ago 33m 6647k - 18.2.2-797-g49e4a679 72a574b3d6f5 13c8883e9b83 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:grafana.smithi006 smithi006 *:3000 running (22m) 70s ago 33m 89.2M - 9.4.7 954c08fa6188 d01998a8dd84 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ncuwuc smithi006 running (17m) 70s ago 28m 105M - 18.2.2-797-g49e4a679 72a574b3d6f5 4fc31eeab4bc 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi006.ufmcfu smithi006 running (16m) 70s ago 28m 124M - 18.2.2-797-g49e4a679 72a574b3d6f5 9e37369088e3 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.jqydtn smithi134 running (16m) 78s ago 28m 17.8M - 18.2.2-797-g49e4a679 72a574b3d6f5 63930b3fc74a 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:mds.cephfs.smithi134.ufgvbd smithi134 running (16m) 78s ago 28m 17.7M - 18.2.2-797-g49e4a679 72a574b3d6f5 5828c03efcaa 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi006.kskdce smithi006 *:8443,9283,8765 running (24m) 70s ago 35m 509M - 18.2.2-797-g49e4a679 72a574b3d6f5 25cd4c273d38 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:mgr.smithi134.gcntfu smithi134 *:8443,9283,8765 running (23m) 78s ago 33m 456M - 18.2.2-797-g49e4a679 72a574b3d6f5 f08143da6682 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi006 smithi006 running (21m) 70s ago 35m 87.7M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 34464f865bf1 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:mon.smithi134 smithi134 running (21m) 78s ago 33m 51.3M 2048M 18.2.2-797-g49e4a679 72a574b3d6f5 7600006320db 2024-03-12T16:36:14.731 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi006 smithi006 *:9100 running (23m) 70s ago 33m 17.8M - 1.5.0 0da6a335fe13 a3d10c2a3156 2024-03-12T16:36:14.732 INFO:teuthology.orchestra.run.smithi006.stdout:node-exporter.smithi134 smithi134 *:9100 running (23m) 78s ago 32m 18.4M - 1.5.0 0da6a335fe13 c90bcf6d55cc 2024-03-12T16:36:14.732 INFO:teuthology.orchestra.run.smithi006.stdout:osd.0 smithi006 running (20m) 70s ago 32m 100M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 36b3cfcba127 2024-03-12T16:36:14.732 INFO:teuthology.orchestra.run.smithi006.stdout:osd.1 smithi006 running (19m) 70s ago 32m 107M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 f9ceda6861e6 2024-03-12T16:36:14.732 INFO:teuthology.orchestra.run.smithi006.stdout:osd.2 smithi006 running (19m) 70s ago 31m 94.5M 1911M 18.2.2-797-g49e4a679 72a574b3d6f5 5acba1c83685 2024-03-12T16:36:14.732 INFO:teuthology.orchestra.run.smithi006.stdout:osd.3 smithi134 running (18m) 78s ago 31m 135M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 705cb952fee4 2024-03-12T16:36:14.732 INFO:teuthology.orchestra.run.smithi006.stdout:osd.4 smithi134 running (18m) 78s ago 30m 99.9M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 f7bee1f20e9a 2024-03-12T16:36:14.732 INFO:teuthology.orchestra.run.smithi006.stdout:osd.5 smithi134 running (17m) 78s ago 30m 99.6M 2251M 18.2.2-797-g49e4a679 72a574b3d6f5 7eeb27fa1187 2024-03-12T16:36:14.732 INFO:teuthology.orchestra.run.smithi006.stdout:prometheus.smithi134 smithi134 *:9095 running (23m) 78s ago 32m 79.8M - 2.43.0 a07b618ecd1d 4f74986af0a3 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.738+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8cc406caa0 msgr2=0x7f8cc406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.738+0000 7f8cdfe72700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8cc406caa0 0x7f8cc406ef60 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 rx=0x7f8cd4004f10 tx=0x7f8cd400b040).stop 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.738+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fe250 msgr2=0x7f8cd810e4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.738+0000 7f8cdfe72700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fe250 0x7f8cd810e4d0 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 rx=0x7f8cc8002780 tx=0x7f8cc8009ee0).stop 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.738+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 shutdown_connections 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.738+0000 7f8cdfe72700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8cd80fd8f0 0x7f8cd810dfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.738+0000 7f8cdfe72700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8cc406caa0 0x7f8cc406ef60 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.738+0000 7f8cdfe72700 1 --2- 172.21.15.6:0/3963679078 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8cd80fe250 0x7f8cd810e4d0 unknown :-1 s=CLOSED pgs=576 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.738+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 >> 172.21.15.6:0/3963679078 conn(0x7f8cd80f34b0 msgr2=0x7f8cd80fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.739+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 shutdown_connections 2024-03-12T16:36:14.733 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:14.739+0000 7f8cdfe72700 1 -- 172.21.15.6:0/3963679078 wait complete. 2024-03-12T16:36:15.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph versions' 2024-03-12T16:36:16.010 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:15 smithi006 ceph-mon[103869]: pgmap v691: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:16.010 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:15 smithi006 ceph-mon[103869]: from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:36:16.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:15 smithi134 ceph-mon[85099]: pgmap v691: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:16.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:15 smithi134 ceph-mon[85099]: from='client.35220 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-03-12T16:36:17.130 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.136+0000 7f6beb9da700 1 -- 172.21.15.6:0/2193629118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fe230 msgr2=0x7f6be40f5fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.136+0000 7f6beb9da700 1 --2- 172.21.15.6:0/2193629118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fe230 0x7f6be40f5fa0 secure :-1 s=READY pgs=577 cs=0 l=1 rev1=1 rx=0x7f6bd40047f0 tx=0x7f6bd4009cb0).stop 2024-03-12T16:36:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.136+0000 7f6beb9da700 1 -- 172.21.15.6:0/2193629118 shutdown_connections 2024-03-12T16:36:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.136+0000 7f6beb9da700 1 --2- 172.21.15.6:0/2193629118 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fe230 0x7f6be40f5fa0 unknown :-1 s=CLOSED pgs=577 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.136+0000 7f6beb9da700 1 --2- 172.21.15.6:0/2193629118 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be40fd8d0 0x7f6be40fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.136+0000 7f6beb9da700 1 -- 172.21.15.6:0/2193629118 >> 172.21.15.6:0/2193629118 conn(0x7f6be406ce40 msgr2=0x7f6be406d250 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.136+0000 7f6beb9da700 1 -- 172.21.15.6:0/2193629118 shutdown_connections 2024-03-12T16:36:17.131 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.136+0000 7f6beb9da700 1 -- 172.21.15.6:0/2193629118 wait complete. 2024-03-12T16:36:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.137+0000 7f6beb9da700 1 Processor -- start 2024-03-12T16:36:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.137+0000 7f6beb9da700 1 -- start start 2024-03-12T16:36:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.137+0000 7f6beb9da700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fd8d0 0x7f6be410e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.137+0000 7f6beb9da700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be40fe230 0x7f6be410e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.137+0000 7f6beb9da700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be410eb20 con 0x7f6be40fd8d0 2024-03-12T16:36:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.137+0000 7f6beb9da700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6be410ec60 con 0x7f6be40fe230 2024-03-12T16:36:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.137+0000 7f6be9776700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fd8d0 0x7f6be410e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.137+0000 7f6be9776700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fd8d0 0x7f6be410e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41320/0 (socket says 172.21.15.6:41320) 2024-03-12T16:36:17.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.137+0000 7f6be9776700 1 -- 172.21.15.6:0/2514999748 learned_addr learned my addr 172.21.15.6:0/2514999748 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6be8f75700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be40fe230 0x7f6be410e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6be9776700 1 -- 172.21.15.6:0/2514999748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be40fe230 msgr2=0x7f6be410e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6be9776700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be40fe230 0x7f6be410e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6be9776700 1 -- 172.21.15.6:0/2514999748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6bd4005040 con 0x7f6be40fd8d0 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6be8f75700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be40fe230 0x7f6be410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6be9776700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fd8d0 0x7f6be410e030 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f6be00041d0 tx=0x7f6be0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6bda7fc700 1 -- 172.21.15.6:0/2514999748 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be0002d90 con 0x7f6be40fd8d0 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6bda7fc700 1 -- 172.21.15.6:0/2514999748 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6be000f040 con 0x7f6be40fd8d0 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6bda7fc700 1 -- 172.21.15.6:0/2514999748 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6be000d800 con 0x7f6be40fd8d0 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6be41082f0 con 0x7f6be40fd8d0 2024-03-12T16:36:17.134 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.138+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6be4108830 con 0x7f6be40fd8d0 2024-03-12T16:36:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.139+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6be405f090 con 0x7f6be40fd8d0 2024-03-12T16:36:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.140+0000 7f6bda7fc700 1 -- 172.21.15.6:0/2514999748 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f6be000dac0 con 0x7f6be40fd8d0 2024-03-12T16:36:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.140+0000 7f6bda7fc700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6bd006caa0 0x7f6bd006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:17.135 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.140+0000 7f6bda7fc700 1 -- 172.21.15.6:0/2514999748 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6be008bde0 con 0x7f6be40fd8d0 2024-03-12T16:36:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.140+0000 7f6be8f75700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6bd006caa0 0x7f6bd006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:17.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.140+0000 7f6be8f75700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6bd006caa0 0x7f6bd006ef60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f6bd4004540 tx=0x7f6bd400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:17.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.145+0000 7f6bda7fc700 1 -- 172.21.15.6:0/2514999748 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6be0059940 con 0x7f6be40fd8d0 2024-03-12T16:36:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.425+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7f6be41097c0 con 0x7f6be40fd8d0 2024-03-12T16:36:17.419 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.425+0000 7f6bda7fc700 1 -- 172.21.15.6:0/2514999748 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7f6be00594d0 con 0x7f6be40fd8d0 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout:{ 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "mon": { 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "mgr": { 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 2 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "osd": { 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 6 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "mds": { 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 4 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: }, 2024-03-12T16:36:17.420 INFO:teuthology.orchestra.run.smithi006.stdout: "overall": { 2024-03-12T16:36:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)": 14 2024-03-12T16:36:17.421 INFO:teuthology.orchestra.run.smithi006.stdout: } 2024-03-12T16:36:17.421 INFO:teuthology.orchestra.run.smithi006.stdout:} 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6bd006caa0 msgr2=0x7f6bd006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6bd006caa0 0x7f6bd006ef60 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 rx=0x7f6bd4004540 tx=0x7f6bd400b040).stop 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fd8d0 msgr2=0x7f6be410e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fd8d0 0x7f6be410e030 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 rx=0x7f6be00041d0 tx=0x7f6be0009f60).stop 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 shutdown_connections 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6bd006caa0 0x7f6bd006ef60 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6be40fd8d0 0x7f6be410e030 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 --2- 172.21.15.6:0/2514999748 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6be40fe230 0x7f6be410e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 >> 172.21.15.6:0/2514999748 conn(0x7f6be406ce40 msgr2=0x7f6be4100f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 shutdown_connections 2024-03-12T16:36:17.422 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:17.427+0000 7f6beb9da700 1 -- 172.21.15.6:0/2514999748 wait complete. 2024-03-12T16:36:18.051 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:17 smithi006 ceph-mon[103869]: pgmap v692: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:18.051 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:36:18.051 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:17 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2514999748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:36:18.074 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 1'"'"'' 2024-03-12T16:36:18.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:17 smithi134 ceph-mon[85099]: pgmap v692: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:18.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:36:18.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:17 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2514999748' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:36:19.725 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:19 smithi006 ceph-mon[103869]: pgmap v693: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:19.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:19 smithi134 ceph-mon[85099]: pgmap v693: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.961+0000 7fdce7d0e700 1 -- 172.21.15.6:0/2354791888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f8900 msgr2=0x7fdce00f8ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.961+0000 7fdce7d0e700 1 --2- 172.21.15.6:0/2354791888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f8900 0x7fdce00f8ce0 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 rx=0x7fdcdc0047f0 tx=0x7fdcdc009cb0).stop 2024-03-12T16:36:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 -- 172.21.15.6:0/2354791888 shutdown_connections 2024-03-12T16:36:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 --2- 172.21.15.6:0/2354791888 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce00f9260 0x7fdce0101970 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 --2- 172.21.15.6:0/2354791888 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f8900 0x7fdce00f8ce0 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 -- 172.21.15.6:0/2354791888 >> 172.21.15.6:0/2354791888 conn(0x7fdce0070590 msgr2=0x7fdce00f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 -- 172.21.15.6:0/2354791888 shutdown_connections 2024-03-12T16:36:19.956 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 -- 172.21.15.6:0/2354791888 wait complete. 2024-03-12T16:36:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 Processor -- start 2024-03-12T16:36:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 -- start start 2024-03-12T16:36:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce00f8900 0x7fdce010e040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.962+0000 7fdce7d0e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f9260 0x7fdce010e530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce7d0e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce010eb30 con 0x7fdce00f9260 2024-03-12T16:36:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce7d0e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fdce010ec70 con 0x7fdce00f8900 2024-03-12T16:36:19.958 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce52a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f9260 0x7fdce010e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce52a9700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f9260 0x7fdce010e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:41328/0 (socket says 172.21.15.6:41328) 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce52a9700 1 -- 172.21.15.6:0/3556267479 learned_addr learned my addr 172.21.15.6:0/3556267479 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce5aaa700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce00f8900 0x7fdce010e040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce52a9700 1 -- 172.21.15.6:0/3556267479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce00f8900 msgr2=0x7fdce010e040 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce52a9700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce00f8900 0x7fdce010e040 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce52a9700 1 -- 172.21.15.6:0/3556267479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fdcdc005040 con 0x7fdce00f9260 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce52a9700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f9260 0x7fdce010e530 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fdcd00041d0 tx=0x7fdcd0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdcd6ffd700 1 -- 172.21.15.6:0/3556267479 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcd0007b40 con 0x7fdce00f9260 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdcd6ffd700 1 -- 172.21.15.6:0/3556267479 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fdcd000f040 con 0x7fdce00f9260 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdcd6ffd700 1 -- 172.21.15.6:0/3556267479 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fdcd00147b0 con 0x7fdce00f9260 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fdce0108300 con 0x7fdce00f9260 2024-03-12T16:36:19.959 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.963+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fdce0108840 con 0x7fdce00f9260 2024-03-12T16:36:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.964+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fdce005f590 con 0x7fdce00f9260 2024-03-12T16:36:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.965+0000 7fdcd6ffd700 1 -- 172.21.15.6:0/3556267479 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fdcd0009110 con 0x7fdce00f9260 2024-03-12T16:36:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.965+0000 7fdcd6ffd700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdccc06caa0 0x7fdccc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.965+0000 7fdcd6ffd700 1 -- 172.21.15.6:0/3556267479 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fdcd008bcf0 con 0x7fdce00f9260 2024-03-12T16:36:19.960 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.965+0000 7fdce5aaa700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdccc06caa0 0x7fdccc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:19.961 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.966+0000 7fdce5aaa700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdccc06caa0 0x7fdccc06ef60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fdcdc009ee0 tx=0x7fdcdc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:19.964 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:19.970+0000 7fdcd6ffd700 1 -- 172.21.15.6:0/3556267479 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fdcd0059850 con 0x7fdce00f9260 2024-03-12T16:36:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.252+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fdce00feeb0 con 0x7fdce00f9260 2024-03-12T16:36:20.246 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.252+0000 7fdcd6ffd700 1 -- 172.21.15.6:0/3556267479 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fdcd00593e0 con 0x7fdce00f9260 2024-03-12T16:36:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdccc06caa0 msgr2=0x7fdccc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdccc06caa0 0x7fdccc06ef60 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 rx=0x7fdcdc009ee0 tx=0x7fdcdc00b040).stop 2024-03-12T16:36:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f9260 msgr2=0x7fdce010e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f9260 0x7fdce010e530 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 rx=0x7fdcd00041d0 tx=0x7fdcd0009f60).stop 2024-03-12T16:36:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 shutdown_connections 2024-03-12T16:36:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fdce00f8900 0x7fdce010e040 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fdccc06caa0 0x7fdccc06ef60 unknown :-1 s=CLOSED pgs=311 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 --2- 172.21.15.6:0/3556267479 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fdce00f9260 0x7fdce010e530 unknown :-1 s=CLOSED pgs=580 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:20.249 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 >> 172.21.15.6:0/3556267479 conn(0x7fdce0070590 msgr2=0x7fdce00fc1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 shutdown_connections 2024-03-12T16:36:20.250 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:20.255+0000 7fdce7d0e700 1 -- 172.21.15.6:0/3556267479 wait complete. 2024-03-12T16:36:20.259 INFO:teuthology.orchestra.run.smithi006.stdout:true 2024-03-12T16:36:20.600 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:20 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3556267479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:36:20.912 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -e sha1=49e4a6794d5502bd66908faf714fc54896c51712 -- bash -c 'ceph versions | jq -e '"'"'.overall | keys'"'"' | grep $sha1' 2024-03-12T16:36:20.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:20 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3556267479' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:36:21.635 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:21 smithi006 ceph-mon[103869]: pgmap v694: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:21.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:21 smithi134 ceph-mon[85099]: pgmap v694: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.860+0000 7fa491406700 1 -- 172.21.15.6:0/2164992721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fd150 msgr2=0x7fa48c0f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.860+0000 7fa491406700 1 --2- 172.21.15.6:0/2164992721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fd150 0x7fa48c0f6930 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 rx=0x7fa4800047f0 tx=0x7fa480009cb0).stop 2024-03-12T16:36:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.860+0000 7fa491406700 1 -- 172.21.15.6:0/2164992721 shutdown_connections 2024-03-12T16:36:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.860+0000 7fa491406700 1 --2- 172.21.15.6:0/2164992721 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fd150 0x7fa48c0f6930 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.860+0000 7fa491406700 1 --2- 172.21.15.6:0/2164992721 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa48c0fc7f0 0x7fa48c0fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:22.856 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.860+0000 7fa491406700 1 -- 172.21.15.6:0/2164992721 >> 172.21.15.6:0/2164992721 conn(0x7fa48c070590 msgr2=0x7fa48c0f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.860+0000 7fa491406700 1 -- 172.21.15.6:0/2164992721 shutdown_connections 2024-03-12T16:36:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.860+0000 7fa491406700 1 -- 172.21.15.6:0/2164992721 wait complete. 2024-03-12T16:36:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.861+0000 7fa491406700 1 Processor -- start 2024-03-12T16:36:22.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.861+0000 7fa491406700 1 -- start start 2024-03-12T16:36:22.858 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.861+0000 7fa491406700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fc7f0 0x7fa48c1101d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.861+0000 7fa491406700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa48c0fd150 0x7fa48c1106c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.861+0000 7fa491406700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c110cc0 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.861+0000 7fa491406700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fa48c110e00 con 0x7fa48c0fd150 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.861+0000 7fa48affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fc7f0 0x7fa48c1101d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.861+0000 7fa48affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fc7f0 0x7fa48c1101d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40500/0 (socket says 172.21.15.6:40500) 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.861+0000 7fa48affd700 1 -- 172.21.15.6:0/2506171070 learned_addr learned my addr 172.21.15.6:0/2506171070 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa48a7fc700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa48c0fd150 0x7fa48c1106c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa48affd700 1 -- 172.21.15.6:0/2506171070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa48c0fd150 msgr2=0x7fa48c1106c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa48affd700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa48c0fd150 0x7fa48c1106c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa48affd700 1 -- 172.21.15.6:0/2506171070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fa480005040 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa48a7fc700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa48c0fd150 0x7fa48c1106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa48affd700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fc7f0 0x7fa48c1101d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fa47c00c740 tx=0x7fa47c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa473fff700 1 -- 172.21.15.6:0/2506171070 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47c00e680 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.859 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa473fff700 1 -- 172.21.15.6:0/2506171070 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fa47c00ec90 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa473fff700 1 -- 172.21.15.6:0/2506171070 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fa47c013d60 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fa48c10a490 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.862+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fa48c10aa50 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.863+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fa48c05f590 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.863+0000 7fa473fff700 1 -- 172.21.15.6:0/2506171070 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fa47c00e7e0 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.864+0000 7fa473fff700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa47406caa0 0x7fa47406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:22.860 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.864+0000 7fa473fff700 1 -- 172.21.15.6:0/2506171070 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fa47c08c040 con 0x7fa48c0fc7f0 2024-03-12T16:36:22.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.864+0000 7fa48a7fc700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa47406caa0 0x7fa47406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:22.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.864+0000 7fa48a7fc700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa47406caa0 0x7fa47406ef60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fa4800043d0 tx=0x7fa48000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:22.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:22.869+0000 7fa473fff700 1 -- 172.21.15.6:0/2506171070 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fa47c059ba0 con 0x7fa48c0fc7f0 2024-03-12T16:36:23.146 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.151+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "versions"} v 0) v1 -- 0x7fa48c047540 con 0x7fa48c0fc7f0 2024-03-12T16:36:23.147 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.151+0000 7fa473fff700 1 -- 172.21.15.6:0/2506171070 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "versions"}]=0 v0) v1 ==== 56+0+628 (secure 0 0 0) 0x7fa47c059730 con 0x7fa48c0fc7f0 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.153+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa47406caa0 msgr2=0x7fa47406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.153+0000 7fa491406700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa47406caa0 0x7fa47406ef60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 rx=0x7fa4800043d0 tx=0x7fa48000b040).stop 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.153+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fc7f0 msgr2=0x7fa48c1101d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.153+0000 7fa491406700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fc7f0 0x7fa48c1101d0 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 rx=0x7fa47c00c740 tx=0x7fa47c007ef0).stop 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.154+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 shutdown_connections 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.154+0000 7fa491406700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fa47406caa0 0x7fa47406ef60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.154+0000 7fa491406700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fa48c0fc7f0 0x7fa48c1101d0 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.154+0000 7fa491406700 1 --2- 172.21.15.6:0/2506171070 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fa48c0fd150 0x7fa48c1106c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.154+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 >> 172.21.15.6:0/2506171070 conn(0x7fa48c070590 msgr2=0x7fa48c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:23.149 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.154+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 shutdown_connections 2024-03-12T16:36:23.150 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:23.154+0000 7fa491406700 1 -- 172.21.15.6:0/2506171070 wait complete. 2024-03-12T16:36:23.159 INFO:teuthology.orchestra.run.smithi006.stdout: "ceph version 18.2.2-797-g49e4a679 (49e4a6794d5502bd66908faf714fc54896c51712) reef (stable)" 2024-03-12T16:36:23.807 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:23 smithi006 ceph-mon[103869]: pgmap v695: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:23.807 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:23 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2506171070' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:36:23.831 DEBUG:teuthology.parallel:result is None 2024-03-12T16:36:23.831 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-03-12T16:36:23.843 INFO:tasks.cephadm:Running commands on role host.a host ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:36:23.844 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm --image quay.ceph.io/ceph-ci/ceph:pacific shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 -- bash -c 'ceph fs dump' 2024-03-12T16:36:24.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:23 smithi134 ceph-mon[85099]: pgmap v695: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:24.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:23 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2506171070' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.813+0000 7f3aee788700 1 -- 172.21.15.6:0/73405621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fd150 msgr2=0x7f3ae80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.813+0000 7f3aee788700 1 --2- 172.21.15.6:0/73405621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fd150 0x7f3ae80f6930 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 rx=0x7f3adc0047f0 tx=0x7f3adc009cb0).stop 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.813+0000 7f3aee788700 1 -- 172.21.15.6:0/73405621 shutdown_connections 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.813+0000 7f3aee788700 1 --2- 172.21.15.6:0/73405621 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fd150 0x7f3ae80f6930 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.813+0000 7f3aee788700 1 --2- 172.21.15.6:0/73405621 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80fc7f0 0x7f3ae80fcbd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.813+0000 7f3aee788700 1 -- 172.21.15.6:0/73405621 >> 172.21.15.6:0/73405621 conn(0x7f3ae8070590 msgr2=0x7f3ae80f4880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.813+0000 7f3aee788700 1 -- 172.21.15.6:0/73405621 shutdown_connections 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.813+0000 7f3aee788700 1 -- 172.21.15.6:0/73405621 wait complete. 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.814+0000 7f3aee788700 1 Processor -- start 2024-03-12T16:36:25.812 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.814+0000 7f3aee788700 1 -- start start 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.814+0000 7f3aee788700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fc7f0 0x7f3ae810dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.814+0000 7f3aee788700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80fd150 0x7f3ae810e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.814+0000 7f3aee788700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae810eab0 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.814+0000 7f3aee788700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f3ae810ebf0 con 0x7f3ae80fd150 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fc7f0 0x7f3ae810dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae7fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fc7f0 0x7f3ae810dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40516/0 (socket says 172.21.15.6:40516) 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae7fff700 1 -- 172.21.15.6:0/3118046169 learned_addr learned my addr 172.21.15.6:0/3118046169 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae77fe700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80fd150 0x7f3ae810e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae7fff700 1 -- 172.21.15.6:0/3118046169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80fd150 msgr2=0x7f3ae810e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae7fff700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80fd150 0x7f3ae810e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae7fff700 1 -- 172.21.15.6:0/3118046169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f3adc005040 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae7fff700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fc7f0 0x7f3ae810dfc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f3ad80041d0 tx=0x7f3ad8009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae57fa700 1 -- 172.21.15.6:0/3118046169 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad8002d90 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.813 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f3ae8108280 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae57fa700 1 -- 172.21.15.6:0/3118046169 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f3ad800f040 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3ae57fa700 1 -- 172.21.15.6:0/3118046169 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f3ad800d800 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.815+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f3ae8108840 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.816+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f3ae805f590 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.814 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.817+0000 7f3ae57fa700 1 -- 172.21.15.6:0/3118046169 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f3ad800dae0 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.817+0000 7f3ae57fa700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3ad006cab0 0x7f3ad006ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.817+0000 7f3ae57fa700 1 -- 172.21.15.6:0/3118046169 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f3ad808bdc0 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.817+0000 7f3ae77fe700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3ad006cab0 0x7f3ad006ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:25.815 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.818+0000 7f3ae77fe700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3ad006cab0 0x7f3ad006ef70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f3ae8109900 tx=0x7f3adc009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:25.817 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:25.822+0000 7f3ae57fa700 1 -- 172.21.15.6:0/3118046169 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f3ad8059920 con 0x7f3ae80fc7f0 2024-03-12T16:36:25.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:25 smithi006 ceph-mon[103869]: pgmap v696: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:26.060 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.065+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump"} v 0) v1 -- 0x7f3ae8047540 con 0x7f3ae80fc7f0 2024-03-12T16:36:26.061 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.066+0000 7f3ae57fa700 1 -- 172.21.15.6:0/3118046169 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump"}]=0 dumped fsmap epoch 33 v33) v1 ==== 76+0+1854 (secure 0 0 0) 0x7f3ad80594b0 con 0x7f3ae80fc7f0 2024-03-12T16:36:26.061 INFO:teuthology.orchestra.run.smithi006.stdout:e33 2024-03-12T16:36:26.061 INFO:teuthology.orchestra.run.smithi006.stdout:enable_multiple, ever_enabled_multiple: 1,1 2024-03-12T16:36:26.061 INFO:teuthology.orchestra.run.smithi006.stdout:default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:36:26.061 INFO:teuthology.orchestra.run.smithi006.stdout:legacy client fscid: 1 2024-03-12T16:36:26.061 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:26.061 INFO:teuthology.orchestra.run.smithi006.stdout:Filesystem 'cephfs' (1) 2024-03-12T16:36:26.061 INFO:teuthology.orchestra.run.smithi006.stdout:fs_name cephfs 2024-03-12T16:36:26.061 INFO:teuthology.orchestra.run.smithi006.stdout:epoch 33 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:flags 12 joinable allow_snaps allow_multimds_snaps 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:created 2024-03-12T16:07:21.259716+0000 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:modified 2024-03-12T16:35:04.674097+0000 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:tableserver 0 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:root 0 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:session_timeout 60 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:session_autoclose 300 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:max_file_size 1099511627776 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:max_xattr_size 65536 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:required_client_features {} 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure 0 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:last_failure_osd_epoch 78 2024-03-12T16:36:26.062 INFO:teuthology.orchestra.run.smithi006.stdout:compat compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,7=mds uses inline data,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:max_mds 2 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:in 0,1 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:up {0=34378,1=34410} 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:failed 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:damaged 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:stopped 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:data_pools [3] 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:metadata_pool 2 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:inline_data disabled 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:balancer 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:bal_rank_mask -1 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:standby_count_wanted 1 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ncuwuc{0:34378} state up:active seq 244 join_fscid=1 addr [v2:172.21.15.6:6826/3791215151,v1:172.21.15.6:6827/3791215151] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:36:26.063 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi006.ufmcfu{1:34410} state up:active seq 239 join_fscid=1 addr [v2:172.21.15.6:6828/1788108531,v1:172.21.15.6:6829/1788108531] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:36:26.064 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:26.064 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:26.064 INFO:teuthology.orchestra.run.smithi006.stdout:Standby daemons: 2024-03-12T16:36:26.064 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:26.064 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.jqydtn{-1:44313} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6824/478277334,v1:172.21.15.134:6825/478277334] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:36:26.064 INFO:teuthology.orchestra.run.smithi006.stdout:[mds.cephfs.smithi134.ufgvbd{-1:44343} state up:standby seq 1 join_fscid=1 addr [v2:172.21.15.134:6826/665910356,v1:172.21.15.134:6827/665910356] compat {c=[1],r=[1],i=[7ff]}] 2024-03-12T16:36:26.064 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.067+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3ad006cab0 msgr2=0x7f3ad006ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.067+0000 7f3aee788700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3ad006cab0 0x7f3ad006ef70 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 rx=0x7f3ae8109900 tx=0x7f3adc009cb0).stop 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.067+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fc7f0 msgr2=0x7f3ae810dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.067+0000 7f3aee788700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fc7f0 0x7f3ae810dfc0 secure :-1 s=READY pgs=584 cs=0 l=1 rev1=1 rx=0x7f3ad80041d0 tx=0x7f3ad8009f60).stop 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.068+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 shutdown_connections 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.068+0000 7f3aee788700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f3ad006cab0 0x7f3ad006ef70 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.068+0000 7f3aee788700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f3ae80fc7f0 0x7f3ae810dfc0 unknown :-1 s=CLOSED pgs=584 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.068+0000 7f3aee788700 1 --2- 172.21.15.6:0/3118046169 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f3ae80fd150 0x7f3ae810e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.068+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 >> 172.21.15.6:0/3118046169 conn(0x7f3ae8070590 msgr2=0x7f3ae8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.068+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 shutdown_connections 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.068+0000 7f3aee788700 1 -- 172.21.15.6:0/3118046169 wait complete. 2024-03-12T16:36:26.065 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 33 2024-03-12T16:36:26.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:25 smithi134 ceph-mon[85099]: pgmap v696: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:26.721 INFO:teuthology.run_tasks:Running task fs.post_upgrade_checks... 2024-03-12T16:36:26.733 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T16:36:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.865+0000 7f9c36576700 1 -- 172.21.15.6:0/1388560363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 msgr2=0x7f9c300fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.865+0000 7f9c36576700 1 --2- 172.21.15.6:0/1388560363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 0x7f9c300fcb10 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 rx=0x7f9c200047f0 tx=0x7f9c20009cb0).stop 2024-03-12T16:36:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.865+0000 7f9c36576700 1 -- 172.21.15.6:0/1388560363 shutdown_connections 2024-03-12T16:36:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.865+0000 7f9c36576700 1 --2- 172.21.15.6:0/1388560363 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300fd090 0x7f9c300f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.865+0000 7f9c36576700 1 --2- 172.21.15.6:0/1388560363 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 0x7f9c300fcb10 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.865+0000 7f9c36576700 1 -- 172.21.15.6:0/1388560363 >> 172.21.15.6:0/1388560363 conn(0x7f9c3006c760 msgr2=0x7f9c3006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.865+0000 7f9c36576700 1 -- 172.21.15.6:0/1388560363 shutdown_connections 2024-03-12T16:36:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.865+0000 7f9c36576700 1 -- 172.21.15.6:0/1388560363 wait complete. 2024-03-12T16:36:26.861 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.866+0000 7f9c36576700 1 Processor -- start 2024-03-12T16:36:26.862 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.866+0000 7f9c36576700 1 -- start start 2024-03-12T16:36:26.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.866+0000 7f9c36576700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 0x7f9c3010dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:26.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.866+0000 7f9c36576700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300fd090 0x7f9c3010e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:26.863 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.866+0000 7f9c36576700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3010e9d0 con 0x7f9c300fc730 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.866+0000 7f9c36576700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f9c3010eb10 con 0x7f9c300fd090 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.866+0000 7f9c2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 0x7f9c3010dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.866+0000 7f9c2ffff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 0x7f9c3010dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40536/0 (socket says 172.21.15.6:40536) 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.866+0000 7f9c2ffff700 1 -- 172.21.15.6:0/392195029 learned_addr learned my addr 172.21.15.6:0/392195029 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c2f7fe700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300fd090 0x7f9c3010e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c2ffff700 1 -- 172.21.15.6:0/392195029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300fd090 msgr2=0x7f9c3010e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c2ffff700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300fd090 0x7f9c3010e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c2ffff700 1 -- 172.21.15.6:0/392195029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f9c20005040 con 0x7f9c300fc730 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c2ffff700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 0x7f9c3010dee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f9c20005010 tx=0x7f9c20009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c2d7fa700 1 -- 172.21.15.6:0/392195029 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c2000e030 con 0x7f9c300fc730 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c2d7fa700 1 -- 172.21.15.6:0/392195029 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f9c20007e90 con 0x7f9c300fc730 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f9c30108140 con 0x7f9c300fc730 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c2d7fa700 1 -- 172.21.15.6:0/392195029 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f9c20018070 con 0x7f9c300fc730 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.867+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f9c30108620 con 0x7f9c300fc730 2024-03-12T16:36:26.864 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.868+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f9c3005f380 con 0x7f9c300fc730 2024-03-12T16:36:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.868+0000 7f9c2d7fa700 1 -- 172.21.15.6:0/392195029 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f9c2001d6e0 con 0x7f9c300fc730 2024-03-12T16:36:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.869+0000 7f9c2d7fa700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c1806ca30 0x7f9c1806eef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.869+0000 7f9c2d7fa700 1 -- 172.21.15.6:0/392195029 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f9c2008d040 con 0x7f9c300fc730 2024-03-12T16:36:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.869+0000 7f9c2f7fe700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c1806ca30 0x7f9c1806eef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:26.865 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.869+0000 7f9c2f7fe700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c1806ca30 0x7f9c1806eef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f9c30109820 tx=0x7f9c24009de0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:26.868 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:26.873+0000 7f9c2d7fa700 1 -- 172.21.15.6:0/392195029 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f9c2005a910 con 0x7f9c300fc730 2024-03-12T16:36:26.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:26 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3118046169' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:36:27.068 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.073+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f9c30108cb0 con 0x7f9c300fc730 2024-03-12T16:36:27.069 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.074+0000 7f9c2d7fa700 1 -- 172.21.15.6:0/392195029 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f9c2005a730 con 0x7f9c300fc730 2024-03-12T16:36:27.070 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:27.070 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","created":"2024-03-12T16:00:42.612784+0000","modified":"2024-03-12T16:19:47.764663+0000","last_up_change":"2024-03-12T16:18:56.265381+0000","last_in_change":"2024-03-12T16:05:41.290069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T16:04:29.453605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-12T16:07:20.200653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-12T16:07:20.688894+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81b3ff11-3d87-4f3b-a302-c8c55f378ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":80,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6803","nonce":1475010970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6805","nonce":1475010970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6809","nonce":1475010970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6807","nonce":1475010970}]},"public_addr":"172.21.15.6:6803/1475010970","cluster_addr":"172.21.15.6:6805/1475010970","heartbeat_back_addr":"172.21.15.6:6809/1475010970","heartbeat_front_addr":"172.21.15.6:6807/1475010970","state":["exists","up"]},{"osd":1,"uuid":"e638e6a3-7dc0-47f6-8901-1bdb1c208583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":80,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6811","nonce":4090040477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6813","nonce":4090040477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6817","nonce":4090040477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6815","nonce":4090040477}]},"public_addr":"172.21.15.6:6811/4090040477","cluster_addr":"172.21.15.6:6813/4090040477","heartbeat_back_addr":"172.21.15.6:6817/4090040477","heartbeat_front_addr":"172.21.15.6:6815/4090040477","state":["exists","up"]},{"osd":2,"uuid":"45eed951-90a9-4fe0-a184-11b5e1ebe46d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":80,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6819","nonce":1248094022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6821","nonce":1248094022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6825","nonce":1248094022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6823","nonce":1248094022}]},"public_addr":"172.21.15.6:6819/1248094022","cluster_addr":"172.21.15.6:6821/1248094022","heartbeat_back_addr":"172.21.15.6:6825/1248094022","heartbeat_front_addr":"172.21.15.6:6823/1248094022","state":["exists","up"]},{"osd":3,"uuid":"47d2f20b-d7b8-4d67-905c-af29938d36d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":80,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6801","nonce":3039719923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6803","nonce":3039719923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6807","nonce":3039719923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6805","nonce":3039719923}]},"public_addr":"172.21.15.134:6801/3039719923","cluster_addr":"172.21.15.134:6803/3039719923","heartbeat_back_addr":"172.21.15.134:6807/3039719923","heartbeat_front_addr":"172.21.15.134:6805/3039719923","state":["exists","up"]},{"osd":4,"uuid":"bfe8b5a1-489a-458d-ba30-5d1bada0c33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":69,"up_from":73,"up_thru":80,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6809","nonce":3599039531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6811","nonce":3599039531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6815","nonce":3599039531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6813","nonce":3599039531}]},"public_addr":"172.21.15.134:6809/3599039531","cluster_addr":"172.21.15.134:6811/3599039531","heartbeat_back_addr":"172.21.15.134:6815/3599039531","heartbeat_front_addr":"172.21.15.134:6813/3599039531","state":["exists","up"]},{"osd":5,"uuid":"02e056ee-a66a-4c23-a819-1e4c1e2d1236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":74,"up_from":80,"up_thru":80,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6817","nonce":4202679969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6819","nonce":4202679969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6823","nonce":4202679969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6821","nonce":4202679969}]},"public_addr":"172.21.15.134:6817/4202679969","cluster_addr":"172.21.15.134:6819/4202679969","heartbeat_back_addr":"172.21.15.134:6823/4202679969","heartbeat_front_addr":"172.21.15.134:6821/4202679969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:35.977637+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:59.443373+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:04:27.106208+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:02.955636+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:30.634685+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:58.981490+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6826/163878097":"2024-03-13T16:18:54.111614+0000","172.21.15.134:6825/3713757560":"2024-03-13T16:18:54.111632+0000","172.21.15.134:6824/3713757560":"2024-03-13T16:18:54.111632+0000","172.21.15.6:0/1419012389":"2024-03-13T16:14:31.789372+0000","172.21.15.6:0/3113166053":"2024-03-13T16:14:31.789372+0000","172.21.15.6:0/4255668203":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/179696865":"2024-03-13T16:01:44.393271+0000","172.21.15.6:0/687610333":"2024-03-13T16:01:44.393271+0000","172.21.15.6:0/1637754840":"2024-03-13T16:01:12.726451+0000","172.21.15.6:6801/2268121787":"2024-03-13T16:14:31.789372+0000","172.21.15.6:6801/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/139345082":"2024-03-13T16:09:39.532193+0000","172.21.15.6:0/3228405447":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/3126632977":"2024-03-13T16:09:39.532193+0000","172.21.15.6:6800/2268121787":"2024-03-13T16:14:31.789372+0000","172.21.15.134:0/3223900424":"2024-03-13T16:11:51.047707+0000","172.21.15.134:6828/3354806786":"2024-03-13T16:11:51.047707+0000","172.21.15.6:0/1732211885":"2024-03-13T16:14:31.789372+0000","172.21.15.6:6800/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4085533321":"2024-03-13T16:14:31.789372+0000","172.21.15.134:6829/3354806786":"2024-03-13T16:11:51.047707+0000","172.21.15.6:6827/163878097":"2024-03-13T16:18:54.111614+0000","172.21.15.134:0/182723627":"2024-03-13T16:11:51.047707+0000","172.21.15.134:0/1919894603":"2024-03-13T16:11:51.047707+0000","172.21.15.6:0/124082729":"2024-03-13T16:09:39.532193+0000","172.21.15.6:6801/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4212806006":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6801/139345082":"2024-03-13T16:09:39.532193+0000","172.21.15.134:0/500953021":"2024-03-13T16:11:51.047707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.076+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c1806ca30 msgr2=0x7f9c1806eef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.076+0000 7f9c36576700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c1806ca30 0x7f9c1806eef0 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 rx=0x7f9c30109820 tx=0x7f9c24009de0).stop 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.076+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 msgr2=0x7f9c3010dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.076+0000 7f9c36576700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 0x7f9c3010dee0 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 rx=0x7f9c20005010 tx=0x7f9c20009cb0).stop 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.077+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 shutdown_connections 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.077+0000 7f9c36576700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f9c1806ca30 0x7f9c1806eef0 unknown :-1 s=CLOSED pgs=314 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.077+0000 7f9c36576700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f9c300fc730 0x7f9c3010dee0 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.077+0000 7f9c36576700 1 --2- 172.21.15.6:0/392195029 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f9c300fd090 0x7f9c3010e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.077+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 >> 172.21.15.6:0/392195029 conn(0x7f9c3006c760 msgr2=0x7f9c30060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:27.072 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.077+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 shutdown_connections 2024-03-12T16:36:27.073 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.077+0000 7f9c36576700 1 -- 172.21.15.6:0/392195029 wait complete. 2024-03-12T16:36:27.084 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T16:04:29.453605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-12T16:07:20.200653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-12T16:07:20.688894+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T16:36:27.085 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T16:36:27.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:26 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3118046169' entity='client.admin' cmd=[{"prefix": "fs dump"}]: dispatch 2024-03-12T16:36:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.213+0000 7fe084281700 1 -- 172.21.15.6:0/498711013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 msgr2=0x7fe07c0fdcb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.213+0000 7fe084281700 1 --2- 172.21.15.6:0/498711013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 0x7fe07c0fdcb0 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 rx=0x7fe06c009b60 tx=0x7fe06c004d10).stop 2024-03-12T16:36:27.208 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.213+0000 7fe084281700 1 -- 172.21.15.6:0/498711013 shutdown_connections 2024-03-12T16:36:27.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.213+0000 7fe084281700 1 --2- 172.21.15.6:0/498711013 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe07c0fe230 0x7fe07c0f7a10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.213+0000 7fe084281700 1 --2- 172.21.15.6:0/498711013 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 0x7fe07c0fdcb0 unknown :-1 s=CLOSED pgs=587 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.213+0000 7fe084281700 1 -- 172.21.15.6:0/498711013 >> 172.21.15.6:0/498711013 conn(0x7fe07c0f3490 msgr2=0x7fe07c0f58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:27.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.213+0000 7fe084281700 1 -- 172.21.15.6:0/498711013 shutdown_connections 2024-03-12T16:36:27.209 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.213+0000 7fe084281700 1 -- 172.21.15.6:0/498711013 wait complete. 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe084281700 1 Processor -- start 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe084281700 1 -- start start 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe084281700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 0x7fe07c10e030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe084281700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe07c0fe230 0x7fe07c10e520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe084281700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c10eb20 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe084281700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe07c10ec60 con 0x7fe07c0fe230 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe08201d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 0x7fe07c10e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe08201d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 0x7fe07c10e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40556/0 (socket says 172.21.15.6:40556) 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe08201d700 1 -- 172.21.15.6:0/748221663 learned_addr learned my addr 172.21.15.6:0/748221663 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe08181c700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe07c0fe230 0x7fe07c10e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe08201d700 1 -- 172.21.15.6:0/748221663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe07c0fe230 msgr2=0x7fe07c10e520 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.211 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe08201d700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe07c0fe230 0x7fe07c10e520 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe08201d700 1 -- 172.21.15.6:0/748221663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe06c0097c0 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.214+0000 7fe08201d700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 0x7fe07c10e030 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fe06c009040 tx=0x7fe06c004d10).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.215+0000 7fe07b779700 1 -- 172.21.15.6:0/748221663 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06c00e070 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.215+0000 7fe07b779700 1 -- 172.21.15.6:0/748221663 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe06c00bec0 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.215+0000 7fe084281700 1 -- 172.21.15.6:0/748221663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe07c108290 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.215+0000 7fe07b779700 1 -- 172.21.15.6:0/748221663 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe06c019070 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.215+0000 7fe084281700 1 -- 172.21.15.6:0/748221663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe07c108770 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.212 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.216+0000 7fe079775700 1 -- 172.21.15.6:0/748221663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe05c005120 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.216+0000 7fe07b779700 1 -- 172.21.15.6:0/748221663 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe06c0139d0 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.217+0000 7fe07b779700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe06406caa0 0x7fe06406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:27.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.217+0000 7fe07b779700 1 -- 172.21.15.6:0/748221663 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe06c08cfc0 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.217+0000 7fe08181c700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe06406caa0 0x7fe06406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:27.213 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.217+0000 7fe08181c700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe06406caa0 0x7fe06406ef60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fe07c109970 tx=0x7fe070009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:27.216 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.221+0000 7fe07b779700 1 -- 172.21.15.6:0/748221663 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe06c05ab20 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.420+0000 7fe079775700 1 -- 172.21.15.6:0/748221663 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe05c005d70 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.415 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.420+0000 7fe07b779700 1 -- 172.21.15.6:0/748221663 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe06c05a6b0 con 0x7fe07c0fd8d0 2024-03-12T16:36:27.415 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 -- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe06406caa0 msgr2=0x7fe06406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe06406caa0 0x7fe06406ef60 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 rx=0x7fe07c109970 tx=0x7fe070009d60).stop 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 -- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 msgr2=0x7fe07c10e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 0x7fe07c10e030 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 rx=0x7fe06c009040 tx=0x7fe06c004d10).stop 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 -- 172.21.15.6:0/748221663 shutdown_connections 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe06406caa0 0x7fe06406ef60 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe07c0fd8d0 0x7fe07c10e030 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 --2- 172.21.15.6:0/748221663 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe07c0fe230 0x7fe07c10e520 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 -- 172.21.15.6:0/748221663 >> 172.21.15.6:0/748221663 conn(0x7fe07c0f3490 msgr2=0x7fe07c0fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 -- 172.21.15.6:0/748221663 shutdown_connections 2024-03-12T16:36:27.418 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.422+0000 7fe079775700 1 -- 172.21.15.6:0/748221663 wait complete. 2024-03-12T16:36:27.429 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-12T16:36:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.558+0000 7fb43fed3700 1 -- 172.21.15.6:0/2561607769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fe290 msgr2=0x7fb4380f5f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.558+0000 7fb43fed3700 1 --2- 172.21.15.6:0/2561607769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fe290 0x7fb4380f5f50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 rx=0x7fb4340047f0 tx=0x7fb434009cb0).stop 2024-03-12T16:36:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.558+0000 7fb43fed3700 1 -- 172.21.15.6:0/2561607769 shutdown_connections 2024-03-12T16:36:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.558+0000 7fb43fed3700 1 --2- 172.21.15.6:0/2561607769 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fe290 0x7fb4380f5f50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.558+0000 7fb43fed3700 1 --2- 172.21.15.6:0/2561607769 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4380fd930 0x7fb4380fdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.558+0000 7fb43fed3700 1 -- 172.21.15.6:0/2561607769 >> 172.21.15.6:0/2561607769 conn(0x7fb43806de70 msgr2=0x7fb43806e280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.558+0000 7fb43fed3700 1 -- 172.21.15.6:0/2561607769 shutdown_connections 2024-03-12T16:36:27.555 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.558+0000 7fb43fed3700 1 -- 172.21.15.6:0/2561607769 wait complete. 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.558+0000 7fb43fed3700 1 Processor -- start 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43fed3700 1 -- start start 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43fed3700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fd930 0x7fb43810e150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43fed3700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4380fe290 0x7fb43810e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43fed3700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43810ec40 con 0x7fb4380fd930 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43fed3700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb43810ed80 con 0x7fb4380fe290 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43dc6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fd930 0x7fb43810e150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43dc6f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fd930 0x7fb43810e150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40568/0 (socket says 172.21.15.6:40568) 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43dc6f700 1 -- 172.21.15.6:0/487643518 learned_addr learned my addr 172.21.15.6:0/487643518 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43dc6f700 1 -- 172.21.15.6:0/487643518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4380fe290 msgr2=0x7fb43810e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43dc6f700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4380fe290 0x7fb43810e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43dc6f700 1 -- 172.21.15.6:0/487643518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb434005040 con 0x7fb4380fd930 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43dc6f700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fd930 0x7fb43810e150 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb42800e8f0 tx=0x7fb42800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb42effd700 1 -- 172.21.15.6:0/487643518 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb42800ee90 con 0x7fb4380fd930 2024-03-12T16:36:27.556 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb42effd700 1 -- 172.21.15.6:0/487643518 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb42800f040 con 0x7fb4380fd930 2024-03-12T16:36:27.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb438108410 con 0x7fb4380fd930 2024-03-12T16:36:27.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb42effd700 1 -- 172.21.15.6:0/487643518 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb42800c8a0 con 0x7fb4380fd930 2024-03-12T16:36:27.557 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.559+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb438108950 con 0x7fb4380fd930 2024-03-12T16:36:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.560+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb43805fb30 con 0x7fb4380fd930 2024-03-12T16:36:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.561+0000 7fb42effd700 1 -- 172.21.15.6:0/487643518 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb428009090 con 0x7fb4380fd930 2024-03-12T16:36:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.562+0000 7fb42effd700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb42406caa0 0x7fb42406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.562+0000 7fb42effd700 1 -- 172.21.15.6:0/487643518 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb42808c180 con 0x7fb4380fd930 2024-03-12T16:36:27.558 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.562+0000 7fb43d46e700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb42406caa0 0x7fb42406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:27.559 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.562+0000 7fb43d46e700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb42406caa0 0x7fb42406ef60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fb434004e60 tx=0x7fb434009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:27.560 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.566+0000 7fb42effd700 1 -- 172.21.15.6:0/487643518 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb428059ce0 con 0x7fb4380fd930 2024-03-12T16:36:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.763+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fb438104710 con 0x7fb4380fd930 2024-03-12T16:36:27.759 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.764+0000 7fb42effd700 1 -- 172.21.15.6:0/487643518 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fb428059870 con 0x7fb4380fd930 2024-03-12T16:36:27.759 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-03-12T16:36:27.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb42406caa0 msgr2=0x7fb42406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb42406caa0 0x7fb42406ef60 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 rx=0x7fb434004e60 tx=0x7fb434009cb0).stop 2024-03-12T16:36:27.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fd930 msgr2=0x7fb43810e150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fd930 0x7fb43810e150 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 rx=0x7fb42800e8f0 tx=0x7fb42800b040).stop 2024-03-12T16:36:27.761 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 shutdown_connections 2024-03-12T16:36:27.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb42406caa0 0x7fb42406ef60 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb4380fd930 0x7fb43810e150 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 --2- 172.21.15.6:0/487643518 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb4380fe290 0x7fb43810e640 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).stop 2024-03-12T16:36:27.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 >> 172.21.15.6:0/487643518 conn(0x7fb43806de70 msgr2=0x7fb4380fbd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:27.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 shutdown_connections 2024-03-12T16:36:27.762 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.766+0000 7fb43fed3700 1 -- 172.21.15.6:0/487643518 wait complete. 2024-03-12T16:36:27.773 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-12T16:36:27.898 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.901+0000 7f1caba1c700 1 -- 172.21.15.6:0/2088592563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fc830 msgr2=0x7f1ca40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.901+0000 7f1caba1c700 1 --2- 172.21.15.6:0/2088592563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fc830 0x7f1ca40fcc10 secure :-1 s=READY pgs=591 cs=0 l=1 rev1=1 rx=0x7f1ca00047f0 tx=0x7f1ca0009cb0).stop 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.901+0000 7f1caba1c700 1 -- 172.21.15.6:0/2088592563 shutdown_connections 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.901+0000 7f1caba1c700 1 --2- 172.21.15.6:0/2088592563 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca40fd100 0x7f1ca40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=0 rx=0 tx=0).stop 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.901+0000 7f1caba1c700 1 --2- 172.21.15.6:0/2088592563 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fc830 0x7f1ca40fcc10 unknown :-1 s=CLOSED pgs=591 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.901+0000 7f1caba1c700 1 -- 172.21.15.6:0/2088592563 >> 172.21.15.6:0/2088592563 conn(0x7f1ca406c760 msgr2=0x7f1ca406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.901+0000 7f1caba1c700 1 -- 172.21.15.6:0/2088592563 shutdown_connections 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.901+0000 7f1caba1c700 1 -- 172.21.15.6:0/2088592563 wait complete. 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.902+0000 7f1caba1c700 1 Processor -- start 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.902+0000 7f1caba1c700 1 -- start start 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.902+0000 7f1caba1c700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca40fc830 0x7f1ca410e010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.902+0000 7f1caba1c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fd100 0x7f1ca410e500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:27.899 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.902+0000 7f1caba1c700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca410eb90 con 0x7f1ca40fd100 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.902+0000 7f1caba1c700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1ca41081b0 con 0x7f1ca40fc830 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.902+0000 7f1ca8fb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fd100 0x7f1ca410e500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.902+0000 7f1ca8fb7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fd100 0x7f1ca410e500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40592/0 (socket says 172.21.15.6:40592) 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.902+0000 7f1ca8fb7700 1 -- 172.21.15.6:0/4174089775 learned_addr learned my addr 172.21.15.6:0/4174089775 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1ca97b8700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca40fc830 0x7f1ca410e010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1ca8fb7700 1 -- 172.21.15.6:0/4174089775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca40fc830 msgr2=0x7f1ca410e010 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1ca8fb7700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca40fc830 0x7f1ca410e010 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1ca8fb7700 1 -- 172.21.15.6:0/4174089775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1ca0005040 con 0x7f1ca40fd100 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1ca8fb7700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fd100 0x7f1ca410e500 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f1c9400b4b0 tx=0x7f1c940090f0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1c9a7fc700 1 -- 172.21.15.6:0/4174089775 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c94002500 con 0x7f1ca40fd100 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1ca4108460 con 0x7f1ca40fd100 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1c9a7fc700 1 -- 172.21.15.6:0/4174089775 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1c94002b10 con 0x7f1ca40fd100 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1c9a7fc700 1 -- 172.21.15.6:0/4174089775 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1c94012cf0 con 0x7f1ca40fd100 2024-03-12T16:36:27.900 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.903+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1ca41089a0 con 0x7f1ca40fd100 2024-03-12T16:36:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.904+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1ca405f380 con 0x7f1ca40fd100 2024-03-12T16:36:27.901 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.904+0000 7f1c9a7fc700 1 -- 172.21.15.6:0/4174089775 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f1c94002660 con 0x7f1ca40fd100 2024-03-12T16:36:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.905+0000 7f1c9a7fc700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1c9006caa0 0x7f1c9006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.905+0000 7f1c9a7fc700 1 -- 172.21.15.6:0/4174089775 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1c9408be70 con 0x7f1ca40fd100 2024-03-12T16:36:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.905+0000 7f1ca97b8700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1c9006caa0 0x7f1c9006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:27.902 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.905+0000 7f1ca97b8700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1c9006caa0 0x7f1c9006ef60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f1ca0004f10 tx=0x7f1ca000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:27.904 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:27.909+0000 7f1c9a7fc700 1 -- 172.21.15.6:0/4174089775 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1c940599d0 con 0x7f1ca40fd100 2024-03-12T16:36:28.102 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.107+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f1ca4109040 con 0x7f1ca40fd100 2024-03-12T16:36:28.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.107+0000 7f1c9a7fc700 1 -- 172.21.15.6:0/4174089775 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f1c94059560 con 0x7f1ca40fd100 2024-03-12T16:36:28.103 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-03-12T16:36:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.109+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1c9006caa0 msgr2=0x7f1c9006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.109+0000 7f1caba1c700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1c9006caa0 0x7f1c9006ef60 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 rx=0x7f1ca0004f10 tx=0x7f1ca000b040).stop 2024-03-12T16:36:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.109+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fd100 msgr2=0x7f1ca410e500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.110+0000 7f1caba1c700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fd100 0x7f1ca410e500 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 rx=0x7f1c9400b4b0 tx=0x7f1c940090f0).stop 2024-03-12T16:36:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.110+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 shutdown_connections 2024-03-12T16:36:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.110+0000 7f1caba1c700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1ca40fc830 0x7f1ca410e010 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.110+0000 7f1caba1c700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1c9006caa0 0x7f1c9006ef60 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.105 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.110+0000 7f1caba1c700 1 --2- 172.21.15.6:0/4174089775 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1ca40fd100 0x7f1ca410e500 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.110+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 >> 172.21.15.6:0/4174089775 conn(0x7f1ca406c760 msgr2=0x7f1ca4060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.110+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 shutdown_connections 2024-03-12T16:36:28.106 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.110+0000 7f1caba1c700 1 -- 172.21.15.6:0/4174089775 wait complete. 2024-03-12T16:36:28.116 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:27 smithi006 ceph-mon[103869]: pgmap v697: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:28.116 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:27 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/392195029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:36:28.116 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:27 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/748221663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-12T16:36:28.117 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 2024-03-12T16:36:28.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:27 smithi134 ceph-mon[85099]: pgmap v697: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:28.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:27 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/392195029' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:36:28.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:27 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/748221663' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.242+0000 7fb06dc3e700 1 -- 172.21.15.6:0/3407243936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 msgr2=0x7fb0680fcb10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.242+0000 7fb06dc3e700 1 --2- 172.21.15.6:0/3407243936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 0x7fb0680fcb10 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 rx=0x7fb0580047f0 tx=0x7fb058009cb0).stop 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.242+0000 7fb06dc3e700 1 -- 172.21.15.6:0/3407243936 shutdown_connections 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.242+0000 7fb06dc3e700 1 --2- 172.21.15.6:0/3407243936 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0680fd090 0x7fb0680f6870 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.242+0000 7fb06dc3e700 1 --2- 172.21.15.6:0/3407243936 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 0x7fb0680fcb10 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.242+0000 7fb06dc3e700 1 -- 172.21.15.6:0/3407243936 >> 172.21.15.6:0/3407243936 conn(0x7fb06806c760 msgr2=0x7fb06806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.243+0000 7fb06dc3e700 1 -- 172.21.15.6:0/3407243936 shutdown_connections 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.243+0000 7fb06dc3e700 1 -- 172.21.15.6:0/3407243936 wait complete. 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.243+0000 7fb06dc3e700 1 Processor -- start 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.243+0000 7fb06dc3e700 1 -- start start 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.243+0000 7fb06dc3e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 0x7fb06810df20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:28.240 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.243+0000 7fb06dc3e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0680fd090 0x7fb06810e410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.243+0000 7fb06dc3e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06810ea10 con 0x7fb0680fc730 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.243+0000 7fb06dc3e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb06810eb50 con 0x7fb0680fd090 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb0677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 0x7fb06810df20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb0677fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 0x7fb06810df20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40612/0 (socket says 172.21.15.6:40612) 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb0677fe700 1 -- 172.21.15.6:0/2950179104 learned_addr learned my addr 172.21.15.6:0/2950179104 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb066ffd700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0680fd090 0x7fb06810e410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb0677fe700 1 -- 172.21.15.6:0/2950179104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0680fd090 msgr2=0x7fb06810e410 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb0677fe700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0680fd090 0x7fb06810e410 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb0677fe700 1 -- 172.21.15.6:0/2950179104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb058005040 con 0x7fb0680fc730 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb0677fe700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 0x7fb06810df20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fb058005010 tx=0x7fb058009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb064ff9700 1 -- 172.21.15.6:0/2950179104 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb05800e030 con 0x7fb0680fc730 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb064ff9700 1 -- 172.21.15.6:0/2950179104 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb058007e90 con 0x7fb0680fc730 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb064ff9700 1 -- 172.21.15.6:0/2950179104 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb058018070 con 0x7fb0680fc730 2024-03-12T16:36:28.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb068108180 con 0x7fb0680fc730 2024-03-12T16:36:28.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.244+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb0681086e0 con 0x7fb0680fc730 2024-03-12T16:36:28.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.245+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb06805f380 con 0x7fb0680fc730 2024-03-12T16:36:28.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.246+0000 7fb064ff9700 1 -- 172.21.15.6:0/2950179104 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb05801d670 con 0x7fb0680fc730 2024-03-12T16:36:28.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.246+0000 7fb064ff9700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb05006caa0 0x7fb05006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:28.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.246+0000 7fb064ff9700 1 -- 172.21.15.6:0/2950179104 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb05808d010 con 0x7fb0680fc730 2024-03-12T16:36:28.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.246+0000 7fb066ffd700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb05006caa0 0x7fb05006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:28.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.246+0000 7fb066ffd700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb05006caa0 0x7fb05006ef60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fb068109860 tx=0x7fb05c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:28.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.250+0000 7fb064ff9700 1 -- 172.21.15.6:0/2950179104 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb05805ab70 con 0x7fb0680fc730 2024-03-12T16:36:28.491 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.496+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "format": "json"} v 0) v1 -- 0x7fb06805eec0 con 0x7fb0680fc730 2024-03-12T16:36:28.492 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.497+0000 7fb064ff9700 1 -- 172.21.15.6:0/2950179104 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "format": "json"}]=0 dumped fsmap epoch 33 v33) v1 ==== 94+0+4839 (secure 0 0 0) 0x7fb05805a700 con 0x7fb0680fc730 2024-03-12T16:36:28.492 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:28.492 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":33,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44343,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/665910356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":665910356},{"type":"v1","addr":"172.21.15.134:6827","nonce":665910356}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":33,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:35:04.674097+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":28,"state":"up:active","state_seq":244,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":1,"incarnation":28,"state":"up:active","state_seq":239,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:28.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb05006caa0 msgr2=0x7fb05006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb05006caa0 0x7fb05006ef60 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 rx=0x7fb068109860 tx=0x7fb05c00b040).stop 2024-03-12T16:36:28.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 msgr2=0x7fb06810df20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 0x7fb06810df20 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 rx=0x7fb058005010 tx=0x7fb058009cb0).stop 2024-03-12T16:36:28.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 shutdown_connections 2024-03-12T16:36:28.494 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb05006caa0 0x7fb05006ef60 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb0680fc730 0x7fb06810df20 unknown :-1 s=CLOSED pgs=594 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 --2- 172.21.15.6:0/2950179104 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb0680fd090 0x7fb06810e410 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 >> 172.21.15.6:0/2950179104 conn(0x7fb06806c760 msgr2=0x7fb068060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 shutdown_connections 2024-03-12T16:36:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.499+0000 7fb06dc3e700 1 -- 172.21.15.6:0/2950179104 wait complete. 2024-03-12T16:36:28.495 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 33 2024-03-12T16:36:28.506 DEBUG:tasks.fs:checking fs fscid=1,name=cephfs state = {'epoch': 12, 'max_mds': 2, 'flags': 18} 2024-03-12T16:36:28.506 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 13 2024-03-12T16:36:28.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.632+0000 7f265d479700 1 -- 172.21.15.6:0/1992091632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fe250 msgr2=0x7f26580f5f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.632+0000 7f265d479700 1 --2- 172.21.15.6:0/1992091632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fe250 0x7f26580f5f30 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 rx=0x7f264c0047f0 tx=0x7f264c009cb0).stop 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.632+0000 7f265d479700 1 -- 172.21.15.6:0/1992091632 shutdown_connections 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.632+0000 7f265d479700 1 --2- 172.21.15.6:0/1992091632 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fe250 0x7f26580f5f30 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.632+0000 7f265d479700 1 --2- 172.21.15.6:0/1992091632 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26580fd8f0 0x7f26580fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.632+0000 7f265d479700 1 -- 172.21.15.6:0/1992091632 >> 172.21.15.6:0/1992091632 conn(0x7f265806cdc0 msgr2=0x7f265806d1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.632+0000 7f265d479700 1 -- 172.21.15.6:0/1992091632 shutdown_connections 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.632+0000 7f265d479700 1 -- 172.21.15.6:0/1992091632 wait complete. 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f265d479700 1 Processor -- start 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f265d479700 1 -- start start 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f265d479700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fd8f0 0x7f265810dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f265d479700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26580fe250 0x7f265810e4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f265d479700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265810ead0 con 0x7f26580fd8f0 2024-03-12T16:36:28.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f265d479700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f265810ec10 con 0x7f26580fe250 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f2656ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fd8f0 0x7f265810dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f2656ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fd8f0 0x7f265810dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40628/0 (socket says 172.21.15.6:40628) 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f2656ffd700 1 -- 172.21.15.6:0/2421783934 learned_addr learned my addr 172.21.15.6:0/2421783934 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.633+0000 7f26567fc700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26580fe250 0x7f265810e4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f2656ffd700 1 -- 172.21.15.6:0/2421783934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26580fe250 msgr2=0x7f265810e4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f2656ffd700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26580fe250 0x7f265810e4d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f2656ffd700 1 -- 172.21.15.6:0/2421783934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f264c005040 con 0x7f26580fd8f0 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f26567fc700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26580fe250 0x7f265810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f2656ffd700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fd8f0 0x7f265810dfe0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f264800dad0 tx=0x7f2648004ee0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f263ffff700 1 -- 172.21.15.6:0/2421783934 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f264800b750 con 0x7f26580fd8f0 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f263ffff700 1 -- 172.21.15.6:0/2421783934 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f264800f040 con 0x7f26580fd8f0 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f26581082a0 con 0x7f26580fd8f0 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f263ffff700 1 -- 172.21.15.6:0/2421783934 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2648013ce0 con 0x7f26580fd8f0 2024-03-12T16:36:28.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.634+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f26581087e0 con 0x7f26580fd8f0 2024-03-12T16:36:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.635+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f265805fb30 con 0x7f26580fd8f0 2024-03-12T16:36:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.635+0000 7f263ffff700 1 -- 172.21.15.6:0/2421783934 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f264800b8b0 con 0x7f26580fd8f0 2024-03-12T16:36:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.636+0000 7f263ffff700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f264006caa0 0x7f264006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.636+0000 7f26567fc700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f264006caa0 0x7f264006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:28.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.636+0000 7f263ffff700 1 -- 172.21.15.6:0/2421783934 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f264808b8f0 con 0x7f26580fd8f0 2024-03-12T16:36:28.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.636+0000 7f26567fc700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f264006caa0 0x7f264006ef60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f264c0043d0 tx=0x7f264c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:28.635 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.641+0000 7f263ffff700 1 -- 172.21.15.6:0/2421783934 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2648059440 con 0x7f26580fd8f0 2024-03-12T16:36:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.887+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 13, "format": "json"} v 0) v1 -- 0x7f26581046a0 con 0x7f26580fd8f0 2024-03-12T16:36:28.886 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.888+0000 7f263ffff700 1 -- 172.21.15.6:0/2421783934 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 13, "format": "json"}]=0 dumped fsmap epoch 13 v33) v1 ==== 107+0+4835 (secure 0 0 0) 0x7f2648058fd0 con 0x7f26580fd8f0 2024-03-12T16:36:28.887 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:28.887 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":13,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14444,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1071999293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1071999293},{"type":"v1","addr":"172.21.15.6:6829","nonce":1071999293}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":13,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:09:35.228673+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14432,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14432":{"gid":14432,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.6:6827/163878097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":163878097},{"type":"v1","addr":"172.21.15.6:6827","nonce":163878097}]},"join_fscid":1,"export_targets":[1],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi134.jqydtn","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.134:6825/3713757560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3713757560},{"type":"v1","addr":"172.21.15.134:6825","nonce":3713757560}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f264006caa0 msgr2=0x7f264006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f264006caa0 0x7f264006ef60 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 rx=0x7f264c0043d0 tx=0x7f264c00b040).stop 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fd8f0 msgr2=0x7f265810dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fd8f0 0x7f265810dfe0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 rx=0x7f264800dad0 tx=0x7f2648004ee0).stop 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 shutdown_connections 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f264006caa0 0x7f264006ef60 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f26580fd8f0 0x7f265810dfe0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 --2- 172.21.15.6:0/2421783934 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f26580fe250 0x7f265810e4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 >> 172.21.15.6:0/2421783934 conn(0x7f265806cdc0 msgr2=0x7f2658100f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 shutdown_connections 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:28.890+0000 7f265d479700 1 -- 172.21.15.6:0/2421783934 wait complete. 2024-03-12T16:36:28.888 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 13 2024-03-12T16:36:28.897 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:28 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/487643518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-12T16:36:28.897 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:28 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/4174089775' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-12T16:36:28.897 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:28 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2950179104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-12T16:36:28.898 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 14 2024-03-12T16:36:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.023+0000 7f1fc8280700 1 -- 172.21.15.6:0/3290760689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 msgr2=0x7f1fc00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.023+0000 7f1fc8280700 1 --2- 172.21.15.6:0/3290760689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 0x7f1fc00f6930 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 rx=0x7f1fb00047f0 tx=0x7f1fb0009cb0).stop 2024-03-12T16:36:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 -- 172.21.15.6:0/3290760689 shutdown_connections 2024-03-12T16:36:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 --2- 172.21.15.6:0/3290760689 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 0x7f1fc00f6930 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 --2- 172.21.15.6:0/3290760689 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fc00fc830 0x7f1fc00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 -- 172.21.15.6:0/3290760689 >> 172.21.15.6:0/3290760689 conn(0x7f1fc006c760 msgr2=0x7f1fc006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:29.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 -- 172.21.15.6:0/3290760689 shutdown_connections 2024-03-12T16:36:29.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 -- 172.21.15.6:0/3290760689 wait complete. 2024-03-12T16:36:29.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 Processor -- start 2024-03-12T16:36:29.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 -- start start 2024-03-12T16:36:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fc00fc830 0x7f1fc0106ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 0x7f1fc0107390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0061500 con 0x7f1fc00fd100 2024-03-12T16:36:29.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc8280700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1fc0107880 con 0x7f1fc00fc830 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.024+0000 7f1fc581b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 0x7f1fc0107390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fc581b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 0x7f1fc0107390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40648/0 (socket says 172.21.15.6:40648) 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fc581b700 1 -- 172.21.15.6:0/3575119718 learned_addr learned my addr 172.21.15.6:0/3575119718 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fc601c700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fc00fc830 0x7f1fc0106ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fc581b700 1 -- 172.21.15.6:0/3575119718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fc00fc830 msgr2=0x7f1fc0106ea0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fc581b700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fc00fc830 0x7f1fc0106ea0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fc581b700 1 -- 172.21.15.6:0/3575119718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1fb0005040 con 0x7f1fc00fd100 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fc581b700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 0x7f1fc0107390 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f1fb0005010 tx=0x7f1fb0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fb7779700 1 -- 172.21.15.6:0/3575119718 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb000e030 con 0x7f1fc00fd100 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fb7779700 1 -- 172.21.15.6:0/3575119718 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1fb0007e90 con 0x7f1fc00fd100 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fb7779700 1 -- 172.21.15.6:0/3575119718 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1fb0018070 con 0x7f1fc00fd100 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1fc0107b00 con 0x7f1fc00fd100 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.025+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1fc01146d0 con 0x7f1fc00fd100 2024-03-12T16:36:29.023 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.026+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1fc005f380 con 0x7f1fc00fd100 2024-03-12T16:36:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.027+0000 7f1fb7779700 1 -- 172.21.15.6:0/3575119718 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f1fb001d420 con 0x7f1fc00fd100 2024-03-12T16:36:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.027+0000 7f1fb7779700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1fac06caa0 0x7f1fac06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.027+0000 7f1fb7779700 1 -- 172.21.15.6:0/3575119718 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1fb008d0c0 con 0x7f1fc00fd100 2024-03-12T16:36:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.027+0000 7f1fc601c700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1fac06caa0 0x7f1fac06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:29.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.027+0000 7f1fc601c700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1fac06caa0 0x7f1fac06ef60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f1fbc009170 tx=0x7f1fbc009da0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:29.026 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.031+0000 7f1fb7779700 1 -- 172.21.15.6:0/3575119718 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1fb005ac20 con 0x7f1fc00fd100 2024-03-12T16:36:29.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:28 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/487643518' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-12T16:36:29.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:28 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/4174089775' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-12T16:36:29.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:28 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2950179104' entity='client.admin' cmd=[{"prefix": "fs dump", "format": "json"}]: dispatch 2024-03-12T16:36:29.267 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.272+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 14, "format": "json"} v 0) v1 -- 0x7f1fc00feb60 con 0x7f1fc00fd100 2024-03-12T16:36:29.268 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.273+0000 7f1fb7779700 1 -- 172.21.15.6:0/3575119718 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 14, "format": "json"}]=0 dumped fsmap epoch 14 v33) v1 ==== 107+0+4836 (secure 0 0 0) 0x7f1fb005be60 con 0x7f1fc00fd100 2024-03-12T16:36:29.268 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:29.268 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":14,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14444,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1071999293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1071999293},{"type":"v1","addr":"172.21.15.6:6829","nonce":1071999293}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":14,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:10:47.693652+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14432,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14432":{"gid":14432,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.6:6827/163878097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":163878097},{"type":"v1","addr":"172.21.15.6:6827","nonce":163878097}]},"join_fscid":1,"export_targets":[1],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi134.jqydtn","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.134:6825/3713757560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3713757560},{"type":"v1","addr":"172.21.15.134:6825","nonce":3713757560}]},"join_fscid":1,"export_targets":[0],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1fac06caa0 msgr2=0x7f1fac06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1fac06caa0 0x7f1fac06ef60 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 rx=0x7f1fbc009170 tx=0x7f1fbc009da0).stop 2024-03-12T16:36:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 msgr2=0x7f1fc0107390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 0x7f1fc0107390 secure :-1 s=READY pgs=598 cs=0 l=1 rev1=1 rx=0x7f1fb0005010 tx=0x7f1fb0009cb0).stop 2024-03-12T16:36:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 shutdown_connections 2024-03-12T16:36:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1fc00fc830 0x7f1fc0106ea0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1fac06caa0 0x7f1fac06ef60 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 --2- 172.21.15.6:0/3575119718 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1fc00fd100 0x7f1fc0107390 unknown :-1 s=CLOSED pgs=598 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.271 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 >> 172.21.15.6:0/3575119718 conn(0x7f1fc006c760 msgr2=0x7f1fc00fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 shutdown_connections 2024-03-12T16:36:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.275+0000 7f1fc8280700 1 -- 172.21.15.6:0/3575119718 wait complete. 2024-03-12T16:36:29.272 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 14 2024-03-12T16:36:29.283 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 15 2024-03-12T16:36:29.405 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.410+0000 7f8b61de5700 1 -- 172.21.15.6:0/3043347127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fc830 msgr2=0x7f8b5c0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.410+0000 7f8b61de5700 1 --2- 172.21.15.6:0/3043347127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fc830 0x7f8b5c0fcc10 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 rx=0x7f8b440047f0 tx=0x7f8b44009cb0).stop 2024-03-12T16:36:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.410+0000 7f8b61de5700 1 -- 172.21.15.6:0/3043347127 shutdown_connections 2024-03-12T16:36:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.410+0000 7f8b61de5700 1 --2- 172.21.15.6:0/3043347127 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b5c0fd100 0x7f8b5c0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.410+0000 7f8b61de5700 1 --2- 172.21.15.6:0/3043347127 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fc830 0x7f8b5c0fcc10 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.410+0000 7f8b61de5700 1 -- 172.21.15.6:0/3043347127 >> 172.21.15.6:0/3043347127 conn(0x7f8b5c06c760 msgr2=0x7f8b5c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.410+0000 7f8b61de5700 1 -- 172.21.15.6:0/3043347127 shutdown_connections 2024-03-12T16:36:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.410+0000 7f8b61de5700 1 -- 172.21.15.6:0/3043347127 wait complete. 2024-03-12T16:36:29.406 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b61de5700 1 Processor -- start 2024-03-12T16:36:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b61de5700 1 -- start start 2024-03-12T16:36:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b61de5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b5c0fc830 0x7f8b5c10e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b61de5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fd100 0x7f8b5c10e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b61de5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c10eb70 con 0x7f8b5c0fd100 2024-03-12T16:36:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b61de5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8b5c10ecb0 con 0x7f8b5c0fc830 2024-03-12T16:36:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b5affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fd100 0x7f8b5c10e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b5affd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fd100 0x7f8b5c10e570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40652/0 (socket says 172.21.15.6:40652) 2024-03-12T16:36:29.409 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b5affd700 1 -- 172.21.15.6:0/2392476901 learned_addr learned my addr 172.21.15.6:0/2392476901 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b5b7fe700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b5c0fc830 0x7f8b5c10e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b5affd700 1 -- 172.21.15.6:0/2392476901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b5c0fc830 msgr2=0x7f8b5c10e080 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b5affd700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b5c0fc830 0x7f8b5c10e080 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b5affd700 1 -- 172.21.15.6:0/2392476901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8b44005040 con 0x7f8b5c0fd100 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b5b7fe700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b5c0fc830 0x7f8b5c10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.411+0000 7f8b5affd700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fd100 0x7f8b5c10e570 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f8b4c00e8f0 tx=0x7f8b4c00b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.412+0000 7f8b58ff9700 1 -- 172.21.15.6:0/2392476901 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b4c00ee90 con 0x7f8b5c0fd100 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.412+0000 7f8b58ff9700 1 -- 172.21.15.6:0/2392476901 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8b4c00f040 con 0x7f8b5c0fd100 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.412+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8b5c108340 con 0x7f8b5c0fd100 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.412+0000 7f8b58ff9700 1 -- 172.21.15.6:0/2392476901 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8b4c00c8a0 con 0x7f8b5c0fd100 2024-03-12T16:36:29.410 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.412+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8b5c108900 con 0x7f8b5c0fd100 2024-03-12T16:36:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.413+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8b5c05f380 con 0x7f8b5c0fd100 2024-03-12T16:36:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.413+0000 7f8b58ff9700 1 -- 172.21.15.6:0/2392476901 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8b4c007b40 con 0x7f8b5c0fd100 2024-03-12T16:36:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.414+0000 7f8b58ff9700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b4806caa0 0x7f8b4806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.414+0000 7f8b58ff9700 1 -- 172.21.15.6:0/2392476901 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8b4c08b970 con 0x7f8b5c0fd100 2024-03-12T16:36:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.414+0000 7f8b5b7fe700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b4806caa0 0x7f8b4806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:29.411 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.414+0000 7f8b5b7fe700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b4806caa0 0x7f8b4806ef60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f8b44004e60 tx=0x7f8b4400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:29.413 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.418+0000 7f8b58ff9700 1 -- 172.21.15.6:0/2392476901 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8b4c0594d0 con 0x7f8b5c0fd100 2024-03-12T16:36:29.655 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.660+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 15, "format": "json"} v 0) v1 -- 0x7f8b5c108f90 con 0x7f8b5c0fd100 2024-03-12T16:36:29.656 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.661+0000 7f8b58ff9700 1 -- 172.21.15.6:0/2392476901 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 15, "format": "json"}]=0 dumped fsmap epoch 15 v33) v1 ==== 107+0+4835 (secure 0 0 0) 0x7f8b4c059060 con 0x7f8b5c0fd100 2024-03-12T16:36:29.656 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:29.656 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":15,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14444,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1071999293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1071999293},{"type":"v1","addr":"172.21.15.6:6829","nonce":1071999293}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":15,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:14:27.566046+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14432,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14432":{"gid":14432,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.6:6827/163878097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":163878097},{"type":"v1","addr":"172.21.15.6:6827","nonce":163878097}]},"join_fscid":1,"export_targets":[1],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi134.jqydtn","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.134:6825/3713757560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3713757560},{"type":"v1","addr":"172.21.15.134:6825","nonce":3713757560}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b4806caa0 msgr2=0x7f8b4806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b4806caa0 0x7f8b4806ef60 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 rx=0x7f8b44004e60 tx=0x7f8b4400b040).stop 2024-03-12T16:36:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fd100 msgr2=0x7f8b5c10e570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fd100 0x7f8b5c10e570 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 rx=0x7f8b4c00e8f0 tx=0x7f8b4c00b040).stop 2024-03-12T16:36:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 shutdown_connections 2024-03-12T16:36:29.659 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8b5c0fc830 0x7f8b5c10e080 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8b4806caa0 0x7f8b4806ef60 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 --2- 172.21.15.6:0/2392476901 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8b5c0fd100 0x7f8b5c10e570 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 >> 172.21.15.6:0/2392476901 conn(0x7f8b5c06c760 msgr2=0x7f8b5c060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 shutdown_connections 2024-03-12T16:36:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.663+0000 7f8b61de5700 1 -- 172.21.15.6:0/2392476901 wait complete. 2024-03-12T16:36:29.660 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 15 2024-03-12T16:36:29.671 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 16 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.799+0000 7f4bffe44700 1 -- 172.21.15.6:0/542965597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 msgr2=0x7f4bf80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.799+0000 7f4bffe44700 1 --2- 172.21.15.6:0/542965597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 0x7f4bf80f6930 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 rx=0x7f4bec0047f0 tx=0x7f4bec009cb0).stop 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.799+0000 7f4bffe44700 1 -- 172.21.15.6:0/542965597 shutdown_connections 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.799+0000 7f4bffe44700 1 --2- 172.21.15.6:0/542965597 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 0x7f4bf80f6930 unknown :-1 s=CLOSED pgs=601 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.799+0000 7f4bffe44700 1 --2- 172.21.15.6:0/542965597 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf80fc830 0x7f4bf80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.799+0000 7f4bffe44700 1 -- 172.21.15.6:0/542965597 >> 172.21.15.6:0/542965597 conn(0x7f4bf806c760 msgr2=0x7f4bf806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.799+0000 7f4bffe44700 1 -- 172.21.15.6:0/542965597 shutdown_connections 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.799+0000 7f4bffe44700 1 -- 172.21.15.6:0/542965597 wait complete. 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bffe44700 1 Processor -- start 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bffe44700 1 -- start start 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bffe44700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf80fc830 0x7f4bf80f8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:29.797 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bffe44700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 0x7f4bf80f8a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bffe44700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80f8f20 con 0x7f4bf80fd100 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bffe44700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f4bf80f9060 con 0x7f4bf80fc830 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bfd3df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 0x7f4bf80f8a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bfd3df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 0x7f4bf80f8a30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40680/0 (socket says 172.21.15.6:40680) 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bfd3df700 1 -- 172.21.15.6:0/424267847 learned_addr learned my addr 172.21.15.6:0/424267847 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bfd3df700 1 -- 172.21.15.6:0/424267847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf80fc830 msgr2=0x7f4bf80f8540 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bfdbe0700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf80fc830 0x7f4bf80f8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bfd3df700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf80fc830 0x7f4bf80f8540 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bfd3df700 1 -- 172.21.15.6:0/424267847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f4bec005040 con 0x7f4bf80fd100 2024-03-12T16:36:29.798 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.800+0000 7f4bfdbe0700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf80fc830 0x7f4bf80f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:36:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.801+0000 7f4bfd3df700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 0x7f4bf80f8a30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f4bec013640 tx=0x7f4bec009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.801+0000 7f4beaffd700 1 -- 172.21.15.6:0/424267847 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bec00e030 con 0x7f4bf80fd100 2024-03-12T16:36:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.801+0000 7f4beaffd700 1 -- 172.21.15.6:0/424267847 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f4bec007e90 con 0x7f4bf80fd100 2024-03-12T16:36:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.801+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f4bf80f92b0 con 0x7f4bf80fd100 2024-03-12T16:36:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.801+0000 7f4beaffd700 1 -- 172.21.15.6:0/424267847 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f4bec018070 con 0x7f4bf80fd100 2024-03-12T16:36:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.801+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f4bf81145b0 con 0x7f4bf80fd100 2024-03-12T16:36:29.799 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.802+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f4bf805f380 con 0x7f4bf80fd100 2024-03-12T16:36:29.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.802+0000 7f4beaffd700 1 -- 172.21.15.6:0/424267847 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f4bec01d420 con 0x7f4bf80fd100 2024-03-12T16:36:29.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.803+0000 7f4beaffd700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4be406cab0 0x7f4be406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:29.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.803+0000 7f4beaffd700 1 -- 172.21.15.6:0/424267847 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f4bec08d420 con 0x7f4bf80fd100 2024-03-12T16:36:29.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.803+0000 7f4bfdbe0700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4be406cab0 0x7f4be406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:29.800 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.803+0000 7f4bfdbe0700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4be406cab0 0x7f4be406ef70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f4bf40041d0 tx=0x7f4bf4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:29.802 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:29.807+0000 7f4beaffd700 1 -- 172.21.15.6:0/424267847 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f4bec057430 con 0x7f4bf80fd100 2024-03-12T16:36:29.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:29 smithi006 ceph-mon[103869]: pgmap v698: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:29.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:29 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2421783934' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-03-12T16:36:29.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:29 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3575119718' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-03-12T16:36:29.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:29 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2392476901' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-03-12T16:36:30.047 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.052+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 16, "format": "json"} v 0) v1 -- 0x7f4bf8114bc0 con 0x7f4bf80fd100 2024-03-12T16:36:30.048 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.053+0000 7f4beaffd700 1 -- 172.21.15.6:0/424267847 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 16, "format": "json"}]=0 dumped fsmap epoch 16 v33) v1 ==== 107+0+4834 (secure 0 0 0) 0x7f4bec05aa50 con 0x7f4bf80fd100 2024-03-12T16:36:30.048 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:30.048 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":16,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14444,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1071999293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1071999293},{"type":"v1","addr":"172.21.15.6:6829","nonce":1071999293}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":16,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:14:55.638904+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":14432,"mds_1":24271},"failed":[],"damaged":[],"stopped":[],"info":{"gid_14432":{"gid":14432,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":4,"state":"up:active","state_seq":2,"addr":"172.21.15.6:6827/163878097","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":163878097},{"type":"v1","addr":"172.21.15.6:6827","nonce":163878097}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_24271":{"gid":24271,"name":"cephfs.smithi134.jqydtn","rank":1,"incarnation":7,"state":"up:active","state_seq":2,"addr":"172.21.15.134:6825/3713757560","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":3713757560},{"type":"v1","addr":"172.21.15.134:6825","nonce":3713757560}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4be406cab0 msgr2=0x7f4be406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4be406cab0 0x7f4be406ef70 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 rx=0x7f4bf40041d0 tx=0x7f4bf4009040).stop 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 msgr2=0x7f4bf80f8a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 0x7f4bf80f8a30 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 rx=0x7f4bec013640 tx=0x7f4bec009cb0).stop 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 shutdown_connections 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f4bf80fc830 0x7f4bf80f8540 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f4be406cab0 0x7f4be406ef70 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 --2- 172.21.15.6:0/424267847 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f4bf80fd100 0x7f4bf80f8a30 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 >> 172.21.15.6:0/424267847 conn(0x7f4bf806c760 msgr2=0x7f4bf8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 shutdown_connections 2024-03-12T16:36:30.051 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.055+0000 7f4bffe44700 1 -- 172.21.15.6:0/424267847 wait complete. 2024-03-12T16:36:30.052 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 16 2024-03-12T16:36:30.063 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 17 2024-03-12T16:36:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.188+0000 7ff1f075b700 1 -- 172.21.15.6:0/1481647884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fc830 msgr2=0x7ff1e80fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.188+0000 7ff1f075b700 1 --2- 172.21.15.6:0/1481647884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fc830 0x7ff1e80fcc10 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 rx=0x7ff1e40047f0 tx=0x7ff1e4009cb0).stop 2024-03-12T16:36:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.189+0000 7ff1f075b700 1 -- 172.21.15.6:0/1481647884 shutdown_connections 2024-03-12T16:36:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.189+0000 7ff1f075b700 1 --2- 172.21.15.6:0/1481647884 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80fd100 0x7ff1e80f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.189+0000 7ff1f075b700 1 --2- 172.21.15.6:0/1481647884 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fc830 0x7ff1e80fcc10 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.184 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.189+0000 7ff1f075b700 1 -- 172.21.15.6:0/1481647884 >> 172.21.15.6:0/1481647884 conn(0x7ff1e806c760 msgr2=0x7ff1e806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:30.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.189+0000 7ff1f075b700 1 -- 172.21.15.6:0/1481647884 shutdown_connections 2024-03-12T16:36:30.185 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.189+0000 7ff1f075b700 1 -- 172.21.15.6:0/1481647884 wait complete. 2024-03-12T16:36:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.189+0000 7ff1f075b700 1 Processor -- start 2024-03-12T16:36:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.189+0000 7ff1f075b700 1 -- start start 2024-03-12T16:36:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1f075b700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80fc830 0x7ff1e8109160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1f075b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fd100 0x7ff1e8109650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1f075b700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8109b40 con 0x7ff1e80fd100 2024-03-12T16:36:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1f075b700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ff1e8109c80 con 0x7ff1e80fc830 2024-03-12T16:36:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1edcf6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fd100 0x7ff1e8109650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1edcf6700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fd100 0x7ff1e8109650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40690/0 (socket says 172.21.15.6:40690) 2024-03-12T16:36:30.187 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1edcf6700 1 -- 172.21.15.6:0/4276461592 learned_addr learned my addr 172.21.15.6:0/4276461592 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1ee4f7700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80fc830 0x7ff1e8109160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1edcf6700 1 -- 172.21.15.6:0/4276461592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80fc830 msgr2=0x7ff1e8109160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1edcf6700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80fc830 0x7ff1e8109160 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1edcf6700 1 -- 172.21.15.6:0/4276461592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ff1e4005040 con 0x7ff1e80fd100 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1edcf6700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fd100 0x7ff1e8109650 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7ff1d800e8f0 tx=0x7ff1d800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.190+0000 7ff1df7fe700 1 -- 172.21.15.6:0/4276461592 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d800ee90 con 0x7ff1e80fd100 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.191+0000 7ff1df7fe700 1 -- 172.21.15.6:0/4276461592 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ff1d800f040 con 0x7ff1e80fd100 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.191+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ff1e8109f30 con 0x7ff1e80fd100 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.191+0000 7ff1df7fe700 1 -- 172.21.15.6:0/4276461592 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ff1d800c8a0 con 0x7ff1e80fd100 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.191+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ff1e8112550 con 0x7ff1e80fd100 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.192+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ff1e805f380 con 0x7ff1e80fd100 2024-03-12T16:36:30.188 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.192+0000 7ff1df7fe700 1 -- 172.21.15.6:0/4276461592 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7ff1d8007b40 con 0x7ff1e80fd100 2024-03-12T16:36:30.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.192+0000 7ff1df7fe700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff1d406caa0 0x7ff1d406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:30.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.192+0000 7ff1df7fe700 1 -- 172.21.15.6:0/4276461592 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ff1d808bb10 con 0x7ff1e80fd100 2024-03-12T16:36:30.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.193+0000 7ff1ee4f7700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff1d406caa0 0x7ff1d406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:30.189 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.193+0000 7ff1ee4f7700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff1d406caa0 0x7ff1d406ef60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff1e4004e60 tx=0x7ff1e400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:30.192 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.197+0000 7ff1df7fe700 1 -- 172.21.15.6:0/4276461592 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ff1d8055b20 con 0x7ff1e80fd100 2024-03-12T16:36:30.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:29 smithi134 ceph-mon[85099]: pgmap v698: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:30.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:29 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2421783934' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 13, "format": "json"}]: dispatch 2024-03-12T16:36:30.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:29 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3575119718' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 14, "format": "json"}]: dispatch 2024-03-12T16:36:30.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:29 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2392476901' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 15, "format": "json"}]: dispatch 2024-03-12T16:36:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.442+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 17, "format": "json"} v 0) v1 -- 0x7ff1e805eec0 con 0x7ff1e80fd100 2024-03-12T16:36:30.437 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.442+0000 7ff1df7fe700 1 -- 172.21.15.6:0/4276461592 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 17, "format": "json"}]=0 dumped fsmap epoch 17 v33) v1 ==== 107+0+3260 (secure 0 0 0) 0x7ff1d8019cd0 con 0x7ff1e80fd100 2024-03-12T16:36:30.438 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:30.438 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":17,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14444,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1071999293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1071999293},{"type":"v1","addr":"172.21.15.6:6829","nonce":1071999293}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.444+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff1d406caa0 msgr2=0x7ff1d406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.444+0000 7ff1f075b700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff1d406caa0 0x7ff1d406ef60 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 rx=0x7ff1e4004e60 tx=0x7ff1e400b040).stop 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.444+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fd100 msgr2=0x7ff1e8109650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.444+0000 7ff1f075b700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fd100 0x7ff1e8109650 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 rx=0x7ff1d800e8f0 tx=0x7ff1d800b040).stop 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.444+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 shutdown_connections 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.444+0000 7ff1f075b700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ff1e80fc830 0x7ff1e8109160 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.444+0000 7ff1f075b700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ff1d406caa0 0x7ff1d406ef60 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.444+0000 7ff1f075b700 1 --2- 172.21.15.6:0/4276461592 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ff1e80fd100 0x7ff1e8109650 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.444+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 >> 172.21.15.6:0/4276461592 conn(0x7ff1e806c760 msgr2=0x7ff1e80ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.445+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 shutdown_connections 2024-03-12T16:36:30.440 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.445+0000 7ff1f075b700 1 -- 172.21.15.6:0/4276461592 wait complete. 2024-03-12T16:36:30.441 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 17 2024-03-12T16:36:30.452 DEBUG:tasks.fs:max_mds not reduced in epoch 17 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:30.452 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 18 2024-03-12T16:36:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 -- 172.21.15.6:0/3880640159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f93f0 msgr2=0x7f19e0101b00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 --2- 172.21.15.6:0/3880640159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f93f0 0x7f19e0101b00 secure :-1 s=READY pgs=605 cs=0 l=1 rev1=1 rx=0x7f19d00047f0 tx=0x7f19d0009cb0).stop 2024-03-12T16:36:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 -- 172.21.15.6:0/3880640159 shutdown_connections 2024-03-12T16:36:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 --2- 172.21.15.6:0/3880640159 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f93f0 0x7f19e0101b00 unknown :-1 s=CLOSED pgs=605 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 --2- 172.21.15.6:0/3880640159 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e00f8a90 0x7f19e00f8e70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 -- 172.21.15.6:0/3880640159 >> 172.21.15.6:0/3880640159 conn(0x7f19e00f2580 msgr2=0x7f19e00f49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 -- 172.21.15.6:0/3880640159 shutdown_connections 2024-03-12T16:36:30.576 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 -- 172.21.15.6:0/3880640159 wait complete. 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 Processor -- start 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.579+0000 7f19e534f700 1 -- start start 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19e534f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f8a90 0x7f19e00f6a40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19e534f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e00f93f0 0x7f19e00f6f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19e534f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00f7420 con 0x7f19e00f8a90 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19e534f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f19e00f7560 con 0x7f19e00f93f0 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f8a90 0x7f19e00f6a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19deffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f8a90 0x7f19e00f6a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40712/0 (socket says 172.21.15.6:40712) 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19deffd700 1 -- 172.21.15.6:0/708884661 learned_addr learned my addr 172.21.15.6:0/708884661 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19de7fc700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e00f93f0 0x7f19e00f6f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19deffd700 1 -- 172.21.15.6:0/708884661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e00f93f0 msgr2=0x7f19e00f6f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19deffd700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e00f93f0 0x7f19e00f6f30 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.577 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19deffd700 1 -- 172.21.15.6:0/708884661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f19d0005040 con 0x7f19e00f8a90 2024-03-12T16:36:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19de7fc700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e00f93f0 0x7f19e00f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:36:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19deffd700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f8a90 0x7f19e00f6a40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f19d400e8f0 tx=0x7f19d400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19c7fff700 1 -- 172.21.15.6:0/708884661 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19d400ee90 con 0x7f19e00f8a90 2024-03-12T16:36:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19c7fff700 1 -- 172.21.15.6:0/708884661 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f19d400f040 con 0x7f19e00f8a90 2024-03-12T16:36:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19c7fff700 1 -- 172.21.15.6:0/708884661 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f19d400c8a0 con 0x7f19e00f8a90 2024-03-12T16:36:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f19e00f7810 con 0x7f19e00f8a90 2024-03-12T16:36:30.578 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.580+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f19e0114a10 con 0x7f19e00f8a90 2024-03-12T16:36:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.581+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f19e00603f0 con 0x7f19e00f8a90 2024-03-12T16:36:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.582+0000 7f19c7fff700 1 -- 172.21.15.6:0/708884661 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f19d4007b40 con 0x7f19e00f8a90 2024-03-12T16:36:30.579 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.582+0000 7f19c7fff700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19c806caa0 0x7f19c806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.583+0000 7f19de7fc700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19c806caa0 0x7f19c806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.583+0000 7f19c7fff700 1 -- 172.21.15.6:0/708884661 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f19d408ba50 con 0x7f19e00f8a90 2024-03-12T16:36:30.580 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.583+0000 7f19de7fc700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19c806caa0 0x7f19c806ef60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f19d0004e60 tx=0x7f19d000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:30.582 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.587+0000 7f19c7fff700 1 -- 172.21.15.6:0/708884661 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f19d4055b20 con 0x7f19e00f8a90 2024-03-12T16:36:30.829 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.834+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 18, "format": "json"} v 0) v1 -- 0x7f19e005f120 con 0x7f19e00f8a90 2024-03-12T16:36:30.830 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.835+0000 7f19c7fff700 1 -- 172.21.15.6:0/708884661 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 18, "format": "json"}]=0 dumped fsmap epoch 18 v33) v1 ==== 107+0+4818 (secure 0 0 0) 0x7f19d4059140 con 0x7f19e00f8a90 2024-03-12T16:36:30.830 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:30.830 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":18,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14444,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1071999293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1071999293},{"type":"v1","addr":"172.21.15.6:6829","nonce":1071999293}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34372,"name":"cephfs.smithi006.ncuwuc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6827/1318075023","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":1318075023},{"type":"v1","addr":"172.21.15.6:6827","nonce":1318075023}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18},{"gid":44275,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/4005490805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":4005490805},{"type":"v1","addr":"172.21.15.134:6825","nonce":4005490805}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19c806caa0 msgr2=0x7f19c806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19c806caa0 0x7f19c806ef60 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 rx=0x7f19d0004e60 tx=0x7f19d000b040).stop 2024-03-12T16:36:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f8a90 msgr2=0x7f19e00f6a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.833 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f8a90 0x7f19e00f6a40 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 rx=0x7f19d400e8f0 tx=0x7f19d400b040).stop 2024-03-12T16:36:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 shutdown_connections 2024-03-12T16:36:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f19c806caa0 0x7f19c806ef60 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f19e00f8a90 0x7f19e00f6a40 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 --2- 172.21.15.6:0/708884661 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f19e00f93f0 0x7f19e00f6f30 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 >> 172.21.15.6:0/708884661 conn(0x7f19e00f2580 msgr2=0x7f19e00ff4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 shutdown_connections 2024-03-12T16:36:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.838+0000 7f19e534f700 1 -- 172.21.15.6:0/708884661 wait complete. 2024-03-12T16:36:30.834 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 18 2024-03-12T16:36:30.845 DEBUG:tasks.fs:max_mds not reduced in epoch 18 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:30.846 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 19 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.972+0000 7f2aa86ac700 1 -- 172.21.15.6:0/2064938274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fd100 msgr2=0x7f2aa00f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.972+0000 7f2aa86ac700 1 --2- 172.21.15.6:0/2064938274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fd100 0x7f2aa00f6930 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 rx=0x7f2a940047f0 tx=0x7f2a94009cb0).stop 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.972+0000 7f2aa86ac700 1 -- 172.21.15.6:0/2064938274 shutdown_connections 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.972+0000 7f2aa86ac700 1 --2- 172.21.15.6:0/2064938274 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fd100 0x7f2aa00f6930 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.972+0000 7f2aa86ac700 1 --2- 172.21.15.6:0/2064938274 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa00fc830 0x7f2aa00fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.972+0000 7f2aa86ac700 1 -- 172.21.15.6:0/2064938274 >> 172.21.15.6:0/2064938274 conn(0x7f2aa006c760 msgr2=0x7f2aa006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.972+0000 7f2aa86ac700 1 -- 172.21.15.6:0/2064938274 shutdown_connections 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.972+0000 7f2aa86ac700 1 -- 172.21.15.6:0/2064938274 wait complete. 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.973+0000 7f2aa86ac700 1 Processor -- start 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.973+0000 7f2aa86ac700 1 -- start start 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.973+0000 7f2aa86ac700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fc830 0x7f2aa010dfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:30.970 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.973+0000 7f2aa86ac700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa00fd100 0x7f2aa010e4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.973+0000 7f2aa86ac700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa010eab0 con 0x7f2aa00fc830 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.973+0000 7f2aa86ac700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f2aa010ebf0 con 0x7f2aa00fd100 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.973+0000 7f2aa6448700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fc830 0x7f2aa010dfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.973+0000 7f2aa6448700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fc830 0x7f2aa010dfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40730/0 (socket says 172.21.15.6:40730) 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.973+0000 7f2aa6448700 1 -- 172.21.15.6:0/1227952277 learned_addr learned my addr 172.21.15.6:0/1227952277 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2aa5c47700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa00fd100 0x7f2aa010e4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2aa6448700 1 -- 172.21.15.6:0/1227952277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa00fd100 msgr2=0x7f2aa010e4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2aa6448700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa00fd100 0x7f2aa010e4b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2aa6448700 1 -- 172.21.15.6:0/1227952277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f2a94005040 con 0x7f2aa00fc830 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2aa5c47700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa00fd100 0x7f2aa010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2aa6448700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fc830 0x7f2aa010dfc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f2a9c00c740 tx=0x7f2a9c007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:30.971 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2a937fe700 1 -- 172.21.15.6:0/1227952277 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a9c00e680 con 0x7f2aa00fc830 2024-03-12T16:36:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2a937fe700 1 -- 172.21.15.6:0/1227952277 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f2a9c00ec90 con 0x7f2aa00fc830 2024-03-12T16:36:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2a937fe700 1 -- 172.21.15.6:0/1227952277 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2a9c013d60 con 0x7f2aa00fc830 2024-03-12T16:36:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f2aa0108280 con 0x7f2aa00fc830 2024-03-12T16:36:30.972 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.974+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f2aa0108840 con 0x7f2aa00fc830 2024-03-12T16:36:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.975+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f2aa005f380 con 0x7f2aa00fc830 2024-03-12T16:36:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.976+0000 7f2a937fe700 1 -- 172.21.15.6:0/1227952277 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f2a9c00e7e0 con 0x7f2aa00fc830 2024-03-12T16:36:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.976+0000 7f2a937fe700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a8c06caa0 0x7f2a8c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.976+0000 7f2a937fe700 1 -- 172.21.15.6:0/1227952277 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f2a9c08c040 con 0x7f2aa00fc830 2024-03-12T16:36:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.976+0000 7f2aa5c47700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a8c06caa0 0x7f2a8c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:30.973 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.976+0000 7f2aa5c47700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a8c06caa0 0x7f2a8c06ef60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f2a940043d0 tx=0x7f2a9400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:30.975 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:30.980+0000 7f2a937fe700 1 -- 172.21.15.6:0/1227952277 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2a9c059ba0 con 0x7f2aa00fc830 2024-03-12T16:36:31.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:30 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/424267847' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-03-12T16:36:31.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:30 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/4276461592' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-03-12T16:36:31.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:30 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/424267847' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 16, "format": "json"}]: dispatch 2024-03-12T16:36:31.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:30 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/4276461592' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 17, "format": "json"}]: dispatch 2024-03-12T16:36:31.220 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.225+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 19, "format": "json"} v 0) v1 -- 0x7f2aa005eec0 con 0x7f2aa00fc830 2024-03-12T16:36:31.221 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.226+0000 7f2a937fe700 1 -- 172.21.15.6:0/1227952277 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 19, "format": "json"}]=0 dumped fsmap epoch 19 v33) v1 ==== 107+0+4042 (secure 0 0 0) 0x7f2a9c059730 con 0x7f2aa00fc830 2024-03-12T16:36:31.221 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:31.221 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":19,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14444,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1071999293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1071999293},{"type":"v1","addr":"172.21.15.6:6829","nonce":1071999293}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":44275,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/4005490805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":4005490805},{"type":"v1","addr":"172.21.15.134:6825","nonce":4005490805}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.228+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a8c06caa0 msgr2=0x7f2a8c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.228+0000 7f2aa86ac700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a8c06caa0 0x7f2a8c06ef60 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 rx=0x7f2a940043d0 tx=0x7f2a9400b040).stop 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.228+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fc830 msgr2=0x7f2aa010dfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.228+0000 7f2aa86ac700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fc830 0x7f2aa010dfc0 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 rx=0x7f2a9c00c740 tx=0x7f2a9c007ef0).stop 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.228+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 shutdown_connections 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.228+0000 7f2aa86ac700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f2a8c06caa0 0x7f2a8c06ef60 unknown :-1 s=CLOSED pgs=325 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.228+0000 7f2aa86ac700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f2aa00fc830 0x7f2aa010dfc0 unknown :-1 s=CLOSED pgs=608 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.228+0000 7f2aa86ac700 1 --2- 172.21.15.6:0/1227952277 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f2aa00fd100 0x7f2aa010e4b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.228+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 >> 172.21.15.6:0/1227952277 conn(0x7f2aa006c760 msgr2=0x7f2aa00605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.229+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 shutdown_connections 2024-03-12T16:36:31.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.229+0000 7f2aa86ac700 1 -- 172.21.15.6:0/1227952277 wait complete. 2024-03-12T16:36:31.225 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 19 2024-03-12T16:36:31.236 DEBUG:tasks.fs:max_mds not reduced in epoch 19 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:31.236 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 20 2024-03-12T16:36:31.359 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.362+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/3818680089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fd100 msgr2=0x7fb7c40f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.362+0000 7fb7cb9ad700 1 --2- 172.21.15.6:0/3818680089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fd100 0x7fb7c40f6930 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 rx=0x7fb7b40047f0 tx=0x7fb7b4009cb0).stop 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.362+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/3818680089 shutdown_connections 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.362+0000 7fb7cb9ad700 1 --2- 172.21.15.6:0/3818680089 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fd100 0x7fb7c40f6930 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.362+0000 7fb7cb9ad700 1 --2- 172.21.15.6:0/3818680089 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7c40fc830 0x7fb7c40fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.362+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/3818680089 >> 172.21.15.6:0/3818680089 conn(0x7fb7c406c760 msgr2=0x7fb7c406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.362+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/3818680089 shutdown_connections 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.362+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/3818680089 wait complete. 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7cb9ad700 1 Processor -- start 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7cb9ad700 1 -- start start 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7cb9ad700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fc830 0x7fb7c4109090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7cb9ad700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7c40fd100 0x7fb7c4109580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7cb9ad700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c4109a70 con 0x7fb7c40fc830 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7cb9ad700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb7c4109bb0 con 0x7fb7c40fd100 2024-03-12T16:36:31.360 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7c9749700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fc830 0x7fb7c4109090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7c9749700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fc830 0x7fb7c4109090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40750/0 (socket says 172.21.15.6:40750) 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7c9749700 1 -- 172.21.15.6:0/2117809450 learned_addr learned my addr 172.21.15.6:0/2117809450 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7c8f48700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7c40fd100 0x7fb7c4109580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7c9749700 1 -- 172.21.15.6:0/2117809450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7c40fd100 msgr2=0x7fb7c4109580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7c9749700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7c40fd100 0x7fb7c4109580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7c9749700 1 -- 172.21.15.6:0/2117809450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb7b4005040 con 0x7fb7c40fc830 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.363+0000 7fb7c8f48700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7c40fd100 0x7fb7c4109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.364+0000 7fb7c9749700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fc830 0x7fb7c4109090 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fb7c00041d0 tx=0x7fb7c0009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.364+0000 7fb7ba7fc700 1 -- 172.21.15.6:0/2117809450 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c0002d90 con 0x7fb7c40fc830 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.364+0000 7fb7ba7fc700 1 -- 172.21.15.6:0/2117809450 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb7c000f040 con 0x7fb7c40fc830 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.364+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb7c4109e60 con 0x7fb7c40fc830 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.364+0000 7fb7ba7fc700 1 -- 172.21.15.6:0/2117809450 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb7c000d800 con 0x7fb7c40fc830 2024-03-12T16:36:31.361 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.364+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb7c4112450 con 0x7fb7c40fc830 2024-03-12T16:36:31.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.365+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb7c405f380 con 0x7fb7c40fc830 2024-03-12T16:36:31.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.365+0000 7fb7ba7fc700 1 -- 172.21.15.6:0/2117809450 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb7c000da70 con 0x7fb7c40fc830 2024-03-12T16:36:31.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.365+0000 7fb7ba7fc700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb7b006caa0 0x7fb7b006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:31.362 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.366+0000 7fb7ba7fc700 1 -- 172.21.15.6:0/2117809450 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb7c008bd10 con 0x7fb7c40fc830 2024-03-12T16:36:31.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.366+0000 7fb7c8f48700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb7b006caa0 0x7fb7b006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:31.363 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.366+0000 7fb7c8f48700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb7b006caa0 0x7fb7b006ef60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb7b40043d0 tx=0x7fb7b400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:31.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.370+0000 7fb7ba7fc700 1 -- 172.21.15.6:0/2117809450 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb7c0055de0 con 0x7fb7c40fc830 2024-03-12T16:36:31.609 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.614+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 20, "format": "json"} v 0) v1 -- 0x7fb7c40feb60 con 0x7fb7c40fc830 2024-03-12T16:36:31.610 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.615+0000 7fb7ba7fc700 1 -- 172.21.15.6:0/2117809450 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 20, "format": "json"}]=0 dumped fsmap epoch 20 v33) v1 ==== 107+0+4818 (secure 0 0 0) 0x7fb7c0059400 con 0x7fb7c40fc830 2024-03-12T16:36:31.611 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:31.611 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":20,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":14444,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1071999293","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1071999293},{"type":"v1","addr":"172.21.15.6:6829","nonce":1071999293}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":9},{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44275,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/4005490805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":4005490805},{"type":"v1","addr":"172.21.15.134:6825","nonce":4005490805}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:31.613 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb7b006caa0 msgr2=0x7fb7b006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb7b006caa0 0x7fb7b006ef60 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 rx=0x7fb7b40043d0 tx=0x7fb7b400b040).stop 2024-03-12T16:36:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fc830 msgr2=0x7fb7c4109090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fc830 0x7fb7c4109090 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 rx=0x7fb7c00041d0 tx=0x7fb7c0009f60).stop 2024-03-12T16:36:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 shutdown_connections 2024-03-12T16:36:31.614 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb7b006caa0 0x7fb7b006ef60 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb7c40fc830 0x7fb7c4109090 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 --2- 172.21.15.6:0/2117809450 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb7c40fd100 0x7fb7c4109580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 >> 172.21.15.6:0/2117809450 conn(0x7fb7c406c760 msgr2=0x7fb7c40fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 shutdown_connections 2024-03-12T16:36:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.617+0000 7fb7cb9ad700 1 -- 172.21.15.6:0/2117809450 wait complete. 2024-03-12T16:36:31.615 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 20 2024-03-12T16:36:31.625 DEBUG:tasks.fs:max_mds not reduced in epoch 20 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:31.626 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 21 2024-03-12T16:36:31.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.753+0000 7f20b21c7700 1 -- 172.21.15.6:0/1153758792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fc830 msgr2=0x7f20ac0fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:31.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.753+0000 7f20b21c7700 1 --2- 172.21.15.6:0/1153758792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fc830 0x7f20ac0fcc10 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 rx=0x7f209c0047f0 tx=0x7f209c009cb0).stop 2024-03-12T16:36:31.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.753+0000 7f20b21c7700 1 -- 172.21.15.6:0/1153758792 shutdown_connections 2024-03-12T16:36:31.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.753+0000 7f20b21c7700 1 --2- 172.21.15.6:0/1153758792 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ac0fd100 0x7f20ac0f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.753 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.753+0000 7f20b21c7700 1 --2- 172.21.15.6:0/1153758792 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fc830 0x7f20ac0fcc10 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.753+0000 7f20b21c7700 1 -- 172.21.15.6:0/1153758792 >> 172.21.15.6:0/1153758792 conn(0x7f20ac06c760 msgr2=0x7f20ac06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.753+0000 7f20b21c7700 1 -- 172.21.15.6:0/1153758792 shutdown_connections 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.753+0000 7f20b21c7700 1 -- 172.21.15.6:0/1153758792 wait complete. 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.753+0000 7f20b21c7700 1 Processor -- start 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20b21c7700 1 -- start start 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20b21c7700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ac0fc830 0x7f20ac10df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20b21c7700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fd100 0x7f20ac10e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20b21c7700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac10ea50 con 0x7f20ac0fd100 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20b21c7700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f20ac10eb90 con 0x7f20ac0fc830 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fd100 0x7f20ac10e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20aaffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fd100 0x7f20ac10e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40758/0 (socket says 172.21.15.6:40758) 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20aaffd700 1 -- 172.21.15.6:0/2270401623 learned_addr learned my addr 172.21.15.6:0/2270401623 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:31.754 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20ab7fe700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ac0fc830 0x7f20ac10df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20aaffd700 1 -- 172.21.15.6:0/2270401623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ac0fc830 msgr2=0x7f20ac10df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20aaffd700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ac0fc830 0x7f20ac10df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20aaffd700 1 -- 172.21.15.6:0/2270401623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f209c005040 con 0x7f20ac0fd100 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20ab7fe700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ac0fc830 0x7f20ac10df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20aaffd700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fd100 0x7f20ac10e450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f20940041d0 tx=0x7f2094009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.754+0000 7f20a8ff9700 1 -- 172.21.15.6:0/2270401623 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f2094002d90 con 0x7f20ac0fd100 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.755+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f20ac108220 con 0x7f20ac0fd100 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.755+0000 7f20a8ff9700 1 -- 172.21.15.6:0/2270401623 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f209400f040 con 0x7f20ac0fd100 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.755+0000 7f20a8ff9700 1 -- 172.21.15.6:0/2270401623 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f209400d800 con 0x7f20ac0fd100 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.755+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f20ac1087e0 con 0x7f20ac0fd100 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.756+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f20ac05f380 con 0x7f20ac0fd100 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.756+0000 7f20a8ff9700 1 -- 172.21.15.6:0/2270401623 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f209400dae0 con 0x7f20ac0fd100 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.756+0000 7f20a8ff9700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f209806caa0 0x7f209806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.757+0000 7f20a8ff9700 1 -- 172.21.15.6:0/2270401623 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f209408be80 con 0x7f20ac0fd100 2024-03-12T16:36:31.755 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.757+0000 7f20ab7fe700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f209806caa0 0x7f209806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:31.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.757+0000 7f20ab7fe700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f209806caa0 0x7f209806ef60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f209c0043d0 tx=0x7f209c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:31.756 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:31.761+0000 7f20a8ff9700 1 -- 172.21.15.6:0/2270401623 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f2094059920 con 0x7f20ac0fd100 2024-03-12T16:36:31.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:31 smithi006 ceph-mon[103869]: pgmap v699: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:31.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:31 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/708884661' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-03-12T16:36:31.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:31 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1227952277' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-03-12T16:36:31.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:31 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2117809450' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-03-12T16:36:31.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.002+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 21, "format": "json"} v 0) v1 -- 0x7f20ac05eec0 con 0x7f20ac0fd100 2024-03-12T16:36:31.997 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.002+0000 7f20a8ff9700 1 -- 172.21.15.6:0/2270401623 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 21, "format": "json"}]=0 dumped fsmap epoch 21 v33) v1 ==== 107+0+4043 (secure 0 0 0) 0x7f20940594b0 con 0x7f20ac0fd100 2024-03-12T16:36:31.998 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:31.998 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":21,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":44275,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/4005490805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":4005490805},{"type":"v1","addr":"172.21.15.134:6825","nonce":4005490805}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.004+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f209806caa0 msgr2=0x7f209806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.004+0000 7f20b21c7700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f209806caa0 0x7f209806ef60 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 rx=0x7f209c0043d0 tx=0x7f209c00b040).stop 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.004+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fd100 msgr2=0x7f20ac10e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.004+0000 7f20b21c7700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fd100 0x7f20ac10e450 secure :-1 s=READY pgs=612 cs=0 l=1 rev1=1 rx=0x7f20940041d0 tx=0x7f2094009f60).stop 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.004+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 shutdown_connections 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.004+0000 7f20b21c7700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f20ac0fc830 0x7f20ac10df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.004+0000 7f20b21c7700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f209806caa0 0x7f209806ef60 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.004+0000 7f20b21c7700 1 --2- 172.21.15.6:0/2270401623 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f20ac0fd100 0x7f20ac10e450 unknown :-1 s=CLOSED pgs=612 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.004+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 >> 172.21.15.6:0/2270401623 conn(0x7f20ac06c760 msgr2=0x7f20ac0605b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.005+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 shutdown_connections 2024-03-12T16:36:32.000 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.005+0000 7f20b21c7700 1 -- 172.21.15.6:0/2270401623 wait complete. 2024-03-12T16:36:32.001 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 21 2024-03-12T16:36:32.012 DEBUG:tasks.fs:max_mds not reduced in epoch 21 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:32.012 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 22 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.139+0000 7f1c057ba700 1 -- 172.21.15.6:0/325378449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f8a90 msgr2=0x7f1c000f8e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.139+0000 7f1c057ba700 1 --2- 172.21.15.6:0/325378449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f8a90 0x7f1c000f8e70 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 rx=0x7f1bf00047f0 tx=0x7f1bf0009cb0).stop 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.139+0000 7f1c057ba700 1 -- 172.21.15.6:0/325378449 shutdown_connections 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.139+0000 7f1c057ba700 1 --2- 172.21.15.6:0/325378449 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c000f93f0 0x7f1c00101b00 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.139+0000 7f1c057ba700 1 --2- 172.21.15.6:0/325378449 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f8a90 0x7f1c000f8e70 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.139+0000 7f1c057ba700 1 -- 172.21.15.6:0/325378449 >> 172.21.15.6:0/325378449 conn(0x7f1c000f2580 msgr2=0x7f1c000f49a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.139+0000 7f1c057ba700 1 -- 172.21.15.6:0/325378449 shutdown_connections 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.139+0000 7f1c057ba700 1 -- 172.21.15.6:0/325378449 wait complete. 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.139+0000 7f1c057ba700 1 Processor -- start 2024-03-12T16:36:32.136 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1c057ba700 1 -- start start 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1c057ba700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c000f8a90 0x7f1c0010e3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1c057ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f93f0 0x7f1c0010e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1c057ba700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0010eec0 con 0x7f1c000f93f0 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1c057ba700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f1c0010f000 con 0x7f1c000f8a90 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1bfe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f93f0 0x7f1c0010e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1bfe7fc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f93f0 0x7f1c0010e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:40774/0 (socket says 172.21.15.6:40774) 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1bfe7fc700 1 -- 172.21.15.6:0/690742241 learned_addr learned my addr 172.21.15.6:0/690742241 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1bfeffd700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c000f8a90 0x7f1c0010e3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1bfe7fc700 1 -- 172.21.15.6:0/690742241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c000f8a90 msgr2=0x7f1c0010e3d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1bfe7fc700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c000f8a90 0x7f1c0010e3d0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1bfe7fc700 1 -- 172.21.15.6:0/690742241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f1bf0005040 con 0x7f1c000f93f0 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1bfe7fc700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f93f0 0x7f1c0010e8c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f1bf4002770 tx=0x7f1bf4002a80).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1be7fff700 1 -- 172.21.15.6:0/690742241 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf4007b40 con 0x7f1c000f93f0 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f1c00108690 con 0x7f1c000f93f0 2024-03-12T16:36:32.137 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1be7fff700 1 -- 172.21.15.6:0/690742241 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f1bf400f040 con 0x7f1c000f93f0 2024-03-12T16:36:32.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.140+0000 7f1be7fff700 1 -- 172.21.15.6:0/690742241 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f1bf4014820 con 0x7f1c000f93f0 2024-03-12T16:36:32.138 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.141+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f1c00108bd0 con 0x7f1c000f93f0 2024-03-12T16:36:32.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.141+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f1c000603f0 con 0x7f1c000f93f0 2024-03-12T16:36:32.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.142+0000 7f1be7fff700 1 -- 172.21.15.6:0/690742241 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f1bf4007ca0 con 0x7f1c000f93f0 2024-03-12T16:36:32.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.142+0000 7f1be7fff700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1be806caa0 0x7f1be806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:32.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.142+0000 7f1be7fff700 1 -- 172.21.15.6:0/690742241 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f1bf408b980 con 0x7f1c000f93f0 2024-03-12T16:36:32.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.142+0000 7f1bfeffd700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1be806caa0 0x7f1be806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:32.139 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.143+0000 7f1bfeffd700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1be806caa0 0x7f1be806ef60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f1bf0004f10 tx=0x7f1bf000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:32.142 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.147+0000 7f1be7fff700 1 -- 172.21.15.6:0/690742241 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f1bf40594e0 con 0x7f1c000f93f0 2024-03-12T16:36:32.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:31 smithi134 ceph-mon[85099]: pgmap v699: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:32.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:31 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/708884661' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 18, "format": "json"}]: dispatch 2024-03-12T16:36:32.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:31 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1227952277' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 19, "format": "json"}]: dispatch 2024-03-12T16:36:32.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:31 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2117809450' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 20, "format": "json"}]: dispatch 2024-03-12T16:36:32.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.389+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 22, "format": "json"} v 0) v1 -- 0x7f1c0005f0f0 con 0x7f1c000f93f0 2024-03-12T16:36:32.385 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.390+0000 7f1be7fff700 1 -- 172.21.15.6:0/690742241 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 22, "format": "json"}]=0 dumped fsmap epoch 22 v33) v1 ==== 107+0+4819 (secure 0 0 0) 0x7f1bf4059070 con 0x7f1c000f93f0 2024-03-12T16:36:32.386 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:32.386 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":22,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44275,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/4005490805","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":4005490805},{"type":"v1","addr":"172.21.15.134:6825","nonce":4005490805}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":18}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1be806caa0 msgr2=0x7f1be806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1be806caa0 0x7f1be806ef60 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 rx=0x7f1bf0004f10 tx=0x7f1bf000b040).stop 2024-03-12T16:36:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f93f0 msgr2=0x7f1c0010e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f93f0 0x7f1c0010e8c0 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 rx=0x7f1bf4002770 tx=0x7f1bf4002a80).stop 2024-03-12T16:36:32.387 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 shutdown_connections 2024-03-12T16:36:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f1c000f8a90 0x7f1c0010e3d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f1be806caa0 0x7f1be806ef60 unknown :-1 s=CLOSED pgs=328 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 --2- 172.21.15.6:0/690742241 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f1c000f93f0 0x7f1c0010e8c0 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 >> 172.21.15.6:0/690742241 conn(0x7f1c000f2580 msgr2=0x7f1c000ff440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 shutdown_connections 2024-03-12T16:36:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.392+0000 7f1c057ba700 1 -- 172.21.15.6:0/690742241 wait complete. 2024-03-12T16:36:32.388 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 22 2024-03-12T16:36:32.399 DEBUG:tasks.fs:max_mds not reduced in epoch 22 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:32.399 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 23 2024-03-12T16:36:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.525+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3215300228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b110 msgr2=0x7f7a2806b4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.525+0000 7f7a2cca4700 1 --2- 172.21.15.6:0/3215300228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b110 0x7f7a2806b4f0 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 rx=0x7f7a180047f0 tx=0x7f7a18009cb0).stop 2024-03-12T16:36:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.525+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3215300228 shutdown_connections 2024-03-12T16:36:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.525+0000 7f7a2cca4700 1 --2- 172.21.15.6:0/3215300228 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2806b9e0 0x7f7a28103ca0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.525+0000 7f7a2cca4700 1 --2- 172.21.15.6:0/3215300228 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b110 0x7f7a2806b4f0 unknown :-1 s=CLOSED pgs=615 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.525+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3215300228 >> 172.21.15.6:0/3215300228 conn(0x7f7a280f34d0 msgr2=0x7f7a280f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.525+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3215300228 shutdown_connections 2024-03-12T16:36:32.521 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.525+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3215300228 wait complete. 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.526+0000 7f7a2cca4700 1 Processor -- start 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.526+0000 7f7a2cca4700 1 -- start start 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a2cca4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2806b110 0x7f7a281102b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a2cca4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b9e0 0x7f7a281107a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a2cca4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a28110da0 con 0x7f7a2806b9e0 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a2cca4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a28110ee0 con 0x7f7a2806b110 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a25d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b9e0 0x7f7a281107a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a25d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b9e0 0x7f7a281107a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60070/0 (socket says 172.21.15.6:60070) 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a25d9b700 1 -- 172.21.15.6:0/3097673318 learned_addr learned my addr 172.21.15.6:0/3097673318 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a2659c700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2806b110 0x7f7a281102b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:32.524 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a25d9b700 1 -- 172.21.15.6:0/3097673318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2806b110 msgr2=0x7f7a281102b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a25d9b700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2806b110 0x7f7a281102b0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a25d9b700 1 -- 172.21.15.6:0/3097673318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a18005040 con 0x7f7a2806b9e0 2024-03-12T16:36:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a25d9b700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b9e0 0x7f7a281107a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f7a100041d0 tx=0x7f7a10009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.527+0000 7f7a1f7fe700 1 -- 172.21.15.6:0/3097673318 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a10007b40 con 0x7f7a2806b9e0 2024-03-12T16:36:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.528+0000 7f7a1f7fe700 1 -- 172.21.15.6:0/3097673318 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a1000f040 con 0x7f7a2806b9e0 2024-03-12T16:36:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.528+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2810a5c0 con 0x7f7a2806b9e0 2024-03-12T16:36:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.528+0000 7f7a1f7fe700 1 -- 172.21.15.6:0/3097673318 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a100147b0 con 0x7f7a2806b9e0 2024-03-12T16:36:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.528+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2810ab00 con 0x7f7a2806b9e0 2024-03-12T16:36:32.525 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.529+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2805f360 con 0x7f7a2806b9e0 2024-03-12T16:36:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.530+0000 7f7a1f7fe700 1 -- 172.21.15.6:0/3097673318 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7a10009110 con 0x7f7a2806b9e0 2024-03-12T16:36:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.530+0000 7f7a1f7fe700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.530+0000 7f7a1f7fe700 1 -- 172.21.15.6:0/3097673318 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f7a1008bfb0 con 0x7f7a2806b9e0 2024-03-12T16:36:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.530+0000 7f7a2659c700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:32.526 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.530+0000 7f7a2659c700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f7a18004f10 tx=0x7f7a1800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:32.529 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.534+0000 7f7a1f7fe700 1 -- 172.21.15.6:0/3097673318 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7a10059b90 con 0x7f7a2806b9e0 2024-03-12T16:36:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.775+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 23, "format": "json"} v 0) v1 -- 0x7f7a2810b9d0 con 0x7f7a2806b9e0 2024-03-12T16:36:32.774 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.775+0000 7f7a1f7fe700 1 -- 172.21.15.6:0/3097673318 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 23, "format": "json"}]=0 dumped fsmap epoch 23 v33) v1 ==== 107+0+4037 (secure 0 0 0) 0x7f7a10059720 con 0x7f7a2806b9e0 2024-03-12T16:36:32.774 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:32.775 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":23,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.777+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 msgr2=0x7f7a1406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.777+0000 7f7a2cca4700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 rx=0x7f7a18004f10 tx=0x7f7a1800b040).stop 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.777+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b9e0 msgr2=0x7f7a281107a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.777+0000 7f7a2cca4700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b9e0 0x7f7a281107a0 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 rx=0x7f7a100041d0 tx=0x7f7a10009f60).stop 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.778+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 shutdown_connections 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.778+0000 7f7a2cca4700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2806b110 0x7f7a281102b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.778+0000 7f7a2cca4700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.778+0000 7f7a2cca4700 1 --2- 172.21.15.6:0/3097673318 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2806b9e0 0x7f7a281107a0 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.778+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 >> 172.21.15.6:0/3097673318 conn(0x7f7a280f34d0 msgr2=0x7f7a28103690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.778+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 shutdown_connections 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.778+0000 7f7a2cca4700 1 -- 172.21.15.6:0/3097673318 wait complete. 2024-03-12T16:36:32.776 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 23 2024-03-12T16:36:32.785 DEBUG:tasks.fs:max_mds not reduced in epoch 23 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:32.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 24 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.911+0000 7fba456d4700 1 -- 172.21.15.6:0/3378986944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f9450 msgr2=0x7fba40101b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.911+0000 7fba456d4700 1 --2- 172.21.15.6:0/3378986944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f9450 0x7fba40101b60 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 rx=0x7fba300047f0 tx=0x7fba30009cb0).stop 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.911+0000 7fba456d4700 1 -- 172.21.15.6:0/3378986944 shutdown_connections 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.911+0000 7fba456d4700 1 --2- 172.21.15.6:0/3378986944 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f9450 0x7fba40101b60 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.911+0000 7fba456d4700 1 --2- 172.21.15.6:0/3378986944 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba400f8af0 0x7fba400f8ed0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.911+0000 7fba456d4700 1 -- 172.21.15.6:0/3378986944 >> 172.21.15.6:0/3378986944 conn(0x7fba400f2540 msgr2=0x7fba400f4960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.912+0000 7fba456d4700 1 -- 172.21.15.6:0/3378986944 shutdown_connections 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.912+0000 7fba456d4700 1 -- 172.21.15.6:0/3378986944 wait complete. 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.912+0000 7fba456d4700 1 Processor -- start 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.912+0000 7fba456d4700 1 -- start start 2024-03-12T16:36:32.909 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.912+0000 7fba456d4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f8af0 0x7fba4010e2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.912+0000 7fba456d4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba400f9450 0x7fba4010e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.912+0000 7fba456d4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4010edb0 con 0x7fba400f8af0 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.912+0000 7fba456d4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fba4010eef0 con 0x7fba400f9450 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba3effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f8af0 0x7fba4010e2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba3effd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f8af0 0x7fba4010e2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60088/0 (socket says 172.21.15.6:60088) 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba3effd700 1 -- 172.21.15.6:0/4156360511 learned_addr learned my addr 172.21.15.6:0/4156360511 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba3e7fc700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba400f9450 0x7fba4010e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba3effd700 1 -- 172.21.15.6:0/4156360511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba400f9450 msgr2=0x7fba4010e7b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba3effd700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba400f9450 0x7fba4010e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba3effd700 1 -- 172.21.15.6:0/4156360511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fba30005040 con 0x7fba400f8af0 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba3effd700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f8af0 0x7fba4010e2c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fba3400c740 tx=0x7fba34007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba27fff700 1 -- 172.21.15.6:0/4156360511 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba3400e680 con 0x7fba400f8af0 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba27fff700 1 -- 172.21.15.6:0/4156360511 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fba3400ec90 con 0x7fba400f8af0 2024-03-12T16:36:32.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fba40108580 con 0x7fba400f8af0 2024-03-12T16:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba27fff700 1 -- 172.21.15.6:0/4156360511 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fba34013d60 con 0x7fba400f8af0 2024-03-12T16:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.913+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fba40108ac0 con 0x7fba400f8af0 2024-03-12T16:36:32.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.914+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fba400603f0 con 0x7fba400f8af0 2024-03-12T16:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.915+0000 7fba27fff700 1 -- 172.21.15.6:0/4156360511 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fba3400e7e0 con 0x7fba400f8af0 2024-03-12T16:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.915+0000 7fba27fff700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fba2806caa0 0x7fba2806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.915+0000 7fba27fff700 1 -- 172.21.15.6:0/4156360511 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fba3408c040 con 0x7fba400f8af0 2024-03-12T16:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.915+0000 7fba3e7fc700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fba2806caa0 0x7fba2806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:32.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.916+0000 7fba3e7fc700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fba2806caa0 0x7fba2806ef60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fba300043d0 tx=0x7fba3000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:32.914 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:32.920+0000 7fba27fff700 1 -- 172.21.15.6:0/4156360511 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fba34059ba0 con 0x7fba400f8af0 2024-03-12T16:36:33.157 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.162+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 24, "format": "json"} v 0) v1 -- 0x7fba4005fb30 con 0x7fba400f8af0 2024-03-12T16:36:33.158 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.163+0000 7fba27fff700 1 -- 172.21.15.6:0/4156360511 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 24, "format": "json"}]=0 dumped fsmap epoch 24 v33) v1 ==== 107+0+4816 (secure 0 0 0) 0x7fba34059730 con 0x7fba400f8af0 2024-03-12T16:36:33.158 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:33.158 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":24,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":24283,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/2682762789","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":2682762789},{"type":"v1","addr":"172.21.15.134:6827","nonce":2682762789}]},"join_fscid":1,"export_targets":[],"features":4540138314316775423,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":11},{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:33.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fba2806caa0 msgr2=0x7fba2806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fba2806caa0 0x7fba2806ef60 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 rx=0x7fba300043d0 tx=0x7fba3000b040).stop 2024-03-12T16:36:33.160 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f8af0 msgr2=0x7fba4010e2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f8af0 0x7fba4010e2c0 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 rx=0x7fba3400c740 tx=0x7fba34007ef0).stop 2024-03-12T16:36:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 shutdown_connections 2024-03-12T16:36:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fba2806caa0 0x7fba2806ef60 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fba400f8af0 0x7fba4010e2c0 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 --2- 172.21.15.6:0/4156360511 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fba400f9450 0x7fba4010e7b0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 >> 172.21.15.6:0/4156360511 conn(0x7fba400f2540 msgr2=0x7fba40101440 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 shutdown_connections 2024-03-12T16:36:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.165+0000 7fba456d4700 1 -- 172.21.15.6:0/4156360511 wait complete. 2024-03-12T16:36:33.161 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 24 2024-03-12T16:36:33.171 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:36:33.171 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:32 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2270401623' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-03-12T16:36:33.171 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:32 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/690742241' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-03-12T16:36:33.172 DEBUG:tasks.fs:max_mds not reduced in epoch 24 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:33.173 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 25 2024-03-12T16:36:33.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:36:33.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:32 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2270401623' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 21, "format": "json"}]: dispatch 2024-03-12T16:36:33.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:32 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/690742241' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 22, "format": "json"}]: dispatch 2024-03-12T16:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.298+0000 7f1252474700 1 -- 172.21.15.6:0/193312784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 msgr2=0x7f124c0fdcd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.298+0000 7f1252474700 1 --2- 172.21.15.6:0/193312784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 0x7f124c0fdcd0 secure :-1 s=READY pgs=619 cs=0 l=1 rev1=1 rx=0x7f123c0047f0 tx=0x7f123c009cb0).stop 2024-03-12T16:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.298+0000 7f1252474700 1 -- 172.21.15.6:0/193312784 shutdown_connections 2024-03-12T16:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.298+0000 7f1252474700 1 --2- 172.21.15.6:0/193312784 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f124c0fe250 0x7f124c0f7a30 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.298+0000 7f1252474700 1 --2- 172.21.15.6:0/193312784 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 0x7f124c0fdcd0 unknown :-1 s=CLOSED pgs=619 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.298+0000 7f1252474700 1 -- 172.21.15.6:0/193312784 >> 172.21.15.6:0/193312784 conn(0x7f124c0f34d0 msgr2=0x7f124c0f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.298+0000 7f1252474700 1 -- 172.21.15.6:0/193312784 shutdown_connections 2024-03-12T16:36:33.294 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.298+0000 7f1252474700 1 -- 172.21.15.6:0/193312784 wait complete. 2024-03-12T16:36:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.299+0000 7f1252474700 1 Processor -- start 2024-03-12T16:36:33.295 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.299+0000 7f1252474700 1 -- start start 2024-03-12T16:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.299+0000 7f1252474700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 0x7f124c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.299+0000 7f1252474700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f124c0fe250 0x7f124c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.299+0000 7f1252474700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c06bab0 con 0x7f124c0fd8f0 2024-03-12T16:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.299+0000 7f1252474700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f124c06bbf0 con 0x7f124c0fe250 2024-03-12T16:36:33.297 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.299+0000 7f124bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 0x7f124c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.299+0000 7f124bfff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 0x7f124c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60106/0 (socket says 172.21.15.6:60106) 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.299+0000 7f124bfff700 1 -- 172.21.15.6:0/4043036633 learned_addr learned my addr 172.21.15.6:0/4043036633 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f124b7fe700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f124c0fe250 0x7f124c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f124bfff700 1 -- 172.21.15.6:0/4043036633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f124c0fe250 msgr2=0x7f124c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f124bfff700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f124c0fe250 0x7f124c06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f124bfff700 1 -- 172.21.15.6:0/4043036633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f123c005040 con 0x7f124c0fd8f0 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f124b7fe700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f124c0fe250 0x7f124c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f124bfff700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 0x7f124c06b0d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f123c00b120 tx=0x7f123c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f12497fa700 1 -- 172.21.15.6:0/4043036633 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123c00e030 con 0x7f124c0fd8f0 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f12497fa700 1 -- 172.21.15.6:0/4043036633 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f123c007e90 con 0x7f124c0fd8f0 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f12497fa700 1 -- 172.21.15.6:0/4043036633 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f123c018070 con 0x7f124c0fd8f0 2024-03-12T16:36:33.298 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f124c06be40 con 0x7f124c0fd8f0 2024-03-12T16:36:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.300+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f124c1145e0 con 0x7f124c0fd8f0 2024-03-12T16:36:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.301+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f124c05f360 con 0x7f124c0fd8f0 2024-03-12T16:36:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.301+0000 7f12497fa700 1 -- 172.21.15.6:0/4043036633 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f123c01d420 con 0x7f124c0fd8f0 2024-03-12T16:36:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.302+0000 7f12497fa700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f123406caa0 0x7f123406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.302+0000 7f12497fa700 1 -- 172.21.15.6:0/4043036633 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f123c08d300 con 0x7f124c0fd8f0 2024-03-12T16:36:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.302+0000 7f124b7fe700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f123406caa0 0x7f123406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:33.299 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.302+0000 7f124b7fe700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f123406caa0 0x7f123406ef60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f124c06c870 tx=0x7f1240009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:33.301 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.306+0000 7f12497fa700 1 -- 172.21.15.6:0/4043036633 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f123c057310 con 0x7f124c0fd8f0 2024-03-12T16:36:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.551+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 25, "format": "json"} v 0) v1 -- 0x7f124c0ffc80 con 0x7f124c0fd8f0 2024-03-12T16:36:33.546 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.551+0000 7f12497fa700 1 -- 172.21.15.6:0/4043036633 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 25, "format": "json"}]=0 dumped fsmap epoch 25 v33) v1 ==== 107+0+4034 (secure 0 0 0) 0x7f123c05a930 con 0x7f124c0fd8f0 2024-03-12T16:36:33.546 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:33.547 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":25,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:33.548 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f123406caa0 msgr2=0x7f123406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f123406caa0 0x7f123406ef60 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 rx=0x7f124c06c870 tx=0x7f1240009040).stop 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 msgr2=0x7f124c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 0x7f124c06b0d0 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 rx=0x7f123c00b120 tx=0x7f123c009cb0).stop 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 shutdown_connections 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f123406caa0 0x7f123406ef60 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f124c0fd8f0 0x7f124c06b0d0 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 --2- 172.21.15.6:0/4043036633 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f124c0fe250 0x7f124c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 >> 172.21.15.6:0/4043036633 conn(0x7f124c0f34d0 msgr2=0x7f124c0fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 shutdown_connections 2024-03-12T16:36:33.549 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.553+0000 7f1252474700 1 -- 172.21.15.6:0/4043036633 wait complete. 2024-03-12T16:36:33.550 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 25 2024-03-12T16:36:33.561 DEBUG:tasks.fs:max_mds not reduced in epoch 25 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:33.561 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 26 2024-03-12T16:36:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.687+0000 7fe5f476f700 1 -- 172.21.15.6:0/398159148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f89f0 msgr2=0x7fe5ec0f8dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.687+0000 7fe5f476f700 1 --2- 172.21.15.6:0/398159148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f89f0 0x7fe5ec0f8dd0 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 rx=0x7fe5e80047f0 tx=0x7fe5e8009cb0).stop 2024-03-12T16:36:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.687+0000 7fe5f476f700 1 -- 172.21.15.6:0/398159148 shutdown_connections 2024-03-12T16:36:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.687+0000 7fe5f476f700 1 --2- 172.21.15.6:0/398159148 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec0f92c0 0x7fe5ec101a60 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.684 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.687+0000 7fe5f476f700 1 --2- 172.21.15.6:0/398159148 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f89f0 0x7fe5ec0f8dd0 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.687+0000 7fe5f476f700 1 -- 172.21.15.6:0/398159148 >> 172.21.15.6:0/398159148 conn(0x7fe5ec06c760 msgr2=0x7fe5ec06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.687+0000 7fe5f476f700 1 -- 172.21.15.6:0/398159148 shutdown_connections 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.687+0000 7fe5f476f700 1 -- 172.21.15.6:0/398159148 wait complete. 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f476f700 1 Processor -- start 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f476f700 1 -- start start 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f476f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec0f89f0 0x7fe5ec110170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f476f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f92c0 0x7fe5ec110660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f476f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec110c60 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f476f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe5ec110da0 con 0x7fe5ec0f89f0 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f1d0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f92c0 0x7fe5ec110660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f1d0a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f92c0 0x7fe5ec110660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60128/0 (socket says 172.21.15.6:60128) 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f1d0a700 1 -- 172.21.15.6:0/3813518618 learned_addr learned my addr 172.21.15.6:0/3813518618 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f250b700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec0f89f0 0x7fe5ec110170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:33.685 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f1d0a700 1 -- 172.21.15.6:0/3813518618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec0f89f0 msgr2=0x7fe5ec110170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f1d0a700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec0f89f0 0x7fe5ec110170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f1d0a700 1 -- 172.21.15.6:0/3813518618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe5e8005040 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.688+0000 7fe5f1d0a700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f92c0 0x7fe5ec110660 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fe5dc00c740 tx=0x7fe5dc007ef0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.689+0000 7fe5e37fe700 1 -- 172.21.15.6:0/3813518618 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5dc00e680 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.689+0000 7fe5e37fe700 1 -- 172.21.15.6:0/3813518618 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe5dc00ec90 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.689+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe5ec10a470 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.689+0000 7fe5e37fe700 1 -- 172.21.15.6:0/3813518618 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe5dc013d60 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.686 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.689+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe5ec10a9b0 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.690+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe5ec05f380 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.690+0000 7fe5e37fe700 1 -- 172.21.15.6:0/3813518618 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe5dc00e7e0 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.691+0000 7fe5e37fe700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5d806caa0 0x7fe5d806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.691+0000 7fe5e37fe700 1 -- 172.21.15.6:0/3813518618 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe5dc08c040 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.691+0000 7fe5f250b700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5d806caa0 0x7fe5d806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:33.687 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.691+0000 7fe5f250b700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5d806caa0 0x7fe5d806ef60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fe5e80043d0 tx=0x7fe5e800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:33.690 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.695+0000 7fe5e37fe700 1 -- 172.21.15.6:0/3813518618 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe5dc056110 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.941+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 26, "format": "json"} v 0) v1 -- 0x7fe5ec05eec0 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.936 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.941+0000 7fe5e37fe700 1 -- 172.21.15.6:0/3813518618 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 26, "format": "json"}]=0 dumped fsmap epoch 26 v33) v1 ==== 107+0+4813 (secure 0 0 0) 0x7fe5dc059730 con 0x7fe5ec0f92c0 2024-03-12T16:36:33.937 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:33.937 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":26,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44343,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/665910356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":665910356},{"type":"v1","addr":"172.21.15.134:6827","nonce":665910356}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":17,"flags":19,"flags_state":{"joinable":false,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:18:54.112159+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5d806caa0 msgr2=0x7fe5d806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5d806caa0 0x7fe5d806ef60 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 rx=0x7fe5e80043d0 tx=0x7fe5e800b040).stop 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f92c0 msgr2=0x7fe5ec110660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f92c0 0x7fe5ec110660 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 rx=0x7fe5dc00c740 tx=0x7fe5dc007ef0).stop 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 shutdown_connections 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe5ec0f89f0 0x7fe5ec110170 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe5d806caa0 0x7fe5d806ef60 unknown :-1 s=CLOSED pgs=332 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 --2- 172.21.15.6:0/3813518618 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe5ec0f92c0 0x7fe5ec110660 unknown :-1 s=CLOSED pgs=622 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 >> 172.21.15.6:0/3813518618 conn(0x7fe5ec06c760 msgr2=0x7fe5ec0f67d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 shutdown_connections 2024-03-12T16:36:33.939 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:33.943+0000 7fe5f476f700 1 -- 172.21.15.6:0/3813518618 wait complete. 2024-03-12T16:36:33.940 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 26 2024-03-12T16:36:33.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:33 smithi006 ceph-mon[103869]: pgmap v700: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:33.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:33 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3097673318' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-03-12T16:36:33.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:33 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/4156360511' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-03-12T16:36:33.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:33 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/4043036633' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-03-12T16:36:33.951 DEBUG:tasks.fs:max_mds not reduced in epoch 26 as fs was failed for carrying out rapid multi-rank mds upgrade 2024-03-12T16:36:33.951 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 27 2024-03-12T16:36:34.074 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.077+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2167453417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 msgr2=0x7f5b880f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.077+0000 7f5b8ee61700 1 --2- 172.21.15.6:0/2167453417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 0x7f5b880f6930 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 rx=0x7f5b740047f0 tx=0x7f5b74009cb0).stop 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.077+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2167453417 shutdown_connections 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.077+0000 7f5b8ee61700 1 --2- 172.21.15.6:0/2167453417 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 0x7f5b880f6930 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.077+0000 7f5b8ee61700 1 --2- 172.21.15.6:0/2167453417 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b880fc830 0x7f5b880fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.077+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2167453417 >> 172.21.15.6:0/2167453417 conn(0x7f5b8806c760 msgr2=0x7f5b8806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.077+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2167453417 shutdown_connections 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.077+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2167453417 wait complete. 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b8ee61700 1 Processor -- start 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b8ee61700 1 -- start start 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b8ee61700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b880fc830 0x7f5b8810cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b8ee61700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 0x7f5b8810d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b8ee61700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8810dad0 con 0x7f5b880fd100 2024-03-12T16:36:34.075 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b8ee61700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5b8810dc10 con 0x7f5b880fc830 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 0x7f5b8810d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b87fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 0x7f5b8810d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60136/0 (socket says 172.21.15.6:60136) 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b87fff700 1 -- 172.21.15.6:0/2016395850 learned_addr learned my addr 172.21.15.6:0/2016395850 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b8cbfd700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b880fc830 0x7f5b8810cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b87fff700 1 -- 172.21.15.6:0/2016395850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b880fc830 msgr2=0x7f5b8810cfe0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b87fff700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b880fc830 0x7f5b8810cfe0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.078+0000 7f5b87fff700 1 -- 172.21.15.6:0/2016395850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5b74005040 con 0x7f5b880fd100 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.079+0000 7f5b87fff700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 0x7f5b8810d4d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f5b74009380 tx=0x7f5b74009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.079+0000 7f5b85ffb700 1 -- 172.21.15.6:0/2016395850 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b74018070 con 0x7f5b880fd100 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.079+0000 7f5b85ffb700 1 -- 172.21.15.6:0/2016395850 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5b74007e90 con 0x7f5b880fd100 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.079+0000 7f5b85ffb700 1 -- 172.21.15.6:0/2016395850 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5b740123c0 con 0x7f5b880fd100 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.079+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5b88107290 con 0x7f5b880fd100 2024-03-12T16:36:34.076 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.079+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5b881077f0 con 0x7f5b880fd100 2024-03-12T16:36:34.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.080+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5b8805f380 con 0x7f5b880fd100 2024-03-12T16:36:34.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.080+0000 7f5b85ffb700 1 -- 172.21.15.6:0/2016395850 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5b7401d420 con 0x7f5b880fd100 2024-03-12T16:36:34.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.081+0000 7f5b85ffb700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5b7806caa0 0x7f5b7806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:34.077 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.081+0000 7f5b85ffb700 1 -- 172.21.15.6:0/2016395850 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5b7408cb00 con 0x7f5b880fd100 2024-03-12T16:36:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.081+0000 7f5b8cbfd700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5b7806caa0 0x7f5b7806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:34.078 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.081+0000 7f5b8cbfd700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5b7806caa0 0x7f5b7806ef60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f5b7c0092f0 tx=0x7f5b7c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:34.080 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.085+0000 7f5b85ffb700 1 -- 172.21.15.6:0/2016395850 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5b7405a660 con 0x7f5b880fd100 2024-03-12T16:36:34.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:33 smithi134 ceph-mon[85099]: pgmap v700: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:34.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:33 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3097673318' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 23, "format": "json"}]: dispatch 2024-03-12T16:36:34.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:33 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/4156360511' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 24, "format": "json"}]: dispatch 2024-03-12T16:36:34.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:33 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/4043036633' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 25, "format": "json"}]: dispatch 2024-03-12T16:36:34.321 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.326+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 27, "format": "json"} v 0) v1 -- 0x7f5b8805eec0 con 0x7f5b880fd100 2024-03-12T16:36:34.322 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.327+0000 7f5b85ffb700 1 -- 172.21.15.6:0/2016395850 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 27, "format": "json"}]=0 dumped fsmap epoch 27 v33) v1 ==== 107+0+4812 (secure 0 0 0) 0x7f5b7405a1f0 con 0x7f5b880fd100 2024-03-12T16:36:34.322 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:34.322 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":27,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":20},{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":22},{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44343,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/665910356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":665910356},{"type":"v1","addr":"172.21.15.134:6827","nonce":665910356}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":27,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:34:53.100478+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{},"failed":[0,1],"damaged":[],"stopped":[],"info":{},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5b7806caa0 msgr2=0x7f5b7806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5b7806caa0 0x7f5b7806ef60 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 rx=0x7f5b7c0092f0 tx=0x7f5b7c00b040).stop 2024-03-12T16:36:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 msgr2=0x7f5b8810d4d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 0x7f5b8810d4d0 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 rx=0x7f5b74009380 tx=0x7f5b74009cb0).stop 2024-03-12T16:36:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 shutdown_connections 2024-03-12T16:36:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5b880fc830 0x7f5b8810cfe0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5b7806caa0 0x7f5b7806ef60 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 --2- 172.21.15.6:0/2016395850 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5b880fd100 0x7f5b8810d4d0 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 >> 172.21.15.6:0/2016395850 conn(0x7f5b8806c760 msgr2=0x7f5b880fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 shutdown_connections 2024-03-12T16:36:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.329+0000 7f5b8ee61700 1 -- 172.21.15.6:0/2016395850 wait complete. 2024-03-12T16:36:34.325 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 27 2024-03-12T16:36:34.336 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 28 2024-03-12T16:36:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.462+0000 7f73fa9a4700 1 -- 172.21.15.6:0/3693007073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 msgr2=0x7f73f40fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.462+0000 7f73fa9a4700 1 --2- 172.21.15.6:0/3693007073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 0x7f73f40fcc10 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 rx=0x7f73e40047f0 tx=0x7f73e4009cb0).stop 2024-03-12T16:36:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.462+0000 7f73fa9a4700 1 -- 172.21.15.6:0/3693007073 shutdown_connections 2024-03-12T16:36:34.459 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.462+0000 7f73fa9a4700 1 --2- 172.21.15.6:0/3693007073 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f40fd100 0x7f73f40f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.462+0000 7f73fa9a4700 1 --2- 172.21.15.6:0/3693007073 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 0x7f73f40fcc10 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.462+0000 7f73fa9a4700 1 -- 172.21.15.6:0/3693007073 >> 172.21.15.6:0/3693007073 conn(0x7f73f406c760 msgr2=0x7f73f406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.462+0000 7f73fa9a4700 1 -- 172.21.15.6:0/3693007073 shutdown_connections 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.462+0000 7f73fa9a4700 1 -- 172.21.15.6:0/3693007073 wait complete. 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73fa9a4700 1 Processor -- start 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73fa9a4700 1 -- start start 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73fa9a4700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 0x7f73f4109010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73fa9a4700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f40fd100 0x7f73f4109500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73fa9a4700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f4109a40 con 0x7f73f40fc830 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73fa9a4700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f73f4109b80 con 0x7f73f40fd100 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 0x7f73f4109010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73f3fff700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 0x7f73f4109010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60146/0 (socket says 172.21.15.6:60146) 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73f3fff700 1 -- 172.21.15.6:0/4237982410 learned_addr learned my addr 172.21.15.6:0/4237982410 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:34.460 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73f37fe700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f40fd100 0x7f73f4109500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73f3fff700 1 -- 172.21.15.6:0/4237982410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f40fd100 msgr2=0x7f73f4109500 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73f3fff700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f40fd100 0x7f73f4109500 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73f3fff700 1 -- 172.21.15.6:0/4237982410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f73e4005040 con 0x7f73f40fc830 2024-03-12T16:36:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.463+0000 7f73f3fff700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 0x7f73f4109010 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f73e400b120 tx=0x7f73e4009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.464+0000 7f73f17fa700 1 -- 172.21.15.6:0/4237982410 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e400e030 con 0x7f73f40fc830 2024-03-12T16:36:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.464+0000 7f73f17fa700 1 -- 172.21.15.6:0/4237982410 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f73e4007e90 con 0x7f73f40fc830 2024-03-12T16:36:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.464+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f73f4109dd0 con 0x7f73f40fc830 2024-03-12T16:36:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.464+0000 7f73f17fa700 1 -- 172.21.15.6:0/4237982410 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73e4018070 con 0x7f73f40fc830 2024-03-12T16:36:34.461 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.464+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f73f4112370 con 0x7f73f40fc830 2024-03-12T16:36:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.465+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f73f405f380 con 0x7f73f40fc830 2024-03-12T16:36:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.465+0000 7f73f17fa700 1 -- 172.21.15.6:0/4237982410 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f73e4009710 con 0x7f73f40fc830 2024-03-12T16:36:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.466+0000 7f73f17fa700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73dc06caa0 0x7f73dc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.466+0000 7f73f17fa700 1 -- 172.21.15.6:0/4237982410 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f73e408d2d0 con 0x7f73f40fc830 2024-03-12T16:36:34.462 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.466+0000 7f73f37fe700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73dc06caa0 0x7f73dc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:34.463 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.466+0000 7f73f37fe700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73dc06caa0 0x7f73dc06ef60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f73f4060f60 tx=0x7f73e8009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:34.465 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.470+0000 7f73f17fa700 1 -- 172.21.15.6:0/4237982410 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f73e40573a0 con 0x7f73f40fc830 2024-03-12T16:36:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.716+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 28, "format": "json"} v 0) v1 -- 0x7f73f405eec0 con 0x7f73f40fc830 2024-03-12T16:36:34.712 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.717+0000 7f73f17fa700 1 -- 172.21.15.6:0/4237982410 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 28, "format": "json"}]=0 dumped fsmap epoch 28 v33) v1 ==== 107+0+4835 (secure 0 0 0) 0x7f73e405a9c0 con 0x7f73f40fc830 2024-03-12T16:36:34.712 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:34.713 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":28,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44343,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/665910356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":665910356},{"type":"v1","addr":"172.21.15.134:6827","nonce":665910356}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":28,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:34:53.104166+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":1,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.719+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73dc06caa0 msgr2=0x7f73dc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.719+0000 7f73fa9a4700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73dc06caa0 0x7f73dc06ef60 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 rx=0x7f73f4060f60 tx=0x7f73e8009040).stop 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.719+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 msgr2=0x7f73f4109010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.719+0000 7f73fa9a4700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 0x7f73f4109010 secure :-1 s=READY pgs=626 cs=0 l=1 rev1=1 rx=0x7f73e400b120 tx=0x7f73e4009cb0).stop 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.719+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 shutdown_connections 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.719+0000 7f73fa9a4700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f73dc06caa0 0x7f73dc06ef60 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.719+0000 7f73fa9a4700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73f40fc830 0x7f73f4109010 unknown :-1 s=CLOSED pgs=626 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.719+0000 7f73fa9a4700 1 --2- 172.21.15.6:0/4237982410 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73f40fd100 0x7f73f4109500 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.719+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 >> 172.21.15.6:0/4237982410 conn(0x7f73f406c760 msgr2=0x7f73f40ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.720+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 shutdown_connections 2024-03-12T16:36:34.715 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.720+0000 7f73fa9a4700 1 -- 172.21.15.6:0/4237982410 wait complete. 2024-03-12T16:36:34.716 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 28 2024-03-12T16:36:34.727 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 29 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 -- 172.21.15.6:0/4200190459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f92c0 msgr2=0x7f0510101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 --2- 172.21.15.6:0/4200190459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f92c0 0x7f0510101a60 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 rx=0x7f05000047f0 tx=0x7f0500009cb0).stop 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 -- 172.21.15.6:0/4200190459 shutdown_connections 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 --2- 172.21.15.6:0/4200190459 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f92c0 0x7f0510101a60 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 --2- 172.21.15.6:0/4200190459 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05100f89f0 0x7f05100f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 -- 172.21.15.6:0/4200190459 >> 172.21.15.6:0/4200190459 conn(0x7f051006c760 msgr2=0x7f051006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 -- 172.21.15.6:0/4200190459 shutdown_connections 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 -- 172.21.15.6:0/4200190459 wait complete. 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 Processor -- start 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.854+0000 7f051871e700 1 -- start start 2024-03-12T16:36:34.852 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f051871e700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f89f0 0x7f051010dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f051871e700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05100f92c0 0x7f051010e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f051871e700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051010eac0 con 0x7f05100f89f0 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f051871e700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f051010ec00 con 0x7f05100f92c0 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05164ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f89f0 0x7f051010dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05164ba700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f89f0 0x7f051010dfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60168/0 (socket says 172.21.15.6:60168) 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05164ba700 1 -- 172.21.15.6:0/3739930722 learned_addr learned my addr 172.21.15.6:0/3739930722 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f0515cb9700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05100f92c0 0x7f051010e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05164ba700 1 -- 172.21.15.6:0/3739930722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05100f92c0 msgr2=0x7f051010e4c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05164ba700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05100f92c0 0x7f051010e4c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05164ba700 1 -- 172.21.15.6:0/3739930722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f0500005040 con 0x7f05100f89f0 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f0515cb9700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05100f92c0 0x7f051010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05164ba700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f89f0 0x7f051010dfd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f050c0041d0 tx=0x7f050c009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05077fe700 1 -- 172.21.15.6:0/3739930722 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050c002d90 con 0x7f05100f89f0 2024-03-12T16:36:34.853 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0510108290 con 0x7f05100f89f0 2024-03-12T16:36:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05077fe700 1 -- 172.21.15.6:0/3739930722 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f050c00f040 con 0x7f05100f89f0 2024-03-12T16:36:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f05077fe700 1 -- 172.21.15.6:0/3739930722 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f050c00d800 con 0x7f05100f89f0 2024-03-12T16:36:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.855+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f05101087d0 con 0x7f05100f89f0 2024-03-12T16:36:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.856+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f051005f380 con 0x7f05100f89f0 2024-03-12T16:36:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.857+0000 7f05077fe700 1 -- 172.21.15.6:0/3739930722 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f050c00dac0 con 0x7f05100f89f0 2024-03-12T16:36:34.854 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.857+0000 7f05077fe700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f04fc06caa0 0x7f04fc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.857+0000 7f0515cb9700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f04fc06caa0 0x7f04fc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.857+0000 7f05077fe700 1 -- 172.21.15.6:0/3739930722 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f050c08bde0 con 0x7f05100f89f0 2024-03-12T16:36:34.855 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.858+0000 7f0515cb9700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f04fc06caa0 0x7f04fc06ef60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0500009ee0 tx=0x7f050000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:34.857 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:34.862+0000 7f05077fe700 1 -- 172.21.15.6:0/3739930722 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f050c059940 con 0x7f05100f89f0 2024-03-12T16:36:35.099 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.104+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 29, "format": "json"} v 0) v1 -- 0x7f051005eec0 con 0x7f05100f89f0 2024-03-12T16:36:35.100 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.105+0000 7f05077fe700 1 -- 172.21.15.6:0/3739930722 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 29, "format": "json"}]=0 dumped fsmap epoch 29 v33) v1 ==== 107+0+4838 (secure 0 0 0) 0x7f050c0594d0 con 0x7f05100f89f0 2024-03-12T16:36:35.100 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:35.100 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":29,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44343,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/665910356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":665910356},{"type":"v1","addr":"172.21.15.134:6827","nonce":665910356}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":29,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:35:00.649175+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":28,"state":"up:replay","state_seq":1,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":1,"incarnation":28,"state":"up:resolve","state_seq":236,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f04fc06caa0 msgr2=0x7f04fc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f04fc06caa0 0x7f04fc06ef60 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 rx=0x7f0500009ee0 tx=0x7f050000b040).stop 2024-03-12T16:36:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f89f0 msgr2=0x7f051010dfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f89f0 0x7f051010dfd0 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 rx=0x7f050c0041d0 tx=0x7f050c009f60).stop 2024-03-12T16:36:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 shutdown_connections 2024-03-12T16:36:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f04fc06caa0 0x7f04fc06ef60 unknown :-1 s=CLOSED pgs=335 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f05100f89f0 0x7f051010dfd0 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.103 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 --2- 172.21.15.6:0/3739930722 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f05100f92c0 0x7f051010e4c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 >> 172.21.15.6:0/3739930722 conn(0x7f051006c760 msgr2=0x7f05100fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 shutdown_connections 2024-03-12T16:36:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.107+0000 7f051871e700 1 -- 172.21.15.6:0/3739930722 wait complete. 2024-03-12T16:36:35.104 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 29 2024-03-12T16:36:35.114 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:34 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3813518618' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-03-12T16:36:35.114 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:34 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2016395850' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-03-12T16:36:35.114 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:34 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/4237982410' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-03-12T16:36:35.115 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 30 2024-03-12T16:36:35.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:34 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3813518618' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 26, "format": "json"}]: dispatch 2024-03-12T16:36:35.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:34 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2016395850' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 27, "format": "json"}]: dispatch 2024-03-12T16:36:35.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:34 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/4237982410' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 28, "format": "json"}]: dispatch 2024-03-12T16:36:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.241+0000 7fc83a126700 1 -- 172.21.15.6:0/606468227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 msgr2=0x7fc834101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.241+0000 7fc83a126700 1 --2- 172.21.15.6:0/606468227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 0x7fc834101a60 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 rx=0x7fc8240047f0 tx=0x7fc824009cb0).stop 2024-03-12T16:36:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.241+0000 7fc83a126700 1 -- 172.21.15.6:0/606468227 shutdown_connections 2024-03-12T16:36:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.241+0000 7fc83a126700 1 --2- 172.21.15.6:0/606468227 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 0x7fc834101a60 unknown :-1 s=CLOSED pgs=629 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.241+0000 7fc83a126700 1 --2- 172.21.15.6:0/606468227 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8340f89f0 0x7fc8340f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.241+0000 7fc83a126700 1 -- 172.21.15.6:0/606468227 >> 172.21.15.6:0/606468227 conn(0x7fc83406c760 msgr2=0x7fc83406cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.241+0000 7fc83a126700 1 -- 172.21.15.6:0/606468227 shutdown_connections 2024-03-12T16:36:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.241+0000 7fc83a126700 1 -- 172.21.15.6:0/606468227 wait complete. 2024-03-12T16:36:35.241 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.241+0000 7fc83a126700 1 Processor -- start 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc83a126700 1 -- start start 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc83a126700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8340f89f0 0x7fc83410df60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc83a126700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 0x7fc83410e450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc83a126700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83410ea50 con 0x7fc8340f92c0 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc83a126700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fc83410eb90 con 0x7fc8340f89f0 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc832ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 0x7fc83410e450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc832ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 0x7fc83410e450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60184/0 (socket says 172.21.15.6:60184) 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc832ffd700 1 -- 172.21.15.6:0/1137637242 learned_addr learned my addr 172.21.15.6:0/1137637242 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc8337fe700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8340f89f0 0x7fc83410df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc832ffd700 1 -- 172.21.15.6:0/1137637242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8340f89f0 msgr2=0x7fc83410df60 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc832ffd700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8340f89f0 0x7fc83410df60 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc832ffd700 1 -- 172.21.15.6:0/1137637242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fc824005040 con 0x7fc8340f92c0 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc8337fe700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8340f89f0 0x7fc83410df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).send_auth_request state changed! 2024-03-12T16:36:35.242 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc832ffd700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 0x7fc83410e450 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fc824009380 tx=0x7fc824009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc830ff9700 1 -- 172.21.15.6:0/1137637242 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc82400e070 con 0x7fc8340f92c0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc830ff9700 1 -- 172.21.15.6:0/1137637242 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fc824007e90 con 0x7fc8340f92c0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc830ff9700 1 -- 172.21.15.6:0/1137637242 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fc824018070 con 0x7fc8340f92c0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.242+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fc834108220 con 0x7fc8340f92c0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.243+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fc834108760 con 0x7fc8340f92c0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.244+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fc83405f380 con 0x7fc8340f92c0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.244+0000 7fc830ff9700 1 -- 172.21.15.6:0/1137637242 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fc82401d420 con 0x7fc8340f92c0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.245+0000 7fc830ff9700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc81c06caa0 0x7fc81c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.245+0000 7fc8337fe700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc81c06caa0 0x7fc81c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.245+0000 7fc830ff9700 1 -- 172.21.15.6:0/1137637242 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fc82408c940 con 0x7fc8340f92c0 2024-03-12T16:36:35.243 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.245+0000 7fc8337fe700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc81c06caa0 0x7fc81c06ef60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fc828009a00 tx=0x7fc82800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:35.245 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.249+0000 7fc830ff9700 1 -- 172.21.15.6:0/1137637242 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fc82405a4a0 con 0x7fc8340f92c0 2024-03-12T16:36:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.491+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 30, "format": "json"} v 0) v1 -- 0x7fc83405eec0 con 0x7fc8340f92c0 2024-03-12T16:36:35.486 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.491+0000 7fc830ff9700 1 -- 172.21.15.6:0/1137637242 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 30, "format": "json"}]=0 dumped fsmap epoch 30 v33) v1 ==== 107+0+4841 (secure 0 0 0) 0x7fc82405a030 con 0x7fc8340f92c0 2024-03-12T16:36:35.486 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:35.487 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":30,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44343,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/665910356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":665910356},{"type":"v1","addr":"172.21.15.134:6827","nonce":665910356}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":30,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:35:01.655724+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":28,"state":"up:resolve","state_seq":241,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":1,"incarnation":28,"state":"up:resolve","state_seq":236,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.493+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc81c06caa0 msgr2=0x7fc81c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.493+0000 7fc83a126700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc81c06caa0 0x7fc81c06ef60 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 rx=0x7fc828009a00 tx=0x7fc82800b040).stop 2024-03-12T16:36:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.493+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 msgr2=0x7fc83410e450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.493+0000 7fc83a126700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 0x7fc83410e450 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 rx=0x7fc824009380 tx=0x7fc824009cb0).stop 2024-03-12T16:36:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.493+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 shutdown_connections 2024-03-12T16:36:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.493+0000 7fc83a126700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fc8340f89f0 0x7fc83410df60 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.493+0000 7fc83a126700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fc81c06caa0 0x7fc81c06ef60 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.493+0000 7fc83a126700 1 --2- 172.21.15.6:0/1137637242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fc8340f92c0 0x7fc83410e450 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.489 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.493+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 >> 172.21.15.6:0/1137637242 conn(0x7fc83406c760 msgr2=0x7fc8340fc200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.494+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 shutdown_connections 2024-03-12T16:36:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.494+0000 7fc83a126700 1 -- 172.21.15.6:0/1137637242 wait complete. 2024-03-12T16:36:35.490 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 30 2024-03-12T16:36:35.501 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 31 2024-03-12T16:36:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.627+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/339629742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 msgr2=0x7f6cf8103ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.627+0000 7f6cfc8b0700 1 --2- 172.21.15.6:0/339629742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 0x7f6cf8103ca0 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 rx=0x7f6ce00047f0 tx=0x7f6ce0009cb0).stop 2024-03-12T16:36:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.627+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/339629742 shutdown_connections 2024-03-12T16:36:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.627+0000 7f6cfc8b0700 1 --2- 172.21.15.6:0/339629742 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 0x7f6cf8103ca0 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.626 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.627+0000 7f6cfc8b0700 1 --2- 172.21.15.6:0/339629742 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf806b110 0x7f6cf806b4f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.627+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/339629742 >> 172.21.15.6:0/339629742 conn(0x7f6cf80f34d0 msgr2=0x7f6cf80f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.627+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/339629742 shutdown_connections 2024-03-12T16:36:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.627+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/339629742 wait complete. 2024-03-12T16:36:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.628+0000 7f6cfc8b0700 1 Processor -- start 2024-03-12T16:36:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.628+0000 7f6cfc8b0700 1 -- start start 2024-03-12T16:36:35.627 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.628+0000 7f6cfc8b0700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf806b110 0x7f6cf81102f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cfc8b0700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 0x7f6cf81107e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cfc8b0700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf8110de0 con 0x7f6cf806b9e0 2024-03-12T16:36:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cfc8b0700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f6cf8110f20 con 0x7f6cf806b110 2024-03-12T16:36:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cf5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 0x7f6cf81107e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:35.628 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cf5d9b700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 0x7f6cf81107e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60214/0 (socket says 172.21.15.6:60214) 2024-03-12T16:36:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cf5d9b700 1 -- 172.21.15.6:0/160788098 learned_addr learned my addr 172.21.15.6:0/160788098 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cf659c700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf806b110 0x7f6cf81102f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cf5d9b700 1 -- 172.21.15.6:0/160788098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf806b110 msgr2=0x7f6cf81102f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cf5d9b700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf806b110 0x7f6cf81102f0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cf5d9b700 1 -- 172.21.15.6:0/160788098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f6ce0005040 con 0x7f6cf806b9e0 2024-03-12T16:36:35.629 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cf5d9b700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 0x7f6cf81107e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f6ce0005010 tx=0x7f6ce0009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cef7fe700 1 -- 172.21.15.6:0/160788098 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce000e030 con 0x7f6cf806b9e0 2024-03-12T16:36:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cef7fe700 1 -- 172.21.15.6:0/160788098 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f6ce0007e90 con 0x7f6cf806b9e0 2024-03-12T16:36:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f6cf810a550 con 0x7f6cf806b9e0 2024-03-12T16:36:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cef7fe700 1 -- 172.21.15.6:0/160788098 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f6ce0018070 con 0x7f6cf806b9e0 2024-03-12T16:36:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.629+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f6cf810aa30 con 0x7f6cf806b9e0 2024-03-12T16:36:35.630 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.630+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f6cf805f360 con 0x7f6cf806b9e0 2024-03-12T16:36:35.631 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.631+0000 7f6cef7fe700 1 -- 172.21.15.6:0/160788098 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f6ce001d670 con 0x7f6cf806b9e0 2024-03-12T16:36:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.631+0000 7f6cef7fe700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ce406caa0 0x7f6ce406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:35.632 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.631+0000 7f6cef7fe700 1 -- 172.21.15.6:0/160788098 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f6ce008d0d0 con 0x7f6cf806b9e0 2024-03-12T16:36:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.631+0000 7f6cf659c700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ce406caa0 0x7f6ce406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.632+0000 7f6cf659c700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ce406caa0 0x7f6ce406ef60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f6ce8004dc0 tx=0x7f6ce800b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:35.633 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.636+0000 7f6cef7fe700 1 -- 172.21.15.6:0/160788098 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f6ce005ab70 con 0x7f6cf806b9e0 2024-03-12T16:36:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.880+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 31, "format": "json"} v 0) v1 -- 0x7f6cf810b970 con 0x7f6cf806b9e0 2024-03-12T16:36:35.876 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.881+0000 7f6cef7fe700 1 -- 172.21.15.6:0/160788098 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 31, "format": "json"}]=0 dumped fsmap epoch 31 v33) v1 ==== 107+0+4845 (secure 0 0 0) 0x7f6ce005a700 con 0x7f6cf806b9e0 2024-03-12T16:36:35.876 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:35.876 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":31,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44343,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/665910356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":665910356},{"type":"v1","addr":"172.21.15.134:6827","nonce":665910356}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":31,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:35:02.661021+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":28,"state":"up:reconnect","state_seq":242,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":1,"incarnation":28,"state":"up:reconnect","state_seq":237,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:35.878 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ce406caa0 msgr2=0x7f6ce406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ce406caa0 0x7f6ce406ef60 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 rx=0x7f6ce8004dc0 tx=0x7f6ce800b040).stop 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 msgr2=0x7f6cf81107e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 0x7f6cf81107e0 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 rx=0x7f6ce0005010 tx=0x7f6ce0009cb0).stop 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 shutdown_connections 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f6cf806b110 0x7f6cf81102f0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f6ce406caa0 0x7f6ce406ef60 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 --2- 172.21.15.6:0/160788098 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f6cf806b9e0 0x7f6cf81107e0 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 >> 172.21.15.6:0/160788098 conn(0x7f6cf80f34d0 msgr2=0x7f6cf80fe5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.883+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 shutdown_connections 2024-03-12T16:36:35.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:35.884+0000 7f6cfc8b0700 1 -- 172.21.15.6:0/160788098 wait complete. 2024-03-12T16:36:35.880 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 31 2024-03-12T16:36:35.889 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:35 smithi006 ceph-mon[103869]: pgmap v701: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:35.889 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:35 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/3739930722' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-03-12T16:36:35.890 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:35 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1137637242' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-03-12T16:36:35.891 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph fs dump --format=json 32 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.017+0000 7ffad88df700 1 -- 172.21.15.6:0/978973755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fe250 msgr2=0x7ffad40f7a30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.017+0000 7ffad88df700 1 --2- 172.21.15.6:0/978973755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fe250 0x7ffad40f7a30 secure :-1 s=READY pgs=633 cs=0 l=1 rev1=1 rx=0x7ffabc0047f0 tx=0x7ffabc009cb0).stop 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.017+0000 7ffad88df700 1 -- 172.21.15.6:0/978973755 shutdown_connections 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.017+0000 7ffad88df700 1 --2- 172.21.15.6:0/978973755 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fe250 0x7ffad40f7a30 unknown :-1 s=CLOSED pgs=633 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.017+0000 7ffad88df700 1 --2- 172.21.15.6:0/978973755 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fd8f0 0x7ffad40fdcd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.017+0000 7ffad88df700 1 -- 172.21.15.6:0/978973755 >> 172.21.15.6:0/978973755 conn(0x7ffad40f34d0 msgr2=0x7ffad40f58f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.017+0000 7ffad88df700 1 -- 172.21.15.6:0/978973755 shutdown_connections 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.017+0000 7ffad88df700 1 -- 172.21.15.6:0/978973755 wait complete. 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad88df700 1 Processor -- start 2024-03-12T16:36:36.013 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad88df700 1 -- start start 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad88df700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fd8f0 0x7ffad410e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad88df700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fe250 0x7ffad410e580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad88df700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad410eb80 con 0x7ffad40fd8f0 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad88df700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7ffad410ecc0 con 0x7ffad40fe250 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fd8f0 0x7ffad410e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fd8f0 0x7ffad410e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60236/0 (socket says 172.21.15.6:60236) 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad259c700 1 -- 172.21.15.6:0/52385081 learned_addr learned my addr 172.21.15.6:0/52385081 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad1d9b700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fe250 0x7ffad410e580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad259c700 1 -- 172.21.15.6:0/52385081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fe250 msgr2=0x7ffad410e580 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad259c700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fe250 0x7ffad410e580 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.016 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad259c700 1 -- 172.21.15.6:0/52385081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7ffabc005040 con 0x7ffad40fd8f0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.018+0000 7ffad1d9b700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fe250 0x7ffad410e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.019+0000 7ffad259c700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fd8f0 0x7ffad410e090 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7ffac400e8f0 tx=0x7ffac400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.019+0000 7ffacb7fe700 1 -- 172.21.15.6:0/52385081 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac400ee90 con 0x7ffad40fd8f0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.019+0000 7ffacb7fe700 1 -- 172.21.15.6:0/52385081 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7ffac400f040 con 0x7ffad40fd8f0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.019+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7ffad4108350 con 0x7ffad40fd8f0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.019+0000 7ffacb7fe700 1 -- 172.21.15.6:0/52385081 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7ffac400c8a0 con 0x7ffad40fd8f0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.019+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7ffad4108910 con 0x7ffad40fd8f0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.020+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7ffad405f360 con 0x7ffad40fd8f0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.020+0000 7ffacb7fe700 1 -- 172.21.15.6:0/52385081 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7ffac4007b40 con 0x7ffad40fd8f0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.021+0000 7ffacb7fe700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffac006caa0 0x7ffac006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.021+0000 7ffacb7fe700 1 -- 172.21.15.6:0/52385081 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7ffac408ba50 con 0x7ffad40fd8f0 2024-03-12T16:36:36.017 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.021+0000 7ffad1d9b700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffac006caa0 0x7ffac006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:36.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.021+0000 7ffad1d9b700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffac006caa0 0x7ffac006ef60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ffabc004e60 tx=0x7ffabc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:36.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.025+0000 7ffacb7fe700 1 -- 172.21.15.6:0/52385081 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7ffac40595b0 con 0x7ffad40fd8f0 2024-03-12T16:36:36.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:35 smithi134 ceph-mon[85099]: pgmap v701: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:36.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:35 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/3739930722' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 29, "format": "json"}]: dispatch 2024-03-12T16:36:36.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:35 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1137637242' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 30, "format": "json"}]: dispatch 2024-03-12T16:36:36.261 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.266+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "fs dump", "epoch": 32, "format": "json"} v 0) v1 -- 0x7ffad405eec0 con 0x7ffad40fd8f0 2024-03-12T16:36:36.262 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.267+0000 7ffacb7fe700 1 -- 172.21.15.6:0/52385081 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "fs dump", "epoch": 32, "format": "json"}]=0 dumped fsmap epoch 32 v33) v1 ==== 107+0+4839 (secure 0 0 0) 0x7ffac4059140 con 0x7ffad40fd8f0 2024-03-12T16:36:36.262 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:36.262 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":32,"default_fscid":1,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"feature_flags":{"enable_multiple":true,"ever_enabled_multiple":true},"standbys":[{"gid":44313,"name":"cephfs.smithi134.jqydtn","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6825/478277334","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6824","nonce":478277334},{"type":"v1","addr":"172.21.15.134:6825","nonce":478277334}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":24},{"gid":44343,"name":"cephfs.smithi134.ufgvbd","rank":-1,"incarnation":0,"state":"up:standby","state_seq":1,"addr":"172.21.15.134:6827/665910356","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6826","nonce":665910356},{"type":"v1","addr":"172.21.15.134:6827","nonce":665910356}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"epoch":26}],"filesystems":[{"mdsmap":{"epoch":32,"flags":18,"flags_state":{"joinable":true,"allow_snaps":true,"allow_multimds_snaps":true,"allow_standby_replay":false,"refuse_client_session":false,"refuse_standby_for_another_fs":false,"balance_automate":false},"ever_allowed_features":0,"explicitly_allowed_features":0,"created":"2024-03-12T16:07:21.259716+0000","modified":"2024-03-12T16:35:03.666526+0000","tableserver":0,"root":0,"session_timeout":60,"session_autoclose":300,"required_client_features":{},"max_file_size":1099511627776,"max_xattr_size":65536,"last_failure":0,"last_failure_osd_epoch":78,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}},"max_mds":2,"in":[0,1],"up":{"mds_0":34378,"mds_1":34410},"failed":[],"damaged":[],"stopped":[],"info":{"gid_34378":{"gid":34378,"name":"cephfs.smithi006.ncuwuc","rank":0,"incarnation":28,"state":"up:rejoin","state_seq":243,"addr":"172.21.15.6:6827/3791215151","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6826","nonce":3791215151},{"type":"v1","addr":"172.21.15.6:6827","nonce":3791215151}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}},"gid_34410":{"gid":34410,"name":"cephfs.smithi006.ufmcfu","rank":1,"incarnation":28,"state":"up:rejoin","state_seq":238,"addr":"172.21.15.6:6829/1788108531","addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6828","nonce":1788108531},{"type":"v1","addr":"172.21.15.6:6829","nonce":1788108531}]},"join_fscid":1,"export_targets":[],"features":4540138322906710015,"flags":0,"compat":{"compat":{},"ro_compat":{},"incompat":{"feature_1":"base v0.20","feature_2":"client writeable ranges","feature_3":"default file layouts on dirs","feature_4":"dir inode in separate object","feature_5":"mds uses versioned encoding","feature_6":"dirfrag is stored in omap","feature_7":"mds uses inline data","feature_8":"no anchor table","feature_9":"file layout v2","feature_10":"snaprealm v2"}}}},"data_pools":[3],"metadata_pool":2,"enabled":true,"fs_name":"cephfs","balancer":"","bal_rank_mask":"-1","standby_count_wanted":1},"id":1}]} 2024-03-12T16:36:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffac006caa0 msgr2=0x7ffac006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.264 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffac006caa0 0x7ffac006ef60 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 rx=0x7ffabc004e60 tx=0x7ffabc00b040).stop 2024-03-12T16:36:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fd8f0 msgr2=0x7ffad410e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fd8f0 0x7ffad410e090 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 rx=0x7ffac400e8f0 tx=0x7ffac400b040).stop 2024-03-12T16:36:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 shutdown_connections 2024-03-12T16:36:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7ffac006caa0 0x7ffac006ef60 unknown :-1 s=CLOSED pgs=338 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7ffad40fd8f0 0x7ffad410e090 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 --2- 172.21.15.6:0/52385081 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7ffad40fe250 0x7ffad410e580 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 >> 172.21.15.6:0/52385081 conn(0x7ffad40f34d0 msgr2=0x7ffad40fbcb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 shutdown_connections 2024-03-12T16:36:36.265 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.269+0000 7ffad88df700 1 -- 172.21.15.6:0/52385081 wait complete. 2024-03-12T16:36:36.266 INFO:teuthology.orchestra.run.smithi006.stderr:dumped fsmap epoch 32 2024-03-12T16:36:36.277 DEBUG:teuthology.run_tasks:Unwinding manager ceph-fuse 2024-03-12T16:36:36.289 INFO:tasks.ceph_fuse:Unmounting ceph-fuse clients... 2024-03-12T16:36:36.290 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:36:36.290 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T16:36:36.311 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:36:36.311 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T16:36:36.371 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T16:36:36.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.536+0000 7f738e1e5700 1 -- 172.21.15.6:0/3747788242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 msgr2=0x7f7388103db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.533 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.536+0000 7f738e1e5700 1 --2- 172.21.15.6:0/3747788242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 0x7f7388103db0 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 rx=0x7f7378004820 tx=0x7f7378009cb0).stop 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.536+0000 7f738e1e5700 1 -- 172.21.15.6:0/3747788242 shutdown_connections 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.536+0000 7f738e1e5700 1 --2- 172.21.15.6:0/3747788242 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 0x7f7388103db0 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.536+0000 7f738e1e5700 1 --2- 172.21.15.6:0/3747788242 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73880f6740 0x7f73880f6b20 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.536+0000 7f738e1e5700 1 -- 172.21.15.6:0/3747788242 >> 172.21.15.6:0/3747788242 conn(0x7f738806c760 msgr2=0x7f738806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.536+0000 7f738e1e5700 1 -- 172.21.15.6:0/3747788242 shutdown_connections 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.536+0000 7f738e1e5700 1 -- 172.21.15.6:0/3747788242 wait complete. 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.536+0000 7f738e1e5700 1 Processor -- start 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f738e1e5700 1 -- start start 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f738e1e5700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73880f6740 0x7f73881101a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f738e1e5700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 0x7f7388110690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f738e1e5700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7388110c90 con 0x7f73880f7010 2024-03-12T16:36:36.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f738e1e5700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7388110dd0 con 0x7f73880f6740 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f7386ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 0x7f7388110690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f7386ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 0x7f7388110690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60246/0 (socket says 172.21.15.6:60246) 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f7386ffd700 1 -- 172.21.15.6:0/199170255 learned_addr learned my addr 172.21.15.6:0/199170255 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f73877fe700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73880f6740 0x7f73881101a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f7386ffd700 1 -- 172.21.15.6:0/199170255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73880f6740 msgr2=0x7f73881101a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f7386ffd700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73880f6740 0x7f73881101a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f7386ffd700 1 -- 172.21.15.6:0/199170255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7378005040 con 0x7f73880f7010 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f7386ffd700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 0x7f7388110690 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f7378009a00 tx=0x7f737800b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.537+0000 7f7384ff9700 1 -- 172.21.15.6:0/199170255 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7378019070 con 0x7f73880f7010 2024-03-12T16:36:36.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.538+0000 7f7384ff9700 1 -- 172.21.15.6:0/199170255 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f737801e420 con 0x7f73880f7010 2024-03-12T16:36:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.538+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f738810a400 con 0x7f73880f7010 2024-03-12T16:36:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.538+0000 7f7384ff9700 1 -- 172.21.15.6:0/199170255 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f73780097a0 con 0x7f73880f7010 2024-03-12T16:36:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.538+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f738810a960 con 0x7f73880f7010 2024-03-12T16:36:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.538+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f738805f380 con 0x7f73880f7010 2024-03-12T16:36:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.539+0000 7f7384ff9700 1 -- 172.21.15.6:0/199170255 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f73780092f0 con 0x7f73880f7010 2024-03-12T16:36:36.536 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.539+0000 7f7384ff9700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737406cab0 0x7f737406ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.540+0000 7f7384ff9700 1 -- 172.21.15.6:0/199170255 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f737808c8f0 con 0x7f73880f7010 2024-03-12T16:36:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.540+0000 7f73877fe700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737406cab0 0x7f737406ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:36.537 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.540+0000 7f73877fe700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737406cab0 0x7f737406ef70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f73700048b0 tx=0x7f737000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:36.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.544+0000 7f7384ff9700 1 -- 172.21.15.6:0/199170255 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f737805a450 con 0x7f73880f7010 2024-03-12T16:36:36.739 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.744+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7f7388101320 con 0x7f73880f7010 2024-03-12T16:36:36.740 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.745+0000 7f7384ff9700 1 -- 172.21.15.6:0/199170255 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16089 (secure 0 0 0) 0x7f7378059fe0 con 0x7f73880f7010 2024-03-12T16:36:36.740 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:36.740 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","created":"2024-03-12T16:00:42.612784+0000","modified":"2024-03-12T16:19:47.764663+0000","last_up_change":"2024-03-12T16:18:56.265381+0000","last_in_change":"2024-03-12T16:05:41.290069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T16:04:29.453605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-12T16:07:20.200653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-12T16:07:20.688894+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81b3ff11-3d87-4f3b-a302-c8c55f378ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":80,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6803","nonce":1475010970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6805","nonce":1475010970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6809","nonce":1475010970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6807","nonce":1475010970}]},"public_addr":"172.21.15.6:6803/1475010970","cluster_addr":"172.21.15.6:6805/1475010970","heartbeat_back_addr":"172.21.15.6:6809/1475010970","heartbeat_front_addr":"172.21.15.6:6807/1475010970","state":["exists","up"]},{"osd":1,"uuid":"e638e6a3-7dc0-47f6-8901-1bdb1c208583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":80,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6811","nonce":4090040477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6813","nonce":4090040477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6817","nonce":4090040477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6815","nonce":4090040477}]},"public_addr":"172.21.15.6:6811/4090040477","cluster_addr":"172.21.15.6:6813/4090040477","heartbeat_back_addr":"172.21.15.6:6817/4090040477","heartbeat_front_addr":"172.21.15.6:6815/4090040477","state":["exists","up"]},{"osd":2,"uuid":"45eed951-90a9-4fe0-a184-11b5e1ebe46d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":80,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6819","nonce":1248094022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6821","nonce":1248094022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6825","nonce":1248094022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6823","nonce":1248094022}]},"public_addr":"172.21.15.6:6819/1248094022","cluster_addr":"172.21.15.6:6821/1248094022","heartbeat_back_addr":"172.21.15.6:6825/1248094022","heartbeat_front_addr":"172.21.15.6:6823/1248094022","state":["exists","up"]},{"osd":3,"uuid":"47d2f20b-d7b8-4d67-905c-af29938d36d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":80,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6801","nonce":3039719923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6803","nonce":3039719923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6807","nonce":3039719923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6805","nonce":3039719923}]},"public_addr":"172.21.15.134:6801/3039719923","cluster_addr":"172.21.15.134:6803/3039719923","heartbeat_back_addr":"172.21.15.134:6807/3039719923","heartbeat_front_addr":"172.21.15.134:6805/3039719923","state":["exists","up"]},{"osd":4,"uuid":"bfe8b5a1-489a-458d-ba30-5d1bada0c33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":69,"up_from":73,"up_thru":80,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6809","nonce":3599039531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6811","nonce":3599039531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6815","nonce":3599039531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6813","nonce":3599039531}]},"public_addr":"172.21.15.134:6809/3599039531","cluster_addr":"172.21.15.134:6811/3599039531","heartbeat_back_addr":"172.21.15.134:6815/3599039531","heartbeat_front_addr":"172.21.15.134:6813/3599039531","state":["exists","up"]},{"osd":5,"uuid":"02e056ee-a66a-4c23-a819-1e4c1e2d1236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":74,"up_from":80,"up_thru":80,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6817","nonce":4202679969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6819","nonce":4202679969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6823","nonce":4202679969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6821","nonce":4202679969}]},"public_addr":"172.21.15.134:6817/4202679969","cluster_addr":"172.21.15.134:6819/4202679969","heartbeat_back_addr":"172.21.15.134:6823/4202679969","heartbeat_front_addr":"172.21.15.134:6821/4202679969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:35.977637+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:59.443373+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:04:27.106208+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:02.955636+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:30.634685+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:58.981490+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6826/163878097":"2024-03-13T16:18:54.111614+0000","172.21.15.134:6825/3713757560":"2024-03-13T16:18:54.111632+0000","172.21.15.134:6824/3713757560":"2024-03-13T16:18:54.111632+0000","172.21.15.6:0/1419012389":"2024-03-13T16:14:31.789372+0000","172.21.15.6:0/3113166053":"2024-03-13T16:14:31.789372+0000","172.21.15.6:0/4255668203":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/179696865":"2024-03-13T16:01:44.393271+0000","172.21.15.6:0/687610333":"2024-03-13T16:01:44.393271+0000","172.21.15.6:0/1637754840":"2024-03-13T16:01:12.726451+0000","172.21.15.6:6801/2268121787":"2024-03-13T16:14:31.789372+0000","172.21.15.6:6801/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/139345082":"2024-03-13T16:09:39.532193+0000","172.21.15.6:0/3228405447":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/3126632977":"2024-03-13T16:09:39.532193+0000","172.21.15.6:6800/2268121787":"2024-03-13T16:14:31.789372+0000","172.21.15.134:0/3223900424":"2024-03-13T16:11:51.047707+0000","172.21.15.134:6828/3354806786":"2024-03-13T16:11:51.047707+0000","172.21.15.6:0/1732211885":"2024-03-13T16:14:31.789372+0000","172.21.15.6:6800/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4085533321":"2024-03-13T16:14:31.789372+0000","172.21.15.134:6829/3354806786":"2024-03-13T16:11:51.047707+0000","172.21.15.6:6827/163878097":"2024-03-13T16:18:54.111614+0000","172.21.15.134:0/182723627":"2024-03-13T16:11:51.047707+0000","172.21.15.134:0/1919894603":"2024-03-13T16:11:51.047707+0000","172.21.15.6:0/124082729":"2024-03-13T16:09:39.532193+0000","172.21.15.6:6801/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4212806006":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6801/139345082":"2024-03-13T16:09:39.532193+0000","172.21.15.134:0/500953021":"2024-03-13T16:11:51.047707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T16:36:36.742 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737406cab0 msgr2=0x7f737406ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737406cab0 0x7f737406ef70 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 rx=0x7f73700048b0 tx=0x7f737000b040).stop 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 msgr2=0x7f7388110690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 0x7f7388110690 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 rx=0x7f7378009a00 tx=0x7f737800b040).stop 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 shutdown_connections 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f73880f6740 0x7f73881101a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f737406cab0 0x7f737406ef70 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 --2- 172.21.15.6:0/199170255 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f73880f7010 0x7f7388110690 unknown :-1 s=CLOSED pgs=636 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 >> 172.21.15.6:0/199170255 conn(0x7f738806c760 msgr2=0x7f73880f5830 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 shutdown_connections 2024-03-12T16:36:36.743 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.747+0000 7f738e1e5700 1 -- 172.21.15.6:0/199170255 wait complete. 2024-03-12T16:36:36.756 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T16:04:29.453605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-12T16:07:20.200653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-12T16:07:20.688894+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T16:36:36.756 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T16:36:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.884+0000 7f806dfdd700 1 -- 172.21.15.6:0/908132028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fc830 msgr2=0x7f80680fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.884+0000 7f806dfdd700 1 --2- 172.21.15.6:0/908132028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fc830 0x7f80680fcc10 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 rx=0x7f80500047f0 tx=0x7f8050009cb0).stop 2024-03-12T16:36:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.885+0000 7f806dfdd700 1 -- 172.21.15.6:0/908132028 shutdown_connections 2024-03-12T16:36:36.880 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.885+0000 7f806dfdd700 1 --2- 172.21.15.6:0/908132028 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80680fd100 0x7f80680f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.885+0000 7f806dfdd700 1 --2- 172.21.15.6:0/908132028 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fc830 0x7f80680fcc10 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.885+0000 7f806dfdd700 1 -- 172.21.15.6:0/908132028 >> 172.21.15.6:0/908132028 conn(0x7f806806c760 msgr2=0x7f806806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.885+0000 7f806dfdd700 1 -- 172.21.15.6:0/908132028 shutdown_connections 2024-03-12T16:36:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.885+0000 7f806dfdd700 1 -- 172.21.15.6:0/908132028 wait complete. 2024-03-12T16:36:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.885+0000 7f806dfdd700 1 Processor -- start 2024-03-12T16:36:36.881 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.885+0000 7f806dfdd700 1 -- start start 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f806dfdd700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80680fc830 0x7f806810ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f806dfdd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fd100 0x7f806810d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f806dfdd700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806810d970 con 0x7f80680fd100 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f806dfdd700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f806810dab0 con 0x7f80680fc830 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8066ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fd100 0x7f806810d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8066ffd700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fd100 0x7f806810d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60266/0 (socket says 172.21.15.6:60266) 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8066ffd700 1 -- 172.21.15.6:0/2316999576 learned_addr learned my addr 172.21.15.6:0/2316999576 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f80677fe700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80680fc830 0x7f806810ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8066ffd700 1 -- 172.21.15.6:0/2316999576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80680fc830 msgr2=0x7f806810ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8066ffd700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80680fc830 0x7f806810ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:36.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8066ffd700 1 -- 172.21.15.6:0/2316999576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8050005040 con 0x7f80680fd100 2024-03-12T16:36:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8066ffd700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fd100 0x7f806810d370 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f805800c790 tx=0x7f8058004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8064ff9700 1 -- 172.21.15.6:0/2316999576 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f80580106f0 con 0x7f80680fd100 2024-03-12T16:36:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8064ff9700 1 -- 172.21.15.6:0/2316999576 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8058010d00 con 0x7f80680fd100 2024-03-12T16:36:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8068107140 con 0x7f80680fd100 2024-03-12T16:36:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f8064ff9700 1 -- 172.21.15.6:0/2316999576 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8058012da0 con 0x7f80680fd100 2024-03-12T16:36:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.886+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8068107700 con 0x7f80680fd100 2024-03-12T16:36:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.887+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f806805f380 con 0x7f80680fd100 2024-03-12T16:36:36.884 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.888+0000 7f8064ff9700 1 -- 172.21.15.6:0/2316999576 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8058012400 con 0x7f80680fd100 2024-03-12T16:36:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.888+0000 7f8064ff9700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f805406caa0 0x7f805406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.888+0000 7f8064ff9700 1 -- 172.21.15.6:0/2316999576 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f805808b750 con 0x7f80680fd100 2024-03-12T16:36:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.888+0000 7f80677fe700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f805406caa0 0x7f805406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:36.885 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.889+0000 7f80677fe700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f805406caa0 0x7f805406ef60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f8050004f10 tx=0x7f805000b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:36.888 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:36.893+0000 7f8064ff9700 1 -- 172.21.15.6:0/2316999576 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f80580591f0 con 0x7f80680fd100 2024-03-12T16:36:37.085 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.090+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7f80680f9960 con 0x7f80680fd100 2024-03-12T16:36:37.086 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.091+0000 7f8064ff9700 1 -- 172.21.15.6:0/2316999576 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7f805805f020 con 0x7f80680fd100 2024-03-12T16:36:37.086 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-03-12T16:36:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f805406caa0 msgr2=0x7f805406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f805406caa0 0x7f805406ef60 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 rx=0x7f8050004f10 tx=0x7f805000b040).stop 2024-03-12T16:36:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fd100 msgr2=0x7f806810d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fd100 0x7f806810d370 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 rx=0x7f805800c790 tx=0x7f8058004330).stop 2024-03-12T16:36:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 shutdown_connections 2024-03-12T16:36:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f80680fc830 0x7f806810ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.088 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f805406caa0 0x7f805406ef60 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 --2- 172.21.15.6:0/2316999576 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f80680fd100 0x7f806810d370 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 >> 172.21.15.6:0/2316999576 conn(0x7f806806c760 msgr2=0x7f80680ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:37.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 shutdown_connections 2024-03-12T16:36:37.089 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.093+0000 7f806dfdd700 1 -- 172.21.15.6:0/2316999576 wait complete. 2024-03-12T16:36:37.099 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:36 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/160788098' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-03-12T16:36:37.099 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:36 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/52385081' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-03-12T16:36:37.100 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-12T16:36:37.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:36 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/160788098' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 31, "format": "json"}]: dispatch 2024-03-12T16:36:37.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:36 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/52385081' entity='client.admin' cmd=[{"prefix": "fs dump", "epoch": 32, "format": "json"}]: dispatch 2024-03-12T16:36:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 -- 172.21.15.6:0/3635970211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fe230 msgr2=0x7f8bf40f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 --2- 172.21.15.6:0/3635970211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fe230 0x7f8bf40f7a10 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 rx=0x7f8be40047f0 tx=0x7f8be4009cb0).stop 2024-03-12T16:36:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 -- 172.21.15.6:0/3635970211 shutdown_connections 2024-03-12T16:36:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 --2- 172.21.15.6:0/3635970211 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fe230 0x7f8bf40f7a10 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 --2- 172.21.15.6:0/3635970211 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf40fd8d0 0x7f8bf40fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 -- 172.21.15.6:0/3635970211 >> 172.21.15.6:0/3635970211 conn(0x7f8bf40f3490 msgr2=0x7f8bf40f58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 -- 172.21.15.6:0/3635970211 shutdown_connections 2024-03-12T16:36:37.223 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 -- 172.21.15.6:0/3635970211 wait complete. 2024-03-12T16:36:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 Processor -- start 2024-03-12T16:36:37.225 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.228+0000 7f8bf8b68700 1 -- start start 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf8b68700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fd8d0 0x7f8bf410df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf8b68700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf40fe230 0x7f8bf410e460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf8b68700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf410ea60 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf8b68700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f8bf410eba0 con 0x7f8bf40fe230 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fd8d0 0x7f8bf410df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf259c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fd8d0 0x7f8bf410df70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60284/0 (socket says 172.21.15.6:60284) 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf259c700 1 -- 172.21.15.6:0/1614428084 learned_addr learned my addr 172.21.15.6:0/1614428084 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf1d9b700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf40fe230 0x7f8bf410e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf259c700 1 -- 172.21.15.6:0/1614428084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf40fe230 msgr2=0x7f8bf410e460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf259c700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf40fe230 0x7f8bf410e460 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf259c700 1 -- 172.21.15.6:0/1614428084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f8be4005040 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf259c700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fd8d0 0x7f8bf410df70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f8be80041d0 tx=0x7f8be8009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:37.226 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8be37fe700 1 -- 172.21.15.6:0/1614428084 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8be8007b40 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f8bf4108230 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8be37fe700 1 -- 172.21.15.6:0/1614428084 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f8be800f040 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.229+0000 7f8be37fe700 1 -- 172.21.15.6:0/1614428084 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f8be80147b0 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.230+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f8bf41087f0 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.230+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f8bf40606d0 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.231+0000 7f8be37fe700 1 -- 172.21.15.6:0/1614428084 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8be8009110 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.231+0000 7f8be37fe700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8bdc06caa0 0x7f8bdc06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.231+0000 7f8be37fe700 1 -- 172.21.15.6:0/1614428084 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f8be808bd90 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.231+0000 7f8bf1d9b700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8bdc06caa0 0x7f8bdc06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:37.228 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.232+0000 7f8bf1d9b700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8bdc06caa0 0x7f8bdc06ef60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f8bf41098b0 tx=0x7f8be400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:37.231 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.236+0000 7f8be37fe700 1 -- 172.21.15.6:0/1614428084 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f8be80598f0 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.426 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.431+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7f8bf405eec0 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.427 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.432+0000 7f8be37fe700 1 -- 172.21.15.6:0/1614428084 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8be8059480 con 0x7f8bf40fd8d0 2024-03-12T16:36:37.427 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-03-12T16:36:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.433+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8bdc06caa0 msgr2=0x7f8bdc06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.433+0000 7f8bf8b68700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8bdc06caa0 0x7f8bdc06ef60 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 rx=0x7f8bf41098b0 tx=0x7f8be400b040).stop 2024-03-12T16:36:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.433+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fd8d0 msgr2=0x7f8bf410df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.433+0000 7f8bf8b68700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fd8d0 0x7f8bf410df70 secure :-1 s=READY pgs=640 cs=0 l=1 rev1=1 rx=0x7f8be80041d0 tx=0x7f8be8009f60).stop 2024-03-12T16:36:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.434+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 shutdown_connections 2024-03-12T16:36:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.434+0000 7f8bf8b68700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f8bdc06caa0 0x7f8bdc06ef60 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.434+0000 7f8bf8b68700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f8bf40fd8d0 0x7f8bf410df70 unknown :-1 s=CLOSED pgs=640 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.434+0000 7f8bf8b68700 1 --2- 172.21.15.6:0/1614428084 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f8bf40fe230 0x7f8bf410e460 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.429 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.434+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 >> 172.21.15.6:0/1614428084 conn(0x7f8bf40f3490 msgr2=0x7f8bf40fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.434+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 shutdown_connections 2024-03-12T16:36:37.430 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.434+0000 7f8bf8b68700 1 -- 172.21.15.6:0/1614428084 wait complete. 2024-03-12T16:36:37.441 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-12T16:36:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.569+0000 7f7a311bb700 1 -- 172.21.15.6:0/2320959413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fe230 msgr2=0x7f7a2c0f7a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.569+0000 7f7a311bb700 1 --2- 172.21.15.6:0/2320959413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fe230 0x7f7a2c0f7a10 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 rx=0x7f7a1c0047f0 tx=0x7f7a1c009cb0).stop 2024-03-12T16:36:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.569+0000 7f7a311bb700 1 -- 172.21.15.6:0/2320959413 shutdown_connections 2024-03-12T16:36:37.564 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.569+0000 7f7a311bb700 1 --2- 172.21.15.6:0/2320959413 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fe230 0x7f7a2c0f7a10 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.569+0000 7f7a311bb700 1 --2- 172.21.15.6:0/2320959413 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0fd8d0 0x7f7a2c0fdcb0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.569+0000 7f7a311bb700 1 -- 172.21.15.6:0/2320959413 >> 172.21.15.6:0/2320959413 conn(0x7f7a2c0f3490 msgr2=0x7f7a2c0f58b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.569+0000 7f7a311bb700 1 -- 172.21.15.6:0/2320959413 shutdown_connections 2024-03-12T16:36:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.569+0000 7f7a311bb700 1 -- 172.21.15.6:0/2320959413 wait complete. 2024-03-12T16:36:37.565 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.569+0000 7f7a311bb700 1 Processor -- start 2024-03-12T16:36:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a311bb700 1 -- start start 2024-03-12T16:36:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a311bb700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fd8d0 0x7f7a2c06b0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a311bb700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0fe230 0x7f7a2c06b5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a311bb700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c06bab0 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a311bb700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f7a2c06bbf0 con 0x7f7a2c0fe230 2024-03-12T16:36:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a2ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fd8d0 0x7f7a2c06b0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a2ad9d700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fd8d0 0x7f7a2c06b0d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60310/0 (socket says 172.21.15.6:60310) 2024-03-12T16:36:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a2ad9d700 1 -- 172.21.15.6:0/1588911918 learned_addr learned my addr 172.21.15.6:0/1588911918 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:37.567 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a2a59c700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0fe230 0x7f7a2c06b5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a2ad9d700 1 -- 172.21.15.6:0/1588911918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0fe230 msgr2=0x7f7a2c06b5c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a2ad9d700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0fe230 0x7f7a2c06b5c0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a2ad9d700 1 -- 172.21.15.6:0/1588911918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f7a1c005040 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a2ad9d700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fd8d0 0x7f7a2c06b0d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f7a2000e8f0 tx=0x7f7a2000b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.570+0000 7f7a13fff700 1 -- 172.21.15.6:0/1588911918 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a2000ee90 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.571+0000 7f7a13fff700 1 -- 172.21.15.6:0/1588911918 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f7a2000f040 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.571+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f7a2c06bea0 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.571+0000 7f7a13fff700 1 -- 172.21.15.6:0/1588911918 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f7a2000c8a0 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.571+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f7a2c114780 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.572+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f7a2c0606d0 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.568 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.572+0000 7f7a13fff700 1 -- 172.21.15.6:0/1588911918 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f7a20007b40 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.572+0000 7f7a13fff700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.573+0000 7f7a13fff700 1 -- 172.21.15.6:0/1588911918 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f7a2008b970 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.573+0000 7f7a2a59c700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:37.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.573+0000 7f7a2a59c700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7a1c004e60 tx=0x7f7a1c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:37.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.577+0000 7f7a13fff700 1 -- 172.21.15.6:0/1588911918 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f7a20055a40 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.775+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f7a2c06c6b0 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.770 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.775+0000 7f7a13fff700 1 -- 172.21.15.6:0/1588911918 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f7a20059060 con 0x7f7a2c0fd8d0 2024-03-12T16:36:37.771 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-03-12T16:36:37.772 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.777+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 msgr2=0x7f7a1406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.777+0000 7f7a311bb700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 rx=0x7f7a1c004e60 tx=0x7f7a1c00b040).stop 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.777+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fd8d0 msgr2=0x7f7a2c06b0d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.777+0000 7f7a311bb700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fd8d0 0x7f7a2c06b0d0 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 rx=0x7f7a2000e8f0 tx=0x7f7a2000b040).stop 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.777+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 shutdown_connections 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.777+0000 7f7a311bb700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f7a1406caa0 0x7f7a1406ef60 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.777+0000 7f7a311bb700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f7a2c0fd8d0 0x7f7a2c06b0d0 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.777+0000 7f7a311bb700 1 --2- 172.21.15.6:0/1588911918 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f7a2c0fe230 0x7f7a2c06b5c0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.777+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 >> 172.21.15.6:0/1588911918 conn(0x7f7a2c0f3490 msgr2=0x7f7a2c0fbc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.778+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 shutdown_connections 2024-03-12T16:36:37.773 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.778+0000 7f7a311bb700 1 -- 172.21.15.6:0/1588911918 wait complete. 2024-03-12T16:36:37.785 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-12T16:36:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.911+0000 7f0797b24700 1 -- 172.21.15.6:0/401840491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fc830 msgr2=0x7f07900fcc10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.911+0000 7f0797b24700 1 --2- 172.21.15.6:0/401840491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fc830 0x7f07900fcc10 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 rx=0x7f078c0047f0 tx=0x7f078c009cb0).stop 2024-03-12T16:36:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.912+0000 7f0797b24700 1 -- 172.21.15.6:0/401840491 shutdown_connections 2024-03-12T16:36:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.912+0000 7f0797b24700 1 --2- 172.21.15.6:0/401840491 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07900fd100 0x7f07900f6930 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.912+0000 7f0797b24700 1 --2- 172.21.15.6:0/401840491 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fc830 0x7f07900fcc10 unknown :-1 s=CLOSED pgs=643 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.907 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.912+0000 7f0797b24700 1 -- 172.21.15.6:0/401840491 >> 172.21.15.6:0/401840491 conn(0x7f079006c760 msgr2=0x7f079006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.912+0000 7f0797b24700 1 -- 172.21.15.6:0/401840491 shutdown_connections 2024-03-12T16:36:37.908 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.912+0000 7f0797b24700 1 -- 172.21.15.6:0/401840491 wait complete. 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.912+0000 7f0797b24700 1 Processor -- start 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.912+0000 7f0797b24700 1 -- start start 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f0797b24700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07900fc830 0x7f079010ce80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f0797b24700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fd100 0x7f079010d370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f0797b24700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079010d970 con 0x7f07900fd100 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f0797b24700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f079010dab0 con 0x7f07900fc830 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f07950bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fd100 0x7f079010d370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f07950bf700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fd100 0x7f079010d370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60330/0 (socket says 172.21.15.6:60330) 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f07950bf700 1 -- 172.21.15.6:0/2350615941 learned_addr learned my addr 172.21.15.6:0/2350615941 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f07958c0700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07900fc830 0x7f079010ce80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f07950bf700 1 -- 172.21.15.6:0/2350615941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07900fc830 msgr2=0x7f079010ce80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:37.910 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f07950bf700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07900fc830 0x7f079010ce80 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f07950bf700 1 -- 172.21.15.6:0/2350615941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f078c005040 con 0x7f07900fd100 2024-03-12T16:36:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f07950bf700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fd100 0x7f079010d370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f07840041d0 tx=0x7f0784009f60).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f0782ffd700 1 -- 172.21.15.6:0/2350615941 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f0784007b40 con 0x7f07900fd100 2024-03-12T16:36:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f0782ffd700 1 -- 172.21.15.6:0/2350615941 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f078400f040 con 0x7f07900fd100 2024-03-12T16:36:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f0790107140 con 0x7f07900fd100 2024-03-12T16:36:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.913+0000 7f0782ffd700 1 -- 172.21.15.6:0/2350615941 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f07840147b0 con 0x7f07900fd100 2024-03-12T16:36:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.914+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f0790107700 con 0x7f07900fd100 2024-03-12T16:36:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.914+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f079005f380 con 0x7f07900fd100 2024-03-12T16:36:37.911 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.915+0000 7f0782ffd700 1 -- 172.21.15.6:0/2350615941 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f0784009110 con 0x7f07900fd100 2024-03-12T16:36:37.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.915+0000 7f0782ffd700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f077c06caa0 0x7f077c06ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:37.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.915+0000 7f0782ffd700 1 -- 172.21.15.6:0/2350615941 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f078408bcf0 con 0x7f07900fd100 2024-03-12T16:36:37.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.915+0000 7f07958c0700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f077c06caa0 0x7f077c06ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:37.912 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.916+0000 7f07958c0700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f077c06caa0 0x7f077c06ef60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f078c004f10 tx=0x7f078c00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:37.915 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:37.920+0000 7f0782ffd700 1 -- 172.21.15.6:0/2350615941 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f0784059850 con 0x7f07900fd100 2024-03-12T16:36:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.133+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f079005eec0 con 0x7f07900fd100 2024-03-12T16:36:38.128 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.133+0000 7f0782ffd700 1 -- 172.21.15.6:0/2350615941 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 32 entries v85) v1 ==== 81+0+1875 (secure 0 0 0) 0x7f079005eec0 con 0x7f07900fd100 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6826/163878097 2024-03-13T16:18:54.111614+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:6825/3713757560 2024-03-13T16:18:54.111632+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:6824/3713757560 2024-03-13T16:18:54.111632+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1419012389 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3113166053 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4255668203 2024-03-13T16:01:12.726451+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/179696865 2024-03-13T16:01:44.393271+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/687610333 2024-03-13T16:01:44.393271+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1637754840 2024-03-13T16:01:12.726451+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2268121787 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/344339741 2024-03-13T16:01:44.393271+0000 2024-03-12T16:36:38.129 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/344339741 2024-03-13T16:01:44.393271+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3591243488 2024-03-13T16:02:39.916474+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/139345082 2024-03-13T16:09:39.532193+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3228405447 2024-03-13T16:02:39.916474+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3126632977 2024-03-13T16:09:39.532193+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2268121787 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:0/3223900424 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:6828/3354806786 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1732211885 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3591243488 2024-03-13T16:02:39.916474+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/860696411 2024-03-13T16:01:12.726451+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4085533321 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:6829/3354806786 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:38.130 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6827/163878097 2024-03-13T16:18:54.111614+0000 2024-03-12T16:36:38.131 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:0/182723627 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:38.131 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:0/1919894603 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:38.131 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/124082729 2024-03-13T16:09:39.532193+0000 2024-03-12T16:36:38.131 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/860696411 2024-03-13T16:01:12.726451+0000 2024-03-12T16:36:38.131 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4212806006 2024-03-13T16:02:39.916474+0000 2024-03-12T16:36:38.131 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/139345082 2024-03-13T16:09:39.532193+0000 2024-03-12T16:36:38.131 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:0/500953021 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f077c06caa0 msgr2=0x7f077c06ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f077c06caa0 0x7f077c06ef60 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 rx=0x7f078c004f10 tx=0x7f078c00b040).stop 2024-03-12T16:36:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fd100 msgr2=0x7f079010d370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fd100 0x7f079010d370 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 rx=0x7f07840041d0 tx=0x7f0784009f60).stop 2024-03-12T16:36:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 shutdown_connections 2024-03-12T16:36:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f07900fc830 0x7f079010ce80 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.132 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f077c06caa0 0x7f077c06ef60 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 --2- 172.21.15.6:0/2350615941 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f07900fd100 0x7f079010d370 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 >> 172.21.15.6:0/2350615941 conn(0x7f079006c760 msgr2=0x7f07900ffdf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:38.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 shutdown_connections 2024-03-12T16:36:38.133 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.136+0000 7f0797b24700 1 -- 172.21.15.6:0/2350615941 wait complete. 2024-03-12T16:36:38.133 INFO:teuthology.orchestra.run.smithi006.stderr:listed 32 entries 2024-03-12T16:36:38.141 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:37 smithi006 ceph-mon[103869]: pgmap v702: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:38.142 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:37 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/199170255' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:36:38.142 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:37 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2316999576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-12T16:36:38.142 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:37 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1614428084' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-12T16:36:38.143 DEBUG:teuthology.orchestra.run.smithi006:> set -ex 2024-03-12T16:36:38.143 DEBUG:teuthology.orchestra.run.smithi006:> dd if=/proc/self/mounts of=/dev/stdout 2024-03-12T16:36:38.163 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-03-12T16:36:38.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:37 smithi134 ceph-mon[85099]: pgmap v702: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:38.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:37 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/199170255' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:36:38.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:37 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2316999576' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-12T16:36:38.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:37 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1614428084' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-12T16:36:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.328+0000 7fb6b2112700 1 -- 172.21.15.6:0/1269277143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 msgr2=0x7fb6ac0fcd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.328+0000 7fb6b2112700 1 --2- 172.21.15.6:0/1269277143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 0x7fb6ac0fcd10 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 rx=0x7fb69c0047f0 tx=0x7fb69c009cb0).stop 2024-03-12T16:36:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.328+0000 7fb6b2112700 1 -- 172.21.15.6:0/1269277143 shutdown_connections 2024-03-12T16:36:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.328+0000 7fb6b2112700 1 --2- 172.21.15.6:0/1269277143 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6ac0fd290 0x7fb6ac0f6a70 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.323 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.328+0000 7fb6b2112700 1 --2- 172.21.15.6:0/1269277143 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 0x7fb6ac0fcd10 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.328+0000 7fb6b2112700 1 -- 172.21.15.6:0/1269277143 >> 172.21.15.6:0/1269277143 conn(0x7fb6ac0f24f0 msgr2=0x7fb6ac0f4910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.328+0000 7fb6b2112700 1 -- 172.21.15.6:0/1269277143 shutdown_connections 2024-03-12T16:36:38.324 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.328+0000 7fb6b2112700 1 -- 172.21.15.6:0/1269277143 wait complete. 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.328+0000 7fb6b2112700 1 Processor -- start 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6b2112700 1 -- start start 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6b2112700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 0x7fb6ac10d1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6b2112700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6ac0fd290 0x7fb6ac10d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6b2112700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac10dca0 con 0x7fb6ac0fc930 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6b2112700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fb6ac10dde0 con 0x7fb6ac0fd290 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6ab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 0x7fb6ac10d1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6ab7fe700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 0x7fb6ac10d1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60344/0 (socket says 172.21.15.6:60344) 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6ab7fe700 1 -- 172.21.15.6:0/123854690 learned_addr learned my addr 172.21.15.6:0/123854690 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6aaffd700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6ac0fd290 0x7fb6ac10d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:38.326 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6ab7fe700 1 -- 172.21.15.6:0/123854690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6ac0fd290 msgr2=0x7fb6ac10d6a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6ab7fe700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6ac0fd290 0x7fb6ac10d6a0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6ab7fe700 1 -- 172.21.15.6:0/123854690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fb69c005040 con 0x7fb6ac0fc930 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.329+0000 7fb6aaffd700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6ac0fd290 0x7fb6ac10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.330+0000 7fb6ab7fe700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 0x7fb6ac10d1b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fb69c009380 tx=0x7fb69c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.330+0000 7fb6a8ff9700 1 -- 172.21.15.6:0/123854690 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb69c018070 con 0x7fb6ac0fc930 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.330+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fb6ac107410 con 0x7fb6ac0fc930 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.330+0000 7fb6a8ff9700 1 -- 172.21.15.6:0/123854690 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fb69c007e90 con 0x7fb6ac0fc930 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.330+0000 7fb6a8ff9700 1 -- 172.21.15.6:0/123854690 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fb69c01c380 con 0x7fb6ac0fc930 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.330+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fb6ac1078f0 con 0x7fb6ac0fc930 2024-03-12T16:36:38.327 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.331+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fb6ac060400 con 0x7fb6ac0fc930 2024-03-12T16:36:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.331+0000 7fb6a8ff9700 1 -- 172.21.15.6:0/123854690 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fb69c0123c0 con 0x7fb6ac0fc930 2024-03-12T16:36:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.332+0000 7fb6a8ff9700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb69806cab0 0x7fb69806ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.332+0000 7fb6a8ff9700 1 -- 172.21.15.6:0/123854690 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fb69c08cba0 con 0x7fb6ac0fc930 2024-03-12T16:36:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.332+0000 7fb6aaffd700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb69806cab0 0x7fb69806ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:38.328 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.332+0000 7fb6aaffd700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb69806cab0 0x7fb69806ef70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fb694007fd0 tx=0x7fb69400b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:38.331 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.336+0000 7fb6a8ff9700 1 -- 172.21.15.6:0/123854690 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fb69c05a700 con 0x7fb6ac0fc930 2024-03-12T16:36:38.534 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.539+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) v1 -- 0x7fb6ac108830 con 0x7fb6ac0fc930 2024-03-12T16:36:38.535 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.540+0000 7fb6a8ff9700 1 -- 172.21.15.6:0/123854690 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v85) v1 ==== 74+0+16089 (secure 0 0 0) 0x7fb69c05a290 con 0x7fb6ac0fc930 2024-03-12T16:36:38.535 INFO:teuthology.orchestra.run.smithi006.stdout: 2024-03-12T16:36:38.536 INFO:teuthology.orchestra.run.smithi006.stdout:{"epoch":85,"fsid":"88d7ee42-e089-11ee-95c8-87774f69a715","created":"2024-03-12T16:00:42.612784+0000","modified":"2024-03-12T16:19:47.764663+0000","last_up_change":"2024-03-12T16:18:56.265381+0000","last_in_change":"2024-03-12T16:05:41.290069+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":20,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":3,"max_osd":6,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"reef","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-03-12T16:04:29.453605+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"47","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{},"mgr_devicehealth":{}},"read_balance":{"score_acting":6,"score_stable":6,"optimal_score":0.5,"raw_score_acting":3,"raw_score_stable":3,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"cephfs.cephfs.meta","create_time":"2024-03-12T16:07:20.200653+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"42","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4,"pg_num_min":16,"recovery_priority":5},"application_metadata":{"cephfs":{"metadata":"cephfs"}},"read_balance":{"score_acting":1.690000057220459,"score_stable":1.690000057220459,"optimal_score":1,"raw_score_acting":1.690000057220459,"raw_score_stable":1.690000057220459,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"cephfs.cephfs.data","create_time":"2024-03-12T16:07:20.688894+0000","flags":131073,"flags_names":"hashpspool,bulk","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"43","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"cephfs":{"data":"cephfs"}},"read_balance":{"score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"81b3ff11-3d87-4f3b-a302-c8c55f378ce1","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":9,"last_clean_end":49,"up_from":53,"up_thru":80,"down_at":50,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6802","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6803","nonce":1475010970}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6804","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6805","nonce":1475010970}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6808","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6809","nonce":1475010970}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6806","nonce":1475010970},{"type":"v1","addr":"172.21.15.6:6807","nonce":1475010970}]},"public_addr":"172.21.15.6:6803/1475010970","cluster_addr":"172.21.15.6:6805/1475010970","heartbeat_back_addr":"172.21.15.6:6809/1475010970","heartbeat_front_addr":"172.21.15.6:6807/1475010970","state":["exists","up"]},{"osd":1,"uuid":"e638e6a3-7dc0-47f6-8901-1bdb1c208583","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":14,"last_clean_end":54,"up_from":58,"up_thru":80,"down_at":55,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6810","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6811","nonce":4090040477}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6812","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6813","nonce":4090040477}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6816","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6817","nonce":4090040477}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6814","nonce":4090040477},{"type":"v1","addr":"172.21.15.6:6815","nonce":4090040477}]},"public_addr":"172.21.15.6:6811/4090040477","cluster_addr":"172.21.15.6:6813/4090040477","heartbeat_back_addr":"172.21.15.6:6817/4090040477","heartbeat_front_addr":"172.21.15.6:6815/4090040477","state":["exists","up"]},{"osd":2,"uuid":"45eed951-90a9-4fe0-a184-11b5e1ebe46d","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":19,"last_clean_end":59,"up_from":63,"up_thru":80,"down_at":60,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6818","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6819","nonce":1248094022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6820","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6821","nonce":1248094022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6824","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6825","nonce":1248094022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.6:6822","nonce":1248094022},{"type":"v1","addr":"172.21.15.6:6823","nonce":1248094022}]},"public_addr":"172.21.15.6:6819/1248094022","cluster_addr":"172.21.15.6:6821/1248094022","heartbeat_back_addr":"172.21.15.6:6825/1248094022","heartbeat_front_addr":"172.21.15.6:6823/1248094022","state":["exists","up"]},{"osd":3,"uuid":"47d2f20b-d7b8-4d67-905c-af29938d36d0","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":26,"last_clean_end":64,"up_from":68,"up_thru":80,"down_at":65,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6800","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6801","nonce":3039719923}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6802","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6803","nonce":3039719923}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6806","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6807","nonce":3039719923}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6804","nonce":3039719923},{"type":"v1","addr":"172.21.15.134:6805","nonce":3039719923}]},"public_addr":"172.21.15.134:6801/3039719923","cluster_addr":"172.21.15.134:6803/3039719923","heartbeat_back_addr":"172.21.15.134:6807/3039719923","heartbeat_front_addr":"172.21.15.134:6805/3039719923","state":["exists","up"]},{"osd":4,"uuid":"bfe8b5a1-489a-458d-ba30-5d1bada0c33e","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":32,"last_clean_end":69,"up_from":73,"up_thru":80,"down_at":70,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6808","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6809","nonce":3599039531}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6810","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6811","nonce":3599039531}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6814","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6815","nonce":3599039531}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6812","nonce":3599039531},{"type":"v1","addr":"172.21.15.134:6813","nonce":3599039531}]},"public_addr":"172.21.15.134:6809/3599039531","cluster_addr":"172.21.15.134:6811/3599039531","heartbeat_back_addr":"172.21.15.134:6815/3599039531","heartbeat_front_addr":"172.21.15.134:6813/3599039531","state":["exists","up"]},{"osd":5,"uuid":"02e056ee-a66a-4c23-a819-1e4c1e2d1236","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":37,"last_clean_end":74,"up_from":80,"up_thru":80,"down_at":75,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6816","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6817","nonce":4202679969}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6818","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6819","nonce":4202679969}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6822","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6823","nonce":4202679969}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.134:6820","nonce":4202679969},{"type":"v1","addr":"172.21.15.134:6821","nonce":4202679969}]},"public_addr":"172.21.15.134:6817/4202679969","cluster_addr":"172.21.15.134:6819/4202679969","heartbeat_back_addr":"172.21.15.134:6823/4202679969","heartbeat_front_addr":"172.21.15.134:6821/4202679969","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:35.977637+0000","dead_epoch":49},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:03:59.443373+0000","dead_epoch":54},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:04:27.106208+0000","dead_epoch":59},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:02.955636+0000","dead_epoch":64},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:30.634685+0000","dead_epoch":69},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138322906710015,"old_weight":0,"last_purged_snaps_scrub":"2024-03-12T16:05:58.981490+0000","dead_epoch":74}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.6:6826/163878097":"2024-03-13T16:18:54.111614+0000","172.21.15.134:6825/3713757560":"2024-03-13T16:18:54.111632+0000","172.21.15.134:6824/3713757560":"2024-03-13T16:18:54.111632+0000","172.21.15.6:0/1419012389":"2024-03-13T16:14:31.789372+0000","172.21.15.6:0/3113166053":"2024-03-13T16:14:31.789372+0000","172.21.15.6:0/4255668203":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/179696865":"2024-03-13T16:01:44.393271+0000","172.21.15.6:0/687610333":"2024-03-13T16:01:44.393271+0000","172.21.15.6:0/1637754840":"2024-03-13T16:01:12.726451+0000","172.21.15.6:6801/2268121787":"2024-03-13T16:14:31.789372+0000","172.21.15.6:6801/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6800/344339741":"2024-03-13T16:01:44.393271+0000","172.21.15.6:6801/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/139345082":"2024-03-13T16:09:39.532193+0000","172.21.15.6:0/3228405447":"2024-03-13T16:02:39.916474+0000","172.21.15.6:0/3126632977":"2024-03-13T16:09:39.532193+0000","172.21.15.6:6800/2268121787":"2024-03-13T16:14:31.789372+0000","172.21.15.134:0/3223900424":"2024-03-13T16:11:51.047707+0000","172.21.15.134:6828/3354806786":"2024-03-13T16:11:51.047707+0000","172.21.15.6:0/1732211885":"2024-03-13T16:14:31.789372+0000","172.21.15.6:6800/3591243488":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6800/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4085533321":"2024-03-13T16:14:31.789372+0000","172.21.15.134:6829/3354806786":"2024-03-13T16:11:51.047707+0000","172.21.15.6:6827/163878097":"2024-03-13T16:18:54.111614+0000","172.21.15.134:0/182723627":"2024-03-13T16:11:51.047707+0000","172.21.15.134:0/1919894603":"2024-03-13T16:11:51.047707+0000","172.21.15.6:0/124082729":"2024-03-13T16:09:39.532193+0000","172.21.15.6:6801/860696411":"2024-03-13T16:01:12.726451+0000","172.21.15.6:0/4212806006":"2024-03-13T16:02:39.916474+0000","172.21.15.6:6801/139345082":"2024-03-13T16:09:39.532193+0000","172.21.15.134:0/500953021":"2024-03-13T16:11:51.047707+0000"},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb69806cab0 msgr2=0x7fb69806ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb69806cab0 0x7fb69806ef70 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 rx=0x7fb694007fd0 tx=0x7fb69400b040).stop 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 msgr2=0x7fb6ac10d1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 0x7fb6ac10d1b0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 rx=0x7fb69c009380 tx=0x7fb69c009cb0).stop 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 shutdown_connections 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fb69806cab0 0x7fb69806ef70 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fb6ac0fc930 0x7fb6ac10d1b0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 --2- 172.21.15.6:0/123854690 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fb6ac0fd290 0x7fb6ac10d6a0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 >> 172.21.15.6:0/123854690 conn(0x7fb6ac0f24f0 msgr2=0x7fb6ac0facf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:38.538 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 shutdown_connections 2024-03-12T16:36:38.539 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.543+0000 7fb6b2112700 1 -- 172.21.15.6:0/123854690 wait complete. 2024-03-12T16:36:38.550 INFO:tasks.cephfs.filesystem.ceph_manager:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-03-12T16:04:29.453605+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '47', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}, 'mgr_devicehealth': {}}, 'read_balance': {'score_acting': 6, 'score_stable': 6, 'optimal_score': 0.5, 'raw_score_acting': 3, 'raw_score_stable': 3, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 2, 'pool_name': 'cephfs.cephfs.meta', 'create_time': '2024-03-12T16:07:20.200653+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '42', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_autoscale_bias': 4, 'pg_num_min': 16, 'recovery_priority': 5}, 'application_metadata': {'cephfs': {'metadata': 'cephfs'}}, 'read_balance': {'score_acting': 1.690000057220459, 'score_stable': 1.690000057220459, 'optimal_score': 1, 'raw_score_acting': 1.690000057220459, 'raw_score_stable': 1.690000057220459, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}, {'pool': 3, 'pool_name': 'cephfs.cephfs.data', 'create_time': '2024-03-12T16:07:20.688894+0000', 'flags': 131073, 'flags_names': 'hashpspool,bulk', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 32, 'pg_placement_num': 32, 'pg_placement_num_target': 32, 'pg_num_target': 32, 'pg_num_pending': 32, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '43', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {}, 'application_metadata': {'cephfs': {'data': 'cephfs'}}, 'read_balance': {'score_acting': 1.5, 'score_stable': 1.5, 'optimal_score': 1, 'raw_score_acting': 1.5, 'raw_score_stable': 1.5, 'primary_affinity_weighted': 1, 'average_primary_affinity': 1, 'average_primary_affinity_weighted': 1}}] 2024-03-12T16:36:38.551 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get .mgr pg_num 2024-03-12T16:36:38.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 -- 172.21.15.6:0/2104532256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 msgr2=0x7fe56c101a60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 --2- 172.21.15.6:0/2104532256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 0x7fe56c101a60 secure :-1 s=READY pgs=647 cs=0 l=1 rev1=1 rx=0x7fe55c0047f0 tx=0x7fe55c009cb0).stop 2024-03-12T16:36:38.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 -- 172.21.15.6:0/2104532256 shutdown_connections 2024-03-12T16:36:38.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 --2- 172.21.15.6:0/2104532256 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 0x7fe56c101a60 unknown :-1 s=CLOSED pgs=647 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 --2- 172.21.15.6:0/2104532256 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe56c0f89f0 0x7fe56c0f8dd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 -- 172.21.15.6:0/2104532256 >> 172.21.15.6:0/2104532256 conn(0x7fe56c06c760 msgr2=0x7fe56c06cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:38.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 -- 172.21.15.6:0/2104532256 shutdown_connections 2024-03-12T16:36:38.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 -- 172.21.15.6:0/2104532256 wait complete. 2024-03-12T16:36:38.676 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 Processor -- start 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 -- start start 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.679+0000 7fe573a97700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe56c0f89f0 0x7fe56c10dfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe573a97700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 0x7fe56c10e4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe573a97700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c10eac0 con 0x7fe56c0f92c0 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe573a97700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fe56c10ec00 con 0x7fe56c0f89f0 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe571032700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 0x7fe56c10e4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe571032700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 0x7fe56c10e4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60356/0 (socket says 172.21.15.6:60356) 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe571032700 1 -- 172.21.15.6:0/1264561701 learned_addr learned my addr 172.21.15.6:0/1264561701 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe571833700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe56c0f89f0 0x7fe56c10dfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe571032700 1 -- 172.21.15.6:0/1264561701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe56c0f89f0 msgr2=0x7fe56c10dfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe571032700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe56c0f89f0 0x7fe56c10dfd0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe571032700 1 -- 172.21.15.6:0/1264561701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fe55c005040 con 0x7fe56c0f92c0 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe571032700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 0x7fe56c10e4c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fe55c009380 tx=0x7fe55c009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:38.677 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe562f78700 1 -- 172.21.15.6:0/1264561701 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe55c00e070 con 0x7fe56c0f92c0 2024-03-12T16:36:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe562f78700 1 -- 172.21.15.6:0/1264561701 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fe55c007e90 con 0x7fe56c0f92c0 2024-03-12T16:36:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fe56c108290 con 0x7fe56c0f92c0 2024-03-12T16:36:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe562f78700 1 -- 172.21.15.6:0/1264561701 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fe55c018070 con 0x7fe56c0f92c0 2024-03-12T16:36:38.678 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.680+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fe56c1087d0 con 0x7fe56c0f92c0 2024-03-12T16:36:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.681+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fe56c05f380 con 0x7fe56c0f92c0 2024-03-12T16:36:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.682+0000 7fe562f78700 1 -- 172.21.15.6:0/1264561701 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fe55c01d420 con 0x7fe56c0f92c0 2024-03-12T16:36:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.682+0000 7fe562f78700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe55806caa0 0x7fe55806ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.682+0000 7fe562f78700 1 -- 172.21.15.6:0/1264561701 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fe55c08c880 con 0x7fe56c0f92c0 2024-03-12T16:36:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.682+0000 7fe571833700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe55806caa0 0x7fe55806ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:38.679 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.682+0000 7fe571833700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe55806caa0 0x7fe55806ef60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fe568009170 tx=0x7fe568009d60).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:38.682 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.687+0000 7fe562f78700 1 -- 172.21.15.6:0/1264561701 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fe55c05a4a0 con 0x7fe56c0f92c0 2024-03-12T16:36:38.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.884+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"} v 0) v1 -- 0x7fe56c0fef60 con 0x7fe56c0f92c0 2024-03-12T16:36:38.879 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.884+0000 7fe562f78700 1 -- 172.21.15.6:0/1264561701 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]=0 v85) v1 ==== 93+0+10 (secure 0 0 0) 0x7fe55c05a030 con 0x7fe56c0f92c0 2024-03-12T16:36:38.879 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 1 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe55806caa0 msgr2=0x7fe55806ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe55806caa0 0x7fe55806ef60 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 rx=0x7fe568009170 tx=0x7fe568009d60).stop 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 msgr2=0x7fe56c10e4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 0x7fe56c10e4c0 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 rx=0x7fe55c009380 tx=0x7fe55c009cb0).stop 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 shutdown_connections 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fe56c0f89f0 0x7fe56c10dfd0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fe55806caa0 0x7fe55806ef60 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 --2- 172.21.15.6:0/1264561701 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fe56c0f92c0 0x7fe56c10e4c0 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 >> 172.21.15.6:0/1264561701 conn(0x7fe56c06c760 msgr2=0x7fe56c0fc2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:38.882 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 shutdown_connections 2024-03-12T16:36:38.883 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:38.886+0000 7fe573a97700 1 -- 172.21.15.6:0/1264561701 wait complete. 2024-03-12T16:36:38.892 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:38 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1588911918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-12T16:36:38.892 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:38 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/2350615941' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-12T16:36:38.892 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:38 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/123854690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:36:38.893 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.meta pg_num 2024-03-12T16:36:39.018 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.021+0000 7fc00036f700 1 -- 172.21.15.6:0/1131001068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 msgr2=0x7fbff80f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.021+0000 7fc00036f700 1 --2- 172.21.15.6:0/1131001068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 0x7fbff80f6930 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 rx=0x7fbfec0047f0 tx=0x7fbfec009cb0).stop 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.021+0000 7fc00036f700 1 -- 172.21.15.6:0/1131001068 shutdown_connections 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.021+0000 7fc00036f700 1 --2- 172.21.15.6:0/1131001068 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 0x7fbff80f6930 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.021+0000 7fc00036f700 1 --2- 172.21.15.6:0/1131001068 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80fc830 0x7fbff80fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.021+0000 7fc00036f700 1 -- 172.21.15.6:0/1131001068 >> 172.21.15.6:0/1131001068 conn(0x7fbff806c760 msgr2=0x7fbff806cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.021+0000 7fc00036f700 1 -- 172.21.15.6:0/1131001068 shutdown_connections 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fc00036f700 1 -- 172.21.15.6:0/1131001068 wait complete. 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fc00036f700 1 Processor -- start 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fc00036f700 1 -- start start 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fc00036f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80fc830 0x7fbff810dfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fc00036f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 0x7fbff810e490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fc00036f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff810ea90 con 0x7fbff80fd100 2024-03-12T16:36:39.019 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fc00036f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7fbff810ebd0 con 0x7fbff80fc830 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fbffd90a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 0x7fbff810e490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fbffd90a700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 0x7fbff810e490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60382/0 (socket says 172.21.15.6:60382) 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.022+0000 7fbffd90a700 1 -- 172.21.15.6:0/214382067 learned_addr learned my addr 172.21.15.6:0/214382067 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fbffe10b700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80fc830 0x7fbff810dfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fbffd90a700 1 -- 172.21.15.6:0/214382067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80fc830 msgr2=0x7fbff810dfa0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fbffd90a700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80fc830 0x7fbff810dfa0 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fbffd90a700 1 -- 172.21.15.6:0/214382067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7fbfec005040 con 0x7fbff80fd100 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fbffd90a700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 0x7fbff810e490 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fbfec00b120 tx=0x7fbfec009cb0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fbfeb7fe700 1 -- 172.21.15.6:0/214382067 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfec00e030 con 0x7fbff80fd100 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7fbff8108200 con 0x7fbff80fd100 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fbfeb7fe700 1 -- 172.21.15.6:0/214382067 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7fbfec007e90 con 0x7fbff80fd100 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fbfeb7fe700 1 -- 172.21.15.6:0/214382067 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7fbfec018070 con 0x7fbff80fd100 2024-03-12T16:36:39.020 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.023+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7fbff8108760 con 0x7fbff80fd100 2024-03-12T16:36:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.024+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7fbff805f380 con 0x7fbff80fd100 2024-03-12T16:36:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.025+0000 7fbfeb7fe700 1 -- 172.21.15.6:0/214382067 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7fbfec009690 con 0x7fbff80fd100 2024-03-12T16:36:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.025+0000 7fbfeb7fe700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbfe406caa0 0x7fbfe406ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:39.021 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.025+0000 7fbfeb7fe700 1 -- 172.21.15.6:0/214382067 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7fbfec08d240 con 0x7fbff80fd100 2024-03-12T16:36:39.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.025+0000 7fbffe10b700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbfe406caa0 0x7fbfe406ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:39.022 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.025+0000 7fbffe10b700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbfe406caa0 0x7fbfe406ef60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fbff4004d20 tx=0x7fbff4009040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:39.024 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.030+0000 7fbfeb7fe700 1 -- 172.21.15.6:0/214382067 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7fbfec05ada0 con 0x7fbff80fd100 2024-03-12T16:36:39.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:38 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1588911918' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-12T16:36:39.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:38 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/2350615941' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-12T16:36:39.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:38 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/123854690' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-03-12T16:36:39.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.229+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"} v 0) v1 -- 0x7fbff81096c0 con 0x7fbff80fd100 2024-03-12T16:36:39.224 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.229+0000 7fbfeb7fe700 1 -- 172.21.15.6:0/214382067 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7fbfec05a930 con 0x7fbff80fd100 2024-03-12T16:36:39.225 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbfe406caa0 msgr2=0x7fbfe406ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbfe406caa0 0x7fbfe406ef60 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 rx=0x7fbff4004d20 tx=0x7fbff4009040).stop 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 msgr2=0x7fbff810e490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 0x7fbff810e490 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 rx=0x7fbfec00b120 tx=0x7fbfec009cb0).stop 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 shutdown_connections 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7fbff80fc830 0x7fbff810dfa0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7fbfe406caa0 0x7fbfe406ef60 unknown :-1 s=CLOSED pgs=346 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 --2- 172.21.15.6:0/214382067 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7fbff80fd100 0x7fbff810e490 unknown :-1 s=CLOSED pgs=650 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 >> 172.21.15.6:0/214382067 conn(0x7fbff806c760 msgr2=0x7fbff8060db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.231+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 shutdown_connections 2024-03-12T16:36:39.227 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.232+0000 7fc00036f700 1 -- 172.21.15.6:0/214382067 wait complete. 2024-03-12T16:36:39.239 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd pool get cephfs.cephfs.data pg_num 2024-03-12T16:36:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 -- 172.21.15.6:0/1878694808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fd100 msgr2=0x7f81100f6930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 --2- 172.21.15.6:0/1878694808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fd100 0x7f81100f6930 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 rx=0x7f80fc0047f0 tx=0x7f80fc009cb0).stop 2024-03-12T16:36:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 -- 172.21.15.6:0/1878694808 shutdown_connections 2024-03-12T16:36:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 --2- 172.21.15.6:0/1878694808 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fd100 0x7f81100f6930 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 --2- 172.21.15.6:0/1878694808 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81100fc830 0x7f81100fcc10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.364 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 -- 172.21.15.6:0/1878694808 >> 172.21.15.6:0/1878694808 conn(0x7f811006c760 msgr2=0x7f811006cb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 -- 172.21.15.6:0/1878694808 shutdown_connections 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 -- 172.21.15.6:0/1878694808 wait complete. 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 Processor -- start 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.367+0000 7f8116ffc700 1 -- start start 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8116ffc700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fc830 0x7f811010cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8116ffc700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81100fd100 0x7f811010d4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8116ffc700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811010dad0 con 0x7f81100fc830 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8116ffc700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f811010dc10 con 0x7f81100fd100 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8114d98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fc830 0x7f811010cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8114d98700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fc830 0x7f811010cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60396/0 (socket says 172.21.15.6:60396) 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8114d98700 1 -- 172.21.15.6:0/796493656 learned_addr learned my addr 172.21.15.6:0/796493656 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8114d98700 1 -- 172.21.15.6:0/796493656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81100fd100 msgr2=0x7f811010d4d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.365 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f810ffff700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81100fd100 0x7f811010d4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8114d98700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81100fd100 0x7f811010d4d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8114d98700 1 -- 172.21.15.6:0/796493656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f80fc005040 con 0x7f81100fc830 2024-03-12T16:36:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8114d98700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fc830 0x7f811010cfe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f810400e8f0 tx=0x7f810400b040).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f810dffb700 1 -- 172.21.15.6:0/796493656 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810400ee90 con 0x7f81100fc830 2024-03-12T16:36:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f810dffb700 1 -- 172.21.15.6:0/796493656 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f810400f040 con 0x7f81100fc830 2024-03-12T16:36:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f81101072f0 con 0x7f81100fc830 2024-03-12T16:36:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.368+0000 7f810dffb700 1 -- 172.21.15.6:0/796493656 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f810400c8a0 con 0x7f81100fc830 2024-03-12T16:36:39.366 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.369+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f81101078b0 con 0x7f81100fc830 2024-03-12T16:36:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.370+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f811005f380 con 0x7f81100fc830 2024-03-12T16:36:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.370+0000 7f810dffb700 1 -- 172.21.15.6:0/796493656 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f8104007b40 con 0x7f81100fc830 2024-03-12T16:36:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.370+0000 7f810dffb700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f810006caa0 0x7f810006ef60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.370+0000 7f810dffb700 1 -- 172.21.15.6:0/796493656 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f810408ba50 con 0x7f81100fc830 2024-03-12T16:36:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.370+0000 7f810ffff700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f810006caa0 0x7f810006ef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:39.367 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.371+0000 7f810ffff700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f810006caa0 0x7f810006ef60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f80fc000c00 tx=0x7f80fc00b040).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:39.369 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.375+0000 7f810dffb700 1 -- 172.21.15.6:0/796493656 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f81040595b0 con 0x7f81100fc830 2024-03-12T16:36:39.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.573+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"} v 0) v1 -- 0x7f81100feb80 con 0x7f81100fc830 2024-03-12T16:36:39.569 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.574+0000 7f810dffb700 1 -- 172.21.15.6:0/796493656 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]=0 v85) v1 ==== 107+0+11 (secure 0 0 0) 0x7f8104059140 con 0x7f81100fc830 2024-03-12T16:36:39.569 INFO:teuthology.orchestra.run.smithi006.stdout:pg_num: 32 2024-03-12T16:36:39.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f810006caa0 msgr2=0x7f810006ef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f810006caa0 0x7f810006ef60 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 rx=0x7f80fc000c00 tx=0x7f80fc00b040).stop 2024-03-12T16:36:39.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fc830 msgr2=0x7f811010cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.571 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fc830 0x7f811010cfe0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 rx=0x7f810400e8f0 tx=0x7f810400b040).stop 2024-03-12T16:36:39.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 shutdown_connections 2024-03-12T16:36:39.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f810006caa0 0x7f810006ef60 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f81100fc830 0x7f811010cfe0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 --2- 172.21.15.6:0/796493656 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f81100fd100 0x7f811010d4d0 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 >> 172.21.15.6:0/796493656 conn(0x7f811006c760 msgr2=0x7f81100fabb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:39.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 shutdown_connections 2024-03-12T16:36:39.572 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.576+0000 7f8116ffc700 1 -- 172.21.15.6:0/796493656 wait complete. 2024-03-12T16:36:39.583 DEBUG:teuthology.orchestra.run.smithi006:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd blocklist ls 2024-03-12T16:36:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.710+0000 7f5f1494f700 1 -- 172.21.15.6:0/452476409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fe290 msgr2=0x7f5f100f5f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.710+0000 7f5f1494f700 1 --2- 172.21.15.6:0/452476409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fe290 0x7f5f100f5f70 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 rx=0x7f5f000047f0 tx=0x7f5f00009cb0).stop 2024-03-12T16:36:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.710+0000 7f5f1494f700 1 -- 172.21.15.6:0/452476409 shutdown_connections 2024-03-12T16:36:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.710+0000 7f5f1494f700 1 --2- 172.21.15.6:0/452476409 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fe290 0x7f5f100f5f70 unknown :-1 s=CLOSED pgs=653 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.710+0000 7f5f1494f700 1 --2- 172.21.15.6:0/452476409 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f100fd930 0x7f5f100fdd10 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.710+0000 7f5f1494f700 1 -- 172.21.15.6:0/452476409 >> 172.21.15.6:0/452476409 conn(0x7f5f1006cea0 msgr2=0x7f5f1006d2b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.711+0000 7f5f1494f700 1 -- 172.21.15.6:0/452476409 shutdown_connections 2024-03-12T16:36:39.706 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.711+0000 7f5f1494f700 1 -- 172.21.15.6:0/452476409 wait complete. 2024-03-12T16:36:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.711+0000 7f5f1494f700 1 Processor -- start 2024-03-12T16:36:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.711+0000 7f5f1494f700 1 -- start start 2024-03-12T16:36:39.708 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.711+0000 7f5f1494f700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fd930 0x7f5f1010e080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.711+0000 7f5f1494f700 1 --2- >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f100fe290 0x7f5f1010e570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.711+0000 7f5f1494f700 1 -- --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1010eb70 con 0x7f5f100fd930 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.711+0000 7f5f1494f700 1 -- --> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] -- mon_getmap magic: 0 v1 -- 0x7f5f1010ecb0 con 0x7f5f100fe290 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f0e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fd930 0x7f5f1010e080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f0e59c700 1 --2- >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fd930 0x7f5f1010e080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_hello peer v2:172.21.15.6:3300/0 says I am v2:172.21.15.6:60422/0 (socket says 172.21.15.6:60422) 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f0e59c700 1 -- 172.21.15.6:0/637557809 learned_addr learned my addr 172.21.15.6:0/637557809 (peer_addr_for_me v2:172.21.15.6:0/0) 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f0dd9b700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f100fe290 0x7f5f1010e570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f0e59c700 1 -- 172.21.15.6:0/637557809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f100fe290 msgr2=0x7f5f1010e570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f0e59c700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f100fe290 0x7f5f1010e570 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f0e59c700 1 -- 172.21.15.6:0/637557809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({config=0+,monmap=0+}) v3 -- 0x7f5f00005040 con 0x7f5f100fd930 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f0dd9b700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f100fe290 0x7f5f1010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).handle_auth_reply_more state changed! 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f0e59c700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fd930 0x7f5f1010e080 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f5ef800c790 tx=0x7f5ef8004330).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f077fe700 1 -- 172.21.15.6:0/637557809 <== mon.0 v2:172.21.15.6:3300/0 1 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef80106f0 con 0x7f5f100fd930 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f077fe700 1 -- 172.21.15.6:0/637557809 <== mon.0 v2:172.21.15.6:3300/0 2 ==== config(26 keys) v1 ==== 1074+0+0 (secure 0 0 0) 0x7f5ef8010d00 con 0x7f5f100fd930 2024-03-12T16:36:39.709 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({mgrmap=0+}) v3 -- 0x7f5f10108340 con 0x7f5f100fd930 2024-03-12T16:36:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f077fe700 1 -- 172.21.15.6:0/637557809 <== mon.0 v2:172.21.15.6:3300/0 3 ==== mon_map magic: 0 v1 ==== 357+0+0 (secure 0 0 0) 0x7f5ef8012da0 con 0x7f5f100fd930 2024-03-12T16:36:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.712+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_subscribe({osdmap=0}) v3 -- 0x7f5f10108880 con 0x7f5f100fd930 2024-03-12T16:36:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.713+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) v1 -- 0x7f5f1005fb30 con 0x7f5f100fd930 2024-03-12T16:36:39.710 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.714+0000 7f5f077fe700 1 -- 172.21.15.6:0/637557809 <== mon.0 v2:172.21.15.6:3300/0 4 ==== mgrmap(e 40) v1 ==== 90840+0+0 (secure 0 0 0) 0x7f5ef8012400 con 0x7f5f100fd930 2024-03-12T16:36:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.714+0000 7f5f077fe700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5efc06cab0 0x7f5efc06ef70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0).connect 2024-03-12T16:36:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.714+0000 7f5f077fe700 1 -- 172.21.15.6:0/637557809 <== mon.0 v2:172.21.15.6:3300/0 5 ==== osd_map(85..85 src has 1..85) v4 ==== 6223+0+0 (secure 0 0 0) 0x7f5ef808b690 con 0x7f5f100fd930 2024-03-12T16:36:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.714+0000 7f5f0dd9b700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5efc06cab0 0x7f5efc06ef70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-03-12T16:36:39.711 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.715+0000 7f5f0dd9b700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5efc06cab0 0x7f5efc06ef70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f5f00004f10 tx=0x7f5f00009cb0).ready entity=mgr.34104 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-03-12T16:36:39.714 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.719+0000 7f5f077fe700 1 -- 172.21.15.6:0/637557809 <== mon.0 v2:172.21.15.6:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) v1 ==== 72+0+180596 (secure 0 0 0) 0x7f5ef80591f0 con 0x7f5f100fd930 2024-03-12T16:36:39.930 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.935+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 --> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] -- mon_command({"prefix": "osd blocklist ls"} v 0) v1 -- 0x7f5f10104710 con 0x7f5f100fd930 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.936+0000 7f5f077fe700 1 -- 172.21.15.6:0/637557809 <== mon.0 v2:172.21.15.6:3300/0 7 ==== mon_command_ack([{"prefix": "osd blocklist ls"}]=0 listed 32 entries v85) v1 ==== 81+0+1875 (secure 0 0 0) 0x7f5ef805f020 con 0x7f5f100fd930 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6826/163878097 2024-03-13T16:18:54.111614+0000 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:6825/3713757560 2024-03-13T16:18:54.111632+0000 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:6824/3713757560 2024-03-13T16:18:54.111632+0000 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1419012389 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3113166053 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4255668203 2024-03-13T16:01:12.726451+0000 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/179696865 2024-03-13T16:01:44.393271+0000 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/687610333 2024-03-13T16:01:44.393271+0000 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1637754840 2024-03-13T16:01:12.726451+0000 2024-03-12T16:36:39.931 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/2268121787 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/344339741 2024-03-13T16:01:44.393271+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/344339741 2024-03-13T16:01:44.393271+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/3591243488 2024-03-13T16:02:39.916474+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/139345082 2024-03-13T16:09:39.532193+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3228405447 2024-03-13T16:02:39.916474+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/3126632977 2024-03-13T16:09:39.532193+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/2268121787 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:0/3223900424 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:6828/3354806786 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/1732211885 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/3591243488 2024-03-13T16:02:39.916474+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6800/860696411 2024-03-13T16:01:12.726451+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4085533321 2024-03-13T16:14:31.789372+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:6829/3354806786 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:39.932 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6827/163878097 2024-03-13T16:18:54.111614+0000 2024-03-12T16:36:39.933 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:0/182723627 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:39.933 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:0/1919894603 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:39.933 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/124082729 2024-03-13T16:09:39.532193+0000 2024-03-12T16:36:39.933 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/860696411 2024-03-13T16:01:12.726451+0000 2024-03-12T16:36:39.933 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:0/4212806006 2024-03-13T16:02:39.916474+0000 2024-03-12T16:36:39.933 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.6:6801/139345082 2024-03-13T16:09:39.532193+0000 2024-03-12T16:36:39.933 INFO:teuthology.orchestra.run.smithi006.stdout:172.21.15.134:0/500953021 2024-03-13T16:11:51.047707+0000 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5efc06cab0 msgr2=0x7f5efc06ef70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5efc06cab0 0x7f5efc06ef70 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 rx=0x7f5f00004f10 tx=0x7f5f00009cb0).stop 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fd930 msgr2=0x7f5f1010e080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fd930 0x7f5f1010e080 secure :-1 s=READY pgs=654 cs=0 l=1 rev1=1 rx=0x7f5ef800c790 tx=0x7f5ef8004330).stop 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 shutdown_connections 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:6800/2635749422,v1:172.21.15.6:6801/2635749422] conn(0x7f5efc06cab0 0x7f5efc06ef70 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.6:3300/0,v1:172.21.15.6:6789/0] conn(0x7f5f100fd930 0x7f5f1010e080 unknown :-1 s=CLOSED pgs=654 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 --2- 172.21.15.6:0/637557809 >> [v2:172.21.15.134:3300/0,v1:172.21.15.134:6789/0] conn(0x7f5f100fe290 0x7f5f1010e570 unknown :-1 s=CLOSED pgs=0 cs=0 l=1 rev1=1 rx=0 tx=0).stop 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 >> 172.21.15.6:0/637557809 conn(0x7f5f1006cea0 msgr2=0x7f5f10100ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 shutdown_connections 2024-03-12T16:36:39.934 INFO:teuthology.orchestra.run.smithi006.stderr:2024-03-12T16:36:39.938+0000 7f5f1494f700 1 -- 172.21.15.6:0/637557809 wait complete. 2024-03-12T16:36:39.935 INFO:teuthology.orchestra.run.smithi006.stderr:listed 32 entries 2024-03-12T16:36:39.944 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:39 smithi006 ceph-mon[103869]: pgmap v703: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:39.944 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:39 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/1264561701' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-12T16:36:39.944 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:39 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/214382067' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-12T16:36:39.944 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:39 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/796493656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-12T16:36:39.945 INFO:tasks.cephfs.fuse_mount:Running fusermount -u on ubuntu@smithi006.front.sepia.ceph.com... 2024-03-12T16:36:39.945 INFO:teuthology.orchestra.run:Running command with timeout 300 2024-03-12T16:36:39.945 DEBUG:teuthology.orchestra.run.smithi006:> sudo fusermount -u /home/ubuntu/cephtest/mnt.0 2024-03-12T16:36:39.979 INFO:teuthology.orchestra.run:waiting for 300 2024-03-12T16:36:40.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:39 smithi134 ceph-mon[85099]: pgmap v703: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:40.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:39 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/1264561701' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-03-12T16:36:40.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:39 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/214382067' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.meta", "var": "pg_num"}]: dispatch 2024-03-12T16:36:40.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:39 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/796493656' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": "cephfs.cephfs.data", "var": "pg_num"}]: dispatch 2024-03-12T16:36:41.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:40 smithi134 ceph-mon[85099]: from='client.? 172.21.15.6:0/637557809' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-12T16:36:41.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:40 smithi006 ceph-mon[103869]: from='client.? 172.21.15.6:0/637557809' entity='client.admin' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-03-12T16:36:42.197 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:41 smithi134 ceph-mon[85099]: pgmap v704: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:42.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:41 smithi006 ceph-mon[103869]: pgmap v704: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:44.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:43 smithi134 ceph-mon[85099]: pgmap v705: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:44.245 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:43 smithi006 ceph-mon[103869]: pgmap v705: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:46.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:45 smithi134 ceph-mon[85099]: pgmap v706: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:46.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:45 smithi006 ceph-mon[103869]: pgmap v706: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:48.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:47 smithi134 ceph-mon[85099]: pgmap v707: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:48.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:36:48.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:47 smithi006 ceph-mon[103869]: pgmap v707: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:48.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:36:49.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:49 smithi134 ceph-mon[85099]: pgmap v708: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:49.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:49 smithi006 ceph-mon[103869]: pgmap v708: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:51 smithi134 ceph-mon[85099]: pgmap v709: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:52.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:51 smithi006 ceph-mon[103869]: pgmap v709: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:54.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:53 smithi134 ceph-mon[85099]: pgmap v710: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:54.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:53 smithi006 ceph-mon[103869]: pgmap v710: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:56.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:55 smithi134 ceph-mon[85099]: pgmap v711: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:56.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:55 smithi006 ceph-mon[103869]: pgmap v711: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:58.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:57 smithi134 ceph-mon[85099]: pgmap v712: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:58.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:57 smithi006 ceph-mon[103869]: pgmap v712: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:59.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:36:59 smithi134 ceph-mon[85099]: pgmap v713: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:36:59.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:36:59 smithi006 ceph-mon[103869]: pgmap v713: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:02.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:01 smithi134 ceph-mon[85099]: pgmap v714: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:02.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:01 smithi006 ceph-mon[103869]: pgmap v714: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:03.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:37:03.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:37:04.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:03 smithi134 ceph-mon[85099]: pgmap v715: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:04.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:03 smithi006 ceph-mon[103869]: pgmap v715: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:06.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:05 smithi134 ceph-mon[85099]: pgmap v716: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:06.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:05 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:37:06.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:05 smithi006 ceph-mon[103869]: pgmap v716: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:06.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:05 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:37:07.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:37:07.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:37:07.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:37:07.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:37:07.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:37:07.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:37:08.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:07 smithi134 ceph-mon[85099]: pgmap v717: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:08.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:07 smithi006 ceph-mon[103869]: pgmap v717: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:09.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:09 smithi134 ceph-mon[85099]: pgmap v718: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:09.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:09 smithi006 ceph-mon[103869]: pgmap v718: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:12.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:11 smithi134 ceph-mon[85099]: pgmap v719: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:12.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:11 smithi006 ceph-mon[103869]: pgmap v719: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:14.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:13 smithi134 ceph-mon[85099]: pgmap v720: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:14.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:13 smithi006 ceph-mon[103869]: pgmap v720: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:16.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:15 smithi134 ceph-mon[85099]: pgmap v721: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:16.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:15 smithi006 ceph-mon[103869]: pgmap v721: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:18.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:17 smithi134 ceph-mon[85099]: pgmap v722: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:18.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:37:18.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:17 smithi006 ceph-mon[103869]: pgmap v722: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:18.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:37:19.947 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:19 smithi134 ceph-mon[85099]: pgmap v723: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:19.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:19 smithi006 ceph-mon[103869]: pgmap v723: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:22.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:21 smithi134 ceph-mon[85099]: pgmap v724: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:22.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:21 smithi006 ceph-mon[103869]: pgmap v724: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:24.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:23 smithi134 ceph-mon[85099]: pgmap v725: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:24.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:23 smithi006 ceph-mon[103869]: pgmap v725: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:26.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:25 smithi134 ceph-mon[85099]: pgmap v726: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:26.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:25 smithi006 ceph-mon[103869]: pgmap v726: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:28.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:27 smithi134 ceph-mon[85099]: pgmap v727: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:28.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:27 smithi006 ceph-mon[103869]: pgmap v727: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:29.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:29 smithi134 ceph-mon[85099]: pgmap v728: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:29.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:29 smithi006 ceph-mon[103869]: pgmap v728: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:32.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:31 smithi134 ceph-mon[85099]: pgmap v729: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:32.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:31 smithi006 ceph-mon[103869]: pgmap v729: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:33.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:37:33.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:37:34.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:33 smithi134 ceph-mon[85099]: pgmap v730: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:34.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:33 smithi006 ceph-mon[103869]: pgmap v730: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:36.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:35 smithi134 ceph-mon[85099]: pgmap v731: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:36.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:35 smithi006 ceph-mon[103869]: pgmap v731: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:38.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:37 smithi134 ceph-mon[85099]: pgmap v732: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:38.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:37 smithi006 ceph-mon[103869]: pgmap v732: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:39.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:39 smithi134 ceph-mon[85099]: pgmap v733: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:39.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:39 smithi006 ceph-mon[103869]: pgmap v733: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:42.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:41 smithi134 ceph-mon[85099]: pgmap v734: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:42.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:41 smithi006 ceph-mon[103869]: pgmap v734: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:44.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:43 smithi134 ceph-mon[85099]: pgmap v735: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:44.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:43 smithi006 ceph-mon[103869]: pgmap v735: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:46.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:45 smithi134 ceph-mon[85099]: pgmap v736: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:46.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:45 smithi006 ceph-mon[103869]: pgmap v736: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:48.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:47 smithi134 ceph-mon[85099]: pgmap v737: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:48.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:37:48.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:47 smithi006 ceph-mon[103869]: pgmap v737: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:48.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:37:49.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:49 smithi134 ceph-mon[85099]: pgmap v738: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:49.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:49 smithi006 ceph-mon[103869]: pgmap v738: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:52.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:51 smithi134 ceph-mon[85099]: pgmap v739: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:52.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:51 smithi006 ceph-mon[103869]: pgmap v739: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:54.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:53 smithi134 ceph-mon[85099]: pgmap v740: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:54.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:53 smithi006 ceph-mon[103869]: pgmap v740: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:56.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:55 smithi134 ceph-mon[85099]: pgmap v741: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:56.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:55 smithi006 ceph-mon[103869]: pgmap v741: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:58.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:57 smithi134 ceph-mon[85099]: pgmap v742: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:58.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:57 smithi006 ceph-mon[103869]: pgmap v742: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:59.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:37:59 smithi134 ceph-mon[85099]: pgmap v743: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:37:59.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:37:59 smithi006 ceph-mon[103869]: pgmap v743: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:02.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:01 smithi134 ceph-mon[85099]: pgmap v744: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:02.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:01 smithi006 ceph-mon[103869]: pgmap v744: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:03.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:38:03.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:38:04.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:03 smithi134 ceph-mon[85099]: pgmap v745: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:04.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:03 smithi006 ceph-mon[103869]: pgmap v745: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:06.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:05 smithi134 ceph-mon[85099]: pgmap v746: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:06.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:05 smithi006 ceph-mon[103869]: pgmap v746: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:07.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:38:07.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:38:07.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:38:07.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:38:07.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:38:07.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:38:07.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:38:07.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:38:08.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:07 smithi134 ceph-mon[85099]: pgmap v747: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:07 smithi006 ceph-mon[103869]: pgmap v747: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:09.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:09 smithi134 ceph-mon[85099]: pgmap v748: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:09.950 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:09 smithi006 ceph-mon[103869]: pgmap v748: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:12.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:11 smithi134 ceph-mon[85099]: pgmap v749: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:12.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:11 smithi006 ceph-mon[103869]: pgmap v749: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:14.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:13 smithi134 ceph-mon[85099]: pgmap v750: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:14.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:13 smithi006 ceph-mon[103869]: pgmap v750: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:16.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:15 smithi134 ceph-mon[85099]: pgmap v751: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:16.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:15 smithi006 ceph-mon[103869]: pgmap v751: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:18.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:17 smithi134 ceph-mon[85099]: pgmap v752: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:18.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:38:18.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:17 smithi006 ceph-mon[103869]: pgmap v752: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:18.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:38:19.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:19 smithi134 ceph-mon[85099]: pgmap v753: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:19.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:19 smithi006 ceph-mon[103869]: pgmap v753: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:22.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:21 smithi134 ceph-mon[85099]: pgmap v754: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:22.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:21 smithi006 ceph-mon[103869]: pgmap v754: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:24.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:23 smithi134 ceph-mon[85099]: pgmap v755: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:24.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:23 smithi006 ceph-mon[103869]: pgmap v755: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:26.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:25 smithi134 ceph-mon[85099]: pgmap v756: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:26.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:25 smithi006 ceph-mon[103869]: pgmap v756: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:28.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:27 smithi134 ceph-mon[85099]: pgmap v757: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:28.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:27 smithi006 ceph-mon[103869]: pgmap v757: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:29.946 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:29 smithi134 ceph-mon[85099]: pgmap v758: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:29.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:29 smithi006 ceph-mon[103869]: pgmap v758: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:32.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:31 smithi134 ceph-mon[85099]: pgmap v759: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:32.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:31 smithi006 ceph-mon[103869]: pgmap v759: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:33.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:38:33.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:38:34.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:33 smithi134 ceph-mon[85099]: pgmap v760: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:34.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:33 smithi006 ceph-mon[103869]: pgmap v760: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:36.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:35 smithi134 ceph-mon[85099]: pgmap v761: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:36.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:35 smithi006 ceph-mon[103869]: pgmap v761: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:38.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:37 smithi134 ceph-mon[85099]: pgmap v762: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:38.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:37 smithi006 ceph-mon[103869]: pgmap v762: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:39.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:39 smithi134 ceph-mon[85099]: pgmap v763: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:39.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:39 smithi006 ceph-mon[103869]: pgmap v763: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:42.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:41 smithi134 ceph-mon[85099]: pgmap v764: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:42.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:41 smithi006 ceph-mon[103869]: pgmap v764: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:44.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:43 smithi134 ceph-mon[85099]: pgmap v765: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:44.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:43 smithi006 ceph-mon[103869]: pgmap v765: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:46.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:45 smithi134 ceph-mon[85099]: pgmap v766: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:46.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:45 smithi006 ceph-mon[103869]: pgmap v766: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:48.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:47 smithi134 ceph-mon[85099]: pgmap v767: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:48.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:38:48.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:47 smithi006 ceph-mon[103869]: pgmap v767: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:48.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:38:49.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:49 smithi134 ceph-mon[85099]: pgmap v768: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:49.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:49 smithi006 ceph-mon[103869]: pgmap v768: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:51 smithi134 ceph-mon[85099]: pgmap v769: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:52.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:51 smithi006 ceph-mon[103869]: pgmap v769: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:54.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:53 smithi134 ceph-mon[85099]: pgmap v770: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:54.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:53 smithi006 ceph-mon[103869]: pgmap v770: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:56.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:55 smithi134 ceph-mon[85099]: pgmap v771: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:56.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:55 smithi006 ceph-mon[103869]: pgmap v771: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:58.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:57 smithi134 ceph-mon[85099]: pgmap v772: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:58.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:57 smithi006 ceph-mon[103869]: pgmap v772: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:59.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:38:59 smithi134 ceph-mon[85099]: pgmap v773: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:38:59.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:38:59 smithi006 ceph-mon[103869]: pgmap v773: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:02.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:01 smithi134 ceph-mon[85099]: pgmap v774: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:02.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:01 smithi006 ceph-mon[103869]: pgmap v774: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:03.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:39:03.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:39:04.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:03 smithi134 ceph-mon[85099]: pgmap v775: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:04.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:03 smithi006 ceph-mon[103869]: pgmap v775: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:06.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:05 smithi134 ceph-mon[85099]: pgmap v776: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:06.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:05 smithi006 ceph-mon[103869]: pgmap v776: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:07.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:06 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:39:07.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:06 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:39:08.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:07 smithi134 ceph-mon[85099]: pgmap v777: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:08.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:39:08.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:39:08.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:39:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:07 smithi006 ceph-mon[103869]: pgmap v777: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:39:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:39:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:39:09.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:09 smithi134 ceph-mon[85099]: pgmap v778: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:09.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:09 smithi006 ceph-mon[103869]: pgmap v778: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:12.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:11 smithi134 ceph-mon[85099]: pgmap v779: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:12.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:11 smithi006 ceph-mon[103869]: pgmap v779: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:14.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:13 smithi134 ceph-mon[85099]: pgmap v780: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:14.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:13 smithi006 ceph-mon[103869]: pgmap v780: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:16.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:15 smithi134 ceph-mon[85099]: pgmap v781: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:16.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:15 smithi006 ceph-mon[103869]: pgmap v781: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:18.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:17 smithi134 ceph-mon[85099]: pgmap v782: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:18.199 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:39:18.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:17 smithi006 ceph-mon[103869]: pgmap v782: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:18.200 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:39:19.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:19 smithi134 ceph-mon[85099]: pgmap v783: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:19.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:19 smithi006 ceph-mon[103869]: pgmap v783: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:22.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:21 smithi134 ceph-mon[85099]: pgmap v784: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:22.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:21 smithi006 ceph-mon[103869]: pgmap v784: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:24.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:23 smithi134 ceph-mon[85099]: pgmap v785: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:24.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:23 smithi006 ceph-mon[103869]: pgmap v785: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:26.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:25 smithi134 ceph-mon[85099]: pgmap v786: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:26.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:25 smithi006 ceph-mon[103869]: pgmap v786: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:28.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:27 smithi134 ceph-mon[85099]: pgmap v787: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:28.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:27 smithi006 ceph-mon[103869]: pgmap v787: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:29.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:29 smithi134 ceph-mon[85099]: pgmap v788: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:29.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:29 smithi006 ceph-mon[103869]: pgmap v788: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:32.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:31 smithi134 ceph-mon[85099]: pgmap v789: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:32.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:31 smithi006 ceph-mon[103869]: pgmap v789: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:33.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:39:33.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:39:34.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:33 smithi134 ceph-mon[85099]: pgmap v790: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:34.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:33 smithi006 ceph-mon[103869]: pgmap v790: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:36.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:35 smithi134 ceph-mon[85099]: pgmap v791: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:36.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:35 smithi006 ceph-mon[103869]: pgmap v791: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:38.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:37 smithi134 ceph-mon[85099]: pgmap v792: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:38.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:37 smithi006 ceph-mon[103869]: pgmap v792: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:39.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:39 smithi134 ceph-mon[85099]: pgmap v793: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:39.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:39 smithi006 ceph-mon[103869]: pgmap v793: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:42.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:41 smithi134 ceph-mon[85099]: pgmap v794: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:42.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:41 smithi006 ceph-mon[103869]: pgmap v794: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:44.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:43 smithi134 ceph-mon[85099]: pgmap v795: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:44.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:43 smithi006 ceph-mon[103869]: pgmap v795: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:46.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:45 smithi134 ceph-mon[85099]: pgmap v796: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:46.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:45 smithi006 ceph-mon[103869]: pgmap v796: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:48.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:47 smithi134 ceph-mon[85099]: pgmap v797: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:48.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:39:48.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:47 smithi006 ceph-mon[103869]: pgmap v797: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:48.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:39:49.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:49 smithi134 ceph-mon[85099]: pgmap v798: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:49.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:49 smithi006 ceph-mon[103869]: pgmap v798: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:51 smithi134 ceph-mon[85099]: pgmap v799: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:52.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:51 smithi006 ceph-mon[103869]: pgmap v799: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:54.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:53 smithi134 ceph-mon[85099]: pgmap v800: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:54.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:53 smithi006 ceph-mon[103869]: pgmap v800: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:56.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:55 smithi134 ceph-mon[85099]: pgmap v801: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:56.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:55 smithi006 ceph-mon[103869]: pgmap v801: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:58.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:57 smithi134 ceph-mon[85099]: pgmap v802: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:58.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:57 smithi006 ceph-mon[103869]: pgmap v802: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:59.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:39:59 smithi134 ceph-mon[85099]: pgmap v803: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:39:59.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:39:59 smithi006 ceph-mon[103869]: pgmap v803: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:00.829 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:00 smithi006 ceph-mon[103869]: overall HEALTH_OK 2024-03-12T16:40:00.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:00 smithi134 ceph-mon[85099]: overall HEALTH_OK 2024-03-12T16:40:01.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:01 smithi134 ceph-mon[85099]: pgmap v804: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:01.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:01 smithi006 ceph-mon[103869]: pgmap v804: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:02.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:40:02.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:40:03.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:03 smithi134 ceph-mon[85099]: pgmap v805: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:03.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:03 smithi006 ceph-mon[103869]: pgmap v805: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:06.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:05 smithi134 ceph-mon[85099]: pgmap v806: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:06.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:05 smithi006 ceph-mon[103869]: pgmap v806: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:08.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:07 smithi134 ceph-mon[85099]: pgmap v807: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:08.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:40:08.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:40:08.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:40:08.196 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:07 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:40:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:07 smithi006 ceph-mon[103869]: pgmap v807: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:40:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:40:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:40:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:07 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:40:09.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:09 smithi134 ceph-mon[85099]: pgmap v808: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:09.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:09 smithi006 ceph-mon[103869]: pgmap v808: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:12.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:11 smithi134 ceph-mon[85099]: pgmap v809: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:12.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:11 smithi006 ceph-mon[103869]: pgmap v809: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:14.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:13 smithi134 ceph-mon[85099]: pgmap v810: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:14.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:13 smithi006 ceph-mon[103869]: pgmap v810: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:16.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:15 smithi134 ceph-mon[85099]: pgmap v811: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:16.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:15 smithi006 ceph-mon[103869]: pgmap v811: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:18.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:17 smithi134 ceph-mon[85099]: pgmap v812: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:18.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:40:18.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:17 smithi006 ceph-mon[103869]: pgmap v812: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:18.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:40:19.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:19 smithi134 ceph-mon[85099]: pgmap v813: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:19.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:19 smithi006 ceph-mon[103869]: pgmap v813: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:22.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:21 smithi134 ceph-mon[85099]: pgmap v814: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:22.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:21 smithi006 ceph-mon[103869]: pgmap v814: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:24.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:23 smithi134 ceph-mon[85099]: pgmap v815: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:24.202 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:23 smithi006 ceph-mon[103869]: pgmap v815: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:26.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:25 smithi134 ceph-mon[85099]: pgmap v816: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:26.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:25 smithi006 ceph-mon[103869]: pgmap v816: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:28.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:27 smithi134 ceph-mon[85099]: pgmap v817: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:28.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:27 smithi006 ceph-mon[103869]: pgmap v817: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:29.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:29 smithi134 ceph-mon[85099]: pgmap v818: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:29.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:29 smithi006 ceph-mon[103869]: pgmap v818: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:32.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:31 smithi134 ceph-mon[85099]: pgmap v819: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:32.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:31 smithi006 ceph-mon[103869]: pgmap v819: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:33.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:40:33.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:40:34.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:33 smithi134 ceph-mon[85099]: pgmap v820: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:34.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:33 smithi006 ceph-mon[103869]: pgmap v820: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:36.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:35 smithi134 ceph-mon[85099]: pgmap v821: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:36.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:35 smithi006 ceph-mon[103869]: pgmap v821: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:38.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:37 smithi134 ceph-mon[85099]: pgmap v822: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:38.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:37 smithi006 ceph-mon[103869]: pgmap v822: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:39.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:39 smithi134 ceph-mon[85099]: pgmap v823: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:39.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:39 smithi006 ceph-mon[103869]: pgmap v823: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:42.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:41 smithi134 ceph-mon[85099]: pgmap v824: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:42.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:41 smithi006 ceph-mon[103869]: pgmap v824: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:44.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:43 smithi134 ceph-mon[85099]: pgmap v825: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:44.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:43 smithi006 ceph-mon[103869]: pgmap v825: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:46.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:45 smithi134 ceph-mon[85099]: pgmap v826: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:46.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:45 smithi006 ceph-mon[103869]: pgmap v826: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:48.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:47 smithi134 ceph-mon[85099]: pgmap v827: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:48.198 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:47 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:40:48.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:47 smithi006 ceph-mon[103869]: pgmap v827: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:48.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:47 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:40:49.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:49 smithi134 ceph-mon[85099]: pgmap v828: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:49.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:49 smithi006 ceph-mon[103869]: pgmap v828: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:52.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:51 smithi134 ceph-mon[85099]: pgmap v829: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:52.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:51 smithi006 ceph-mon[103869]: pgmap v829: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:54.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:53 smithi134 ceph-mon[85099]: pgmap v830: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:54.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:53 smithi006 ceph-mon[103869]: pgmap v830: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:56.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:55 smithi134 ceph-mon[85099]: pgmap v831: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:56.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:55 smithi006 ceph-mon[103869]: pgmap v831: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:58.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:57 smithi134 ceph-mon[85099]: pgmap v832: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:58.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:57 smithi006 ceph-mon[103869]: pgmap v832: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:59.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:40:59 smithi134 ceph-mon[85099]: pgmap v833: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:40:59.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:40:59 smithi006 ceph-mon[103869]: pgmap v833: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:02.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:01 smithi134 ceph-mon[85099]: pgmap v834: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:02.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:01 smithi006 ceph-mon[103869]: pgmap v834: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:03.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:02 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:41:03.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:02 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:41:04.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:03 smithi134 ceph-mon[85099]: pgmap v835: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:04.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:03 smithi006 ceph-mon[103869]: pgmap v835: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:06.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:05 smithi134 ceph-mon[85099]: pgmap v836: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:06.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:05 smithi006 ceph-mon[103869]: pgmap v836: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:08.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:07 smithi134 ceph-mon[85099]: pgmap v837: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:08.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:07 smithi006 ceph-mon[103869]: pgmap v837: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:09.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:08 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:41:09.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:08 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:41:09.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:08 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:41:09.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:08 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:41:09.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:08 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-03-12T16:41:09.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:08 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-03-12T16:41:09.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:08 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-03-12T16:41:09.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:08 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' 2024-03-12T16:41:10.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:09 smithi134 ceph-mon[85099]: pgmap v838: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:10.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:09 smithi006 ceph-mon[103869]: pgmap v838: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:12.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:11 smithi134 ceph-mon[85099]: pgmap v839: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:12.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:11 smithi006 ceph-mon[103869]: pgmap v839: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:14.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:13 smithi134 ceph-mon[85099]: pgmap v840: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:14.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:13 smithi006 ceph-mon[103869]: pgmap v840: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:16.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:15 smithi134 ceph-mon[85099]: pgmap v841: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:16.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:15 smithi006 ceph-mon[103869]: pgmap v841: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:18.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:17 smithi134 ceph-mon[85099]: pgmap v842: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:18.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:17 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:41:18.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:17 smithi006 ceph-mon[103869]: pgmap v842: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:18.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:17 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:41:19.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:19 smithi134 ceph-mon[85099]: pgmap v843: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:19.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:19 smithi006 ceph-mon[103869]: pgmap v843: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:22.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:21 smithi134 ceph-mon[85099]: pgmap v844: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:22.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:21 smithi006 ceph-mon[103869]: pgmap v844: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:24.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:23 smithi134 ceph-mon[85099]: pgmap v845: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:24.199 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:23 smithi006 ceph-mon[103869]: pgmap v845: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:26.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:25 smithi134 ceph-mon[85099]: pgmap v846: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:26.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:25 smithi006 ceph-mon[103869]: pgmap v846: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:28.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:27 smithi134 ceph-mon[85099]: pgmap v847: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:28.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:27 smithi006 ceph-mon[103869]: pgmap v847: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:29.945 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:29 smithi134 ceph-mon[85099]: pgmap v848: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:29.949 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:29 smithi006 ceph-mon[103869]: pgmap v848: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:32.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:31 smithi134 ceph-mon[85099]: pgmap v849: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:32.274 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:31 smithi006 ceph-mon[103869]: pgmap v849: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:33.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:32 smithi134 ceph-mon[85099]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:41:33.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:32 smithi006 ceph-mon[103869]: from='mgr.34104 172.21.15.6:0/3653566260' entity='mgr.smithi006.kskdce' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-03-12T16:41:34.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:33 smithi134 ceph-mon[85099]: pgmap v850: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:34.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:33 smithi006 ceph-mon[103869]: pgmap v850: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:36.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:35 smithi134 ceph-mon[85099]: pgmap v851: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:36.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:35 smithi006 ceph-mon[103869]: pgmap v851: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:38.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:37 smithi134 ceph-mon[85099]: pgmap v852: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:38.198 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:37 smithi006 ceph-mon[103869]: pgmap v852: 65 pgs: 65 active+clean; 268 MiB data, 1.1 GiB used, 535 GiB / 536 GiB avail 2024-03-12T16:41:39.047 ERROR:tasks.cephfs.fuse_mount:process failed to terminate after unmount. This probably indicates a bug within ceph-fuse. 2024-03-12T16:41:39.048 ERROR:teuthology.run_tasks:Manager failed: ceph-fuse Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-03-12T16:41:39.066 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-03-12T16:41:39.079 INFO:tasks.cephadm:Teardown begin 2024-03-12T16:41:39.079 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks/cephadm.py", line 1750, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-03-12T16:41:39.080 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-12T16:41:39.119 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-12T16:41:39.158 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-03-12T16:41:39.158 DEBUG:teuthology.orchestra.run.smithi006:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-12T16:41:39.181 DEBUG:teuthology.orchestra.run.smithi134:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-03-12T16:41:39.219 INFO:tasks.cephadm:Stopping all daemons... 2024-03-12T16:41:39.220 INFO:tasks.cephadm.mon.smithi006:Stopping mon.smithi006... 2024-03-12T16:41:39.220 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi006 2024-03-12T16:41:39.449 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:39 smithi006 systemd[1]: Stopping Ceph mon.smithi006 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:41:39.866 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[103846]: 2024-03-12T16:41:39.527+0000 7f02e90e6700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi006 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-12T16:41:39.867 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:39 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006[103846]: 2024-03-12T16:41:39.527+0000 7f02e90e6700 -1 mon.smithi006@0(leader) e3 *** Got Signal Terminated *** 2024-03-12T16:41:40.428 INFO:journalctl@ceph.mon.smithi006.smithi006.stdout:Mar 12 16:41:40 smithi006 bash[158950]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi006 2024-03-12T16:41:40.435 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi006.service' 2024-03-12T16:41:40.491 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-12T16:41:40.491 INFO:tasks.cephadm.mon.smithi006:Stopped mon.smithi006 2024-03-12T16:41:40.491 INFO:tasks.cephadm.mon.smithi134:Stopping mon.smithi134... 2024-03-12T16:41:40.491 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi134 2024-03-12T16:41:40.873 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:40 smithi134 systemd[1]: Stopping Ceph mon.smithi134 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:41:41.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[85076]: 2024-03-12T16:41:40.878+0000 7f211f672700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.smithi134 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-03-12T16:41:41.195 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:40 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134[85076]: 2024-03-12T16:41:40.878+0000 7f211f672700 -1 mon.smithi134@1(peon) e3 *** Got Signal Terminated *** 2024-03-12T16:41:41.694 INFO:journalctl@ceph.mon.smithi134.smithi134.stdout:Mar 12 16:41:41 smithi134 bash[129552]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-mon-smithi134 2024-03-12T16:41:41.792 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@mon.smithi134.service' 2024-03-12T16:41:41.838 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-12T16:41:41.839 INFO:tasks.cephadm.mon.smithi134:Stopped mon.smithi134 2024-03-12T16:41:41.839 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-03-12T16:41:41.839 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.0 2024-03-12T16:41:42.134 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:41:41 smithi006 systemd[1]: Stopping Ceph osd.0 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:41:42.449 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:41:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[118234]: 2024-03-12T16:41:42.140+0000 7faff1747700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-12T16:41:42.449 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:41:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[118234]: 2024-03-12T16:41:42.140+0000 7faff1747700 -1 osd.0 85 *** Got signal Terminated *** 2024-03-12T16:41:42.449 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:41:42 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0[118234]: 2024-03-12T16:41:42.140+0000 7faff1747700 -1 osd.0 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:41:48.199 INFO:journalctl@ceph.osd.0.smithi006.stdout:Mar 12 16:41:47 smithi006 bash[159111]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-0 2024-03-12T16:41:49.706 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.0.service' 2024-03-12T16:41:49.750 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-12T16:41:49.750 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-03-12T16:41:49.751 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-03-12T16:41:49.751 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.1 2024-03-12T16:41:50.064 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:41:49 smithi006 systemd[1]: Stopping Ceph osd.1 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:41:50.449 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:41:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[124752]: 2024-03-12T16:41:50.070+0000 7f28be283700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-12T16:41:50.449 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:41:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[124752]: 2024-03-12T16:41:50.070+0000 7f28be283700 -1 osd.1 85 *** Got signal Terminated *** 2024-03-12T16:41:50.449 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:41:50 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1[124752]: 2024-03-12T16:41:50.070+0000 7f28be283700 -1 osd.1 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:41:55.949 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:41:55 smithi006 bash[159385]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-1 2024-03-12T16:41:57.507 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:41:57 smithi006 systemd[1]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.1.service: Succeeded. 2024-03-12T16:41:57.507 INFO:journalctl@ceph.osd.1.smithi006.stdout:Mar 12 16:41:57 smithi006 systemd[1]: Stopped Ceph osd.1 for 88d7ee42-e089-11ee-95c8-87774f69a715. 2024-03-12T16:41:57.508 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.1.service' 2024-03-12T16:41:57.552 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-12T16:41:57.553 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-03-12T16:41:57.553 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-03-12T16:41:57.553 DEBUG:teuthology.orchestra.run.smithi006:> sudo systemctl stop ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.2 2024-03-12T16:41:57.866 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:41:57 smithi006 systemd[1]: Stopping Ceph osd.2 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:41:58.199 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:41:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[131312]: 2024-03-12T16:41:57.869+0000 7f65ad8eb700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-12T16:41:58.199 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:41:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[131312]: 2024-03-12T16:41:57.870+0000 7f65ad8eb700 -1 osd.2 85 *** Got signal Terminated *** 2024-03-12T16:41:58.199 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:41:57 smithi006 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2[131312]: 2024-03-12T16:41:57.870+0000 7f65ad8eb700 -1 osd.2 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:42:03.699 INFO:journalctl@ceph.osd.2.smithi006.stdout:Mar 12 16:42:03 smithi006 bash[159653]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-2 2024-03-12T16:42:05.187 DEBUG:teuthology.orchestra.run.smithi006:> sudo pkill -f 'journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.2.service' 2024-03-12T16:42:05.233 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-12T16:42:05.234 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-03-12T16:42:05.234 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-03-12T16:42:05.234 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.3 2024-03-12T16:42:05.612 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:42:05 smithi134 systemd[1]: Stopping Ceph osd.3 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:42:05.944 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:42:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[98216]: 2024-03-12T16:42:05.619+0000 7ffb50e96700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-12T16:42:05.945 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:42:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[98216]: 2024-03-12T16:42:05.619+0000 7ffb50e96700 -1 osd.3 85 *** Got signal Terminated *** 2024-03-12T16:42:05.945 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:42:05 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3[98216]: 2024-03-12T16:42:05.619+0000 7ffb50e96700 -1 osd.3 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:42:09.945 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:09 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:09.685+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:43.440407+0000 front 2024-03-12T16:41:43.440435+0000 (oldest deadline 2024-03-12T16:42:09.340265+0000) 2024-03-12T16:42:10.945 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:10 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:10.680+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:43.440407+0000 front 2024-03-12T16:41:43.440435+0000 (oldest deadline 2024-03-12T16:42:09.340265+0000) 2024-03-12T16:42:10.945 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:10 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:10.727+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:11.695 INFO:journalctl@ceph.osd.3.smithi134.stdout:Mar 12 16:42:11 smithi134 bash[129709]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-3 2024-03-12T16:42:11.695 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:11.651+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:43.440407+0000 front 2024-03-12T16:41:43.440435+0000 (oldest deadline 2024-03-12T16:42:09.340265+0000) 2024-03-12T16:42:12.153 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:11 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:11.767+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:12.925 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:12 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:12.679+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:43.440407+0000 front 2024-03-12T16:41:43.440435+0000 (oldest deadline 2024-03-12T16:42:09.340265+0000) 2024-03-12T16:42:12.925 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:12 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:12.806+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:13.202 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.3.service' 2024-03-12T16:42:13.243 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-12T16:42:13.243 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-03-12T16:42:13.243 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-03-12T16:42:13.243 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.4 2024-03-12T16:42:13.552 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:13 smithi134 systemd[1]: Stopping Ceph osd.4 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:42:13.820 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:13.558+0000 7f43acbc8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-12T16:42:13.820 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:13.558+0000 7f43acbc8700 -1 osd.4 85 *** Got signal Terminated *** 2024-03-12T16:42:13.821 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:13.558+0000 7f43acbc8700 -1 osd.4 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:42:13.821 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:13.653+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:43.440407+0000 front 2024-03-12T16:41:43.440435+0000 (oldest deadline 2024-03-12T16:42:09.340265+0000) 2024-03-12T16:42:14.194 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:13 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:13.827+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:14.944 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:14.614+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:43.440407+0000 front 2024-03-12T16:41:43.440435+0000 (oldest deadline 2024-03-12T16:42:09.340265+0000) 2024-03-12T16:42:14.945 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:14 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:14.854+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:15.895 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:15.578+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:43.440407+0000 front 2024-03-12T16:41:43.440435+0000 (oldest deadline 2024-03-12T16:42:09.340265+0000) 2024-03-12T16:42:16.194 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:15 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:15.901+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:16.902 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:16.569+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:43.440407+0000 front 2024-03-12T16:41:43.440435+0000 (oldest deadline 2024-03-12T16:42:09.340265+0000) 2024-03-12T16:42:16.902 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:16.569+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6814 osd.1 since back 2024-03-12T16:41:50.341194+0000 front 2024-03-12T16:41:50.341213+0000 (oldest deadline 2024-03-12T16:42:16.241228+0000) 2024-03-12T16:42:17.194 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:16 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:16.908+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:17.935 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:17.573+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:43.440407+0000 front 2024-03-12T16:41:43.440435+0000 (oldest deadline 2024-03-12T16:42:09.340265+0000) 2024-03-12T16:42:17.936 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4[105228]: 2024-03-12T16:42:17.573+0000 7f43a79bb700 -1 osd.4 85 heartbeat_check: no reply from 172.21.15.6:6814 osd.1 since back 2024-03-12T16:41:50.341194+0000 front 2024-03-12T16:41:50.341213+0000 (oldest deadline 2024-03-12T16:42:16.241228+0000) 2024-03-12T16:42:18.194 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:17 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:17.942+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:19.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:18 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:18.895+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:19.695 INFO:journalctl@ceph.osd.4.smithi134.stdout:Mar 12 16:42:19 smithi134 bash[129979]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-4 2024-03-12T16:42:20.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:19 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:19.870+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:21.055 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:20.838+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:21.056 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:20 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:20.838+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6814 osd.1 since back 2024-03-12T16:41:54.889648+0000 front 2024-03-12T16:41:54.889635+0000 (oldest deadline 2024-03-12T16:42:20.189558+0000) 2024-03-12T16:42:21.064 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.4.service' 2024-03-12T16:42:21.108 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-12T16:42:21.108 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-03-12T16:42:21.108 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-03-12T16:42:21.108 DEBUG:teuthology.orchestra.run.smithi134:> sudo systemctl stop ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.5 2024-03-12T16:42:21.412 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:21 smithi134 systemd[1]: Stopping Ceph osd.5 for 88d7ee42-e089-11ee-95c8-87774f69a715... 2024-03-12T16:42:21.694 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:21.418+0000 7f3c0bde8700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-03-12T16:42:21.695 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:21.418+0000 7f3c0bde8700 -1 osd.5 85 *** Got signal Terminated *** 2024-03-12T16:42:21.695 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:21.418+0000 7f3c0bde8700 -1 osd.5 85 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-03-12T16:42:22.194 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:21.806+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:22.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:21 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:21.806+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6814 osd.1 since back 2024-03-12T16:41:54.889648+0000 front 2024-03-12T16:41:54.889635+0000 (oldest deadline 2024-03-12T16:42:20.189558+0000) 2024-03-12T16:42:23.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:22 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:22.852+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:23.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:22 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:22.852+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6814 osd.1 since back 2024-03-12T16:41:54.889648+0000 front 2024-03-12T16:41:54.889635+0000 (oldest deadline 2024-03-12T16:42:20.189558+0000) 2024-03-12T16:42:24.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:23.901+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:24.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:23 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:23.901+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6814 osd.1 since back 2024-03-12T16:41:54.889648+0000 front 2024-03-12T16:41:54.889635+0000 (oldest deadline 2024-03-12T16:42:20.189558+0000) 2024-03-12T16:42:25.194 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:24.898+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:25.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:24.898+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6814 osd.1 since back 2024-03-12T16:41:54.889648+0000 front 2024-03-12T16:41:54.889635+0000 (oldest deadline 2024-03-12T16:42:20.189558+0000) 2024-03-12T16:42:25.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:24 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:24.898+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6822 osd.2 since back 2024-03-12T16:42:00.190047+0000 front 2024-03-12T16:42:00.189992+0000 (oldest deadline 2024-03-12T16:42:24.889948+0000) 2024-03-12T16:42:26.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:25.936+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6806 osd.0 since back 2024-03-12T16:41:44.587317+0000 front 2024-03-12T16:41:44.587427+0000 (oldest deadline 2024-03-12T16:42:09.887304+0000) 2024-03-12T16:42:26.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:25.936+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6814 osd.1 since back 2024-03-12T16:41:54.889648+0000 front 2024-03-12T16:41:54.889635+0000 (oldest deadline 2024-03-12T16:42:20.189558+0000) 2024-03-12T16:42:26.195 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:25 smithi134 ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5[112262]: 2024-03-12T16:42:25.936+0000 7f3c06bdb700 -1 osd.5 85 heartbeat_check: no reply from 172.21.15.6:6822 osd.2 since back 2024-03-12T16:42:00.190047+0000 front 2024-03-12T16:42:00.189992+0000 (oldest deadline 2024-03-12T16:42:24.889948+0000) 2024-03-12T16:42:27.694 INFO:journalctl@ceph.osd.5.smithi134.stdout:Mar 12 16:42:27 smithi134 bash[130249]: ceph-88d7ee42-e089-11ee-95c8-87774f69a715-osd-5 2024-03-12T16:42:29.048 DEBUG:teuthology.orchestra.run.smithi134:> sudo pkill -f 'journalctl -f -n 0 -u ceph-88d7ee42-e089-11ee-95c8-87774f69a715@osd.5.service' 2024-03-12T16:42:29.090 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-03-12T16:42:29.090 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-03-12T16:42:29.090 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 --force --keep-logs 2024-03-12T16:42:34.233 INFO:tasks.cephfs.fuse_mount.ceph-fuse.0.smithi006.stderr:ceph-fuse[78410]: fuse finished with error 0 and tester_r 0 2024-03-12T16:42:49.955 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 --force --keep-logs 2024-03-12T16:43:04.577 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-12T16:43:04.616 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-03-12T16:43:04.647 INFO:tasks.cephadm:Archiving crash dumps... 2024-03-12T16:43:04.650 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640/remote/smithi006/crash 2024-03-12T16:43:04.651 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/crash -- . 2024-03-12T16:43:04.688 INFO:teuthology.orchestra.run.smithi006.stderr:tar: /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/crash: Cannot open: No such file or directory 2024-03-12T16:43:04.688 INFO:teuthology.orchestra.run.smithi006.stderr:tar: Error is not recoverable: exiting now 2024-03-12T16:43:04.689 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/crash to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640/remote/smithi134/crash 2024-03-12T16:43:04.690 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/crash -- . 2024-03-12T16:43:04.717 INFO:teuthology.orchestra.run.smithi134.stderr:tar: /var/lib/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/crash: Cannot open: No such file or directory 2024-03-12T16:43:04.717 INFO:teuthology.orchestra.run.smithi134.stderr:tar: Error is not recoverable: exiting now 2024-03-12T16:43:04.718 INFO:tasks.cephadm:Checking cluster log for badness... 2024-03-12T16:43:04.719 DEBUG:teuthology.orchestra.run.smithi006:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v FS_DEGRADED | egrep -v FS_INLINE_DATA_DEPRECATED | egrep -v FS_WITH_FAILED_MDS | egrep -v MDS_ALL_DOWN | egrep -v MDS_DAMAGE | egrep -v MDS_DEGRADED | egrep -v MDS_FAILED | egrep -v MDS_INSUFFICIENT_STANDBY | egrep -v MDS_UP_LESS_THAN_MAX | egrep -v POOL_APP_NOT_ENABLED | egrep -v 'overall HEALTH_' | egrep -v 'Replacing daemon' | egrep -v OSD_DOWN | egrep -v 'overall HEALTH_' | egrep -v '\(OSD_DOWN\)' | egrep -v '\(OSD_' | egrep -v 'but it is still running' | egrep -v 'is not responding' | head -n 1 2024-03-12T16:43:04.764 INFO:teuthology.orchestra.run.smithi006.stderr:grep: /var/log/ceph/88d7ee42-e089-11ee-95c8-87774f69a715/ceph.log: No such file or directory 2024-03-12T16:43:04.767 INFO:tasks.cephadm:Compressing logs... 2024-03-12T16:43:04.767 DEBUG:teuthology.orchestra.run.smithi006:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-12T16:43:04.809 DEBUG:teuthology.orchestra.run.smithi134:> sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-12T16:43:04.837 INFO:teuthology.orchestra.run.smithi134.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-03-12T16:43:04.837 INFO:teuthology.orchestra.run.smithi006.stderr:find: ‘/var/log/rbd-target-api’: No such file or directory 2024-03-12T16:44:24.816 INFO:teuthology.orchestra.run.smithi134.stderr:gzip: /var/log/ceph/ceph-client.1.log: file size changed while zipping 2024-03-12T16:44:55.054 INFO:tasks.cephadm:Archiving logs... 2024-03-12T16:44:55.056 DEBUG:teuthology.misc:Transferring archived files from smithi006:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640/remote/smithi006/log 2024-03-12T16:44:55.057 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-12T16:45:07.393 DEBUG:teuthology.misc:Transferring archived files from smithi134:/var/log/ceph to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640/remote/smithi134/log 2024-03-12T16:45:07.394 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /var/log/ceph -- . 2024-03-12T16:45:16.976 INFO:tasks.cephadm:Removing cluster... 2024-03-12T16:45:16.977 DEBUG:teuthology.orchestra.run.smithi006:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 --force 2024-03-12T16:45:17.543 DEBUG:teuthology.orchestra.run.smithi134:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 88d7ee42-e089-11ee-95c8-87774f69a715 --force 2024-03-12T16:45:18.056 INFO:tasks.cephadm:Removing cephadm ... 2024-03-12T16:45:18.056 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-12T16:45:18.078 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf /home/ubuntu/cephtest/cephadm 2024-03-12T16:45:18.096 INFO:tasks.cephadm:Teardown complete 2024-03-12T16:45:18.097 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-03-12T16:45:18.111 ERROR:teuthology.contextutil:Saw exception from nested tasks Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 32, in nested yield vars File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/install/__init__.py", line 626, in task yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-03-12T16:45:18.112 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-03-12T16:45:18.113 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-12T16:45:18.120 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-03-12T16:45:18.213 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-03-12T16:45:18.224 INFO:teuthology.task.clock:Checking final clock skew... 2024-03-12T16:45:18.224 DEBUG:teuthology.orchestra.run.smithi006:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-12T16:45:18.227 DEBUG:teuthology.orchestra.run.smithi134:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-03-12T16:45:18.243 INFO:teuthology.orchestra.run.smithi134.stderr:bash: ntpq: command not found 2024-03-12T16:45:18.244 INFO:teuthology.orchestra.run.smithi006.stderr:bash: ntpq: command not found 2024-03-12T16:45:18.247 INFO:teuthology.orchestra.run.smithi134.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-12T16:45:18.247 INFO:teuthology.orchestra.run.smithi134.stdout:=============================================================================== 2024-03-12T16:45:18.247 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv01.front.sepia.ceph.com 2 6 377 22 +3464us[+3464us] +/- 105ms 2024-03-12T16:45:18.248 INFO:teuthology.orchestra.run.smithi134.stdout:^* hv02.front.sepia.ceph.com 3 7 377 23 -1659us[-1503us] +/- 80ms 2024-03-12T16:45:18.248 INFO:teuthology.orchestra.run.smithi134.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 23 -469us[ -469us] +/- 78ms 2024-03-12T16:45:18.248 INFO:teuthology.orchestra.run.smithi134.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T16:45:18.249 INFO:teuthology.orchestra.run.smithi006.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-03-12T16:45:18.249 INFO:teuthology.orchestra.run.smithi006.stdout:=============================================================================== 2024-03-12T16:45:18.249 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv01.front.sepia.ceph.com 2 7 377 23 +3423us[+3424us] +/- 105ms 2024-03-12T16:45:18.249 INFO:teuthology.orchestra.run.smithi006.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 24 -1768us[-1770us] +/- 80ms 2024-03-12T16:45:18.249 INFO:teuthology.orchestra.run.smithi006.stdout:^* hv03.front.sepia.ceph.com 3 6 377 19 -550us[ -549us] +/- 78ms 2024-03-12T16:45:18.249 INFO:teuthology.orchestra.run.smithi006.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-03-12T16:45:18.250 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-03-12T16:45:18.262 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-03-12T16:45:18.263 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-03-12T16:45:18.274 DEBUG:teuthology.orchestra.run.smithi006:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-12T16:45:18.366 DEBUG:teuthology.orchestra.run.smithi134:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-03-12T16:45:18.433 DEBUG:teuthology.orchestra.run.smithi006:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-12T16:45:18.468 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T16:45:18.469 DEBUG:teuthology.orchestra.run.smithi134:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-03-12T16:45:18.499 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T16:45:18.499 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-03-12T16:45:18.512 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-03-12T16:45:18.523 INFO:teuthology.task.internal:Duration was 3432.785671 seconds 2024-03-12T16:45:18.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-03-12T16:45:18.535 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-03-12T16:45:18.536 DEBUG:teuthology.orchestra.run.smithi006:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-12T16:45:18.538 DEBUG:teuthology.orchestra.run.smithi134:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-03-12T16:45:18.585 INFO:teuthology.orchestra.run.smithi006.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-12T16:45:18.585 INFO:teuthology.orchestra.run.smithi134.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-03-12T16:45:18.959 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-03-12T16:45:18.959 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi006.front.sepia.ceph.com 2024-03-12T16:45:18.959 DEBUG:teuthology.orchestra.run.smithi006:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-12T16:45:18.983 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi134.front.sepia.ceph.com 2024-03-12T16:45:18.983 DEBUG:teuthology.orchestra.run.smithi134:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-03-12T16:45:19.007 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-03-12T16:45:19.007 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-12T16:45:19.026 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-03-12T16:45:19.108 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-03-12T16:45:19.108 DEBUG:teuthology.orchestra.run.smithi006:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-12T16:45:19.110 DEBUG:teuthology.orchestra.run.smithi134:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-03-12T16:45:19.281 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-03-12T16:45:19.296 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-03-12T16:45:19.296 DEBUG:teuthology.orchestra.run.smithi006:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-12T16:45:19.325 DEBUG:teuthology.orchestra.run.smithi134:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-03-12T16:45:19.353 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-03-12T16:45:19.366 DEBUG:teuthology.orchestra.run.smithi006:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-12T16:45:19.368 DEBUG:teuthology.orchestra.run.smithi134:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-03-12T16:45:19.393 INFO:teuthology.orchestra.run.smithi006.stdout:kernel.core_pattern = core 2024-03-12T16:45:19.420 INFO:teuthology.orchestra.run.smithi134.stdout:kernel.core_pattern = core 2024-03-12T16:45:19.444 DEBUG:teuthology.orchestra.run.smithi006:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-12T16:45:19.470 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T16:45:19.470 DEBUG:teuthology.orchestra.run.smithi134:> test -e /home/ubuntu/cephtest/archive/coredump 2024-03-12T16:45:19.501 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T16:45:19.502 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-03-12T16:45:19.517 INFO:teuthology.task.internal:Transferring archived files... 2024-03-12T16:45:19.518 DEBUG:teuthology.misc:Transferring archived files from smithi006:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640/remote/smithi006 2024-03-12T16:45:19.519 DEBUG:teuthology.orchestra.run.smithi006:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-12T16:45:19.565 DEBUG:teuthology.misc:Transferring archived files from smithi134:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640/remote/smithi134 2024-03-12T16:45:19.565 DEBUG:teuthology.orchestra.run.smithi134:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-03-12T16:45:19.611 INFO:teuthology.task.internal:Removing archive directory... 2024-03-12T16:45:19.611 DEBUG:teuthology.orchestra.run.smithi006:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-12T16:45:19.614 DEBUG:teuthology.orchestra.run.smithi134:> rm -rf -- /home/ubuntu/cephtest/archive 2024-03-12T16:45:19.662 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-03-12T16:45:19.677 INFO:teuthology.task.internal:Not uploading archives. 2024-03-12T16:45:19.678 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-03-12T16:45:19.692 INFO:teuthology.task.internal:Tidying up after the test... 2024-03-12T16:45:19.692 DEBUG:teuthology.orchestra.run.smithi006:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-12T16:45:19.694 DEBUG:teuthology.orchestra.run.smithi134:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-03-12T16:45:19.710 INFO:teuthology.orchestra.run.smithi006.stdout: 393224 4 drwxr-xr-x 3 ubuntu ubuntu 4096 Mar 12 16:45 /home/ubuntu/cephtest 2024-03-12T16:45:19.711 INFO:teuthology.orchestra.run.smithi006.stdout: 395751 4 d--------- 2 ubuntu ubuntu 4096 Mar 12 16:07 /home/ubuntu/cephtest/mnt.0 2024-03-12T16:45:19.711 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-03-12T16:45:19.712 INFO:teuthology.orchestra.run.smithi006.stderr:find: ‘/home/ubuntu/cephtest/mnt.0’: Permission denied 2024-03-12T16:45:19.712 INFO:teuthology.orchestra.run.smithi006.stderr:rmdir: failed to remove '/home/ubuntu/cephtest': Directory not empty 2024-03-12T16:45:19.712 ERROR:teuthology.run_tasks:Manager failed: internal.base Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 48, in base yield File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 120, in __exit__ next(self.gen) File "/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks/ceph_fuse.py", line 183, in task mount.umount_wait() File "/home/teuthworker/src/github.com_ceph_ceph-c_49e4a6794d5502bd66908faf714fc54896c51712/qa/tasks/cephfs/fuse_mount.py", line 400, in umount_wait run.wait([self.fuse_daemon], timeout) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 473, in wait check_time() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/contextutil.py", line 134, in __call__ raise MaxWhileTries(error_msg) teuthology.exceptions.MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds During handling of the above exception, another exception occurred: Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/run_tasks.py", line 154, in run_tasks suppress = manager.__exit__(*exc_info) File "/usr/lib/python3.8/contextlib.py", line 131, in __exit__ self.gen.throw(type, value, traceback) File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/task/internal/__init__.py", line 53, in base run.wait( File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 479, in wait proc.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e691533f9cbb33d85b2187bba20d7102f098636d/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi006 with status 1: 'find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest' 2024-03-12T16:45:19.713 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-03-12T16:45:19.728 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-03-12T16:45:19.743 DEBUG:teuthology.run_tasks:Exception was not quenched, exiting: MaxWhileTries: reached maximum tries (51) after waiting for 300 seconds 2024-03-12T16:45:19.743 INFO:teuthology.nuke:Checking targets against current locks 2024-03-12T16:45:19.770 DEBUG:teuthology.nuke:shortname: smithi006 2024-03-12T16:45:19.770 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-12T16:45:19.794 DEBUG:teuthology.nuke:shortname: smithi134 2024-03-12T16:45:19.794 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-03-12T16:45:19.798 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi006.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-12 15:36:08.609279', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBP/8geieGzvcccyabxwJDW1GF/3Yi6gLib589imOauAjgMjGkbfLx2Z1AxkRt717Ov7EmcixmeHXI3aN5cn6tlo='} 2024-03-12T16:45:19.823 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi134.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuriw-2024-03-12_14:59:27-fs-wip-yuri11-testing-2024-03-11-0838-reef-distro-default-smithi/7593640', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '8', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-03-12 15:36:08.611131', 'locked_by': 'scheduled_yuriw@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBCKv+ws9DevildNnkJO/shSslHwTUggX9SVna4RVVaWEEsjNJzuneJ8TscB9BBDbeZaqDzt8GUb9V/0andMGjr4='} 2024-03-12T16:45:19.848 INFO:teuthology.orchestra.console.smithi006:Power off 2024-03-12T16:45:19.849 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-12T16:45:19.877 DEBUG:teuthology.orchestra.console.smithi006:power off output: Chassis Power Control: Down/Off 2024-03-12T16:45:19.877 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T16:45:19.896 INFO:teuthology.orchestra.console.smithi134:Power off 2024-03-12T16:45:19.896 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power off 2024-03-12T16:45:19.905 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-03-12T16:45:19.919 DEBUG:teuthology.orchestra.console.smithi134:power off output: Chassis Power Control: Down/Off 2024-03-12T16:45:19.919 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T16:45:19.943 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-03-12T16:45:23.906 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T16:45:23.944 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T16:45:24.017 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is on 2024-03-12T16:45:24.056 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is on 2024-03-12T16:45:28.022 DEBUG:teuthology.orchestra.console.smithi006:pexpect command: ipmitool -H smithi006.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T16:45:28.057 DEBUG:teuthology.orchestra.console.smithi134:pexpect command: ipmitool -H smithi134.ipmi.sepia.ceph.com -I lanplus -U inktank -P ApGNXcA7 power status 2024-03-12T16:45:28.134 DEBUG:teuthology.orchestra.console.smithi006:check power output: Chassis Power is off 2024-03-12T16:45:28.169 DEBUG:teuthology.orchestra.console.smithi134:check power output: Chassis Power is off 2024-03-12T16:45:28.234 INFO:teuthology.orchestra.console.smithi006:Power off completed 2024-03-12T16:45:28.270 INFO:teuthology.orchestra.console.smithi134:Power off completed 2024-03-12T16:45:28.375 INFO:teuthology.run:Summary data: description: fs/upgrade/mds_upgrade_sequence/{bluestore-bitmap centos_8.stream_container_tools conf/{client mds mon osd} fail_fs/yes overrides/{ignorelist_health ignorelist_upgrade ignorelist_wrongly_marked_down pg-warn syntax} roles tasks/{0-from/pacific 1-volume/{0-create 1-ranks/2 2-allow_standby_replay/no 3-inline/no 4-verify} 2-client/fuse 3-upgrade-mgr-staggered 4-config-upgrade/{fail_fs} 5-upgrade-with-workload 6-verify}} duration: 3432.785670518875 failure_reason: reached maximum tries (51) after waiting for 300 seconds flavor: default owner: scheduled_yuriw@teuthology status: fail success: false 2024-03-12T16:45:28.375 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-03-12T16:45:28.462 INFO:teuthology.run:FAIL